2023-12-11T19:42:41.544 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-11T19:42:41.544 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249 --owner scheduled_rishabh@teuthology --name rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi --verbose --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/orig.config.yaml 2023-12-11T19:42:41.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T19:42:41.681 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249 branch: rishabh-2023dec11 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} email: null first_in_suite: false job_id: '7487249' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023dec11 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request - SLOW_OPS - slow request sha1: a62fda73efba5520d409bb5a21bd8373289dda5d subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: a62fda73efba5520d409bb5a21bd8373289dda5d kclient: client.0: mount_subvol_num: 1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023dec11 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5791 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d sleep_before_teardown: 0 subset: 209/512 suite: fs suite_branch: rishabh-2023dec11 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a62fda73efba5520d409bb5a21bd8373289dda5d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-11_15:37:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-11T19:42:41.681 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa; will attempt to use it 2023-12-11T19:42:41.682 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks 2023-12-11T19:42:41.682 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-11T19:42:41.684 INFO:teuthology.task.internal:Checking packages... 2023-12-11T19:42:41.707 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a62fda73efba5520d409bb5a21bd8373289dda5d' 2023-12-11T19:42:41.707 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-11T19:42:41.707 INFO:teuthology.packaging:ref: None 2023-12-11T19:42:41.707 INFO:teuthology.packaging:tag: None 2023-12-11T19:42:41.708 INFO:teuthology.packaging:branch: rishabh-2023dec11 2023-12-11T19:42:41.708 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T19:42:41.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023dec11 2023-12-11T19:42:41.848 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-119.ga62fda73 2023-12-11T19:42:41.849 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-11T19:42:41.856 INFO:teuthology.task.internal:no buildpackages task found 2023-12-11T19:42:41.857 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-11T19:42:41.865 INFO:teuthology.task.internal:Saving configuration 2023-12-11T19:42:41.885 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-11T19:42:41.893 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T19:42:41.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:36:36.161215', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T19:42:41.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:36:36.157134', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T19:42:41.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:36:36.158923', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T19:42:41.966 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-11T19:42:41.974 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-12-11T19:42:41.974 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-12-11T19:42:41.974 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-12-11T19:42:41.974 INFO:teuthology.run_tasks:Running task console_log... 2023-12-11T19:42:42.088 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d2a630dc0>, signals=[15]) 2023-12-11T19:42:42.088 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-11T19:42:42.095 INFO:teuthology.task.internal:Opening connections... 2023-12-11T19:42:42.095 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2023-12-11T19:42:42.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:42:42.167 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2023-12-11T19:42:42.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:42:42.235 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2023-12-11T19:42:42.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:42:42.304 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-11T19:42:42.311 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-12-11T19:42:42.333 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-12-11T19:42:42.333 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:ID="rhel" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="fedora" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8.6" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:42:42.393 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:42:42.394 INFO:teuthology.orchestra.run.smithi012.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:42:42.394 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:42:42.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T19:42:42.394 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:42:42.394 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:42:42.394 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:42:42.394 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:42:42.395 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-12-11T19:42:42.419 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-12-11T19:42:42.440 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-12-11T19:42:42.440 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:42:42.500 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:42:42.501 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T19:42:42.501 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:42:42.501 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:42:42.501 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:42:42.501 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:42:42.501 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-12-11T19:42:42.519 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2023-12-11T19:42:42.541 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-12-11T19:42:42.541 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.6" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T19:42:42.601 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T19:42:42.602 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T19:42:42.602 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T19:42:42.602 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T19:42:42.602 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T19:42:42.602 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T19:42:42.602 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-12-11T19:42:42.627 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-11T19:42:42.638 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-11T19:42:42.650 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-11T19:42:42.650 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2023-12-11T19:42:42.653 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2023-12-11T19:42:42.655 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2023-12-11T19:42:42.674 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-11T19:42:42.684 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-11T19:42:42.684 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2023-12-11T19:42:42.712 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2023-12-11T19:42:42.715 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2023-12-11T19:42:42.749 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-11T19:42:42.829 INFO:teuthology.run_tasks:Running task kernel... 2023-12-11T19:42:42.848 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-11T19:42:42.848 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-11T19:42:42.849 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-11T19:42:42.849 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-11T19:42:42.850 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-11T19:42:42.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T19:42:42.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T19:42:42.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T19:42:42.871 DEBUG:teuthology.task.kernel:sha1 for mon.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:42.871 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-11T19:42:42.871 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-12-11T19:42:42.871 DEBUG:teuthology.task.kernel:sha1 for mon.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:42.872 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-11T19:42:42.872 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2023-12-11T19:42:42.872 DEBUG:teuthology.task.kernel:sha1 for mon.c is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:42.872 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-11T19:42:42.872 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2023-12-11T19:42:42.931 INFO:teuthology.orchestra.run.smithi039.stdout:4.18.0-372.9.1.el8.x86_64 2023-12-11T19:42:42.931 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:42.931 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-11T19:42:42.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:42.937 INFO:teuthology.orchestra.run.smithi012.stdout:4.18.0-372.9.1.el8.x86_64 2023-12-11T19:42:42.937 INFO:teuthology.orchestra.run.smithi032.stdout:4.18.0-372.9.1.el8.x86_64 2023-12-11T19:42:42.937 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:42.937 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-11T19:42:42.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:42.939 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:42.939 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-11T19:42:42.939 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:43.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum upgrade -y linux-firmware 2023-12-11T19:42:43.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum upgrade -y linux-firmware 2023-12-11T19:42:43.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum upgrade -y linux-firmware 2023-12-11T19:42:44.280 INFO:teuthology.orchestra.run.smithi039.stdout:Updating Subscription Management repositories. 2023-12-11T19:42:44.281 INFO:teuthology.orchestra.run.smithi039.stdout:Unable to read consumer identity 2023-12-11T19:42:44.344 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-12-11T19:42:44.344 INFO:teuthology.orchestra.run.smithi032.stdout:Unable to read consumer identity 2023-12-11T19:42:44.429 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-12-11T19:42:44.429 INFO:teuthology.orchestra.run.smithi012.stdout:Unable to read consumer identity 2023-12-11T19:42:45.761 INFO:teuthology.orchestra.run.smithi039.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-12-11T19:42:45.821 INFO:teuthology.orchestra.run.smithi032.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-12-11T19:42:45.911 INFO:teuthology.orchestra.run.smithi012.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-12-11T19:42:46.470 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-12-11T19:42:46.705 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-12-11T19:42:47.436 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-11T19:42:50.203 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 601 kB/s | 24 kB 00:00 2023-12-11T19:42:50.430 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 550 kB/s | 24 kB 00:00 2023-12-11T19:42:50.975 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2023-12-11T19:42:50.976 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2023-12-11T19:42:50.976 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2023-12-11T19:42:51.112 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.c... 2023-12-11T19:42:51.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:51.169 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 430 kB/s | 24 kB 00:00 2023-12-11T19:42:51.180 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-12-11T19:42:51.182 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2023-12-11T19:42:51.182 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-12-11T19:42:51.257 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-11T19:42:51.258 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-11T19:42:51.260 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi039.front.sepia.ceph.com to complete... 2023-12-11T19:42:51.299 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-11T19:42:51.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:51.442 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-11T19:42:51.442 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-11T19:42:51.444 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi032.front.sepia.ceph.com to complete... 2023-12-11T19:42:51.938 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-12-11T19:42:51.939 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2023-12-11T19:42:51.940 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-12-11T19:42:52.079 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-11T19:42:52.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T19:42:52.351 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-11T19:42:52.352 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-11T19:42:52.354 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi012.front.sepia.ceph.com to complete... 2023-12-11T19:43:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11 19:43:21 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-11T19:43:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:FINISHED --2023-12-11 19:43:21-- 2023-12-11T19:43:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:Total wall clock time: 29s 2023-12-11T19:43:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:Downloaded: 1 files, 365M in 29s (12.8 MB/s) 2023-12-11T19:43:21.469 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-11T19:43:21.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-11T19:43:23.427 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying... ######################################## 2023-12-11T19:43:23.549 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing... ######################################## 2023-12-11T19:43:23.738 INFO:teuthology.orchestra.run.smithi012.stdout:Updating / installing... 2023-12-11T19:43:28.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11 19:43:28 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-11T19:43:28.383 INFO:teuthology.orchestra.run.smithi032.stderr:FINISHED --2023-12-11 19:43:28-- 2023-12-11T19:43:28.383 INFO:teuthology.orchestra.run.smithi032.stderr:Total wall clock time: 37s 2023-12-11T19:43:28.383 INFO:teuthology.orchestra.run.smithi032.stderr:Downloaded: 1 files, 365M in 37s (9.96 MB/s) 2023-12-11T19:43:28.386 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-11T19:43:28.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-11T19:43:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying... ######################################## 2023-12-11T19:43:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing... ######################################## 2023-12-11T19:43:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:Updating / installing... 2023-12-11T19:43:39.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11 19:43:39 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-11T19:43:39.592 INFO:teuthology.orchestra.run.smithi039.stderr:FINISHED --2023-12-11 19:43:39-- 2023-12-11T19:43:39.592 INFO:teuthology.orchestra.run.smithi039.stderr:Total wall clock time: 48s 2023-12-11T19:43:39.592 INFO:teuthology.orchestra.run.smithi039.stderr:Downloaded: 1 files, 365M in 48s (7.61 MB/s) 2023-12-11T19:43:39.595 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.c... 2023-12-11T19:43:39.595 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-11T19:43:41.266 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying... ######################################## 2023-12-11T19:43:41.347 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing... ######################################## 2023-12-11T19:43:41.435 INFO:teuthology.orchestra.run.smithi039.stdout:Updating / installing... 2023-12-11T19:44:04.496 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-11T19:44:06.077 INFO:teuthology.orchestra.run.smithi012.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-11T19:44:11.050 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-11T19:44:12.701 INFO:teuthology.orchestra.run.smithi032.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-11T19:44:22.368 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-11T19:44:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-11T19:44:29.390 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-11T19:44:29.391 DEBUG:teuthology.orchestra.run.smithi012:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-11T19:44:29.457 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.457 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-11T19:44:29.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-11T19:44:29.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-11T19:44:29.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-11T19:44:29.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-11T19:44:29.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-11T19:44:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-11T19:44:29.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-11T19:44:29.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-11T19:44:29.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-11T19:44:29.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-11T19:44:29.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-11T19:44:29.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-11T19:44:29.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-11T19:44:29.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-11T19:44:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-11T19:44:29.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-11T19:44:29.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-11T19:44:29.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-11T19:44:29.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-11T19:44:29.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-11T19:44:29.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-11T19:44:29.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-11T19:44:29.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-11T19:44:29.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-11T19:44:29.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-11T19:44:29.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-11T19:44:29.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-11T19:44:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-11T19:44:29.486 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-11T19:44:29.487 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-11T19:44:29.487 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-11T19:44:29.487 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-11T19:44:29.487 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-11T19:44:29.487 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-11T19:44:29.487 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-11T19:44:29.487 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-11T19:44:29.487 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-11T19:44:29.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-11T19:44:29.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-11T19:44:29.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-11T19:44:29.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-11T19:44:29.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-11T19:44:29.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-11T19:44:29.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-11T19:44:29.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-11T19:44:29.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-11T19:44:29.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-11T19:44:29.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-11T19:44:29.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-11T19:44:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-11T19:44:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-11T19:44:29.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-11T19:44:29.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-11T19:44:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-11T19:44:29.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-11T19:44:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-11T19:44:29.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-11T19:44:29.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-11T19:44:29.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-11T19:44:29.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-11T19:44:29.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-11T19:44:29.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-11T19:44:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-11T19:44:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-11T19:44:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-11T19:44:29.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-11T19:44:29.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-11T19:44:29.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-11T19:44:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-11T19:44:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-11T19:44:29.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-11T19:44:29.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-11T19:44:29.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-11T19:44:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-11T19:44:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-11T19:44:29.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-11T19:44:29.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-11T19:44:29.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-11T19:44:29.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-11T19:44:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-11T19:44:29.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-11T19:44:29.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-11T19:44:29.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-11T19:44:29.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-11T19:44:29.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-11T19:44:29.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-11T19:44:29.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-11T19:44:29.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-11T19:44:29.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-11T19:44:29.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-11T19:44:29.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-11T19:44:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-11T19:44:29.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-11T19:44:29.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-11T19:44:29.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-11T19:44:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-11T19:44:29.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-11T19:44:29.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-11T19:44:29.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-11T19:44:29.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-11T19:44:29.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-11T19:44:29.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-11T19:44:29.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-11T19:44:29.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-11T19:44:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-11T19:44:29.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-11T19:44:29.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-11T19:44:29.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-11T19:44:29.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-11T19:44:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-11T19:44:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-11T19:44:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-11T19:44:29.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-11T19:44:29.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-11T19:44:29.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-11T19:44:29.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-11T19:44:29.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-11T19:44:29.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-11T19:44:29.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-11T19:44:29.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-11T19:44:29.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-11T19:44:29.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-11T19:44:29.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-11T19:44:29.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-11T19:44:29.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-11T19:44:29.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-11T19:44:29.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-11T19:44:29.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-11T19:44:29.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-11T19:44:29.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-11T19:44:29.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-11T19:44:29.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-11T19:44:29.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-11T19:44:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-11T19:44:29.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-11T19:44:29.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-11T19:44:29.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-11T19:44:29.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-11T19:44:29.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-11T19:44:29.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-11T19:44:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-11T19:44:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-11T19:44:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-11T19:44:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-11T19:44:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-11T19:44:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-11T19:44:29.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-11T19:44:29.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-11T19:44:29.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-11T19:44:29.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-11T19:44:29.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-11T19:44:29.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-11T19:44:29.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-11T19:44:29.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-11T19:44:29.599 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.599 DEBUG:teuthology.orchestra.run.smithi012:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-11T19:44:29.624 INFO:teuthology.orchestra.run.smithi012.stdout:postinstall scriptlet (using /bin/sh): 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-11T19:44:29.625 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.626 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-12-11T19:44:29.626 INFO:teuthology.orchestra.run.smithi012.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-11T19:44:29.626 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-11T19:44:29.626 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.626 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-12-11T19:44:29.627 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2023-12-11T19:44:29.703 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2023-12-11T19:44:29.703 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.02 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 123.el8 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Group : System Environment/Base 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 9265450 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Relocations : (not relocatable) 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : Red Hat, Inc. 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : Red Hat, Inc. 2023-12-11T19:44:29.704 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T19:44:29.705 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2023-12-11T19:44:29.706 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-11T19:44:29.706 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 6.6.0-gcd68252d7b4d 2023-12-11T19:44:29.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-11T19:44:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2023-12-11T19:44:34.740 INFO:teuthology.orchestra.run.smithi012.stderr:done 2023-12-11T19:44:34.742 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-12-11T19:44:34.768 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.cMYG1NTuYs 2023-12-11T19:44:34.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cMYG1NTuYs 2023-12-11T19:44:34.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.cMYG1NTuYs 2023-12-11T19:44:34.907 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-11T19:44:34.907 DEBUG:teuthology.orchestra.run.smithi032:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-11T19:44:34.963 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T19:44:34.963 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-11T19:44:34.963 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-11T19:44:34.963 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-11T19:44:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-11T19:44:34.965 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-11T19:44:34.966 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-11T19:44:34.967 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-11T19:44:34.968 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-11T19:44:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-11T19:44:34.970 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-11T19:44:34.971 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-11T19:44:34.972 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-11T19:44:34.973 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-11T19:44:34.974 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-11T19:44:34.975 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-11T19:44:34.976 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-11T19:44:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-11T19:44:34.978 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-11T19:44:34.979 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-11T19:44:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-11T19:44:34.981 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-11T19:44:34.982 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-11T19:44:34.983 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-11T19:44:34.984 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-11T19:44:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-11T19:44:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-11T19:44:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-11T19:44:34.988 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-11T19:44:34.989 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-11T19:44:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-11T19:44:34.991 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-11T19:44:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-11T19:44:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-11T19:44:34.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-11T19:44:34.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-11T19:44:34.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-11T19:44:34.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-11T19:44:34.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-11T19:44:34.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-11T19:44:35.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-11T19:44:35.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-11T19:44:35.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-11T19:44:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-11T19:44:35.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-11T19:44:35.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-11T19:44:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-11T19:44:35.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-11T19:44:35.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-11T19:44:35.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-11T19:44:35.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-11T19:44:35.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-11T19:44:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-11T19:44:35.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-11T19:44:35.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-11T19:44:35.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-11T19:44:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-11T19:44:35.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-11T19:44:35.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-11T19:44:35.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-11T19:44:35.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-11T19:44:35.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-11T19:44:35.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-11T19:44:35.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-11T19:44:35.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-11T19:44:35.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-11T19:44:35.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-11T19:44:35.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-11T19:44:35.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-11T19:44:35.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-11T19:44:35.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-11T19:44:35.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-11T19:44:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-11T19:44:35.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-11T19:44:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-11T19:44:35.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-11T19:44:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-11T19:44:35.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-11T19:44:35.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-11T19:44:35.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-11T19:44:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-11T19:44:35.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-11T19:44:35.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-11T19:44:35.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-11T19:44:35.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-11T19:44:35.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-11T19:44:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-11T19:44:35.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-11T19:44:35.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-11T19:44:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-11T19:44:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-11T19:44:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-11T19:44:35.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-11T19:44:35.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-11T19:44:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-11T19:44:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-11T19:44:35.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-11T19:44:35.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-11T19:44:35.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-11T19:44:35.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-11T19:44:35.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-11T19:44:35.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-11T19:44:35.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-11T19:44:35.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-11T19:44:35.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-11T19:44:35.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-11T19:44:35.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-11T19:44:35.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-11T19:44:35.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-11T19:44:35.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-11T19:44:35.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-11T19:44:35.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-11T19:44:35.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-11T19:44:35.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-11T19:44:35.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-11T19:44:35.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-11T19:44:35.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-11T19:44:35.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-11T19:44:35.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-11T19:44:35.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-11T19:44:35.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-11T19:44:35.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-11T19:44:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-11T19:44:35.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-11T19:44:35.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-11T19:44:35.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-11T19:44:35.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-11T19:44:35.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-11T19:44:35.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-11T19:44:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-11T19:44:35.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-11T19:44:35.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-11T19:44:35.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-11T19:44:35.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-11T19:44:35.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-11T19:44:35.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-11T19:44:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-11T19:44:35.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-11T19:44:35.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-11T19:44:35.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-11T19:44:35.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-11T19:44:35.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-11T19:44:35.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-11T19:44:35.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-11T19:44:35.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-11T19:44:35.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-11T19:44:35.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-11T19:44:35.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-11T19:44:35.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-11T19:44:35.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-11T19:44:35.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-11T19:44:35.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-11T19:44:35.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-11T19:44:35.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-11T19:44:35.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-11T19:44:35.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-11T19:44:35.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-11T19:44:35.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-11T19:44:35.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-11T19:44:35.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-11T19:44:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-11T19:44:35.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-11T19:44:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-11T19:44:35.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-11T19:44:35.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-11T19:44:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-11T19:44:35.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-11T19:44:35.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-11T19:44:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-11T19:44:35.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-11T19:44:35.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-11T19:44:35.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-11T19:44:35.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-11T19:44:35.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-11T19:44:35.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-11T19:44:35.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-11T19:44:35.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-11T19:44:35.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-11T19:44:35.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-11T19:44:35.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-11T19:44:35.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-11T19:44:35.104 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-11T19:44:35.105 DEBUG:teuthology.orchestra.run.smithi032:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-11T19:44:35.111 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.cMYG1NTuYs is 6KB 2023-12-11T19:44:35.133 INFO:teuthology.orchestra.run.smithi032.stdout:postinstall scriptlet (using /bin/sh): 2023-12-11T19:44:35.133 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-11T19:44:35.133 INFO:teuthology.orchestra.run.smithi032.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-11T19:44:35.134 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2023-12-11T19:44:35.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo rpm -qi grub2-tools 2023-12-11T19:44:35.139 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.cMYG1NTuYs 2023-12-11T19:44:35.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2023-12-11T19:44:35.216 INFO:teuthology.orchestra.run.smithi032.stdout:Name : grub2-tools 2023-12-11T19:44:35.216 INFO:teuthology.orchestra.run.smithi032.stdout:Epoch : 1 2023-12-11T19:44:35.217 INFO:teuthology.orchestra.run.smithi032.stdout:Version : 2.02 2023-12-11T19:44:35.217 INFO:teuthology.orchestra.run.smithi032.stdout:Release : 123.el8 2023-12-11T19:44:35.217 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: x86_64 2023-12-11T19:44:35.217 INFO:teuthology.orchestra.run.smithi032.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-12-11T19:44:35.217 INFO:teuthology.orchestra.run.smithi032.stdout:Group : System Environment/Base 2023-12-11T19:44:35.217 INFO:teuthology.orchestra.run.smithi032.stdout:Size : 9265450 2023-12-11T19:44:35.217 INFO:teuthology.orchestra.run.smithi032.stdout:License : GPLv3+ 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Relocations : (not relocatable) 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Packager : Red Hat, Inc. 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Vendor : Red Hat, Inc. 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Summary : Support tools for GRUB. 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:Description : 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-11T19:44:35.218 INFO:teuthology.orchestra.run.smithi032.stdout:hardware devices. 2023-12-11T19:44:35.219 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T19:44:35.219 INFO:teuthology.orchestra.run.smithi032.stdout:This subpackage provides tools for support of all platforms. 2023-12-11T19:44:35.220 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-11T19:44:35.220 INFO:teuthology.task.kernel:Updating grub on smithi032 to boot 6.6.0-gcd68252d7b4d 2023-12-11T19:44:35.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-11T19:44:35.226 INFO:teuthology.orchestra.run.smithi012.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-12-11T19:44:35.226 INFO:teuthology.orchestra.run.smithi012.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-12-11T19:44:35.226 INFO:teuthology.orchestra.run.smithi012.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.6.0-gcd68252d7b4d.conf 2023-12-11T19:44:35.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.6.0-gcd68252d7b4d 2023-12-11T19:44:35.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2023-12-11T19:44:39.512 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2023-12-11T19:44:41.273 INFO:teuthology.orchestra.run.smithi032.stderr:done 2023-12-11T19:44:41.275 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2023-12-11T19:44:41.292 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.DjJNlhshKw 2023-12-11T19:44:41.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DjJNlhshKw 2023-12-11T19:44:41.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.DjJNlhshKw 2023-12-11T19:44:41.521 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.DjJNlhshKw is 6KB 2023-12-11T19:44:41.570 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.DjJNlhshKw 2023-12-11T19:44:41.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo /bin/ls /boot/loader/entries || true 2023-12-11T19:44:41.660 INFO:teuthology.orchestra.run.smithi032.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-12-11T19:44:41.660 INFO:teuthology.orchestra.run.smithi032.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-12-11T19:44:41.660 INFO:teuthology.orchestra.run.smithi032.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.6.0-gcd68252d7b4d.conf 2023-12-11T19:44:41.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.6.0-gcd68252d7b4d 2023-12-11T19:44:41.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2023-12-11T19:44:45.210 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-11T19:44:45.211 DEBUG:teuthology.orchestra.run.smithi039:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-11T19:44:45.282 INFO:teuthology.orchestra.run.smithi039.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.282 INFO:teuthology.orchestra.run.smithi039.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-11T19:44:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-11T19:44:45.284 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-11T19:44:45.285 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-11T19:44:45.286 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-11T19:44:45.287 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-11T19:44:45.288 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-11T19:44:45.289 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-11T19:44:45.290 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-11T19:44:45.291 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-11T19:44:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-11T19:44:45.293 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-11T19:44:45.294 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-11T19:44:45.295 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-11T19:44:45.296 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-11T19:44:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-11T19:44:45.298 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-11T19:44:45.299 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-11T19:44:45.300 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-11T19:44:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-11T19:44:45.302 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-11T19:44:45.303 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-11T19:44:45.304 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-11T19:44:45.305 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-11T19:44:45.306 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-11T19:44:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-11T19:44:45.308 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-11T19:44:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-11T19:44:45.310 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-11T19:44:45.311 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-11T19:44:45.312 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-11T19:44:45.313 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-11T19:44:45.314 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-11T19:44:45.315 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-11T19:44:45.316 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-11T19:44:45.317 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-11T19:44:45.318 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-11T19:44:45.319 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-11T19:44:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-11T19:44:45.321 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-11T19:44:45.322 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-11T19:44:45.323 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-11T19:44:45.323 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-11T19:44:45.323 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-11T19:44:45.323 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-11T19:44:45.323 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-11T19:44:45.325 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-11T19:44:45.325 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-11T19:44:45.325 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-11T19:44:45.325 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-11T19:44:45.325 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-11T19:44:45.325 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-11T19:44:45.326 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-11T19:44:45.327 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-11T19:44:45.328 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-11T19:44:45.329 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-11T19:44:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-11T19:44:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-11T19:44:45.332 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-11T19:44:45.333 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-11T19:44:45.334 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-11T19:44:45.335 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-11T19:44:45.336 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-11T19:44:45.337 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-11T19:44:45.338 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-11T19:44:45.339 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-11T19:44:45.340 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-11T19:44:45.341 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-11T19:44:45.342 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-11T19:44:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-11T19:44:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-11T19:44:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-11T19:44:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-11T19:44:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-11T19:44:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-11T19:44:45.349 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-11T19:44:45.350 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-11T19:44:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-11T19:44:45.352 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-11T19:44:45.353 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-11T19:44:45.354 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-11T19:44:45.355 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-11T19:44:45.356 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-11T19:44:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-11T19:44:45.358 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-11T19:44:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-11T19:44:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-11T19:44:45.361 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-11T19:44:45.362 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-11T19:44:45.363 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-11T19:44:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-11T19:44:45.365 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-11T19:44:45.366 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-11T19:44:45.367 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-11T19:44:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-11T19:44:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-11T19:44:45.370 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-11T19:44:45.371 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-11T19:44:45.372 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-11T19:44:45.373 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-11T19:44:45.374 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-11T19:44:45.375 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-11T19:44:45.376 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-11T19:44:45.377 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-11T19:44:45.378 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-11T19:44:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-11T19:44:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-11T19:44:45.381 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-11T19:44:45.382 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-11T19:44:45.383 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-11T19:44:45.384 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-11T19:44:45.385 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-11T19:44:45.387 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-11T19:44:45.388 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-11T19:44:45.389 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-11T19:44:45.390 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-11T19:44:45.391 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-11T19:44:45.392 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-11T19:44:45.393 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-11T19:44:45.394 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-11T19:44:45.395 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-11T19:44:45.396 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-11T19:44:45.397 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-11T19:44:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-11T19:44:45.399 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-11T19:44:45.401 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-11T19:44:45.402 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-11T19:44:45.403 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-11T19:44:45.404 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-11T19:44:45.405 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-11T19:44:45.406 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-11T19:44:45.407 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-11T19:44:45.408 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-11T19:44:45.409 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-11T19:44:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-11T19:44:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-11T19:44:45.413 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-11T19:44:45.414 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-11T19:44:45.415 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-11T19:44:45.416 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-11T19:44:45.417 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-11T19:44:45.418 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-11T19:44:45.419 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-11T19:44:45.419 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-11T19:44:45.419 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-11T19:44:45.419 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.419 DEBUG:teuthology.orchestra.run.smithi039:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:postinstall scriptlet (using /bin/sh): 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:fi 2023-12-11T19:44:45.448 INFO:teuthology.orchestra.run.smithi039.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:fi 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.449 INFO:teuthology.orchestra.run.smithi039.stdout:fi 2023-12-11T19:44:45.450 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2023-12-11T19:44:45.531 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.02 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 123.el8 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Group : System Environment/Base 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 9265450 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Relocations : (not relocatable) 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : Red Hat, Inc. 2023-12-11T19:44:45.532 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : Red Hat, Inc. 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T19:44:45.533 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2023-12-11T19:44:45.534 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-11T19:44:45.534 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 6.6.0-gcd68252d7b4d 2023-12-11T19:44:45.534 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-11T19:44:50.876 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2023-12-11T19:44:53.025 INFO:teuthology.orchestra.run.smithi039.stderr:done 2023-12-11T19:44:53.027 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2023-12-11T19:44:53.054 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.a1fuW3wMRM 2023-12-11T19:44:53.054 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.a1fuW3wMRM 2023-12-11T19:44:53.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.a1fuW3wMRM 2023-12-11T19:44:53.265 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.a1fuW3wMRM is 6KB 2023-12-11T19:44:53.315 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.a1fuW3wMRM 2023-12-11T19:44:53.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2023-12-11T19:44:53.409 INFO:teuthology.orchestra.run.smithi039.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-12-11T19:44:53.409 INFO:teuthology.orchestra.run.smithi039.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-12-11T19:44:53.409 INFO:teuthology.orchestra.run.smithi039.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.6.0-gcd68252d7b4d.conf 2023-12-11T19:44:53.410 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.6.0-gcd68252d7b4d 2023-12-11T19:44:53.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2023-12-11T19:45:05.410 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-11T19:45:05.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-11T19:45:05.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:45:11.858 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-11T19:45:11.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-11T19:45:11.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:45:23.578 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-12-11T19:45:23.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-12-11T19:45:23.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:45:23.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-11T19:45:30.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-11T19:45:32.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-11T19:45:32.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:45:39.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-11T19:45:39.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:45:41.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-12-11T19:45:50.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-12-11T19:45:51.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:45:51.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-11T19:45:54.050 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-12-11T19:45:57.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-11T19:46:03.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-11T19:46:03.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:46:06.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-12-11T19:46:06.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:46:06.274 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-11T19:46:09.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-12-11T19:46:09.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-11T19:46:09.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:46:12.669 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-12-11T19:46:13.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-11T19:46:13.106 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-gcd68252d7b4d"... 2023-12-11T19:46:13.106 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2023-12-11T19:46:13.150 INFO:teuthology.orchestra.run.smithi032.stdout:6.6.0-gcd68252d7b4d 2023-12-11T19:46:13.150 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-11T19:46:13.150 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-11T19:46:13.150 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-12-11T19:46:14.151 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-11T19:46:14.151 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-11T19:46:14.289 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2023-12-11T19:46:14.311 DEBUG:teuthology.parallel:result is None 2023-12-11T19:46:21.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-11T19:46:21.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:46:21.636 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-12-11T19:46:21.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-11T19:46:21.993 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-gcd68252d7b4d"... 2023-12-11T19:46:21.993 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-12-11T19:46:22.036 INFO:teuthology.orchestra.run.smithi012.stdout:6.6.0-gcd68252d7b4d 2023-12-11T19:46:22.036 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-11T19:46:22.036 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-11T19:46:22.037 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-12-11T19:46:23.037 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-11T19:46:23.038 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-11T19:46:23.177 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2023-12-11T19:46:23.200 DEBUG:teuthology.parallel:result is None 2023-12-11T19:46:24.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-12-11T19:46:24.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:46:27.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-12-11T19:46:45.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-12-11T19:46:45.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T19:47:17.052 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-12-11T19:47:17.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-12-11T19:47:17.473 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.6.0-gcd68252d7b4d"... 2023-12-11T19:47:17.473 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2023-12-11T19:47:17.516 INFO:teuthology.orchestra.run.smithi039.stdout:6.6.0-gcd68252d7b4d 2023-12-11T19:47:17.516 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-11T19:47:17.516 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-11T19:47:17.516 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-12-11T19:47:18.517 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-12-11T19:47:18.517 DEBUG:teuthology.orchestra.run.smithi039:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-11T19:47:18.658 INFO:teuthology.orchestra.run.smithi039.stdout:ttyS1 2023-12-11T19:47:18.682 DEBUG:teuthology.parallel:result is None 2023-12-11T19:47:18.682 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-11T19:47:18.689 INFO:teuthology.task.internal:Creating test directory... 2023-12-11T19:47:18.689 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-11T19:47:18.694 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-11T19:47:18.700 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-11T19:47:18.744 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-11T19:47:18.751 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-11T19:47:18.758 INFO:teuthology.task.internal:Creating archive directory... 2023-12-11T19:47:18.758 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-11T19:47:18.763 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-11T19:47:18.767 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-11T19:47:18.840 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-11T19:47:18.847 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-11T19:47:18.847 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-11T19:47:18.852 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-11T19:47:18.859 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-11T19:47:18.923 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T19:47:18.935 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T19:47:18.938 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T19:47:18.952 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T19:47:18.964 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T19:47:18.968 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T19:47:18.971 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-11T19:47:18.978 INFO:teuthology.task.internal:Configuring sudo... 2023-12-11T19:47:18.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-11T19:47:18.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-11T19:47:18.987 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-11T19:47:19.056 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-11T19:47:19.066 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-11T19:47:19.066 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-11T19:47:19.070 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-11T19:47:19.075 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-11T19:47:19.117 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T19:47:19.222 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T19:47:19.300 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T19:47:19.371 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T19:47:19.455 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T19:47:19.455 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-11T19:47:19.537 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T19:47:19.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T19:47:19.684 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T19:47:19.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T19:47:19.823 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T19:47:19.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-11T19:47:19.918 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T19:47:19.998 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T19:47:20.071 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T19:47:20.146 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T19:47:20.215 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T19:47:20.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-11T19:47:20.284 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2023-12-11T19:47:20.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2023-12-11T19:47:20.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2023-12-11T19:47:20.415 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-11T19:47:20.424 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-11T19:47:20.455 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-11T19:47:20.917 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-11T19:47:20.925 INFO:teuthology.task.internal:Starting timer... 2023-12-11T19:47:20.925 INFO:teuthology.run_tasks:Running task pcp... 2023-12-11T19:47:20.938 INFO:teuthology.run_tasks:Running task selinux... 2023-12-11T19:47:20.947 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-11T19:47:20.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2023-12-11T19:47:21.070 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2023-12-11T19:47:21.074 DEBUG:teuthology.orchestra.run.smithi032:> sudo service auditd rotate 2023-12-11T19:47:21.196 INFO:teuthology.orchestra.run.smithi032.stdout:Rotating logs: 2023-12-11T19:47:21.201 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2023-12-11T19:47:21.321 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2023-12-11T19:47:21.325 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-11T19:47:21.325 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2023-12-11T19:47:21.383 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2023-12-11T19:47:21.383 DEBUG:teuthology.orchestra.run.smithi032:> /usr/sbin/getenforce 2023-12-11T19:47:21.442 INFO:teuthology.orchestra.run.smithi032.stdout:Permissive 2023-12-11T19:47:21.442 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2023-12-11T19:47:21.495 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2023-12-11T19:47:21.496 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi032.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi039.front.sepia.ceph.com': 'permissive'} 2023-12-11T19:47:21.496 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-11T19:47:21.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T19:47:21.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-11T19:47:21.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T19:47:21.640 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-11T19:47:21.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T19:47:21.710 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-11T19:47:21.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2023-12-11T19:47:21.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo /usr/sbin/setenforce permissive 2023-12-11T19:47:21.851 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2023-12-11T19:47:21.919 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-11T19:47:21.929 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-11T19:47:21.934 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-11T19:47:22.056 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-11T19:47:22.072 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-11T19:47:22.073 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi032.front.sepia.ceph.com,smithi039.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-11T20:00:51.901 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi039.front.sepia.ceph.com')] 2023-12-11T20:00:51.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-11T20:00:51.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T20:00:51.994 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-12-11T20:00:52.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-11T20:00:52.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-11T20:00:52.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T20:00:52.199 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-12-11T20:00:52.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-11T20:00:52.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-12-11T20:00:52.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T20:00:52.404 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-12-11T20:00:52.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-12-11T20:00:52.524 INFO:teuthology.run_tasks:Running task clock... 2023-12-11T20:00:52.538 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-11T20:00:52.539 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-11T20:00:52.540 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-11T20:00:52.545 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-11T20:00:52.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-11T20:00:52.550 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-11T20:00:52.550 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-11T20:00:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-11T20:00:52.624 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-11T20:00:52.642 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-11T20:00:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-11T20:00:52.659 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-11T20:00:52.678 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-11T20:00:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2023-12-11T20:00:52.755 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: ntpd: command not found 2023-12-11T20:00:52.771 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2023-12-11T20:00:52.775 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2023-12-11T20:00:52.785 INFO:teuthology.orchestra.run.smithi032.stdout:506 Cannot talk to daemon 2023-12-11T20:00:52.800 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2023-12-11T20:00:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-11T20:00:52.819 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-11T20:00:52.835 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-11T20:00:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-11T20:00:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-11T20:00:52.870 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-11T20:00:52.933 INFO:teuthology.orchestra.run.smithi012.stderr:bash: ntpq: command not found 2023-12-11T20:00:52.941 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-11T20:00:52.941 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-12-11T20:00:52.941 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.941 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.941 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.941 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:bash: ntpq: command not found 2023-12-11T20:00:52.954 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-11T20:00:52.954 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2023-12-11T20:00:52.954 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.954 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.954 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.954 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.984 INFO:teuthology.orchestra.run.smithi039.stderr:bash: ntpq: command not found 2023-12-11T20:00:52.991 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-11T20:00:52.991 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2023-12-11T20:00:52.991 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.991 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.991 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.991 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:00:52.992 INFO:teuthology.run_tasks:Running task pexec... 2023-12-11T20:00:53.002 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-11T20:00:53.003 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi012.front.sepia.ceph.com 2023-12-11T20:00:53.003 DEBUG:teuthology.orchestra.run.smithi012:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-11T20:00:53.003 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi032.front.sepia.ceph.com 2023-12-11T20:00:53.003 DEBUG:teuthology.orchestra.run.smithi032:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-11T20:00:53.004 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi039.front.sepia.ceph.com 2023-12-11T20:00:53.004 DEBUG:teuthology.orchestra.run.smithi039:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-11T20:00:53.519 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-12-11T20:00:53.521 INFO:teuthology.orchestra.run.smithi039.stdout:Updating Subscription Management repositories. 2023-12-11T20:00:53.522 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-12-11T20:00:55.205 INFO:teuthology.orchestra.run.smithi039.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 31 kB/s | 4.5 kB 00:00 2023-12-11T20:00:55.220 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 kB/s | 4.5 kB 00:00 2023-12-11T20:00:55.424 INFO:teuthology.orchestra.run.smithi032.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 23 kB/s | 4.1 kB 00:00 2023-12-11T20:00:55.631 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 kB/s | 4.1 kB 00:00 2023-12-11T20:00:55.649 INFO:teuthology.orchestra.run.smithi039.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2023-12-11T20:00:55.866 INFO:teuthology.orchestra.run.smithi032.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 27 kB/s | 4.5 kB 00:00 2023-12-11T20:00:57.838 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-12-11T20:00:57.839 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-12-11T20:00:57.839 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2023-12-11T20:00:57.839 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-12-11T20:00:57.840 INFO:teuthology.orchestra.run.smithi012.stdout:Resetting modules: 2023-12-11T20:00:57.840 INFO:teuthology.orchestra.run.smithi012.stdout: container-tools 2023-12-11T20:00:57.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:00:57.840 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-12-11T20:00:57.840 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-12-11T20:00:57.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:00:58.022 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2023-12-11T20:00:58.023 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2023-12-11T20:00:58.023 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2023-12-11T20:00:58.023 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2023-12-11T20:00:58.023 INFO:teuthology.orchestra.run.smithi039.stdout:Resetting modules: 2023-12-11T20:00:58.023 INFO:teuthology.orchestra.run.smithi039.stdout: container-tools 2023-12-11T20:00:58.023 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:00:58.023 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2023-12-11T20:00:58.024 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2023-12-11T20:00:58.024 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:00:58.127 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: Package Architecture Version Repository Size 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout:Resetting modules: 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: container-tools 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2023-12-11T20:00:58.129 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:01:02.819 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-12-11T20:01:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-12-11T20:01:03.169 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2023-12-11T20:01:03.450 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:03.602 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:03.793 INFO:teuthology.orchestra.run.smithi039.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:04.335 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 117 kB/s | 4.5 kB 00:00 2023-12-11T20:01:04.661 INFO:teuthology.orchestra.run.smithi032.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 106 kB/s | 4.1 kB 00:00 2023-12-11T20:01:04.711 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 102 kB/s | 4.1 kB 00:00 2023-12-11T20:01:04.725 INFO:teuthology.orchestra.run.smithi039.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 114 kB/s | 4.5 kB 00:00 2023-12-11T20:01:04.952 INFO:teuthology.orchestra.run.smithi032.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 73 kB/s | 4.5 kB 00:00 2023-12-11T20:01:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 69 kB/s | 4.1 kB 00:00 2023-12-11T20:01:06.970 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================================ 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================================ 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout:Installing group/module packages: 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-12-11T20:01:07.078 INFO:teuthology.orchestra.run.smithi012.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout:Installing module profiles: 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: container-tools/common 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling module streams: 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: container-tools rhel8 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================================ 2023-12-11T20:01:07.079 INFO:teuthology.orchestra.run.smithi012.stdout:Install 10 Packages 2023-12-11T20:01:07.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:01:07.080 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 18 M 2023-12-11T20:01:07.080 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 65 M 2023-12-11T20:01:07.080 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-12-11T20:01:07.189 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-12-11T20:01:07.246 INFO:teuthology.orchestra.run.smithi012.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 571 kB/s | 94 kB 00:00 2023-12-11T20:01:07.288 INFO:teuthology.orchestra.run.smithi012.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 120 kB/s | 25 kB 00:00 2023-12-11T20:01:07.295 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================================================ 2023-12-11T20:01:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2023-12-11T20:01:07.295 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================================================ 2023-12-11T20:01:07.295 INFO:teuthology.orchestra.run.smithi032.stdout:Installing group/module packages: 2023-12-11T20:01:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-12-11T20:01:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout:Installing module profiles: 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: container-tools/common 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:01:07.296 INFO:teuthology.orchestra.run.smithi032.stdout:Enabling module streams: 2023-12-11T20:01:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: container-tools rhel8 2023-12-11T20:01:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:01:07.297 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2023-12-11T20:01:07.297 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================================================ 2023-12-11T20:01:07.297 INFO:teuthology.orchestra.run.smithi032.stdout:Install 10 Packages 2023-12-11T20:01:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:01:07.297 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 18 M 2023-12-11T20:01:07.298 INFO:teuthology.orchestra.run.smithi032.stdout:Installed size: 65 M 2023-12-11T20:01:07.298 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2023-12-11T20:01:07.307 INFO:teuthology.orchestra.run.smithi012.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 183 kB/s | 41 kB 00:00 2023-12-11T20:01:07.338 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2023-12-11T20:01:07.413 INFO:teuthology.orchestra.run.smithi012.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 295 kB/s | 49 kB 00:00 2023-12-11T20:01:07.443 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================================================ 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================================================ 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout:Installing group/module packages: 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2023-12-11T20:01:07.444 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout:Installing module profiles: 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout: container-tools/common 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling module streams: 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout: container-tools rhel8 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================================================ 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout:Install 10 Packages 2023-12-11T20:01:07.445 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:01:07.446 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 18 M 2023-12-11T20:01:07.446 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 65 M 2023-12-11T20:01:07.446 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2023-12-11T20:01:07.497 INFO:teuthology.orchestra.run.smithi012.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.4 MB/s | 524 kB 00:00 2023-12-11T20:01:07.532 INFO:teuthology.orchestra.run.smithi032.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 174 kB/s | 41 kB 00:00 2023-12-11T20:01:07.557 INFO:teuthology.orchestra.run.smithi032.stdout:(2/10): python3-pyxdg-0.25-16.el8.noarch.rpm 363 kB/s | 94 kB 00:00 2023-12-11T20:01:07.581 INFO:teuthology.orchestra.run.smithi012.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 894 kB/s | 149 kB 00:00 2023-12-11T20:01:07.599 INFO:teuthology.orchestra.run.smithi032.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 82 kB/s | 25 kB 00:00 2023-12-11T20:01:07.618 INFO:teuthology.orchestra.run.smithi039.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 239 kB/s | 41 kB 00:00 2023-12-11T20:01:07.633 INFO:teuthology.orchestra.run.smithi032.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 491 kB/s | 49 kB 00:00 2023-12-11T20:01:07.643 INFO:teuthology.orchestra.run.smithi039.stdout:(2/10): python3-pyxdg-0.25-16.el8.noarch.rpm 478 kB/s | 94 kB 00:00 2023-12-11T20:01:07.675 INFO:teuthology.orchestra.run.smithi032.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.4 MB/s | 524 kB 00:00 2023-12-11T20:01:07.752 INFO:teuthology.orchestra.run.smithi039.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 81 kB/s | 25 kB 00:00 2023-12-11T20:01:07.773 INFO:teuthology.orchestra.run.smithi012.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 17 MB/s | 8.0 MB 00:00 2023-12-11T20:01:07.775 INFO:teuthology.orchestra.run.smithi032.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.0 MB/s | 149 kB 00:00 2023-12-11T20:01:07.777 INFO:teuthology.orchestra.run.smithi039.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 311 kB/s | 49 kB 00:00 2023-12-11T20:01:07.806 INFO:teuthology.orchestra.run.smithi012.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 690 kB/s | 213 kB 00:00 2023-12-11T20:01:07.844 INFO:teuthology.orchestra.run.smithi039.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.6 MB/s | 524 kB 00:00 2023-12-11T20:01:07.874 INFO:teuthology.orchestra.run.smithi032.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.0 MB/s | 213 kB 00:00 2023-12-11T20:01:07.942 INFO:teuthology.orchestra.run.smithi012.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 13 MB/s | 2.2 MB 00:00 2023-12-11T20:01:07.944 INFO:teuthology.orchestra.run.smithi039.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 895 kB/s | 149 kB 00:00 2023-12-11T20:01:07.978 INFO:teuthology.orchestra.run.smithi039.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.6 MB/s | 213 kB 00:00 2023-12-11T20:01:08.050 INFO:teuthology.orchestra.run.smithi032.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 18 MB/s | 8.0 MB 00:00 2023-12-11T20:01:08.081 INFO:teuthology.orchestra.run.smithi012.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 14 MB/s | 7.0 MB 00:00 2023-12-11T20:01:08.082 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-12-11T20:01:08.082 INFO:teuthology.orchestra.run.smithi012.stdout:Total 18 MB/s | 18 MB 00:01 2023-12-11T20:01:08.104 INFO:teuthology.orchestra.run.smithi039.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 23 MB/s | 8.0 MB 00:00 2023-12-11T20:01:08.142 INFO:teuthology.orchestra.run.smithi032.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 8.2 MB/s | 2.2 MB 00:00 2023-12-11T20:01:08.187 INFO:teuthology.orchestra.run.smithi039.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 11 MB/s | 2.2 MB 00:00 2023-12-11T20:01:08.243 INFO:teuthology.orchestra.run.smithi032.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 15 MB/s | 7.0 MB 00:00 2023-12-11T20:01:08.244 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2023-12-11T20:01:08.244 INFO:teuthology.orchestra.run.smithi032.stdout:Total 19 MB/s | 18 MB 00:00 2023-12-11T20:01:08.412 INFO:teuthology.orchestra.run.smithi039.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 15 MB/s | 7.0 MB 00:00 2023-12-11T20:01:08.413 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2023-12-11T20:01:08.413 INFO:teuthology.orchestra.run.smithi039.stdout:Total 19 MB/s | 18 MB 00:00 2023-12-11T20:01:08.428 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-12-11T20:01:08.453 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-12-11T20:01:08.453 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-12-11T20:01:08.589 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2023-12-11T20:01:08.614 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2023-12-11T20:01:08.614 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2023-12-11T20:01:08.757 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2023-12-11T20:01:08.795 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2023-12-11T20:01:08.795 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2023-12-11T20:01:08.984 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-12-11T20:01:08.989 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-12-11T20:01:09.097 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2023-12-11T20:01:09.102 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2023-12-11T20:01:09.281 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2023-12-11T20:01:09.286 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2023-12-11T20:01:09.567 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-12-11T20:01:09.676 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2023-12-11T20:01:09.772 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-12-11T20:01:09.846 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2023-12-11T20:01:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-12-11T20:01:09.954 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-11T20:01:10.028 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-12-11T20:01:10.041 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-11T20:01:10.166 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-12-11T20:01:10.278 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-12-11T20:01:10.343 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-11T20:01:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-12-11T20:01:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-12-11T20:01:10.563 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-12-11T20:01:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-12-11T20:01:10.800 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-12-11T20:01:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-12-11T20:01:11.179 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-12-11T20:01:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-12-11T20:01:11.755 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-12-11T20:01:12.120 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-12-11T20:01:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-12-11T20:01:12.704 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-12-11T20:01:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-12-11T20:01:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-12-11T20:01:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-12-11T20:01:13.130 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-12-11T20:01:13.191 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-12-11T20:01:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-11T20:01:13.295 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-11T20:01:13.452 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-12-11T20:01:13.631 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-12-11T20:01:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-12-11T20:01:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-11T20:01:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-12-11T20:01:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-11T20:01:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-12-11T20:01:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-12-11T20:01:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-12-11T20:01:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-12-11T20:01:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-12-11T20:01:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-12-11T20:01:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-12-11T20:01:13.822 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-11T20:01:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-11T20:01:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-12-11T20:01:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-11T20:01:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-12-11T20:01:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-12-11T20:01:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-12-11T20:01:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-12-11T20:01:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-12-11T20:01:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-12-11T20:01:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-12-11T20:01:21.009 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-12-11T20:01:21.010 INFO:teuthology.orchestra.run.smithi032.stdout:Installed products updated. 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-11T20:01:21.247 INFO:teuthology.orchestra.run.smithi032.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.248 INFO:teuthology.orchestra.run.smithi032.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.248 INFO:teuthology.orchestra.run.smithi032.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-12-11T20:01:21.248 INFO:teuthology.orchestra.run.smithi032.stdout: yajl-2.1.0-10.el8.x86_64 2023-12-11T20:01:21.248 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:01:21.248 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-12-11T20:01:21.422 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-12-11T20:01:21.422 INFO:teuthology.orchestra.run.smithi012.stdout:Installed products updated. 2023-12-11T20:01:21.467 DEBUG:teuthology.parallel:result is None 2023-12-11T20:01:21.605 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-12-11T20:01:21.605 INFO:teuthology.orchestra.run.smithi039.stdout:Installed products updated. 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-12-11T20:01:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: yajl-2.1.0-10.el8.x86_64 2023-12-11T20:01:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:01:21.638 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-12-11T20:01:21.823 INFO:teuthology.orchestra.run.smithi039.stdout: yajl-2.1.0-10.el8.x86_64 2023-12-11T20:01:21.824 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:01:21.824 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2023-12-11T20:01:21.868 DEBUG:teuthology.parallel:result is None 2023-12-11T20:01:22.054 DEBUG:teuthology.parallel:result is None 2023-12-11T20:01:22.054 INFO:teuthology.run_tasks:Running task install... 2023-12-11T20:01:22.064 DEBUG:teuthology.task.install:project ceph 2023-12-11T20:01:22.064 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}} 2023-12-11T20:01:22.065 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'} 2023-12-11T20:01:22.065 INFO:teuthology.task.install:Using flavor: default 2023-12-11T20:01:22.071 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-11T20:01:22.071 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-11T20:01:22.071 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-11T20:01:22.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:01:22.074 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-11T20:01:22.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:01:22.075 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-11T20:01:22.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:01:22.298 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/ 2023-12-11T20:01:22.299 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-11T20:01:22.304 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/ 2023-12-11T20:01:22.304 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-11T20:01:22.318 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/ 2023-12-11T20:01:22.318 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-11T20:01:22.413 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-11T20:01:22.414 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:01:22.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-11T20:01:22.421 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-11T20:01:22.422 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:01:22.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-11T20:01:22.485 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-11T20:01:22.485 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:01:22.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-11T20:01:22.487 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-11T20:01:22.487 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-11T20:01:22.491 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-11T20:01:22.491 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-11T20:01:22.555 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-11T20:01:22.556 DEBUG:teuthology.orchestra.run.smithi032:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-11T20:01:22.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-11T20:01:22.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-11T20:01:22.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-11T20:01:22.701 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-11T20:01:22.704 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-11T20:01:22.769 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2023-12-11T20:01:22.770 DEBUG:teuthology.orchestra.run.smithi032:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-11T20:01:22.772 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2023-12-11T20:01:22.773 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2023-12-11T20:01:22.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2023-12-11T20:01:22.843 INFO:teuthology.orchestra.run.smithi032.stdout:check_obsoletes = 1 2023-12-11T20:01:22.846 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum clean all 2023-12-11T20:01:23.257 INFO:teuthology.orchestra.run.smithi039.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:23.319 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:23.371 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:24.728 INFO:teuthology.orchestra.run.smithi039.stdout:44 files removed 2023-12-11T20:01:24.767 INFO:teuthology.orchestra.run.smithi012.stdout:44 files removed 2023-12-11T20:01:24.785 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-11T20:01:24.802 INFO:teuthology.orchestra.run.smithi032.stdout:44 files removed 2023-12-11T20:01:24.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-11T20:01:24.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-11T20:01:25.267 INFO:teuthology.orchestra.run.smithi039.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:25.321 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:25.354 INFO:teuthology.orchestra.run.smithi032.stdout:Updating Subscription Management repositories. 2023-12-11T20:01:26.997 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 250 kB/s | 81 kB 00:00 2023-12-11T20:01:27.134 INFO:teuthology.orchestra.run.smithi032.stdout:ceph packages for x86_64 205 kB/s | 81 kB 00:00 2023-12-11T20:01:27.185 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 296 kB/s | 81 kB 00:00 2023-12-11T20:01:27.415 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-12-11T20:01:27.450 INFO:teuthology.orchestra.run.smithi032.stdout:ceph noarch packages 35 kB/s | 9.5 kB 00:00 2023-12-11T20:01:27.710 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-12-11T20:01:27.741 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-12-11T20:01:27.767 INFO:teuthology.orchestra.run.smithi032.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2023-12-11T20:01:27.926 INFO:teuthology.orchestra.run.smithi032.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-12-11T20:01:27.958 INFO:teuthology.orchestra.run.smithi039.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-12-11T20:01:28.061 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-12-11T20:01:28.229 INFO:teuthology.orchestra.run.smithi012.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-12-11T20:01:29.219 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-12-11T20:01:29.605 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-12-11T20:01:29.739 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2023-12-11T20:01:33.601 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 484 kB/s | 24 kB 00:00 2023-12-11T20:01:34.209 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 406 kB/s | 24 kB 00:00 2023-12-11T20:01:34.275 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 293 kB/s | 24 kB 00:00 2023-12-11T20:01:35.036 INFO:teuthology.orchestra.run.smithi039.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 35 MB/s | 47 MB 00:01 2023-12-11T20:01:35.636 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 36 MB/s | 47 MB 00:01 2023-12-11T20:01:35.736 INFO:teuthology.orchestra.run.smithi032.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 MB/s | 53 MB 00:01 2023-12-11T20:01:44.370 INFO:teuthology.orchestra.run.smithi039.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 39 MB/s | 53 MB 00:01 2023-12-11T20:01:45.425 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 37 MB/s | 53 MB 00:01 2023-12-11T20:01:46.036 INFO:teuthology.orchestra.run.smithi032.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 27 MB/s | 47 MB 00:01 2023-12-11T20:01:56.824 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-11T20:01:56.825 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-11T20:01:56.841 INFO:teuthology.orchestra.run.smithi039.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-11T20:01:56.842 INFO:teuthology.orchestra.run.smithi039.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-11T20:01:56.843 INFO:teuthology.orchestra.run.smithi039.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-11T20:01:56.845 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-11T20:01:56.847 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-11T20:01:56.851 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-11T20:01:56.852 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-11T20:01:57.004 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2023-12-11T20:01:57.018 INFO:teuthology.orchestra.run.smithi039.stdout:=========================================================================================================================== 2023-12-11T20:01:57.018 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2023-12-11T20:01:57.018 INFO:teuthology.orchestra.run.smithi039.stdout:=========================================================================================================================== 2023-12-11T20:01:57.018 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2023-12-11T20:01:57.018 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-12-11T20:01:57.018 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.4 k 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el8 ceph 5.4 M 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 919 k 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el8 ceph 171 k 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el8 ceph 1.6 M 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 133 k 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 1.8 M 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 7.4 M 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 50 k 2023-12-11T20:01:57.019 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 14 M 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el8 ceph 49 M 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 262 k 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 415 k 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 262 k 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 18 k 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 31 k 2023-12-11T20:01:57.020 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 838 k 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 139 k 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el8 ceph 197 k 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el8 ceph 371 k 2023-12-11T20:01:57.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 364 k 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 107 k 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 93 k 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.6 M 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 181 k 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.8 M 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.7 M 2023-12-11T20:01:57.022 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 23 M 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 28 k 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el8 ceph 2.3 M 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 243 k 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el8 ceph 4.6 M 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 18 M 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 15 k 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el8 ceph 24 k 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-11T20:01:57.023 INFO:teuthology.orchestra.run.smithi039.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el8 ceph 183 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 517 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.9 M 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-11T20:01:57.024 INFO:teuthology.orchestra.run.smithi039.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.5.0-1.el8 epel 167 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-11T20:01:57.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 45 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 129 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-11T20:01:57.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-11T20:01:57.027 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-11T20:01:57.028 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-11T20:01:57.029 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-11T20:01:57.030 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling module streams: 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql 10 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout:=========================================================================================================================== 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout:Install 129 Packages 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 3 Packages 2023-12-11T20:01:57.031 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:01:57.032 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 209 M 2023-12-11T20:01:57.032 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2023-12-11T20:01:57.622 INFO:teuthology.orchestra.run.smithi039.stdout:(1/132): ceph-19.0.0-119.ga62fda73.el8.x86_64.r 30 kB/s | 6.4 kB 00:00 2023-12-11T20:01:58.022 INFO:teuthology.orchestra.run.smithi039.stdout:(2/132): ceph-base-19.0.0-119.ga62fda73.el8.x86 8.7 MB/s | 5.4 MB 00:00 2023-12-11T20:01:58.081 INFO:teuthology.orchestra.run.smithi039.stdout:(3/132): ceph-immutable-object-cache-19.0.0-119 2.9 MB/s | 171 kB 00:00 2023-12-11T20:01:58.084 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-11T20:01:58.086 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-11T20:01:58.102 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-11T20:01:58.103 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-11T20:01:58.104 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-11T20:01:58.105 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-11T20:01:58.108 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-11T20:01:58.111 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-11T20:01:58.112 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-11T20:01:58.261 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-12-11T20:01:58.274 INFO:teuthology.orchestra.run.smithi012.stdout:=========================================================================================================================== 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout:=========================================================================================================================== 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.4 k 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el8 ceph 5.4 M 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 919 k 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el8 ceph 171 k 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el8 ceph 1.6 M 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 133 k 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 1.8 M 2023-12-11T20:01:58.275 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 7.4 M 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 50 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 14 M 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el8 ceph 49 M 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 262 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 415 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 262 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 18 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 31 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 838 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 139 k 2023-12-11T20:01:58.276 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el8 ceph 197 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el8 ceph 371 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 364 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 107 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 93 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.6 M 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 181 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2023-12-11T20:01:58.277 INFO:teuthology.orchestra.run.smithi012.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.8 M 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.7 M 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 23 M 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 28 k 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el8 ceph 2.3 M 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 243 k 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el8 ceph 4.6 M 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 18 M 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 15 k 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el8 ceph 24 k 2023-12-11T20:01:58.278 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el8 ceph 183 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 517 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-11T20:01:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.9 M 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.5.0-1.el8 epel 167 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-11T20:01:58.280 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 45 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 129 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-11T20:01:58.281 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-11T20:01:58.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-11T20:01:58.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-11T20:01:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-11T20:01:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-11T20:01:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-11T20:01:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-11T20:01:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-11T20:01:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-11T20:01:58.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling module streams: 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql 10 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout:=========================================================================================================================== 2023-12-11T20:01:58.285 INFO:teuthology.orchestra.run.smithi012.stdout:Install 129 Packages 2023-12-11T20:01:58.286 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 3 Packages 2023-12-11T20:01:58.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:01:58.286 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 209 M 2023-12-11T20:01:58.286 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-12-11T20:01:58.340 INFO:teuthology.orchestra.run.smithi039.stdout:(4/132): ceph-mds-19.0.0-119.ga62fda73.el8.x86_ 8.9 MB/s | 2.3 MB 00:00 2023-12-11T20:01:58.373 INFO:teuthology.orchestra.run.smithi039.stdout:(5/132): ceph-fuse-19.0.0-119.ga62fda73.el8.x86 1.2 MB/s | 919 kB 00:00 2023-12-11T20:01:58.557 INFO:teuthology.orchestra.run.smithi039.stdout:(6/132): ceph-mgr-19.0.0-119.ga62fda73.el8.x86_ 7.5 MB/s | 1.6 MB 00:00 2023-12-11T20:01:58.590 INFO:teuthology.orchestra.run.smithi032.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-11T20:01:58.591 INFO:teuthology.orchestra.run.smithi032.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-11T20:01:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:(1/132): ceph-19.0.0-119.ga62fda73.el8.x86_64.r 26 kB/s | 6.4 kB 00:00 2023-12-11T20:01:58.606 INFO:teuthology.orchestra.run.smithi032.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-11T20:01:58.608 INFO:teuthology.orchestra.run.smithi032.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-11T20:01:58.609 INFO:teuthology.orchestra.run.smithi032.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-11T20:01:58.610 INFO:teuthology.orchestra.run.smithi032.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-11T20:01:58.612 INFO:teuthology.orchestra.run.smithi032.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-11T20:01:58.616 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-11T20:01:58.617 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-11T20:01:58.766 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-12-11T20:01:58.780 INFO:teuthology.orchestra.run.smithi032.stdout:=========================================================================================================================== 2023-12-11T20:01:58.780 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2023-12-11T20:01:58.780 INFO:teuthology.orchestra.run.smithi032.stdout:=========================================================================================================================== 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.4 k 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el8 ceph 5.4 M 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 919 k 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el8 ceph 171 k 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el8 ceph 1.6 M 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 133 k 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 1.8 M 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 7.4 M 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 50 k 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 14 M 2023-12-11T20:01:58.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el8 ceph 49 M 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 262 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 415 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 262 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 18 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 31 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 838 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 139 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-11T20:01:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el8 ceph 197 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el8 ceph 371 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 364 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 107 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 93 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.6 M 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 181 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.8 M 2023-12-11T20:01:58.783 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.7 M 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 23 M 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 28 k 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el8 ceph 2.3 M 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 243 k 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el8 ceph 4.6 M 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 18 M 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 15 k 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el8 ceph 24 k 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-11T20:01:58.784 INFO:teuthology.orchestra.run.smithi032.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el8 ceph 183 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 517 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.9 M 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-11T20:01:58.785 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: luarocks noarch 3.5.0-1.el8 epel 167 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-11T20:01:58.786 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 45 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 129 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-11T20:01:58.787 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-11T20:01:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-11T20:01:58.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout:Enabling module streams: 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql 10 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout:=========================================================================================================================== 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout:Install 129 Packages 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 3 Packages 2023-12-11T20:01:58.790 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:01:58.791 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 209 M 2023-12-11T20:01:58.791 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2023-12-11T20:01:59.141 INFO:teuthology.orchestra.run.smithi032.stdout:(1/132): ceph-19.0.0-119.ga62fda73.el8.x86_64.r 24 kB/s | 6.4 kB 00:00 2023-12-11T20:01:59.157 INFO:teuthology.orchestra.run.smithi039.stdout:(7/132): ceph-common-19.0.0-119.ga62fda73.el8.x 13 MB/s | 23 MB 00:01 2023-12-11T20:01:59.308 INFO:teuthology.orchestra.run.smithi012.stdout:(2/132): ceph-fuse-19.0.0-119.ga62fda73.el8.x86 1.3 MB/s | 919 kB 00:00 2023-12-11T20:01:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:(3/132): ceph-immutable-object-cache-19.0.0-119 662 kB/s | 171 kB 00:00 2023-12-11T20:02:00.513 INFO:teuthology.orchestra.run.smithi032.stdout:(2/132): ceph-base-19.0.0-119.ga62fda73.el8.x86 3.3 MB/s | 5.4 MB 00:01 2023-12-11T20:02:00.614 INFO:teuthology.orchestra.run.smithi032.stdout:(3/132): ceph-immutable-object-cache-19.0.0-119 1.7 MB/s | 171 kB 00:00 2023-12-11T20:02:00.722 INFO:teuthology.orchestra.run.smithi032.stdout:(4/132): ceph-fuse-19.0.0-119.ga62fda73.el8.x86 581 kB/s | 919 kB 00:01 2023-12-11T20:02:00.824 INFO:teuthology.orchestra.run.smithi039.stdout:(8/132): ceph-osd-19.0.0-119.ga62fda73.el8.x86_ 7.9 MB/s | 18 MB 00:02 2023-12-11T20:02:00.899 INFO:teuthology.orchestra.run.smithi039.stdout:(9/132): ceph-selinux-19.0.0-119.ga62fda73.el8. 325 kB/s | 24 kB 00:00 2023-12-11T20:02:01.148 INFO:teuthology.orchestra.run.smithi032.stdout:(5/132): ceph-mds-19.0.0-119.ga62fda73.el8.x86_ 4.3 MB/s | 2.3 MB 00:00 2023-12-11T20:02:01.259 INFO:teuthology.orchestra.run.smithi012.stdout:(4/132): ceph-mds-19.0.0-119.ga62fda73.el8.x86_ 1.4 MB/s | 2.3 MB 00:01 2023-12-11T20:02:01.341 INFO:teuthology.orchestra.run.smithi039.stdout:(10/132): ceph-radosgw-19.0.0-119.ga62fda73.el8 6.3 MB/s | 14 MB 00:02 2023-12-11T20:02:01.433 INFO:teuthology.orchestra.run.smithi039.stdout:(11/132): cephfs-mirror-19.0.0-119.ga62fda73.el 2.8 MB/s | 262 kB 00:00 2023-12-11T20:02:01.542 INFO:teuthology.orchestra.run.smithi039.stdout:(12/132): libcephfs-devel-19.0.0-119.ga62fda73. 286 kB/s | 31 kB 00:00 2023-12-11T20:02:01.725 INFO:teuthology.orchestra.run.smithi039.stdout:(13/132): libcephfs2-19.0.0-119.ga62fda73.el8.x 4.5 MB/s | 838 kB 00:00 2023-12-11T20:02:01.809 INFO:teuthology.orchestra.run.smithi039.stdout:(14/132): libcephsqlite-19.0.0-119.ga62fda73.el 2.1 MB/s | 183 kB 00:00 2023-12-11T20:02:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:(15/132): librados-devel-19.0.0-119.ga62fda73.e 1.5 MB/s | 139 kB 00:00 2023-12-11T20:02:02.068 INFO:teuthology.orchestra.run.smithi039.stdout:(16/132): libradosstriper1-19.0.0-119.ga62fda73 3.0 MB/s | 517 kB 00:00 2023-12-11T20:02:02.176 INFO:teuthology.orchestra.run.smithi039.stdout:(17/132): ceph-mon-19.0.0-119.ga62fda73.el8.x86 1.2 MB/s | 4.6 MB 00:03 2023-12-11T20:02:02.248 INFO:teuthology.orchestra.run.smithi032.stdout:(6/132): ceph-mon-19.0.0-119.ga62fda73.el8.x86_ 4.2 MB/s | 4.6 MB 00:01 2023-12-11T20:02:02.268 INFO:teuthology.orchestra.run.smithi039.stdout:(18/132): python3-ceph-argparse-19.0.0-119.ga62 489 kB/s | 45 kB 00:00 2023-12-11T20:02:02.292 INFO:teuthology.orchestra.run.smithi012.stdout:(5/132): ceph-mgr-19.0.0-119.ga62fda73.el8.x86_ 1.6 MB/s | 1.6 MB 00:01 2023-12-11T20:02:02.460 INFO:teuthology.orchestra.run.smithi039.stdout:(19/132): python3-ceph-common-19.0.0-119.ga62fd 671 kB/s | 129 kB 00:00 2023-12-11T20:02:02.526 INFO:teuthology.orchestra.run.smithi012.stdout:(6/132): ceph-common-19.0.0-119.ga62fda73.el8.x 5.4 MB/s | 23 MB 00:04 2023-12-11T20:02:02.652 INFO:teuthology.orchestra.run.smithi039.stdout:(20/132): python3-cephfs-19.0.0-119.ga62fda73.e 1.0 MB/s | 197 kB 00:00 2023-12-11T20:02:03.011 INFO:teuthology.orchestra.run.smithi039.stdout:(21/132): python3-rados-19.0.0-119.ga62fda73.el 1.0 MB/s | 371 kB 00:00 2023-12-11T20:02:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:(7/132): ceph-mgr-19.0.0-119.ga62fda73.el8.x86_ 677 kB/s | 1.6 MB 00:02 2023-12-11T20:02:03.220 INFO:teuthology.orchestra.run.smithi039.stdout:(22/132): librgw2-19.0.0-119.ga62fda73.el8.x86_ 6.0 MB/s | 6.9 MB 00:01 2023-12-11T20:02:03.295 INFO:teuthology.orchestra.run.smithi039.stdout:(23/132): python3-rgw-19.0.0-119.ga62fda73.el8. 1.4 MB/s | 107 kB 00:00 2023-12-11T20:02:03.346 INFO:teuthology.orchestra.run.smithi039.stdout:(24/132): python3-rbd-19.0.0-119.ga62fda73.el8. 1.1 MB/s | 364 kB 00:00 2023-12-11T20:02:03.412 INFO:teuthology.orchestra.run.smithi039.stdout:(25/132): rbd-fuse-19.0.0-119.ga62fda73.el8.x86 800 kB/s | 93 kB 00:00 2023-12-11T20:02:03.496 INFO:teuthology.orchestra.run.smithi039.stdout:(26/132): rbd-nbd-19.0.0-119.ga62fda73.el8.x86_ 2.1 MB/s | 181 kB 00:00 2023-12-11T20:02:03.571 INFO:teuthology.orchestra.run.smithi039.stdout:(27/132): ceph-grafana-dashboards-19.0.0-119.ga 374 kB/s | 28 kB 00:00 2023-12-11T20:02:03.646 INFO:teuthology.orchestra.run.smithi039.stdout:(28/132): ceph-mgr-cephadm-19.0.0-119.ga62fda73 1.7 MB/s | 133 kB 00:00 2023-12-11T20:02:03.767 INFO:teuthology.orchestra.run.smithi012.stdout:(7/132): ceph-base-19.0.0-119.ga62fda73.el8.x86 1.0 MB/s | 5.4 MB 00:05 2023-12-11T20:02:04.005 INFO:teuthology.orchestra.run.smithi039.stdout:(29/132): ceph-mgr-dashboard-19.0.0-119.ga62fda 4.9 MB/s | 1.8 MB 00:00 2023-12-11T20:02:05.357 INFO:teuthology.orchestra.run.smithi032.stdout:(8/132): ceph-common-19.0.0-119.ga62fda73.el8.x 3.5 MB/s | 23 MB 00:06 2023-12-11T20:02:05.414 INFO:teuthology.orchestra.run.smithi039.stdout:(30/132): ceph-mgr-diskprediction-local-19.0.0- 5.3 MB/s | 7.4 MB 00:01 2023-12-11T20:02:05.432 INFO:teuthology.orchestra.run.smithi032.stdout:(9/132): ceph-selinux-19.0.0-119.ga62fda73.el8. 326 kB/s | 24 kB 00:00 2023-12-11T20:02:05.442 INFO:teuthology.orchestra.run.smithi012.stdout:(8/132): ceph-mon-19.0.0-119.ga62fda73.el8.x86_ 1.5 MB/s | 4.6 MB 00:03 2023-12-11T20:02:05.480 INFO:teuthology.orchestra.run.smithi039.stdout:(31/132): ceph-mgr-modules-core-19.0.0-119.ga62 3.6 MB/s | 243 kB 00:00 2023-12-11T20:02:05.542 INFO:teuthology.orchestra.run.smithi012.stdout:(9/132): ceph-selinux-19.0.0-119.ga62fda73.el8. 244 kB/s | 24 kB 00:00 2023-12-11T20:02:05.556 INFO:teuthology.orchestra.run.smithi039.stdout:(32/132): ceph-mgr-rook-19.0.0-119.ga62fda73.el 668 kB/s | 50 kB 00:00 2023-12-11T20:02:05.631 INFO:teuthology.orchestra.run.smithi039.stdout:(33/132): ceph-prometheus-alerts-19.0.0-119.ga6 200 kB/s | 15 kB 00:00 2023-12-11T20:02:05.731 INFO:teuthology.orchestra.run.smithi039.stdout:(34/132): ceph-volume-19.0.0-119.ga62fda73.el8. 2.6 MB/s | 262 kB 00:00 2023-12-11T20:02:05.952 INFO:teuthology.orchestra.run.smithi012.stdout:(10/132): ceph-osd-19.0.0-119.ga62fda73.el8.x86 5.3 MB/s | 18 MB 00:03 2023-12-11T20:02:06.052 INFO:teuthology.orchestra.run.smithi012.stdout:(11/132): cephfs-mirror-19.0.0-119.ga62fda73.el 2.6 MB/s | 262 kB 00:00 2023-12-11T20:02:06.063 INFO:teuthology.orchestra.run.smithi039.stdout:(35/132): rbd-mirror-19.0.0-119.ga62fda73.el8.x 1.3 MB/s | 3.6 MB 00:02 2023-12-11T20:02:06.127 INFO:teuthology.orchestra.run.smithi012.stdout:(12/132): libcephfs-devel-19.0.0-119.ga62fda73. 416 kB/s | 31 kB 00:00 2023-12-11T20:02:06.166 INFO:teuthology.orchestra.run.smithi039.stdout:(36/132): cephadm-19.0.0-119.ga62fda73.el8.noar 957 kB/s | 415 kB 00:00 2023-12-11T20:02:06.191 INFO:teuthology.orchestra.run.smithi039.stdout:(37/132): cephfs-top-19.0.0-119.ga62fda73.el8.n 142 kB/s | 18 kB 00:00 2023-12-11T20:02:06.292 INFO:teuthology.orchestra.run.smithi012.stdout:(13/132): libcephfs2-19.0.0-119.ga62fda73.el8.x 5.0 MB/s | 838 kB 00:00 2023-12-11T20:02:06.340 INFO:teuthology.orchestra.run.smithi032.stdout:(10/132): ceph-osd-19.0.0-119.ga62fda73.el8.x86 4.4 MB/s | 18 MB 00:04 2023-12-11T20:02:06.349 INFO:teuthology.orchestra.run.smithi039.stdout:(38/132): liboath-2.6.2-3.el8.x86_64.rpm 372 kB/s | 59 kB 00:00 2023-12-11T20:02:06.361 INFO:teuthology.orchestra.run.smithi012.stdout:(14/132): libcephsqlite-19.0.0-119.ga62fda73.el 2.6 MB/s | 183 kB 00:00 2023-12-11T20:02:06.407 INFO:teuthology.orchestra.run.smithi032.stdout:(11/132): cephfs-mirror-19.0.0-119.ga62fda73.el 3.9 MB/s | 262 kB 00:00 2023-12-11T20:02:06.425 INFO:teuthology.orchestra.run.smithi039.stdout:(39/132): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-12-11T20:02:06.444 INFO:teuthology.orchestra.run.smithi012.stdout:(15/132): librados-devel-19.0.0-119.ga62fda73.e 1.6 MB/s | 139 kB 00:00 2023-12-11T20:02:06.450 INFO:teuthology.orchestra.run.smithi039.stdout:(40/132): libunwind-1.3.1-3.el8.x86_64.rpm 749 kB/s | 75 kB 00:00 2023-12-11T20:02:06.492 INFO:teuthology.orchestra.run.smithi039.stdout:(41/132): luarocks-3.5.0-1.el8.noarch.rpm 2.4 MB/s | 167 kB 00:00 2023-12-11T20:02:06.499 INFO:teuthology.orchestra.run.smithi032.stdout:(12/132): libcephfs-devel-19.0.0-119.ga62fda73. 339 kB/s | 31 kB 00:00 2023-12-11T20:02:06.551 INFO:teuthology.orchestra.run.smithi039.stdout:(42/132): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 746 kB/s | 44 kB 00:00 2023-12-11T20:02:06.553 INFO:teuthology.orchestra.run.smithi012.stdout:(16/132): libradosstriper1-19.0.0-119.ga62fda73 4.7 MB/s | 517 kB 00:00 2023-12-11T20:02:06.584 INFO:teuthology.orchestra.run.smithi039.stdout:(43/132): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2023-12-11T20:02:06.651 INFO:teuthology.orchestra.run.smithi039.stdout:(44/132): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-12-11T20:02:06.676 INFO:teuthology.orchestra.run.smithi039.stdout:(45/132): python3-cachetools-3.1.1-4.el8.noarch 359 kB/s | 33 kB 00:00 2023-12-11T20:02:06.708 INFO:teuthology.orchestra.run.smithi032.stdout:(13/132): libcephfs2-19.0.0-119.ga62fda73.el8.x 3.9 MB/s | 838 kB 00:00 2023-12-11T20:02:06.727 INFO:teuthology.orchestra.run.smithi039.stdout:(46/132): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-12-11T20:02:06.752 INFO:teuthology.orchestra.run.smithi039.stdout:(47/132): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-12-11T20:02:06.800 INFO:teuthology.orchestra.run.smithi032.stdout:(14/132): libcephsqlite-19.0.0-119.ga62fda73.el 2.0 MB/s | 183 kB 00:00 2023-12-11T20:02:06.811 INFO:teuthology.orchestra.run.smithi039.stdout:(48/132): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-12-11T20:02:06.836 INFO:teuthology.orchestra.run.smithi039.stdout:(49/132): python3-google-auth-1.1.1-10.el8.noar 974 kB/s | 81 kB 00:00 2023-12-11T20:02:06.884 INFO:teuthology.orchestra.run.smithi032.stdout:(15/132): librados-devel-19.0.0-119.ga62fda73.e 1.6 MB/s | 139 kB 00:00 2023-12-11T20:02:06.895 INFO:teuthology.orchestra.run.smithi039.stdout:(50/132): python3-jaraco-6.2-6.el8.noarch.rpm 191 kB/s | 11 kB 00:00 2023-12-11T20:02:06.920 INFO:teuthology.orchestra.run.smithi039.stdout:(51/132): python3-jaraco-functools-2.0-4.el8.no 211 kB/s | 18 kB 00:00 2023-12-11T20:02:06.979 INFO:teuthology.orchestra.run.smithi039.stdout:(52/132): python3-logutils-0.3.5-11.el8.noarch. 838 kB/s | 49 kB 00:00 2023-12-11T20:02:07.021 INFO:teuthology.orchestra.run.smithi039.stdout:(53/132): python3-kubernetes-11.0.0-6.el8.noarc 9.3 MB/s | 1.2 MB 00:00 2023-12-11T20:02:07.034 INFO:teuthology.orchestra.run.smithi032.stdout:(16/132): libradosstriper1-19.0.0-119.ga62fda73 3.4 MB/s | 517 kB 00:00 2023-12-11T20:02:07.046 INFO:teuthology.orchestra.run.smithi039.stdout:(54/132): python3-more-itertools-7.2.0-3.el8.no 879 kB/s | 59 kB 00:00 2023-12-11T20:02:07.098 INFO:teuthology.orchestra.run.smithi039.stdout:(55/132): python3-natsort-7.1.1-2.el8.noarch.rp 789 kB/s | 60 kB 00:00 2023-12-11T20:02:07.130 INFO:teuthology.orchestra.run.smithi039.stdout:(56/132): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-12-11T20:02:07.155 INFO:teuthology.orchestra.run.smithi039.stdout:(57/132): python3-portend-2.6-1.el8.noarch.rpm 273 kB/s | 16 kB 00:00 2023-12-11T20:02:07.180 INFO:teuthology.orchestra.run.smithi039.stdout:(58/132): python3-repoze-lru-0.7-6.el8.noarch.r 671 kB/s | 34 kB 00:00 2023-12-11T20:02:07.214 INFO:teuthology.orchestra.run.smithi039.stdout:(59/132): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-12-11T20:02:07.239 INFO:teuthology.orchestra.run.smithi039.stdout:(60/132): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-12-11T20:02:07.273 INFO:teuthology.orchestra.run.smithi039.stdout:(61/132): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2023-12-11T20:02:07.298 INFO:teuthology.orchestra.run.smithi039.stdout:(62/132): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2023-12-11T20:02:07.324 INFO:teuthology.orchestra.run.smithi039.stdout:(63/132): python3-tempora-1.14.1-5.el8.noarch.r 581 kB/s | 29 kB 00:00 2023-12-11T20:02:07.349 INFO:teuthology.orchestra.run.smithi039.stdout:(64/132): python3-trustme-0.6.0-4.el8.noarch.rp 547 kB/s | 27 kB 00:00 2023-12-11T20:02:07.390 INFO:teuthology.orchestra.run.smithi039.stdout:(65/132): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-12-11T20:02:07.416 INFO:teuthology.orchestra.run.smithi039.stdout:(66/132): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-12-11T20:02:07.441 INFO:teuthology.orchestra.run.smithi039.stdout:(67/132): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-12-11T20:02:07.475 INFO:teuthology.orchestra.run.smithi039.stdout:(68/132): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-12-11T20:02:07.508 INFO:teuthology.orchestra.run.smithi039.stdout:(69/132): python3-zc-lockfile-2.0-2.el8.noarch. 343 kB/s | 23 kB 00:00 2023-12-11T20:02:07.534 INFO:teuthology.orchestra.run.smithi039.stdout:(70/132): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-12-11T20:02:07.592 INFO:teuthology.orchestra.run.smithi039.stdout:(71/132): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-12-11T20:02:07.720 INFO:teuthology.orchestra.run.smithi012.stdout:(17/132): librgw2-19.0.0-119.ga62fda73.el8.x86_ 5.9 MB/s | 6.9 MB 00:01 2023-12-11T20:02:07.812 INFO:teuthology.orchestra.run.smithi012.stdout:(18/132): python3-ceph-argparse-19.0.0-119.ga62 489 kB/s | 45 kB 00:00 2023-12-11T20:02:07.826 INFO:teuthology.orchestra.run.smithi039.stdout:(72/132): python3-pyasn1-modules-0.3.7-6.el8.no 491 kB/s | 110 kB 00:00 2023-12-11T20:02:07.895 INFO:teuthology.orchestra.run.smithi012.stdout:(19/132): python3-ceph-common-19.0.0-119.ga62fd 1.5 MB/s | 129 kB 00:00 2023-12-11T20:02:07.918 INFO:teuthology.orchestra.run.smithi039.stdout:(73/132): python3-pytz-2017.2-9.el8.noarch.rpm 591 kB/s | 54 kB 00:00 2023-12-11T20:02:07.993 INFO:teuthology.orchestra.run.smithi039.stdout:(74/132): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-12-11T20:02:08.018 INFO:teuthology.orchestra.run.smithi012.stdout:(20/132): python3-cephfs-19.0.0-119.ga62fda73.e 1.6 MB/s | 197 kB 00:00 2023-12-11T20:02:08.121 INFO:teuthology.orchestra.run.smithi012.stdout:(21/132): python3-rados-19.0.0-119.ga62fda73.el 3.5 MB/s | 371 kB 00:00 2023-12-11T20:02:08.194 INFO:teuthology.orchestra.run.smithi039.stdout:(75/132): python3-scipy-1.0.0-21.module+el8.5.0 21 MB/s | 14 MB 00:00 2023-12-11T20:02:08.221 INFO:teuthology.orchestra.run.smithi012.stdout:(22/132): python3-rbd-19.0.0-119.ga62fda73.el8. 3.6 MB/s | 364 kB 00:00 2023-12-11T20:02:08.227 INFO:teuthology.orchestra.run.smithi039.stdout:(76/132): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2023-12-11T20:02:08.303 INFO:teuthology.orchestra.run.smithi039.stdout:(77/132): python3-markupsafe-0.23-19.el8.x86_64 358 kB/s | 39 kB 00:00 2023-12-11T20:02:08.313 INFO:teuthology.orchestra.run.smithi012.stdout:(23/132): python3-rgw-19.0.0-119.ga62fda73.el8. 1.1 MB/s | 107 kB 00:00 2023-12-11T20:02:08.389 INFO:teuthology.orchestra.run.smithi012.stdout:(24/132): rbd-fuse-19.0.0-119.ga62fda73.el8.x86 1.2 MB/s | 93 kB 00:00 2023-12-11T20:02:08.401 INFO:teuthology.orchestra.run.smithi032.stdout:(17/132): librgw2-19.0.0-119.ga62fda73.el8.x86_ 5.1 MB/s | 6.9 MB 00:01 2023-12-11T20:02:08.436 INFO:teuthology.orchestra.run.smithi039.stdout:(78/132): bison-3.0.4-10.el8.x86_64.rpm 3.2 MB/s | 688 kB 00:00 2023-12-11T20:02:08.476 INFO:teuthology.orchestra.run.smithi032.stdout:(18/132): python3-ceph-argparse-19.0.0-119.ga62 600 kB/s | 45 kB 00:00 2023-12-11T20:02:08.499 INFO:teuthology.orchestra.run.smithi039.stdout:(79/132): python3-jinja2-2.10.1-3.el8.noarch.rp 2.7 MB/s | 538 kB 00:00 2023-12-11T20:02:08.560 INFO:teuthology.orchestra.run.smithi032.stdout:(19/132): python3-ceph-common-19.0.0-119.ga62fd 1.5 MB/s | 129 kB 00:00 2023-12-11T20:02:08.604 INFO:teuthology.orchestra.run.smithi039.stdout:(80/132): python3-mako-1.0.6-13.el8.noarch.rpm 940 kB/s | 157 kB 00:00 2023-12-11T20:02:08.637 INFO:teuthology.orchestra.run.smithi039.stdout:(81/132): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-12-11T20:02:08.652 INFO:teuthology.orchestra.run.smithi032.stdout:(20/132): python3-cephfs-19.0.0-119.ga62fda73.e 2.1 MB/s | 197 kB 00:00 2023-12-11T20:02:08.687 INFO:teuthology.orchestra.run.smithi039.stdout:(82/132): automake-1.16.1-7.el8.noarch.rpm 8.3 MB/s | 713 kB 00:00 2023-12-11T20:02:08.794 INFO:teuthology.orchestra.run.smithi032.stdout:(21/132): python3-rados-19.0.0-119.ga62fda73.el 2.6 MB/s | 371 kB 00:00 2023-12-11T20:02:08.821 INFO:teuthology.orchestra.run.smithi039.stdout:(83/132): python3-jsonpatch-1.21-2.el8.noarch.r 199 kB/s | 27 kB 00:00 2023-12-11T20:02:08.896 INFO:teuthology.orchestra.run.smithi039.stdout:(84/132): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-12-11T20:02:08.936 INFO:teuthology.orchestra.run.smithi032.stdout:(22/132): python3-rbd-19.0.0-119.ga62fda73.el8. 2.5 MB/s | 364 kB 00:00 2023-12-11T20:02:08.977 INFO:teuthology.orchestra.run.smithi039.stdout:(85/132): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2023-12-11T20:02:08.989 INFO:teuthology.orchestra.run.smithi012.stdout:(25/132): rbd-mirror-19.0.0-119.ga62fda73.el8.x 6.0 MB/s | 3.6 MB 00:00 2023-12-11T20:02:08.994 INFO:teuthology.orchestra.run.smithi032.stdout:(23/132): python3-rgw-19.0.0-119.ga62fda73.el8. 1.8 MB/s | 107 kB 00:00 2023-12-11T20:02:09.022 INFO:teuthology.orchestra.run.smithi039.stdout:(86/132): python3-prettytable-0.7.2-14.el8.noar 352 kB/s | 44 kB 00:00 2023-12-11T20:02:09.056 INFO:teuthology.orchestra.run.smithi012.stdout:(26/132): rbd-nbd-19.0.0-119.ga62fda73.el8.x86_ 2.7 MB/s | 181 kB 00:00 2023-12-11T20:02:09.101 INFO:teuthology.orchestra.run.smithi032.stdout:(24/132): rbd-fuse-19.0.0-119.ga62fda73.el8.x86 883 kB/s | 93 kB 00:00 2023-12-11T20:02:09.114 INFO:teuthology.orchestra.run.smithi012.stdout:(27/132): ceph-grafana-dashboards-19.0.0-119.ga 482 kB/s | 28 kB 00:00 2023-12-11T20:02:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:(28/132): ceph-mgr-cephadm-19.0.0-119.ga62fda73 636 kB/s | 133 kB 00:00 2023-12-11T20:02:09.514 INFO:teuthology.orchestra.run.smithi039.stdout:(87/132): ceph-test-19.0.0-119.ga62fda73.el8.x8 5.7 MB/s | 49 MB 00:08 2023-12-11T20:02:09.564 INFO:teuthology.orchestra.run.smithi039.stdout:(88/132): python3-werkzeug-0.12.2-4.el8.noarch. 844 kB/s | 457 kB 00:00 2023-12-11T20:02:09.629 INFO:teuthology.orchestra.run.smithi032.stdout:(25/132): rbd-mirror-19.0.0-119.ga62fda73.el8.x 6.8 MB/s | 3.6 MB 00:00 2023-12-11T20:02:09.632 INFO:teuthology.orchestra.run.smithi012.stdout:(29/132): ceph-mgr-dashboard-19.0.0-119.ga62fda 5.7 MB/s | 1.8 MB 00:00 2023-12-11T20:02:09.681 INFO:teuthology.orchestra.run.smithi039.stdout:(89/132): python3-numpy-1.14.3-10.el8.x86_64.rp 5.3 MB/s | 3.7 MB 00:00 2023-12-11T20:02:09.687 INFO:teuthology.orchestra.run.smithi032.stdout:(26/132): rbd-nbd-19.0.0-119.ga62fda73.el8.x86_ 3.0 MB/s | 181 kB 00:00 2023-12-11T20:02:09.732 INFO:teuthology.orchestra.run.smithi039.stdout:(90/132): uuid-1.6.2-43.el8.x86_64.rpm 404 kB/s | 64 kB 00:00 2023-12-11T20:02:09.746 INFO:teuthology.orchestra.run.smithi032.stdout:(27/132): ceph-grafana-dashboards-19.0.0-119.ga 481 kB/s | 28 kB 00:00 2023-12-11T20:02:09.790 INFO:teuthology.orchestra.run.smithi039.stdout:(91/132): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-12-11T20:02:09.815 INFO:teuthology.orchestra.run.smithi039.stdout:(92/132): python3-jsonpointer-1.10-11.el8.noarc 240 kB/s | 20 kB 00:00 2023-12-11T20:02:09.841 INFO:teuthology.orchestra.run.smithi039.stdout:(93/132): python3-numpy-f2py-1.14.3-10.el8.x86_ 691 kB/s | 225 kB 00:00 2023-12-11T20:02:09.845 INFO:teuthology.orchestra.run.smithi032.stdout:(28/132): ceph-mgr-cephadm-19.0.0-119.ga62fda73 1.3 MB/s | 133 kB 00:00 2023-12-11T20:02:09.899 INFO:teuthology.orchestra.run.smithi039.stdout:(94/132): python3-pyOpenSSL-19.0.0-1.el8.noarch 952 kB/s | 103 kB 00:00 2023-12-11T20:02:09.975 INFO:teuthology.orchestra.run.smithi039.stdout:(95/132): libtool-2.4.6-25.el8.x86_64.rpm 4.3 MB/s | 709 kB 00:00 2023-12-11T20:02:10.033 INFO:teuthology.orchestra.run.smithi039.stdout:(96/132): libpq-13.5-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-12-11T20:02:10.096 INFO:teuthology.orchestra.run.smithi032.stdout:(29/132): ceph-mgr-dashboard-19.0.0-119.ga62fda 7.0 MB/s | 1.8 MB 00:00 2023-12-11T20:02:10.115 INFO:teuthology.orchestra.run.smithi012.stdout:(30/132): ceph-radosgw-19.0.0-119.ga62fda73.el8 2.2 MB/s | 14 MB 00:06 2023-12-11T20:02:10.150 INFO:teuthology.orchestra.run.smithi039.stdout:(97/132): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-12-11T20:02:10.199 INFO:teuthology.orchestra.run.smithi012.stdout:(31/132): ceph-mgr-modules-core-19.0.0-119.ga62 2.9 MB/s | 243 kB 00:00 2023-12-11T20:02:10.208 INFO:teuthology.orchestra.run.smithi039.stdout:(98/132): jq-1.6-3.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-12-11T20:02:10.241 INFO:teuthology.orchestra.run.smithi012.stdout:(32/132): ceph-mgr-rook-19.0.0-119.ga62fda73.el 1.2 MB/s | 50 kB 00:00 2023-12-11T20:02:10.291 INFO:teuthology.orchestra.run.smithi012.stdout:(33/132): ceph-prometheus-alerts-19.0.0-119.ga6 301 kB/s | 15 kB 00:00 2023-12-11T20:02:10.317 INFO:teuthology.orchestra.run.smithi039.stdout:(99/132): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-12-11T20:02:10.359 INFO:teuthology.orchestra.run.smithi039.stdout:(100/132): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-12-11T20:02:10.392 INFO:teuthology.orchestra.run.smithi012.stdout:(34/132): ceph-volume-19.0.0-119.ga62fda73.el8. 2.6 MB/s | 262 kB 00:00 2023-12-11T20:02:10.501 INFO:teuthology.orchestra.run.smithi039.stdout:(101/132): postgresql-server-10.21-2.module+el8 17 MB/s | 5.1 MB 00:00 2023-12-11T20:02:10.543 INFO:teuthology.orchestra.run.smithi039.stdout:(102/132): postgresql-contrib-10.21-2.module+el 3.5 MB/s | 808 kB 00:00 2023-12-11T20:02:10.550 INFO:teuthology.orchestra.run.smithi012.stdout:(35/132): cephadm-19.0.0-119.ga62fda73.el8.noar 2.6 MB/s | 415 kB 00:00 2023-12-11T20:02:10.577 INFO:teuthology.orchestra.run.smithi039.stdout:(103/132): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2023-12-11T20:02:10.619 INFO:teuthology.orchestra.run.smithi039.stdout:(104/132): postgresql-10.21-2.module+el8.6.0+15 5.8 MB/s | 1.5 MB 00:00 2023-12-11T20:02:10.619 INFO:teuthology.orchestra.run.smithi012.stdout:(36/132): cephfs-top-19.0.0-119.ga62fda73.el8.n 265 kB/s | 18 kB 00:00 2023-12-11T20:02:10.677 INFO:teuthology.orchestra.run.smithi039.stdout:(105/132): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2023-12-11T20:02:10.703 INFO:teuthology.orchestra.run.smithi039.stdout:(106/132): python3-jwt-1.6.1-2.el8.noarch.rpm 339 kB/s | 43 kB 00:00 2023-12-11T20:02:10.745 INFO:teuthology.orchestra.run.smithi039.stdout:(107/132): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-12-11T20:02:10.770 INFO:teuthology.orchestra.run.smithi039.stdout:(108/132): keyutils-libs-devel-1.5.10-9.el8.x86 521 kB/s | 48 kB 00:00 2023-12-11T20:02:10.795 INFO:teuthology.orchestra.run.smithi039.stdout:(109/132): libsepol-devel-2.9-3.el8.x86_64.rpm 943 kB/s | 87 kB 00:00 2023-12-11T20:02:10.821 INFO:teuthology.orchestra.run.smithi039.stdout:(110/132): python3-requests-oauthlib-1.0.0-1.el 566 kB/s | 43 kB 00:00 2023-12-11T20:02:10.846 INFO:teuthology.orchestra.run.smithi039.stdout:(111/132): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-12-11T20:02:10.871 INFO:teuthology.orchestra.run.smithi039.stdout:(112/132): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-12-11T20:02:10.926 INFO:teuthology.orchestra.run.smithi012.stdout:(37/132): ceph-mgr-diskprediction-local-19.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-12-11T20:02:10.930 INFO:teuthology.orchestra.run.smithi039.stdout:(113/132): libaio-devel-0.3.112-1.el8.x86_64.rp 224 kB/s | 19 kB 00:00 2023-12-11T20:02:10.955 INFO:teuthology.orchestra.run.smithi039.stdout:(114/132): python3-oauthlib-2.1.0-1.el8.noarch. 1.8 MB/s | 155 kB 00:00 2023-12-11T20:02:10.988 INFO:teuthology.orchestra.run.smithi039.stdout:(115/132): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-12-11T20:02:11.005 INFO:teuthology.orchestra.run.smithi039.stdout:(116/132): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-12-11T20:02:11.013 INFO:teuthology.orchestra.run.smithi032.stdout:(30/132): ceph-mgr-diskprediction-local-19.0.0- 8.1 MB/s | 7.4 MB 00:00 2023-12-11T20:02:11.039 INFO:teuthology.orchestra.run.smithi039.stdout:(117/132): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-12-11T20:02:11.073 INFO:teuthology.orchestra.run.smithi039.stdout:(118/132): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-12-11T20:02:11.080 INFO:teuthology.orchestra.run.smithi032.stdout:(31/132): ceph-mgr-modules-core-19.0.0-119.ga62 3.6 MB/s | 243 kB 00:00 2023-12-11T20:02:11.107 INFO:teuthology.orchestra.run.smithi039.stdout:(119/132): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-12-11T20:02:11.125 INFO:teuthology.orchestra.run.smithi032.stdout:(32/132): ceph-mgr-rook-19.0.0-119.ga62fda73.el 1.2 MB/s | 50 kB 00:00 2023-12-11T20:02:11.131 INFO:teuthology.orchestra.run.smithi039.stdout:(120/132): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-12-11T20:02:11.156 INFO:teuthology.orchestra.run.smithi032.stdout:(33/132): ceph-prometheus-alerts-19.0.0-119.ga6 448 kB/s | 15 kB 00:00 2023-12-11T20:02:11.157 INFO:teuthology.orchestra.run.smithi039.stdout:(121/132): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-12-11T20:02:11.161 INFO:teuthology.orchestra.run.smithi012.stdout:(38/132): gperftools-libs-2.7-9.el8.x86_64.rpm 565 kB/s | 306 kB 00:00 2023-12-11T20:02:11.187 INFO:teuthology.orchestra.run.smithi012.stdout:(39/132): liboath-2.6.2-3.el8.x86_64.rpm 226 kB/s | 59 kB 00:00 2023-12-11T20:02:11.190 INFO:teuthology.orchestra.run.smithi039.stdout:(122/132): elfutils-libelf-devel-0.186-1.el8.x8 1.0 MB/s | 60 kB 00:00 2023-12-11T20:02:11.206 INFO:teuthology.orchestra.run.smithi032.stdout:(34/132): ceph-volume-19.0.0-119.ga62fda73.el8. 5.1 MB/s | 262 kB 00:00 2023-12-11T20:02:11.216 INFO:teuthology.orchestra.run.smithi039.stdout:(123/132): libuuid-devel-2.32.1-35.el8.x86_64.r 1.6 MB/s | 98 kB 00:00 2023-12-11T20:02:11.241 INFO:teuthology.orchestra.run.smithi039.stdout:(124/132): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-12-11T20:02:11.270 INFO:teuthology.orchestra.run.smithi012.stdout:(40/132): libunwind-1.3.1-3.el8.x86_64.rpm 692 kB/s | 75 kB 00:00 2023-12-11T20:02:11.283 INFO:teuthology.orchestra.run.smithi039.stdout:(125/132): libcom_err-devel-1.45.6-4.el8.x86_64 578 kB/s | 39 kB 00:00 2023-12-11T20:02:11.328 INFO:teuthology.orchestra.run.smithi032.stdout:(35/132): cephadm-19.0.0-119.ga62fda73.el8.noar 3.4 MB/s | 415 kB 00:00 2023-12-11T20:02:11.342 INFO:teuthology.orchestra.run.smithi039.stdout:(126/132): openssl-devel-1.1.1k-7.el8_6.x86_64. 7.7 MB/s | 2.3 MB 00:00 2023-12-11T20:02:11.354 INFO:teuthology.orchestra.run.smithi012.stdout:(41/132): luarocks-3.5.0-1.el8.noarch.rpm 1.0 MB/s | 167 kB 00:00 2023-12-11T20:02:11.382 INFO:teuthology.orchestra.run.smithi032.stdout:(36/132): cephfs-top-19.0.0-119.ga62fda73.el8.n 335 kB/s | 18 kB 00:00 2023-12-11T20:02:11.430 INFO:teuthology.orchestra.run.smithi012.stdout:(42/132): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 582 kB/s | 44 kB 00:00 2023-12-11T20:02:11.546 INFO:teuthology.orchestra.run.smithi012.stdout:(43/132): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-12-11T20:02:11.575 INFO:teuthology.orchestra.run.smithi039.stdout:(127/132): libgfortran-8.5.0-10.1.el8_6.x86_64. 1.9 MB/s | 644 kB 00:00 2023-12-11T20:02:11.580 INFO:teuthology.orchestra.run.smithi012.stdout:(44/132): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-12-11T20:02:11.622 INFO:teuthology.orchestra.run.smithi012.stdout:(45/132): python3-cachetools-3.1.1-4.el8.noarch 441 kB/s | 33 kB 00:00 2023-12-11T20:02:11.656 INFO:teuthology.orchestra.run.smithi012.stdout:(46/132): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-12-11T20:02:11.692 INFO:teuthology.orchestra.run.smithi039.stdout:(128/132): NetworkManager-initscripts-updown-1. 393 kB/s | 138 kB 00:00 2023-12-11T20:02:11.714 INFO:teuthology.orchestra.run.smithi012.stdout:(47/132): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-12-11T20:02:11.718 INFO:teuthology.orchestra.run.smithi039.stdout:(129/132): libquadmath-8.5.0-10.1.el8_6.x86_64. 394 kB/s | 171 kB 00:00 2023-12-11T20:02:11.789 INFO:teuthology.orchestra.run.smithi012.stdout:(48/132): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-12-11T20:02:11.799 INFO:teuthology.orchestra.run.smithi032.stdout:(37/132): gperftools-libs-2.7-9.el8.x86_64.rpm 736 kB/s | 306 kB 00:00 2023-12-11T20:02:11.857 INFO:teuthology.orchestra.run.smithi012.stdout:(49/132): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2023-12-11T20:02:11.858 INFO:teuthology.orchestra.run.smithi032.stdout:(38/132): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-12-11T20:02:11.876 INFO:teuthology.orchestra.run.smithi039.stdout:(130/132): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.9 MB/s | 798 kB 00:00 2023-12-11T20:02:11.882 INFO:teuthology.orchestra.run.smithi012.stdout:(50/132): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-12-11T20:02:11.916 INFO:teuthology.orchestra.run.smithi032.stdout:(39/132): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-12-11T20:02:11.932 INFO:teuthology.orchestra.run.smithi012.stdout:(51/132): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-12-11T20:02:12.016 INFO:teuthology.orchestra.run.smithi012.stdout:(52/132): python3-logutils-0.3.5-11.el8.noarch. 586 kB/s | 49 kB 00:00 2023-12-11T20:02:12.091 INFO:teuthology.orchestra.run.smithi012.stdout:(53/132): python3-kubernetes-11.0.0-6.el8.noarc 5.6 MB/s | 1.2 MB 00:00 2023-12-11T20:02:12.117 INFO:teuthology.orchestra.run.smithi012.stdout:(54/132): python3-more-itertools-7.2.0-3.el8.no 586 kB/s | 59 kB 00:00 2023-12-11T20:02:12.146 INFO:teuthology.orchestra.run.smithi039.stdout:(131/132): librbd1-19.0.0-119.ga62fda73.el8.x86 8.2 MB/s | 3.7 MB 00:00 2023-12-11T20:02:12.158 INFO:teuthology.orchestra.run.smithi012.stdout:(55/132): python3-natsort-7.1.1-2.el8.noarch.rp 906 kB/s | 60 kB 00:00 2023-12-11T20:02:12.226 INFO:teuthology.orchestra.run.smithi012.stdout:(56/132): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-12-11T20:02:12.268 INFO:teuthology.orchestra.run.smithi012.stdout:(57/132): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-12-11T20:02:12.293 INFO:teuthology.orchestra.run.smithi012.stdout:(58/132): python3-repoze-lru-0.7-6.el8.noarch.r 505 kB/s | 34 kB 00:00 2023-12-11T20:02:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:(59/132): python3-rsa-4.9-2.el8.noarch.rpm 959 kB/s | 64 kB 00:00 2023-12-11T20:02:12.393 INFO:teuthology.orchestra.run.smithi012.stdout:(60/132): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-12-11T20:02:12.427 INFO:teuthology.orchestra.run.smithi012.stdout:(61/132): python3-simplegeneric-0.8.1-17.el8.no 281 kB/s | 19 kB 00:00 2023-12-11T20:02:12.447 INFO:teuthology.orchestra.run.smithi032.stdout:(40/132): ceph-test-19.0.0-119.ga62fda73.el8.x8 7.0 MB/s | 49 MB 00:07 2023-12-11T20:02:12.469 INFO:teuthology.orchestra.run.smithi012.stdout:(62/132): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-12-11T20:02:12.484 INFO:teuthology.orchestra.run.smithi032.stdout:(41/132): luarocks-3.5.0-1.el8.noarch.rpm 294 kB/s | 167 kB 00:00 2023-12-11T20:02:12.486 INFO:teuthology.orchestra.run.smithi012.stdout:(63/132): python3-tempora-1.14.1-5.el8.noarch.r 498 kB/s | 29 kB 00:00 2023-12-11T20:02:12.543 INFO:teuthology.orchestra.run.smithi032.stdout:(42/132): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 752 kB/s | 44 kB 00:00 2023-12-11T20:02:12.578 INFO:teuthology.orchestra.run.smithi012.stdout:(64/132): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2023-12-11T20:02:12.626 INFO:teuthology.orchestra.run.smithi032.stdout:(43/132): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-12-11T20:02:12.636 INFO:teuthology.orchestra.run.smithi012.stdout:(65/132): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2023-12-11T20:02:12.685 INFO:teuthology.orchestra.run.smithi032.stdout:(44/132): python3-cachetools-3.1.1-4.el8.noarch 568 kB/s | 33 kB 00:00 2023-12-11T20:02:12.704 INFO:teuthology.orchestra.run.smithi012.stdout:(66/132): python3-websocket-client-0.56.0-5.el8 913 kB/s | 61 kB 00:00 2023-12-11T20:02:12.729 INFO:teuthology.orchestra.run.smithi012.stdout:(67/132): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-12-11T20:02:12.771 INFO:teuthology.orchestra.run.smithi012.stdout:(68/132): python3-webtest-2.0.33-1.el8.noarch.r 1.3 MB/s | 85 kB 00:00 2023-12-11T20:02:12.802 INFO:teuthology.orchestra.run.smithi032.stdout:(45/132): python3-certifi-2018.10.15-7.el8.noar 140 kB/s | 16 kB 00:00 2023-12-11T20:02:12.804 INFO:teuthology.orchestra.run.smithi012.stdout:(69/132): python3-zc-lockfile-2.0-2.el8.noarch. 306 kB/s | 23 kB 00:00 2023-12-11T20:02:12.830 INFO:teuthology.orchestra.run.smithi012.stdout:(70/132): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-12-11T20:02:12.868 INFO:teuthology.orchestra.run.smithi039.stdout:(132/132): librados2-19.0.0-119.ga62fda73.el8.x 2.9 MB/s | 3.8 MB 00:01 2023-12-11T20:02:12.869 INFO:teuthology.orchestra.run.smithi032.stdout:(46/132): python3-asyncssh-2.7.0-2.el8.noarch.r 1.1 MB/s | 476 kB 00:00 2023-12-11T20:02:12.871 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2023-12-11T20:02:12.872 INFO:teuthology.orchestra.run.smithi039.stdout:Total 13 MB/s | 209 MB 00:15 2023-12-11T20:02:12.894 INFO:teuthology.orchestra.run.smithi032.stdout:(47/132): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-12-11T20:02:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:(71/132): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-12-11T20:02:12.980 INFO:teuthology.orchestra.run.smithi012.stdout:(72/132): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-12-11T20:02:13.031 INFO:teuthology.orchestra.run.smithi012.stdout:(73/132): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-12-11T20:02:13.045 INFO:teuthology.orchestra.run.smithi032.stdout:(48/132): ceph-radosgw-19.0.0-119.ga62fda73.el8 1.4 MB/s | 14 MB 00:09 2023-12-11T20:02:13.070 INFO:teuthology.orchestra.run.smithi032.stdout:(49/132): python3-google-auth-1.1.1-10.el8.noar 463 kB/s | 81 kB 00:00 2023-12-11T20:02:13.090 INFO:teuthology.orchestra.run.smithi012.stdout:(74/132): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.4 MB/s | 259 kB 00:00 2023-12-11T20:02:13.095 INFO:teuthology.orchestra.run.smithi032.stdout:(50/132): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-12-11T20:02:13.121 INFO:teuthology.orchestra.run.smithi032.stdout:(51/132): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-12-11T20:02:13.140 INFO:teuthology.orchestra.run.smithi012.stdout:(75/132): socat-1.7.4.1-1.el8.x86_64.rpm 6.4 MB/s | 323 kB 00:00 2023-12-11T20:02:13.146 INFO:teuthology.orchestra.run.smithi032.stdout:(52/132): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-12-11T20:02:13.180 INFO:teuthology.orchestra.run.smithi032.stdout:(53/132): python3-logutils-0.3.5-11.el8.noarch. 830 kB/s | 49 kB 00:00 2023-12-11T20:02:13.223 INFO:teuthology.orchestra.run.smithi012.stdout:(76/132): python3-markupsafe-0.23-19.el8.x86_64 468 kB/s | 39 kB 00:00 2023-12-11T20:02:13.246 INFO:teuthology.orchestra.run.smithi032.stdout:(54/132): python3-kubernetes-11.0.0-6.el8.noarc 7.7 MB/s | 1.2 MB 00:00 2023-12-11T20:02:13.272 INFO:teuthology.orchestra.run.smithi032.stdout:(55/132): python3-more-itertools-7.2.0-3.el8.no 467 kB/s | 59 kB 00:00 2023-12-11T20:02:13.297 INFO:teuthology.orchestra.run.smithi032.stdout:(56/132): python3-natsort-7.1.1-2.el8.noarch.rp 515 kB/s | 60 kB 00:00 2023-12-11T20:02:13.298 INFO:teuthology.orchestra.run.smithi012.stdout:(77/132): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-12-11T20:02:13.322 INFO:teuthology.orchestra.run.smithi032.stdout:(57/132): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-12-11T20:02:13.348 INFO:teuthology.orchestra.run.smithi032.stdout:(58/132): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-12-11T20:02:13.357 INFO:teuthology.orchestra.run.smithi012.stdout:(78/132): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2023-12-11T20:02:13.373 INFO:teuthology.orchestra.run.smithi032.stdout:(59/132): python3-repoze-lru-0.7-6.el8.noarch.r 445 kB/s | 34 kB 00:00 2023-12-11T20:02:13.398 INFO:teuthology.orchestra.run.smithi032.stdout:(60/132): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2023-12-11T20:02:13.416 INFO:teuthology.orchestra.run.smithi012.stdout:(79/132): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-12-11T20:02:13.423 INFO:teuthology.orchestra.run.smithi032.stdout:(61/132): python3-rsa-4.9-2.el8.noarch.rpm 851 kB/s | 64 kB 00:00 2023-12-11T20:02:13.440 INFO:teuthology.orchestra.run.smithi032.stdout:(62/132): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2023-12-11T20:02:13.458 INFO:teuthology.orchestra.run.smithi032.stdout:(63/132): python3-singledispatch-3.4.0.3-18.el8 404 kB/s | 24 kB 00:00 2023-12-11T20:02:13.474 INFO:teuthology.orchestra.run.smithi032.stdout:(64/132): python3-tempora-1.14.1-5.el8.noarch.r 579 kB/s | 29 kB 00:00 2023-12-11T20:02:13.500 INFO:teuthology.orchestra.run.smithi032.stdout:(65/132): python3-trustme-0.6.0-4.el8.noarch.rp 468 kB/s | 27 kB 00:00 2023-12-11T20:02:13.534 INFO:teuthology.orchestra.run.smithi032.stdout:(66/132): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-12-11T20:02:13.586 INFO:teuthology.orchestra.run.smithi032.stdout:(67/132): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-12-11T20:02:13.591 INFO:teuthology.orchestra.run.smithi012.stdout:(80/132): python3-scipy-1.0.0-21.module+el8.5.0 18 MB/s | 14 MB 00:00 2023-12-11T20:02:13.618 INFO:teuthology.orchestra.run.smithi032.stdout:(68/132): python3-websocket-client-0.56.0-5.el8 521 kB/s | 61 kB 00:00 2023-12-11T20:02:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:(81/132): oniguruma-6.8.2-2.el8.x86_64.rpm 898 kB/s | 187 kB 00:00 2023-12-11T20:02:13.643 INFO:teuthology.orchestra.run.smithi032.stdout:(69/132): python3-webtest-2.0.33-1.el8.noarch.r 783 kB/s | 85 kB 00:00 2023-12-11T20:02:13.677 INFO:teuthology.orchestra.run.smithi032.stdout:(70/132): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 70 kB 00:00 2023-12-11T20:02:13.702 INFO:teuthology.orchestra.run.smithi032.stdout:(71/132): python3-zc-lockfile-2.0-2.el8.noarch. 198 kB/s | 23 kB 00:00 2023-12-11T20:02:13.725 INFO:teuthology.orchestra.run.smithi012.stdout:(82/132): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2023-12-11T20:02:13.819 INFO:teuthology.orchestra.run.smithi032.stdout:(72/132): librabbitmq-0.9.0-3.el8.x86_64.rpm 330 kB/s | 47 kB 00:00 2023-12-11T20:02:13.834 INFO:teuthology.orchestra.run.smithi012.stdout:(83/132): python3-jsonpatch-1.21-2.el8.noarch.r 245 kB/s | 27 kB 00:00 2023-12-11T20:02:13.853 INFO:teuthology.orchestra.run.smithi032.stdout:(73/132): libselinux-devel-2.9-5.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2023-12-11T20:02:13.894 INFO:teuthology.orchestra.run.smithi032.stdout:(74/132): thrift-0.13.0-2.el8.x86_64.rpm 6.3 MB/s | 1.7 MB 00:00 2023-12-11T20:02:13.920 INFO:teuthology.orchestra.run.smithi032.stdout:(75/132): python3-jwt-1.6.1-2.el8.noarch.rpm 425 kB/s | 43 kB 00:00 2023-12-11T20:02:13.926 INFO:teuthology.orchestra.run.smithi012.stdout:(84/132): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-12-11T20:02:13.959 INFO:teuthology.orchestra.run.smithi012.stdout:(85/132): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2023-12-11T20:02:13.987 INFO:teuthology.orchestra.run.smithi032.stdout:(76/132): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-12-11T20:02:14.035 INFO:teuthology.orchestra.run.smithi012.stdout:(86/132): python3-prettytable-0.7.2-14.el8.noar 406 kB/s | 44 kB 00:00 2023-12-11T20:02:14.045 INFO:teuthology.orchestra.run.smithi032.stdout:(77/132): libsepol-devel-2.9-3.el8.x86_64.rpm 746 kB/s | 87 kB 00:00 2023-12-11T20:02:14.087 INFO:teuthology.orchestra.run.smithi032.stdout:(78/132): keyutils-libs-devel-1.5.10-9.el8.x86_ 250 kB/s | 48 kB 00:00 2023-12-11T20:02:14.113 INFO:teuthology.orchestra.run.smithi032.stdout:(79/132): python3-requests-oauthlib-1.0.0-1.el8 341 kB/s | 43 kB 00:00 2023-12-11T20:02:14.138 INFO:teuthology.orchestra.run.smithi032.stdout:(80/132): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2023-12-11T20:02:14.169 INFO:teuthology.orchestra.run.smithi012.stdout:(87/132): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-12-11T20:02:14.230 INFO:teuthology.orchestra.run.smithi032.stdout:(81/132): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-12-11T20:02:14.255 INFO:teuthology.orchestra.run.smithi032.stdout:(82/132): libaio-devel-0.3.112-1.el8.x86_64.rpm 160 kB/s | 19 kB 00:00 2023-12-11T20:02:14.289 INFO:teuthology.orchestra.run.smithi032.stdout:(83/132): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.1 MB/s | 560 kB 00:00 2023-12-11T20:02:14.356 INFO:teuthology.orchestra.run.smithi032.stdout:(84/132): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2023-12-11T20:02:14.381 INFO:teuthology.orchestra.run.smithi032.stdout:(85/132): libverto-devel-0.3.0-5.el8.x86_64.rpm 195 kB/s | 18 kB 00:00 2023-12-11T20:02:14.415 INFO:teuthology.orchestra.run.smithi032.stdout:(86/132): python3-cryptography-3.2.1-5.el8.x86_ 3.4 MB/s | 559 kB 00:00 2023-12-11T20:02:14.457 INFO:teuthology.orchestra.run.smithi012.stdout:(88/132): python3-numpy-1.14.3-10.el8.x86_64.rp 7.5 MB/s | 3.7 MB 00:00 2023-12-11T20:02:14.499 INFO:teuthology.orchestra.run.smithi032.stdout:(87/132): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2023-12-11T20:02:14.532 INFO:teuthology.orchestra.run.smithi032.stdout:(88/132): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2023-12-11T20:02:14.584 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2023-12-11T20:02:14.616 INFO:teuthology.orchestra.run.smithi032.stdout:(89/132): openssl-devel-1.1.1k-7.el8_6.x86_64.r 12 MB/s | 2.3 MB 00:00 2023-12-11T20:02:14.641 INFO:teuthology.orchestra.run.smithi032.stdout:(90/132): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 509 kB/s | 72 kB 00:00 2023-12-11T20:02:14.666 INFO:teuthology.orchestra.run.smithi032.stdout:(91/132): fuse-2.9.7-15.el8.x86_64.rpm 619 kB/s | 83 kB 00:00 2023-12-11T20:02:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:(89/132): python3-numpy-f2py-1.14.3-10.el8.x86_ 450 kB/s | 225 kB 00:00 2023-12-11T20:02:14.695 INFO:teuthology.orchestra.run.smithi012.stdout:(90/132): uuid-1.6.2-43.el8.x86_64.rpm 270 kB/s | 64 kB 00:00 2023-12-11T20:02:14.733 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2023-12-11T20:02:14.733 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2023-12-11T20:02:14.775 INFO:teuthology.orchestra.run.smithi032.stdout:(92/132): elfutils-libelf-devel-0.186-1.el8.x86 377 kB/s | 60 kB 00:00 2023-12-11T20:02:14.826 INFO:teuthology.orchestra.run.smithi032.stdout:(93/132): libuuid-devel-2.32.1-35.el8.x86_64.rp 533 kB/s | 98 kB 00:00 2023-12-11T20:02:14.843 INFO:teuthology.orchestra.run.smithi032.stdout:(94/132): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 328 kB/s | 58 kB 00:00 2023-12-11T20:02:14.862 INFO:teuthology.orchestra.run.smithi012.stdout:(91/132): python3-jsonpointer-1.10-11.el8.noarc 120 kB/s | 20 kB 00:00 2023-12-11T20:02:14.895 INFO:teuthology.orchestra.run.smithi012.stdout:(92/132): python3-pyasn1-0.3.7-6.el8.noarch.rpm 561 kB/s | 126 kB 00:00 2023-12-11T20:02:14.910 INFO:teuthology.orchestra.run.smithi032.stdout:(95/132): libcom_err-devel-1.45.6-4.el8.x86_64. 288 kB/s | 39 kB 00:00 2023-12-11T20:02:14.952 INFO:teuthology.orchestra.run.smithi032.stdout:(96/132): libgfortran-8.5.0-10.1.el8_6.x86_64.r 5.0 MB/s | 644 kB 00:00 2023-12-11T20:02:14.979 INFO:teuthology.orchestra.run.smithi012.stdout:(93/132): python3-pyOpenSSL-19.0.0-1.el8.noarch 886 kB/s | 103 kB 00:00 2023-12-11T20:02:15.035 INFO:teuthology.orchestra.run.smithi032.stdout:(97/132): NetworkManager-initscripts-updown-1.3 1.1 MB/s | 138 kB 00:00 2023-12-11T20:02:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:(94/132): libtool-2.4.6-25.el8.x86_64.rpm 3.8 MB/s | 709 kB 00:00 2023-12-11T20:02:15.094 INFO:teuthology.orchestra.run.smithi032.stdout:(98/132): libquadmath-8.5.0-10.1.el8_6.x86_64.r 682 kB/s | 171 kB 00:00 2023-12-11T20:02:15.169 INFO:teuthology.orchestra.run.smithi032.stdout:(99/132): python3-pyasn1-modules-0.3.7-6.el8.no 825 kB/s | 110 kB 00:00 2023-12-11T20:02:15.194 INFO:teuthology.orchestra.run.smithi032.stdout:(100/132): python3-pytz-2017.2-9.el8.noarch.rpm 541 kB/s | 54 kB 00:00 2023-12-11T20:02:15.261 INFO:teuthology.orchestra.run.smithi032.stdout:(101/132): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-12-11T20:02:15.320 INFO:teuthology.orchestra.run.smithi032.stdout:(102/132): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-12-11T20:02:15.362 INFO:teuthology.orchestra.run.smithi032.stdout:(103/132): python3-markupsafe-0.23-19.el8.x86_6 387 kB/s | 39 kB 00:00 2023-12-11T20:02:15.479 INFO:teuthology.orchestra.run.smithi032.stdout:(104/132): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2023-12-11T20:02:15.638 INFO:teuthology.orchestra.run.smithi032.stdout:(105/132): python3-scipy-1.0.0-21.module+el8.5. 20 MB/s | 14 MB 00:00 2023-12-11T20:02:15.638 INFO:teuthology.orchestra.run.smithi012.stdout:(95/132): ceph-test-19.0.0-119.ga62fda73.el8.x8 4.9 MB/s | 49 MB 00:10 2023-12-11T20:02:15.663 INFO:teuthology.orchestra.run.smithi032.stdout:(106/132): python3-mako-1.0.6-13.el8.noarch.rpm 856 kB/s | 157 kB 00:00 2023-12-11T20:02:15.671 INFO:teuthology.orchestra.run.smithi012.stdout:(96/132): libpq-13.5-1.el8.x86_64.rpm 334 kB/s | 198 kB 00:00 2023-12-11T20:02:15.688 INFO:teuthology.orchestra.run.smithi032.stdout:(107/132): python3-jinja2-2.10.1-3.el8.noarch.r 1.6 MB/s | 538 kB 00:00 2023-12-11T20:02:15.772 INFO:teuthology.orchestra.run.smithi032.stdout:(108/132): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-12-11T20:02:15.788 INFO:teuthology.orchestra.run.smithi012.stdout:(97/132): openblas-threads-0.3.15-3.el8.x86_64. 6.0 MB/s | 4.9 MB 00:00 2023-12-11T20:02:15.831 INFO:teuthology.orchestra.run.smithi012.stdout:(98/132): jq-1.6-3.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2023-12-11T20:02:15.873 INFO:teuthology.orchestra.run.smithi032.stdout:(109/132): python3-jsonpatch-1.21-2.el8.noarch. 265 kB/s | 27 kB 00:00 2023-12-11T20:02:15.956 INFO:teuthology.orchestra.run.smithi032.stdout:(110/132): automake-1.16.1-7.el8.noarch.rpm 2.4 MB/s | 713 kB 00:00 2023-12-11T20:02:15.956 INFO:teuthology.orchestra.run.smithi012.stdout:(99/132): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2023-12-11T20:02:16.006 INFO:teuthology.orchestra.run.smithi032.stdout:(111/132): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-12-11T20:02:16.031 INFO:teuthology.orchestra.run.smithi012.stdout:(100/132): openblas-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-12-11T20:02:16.082 INFO:teuthology.orchestra.run.smithi032.stdout:(112/132): python3-prettytable-0.7.2-14.el8.noa 351 kB/s | 44 kB 00:00 2023-12-11T20:02:16.090 INFO:teuthology.orchestra.run.smithi012.stdout:(101/132): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-12-11T20:02:16.182 INFO:teuthology.orchestra.run.smithi012.stdout:(102/132): postgresql-10.21-2.module+el8.6.0+15 10 MB/s | 1.5 MB 00:00 2023-12-11T20:02:16.215 INFO:teuthology.orchestra.run.smithi032.stdout:(113/132): python3-babel-2.5.1-7.el8.noarch.rpm 9.1 MB/s | 4.8 MB 00:00 2023-12-11T20:02:16.274 INFO:teuthology.orchestra.run.smithi012.stdout:(103/132): postgresql-server-10.21-2.module+el8 11 MB/s | 5.1 MB 00:00 2023-12-11T20:02:16.299 INFO:teuthology.orchestra.run.smithi012.stdout:(104/132): librabbitmq-0.9.0-3.el8.x86_64.rpm 224 kB/s | 47 kB 00:00 2023-12-11T20:02:16.332 INFO:teuthology.orchestra.run.smithi032.stdout:(114/132): python3-numpy-1.14.3-10.el8.x86_64.r 11 MB/s | 3.7 MB 00:00 2023-12-11T20:02:16.357 INFO:teuthology.orchestra.run.smithi012.stdout:(105/132): libselinux-devel-2.9-5.el8.x86_64.rp 1.1 MB/s | 200 kB 00:00 2023-12-11T20:02:16.366 INFO:teuthology.orchestra.run.smithi032.stdout:(115/132): python3-werkzeug-0.12.2-4.el8.noarch 1.6 MB/s | 457 kB 00:00 2023-12-11T20:02:16.391 INFO:teuthology.orchestra.run.smithi032.stdout:(116/132): python3-numpy-f2py-1.14.3-10.el8.x86 1.3 MB/s | 225 kB 00:00 2023-12-11T20:02:16.399 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2023-12-11T20:02:16.399 INFO:teuthology.orchestra.run.smithi012.stdout:(106/132): python3-jwt-1.6.1-2.el8.noarch.rpm 340 kB/s | 43 kB 00:00 2023-12-11T20:02:16.404 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2023-12-11T20:02:16.466 INFO:teuthology.orchestra.run.smithi012.stdout:(107/132): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2023-12-11T20:02:16.483 INFO:teuthology.orchestra.run.smithi032.stdout:(117/132): uuid-1.6.2-43.el8.x86_64.rpm 426 kB/s | 64 kB 00:00 2023-12-11T20:02:16.508 INFO:teuthology.orchestra.run.smithi012.stdout:(108/132): keyutils-libs-devel-1.5.10-9.el8.x86 319 kB/s | 48 kB 00:00 2023-12-11T20:02:16.550 INFO:teuthology.orchestra.run.smithi012.stdout:(109/132): python3-requests-oauthlib-1.0.0-1.el 510 kB/s | 43 kB 00:00 2023-12-11T20:02:16.575 INFO:teuthology.orchestra.run.smithi032.stdout:(118/132): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.1 MB/s | 103 kB 00:00 2023-12-11T20:02:16.584 INFO:teuthology.orchestra.run.smithi012.stdout:(110/132): libsepol-devel-2.9-3.el8.x86_64.rpm 472 kB/s | 87 kB 00:00 2023-12-11T20:02:16.600 INFO:teuthology.orchestra.run.smithi032.stdout:(119/132): python3-jsonpointer-1.10-11.el8.noar 96 kB/s | 20 kB 00:00 2023-12-11T20:02:16.625 INFO:teuthology.orchestra.run.smithi032.stdout:(120/132): python3-pyasn1-0.3.7-6.el8.noarch.rp 487 kB/s | 126 kB 00:00 2023-12-11T20:02:16.668 INFO:teuthology.orchestra.run.smithi012.stdout:(111/132): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-12-11T20:02:16.684 INFO:teuthology.orchestra.run.smithi032.stdout:(121/132): libtool-2.4.6-25.el8.x86_64.rpm 6.3 MB/s | 709 kB 00:00 2023-12-11T20:02:16.709 INFO:teuthology.orchestra.run.smithi012.stdout:(112/132): python3-pycparser-2.14-14.el8.noarch 543 kB/s | 109 kB 00:00 2023-12-11T20:02:16.726 INFO:teuthology.orchestra.run.smithi032.stdout:(122/132): libpq-13.5-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-12-11T20:02:16.751 INFO:teuthology.orchestra.run.smithi012.stdout:(113/132): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-12-11T20:02:16.802 INFO:teuthology.orchestra.run.smithi012.stdout:(114/132): libaio-devel-0.3.112-1.el8.x86_64.rp 139 kB/s | 19 kB 00:00 2023-12-11T20:02:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:(115/132): python3-oauthlib-2.1.0-1.el8.noarch. 1.1 MB/s | 155 kB 00:00 2023-12-11T20:02:16.885 INFO:teuthology.orchestra.run.smithi032.stdout:(123/132): openblas-0.3.15-3.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2023-12-11T20:02:16.936 INFO:teuthology.orchestra.run.smithi012.stdout:(116/132): python3-cryptography-3.2.1-5.el8.x86 3.0 MB/s | 559 kB 00:00 2023-12-11T20:02:16.961 INFO:teuthology.orchestra.run.smithi012.stdout:(117/132): libverto-devel-0.3.0-5.el8.x86_64.rp 113 kB/s | 18 kB 00:00 2023-12-11T20:02:16.977 INFO:teuthology.orchestra.run.smithi032.stdout:(124/132): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-12-11T20:02:16.995 INFO:teuthology.orchestra.run.smithi012.stdout:(118/132): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-12-11T20:02:17.002 INFO:teuthology.orchestra.run.smithi032.stdout:(125/132): jq-1.6-3.el8.x86_64.rpm 734 kB/s | 202 kB 00:00 2023-12-11T20:02:17.044 INFO:teuthology.orchestra.run.smithi032.stdout:(126/132): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2023-12-11T20:02:17.070 INFO:teuthology.orchestra.run.smithi012.stdout:(119/132): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.7 MB/s | 238 kB 00:00 2023-12-11T20:02:17.103 INFO:teuthology.orchestra.run.smithi012.stdout:(120/132): xfsprogs-devel-5.0.0-10.el8.x86_64.r 667 kB/s | 72 kB 00:00 2023-12-11T20:02:17.178 INFO:teuthology.orchestra.run.smithi032.stdout:(127/132): postgresql-server-10.21-2.module+el8 25 MB/s | 5.1 MB 00:00 2023-12-11T20:02:17.204 INFO:teuthology.orchestra.run.smithi012.stdout:(121/132): openssl-devel-1.1.1k-7.el8_6.x86_64. 9.6 MB/s | 2.3 MB 00:00 2023-12-11T20:02:17.219 INFO:teuthology.orchestra.run.smithi032.stdout:(128/132): postgresql-contrib-10.21-2.module+el 3.6 MB/s | 808 kB 00:00 2023-12-11T20:02:17.229 INFO:teuthology.orchestra.run.smithi012.stdout:(122/132): elfutils-libelf-devel-0.186-1.el8.x8 478 kB/s | 60 kB 00:00 2023-12-11T20:02:17.255 INFO:teuthology.orchestra.run.smithi012.stdout:(123/132): fuse-2.9.7-15.el8.x86_64.rpm 449 kB/s | 83 kB 00:00 2023-12-11T20:02:17.280 INFO:teuthology.orchestra.run.smithi012.stdout:(124/132): libuuid-devel-2.32.1-35.el8.x86_64.r 1.3 MB/s | 98 kB 00:00 2023-12-11T20:02:17.292 INFO:teuthology.orchestra.run.smithi032.stdout:(129/132): postgresql-10.21-2.module+el8.6.0+15 6.1 MB/s | 1.5 MB 00:00 2023-12-11T20:02:17.355 INFO:teuthology.orchestra.run.smithi012.stdout:(125/132): zlib-devel-1.2.11-18.el8_5.x86_64.rp 459 kB/s | 58 kB 00:00 2023-12-11T20:02:17.430 INFO:teuthology.orchestra.run.smithi012.stdout:(126/132): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.2 MB/s | 644 kB 00:00 2023-12-11T20:02:17.454 INFO:teuthology.orchestra.run.smithi032.stdout:(130/132): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.8 MB/s | 798 kB 00:00 2023-12-11T20:02:17.455 INFO:teuthology.orchestra.run.smithi012.stdout:(127/132): libcom_err-devel-1.45.6-4.el8.x86_64 192 kB/s | 39 kB 00:00 2023-12-11T20:02:17.523 INFO:teuthology.orchestra.run.smithi012.stdout:(128/132): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.0 MB/s | 171 kB 00:00 2023-12-11T20:02:17.598 INFO:teuthology.orchestra.run.smithi012.stdout:(129/132): NetworkManager-initscripts-updown-1. 824 kB/s | 138 kB 00:00 2023-12-11T20:02:17.729 INFO:teuthology.orchestra.run.smithi032.stdout:(131/132): librbd1-19.0.0-119.ga62fda73.el8.x86 7.3 MB/s | 3.7 MB 00:00 2023-12-11T20:02:17.773 INFO:teuthology.orchestra.run.smithi012.stdout:(130/132): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.5 MB/s | 798 kB 00:00 2023-12-11T20:02:17.915 INFO:teuthology.orchestra.run.smithi012.stdout:(131/132): librados2-19.0.0-119.ga62fda73.el8.x 8.2 MB/s | 3.8 MB 00:00 2023-12-11T20:02:18.138 INFO:teuthology.orchestra.run.smithi032.stdout:(132/132): librados2-19.0.0-119.ga62fda73.el8.x 3.9 MB/s | 3.8 MB 00:00 2023-12-11T20:02:18.140 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2023-12-11T20:02:18.140 INFO:teuthology.orchestra.run.smithi032.stdout:Total 11 MB/s | 209 MB 00:19 2023-12-11T20:02:18.207 INFO:teuthology.orchestra.run.smithi012.stdout:(132/132): librbd1-19.0.0-119.ga62fda73.el8.x86 5.4 MB/s | 3.7 MB 00:00 2023-12-11T20:02:18.210 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-12-11T20:02:18.211 INFO:teuthology.orchestra.run.smithi012.stdout:Total 11 MB/s | 209 MB 00:19 2023-12-11T20:02:19.862 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2023-12-11T20:02:19.952 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-12-11T20:02:20.012 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2023-12-11T20:02:20.013 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2023-12-11T20:02:20.102 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-12-11T20:02:20.102 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-12-11T20:02:21.559 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2023-12-11T20:02:21.626 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2023-12-11T20:02:21.631 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2023-12-11T20:02:21.726 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-12-11T20:02:21.731 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-12-11T20:02:21.991 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/135 2023-12-11T20:02:22.171 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/135 2023-12-11T20:02:22.418 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/135 2023-12-11T20:02:22.588 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/135 2023-12-11T20:02:22.720 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/135 2023-12-11T20:02:22.963 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/135 2023-12-11T20:02:23.463 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/135 2023-12-11T20:02:23.693 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:02:24.199 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:02:24.379 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:02:24.543 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:02:24.771 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 8/135 2023-12-11T20:02:24.881 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 8/135 2023-12-11T20:02:25.761 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 9/135 2023-12-11T20:02:25.938 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:02:26.079 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:02:26.332 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpq-13.5-1.el8.x86_64 11/135 2023-12-11T20:02:26.569 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/135 2023-12-11T20:02:27.036 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-12-11T20:02:27.092 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/135 2023-12-11T20:02:27.136 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2023-12-11T20:02:27.216 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/135 2023-12-11T20:02:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/135 2023-12-11T20:02:27.355 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/135 2023-12-11T20:02:27.427 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/135 2023-12-11T20:02:27.515 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/135 2023-12-11T20:02:27.545 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:02:27.629 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/135 2023-12-11T20:02:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/135 2023-12-11T20:02:27.683 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:02:27.790 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/135 2023-12-11T20:02:27.800 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/135 2023-12-11T20:02:27.973 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/135 2023-12-11T20:02:27.978 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/135 2023-12-11T20:02:27.995 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 16/135 2023-12-11T20:02:28.095 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 16/135 2023-12-11T20:02:28.184 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/135 2023-12-11T20:02:28.237 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/135 2023-12-11T20:02:28.408 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/135 2023-12-11T20:02:28.471 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/135 2023-12-11T20:02:28.562 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/135 2023-12-11T20:02:28.681 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/135 2023-12-11T20:02:28.729 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 5/135 2023-12-11T20:02:28.917 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:02:29.231 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 5/135 2023-12-11T20:02:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/135 2023-12-11T20:02:29.412 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:02:29.446 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:02:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/135 2023-12-11T20:02:29.571 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:02:29.779 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:02:29.816 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:02:29.900 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:02:29.982 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:02:30.076 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 8/135 2023-12-11T20:02:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/135 2023-12-11T20:02:30.200 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 8/135 2023-12-11T20:02:30.335 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 8/135 2023-12-11T20:02:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/135 2023-12-11T20:02:30.926 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/135 2023-12-11T20:02:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:02:31.194 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 9/135 2023-12-11T20:02:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:02:31.280 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/135 2023-12-11T20:02:31.401 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:02:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libpq-13.5-1.el8.x86_64 11/135 2023-12-11T20:02:31.501 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:02:31.520 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/135 2023-12-11T20:02:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/135 2023-12-11T20:02:31.734 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpq-13.5-1.el8.x86_64 11/135 2023-12-11T20:02:31.763 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/135 2023-12-11T20:02:31.977 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/135 2023-12-11T20:02:32.066 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/135 2023-12-11T20:02:32.097 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/135 2023-12-11T20:02:32.177 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/135 2023-12-11T20:02:32.321 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/135 2023-12-11T20:02:32.419 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/135 2023-12-11T20:02:32.453 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:02:32.526 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/135 2023-12-11T20:02:32.587 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:02:32.703 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/135 2023-12-11T20:02:32.768 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/135 2023-12-11T20:02:32.778 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 16/135 2023-12-11T20:02:32.878 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 27/135 2023-12-11T20:02:32.924 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:02:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 16/135 2023-12-11T20:02:33.025 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 28/135 2023-12-11T20:02:33.067 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:02:33.202 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/135 2023-12-11T20:02:33.232 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 16/135 2023-12-11T20:02:33.338 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 16/135 2023-12-11T20:02:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/135 2023-12-11T20:02:33.597 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 18/135 2023-12-11T20:02:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/135 2023-12-11T20:02:33.771 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 19/135 2023-12-11T20:02:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/135 2023-12-11T20:02:33.953 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 20/135 2023-12-11T20:02:34.118 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 20/135 2023-12-11T20:02:34.146 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 29/135 2023-12-11T20:02:34.311 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 21/135 2023-12-11T20:02:34.511 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 30/135 2023-12-11T20:02:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/135 2023-12-11T20:02:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/135 2023-12-11T20:02:34.782 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 31/135 2023-12-11T20:02:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 21/135 2023-12-11T20:02:35.077 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/135 2023-12-11T20:02:35.203 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 22/135 2023-12-11T20:02:35.394 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/135 2023-12-11T20:02:35.448 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/135 2023-12-11T20:02:35.607 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/135 2023-12-11T20:02:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 22/135 2023-12-11T20:02:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-0.3.15-3.el8.x86_64 23/135 2023-12-11T20:02:36.456 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/135 2023-12-11T20:02:36.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/135 2023-12-11T20:02:36.988 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/135 2023-12-11T20:02:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 23/135 2023-12-11T20:02:37.239 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/135 2023-12-11T20:02:37.268 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/135 2023-12-11T20:02:37.425 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/135 2023-12-11T20:02:37.466 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 25/135 2023-12-11T20:02:37.596 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/135 2023-12-11T20:02:37.673 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/135 2023-12-11T20:02:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/135 2023-12-11T20:02:37.910 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 27/135 2023-12-11T20:02:37.932 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/135 2023-12-11T20:02:38.072 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 34/135 2023-12-11T20:02:38.075 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 28/135 2023-12-11T20:02:38.106 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 27/135 2023-12-11T20:02:38.285 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el8.noarch 35/135 2023-12-11T20:02:38.300 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 29/135 2023-12-11T20:02:38.305 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 28/135 2023-12-11T20:02:38.493 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/135 2023-12-11T20:02:38.511 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/135 2023-12-11T20:02:38.710 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 37/135 2023-12-11T20:02:38.918 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 38/135 2023-12-11T20:02:39.124 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 39/135 2023-12-11T20:02:39.319 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 40/135 2023-12-11T20:02:39.360 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 29/135 2023-12-11T20:02:39.498 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 41/135 2023-12-11T20:02:39.672 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.7-15.el8.x86_64 42/135 2023-12-11T20:02:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 30/135 2023-12-11T20:02:39.876 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 43/135 2023-12-11T20:02:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 31/135 2023-12-11T20:02:40.112 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 44/135 2023-12-11T20:02:40.282 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/135 2023-12-11T20:02:40.373 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 45/135 2023-12-11T20:02:40.481 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/135 2023-12-11T20:02:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/135 2023-12-11T20:02:40.783 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 46/135 2023-12-11T20:02:41.220 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 47/135 2023-12-11T20:02:41.411 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/135 2023-12-11T20:02:41.690 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 49/135 2023-12-11T20:02:41.886 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/135 2023-12-11T20:02:41.948 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 50/135 2023-12-11T20:02:42.266 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 32/135 2023-12-11T20:02:42.340 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 51/135 2023-12-11T20:02:42.546 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 52/135 2023-12-11T20:02:42.555 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 33/135 2023-12-11T20:02:42.677 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/135 2023-12-11T20:02:42.756 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/135 2023-12-11T20:02:42.774 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 53/135 2023-12-11T20:02:42.991 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rsa-4.9-2.el8.noarch 35/135 2023-12-11T20:02:43.017 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 34/135 2023-12-11T20:02:43.031 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/135 2023-12-11T20:02:43.140 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/135 2023-12-11T20:02:43.227 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 55/135 2023-12-11T20:02:43.236 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el8.noarch 35/135 2023-12-11T20:02:43.388 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 37/135 2023-12-11T20:02:43.408 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 56/135 2023-12-11T20:02:43.453 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/135 2023-12-11T20:02:43.560 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 38/135 2023-12-11T20:02:43.662 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 37/135 2023-12-11T20:02:43.752 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 39/135 2023-12-11T20:02:43.805 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 57/135 2023-12-11T20:02:43.830 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 38/135 2023-12-11T20:02:43.903 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 40/135 2023-12-11T20:02:44.035 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 39/135 2023-12-11T20:02:44.091 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 41/135 2023-12-11T20:02:44.115 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 58/135 2023-12-11T20:02:44.190 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 40/135 2023-12-11T20:02:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : uuid-1.6.2-43.el8.x86_64 42/135 2023-12-11T20:02:44.334 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 42/135 2023-12-11T20:02:44.368 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 41/135 2023-12-11T20:02:44.371 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 59/135 2023-12-11T20:02:44.534 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.7-15.el8.x86_64 42/135 2023-12-11T20:02:44.591 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 43/135 2023-12-11T20:02:44.635 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 60/135 2023-12-11T20:02:44.704 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 43/135 2023-12-11T20:02:44.817 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : automake-1.16.1-7.el8.noarch 44/135 2023-12-11T20:02:44.828 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 61/135 2023-12-11T20:02:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 44/135 2023-12-11T20:02:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/135 2023-12-11T20:02:45.006 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 62/135 2023-12-11T20:02:45.071 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/135 2023-12-11T20:02:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 45/135 2023-12-11T20:02:45.193 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : uuid-1.6.2-43.el8.x86_64 63/135 2023-12-11T20:02:45.286 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 63/135 2023-12-11T20:02:45.323 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : jq-1.6-3.el8.x86_64 46/135 2023-12-11T20:02:45.509 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 47/135 2023-12-11T20:02:45.574 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 64/135 2023-12-11T20:02:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 46/135 2023-12-11T20:02:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/135 2023-12-11T20:02:45.800 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.1-7.el8.noarch 65/135 2023-12-11T20:02:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 49/135 2023-12-11T20:02:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 47/135 2023-12-11T20:02:45.993 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 66/135 2023-12-11T20:02:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fuse-2.9.7-15.el8.x86_64 50/135 2023-12-11T20:02:46.090 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 66/135 2023-12-11T20:02:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/135 2023-12-11T20:02:46.159 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 51/135 2023-12-11T20:02:46.360 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jq-1.6-3.el8.x86_64 67/135 2023-12-11T20:02:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 52/135 2023-12-11T20:02:46.426 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 49/135 2023-12-11T20:02:46.529 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 68/135 2023-12-11T20:02:46.620 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 53/135 2023-12-11T20:02:46.625 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 50/135 2023-12-11T20:02:46.704 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 69/135 2023-12-11T20:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 70/135 2023-12-11T20:02:46.947 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 51/135 2023-12-11T20:02:47.053 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 54/135 2023-12-11T20:02:47.148 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 52/135 2023-12-11T20:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 71/135 2023-12-11T20:02:47.318 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 55/135 2023-12-11T20:02:47.327 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 53/135 2023-12-11T20:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 72/135 2023-12-11T20:02:47.543 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 56/135 2023-12-11T20:02:47.601 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/135 2023-12-11T20:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 73/135 2023-12-11T20:02:47.789 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 55/135 2023-12-11T20:02:47.820 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/135 2023-12-11T20:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 74/135 2023-12-11T20:02:47.962 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 56/135 2023-12-11T20:02:48.038 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 58/135 2023-12-11T20:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 75/135 2023-12-11T20:02:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 76/135 2023-12-11T20:02:48.344 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 57/135 2023-12-11T20:02:48.404 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 59/135 2023-12-11T20:02:48.528 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 77/135 2023-12-11T20:02:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 58/135 2023-12-11T20:02:48.689 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 78/135 2023-12-11T20:02:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 60/135 2023-12-11T20:02:48.884 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 79/135 2023-12-11T20:02:48.888 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/135 2023-12-11T20:02:48.914 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 59/135 2023-12-11T20:02:49.106 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 62/135 2023-12-11T20:02:49.116 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 80/135 2023-12-11T20:02:49.178 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 60/135 2023-12-11T20:02:49.302 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 63/135 2023-12-11T20:02:49.359 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/135 2023-12-11T20:02:49.389 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 61/135 2023-12-11T20:02:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 64/135 2023-12-11T20:02:49.550 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 62/135 2023-12-11T20:02:49.567 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/135 2023-12-11T20:02:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-43.el8.x86_64 63/135 2023-12-11T20:02:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 65/135 2023-12-11T20:02:49.843 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 63/135 2023-12-11T20:02:49.885 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/135 2023-12-11T20:02:50.093 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 64/135 2023-12-11T20:02:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 66/135 2023-12-11T20:02:50.103 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/135 2023-12-11T20:02:50.313 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 85/135 2023-12-11T20:02:50.378 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 67/135 2023-12-11T20:02:50.403 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.1-7.el8.noarch 65/135 2023-12-11T20:02:50.562 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 66/135 2023-12-11T20:02:50.566 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 86/135 2023-12-11T20:02:50.613 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 68/135 2023-12-11T20:02:50.663 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 66/135 2023-12-11T20:02:50.803 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 69/135 2023-12-11T20:02:50.897 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : jq-1.6-3.el8.x86_64 67/135 2023-12-11T20:02:50.960 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 70/135 2023-12-11T20:02:51.090 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 68/135 2023-12-11T20:02:51.255 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 69/135 2023-12-11T20:02:51.264 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 71/135 2023-12-11T20:02:51.437 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 70/135 2023-12-11T20:02:51.518 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 72/135 2023-12-11T20:02:51.656 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 73/135 2023-12-11T20:02:51.742 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 71/135 2023-12-11T20:02:51.790 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 74/135 2023-12-11T20:02:51.970 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 72/135 2023-12-11T20:02:52.018 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 75/135 2023-12-11T20:02:52.041 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 87/135 2023-12-11T20:02:52.150 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 73/135 2023-12-11T20:02:52.210 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 76/135 2023-12-11T20:02:52.292 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 74/135 2023-12-11T20:02:52.382 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 88/135 2023-12-11T20:02:52.400 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 77/135 2023-12-11T20:02:52.488 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 75/135 2023-12-11T20:02:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 78/135 2023-12-11T20:02:52.726 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 76/135 2023-12-11T20:02:52.735 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/135 2023-12-11T20:02:52.751 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 79/135 2023-12-11T20:02:52.912 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 77/135 2023-12-11T20:02:52.964 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 80/135 2023-12-11T20:02:53.098 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/135 2023-12-11T20:02:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/135 2023-12-11T20:02:53.232 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 78/135 2023-12-11T20:02:53.317 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/135 2023-12-11T20:02:53.403 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 79/135 2023-12-11T20:02:53.449 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/135 2023-12-11T20:02:53.607 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/135 2023-12-11T20:02:53.632 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 80/135 2023-12-11T20:02:53.692 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.5.0-1.el8.noarch 92/135 2023-12-11T20:02:53.852 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/135 2023-12-11T20:02:53.860 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/135 2023-12-11T20:02:53.908 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 93/135 2023-12-11T20:02:54.030 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 85/135 2023-12-11T20:02:54.060 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/135 2023-12-11T20:02:54.109 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 94/135 2023-12-11T20:02:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 86/135 2023-12-11T20:02:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/135 2023-12-11T20:02:54.571 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/135 2023-12-11T20:02:54.766 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 85/135 2023-12-11T20:02:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 86/135 2023-12-11T20:02:55.724 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 87/135 2023-12-11T20:02:55.981 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 88/135 2023-12-11T20:02:56.266 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/135 2023-12-11T20:02:56.469 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 87/135 2023-12-11T20:02:56.641 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/135 2023-12-11T20:02:56.774 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 88/135 2023-12-11T20:02:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/135 2023-12-11T20:02:57.051 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/135 2023-12-11T20:02:57.239 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : luarocks-3.5.0-1.el8.noarch 92/135 2023-12-11T20:02:57.424 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 93/135 2023-12-11T20:02:57.601 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/135 2023-12-11T20:02:57.625 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 94/135 2023-12-11T20:02:57.965 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/135 2023-12-11T20:02:58.193 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.5.0-1.el8.noarch 92/135 2023-12-11T20:02:58.398 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 93/135 2023-12-11T20:02:58.594 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 94/135 2023-12-11T20:02:59.389 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:02:59.625 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:03:00.363 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:03:00.665 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 96/135 2023-12-11T20:03:00.806 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 96/135 2023-12-11T20:03:00.941 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 97/135 2023-12-11T20:03:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:03:03.300 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:03:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:03:04.621 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:03:04.910 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:03:05.127 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 96/135 2023-12-11T20:03:05.258 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 96/135 2023-12-11T20:03:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 97/135 2023-12-11T20:03:05.623 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 95/135 2023-12-11T20:03:05.938 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 96/135 2023-12-11T20:03:06.959 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 96/135 2023-12-11T20:03:07.150 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 97/135 2023-12-11T20:03:21.906 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 97/135 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /dev 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /run 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /dev 2023-12-11T20:03:21.907 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:03:22.338 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 98/135 2023-12-11T20:03:24.210 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 98/135 2023-12-11T20:03:24.395 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 99/135 2023-12-11T20:03:24.692 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 99/135 2023-12-11T20:03:24.862 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 100/135 2023-12-11T20:03:25.420 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 100/135 2023-12-11T20:03:25.646 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 101/135 2023-12-11T20:03:25.688 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 101/135 2023-12-11T20:03:27.118 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 97/135 2023-12-11T20:03:27.118 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /sys 2023-12-11T20:03:27.118 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /proc 2023-12-11T20:03:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /dev 2023-12-11T20:03:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /run 2023-12-11T20:03:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /mnt 2023-12-11T20:03:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /var/tmp 2023-12-11T20:03:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /home 2023-12-11T20:03:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /tmp 2023-12-11T20:03:27.119 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /dev 2023-12-11T20:03:27.119 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:03:27.505 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 98/135 2023-12-11T20:03:28.179 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 97/135 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /dev 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /run 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /dev 2023-12-11T20:03:28.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:03:28.667 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 102/135 2023-12-11T20:03:28.729 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 98/135 2023-12-11T20:03:28.848 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 102/135 2023-12-11T20:03:28.971 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 103/135 2023-12-11T20:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 104/135 2023-12-11T20:03:29.366 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 98/135 2023-12-11T20:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 105/135 2023-12-11T20:03:29.574 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 99/135 2023-12-11T20:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 105/135 2023-12-11T20:03:29.867 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 99/135 2023-12-11T20:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 106/135 2023-12-11T20:03:30.038 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 100/135 2023-12-11T20:03:30.591 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 98/135 2023-12-11T20:03:30.592 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 100/135 2023-12-11T20:03:30.771 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 101/135 2023-12-11T20:03:30.814 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 101/135 2023-12-11T20:03:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 99/135 2023-12-11T20:03:31.064 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 106/135 2023-12-11T20:03:31.213 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 99/135 2023-12-11T20:03:31.294 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 107/135 2023-12-11T20:03:31.432 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 107/135 2023-12-11T20:03:31.520 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 100/135 2023-12-11T20:03:31.800 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 108/135 2023-12-11T20:03:32.034 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 109/135 2023-12-11T20:03:32.076 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 100/135 2023-12-11T20:03:32.104 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 109/135 2023-12-11T20:03:32.270 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 101/135 2023-12-11T20:03:32.314 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 101/135 2023-12-11T20:03:32.352 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 110/135 2023-12-11T20:03:32.382 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 110/135 2023-12-11T20:03:33.836 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 102/135 2023-12-11T20:03:33.890 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 111/135 2023-12-11T20:03:34.035 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 102/135 2023-12-11T20:03:34.155 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 112/135 2023-12-11T20:03:34.155 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 103/135 2023-12-11T20:03:34.228 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 112/135 2023-12-11T20:03:34.386 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 113/135 2023-12-11T20:03:34.395 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 104/135 2023-12-11T20:03:34.460 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 113/135 2023-12-11T20:03:34.562 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 105/135 2023-12-11T20:03:34.653 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 114/135 2023-12-11T20:03:34.844 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 105/135 2023-12-11T20:03:34.997 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 106/135 2023-12-11T20:03:35.097 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 114/135 2023-12-11T20:03:35.277 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 115/135 2023-12-11T20:03:35.338 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 102/135 2023-12-11T20:03:35.484 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 102/135 2023-12-11T20:03:35.636 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 103/135 2023-12-11T20:03:35.843 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 104/135 2023-12-11T20:03:36.027 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 105/135 2023-12-11T20:03:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 106/135 2023-12-11T20:03:36.309 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 105/135 2023-12-11T20:03:36.328 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 107/135 2023-12-11T20:03:36.464 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 107/135 2023-12-11T20:03:36.514 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 106/135 2023-12-11T20:03:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 108/135 2023-12-11T20:03:37.105 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 109/135 2023-12-11T20:03:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 109/135 2023-12-11T20:03:37.395 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 110/135 2023-12-11T20:03:37.424 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 110/135 2023-12-11T20:03:37.669 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 106/135 2023-12-11T20:03:37.934 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 107/135 2023-12-11T20:03:38.070 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 107/135 2023-12-11T20:03:38.436 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 108/135 2023-12-11T20:03:38.682 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 109/135 2023-12-11T20:03:38.753 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 109/135 2023-12-11T20:03:38.920 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 111/135 2023-12-11T20:03:38.984 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 110/135 2023-12-11T20:03:39.015 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 110/135 2023-12-11T20:03:39.190 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 112/135 2023-12-11T20:03:39.259 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 112/135 2023-12-11T20:03:39.412 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 113/135 2023-12-11T20:03:39.485 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 113/135 2023-12-11T20:03:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 114/135 2023-12-11T20:03:40.132 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 114/135 2023-12-11T20:03:40.328 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 115/135 2023-12-11T20:03:40.515 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 111/135 2023-12-11T20:03:40.681 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 115/135 2023-12-11T20:03:40.759 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 112/135 2023-12-11T20:03:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 112/135 2023-12-11T20:03:40.983 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 116/135 2023-12-11T20:03:40.984 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 113/135 2023-12-11T20:03:41.058 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 113/135 2023-12-11T20:03:41.226 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 114/135 2023-12-11T20:03:41.318 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/135 2023-12-11T20:03:41.590 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/135 2023-12-11T20:03:41.672 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 114/135 2023-12-11T20:03:41.859 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 115/135 2023-12-11T20:03:42.928 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 118/135 2023-12-11T20:03:43.317 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/135 2023-12-11T20:03:43.516 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 120/135 2023-12-11T20:03:43.723 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 121/135 2023-12-11T20:03:43.890 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 122/135 2023-12-11T20:03:44.087 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/135 2023-12-11T20:03:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 115/135 2023-12-11T20:03:47.050 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 116/135 2023-12-11T20:03:47.259 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 115/135 2023-12-11T20:03:47.391 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 117/135 2023-12-11T20:03:47.553 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 116/135 2023-12-11T20:03:47.584 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 118/135 2023-12-11T20:03:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:47.765 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/135 2023-12-11T20:03:47.877 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 119/135 2023-12-11T20:03:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:48.033 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/135 2023-12-11T20:03:48.035 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/135 2023-12-11T20:03:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:48.286 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 125/135 2023-12-11T20:03:48.302 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/135 2023-12-11T20:03:48.520 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 126/135 2023-12-11T20:03:48.574 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 121/135 2023-12-11T20:03:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 122/135 2023-12-11T20:03:48.898 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 127/135 2023-12-11T20:03:48.905 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/135 2023-12-11T20:03:49.244 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 128/135 2023-12-11T20:03:49.352 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 118/135 2023-12-11T20:03:49.417 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 129/135 2023-12-11T20:03:49.441 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 129/135 2023-12-11T20:03:49.663 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 130/135 2023-12-11T20:03:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/135 2023-12-11T20:03:49.841 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.1-9.el8.x86_64 131/135 2023-12-11T20:03:49.958 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 131/135 2023-12-11T20:03:49.972 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 120/135 2023-12-11T20:03:50.187 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 121/135 2023-12-11T20:03:50.217 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/135 2023-12-11T20:03:50.247 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/135 2023-12-11T20:03:50.247 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:50.363 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 122/135 2023-12-11T20:03:50.473 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:50.473 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/135 2023-12-11T20:03:50.560 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/135 2023-12-11T20:03:50.766 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/135 2023-12-11T20:03:50.984 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:03:51.255 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:03:51.255 INFO:teuthology.orchestra.run.smithi039.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-11T20:03:51.255 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:03:51.911 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 1/135 2023-12-11T20:03:51.911 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2/135 2023-12-11T20:03:51.911 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 3/135 2023-12-11T20:03:51.911 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 4/135 2023-12-11T20:03:51.911 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/135 2023-12-11T20:03:51.911 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 8/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 9/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 11/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 12/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 13/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 14/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 16/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 17/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 18/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 19/135 2023-12-11T20:03:51.912 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 20/135 2023-12-11T20:03:51.913 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 21/135 2023-12-11T20:03:51.913 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 22/135 2023-12-11T20:03:51.913 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 23/135 2023-12-11T20:03:51.913 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 24/135 2023-12-11T20:03:51.913 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 25/135 2023-12-11T20:03:51.922 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 26/135 2023-12-11T20:03:51.922 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 27/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 28/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 30/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 31/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 33/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 34/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 36/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 37/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 38/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/135 2023-12-11T20:03:51.923 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.5.0-1.el8.noarch 42/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 43/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 44/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 45/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 46/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 47/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 48/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 49/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/135 2023-12-11T20:03:51.924 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 56/135 2023-12-11T20:03:51.925 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 57/135 2023-12-11T20:03:51.925 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-2.6-1.el8.noarch 58/135 2023-12-11T20:03:51.925 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/135 2023-12-11T20:03:51.925 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 71/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 72/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 73/135 2023-12-11T20:03:51.926 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 74/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 75/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 76/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 77/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 78/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 80/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 81/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 82/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.1-7.el8.noarch 83/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 84/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 85/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 87/135 2023-12-11T20:03:51.927 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 89/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 91/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 92/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 93/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 94/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 95/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 96/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpq-13.5-1.el8.x86_64 97/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 98/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jq-1.6-3.el8.x86_64 99/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 100/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 101/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 102/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 103/135 2023-12-11T20:03:51.928 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 104/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 105/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 106/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 107/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 108/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 109/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 110/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 111/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 113/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 114/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 115/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 116/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 117/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 118/135 2023-12-11T20:03:51.929 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 119/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 120/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 121/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 122/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 123/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 124/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 125/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 126/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 127/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 128/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 129/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 130/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 132/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:51.930 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 134/135 2023-12-11T20:03:52.487 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:52.777 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:52.816 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 125/135 2023-12-11T20:03:53.380 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 126/135 2023-12-11T20:03:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 127/135 2023-12-11T20:03:54.107 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 128/135 2023-12-11T20:03:54.301 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flex-2.6.1-9.el8.x86_64 129/135 2023-12-11T20:03:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:54.414 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 129/135 2023-12-11T20:03:54.643 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : bison-3.0.4-10.el8.x86_64 130/135 2023-12-11T20:03:54.672 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 130/135 2023-12-11T20:03:54.698 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:54.738 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/135 2023-12-11T20:03:54.876 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 131/135 2023-12-11T20:03:54.899 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 125/135 2023-12-11T20:03:54.899 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 131/135 2023-12-11T20:03:55.046 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 132/135 2023-12-11T20:03:55.046 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 126/135 2023-12-11T20:03:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/135 2023-12-11T20:03:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 127/135 2023-12-11T20:03:55.559 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/135 2023-12-11T20:03:55.802 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:03:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 128/135 2023-12-11T20:03:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 129/135 2023-12-11T20:03:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 129/135 2023-12-11T20:03:56.078 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:03:56.078 INFO:teuthology.orchestra.run.smithi032.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-11T20:03:56.078 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:03:56.276 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 130/135 2023-12-11T20:03:56.463 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.1-9.el8.x86_64 131/135 2023-12-11T20:03:56.583 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 131/135 2023-12-11T20:03:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 1/135 2023-12-11T20:03:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2/135 2023-12-11T20:03:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 3/135 2023-12-11T20:03:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 4/135 2023-12-11T20:03:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/135 2023-12-11T20:03:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:03:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:03:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 8/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 9/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 11/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 12/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 13/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 14/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 16/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 17/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 18/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 19/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 20/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 21/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 22/135 2023-12-11T20:03:56.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 23/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 24/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 25/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 26/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 27/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 28/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 30/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 31/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 33/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 34/135 2023-12-11T20:03:56.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 36/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 37/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 38/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : luarocks-3.5.0-1.el8.noarch 42/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 43/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 44/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 45/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 46/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 47/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 48/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 49/135 2023-12-11T20:03:56.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 56/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 57/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-portend-2.6-1.el8.noarch 58/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/135 2023-12-11T20:03:56.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 71/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 72/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 73/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 74/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 75/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 76/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 77/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 78/135 2023-12-11T20:03:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 80/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 82/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 83/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 84/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 85/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 87/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 88/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 89/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 90/135 2023-12-11T20:03:56.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 91/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 92/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 93/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 94/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 95/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 96/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 97/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 98/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 99/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 100/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 101/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 102/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 103/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 104/135 2023-12-11T20:03:56.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 106/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 107/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 108/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : automake-1.16.1-7.el8.noarch 109/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 110/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 111/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flex-2.6.1-9.el8.x86_64 112/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 113/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 114/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 115/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 116/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 117/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 118/135 2023-12-11T20:03:56.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 119/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 120/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 121/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 122/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libpq-13.5-1.el8.x86_64 123/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 124/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : jq-1.6-3.el8.x86_64 125/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 126/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 127/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 128/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 129/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 130/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 132/135 2023-12-11T20:03:56.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:56.740 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 134/135 2023-12-11T20:03:56.939 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/135 2023-12-11T20:03:56.971 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/135 2023-12-11T20:03:56.971 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:57.204 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:57.205 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 134/135 2023-12-11T20:03:57.505 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 134/135 2023-12-11T20:03:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:03:57.979 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:03:57.979 INFO:teuthology.orchestra.run.smithi012.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-11T20:03:57.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 1/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 3/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 4/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 6/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 7/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 8/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 9/135 2023-12-11T20:03:58.610 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 10/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 11/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 12/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 13/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 14/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 15/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 16/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 17/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 18/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 19/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 20/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 21/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 22/135 2023-12-11T20:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 23/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 24/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 25/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 26/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 27/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 28/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 30/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 31/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 33/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 34/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 36/135 2023-12-11T20:03:58.612 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 37/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 38/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.5.0-1.el8.noarch 42/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 43/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 44/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 45/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 46/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 47/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 48/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 49/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/135 2023-12-11T20:03:58.613 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 56/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 57/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-2.6-1.el8.noarch 58/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/135 2023-12-11T20:03:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 71/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 72/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 73/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 74/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 75/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 76/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 77/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 78/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/135 2023-12-11T20:03:58.615 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 80/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 81/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 82/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.1-7.el8.noarch 83/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 84/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 85/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 87/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 89/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 91/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 92/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 93/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 94/135 2023-12-11T20:03:58.616 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 95/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 96/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpq-13.5-1.el8.x86_64 97/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 98/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : jq-1.6-3.el8.x86_64 99/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 100/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 101/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 102/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 103/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 104/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 105/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 106/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 107/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 108/135 2023-12-11T20:03:58.617 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 109/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 110/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 111/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 113/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 114/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 115/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 116/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 117/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 118/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 119/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 120/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 121/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 122/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 123/135 2023-12-11T20:03:58.618 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 124/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 125/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 126/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 127/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 128/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 129/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 130/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 132/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/135 2023-12-11T20:03:58.619 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 134/135 2023-12-11T20:04:00.683 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:04:00.683 INFO:teuthology.orchestra.run.smithi039.stdout:Installed products updated. 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.1-7.el8.noarch 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.0.4-10.el8.x86_64 2023-12-11T20:04:00.922 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.923 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.1-9.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.7-15.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: jq-1.6-3.el8.x86_64 2023-12-11T20:04:00.924 INFO:teuthology.orchestra.run.smithi039.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libpq-13.5-1.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.925 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.5.0-1.el8.noarch 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.15-3.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-12-11T20:04:00.926 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-12-11T20:04:00.927 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.0.6-13.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-11T20:04:00.928 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-2.6-1.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2017.2-9.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-11T20:04:00.929 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-11T20:04:00.930 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.931 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.931 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:00.931 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-11T20:04:00.931 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-11T20:04:00.931 INFO:teuthology.orchestra.run.smithi039.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-11T20:04:00.931 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-12-11T20:04:00.931 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-11T20:04:00.931 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-11T20:04:00.932 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:04:00.932 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2023-12-11T20:04:01.370 DEBUG:teuthology.parallel:result is None 2023-12-11T20:04:06.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:04:06.868 INFO:teuthology.orchestra.run.smithi012.stdout:Installed products updated. 2023-12-11T20:04:07.011 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 135/135 2023-12-11T20:04:07.011 INFO:teuthology.orchestra.run.smithi032.stdout:Installed products updated. 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.1-7.el8.noarch 2023-12-11T20:04:07.115 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.0.4-10.el8.x86_64 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.116 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.1-9.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.7-15.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-11T20:04:07.117 INFO:teuthology.orchestra.run.smithi012.stdout: jq-1.6-3.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: libpq-13.5-1.el8.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-12-11T20:04:07.118 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-12-11T20:04:07.119 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.119 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.119 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-11T20:04:07.119 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.119 INFO:teuthology.orchestra.run.smithi012.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.5.0-1.el8.noarch 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.15-3.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-11T20:04:07.120 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-11T20:04:07.121 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:07.121 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:07.121 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:07.121 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-11T20:04:07.122 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-11T20:04:07.122 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-11T20:04:07.122 INFO:teuthology.orchestra.run.smithi012.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-11T20:04:07.122 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-11T20:04:07.122 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.122 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-11T20:04:07.123 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.0.6-13.el8.noarch 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-2.6-1.el8.noarch 2023-12-11T20:04:07.124 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2017.2-9.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-11T20:04:07.125 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-11T20:04:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-11T20:04:07.127 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-11T20:04:07.127 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-12-11T20:04:07.127 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-11T20:04:07.127 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-11T20:04:07.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:04:07.127 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-12-11T20:04:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:04:07.251 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: automake-1.16.1-7.el8.noarch 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: bison-3.0.4-10.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: flex-2.6.1-9.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: fuse-2.9.7-15.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: jq-1.6-3.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-11T20:04:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libpq-13.5-1.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-11T20:04:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: luarocks-3.5.0-1.el8.noarch 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-0.3.15-3.el8.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-11T20:04:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-11T20:04:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako-1.0.6-13.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend-2.6-1.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-11T20:04:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz-2017.2-9.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-11T20:04:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-12-11T20:04:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-11T20:04:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-11T20:04:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-12-11T20:04:07.261 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-12-11T20:04:07.574 DEBUG:teuthology.parallel:result is None 2023-12-11T20:04:08.383 DEBUG:teuthology.parallel:result is None 2023-12-11T20:04:08.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:04:08.531 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-11T20:04:08.586 INFO:teuthology.orchestra.run.smithi012.stdout:19.0.0-119.ga62fda73.el8 2023-12-11T20:04:08.587 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el8 2023-12-11T20:04:08.587 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-11T20:04:08.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:04:08.806 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-11T20:04:08.867 INFO:teuthology.orchestra.run.smithi032.stdout:19.0.0-119.ga62fda73.el8 2023-12-11T20:04:08.867 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el8 2023-12-11T20:04:08.867 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-11T20:04:08.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:04:09.010 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-11T20:04:09.072 INFO:teuthology.orchestra.run.smithi039.stdout:19.0.0-119.ga62fda73.el8 2023-12-11T20:04:09.072 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el8 2023-12-11T20:04:09.072 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-11T20:04:09.074 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-11T20:04:09.074 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:04:09.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-11T20:04:09.171 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:04:09.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-11T20:04:09.268 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:04:09.268 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-11T20:04:09.364 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-11T20:04:09.365 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:04:09.365 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2023-12-11T20:04:09.440 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-11T20:04:09.552 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:04:09.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2023-12-11T20:04:09.625 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-11T20:04:09.736 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:04:09.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2023-12-11T20:04:09.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-11T20:04:09.922 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-11T20:04:09.923 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:04:09.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-11T20:04:09.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-11T20:04:10.109 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:04:10.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-11T20:04:10.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-11T20:04:10.295 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:04:10.295 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-11T20:04:10.368 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-11T20:04:10.478 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-11T20:04:10.478 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:04:10.478 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2023-12-11T20:04:10.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-11T20:04:10.661 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:04:10.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2023-12-11T20:04:10.732 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-11T20:04:10.841 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:04:10.841 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2023-12-11T20:04:10.911 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-11T20:04:11.020 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-11T20:04:11.110 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request', 'SLOW_OPS', 'slow request'], 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-12-11T20:04:11.110 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:04:11.111 INFO:tasks.cephadm:Cluster fsid is 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:04:11.111 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-11T20:04:11.111 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.12', 'mon.b': '172.21.15.32', 'mon.c': '172.21.15.39'} 2023-12-11T20:04:11.111 INFO:tasks.cephadm:First mon is mon.a on smithi012 2023-12-11T20:04:11.111 INFO:tasks.cephadm:First mgr is x 2023-12-11T20:04:11.111 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-11T20:04:11.111 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname $(hostname -s) 2023-12-11T20:04:11.188 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname $(hostname -s) 2023-12-11T20:04:11.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname $(hostname -s) 2023-12-11T20:04:11.331 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-12-11T20:04:11.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:04:11.472 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/74860/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-119-ga62fda73', 'node_name': '172.21.4.63+confusa01', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-119.ga62fda73'}, 'url': 'https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-12-11 13:31:01.711792', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-2023dec11', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/74860/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-119-ga62fda73', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-119.ga62fda73'}, 'url': 'https://4.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-12-11 12:43:31.974707', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-2023dec11', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-12-11T20:04:11.689 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref rishabh-2023dec11, sha1 a62fda73efba5520d409bb5a21bd8373289dda5d from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:04:11.690 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/x86_64/flavors/default/cephadm 2023-12-11T20:04:11.691 DEBUG:teuthology.orchestra.run.smithi012:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:12.380 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2272057 Dec 11 20:04 /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:12.381 DEBUG:teuthology.orchestra.run.smithi032:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:13.352 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2272057 Dec 11 20:04 /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:13.353 DEBUG:teuthology.orchestra.run.smithi039:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:13.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2272057 Dec 11 20:04 /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:13.998 DEBUG:teuthology.orchestra.run.smithi012:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:14.049 DEBUG:teuthology.orchestra.run.smithi032:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:14.100 DEBUG:teuthology.orchestra.run.smithi039:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-11T20:04:14.167 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d on all hosts... 2023-12-11T20:04:14.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d pull 2023-12-11T20:04:14.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d pull 2023-12-11T20:04:14.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d pull 2023-12-11T20:04:16.507 INFO:teuthology.orchestra.run.smithi039.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-11T20:04:17.144 INFO:teuthology.orchestra.run.smithi032.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-11T20:04:17.348 INFO:teuthology.orchestra.run.smithi012.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-11T20:04:44.383 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-12-11T20:04:44.384 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-11T20:04:44.384 INFO:teuthology.orchestra.run.smithi039.stdout: "image_id": "0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a", 2023-12-11T20:04:44.384 INFO:teuthology.orchestra.run.smithi039.stdout: "repo_digests": [ 2023-12-11T20:04:44.384 INFO:teuthology.orchestra.run.smithi039.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40" 2023-12-11T20:04:44.384 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2023-12-11T20:04:44.384 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-12-11T20:04:45.021 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-12-11T20:04:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-11T20:04:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "image_id": "0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a", 2023-12-11T20:04:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "repo_digests": [ 2023-12-11T20:04:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40" 2023-12-11T20:04:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2023-12-11T20:04:45.022 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-12-11T20:04:50.823 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:04:50.823 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-11T20:04:50.823 INFO:teuthology.orchestra.run.smithi012.stdout: "image_id": "0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a", 2023-12-11T20:04:50.824 INFO:teuthology.orchestra.run.smithi012.stdout: "repo_digests": [ 2023-12-11T20:04:50.824 INFO:teuthology.orchestra.run.smithi012.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40" 2023-12-11T20:04:50.824 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:04:50.824 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:04:50.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph 2023-12-11T20:04:50.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph 2023-12-11T20:04:51.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph 2023-12-11T20:04:51.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /etc/ceph 2023-12-11T20:04:51.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /etc/ceph 2023-12-11T20:04:51.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /etc/ceph 2023-12-11T20:04:51.306 INFO:tasks.cephadm:Writing seed config... 2023-12-11T20:04:51.307 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-11T20:04:51.307 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-11T20:04:51.307 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-11T20:04:51.307 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-11T20:04:51.307 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-11T20:04:51.307 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-11T20:04:51.307 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-12-11T20:04:51.308 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2023-12-11T20:04:51.309 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-11T20:04:51.310 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-11T20:04:51.310 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-11T20:04:51.310 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-11T20:04:51.310 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2023-12-11T20:04:51.310 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-11T20:04:51.310 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-11T20:04:51.310 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-12-11T20:04:51.310 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-12-11T20:04:51.311 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:04:51.311 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-11T20:04:51.355 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 732461f0-9860-11ee-95a3-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-11T20:04:51.355 DEBUG:teuthology.orchestra.run.smithi012:mon.a> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.a.service 2023-12-11T20:04:51.400 DEBUG:teuthology.orchestra.run.smithi012:mgr.x> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.x.service 2023-12-11T20:04:51.445 INFO:tasks.cephadm:Bootstrapping... 2023-12-11T20:04:51.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d -v bootstrap --fsid 732461f0-9860-11ee-95a3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.12 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:04:51.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:04:51.513 INFO:journalctl@ceph.mgr.x.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:04:51.721 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-12-11T20:04:51.721 INFO:teuthology.orchestra.run.smithi012.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d', '-v', 'bootstrap', '--fsid', '732461f0-9860-11ee-95a3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.12', '--skip-admin-label'] 2023-12-11T20:04:51.897 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 4.1.1 2023-12-11T20:04:51.897 INFO:teuthology.orchestra.run.smithi012.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-11T20:04:51.898 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying podman|docker is present... 2023-12-11T20:04:52.072 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 4.1.1 2023-12-11T20:04:52.072 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying lvm2 is present... 2023-12-11T20:04:52.073 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying time synchronization is in place... 2023-12-11T20:04:52.086 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-11T20:04:52.087 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-11T20:04:52.100 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-11T20:04:52.100 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2023-12-11T20:04:52.114 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2023-12-11T20:04:52.127 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2023-12-11T20:04:52.128 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2023-12-11T20:04:52.128 INFO:teuthology.orchestra.run.smithi012.stdout:Repeating the final host check... 2023-12-11T20:04:52.300 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 4.1.1 2023-12-11T20:04:52.301 INFO:teuthology.orchestra.run.smithi012.stdout:podman (/bin/podman) version 4.1.1 is present 2023-12-11T20:04:52.301 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl is present 2023-12-11T20:04:52.301 INFO:teuthology.orchestra.run.smithi012.stdout:lvcreate is present 2023-12-11T20:04:52.314 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-11T20:04:52.314 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-11T20:04:52.327 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-11T20:04:52.328 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2023-12-11T20:04:52.341 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2023-12-11T20:04:52.354 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2023-12-11T20:04:52.355 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2023-12-11T20:04:52.355 INFO:teuthology.orchestra.run.smithi012.stdout:Host looks OK 2023-12-11T20:04:52.355 INFO:teuthology.orchestra.run.smithi012.stdout:Cluster fsid: 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:04:52.355 INFO:teuthology.orchestra.run.smithi012.stdout:Acquiring lock 140089549104520 on /run/cephadm/732461f0-9860-11ee-95a3-87774f69a715.lock 2023-12-11T20:04:52.355 INFO:teuthology.orchestra.run.smithi012.stdout:Lock 140089549104520 acquired on /run/cephadm/732461f0-9860-11ee-95a3-87774f69a715.lock 2023-12-11T20:04:52.355 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 3300 ... 2023-12-11T20:04:52.356 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 6789 ... 2023-12-11T20:04:52.356 INFO:teuthology.orchestra.run.smithi012.stdout:Base mon IP(s) is [172.21.15.12:3300, 172.21.15.12:6789], mon addrv is [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2023-12-11T20:04:52.364 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-12-11T20:04:52.364 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.12 metric 100 2023-12-11T20:04:52.371 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-11T20:04:52.371 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-12-11T20:04:52.371 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2023-12-11T20:04:52.378 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-11T20:04:52.378 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-11T20:04:52.378 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-11T20:04:52.378 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-12-11T20:04:52.378 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2023-12-11T20:04:52.378 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-11T20:04:52.379 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2023-12-11T20:04:52.379 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2023-12-11T20:04:52.379 INFO:teuthology.orchestra.run.smithi012.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-11T20:04:52.380 INFO:teuthology.orchestra.run.smithi012.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-11T20:04:52.381 INFO:teuthology.orchestra.run.smithi012.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-11T20:04:52.859 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a 2023-12-11T20:04:52.859 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-11T20:04:52.859 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Getting image source signatures 2023-12-11T20:04:52.859 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:933954f0af8f706d6a6186e87e0ea462c846b5abc6ef29ee9ef20dac46eff0f7 2023-12-11T20:04:52.859 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-11T20:04:52.859 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying config sha256:0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a 2023-12-11T20:04:52.859 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-11T20:04:52.859 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Storing signatures 2023-12-11T20:04:53.835 INFO:teuthology.orchestra.run.smithi012.stdout:ceph: stdout ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-11T20:04:53.835 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph version: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-11T20:04:53.835 INFO:teuthology.orchestra.run.smithi012.stdout:Extracting ceph user uid/gid from container image... 2023-12-11T20:04:54.715 INFO:teuthology.orchestra.run.smithi012.stdout:stat: stdout 167 167 2023-12-11T20:04:54.715 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial keys... 2023-12-11T20:04:55.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQBna3dl6pxDBxAApXArVNuyLEawuKKX197UaA== 2023-12-11T20:04:56.267 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQBna3dl5xmpNxAA7PdjJ3I2uLE9l9tC9W92Rg== 2023-12-11T20:04:57.447 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQBpa3dln3pTARAA9fBIhw2IPnwiD+jlSxdekg== 2023-12-11T20:04:57.448 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial monmap... 2023-12-11T20:04:58.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-11T20:04:58.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-12-11T20:04:58.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:04:58.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-11T20:04:58.330 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool for a [v2:172.21.15.12:3300,v1:172.21.15.12:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-11T20:04:58.330 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = pacific 2023-12-11T20:04:58.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: set fsid to 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:04:58.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-11T20:04:58.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:04:58.330 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mon... 2023-12-11T20:04:59.210 INFO:teuthology.orchestra.run.smithi012.stdout:create mon.a on 2023-12-11T20:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-11T20:04:59.688 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-11T20:04:59.930 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-732461f0-9860-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-732461f0-9860-11ee-95a3-87774f69a715.target. 2023-12-11T20:04:59.930 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-732461f0-9860-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-732461f0-9860-11ee-95a3-87774f69a715.target. 2023-12-11T20:05:00.306 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.a 2023-12-11T20:05:00.306 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.a.service: Unit ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.a.service not loaded. 2023-12-11T20:05:00.521 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-732461f0-9860-11ee-95a3-87774f69a715.target.wants/ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.a.service → /etc/systemd/system/ceph-732461f0-9860-11ee-95a3-87774f69a715@.service. 2023-12-11T20:05:00.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:00 smithi012 systemd[1]: Starting Ceph mon.a for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:05:01.322 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:01 smithi012 podman[128237]: 2023-12-11T20:05:01.323 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:01 smithi012 bash[128237]: a9f84bf641506aae43f4e86b36eade58f71b24a13b31841711c859eb61b10249 2023-12-11T20:05:01.347 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-11T20:05:01.347 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2023-12-11T20:05:01.363 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-11T20:05:01.363 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2023-12-11T20:05:01.364 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2023-12-11T20:05:01.364 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2023-12-11T20:05:01.364 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon to start... 2023-12-11T20:05:01.364 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon... 2023-12-11T20:05:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:01 smithi012 systemd[1]: Started Ceph mon.a for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:05:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:01 smithi012 ceph-mon[128277]: mkfs 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:05:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:01 smithi012 ceph-mon[128277]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-11T20:05:02.666 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:02 smithi012 ceph-mon[128277]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-11T20:05:02.666 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:02 smithi012 ceph-mon[128277]: monmap e1: 1 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-11T20:05:02.666 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:02 smithi012 ceph-mon[128277]: fsmap 2023-12-11T20:05:02.666 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:02 smithi012 ceph-mon[128277]: osdmap e1: 0 total, 0 up, 0 in 2023-12-11T20:05:02.666 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:02 smithi012 ceph-mon[128277]: mgrmap e1: no daemons active 2023-12-11T20:05:03.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout cluster: 2023-12-11T20:05:03.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout id: 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:05:03.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-11T20:05:03.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:03.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout services: 2023-12-11T20:05:03.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 1.31678s) 2023-12-11T20:05:03.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-11T20:05:03.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout data: 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pgs: 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.557+0000 7f1345049700 1 Processor -- start 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.557+0000 7f1345049700 1 -- start start 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.557+0000 7f1345049700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f13401070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.557+0000 7f1345049700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13401076a0 con 0x7f1340106cb0 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.558+0000 7f133ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f13401070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:03.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.558+0000 7f133ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f13401070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56634/0 (socket says 172.21.15.12:56634) 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.558+0000 7f133ed9d700 1 -- 172.21.15.12:0/3049937270 learned_addr learned my addr 172.21.15.12:0/3049937270 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.559+0000 7f133ed9d700 1 -- 172.21.15.12:0/3049937270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340107eb0 con 0x7f1340106cb0 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.559+0000 7f133ed9d700 1 --2- 172.21.15.12:0/3049937270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f13401070d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f13300098a0 tx=0x7f1330009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409c5a3baf5fd092 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.559+0000 7f133dd9b700 1 -- 172.21.15.12:0/3049937270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1330004160 con 0x7f1340106cb0 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.559+0000 7f133dd9b700 1 -- 172.21.15.12:0/3049937270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13300042c0 con 0x7f1340106cb0 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.559+0000 7f133dd9b700 1 -- 172.21.15.12:0/3049937270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13300045a0 con 0x7f1340106cb0 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.560+0000 7f1345049700 1 -- 172.21.15.12:0/3049937270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 msgr2=0x7f13401070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.560+0000 7f1345049700 1 --2- 172.21.15.12:0/3049937270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f13401070d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f13300098a0 tx=0x7f1330009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.560+0000 7f1345049700 1 -- 172.21.15.12:0/3049937270 shutdown_connections 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.560+0000 7f1345049700 1 --2- 172.21.15.12:0/3049937270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f13401070d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.560+0000 7f1345049700 1 -- 172.21.15.12:0/3049937270 >> 172.21.15.12:0/3049937270 conn(0x7f1340102250 msgr2=0x7f1340104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:03.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.560+0000 7f1345049700 1 -- 172.21.15.12:0/3049937270 shutdown_connections 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.560+0000 7f1345049700 1 -- 172.21.15.12:0/3049937270 wait complete. 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.561+0000 7f1345049700 1 Processor -- start 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.561+0000 7f1345049700 1 -- start start 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.561+0000 7f1345049700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f134007b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.561+0000 7f1345049700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134007bee0 con 0x7f1340106cb0 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.562+0000 7f133ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f134007b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.562+0000 7f133ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f134007b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56644/0 (socket says 172.21.15.12:56644) 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.562+0000 7f133ed9d700 1 -- 172.21.15.12:0/1182337410 learned_addr learned my addr 172.21.15.12:0/1182337410 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.562+0000 7f133ed9d700 1 -- 172.21.15.12:0/1182337410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330009550 con 0x7f1340106cb0 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.562+0000 7f133ed9d700 1 --2- 172.21.15.12:0/1182337410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f134007b9a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1330004000 tx=0x7f1330004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.563+0000 7f1327fff700 1 -- 172.21.15.12:0/1182337410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1330011630 con 0x7f1340106cb0 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.563+0000 7f1327fff700 1 -- 172.21.15.12:0/1182337410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330011790 con 0x7f1340106cb0 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.563+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134007a120 con 0x7f1340106cb0 2023-12-11T20:05:03.661 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.563+0000 7f1327fff700 1 -- 172.21.15.12:0/1182337410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1330011a30 con 0x7f1340106cb0 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.563+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134007a5c0 con 0x7f1340106cb0 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.563+0000 7f1327fff700 1 -- 172.21.15.12:0/1182337410 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1330022070 con 0x7f1340106cb0 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.563+0000 7f1327fff700 1 -- 172.21.15.12:0/1182337410 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f133001c450 con 0x7f1340106cb0 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.564+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1340062c00 con 0x7f1340106cb0 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.567+0000 7f1327fff700 1 -- 172.21.15.12:0/1182337410 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f133001b450 con 0x7f1340106cb0 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.644+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f1340108430 con 0x7f1340106cb0 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.644+0000 7f1327fff700 1 -- 172.21.15.12:0/1182337410 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+316 (secure 0 0 0) 0x7f133001b5f0 con 0x7f1340106cb0 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.645+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 msgr2=0x7f134007b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.645+0000 7f1345049700 1 --2- 172.21.15.12:0/1182337410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f134007b9a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1330004000 tx=0x7f1330004750 comp rx=0 tx=0).stop 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.646+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 shutdown_connections 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.646+0000 7f1345049700 1 --2- 172.21.15.12:0/1182337410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340106cb0 0x7f134007b9a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.646+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 >> 172.21.15.12:0/1182337410 conn(0x7f1340102250 msgr2=0x7f1340190f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:03.663 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.646+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 shutdown_connections 2023-12-11T20:05:03.663 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:02.646+0000 7f1345049700 1 -- 172.21.15.12:0/1182337410 wait complete. 2023-12-11T20:05:03.663 INFO:teuthology.orchestra.run.smithi012.stdout:mon is available 2023-12-11T20:05:03.663 INFO:teuthology.orchestra.run.smithi012.stdout:Assimilating anything we can from ceph.conf... 2023-12-11T20:05:03.693 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:03 smithi012 ceph-mon[128277]: from='client.? 172.21.15.12:0/1182337410' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-11T20:05:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:04 smithi012 ceph-mon[128277]: from='client.? 172.21.15.12:0/156583001' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-11T20:05:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:04 smithi012 ceph-mon[128277]: from='client.? 172.21.15.12:0/156583001' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-11T20:05:04.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:04.748 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2023-12-11T20:05:04.748 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-11T20:05:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-11T20:05:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-11T20:05:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-11T20:05:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.212+0000 7f9a79892700 1 Processor -- start 2023-12-11T20:05:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.212+0000 7f9a79892700 1 -- start start 2023-12-11T20:05:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.212+0000 7f9a79892700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7407a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.212+0000 7f9a79892700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7407a730 con 0x7f9a7407bd00 2023-12-11T20:05:04.750 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.213+0000 7f9a72ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7407a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.213+0000 7f9a72ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7407a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56652/0 (socket says 172.21.15.12:56652) 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.213+0000 7f9a72ffd700 1 -- 172.21.15.12:0/826450237 learned_addr learned my addr 172.21.15.12:0/826450237 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.213+0000 7f9a72ffd700 1 -- 172.21.15.12:0/826450237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7407a870 con 0x7f9a7407bd00 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.213+0000 7f9a72ffd700 1 --2- 172.21.15.12:0/826450237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7407a160 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9a640098a0 tx=0x7f9a64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a7f583a9319934 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a71ffb700 1 -- 172.21.15.12:0/826450237 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a64004160 con 0x7f9a7407bd00 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a71ffb700 1 -- 172.21.15.12:0/826450237 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a640042c0 con 0x7f9a7407bd00 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a71ffb700 1 -- 172.21.15.12:0/826450237 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a640045a0 con 0x7f9a7407bd00 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a79892700 1 -- 172.21.15.12:0/826450237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 msgr2=0x7f9a7407a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a79892700 1 --2- 172.21.15.12:0/826450237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7407a160 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9a640098a0 tx=0x7f9a64009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a79892700 1 -- 172.21.15.12:0/826450237 shutdown_connections 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a79892700 1 --2- 172.21.15.12:0/826450237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7407a160 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a79892700 1 -- 172.21.15.12:0/826450237 >> 172.21.15.12:0/826450237 conn(0x7f9a74102290 msgr2=0x7f9a741046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a79892700 1 -- 172.21.15.12:0/826450237 shutdown_connections 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.214+0000 7f9a79892700 1 -- 172.21.15.12:0/826450237 wait complete. 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.215+0000 7f9a79892700 1 Processor -- start 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.216+0000 7f9a79892700 1 -- start start 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.216+0000 7f9a79892700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.216+0000 7f9a79892700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7419c850 con 0x7f9a7407bd00 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.216+0000 7f9a72ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.216+0000 7f9a72ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7419c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56654/0 (socket says 172.21.15.12:56654) 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.216+0000 7f9a72ffd700 1 -- 172.21.15.12:0/156583001 learned_addr learned my addr 172.21.15.12:0/156583001 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.216+0000 7f9a72ffd700 1 -- 172.21.15.12:0/156583001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64009550 con 0x7f9a7407bd00 2023-12-11T20:05:04.754 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.217+0000 7f9a72ffd700 1 --2- 172.21.15.12:0/156583001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7419c310 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9a7407b1d0 tx=0x7f9a64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.217+0000 7f9a78890700 1 -- 172.21.15.12:0/156583001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a64011630 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.217+0000 7f9a78890700 1 -- 172.21.15.12:0/156583001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64011790 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.217+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7419ca50 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.217+0000 7f9a78890700 1 -- 172.21.15.12:0/156583001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a64011a30 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.217+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7419cef0 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.217+0000 7f9a78890700 1 -- 172.21.15.12:0/156583001 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9a64022070 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.217+0000 7f9a78890700 1 -- 172.21.15.12:0/156583001 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9a6401c450 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.218+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a741962b0 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.221+0000 7f9a78890700 1 -- 172.21.15.12:0/156583001 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f9a6401b450 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.295+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9a7407ae10 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.298+0000 7f9a78890700 1 -- 172.21.15.12:0/156583001 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+454 (secure 0 0 0) 0x7f9a6401b5f0 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.299+0000 7f9a78890700 1 -- 172.21.15.12:0/156583001 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9a64011e90 con 0x7f9a7407bd00 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.300+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 msgr2=0x7f9a7419c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:04.755 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.300+0000 7f9a79892700 1 --2- 172.21.15.12:0/156583001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7419c310 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9a7407b1d0 tx=0x7f9a64004750 comp rx=0 tx=0).stop 2023-12-11T20:05:04.756 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.300+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 shutdown_connections 2023-12-11T20:05:04.756 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.300+0000 7f9a79892700 1 --2- 172.21.15.12:0/156583001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7407bd00 0x7f9a7419c310 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:04.756 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.300+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 >> 172.21.15.12:0/156583001 conn(0x7f9a74102290 msgr2=0x7f9a74103110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:04.756 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.300+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 shutdown_connections 2023-12-11T20:05:04.756 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:04.300+0000 7f9a79892700 1 -- 172.21.15.12:0/156583001 wait complete. 2023-12-11T20:05:04.756 INFO:teuthology.orchestra.run.smithi012.stdout:Generating new minimal ceph.conf... 2023-12-11T20:05:05.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:05 smithi012 ceph-mon[128277]: from='client.? 172.21.15.12:0/212212011' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.300+0000 7f90560d0700 1 Processor -- start 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.301+0000 7f90560d0700 1 -- start start 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.301+0000 7f90560d0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f90501070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.301+0000 7f90560d0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90501076a0 con 0x7f9050106cb0 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.301+0000 7f904f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f90501070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.302+0000 7f904f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f90501070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56656/0 (socket says 172.21.15.12:56656) 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.302+0000 7f904f7fe700 1 -- 172.21.15.12:0/1661263891 learned_addr learned my addr 172.21.15.12:0/1661263891 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.302+0000 7f904f7fe700 1 -- 172.21.15.12:0/1661263891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9050107eb0 con 0x7f9050106cb0 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.302+0000 7f904f7fe700 1 --2- 172.21.15.12:0/1661263891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f90501070d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f90400098a0 tx=0x7f9040009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d268e2f9fe7af295 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.302+0000 7f904e7fc700 1 -- 172.21.15.12:0/1661263891 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9040004160 con 0x7f9050106cb0 2023-12-11T20:05:05.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.302+0000 7f904e7fc700 1 -- 172.21.15.12:0/1661263891 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f90400042c0 con 0x7f9050106cb0 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.302+0000 7f904e7fc700 1 -- 172.21.15.12:0/1661263891 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9040011940 con 0x7f9050106cb0 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.303+0000 7f90560d0700 1 -- 172.21.15.12:0/1661263891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 msgr2=0x7f90501070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.303+0000 7f90560d0700 1 --2- 172.21.15.12:0/1661263891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f90501070d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f90400098a0 tx=0x7f9040009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.303+0000 7f90560d0700 1 -- 172.21.15.12:0/1661263891 shutdown_connections 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.303+0000 7f90560d0700 1 --2- 172.21.15.12:0/1661263891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f90501070d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.303+0000 7f90560d0700 1 -- 172.21.15.12:0/1661263891 >> 172.21.15.12:0/1661263891 conn(0x7f9050102250 msgr2=0x7f9050104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.303+0000 7f90560d0700 1 -- 172.21.15.12:0/1661263891 shutdown_connections 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.303+0000 7f90560d0700 1 -- 172.21.15.12:0/1661263891 wait complete. 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.304+0000 7f90560d0700 1 Processor -- start 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.304+0000 7f90560d0700 1 -- start start 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.305+0000 7f90560d0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f905019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.305+0000 7f90560d0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905019d020 con 0x7f9050106cb0 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.305+0000 7f904f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f905019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.305+0000 7f904f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f905019cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56660/0 (socket says 172.21.15.12:56660) 2023-12-11T20:05:05.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.305+0000 7f904f7fe700 1 -- 172.21.15.12:0/212212011 learned_addr learned my addr 172.21.15.12:0/212212011 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.305+0000 7f904f7fe700 1 -- 172.21.15.12:0/212212011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040009550 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.305+0000 7f904f7fe700 1 --2- 172.21.15.12:0/212212011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f905019cae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9040003f20 tx=0x7f9040011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.306+0000 7f904cff9700 1 -- 172.21.15.12:0/212212011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90400036a0 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.306+0000 7f904cff9700 1 -- 172.21.15.12:0/212212011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f904001b440 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.306+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905019d220 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.306+0000 7f904cff9700 1 -- 172.21.15.12:0/212212011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9040023400 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.306+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905019d6c0 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.306+0000 7f904cff9700 1 -- 172.21.15.12:0/212212011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9040023970 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.306+0000 7f904cff9700 1 -- 172.21.15.12:0/212212011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f904002cdf0 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.307+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9050062c00 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.310+0000 7f904cff9700 1 -- 172.21.15.12:0/212212011 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f9040023d60 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.384+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f905010b0b0 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.385+0000 7f904cff9700 1 -- 172.21.15.12:0/212212011 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f904001b5b0 con 0x7f9050106cb0 2023-12-11T20:05:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.385+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 msgr2=0x7f905019cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:05.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.385+0000 7f90560d0700 1 --2- 172.21.15.12:0/212212011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f905019cae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9040003f20 tx=0x7f9040011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:05.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.386+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 shutdown_connections 2023-12-11T20:05:05.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.386+0000 7f90560d0700 1 --2- 172.21.15.12:0/212212011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9050106cb0 0x7f905019cae0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:05.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.386+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 >> 172.21.15.12:0/212212011 conn(0x7f9050102250 msgr2=0x7f9050102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:05.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.386+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 shutdown_connections 2023-12-11T20:05:05.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:05.386+0000 7f90560d0700 1 -- 172.21.15.12:0/212212011 wait complete. 2023-12-11T20:05:05.833 INFO:teuthology.orchestra.run.smithi012.stdout:Restarting the monitor... 2023-12-11T20:05:06.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:05 smithi012 systemd[1]: Stopping Ceph mon.a for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:05:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:06 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-a[128253]: 2023-12-11T20:05:06.293+0000 7f0689ae8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:05:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:06 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-a[128253]: 2023-12-11T20:05:06.293+0000 7f0689ae8700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-11T20:05:07.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:06 smithi012 bash[128622]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-a 2023-12-11T20:05:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.a.service: Succeeded. 2023-12-11T20:05:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 systemd[1]: Stopped Ceph mon.a for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:05:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 systemd[1]: Starting Ceph mon.a for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:05:07.865 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 podman[128747]: 2023-12-11T20:05:07.865 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 bash[128747]: a0d27fe7a4783d4fd2d2847d2e0e9edd0b51eacef5d933a046c9e67ea6539f1b 2023-12-11T20:05:07.865 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: set uid:gid to 167:167 (ceph:ceph) 2023-12-11T20:05:07.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev), process ceph-mon, pid 7 2023-12-11T20:05:07.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: pidfile_write: ignore empty --pid-file 2023-12-11T20:05:07.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: load: jerasure load: lrc 2023-12-11T20:05:07.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: RocksDB version: 7.9.2 2023-12-11T20:05:07.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Git sha 0 2023-12-11T20:05:07.930 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Compile date 2023-12-11 11:29:13 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: DB SUMMARY 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: DB Session ID: DTRL62UHHE9TJZJAX56W 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: CURRENT file: CURRENT 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: IDENTITY file: IDENTITY 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99184 ; 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.error_if_exists: 0 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.create_if_missing: 0 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.paranoid_checks: 1 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.env: 0x55e84859ba60 2023-12-11T20:05:07.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.fs: PosixFileSystem 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.info_log: 0x55e849393780 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_file_opening_threads: 16 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.statistics: (nil) 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.use_fsync: 0 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_log_file_size: 0 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.keep_log_file_num: 1000 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.recycle_log_file_num: 0 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.allow_fallocate: 1 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.allow_mmap_reads: 0 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.allow_mmap_writes: 0 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.use_direct_reads: 0 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-11T20:05:07.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.create_missing_column_families: 0 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.db_log_dir: 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.wal_dir: 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.advise_random_on_open: 1 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.db_write_buffer_size: 0 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.write_buffer_manager: 0x55e849349360 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-11T20:05:07.933 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.rate_limiter: (nil) 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.wal_recovery_mode: 2 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.enable_thread_tracking: 0 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.enable_pipelined_write: 0 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.unordered_write: 0 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.row_cache: None 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.wal_filter: None 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.allow_ingest_behind: 0 2023-12-11T20:05:07.934 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.two_write_queues: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.manual_wal_flush: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.wal_compression: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.atomic_flush: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.log_readahead_size: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.best_efforts_recovery: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.allow_data_in_errors: 0 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.db_host_id: __hostname__ 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-11T20:05:07.935 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_background_jobs: 2 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_background_compactions: -1 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_subcompactions: 1 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_total_wal_size: 0 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_open_files: -1 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bytes_per_sync: 0 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-11T20:05:07.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_readahead_size: 0 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_background_flushes: -1 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Compression algorithms supported: 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: kZSTD supported: 0 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: kXpressCompression supported: 0 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: kLZ4HCCompression supported: 1 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: kZlibCompression supported: 1 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: kSnappyCompression supported: 1 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: kLZ4Compression supported: 1 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: kBZip2Compression supported: 0 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-11T20:05:07.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.merge_operator: 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_filter: None 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_filter_factory: None 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.sst_partitioner_factory: None 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e8493938a0) 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks: 1 2023-12-11T20:05:07.938 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-11T20:05:07.939 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-11T20:05:07.939 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_top_level_index_and_filter: 1 2023-12-11T20:05:07.939 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_type: 0 2023-12-11T20:05:07.939 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_index_type: 0 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_shortening: 1 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: checksum: 4 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: no_block_cache: 0 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache: 0x55e8493e9090 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_name: BinnedLRUCache 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_options: 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: capacity : 536870912 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_shard_bits : 4 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: strict_capacity_limit : 0 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: high_pri_pool_ratio: 0.000 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_compressed: (nil) 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: persistent_cache: (nil) 2023-12-11T20:05:07.940 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size: 4096 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size_deviation: 10 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_restart_interval: 16 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_block_restart_interval: 1 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: metadata_block_size: 4096 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: partition_filters: 0 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: use_delta_encoding: 1 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: filter_policy: bloomfilter 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: whole_key_filtering: 1 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: verify_compression: 0 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: read_amp_bytes_per_bit: 0 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: format_version: 5 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_index_compression: 1 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_align: 0 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_auto_readahead_size: 262144 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: prepopulate_block_cache: 0 2023-12-11T20:05:07.941 INFO:journalctl@ceph.mon.a.smithi012.stdout: initial_auto_readahead_size: 8192 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.write_buffer_size: 33554432 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_write_buffer_number: 2 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression: NoCompression 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression: Disabled 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.prefix_extractor: nullptr 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.num_levels: 7 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-11T20:05:07.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.level: 32767 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.strategy: 0 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.enabled: false 2023-12-11T20:05:07.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.target_file_size_base: 67108864 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-11T20:05:07.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.arena_block_size: 1048576 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.disable_auto_compactions: 0 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-11T20:05:07.945 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.table_properties_collectors: 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.inplace_update_support: 0 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.bloom_locality: 0 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.max_successive_merges: 0 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.paranoid_file_checks: 0 2023-12-11T20:05:07.946 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.force_consistency_checks: 1 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.report_bg_io_stats: 0 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.ttl: 2592000 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.enable_blob_files: false 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.min_blob_size: 0 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.blob_file_size: 268435456 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.blob_file_starting_level: 0 2023-12-11T20:05:07.947 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2be973cc-1c4b-4474-bd33-fc979a1b06ce 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325107876150, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325107877800, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94284, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 320, "table_properties": {"data_size": 92285, "index_size": 281, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13674, "raw_average_key_size": 49, "raw_value_size": 84817, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702325107, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2be973cc-1c4b-4474-bd33-fc979a1b06ce", "db_session_id": "DTRL62UHHE9TJZJAX56W", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325107877935, "job": 1, "event": "recovery_finished"} 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e849484000 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: DB pointer 0x55e849470000 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-11T20:05:07.948 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** DB Stats ** 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: L0 2/0 93.91 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Sum 2/0 93.91 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:05:07.949 INFO:journalctl@ceph.mon.a.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 86.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-11T20:05:07.950 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative compaction: 0.00 GB write, 10.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval compaction: 0.00 GB write, 10.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache BinnedLRUCache@0x55e8493e9090#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: starting mon.a rank 0 at public addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] at bind addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a@-1(???) e1 preinit fsid 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a@-1(???).mds e1 new map 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a@-1(???).mds e1 print_map 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: e1 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-11T20:05:07.951 INFO:journalctl@ceph.mon.a.smithi012.stdout: legacy client fscid: -1 2023-12-11T20:05:07.952 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2023-12-11T20:05:07.952 INFO:journalctl@ceph.mon.a.smithi012.stdout: No filesystems configured 2023-12-11T20:05:07.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-11T20:05:07.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:05:07.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:05:07.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:05:07.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-11T20:05:07.952 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 systemd[1]: Started Ceph mon.a for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:05:07.952 INFO:teuthology.orchestra.run.smithi012.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-12-11T20:05:08.187 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-11T20:05:08.187 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: monmap e1: 1 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-11T20:05:08.187 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: fsmap 2023-12-11T20:05:08.187 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: osdmap e1: 0 total, 0 up, 0 in 2023-12-11T20:05:08.187 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:07 smithi012 ceph-mon[128787]: mgrmap e1: no daemons active 2023-12-11T20:05:08.917 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.457+0000 7fca4994e700 1 Processor -- start 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.457+0000 7fca4994e700 1 -- start start 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.457+0000 7fca4994e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4407a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.457+0000 7fca4994e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4407a750 con 0x7fca4407bd20 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.458+0000 7fca42ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4407a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.458+0000 7fca42ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4407a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56668/0 (socket says 172.21.15.12:56668) 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.458+0000 7fca42ffd700 1 -- 172.21.15.12:0/3282315542 learned_addr learned my addr 172.21.15.12:0/3282315542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.459+0000 7fca42ffd700 1 -- 172.21.15.12:0/3282315542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4407a890 con 0x7fca4407bd20 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.459+0000 7fca42ffd700 1 --2- 172.21.15.12:0/3282315542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4407a180 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fca340098a0 tx=0x7fca34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7f215634d16403 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.459+0000 7fca41ffb700 1 -- 172.21.15.12:0/3282315542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca34004160 con 0x7fca4407bd20 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.459+0000 7fca41ffb700 1 -- 172.21.15.12:0/3282315542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fca340042c0 con 0x7fca4407bd20 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.459+0000 7fca41ffb700 1 -- 172.21.15.12:0/3282315542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca34011940 con 0x7fca4407bd20 2023-12-11T20:05:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.460+0000 7fca4994e700 1 -- 172.21.15.12:0/3282315542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 msgr2=0x7fca4407a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.460+0000 7fca4994e700 1 --2- 172.21.15.12:0/3282315542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4407a180 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fca340098a0 tx=0x7fca34009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.460+0000 7fca4994e700 1 -- 172.21.15.12:0/3282315542 shutdown_connections 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.460+0000 7fca4994e700 1 --2- 172.21.15.12:0/3282315542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4407a180 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.460+0000 7fca4994e700 1 -- 172.21.15.12:0/3282315542 >> 172.21.15.12:0/3282315542 conn(0x7fca44102250 msgr2=0x7fca44104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.460+0000 7fca4994e700 1 -- 172.21.15.12:0/3282315542 shutdown_connections 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.460+0000 7fca4994e700 1 -- 172.21.15.12:0/3282315542 wait complete. 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.461+0000 7fca4994e700 1 Processor -- start 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.461+0000 7fca4994e700 1 -- start start 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.462+0000 7fca4994e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.462+0000 7fca4994e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4419cff0 con 0x7fca4407bd20 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.462+0000 7fca42ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.462+0000 7fca42ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4419cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56674/0 (socket says 172.21.15.12:56674) 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.462+0000 7fca42ffd700 1 -- 172.21.15.12:0/2367862499 learned_addr learned my addr 172.21.15.12:0/2367862499 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.462+0000 7fca42ffd700 1 -- 172.21.15.12:0/2367862499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca34009550 con 0x7fca4407bd20 2023-12-11T20:05:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.463+0000 7fca42ffd700 1 --2- 172.21.15.12:0/2367862499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4419cab0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fca34003f20 tx=0x7fca34011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.463+0000 7fca4894c700 1 -- 172.21.15.12:0/2367862499 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca340036a0 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.463+0000 7fca4894c700 1 -- 172.21.15.12:0/2367862499 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fca3401b440 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.463+0000 7fca4894c700 1 -- 172.21.15.12:0/2367862499 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca34023400 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.463+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4419d1f0 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.463+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4419d690 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.463+0000 7fca4894c700 1 -- 172.21.15.12:0/2367862499 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca34023970 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.463+0000 7fca4894c700 1 -- 172.21.15.12:0/2367862499 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fca3402cdf0 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.464+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4410d020 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.467+0000 7fca4894c700 1 -- 172.21.15.12:0/2367862499 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fca34023d60 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.541+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fca4410d1e0 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.543+0000 7fca4894c700 1 -- 172.21.15.12:0/2367862499 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fca34006d60 con 0x7fca4407bd20 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.544+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 msgr2=0x7fca4419cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.544+0000 7fca4994e700 1 --2- 172.21.15.12:0/2367862499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4419cab0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fca34003f20 tx=0x7fca34011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.544+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 shutdown_connections 2023-12-11T20:05:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.544+0000 7fca4994e700 1 --2- 172.21.15.12:0/2367862499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca4407bd20 0x7fca4419cab0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.544+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 >> 172.21.15.12:0/2367862499 conn(0x7fca44102250 msgr2=0x7fca44102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.545+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 shutdown_connections 2023-12-11T20:05:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:08.545+0000 7fca4994e700 1 -- 172.21.15.12:0/2367862499 wait complete. 2023-12-11T20:05:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-11T20:05:08.942 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:05:08.943 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mgr... 2023-12-11T20:05:08.943 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:9283 ... 2023-12-11T20:05:08.944 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:8765 ... 2023-12-11T20:05:09.316 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.x 2023-12-11T20:05:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.x.service: Unit ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.x.service not loaded. 2023-12-11T20:05:09.523 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-732461f0-9860-11ee-95a3-87774f69a715.target.wants/ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-732461f0-9860-11ee-95a3-87774f69a715@.service. 2023-12-11T20:05:09.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:09 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2367862499' entity='client.admin' 2023-12-11T20:05:09.831 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:09 smithi012 systemd[1]: Starting Ceph mgr.x for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:05:10.293 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:10 smithi012 podman[129015]: 2023-12-11T20:05:10.343 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-11T20:05:10.344 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2023-12-11T20:05:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-11T20:05:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2023-12-11T20:05:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2023-12-11T20:05:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2023-12-11T20:05:10.379 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-11T20:05:10.379 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2023-12-11T20:05:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-11T20:05:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2023-12-11T20:05:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2023-12-11T20:05:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-12-11T20:05:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr to start... 2023-12-11T20:05:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr... 2023-12-11T20:05:10.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:10 smithi012 bash[129015]: c9a94701935a66f9e026f66613e690d65bfabd5d3ffa5b3d2beb16a47bd22873 2023-12-11T20:05:10.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:10 smithi012 systemd[1]: Started Ceph mgr.x for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:05:10.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:10 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:10.487+0000 7f7f204b1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-11T20:05:10.854 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:10 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:10.595+0000 7f7f204b1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-11T20:05:10.854 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:10 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:10.719+0000 7f7f204b1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-11T20:05:11.113 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:10 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:10.856+0000 7f7f204b1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-11T20:05:11.113 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:11 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:11.092+0000 7f7f204b1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-11T20:05:11.480 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:11.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2023-12-11T20:05:11.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "732461f0-9860-11ee-95a3-87774f69a715", 2023-12-11T20:05:11.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2023-12-11T20:05:11.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-11T20:05:11.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-11T20:05:11.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-11T20:05:11.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-11T20:05:11.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-11T20:05:11.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-11T20:05:11.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-11T20:05:11.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-11T20:05:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-11T20:05:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-11T20:05:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-11T20:05:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-11T20:05:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-11T20:05:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-11T20:05:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2023-12-11T20:05:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2023-12-11T20:05:01.329945+0000", 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.975+0000 7f5aa7b0d700 1 Processor -- start 2023-12-11T20:05:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.976+0000 7f5aa7b0d700 1 -- start start 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.976+0000 7f5aa7b0d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa01070f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.976+0000 7f5aa7b0d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa01076c0 con 0x7f5aa0106cd0 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.976+0000 7f5aa58a9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa01070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.977+0000 7f5aa58a9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa01070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45468/0 (socket says 172.21.15.12:45468) 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.977+0000 7f5aa58a9700 1 -- 172.21.15.12:0/3595542751 learned_addr learned my addr 172.21.15.12:0/3595542751 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.977+0000 7f5aa58a9700 1 -- 172.21.15.12:0/3595542751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0107ed0 con 0x7f5aa0106cd0 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.977+0000 7f5aa58a9700 1 --2- 172.21.15.12:0/3595542751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa01070f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0098a0 tx=0x7f5a9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a57a2efd5b8012d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.977+0000 7f5aa48a7700 1 -- 172.21.15.12:0/3595542751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c004160 con 0x7f5aa0106cd0 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.977+0000 7f5aa48a7700 1 -- 172.21.15.12:0/3595542751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5a9c0042c0 con 0x7f5aa0106cd0 2023-12-11T20:05:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.977+0000 7f5aa48a7700 1 -- 172.21.15.12:0/3595542751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c011940 con 0x7f5aa0106cd0 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.978+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/3595542751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 msgr2=0x7f5aa01070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.978+0000 7f5aa7b0d700 1 --2- 172.21.15.12:0/3595542751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa01070f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0098a0 tx=0x7f5a9c009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.978+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/3595542751 shutdown_connections 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.978+0000 7f5aa7b0d700 1 --2- 172.21.15.12:0/3595542751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa01070f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.978+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/3595542751 >> 172.21.15.12:0/3595542751 conn(0x7f5aa0102290 msgr2=0x7f5aa01046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.978+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/3595542751 shutdown_connections 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.978+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/3595542751 wait complete. 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.980+0000 7f5aa7b0d700 1 Processor -- start 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.980+0000 7f5aa7b0d700 1 -- start start 2023-12-11T20:05:11.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.980+0000 7f5aa7b0d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.980+0000 7f5aa7b0d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa019ae00 con 0x7f5aa0106cd0 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.981+0000 7f5aa58a9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.981+0000 7f5aa58a9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45482/0 (socket says 172.21.15.12:45482) 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.981+0000 7f5aa58a9700 1 -- 172.21.15.12:0/1124664224 learned_addr learned my addr 172.21.15.12:0/1124664224 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.981+0000 7f5aa58a9700 1 -- 172.21.15.12:0/1124664224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c009550 con 0x7f5aa0106cd0 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.981+0000 7f5aa58a9700 1 --2- 172.21.15.12:0/1124664224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa019a8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c003f20 tx=0x7f5a9c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.982+0000 7f5a96ffd700 1 -- 172.21.15.12:0/1124664224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c0036a0 con 0x7f5aa0106cd0 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.982+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa019b000 con 0x7f5aa0106cd0 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.982+0000 7f5a96ffd700 1 -- 172.21.15.12:0/1124664224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5a9c01b440 con 0x7f5aa0106cd0 2023-12-11T20:05:11.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.982+0000 7f5a96ffd700 1 -- 172.21.15.12:0/1124664224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a9c023400 con 0x7f5aa0106cd0 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.982+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa019b4a0 con 0x7f5aa0106cd0 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.982+0000 7f5a96ffd700 1 -- 172.21.15.12:0/1124664224 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a9c0239c0 con 0x7f5aa0106cd0 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.982+0000 7f5a96ffd700 1 -- 172.21.15.12:0/1124664224 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5a9c02ce40 con 0x7f5aa0106cd0 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.983+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa0062c00 con 0x7f5aa0106cd0 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:10.986+0000 7f5a96ffd700 1 -- 172.21.15.12:0/1124664224 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5a9c023d60 con 0x7f5aa0106cd0 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.063+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5aa010b100 con 0x7f5aa0106cd0 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.064+0000 7f5a96ffd700 1 -- 172.21.15.12:0/1124664224 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5a9c01b5b0 con 0x7f5aa0106cd0 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.065+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 msgr2=0x7f5aa019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.065+0000 7f5aa7b0d700 1 --2- 172.21.15.12:0/1124664224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa019a8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c003f20 tx=0x7f5a9c011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.065+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 shutdown_connections 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.065+0000 7f5aa7b0d700 1 --2- 172.21.15.12:0/1124664224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa0106cd0 0x7f5aa019a8c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:11.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.065+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 >> 172.21.15.12:0/1124664224 conn(0x7f5aa0102290 msgr2=0x7f5aa0102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.065+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 shutdown_connections 2023-12-11T20:05:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:11.065+0000 7f5aa7b0d700 1 -- 172.21.15.12:0/1124664224 wait complete. 2023-12-11T20:05:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (1/15)... 2023-12-11T20:05:11.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:11 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1124664224' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-11T20:05:11.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:11 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:11.593+0000 7f7f204b1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-11T20:05:11.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:11 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:11.761+0000 7f7f204b1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-11T20:05:12.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:11 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:11.883+0000 7f7f204b1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-11T20:05:12.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:12 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:12.010+0000 7f7f204b1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-11T20:05:12.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:12 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:12.578+0000 7f7f204b1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-11T20:05:13.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:13 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:13.503+0000 7f7f204b1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-11T20:05:13.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:13 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:13.626+0000 7f7f204b1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-11T20:05:15.021 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:14 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:14.649+0000 7f7f204b1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:05:15.021 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:14 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:14.782+0000 7f7f204b1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-11T20:05:15.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:15 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:15.023+0000 7f7f204b1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:05:15.906 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:15 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:15.583+0000 7f7f204b1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-11T20:05:15.907 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:15 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:15.705+0000 7f7f204b1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-11T20:05:16.267 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:15 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:15.908+0000 7f7f204b1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-11T20:05:16.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:16 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:16.269+0000 7f7f204b1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-11T20:05:17.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:17 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:17.244+0000 7f7f204b1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-11T20:05:17.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:17 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:17.427+0000 7f7f204b1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-11T20:05:18.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:17 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:17.690+0000 7f7f204b1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-11T20:05:18.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:17 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:17.848+0000 7f7f204b1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-11T20:05:18.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:18 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:18.143+0000 7f7f204b1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-11T20:05:19.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:19.279+0000 7f7f204b1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-11T20:05:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: Activating manager daemon x 2023-12-11T20:05:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: mgrmap e2: x(active, starting, since 0.00485746s) 2023-12-11T20:05:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-11T20:05:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-11T20:05:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-11T20:05:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:05:19.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-11T20:05:19.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: Manager daemon x is now available 2023-12-11T20:05:19.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-11T20:05:19.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-11T20:05:19.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' 2023-12-11T20:05:19.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' 2023-12-11T20:05:19.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:19 smithi012 ceph-mon[128787]: from='mgr.14100 172.21.15.12:0/1818128903' entity='mgr.x' 2023-12-11T20:05:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:21 smithi012 ceph-mon[128787]: mgrmap e3: x(active, since 1.00921s) 2023-12-11T20:05:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:21 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1290925651' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-11T20:05:22.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:22 smithi012 ceph-mon[128787]: mgrmap e4: x(active, since 2s) 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "732461f0-9860-11ee-95a3-87774f69a715", 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-11T20:05:22.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-11T20:05:22.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-11T20:05:22.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-11T20:05:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2023-12-11T20:05:01.329945+0000", 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.238+0000 7f5ea90b4700 1 Processor -- start 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.238+0000 7f5ea90b4700 1 -- start start 2023-12-11T20:05:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.238+0000 7f5ea90b4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea41070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.238+0000 7f5ea90b4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea41076a0 con 0x7f5ea4106cb0 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.239+0000 7f5ea2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea41070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.239+0000 7f5ea2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea41070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55008/0 (socket says 172.21.15.12:55008) 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.239+0000 7f5ea2d9d700 1 -- 172.21.15.12:0/3446669030 learned_addr learned my addr 172.21.15.12:0/3446669030 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.239+0000 7f5ea2d9d700 1 -- 172.21.15.12:0/3446669030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4107eb0 con 0x7f5ea4106cb0 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.239+0000 7f5ea2d9d700 1 --2- 172.21.15.12:0/3446669030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea41070d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5e940098a0 tx=0x7f5e94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd6dc7efef159a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea1d9b700 1 -- 172.21.15.12:0/3446669030 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e94004160 con 0x7f5ea4106cb0 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea1d9b700 1 -- 172.21.15.12:0/3446669030 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5e940042c0 con 0x7f5ea4106cb0 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea1d9b700 1 -- 172.21.15.12:0/3446669030 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e94011940 con 0x7f5ea4106cb0 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea90b4700 1 -- 172.21.15.12:0/3446669030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 msgr2=0x7f5ea41070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea90b4700 1 --2- 172.21.15.12:0/3446669030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea41070d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5e940098a0 tx=0x7f5e94009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea90b4700 1 -- 172.21.15.12:0/3446669030 shutdown_connections 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea90b4700 1 --2- 172.21.15.12:0/3446669030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea41070d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:22.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea90b4700 1 -- 172.21.15.12:0/3446669030 >> 172.21.15.12:0/3446669030 conn(0x7f5ea4102250 msgr2=0x7f5ea4104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.240+0000 7f5ea90b4700 1 -- 172.21.15.12:0/3446669030 shutdown_connections 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.241+0000 7f5ea90b4700 1 -- 172.21.15.12:0/3446669030 wait complete. 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.242+0000 7f5ea90b4700 1 Processor -- start 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.242+0000 7f5ea90b4700 1 -- start start 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.243+0000 7f5ea90b4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.243+0000 7f5ea90b4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea419d030 con 0x7f5ea4106cb0 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.243+0000 7f5ea2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.243+0000 7f5ea2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea419caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55022/0 (socket says 172.21.15.12:55022) 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.243+0000 7f5ea2d9d700 1 -- 172.21.15.12:0/1290925651 learned_addr learned my addr 172.21.15.12:0/1290925651 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.243+0000 7f5ea2d9d700 1 -- 172.21.15.12:0/1290925651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94009550 con 0x7f5ea4106cb0 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.243+0000 7f5ea2d9d700 1 --2- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea419caf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e94003f20 tx=0x7f5e94011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.244+0000 7f5e8bfff700 1 -- 172.21.15.12:0/1290925651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e940036a0 con 0x7f5ea4106cb0 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.244+0000 7f5e8bfff700 1 -- 172.21.15.12:0/1290925651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5e9401b440 con 0x7f5ea4106cb0 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.244+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea419d230 con 0x7f5ea4106cb0 2023-12-11T20:05:22.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.244+0000 7f5e8bfff700 1 -- 172.21.15.12:0/1290925651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e94023400 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.244+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea419d6d0 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.245+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea410b0e0 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.245+0000 7f5e8bfff700 1 -- 172.21.15.12:0/1290925651 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 2) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f5e9401b5b0 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.246+0000 7f5e8bfff700 1 -- 172.21.15.12:0/1290925651 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5e9404c390 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.248+0000 7f5e8bfff700 1 -- 172.21.15.12:0/1290925651 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5e9401b920 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.287+0000 7f5e8bfff700 1 -- 172.21.15.12:0/1290925651 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 3) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f5e94003800 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.287+0000 7f5e8bfff700 1 --2- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f5e8c039300 0x7f5e8c03b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.288+0000 7f5ea259c700 1 --2- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f5e8c039300 0x7f5e8c03b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.289+0000 7f5ea259c700 1 --2- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f5e8c039300 0x7f5e8c03b6f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5e98006fd0 tx=0x7f5e98006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.328+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5ea419ff60 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.328+0000 7f5e8bfff700 1 -- 172.21.15.12:0/1290925651 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5e9400b5c0 con 0x7f5ea4106cb0 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f5e8c039300 msgr2=0x7f5e8c03b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 --2- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f5e8c039300 0x7f5e8c03b6f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5e98006fd0 tx=0x7f5e98006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:22.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 msgr2=0x7f5ea419caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 --2- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea419caf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e94003f20 tx=0x7f5e94011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 shutdown_connections 2023-12-11T20:05:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 --2- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f5e8c039300 0x7f5e8c03b6f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 --2- 172.21.15.12:0/1290925651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea4106cb0 0x7f5ea419caf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 >> 172.21.15.12:0/1290925651 conn(0x7f5ea4102250 msgr2=0x7f5ea4102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 shutdown_connections 2023-12-11T20:05:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:20.329+0000 7f5ea90b4700 1 -- 172.21.15.12:0/1290925651 wait complete. 2023-12-11T20:05:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:mgr is available 2023-12-11T20:05:23.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:23.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2023-12-11T20:05:23.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:05:23.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-11T20:05:23.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-11T20:05:23.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-11T20:05:23.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-11T20:05:23.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.088+0000 7f703c122700 1 Processor -- start 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.089+0000 7f703c122700 1 -- start start 2023-12-11T20:05:23.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.089+0000 7f703c122700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703407a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.089+0000 7f703c122700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703407a710 con 0x7f703407bce0 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.089+0000 7f7039ebe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703407a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.089+0000 7f7039ebe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703407a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55036/0 (socket says 172.21.15.12:55036) 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.089+0000 7f7039ebe700 1 -- 172.21.15.12:0/2261192816 learned_addr learned my addr 172.21.15.12:0/2261192816 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.090+0000 7f7039ebe700 1 -- 172.21.15.12:0/2261192816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703407a850 con 0x7f703407bce0 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.090+0000 7f7039ebe700 1 --2- 172.21.15.12:0/2261192816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703407a140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70300098a0 tx=0x7f7030009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebb69fdc96c0bc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.090+0000 7f7038ebc700 1 -- 172.21.15.12:0/2261192816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7030004160 con 0x7f703407bce0 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.090+0000 7f7038ebc700 1 -- 172.21.15.12:0/2261192816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f70300042c0 con 0x7f703407bce0 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.090+0000 7f7038ebc700 1 -- 172.21.15.12:0/2261192816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7030011940 con 0x7f703407bce0 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.091+0000 7f703c122700 1 -- 172.21.15.12:0/2261192816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 msgr2=0x7f703407a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.091+0000 7f703c122700 1 --2- 172.21.15.12:0/2261192816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703407a140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70300098a0 tx=0x7f7030009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:23.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.091+0000 7f703c122700 1 -- 172.21.15.12:0/2261192816 shutdown_connections 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.091+0000 7f703c122700 1 --2- 172.21.15.12:0/2261192816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703407a140 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.091+0000 7f703c122700 1 -- 172.21.15.12:0/2261192816 >> 172.21.15.12:0/2261192816 conn(0x7f7034102250 msgr2=0x7f7034104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.091+0000 7f703c122700 1 -- 172.21.15.12:0/2261192816 shutdown_connections 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.091+0000 7f703c122700 1 -- 172.21.15.12:0/2261192816 wait complete. 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.092+0000 7f703c122700 1 Processor -- start 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.092+0000 7f703c122700 1 -- start start 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.093+0000 7f703c122700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.093+0000 7f703c122700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703419cfb0 con 0x7f703407bce0 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.093+0000 7f7039ebe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.093+0000 7f7039ebe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55050/0 (socket says 172.21.15.12:55050) 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.093+0000 7f7039ebe700 1 -- 172.21.15.12:0/3651366390 learned_addr learned my addr 172.21.15.12:0/3651366390 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.093+0000 7f7039ebe700 1 -- 172.21.15.12:0/3651366390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009550 con 0x7f703407bce0 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.093+0000 7f7039ebe700 1 --2- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703419ca70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7030003f20 tx=0x7f7030011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.094+0000 7f702affd700 1 -- 172.21.15.12:0/3651366390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70300037d0 con 0x7f703407bce0 2023-12-11T20:05:23.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.094+0000 7f702affd700 1 -- 172.21.15.12:0/3651366390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f703001b440 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.094+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703419d1b0 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.094+0000 7f702affd700 1 -- 172.21.15.12:0/3651366390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7030023590 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.094+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703419d650 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.095+0000 7f702affd700 1 -- 172.21.15.12:0/3651366390 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f703001b5b0 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.095+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703410d000 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.095+0000 7f702affd700 1 --2- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f70200387d0 0x7f702003ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.095+0000 7f702affd700 1 -- 172.21.15.12:0/3651366390 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f703004c7d0 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.095+0000 7f70396bd700 1 --2- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f70200387d0 0x7f702003ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.095+0000 7f70396bd700 1 --2- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f70200387d0 0x7f702003ac90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7024006fd0 tx=0x7f7024006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.101+0000 7f702affd700 1 -- 172.21.15.12:0/3651366390 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f703001b920 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.306+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f703410d240 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.307+0000 7f702affd700 1 -- 172.21.15.12:0/3651366390 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+398 (secure 0 0 0) 0x7f7030016260 con 0x7f703407bce0 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f70200387d0 msgr2=0x7f702003ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:23.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 --2- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f70200387d0 0x7f702003ac90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7024006fd0 tx=0x7f7024006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 msgr2=0x7f703419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 --2- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703419ca70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7030003f20 tx=0x7f7030011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 shutdown_connections 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 --2- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f70200387d0 0x7f702003ac90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 --2- 172.21.15.12:0/3651366390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f703407bce0 0x7f703419ca70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 >> 172.21.15.12:0/3651366390 conn(0x7f7034102250 msgr2=0x7f7034102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 shutdown_connections 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:23.309+0000 7f703c122700 1 -- 172.21.15.12:0/3651366390 wait complete. 2023-12-11T20:05:23.793 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling cephadm module... 2023-12-11T20:05:24.068 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:23 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3651366390' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-11T20:05:25.171 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:24 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/151615955' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-11T20:05:25.172 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: ignoring --setuser ceph since I am not root 2023-12-11T20:05:25.172 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: ignoring --setgroup ceph since I am not root 2023-12-11T20:05:25.172 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:25.172+0000 7ff92df3e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-11T20:05:25.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.341+0000 7f169b396700 1 Processor -- start 2023-12-11T20:05:25.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.341+0000 7f169b396700 1 -- start start 2023-12-11T20:05:25.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.341+0000 7f169b396700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f16941070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.341+0000 7f169b396700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16941076a0 con 0x7f1694106cb0 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.341+0000 7f1699132700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f16941070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.342+0000 7f1699132700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f16941070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55058/0 (socket says 172.21.15.12:55058) 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.342+0000 7f1699132700 1 -- 172.21.15.12:0/2702804870 learned_addr learned my addr 172.21.15.12:0/2702804870 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.342+0000 7f1699132700 1 -- 172.21.15.12:0/2702804870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694107eb0 con 0x7f1694106cb0 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.342+0000 7f1699132700 1 --2- 172.21.15.12:0/2702804870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f16941070d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f16900098a0 tx=0x7f1690009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49410c87f638890d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.342+0000 7f168bfff700 1 -- 172.21.15.12:0/2702804870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1690004160 con 0x7f1694106cb0 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.342+0000 7f168bfff700 1 -- 172.21.15.12:0/2702804870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f16900042c0 con 0x7f1694106cb0 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.342+0000 7f168bfff700 1 -- 172.21.15.12:0/2702804870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1690011940 con 0x7f1694106cb0 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.343+0000 7f169b396700 1 -- 172.21.15.12:0/2702804870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 msgr2=0x7f16941070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.343+0000 7f169b396700 1 --2- 172.21.15.12:0/2702804870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f16941070d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f16900098a0 tx=0x7f1690009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.343+0000 7f169b396700 1 -- 172.21.15.12:0/2702804870 shutdown_connections 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.343+0000 7f169b396700 1 --2- 172.21.15.12:0/2702804870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f16941070d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:25.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.343+0000 7f169b396700 1 -- 172.21.15.12:0/2702804870 >> 172.21.15.12:0/2702804870 conn(0x7f1694102250 msgr2=0x7f1694104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:25.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.343+0000 7f169b396700 1 -- 172.21.15.12:0/2702804870 shutdown_connections 2023-12-11T20:05:25.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.343+0000 7f169b396700 1 -- 172.21.15.12:0/2702804870 wait complete. 2023-12-11T20:05:25.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.345+0000 7f169b396700 1 Processor -- start 2023-12-11T20:05:25.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.345+0000 7f169b396700 1 -- start start 2023-12-11T20:05:25.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.345+0000 7f169b396700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f169407b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:25.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.345+0000 7f169b396700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169407bee0 con 0x7f1694106cb0 2023-12-11T20:05:25.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f1699132700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f169407b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:25.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f1699132700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f169407b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55066/0 (socket says 172.21.15.12:55066) 2023-12-11T20:05:25.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f1699132700 1 -- 172.21.15.12:0/151615955 learned_addr learned my addr 172.21.15.12:0/151615955 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:25.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f1699132700 1 -- 172.21.15.12:0/151615955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690009550 con 0x7f1694106cb0 2023-12-11T20:05:25.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f1699132700 1 --2- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f169407b9a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1690003f20 tx=0x7f1690011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:25.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f168a7fc700 1 -- 172.21.15.12:0/151615955 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16900036a0 con 0x7f1694106cb0 2023-12-11T20:05:25.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f168a7fc700 1 -- 172.21.15.12:0/151615955 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f169001b440 con 0x7f1694106cb0 2023-12-11T20:05:25.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f168a7fc700 1 -- 172.21.15.12:0/151615955 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1690023400 con 0x7f1694106cb0 2023-12-11T20:05:25.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f169b396700 1 -- 172.21.15.12:0/151615955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169407a120 con 0x7f1694106cb0 2023-12-11T20:05:25.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.346+0000 7f169b396700 1 -- 172.21.15.12:0/151615955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169407a5c0 con 0x7f1694106cb0 2023-12-11T20:05:25.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.348+0000 7f168a7fc700 1 -- 172.21.15.12:0/151615955 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f169001b5b0 con 0x7f1694106cb0 2023-12-11T20:05:25.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.348+0000 7f167ffff700 1 -- 172.21.15.12:0/151615955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16740052f0 con 0x7f1694106cb0 2023-12-11T20:05:25.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.348+0000 7f168a7fc700 1 --2- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f1680038820 0x7f168003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:25.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.348+0000 7f168a7fc700 1 -- 172.21.15.12:0/151615955 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f169004c770 con 0x7f1694106cb0 2023-12-11T20:05:25.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.348+0000 7f1698931700 1 --2- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f1680038820 0x7f168003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:25.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.349+0000 7f1698931700 1 --2- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f1680038820 0x7f168003ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1684006fd0 tx=0x7f1684006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:25.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.353+0000 7f168a7fc700 1 -- 172.21.15.12:0/151615955 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f169001b920 con 0x7f1694106cb0 2023-12-11T20:05:25.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.622+0000 7f167ffff700 1 -- 172.21.15.12:0/151615955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f1674005160 con 0x7f1694106cb0 2023-12-11T20:05:25.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.898+0000 7f168a7fc700 1 -- 172.21.15.12:0/151615955 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f169000b3e0 con 0x7f1694106cb0 2023-12-11T20:05:25.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.900+0000 7f168a7fc700 1 -- 172.21.15.12:0/151615955 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 5) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f16900236c0 con 0x7f1694106cb0 2023-12-11T20:05:25.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.902+0000 7f167ffff700 1 -- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f1680038820 msgr2=0x7f168003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:25.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.902+0000 7f167ffff700 1 --2- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f1680038820 0x7f168003ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1684006fd0 tx=0x7f1684006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:25.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.902+0000 7f167ffff700 1 -- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 msgr2=0x7f169407b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:25.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.902+0000 7f167ffff700 1 --2- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f169407b9a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1690003f20 tx=0x7f1690011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:25.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.902+0000 7f167ffff700 1 -- 172.21.15.12:0/151615955 shutdown_connections 2023-12-11T20:05:25.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.902+0000 7f167ffff700 1 --2- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f1680038820 0x7f168003ace0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:25.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.902+0000 7f167ffff700 1 --2- 172.21.15.12:0/151615955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1694106cb0 0x7f169407b9a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:25.378 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.902+0000 7f167ffff700 1 -- 172.21.15.12:0/151615955 >> 172.21.15.12:0/151615955 conn(0x7f1694102250 msgr2=0x7f1694102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:25.378 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.903+0000 7f167ffff700 1 -- 172.21.15.12:0/151615955 shutdown_connections 2023-12-11T20:05:25.378 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:24.903+0000 7f167ffff700 1 -- 172.21.15.12:0/151615955 wait complete. 2023-12-11T20:05:25.557 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:25.284+0000 7ff92df3e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-11T20:05:25.557 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:25.419+0000 7ff92df3e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-11T20:05:25.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:25.557+0000 7ff92df3e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-11T20:05:25.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:25.804+0000 7ff92df3e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-11T20:05:26.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/151615955' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-11T20:05:26.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:25 smithi012 ceph-mon[128787]: mgrmap e5: x(active, since 5s) 2023-12-11T20:05:26.475 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:26 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:26.302+0000 7ff92df3e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-11T20:05:26.475 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:26 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:26.476+0000 7ff92df3e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.908+0000 7fb9c81a5700 1 Processor -- start 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.908+0000 7fb9c81a5700 1 -- start start 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.908+0000 7fb9c81a5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c0110050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.908+0000 7fb9c81a5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0081550 con 0x7fb9c010dc60 2023-12-11T20:05:26.677 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.908+0000 7fb9c5f41700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c0110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.908+0000 7fb9c5f41700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c0110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55090/0 (socket says 172.21.15.12:55090) 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.908+0000 7fb9c5f41700 1 -- 172.21.15.12:0/1748135163 learned_addr learned my addr 172.21.15.12:0/1748135163 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.909+0000 7fb9c5f41700 1 -- 172.21.15.12:0/1748135163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0110590 con 0x7fb9c010dc60 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.909+0000 7fb9c5f41700 1 --2- 172.21.15.12:0/1748135163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c0110050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0098a0 tx=0x7fb9bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f52beeb65ccc06 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.909+0000 7fb9c4f3f700 1 -- 172.21.15.12:0/1748135163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9bc004160 con 0x7fb9c010dc60 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.909+0000 7fb9c4f3f700 1 -- 172.21.15.12:0/1748135163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb9bc0042c0 con 0x7fb9c010dc60 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.909+0000 7fb9c4f3f700 1 -- 172.21.15.12:0/1748135163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9bc011940 con 0x7fb9c010dc60 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.910+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1748135163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 msgr2=0x7fb9c0110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.910+0000 7fb9c81a5700 1 --2- 172.21.15.12:0/1748135163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c0110050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0098a0 tx=0x7fb9bc009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.910+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1748135163 shutdown_connections 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.910+0000 7fb9c81a5700 1 --2- 172.21.15.12:0/1748135163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c0110050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.910+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1748135163 >> 172.21.15.12:0/1748135163 conn(0x7fb9c007c2d0 msgr2=0x7fb9c007e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.910+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1748135163 shutdown_connections 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.910+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1748135163 wait complete. 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.912+0000 7fb9c81a5700 1 Processor -- start 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.912+0000 7fb9c81a5700 1 -- start start 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.912+0000 7fb9c81a5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c01a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.912+0000 7fb9c81a5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01a1470 con 0x7fb9c010dc60 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.913+0000 7fb9c5f41700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c01a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.913+0000 7fb9c5f41700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c01a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55100/0 (socket says 172.21.15.12:55100) 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.913+0000 7fb9c5f41700 1 -- 172.21.15.12:0/1171344959 learned_addr learned my addr 172.21.15.12:0/1171344959 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.913+0000 7fb9c5f41700 1 -- 172.21.15.12:0/1171344959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009550 con 0x7fb9c010dc60 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.913+0000 7fb9c5f41700 1 --2- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c01a0f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc003f20 tx=0x7fb9bc011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.914+0000 7fb9b6ffd700 1 -- 172.21.15.12:0/1171344959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9bc0037d0 con 0x7fb9c010dc60 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.914+0000 7fb9b6ffd700 1 -- 172.21.15.12:0/1171344959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb9bc01b440 con 0x7fb9c010dc60 2023-12-11T20:05:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.914+0000 7fb9b6ffd700 1 -- 172.21.15.12:0/1171344959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9bc023590 con 0x7fb9c010dc60 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.914+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c01a1670 con 0x7fb9c010dc60 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.914+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c01a1b10 con 0x7fb9c010dc60 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.915+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c01113f0 con 0x7fb9c010dc60 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.915+0000 7fb9b6ffd700 1 -- 172.21.15.12:0/1171344959 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 45580+0+0 (secure 0 0 0) 0x7fb9bc01b5b0 con 0x7fb9c010dc60 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.915+0000 7fb9b6ffd700 1 --2- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7fb9ac038870 0x7fb9ac03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.915+0000 7fb9b6ffd700 1 -- 172.21.15.12:0/1171344959 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb9bc04c770 con 0x7fb9c010dc60 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.915+0000 7fb9c5740700 1 -- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7fb9ac038870 msgr2=0x7fb9ac03ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1214012838 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.916+0000 7fb9c5740700 1 --2- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7fb9ac038870 0x7fb9ac03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:25.924+0000 7fb9b6ffd700 1 -- 172.21.15.12:0/1171344959 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb9bc01b920 con 0x7fb9c010dc60 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.117+0000 7fb9c5740700 1 -- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7fb9ac038870 msgr2=0x7fb9ac03ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1214012838 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.117+0000 7fb9c5740700 1 --2- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7fb9ac038870 0x7fb9ac03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.189+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb9c01a43a0 con 0x7fb9c010dc60 2023-12-11T20:05:26.680 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.189+0000 7fb9b6ffd700 1 -- 172.21.15.12:0/1171344959 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb9bc00bbd0 con 0x7fb9c010dc60 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7fb9ac038870 msgr2=0x7fb9ac03ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 --2- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7fb9ac038870 0x7fb9ac03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 msgr2=0x7fb9c01a0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 --2- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c01a0f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc003f20 tx=0x7fb9bc011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 shutdown_connections 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 --2- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7fb9ac038870 0x7fb9ac03ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 --2- 172.21.15.12:0/1171344959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9c010dc60 0x7fb9c01a0f30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 >> 172.21.15.12:0/1171344959 conn(0x7fb9c007c2d0 msgr2=0x7fb9c007cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 shutdown_connections 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:26.192+0000 7fb9c81a5700 1 -- 172.21.15.12:0/1171344959 wait complete. 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2023-12-11T20:05:26.681 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 5... 2023-12-11T20:05:26.732 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:26 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:26.598+0000 7ff92df3e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-11T20:05:27.007 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:26 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1171344959' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-11T20:05:27.007 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:26 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:26.733+0000 7ff92df3e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-11T20:05:27.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:27 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:27.328+0000 7ff92df3e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-11T20:05:28.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:28 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:28.225+0000 7ff92df3e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-11T20:05:28.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:28 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:28.337+0000 7ff92df3e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-11T20:05:29.716 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:29 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:29.352+0000 7ff92df3e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:05:29.716 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:29 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:29.479+0000 7ff92df3e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-11T20:05:30.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:29 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:29.717+0000 7ff92df3e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:05:30.582 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:30 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:30.266+0000 7ff92df3e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-11T20:05:30.582 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:30 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:30.390+0000 7ff92df3e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-11T20:05:30.959 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:30 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:30.597+0000 7ff92df3e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-11T20:05:31.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:30 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:30.960+0000 7ff92df3e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-11T20:05:32.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:31 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:31.942+0000 7ff92df3e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-11T20:05:32.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:32 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:32.127+0000 7ff92df3e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-11T20:05:32.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:32 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:32.392+0000 7ff92df3e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-11T20:05:32.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:32 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:32.546+0000 7ff92df3e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-11T20:05:33.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:32 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:32.840+0000 7ff92df3e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-11T20:05:34.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:33 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:33.967+0000 7ff92df3e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-11T20:05:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: Active manager daemon x restarted 2023-12-11T20:05:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: Activating manager daemon x 2023-12-11T20:05:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: osdmap e2: 0 total, 0 up, 0 in 2023-12-11T20:05:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: mgrmap e6: x(active, starting, since 0.00388095s) 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: Manager daemon x is now available 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: Found migration_current of "None". Setting to last migration. 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:34 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:05:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:35 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:05:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:35 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:05:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:35 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-11T20:05:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:35 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-11T20:05:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:35 smithi012 ceph-mon[128787]: mgrmap e7: x(active, since 1.00689s) 2023-12-11T20:05:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:35 smithi012 ceph-mon[128787]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-11T20:05:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:35 smithi012 ceph-mon[128787]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.215+0000 7f8c347af700 1 Processor -- start 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.215+0000 7f8c347af700 1 -- start start 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.215+0000 7f8c347af700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c1070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.215+0000 7f8c347af700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c1076a0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.216+0000 7f8c3254b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c1070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.216+0000 7f8c3254b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c1070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55104/0 (socket says 172.21.15.12:55104) 2023-12-11T20:05:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.216+0000 7f8c3254b700 1 -- 172.21.15.12:0/2540065614 learned_addr learned my addr 172.21.15.12:0/2540065614 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.216+0000 7f8c3254b700 1 -- 172.21.15.12:0/2540065614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c107eb0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.216+0000 7f8c3254b700 1 --2- 172.21.15.12:0/2540065614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c1070d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c280098a0 tx=0x7f8c28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb393d95092c11e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.217+0000 7f8c31549700 1 -- 172.21.15.12:0/2540065614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c28004160 con 0x7f8c2c106cb0 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.217+0000 7f8c31549700 1 -- 172.21.15.12:0/2540065614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8c280042c0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.217+0000 7f8c31549700 1 -- 172.21.15.12:0/2540065614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c28011940 con 0x7f8c2c106cb0 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.217+0000 7f8c347af700 1 -- 172.21.15.12:0/2540065614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 msgr2=0x7f8c2c1070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.217+0000 7f8c347af700 1 --2- 172.21.15.12:0/2540065614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c1070d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c280098a0 tx=0x7f8c28009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.217+0000 7f8c347af700 1 -- 172.21.15.12:0/2540065614 shutdown_connections 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.217+0000 7f8c347af700 1 --2- 172.21.15.12:0/2540065614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c1070d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.217+0000 7f8c347af700 1 -- 172.21.15.12:0/2540065614 >> 172.21.15.12:0/2540065614 conn(0x7f8c2c102250 msgr2=0x7f8c2c104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.218+0000 7f8c347af700 1 -- 172.21.15.12:0/2540065614 shutdown_connections 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.218+0000 7f8c347af700 1 -- 172.21.15.12:0/2540065614 wait complete. 2023-12-11T20:05:35.482 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.219+0000 7f8c347af700 1 Processor -- start 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.219+0000 7f8c347af700 1 -- start start 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.219+0000 7f8c347af700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.219+0000 7f8c347af700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c07bee0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.219+0000 7f8c3254b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.219+0000 7f8c3254b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c07b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55112/0 (socket says 172.21.15.12:55112) 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.219+0000 7f8c3254b700 1 -- 172.21.15.12:0/2328989819 learned_addr learned my addr 172.21.15.12:0/2328989819 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.220+0000 7f8c3254b700 1 -- 172.21.15.12:0/2328989819 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009550 con 0x7f8c2c106cb0 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.220+0000 7f8c3254b700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c07b9a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8c28003f20 tx=0x7f8c28011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.220+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c280036a0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.220+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8c2801b440 con 0x7f8c2c106cb0 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.220+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c28023400 con 0x7f8c2c106cb0 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.220+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c07a120 con 0x7f8c2c106cb0 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.221+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c07a5c0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.222+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f8c2801b5b0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.222+0000 7f8c237fe700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.222+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 --> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c1803b440 con 0x7f8c18038870 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.223+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8c2804c7d0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.223+0000 7f8c31d4a700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 msgr2=0x7f8c1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1214012838 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.223+0000 7f8c31d4a700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.424+0000 7f8c31d4a700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 msgr2=0x7f8c1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1214012838 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.424+0000 7f8c31d4a700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.825+0000 7f8c31d4a700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 msgr2=0x7f8c1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1214012838 2023-12-11T20:05:35.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:27.825+0000 7f8c31d4a700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:28.626+0000 7f8c31d4a700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 msgr2=0x7f8c1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1214012838 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:28.626+0000 7f8c31d4a700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:30.227+0000 7f8c31d4a700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 msgr2=0x7f8c1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1214012838 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:30.228+0000 7f8c31d4a700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:33.431+0000 7f8c31d4a700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 msgr2=0x7f8c1803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1214012838 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:33.431+0000 7f8c31d4a700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:33.972+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 6) v1 ==== 45347+0+0 (secure 0 0 0) 0x7f8c28003800 con 0x7f8c2c106cb0 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:33.972+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 msgr2=0x7f8c1803ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:33.972+0000 7f8c237fe700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.973+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 7) v1 ==== 45474+0+0 (secure 0 0 0) 0x7f8c2804e2e0 con 0x7f8c2c106cb0 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.973+0000 7f8c237fe700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f8c1803bfd0 0x7f8c1803e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.973+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c1803b440 con 0x7f8c1803bfd0 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.974+0000 7f8c31d4a700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f8c1803bfd0 0x7f8c1803e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:35.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.975+0000 7f8c31d4a700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f8c1803bfd0 0x7f8c1803e3c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c003a10 tx=0x7f8c1c0092b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.977+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mgr.14116 v2:172.21.15.12:6800/3786645349 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f8c1803b440 con 0x7f8c1803bfd0 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.984+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8c2c108cc0 con 0x7f8c1803bfd0 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.984+0000 7f8c237fe700 1 -- 172.21.15.12:0/2328989819 <== mgr.14116 v2:172.21.15.12:6800/3786645349 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8c1c00a050 con 0x7f8c1803bfd0 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.984+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f8c1803bfd0 msgr2=0x7f8c1803e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.984+0000 7f8c347af700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f8c1803bfd0 0x7f8c1803e3c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c003a10 tx=0x7f8c1c0092b0 comp rx=0 tx=0).stop 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.984+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 msgr2=0x7f8c2c07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.984+0000 7f8c347af700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c07b9a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8c28003f20 tx=0x7f8c28011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.985+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 shutdown_connections 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.985+0000 7f8c347af700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f8c1803bfd0 0x7f8c1803e3c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.985+0000 7f8c347af700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c2c106cb0 0x7f8c2c07b9a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.985+0000 7f8c347af700 1 --2- 172.21.15.12:0/2328989819 >> [v2:172.21.15.12:6800/1214012838,v1:172.21.15.12:6801/1214012838] conn(0x7f8c18038870 0x7f8c1803ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.985+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 >> 172.21.15.12:0/2328989819 conn(0x7f8c2c102250 msgr2=0x7f8c2c102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.985+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 shutdown_connections 2023-12-11T20:05:35.486 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:34.985+0000 7f8c347af700 1 -- 172.21.15.12:0/2328989819 wait complete. 2023-12-11T20:05:35.487 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 5 is available 2023-12-11T20:05:35.487 INFO:teuthology.orchestra.run.smithi012.stdout:Setting orchestrator backend to cephadm... 2023-12-11T20:05:36.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:36 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:36.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:36 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.066+0000 7ff828ac8700 1 Processor -- start 2023-12-11T20:05:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.066+0000 7ff828ac8700 1 -- start start 2023-12-11T20:05:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.067+0000 7ff828ac8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82407a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.067+0000 7ff828ac8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82407a730 con 0x7ff82407bd00 2023-12-11T20:05:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.067+0000 7ff82259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82407a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.067+0000 7ff82259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82407a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50458/0 (socket says 172.21.15.12:50458) 2023-12-11T20:05:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.067+0000 7ff82259c700 1 -- 172.21.15.12:0/1043027723 learned_addr learned my addr 172.21.15.12:0/1043027723 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.068+0000 7ff82259c700 1 -- 172.21.15.12:0/1043027723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82407a870 con 0x7ff82407bd00 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.068+0000 7ff82259c700 1 --2- 172.21.15.12:0/1043027723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82407a160 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8140098a0 tx=0x7ff814009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fac1354f5a2da2e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.068+0000 7ff82159a700 1 -- 172.21.15.12:0/1043027723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff814004160 con 0x7ff82407bd00 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.068+0000 7ff82159a700 1 -- 172.21.15.12:0/1043027723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff8140042c0 con 0x7ff82407bd00 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.068+0000 7ff82159a700 1 -- 172.21.15.12:0/1043027723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff814011940 con 0x7ff82407bd00 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.069+0000 7ff828ac8700 1 -- 172.21.15.12:0/1043027723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 msgr2=0x7ff82407a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.069+0000 7ff828ac8700 1 --2- 172.21.15.12:0/1043027723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82407a160 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8140098a0 tx=0x7ff814009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.069+0000 7ff828ac8700 1 -- 172.21.15.12:0/1043027723 shutdown_connections 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.069+0000 7ff828ac8700 1 --2- 172.21.15.12:0/1043027723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82407a160 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.069+0000 7ff828ac8700 1 -- 172.21.15.12:0/1043027723 >> 172.21.15.12:0/1043027723 conn(0x7ff824102250 msgr2=0x7ff824104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.069+0000 7ff828ac8700 1 -- 172.21.15.12:0/1043027723 shutdown_connections 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.069+0000 7ff828ac8700 1 -- 172.21.15.12:0/1043027723 wait complete. 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.070+0000 7ff828ac8700 1 Processor -- start 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.071+0000 7ff828ac8700 1 -- start start 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.071+0000 7ff828ac8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82419ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.071+0000 7ff828ac8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82419cfa0 con 0x7ff82407bd00 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.071+0000 7ff82259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82419ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.071+0000 7ff82259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82419ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50466/0 (socket says 172.21.15.12:50466) 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.071+0000 7ff82259c700 1 -- 172.21.15.12:0/251883422 learned_addr learned my addr 172.21.15.12:0/251883422 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.072+0000 7ff82259c700 1 -- 172.21.15.12:0/251883422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814009550 con 0x7ff82407bd00 2023-12-11T20:05:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.072+0000 7ff82259c700 1 --2- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82419ca60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff814003f20 tx=0x7ff814011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.072+0000 7ff8137fe700 1 -- 172.21.15.12:0/251883422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8140037d0 con 0x7ff82407bd00 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.072+0000 7ff8137fe700 1 -- 172.21.15.12:0/251883422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff81401b440 con 0x7ff82407bd00 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.072+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82419d1a0 con 0x7ff82407bd00 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.072+0000 7ff8137fe700 1 -- 172.21.15.12:0/251883422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff814023590 con 0x7ff82407bd00 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.072+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82419d640 con 0x7ff82407bd00 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.073+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82410d040 con 0x7ff82407bd00 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.073+0000 7ff8137fe700 1 -- 172.21.15.12:0/251883422 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) v1 ==== 45474+0+0 (secure 0 0 0) 0x7ff81401b5b0 con 0x7ff82407bd00 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.074+0000 7ff8137fe700 1 --2- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7ff80c0386f0 0x7ff80c03abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:36.873 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.074+0000 7ff8137fe700 1 -- 172.21.15.12:0/251883422 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff81404c6f0 con 0x7ff82407bd00 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.074+0000 7ff821d9b700 1 --2- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7ff80c0386f0 0x7ff80c03abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.075+0000 7ff821d9b700 1 --2- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7ff80c0386f0 0x7ff80c03abb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff818006fd0 tx=0x7ff818006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.079+0000 7ff8137fe700 1 -- 172.21.15.12:0/251883422 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff81401b920 con 0x7ff82407bd00 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.244+0000 7ff8137fe700 1 -- 172.21.15.12:0/251883422 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7ff814003930 con 0x7ff82407bd00 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.305+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7ff824103410 con 0x7ff80c0386f0 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.312+0000 7ff8137fe700 1 -- 172.21.15.12:0/251883422 <== mgr.14116 v2:172.21.15.12:6800/3786645349 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff824103410 con 0x7ff80c0386f0 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.314+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7ff80c0386f0 msgr2=0x7ff80c03abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.314+0000 7ff828ac8700 1 --2- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7ff80c0386f0 0x7ff80c03abb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff818006fd0 tx=0x7ff818006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.314+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 msgr2=0x7ff82419ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:36.874 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.314+0000 7ff828ac8700 1 --2- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82419ca60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff814003f20 tx=0x7ff814011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:36.875 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.315+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 shutdown_connections 2023-12-11T20:05:36.875 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.315+0000 7ff828ac8700 1 --2- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7ff80c0386f0 0x7ff80c03abb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:36.875 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.315+0000 7ff828ac8700 1 --2- 172.21.15.12:0/251883422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff82407bd00 0x7ff82419ca60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:36.875 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.315+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 >> 172.21.15.12:0/251883422 conn(0x7ff824102250 msgr2=0x7ff824102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:36.875 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.315+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 shutdown_connections 2023-12-11T20:05:36.875 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:36.315+0000 7ff828ac8700 1 -- 172.21.15.12:0/251883422 wait complete. 2023-12-11T20:05:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: [11/Dec/2023:20:05:36] ENGINE Bus STARTING 2023-12-11T20:05:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: [11/Dec/2023:20:05:36] ENGINE Serving on https://172.21.15.12:7150 2023-12-11T20:05:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: mgrmap e8: x(active, since 2s) 2023-12-11T20:05:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: [11/Dec/2023:20:05:36] ENGINE Serving on http://172.21.15.12:8765 2023-12-11T20:05:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: [11/Dec/2023:20:05:36] ENGINE Bus STARTED 2023-12-11T20:05:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:05:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:05:37.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:37.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:37 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:05:38.048 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.404+0000 7f2520b58700 1 Processor -- start 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.404+0000 7f2520b58700 1 -- start start 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.405+0000 7f2520b58700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c07a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.405+0000 7f2520b58700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c07a750 con 0x7f251c07bd20 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.405+0000 7f251a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c07a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.405+0000 7f251a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c07a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50474/0 (socket says 172.21.15.12:50474) 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.405+0000 7f251a59c700 1 -- 172.21.15.12:0/3750227633 learned_addr learned my addr 172.21.15.12:0/3750227633 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.406+0000 7f251a59c700 1 -- 172.21.15.12:0/3750227633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c07a890 con 0x7f251c07bd20 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.406+0000 7f251a59c700 1 --2- 172.21.15.12:0/3750227633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c07a180 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f250c0098a0 tx=0x7f250c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a548e9d616e3be0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.406+0000 7f251959a700 1 -- 172.21.15.12:0/3750227633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f250c004160 con 0x7f251c07bd20 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.406+0000 7f251959a700 1 -- 172.21.15.12:0/3750227633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f250c0042c0 con 0x7f251c07bd20 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.406+0000 7f251959a700 1 -- 172.21.15.12:0/3750227633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f250c011940 con 0x7f251c07bd20 2023-12-11T20:05:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.407+0000 7f2520b58700 1 -- 172.21.15.12:0/3750227633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 msgr2=0x7f251c07a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.407+0000 7f2520b58700 1 --2- 172.21.15.12:0/3750227633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c07a180 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f250c0098a0 tx=0x7f250c009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.407+0000 7f2520b58700 1 -- 172.21.15.12:0/3750227633 shutdown_connections 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.407+0000 7f2520b58700 1 --2- 172.21.15.12:0/3750227633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c07a180 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.407+0000 7f2520b58700 1 -- 172.21.15.12:0/3750227633 >> 172.21.15.12:0/3750227633 conn(0x7f251c102250 msgr2=0x7f251c104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.407+0000 7f2520b58700 1 -- 172.21.15.12:0/3750227633 shutdown_connections 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.407+0000 7f2520b58700 1 -- 172.21.15.12:0/3750227633 wait complete. 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.408+0000 7f2520b58700 1 Processor -- start 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.409+0000 7f2520b58700 1 -- start start 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.409+0000 7f2520b58700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.409+0000 7f2520b58700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c19cff0 con 0x7f251c07bd20 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.409+0000 7f251a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.409+0000 7f251a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c19cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50480/0 (socket says 172.21.15.12:50480) 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.409+0000 7f251a59c700 1 -- 172.21.15.12:0/867690542 learned_addr learned my addr 172.21.15.12:0/867690542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.410+0000 7f251a59c700 1 -- 172.21.15.12:0/867690542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c009550 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.410+0000 7f251a59c700 1 --2- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c19cab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f250c003f20 tx=0x7f250c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.410+0000 7f250b7fe700 1 -- 172.21.15.12:0/867690542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f250c0036a0 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.410+0000 7f250b7fe700 1 -- 172.21.15.12:0/867690542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f250c01b440 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.410+0000 7f250b7fe700 1 -- 172.21.15.12:0/867690542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f250c023400 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.410+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c19d1f0 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.410+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c19d690 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.411+0000 7f250b7fe700 1 -- 172.21.15.12:0/867690542 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f250c01b5b0 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.411+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c10d020 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.412+0000 7f250b7fe700 1 --2- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f2504038870 0x7f250403ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.412+0000 7f250b7fe700 1 -- 172.21.15.12:0/867690542 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f250c04c8a0 con 0x7f251c07bd20 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.412+0000 7f2519d9b700 1 --2- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f2504038870 0x7f250403ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.413+0000 7f2519d9b700 1 --2- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f2504038870 0x7f250403ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2510006fd0 tx=0x7f2510006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:38.051 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.417+0000 7f250b7fe700 1 -- 172.21.15.12:0/867690542 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f250c01b920 con 0x7f251c07bd20 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.631+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f251c103450 con 0x7f2504038870 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.632+0000 7f250b7fe700 1 -- 172.21.15.12:0/867690542 <== mgr.14116 v2:172.21.15.12:6800/3786645349 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f251c103450 con 0x7f2504038870 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f2504038870 msgr2=0x7f250403ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 --2- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f2504038870 0x7f250403ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2510006fd0 tx=0x7f2510006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 msgr2=0x7f251c19cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 --2- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c19cab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f250c003f20 tx=0x7f250c011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 shutdown_connections 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 --2- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f2504038870 0x7f250403ad30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 --2- 172.21.15.12:0/867690542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f251c07bd20 0x7f251c19cab0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 >> 172.21.15.12:0/867690542 conn(0x7f251c102250 msgr2=0x7f251c102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 shutdown_connections 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:37.634+0000 7f2520b58700 1 -- 172.21.15.12:0/867690542 wait complete. 2023-12-11T20:05:38.052 INFO:teuthology.orchestra.run.smithi012.stdout:Generating ssh key... 2023-12-11T20:05:39.222 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:38 smithi012 ceph-mon[128787]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: Generating public/private rsa key pair. 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: Your identification has been saved in /tmp/tmpvh728fdr/key. 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: Your public key has been saved in /tmp/tmpvh728fdr/key.pub. 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: The key fingerprint is: 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: SHA256:osRHCrbtK5QmgJL5x5tiR5pNWX4sk2TIf+FryL0AivM ceph-732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: The key's randomart image is: 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: +---[RSA 3072]----+ 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: | | 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: | | 2023-12-11T20:05:39.223 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: |.oo. .. | 2023-12-11T20:05:39.224 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: |*. =oo+ . | 2023-12-11T20:05:39.224 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: |o..o*Bo+S. | 2023-12-11T20:05:39.224 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: |..=+*+*.= | 2023-12-11T20:05:39.224 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: |o+.Bo+.B . | 2023-12-11T20:05:39.224 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: | o* =.o.+ | 2023-12-11T20:05:39.224 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: | .E+. ... | 2023-12-11T20:05:39.224 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: +----[SHA256]-----+ 2023-12-11T20:05:39.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.560+0000 7f8648a67700 1 Processor -- start 2023-12-11T20:05:39.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.560+0000 7f8648a67700 1 -- start start 2023-12-11T20:05:39.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.560+0000 7f8648a67700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864407a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:39.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.560+0000 7f8648a67700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864407a730 con 0x7f864407bd00 2023-12-11T20:05:39.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.560+0000 7f864259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864407a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:39.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.560+0000 7f864259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864407a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50482/0 (socket says 172.21.15.12:50482) 2023-12-11T20:05:39.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.560+0000 7f864259c700 1 -- 172.21.15.12:0/3202891307 learned_addr learned my addr 172.21.15.12:0/3202891307 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.561+0000 7f864259c700 1 -- 172.21.15.12:0/3202891307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864407a870 con 0x7f864407bd00 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.561+0000 7f864259c700 1 --2- 172.21.15.12:0/3202891307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864407a160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86340098a0 tx=0x7f8634009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406d67b41bb25eb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.561+0000 7f864159a700 1 -- 172.21.15.12:0/3202891307 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8634004160 con 0x7f864407bd00 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.561+0000 7f864159a700 1 -- 172.21.15.12:0/3202891307 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f86340042c0 con 0x7f864407bd00 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.561+0000 7f864159a700 1 -- 172.21.15.12:0/3202891307 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8634011940 con 0x7f864407bd00 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.562+0000 7f8648a67700 1 -- 172.21.15.12:0/3202891307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 msgr2=0x7f864407a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.562+0000 7f8648a67700 1 --2- 172.21.15.12:0/3202891307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864407a160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86340098a0 tx=0x7f8634009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.562+0000 7f8648a67700 1 -- 172.21.15.12:0/3202891307 shutdown_connections 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.562+0000 7f8648a67700 1 --2- 172.21.15.12:0/3202891307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864407a160 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.562+0000 7f8648a67700 1 -- 172.21.15.12:0/3202891307 >> 172.21.15.12:0/3202891307 conn(0x7f8644102250 msgr2=0x7f8644104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.562+0000 7f8648a67700 1 -- 172.21.15.12:0/3202891307 shutdown_connections 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.562+0000 7f8648a67700 1 -- 172.21.15.12:0/3202891307 wait complete. 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.563+0000 7f8648a67700 1 Processor -- start 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.563+0000 7f8648a67700 1 -- start start 2023-12-11T20:05:39.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.563+0000 7f8648a67700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864419ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.563+0000 7f8648a67700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864419cfa0 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.564+0000 7f864259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864419ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.564+0000 7f864259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864419ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50490/0 (socket says 172.21.15.12:50490) 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.564+0000 7f864259c700 1 -- 172.21.15.12:0/1486421246 learned_addr learned my addr 172.21.15.12:0/1486421246 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.564+0000 7f864259c700 1 -- 172.21.15.12:0/1486421246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634009550 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.564+0000 7f864259c700 1 --2- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864419ca60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8634003f20 tx=0x7f8634011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.564+0000 7f86337fe700 1 -- 172.21.15.12:0/1486421246 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86340037d0 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.565+0000 7f86337fe700 1 -- 172.21.15.12:0/1486421246 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f863401b440 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.565+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864419d1a0 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.565+0000 7f86337fe700 1 -- 172.21.15.12:0/1486421246 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8634023590 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.565+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864419d640 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.566+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864410d040 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.566+0000 7f86337fe700 1 -- 172.21.15.12:0/1486421246 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f863401b5b0 con 0x7f864407bd00 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.566+0000 7f86337fe700 1 --2- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f862c038870 0x7f862c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:39.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.567+0000 7f86337fe700 1 -- 172.21.15.12:0/1486421246 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f863404c8a0 con 0x7f864407bd00 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.567+0000 7f8641d9b700 1 --2- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f862c038870 0x7f862c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.567+0000 7f8641d9b700 1 --2- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f862c038870 0x7f862c03ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8638006fd0 tx=0x7f8638006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.572+0000 7f86337fe700 1 -- 172.21.15.12:0/1486421246 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f863401b920 con 0x7f864407bd00 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:38.783+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8644103410 con 0x7f862c038870 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.031+0000 7f86337fe700 1 -- 172.21.15.12:0/1486421246 <== mgr.14116 v2:172.21.15.12:6800/3786645349 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8644103410 con 0x7f862c038870 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f862c038870 msgr2=0x7f862c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 --2- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f862c038870 0x7f862c03ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8638006fd0 tx=0x7f8638006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 msgr2=0x7f864419ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 --2- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864419ca60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8634003f20 tx=0x7f8634011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 shutdown_connections 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 --2- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f862c038870 0x7f862c03ad30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 --2- 172.21.15.12:0/1486421246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864407bd00 0x7f864419ca60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 >> 172.21.15.12:0/1486421246 conn(0x7f8644102250 msgr2=0x7f8644102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 shutdown_connections 2023-12-11T20:05:39.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:39.034+0000 7f8648a67700 1 -- 172.21.15.12:0/1486421246 wait complete. 2023-12-11T20:05:40.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-mon[128787]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:05:40.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-mon[128787]: Generating ssh key... 2023-12-11T20:05:40.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:40.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:39 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:40.816 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmDUZkXbWAtnMqFlCdfqAsGzab6IDuRXIb96GbRV8nP4HNoMi5UWosNGyKlzhH3a1qfP3Ty0QETNJ2wRX2I+KcwCybYxG6ePr0YSFmoQOI2c9MkV/ykoaV1u78Yt5RThD4rqQy1IPHbH2tFYaajkHGPIfei0NXv62+GsCnLI3GusWQeyIZ00u3/KNlcEbFMQ1Lmeh2A5FgIeY1zjJIVcoDtxbGO02GuCO8TZ8VvutVHEB5NnHkiORRMmV6K9J6XzzGIn2BvOiyTZWxb9r16pE03eGf0Hlebx7G6fcbwhFj9gcWBa4U8Kg0GlvRzokP3HFmvjDUOJvQ7YjLNuhU58oKxAYDV7hs9Fic+bsnODpLrmQOOgli+tN4wFA83jdMFfnG1X5Efatb/J8Cmsbg0RbxIqKxda+PimnPAMGzaB16kfr4usMZs9EKUVzXw2rrBguOZU0ojddDPmK3D/j1gfD2Ftsfj3fBqwSODTNd3vUL7FzQuVcfpCNtpJ9wB1KyoU8= ceph-732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:05:40.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.076+0000 7fe613839700 1 Processor -- start 2023-12-11T20:05:40.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.077+0000 7fe613839700 1 -- start start 2023-12-11T20:05:40.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.077+0000 7fe613839700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c07a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:40.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.077+0000 7fe613839700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c07a710 con 0x7fe60c07bce0 2023-12-11T20:05:40.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.077+0000 7fe6115d5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c07a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:40.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.077+0000 7fe6115d5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c07a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38932/0 (socket says 172.21.15.12:38932) 2023-12-11T20:05:40.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.077+0000 7fe6115d5700 1 -- 172.21.15.12:0/446502222 learned_addr learned my addr 172.21.15.12:0/446502222 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:40.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.078+0000 7fe6115d5700 1 -- 172.21.15.12:0/446502222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c07a850 con 0x7fe60c07bce0 2023-12-11T20:05:40.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.078+0000 7fe6115d5700 1 --2- 172.21.15.12:0/446502222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c07a140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6080098a0 tx=0x7fe608009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd82981c5b9a0171 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:40.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.078+0000 7fe603fff700 1 -- 172.21.15.12:0/446502222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe608004160 con 0x7fe60c07bce0 2023-12-11T20:05:40.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.078+0000 7fe603fff700 1 -- 172.21.15.12:0/446502222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe6080042c0 con 0x7fe60c07bce0 2023-12-11T20:05:40.826 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.078+0000 7fe603fff700 1 -- 172.21.15.12:0/446502222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe608011940 con 0x7fe60c07bce0 2023-12-11T20:05:40.826 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.079+0000 7fe613839700 1 -- 172.21.15.12:0/446502222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 msgr2=0x7fe60c07a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:40.826 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.079+0000 7fe613839700 1 --2- 172.21.15.12:0/446502222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c07a140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6080098a0 tx=0x7fe608009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:40.826 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.079+0000 7fe613839700 1 -- 172.21.15.12:0/446502222 shutdown_connections 2023-12-11T20:05:40.826 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.079+0000 7fe613839700 1 --2- 172.21.15.12:0/446502222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c07a140 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:40.826 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.079+0000 7fe613839700 1 -- 172.21.15.12:0/446502222 >> 172.21.15.12:0/446502222 conn(0x7fe60c102250 msgr2=0x7fe60c104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.079+0000 7fe613839700 1 -- 172.21.15.12:0/446502222 shutdown_connections 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.079+0000 7fe613839700 1 -- 172.21.15.12:0/446502222 wait complete. 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.080+0000 7fe613839700 1 Processor -- start 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.080+0000 7fe613839700 1 -- start start 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.080+0000 7fe613839700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.080+0000 7fe613839700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c19cfb0 con 0x7fe60c07bce0 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.081+0000 7fe6115d5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.081+0000 7fe6115d5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c19ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38938/0 (socket says 172.21.15.12:38938) 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.081+0000 7fe6115d5700 1 -- 172.21.15.12:0/1678207620 learned_addr learned my addr 172.21.15.12:0/1678207620 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.081+0000 7fe6115d5700 1 -- 172.21.15.12:0/1678207620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608009550 con 0x7fe60c07bce0 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.081+0000 7fe6115d5700 1 --2- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c19ca70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe608003f20 tx=0x7fe608011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.082+0000 7fe6027fc700 1 -- 172.21.15.12:0/1678207620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6080037d0 con 0x7fe60c07bce0 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.082+0000 7fe6027fc700 1 -- 172.21.15.12:0/1678207620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe60801b440 con 0x7fe60c07bce0 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.082+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c19d1b0 con 0x7fe60c07bce0 2023-12-11T20:05:40.827 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.082+0000 7fe6027fc700 1 -- 172.21.15.12:0/1678207620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe608023590 con 0x7fe60c07bce0 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.082+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c19d650 con 0x7fe60c07bce0 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.083+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c10d000 con 0x7fe60c07bce0 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.083+0000 7fe6027fc700 1 -- 172.21.15.12:0/1678207620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7fe60801b5b0 con 0x7fe60c07bce0 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.083+0000 7fe6027fc700 1 --2- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fe5f8038820 0x7fe5f803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.083+0000 7fe6027fc700 1 -- 172.21.15.12:0/1678207620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe60804c8f0 con 0x7fe60c07bce0 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.084+0000 7fe610dd4700 1 --2- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fe5f8038820 0x7fe5f803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.084+0000 7fe610dd4700 1 --2- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fe5f8038820 0x7fe5f803ace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc006fd0 tx=0x7fe5fc006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.088+0000 7fe6027fc700 1 -- 172.21.15.12:0/1678207620 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe60801b920 con 0x7fe60c07bce0 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.301+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe60c103450 con 0x7fe5f8038820 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.302+0000 7fe6027fc700 1 -- 172.21.15.12:0/1678207620 <== mgr.14116 v2:172.21.15.12:6800/3786645349 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fe60c103450 con 0x7fe5f8038820 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fe5f8038820 msgr2=0x7fe5f803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 --2- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fe5f8038820 0x7fe5f803ace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc006fd0 tx=0x7fe5fc006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 msgr2=0x7fe60c19ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:40.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 --2- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c19ca70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe608003f20 tx=0x7fe608011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 shutdown_connections 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 --2- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fe5f8038820 0x7fe5f803ace0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 --2- 172.21.15.12:0/1678207620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe60c07bce0 0x7fe60c19ca70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 >> 172.21.15.12:0/1678207620 conn(0x7fe60c102250 msgr2=0x7fe60c102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 shutdown_connections 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:40.304+0000 7fe613839700 1 -- 172.21.15.12:0/1678207620 wait complete. 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:Adding key to root@localhost authorized_keys... 2023-12-11T20:05:40.829 INFO:teuthology.orchestra.run.smithi012.stdout:Adding host smithi012... 2023-12-11T20:05:41.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:41 smithi012 ceph-mon[128787]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:05:42.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:42 smithi012 ceph-mon[128787]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:05:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:43 smithi012 ceph-mon[128787]: Deploying cephadm binary to smithi012 2023-12-11T20:05:46.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Added host 'smithi012' with addr '172.21.15.12' 2023-12-11T20:05:46.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.355+0000 7f86a95d2700 1 Processor -- start 2023-12-11T20:05:46.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.355+0000 7f86a95d2700 1 -- start start 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.355+0000 7f86a95d2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a407a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.355+0000 7f86a95d2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a407a750 con 0x7f86a407bd20 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.356+0000 7f86a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a407a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.356+0000 7f86a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a407a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38952/0 (socket says 172.21.15.12:38952) 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.356+0000 7f86a2ffd700 1 -- 172.21.15.12:0/1028492394 learned_addr learned my addr 172.21.15.12:0/1028492394 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.356+0000 7f86a2ffd700 1 -- 172.21.15.12:0/1028492394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a407a890 con 0x7f86a407bd20 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.357+0000 7f86a2ffd700 1 --2- 172.21.15.12:0/1028492394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a407a180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f86940098a0 tx=0x7f8694009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a55607c4d1b4be server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.357+0000 7f86a1ffb700 1 -- 172.21.15.12:0/1028492394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8694004160 con 0x7f86a407bd20 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.357+0000 7f86a1ffb700 1 -- 172.21.15.12:0/1028492394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f86940042c0 con 0x7f86a407bd20 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.357+0000 7f86a1ffb700 1 -- 172.21.15.12:0/1028492394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8694011940 con 0x7f86a407bd20 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.357+0000 7f86a95d2700 1 -- 172.21.15.12:0/1028492394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 msgr2=0x7f86a407a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.357+0000 7f86a95d2700 1 --2- 172.21.15.12:0/1028492394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a407a180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f86940098a0 tx=0x7f8694009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:46.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.358+0000 7f86a95d2700 1 -- 172.21.15.12:0/1028492394 shutdown_connections 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.358+0000 7f86a95d2700 1 --2- 172.21.15.12:0/1028492394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a407a180 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.358+0000 7f86a95d2700 1 -- 172.21.15.12:0/1028492394 >> 172.21.15.12:0/1028492394 conn(0x7f86a4102250 msgr2=0x7f86a4104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.358+0000 7f86a95d2700 1 -- 172.21.15.12:0/1028492394 shutdown_connections 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.358+0000 7f86a95d2700 1 -- 172.21.15.12:0/1028492394 wait complete. 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.359+0000 7f86a95d2700 1 Processor -- start 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.359+0000 7f86a95d2700 1 -- start start 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.359+0000 7f86a95d2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.359+0000 7f86a95d2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a419cff0 con 0x7f86a407bd20 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.359+0000 7f86a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f86a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a419cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38954/0 (socket says 172.21.15.12:38954) 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f86a2ffd700 1 -- 172.21.15.12:0/2550046293 learned_addr learned my addr 172.21.15.12:0/2550046293 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f86a2ffd700 1 -- 172.21.15.12:0/2550046293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694009550 con 0x7f86a407bd20 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f86a2ffd700 1 --2- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a419cab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8694003f20 tx=0x7f8694011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:46.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f868bfff700 1 -- 172.21.15.12:0/2550046293 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86940036a0 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f868bfff700 1 -- 172.21.15.12:0/2550046293 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f869401b440 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f868bfff700 1 -- 172.21.15.12:0/2550046293 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8694023400 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a419d1f0 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.360+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a419d690 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.361+0000 7f868bfff700 1 -- 172.21.15.12:0/2550046293 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f869401b5b0 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.362+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a410d020 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.362+0000 7f868bfff700 1 --2- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f868c0388c0 0x7f868c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.362+0000 7f868bfff700 1 -- 172.21.15.12:0/2550046293 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f869404c860 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.362+0000 7f86a27fc700 1 --2- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f868c0388c0 0x7f868c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.363+0000 7f86a27fc700 1 --2- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f868c0388c0 0x7f868c03ad80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8698006fd0 tx=0x7f8698006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.367+0000 7f868bfff700 1 -- 172.21.15.12:0/2550046293 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f869401b920 con 0x7f86a407bd20 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:41.583+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}) v1 -- 0x7f86a4103450 con 0x7f868c0388c0 2023-12-11T20:05:46.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.509+0000 7f868bfff700 1 -- 172.21.15.12:0/2550046293 <== mgr.14116 v2:172.21.15.12:6800/3786645349 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f86a4103450 con 0x7f868c0388c0 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f868c0388c0 msgr2=0x7f868c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 --2- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f868c0388c0 0x7f868c03ad80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8698006fd0 tx=0x7f8698006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 msgr2=0x7f86a419cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 --2- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a419cab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8694003f20 tx=0x7f8694011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 shutdown_connections 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 --2- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f868c0388c0 0x7f868c03ad80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 --2- 172.21.15.12:0/2550046293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a407bd20 0x7f86a419cab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 >> 172.21.15.12:0/2550046293 conn(0x7f86a4102250 msgr2=0x7f86a4102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 shutdown_connections 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:46.512+0000 7f86a95d2700 1 -- 172.21.15.12:0/2550046293 wait complete. 2023-12-11T20:05:46.926 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mon service... 2023-12-11T20:05:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:47 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:47 smithi012 ceph-mon[128787]: Added host smithi012 2023-12-11T20:05:47.765 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:47 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:05:48.319 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-11T20:05:48.319 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.475+0000 7fdb39606700 1 Processor -- start 2023-12-11T20:05:48.319 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.476+0000 7fdb39606700 1 -- start start 2023-12-11T20:05:48.319 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.476+0000 7fdb39606700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb341070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.476+0000 7fdb39606700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb341076a0 con 0x7fdb34106cb0 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.477+0000 7fdb32ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb341070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.477+0000 7fdb32ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb341070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38964/0 (socket says 172.21.15.12:38964) 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.477+0000 7fdb32ffd700 1 -- 172.21.15.12:0/1397459911 learned_addr learned my addr 172.21.15.12:0/1397459911 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.477+0000 7fdb32ffd700 1 -- 172.21.15.12:0/1397459911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34107eb0 con 0x7fdb34106cb0 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.477+0000 7fdb32ffd700 1 --2- 172.21.15.12:0/1397459911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb341070d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb240098a0 tx=0x7fdb24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbcb71d7e41cbb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.477+0000 7fdb31ffb700 1 -- 172.21.15.12:0/1397459911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb24004160 con 0x7fdb34106cb0 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb31ffb700 1 -- 172.21.15.12:0/1397459911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fdb240042c0 con 0x7fdb34106cb0 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb31ffb700 1 -- 172.21.15.12:0/1397459911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb24011940 con 0x7fdb34106cb0 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb39606700 1 -- 172.21.15.12:0/1397459911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 msgr2=0x7fdb341070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb39606700 1 --2- 172.21.15.12:0/1397459911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb341070d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb240098a0 tx=0x7fdb24009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb39606700 1 -- 172.21.15.12:0/1397459911 shutdown_connections 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb39606700 1 --2- 172.21.15.12:0/1397459911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb341070d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:48.320 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb39606700 1 -- 172.21.15.12:0/1397459911 >> 172.21.15.12:0/1397459911 conn(0x7fdb34102250 msgr2=0x7fdb34104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb39606700 1 -- 172.21.15.12:0/1397459911 shutdown_connections 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.478+0000 7fdb39606700 1 -- 172.21.15.12:0/1397459911 wait complete. 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.479+0000 7fdb39606700 1 Processor -- start 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.479+0000 7fdb39606700 1 -- start start 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.480+0000 7fdb39606700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb3419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.480+0000 7fdb39606700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3419d030 con 0x7fdb34106cb0 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.480+0000 7fdb32ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb3419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.480+0000 7fdb32ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb3419caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38972/0 (socket says 172.21.15.12:38972) 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.480+0000 7fdb32ffd700 1 -- 172.21.15.12:0/3757547140 learned_addr learned my addr 172.21.15.12:0/3757547140 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.480+0000 7fdb32ffd700 1 -- 172.21.15.12:0/3757547140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24009550 con 0x7fdb34106cb0 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.481+0000 7fdb32ffd700 1 --2- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb3419caf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb24003f20 tx=0x7fdb24011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.481+0000 7fdb1bfff700 1 -- 172.21.15.12:0/3757547140 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb240036a0 con 0x7fdb34106cb0 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.481+0000 7fdb1bfff700 1 -- 172.21.15.12:0/3757547140 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fdb2401b440 con 0x7fdb34106cb0 2023-12-11T20:05:48.321 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.481+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3419d230 con 0x7fdb34106cb0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.481+0000 7fdb1bfff700 1 -- 172.21.15.12:0/3757547140 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb24023400 con 0x7fdb34106cb0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.481+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3419d6d0 con 0x7fdb34106cb0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.482+0000 7fdb1bfff700 1 -- 172.21.15.12:0/3757547140 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7fdb2401b5b0 con 0x7fdb34106cb0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.482+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3410b0e0 con 0x7fdb34106cb0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.482+0000 7fdb1bfff700 1 --2- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fdb1c038870 0x7fdb1c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.483+0000 7fdb1bfff700 1 -- 172.21.15.12:0/3757547140 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdb2404c7a0 con 0x7fdb34106cb0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.483+0000 7fdb327fc700 1 --2- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fdb1c038870 0x7fdb1c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.483+0000 7fdb327fc700 1 --2- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fdb1c038870 0x7fdb1c03ad30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb28006fd0 tx=0x7fdb28006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.488+0000 7fdb1bfff700 1 -- 172.21.15.12:0/3757547140 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdb2401b920 con 0x7fdb34106cb0 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.735+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fdb3419ff60 con 0x7fdb1c038870 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.741+0000 7fdb1bfff700 1 -- 172.21.15.12:0/3757547140 <== mgr.14116 v2:172.21.15.12:6800/3786645349 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdb3419ff60 con 0x7fdb1c038870 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fdb1c038870 msgr2=0x7fdb1c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 --2- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fdb1c038870 0x7fdb1c03ad30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb28006fd0 tx=0x7fdb28006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 msgr2=0x7fdb3419caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:48.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 --2- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb3419caf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb24003f20 tx=0x7fdb24011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:48.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 shutdown_connections 2023-12-11T20:05:48.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 --2- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fdb1c038870 0x7fdb1c03ad30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:48.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 --2- 172.21.15.12:0/3757547140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb34106cb0 0x7fdb3419caf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:48.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 >> 172.21.15.12:0/3757547140 conn(0x7fdb34102250 msgr2=0x7fdb34102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:48.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 shutdown_connections 2023-12-11T20:05:48.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:47.744+0000 7fdb39606700 1 -- 172.21.15.12:0/3757547140 wait complete. 2023-12-11T20:05:48.323 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mgr service... 2023-12-11T20:05:48.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:48 smithi012 ceph-mon[128787]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:05:48.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:48 smithi012 ceph-mon[128787]: Saving service mon spec with placement count:5 2023-12-11T20:05:48.938 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:48 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:49.710 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.985+0000 7f7d951e8700 1 Processor -- start 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.985+0000 7f7d951e8700 1 -- start start 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.986+0000 7f7d951e8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d90105a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.986+0000 7f7d951e8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9007ada0 con 0x7f7d901055f0 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.986+0000 7f7d8ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d90105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.986+0000 7f7d8ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d90105a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33438/0 (socket says 172.21.15.12:33438) 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.986+0000 7f7d8ed9d700 1 -- 172.21.15.12:0/959270441 learned_addr learned my addr 172.21.15.12:0/959270441 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.987+0000 7f7d8ed9d700 1 -- 172.21.15.12:0/959270441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9007aee0 con 0x7f7d901055f0 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.987+0000 7f7d8ed9d700 1 --2- 172.21.15.12:0/959270441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d90105a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d800098a0 tx=0x7f7d80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d3e7ea5ef07eed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.987+0000 7f7d8dd9b700 1 -- 172.21.15.12:0/959270441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d80004160 con 0x7f7d901055f0 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.987+0000 7f7d8dd9b700 1 -- 172.21.15.12:0/959270441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7d800042c0 con 0x7f7d901055f0 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.987+0000 7f7d8dd9b700 1 -- 172.21.15.12:0/959270441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d80011940 con 0x7f7d901055f0 2023-12-11T20:05:49.711 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.988+0000 7f7d951e8700 1 -- 172.21.15.12:0/959270441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 msgr2=0x7f7d90105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.988+0000 7f7d951e8700 1 --2- 172.21.15.12:0/959270441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d90105a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d800098a0 tx=0x7f7d80009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.988+0000 7f7d951e8700 1 -- 172.21.15.12:0/959270441 shutdown_connections 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.988+0000 7f7d951e8700 1 --2- 172.21.15.12:0/959270441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d90105a10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.988+0000 7f7d951e8700 1 -- 172.21.15.12:0/959270441 >> 172.21.15.12:0/959270441 conn(0x7f7d901011b0 msgr2=0x7f7d901035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.988+0000 7f7d951e8700 1 -- 172.21.15.12:0/959270441 shutdown_connections 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.988+0000 7f7d951e8700 1 -- 172.21.15.12:0/959270441 wait complete. 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.989+0000 7f7d951e8700 1 Processor -- start 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.990+0000 7f7d951e8700 1 -- start start 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.990+0000 7f7d951e8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d9019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.990+0000 7f7d951e8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9019d060 con 0x7f7d901055f0 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.990+0000 7f7d8ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d9019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.990+0000 7f7d8ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d9019cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33440/0 (socket says 172.21.15.12:33440) 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.991+0000 7f7d8ed9d700 1 -- 172.21.15.12:0/2288148341 learned_addr learned my addr 172.21.15.12:0/2288148341 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.991+0000 7f7d8ed9d700 1 -- 172.21.15.12:0/2288148341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80009550 con 0x7f7d901055f0 2023-12-11T20:05:49.712 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.991+0000 7f7d8ed9d700 1 --2- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d9019cb20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d80003f20 tx=0x7f7d80011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.991+0000 7f7d77fff700 1 -- 172.21.15.12:0/2288148341 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d800037d0 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.991+0000 7f7d77fff700 1 -- 172.21.15.12:0/2288148341 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7d8001b440 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.991+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9019d260 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.991+0000 7f7d77fff700 1 -- 172.21.15.12:0/2288148341 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d80023590 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.991+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9019d700 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.992+0000 7f7d77fff700 1 -- 172.21.15.12:0/2288148341 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f7d80023800 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.993+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d901968d0 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.993+0000 7f7d77fff700 1 --2- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f7d78038870 0x7f7d7803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.993+0000 7f7d77fff700 1 -- 172.21.15.12:0/2288148341 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7d8004c9b0 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.993+0000 7f7d8e59c700 1 --2- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f7d78038870 0x7f7d7803ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.994+0000 7f7d8e59c700 1 --2- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f7d78038870 0x7f7d7803ad30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7d84006fd0 tx=0x7f7d84006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:48.999+0000 7f7d77fff700 1 -- 172.21.15.12:0/2288148341 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7d80023ab0 con 0x7f7d901055f0 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.225+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7d9002d580 con 0x7f7d78038870 2023-12-11T20:05:49.713 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.234+0000 7f7d77fff700 1 -- 172.21.15.12:0/2288148341 <== mgr.14116 v2:172.21.15.12:6800/3786645349 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7d9002d580 con 0x7f7d78038870 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.236+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f7d78038870 msgr2=0x7f7d7803ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.236+0000 7f7d951e8700 1 --2- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f7d78038870 0x7f7d7803ad30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7d84006fd0 tx=0x7f7d84006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.236+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 msgr2=0x7f7d9019cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.236+0000 7f7d951e8700 1 --2- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d9019cb20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d80003f20 tx=0x7f7d80011f00 comp rx=0 tx=0).stop 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.236+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 shutdown_connections 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.236+0000 7f7d951e8700 1 --2- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f7d78038870 0x7f7d7803ad30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.236+0000 7f7d951e8700 1 --2- 172.21.15.12:0/2288148341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d901055f0 0x7f7d9019cb20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.236+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 >> 172.21.15.12:0/2288148341 conn(0x7f7d901011b0 msgr2=0x7f7d90193a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.237+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 shutdown_connections 2023-12-11T20:05:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:49.237+0000 7f7d951e8700 1 -- 172.21.15.12:0/2288148341 wait complete. 2023-12-11T20:05:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:50 smithi012 ceph-mon[128787]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:05:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:50 smithi012 ceph-mon[128787]: Saving service mgr spec with placement count:2 2023-12-11T20:05:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:50 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:50 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:50 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:50.991 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.275+0000 7fab30e5c700 1 Processor -- start 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.275+0000 7fab30e5c700 1 -- start start 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.275+0000 7fab30e5c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c07a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.275+0000 7fab30e5c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c07a750 con 0x7fab2c07bd20 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.275+0000 7fab2a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c07a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.276+0000 7fab2a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c07a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33450/0 (socket says 172.21.15.12:33450) 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.276+0000 7fab2a59c700 1 -- 172.21.15.12:0/1878145688 learned_addr learned my addr 172.21.15.12:0/1878145688 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.276+0000 7fab2a59c700 1 -- 172.21.15.12:0/1878145688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c07a890 con 0x7fab2c07bd20 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.276+0000 7fab2a59c700 1 --2- 172.21.15.12:0/1878145688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c07a180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0098a0 tx=0x7fab1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d9e64c9dd703cf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.276+0000 7fab2959a700 1 -- 172.21.15.12:0/1878145688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab1c004160 con 0x7fab2c07bd20 2023-12-11T20:05:50.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.276+0000 7fab2959a700 1 -- 172.21.15.12:0/1878145688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab1c0042c0 con 0x7fab2c07bd20 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.277+0000 7fab2959a700 1 -- 172.21.15.12:0/1878145688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab1c0118e0 con 0x7fab2c07bd20 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.277+0000 7fab30e5c700 1 -- 172.21.15.12:0/1878145688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 msgr2=0x7fab2c07a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.277+0000 7fab30e5c700 1 --2- 172.21.15.12:0/1878145688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c07a180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0098a0 tx=0x7fab1c009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.277+0000 7fab30e5c700 1 -- 172.21.15.12:0/1878145688 shutdown_connections 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.277+0000 7fab30e5c700 1 --2- 172.21.15.12:0/1878145688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c07a180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.277+0000 7fab30e5c700 1 -- 172.21.15.12:0/1878145688 >> 172.21.15.12:0/1878145688 conn(0x7fab2c102250 msgr2=0x7fab2c104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.277+0000 7fab30e5c700 1 -- 172.21.15.12:0/1878145688 shutdown_connections 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.277+0000 7fab30e5c700 1 -- 172.21.15.12:0/1878145688 wait complete. 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.278+0000 7fab30e5c700 1 Processor -- start 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.278+0000 7fab30e5c700 1 -- start start 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.279+0000 7fab30e5c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.279+0000 7fab30e5c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c19d0e0 con 0x7fab2c07bd20 2023-12-11T20:05:50.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.279+0000 7fab2a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.279+0000 7fab2a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c19cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33464/0 (socket says 172.21.15.12:33464) 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.279+0000 7fab2a59c700 1 -- 172.21.15.12:0/952701882 learned_addr learned my addr 172.21.15.12:0/952701882 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.279+0000 7fab2a59c700 1 -- 172.21.15.12:0/952701882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c009550 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.280+0000 7fab2a59c700 1 --2- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c19cba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab1c003f70 tx=0x7fab1c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.280+0000 7fab1b7fe700 1 -- 172.21.15.12:0/952701882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab1c0036a0 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.280+0000 7fab1b7fe700 1 -- 172.21.15.12:0/952701882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab1c01b440 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.280+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c19d2e0 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.280+0000 7fab1b7fe700 1 -- 172.21.15.12:0/952701882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab1c023400 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.280+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c19d780 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.281+0000 7fab1b7fe700 1 -- 172.21.15.12:0/952701882 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7fab1c003800 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.282+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c10d070 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.282+0000 7fab1b7fe700 1 --2- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fab14038820 0x7fab1403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.282+0000 7fab1b7fe700 1 -- 172.21.15.12:0/952701882 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fab1c04c820 con 0x7fab2c07bd20 2023-12-11T20:05:50.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.282+0000 7fab29d9b700 1 --2- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fab14038820 0x7fab1403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.283+0000 7fab29d9b700 1 --2- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fab14038820 0x7fab1403ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab20006fd0 tx=0x7fab20006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.291+0000 7fab1b7fe700 1 -- 172.21.15.12:0/952701882 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fab1c00bd70 con 0x7fab2c07bd20 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.506+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fab2c10d2b0 con 0x7fab2c07bd20 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.508+0000 7fab1b7fe700 1 -- 172.21.15.12:0/952701882 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fab1c016260 con 0x7fab2c07bd20 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fab14038820 msgr2=0x7fab1403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 --2- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fab14038820 0x7fab1403ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab20006fd0 tx=0x7fab20006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 msgr2=0x7fab2c19cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 --2- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c19cba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab1c003f70 tx=0x7fab1c0119a0 comp rx=0 tx=0).stop 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 shutdown_connections 2023-12-11T20:05:50.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 --2- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7fab14038820 0x7fab1403ace0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:50.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 --2- 172.21.15.12:0/952701882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab2c07bd20 0x7fab2c19cba0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:50.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 >> 172.21.15.12:0/952701882 conn(0x7fab2c102250 msgr2=0x7fab2c102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:50.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 shutdown_connections 2023-12-11T20:05:50.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:50.511+0000 7fab30e5c700 1 -- 172.21.15.12:0/952701882 wait complete. 2023-12-11T20:05:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:51 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/952701882' entity='client.admin' 2023-12-11T20:05:52.475 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.546+0000 7f5a0ee8d700 1 Processor -- start 2023-12-11T20:05:52.475 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.547+0000 7f5a0ee8d700 1 -- start start 2023-12-11T20:05:52.475 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.547+0000 7f5a0ee8d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0807a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:52.475 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.547+0000 7f5a0ee8d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0807a730 con 0x7f5a0807bd00 2023-12-11T20:05:52.475 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.547+0000 7f5a0cc29700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0807a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.547+0000 7f5a0cc29700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0807a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33470/0 (socket says 172.21.15.12:33470) 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.547+0000 7f5a0cc29700 1 -- 172.21.15.12:0/3094853418 learned_addr learned my addr 172.21.15.12:0/3094853418 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.548+0000 7f5a0cc29700 1 -- 172.21.15.12:0/3094853418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0807a870 con 0x7f5a0807bd00 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.548+0000 7f5a0cc29700 1 --2- 172.21.15.12:0/3094853418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0807a160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0098a0 tx=0x7f59fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e384b86c2ec04ebb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.548+0000 7f5a077fe700 1 -- 172.21.15.12:0/3094853418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc004160 con 0x7f5a0807bd00 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.548+0000 7f5a077fe700 1 -- 172.21.15.12:0/3094853418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59fc0042c0 con 0x7f5a0807bd00 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.548+0000 7f5a077fe700 1 -- 172.21.15.12:0/3094853418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc0118e0 con 0x7f5a0807bd00 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.549+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/3094853418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 msgr2=0x7f5a0807a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.549+0000 7f5a0ee8d700 1 --2- 172.21.15.12:0/3094853418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0807a160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0098a0 tx=0x7f59fc009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.549+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/3094853418 shutdown_connections 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.549+0000 7f5a0ee8d700 1 --2- 172.21.15.12:0/3094853418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0807a160 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.549+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/3094853418 >> 172.21.15.12:0/3094853418 conn(0x7f5a08102250 msgr2=0x7f5a08104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.549+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/3094853418 shutdown_connections 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.549+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/3094853418 wait complete. 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.550+0000 7f5a0ee8d700 1 Processor -- start 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.550+0000 7f5a0ee8d700 1 -- start start 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.551+0000 7f5a0ee8d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.551+0000 7f5a0ee8d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0819d070 con 0x7f5a0807bd00 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.551+0000 7f5a0cc29700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.551+0000 7f5a0cc29700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0819cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33478/0 (socket says 172.21.15.12:33478) 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.551+0000 7f5a0cc29700 1 -- 172.21.15.12:0/2215920866 learned_addr learned my addr 172.21.15.12:0/2215920866 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:52.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.551+0000 7f5a0cc29700 1 -- 172.21.15.12:0/2215920866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc009550 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.552+0000 7f5a0cc29700 1 --2- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0819cb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59fc003f70 tx=0x7f59fc0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.552+0000 7f5a05ffb700 1 -- 172.21.15.12:0/2215920866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc0036a0 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.552+0000 7f5a05ffb700 1 -- 172.21.15.12:0/2215920866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59fc01b440 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.552+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0819d270 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.552+0000 7f5a05ffb700 1 -- 172.21.15.12:0/2215920866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc023400 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.552+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0819d710 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.553+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0810d090 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.553+0000 7f5a05ffb700 1 -- 172.21.15.12:0/2215920866 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f59fc01b5b0 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.554+0000 7f5a05ffb700 1 --2- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f59f8038870 0x7f59f803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.554+0000 7f5a05ffb700 1 -- 172.21.15.12:0/2215920866 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f59fc04c750 con 0x7f5a0807bd00 2023-12-11T20:05:52.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.554+0000 7f5a07fff700 1 --2- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f59f8038870 0x7f59f803ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:52.479 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.555+0000 7f5a07fff700 1 --2- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f59f8038870 0x7f59f803ad30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f59f4006fd0 tx=0x7f59f4006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:52.479 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.559+0000 7f5a05ffb700 1 -- 172.21.15.12:0/2215920866 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f59fc019840 con 0x7f5a0807bd00 2023-12-11T20:05:52.479 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.780+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5a0810d2d0 con 0x7f5a0807bd00 2023-12-11T20:05:52.479 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.785+0000 7f5a05ffb700 1 -- 172.21.15.12:0/2215920866 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f59fc019840 con 0x7f5a0807bd00 2023-12-11T20:05:52.479 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.787+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f59f8038870 msgr2=0x7f59f803ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:52.479 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.787+0000 7f5a0ee8d700 1 --2- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f59f8038870 0x7f59f803ad30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f59f4006fd0 tx=0x7f59f4006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:52.480 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.787+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 msgr2=0x7f5a0819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:52.480 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.788+0000 7f5a0ee8d700 1 --2- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0819cb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59fc003f70 tx=0x7f59fc0119a0 comp rx=0 tx=0).stop 2023-12-11T20:05:52.480 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.788+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 shutdown_connections 2023-12-11T20:05:52.480 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.788+0000 7f5a0ee8d700 1 --2- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f59f8038870 0x7f59f803ad30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:52.480 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.788+0000 7f5a0ee8d700 1 --2- 172.21.15.12:0/2215920866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0807bd00 0x7f5a0819cb30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:52.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.788+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 >> 172.21.15.12:0/2215920866 conn(0x7f5a08102250 msgr2=0x7f5a08102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:52.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.788+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 shutdown_connections 2023-12-11T20:05:52.481 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:51.788+0000 7f5a0ee8d700 1 -- 172.21.15.12:0/2215920866 wait complete. 2023-12-11T20:05:52.481 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling the dashboard module... 2023-12-11T20:05:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:52 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2215920866' entity='client.admin' 2023-12-11T20:05:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:52 smithi012 ceph-mon[128787]: from='mgr.14116 172.21.15.12:0/3042502694' entity='mgr.x' 2023-12-11T20:05:54.182 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:53 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1655798543' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-11T20:05:54.183 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: ignoring --setuser ceph since I am not root 2023-12-11T20:05:54.183 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: ignoring --setgroup ceph since I am not root 2023-12-11T20:05:54.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.007+0000 7f922b277700 1 Processor -- start 2023-12-11T20:05:54.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.007+0000 7f922b277700 1 -- start start 2023-12-11T20:05:54.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.007+0000 7f922b277700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922407a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:54.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.007+0000 7f922b277700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922407a730 con 0x7f922407bd00 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.008+0000 7f9229013700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922407a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.008+0000 7f9229013700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922407a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33488/0 (socket says 172.21.15.12:33488) 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.008+0000 7f9229013700 1 -- 172.21.15.12:0/1692752750 learned_addr learned my addr 172.21.15.12:0/1692752750 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.008+0000 7f9229013700 1 -- 172.21.15.12:0/1692752750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922407a870 con 0x7f922407bd00 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.008+0000 7f9229013700 1 --2- 172.21.15.12:0/1692752750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922407a160 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92200098a0 tx=0x7f9220009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5c838ed61352c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.009+0000 7f921bfff700 1 -- 172.21.15.12:0/1692752750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9220004160 con 0x7f922407bd00 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.009+0000 7f921bfff700 1 -- 172.21.15.12:0/1692752750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92200042c0 con 0x7f922407bd00 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.009+0000 7f921bfff700 1 -- 172.21.15.12:0/1692752750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92200118e0 con 0x7f922407bd00 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.009+0000 7f922b277700 1 -- 172.21.15.12:0/1692752750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 msgr2=0x7f922407a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.009+0000 7f922b277700 1 --2- 172.21.15.12:0/1692752750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922407a160 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92200098a0 tx=0x7f9220009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.010+0000 7f922b277700 1 -- 172.21.15.12:0/1692752750 shutdown_connections 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.010+0000 7f922b277700 1 --2- 172.21.15.12:0/1692752750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922407a160 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.010+0000 7f922b277700 1 -- 172.21.15.12:0/1692752750 >> 172.21.15.12:0/1692752750 conn(0x7f9224102250 msgr2=0x7f9224104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.010+0000 7f922b277700 1 -- 172.21.15.12:0/1692752750 shutdown_connections 2023-12-11T20:05:54.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.010+0000 7f922b277700 1 -- 172.21.15.12:0/1692752750 wait complete. 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.011+0000 7f922b277700 1 Processor -- start 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.011+0000 7f922b277700 1 -- start start 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.011+0000 7f922b277700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.011+0000 7f922b277700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922419d070 con 0x7f922407bd00 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.011+0000 7f9229013700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.012+0000 7f9229013700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922419cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33490/0 (socket says 172.21.15.12:33490) 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.012+0000 7f9229013700 1 -- 172.21.15.12:0/1655798543 learned_addr learned my addr 172.21.15.12:0/1655798543 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.012+0000 7f9229013700 1 -- 172.21.15.12:0/1655798543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220009550 con 0x7f922407bd00 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.012+0000 7f9229013700 1 --2- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922419cb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9220003f70 tx=0x7f92200119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.012+0000 7f921a7fc700 1 -- 172.21.15.12:0/1655798543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92200036a0 con 0x7f922407bd00 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.012+0000 7f921a7fc700 1 -- 172.21.15.12:0/1655798543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f922001b440 con 0x7f922407bd00 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.012+0000 7f921a7fc700 1 -- 172.21.15.12:0/1655798543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9220023400 con 0x7f922407bd00 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.012+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922419d270 con 0x7f922407bd00 2023-12-11T20:05:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.013+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922419d710 con 0x7f922407bd00 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.014+0000 7f921a7fc700 1 -- 172.21.15.12:0/1655798543 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f9220003800 con 0x7f922407bd00 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.014+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922410d090 con 0x7f922407bd00 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.014+0000 7f921a7fc700 1 --2- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f9210038870 0x7f921003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.014+0000 7f921a7fc700 1 -- 172.21.15.12:0/1655798543 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f922004c850 con 0x7f922407bd00 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.014+0000 7f9228812700 1 --2- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f9210038870 0x7f921003ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.015+0000 7f9228812700 1 --2- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f9210038870 0x7f921003ad30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9214006fd0 tx=0x7f9214006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.020+0000 7f921a7fc700 1 -- 172.21.15.12:0/1655798543 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9220003ab0 con 0x7f922407bd00 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.305+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f922410d2d0 con 0x7f922407bd00 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.898+0000 7f921a7fc700 1 -- 172.21.15.12:0/1655798543 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f922002b350 con 0x7f922407bd00 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.901+0000 7f921a7fc700 1 -- 172.21.15.12:0/1655798543 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 9) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f922001b960 con 0x7f922407bd00 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f9210038870 msgr2=0x7f921003ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 --2- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f9210038870 0x7f921003ad30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9214006fd0 tx=0x7f9214006e40 comp rx=0 tx=0).stop 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 msgr2=0x7f922419cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 --2- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922419cb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9220003f70 tx=0x7f92200119a0 comp rx=0 tx=0).stop 2023-12-11T20:05:54.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 shutdown_connections 2023-12-11T20:05:54.364 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 --2- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f9210038870 0x7f921003ad30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:54.364 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 --2- 172.21.15.12:0/1655798543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f922407bd00 0x7f922419cb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:54.364 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 >> 172.21.15.12:0/1655798543 conn(0x7f9224102250 msgr2=0x7f9224102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:54.364 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 shutdown_connections 2023-12-11T20:05:54.364 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:53.903+0000 7f922b277700 1 -- 172.21.15.12:0/1655798543 wait complete. 2023-12-11T20:05:54.458 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:54.215+0000 7f160153f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-11T20:05:54.458 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:54.325+0000 7f160153f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-11T20:05:54.458 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:54.458+0000 7f160153f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-11T20:05:54.721 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:54.587+0000 7f160153f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-11T20:05:55.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1655798543' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-11T20:05:55.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-mon[128787]: mgrmap e9: x(active, since 19s) 2023-12-11T20:05:55.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:54.830+0000 7f160153f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-11T20:05:55.543 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:55 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:55.373+0000 7f160153f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-11T20:05:55.638 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2023-12-11T20:05:55.643 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.929+0000 7f320e1f6700 1 Processor -- start 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.929+0000 7f320e1f6700 1 -- start start 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.930+0000 7f320e1f6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f32081070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.930+0000 7f320e1f6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32081076a0 con 0x7f3208106cb0 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.930+0000 7f32077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f32081070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.930+0000 7f32077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f32081070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33520/0 (socket says 172.21.15.12:33520) 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.930+0000 7f32077fe700 1 -- 172.21.15.12:0/1729205771 learned_addr learned my addr 172.21.15.12:0/1729205771 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.931+0000 7f32077fe700 1 -- 172.21.15.12:0/1729205771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208107eb0 con 0x7f3208106cb0 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.931+0000 7f32077fe700 1 --2- 172.21.15.12:0/1729205771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f32081070d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31f80098a0 tx=0x7f31f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34affc3148ecf427 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.931+0000 7f32067fc700 1 -- 172.21.15.12:0/1729205771 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31f8004160 con 0x7f3208106cb0 2023-12-11T20:05:55.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.931+0000 7f32067fc700 1 -- 172.21.15.12:0/1729205771 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31f80042c0 con 0x7f3208106cb0 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.931+0000 7f32067fc700 1 -- 172.21.15.12:0/1729205771 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31f80118e0 con 0x7f3208106cb0 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.932+0000 7f320e1f6700 1 -- 172.21.15.12:0/1729205771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 msgr2=0x7f32081070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.932+0000 7f320e1f6700 1 --2- 172.21.15.12:0/1729205771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f32081070d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31f80098a0 tx=0x7f31f8009bb0 comp rx=0 tx=0).stop 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.932+0000 7f320e1f6700 1 -- 172.21.15.12:0/1729205771 shutdown_connections 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.932+0000 7f320e1f6700 1 --2- 172.21.15.12:0/1729205771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f32081070d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.932+0000 7f320e1f6700 1 -- 172.21.15.12:0/1729205771 >> 172.21.15.12:0/1729205771 conn(0x7f3208102250 msgr2=0x7f3208104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.932+0000 7f320e1f6700 1 -- 172.21.15.12:0/1729205771 shutdown_connections 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.932+0000 7f320e1f6700 1 -- 172.21.15.12:0/1729205771 wait complete. 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.934+0000 7f320e1f6700 1 Processor -- start 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.934+0000 7f320e1f6700 1 -- start start 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.934+0000 7f320e1f6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f320807b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.934+0000 7f320e1f6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320807bee0 con 0x7f3208106cb0 2023-12-11T20:05:55.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.935+0000 7f32077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f320807b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.935+0000 7f32077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f320807b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33530/0 (socket says 172.21.15.12:33530) 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.935+0000 7f32077fe700 1 -- 172.21.15.12:0/2306631094 learned_addr learned my addr 172.21.15.12:0/2306631094 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.935+0000 7f32077fe700 1 -- 172.21.15.12:0/2306631094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8009550 con 0x7f3208106cb0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.935+0000 7f32077fe700 1 --2- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f320807b9a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31f8006af0 tx=0x7f31f8011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.936+0000 7f3204ff9700 1 -- 172.21.15.12:0/2306631094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31f80037d0 con 0x7f3208106cb0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.936+0000 7f3204ff9700 1 -- 172.21.15.12:0/2306631094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31f801b440 con 0x7f3208106cb0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.936+0000 7f3204ff9700 1 -- 172.21.15.12:0/2306631094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31f8023400 con 0x7f3208106cb0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.936+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320807a120 con 0x7f3208106cb0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.936+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320807a5c0 con 0x7f3208106cb0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.937+0000 7f3204ff9700 1 -- 172.21.15.12:0/2306631094 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f31f801b5b0 con 0x7f3208106cb0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.937+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3208062c00 con 0x7f3208106cb0 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.937+0000 7f3204ff9700 1 --2- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f31f0038870 0x7f31f003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:05:55.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.937+0000 7f3204ff9700 1 -- 172.21.15.12:0/2306631094 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f31f804c910 con 0x7f3208106cb0 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.937+0000 7f3206ffd700 1 -- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f31f0038870 msgr2=0x7f31f003ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3786645349 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.938+0000 7f3206ffd700 1 --2- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f31f0038870 0x7f31f003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:54.943+0000 7f3204ff9700 1 -- 172.21.15.12:0/2306631094 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f31f801b8d0 con 0x7f3208106cb0 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.139+0000 7f3206ffd700 1 -- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f31f0038870 msgr2=0x7f31f003ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3786645349 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.139+0000 7f3206ffd700 1 --2- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f31f0038870 0x7f31f003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.269+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f320810b0e0 con 0x7f3208106cb0 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.270+0000 7f3204ff9700 1 -- 172.21.15.12:0/2306631094 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f31f800b3e0 con 0x7f3208106cb0 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f31f0038870 msgr2=0x7f31f003ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 --2- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f31f0038870 0x7f31f003ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 msgr2=0x7f320807b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 --2- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f320807b9a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31f8006af0 tx=0x7f31f8011ed0 comp rx=0 tx=0).stop 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 shutdown_connections 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 --2- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f31f0038870 0x7f31f003ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 --2- 172.21.15.12:0/2306631094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3208106cb0 0x7f320807b9a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:05:55.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 >> 172.21.15.12:0/2306631094 conn(0x7f3208102250 msgr2=0x7f3208102d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:05:55.648 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 shutdown_connections 2023-12-11T20:05:55.648 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:55.272+0000 7f320e1f6700 1 -- 172.21.15.12:0/2306631094 wait complete. 2023-12-11T20:05:55.648 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2023-12-11T20:05:55.648 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 9... 2023-12-11T20:05:55.800 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:55 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:55.544+0000 7f160153f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-11T20:05:55.801 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:55 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:55.667+0000 7f160153f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-11T20:05:55.801 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:55 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:55.801+0000 7f160153f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-11T20:05:56.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:05:55 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2306631094' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-11T20:05:56.830 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:56 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:56.380+0000 7f160153f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-11T20:05:57.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:57 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:57.264+0000 7f160153f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-11T20:05:57.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:57 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:57.373+0000 7f160153f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-11T20:05:58.731 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:58.373+0000 7f160153f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:05:58.731 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:58.498+0000 7f160153f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-11T20:05:59.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:58.732+0000 7f160153f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:05:59.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:59 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:59.274+0000 7f160153f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-11T20:05:59.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:59 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:59.395+0000 7f160153f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-11T20:05:59.953 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:59 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:59.597+0000 7f160153f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-11T20:06:00.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:05:59 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:05:59.954+0000 7f160153f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-11T20:06:01.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:06:00 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:06:00.924+0000 7f160153f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-11T20:06:01.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:06:01 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:06:01.105+0000 7f160153f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-11T20:06:01.807 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:06:01 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:06:01.366+0000 7f160153f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-11T20:06:01.807 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:06:01 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:06:01.517+0000 7f160153f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-11T20:06:02.081 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:06:01 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:06:01.808+0000 7f160153f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-11T20:06:03.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:06:02 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:06:02.924+0000 7f160153f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-11T20:06:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: Active manager daemon x restarted 2023-12-11T20:06:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: Activating manager daemon x 2023-12-11T20:06:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: osdmap e3: 0 total, 0 up, 0 in 2023-12-11T20:06:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: mgrmap e10: x(active, starting, since 0.00621131s) 2023-12-11T20:06:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:06:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-11T20:06:04.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-11T20:06:04.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-11T20:06:04.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-11T20:06:04.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: Manager daemon x is now available 2023-12-11T20:06:04.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:04.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:04.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-11T20:06:04.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-11T20:06:04.355 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2023-12-11T20:06:04.355 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-11T20:06:04.355 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-11T20:06:04.355 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.183+0000 7f8176245700 1 Processor -- start 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.183+0000 7f8176245700 1 -- start start 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.183+0000 7f8176245700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f81701092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.183+0000 7f8176245700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81701097e0 con 0x7f8170108e80 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.183+0000 7f816f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f81701092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.183+0000 7f816f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f81701092a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33544/0 (socket says 172.21.15.12:33544) 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.183+0000 7f816f7fe700 1 -- 172.21.15.12:0/3873527745 learned_addr learned my addr 172.21.15.12:0/3873527745 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.184+0000 7f816f7fe700 1 -- 172.21.15.12:0/3873527745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170109920 con 0x7f8170108e80 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.184+0000 7f816f7fe700 1 --2- 172.21.15.12:0/3873527745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f81701092a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81600098a0 tx=0x7f8160009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56915f8ee9ed2bbb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.184+0000 7f816e7fc700 1 -- 172.21.15.12:0/3873527745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8160004160 con 0x7f8170108e80 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.184+0000 7f816e7fc700 1 -- 172.21.15.12:0/3873527745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81600042c0 con 0x7f8170108e80 2023-12-11T20:06:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.184+0000 7f816e7fc700 1 -- 172.21.15.12:0/3873527745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81600118e0 con 0x7f8170108e80 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.185+0000 7f8176245700 1 -- 172.21.15.12:0/3873527745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 msgr2=0x7f81701092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.185+0000 7f8176245700 1 --2- 172.21.15.12:0/3873527745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f81701092a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81600098a0 tx=0x7f8160009bb0 comp rx=0 tx=0).stop 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.185+0000 7f8176245700 1 -- 172.21.15.12:0/3873527745 shutdown_connections 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.185+0000 7f8176245700 1 --2- 172.21.15.12:0/3873527745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f81701092a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.185+0000 7f8176245700 1 -- 172.21.15.12:0/3873527745 >> 172.21.15.12:0/3873527745 conn(0x7f8170104510 msgr2=0x7f8170106900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.185+0000 7f8176245700 1 -- 172.21.15.12:0/3873527745 shutdown_connections 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.185+0000 7f8176245700 1 -- 172.21.15.12:0/3873527745 wait complete. 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.186+0000 7f8176245700 1 Processor -- start 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.186+0000 7f8176245700 1 -- start start 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.187+0000 7f8176245700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f817019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.187+0000 7f8176245700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817019d0b0 con 0x7f8170108e80 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.187+0000 7f816f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f817019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:04.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.187+0000 7f816f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f817019cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33558/0 (socket says 172.21.15.12:33558) 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.187+0000 7f816f7fe700 1 -- 172.21.15.12:0/2176837205 learned_addr learned my addr 172.21.15.12:0/2176837205 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.187+0000 7f816f7fe700 1 -- 172.21.15.12:0/2176837205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160009550 con 0x7f8170108e80 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.188+0000 7f816f7fe700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f817019cb70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8160003f70 tx=0x7f81600119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.188+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81600036a0 con 0x7f8170108e80 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.188+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817019d2b0 con 0x7f8170108e80 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.188+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f816001b440 con 0x7f8170108e80 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.188+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8160023400 con 0x7f8170108e80 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.188+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817019d750 con 0x7f8170108e80 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.189+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f8160023680 con 0x7f8170108e80 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.190+0000 7f816cff9700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.190+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 --> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f815803b490 con 0x7f81580388c0 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.190+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f816004c8b0 con 0x7f8170108e80 2023-12-11T20:06:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.190+0000 7f816effd700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 msgr2=0x7f815803ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3786645349 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.190+0000 7f816effd700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.391+0000 7f816effd700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 msgr2=0x7f815803ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3786645349 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.391+0000 7f816effd700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.792+0000 7f816effd700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 msgr2=0x7f815803ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3786645349 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:56.792+0000 7f816effd700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:57.593+0000 7f816effd700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 msgr2=0x7f815803ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3786645349 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:57.593+0000 7f816effd700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:59.195+0000 7f816effd700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 msgr2=0x7f815803ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3786645349 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:05:59.195+0000 7f816effd700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:02.396+0000 7f816effd700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 msgr2=0x7f815803ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3786645349 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:02.396+0000 7f816effd700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:02.931+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 10) v1 ==== 45360+0+0 (secure 0 0 0) 0x7f816001b5b0 con 0x7f8170108e80 2023-12-11T20:06:04.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:02.931+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 msgr2=0x7f815803ad80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:02.931+0000 7f816cff9700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.933+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 11) v1 ==== 45487+0+0 (secure 0 0 0) 0x7f816004e190 con 0x7f8170108e80 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.933+0000 7f816cff9700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f815803c360 0x7f815803e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.934+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f815803b490 con 0x7f815803c360 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.934+0000 7f816effd700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f815803c360 0x7f815803e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.935+0000 7f816effd700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f815803c360 0x7f815803e750 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8164003a10 tx=0x7f8164009270 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.936+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f815803b490 con 0x7f815803c360 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.945+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8170062c00 con 0x7f815803c360 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.945+0000 7f816cff9700 1 -- 172.21.15.12:0/2176837205 <== mgr.14148 v2:172.21.15.12:6800/1969938581 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f8170062c00 con 0x7f815803c360 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f815803c360 msgr2=0x7f815803e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f815803c360 0x7f815803e750 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8164003a10 tx=0x7f8164009270 comp rx=0 tx=0).stop 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 msgr2=0x7f817019cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f817019cb70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8160003f70 tx=0x7f81600119a0 comp rx=0 tx=0).stop 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 shutdown_connections 2023-12-11T20:06:04.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f815803c360 0x7f815803e750 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:04.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8170108e80 0x7f817019cb70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:04.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 --2- 172.21.15.12:0/2176837205 >> [v2:172.21.15.12:6800/3786645349,v1:172.21.15.12:6801/3786645349] conn(0x7f81580388c0 0x7f815803ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:04.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 >> 172.21.15.12:0/2176837205 conn(0x7f8170104510 msgr2=0x7f8170104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:04.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 shutdown_connections 2023-12-11T20:06:04.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:03.946+0000 7f8176245700 1 -- 172.21.15.12:0/2176837205 wait complete. 2023-12-11T20:06:04.361 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 9 is available 2023-12-11T20:06:04.361 INFO:teuthology.orchestra.run.smithi012.stdout:Generating a dashboard self-signed certificate... 2023-12-11T20:06:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:04 smithi012 ceph-mon[128787]: [11/Dec/2023:20:06:03] ENGINE Bus STARTING 2023-12-11T20:06:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:04 smithi012 ceph-mon[128787]: [11/Dec/2023:20:06:03] ENGINE Serving on https://172.21.15.12:7150 2023-12-11T20:06:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:04 smithi012 ceph-mon[128787]: [11/Dec/2023:20:06:03] ENGINE Serving on http://172.21.15.12:8765 2023-12-11T20:06:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:04 smithi012 ceph-mon[128787]: [11/Dec/2023:20:06:03] ENGINE Bus STARTED 2023-12-11T20:06:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:04 smithi012 ceph-mon[128787]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-11T20:06:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:04 smithi012 ceph-mon[128787]: mgrmap e11: x(active, since 1.00977s) 2023-12-11T20:06:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:04 smithi012 ceph-mon[128787]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-11T20:06:05.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-11T20:06:05.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.958+0000 7f34b8d40700 1 Processor -- start 2023-12-11T20:06:05.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.958+0000 7f34b8d40700 1 -- start start 2023-12-11T20:06:05.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.959+0000 7f34b8d40700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b41070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:05.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.959+0000 7f34b8d40700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b41076a0 con 0x7f34b4106cb0 2023-12-11T20:06:05.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.959+0000 7f34b259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b41070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.959+0000 7f34b259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b41070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45698/0 (socket says 172.21.15.12:45698) 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.959+0000 7f34b259c700 1 -- 172.21.15.12:0/2259620622 learned_addr learned my addr 172.21.15.12:0/2259620622 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.959+0000 7f34b259c700 1 -- 172.21.15.12:0/2259620622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b4107eb0 con 0x7f34b4106cb0 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.960+0000 7f34b259c700 1 --2- 172.21.15.12:0/2259620622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b41070d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f34a40098a0 tx=0x7f34a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0e32e8802b74fa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.960+0000 7f34b159a700 1 -- 172.21.15.12:0/2259620622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34a4004160 con 0x7f34b4106cb0 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.960+0000 7f34b159a700 1 -- 172.21.15.12:0/2259620622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34a40042c0 con 0x7f34b4106cb0 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.960+0000 7f34b159a700 1 -- 172.21.15.12:0/2259620622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34a40118e0 con 0x7f34b4106cb0 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.961+0000 7f34b8d40700 1 -- 172.21.15.12:0/2259620622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 msgr2=0x7f34b41070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.961+0000 7f34b8d40700 1 --2- 172.21.15.12:0/2259620622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b41070d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f34a40098a0 tx=0x7f34a4009bb0 comp rx=0 tx=0).stop 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.961+0000 7f34b8d40700 1 -- 172.21.15.12:0/2259620622 shutdown_connections 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.961+0000 7f34b8d40700 1 --2- 172.21.15.12:0/2259620622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b41070d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.961+0000 7f34b8d40700 1 -- 172.21.15.12:0/2259620622 >> 172.21.15.12:0/2259620622 conn(0x7f34b4102250 msgr2=0x7f34b4104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.961+0000 7f34b8d40700 1 -- 172.21.15.12:0/2259620622 shutdown_connections 2023-12-11T20:06:05.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.961+0000 7f34b8d40700 1 -- 172.21.15.12:0/2259620622 wait complete. 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.962+0000 7f34b8d40700 1 Processor -- start 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.962+0000 7f34b8d40700 1 -- start start 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.963+0000 7f34b8d40700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.963+0000 7f34b8d40700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b419d170 con 0x7f34b4106cb0 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.963+0000 7f34b259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.963+0000 7f34b259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45704/0 (socket says 172.21.15.12:45704) 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.963+0000 7f34b259c700 1 -- 172.21.15.12:0/1983772727 learned_addr learned my addr 172.21.15.12:0/1983772727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.963+0000 7f34b259c700 1 -- 172.21.15.12:0/1983772727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4009550 con 0x7f34b4106cb0 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.964+0000 7f34b259c700 1 --2- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b419cc30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34a4003f70 tx=0x7f34a40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.964+0000 7f34a37fe700 1 -- 172.21.15.12:0/1983772727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34a40036a0 con 0x7f34b4106cb0 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.964+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b419d370 con 0x7f34b4106cb0 2023-12-11T20:06:05.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.964+0000 7f34a37fe700 1 -- 172.21.15.12:0/1983772727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34a401b440 con 0x7f34b4106cb0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.964+0000 7f34a37fe700 1 -- 172.21.15.12:0/1983772727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34a4023400 con 0x7f34b4106cb0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.964+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b419d810 con 0x7f34b4106cb0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.965+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b410b0e0 con 0x7f34b4106cb0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.966+0000 7f34a37fe700 1 -- 172.21.15.12:0/1983772727 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f34a401b5b0 con 0x7f34b4106cb0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.966+0000 7f34a37fe700 1 --2- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f349c038870 0x7f349c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.966+0000 7f34a37fe700 1 -- 172.21.15.12:0/1983772727 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f34a404cda0 con 0x7f34b4106cb0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.966+0000 7f34b1d9b700 1 --2- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f349c038870 0x7f349c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.967+0000 7f34b1d9b700 1 --2- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f349c038870 0x7f349c03ad30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f34a8006fd0 tx=0x7f34a8006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:04.975+0000 7f34a37fe700 1 -- 172.21.15.12:0/1983772727 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f34a400bc10 con 0x7f34b4106cb0 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.228+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f34b41a0000 con 0x7f349c038870 2023-12-11T20:06:05.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.336+0000 7f34a37fe700 1 -- 172.21.15.12:0/1983772727 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f34b41a0000 con 0x7f349c038870 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.338+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f349c038870 msgr2=0x7f349c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.338+0000 7f34b8d40700 1 --2- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f349c038870 0x7f349c03ad30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f34a8006fd0 tx=0x7f34a8006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.338+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 msgr2=0x7f34b419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.338+0000 7f34b8d40700 1 --2- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b419cc30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34a4003f70 tx=0x7f34a40119a0 comp rx=0 tx=0).stop 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.338+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 shutdown_connections 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.338+0000 7f34b8d40700 1 --2- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f349c038870 0x7f349c03ad30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.338+0000 7f34b8d40700 1 --2- 172.21.15.12:0/1983772727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4106cb0 0x7f34b419cc30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.338+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 >> 172.21.15.12:0/1983772727 conn(0x7f34b4102250 msgr2=0x7f34b4102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.339+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 shutdown_connections 2023-12-11T20:06:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:05.339+0000 7f34b8d40700 1 -- 172.21.15.12:0/1983772727 wait complete. 2023-12-11T20:06:05.743 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial admin user... 2023-12-11T20:06:06.053 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:05 smithi012 ceph-mon[128787]: mgrmap e12: x(active, since 2s) 2023-12-11T20:06:06.053 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:06.054 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:06.054 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:07.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:06 smithi012 ceph-mon[128787]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:06:07.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:06 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:07.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$bwtHwPQFpacHmoKiMUpKaufa61CHV6D1XiAiZ1pKNj4KekRedSpZq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702325166, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.296+0000 7f00b1900700 1 Processor -- start 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.296+0000 7f00b1900700 1 -- start start 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.297+0000 7f00b1900700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac07a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.297+0000 7f00b1900700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac07a750 con 0x7f00ac07bd20 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.297+0000 7f00aaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac07a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.297+0000 7f00aaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac07a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45708/0 (socket says 172.21.15.12:45708) 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.297+0000 7f00aaffd700 1 -- 172.21.15.12:0/2677427994 learned_addr learned my addr 172.21.15.12:0/2677427994 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.297+0000 7f00aaffd700 1 -- 172.21.15.12:0/2677427994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac07a890 con 0x7f00ac07bd20 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.298+0000 7f00aaffd700 1 --2- 172.21.15.12:0/2677427994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac07a180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f009c0098a0 tx=0x7f009c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b39a8ba40044e1e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.298+0000 7f00a9ffb700 1 -- 172.21.15.12:0/2677427994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009c004160 con 0x7f00ac07bd20 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.298+0000 7f00a9ffb700 1 -- 172.21.15.12:0/2677427994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f009c0042c0 con 0x7f00ac07bd20 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.298+0000 7f00a9ffb700 1 -- 172.21.15.12:0/2677427994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009c0118e0 con 0x7f00ac07bd20 2023-12-11T20:06:07.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.298+0000 7f00b1900700 1 -- 172.21.15.12:0/2677427994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 msgr2=0x7f00ac07a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.298+0000 7f00b1900700 1 --2- 172.21.15.12:0/2677427994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac07a180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f009c0098a0 tx=0x7f009c009bb0 comp rx=0 tx=0).stop 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.299+0000 7f00b1900700 1 -- 172.21.15.12:0/2677427994 shutdown_connections 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.299+0000 7f00b1900700 1 --2- 172.21.15.12:0/2677427994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac07a180 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.299+0000 7f00b1900700 1 -- 172.21.15.12:0/2677427994 >> 172.21.15.12:0/2677427994 conn(0x7f00ac102250 msgr2=0x7f00ac104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.299+0000 7f00b1900700 1 -- 172.21.15.12:0/2677427994 shutdown_connections 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.299+0000 7f00b1900700 1 -- 172.21.15.12:0/2677427994 wait complete. 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.300+0000 7f00b1900700 1 Processor -- start 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.300+0000 7f00b1900700 1 -- start start 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.300+0000 7f00b1900700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.300+0000 7f00b1900700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac19d0e0 con 0x7f00ac07bd20 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.300+0000 7f00aaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.300+0000 7f00aaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac19cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45724/0 (socket says 172.21.15.12:45724) 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.300+0000 7f00aaffd700 1 -- 172.21.15.12:0/1034865898 learned_addr learned my addr 172.21.15.12:0/1034865898 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.301+0000 7f00aaffd700 1 -- 172.21.15.12:0/1034865898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c009550 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.301+0000 7f00aaffd700 1 --2- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac19cba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f009c003f70 tx=0x7f009c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.301+0000 7f00b08fe700 1 -- 172.21.15.12:0/1034865898 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009c0036a0 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.301+0000 7f00b08fe700 1 -- 172.21.15.12:0/1034865898 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f009c01b440 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.301+0000 7f00b08fe700 1 -- 172.21.15.12:0/1034865898 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009c023400 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.301+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ac19d2e0 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.301+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ac19d780 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.302+0000 7f00b08fe700 1 -- 172.21.15.12:0/1034865898 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f009c01b5b0 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.302+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ac10d070 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.303+0000 7f00b08fe700 1 --2- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00940388c0 0x7f009403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.303+0000 7f00b08fe700 1 -- 172.21.15.12:0/1034865898 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f009c04c880 con 0x7f00ac07bd20 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.303+0000 7f00aa7fc700 1 --2- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00940388c0 0x7f009403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.304+0000 7f00aa7fc700 1 --2- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00940388c0 0x7f009403ad80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00a0006fd0 tx=0x7f00a0006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.308+0000 7f00b08fe700 1 -- 172.21.15.12:0/1034865898 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f009c00be40 con 0x7f00ac07bd20 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.537+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f00ac062a20 con 0x7f00940388c0 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.784+0000 7f00b08fe700 1 -- 172.21.15.12:0/1034865898 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f00ac062a20 con 0x7f00940388c0 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.786+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00940388c0 msgr2=0x7f009403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.786+0000 7f00b1900700 1 --2- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00940388c0 0x7f009403ad80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00a0006fd0 tx=0x7f00a0006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.786+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 msgr2=0x7f00ac19cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.786+0000 7f00b1900700 1 --2- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac19cba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f009c003f70 tx=0x7f009c0119a0 comp rx=0 tx=0).stop 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.786+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 shutdown_connections 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.786+0000 7f00b1900700 1 --2- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00940388c0 0x7f009403ad80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.786+0000 7f00b1900700 1 --2- 172.21.15.12:0/1034865898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00ac07bd20 0x7f00ac19cba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.786+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 >> 172.21.15.12:0/1034865898 conn(0x7f00ac102250 msgr2=0x7f00ac102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.787+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 shutdown_connections 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:06.787+0000 7f00b1900700 1 -- 172.21.15.12:0/1034865898 wait complete. 2023-12-11T20:06:07.235 INFO:teuthology.orchestra.run.smithi012.stdout:Fetching dashboard port number... 2023-12-11T20:06:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:07 smithi012 ceph-mon[128787]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:06:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:08.615 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 8443 2023-12-11T20:06:08.616 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.756+0000 7f5844fd4700 1 Processor -- start 2023-12-11T20:06:08.616 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.756+0000 7f5844fd4700 1 -- start start 2023-12-11T20:06:08.616 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.756+0000 7f5844fd4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f58401070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:08.616 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.756+0000 7f5844fd4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58401076a0 con 0x7f5840106cb0 2023-12-11T20:06:08.616 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.757+0000 7f583e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f58401070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:08.617 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.757+0000 7f583e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f58401070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45726/0 (socket says 172.21.15.12:45726) 2023-12-11T20:06:08.617 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.757+0000 7f583e59c700 1 -- 172.21.15.12:0/463252776 learned_addr learned my addr 172.21.15.12:0/463252776 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:08.617 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.757+0000 7f583e59c700 1 -- 172.21.15.12:0/463252776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840107eb0 con 0x7f5840106cb0 2023-12-11T20:06:08.617 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.757+0000 7f583e59c700 1 --2- 172.21.15.12:0/463252776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f58401070d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58300098a0 tx=0x7f5830009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a173bd57e55b3497 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:08.617 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f583d59a700 1 -- 172.21.15.12:0/463252776 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5830004160 con 0x7f5840106cb0 2023-12-11T20:06:08.617 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f583d59a700 1 -- 172.21.15.12:0/463252776 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58300042c0 con 0x7f5840106cb0 2023-12-11T20:06:08.617 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f583d59a700 1 -- 172.21.15.12:0/463252776 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58300118e0 con 0x7f5840106cb0 2023-12-11T20:06:08.618 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f5844fd4700 1 -- 172.21.15.12:0/463252776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 msgr2=0x7f58401070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:08.618 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f5844fd4700 1 --2- 172.21.15.12:0/463252776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f58401070d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58300098a0 tx=0x7f5830009bb0 comp rx=0 tx=0).stop 2023-12-11T20:06:08.618 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f5844fd4700 1 -- 172.21.15.12:0/463252776 shutdown_connections 2023-12-11T20:06:08.619 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f5844fd4700 1 --2- 172.21.15.12:0/463252776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f58401070d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:08.619 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f5844fd4700 1 -- 172.21.15.12:0/463252776 >> 172.21.15.12:0/463252776 conn(0x7f5840102250 msgr2=0x7f5840104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:08.619 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.758+0000 7f5844fd4700 1 -- 172.21.15.12:0/463252776 shutdown_connections 2023-12-11T20:06:08.619 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.759+0000 7f5844fd4700 1 -- 172.21.15.12:0/463252776 wait complete. 2023-12-11T20:06:08.619 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.759+0000 7f5844fd4700 1 Processor -- start 2023-12-11T20:06:08.619 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.760+0000 7f5844fd4700 1 -- start start 2023-12-11T20:06:08.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.760+0000 7f5844fd4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f584019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:08.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.760+0000 7f5844fd4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584019aee0 con 0x7f5840106cb0 2023-12-11T20:06:08.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.760+0000 7f583e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f584019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:08.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.760+0000 7f583e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f584019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45730/0 (socket says 172.21.15.12:45730) 2023-12-11T20:06:08.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.760+0000 7f583e59c700 1 -- 172.21.15.12:0/1194028642 learned_addr learned my addr 172.21.15.12:0/1194028642 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:08.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.760+0000 7f583e59c700 1 -- 172.21.15.12:0/1194028642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830009550 con 0x7f5840106cb0 2023-12-11T20:06:08.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.761+0000 7f583e59c700 1 --2- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f584019a9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5830003f70 tx=0x7f58300119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:08.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.761+0000 7f582f7fe700 1 -- 172.21.15.12:0/1194028642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58300036a0 con 0x7f5840106cb0 2023-12-11T20:06:08.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.761+0000 7f582f7fe700 1 -- 172.21.15.12:0/1194028642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f583001b440 con 0x7f5840106cb0 2023-12-11T20:06:08.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.761+0000 7f582f7fe700 1 -- 172.21.15.12:0/1194028642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5830023400 con 0x7f5840106cb0 2023-12-11T20:06:08.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.761+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584019b0e0 con 0x7f5840106cb0 2023-12-11T20:06:08.622 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.761+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584019b580 con 0x7f5840106cb0 2023-12-11T20:06:08.622 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.762+0000 7f582f7fe700 1 -- 172.21.15.12:0/1194028642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f583001b5b0 con 0x7f5840106cb0 2023-12-11T20:06:08.624 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.762+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584010b0e0 con 0x7f5840106cb0 2023-12-11T20:06:08.624 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.763+0000 7f582f7fe700 1 --2- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58280388c0 0x7f582803ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.763+0000 7f582f7fe700 1 -- 172.21.15.12:0/1194028642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f583004c920 con 0x7f5840106cb0 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.763+0000 7f583dd9b700 1 --2- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58280388c0 0x7f582803ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.763+0000 7f583dd9b700 1 --2- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58280388c0 0x7f582803ad80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5834006fd0 tx=0x7f5834006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.768+0000 7f582f7fe700 1 -- 172.21.15.12:0/1194028642 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f583000be40 con 0x7f5840106cb0 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:07.998+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f584019de70 con 0x7f5840106cb0 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.000+0000 7f582f7fe700 1 -- 172.21.15.12:0/1194028642 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f583000b3e0 con 0x7f5840106cb0 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.003+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58280388c0 msgr2=0x7f582803ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.003+0000 7f5844fd4700 1 --2- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58280388c0 0x7f582803ad80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5834006fd0 tx=0x7f5834006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.003+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 msgr2=0x7f584019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.003+0000 7f5844fd4700 1 --2- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f584019a9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5830003f70 tx=0x7f58300119a0 comp rx=0 tx=0).stop 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.004+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 shutdown_connections 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.004+0000 7f5844fd4700 1 --2- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58280388c0 0x7f582803ad80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.004+0000 7f5844fd4700 1 --2- 172.21.15.12:0/1194028642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5840106cb0 0x7f584019a9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.004+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 >> 172.21.15.12:0/1194028642 conn(0x7f5840102250 msgr2=0x7f5840102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:08.626 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.004+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 shutdown_connections 2023-12-11T20:06:08.626 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:08.004+0000 7f5844fd4700 1 -- 172.21.15.12:0/1194028642 wait complete. 2023-12-11T20:06:08.638 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-11T20:06:08.638 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2023-12-11T20:06:08.664 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-11T20:06:08.665 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2023-12-11T20:06:08.665 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2023-12-11T20:06:08.665 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-11T20:06:08.667 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph Dashboard is now available at: 2023-12-11T20:06:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: URL: https://smithi012.front.sepia.ceph.com:8443/ 2023-12-11T20:06:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: User: admin 2023-12-11T20:06:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: Password: zseujae3wb 2023-12-11T20:06:08.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:08.668 INFO:teuthology.orchestra.run.smithi012.stdout:Saving cluster configuration to /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config directory 2023-12-11T20:06:08.669 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling autotune for osd_memory_target 2023-12-11T20:06:09.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:08 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1194028642' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-11T20:06:10.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:10 smithi012 ceph-mon[128787]: mgrmap e13: x(active, since 6s) 2023-12-11T20:06:10.357 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.654+0000 7ff78b811700 1 Processor -- start 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.654+0000 7ff78b811700 1 -- start start 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.655+0000 7ff78b811700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78407a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.655+0000 7ff78b811700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78407a710 con 0x7ff78407bce0 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.655+0000 7ff7895ad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78407a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.655+0000 7ff7895ad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78407a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59724/0 (socket says 172.21.15.12:59724) 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.655+0000 7ff7895ad700 1 -- 172.21.15.12:0/1702104987 learned_addr learned my addr 172.21.15.12:0/1702104987 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.656+0000 7ff7895ad700 1 -- 172.21.15.12:0/1702104987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78407a850 con 0x7ff78407bce0 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.656+0000 7ff7895ad700 1 --2- 172.21.15.12:0/1702104987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78407a140 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7800098a0 tx=0x7ff780009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39afad6b92b4c92 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.656+0000 7ff77bfff700 1 -- 172.21.15.12:0/1702104987 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff780004160 con 0x7ff78407bce0 2023-12-11T20:06:10.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.656+0000 7ff77bfff700 1 -- 172.21.15.12:0/1702104987 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7800042c0 con 0x7ff78407bce0 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.656+0000 7ff77bfff700 1 -- 172.21.15.12:0/1702104987 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7800118e0 con 0x7ff78407bce0 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.657+0000 7ff78b811700 1 -- 172.21.15.12:0/1702104987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 msgr2=0x7ff78407a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.657+0000 7ff78b811700 1 --2- 172.21.15.12:0/1702104987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78407a140 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7800098a0 tx=0x7ff780009bb0 comp rx=0 tx=0).stop 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.657+0000 7ff78b811700 1 -- 172.21.15.12:0/1702104987 shutdown_connections 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.657+0000 7ff78b811700 1 --2- 172.21.15.12:0/1702104987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78407a140 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.657+0000 7ff78b811700 1 -- 172.21.15.12:0/1702104987 >> 172.21.15.12:0/1702104987 conn(0x7ff784102250 msgr2=0x7ff784104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.657+0000 7ff78b811700 1 -- 172.21.15.12:0/1702104987 shutdown_connections 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.657+0000 7ff78b811700 1 -- 172.21.15.12:0/1702104987 wait complete. 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.658+0000 7ff78b811700 1 Processor -- start 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.658+0000 7ff78b811700 1 -- start start 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.658+0000 7ff78b811700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.659+0000 7ff78b811700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78419d090 con 0x7ff78407bce0 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.659+0000 7ff7895ad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.659+0000 7ff7895ad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78419cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59732/0 (socket says 172.21.15.12:59732) 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.659+0000 7ff7895ad700 1 -- 172.21.15.12:0/717004490 learned_addr learned my addr 172.21.15.12:0/717004490 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.659+0000 7ff7895ad700 1 -- 172.21.15.12:0/717004490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780009550 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.659+0000 7ff7895ad700 1 --2- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78419cb50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff780003f70 tx=0x7ff7800119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.660+0000 7ff77a7fc700 1 -- 172.21.15.12:0/717004490 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7800036a0 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.660+0000 7ff77a7fc700 1 -- 172.21.15.12:0/717004490 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff78001b440 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.660+0000 7ff77a7fc700 1 -- 172.21.15.12:0/717004490 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff780023400 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.660+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78419d290 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.660+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78419d730 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.661+0000 7ff77a7fc700 1 -- 172.21.15.12:0/717004490 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7ff78001b5b0 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.661+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78410d050 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.661+0000 7ff77a7fc700 1 --2- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff770038960 0x7ff77003ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.661+0000 7ff77a7fc700 1 -- 172.21.15.12:0/717004490 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff78004ca20 con 0x7ff78407bce0 2023-12-11T20:06:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.661+0000 7ff788dac700 1 --2- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff770038960 0x7ff77003ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.662+0000 7ff788dac700 1 --2- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff770038960 0x7ff77003ae20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff774006fd0 tx=0x7ff774006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.667+0000 7ff77a7fc700 1 -- 172.21.15.12:0/717004490 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff780019c30 con 0x7ff78407bce0 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.877+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff78410d290 con 0x7ff78407bce0 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.877+0000 7ff77a7fc700 1 -- 172.21.15.12:0/717004490 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff780019840 con 0x7ff78407bce0 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff770038960 msgr2=0x7ff77003ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 --2- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff770038960 0x7ff77003ae20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff774006fd0 tx=0x7ff774006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 msgr2=0x7ff78419cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 --2- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78419cb50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff780003f70 tx=0x7ff7800119a0 comp rx=0 tx=0).stop 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 shutdown_connections 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 --2- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff770038960 0x7ff77003ae20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 --2- 172.21.15.12:0/717004490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff78407bce0 0x7ff78419cb50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 >> 172.21.15.12:0/717004490 conn(0x7ff784102250 msgr2=0x7ff784102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 shutdown_connections 2023-12-11T20:06:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:09.880+0000 7ff78b811700 1 -- 172.21.15.12:0/717004490 wait complete. 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.855+0000 7f71098d2700 1 Processor -- start 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.855+0000 7f71098d2700 1 -- start start 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.855+0000 7f71098d2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710407a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.855+0000 7f71098d2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710407a750 con 0x7f710407bd20 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.856+0000 7f7102ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710407a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.856+0000 7f7102ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710407a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59740/0 (socket says 172.21.15.12:59740) 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.856+0000 7f7102ffd700 1 -- 172.21.15.12:0/4069211949 learned_addr learned my addr 172.21.15.12:0/4069211949 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.856+0000 7f7102ffd700 1 -- 172.21.15.12:0/4069211949 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710407a890 con 0x7f710407bd20 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.856+0000 7f7102ffd700 1 --2- 172.21.15.12:0/4069211949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710407a180 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70f40098a0 tx=0x7f70f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32460edbe1db9676 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f7101ffb700 1 -- 172.21.15.12:0/4069211949 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70f4004160 con 0x7f710407bd20 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f7101ffb700 1 -- 172.21.15.12:0/4069211949 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70f40042c0 con 0x7f710407bd20 2023-12-11T20:06:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f7101ffb700 1 -- 172.21.15.12:0/4069211949 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70f40118e0 con 0x7f710407bd20 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f71098d2700 1 -- 172.21.15.12:0/4069211949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 msgr2=0x7f710407a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f71098d2700 1 --2- 172.21.15.12:0/4069211949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710407a180 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70f40098a0 tx=0x7f70f4009bb0 comp rx=0 tx=0).stop 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f71098d2700 1 -- 172.21.15.12:0/4069211949 shutdown_connections 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f71098d2700 1 --2- 172.21.15.12:0/4069211949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710407a180 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f71098d2700 1 -- 172.21.15.12:0/4069211949 >> 172.21.15.12:0/4069211949 conn(0x7f7104102250 msgr2=0x7f7104104690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f71098d2700 1 -- 172.21.15.12:0/4069211949 shutdown_connections 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.857+0000 7f71098d2700 1 -- 172.21.15.12:0/4069211949 wait complete. 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.858+0000 7f71098d2700 1 Processor -- start 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.859+0000 7f71098d2700 1 -- start start 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.859+0000 7f71098d2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.859+0000 7f71098d2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710419d100 con 0x7f710407bd20 2023-12-11T20:06:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.859+0000 7f7102ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.859+0000 7f7102ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710419cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59748/0 (socket says 172.21.15.12:59748) 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.859+0000 7f7102ffd700 1 -- 172.21.15.12:0/4112467960 learned_addr learned my addr 172.21.15.12:0/4112467960 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.859+0000 7f7102ffd700 1 -- 172.21.15.12:0/4112467960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4009550 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.860+0000 7f7102ffd700 1 --2- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710419cbc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f70f4003f70 tx=0x7f70f40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.860+0000 7f71088d0700 1 -- 172.21.15.12:0/4112467960 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70f40036a0 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.860+0000 7f71088d0700 1 -- 172.21.15.12:0/4112467960 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70f401b440 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.860+0000 7f71088d0700 1 -- 172.21.15.12:0/4112467960 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70f4023400 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.860+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710419d300 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.860+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710419d7a0 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.861+0000 7f71088d0700 1 -- 172.21.15.12:0/4112467960 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f70f401b5b0 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.861+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710410d070 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.862+0000 7f71088d0700 1 --2- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec038910 0x7f70ec03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.862+0000 7f71088d0700 1 -- 172.21.15.12:0/4112467960 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f70f404c9a0 con 0x7f710407bd20 2023-12-11T20:06:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.862+0000 7f71027fc700 1 --2- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec038910 0x7f70ec03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.863+0000 7f71027fc700 1 --2- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec038910 0x7f70ec03add0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f70f8006fd0 tx=0x7f70f8006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:10.867+0000 7f71088d0700 1 -- 172.21.15.12:0/4112467960 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f70f400bc10 con 0x7f710407bd20 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.194+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f710419ffe0 con 0x7f710407bd20 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.197+0000 7f71088d0700 1 -- 172.21.15.12:0/4112467960 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) v1 ==== 153+0+0 (secure 0 0 0) 0x7f70f400b3e0 con 0x7f710407bd20 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec038910 msgr2=0x7f70ec03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 --2- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec038910 0x7f70ec03add0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f70f8006fd0 tx=0x7f70f8006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 msgr2=0x7f710419cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 --2- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710419cbc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f70f4003f70 tx=0x7f70f40119a0 comp rx=0 tx=0).stop 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 shutdown_connections 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 --2- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec038910 0x7f70ec03add0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 --2- 172.21.15.12:0/4112467960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f710407bd20 0x7f710419cbc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 >> 172.21.15.12:0/4112467960 conn(0x7f7104102250 msgr2=0x7f7104102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 shutdown_connections 2023-12-11T20:06:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2023-12-11T20:06:11.199+0000 7f71098d2700 1 -- 172.21.15.12:0/4112467960 wait complete. 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout:Or, if you are only running a single cluster on this host: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: ceph telemetry on 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout:For more information see: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-12-11T20:06:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:11.649 INFO:teuthology.orchestra.run.smithi012.stdout:Bootstrap complete. 2023-12-11T20:06:11.706 INFO:tasks.cephadm:Fetching config... 2023-12-11T20:06:11.707 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:06:11.707 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-11T20:06:11.750 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-11T20:06:11.750 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:06:11.750 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-11T20:06:11.834 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-11T20:06:11.835 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:06:11.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/keyring of=/dev/stdout 2023-12-11T20:06:11.948 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-11T20:06:11.948 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:06:11.948 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-11T20:06:12.035 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-11T20:06:12.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmDUZkXbWAtnMqFlCdfqAsGzab6IDuRXIb96GbRV8nP4HNoMi5UWosNGyKlzhH3a1qfP3Ty0QETNJ2wRX2I+KcwCybYxG6ePr0YSFmoQOI2c9MkV/ykoaV1u78Yt5RThD4rqQy1IPHbH2tFYaajkHGPIfei0NXv62+GsCnLI3GusWQeyIZ00u3/KNlcEbFMQ1Lmeh2A5FgIeY1zjJIVcoDtxbGO02GuCO8TZ8VvutVHEB5NnHkiORRMmV6K9J6XzzGIn2BvOiyTZWxb9r16pE03eGf0Hlebx7G6fcbwhFj9gcWBa4U8Kg0GlvRzokP3HFmvjDUOJvQ7YjLNuhU58oKxAYDV7hs9Fic+bsnODpLrmQOOgli+tN4wFA83jdMFfnG1X5Efatb/J8Cmsbg0RbxIqKxda+PimnPAMGzaB16kfr4usMZs9EKUVzXw2rrBguOZU0ojddDPmK3D/j1gfD2Ftsfj3fBqwSODTNd3vUL7FzQuVcfpCNtpJ9wB1KyoU8= ceph-732461f0-9860-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-11T20:06:12.178 INFO:teuthology.orchestra.run.smithi012.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmDUZkXbWAtnMqFlCdfqAsGzab6IDuRXIb96GbRV8nP4HNoMi5UWosNGyKlzhH3a1qfP3Ty0QETNJ2wRX2I+KcwCybYxG6ePr0YSFmoQOI2c9MkV/ykoaV1u78Yt5RThD4rqQy1IPHbH2tFYaajkHGPIfei0NXv62+GsCnLI3GusWQeyIZ00u3/KNlcEbFMQ1Lmeh2A5FgIeY1zjJIVcoDtxbGO02GuCO8TZ8VvutVHEB5NnHkiORRMmV6K9J6XzzGIn2BvOiyTZWxb9r16pE03eGf0Hlebx7G6fcbwhFj9gcWBa4U8Kg0GlvRzokP3HFmvjDUOJvQ7YjLNuhU58oKxAYDV7hs9Fic+bsnODpLrmQOOgli+tN4wFA83jdMFfnG1X5Efatb/J8Cmsbg0RbxIqKxda+PimnPAMGzaB16kfr4usMZs9EKUVzXw2rrBguOZU0ojddDPmK3D/j1gfD2Ftsfj3fBqwSODTNd3vUL7FzQuVcfpCNtpJ9wB1KyoU8= ceph-732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:06:12.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmDUZkXbWAtnMqFlCdfqAsGzab6IDuRXIb96GbRV8nP4HNoMi5UWosNGyKlzhH3a1qfP3Ty0QETNJ2wRX2I+KcwCybYxG6ePr0YSFmoQOI2c9MkV/ykoaV1u78Yt5RThD4rqQy1IPHbH2tFYaajkHGPIfei0NXv62+GsCnLI3GusWQeyIZ00u3/KNlcEbFMQ1Lmeh2A5FgIeY1zjJIVcoDtxbGO02GuCO8TZ8VvutVHEB5NnHkiORRMmV6K9J6XzzGIn2BvOiyTZWxb9r16pE03eGf0Hlebx7G6fcbwhFj9gcWBa4U8Kg0GlvRzokP3HFmvjDUOJvQ7YjLNuhU58oKxAYDV7hs9Fic+bsnODpLrmQOOgli+tN4wFA83jdMFfnG1X5Efatb/J8Cmsbg0RbxIqKxda+PimnPAMGzaB16kfr4usMZs9EKUVzXw2rrBguOZU0ojddDPmK3D/j1gfD2Ftsfj3fBqwSODTNd3vUL7FzQuVcfpCNtpJ9wB1KyoU8= ceph-732461f0-9860-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-11T20:06:12.317 INFO:teuthology.orchestra.run.smithi032.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmDUZkXbWAtnMqFlCdfqAsGzab6IDuRXIb96GbRV8nP4HNoMi5UWosNGyKlzhH3a1qfP3Ty0QETNJ2wRX2I+KcwCybYxG6ePr0YSFmoQOI2c9MkV/ykoaV1u78Yt5RThD4rqQy1IPHbH2tFYaajkHGPIfei0NXv62+GsCnLI3GusWQeyIZ00u3/KNlcEbFMQ1Lmeh2A5FgIeY1zjJIVcoDtxbGO02GuCO8TZ8VvutVHEB5NnHkiORRMmV6K9J6XzzGIn2BvOiyTZWxb9r16pE03eGf0Hlebx7G6fcbwhFj9gcWBa4U8Kg0GlvRzokP3HFmvjDUOJvQ7YjLNuhU58oKxAYDV7hs9Fic+bsnODpLrmQOOgli+tN4wFA83jdMFfnG1X5Efatb/J8Cmsbg0RbxIqKxda+PimnPAMGzaB16kfr4usMZs9EKUVzXw2rrBguOZU0ojddDPmK3D/j1gfD2Ftsfj3fBqwSODTNd3vUL7FzQuVcfpCNtpJ9wB1KyoU8= ceph-732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:06:12.348 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmDUZkXbWAtnMqFlCdfqAsGzab6IDuRXIb96GbRV8nP4HNoMi5UWosNGyKlzhH3a1qfP3Ty0QETNJ2wRX2I+KcwCybYxG6ePr0YSFmoQOI2c9MkV/ykoaV1u78Yt5RThD4rqQy1IPHbH2tFYaajkHGPIfei0NXv62+GsCnLI3GusWQeyIZ00u3/KNlcEbFMQ1Lmeh2A5FgIeY1zjJIVcoDtxbGO02GuCO8TZ8VvutVHEB5NnHkiORRMmV6K9J6XzzGIn2BvOiyTZWxb9r16pE03eGf0Hlebx7G6fcbwhFj9gcWBa4U8Kg0GlvRzokP3HFmvjDUOJvQ7YjLNuhU58oKxAYDV7hs9Fic+bsnODpLrmQOOgli+tN4wFA83jdMFfnG1X5Efatb/J8Cmsbg0RbxIqKxda+PimnPAMGzaB16kfr4usMZs9EKUVzXw2rrBguOZU0ojddDPmK3D/j1gfD2Ftsfj3fBqwSODTNd3vUL7FzQuVcfpCNtpJ9wB1KyoU8= ceph-732461f0-9860-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-11T20:06:12.454 INFO:teuthology.orchestra.run.smithi039.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmDUZkXbWAtnMqFlCdfqAsGzab6IDuRXIb96GbRV8nP4HNoMi5UWosNGyKlzhH3a1qfP3Ty0QETNJ2wRX2I+KcwCybYxG6ePr0YSFmoQOI2c9MkV/ykoaV1u78Yt5RThD4rqQy1IPHbH2tFYaajkHGPIfei0NXv62+GsCnLI3GusWQeyIZ00u3/KNlcEbFMQ1Lmeh2A5FgIeY1zjJIVcoDtxbGO02GuCO8TZ8VvutVHEB5NnHkiORRMmV6K9J6XzzGIn2BvOiyTZWxb9r16pE03eGf0Hlebx7G6fcbwhFj9gcWBa4U8Kg0GlvRzokP3HFmvjDUOJvQ7YjLNuhU58oKxAYDV7hs9Fic+bsnODpLrmQOOgli+tN4wFA83jdMFfnG1X5Efatb/J8Cmsbg0RbxIqKxda+PimnPAMGzaB16kfr4usMZs9EKUVzXw2rrBguOZU0ojddDPmK3D/j1gfD2Ftsfj3fBqwSODTNd3vUL7FzQuVcfpCNtpJ9wB1KyoU8= ceph-732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:06:12.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-11T20:06:12.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:12 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4112467960' entity='client.admin' 2023-12-11T20:06:13.297 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:06:15.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.118+0000 7f0d5490d700 1 -- 172.21.15.12:0/3065934779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 msgr2=0x7f0d50101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:15.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.118+0000 7f0d5490d700 1 --2- 172.21.15.12:0/3065934779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 0x7f0d50101340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009910 tx=0x7f0d40009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:15.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.118+0000 7f0d5490d700 1 -- 172.21.15.12:0/3065934779 shutdown_connections 2023-12-11T20:06:15.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.118+0000 7f0d5490d700 1 --2- 172.21.15.12:0/3065934779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 0x7f0d50101340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:15.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.118+0000 7f0d5490d700 1 -- 172.21.15.12:0/3065934779 >> 172.21.15.12:0/3065934779 conn(0x7f0d500fc4f0 msgr2=0x7f0d500fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:15.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.118+0000 7f0d5490d700 1 -- 172.21.15.12:0/3065934779 shutdown_connections 2023-12-11T20:06:15.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.118+0000 7f0d5490d700 1 -- 172.21.15.12:0/3065934779 wait complete. 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.119+0000 7f0d5490d700 1 Processor -- start 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.119+0000 7f0d5490d700 1 -- start start 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.119+0000 7f0d5490d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 0x7f0d501962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.119+0000 7f0d5490d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d501967e0 con 0x7f0d50100f00 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.120+0000 7f0d4e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 0x7f0d501962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.120+0000 7f0d4e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 0x7f0d501962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59762/0 (socket says 172.21.15.12:59762) 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.120+0000 7f0d4e59c700 1 -- 172.21.15.12:0/2059865832 learned_addr learned my addr 172.21.15.12:0/2059865832 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.120+0000 7f0d4e59c700 1 -- 172.21.15.12:0/2059865832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400095f0 con 0x7f0d50100f00 2023-12-11T20:06:15.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.120+0000 7f0d4e59c700 1 --2- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 0x7f0d501962a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d400098e0 tx=0x7f0d40005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.120+0000 7f0d3f7fe700 1 -- 172.21.15.12:0/2059865832 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d4000ba90 con 0x7f0d50100f00 2023-12-11T20:06:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.121+0000 7f0d3f7fe700 1 -- 172.21.15.12:0/2059865832 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d4000bbf0 con 0x7f0d50100f00 2023-12-11T20:06:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.121+0000 7f0d3f7fe700 1 -- 172.21.15.12:0/2059865832 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d4000fe70 con 0x7f0d50100f00 2023-12-11T20:06:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.121+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d50196a40 con 0x7f0d50100f00 2023-12-11T20:06:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.121+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d50199710 con 0x7f0d50100f00 2023-12-11T20:06:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.122+0000 7f0d3f7fe700 1 -- 172.21.15.12:0/2059865832 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f0d4000f460 con 0x7f0d50100f00 2023-12-11T20:06:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.122+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5018fa20 con 0x7f0d50100f00 2023-12-11T20:06:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.122+0000 7f0d3f7fe700 1 --2- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d38038910 0x7f0d3803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.122+0000 7f0d3f7fe700 1 -- 172.21.15.12:0/2059865832 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0d4004ca80 con 0x7f0d50100f00 2023-12-11T20:06:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.122+0000 7f0d4dd9b700 1 --2- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d38038910 0x7f0d3803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.123+0000 7f0d4dd9b700 1 --2- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d38038910 0x7f0d3803add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0d44006fd0 tx=0x7f0d44006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:15.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.128+0000 7f0d3f7fe700 1 -- 172.21.15.12:0/2059865832 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0d4002ad30 con 0x7f0d50100f00 2023-12-11T20:06:15.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.337+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f0d50106d00 con 0x7f0d50100f00 2023-12-11T20:06:15.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.340+0000 7f0d3f7fe700 1 -- 172.21.15.12:0/2059865832 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0d40027030 con 0x7f0d50100f00 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d38038910 msgr2=0x7f0d3803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 --2- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d38038910 0x7f0d3803add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0d44006fd0 tx=0x7f0d44006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 msgr2=0x7f0d501962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 --2- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 0x7f0d501962a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d400098e0 tx=0x7f0d40005810 comp rx=0 tx=0).stop 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 shutdown_connections 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 --2- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d38038910 0x7f0d3803add0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 --2- 172.21.15.12:0/2059865832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d50100f00 0x7f0d501962a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 >> 172.21.15.12:0/2059865832 conn(0x7f0d500fc4f0 msgr2=0x7f0d500fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 shutdown_connections 2023-12-11T20:06:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:15.343+0000 7f0d5490d700 1 -- 172.21.15.12:0/2059865832 wait complete. 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi012", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2059865832' entity='client.admin' 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:15.901 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-11T20:06:15.902 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-11T20:06:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:06:18.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.059+0000 7ff900c06700 1 -- 172.21.15.12:0/3339838421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 msgr2=0x7ff8fc101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.059+0000 7ff900c06700 1 --2- 172.21.15.12:0/3339838421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 0x7ff8fc101340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009910 tx=0x7ff8ec009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.059+0000 7ff900c06700 1 -- 172.21.15.12:0/3339838421 shutdown_connections 2023-12-11T20:06:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.059+0000 7ff900c06700 1 --2- 172.21.15.12:0/3339838421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 0x7ff8fc101340 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.059+0000 7ff900c06700 1 -- 172.21.15.12:0/3339838421 >> 172.21.15.12:0/3339838421 conn(0x7ff8fc0fc4f0 msgr2=0x7ff8fc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.059+0000 7ff900c06700 1 -- 172.21.15.12:0/3339838421 shutdown_connections 2023-12-11T20:06:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.059+0000 7ff900c06700 1 -- 172.21.15.12:0/3339838421 wait complete. 2023-12-11T20:06:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.060+0000 7ff900c06700 1 Processor -- start 2023-12-11T20:06:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.060+0000 7ff900c06700 1 -- start start 2023-12-11T20:06:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.061+0000 7ff900c06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 0x7ff8fc1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.061+0000 7ff900c06700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc198a00 con 0x7ff8fc100f00 2023-12-11T20:06:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.061+0000 7ff8fa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 0x7ff8fc1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.061+0000 7ff8fa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 0x7ff8fc1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59778/0 (socket says 172.21.15.12:59778) 2023-12-11T20:06:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.061+0000 7ff8fa59c700 1 -- 172.21.15.12:0/3962056214 learned_addr learned my addr 172.21.15.12:0/3962056214 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.061+0000 7ff8fa59c700 1 -- 172.21.15.12:0/3962056214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0095f0 con 0x7ff8fc100f00 2023-12-11T20:06:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.062+0000 7ff8fa59c700 1 --2- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 0x7ff8fc1984c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0098e0 tx=0x7ff8ec005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.062+0000 7ff8eb7fe700 1 -- 172.21.15.12:0/3962056214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8ec00ba90 con 0x7ff8fc100f00 2023-12-11T20:06:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.062+0000 7ff8eb7fe700 1 -- 172.21.15.12:0/3962056214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8ec00bbf0 con 0x7ff8fc100f00 2023-12-11T20:06:18.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.062+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc198c60 con 0x7ff8fc100f00 2023-12-11T20:06:18.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.062+0000 7ff8eb7fe700 1 -- 172.21.15.12:0/3962056214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8ec00fe70 con 0x7ff8fc100f00 2023-12-11T20:06:18.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.062+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc19b930 con 0x7ff8fc100f00 2023-12-11T20:06:18.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.063+0000 7ff8eb7fe700 1 -- 172.21.15.12:0/3962056214 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7ff8ec00f460 con 0x7ff8fc100f00 2023-12-11T20:06:18.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.063+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc191e20 con 0x7ff8fc100f00 2023-12-11T20:06:18.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.063+0000 7ff8eb7fe700 1 --2- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff8e4038910 0x7ff8e403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:18.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.064+0000 7ff8eb7fe700 1 -- 172.21.15.12:0/3962056214 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff8ec04ca00 con 0x7ff8fc100f00 2023-12-11T20:06:18.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.064+0000 7ff8f9d9b700 1 --2- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff8e4038910 0x7ff8e403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:18.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.064+0000 7ff8f9d9b700 1 --2- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff8e4038910 0x7ff8e403add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0006fd0 tx=0x7ff8f0006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:18.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.069+0000 7ff8eb7fe700 1 -- 172.21.15.12:0/3962056214 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff8ec02ad30 con 0x7ff8fc100f00 2023-12-11T20:06:18.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.283+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8fc061a10 con 0x7ff8e4038910 2023-12-11T20:06:18.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.289+0000 7ff8eb7fe700 1 -- 172.21.15.12:0/3962056214 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff8fc061a10 con 0x7ff8e4038910 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff8e4038910 msgr2=0x7ff8e403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 --2- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff8e4038910 0x7ff8e403add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0006fd0 tx=0x7ff8f0006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 msgr2=0x7ff8fc1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 --2- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 0x7ff8fc1984c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0098e0 tx=0x7ff8ec005810 comp rx=0 tx=0).stop 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 shutdown_connections 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 --2- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff8e4038910 0x7ff8e403add0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 --2- 172.21.15.12:0/3962056214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8fc100f00 0x7ff8fc1984c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 >> 172.21.15.12:0/3962056214 conn(0x7ff8fc0fc4f0 msgr2=0x7ff8fc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 shutdown_connections 2023-12-11T20:06:18.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:18.292+0000 7ff900c06700 1 -- 172.21.15.12:0/3962056214 wait complete. 2023-12-11T20:06:18.680 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi032 2023-12-11T20:06:18.680 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:06:18.680 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/etc/ceph/ceph.conf 2023-12-11T20:06:18.728 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:06:18.729 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:06:18.814 INFO:tasks.cephadm:Adding host smithi032 to orchestrator... 2023-12-11T20:06:18.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch host add smithi032 2023-12-11T20:06:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:19 smithi012 ceph-mon[128787]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:06:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:06:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:19 smithi012 ceph-mon[128787]: Updating smithi012:/etc/ceph/ceph.conf 2023-12-11T20:06:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:19 smithi012 ceph-mon[128787]: Updating smithi012:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:06:19.619 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:06:20.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:20 smithi012 ceph-mon[128787]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:06:20.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:20 smithi012 ceph-mon[128787]: Updating smithi012:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-11T20:06:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.191+0000 7fb8d9912700 1 -- 172.21.15.12:0/4276261754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 msgr2=0x7fb8d4101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.191+0000 7fb8d9912700 1 --2- 172.21.15.12:0/4276261754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 0x7fb8d4101520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009910 tx=0x7fb8c4009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.191+0000 7fb8d9912700 1 -- 172.21.15.12:0/4276261754 shutdown_connections 2023-12-11T20:06:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.191+0000 7fb8d9912700 1 --2- 172.21.15.12:0/4276261754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 0x7fb8d4101520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.191+0000 7fb8d9912700 1 -- 172.21.15.12:0/4276261754 >> 172.21.15.12:0/4276261754 conn(0x7fb8d40fc9d0 msgr2=0x7fb8d40fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.191+0000 7fb8d9912700 1 -- 172.21.15.12:0/4276261754 shutdown_connections 2023-12-11T20:06:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.191+0000 7fb8d9912700 1 -- 172.21.15.12:0/4276261754 wait complete. 2023-12-11T20:06:21.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.192+0000 7fb8d9912700 1 Processor -- start 2023-12-11T20:06:21.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.192+0000 7fb8d9912700 1 -- start start 2023-12-11T20:06:21.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.192+0000 7fb8d9912700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 0x7fb8d419e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:21.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.192+0000 7fb8d9912700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d419eb90 con 0x7fb8d4101140 2023-12-11T20:06:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.193+0000 7fb8d2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 0x7fb8d419e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.193+0000 7fb8d2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 0x7fb8d419e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35938/0 (socket says 172.21.15.12:35938) 2023-12-11T20:06:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.193+0000 7fb8d2ffd700 1 -- 172.21.15.12:0/2859981720 learned_addr learned my addr 172.21.15.12:0/2859981720 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.193+0000 7fb8d2ffd700 1 -- 172.21.15.12:0/2859981720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40095f0 con 0x7fb8d4101140 2023-12-11T20:06:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.193+0000 7fb8d2ffd700 1 --2- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 0x7fb8d419e650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40098e0 tx=0x7fb8c4005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.193+0000 7fb8d8910700 1 -- 172.21.15.12:0/2859981720 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8c401d070 con 0x7fb8d4101140 2023-12-11T20:06:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.194+0000 7fb8d8910700 1 -- 172.21.15.12:0/2859981720 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8c4009e60 con 0x7fb8d4101140 2023-12-11T20:06:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.194+0000 7fb8d8910700 1 -- 172.21.15.12:0/2859981720 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8c4022b30 con 0x7fb8d4101140 2023-12-11T20:06:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.194+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d419ed30 con 0x7fb8d4101140 2023-12-11T20:06:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.194+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d419f150 con 0x7fb8d4101140 2023-12-11T20:06:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.195+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d4102620 con 0x7fb8d4101140 2023-12-11T20:06:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.195+0000 7fb8d8910700 1 -- 172.21.15.12:0/2859981720 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7fb8c4022470 con 0x7fb8d4101140 2023-12-11T20:06:21.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.195+0000 7fb8d8910700 1 --2- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8bc038910 0x7fb8bc03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:21.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.195+0000 7fb8d8910700 1 -- 172.21.15.12:0/2859981720 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb8c404cdf0 con 0x7fb8d4101140 2023-12-11T20:06:21.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.196+0000 7fb8d27fc700 1 --2- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8bc038910 0x7fb8bc03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:21.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.196+0000 7fb8d27fc700 1 --2- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8bc038910 0x7fb8bc03add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8006fd0 tx=0x7fb8c8006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.200+0000 7fb8d8910700 1 -- 172.21.15.12:0/2859981720 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb8c402ba00 con 0x7fb8d4101140 2023-12-11T20:06:21.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:21.417+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi032", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8d410b0e0 con 0x7fb8bc038910 2023-12-11T20:06:21.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:21 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:21.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:21 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:21.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:21 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:22.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:22 smithi012 ceph-mon[128787]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi032", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:06:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:23 smithi012 ceph-mon[128787]: Deploying cephadm binary to smithi032 2023-12-11T20:06:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:23 smithi012 ceph-mon[128787]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:26.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:25 smithi012 ceph-mon[128787]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:26.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.391+0000 7fb8d8910700 1 -- 172.21.15.12:0/2859981720 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fb8d410b0e0 con 0x7fb8bc038910 2023-12-11T20:06:26.391 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi032' with addr '172.21.15.32' 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8bc038910 msgr2=0x7fb8bc03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 --2- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8bc038910 0x7fb8bc03add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8006fd0 tx=0x7fb8c8006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 msgr2=0x7fb8d419e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 --2- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 0x7fb8d419e650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40098e0 tx=0x7fb8c4005710 comp rx=0 tx=0).stop 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 shutdown_connections 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 --2- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8bc038910 0x7fb8bc03add0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 --2- 172.21.15.12:0/2859981720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d4101140 0x7fb8d419e650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 >> 172.21.15.12:0/2859981720 conn(0x7fb8d40fc9d0 msgr2=0x7fb8d4102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 shutdown_connections 2023-12-11T20:06:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:26.395+0000 7fb8d9912700 1 -- 172.21.15.12:0/2859981720 wait complete. 2023-12-11T20:06:26.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch host ls --format=json 2023-12-11T20:06:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:06:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:27 smithi012 ceph-mon[128787]: Added host smithi032 2023-12-11T20:06:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:27 smithi012 ceph-mon[128787]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.005+0000 7ff3c6b15700 1 -- 172.21.15.12:0/1029201641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 msgr2=0x7ff3c0101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.005+0000 7ff3c6b15700 1 --2- 172.21.15.12:0/1029201641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 0x7ff3c0101520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009910 tx=0x7ff3b4009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.005+0000 7ff3c6b15700 1 -- 172.21.15.12:0/1029201641 shutdown_connections 2023-12-11T20:06:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.005+0000 7ff3c6b15700 1 --2- 172.21.15.12:0/1029201641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 0x7ff3c0101520 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.005+0000 7ff3c6b15700 1 -- 172.21.15.12:0/1029201641 >> 172.21.15.12:0/1029201641 conn(0x7ff3c00fc9d0 msgr2=0x7ff3c00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.005+0000 7ff3c6b15700 1 -- 172.21.15.12:0/1029201641 shutdown_connections 2023-12-11T20:06:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.005+0000 7ff3c6b15700 1 -- 172.21.15.12:0/1029201641 wait complete. 2023-12-11T20:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.006+0000 7ff3c6b15700 1 Processor -- start 2023-12-11T20:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.007+0000 7ff3c6b15700 1 -- start start 2023-12-11T20:06:29.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.007+0000 7ff3c6b15700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 0x7ff3c019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:29.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.007+0000 7ff3c6b15700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c019eb70 con 0x7ff3c0101140 2023-12-11T20:06:29.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.007+0000 7ff3c48b1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 0x7ff3c019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:29.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.007+0000 7ff3c48b1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 0x7ff3c019e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36736/0 (socket says 172.21.15.12:36736) 2023-12-11T20:06:29.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.007+0000 7ff3c48b1700 1 -- 172.21.15.12:0/3906353795 learned_addr learned my addr 172.21.15.12:0/3906353795 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:29.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.008+0000 7ff3c48b1700 1 -- 172.21.15.12:0/3906353795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b40095f0 con 0x7ff3c0101140 2023-12-11T20:06:29.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.008+0000 7ff3c48b1700 1 --2- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 0x7ff3c019e630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40098e0 tx=0x7ff3b4005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.008+0000 7ff3bdffb700 1 -- 172.21.15.12:0/3906353795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b401d070 con 0x7ff3c0101140 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.008+0000 7ff3bdffb700 1 -- 172.21.15.12:0/3906353795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3b4009e60 con 0x7ff3c0101140 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.008+0000 7ff3bdffb700 1 -- 172.21.15.12:0/3906353795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b4022b30 con 0x7ff3c0101140 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.008+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c019ed70 con 0x7ff3c0101140 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.008+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c019f190 con 0x7ff3c0101140 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.009+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c0102620 con 0x7ff3c0101140 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.009+0000 7ff3bdffb700 1 -- 172.21.15.12:0/3906353795 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7ff3b4022470 con 0x7ff3c0101140 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.010+0000 7ff3bdffb700 1 --2- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3b00388c0 0x7ff3b003ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.010+0000 7ff3bdffb700 1 -- 172.21.15.12:0/3906353795 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff3b404cdf0 con 0x7ff3c0101140 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.010+0000 7ff3bffff700 1 --2- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3b00388c0 0x7ff3b003ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:29.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.011+0000 7ff3bffff700 1 --2- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3b00388c0 0x7ff3b003ad80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac006fd0 tx=0x7ff3ac006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:29.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.015+0000 7ff3bdffb700 1 -- 172.21.15.12:0/3906353795 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff3b402ba00 con 0x7ff3c0101140 2023-12-11T20:06:29.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:29.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.233+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3c010b0e0 con 0x7ff3b00388c0 2023-12-11T20:06:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.235+0000 7ff3bdffb700 1 -- 172.21.15.12:0/3906353795 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7ff3c010b0e0 con 0x7ff3b00388c0 2023-12-11T20:06:29.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:29.234 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.32", "hostname": "smithi032", "labels": [], "status": ""}] 2023-12-11T20:06:29.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3b00388c0 msgr2=0x7ff3b003ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:29.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 --2- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3b00388c0 0x7ff3b003ad80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac006fd0 tx=0x7ff3ac006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:29.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 msgr2=0x7ff3c019e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:29.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 --2- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 0x7ff3c019e630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40098e0 tx=0x7ff3b4005710 comp rx=0 tx=0).stop 2023-12-11T20:06:29.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 shutdown_connections 2023-12-11T20:06:29.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 --2- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3b00388c0 0x7ff3b003ad80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:29.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 --2- 172.21.15.12:0/3906353795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3c0101140 0x7ff3c019e630 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:29.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 >> 172.21.15.12:0/3906353795 conn(0x7ff3c00fc9d0 msgr2=0x7ff3c0073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:29.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 shutdown_connections 2023-12-11T20:06:29.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:29.237+0000 7ff3c6b15700 1 -- 172.21.15.12:0/3906353795 wait complete. 2023-12-11T20:06:29.699 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi039 2023-12-11T20:06:29.700 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:06:29.700 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/etc/ceph/ceph.conf 2023-12-11T20:06:29.748 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:06:29.748 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:06:29.834 INFO:tasks.cephadm:Adding host smithi039 to orchestrator... 2023-12-11T20:06:29.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch host add smithi039 2023-12-11T20:06:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:29 smithi012 ceph-mon[128787]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:30.617 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:06:31.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:30 smithi012 ceph-mon[128787]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:06:32.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.080+0000 7f2637083700 1 -- 172.21.15.12:0/1838552885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 msgr2=0x7f2630101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:32.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.080+0000 7f2637083700 1 --2- 172.21.15.12:0/1838552885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 0x7f2630101520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2624009910 tx=0x7f2624009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:32.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.080+0000 7f2637083700 1 -- 172.21.15.12:0/1838552885 shutdown_connections 2023-12-11T20:06:32.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.080+0000 7f2637083700 1 --2- 172.21.15.12:0/1838552885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 0x7f2630101520 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:32.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.080+0000 7f2637083700 1 -- 172.21.15.12:0/1838552885 >> 172.21.15.12:0/1838552885 conn(0x7f26300fc9d0 msgr2=0x7f26300fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:32.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.080+0000 7f2637083700 1 -- 172.21.15.12:0/1838552885 shutdown_connections 2023-12-11T20:06:32.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.080+0000 7f2637083700 1 -- 172.21.15.12:0/1838552885 wait complete. 2023-12-11T20:06:32.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.081+0000 7f2637083700 1 Processor -- start 2023-12-11T20:06:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.081+0000 7f2637083700 1 -- start start 2023-12-11T20:06:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.082+0000 7f2637083700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 0x7f263019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.082+0000 7f2637083700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263019ec10 con 0x7f2630101140 2023-12-11T20:06:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.082+0000 7f2634e1f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 0x7f263019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.082+0000 7f2634e1f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 0x7f263019e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36760/0 (socket says 172.21.15.12:36760) 2023-12-11T20:06:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.082+0000 7f2634e1f700 1 -- 172.21.15.12:0/997631486 learned_addr learned my addr 172.21.15.12:0/997631486 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.082+0000 7f2634e1f700 1 -- 172.21.15.12:0/997631486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240095f0 con 0x7f2630101140 2023-12-11T20:06:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.082+0000 7f2634e1f700 1 --2- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 0x7f263019e6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f26240098e0 tx=0x7f2624005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.083+0000 7f262dffb700 1 -- 172.21.15.12:0/997631486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f262401d070 con 0x7f2630101140 2023-12-11T20:06:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.083+0000 7f262dffb700 1 -- 172.21.15.12:0/997631486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2624009e60 con 0x7f2630101140 2023-12-11T20:06:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.083+0000 7f262dffb700 1 -- 172.21.15.12:0/997631486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2624022b30 con 0x7f2630101140 2023-12-11T20:06:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.083+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263019edb0 con 0x7f2630101140 2023-12-11T20:06:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.083+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263019f1d0 con 0x7f2630101140 2023-12-11T20:06:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.084+0000 7f262dffb700 1 -- 172.21.15.12:0/997631486 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f2624022470 con 0x7f2630101140 2023-12-11T20:06:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.084+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2630102620 con 0x7f2630101140 2023-12-11T20:06:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.084+0000 7f262dffb700 1 --2- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2620038910 0x7f262003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.084+0000 7f262dffb700 1 -- 172.21.15.12:0/997631486 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f262404cdf0 con 0x7f2630101140 2023-12-11T20:06:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.085+0000 7f262ffff700 1 --2- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2620038910 0x7f262003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.085+0000 7f262ffff700 1 --2- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2620038910 0x7f262003add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f261c006fd0 tx=0x7f261c006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:32.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.089+0000 7f262dffb700 1 -- 172.21.15.12:0/997631486 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f262402ba00 con 0x7f2630101140 2023-12-11T20:06:32.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:32.300+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi039", "target": ["mon-mgr", ""]}) v1 -- 0x7f263010b0e0 con 0x7f2620038910 2023-12-11T20:06:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:31 smithi012 ceph-mon[128787]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi039", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi032", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:06:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:34 smithi012 ceph-mon[128787]: Deploying cephadm binary to smithi039 2023-12-11T20:06:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:34 smithi012 ceph-mon[128787]: Updating smithi032:/etc/ceph/ceph.conf 2023-12-11T20:06:36.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:35 smithi012 ceph-mon[128787]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.246+0000 7f262dffb700 1 -- 172.21.15.12:0/997631486 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f263010b0e0 con 0x7f2620038910 2023-12-11T20:06:37.245 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi039' with addr '172.21.15.39' 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2620038910 msgr2=0x7f262003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 --2- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2620038910 0x7f262003add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f261c006fd0 tx=0x7f261c006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 msgr2=0x7f263019e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 --2- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 0x7f263019e6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f26240098e0 tx=0x7f2624005710 comp rx=0 tx=0).stop 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 shutdown_connections 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 --2- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2620038910 0x7f262003add0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 --2- 172.21.15.12:0/997631486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2630101140 0x7f263019e6d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 >> 172.21.15.12:0/997631486 conn(0x7f26300fc9d0 msgr2=0x7f2630104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 shutdown_connections 2023-12-11T20:06:37.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:37.249+0000 7f2637083700 1 -- 172.21.15.12:0/997631486 wait complete. 2023-12-11T20:06:37.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch host ls --format=json 2023-12-11T20:06:38.306 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:06:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:37 smithi012 ceph-mon[128787]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:06:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:37 smithi012 ceph-mon[128787]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:06:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:37 smithi012 ceph-mon[128787]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:38 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:38 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:39.242 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:39 smithi012 ceph-mon[128787]: Added host smithi039 2023-12-11T20:06:39.243 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:39 smithi012 ceph-mon[128787]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-11T20:06:39.243 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:39.243 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:39.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.893+0000 7f5576703700 1 -- 172.21.15.12:0/3671504395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 msgr2=0x7f5570073d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.893+0000 7f5576703700 1 --2- 172.21.15.12:0/3671504395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 0x7f5570073d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5560009910 tx=0x7f5560009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.893+0000 7f5576703700 1 -- 172.21.15.12:0/3671504395 shutdown_connections 2023-12-11T20:06:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.893+0000 7f5576703700 1 --2- 172.21.15.12:0/3671504395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 0x7f5570073d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.893+0000 7f5576703700 1 -- 172.21.15.12:0/3671504395 >> 172.21.15.12:0/3671504395 conn(0x7f55700fc9d0 msgr2=0x7f55700fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.894+0000 7f5576703700 1 -- 172.21.15.12:0/3671504395 shutdown_connections 2023-12-11T20:06:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.894+0000 7f5576703700 1 -- 172.21.15.12:0/3671504395 wait complete. 2023-12-11T20:06:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.895+0000 7f5576703700 1 Processor -- start 2023-12-11T20:06:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.895+0000 7f5576703700 1 -- start start 2023-12-11T20:06:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.895+0000 7f5576703700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 0x7f55701a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.895+0000 7f5576703700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55701a2ec0 con 0x7f5570073970 2023-12-11T20:06:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.895+0000 7f556ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 0x7f55701a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.895+0000 7f556ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 0x7f55701a2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36706/0 (socket says 172.21.15.12:36706) 2023-12-11T20:06:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.895+0000 7f556ffff700 1 -- 172.21.15.12:0/2271263701 learned_addr learned my addr 172.21.15.12:0/2271263701 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.896+0000 7f556ffff700 1 -- 172.21.15.12:0/2271263701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600095f0 con 0x7f5570073970 2023-12-11T20:06:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.896+0000 7f556ffff700 1 --2- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 0x7f55701a2980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55600098e0 tx=0x7f5560005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.896+0000 7f556d7fa700 1 -- 172.21.15.12:0/2271263701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f556001d070 con 0x7f5570073970 2023-12-11T20:06:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.896+0000 7f556d7fa700 1 -- 172.21.15.12:0/2271263701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5560009e60 con 0x7f5570073970 2023-12-11T20:06:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.896+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55701a3120 con 0x7f5570073970 2023-12-11T20:06:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.896+0000 7f556d7fa700 1 -- 172.21.15.12:0/2271263701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5560022c10 con 0x7f5570073970 2023-12-11T20:06:39.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.896+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557019cac0 con 0x7f5570073970 2023-12-11T20:06:39.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.897+0000 7f556d7fa700 1 -- 172.21.15.12:0/2271263701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f5560022470 con 0x7f5570073970 2023-12-11T20:06:39.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.897+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55700750b0 con 0x7f5570073970 2023-12-11T20:06:39.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.898+0000 7f556d7fa700 1 --2- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5558038910 0x7f555803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:39.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.898+0000 7f556d7fa700 1 -- 172.21.15.12:0/2271263701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f556004cb20 con 0x7f5570073970 2023-12-11T20:06:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.898+0000 7f556f7fe700 1 --2- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5558038910 0x7f555803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.899+0000 7f556f7fe700 1 --2- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5558038910 0x7f555803add0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5564006fd0 tx=0x7f5564006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:39.903+0000 7f556d7fa700 1 -- 172.21.15.12:0/2271263701 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f556002b590 con 0x7f5570073970 2023-12-11T20:06:40.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.120+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f557019dff0 con 0x7f5558038910 2023-12-11T20:06:40.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.122+0000 7f556d7fa700 1 -- 172.21.15.12:0/2271263701 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f557019dff0 con 0x7f5558038910 2023-12-11T20:06:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:06:40.121 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.32", "hostname": "smithi032", "labels": [], "status": ""}, {"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}] 2023-12-11T20:06:40.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5558038910 msgr2=0x7f555803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:40.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 --2- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5558038910 0x7f555803add0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5564006fd0 tx=0x7f5564006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:40.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 msgr2=0x7f55701a2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:40.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 --2- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 0x7f55701a2980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55600098e0 tx=0x7f5560005710 comp rx=0 tx=0).stop 2023-12-11T20:06:40.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 shutdown_connections 2023-12-11T20:06:40.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 --2- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5558038910 0x7f555803add0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:40.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 --2- 172.21.15.12:0/2271263701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5570073970 0x7f55701a2980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:40.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 >> 172.21.15.12:0/2271263701 conn(0x7f55700fc9d0 msgr2=0x7f55700fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:40.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 shutdown_connections 2023-12-11T20:06:40.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:40.124+0000 7f5576703700 1 -- 172.21.15.12:0/2271263701 wait complete. 2023-12-11T20:06:40.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:40 smithi012 ceph-mon[128787]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:40.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:40.596 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-11T20:06:40.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd crush tunables default 2023-12-11T20:06:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:06:42.186 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:42 smithi012 ceph-mon[128787]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:06:42.187 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:42 smithi012 ceph-mon[128787]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:42.187 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.769+0000 7f2b4528e700 1 -- 172.21.15.12:0/2264374628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 msgr2=0x7f2b40101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.769+0000 7f2b4528e700 1 --2- 172.21.15.12:0/2264374628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 0x7f2b40101520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009910 tx=0x7f2b30009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.769+0000 7f2b4528e700 1 -- 172.21.15.12:0/2264374628 shutdown_connections 2023-12-11T20:06:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.769+0000 7f2b4528e700 1 --2- 172.21.15.12:0/2264374628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 0x7f2b40101520 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.769+0000 7f2b4528e700 1 -- 172.21.15.12:0/2264374628 >> 172.21.15.12:0/2264374628 conn(0x7f2b400fc9d0 msgr2=0x7f2b400fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.770+0000 7f2b4528e700 1 -- 172.21.15.12:0/2264374628 shutdown_connections 2023-12-11T20:06:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.770+0000 7f2b4528e700 1 -- 172.21.15.12:0/2264374628 wait complete. 2023-12-11T20:06:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.770+0000 7f2b4528e700 1 Processor -- start 2023-12-11T20:06:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.771+0000 7f2b4528e700 1 -- start start 2023-12-11T20:06:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.771+0000 7f2b4528e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 0x7f2b4019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.771+0000 7f2b4528e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4019eb90 con 0x7f2b40101140 2023-12-11T20:06:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.771+0000 7f2b3effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 0x7f2b4019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.771+0000 7f2b3effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 0x7f2b4019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36716/0 (socket says 172.21.15.12:36716) 2023-12-11T20:06:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.771+0000 7f2b3effd700 1 -- 172.21.15.12:0/56089440 learned_addr learned my addr 172.21.15.12:0/56089440 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:06:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.772+0000 7f2b3effd700 1 -- 172.21.15.12:0/56089440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300095f0 con 0x7f2b40101140 2023-12-11T20:06:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.772+0000 7f2b3effd700 1 --2- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 0x7f2b4019e650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b300098e0 tx=0x7f2b30005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.772+0000 7f2b27fff700 1 -- 172.21.15.12:0/56089440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b3001d070 con 0x7f2b40101140 2023-12-11T20:06:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.772+0000 7f2b27fff700 1 -- 172.21.15.12:0/56089440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b30009e60 con 0x7f2b40101140 2023-12-11T20:06:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.772+0000 7f2b27fff700 1 -- 172.21.15.12:0/56089440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b30022b30 con 0x7f2b40101140 2023-12-11T20:06:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.772+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4019ed30 con 0x7f2b40101140 2023-12-11T20:06:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.772+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4019f150 con 0x7f2b40101140 2023-12-11T20:06:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.773+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b40102620 con 0x7f2b40101140 2023-12-11T20:06:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.773+0000 7f2b27fff700 1 -- 172.21.15.12:0/56089440 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f2b30022470 con 0x7f2b40101140 2023-12-11T20:06:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.774+0000 7f2b27fff700 1 --2- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b28038910 0x7f2b2803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:42.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.774+0000 7f2b27fff700 1 -- 172.21.15.12:0/56089440 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2b3004cbf0 con 0x7f2b40101140 2023-12-11T20:06:42.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.774+0000 7f2b3e7fc700 1 --2- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b28038910 0x7f2b2803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:42.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.775+0000 7f2b3e7fc700 1 --2- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b28038910 0x7f2b2803add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b34006fd0 tx=0x7f2b34006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:42.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.779+0000 7f2b27fff700 1 -- 172.21.15.12:0/56089440 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2b3002bdf0 con 0x7f2b40101140 2023-12-11T20:06:42.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:42.994+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2b40062c00 con 0x7f2b40101140 2023-12-11T20:06:43.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.907+0000 7f2b27fff700 1 -- 172.21.15.12:0/56089440 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2b30027070 con 0x7f2b40101140 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.910+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b28038910 msgr2=0x7f2b2803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.910+0000 7f2b4528e700 1 --2- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b28038910 0x7f2b2803add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b34006fd0 tx=0x7f2b34006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.910+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 msgr2=0x7f2b4019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.910+0000 7f2b4528e700 1 --2- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 0x7f2b4019e650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b300098e0 tx=0x7f2b30005710 comp rx=0 tx=0).stop 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.911+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 shutdown_connections 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.911+0000 7f2b4528e700 1 --2- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b28038910 0x7f2b2803add0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.911+0000 7f2b4528e700 1 --2- 172.21.15.12:0/56089440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40101140 0x7f2b4019e650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.911+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 >> 172.21.15.12:0/56089440 conn(0x7f2b400fc9d0 msgr2=0x7f2b40102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.911+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 shutdown_connections 2023-12-11T20:06:43.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:06:43.911+0000 7f2b4528e700 1 -- 172.21.15.12:0/56089440 wait complete. 2023-12-11T20:06:43.911 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2023-12-11T20:06:44.159 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:43 smithi012 ceph-mon[128787]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:44.159 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:43 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/56089440' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-11T20:06:44.382 INFO:tasks.cephadm:Adding mon.a on smithi012 2023-12-11T20:06:44.383 INFO:tasks.cephadm:Adding mon.b on smithi032 2023-12-11T20:06:44.383 INFO:tasks.cephadm:Adding mon.c on smithi039 2023-12-11T20:06:44.383 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch apply mon '3;smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c' 2023-12-11T20:06:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:44 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/56089440' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-11T20:06:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:44 smithi012 ceph-mon[128787]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:06:45.355 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-11T20:06:45.708 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-11T20:06:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:45 smithi012 ceph-mon[128787]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi039", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:06:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:06:47.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.234+0000 7f6087718700 1 -- 172.21.15.39:0/2614172658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 msgr2=0x7f6080107360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.234+0000 7f6087718700 1 --2- 172.21.15.39:0/2614172658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 0x7f6080107360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f607c009910 tx=0x7f607c009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.234+0000 7f6087718700 1 -- 172.21.15.39:0/2614172658 shutdown_connections 2023-12-11T20:06:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.234+0000 7f6087718700 1 --2- 172.21.15.39:0/2614172658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 0x7f6080107360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.234+0000 7f6087718700 1 -- 172.21.15.39:0/2614172658 >> 172.21.15.39:0/2614172658 conn(0x7f6080075930 msgr2=0x7f6080075d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.234+0000 7f6087718700 1 -- 172.21.15.39:0/2614172658 shutdown_connections 2023-12-11T20:06:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.234+0000 7f6087718700 1 -- 172.21.15.39:0/2614172658 wait complete. 2023-12-11T20:06:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.236+0000 7f6087718700 1 Processor -- start 2023-12-11T20:06:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.236+0000 7f6087718700 1 -- start start 2023-12-11T20:06:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.236+0000 7f6087718700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 0x7f60800fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.236+0000 7f6087718700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6080101e10 con 0x7f6080106f80 2023-12-11T20:06:47.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.237+0000 7f60854b4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 0x7f60800fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:47.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.237+0000 7f60854b4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 0x7f60800fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.39:35014/0 (socket says 172.21.15.39:35014) 2023-12-11T20:06:47.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.237+0000 7f60854b4700 1 -- 172.21.15.39:0/2646342284 learned_addr learned my addr 172.21.15.39:0/2646342284 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:06:47.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.237+0000 7f60854b4700 1 -- 172.21.15.39:0/2646342284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0095f0 con 0x7f6080106f80 2023-12-11T20:06:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.238+0000 7f60854b4700 1 --2- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 0x7f60800fff00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f607c0098e0 tx=0x7f607c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.238+0000 7f60767fc700 1 -- 172.21.15.39:0/2646342284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f607c01d070 con 0x7f6080106f80 2023-12-11T20:06:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.238+0000 7f60767fc700 1 -- 172.21.15.39:0/2646342284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f607c009e60 con 0x7f6080106f80 2023-12-11T20:06:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.238+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6080100440 con 0x7f6080106f80 2023-12-11T20:06:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.238+0000 7f60767fc700 1 -- 172.21.15.39:0/2646342284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f607c022b30 con 0x7f6080106f80 2023-12-11T20:06:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.238+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60801008c0 con 0x7f6080106f80 2023-12-11T20:06:47.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.239+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6080102630 con 0x7f6080106f80 2023-12-11T20:06:47.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.240+0000 7f60767fc700 1 -- 172.21.15.39:0/2646342284 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f607c022470 con 0x7f6080106f80 2023-12-11T20:06:47.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.240+0000 7f60767fc700 1 --2- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f606c038910 0x7f606c03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:47.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.240+0000 7f60767fc700 1 -- 172.21.15.39:0/2646342284 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f607c04cdf0 con 0x7f6080106f80 2023-12-11T20:06:47.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.241+0000 7f6084cb3700 1 --2- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f606c038910 0x7f606c03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:47.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.241+0000 7f6084cb3700 1 --2- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f606c038910 0x7f606c03add0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6070006fd0 tx=0x7f6070006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:47.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.246+0000 7f60767fc700 1 -- 172.21.15.39:0/2646342284 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f607c02ba00 con 0x7f6080106f80 2023-12-11T20:06:47.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:46 smithi012 ceph-mon[128787]: Updating smithi039:/etc/ceph/ceph.conf 2023-12-11T20:06:47.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:46 smithi012 ceph-mon[128787]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:06:47.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.490+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f6080100c20 con 0x7f606c038910 2023-12-11T20:06:47.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.498+0000 7f60767fc700 1 -- 172.21.15.39:0/2646342284 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6080100c20 con 0x7f606c038910 2023-12-11T20:06:47.496 INFO:teuthology.orchestra.run.smithi039.stdout:Scheduled mon update... 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f606c038910 msgr2=0x7f606c03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 --2- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f606c038910 0x7f606c03add0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6070006fd0 tx=0x7f6070006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 msgr2=0x7f60800fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 --2- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 0x7f60800fff00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f607c0098e0 tx=0x7f607c005710 comp rx=0 tx=0).stop 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 shutdown_connections 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 --2- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f606c038910 0x7f606c03add0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 --2- 172.21.15.39:0/2646342284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080106f80 0x7f60800fff00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 >> 172.21.15.39:0/2646342284 conn(0x7f6080075930 msgr2=0x7f60800fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 shutdown_connections 2023-12-11T20:06:47.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:47.500+0000 7f6087718700 1 -- 172.21.15.39:0/2646342284 wait complete. 2023-12-11T20:06:48.014 DEBUG:teuthology.orchestra.run.smithi032:mon.b> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.b.service 2023-12-11T20:06:48.019 DEBUG:teuthology.orchestra.run.smithi039:mon.c> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.c.service 2023-12-11T20:06:48.023 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-11T20:06:48.023 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-11T20:06:48.094 INFO:journalctl@ceph.mon.c.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:06:48.098 INFO:journalctl@ceph.mon.b.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:06:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:06:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-11T20:06:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:48.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:48.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:48.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:48.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:48.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:48.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:06:48.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:06:48.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:48.845 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:06:49.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:48 smithi012 ceph-mon[128787]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:06:49.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:48 smithi012 ceph-mon[128787]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c;count:3 2023-12-11T20:06:49.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:48 smithi012 ceph-mon[128787]: Reconfiguring mon.a (unknown last config time)... 2023-12-11T20:06:49.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:48 smithi012 ceph-mon[128787]: Reconfiguring daemon mon.a on smithi012 2023-12-11T20:06:50.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.316+0000 7f4ad5dab700 1 -- 172.21.15.39:0/2010341184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 msgr2=0x7f4ad0101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:50.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.316+0000 7f4ad5dab700 1 --2- 172.21.15.39:0/2010341184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 0x7f4ad0101520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009910 tx=0x7f4ac0009c20 comp rx=0 tx=0).stop 2023-12-11T20:06:50.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.316+0000 7f4ad5dab700 1 -- 172.21.15.39:0/2010341184 shutdown_connections 2023-12-11T20:06:50.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.316+0000 7f4ad5dab700 1 --2- 172.21.15.39:0/2010341184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 0x7f4ad0101520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:50.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.316+0000 7f4ad5dab700 1 -- 172.21.15.39:0/2010341184 >> 172.21.15.39:0/2010341184 conn(0x7f4ad00fc9d0 msgr2=0x7f4ad00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:50.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.316+0000 7f4ad5dab700 1 -- 172.21.15.39:0/2010341184 shutdown_connections 2023-12-11T20:06:50.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.316+0000 7f4ad5dab700 1 -- 172.21.15.39:0/2010341184 wait complete. 2023-12-11T20:06:50.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.317+0000 7f4ad5dab700 1 Processor -- start 2023-12-11T20:06:50.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.318+0000 7f4ad5dab700 1 -- start start 2023-12-11T20:06:50.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.318+0000 7f4ad5dab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 0x7f4ad019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:50.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.318+0000 7f4ad5dab700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad019eb90 con 0x7f4ad0101140 2023-12-11T20:06:50.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.319+0000 7f4acf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 0x7f4ad019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:50.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.319+0000 7f4acf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 0x7f4ad019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.39:36430/0 (socket says 172.21.15.39:36430) 2023-12-11T20:06:50.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.319+0000 7f4acf7fe700 1 -- 172.21.15.39:0/3798957248 learned_addr learned my addr 172.21.15.39:0/3798957248 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:06:50.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.319+0000 7f4acf7fe700 1 -- 172.21.15.39:0/3798957248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00095f0 con 0x7f4ad0101140 2023-12-11T20:06:50.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.319+0000 7f4acf7fe700 1 --2- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 0x7f4ad019e650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00098e0 tx=0x7f4ac0005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:50.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.319+0000 7f4accff9700 1 -- 172.21.15.39:0/3798957248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac001d070 con 0x7f4ad0101140 2023-12-11T20:06:50.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.319+0000 7f4accff9700 1 -- 172.21.15.39:0/3798957248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ac0009e60 con 0x7f4ad0101140 2023-12-11T20:06:50.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.319+0000 7f4accff9700 1 -- 172.21.15.39:0/3798957248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0022b30 con 0x7f4ad0101140 2023-12-11T20:06:50.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.320+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad019ed30 con 0x7f4ad0101140 2023-12-11T20:06:50.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.320+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad019f150 con 0x7f4ad0101140 2023-12-11T20:06:50.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.321+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad0102620 con 0x7f4ad0101140 2023-12-11T20:06:50.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.321+0000 7f4accff9700 1 -- 172.21.15.39:0/3798957248 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f4ac0022470 con 0x7f4ad0101140 2023-12-11T20:06:50.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.321+0000 7f4accff9700 1 --2- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ab8038910 0x7f4ab803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:06:50.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.321+0000 7f4accff9700 1 -- 172.21.15.39:0/3798957248 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4ac004cdf0 con 0x7f4ad0101140 2023-12-11T20:06:50.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.321+0000 7f4aceffd700 1 --2- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ab8038910 0x7f4ab803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:06:50.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.322+0000 7f4aceffd700 1 --2- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ab8038910 0x7f4ab803add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006fd0 tx=0x7f4ac4006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:06:50.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.327+0000 7f4accff9700 1 -- 172.21.15.39:0/3798957248 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4ac002ba00 con 0x7f4ad0101140 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:06:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:50.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.633+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4ad0062c00 con 0x7f4ad0101140 2023-12-11T20:06:50.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.634+0000 7f4accff9700 1 -- 172.21.15.39:0/3798957248 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f4ac0027020 con 0x7f4ad0101140 2023-12-11T20:06:50.633 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:06:50.633 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":1,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","modified":"2023-12-11T20:04:57.917964Z","created":"2023-12-11T20:04:57.917964Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-11T20:06:50.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.636+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ab8038910 msgr2=0x7f4ab803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:50.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.636+0000 7f4ad5dab700 1 --2- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ab8038910 0x7f4ab803add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006fd0 tx=0x7f4ac4006e40 comp rx=0 tx=0).stop 2023-12-11T20:06:50.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.637+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 msgr2=0x7f4ad019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:06:50.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.637+0000 7f4ad5dab700 1 --2- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 0x7f4ad019e650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00098e0 tx=0x7f4ac0005710 comp rx=0 tx=0).stop 2023-12-11T20:06:50.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.637+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 shutdown_connections 2023-12-11T20:06:50.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.637+0000 7f4ad5dab700 1 --2- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ab8038910 0x7f4ab803add0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:50.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.637+0000 7f4ad5dab700 1 --2- 172.21.15.39:0/3798957248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ad0101140 0x7f4ad019e650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:06:50.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.637+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 >> 172.21.15.39:0/3798957248 conn(0x7f4ad00fc9d0 msgr2=0x7f4ad0102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:06:50.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.637+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 shutdown_connections 2023-12-11T20:06:50.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:06:50.637+0000 7f4ad5dab700 1 -- 172.21.15.39:0/3798957248 wait complete. 2023-12-11T20:06:50.636 INFO:teuthology.orchestra.run.smithi039.stderr:dumped monmap epoch 1 2023-12-11T20:06:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:50 smithi012 ceph-mon[128787]: Deploying daemon mon.c on smithi039 2023-12-11T20:06:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:50 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/3798957248' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:06:52.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:51 smithi012 ceph-mon[128787]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:52.389 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-11T20:06:52.390 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-11T20:06:53.715 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:06:54.000 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:53 smithi039 systemd[1]: Starting Ceph mon.c for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:06:54.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:53 smithi012 ceph-mon[128787]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:54.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 podman[102109]: 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 bash[102109]: ce8243392c3e81fc8b729ba1c1a93bf85c73e8b9a55d56e422c5566efe2949b0 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: set uid:gid to 167:167 (ceph:ceph) 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev), process ceph-mon, pid 7 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pidfile_write: ignore empty --pid-file 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: load: jerasure load: lrc 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: RocksDB version: 7.9.2 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Git sha 0 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Compile date 2023-12-11 11:29:13 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: DB SUMMARY 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: DB Session ID: GE16H3RIXQ0V01EEOT9T 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: CURRENT file: CURRENT 2023-12-11T20:06:55.013 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: IDENTITY file: IDENTITY 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.error_if_exists: 0 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.create_if_missing: 0 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.paranoid_checks: 1 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.env: 0x555a22755a60 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.fs: PosixFileSystem 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.info_log: 0x555a23299780 2023-12-11T20:06:55.014 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_file_opening_threads: 16 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.statistics: (nil) 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.use_fsync: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_log_file_size: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.keep_log_file_num: 1000 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.recycle_log_file_num: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.allow_fallocate: 1 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.allow_mmap_reads: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.allow_mmap_writes: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.use_direct_reads: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.create_missing_column_families: 0 2023-12-11T20:06:55.015 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.db_log_dir: 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.wal_dir: 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.advise_random_on_open: 1 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.db_write_buffer_size: 0 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.write_buffer_manager: 0x555a2324f360 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-11T20:06:55.016 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.rate_limiter: (nil) 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.wal_recovery_mode: 2 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.enable_thread_tracking: 0 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.enable_pipelined_write: 0 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.unordered_write: 0 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.row_cache: None 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.wal_filter: None 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.allow_ingest_behind: 0 2023-12-11T20:06:55.017 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.two_write_queues: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.manual_wal_flush: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.wal_compression: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.atomic_flush: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.log_readahead_size: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.best_efforts_recovery: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.allow_data_in_errors: 0 2023-12-11T20:06:55.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.db_host_id: __hostname__ 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_background_jobs: 2 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_background_compactions: -1 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_subcompactions: 1 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_total_wal_size: 0 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-11T20:06:55.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_open_files: -1 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bytes_per_sync: 0 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_readahead_size: 0 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_background_flushes: -1 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Compression algorithms supported: 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: kZSTD supported: 0 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: kXpressCompression supported: 0 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: kLZ4HCCompression supported: 1 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: kZlibCompression supported: 1 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: kSnappyCompression supported: 1 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: kLZ4Compression supported: 1 2023-12-11T20:06:55.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: kBZip2Compression supported: 0 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.merge_operator: 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_filter: None 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_filter_factory: None 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.sst_partitioner_factory: None 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555a232998a0) 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout: cache_index_and_filter_blocks: 1 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-11T20:06:55.021 INFO:journalctl@ceph.mon.c.smithi039.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: pin_top_level_index_and_filter: 1 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: index_type: 0 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: data_block_index_type: 0 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: index_shortening: 1 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: checksum: 4 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: no_block_cache: 0 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: block_cache: 0x555a232ef090 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: block_cache_name: BinnedLRUCache 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: block_cache_options: 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: capacity : 536870912 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: num_shard_bits : 4 2023-12-11T20:06:55.022 INFO:journalctl@ceph.mon.c.smithi039.stdout: strict_capacity_limit : 0 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: high_pri_pool_ratio: 0.000 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: block_cache_compressed: (nil) 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: persistent_cache: (nil) 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: block_size: 4096 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: block_size_deviation: 10 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: block_restart_interval: 16 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: index_block_restart_interval: 1 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: metadata_block_size: 4096 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: partition_filters: 0 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: use_delta_encoding: 1 2023-12-11T20:06:55.023 INFO:journalctl@ceph.mon.c.smithi039.stdout: filter_policy: bloomfilter 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: whole_key_filtering: 1 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: verify_compression: 0 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: read_amp_bytes_per_bit: 0 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: format_version: 5 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: enable_index_compression: 1 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: block_align: 0 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: max_auto_readahead_size: 262144 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: prepopulate_block_cache: 0 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: initial_auto_readahead_size: 8192 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout: num_file_reads_for_auto_readahead: 2 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.write_buffer_size: 33554432 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_write_buffer_number: 2 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression: NoCompression 2023-12-11T20:06:55.024 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression: Disabled 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.prefix_extractor: nullptr 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.num_levels: 7 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-11T20:06:55.025 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-11T20:06:55.026 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-11T20:06:55.026 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.level: 32767 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.strategy: 0 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.enabled: false 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-11T20:06:55.027 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.target_file_size_base: 67108864 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-11T20:06:55.028 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.arena_block_size: 1048576 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.disable_auto_compactions: 0 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-11T20:06:55.029 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.table_properties_collectors: 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.inplace_update_support: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.bloom_locality: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.max_successive_merges: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.paranoid_file_checks: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.force_consistency_checks: 1 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.report_bg_io_stats: 0 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.ttl: 2592000 2023-12-11T20:06:55.030 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.enable_blob_files: false 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.min_blob_size: 0 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.blob_file_size: 268435456 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.blob_file_starting_level: 0 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-11T20:06:55.031 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 764a8f28-791f-4cca-b97f-c0689e3f311b 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325214770950, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325214771888, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702325214, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "764a8f28-791f-4cca-b97f-c0689e3f311b", "db_session_id": "GE16H3RIXQ0V01EEOT9T", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325214772130, "job": 1, "event": "recovery_finished"} 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555a2338a000 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: DB pointer 0x555a23376000 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout: ** DB Stats ** 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-11T20:06:55.032 INFO:journalctl@ceph.mon.c.smithi039.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: ** Compaction Stats [default] ** 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: ** Compaction Stats [default] ** 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-11T20:06:55.033 INFO:journalctl@ceph.mon.c.smithi039.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: Cumulative compaction: 0.00 GB write, 0.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: Interval compaction: 0.00 GB write, 0.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-11T20:06:55.034 INFO:journalctl@ceph.mon.c.smithi039.stdout: Block cache BinnedLRUCache@0x555a232ef090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout: 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: using public_addr v2:172.21.15.39:0/0 -> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: starting mon.c rank -1 at public addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] at bind addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(???) e0 preinit fsid 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 systemd[1]: Started Ceph mon.c for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).mds e1 new map 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).mds e1 print_map 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout: e1 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-11T20:06:55.035 INFO:journalctl@ceph.mon.c.smithi039.stdout: legacy client fscid: -1 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout: 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout: No filesystems configured 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi039", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:06:55.036 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi032", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Deploying cephadm binary to smithi039 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Updating smithi032:/etc/ceph/ceph.conf 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.037 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Added host smithi039 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/56089440' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/56089440' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-11T20:06:55.038 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi039", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Updating smithi039:/etc/ceph/ceph.conf 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:06:55.039 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:06:55.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c;count:3 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Reconfiguring mon.a (unknown last config time)... 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Reconfiguring daemon mon.a on smithi012 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: Deploying daemon mon.c on smithi039 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/3798957248' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.041 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:06:55.042 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:54 smithi039 ceph-mon[102205]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-12-11T20:07:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:07:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: mon.a calling monitor election 2023-12-11T20:07:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: mon.c calling monitor election 2023-12-11T20:07:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],c=[v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: fsmap 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: mgrmap e13: x(active, since 56s) 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: overall HEALTH_OK 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:06:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:07:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: mon.a calling monitor election 2023-12-11T20:07:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: mon.c calling monitor election 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],c=[v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: fsmap 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: mgrmap e13: x(active, since 56s) 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: overall HEALTH_OK 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:00.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:06:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:01.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.301+0000 7fec5f4f2700 1 -- 172.21.15.39:0/1178294453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 msgr2=0x7fec440086b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:01.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.301+0000 7fec5f4f2700 1 --2- 172.21.15.39:0/1178294453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 0x7fec440086b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec581020d0 tx=0x7fec5400fe90 comp rx=0 tx=0).stop 2023-12-11T20:07:01.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.301+0000 7fec5f4f2700 1 -- 172.21.15.39:0/1178294453 shutdown_connections 2023-12-11T20:07:01.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.301+0000 7fec5f4f2700 1 --2- 172.21.15.39:0/1178294453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 0x7fec440086b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:01.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.301+0000 7fec5f4f2700 1 -- 172.21.15.39:0/1178294453 >> 172.21.15.39:0/1178294453 conn(0x7fec580fcb20 msgr2=0x7fec580fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:01.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.302+0000 7fec5f4f2700 1 -- 172.21.15.39:0/1178294453 shutdown_connections 2023-12-11T20:07:01.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.302+0000 7fec5f4f2700 1 -- 172.21.15.39:0/1178294453 wait complete. 2023-12-11T20:07:01.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:01.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:01.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:01.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:00 smithi039 ceph-mon[102205]: Deploying daemon mon.b on smithi032 2023-12-11T20:07:01.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:01.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.303+0000 7fec5f4f2700 1 Processor -- start 2023-12-11T20:07:01.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.304+0000 7fec5f4f2700 1 -- start start 2023-12-11T20:07:01.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.304+0000 7fec5f4f2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 0x7fec5819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:01.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.304+0000 7fec5f4f2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 0x7fec58196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:01.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.304+0000 7fec5f4f2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5819cfd0 con 0x7fec44006240 2023-12-11T20:07:01.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.304+0000 7fec5f4f2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5819d140 con 0x7fec5819cb50 2023-12-11T20:07:01.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.304+0000 7fec5d28e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 0x7fec5819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:01.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5d28e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 0x7fec5819c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.39:43348/0 (socket says 172.21.15.39:43348) 2023-12-11T20:07:01.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5d28e700 1 -- 172.21.15.39:0/4293329918 learned_addr learned my addr 172.21.15.39:0/4293329918 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:07:01.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5ca8d700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 0x7fec58196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:01.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5ca8d700 1 -- 172.21.15.39:0/4293329918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 msgr2=0x7fec58196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-11T20:07:01.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5ca8d700 1 -- 172.21.15.39:0/4293329918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 msgr2=0x7fec58196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-11T20:07:01.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5ca8d700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 0x7fec58196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-11T20:07:01.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5ca8d700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 0x7fec58196750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-11T20:07:01.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5d28e700 1 -- 172.21.15.39:0/4293329918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 msgr2=0x7fec58196750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T20:07:01.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5d28e700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 0x7fec58196750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:01.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5d28e700 1 -- 172.21.15.39:0/4293329918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5400f8e0 con 0x7fec44006240 2023-12-11T20:07:01.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.305+0000 7fec5d28e700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 0x7fec5819c610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fec5401d9b0 tx=0x7fec5401da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:01.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.306+0000 7fec4e7fc700 1 -- 172.21.15.39:0/4293329918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fec54005da0 con 0x7fec44006240 2023-12-11T20:07:01.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.306+0000 7fec4e7fc700 1 -- 172.21.15.39:0/4293329918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec54005400 con 0x7fec44006240 2023-12-11T20:07:01.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.306+0000 7fec4e7fc700 1 -- 172.21.15.39:0/4293329918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fec54011660 con 0x7fec44006240 2023-12-11T20:07:01.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.306+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec58196d50 con 0x7fec44006240 2023-12-11T20:07:01.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.306+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec58197250 con 0x7fec44006240 2023-12-11T20:07:01.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.307+0000 7fec4e7fc700 1 -- 172.21.15.39:0/4293329918 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7fec54003680 con 0x7fec44006240 2023-12-11T20:07:01.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.307+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec58102750 con 0x7fec44006240 2023-12-11T20:07:01.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.308+0000 7fec4e7fc700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fec3c038700 0x7fec3c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:01.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.308+0000 7fec4e7fc700 1 -- 172.21.15.39:0/4293329918 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fec5404e550 con 0x7fec44006240 2023-12-11T20:07:01.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.308+0000 7fec5ca8d700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fec3c038700 0x7fec3c03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:01.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.309+0000 7fec5ca8d700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fec3c038700 0x7fec3c03abc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec48009850 tx=0x7fec48008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:01.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.313+0000 7fec4e7fc700 1 -- 172.21.15.39:0/4293329918 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fec54038b00 con 0x7fec44006240 2023-12-11T20:07:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:00 smithi012 ceph-mon[128787]: Deploying daemon mon.b on smithi032 2023-12-11T20:07:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:01.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.608+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fec58062c00 con 0x7fec44006240 2023-12-11T20:07:01.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.609+0000 7fec4e7fc700 1 -- 172.21.15.39:0/4293329918 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7fec54038b00 con 0x7fec44006240 2023-12-11T20:07:01.607 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:07:01.608 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":2,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","modified":"2023-12-11T20:06:54.814465Z","created":"2023-12-11T20:04:57.917964Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-11T20:07:01.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.611+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fec3c038700 msgr2=0x7fec3c03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:01.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.611+0000 7fec5f4f2700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fec3c038700 0x7fec3c03abc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec48009850 tx=0x7fec48008040 comp rx=0 tx=0).stop 2023-12-11T20:07:01.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.611+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 msgr2=0x7fec5819c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:01.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.611+0000 7fec5f4f2700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 0x7fec5819c610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fec5401d9b0 tx=0x7fec5401da90 comp rx=0 tx=0).stop 2023-12-11T20:07:01.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.612+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 shutdown_connections 2023-12-11T20:07:01.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.612+0000 7fec5f4f2700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fec3c038700 0x7fec3c03abc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:01.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.612+0000 7fec5f4f2700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec44006240 0x7fec5819c610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:01.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.612+0000 7fec5f4f2700 1 --2- 172.21.15.39:0/4293329918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec5819cb50 0x7fec58196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:01.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.612+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 >> 172.21.15.39:0/4293329918 conn(0x7fec580fcb20 msgr2=0x7fec58104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:01.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.612+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 shutdown_connections 2023-12-11T20:07:01.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:01.612+0000 7fec5f4f2700 1 -- 172.21.15.39:0/4293329918 wait complete. 2023-12-11T20:07:01.613 INFO:teuthology.orchestra.run.smithi039.stderr:dumped monmap epoch 2 2023-12-11T20:07:02.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:01 smithi039 ceph-mon[102205]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:02.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:01 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/4293329918' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:07:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:01 smithi012 ceph-mon[128787]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:01 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/4293329918' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:07:03.077 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-11T20:07:03.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-11T20:07:03.875 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:07:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:03 smithi032 systemd[1]: Starting Ceph mon.b for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:07:04.172 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:03 smithi039 ceph-mon[102205]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:03 smithi012 ceph-mon[128787]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.640 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 podman[132440]: 2023-12-11T20:07:04.640 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: set uid:gid to 167:167 (ceph:ceph) 2023-12-11T20:07:04.640 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev), process ceph-mon, pid 7 2023-12-11T20:07:04.640 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pidfile_write: ignore empty --pid-file 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: load: jerasure load: lrc 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: RocksDB version: 7.9.2 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Git sha 0 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Compile date 2023-12-11 11:29:13 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: DB SUMMARY 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: DB Session ID: XEPVIO9LUGT4ZC0GJT9M 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: CURRENT file: CURRENT 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: IDENTITY file: IDENTITY 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.error_if_exists: 0 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.create_if_missing: 0 2023-12-11T20:07:04.641 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.paranoid_checks: 1 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.env: 0x561272d8fa60 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.fs: PosixFileSystem 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.info_log: 0x5612755db780 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_file_opening_threads: 16 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.statistics: (nil) 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.use_fsync: 0 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_log_file_size: 0 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.keep_log_file_num: 1000 2023-12-11T20:07:04.642 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.recycle_log_file_num: 0 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.allow_fallocate: 1 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.allow_mmap_reads: 0 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.allow_mmap_writes: 0 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.use_direct_reads: 0 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.create_missing_column_families: 0 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.db_log_dir: 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.wal_dir: 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-11T20:07:04.643 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.advise_random_on_open: 1 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.db_write_buffer_size: 0 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.write_buffer_manager: 0x561275591360 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.rate_limiter: (nil) 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.wal_recovery_mode: 2 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.enable_thread_tracking: 0 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.enable_pipelined_write: 0 2023-12-11T20:07:04.644 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.unordered_write: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.row_cache: None 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.wal_filter: None 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.allow_ingest_behind: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.two_write_queues: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.manual_wal_flush: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.wal_compression: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.atomic_flush: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-11T20:07:04.645 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.log_readahead_size: 0 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.best_efforts_recovery: 0 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.allow_data_in_errors: 0 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.db_host_id: __hostname__ 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_background_jobs: 2 2023-12-11T20:07:04.646 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_background_compactions: -1 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_subcompactions: 1 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_total_wal_size: 0 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_open_files: -1 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bytes_per_sync: 0 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_readahead_size: 0 2023-12-11T20:07:04.647 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_background_flushes: -1 2023-12-11T20:07:04.648 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Compression algorithms supported: 2023-12-11T20:07:04.648 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-11T20:07:04.648 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: kZSTD supported: 0 2023-12-11T20:07:04.648 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: kXpressCompression supported: 0 2023-12-11T20:07:04.648 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: kLZ4HCCompression supported: 1 2023-12-11T20:07:04.648 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: kZlibCompression supported: 1 2023-12-11T20:07:04.648 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: kSnappyCompression supported: 1 2023-12-11T20:07:04.648 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: kLZ4Compression supported: 1 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: kBZip2Compression supported: 0 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.merge_operator: 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_filter: None 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_filter_factory: None 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.sst_partitioner_factory: None 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5612755db8a0) 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout: cache_index_and_filter_blocks: 1 2023-12-11T20:07:04.649 INFO:journalctl@ceph.mon.b.smithi032.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: pin_top_level_index_and_filter: 1 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: index_type: 0 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: data_block_index_type: 0 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: index_shortening: 1 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: checksum: 4 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: no_block_cache: 0 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: block_cache: 0x561275631090 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: block_cache_name: BinnedLRUCache 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: block_cache_options: 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: capacity : 536870912 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: num_shard_bits : 4 2023-12-11T20:07:04.650 INFO:journalctl@ceph.mon.b.smithi032.stdout: strict_capacity_limit : 0 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: high_pri_pool_ratio: 0.000 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: block_cache_compressed: (nil) 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: persistent_cache: (nil) 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: block_size: 4096 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: block_size_deviation: 10 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: block_restart_interval: 16 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: index_block_restart_interval: 1 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: metadata_block_size: 4096 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: partition_filters: 0 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: use_delta_encoding: 1 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: filter_policy: bloomfilter 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: whole_key_filtering: 1 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: verify_compression: 0 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: read_amp_bytes_per_bit: 0 2023-12-11T20:07:04.651 INFO:journalctl@ceph.mon.b.smithi032.stdout: format_version: 5 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout: enable_index_compression: 1 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout: block_align: 0 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout: max_auto_readahead_size: 262144 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout: prepopulate_block_cache: 0 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout: initial_auto_readahead_size: 8192 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout: num_file_reads_for_auto_readahead: 2 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.write_buffer_size: 33554432 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_write_buffer_number: 2 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression: NoCompression 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression: Disabled 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.prefix_extractor: nullptr 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.num_levels: 7 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-11T20:07:04.652 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-11T20:07:04.653 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-11T20:07:04.653 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-11T20:07:04.653 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-11T20:07:04.653 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-11T20:07:04.653 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.level: 32767 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.strategy: 0 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-11T20:07:04.654 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.enabled: false 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.target_file_size_base: 67108864 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-11T20:07:04.655 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.arena_block_size: 1048576 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.disable_auto_compactions: 0 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-11T20:07:04.656 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.table_properties_collectors: 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.inplace_update_support: 0 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.bloom_locality: 0 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.max_successive_merges: 0 2023-12-11T20:07:04.657 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.paranoid_file_checks: 0 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.force_consistency_checks: 1 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.report_bg_io_stats: 0 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.ttl: 2592000 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.enable_blob_files: false 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.min_blob_size: 0 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.blob_file_size: 268435456 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-11T20:07:04.658 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.blob_file_starting_level: 0 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d7e270b2-fce6-4854-bae1-b6ba9e68f036 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325224610675, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-11T20:07:04.659 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325224611422, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702325224, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d7e270b2-fce6-4854-bae1-b6ba9e68f036", "db_session_id": "XEPVIO9LUGT4ZC0GJT9M", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702325224611648, "job": 1, "event": "recovery_finished"} 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5612756cc000 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: DB pointer 0x5612756b8000 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout: ** DB Stats ** 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-11T20:07:04.660 INFO:journalctl@ceph.mon.b.smithi032.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: ** Compaction Stats [default] ** 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: ** Compaction Stats [default] ** 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-11T20:07:04.661 INFO:journalctl@ceph.mon.b.smithi032.stdout: 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: Cumulative compaction: 0.00 GB write, 0.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: Interval compaction: 0.00 GB write, 0.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: Block cache BinnedLRUCache@0x561275631090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: 2023-12-11T20:07:04.662 INFO:journalctl@ceph.mon.b.smithi032.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: using public_addr v2:172.21.15.32:0/0 -> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: starting mon.b rank -1 at public addrs [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] at bind addrs [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(???) e0 preinit fsid 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 bash[132440]: c48e67637911cabcdee701d9175e12a3d4e0a296e4ed21dcd4168199d5610155 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).mds e1 new map 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).mds e1 print_map 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout: e1 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout: legacy client fscid: -1 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout: 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout: No filesystems configured 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-11T20:07:04.663 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi039", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.664 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi032", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:07:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Deploying cephadm binary to smithi039 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Updating smithi032:/etc/ceph/ceph.conf 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Updating smithi032:/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Added host smithi039 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/56089440' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/56089440' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi039", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:07:04.965 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Updating smithi039:/etc/ceph/ceph.conf 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c;count:3 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Reconfiguring mon.a (unknown last config time)... 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Reconfiguring daemon mon.a on smithi012 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:04.967 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Deploying daemon mon.c on smithi039 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/3798957248' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.a calling monitor election 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.c calling monitor election 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.968 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],c=[v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: fsmap 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mgrmap e13: x(active, since 56s) 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: overall HEALTH_OK 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: Deploying daemon mon.b on smithi032 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.969 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/4293329918' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:07:04.970 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:04.970 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 ceph-mon[132488]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-12-11T20:07:04.970 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:04 smithi032 systemd[1]: Started Ceph mon.b for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:07:09.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.676+0000 7f0b6fc86700 1 -- 172.21.15.39:0/3676932680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b68101270 msgr2=0x7f0b54005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.676+0000 7f0b6fc86700 1 --2- 172.21.15.39:0/3676932680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b68101270 0x7f0b54005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0b64005fa0 tx=0x7f0b6400ff70 comp rx=0 tx=0).stop 2023-12-11T20:07:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.676+0000 7f0b6fc86700 1 -- 172.21.15.39:0/3676932680 shutdown_connections 2023-12-11T20:07:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.676+0000 7f0b6fc86700 1 --2- 172.21.15.39:0/3676932680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b68101270 0x7f0b54005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.676+0000 7f0b6fc86700 1 -- 172.21.15.39:0/3676932680 >> 172.21.15.39:0/3676932680 conn(0x7f0b680fcb20 msgr2=0x7f0b680fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.677+0000 7f0b6fc86700 1 -- 172.21.15.39:0/3676932680 shutdown_connections 2023-12-11T20:07:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.677+0000 7f0b6fc86700 1 -- 172.21.15.39:0/3676932680 wait complete. 2023-12-11T20:07:09.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.678+0000 7f0b6fc86700 1 Processor -- start 2023-12-11T20:07:09.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.678+0000 7f0b6fc86700 1 -- start start 2023-12-11T20:07:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6fc86700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b68101270 0x7f0b6819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6fc86700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b6819ed80 0x7f0b68198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6fc86700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b68198ec0 0x7f0b68199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6fc86700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6819f380 con 0x7f0b6819ed80 2023-12-11T20:07:09.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6fc86700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681a5660 con 0x7f0b68101270 2023-12-11T20:07:09.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6fc86700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681a57a0 con 0x7f0b68198ec0 2023-12-11T20:07:09.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6d221700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b6819ed80 0x7f0b68198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:09.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6d221700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b6819ed80 0x7f0b68198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.39:43432/0 (socket says 172.21.15.39:43432) 2023-12-11T20:07:09.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.679+0000 7f0b6d221700 1 -- 172.21.15.39:0/2777948655 learned_addr learned my addr 172.21.15.39:0/2777948655 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:07:09.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.680+0000 7f0b6da22700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b68101270 0x7f0b6819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:09.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.680+0000 7f0b6d221700 1 -- 172.21.15.39:0/2777948655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b68198ec0 msgr2=0x7f0b68199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:09.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.680+0000 7f0b6d221700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b68198ec0 0x7f0b68199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:09.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.680+0000 7f0b6d221700 1 -- 172.21.15.39:0/2777948655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b68101270 msgr2=0x7f0b6819e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:09.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.680+0000 7f0b6d221700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b68101270 0x7f0b6819e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:09.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.680+0000 7f0b6d221700 1 -- 172.21.15.39:0/2777948655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6400f970 con 0x7f0b6819ed80 2023-12-11T20:07:09.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.680+0000 7f0b6d221700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b6819ed80 0x7f0b68198980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800b7b0 tx=0x7f0b5800bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:09.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.681+0000 7f0b5effd700 1 -- 172.21.15.39:0/2777948655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58004230 con 0x7f0b6819ed80 2023-12-11T20:07:09.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.682+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b681a5a80 con 0x7f0b6819ed80 2023-12-11T20:07:09.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.682+0000 7f0b5effd700 1 -- 172.21.15.39:0/2777948655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b58004390 con 0x7f0b6819ed80 2023-12-11T20:07:09.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.682+0000 7f0b5effd700 1 -- 172.21.15.39:0/2777948655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58011a50 con 0x7f0b6819ed80 2023-12-11T20:07:09.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.682+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b681a5fd0 con 0x7f0b6819ed80 2023-12-11T20:07:09.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.683+0000 7f0b5effd700 1 -- 172.21.15.39:0/2777948655 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f0b58011bb0 con 0x7f0b6819ed80 2023-12-11T20:07:09.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.683+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b681053f0 con 0x7f0b6819ed80 2023-12-11T20:07:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.683+0000 7f0b5effd700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b4c038d40 0x7f0b4c03b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.683+0000 7f0b5effd700 1 -- 172.21.15.39:0/2777948655 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0b5804af60 con 0x7f0b6819ed80 2023-12-11T20:07:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.684+0000 7f0b6da22700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b4c038d40 0x7f0b4c03b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.685+0000 7f0b6da22700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b4c038d40 0x7f0b4c03b200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b64020040 tx=0x7f0b64005ca0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:09.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.690+0000 7f0b5effd700 1 -- 172.21.15.39:0/2777948655 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0b5801a400 con 0x7f0b6819ed80 2023-12-11T20:07:09.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.993+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0b68199e40 con 0x7f0b6819ed80 2023-12-11T20:07:09.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.994+0000 7f0b5effd700 1 -- 172.21.15.39:0/2777948655 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f0b58011e60 con 0x7f0b6819ed80 2023-12-11T20:07:09.992 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-12-11T20:07:09.992 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":3,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","modified":"2023-12-11T20:07:04.653981Z","created":"2023-12-11T20:04:57.917964Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-11T20:07:09.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b4c038d40 msgr2=0x7f0b4c03b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:09.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b4c038d40 0x7f0b4c03b200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b64020040 tx=0x7f0b64005ca0 comp rx=0 tx=0).stop 2023-12-11T20:07:09.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b6819ed80 msgr2=0x7f0b68198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:09.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b6819ed80 0x7f0b68198980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800b7b0 tx=0x7f0b5800bb70 comp rx=0 tx=0).stop 2023-12-11T20:07:09.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 shutdown_connections 2023-12-11T20:07:09.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b4c038d40 0x7f0b4c03b200 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:09.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b68101270 0x7f0b6819e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:09.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b68198ec0 0x7f0b68199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:09.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 --2- 172.21.15.39:0/2777948655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b6819ed80 0x7f0b68198980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:09.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 >> 172.21.15.39:0/2777948655 conn(0x7f0b680fcb20 msgr2=0x7f0b680fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:09.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 shutdown_connections 2023-12-11T20:07:09.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:09.997+0000 7f0b6fc86700 1 -- 172.21.15.39:0/2777948655 wait complete. 2023-12-11T20:07:09.997 INFO:teuthology.orchestra.run.smithi039.stderr:dumped monmap epoch 3 2023-12-11T20:07:10.018 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: mon.a calling monitor election 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: mon.c calling monitor election 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: mon.b calling monitor election 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.019 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0],c=[v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: fsmap 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: mgrmap e13: x(active, since 66s) 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: overall HEALTH_OK 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.020 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:07:10.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: mon.a calling monitor election 2023-12-11T20:07:10.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:10.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: mon.c calling monitor election 2023-12-11T20:07:10.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: mon.b calling monitor election 2023-12-11T20:07:10.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-11T20:07:10.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0],c=[v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-11T20:07:10.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: fsmap 2023-12-11T20:07:10.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:07:10.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: mgrmap e13: x(active, since 66s) 2023-12-11T20:07:10.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: overall HEALTH_OK 2023-12-11T20:07:10.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: mon.a calling monitor election 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: mon.c calling monitor election 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: mon.b calling monitor election 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0],c=[v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: fsmap 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: osdmap e4: 0 total, 0 up, 0 in 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: mgrmap e13: x(active, since 66s) 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: overall HEALTH_OK 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:10.481 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-11T20:07:10.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph config generate-minimal-conf 2023-12-11T20:07:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:10 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/2777948655' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:07:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:11.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:10 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/2777948655' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:07:11.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:11.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:11.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:10 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/2777948655' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-11T20:07:11.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:11.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:07:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:07:12.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:11 smithi039 ceph-mon[102205]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:12.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:11 smithi012 ceph-mon[128787]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:12.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:11 smithi032 ceph-mon[132488]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:12.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.783+0000 7f2066e23700 1 -- 172.21.15.12:0/1154117022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060073a00 msgr2=0x7f2060073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:12.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.783+0000 7f2066e23700 1 --2- 172.21.15.12:0/1154117022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060073a00 0x7f2060073de0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2054009910 tx=0x7f2054009c20 comp rx=0 tx=0).stop 2023-12-11T20:07:12.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.783+0000 7f2066e23700 1 -- 172.21.15.12:0/1154117022 shutdown_connections 2023-12-11T20:07:12.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.783+0000 7f2066e23700 1 --2- 172.21.15.12:0/1154117022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060073a00 0x7f2060073de0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:12.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.783+0000 7f2066e23700 1 -- 172.21.15.12:0/1154117022 >> 172.21.15.12:0/1154117022 conn(0x7f20600fcb20 msgr2=0x7f20600fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:12.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.783+0000 7f2066e23700 1 -- 172.21.15.12:0/1154117022 shutdown_connections 2023-12-11T20:07:12.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.783+0000 7f2066e23700 1 -- 172.21.15.12:0/1154117022 wait complete. 2023-12-11T20:07:12.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.784+0000 7f2066e23700 1 Processor -- start 2023-12-11T20:07:12.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.784+0000 7f2066e23700 1 -- start start 2023-12-11T20:07:12.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f2066e23700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2060073a00 0x7f206019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f2066e23700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206019ee80 0x7f2060198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f2066e23700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2060198fc0 0x7f2060199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f2066e23700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206019f480 con 0x7f206019ee80 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f2066e23700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20601a5760 con 0x7f2060073a00 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f2066e23700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20601a58a0 con 0x7f2060198fc0 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f205ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206019ee80 0x7f2060198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f205ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206019ee80 0x7f2060198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53766/0 (socket says 172.21.15.12:53766) 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f205ffff700 1 -- 172.21.15.12:0/3228692125 learned_addr learned my addr 172.21.15.12:0/3228692125 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:07:12.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.785+0000 7f2064bbf700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2060073a00 0x7f206019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.786+0000 7f20653c0700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2060198fc0 0x7f2060199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.786+0000 7f205ffff700 1 -- 172.21.15.12:0/3228692125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2060198fc0 msgr2=0x7f2060199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.786+0000 7f205ffff700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2060198fc0 0x7f2060199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:12.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.786+0000 7f205ffff700 1 -- 172.21.15.12:0/3228692125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2060073a00 msgr2=0x7f206019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.786+0000 7f205ffff700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2060073a00 0x7f206019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.786+0000 7f205ffff700 1 -- 172.21.15.12:0/3228692125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540095f0 con 0x7f206019ee80 2023-12-11T20:07:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.786+0000 7f205ffff700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206019ee80 0x7f2060198a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f204c00b7b0 tx=0x7f204c00bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.786+0000 7f205dffb700 1 -- 172.21.15.12:0/3228692125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c004230 con 0x7f206019ee80 2023-12-11T20:07:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.787+0000 7f205dffb700 1 -- 172.21.15.12:0/3228692125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f204c004390 con 0x7f206019ee80 2023-12-11T20:07:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.787+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20601a5b80 con 0x7f206019ee80 2023-12-11T20:07:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.787+0000 7f205dffb700 1 -- 172.21.15.12:0/3228692125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c011a50 con 0x7f206019ee80 2023-12-11T20:07:12.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.787+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20601a60d0 con 0x7f206019ee80 2023-12-11T20:07:12.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.788+0000 7f205dffb700 1 -- 172.21.15.12:0/3228692125 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f204c011bb0 con 0x7f206019ee80 2023-12-11T20:07:12.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.788+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20600750b0 con 0x7f206019ee80 2023-12-11T20:07:12.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.789+0000 7f205dffb700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2050038d90 0x7f205003b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:12.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.789+0000 7f205dffb700 1 -- 172.21.15.12:0/3228692125 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f204c04aeb0 con 0x7f206019ee80 2023-12-11T20:07:12.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.789+0000 7f2064bbf700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2050038d90 0x7f205003b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:12.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.790+0000 7f2064bbf700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2050038d90 0x7f205003b250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2054004690 tx=0x7f2054005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:12.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:12.794+0000 7f205dffb700 1 -- 172.21.15.12:0/3228692125 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f204c01ae40 con 0x7f206019ee80 2023-12-11T20:07:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.060+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f206010d430 con 0x7f206019ee80 2023-12-11T20:07:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.061+0000 7f205dffb700 1 -- 172.21.15.12:0/3228692125 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+271 (secure 0 0 0) 0x7f204c011e60 con 0x7f206019ee80 2023-12-11T20:07:13.059 INFO:teuthology.orchestra.run.smithi012.stdout:# minimal ceph.conf for 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:07:13.059 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2023-12-11T20:07:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:07:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: mon_host = [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2023-12-11T20:07:13.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.063+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2050038d90 msgr2=0x7f205003b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.063+0000 7f2066e23700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2050038d90 0x7f205003b250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2054004690 tx=0x7f2054005fb0 comp rx=0 tx=0).stop 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.063+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206019ee80 msgr2=0x7f2060198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.063+0000 7f2066e23700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206019ee80 0x7f2060198a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f204c00b7b0 tx=0x7f204c00bac0 comp rx=0 tx=0).stop 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.064+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 shutdown_connections 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.064+0000 7f2066e23700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2050038d90 0x7f205003b250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.064+0000 7f2066e23700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2060073a00 0x7f206019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.064+0000 7f2066e23700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2060198fc0 0x7f2060199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.064+0000 7f2066e23700 1 --2- 172.21.15.12:0/3228692125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206019ee80 0x7f2060198a80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.064+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 >> 172.21.15.12:0/3228692125 conn(0x7f20600fcb20 msgr2=0x7f20601072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.064+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 shutdown_connections 2023-12-11T20:07:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:13.064+0000 7f2066e23700 1 -- 172.21.15.12:0/3228692125 wait complete. 2023-12-11T20:07:13.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:13.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:13.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: Updating smithi012:/etc/ceph/ceph.conf 2023-12-11T20:07:13.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: Updating smithi032:/etc/ceph/ceph.conf 2023-12-11T20:07:13.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:12 smithi012 ceph-mon[128787]: Updating smithi039:/etc/ceph/ceph.conf 2023-12-11T20:07:13.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: Updating smithi012:/etc/ceph/ceph.conf 2023-12-11T20:07:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: Updating smithi032:/etc/ceph/ceph.conf 2023-12-11T20:07:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:12 smithi032 ceph-mon[132488]: Updating smithi039:/etc/ceph/ceph.conf 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: Updating smithi012:/etc/ceph/ceph.conf 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: Updating smithi032:/etc/ceph/ceph.conf 2023-12-11T20:07:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:12 smithi039 ceph-mon[102205]: Updating smithi039:/etc/ceph/ceph.conf 2023-12-11T20:07:13.670 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-11T20:07:13.671 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:07:13.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.conf 2023-12-11T20:07:13.747 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:07:13.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:07:13.861 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:07:13.861 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.conf 2023-12-11T20:07:13.937 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:07:13.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:07:14.048 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:07:14.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.conf 2023-12-11T20:07:14.123 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:07:14.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-11T20:07:14.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: Updating smithi012:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3228692125' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:14.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:14.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:14.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:14.234 INFO:tasks.cephadm:Adding mgr.x on smithi012 2023-12-11T20:07:14.234 INFO:tasks.cephadm:Adding mgr.y on smithi032 2023-12-11T20:07:14.234 INFO:tasks.cephadm:Adding mgr.z on smithi039 2023-12-11T20:07:14.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch apply mgr '3;smithi012=x;smithi032=y;smithi039=z' 2023-12-11T20:07:14.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: Updating smithi012:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3228692125' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:14.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:14.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:13 smithi012 ceph-mon[128787]: Updating smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:13 smithi012 ceph-mon[128787]: Updating smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:13 smithi012 ceph-mon[128787]: Updating smithi012:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:13 smithi012 ceph-mon[128787]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3228692125' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:14.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:14.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:14.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:15.050 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:07:15.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:15 smithi039 ceph-mon[102205]: Reconfiguring mon.a (monmap changed)... 2023-12-11T20:07:15.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:15 smithi039 ceph-mon[102205]: Reconfiguring daemon mon.a on smithi012 2023-12-11T20:07:15.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:15 smithi012 ceph-mon[128787]: Reconfiguring mon.a (monmap changed)... 2023-12-11T20:07:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:15 smithi012 ceph-mon[128787]: Reconfiguring daemon mon.a on smithi012 2023-12-11T20:07:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:15.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:15 smithi032 ceph-mon[132488]: Reconfiguring mon.a (monmap changed)... 2023-12-11T20:07:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:15 smithi032 ceph-mon[132488]: Reconfiguring daemon mon.a on smithi012 2023-12-11T20:07:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:16.191 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:16 smithi039 ceph-mon[102205]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:16.191 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:16.191 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:16.191 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:16.192 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:16.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:16 smithi032 ceph-mon[132488]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:16.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:16.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:16.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:16.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:16 smithi012 ceph-mon[128787]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:16.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.445+0000 7f4c82e43700 1 -- 172.21.15.39:0/1534069818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c101060 msgr2=0x7f4c7c101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:16.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.445+0000 7f4c82e43700 1 --2- 172.21.15.39:0/1534069818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c101060 0x7f4c7c101480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009910 tx=0x7f4c70009c20 comp rx=0 tx=0).stop 2023-12-11T20:07:16.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.445+0000 7f4c82e43700 1 -- 172.21.15.39:0/1534069818 shutdown_connections 2023-12-11T20:07:16.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.445+0000 7f4c82e43700 1 --2- 172.21.15.39:0/1534069818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c101060 0x7f4c7c101480 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:16.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.445+0000 7f4c82e43700 1 -- 172.21.15.39:0/1534069818 >> 172.21.15.39:0/1534069818 conn(0x7f4c7c0fc620 msgr2=0x7f4c7c0fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:16.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.445+0000 7f4c82e43700 1 -- 172.21.15.39:0/1534069818 shutdown_connections 2023-12-11T20:07:16.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.445+0000 7f4c82e43700 1 -- 172.21.15.39:0/1534069818 wait complete. 2023-12-11T20:07:16.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.446+0000 7f4c82e43700 1 Processor -- start 2023-12-11T20:07:16.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c82e43700 1 -- start start 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c82e43700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7c101060 0x7f4c7c198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c82e43700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7c198c80 0x7f4c7c19dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c82e43700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c199100 0x7f4c7c1a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c82e43700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c1a09d0 con 0x7f4c7c199100 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c82e43700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c1a0b40 con 0x7f4c7c101060 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c82e43700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c1a0d00 con 0x7f4c7c198c80 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c7bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7c198c80 0x7f4c7c19dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c7bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7c198c80 0x7f4c7c19dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37630/0 (socket says 172.21.15.39:37630) 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c7bfff700 1 -- 172.21.15.39:0/3362817773 learned_addr learned my addr 172.21.15.39:0/3362817773 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c813e0700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c199100 0x7f4c7c1a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:16.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.447+0000 7f4c80bdf700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7c101060 0x7f4c7c198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c7bfff700 1 -- 172.21.15.39:0/3362817773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7c101060 msgr2=0x7f4c7c198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c7bfff700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7c101060 0x7f4c7c198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c7bfff700 1 -- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c199100 msgr2=0x7f4c7c1a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c7bfff700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c199100 0x7f4c7c1a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c7bfff700 1 -- 172.21.15.39:0/3362817773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c700095f0 con 0x7f4c7c198c80 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c7bfff700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7c198c80 0x7f4c7c19dca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800b780 tx=0x7f4c6800ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c79ffb700 1 -- 172.21.15.39:0/3362817773 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68004230 con 0x7f4c7c198c80 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c79ffb700 1 -- 172.21.15.39:0/3362817773 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c68004390 con 0x7f4c7c198c80 2023-12-11T20:07:16.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c79ffb700 1 -- 172.21.15.39:0/3362817773 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68011a30 con 0x7f4c7c198c80 2023-12-11T20:07:16.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c1a0fe0 con 0x7f4c7c198c80 2023-12-11T20:07:16.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.448+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c1a1480 con 0x7f4c7c198c80 2023-12-11T20:07:16.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.450+0000 7f4c79ffb700 1 -- 172.21.15.39:0/3362817773 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f4c680036a0 con 0x7f4c7c198c80 2023-12-11T20:07:16.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.449+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c192030 con 0x7f4c7c198c80 2023-12-11T20:07:16.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.450+0000 7f4c79ffb700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c6c038d90 0x7f4c6c03b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:16.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.450+0000 7f4c79ffb700 1 -- 172.21.15.39:0/3362817773 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4c6804a190 con 0x7f4c7c198c80 2023-12-11T20:07:16.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.451+0000 7f4c80bdf700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c6c038d90 0x7f4c6c03b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:16.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.451+0000 7f4c80bdf700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c6c038d90 0x7f4c6c03b250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009fd0 tx=0x7f4c70005160 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:16.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.456+0000 7f4c79ffb700 1 -- 172.21.15.39:0/3362817773 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4c6801a3b0 con 0x7f4c7c198c80 2023-12-11T20:07:16.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.681+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi032=y;smithi039=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c7c02d480 con 0x7f4c6c038d90 2023-12-11T20:07:16.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.688+0000 7f4c79ffb700 1 -- 172.21.15.39:0/3362817773 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4c7c02d480 con 0x7f4c6c038d90 2023-12-11T20:07:16.687 INFO:teuthology.orchestra.run.smithi039.stdout:Scheduled mgr update... 2023-12-11T20:07:16.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c6c038d90 msgr2=0x7f4c6c03b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:16.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c6c038d90 0x7f4c6c03b250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009fd0 tx=0x7f4c70005160 comp rx=0 tx=0).stop 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7c198c80 msgr2=0x7f4c7c19dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7c198c80 0x7f4c7c19dca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800b780 tx=0x7f4c6800ba90 comp rx=0 tx=0).stop 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 shutdown_connections 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c6c038d90 0x7f4c6c03b250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c7c101060 0x7f4c7c198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c199100 0x7f4c7c1a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 --2- 172.21.15.39:0/3362817773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c7c198c80 0x7f4c7c19dca0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 >> 172.21.15.39:0/3362817773 conn(0x7f4c7c0fc620 msgr2=0x7f4c7c0fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 shutdown_connections 2023-12-11T20:07:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:07:16.690+0000 7f4c82e43700 1 -- 172.21.15.39:0/3362817773 wait complete. 2023-12-11T20:07:17.144 DEBUG:teuthology.orchestra.run.smithi032:mgr.y> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.y.service 2023-12-11T20:07:17.149 DEBUG:teuthology.orchestra.run.smithi039:mgr.z> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.z.service 2023-12-11T20:07:17.194 INFO:tasks.cephadm:Deploying OSDs... 2023-12-11T20:07:17.194 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:07:17.194 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2023-12-11T20:07:17.220 INFO:journalctl@ceph.mgr.y.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:07:17.244 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-11T20:07:17.245 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2023-12-11T20:07:17.263 INFO:journalctl@ceph.mgr.z.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:07:17.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:17 smithi039 ceph-mon[102205]: Reconfiguring mon.b (monmap changed)... 2023-12-11T20:07:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:17 smithi039 ceph-mon[102205]: Reconfiguring daemon mon.b on smithi032 2023-12-11T20:07:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:17 smithi012 ceph-mon[128787]: Reconfiguring mon.b (monmap changed)... 2023-12-11T20:07:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:17 smithi012 ceph-mon[128787]: Reconfiguring daemon mon.b on smithi032 2023-12-11T20:07:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-11T20:07:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:17.332 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-12-11T20:07:17.332 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:17.332 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:17.332 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-12-11 20:06:13.071614242 +0000 2023-12-11T20:07:17.332 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-12-11 20:00:01.795012998 +0000 2023-12-11T20:07:17.332 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-12-11 20:00:01.795012998 +0000 2023-12-11T20:07:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-12-11 20:00:01.766013214 +0000 2023-12-11T20:07:17.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-11T20:07:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-12-11T20:07:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-12-11T20:07:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00030525 s, 1.7 MB/s 2023-12-11T20:07:17.445 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-11T20:07:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:17 smithi032 ceph-mon[132488]: Reconfiguring mon.b (monmap changed)... 2023-12-11T20:07:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:17 smithi032 ceph-mon[132488]: Reconfiguring daemon mon.b on smithi032 2023-12-11T20:07:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-11T20:07:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-11T20:07:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:17.491 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2023-12-11T20:07:17.576 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-11T20:07:17.576 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:17.576 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-12-11T20:07:17.576 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:17.576 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-12-11 20:06:13.151613624 +0000 2023-12-11T20:07:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-12-11 20:00:02.625006808 +0000 2023-12-11T20:07:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-12-11 20:00:02.625006808 +0000 2023-12-11T20:07:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-12-11 20:00:02.596007024 +0000 2023-12-11T20:07:17.577 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-11T20:07:17.682 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-12-11T20:07:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-12-11T20:07:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000285778 s, 1.8 MB/s 2023-12-11T20:07:17.685 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-11T20:07:17.731 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2023-12-11T20:07:17.815 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-11T20:07:17.815 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:17.815 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-12-11T20:07:17.815 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-12-11 20:06:13.235612976 +0000 2023-12-11T20:07:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-12-11 20:00:03.459000589 +0000 2023-12-11T20:07:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-12-11 20:00:03.459000589 +0000 2023-12-11T20:07:17.816 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-12-11 20:00:03.432000790 +0000 2023-12-11T20:07:17.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-11T20:07:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-12-11T20:07:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-12-11T20:07:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000328894 s, 1.6 MB/s 2023-12-11T20:07:17.925 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-11T20:07:17.970 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2023-12-11T20:07:18.058 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-11T20:07:18.058 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:18.058 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-12-11T20:07:18.059 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:18.059 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:18.059 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-12-11 20:06:13.310612397 +0000 2023-12-11T20:07:18.059 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-12-11 20:00:04.326994116 +0000 2023-12-11T20:07:18.059 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-12-11 20:00:04.326994116 +0000 2023-12-11T20:07:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-12-11 20:00:04.299994318 +0000 2023-12-11T20:07:18.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-11T20:07:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-12-11T20:07:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-12-11T20:07:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000357215 s, 1.4 MB/s 2023-12-11T20:07:18.168 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-11T20:07:18.213 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-12-11T20:07:18.213 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2023-12-11T20:07:18.262 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-11T20:07:18.262 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2023-12-11T20:07:18.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:18 smithi039 ceph-mon[102205]: Reconfiguring mon.c (monmap changed)... 2023-12-11T20:07:18.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:18 smithi039 ceph-mon[102205]: Reconfiguring daemon mon.c on smithi039 2023-12-11T20:07:18.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:18 smithi039 ceph-mon[102205]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi032=y;smithi039=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:18.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:18 smithi039 ceph-mon[102205]: Saving service mgr spec with placement smithi012=x;smithi032=y;smithi039=z;count:3 2023-12-11T20:07:18.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:18 smithi039 ceph-mon[102205]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:18.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:18 smithi012 ceph-mon[128787]: Reconfiguring mon.c (monmap changed)... 2023-12-11T20:07:18.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:18 smithi012 ceph-mon[128787]: Reconfiguring daemon mon.c on smithi039 2023-12-11T20:07:18.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:18 smithi012 ceph-mon[128787]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi032=y;smithi039=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:18.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:18 smithi012 ceph-mon[128787]: Saving service mgr spec with placement smithi012=x;smithi032=y;smithi039=z;count:3 2023-12-11T20:07:18.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:18 smithi012 ceph-mon[128787]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:18.351 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-11T20:07:18.351 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:18.351 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-12-11T20:07:18.351 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:18.351 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:18.351 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-12-11 20:07:03.736257893 +0000 2023-12-11T20:07:18.352 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-12-11 20:00:05.224008165 +0000 2023-12-11T20:07:18.352 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-12-11 20:00:05.224008165 +0000 2023-12-11T20:07:18.352 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2023-12-11 20:00:05.199008650 +0000 2023-12-11T20:07:18.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-11T20:07:18.414 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:18 smithi032 ceph-mon[132488]: Reconfiguring mon.c (monmap changed)... 2023-12-11T20:07:18.414 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:18 smithi032 ceph-mon[132488]: Reconfiguring daemon mon.c on smithi039 2023-12-11T20:07:18.414 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:18 smithi032 ceph-mon[132488]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi032=y;smithi039=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:18.414 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:18 smithi032 ceph-mon[132488]: Saving service mgr spec with placement smithi012=x;smithi032=y;smithi039=z;count:3 2023-12-11T20:07:18.414 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:18 smithi032 ceph-mon[132488]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:18.420 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-12-11T20:07:18.420 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-12-11T20:07:18.420 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000193667 s, 2.6 MB/s 2023-12-11T20:07:18.426 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-11T20:07:18.472 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-12-11 20:07:03.736257893 +0000 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-12-11 20:00:06.070991759 +0000 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-12-11 20:00:06.070991759 +0000 2023-12-11T20:07:18.556 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2023-12-11 20:00:06.046992224 +0000 2023-12-11T20:07:18.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-11T20:07:18.661 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-12-11T20:07:18.662 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-12-11T20:07:18.662 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.00019546 s, 2.6 MB/s 2023-12-11T20:07:18.664 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-11T20:07:18.709 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-12-11 20:07:03.737257874 +0000 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-12-11 20:00:06.920975295 +0000 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-12-11 20:00:06.920975295 +0000 2023-12-11T20:07:18.794 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2023-12-11 20:00:06.898975721 +0000 2023-12-11T20:07:18.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-11T20:07:18.899 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-12-11T20:07:18.899 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-12-11T20:07:18.900 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000190554 s, 2.7 MB/s 2023-12-11T20:07:18.902 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-11T20:07:18.947 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2023-12-11T20:07:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-11T20:07:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:19.032 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-12-11T20:07:19.032 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:19.032 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:19.032 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-12-11 20:07:03.737257874 +0000 2023-12-11T20:07:19.032 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-12-11 20:00:07.750959217 +0000 2023-12-11T20:07:19.032 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-12-11 20:00:07.750959217 +0000 2023-12-11T20:07:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2023-12-11 20:00:07.727959663 +0000 2023-12-11T20:07:19.032 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-11T20:07:19.137 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-12-11T20:07:19.137 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-12-11T20:07:19.137 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000194286 s, 2.6 MB/s 2023-12-11T20:07:19.140 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-11T20:07:19.186 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-12-11T20:07:19.186 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2023-12-11T20:07:19.232 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-11T20:07:19.233 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-12-11 20:06:53.458340452 +0000 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-12-11 20:00:06.796414426 +0000 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-12-11 20:00:06.796414426 +0000 2023-12-11T20:07:19.319 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2023-12-11 20:00:06.766415035 +0000 2023-12-11T20:07:19.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-11T20:07:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-12-11T20:07:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-12-11T20:07:19.431 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000370077 s, 1.4 MB/s 2023-12-11T20:07:19.434 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-11T20:07:19.489 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-11T20:07:19.494 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:19.495 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:19.495 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: Deploying daemon mgr.z on smithi039 2023-12-11T20:07:19.495 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:19 smithi039 ceph-mon[102205]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:19.534 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-11T20:07:19.534 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:19.534 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-12-11T20:07:19.534 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:19.535 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:19.535 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-12-11 20:06:53.458340452 +0000 2023-12-11T20:07:19.535 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-12-11 20:00:07.657396954 +0000 2023-12-11T20:07:19.535 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-12-11 20:00:07.657396954 +0000 2023-12-11T20:07:19.535 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2023-12-11 20:00:07.626397583 +0000 2023-12-11T20:07:19.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-11T20:07:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-11T20:07:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:19.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:19.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: Deploying daemon mgr.z on smithi039 2023-12-11T20:07:19.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:19 smithi012 ceph-mon[128787]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:19.643 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-12-11T20:07:19.643 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-12-11T20:07:19.643 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000382913 s, 1.3 MB/s 2023-12-11T20:07:19.646 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-11T20:07:19.691 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: Deploying daemon mgr.z on smithi039 2023-12-11T20:07:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:19 smithi032 ceph-mon[132488]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:19.778 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-11T20:07:19.778 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:19.778 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-12-11T20:07:19.778 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:19.778 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:19.778 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-12-11 20:06:53.458340452 +0000 2023-12-11T20:07:19.778 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-12-11 20:00:08.496379928 +0000 2023-12-11T20:07:19.778 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-12-11 20:00:08.496379928 +0000 2023-12-11T20:07:19.779 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2023-12-11 20:00:08.467380517 +0000 2023-12-11T20:07:19.779 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-11T20:07:19.886 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-12-11T20:07:19.886 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-12-11T20:07:19.887 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000347844 s, 1.5 MB/s 2023-12-11T20:07:19.889 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-11T20:07:19.948 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2023-12-11T20:07:19.992 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-11T20:07:19.993 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T20:07:19.993 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-12-11T20:07:19.993 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:07:19.993 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T20:07:19.993 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-12-11 20:07:19.979800445 +0000 2023-12-11T20:07:19.993 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-12-11 20:00:09.355362497 +0000 2023-12-11T20:07:19.993 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-12-11 20:00:09.355362497 +0000 2023-12-11T20:07:19.993 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2023-12-11 20:00:09.326363085 +0000 2023-12-11T20:07:19.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-11T20:07:20.119 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-12-11T20:07:20.120 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-12-11T20:07:20.120 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000385493 s, 1.3 MB/s 2023-12-11T20:07:20.121 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-11T20:07:20.168 INFO:tasks.cephadm:Deploying osd.0 on smithi012 with /dev/vg_nvme/lv_4... 2023-12-11T20:07:20.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-11T20:07:20.551 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:20 smithi039 systemd[1]: Starting Ceph mgr.z for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:07:20.960 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:07:21.211 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:20 smithi039 podman[104187]: 2023-12-11T20:07:21.211 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:21 smithi039 ceph-mgr[104228]: -- 172.21.15.39:0/296517777 <== mon.1 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55564cfb7520 con 0x55564cf8f000 2023-12-11T20:07:21.211 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:21 smithi039 bash[104187]: 132abf5df346b05cfe48cf256b9379b2444c8eff74e20a122db98fe0a209eca7 2023-12-11T20:07:21.444 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:21 smithi039 systemd[1]: Started Ceph mgr.z for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:07:21.444 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:21 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:21.335+0000 7f00bf713200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-11T20:07:21.551 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:21 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:21.444+0000 7f00bf713200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-11T20:07:21.801 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:21 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:21.563+0000 7f00bf713200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-11T20:07:21.801 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:21 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:21.688+0000 7f00bf713200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-11T20:07:22.196 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:22 smithi012 ceph-mon[128787]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:22.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:22.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-11T20:07:22.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:22.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:22.301 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:21 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:21.917+0000 7f00bf713200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-11T20:07:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-mon[102205]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-11T20:07:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:22.349 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:22 smithi032 ceph-mon[132488]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:22.349 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.349 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.349 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:22.350 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:22.350 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-11T20:07:22.350 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:22.350 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:22.701 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:22.408+0000 7f00bf713200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-11T20:07:22.702 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:22.581+0000 7f00bf713200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-11T20:07:23.009 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:22.702+0000 7f00bf713200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-11T20:07:23.009 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:22 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:22.835+0000 7f00bf713200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-11T20:07:23.034 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-11T20:07:23.034 INFO:teuthology.orchestra.run.smithi012.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-11T20:07:23.035 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10+0 records in 2023-12-11T20:07:23.035 INFO:teuthology.orchestra.run.smithi012.stderr:10+0 records out 2023-12-11T20:07:23.035 INFO:teuthology.orchestra.run.smithi012.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0342606 s, 306 MB/s 2023-12-11T20:07:23.035 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping successful for: 2023-12-11T20:07:23.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:23 smithi032 ceph-mon[132488]: Deploying daemon mgr.y on smithi032 2023-12-11T20:07:23.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:23 smithi039 ceph-mon[102205]: Deploying daemon mgr.y on smithi032 2023-12-11T20:07:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:23 smithi012 ceph-mon[128787]: Deploying daemon mgr.y on smithi032 2023-12-11T20:07:23.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi012:vg_nvme/lv_4 2023-12-11T20:07:23.713 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:23 smithi032 systemd[1]: Starting Ceph mgr.y for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:07:23.801 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:23 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:23.406+0000 7f00bf713200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-11T20:07:24.260 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:24 smithi032 ceph-mon[132488]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:24.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:24 smithi039 ceph-mon[102205]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:24 smithi012 ceph-mon[128787]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:07:24.523 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:24 smithi032 podman[133927]: 2023-12-11T20:07:24.523 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:24 smithi032 bash[133927]: 76487194e7c43671dc40d64c69bde9c711003d7fa1fcdda7ec87e943dfd0a5af 2023-12-11T20:07:24.801 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:24 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:24.335+0000 7f00bf713200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-11T20:07:24.801 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:24 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:24.444+0000 7f00bf713200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-11T20:07:24.803 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:24 smithi032 ceph-mgr[133967]: -- 172.21.15.32:0/653426952 <== mon.1 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c41b13d520 con 0x55c41b114800 2023-12-11T20:07:24.803 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:24 smithi032 systemd[1]: Started Ceph mgr.y for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:07:24.803 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:24 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:24.692+0000 7fd582555200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-11T20:07:25.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:24 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:24.804+0000 7fd582555200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-11T20:07:25.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:24 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:24.926+0000 7fd582555200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-11T20:07:25.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:25.053+0000 7fd582555200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-11T20:07:25.712 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:25.285+0000 7fd582555200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-11T20:07:25.801 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:25.479+0000 7f00bf713200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:07:25.801 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:25.609+0000 7f00bf713200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-11T20:07:25.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:25.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:25.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:25.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:25.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-mon[102205]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:25.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:25.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 -- 172.21.15.12:0/250666985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10181031c0 msgr2=0x7f1018109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:25.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 --2- 172.21.15.12:0/250666985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10181031c0 0x7f1018109a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f101000b0d0 tx=0x7f101000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:07:25.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 -- 172.21.15.12:0/250666985 shutdown_connections 2023-12-11T20:07:25.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 --2- 172.21.15.12:0/250666985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10181031c0 0x7f1018109a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:25.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 --2- 172.21.15.12:0/250666985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1018101620 0x7f1018101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:25.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 --2- 172.21.15.12:0/250666985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1018102820 0x7f1018102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:25.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 -- 172.21.15.12:0/250666985 >> 172.21.15.12:0/250666985 conn(0x7f10180fcbe0 msgr2=0x7f10180ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:25.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 -- 172.21.15.12:0/250666985 shutdown_connections 2023-12-11T20:07:25.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.870+0000 7f101e908700 1 -- 172.21.15.12:0/250666985 wait complete. 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.871+0000 7f101e908700 1 Processor -- start 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.871+0000 7f101e908700 1 -- start start 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.871+0000 7f101e908700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1018101620 0x7f1018197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f101e908700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1018102820 0x7f1018197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f101e908700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10181031c0 0x7f101819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f101e908700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101819f040 con 0x7f1018102820 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f101e908700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101819f180 con 0x7f1018101620 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f101e908700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101819f310 con 0x7f10181031c0 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1018101620 0x7f1018197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f10177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1018102820 0x7f1018197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1018101620 0x7f1018197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:45808/0 (socket says 172.21.15.12:45808) 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 -- 172.21.15.12:0/674272339 learned_addr learned my addr 172.21.15.12:0/674272339 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:07:25.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f101cea5700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10181031c0 0x7f101819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:25.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 -- 172.21.15.12:0/674272339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10181031c0 msgr2=0x7f101819ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:25.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10181031c0 0x7f101819ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 -- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1018102820 msgr2=0x7f1018197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1018102820 0x7f1018197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 -- 172.21.15.12:0/674272339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010009d00 con 0x7f1018101620 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.872+0000 7f1017fff700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1018101620 0x7f1018197500 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f100800e970 tx=0x7f100800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.873+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008009790 con 0x7f1018101620 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.873+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f100800c7e0 con 0x7f1018101620 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.873+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008003bd0 con 0x7f1018101620 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.873+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101819f5f0 con 0x7f1018101620 2023-12-11T20:07:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.873+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101819faa0 con 0x7f1018101620 2023-12-11T20:07:25.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.874+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 13) v1 ==== 45636+0+0 (secure 0 0 0) 0x7f1008003d30 con 0x7f1018101620 2023-12-11T20:07:25.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.874+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1018108a80 con 0x7f1018101620 2023-12-11T20:07:25.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.874+0000 7f10157fa700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1000038af0 0x7f100003afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:25.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.874+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1008014070 con 0x7f1018101620 2023-12-11T20:07:25.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.875+0000 7f10177fe700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1000038af0 0x7f100003afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:25.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.875+0000 7f10177fe700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1000038af0 0x7f100003afb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f100c009c60 tx=0x7f100c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:25.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:25.881+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f100800fbb0 con 0x7f1018101620 2023-12-11T20:07:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:25 smithi012 ceph-mon[128787]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:26.092 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:25.787+0000 7fd582555200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-11T20:07:26.092 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:25.967+0000 7fd582555200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-11T20:07:26.092 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:26.093 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:26.093 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:26.093 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:26.093 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-mon[132488]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:26.093 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:26.099+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f101802d380 con 0x7f1000038af0 2023-12-11T20:07:26.301 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:25 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:25.865+0000 7f00bf713200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:07:26.462 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:26 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:26.093+0000 7fd582555200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-11T20:07:26.463 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:26 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:26.221+0000 7fd582555200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-11T20:07:26.767 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:26 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:26.430+0000 7f00bf713200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-11T20:07:26.767 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:26 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:26.557+0000 7f00bf713200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-11T20:07:27.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:07:27.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:07:27.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:27.052 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:26 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:26.767+0000 7f00bf713200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-11T20:07:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:07:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:07:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:27.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:07:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:07:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:27.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:26 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:26.806+0000 7fd582555200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-11T20:07:27.551 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:27.143+0000 7f00bf713200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-11T20:07:28.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:28.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:28.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:28.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:28.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:28.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:28.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:28.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:27.748+0000 7fd582555200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:27.859+0000 7fd582555200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:28.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:28.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:28.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-11T20:07:28.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-11T20:07:28.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:28.551 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:28 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:28.118+0000 7f00bf713200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-11T20:07:28.551 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:28 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:28.300+0000 7f00bf713200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-11T20:07:29.004 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:28 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:28.563+0000 7f00bf713200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-11T20:07:29.004 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:28 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:28.714+0000 7f00bf713200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-11T20:07:29.212 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:28 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:28.859+0000 7fd582555200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:07:29.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:28 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:28.983+0000 7fd582555200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-11T20:07:29.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:29 smithi032 ceph-mon[132488]: Reconfiguring mgr.x (unknown last config time)... 2023-12-11T20:07:29.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:29 smithi032 ceph-mon[132488]: Reconfiguring daemon mgr.x on smithi012 2023-12-11T20:07:29.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:29 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:29.302 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:29 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:29.008+0000 7f00bf713200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-11T20:07:29.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:29 smithi039 ceph-mon[102205]: Reconfiguring mgr.x (unknown last config time)... 2023-12-11T20:07:29.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:29 smithi039 ceph-mon[102205]: Reconfiguring daemon mgr.x on smithi012 2023-12-11T20:07:29.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:29 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:29 smithi012 ceph-mon[128787]: Reconfiguring mgr.x (unknown last config time)... 2023-12-11T20:07:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:29 smithi012 ceph-mon[128787]: Reconfiguring daemon mgr.x on smithi012 2023-12-11T20:07:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:29.713 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:29 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:29.216+0000 7fd582555200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-11T20:07:30.005 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:29 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:29.756+0000 7fd582555200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-11T20:07:30.006 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:29 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:29.876+0000 7fd582555200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-11T20:07:30.301 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:07:30 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z[104203]: 2023-12-11T20:07:30.125+0000 7f00bf713200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-11T20:07:30.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:30 smithi039 ceph-mon[102205]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:30.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:30 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/354507456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d"}]: dispatch 2023-12-11T20:07:30.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:30 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/354507456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d"}]': finished 2023-12-11T20:07:30.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:30 smithi039 ceph-mon[102205]: osdmap e5: 1 total, 0 up, 1 in 2023-12-11T20:07:30.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:30 smithi012 ceph-mon[128787]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:30 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/354507456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d"}]: dispatch 2023-12-11T20:07:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:30 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/354507456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d"}]': finished 2023-12-11T20:07:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:30 smithi012 ceph-mon[128787]: osdmap e5: 1 total, 0 up, 1 in 2023-12-11T20:07:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:30.432 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:30 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:30.077+0000 7fd582555200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-11T20:07:30.432 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:30 smithi032 ceph-mon[132488]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:30.432 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:30 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/354507456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d"}]: dispatch 2023-12-11T20:07:30.432 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:30 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/354507456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d"}]': finished 2023-12-11T20:07:30.432 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:30 smithi032 ceph-mon[132488]: osdmap e5: 1 total, 0 up, 1 in 2023-12-11T20:07:30.432 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:30.712 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:30 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:30.433+0000 7fd582555200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-11T20:07:31.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:31.020+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mgrmap(e 14) v1 ==== 90793+0+0 (secure 0 0 0) 0x7f1008018950 con 0x7f1018101620 2023-12-11T20:07:31.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:31 smithi039 ceph-mon[102205]: Standby manager daemon z started 2023-12-11T20:07:31.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:31 smithi039 ceph-mon[102205]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-11T20:07:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:31 smithi039 ceph-mon[102205]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-11T20:07:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:31 smithi039 ceph-mon[102205]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-11T20:07:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:31 smithi039 ceph-mon[102205]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-11T20:07:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:31 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/83920310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:07:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:31 smithi012 ceph-mon[128787]: Standby manager daemon z started 2023-12-11T20:07:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:31 smithi012 ceph-mon[128787]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-11T20:07:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:31 smithi012 ceph-mon[128787]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-11T20:07:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:31 smithi012 ceph-mon[128787]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-11T20:07:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:31 smithi012 ceph-mon[128787]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-11T20:07:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:31 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/83920310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:07:31.396 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-mon[132488]: Standby manager daemon z started 2023-12-11T20:07:31.397 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-mon[132488]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-11T20:07:31.397 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-mon[132488]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-11T20:07:31.397 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-mon[132488]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-11T20:07:31.397 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-mon[132488]: from='mgr.? 172.21.15.39:0/1392886680' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-11T20:07:31.397 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/83920310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:07:31.712 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:31.397+0000 7fd582555200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-11T20:07:31.713 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:31.579+0000 7fd582555200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-11T20:07:32.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:32 smithi032 ceph-mon[132488]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:32.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:32 smithi032 ceph-mon[132488]: mgrmap e14: x(active, since 88s), standbys: z 2023-12-11T20:07:32.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:32 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-11T20:07:32.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:31.837+0000 7fd582555200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-11T20:07:32.213 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:31 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:31.989+0000 7fd582555200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-11T20:07:32.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:32 smithi039 ceph-mon[102205]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:32.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:32 smithi039 ceph-mon[102205]: mgrmap e14: x(active, since 88s), standbys: z 2023-12-11T20:07:32.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:32 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-11T20:07:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:32 smithi012 ceph-mon[128787]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:32 smithi012 ceph-mon[128787]: mgrmap e14: x(active, since 88s), standbys: z 2023-12-11T20:07:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:32 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-11T20:07:32.712 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:32 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:32.280+0000 7fd582555200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-11T20:07:33.713 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:07:33 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y[133943]: 2023-12-11T20:07:33.388+0000 7fd582555200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-11T20:07:33.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:33.932+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mon.2 v2:172.21.15.32:3300/0 8 ==== mgrmap(e 15) v1 ==== 135950+0+0 (secure 0 0 0) 0x7f100800f3c0 con 0x7f1018101620 2023-12-11T20:07:34.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:33 smithi032 ceph-mon[132488]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:34.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:33 smithi032 ceph-mon[132488]: Standby manager daemon y started 2023-12-11T20:07:34.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:33 smithi032 ceph-mon[132488]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-11T20:07:34.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:33 smithi032 ceph-mon[132488]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-11T20:07:34.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:33 smithi032 ceph-mon[132488]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-11T20:07:34.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:33 smithi032 ceph-mon[132488]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-11T20:07:34.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:33 smithi039 ceph-mon[102205]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:34.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:33 smithi039 ceph-mon[102205]: Standby manager daemon y started 2023-12-11T20:07:34.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:33 smithi039 ceph-mon[102205]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-11T20:07:34.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:33 smithi039 ceph-mon[102205]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-11T20:07:34.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:33 smithi039 ceph-mon[102205]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-11T20:07:34.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:33 smithi039 ceph-mon[102205]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-11T20:07:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:33 smithi012 ceph-mon[128787]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:33 smithi012 ceph-mon[128787]: Standby manager daemon y started 2023-12-11T20:07:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:33 smithi012 ceph-mon[128787]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-11T20:07:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:33 smithi012 ceph-mon[128787]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-11T20:07:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:33 smithi012 ceph-mon[128787]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-11T20:07:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:33 smithi012 ceph-mon[128787]: from='mgr.? 172.21.15.32:0/660654575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-11T20:07:35.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:34 smithi032 ceph-mon[132488]: mgrmap e15: x(active, since 91s), standbys: z, y 2023-12-11T20:07:35.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-11T20:07:35.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:34 smithi039 ceph-mon[102205]: mgrmap e15: x(active, since 91s), standbys: z, y 2023-12-11T20:07:35.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-11T20:07:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:34 smithi012 ceph-mon[128787]: mgrmap e15: x(active, since 91s), standbys: z, y 2023-12-11T20:07:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-11T20:07:36.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:35 smithi032 ceph-mon[132488]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:36.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:36.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:36.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:36.286 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:35 smithi012 ceph-mon[128787]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:36.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:36.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:36.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:36.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:35 smithi039 ceph-mon[102205]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:36.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:36.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:36.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:36 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:36 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:36 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:37.263 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:36 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:37.264 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:36 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:37.264 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:36 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:36 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:36 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:36 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:37 smithi032 ceph-mon[132488]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-11T20:07:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:38.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:37 smithi012 ceph-mon[128787]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:38.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-11T20:07:38.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:37 smithi039 ceph-mon[102205]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-11T20:07:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:39.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:38 smithi032 ceph-mon[132488]: Deploying daemon osd.0 on smithi012 2023-12-11T20:07:39.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:38 smithi012 ceph-mon[128787]: Deploying daemon osd.0 on smithi012 2023-12-11T20:07:39.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:38 smithi039 ceph-mon[102205]: Deploying daemon osd.0 on smithi012 2023-12-11T20:07:40.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:39 smithi032 ceph-mon[132488]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:40.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:39 smithi039 ceph-mon[102205]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:40.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:39 smithi012 ceph-mon[128787]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:42.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:41 smithi032 ceph-mon[132488]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:42.301 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:41 smithi012 ceph-mon[128787]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:42.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:41 smithi039 ceph-mon[102205]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:44.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:43 smithi032 ceph-mon[132488]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:44.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:44.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:44.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:44.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:43 smithi039 ceph-mon[102205]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:44.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:44.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:43 smithi012 ceph-mon[128787]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:46.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:46 smithi039 ceph-mon[102205]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:46 smithi012 ceph-mon[128787]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:46.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:46 smithi032 ceph-mon[132488]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:47.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.216+0000 7f10157fa700 1 -- 172.21.15.12:0/674272339 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f101802d380 con 0x7f1000038af0 2023-12-11T20:07:47.216 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 0 on host 'smithi012' 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1000038af0 msgr2=0x7f100003afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1000038af0 0x7f100003afb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f100c009c60 tx=0x7f100c009260 comp rx=0 tx=0).stop 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1018101620 msgr2=0x7f1018197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1018101620 0x7f1018197500 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f100800e970 tx=0x7f100800ec80 comp rx=0 tx=0).stop 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 shutdown_connections 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1000038af0 0x7f100003afb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1018101620 0x7f1018197500 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10181031c0 0x7f101819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:47.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 --2- 172.21.15.12:0/674272339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1018102820 0x7f1018197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:47.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 >> 172.21.15.12:0/674272339 conn(0x7f10180fcbe0 msgr2=0x7f1018105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:47.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 shutdown_connections 2023-12-11T20:07:47.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:07:47.219+0000 7f101e908700 1 -- 172.21.15.12:0/674272339 wait complete. 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:47.696 DEBUG:teuthology.orchestra.run.smithi012:osd.0> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.0.service 2023-12-11T20:07:47.700 INFO:tasks.cephadm:Deploying osd.1 on smithi032 with /dev/vg_nvme/lv_4... 2023-12-11T20:07:47.700 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-11T20:07:47.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:47.771 INFO:journalctl@ceph.osd.0.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:07:48.493 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:07:48.710 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:48 smithi012 ceph-mon[128787]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-11T20:07:48.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:48 smithi032 ceph-mon[132488]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-11T20:07:48.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:48 smithi039 ceph-mon[102205]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-11T20:07:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:49 smithi032 ceph-mon[132488]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-11T20:07:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:49 smithi032 ceph-mon[132488]: osdmap e6: 1 total, 0 up, 1 in 2023-12-11T20:07:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:49 smithi032 ceph-mon[132488]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:07:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:49 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:49 smithi032 ceph-mon[132488]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:49 smithi039 ceph-mon[102205]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-11T20:07:49.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:49 smithi039 ceph-mon[102205]: osdmap e6: 1 total, 0 up, 1 in 2023-12-11T20:07:49.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:49 smithi039 ceph-mon[102205]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:07:49.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:49 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:49.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:49 smithi039 ceph-mon[102205]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:49 smithi012 ceph-mon[128787]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-11T20:07:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:49 smithi012 ceph-mon[128787]: osdmap e6: 1 total, 0 up, 1 in 2023-12-11T20:07:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:49 smithi012 ceph-mon[128787]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:07:49.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:49.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:49 smithi012 ceph-mon[128787]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-11T20:07:49.831 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:07:49 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-0[144052]: 2023-12-11T20:07:49.409+0000 7f2c68fc0700 -1 osd.0 0 waiting for initial osdmap 2023-12-11T20:07:49.831 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:07:49 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-0[144052]: 2023-12-11T20:07:49.412+0000 7f2c61db4700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:07:50.644 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-11T20:07:50.644 INFO:teuthology.orchestra.run.smithi032.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-11T20:07:50.644 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10+0 records in 2023-12-11T20:07:50.644 INFO:teuthology.orchestra.run.smithi032.stderr:10+0 records out 2023-12-11T20:07:50.645 INFO:teuthology.orchestra.run.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0309659 s, 339 MB/s 2023-12-11T20:07:50.645 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 2023-12-11T20:07:50.645 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping successful for: 2023-12-11T20:07:50.681 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:50 smithi032 ceph-mon[132488]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:07:50.681 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:50 smithi032 ceph-mon[132488]: osdmap e7: 1 total, 0 up, 1 in 2023-12-11T20:07:50.681 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:50.681 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:50.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:50 smithi039 ceph-mon[102205]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:07:50.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:50 smithi039 ceph-mon[102205]: osdmap e7: 1 total, 0 up, 1 in 2023-12-11T20:07:50.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:50.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:50.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:50 smithi012 ceph-mon[128787]: from='osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:07:50.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:50 smithi012 ceph-mon[128787]: osdmap e7: 1 total, 0 up, 1 in 2023-12-11T20:07:50.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:50.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:51.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi032:vg_nvme/lv_4 2023-12-11T20:07:51.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:51 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:07:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:51 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:07:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:51 smithi032 ceph-mon[132488]: osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] boot 2023-12-11T20:07:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:51 smithi032 ceph-mon[132488]: osdmap e8: 1 total, 1 up, 1 in 2023-12-11T20:07:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:51 smithi032 ceph-mon[132488]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:51.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:51 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:07:51.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:51 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:07:51.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:51 smithi039 ceph-mon[102205]: osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] boot 2023-12-11T20:07:51.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:51 smithi039 ceph-mon[102205]: osdmap e8: 1 total, 1 up, 1 in 2023-12-11T20:07:51.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:51.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:51 smithi039 ceph-mon[102205]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:51.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:51 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:07:51.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:51 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:07:51.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:51 smithi012 ceph-mon[128787]: osd.0 [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] boot 2023-12-11T20:07:51.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:51 smithi012 ceph-mon[128787]: osdmap e8: 1 total, 1 up, 1 in 2023-12-11T20:07:51.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-11T20:07:51.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:51 smithi012 ceph-mon[128787]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:52.006 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:07:52.567 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: osdmap e9: 1 total, 1 up, 1 in 2023-12-11T20:07:52.567 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi012 2023-12-11T20:07:52.567 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.567 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.567 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:07:52.567 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi012 to 17276M 2023-12-11T20:07:52.567 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.567 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:52.568 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:52.568 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: osdmap e9: 1 total, 1 up, 1 in 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi012 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi012 to 17276M 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: osdmap e9: 1 total, 1 up, 1 in 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi012 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi012 to 17276M 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:07:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:07:53.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 -- 172.21.15.32:0/1892258812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 msgr2=0x7f9c0c102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 --2- 172.21.15.32:0/1892258812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 0x7f9c0c102c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c000099c0 tx=0x7f9c00009cd0 comp rx=0 tx=0).stop 2023-12-11T20:07:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 -- 172.21.15.32:0/1892258812 shutdown_connections 2023-12-11T20:07:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 --2- 172.21.15.32:0/1892258812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c0c1031c0 0x7f9c0c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 --2- 172.21.15.32:0/1892258812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c0c101620 0x7f9c0c101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 --2- 172.21.15.32:0/1892258812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 0x7f9c0c102c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 -- 172.21.15.32:0/1892258812 >> 172.21.15.32:0/1892258812 conn(0x7f9c0c0fcbe0 msgr2=0x7f9c0c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:07:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 -- 172.21.15.32:0/1892258812 shutdown_connections 2023-12-11T20:07:53.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.569+0000 7f9c1149b700 1 -- 172.21.15.32:0/1892258812 wait complete. 2023-12-11T20:07:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.570+0000 7f9c1149b700 1 Processor -- start 2023-12-11T20:07:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.570+0000 7f9c1149b700 1 -- start start 2023-12-11T20:07:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c1149b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c0c101620 0x7f9c0c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c1149b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 0x7f9c0c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c1149b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c0c1031c0 0x7f9c0c19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:53.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c1149b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c19f080 con 0x7f9c0c101620 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c1149b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c19f1c0 con 0x7f9c0c102820 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c1149b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c19f350 con 0x7f9c0c1031c0 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 0x7f9c0c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 0x7f9c0c197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46454/0 (socket says 172.21.15.32:46454) 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0a7fc700 1 -- 172.21.15.32:0/3783002022 learned_addr learned my addr 172.21.15.32:0/3783002022 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0b7fe700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c0c1031c0 0x7f9c0c19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0affd700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c0c101620 0x7f9c0c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0a7fc700 1 -- 172.21.15.32:0/3783002022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c0c1031c0 msgr2=0x7f9c0c19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0a7fc700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c0c1031c0 0x7f9c0c19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0a7fc700 1 -- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c0c101620 msgr2=0x7f9c0c197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0a7fc700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c0c101620 0x7f9c0c197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.571+0000 7f9c0a7fc700 1 -- 172.21.15.32:0/3783002022 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000095f0 con 0x7f9c0c102820 2023-12-11T20:07:53.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.572+0000 7f9c0a7fc700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 0x7f9c0c197a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c00000c00 tx=0x7f9c00003b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.572+0000 7f9bf3fff700 1 -- 172.21.15.32:0/3783002022 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0001d070 con 0x7f9c0c102820 2023-12-11T20:07:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.572+0000 7f9bf3fff700 1 -- 172.21.15.32:0/3783002022 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c0000bd30 con 0x7f9c0c102820 2023-12-11T20:07:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.572+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c19f5d0 con 0x7f9c0c102820 2023-12-11T20:07:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.572+0000 7f9bf3fff700 1 -- 172.21.15.32:0/3783002022 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00022dc0 con 0x7f9c0c102820 2023-12-11T20:07:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.572+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c19fa40 con 0x7f9c0c102820 2023-12-11T20:07:53.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.573+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c108ba0 con 0x7f9c0c102820 2023-12-11T20:07:53.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.575+0000 7f9bf3fff700 1 -- 172.21.15.32:0/3783002022 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 15) v1 ==== 135950+0+0 (secure 0 0 0) 0x7f9c00003ff0 con 0x7f9c0c102820 2023-12-11T20:07:53.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.576+0000 7f9bf3fff700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9bf40a14f0 0x7f9bf40a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:07:53.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.577+0000 7f9bf3fff700 1 -- 172.21.15.32:0/3783002022 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f9c000ccfa0 con 0x7f9c0c102820 2023-12-11T20:07:53.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.577+0000 7f9c0affd700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9bf40a14f0 0x7f9bf40a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:07:53.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.578+0000 7f9c0affd700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9bf40a14f0 0x7f9bf40a39b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc005950 tx=0x7f9bfc0058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:07:53.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.580+0000 7f9bf3fff700 1 -- 172.21.15.32:0/3783002022 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9c00098060 con 0x7f9c0c102820 2023-12-11T20:07:53.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:07:53.797+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c0c061a10 con 0x7f9bf40a14f0 2023-12-11T20:07:54.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:53 smithi032 ceph-mon[132488]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:07:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:07:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:54.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:53 smithi039 ceph-mon[102205]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:54.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:07:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:07:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:54.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:53 smithi012 ceph-mon[128787]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:54.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:07:54.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:07:54.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:07:55.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:54 smithi032 ceph-mon[132488]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:55.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:54 smithi039 ceph-mon[102205]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:55.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:54 smithi012 ceph-mon[128787]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:07:56.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:55 smithi032 ceph-mon[132488]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:56.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:55 smithi039 ceph-mon[102205]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:55 smithi012 ceph-mon[128787]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:58.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:58 smithi039 ceph-mon[102205]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:58 smithi039 ceph-mon[102205]: from='client.? 172.21.15.32:0/1422760989' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]: dispatch 2023-12-11T20:07:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:58 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]: dispatch 2023-12-11T20:07:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:58 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]': finished 2023-12-11T20:07:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:58 smithi039 ceph-mon[102205]: osdmap e10: 2 total, 1 up, 2 in 2023-12-11T20:07:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:07:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:07:58 smithi039 ceph-mon[102205]: from='client.? 172.21.15.32:0/2073925982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:07:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:58 smithi012 ceph-mon[128787]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:58 smithi012 ceph-mon[128787]: from='client.? 172.21.15.32:0/1422760989' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]: dispatch 2023-12-11T20:07:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:58 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]: dispatch 2023-12-11T20:07:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:58 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]': finished 2023-12-11T20:07:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:58 smithi012 ceph-mon[128787]: osdmap e10: 2 total, 1 up, 2 in 2023-12-11T20:07:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:07:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:07:58 smithi012 ceph-mon[128787]: from='client.? 172.21.15.32:0/2073925982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:07:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:58 smithi032 ceph-mon[132488]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:07:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:58 smithi032 ceph-mon[132488]: from='client.? 172.21.15.32:0/1422760989' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]: dispatch 2023-12-11T20:07:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:58 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]: dispatch 2023-12-11T20:07:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:58 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ced82c4f-0fb8-4d33-a889-952c83e51c99"}]': finished 2023-12-11T20:07:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:58 smithi032 ceph-mon[132488]: osdmap e10: 2 total, 1 up, 2 in 2023-12-11T20:07:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:07:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:07:58 smithi032 ceph-mon[132488]: from='client.? 172.21.15.32:0/2073925982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:08:00.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:00 smithi039 ceph-mon[102205]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:00 smithi012 ceph-mon[128787]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:00 smithi032 ceph-mon[132488]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:02.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:02 smithi039 ceph-mon[102205]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:02 smithi012 ceph-mon[128787]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:02.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:02 smithi032 ceph-mon[132488]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:04.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:03 smithi032 ceph-mon[132488]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:04.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:03 smithi039 ceph-mon[102205]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:03 smithi012 ceph-mon[128787]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:05.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-11T20:08:05.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:05.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-11T20:08:05.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-11T20:08:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:06.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:05 smithi032 ceph-mon[132488]: Deploying daemon osd.1 on smithi032 2023-12-11T20:08:06.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:05 smithi032 ceph-mon[132488]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:06.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:05 smithi039 ceph-mon[102205]: Deploying daemon osd.1 on smithi032 2023-12-11T20:08:06.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:05 smithi039 ceph-mon[102205]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:05 smithi012 ceph-mon[128787]: Deploying daemon osd.1 on smithi032 2023-12-11T20:08:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:05 smithi012 ceph-mon[128787]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:08.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:08 smithi032 ceph-mon[132488]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:08.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:08 smithi039 ceph-mon[102205]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:08 smithi012 ceph-mon[128787]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:10.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:10 smithi039 ceph-mon[102205]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:10 smithi012 ceph-mon[128787]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:10.398 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:10 smithi032 ceph-mon[132488]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:12.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:12 smithi032 ceph-mon[132488]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:12.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:12.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:12.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:12.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:12 smithi039 ceph-mon[102205]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:12.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:12.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:12.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:12 smithi012 ceph-mon[128787]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:14.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:13 smithi032 ceph-mon[132488]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:14.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:13 smithi039 ceph-mon[102205]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:13 smithi012 ceph-mon[128787]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:15.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.327+0000 7f9bf3fff700 1 -- 172.21.15.32:0/3783002022 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9c0c061a10 con 0x7f9bf40a14f0 2023-12-11T20:08:15.327 INFO:teuthology.orchestra.run.smithi032.stdout:Created osd(s) 1 on host 'smithi032' 2023-12-11T20:08:15.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9bf40a14f0 msgr2=0x7f9bf40a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9bf40a14f0 0x7f9bf40a39b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc005950 tx=0x7f9bfc0058e0 comp rx=0 tx=0).stop 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 msgr2=0x7f9c0c197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 0x7f9c0c197a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c00000c00 tx=0x7f9c00003b00 comp rx=0 tx=0).stop 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 shutdown_connections 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9bf40a14f0 0x7f9bf40a39b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c0c1031c0 0x7f9c0c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c0c101620 0x7f9c0c197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 --2- 172.21.15.32:0/3783002022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c0c102820 0x7f9c0c197a80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.329+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 >> 172.21.15.32:0/3783002022 conn(0x7f9c0c0fcbe0 msgr2=0x7f9c0c105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.330+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 shutdown_connections 2023-12-11T20:08:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:08:15.330+0000 7f9c1149b700 1 -- 172.21.15.32:0/3783002022 wait complete. 2023-12-11T20:08:15.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:15.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:15.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:15 smithi012 ceph-mon[128787]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:15.351 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.351 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.351 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:15.351 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:15.351 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.351 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:15 smithi032 ceph-mon[132488]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:15 smithi039 ceph-mon[102205]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:15.846 DEBUG:teuthology.orchestra.run.smithi032:osd.1> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.1.service 2023-12-11T20:08:15.853 INFO:tasks.cephadm:Deploying osd.2 on smithi039 with /dev/vg_nvme/lv_4... 2023-12-11T20:08:15.853 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-11T20:08:15.929 INFO:journalctl@ceph.osd.1.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:08:16.527 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:16.528 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:16 smithi032 ceph-mon[132488]: from='osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-11T20:08:16.528 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:16 smithi032 ceph-mon[132488]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-11T20:08:16.528 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:16.528 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:16 smithi039 ceph-mon[102205]: from='osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-11T20:08:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:16 smithi039 ceph-mon[102205]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-11T20:08:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:16 smithi012 ceph-mon[128787]: from='osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-11T20:08:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:16 smithi012 ceph-mon[128787]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-11T20:08:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:16.649 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: from='osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: osdmap e11: 2 total, 1 up, 2 in 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: osdmap e12: 2 total, 1 up, 2 in 2023-12-11T20:08:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:17.464 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-1[137660]: 2023-12-11T20:08:17.289+0000 7fa71e882700 -1 osd.1 0 waiting for initial osdmap 2023-12-11T20:08:17.464 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:17 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-1[137660]: 2023-12-11T20:08:17.294+0000 7fa71967a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:08:17.514 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-11T20:08:17.514 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: from='osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:08:17.514 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: osdmap e11: 2 total, 1 up, 2 in 2023-12-11T20:08:17.514 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:17.515 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:08:17.515 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:17.515 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:08:17.515 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: osdmap e12: 2 total, 1 up, 2 in 2023-12-11T20:08:17.515 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-11T20:08:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: from='osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:08:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: osdmap e11: 2 total, 1 up, 2 in 2023-12-11T20:08:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:08:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:08:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: osdmap e12: 2 total, 1 up, 2 in 2023-12-11T20:08:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:18 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:08:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:18 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:08:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:18 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:18.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:18 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:18.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:18 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:08:18.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:18 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:08:18.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:18 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:18.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:18 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:18.739 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-11T20:08:18.739 INFO:teuthology.orchestra.run.smithi039.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-11T20:08:18.739 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10+0 records in 2023-12-11T20:08:18.739 INFO:teuthology.orchestra.run.smithi039.stderr:10+0 records out 2023-12-11T20:08:18.739 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0507479 s, 207 MB/s 2023-12-11T20:08:18.739 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping successful for: 2023-12-11T20:08:18.776 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:18 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:08:18.776 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:18 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:08:18.777 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:18 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:18.777 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:18 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:19.145 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi039:vg_nvme/lv_4 2023-12-11T20:08:19.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:19 smithi039 ceph-mon[102205]: osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] boot 2023-12-11T20:08:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:19 smithi039 ceph-mon[102205]: osdmap e13: 2 total, 2 up, 2 in 2023-12-11T20:08:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:19 smithi039 ceph-mon[102205]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:19 smithi012 ceph-mon[128787]: osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] boot 2023-12-11T20:08:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:19 smithi012 ceph-mon[128787]: osdmap e13: 2 total, 2 up, 2 in 2023-12-11T20:08:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:19 smithi012 ceph-mon[128787]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:19.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:19 smithi032 ceph-mon[132488]: osd.1 [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] boot 2023-12-11T20:08:19.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:19 smithi032 ceph-mon[132488]: osdmap e13: 2 total, 2 up, 2 in 2023-12-11T20:08:19.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-11T20:08:19.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:19 smithi032 ceph-mon[132488]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-11T20:08:19.929 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:08:20.460 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: osdmap e14: 2 total, 2 up, 2 in 2023-12-11T20:08:20.460 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi032 2023-12-11T20:08:20.460 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.460 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.460 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:08:20.461 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi032 to 17276M 2023-12-11T20:08:20.461 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.461 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:20.461 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:20.461 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: osdmap e14: 2 total, 2 up, 2 in 2023-12-11T20:08:20.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi032 2023-12-11T20:08:20.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:08:20.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi032 to 17276M 2023-12-11T20:08:20.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:20.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:20.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: osdmap e14: 2 total, 2 up, 2 in 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi032 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi032 to 17276M 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:21.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.330+0000 7fa9786ff700 1 -- 172.21.15.39:0/4112750900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 msgr2=0x7fa970073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:21.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.330+0000 7fa9786ff700 1 --2- 172.21.15.39:0/4112750900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 0x7fa970073a60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009990 tx=0x7fa96c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:08:21.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.330+0000 7fa9786ff700 1 -- 172.21.15.39:0/4112750900 shutdown_connections 2023-12-11T20:08:21.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.330+0000 7fa9786ff700 1 --2- 172.21.15.39:0/4112750900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9701094f0 0x7fa97010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:21.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.330+0000 7fa9786ff700 1 --2- 172.21.15.39:0/4112750900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 0x7fa970073a60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:21.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.330+0000 7fa9786ff700 1 --2- 172.21.15.39:0/4112750900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970074030 0x7fa9700744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:21.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.330+0000 7fa9786ff700 1 -- 172.21.15.39:0/4112750900 >> 172.21.15.39:0/4112750900 conn(0x7fa9700fcbe0 msgr2=0x7fa9700ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:08:21.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.330+0000 7fa9786ff700 1 -- 172.21.15.39:0/4112750900 shutdown_connections 2023-12-11T20:08:21.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.331+0000 7fa9786ff700 1 -- 172.21.15.39:0/4112750900 wait complete. 2023-12-11T20:08:21.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.331+0000 7fa9786ff700 1 Processor -- start 2023-12-11T20:08:21.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa9786ff700 1 -- start start 2023-12-11T20:08:21.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa9786ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970074030 0x7fa970199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa9786ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 0x7fa970199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa9786ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9701094f0 0x7fa9701a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa9786ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9701a12c0 con 0x7fa970074030 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa9786ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9701a1400 con 0x7fa9701094f0 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa9786ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9701a1590 con 0x7fa970075600 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa975c9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 0x7fa970199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa975c9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 0x7fa970199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48540/0 (socket says 172.21.15.39:48540) 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa975c9a700 1 -- 172.21.15.39:0/3066696796 learned_addr learned my addr 172.21.15.39:0/3066696796 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa97649b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970074030 0x7fa970199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.332+0000 7fa976c9c700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9701094f0 0x7fa9701a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa975c9a700 1 -- 172.21.15.39:0/3066696796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9701094f0 msgr2=0x7fa9701a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa975c9a700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9701094f0 0x7fa9701a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:21.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa975c9a700 1 -- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970074030 msgr2=0x7fa970199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa975c9a700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970074030 0x7fa970199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa975c9a700 1 -- 172.21.15.39:0/3066696796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c0095f0 con 0x7fa970075600 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa975c9a700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 0x7fa970199cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e9a0 tx=0x7fa96000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa9677fe700 1 -- 172.21.15.39:0/3066696796 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960009790 con 0x7fa970075600 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa9677fe700 1 -- 172.21.15.39:0/3066696796 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa96000c810 con 0x7fa970075600 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9701a1870 con 0x7fa970075600 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa9677fe700 1 -- 172.21.15.39:0/3066696796 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960003bd0 con 0x7fa970075600 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.333+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9701a1d70 con 0x7fa970075600 2023-12-11T20:08:21.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.334+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9701082b0 con 0x7fa970075600 2023-12-11T20:08:21.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.337+0000 7fa9677fe700 1 -- 172.21.15.39:0/3066696796 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) v1 ==== 135950+0+0 (secure 0 0 0) 0x7fa96000c980 con 0x7fa970075600 2023-12-11T20:08:21.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.338+0000 7fa9677fe700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa95c0a13f0 0x7fa95c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:08:21.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.338+0000 7fa9677fe700 1 -- 172.21.15.39:0/3066696796 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fa960014070 con 0x7fa970075600 2023-12-11T20:08:21.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.338+0000 7fa97649b700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa95c0a13f0 0x7fa95c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:08:21.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.339+0000 7fa97649b700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa95c0a13f0 0x7fa95c0a38b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa96c006010 tx=0x7fa96c00b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:08:21.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.341+0000 7fa9677fe700 1 -- 172.21.15.39:0/3066696796 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa960096630 con 0x7fa970075600 2023-12-11T20:08:21.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:21 smithi039 ceph-mon[102205]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:21.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:21.560+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa97002d380 con 0x7fa95c0a13f0 2023-12-11T20:08:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:21 smithi012 ceph-mon[128787]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:21.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:21 smithi032 ceph-mon[132488]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:22.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:22 smithi012 ceph-mon[128787]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:08:22.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:08:22.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:08:22.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:22 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:22.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:22 smithi032 ceph-mon[132488]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:08:22.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:08:22.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:08:22.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:22 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:22.714 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:22 smithi039 ceph-mon[102205]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:08:22.714 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:08:22.714 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:08:22.715 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:22 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:24.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:23 smithi039 ceph-mon[102205]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:23 smithi032 ceph-mon[132488]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:23 smithi012 ceph-mon[128787]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:24 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/2058492776' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]: dispatch 2023-12-11T20:08:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:24 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]: dispatch 2023-12-11T20:08:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:24 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]': finished 2023-12-11T20:08:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:24 smithi032 ceph-mon[132488]: osdmap e15: 3 total, 2 up, 3 in 2023-12-11T20:08:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:25.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:24 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/2058492776' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]: dispatch 2023-12-11T20:08:25.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:24 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]: dispatch 2023-12-11T20:08:25.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:24 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]': finished 2023-12-11T20:08:25.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:24 smithi039 ceph-mon[102205]: osdmap e15: 3 total, 2 up, 3 in 2023-12-11T20:08:25.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:24 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/2058492776' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]: dispatch 2023-12-11T20:08:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:24 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]: dispatch 2023-12-11T20:08:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:24 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "447b88d3-b083-4d3e-aa61-1c9971321335"}]': finished 2023-12-11T20:08:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:24 smithi012 ceph-mon[128787]: osdmap e15: 3 total, 2 up, 3 in 2023-12-11T20:08:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:26.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:25 smithi032 ceph-mon[132488]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:26.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:25 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/159543525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:08:26.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:25 smithi039 ceph-mon[102205]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:26.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:25 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/159543525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:08:26.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:25 smithi012 ceph-mon[128787]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:26.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:25 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/159543525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:08:28.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:28 smithi039 ceph-mon[102205]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:28 smithi012 ceph-mon[128787]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:28.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:28 smithi032 ceph-mon[132488]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:30.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:30 smithi039 ceph-mon[102205]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:30 smithi012 ceph-mon[128787]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:30.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:30 smithi032 ceph-mon[132488]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:32.280 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:32 smithi039 ceph-mon[102205]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:32 smithi012 ceph-mon[128787]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:32 smithi032 ceph-mon[132488]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:33.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-11T20:08:33.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:33.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-11T20:08:33.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:33.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-11T20:08:33.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:34.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:34 smithi039 ceph-mon[102205]: Deploying daemon osd.2 on smithi039 2023-12-11T20:08:34.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:34 smithi039 ceph-mon[102205]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:34 smithi012 ceph-mon[128787]: Deploying daemon osd.2 on smithi039 2023-12-11T20:08:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:34 smithi012 ceph-mon[128787]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:34.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:34 smithi032 ceph-mon[132488]: Deploying daemon osd.2 on smithi039 2023-12-11T20:08:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:34 smithi032 ceph-mon[132488]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:36.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:36 smithi039 ceph-mon[102205]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:36.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:36 smithi012 ceph-mon[128787]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:36.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:36 smithi032 ceph-mon[132488]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:38 smithi039 ceph-mon[102205]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:38 smithi012 ceph-mon[128787]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:38 smithi032 ceph-mon[132488]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:39.915 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:39.915 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:39.916 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:39.916 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:39 smithi039 ceph-mon[102205]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:39.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:39.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:39.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:39.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:39 smithi032 ceph-mon[132488]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:40.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:40.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:40.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:40.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:39 smithi012 ceph-mon[128787]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:42.220 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:42 smithi039 ceph-mon[102205]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:42.220 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.220 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.220 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:42.220 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:42.220 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.237 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 2 on host 'smithi039' 2023-12-11T20:08:42.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.238+0000 7fa9677fe700 1 -- 172.21.15.39:0/3066696796 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa97002d380 con 0x7fa95c0a13f0 2023-12-11T20:08:42.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa95c0a13f0 msgr2=0x7fa95c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:42.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa95c0a13f0 0x7fa95c0a38b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa96c006010 tx=0x7fa96c00b610 comp rx=0 tx=0).stop 2023-12-11T20:08:42.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 msgr2=0x7fa970199cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 0x7fa970199cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e9a0 tx=0x7fa96000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 shutdown_connections 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa95c0a13f0 0x7fa95c0a38b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9701094f0 0x7fa9701a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970074030 0x7fa970199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 --2- 172.21.15.39:0/3066696796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa970075600 0x7fa970199cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 >> 172.21.15.39:0/3066696796 conn(0x7fa9700fcbe0 msgr2=0x7fa9701053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 shutdown_connections 2023-12-11T20:08:42.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:08:42.241+0000 7fa9786ff700 1 -- 172.21.15.39:0/3066696796 wait complete. 2023-12-11T20:08:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:42 smithi012 ceph-mon[128787]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:42 smithi032 ceph-mon[132488]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:42.670 DEBUG:teuthology.orchestra.run.smithi039:osd.2> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.2.service 2023-12-11T20:08:42.674 INFO:tasks.cephadm:Deploying osd.3 on smithi012 with /dev/vg_nvme/lv_3... 2023-12-11T20:08:42.675 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-11T20:08:42.746 INFO:journalctl@ceph.osd.2.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:08:43.470 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:08:43.522 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:43.523 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:43.523 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:43.523 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:43 smithi039 ceph-mon[102205]: from='osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-11T20:08:43.523 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:43 smithi039 ceph-mon[102205]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-11T20:08:43.523 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:43 smithi039 ceph-mon[102205]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:43 smithi012 ceph-mon[128787]: from='osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-11T20:08:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:43 smithi012 ceph-mon[128787]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-11T20:08:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:43 smithi012 ceph-mon[128787]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:08:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:43 smithi032 ceph-mon[132488]: from='osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-11T20:08:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:43 smithi032 ceph-mon[132488]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-11T20:08:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:43 smithi032 ceph-mon[132488]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:44.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:44 smithi012 ceph-mon[128787]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-11T20:08:44.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:44 smithi012 ceph-mon[128787]: osdmap e16: 3 total, 2 up, 3 in 2023-12-11T20:08:44.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:44 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:44.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:44 smithi012 ceph-mon[128787]: from='osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:08:44.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:44 smithi012 ceph-mon[128787]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:08:44.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:44 smithi039 ceph-mon[102205]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-11T20:08:44.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:44 smithi039 ceph-mon[102205]: osdmap e16: 3 total, 2 up, 3 in 2023-12-11T20:08:44.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:44 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:44.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:44 smithi039 ceph-mon[102205]: from='osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:08:44.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:44 smithi039 ceph-mon[102205]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:08:44.552 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:44 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-2[107948]: 2023-12-11T20:08:44.236+0000 7fe9afd30700 -1 osd.2 0 waiting for initial osdmap 2023-12-11T20:08:44.552 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:44 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-2[107948]: 2023-12-11T20:08:44.254+0000 7fe9a9b26700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:08:44.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:44 smithi032 ceph-mon[132488]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-11T20:08:44.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:44 smithi032 ceph-mon[132488]: osdmap e16: 3 total, 2 up, 3 in 2023-12-11T20:08:44.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:44 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:44.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:44 smithi032 ceph-mon[132488]: from='osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:08:44.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:44 smithi032 ceph-mon[132488]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:08:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:45 smithi039 ceph-mon[102205]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:08:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:45 smithi039 ceph-mon[102205]: osdmap e17: 3 total, 2 up, 3 in 2023-12-11T20:08:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:45 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:45 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:45 smithi039 ceph-mon[102205]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:45 smithi012 ceph-mon[128787]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:08:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:45 smithi012 ceph-mon[128787]: osdmap e17: 3 total, 2 up, 3 in 2023-12-11T20:08:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:45 smithi012 ceph-mon[128787]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:45 smithi032 ceph-mon[132488]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:08:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:45 smithi032 ceph-mon[132488]: osdmap e17: 3 total, 2 up, 3 in 2023-12-11T20:08:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:45 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:45 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:45 smithi032 ceph-mon[132488]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-11T20:08:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-11T20:08:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-11T20:08:45.718 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10+0 records in 2023-12-11T20:08:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:10+0 records out 2023-12-11T20:08:45.718 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0308219 s, 340 MB/s 2023-12-11T20:08:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping successful for: 2023-12-11T20:08:46.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi012:vg_nvme/lv_3 2023-12-11T20:08:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:46 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:08:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:46 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:08:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:46 smithi012 ceph-mon[128787]: osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] boot 2023-12-11T20:08:46.333 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:46 smithi012 ceph-mon[128787]: osdmap e18: 3 total, 3 up, 3 in 2023-12-11T20:08:46.333 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:46 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:46 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:08:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:46 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:08:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:46 smithi039 ceph-mon[102205]: osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] boot 2023-12-11T20:08:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:46 smithi039 ceph-mon[102205]: osdmap e18: 3 total, 3 up, 3 in 2023-12-11T20:08:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:46 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:46 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:08:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:46 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:08:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:46 smithi032 ceph-mon[132488]: osd.2 [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] boot 2023-12-11T20:08:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:46 smithi032 ceph-mon[132488]: osdmap e18: 3 total, 3 up, 3 in 2023-12-11T20:08:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:46 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-11T20:08:47.070 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:08:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:08:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:47.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:47.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:08:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:48.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:48.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:48.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:08:48.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:48.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:48.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:08:48.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:48.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.824+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/471365201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 msgr2=0x7f6eb0073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:48.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.824+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/471365201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 0x7f6eb0073a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009990 tx=0x7f6eac009ca0 comp rx=0 tx=0).stop 2023-12-11T20:08:48.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.824+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/471365201 shutdown_connections 2023-12-11T20:08:48.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.824+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/471365201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6eb010dc00 0x7f6eb010fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:48.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.824+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/471365201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 0x7f6eb0073a60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:48.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.824+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/471365201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6eb0074030 0x7f6eb00744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:48.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.824+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/471365201 >> 172.21.15.12:0/471365201 conn(0x7f6eb00fcbe0 msgr2=0x7f6eb00ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:08:48.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.825+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/471365201 shutdown_connections 2023-12-11T20:08:48.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.825+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/471365201 wait complete. 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb7b6f700 1 Processor -- start 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb7b6f700 1 -- start start 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb7b6f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6eb0074030 0x7f6eb019daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb7b6f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 0x7f6eb019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb7b6f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6eb010dc00 0x7f6eb01a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb7b6f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01a5630 con 0x7f6eb0075600 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb7b6f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01a5770 con 0x7f6eb0074030 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb7b6f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01a5900 con 0x7f6eb010dc00 2023-12-11T20:08:48.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.826+0000 7f6eb510a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 0x7f6eb019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb510a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 0x7f6eb019e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41524/0 (socket says 172.21.15.12:41524) 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb510a700 1 -- 172.21.15.12:0/1659325618 learned_addr learned my addr 172.21.15.12:0/1659325618 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb590b700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6eb0074030 0x7f6eb019daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb610c700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6eb010dc00 0x7f6eb01a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb510a700 1 -- 172.21.15.12:0/1659325618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6eb010dc00 msgr2=0x7f6eb01a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb510a700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6eb010dc00 0x7f6eb01a5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb510a700 1 -- 172.21.15.12:0/1659325618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6eb0074030 msgr2=0x7f6eb019daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb510a700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6eb0074030 0x7f6eb019daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb510a700 1 -- 172.21.15.12:0/1659325618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0095f0 con 0x7f6eb0075600 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.827+0000 7f6eb510a700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 0x7f6eb019e030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000d9b0 tx=0x7f6ea000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.828+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1659325618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea000b950 con 0x7f6eb0075600 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.828+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1659325618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ea0007620 con 0x7f6eb0075600 2023-12-11T20:08:48.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.828+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1659325618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0010ea0 con 0x7f6eb0075600 2023-12-11T20:08:48.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.828+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb01a5be0 con 0x7f6eb0075600 2023-12-11T20:08:48.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.828+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb01a6090 con 0x7f6eb0075600 2023-12-11T20:08:48.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.829+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb0103750 con 0x7f6eb0075600 2023-12-11T20:08:48.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:48 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi039 2023-12-11T20:08:48.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:48 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi039 to 17271M 2023-12-11T20:08:48.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:48 smithi012 ceph-mon[128787]: pgmap v90: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:48.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:48 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-11T20:08:48.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:48 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-11T20:08:48.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:48 smithi012 ceph-mon[128787]: osdmap e19: 3 total, 3 up, 3 in 2023-12-11T20:08:48.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:48 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-11T20:08:48.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:48 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-11T20:08:48.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.833+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1659325618 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) v1 ==== 135950+0+0 (secure 0 0 0) 0x7f6ea000bab0 con 0x7f6eb0075600 2023-12-11T20:08:48.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.835+0000 7f6ea6ffd700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e9c0a13f0 0x7f6e9c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:08:48.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.835+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1659325618 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f6ea00cbb50 con 0x7f6eb0075600 2023-12-11T20:08:48.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.835+0000 7f6eb590b700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e9c0a13f0 0x7f6e9c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:08:48.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.836+0000 7f6eb590b700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e9c0a13f0 0x7f6e9c0a38b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6eac006010 tx=0x7f6eac00b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:08:48.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:48.837+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1659325618 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6ea00965c0 con 0x7f6eb0075600 2023-12-11T20:08:48.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:48 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi039 2023-12-11T20:08:48.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:48 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi039 to 17271M 2023-12-11T20:08:48.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:48 smithi032 ceph-mon[132488]: pgmap v90: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:48.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:48 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-11T20:08:48.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:48 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-11T20:08:48.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:48 smithi032 ceph-mon[132488]: osdmap e19: 3 total, 3 up, 3 in 2023-12-11T20:08:48.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:48 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-11T20:08:48.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:48 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-11T20:08:49.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:48 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi039 2023-12-11T20:08:49.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:48 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi039 to 17271M 2023-12-11T20:08:49.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:48 smithi039 ceph-mon[102205]: pgmap v90: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:49.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:48 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-11T20:08:49.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:48 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-11T20:08:49.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:48 smithi039 ceph-mon[102205]: osdmap e19: 3 total, 3 up, 3 in 2023-12-11T20:08:49.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:48 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-11T20:08:49.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:48 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-11T20:08:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:49.058+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eb002d420 con 0x7f6e9c0a13f0 2023-12-11T20:08:49.580 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:08:49 smithi012 sudo[150163]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-11T20:08:49.580 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:08:49 smithi012 sudo[150163]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:49.580 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:08:49 smithi012 sudo[150163]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:49.580 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:08:49 smithi012 sudo[150163]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:49.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:08:49.588+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1659325618 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6ea0096990 con 0x7f6eb0075600 2023-12-11T20:08:49.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:49 smithi032 ceph-mon[132488]: osdmap e20: 3 total, 3 up, 3 in 2023-12-11T20:08:49.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:49 smithi032 ceph-mon[132488]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:49.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:49 smithi032 ceph-mon[132488]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:08:49.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:49 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:08:49.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:49 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:08:49.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:49 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:49.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:49 smithi032 ceph-mon[132488]: osdmap e21: 3 total, 3 up, 3 in 2023-12-11T20:08:50.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:49 smithi039 ceph-mon[102205]: osdmap e20: 3 total, 3 up, 3 in 2023-12-11T20:08:50.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:49 smithi039 ceph-mon[102205]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:50.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:49 smithi039 ceph-mon[102205]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:08:50.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:49 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:08:50.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:49 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:08:50.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:49 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:50.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:49 smithi039 ceph-mon[102205]: osdmap e21: 3 total, 3 up, 3 in 2023-12-11T20:08:50.080 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:08:49 smithi012 sudo[150201]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-11T20:08:50.080 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:08:49 smithi012 sudo[150201]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:50.080 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:08:49 smithi012 sudo[150201]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:50.080 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:08:49 smithi012 sudo[150201]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:50.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:49 smithi012 ceph-mon[128787]: osdmap e20: 3 total, 3 up, 3 in 2023-12-11T20:08:50.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:49 smithi012 ceph-mon[128787]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:50.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:49 smithi012 ceph-mon[128787]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:08:50.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:08:50.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:08:50.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:08:50.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:49 smithi012 ceph-mon[128787]: osdmap e21: 3 total, 3 up, 3 in 2023-12-11T20:08:50.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:50 smithi032 ceph-mon[132488]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-11T20:08:50.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:50.713 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:50 smithi032 sudo[142392]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-11T20:08:50.713 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:50 smithi032 sudo[142392]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:50.713 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:50 smithi032 sudo[142392]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:50.713 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:50 smithi032 sudo[142392]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:50.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:50 smithi012 ceph-mon[128787]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-11T20:08:50.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:51.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:50 smithi039 ceph-mon[102205]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-11T20:08:51.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:51.212 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:50 smithi032 sudo[142395]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-11T20:08:51.213 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:50 smithi032 sudo[142395]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:51.213 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:50 smithi032 sudo[142395]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:51.213 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:08:50 smithi032 sudo[142395]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:51.801 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:51 smithi039 sudo[113052]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-11T20:08:51.802 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:51 smithi039 sudo[113052]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:51.802 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:51 smithi039 sudo[113052]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:51.802 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:51 smithi039 sudo[113052]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:52.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:52.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:51 smithi039 ceph-mon[102205]: pgmap v95: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:52.302 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:52 smithi039 sudo[113055]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-11T20:08:52.302 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:52 smithi039 sudo[113055]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:52.302 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:52 smithi039 sudo[113055]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:52.302 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:08:52 smithi039 sudo[113055]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:52.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:52.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:51 smithi012 ceph-mon[128787]: pgmap v95: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:51 smithi032 ceph-mon[132488]: pgmap v95: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:52 smithi012 sudo[150369]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-11T20:08:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:52 smithi012 sudo[150369]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:52 smithi012 sudo[150369]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:52 smithi012 sudo[150369]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:53.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:53.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:53 smithi032 ceph-mon[132488]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:53 smithi039 ceph-mon[102205]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:53 smithi012 sudo[150372]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-11T20:08:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:53 smithi012 sudo[150372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:53 smithi012 sudo[150372]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:53 smithi012 sudo[150372]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:08:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:53 smithi012 ceph-mon[128787]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:54.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:53 smithi039 sudo[113058]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-11T20:08:54.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:53 smithi039 sudo[113058]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:54.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:53 smithi039 sudo[113058]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:53 smithi039 sudo[113058]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 sudo[113061]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 sudo[113061]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 sudo[113061]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 sudo[113061]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: pgmap v96: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/855042714' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9e8e074-7466-40c2-8850-fa247fe45dc6"}]: dispatch 2023-12-11T20:08:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:54.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:54.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/855042714' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9e8e074-7466-40c2-8850-fa247fe45dc6"}]': finished 2023-12-11T20:08:54.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: osdmap e22: 4 total, 3 up, 4 in 2023-12-11T20:08:54.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:08:54.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:54.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:54.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:54.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2169055676' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:08:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: pgmap v96: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:54.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/855042714' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9e8e074-7466-40c2-8850-fa247fe45dc6"}]: dispatch 2023-12-11T20:08:54.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:54.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:54.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/855042714' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9e8e074-7466-40c2-8850-fa247fe45dc6"}]': finished 2023-12-11T20:08:54.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: osdmap e22: 4 total, 3 up, 4 in 2023-12-11T20:08:54.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:08:54.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:54.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:54.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:54.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2169055676' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:08:55.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:54 smithi032 sudo[142398]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-11T20:08:55.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:54 smithi032 sudo[142398]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:55.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:54 smithi032 sudo[142398]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:55.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:54 smithi032 sudo[142398]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 sudo[142401]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-11T20:08:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 sudo[142401]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-11T20:08:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 sudo[142401]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-11T20:08:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 sudo[142401]: pam_unix(sudo:session): session closed for user root 2023-12-11T20:08:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: pgmap v96: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:08:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/855042714' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9e8e074-7466-40c2-8850-fa247fe45dc6"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/855042714' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9e8e074-7466-40c2-8850-fa247fe45dc6"}]': finished 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: osdmap e22: 4 total, 3 up, 4 in 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2169055676' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:55 smithi032 ceph-mon[132488]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 290 KiB/s wr, 18 op/s 2023-12-11T20:08:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:55 smithi039 ceph-mon[102205]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:55 smithi039 ceph-mon[102205]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:55 smithi039 ceph-mon[102205]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 290 KiB/s wr, 18 op/s 2023-12-11T20:08:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:55 smithi012 ceph-mon[128787]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:55 smithi012 ceph-mon[128787]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-11T20:08:55.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-11T20:08:55.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-11T20:08:55.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:55 smithi012 ceph-mon[128787]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 290 KiB/s wr, 18 op/s 2023-12-11T20:08:56.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:56 smithi032 ceph-mon[132488]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:56.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:56 smithi032 ceph-mon[132488]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:56.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:56 smithi039 ceph-mon[102205]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:56.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:56 smithi039 ceph-mon[102205]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:56 smithi012 ceph-mon[128787]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-11T20:08:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:56 smithi012 ceph-mon[128787]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-11T20:08:57.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:57 smithi012 ceph-mon[128787]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 212 KiB/s wr, 13 op/s 2023-12-11T20:08:57.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:57 smithi032 ceph-mon[132488]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 212 KiB/s wr, 13 op/s 2023-12-11T20:08:57.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:57 smithi039 ceph-mon[102205]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 212 KiB/s wr, 13 op/s 2023-12-11T20:08:59.278 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:08:59 smithi012 ceph-mon[128787]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-12-11T20:08:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:08:59 smithi032 ceph-mon[132488]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-12-11T20:08:59.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:08:59 smithi039 ceph-mon[102205]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-12-11T20:09:01.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-11T20:09:01.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-11T20:09:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-11T20:09:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:02.231 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:02 smithi012 ceph-mon[128787]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-12-11T20:09:02.231 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:02 smithi012 ceph-mon[128787]: Deploying daemon osd.3 on smithi012 2023-12-11T20:09:02.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:02 smithi032 ceph-mon[132488]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-12-11T20:09:02.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:02 smithi032 ceph-mon[132488]: Deploying daemon osd.3 on smithi012 2023-12-11T20:09:02.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:02 smithi039 ceph-mon[102205]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-12-11T20:09:02.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:02 smithi039 ceph-mon[102205]: Deploying daemon osd.3 on smithi012 2023-12-11T20:09:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:04 smithi012 ceph-mon[128787]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-12-11T20:09:04.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:04 smithi032 ceph-mon[132488]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-12-11T20:09:04.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:04 smithi039 ceph-mon[102205]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-12-11T20:09:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:06 smithi012 ceph-mon[128787]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-12-11T20:09:06.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:06 smithi032 ceph-mon[132488]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-12-11T20:09:06.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:06 smithi039 ceph-mon[102205]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-12-11T20:09:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:08 smithi012 ceph-mon[128787]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:08 smithi032 ceph-mon[132488]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:08.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:08 smithi039 ceph-mon[102205]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:08.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:08.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:08.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:09.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:09 smithi012 ceph-mon[128787]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:09.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:09 smithi032 ceph-mon[132488]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:09.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:09 smithi039 ceph-mon[102205]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:10.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.922+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1659325618 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6eb002d420 con 0x7f6e9c0a13f0 2023-12-11T20:09:10.921 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 3 on host 'smithi012' 2023-12-11T20:09:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.924+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e9c0a13f0 msgr2=0x7f6e9c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.924+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e9c0a13f0 0x7f6e9c0a38b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6eac006010 tx=0x7f6eac00b610 comp rx=0 tx=0).stop 2023-12-11T20:09:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.924+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 msgr2=0x7f6eb019e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.924+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 0x7f6eb019e030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000d9b0 tx=0x7f6ea000dcc0 comp rx=0 tx=0).stop 2023-12-11T20:09:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.925+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 shutdown_connections 2023-12-11T20:09:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.925+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e9c0a13f0 0x7f6e9c0a38b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.925+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6eb0074030 0x7f6eb019daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.925+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6eb010dc00 0x7f6eb01a5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.925+0000 7f6eb7b6f700 1 --2- 172.21.15.12:0/1659325618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6eb0075600 0x7f6eb019e030 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.925+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 >> 172.21.15.12:0/1659325618 conn(0x7f6eb00fcbe0 msgr2=0x7f6eb00fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:09:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.925+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 shutdown_connections 2023-12-11T20:09:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:09:10.925+0000 7f6eb7b6f700 1 -- 172.21.15.12:0/1659325618 wait complete. 2023-12-11T20:09:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:11.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.319 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.319 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:11.319 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:11.319 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.319 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.319 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.319 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:11.422 DEBUG:teuthology.orchestra.run.smithi012:osd.3> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.3.service 2023-12-11T20:09:11.427 INFO:tasks.cephadm:Deploying osd.4 on smithi032 with /dev/vg_nvme/lv_3... 2023-12-11T20:09:11.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-11T20:09:11.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:11.525 INFO:journalctl@ceph.osd.3.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:09:12.243 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:09:12.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:12 smithi039 ceph-mon[102205]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:12.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:12 smithi039 ceph-mon[102205]: from='osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-11T20:09:12.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:12 smithi039 ceph-mon[102205]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-11T20:09:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:12 smithi012 ceph-mon[128787]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:12 smithi012 ceph-mon[128787]: from='osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-11T20:09:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:12 smithi012 ceph-mon[128787]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-11T20:09:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:12 smithi032 ceph-mon[132488]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-11T20:09:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:12 smithi032 ceph-mon[132488]: from='osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-11T20:09:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:12 smithi032 ceph-mon[132488]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-11T20:09:13.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:13 smithi039 ceph-mon[102205]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-11T20:09:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:13 smithi039 ceph-mon[102205]: osdmap e23: 4 total, 3 up, 4 in 2023-12-11T20:09:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:13 smithi039 ceph-mon[102205]: from='osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:09:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:13 smithi039 ceph-mon[102205]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:09:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:13 smithi039 ceph-mon[102205]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:09:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:13 smithi039 ceph-mon[102205]: osdmap e24: 4 total, 3 up, 4 in 2023-12-11T20:09:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-mon[128787]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-11T20:09:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-mon[128787]: osdmap e23: 4 total, 3 up, 4 in 2023-12-11T20:09:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-mon[128787]: from='osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:09:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-mon[128787]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:09:13.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-mon[128787]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:09:13.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-mon[128787]: osdmap e24: 4 total, 3 up, 4 in 2023-12-11T20:09:13.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:13.331 INFO:journalctl@ceph.osd.3.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-3[152623]: 2023-12-11T20:09:13.045+0000 7f25cd2fa700 -1 osd.3 0 waiting for initial osdmap 2023-12-11T20:09:13.331 INFO:journalctl@ceph.osd.3.smithi012.stdout:Dec 11 20:09:13 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-3[152623]: 2023-12-11T20:09:13.059+0000 7f25c68ef700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:09:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:13 smithi032 ceph-mon[132488]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-11T20:09:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:13 smithi032 ceph-mon[132488]: osdmap e23: 4 total, 3 up, 4 in 2023-12-11T20:09:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:13 smithi032 ceph-mon[132488]: from='osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:09:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:13 smithi032 ceph-mon[132488]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:09:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:13 smithi032 ceph-mon[132488]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:09:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:13 smithi032 ceph-mon[132488]: osdmap e24: 4 total, 3 up, 4 in 2023-12-11T20:09:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:14.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:14 smithi039 ceph-mon[102205]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:09:14.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:14 smithi039 ceph-mon[102205]: osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] boot 2023-12-11T20:09:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:14 smithi039 ceph-mon[102205]: osdmap e25: 4 total, 4 up, 4 in 2023-12-11T20:09:14.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-11T20:09:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-11T20:09:14.329 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10+0 records in 2023-12-11T20:09:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:10+0 records out 2023-12-11T20:09:14.329 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0443883 s, 236 MB/s 2023-12-11T20:09:14.330 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping successful for: 2023-12-11T20:09:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:14 smithi012 ceph-mon[128787]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:09:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:14 smithi012 ceph-mon[128787]: osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] boot 2023-12-11T20:09:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:14 smithi012 ceph-mon[128787]: osdmap e25: 4 total, 4 up, 4 in 2023-12-11T20:09:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:14.366 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:14 smithi032 ceph-mon[132488]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-11T20:09:14.366 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:14.366 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:14 smithi032 ceph-mon[132488]: osd.3 [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] boot 2023-12-11T20:09:14.366 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:14 smithi032 ceph-mon[132488]: osdmap e25: 4 total, 4 up, 4 in 2023-12-11T20:09:14.366 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-11T20:09:14.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi032:vg_nvme/lv_3 2023-12-11T20:09:15.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:09:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:09:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: osdmap e26: 4 total, 4 up, 4 in 2023-12-11T20:09:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi012 2023-12-11T20:09:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:15.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:15.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:15.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: osdmap e26: 4 total, 4 up, 4 in 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi012 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:09:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:09:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: osdmap e26: 4 total, 4 up, 4 in 2023-12-11T20:09:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi012 2023-12-11T20:09:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:15.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:15.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:15.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:15.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:15.669 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:09:16.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:16 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi012 to 8638M 2023-12-11T20:09:16.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:16 smithi032 ceph-mon[132488]: osdmap e27: 4 total, 4 up, 4 in 2023-12-11T20:09:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:16 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi012 to 8638M 2023-12-11T20:09:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:16 smithi039 ceph-mon[102205]: osdmap e27: 4 total, 4 up, 4 in 2023-12-11T20:09:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:16 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi012 to 8638M 2023-12-11T20:09:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:16 smithi012 ceph-mon[128787]: osdmap e27: 4 total, 4 up, 4 in 2023-12-11T20:09:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.174+0000 7f956d758700 1 -- 172.21.15.32:0/2531782272 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 msgr2=0x7f9568102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.174+0000 7f956d758700 1 --2- 172.21.15.32:0/2531782272 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 0x7f9568102c80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f955c0099c0 tx=0x7f955c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:09:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.175+0000 7f956d758700 1 -- 172.21.15.32:0/2531782272 shutdown_connections 2023-12-11T20:09:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.175+0000 7f956d758700 1 --2- 172.21.15.32:0/2531782272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95681031c0 0x7f9568109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.175+0000 7f956d758700 1 --2- 172.21.15.32:0/2531782272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9568101620 0x7f9568101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:17.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.175+0000 7f956d758700 1 --2- 172.21.15.32:0/2531782272 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 0x7f9568102c80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:17.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.175+0000 7f956d758700 1 -- 172.21.15.32:0/2531782272 >> 172.21.15.32:0/2531782272 conn(0x7f95680fcbe0 msgr2=0x7f95680ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:09:17.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.175+0000 7f956d758700 1 -- 172.21.15.32:0/2531782272 shutdown_connections 2023-12-11T20:09:17.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.175+0000 7f956d758700 1 -- 172.21.15.32:0/2531782272 wait complete. 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.176+0000 7f956d758700 1 Processor -- start 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.176+0000 7f956d758700 1 -- start start 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.176+0000 7f956d758700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9568101620 0x7f9568075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.176+0000 7f956d758700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 0x7f95680739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.176+0000 7f956d758700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95681031c0 0x7f9568073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.176+0000 7f956d758700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95680746a0 con 0x7f95681031c0 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.176+0000 7f956d758700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9568074810 con 0x7f9568102820 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.176+0000 7f956d758700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95681a1530 con 0x7f9568101620 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 0x7f95680739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:09:17.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 0x7f95680739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56868/0 (socket says 172.21.15.32:56868) 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 -- 172.21.15.32:0/395659861 learned_addr learned my addr 172.21.15.32:0/395659861 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f9566ffd700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9568101620 0x7f9568075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95677fe700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95681031c0 0x7f9568073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 -- 172.21.15.32:0/395659861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9568101620 msgr2=0x7f9568075320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9568101620 0x7f9568075320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 -- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95681031c0 msgr2=0x7f9568073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95681031c0 0x7f9568073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 -- 172.21.15.32:0/395659861 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0095f0 con 0x7f9568102820 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.177+0000 7f95667fc700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 0x7f95680739c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f955c005910 tx=0x7f955c005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.178+0000 7f954ffff700 1 -- 172.21.15.32:0/395659861 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c01d070 con 0x7f9568102820 2023-12-11T20:09:17.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.178+0000 7f954ffff700 1 -- 172.21.15.32:0/395659861 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f955c00bd30 con 0x7f9568102820 2023-12-11T20:09:17.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.178+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95681a1760 con 0x7f9568102820 2023-12-11T20:09:17.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.178+0000 7f954ffff700 1 -- 172.21.15.32:0/395659861 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c022d80 con 0x7f9568102820 2023-12-11T20:09:17.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.178+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95681a1bd0 con 0x7f9568102820 2023-12-11T20:09:17.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.179+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9568108ba0 con 0x7f9568102820 2023-12-11T20:09:17.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.181+0000 7f954ffff700 1 -- 172.21.15.32:0/395659861 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f955c022470 con 0x7f9568102820 2023-12-11T20:09:17.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.182+0000 7f954ffff700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95500a1580 0x7f95500a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:09:17.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.182+0000 7f954ffff700 1 -- 172.21.15.32:0/395659861 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3669+0+0 (secure 0 0 0) 0x7f955c0cc9c0 con 0x7f9568102820 2023-12-11T20:09:17.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.183+0000 7f9566ffd700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95500a1580 0x7f95500a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:09:17.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.184+0000 7f9566ffd700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95500a1580 0x7f95500a3a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9568102680 tx=0x7f9558007400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:09:17.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.187+0000 7f954ffff700 1 -- 172.21.15.32:0/395659861 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f955c097230 con 0x7f9568102820 2023-12-11T20:09:17.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:17.409+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9568061a10 con 0x7f95500a1580 2023-12-11T20:09:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:17 smithi039 ceph-mon[102205]: osdmap e28: 4 total, 4 up, 4 in 2023-12-11T20:09:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:17 smithi039 ceph-mon[102205]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:17 smithi012 ceph-mon[128787]: osdmap e28: 4 total, 4 up, 4 in 2023-12-11T20:09:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:17 smithi012 ceph-mon[128787]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:17.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:17 smithi032 ceph-mon[132488]: osdmap e28: 4 total, 4 up, 4 in 2023-12-11T20:09:17.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:17 smithi032 ceph-mon[132488]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:18.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:18 smithi039 ceph-mon[102205]: osdmap e29: 4 total, 4 up, 4 in 2023-12-11T20:09:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:18 smithi039 ceph-mon[102205]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:09:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:18 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:09:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:18 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:09:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:18 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:18.578 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:18 smithi032 ceph-mon[132488]: osdmap e29: 4 total, 4 up, 4 in 2023-12-11T20:09:18.579 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:18 smithi032 ceph-mon[132488]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:09:18.579 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:18 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:09:18.579 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:18 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:09:18.579 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:18 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:18 smithi012 ceph-mon[128787]: osdmap e29: 4 total, 4 up, 4 in 2023-12-11T20:09:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:18 smithi012 ceph-mon[128787]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:09:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:18 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:09:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:18 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:09:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:18 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:19 smithi032 ceph-mon[132488]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:19.555 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:19 smithi039 ceph-mon[102205]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:19 smithi012 ceph-mon[128787]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:20.970 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:20 smithi032 ceph-mon[132488]: from='client.? 172.21.15.32:0/3152239055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]: dispatch 2023-12-11T20:09:20.972 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:20 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]: dispatch 2023-12-11T20:09:20.972 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:20 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]': finished 2023-12-11T20:09:20.972 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:20 smithi032 ceph-mon[132488]: osdmap e30: 5 total, 4 up, 5 in 2023-12-11T20:09:20.972 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:21.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:20 smithi039 ceph-mon[102205]: from='client.? 172.21.15.32:0/3152239055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]: dispatch 2023-12-11T20:09:21.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:20 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]: dispatch 2023-12-11T20:09:21.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:20 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]': finished 2023-12-11T20:09:21.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:20 smithi039 ceph-mon[102205]: osdmap e30: 5 total, 4 up, 5 in 2023-12-11T20:09:21.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:20 smithi012 ceph-mon[128787]: from='client.? 172.21.15.32:0/3152239055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]: dispatch 2023-12-11T20:09:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:20 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]: dispatch 2023-12-11T20:09:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:20 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee6f15ff-052e-4621-9d90-4d2e6790b314"}]': finished 2023-12-11T20:09:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:20 smithi012 ceph-mon[128787]: osdmap e30: 5 total, 4 up, 5 in 2023-12-11T20:09:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:21.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:21 smithi032 ceph-mon[132488]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-12-11T20:09:21.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:21 smithi032 ceph-mon[132488]: from='client.? 172.21.15.32:0/3544316415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:09:22.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:21 smithi039 ceph-mon[102205]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-12-11T20:09:22.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:21 smithi039 ceph-mon[102205]: from='client.? 172.21.15.32:0/3544316415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:09:22.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:21 smithi012 ceph-mon[128787]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-12-11T20:09:22.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:21 smithi012 ceph-mon[128787]: from='client.? 172.21.15.32:0/3544316415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:09:24.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:24 smithi039 ceph-mon[102205]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2023-12-11T20:09:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:24 smithi012 ceph-mon[128787]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2023-12-11T20:09:24.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:24 smithi032 ceph-mon[132488]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2023-12-11T20:09:26.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:26 smithi039 ceph-mon[102205]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-11T20:09:26.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:26 smithi012 ceph-mon[128787]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-11T20:09:26.354 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:26 smithi032 ceph-mon[132488]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-11T20:09:28.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:28 smithi039 ceph-mon[102205]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-12-11T20:09:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:28 smithi012 ceph-mon[128787]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-12-11T20:09:28.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:28 smithi032 ceph-mon[132488]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-12-11T20:09:29.420 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:29 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-11T20:09:29.421 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:29 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:29.421 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:29 smithi032 ceph-mon[132488]: Deploying daemon osd.4 on smithi032 2023-12-11T20:09:29.421 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:29 smithi032 ceph-mon[132488]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-11T20:09:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:29 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-11T20:09:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:29 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:29 smithi039 ceph-mon[102205]: Deploying daemon osd.4 on smithi032 2023-12-11T20:09:29.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:29 smithi039 ceph-mon[102205]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-11T20:09:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-11T20:09:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:29 smithi012 ceph-mon[128787]: Deploying daemon osd.4 on smithi032 2023-12-11T20:09:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:29 smithi012 ceph-mon[128787]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-11T20:09:32.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:32 smithi039 ceph-mon[102205]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:32 smithi012 ceph-mon[128787]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:32 smithi032 ceph-mon[132488]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:34.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:34 smithi039 ceph-mon[102205]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:34 smithi012 ceph-mon[128787]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:34.349 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:34 smithi032 ceph-mon[132488]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:35.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:35 smithi032 ceph-mon[132488]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:36.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:36.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:36.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:36.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:35 smithi039 ceph-mon[102205]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:36.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:36.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:36.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:36.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:35 smithi012 ceph-mon[128787]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:38 smithi032 ceph-mon[132488]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:38 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:38 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:38 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:38 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:38 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:38 smithi039 ceph-mon[102205]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:38.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:38 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:38 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:38 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:38 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:38 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:38 smithi012 ceph-mon[128787]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:38 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:38 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:38 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:38 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:38.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:38 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:38.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.340+0000 7f954ffff700 1 -- 172.21.15.32:0/395659861 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9568061a10 con 0x7f95500a1580 2023-12-11T20:09:38.339 INFO:teuthology.orchestra.run.smithi032.stdout:Created osd(s) 4 on host 'smithi032' 2023-12-11T20:09:38.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.342+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95500a1580 msgr2=0x7f95500a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:38.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.342+0000 7f956d758700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95500a1580 0x7f95500a3a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9568102680 tx=0x7f9558007400 comp rx=0 tx=0).stop 2023-12-11T20:09:38.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.342+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 msgr2=0x7f95680739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:38.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.342+0000 7f956d758700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 0x7f95680739c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f955c005910 tx=0x7f955c005b00 comp rx=0 tx=0).stop 2023-12-11T20:09:38.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.343+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 shutdown_connections 2023-12-11T20:09:38.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.343+0000 7f956d758700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95500a1580 0x7f95500a3a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:38.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.343+0000 7f956d758700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95681031c0 0x7f9568073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:38.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.343+0000 7f956d758700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9568101620 0x7f9568075320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:38.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.343+0000 7f956d758700 1 --2- 172.21.15.32:0/395659861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9568102820 0x7f95680739c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:38.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.343+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 >> 172.21.15.32:0/395659861 conn(0x7f95680fcbe0 msgr2=0x7f9568105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:09:38.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.343+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 shutdown_connections 2023-12-11T20:09:38.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:09:38.343+0000 7f956d758700 1 -- 172.21.15.32:0/395659861 wait complete. 2023-12-11T20:09:38.802 DEBUG:teuthology.orchestra.run.smithi032:osd.4> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.4.service 2023-12-11T20:09:38.807 INFO:tasks.cephadm:Deploying osd.5 on smithi039 with /dev/vg_nvme/lv_3... 2023-12-11T20:09:38.807 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-11T20:09:38.879 INFO:journalctl@ceph.osd.4.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:09:39.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:39.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:39 smithi039 ceph-mon[102205]: from='osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-11T20:09:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:39 smithi039 ceph-mon[102205]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-11T20:09:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:39 smithi039 ceph-mon[102205]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:39.555 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:39.555 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:39.555 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:39.555 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:39 smithi032 ceph-mon[132488]: from='osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-11T20:09:39.555 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:39 smithi032 ceph-mon[132488]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-11T20:09:39.555 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:39 smithi032 ceph-mon[132488]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:09:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:39 smithi012 ceph-mon[128787]: from='osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-11T20:09:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:39 smithi012 ceph-mon[128787]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-11T20:09:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:39 smithi012 ceph-mon[128787]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:39.623 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:09:40.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:40 smithi032 ceph-mon[132488]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-11T20:09:40.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:40 smithi032 ceph-mon[132488]: osdmap e31: 5 total, 4 up, 5 in 2023-12-11T20:09:40.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:40.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:40 smithi032 ceph-mon[132488]: from='osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:09:40.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:40 smithi032 ceph-mon[132488]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:09:40.464 INFO:journalctl@ceph.osd.4.smithi032.stdout:Dec 11 20:09:40 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-4[145510]: 2023-12-11T20:09:40.321+0000 7fba4edcb700 -1 osd.4 0 waiting for initial osdmap 2023-12-11T20:09:40.464 INFO:journalctl@ceph.osd.4.smithi032.stdout:Dec 11 20:09:40 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-4[145510]: 2023-12-11T20:09:40.329+0000 7fba47bbf700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:09:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:40 smithi012 ceph-mon[128787]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-11T20:09:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:40 smithi012 ceph-mon[128787]: osdmap e31: 5 total, 4 up, 5 in 2023-12-11T20:09:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:40 smithi012 ceph-mon[128787]: from='osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:09:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:40 smithi012 ceph-mon[128787]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:09:40.666 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:40 smithi039 ceph-mon[102205]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-11T20:09:40.666 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:40 smithi039 ceph-mon[102205]: osdmap e31: 5 total, 4 up, 5 in 2023-12-11T20:09:40.666 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:40.666 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:40 smithi039 ceph-mon[102205]: from='osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:09:40.667 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:40 smithi039 ceph-mon[102205]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:09:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:41 smithi012 ceph-mon[128787]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:09:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:41 smithi012 ceph-mon[128787]: osdmap e32: 5 total, 4 up, 5 in 2023-12-11T20:09:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:41 smithi012 ceph-mon[128787]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:41 smithi032 ceph-mon[132488]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:09:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:41 smithi032 ceph-mon[132488]: osdmap e32: 5 total, 4 up, 5 in 2023-12-11T20:09:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:41 smithi032 ceph-mon[132488]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:41 smithi039 ceph-mon[102205]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:09:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:41 smithi039 ceph-mon[102205]: osdmap e32: 5 total, 4 up, 5 in 2023-12-11T20:09:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:41 smithi039 ceph-mon[102205]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-11T20:09:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:41.861 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-11T20:09:41.861 INFO:teuthology.orchestra.run.smithi039.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-11T20:09:41.861 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10+0 records in 2023-12-11T20:09:41.861 INFO:teuthology.orchestra.run.smithi039.stderr:10+0 records out 2023-12-11T20:09:41.861 INFO:teuthology.orchestra.run.smithi039.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0580766 s, 181 MB/s 2023-12-11T20:09:41.861 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping successful for: 2023-12-11T20:09:42.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi039:vg_nvme/lv_3 2023-12-11T20:09:42.456 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:42 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:09:42.457 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:42 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:09:42.457 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:42 smithi032 ceph-mon[132488]: osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] boot 2023-12-11T20:09:42.457 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:42 smithi032 ceph-mon[132488]: osdmap e33: 5 total, 5 up, 5 in 2023-12-11T20:09:42.457 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:42.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:42 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:09:42.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:42 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:09:42.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:42 smithi039 ceph-mon[102205]: osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] boot 2023-12-11T20:09:42.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:42 smithi039 ceph-mon[102205]: osdmap e33: 5 total, 5 up, 5 in 2023-12-11T20:09:42.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:42.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:42 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:09:42.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:42 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:09:42.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:42 smithi012 ceph-mon[128787]: osd.4 [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] boot 2023-12-11T20:09:42.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:42 smithi012 ceph-mon[128787]: osdmap e33: 5 total, 5 up, 5 in 2023-12-11T20:09:42.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-11T20:09:43.109 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:09:43.648 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: osdmap e34: 5 total, 5 up, 5 in 2023-12-11T20:09:43.648 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi032 2023-12-11T20:09:43.648 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi032 to 8638M 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.649 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:43 smithi039 ceph-mon[102205]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: osdmap e34: 5 total, 5 up, 5 in 2023-12-11T20:09:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi032 2023-12-11T20:09:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi032 to 8638M 2023-12-11T20:09:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:43 smithi032 ceph-mon[132488]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:43.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: osdmap e34: 5 total, 5 up, 5 in 2023-12-11T20:09:43.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi032 2023-12-11T20:09:43.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:43.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:09:43.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi032 to 8638M 2023-12-11T20:09:43.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:43.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:09:43.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:09:43.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:43 smithi012 ceph-mon[128787]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:44.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 -- 172.21.15.39:0/2013431921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 msgr2=0x7f3fa8109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:44.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 --2- 172.21.15.39:0/2013431921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 0x7f3fa8109a70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000b0a0 tx=0x7f3fa000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:09:44.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 -- 172.21.15.39:0/2013431921 shutdown_connections 2023-12-11T20:09:44.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 --2- 172.21.15.39:0/2013431921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 0x7f3fa8109a70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:44.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 --2- 172.21.15.39:0/2013431921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa8101620 0x7f3fa8101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:44.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 --2- 172.21.15.39:0/2013431921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa8102820 0x7f3fa8102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:44.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 -- 172.21.15.39:0/2013431921 >> 172.21.15.39:0/2013431921 conn(0x7f3fa80fcbe0 msgr2=0x7f3fa80ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:09:44.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 -- 172.21.15.39:0/2013431921 shutdown_connections 2023-12-11T20:09:44.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.773+0000 7f3fac987700 1 -- 172.21.15.39:0/2013431921 wait complete. 2023-12-11T20:09:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.774+0000 7f3fac987700 1 Processor -- start 2023-12-11T20:09:44.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fac987700 1 -- start start 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fac987700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa8101620 0x7f3fa8197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fac987700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa8102820 0x7f3fa8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fac987700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 0x7f3fa819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fac987700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa819f080 con 0x7f3fa8102820 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fac987700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa819f1c0 con 0x7f3fa8101620 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fac987700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa819f350 con 0x7f3fa81031c0 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fa6d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 0x7f3fa819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fa6d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 0x7f3fa819eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53326/0 (socket says 172.21.15.39:53326) 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fa6d9d700 1 -- 172.21.15.39:0/1828233911 learned_addr learned my addr 172.21.15.39:0/1828233911 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fa659c700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa8101620 0x7f3fa8197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.775+0000 7f3fa5d9b700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa8102820 0x7f3fa8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:09:44.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3fa6d9d700 1 -- 172.21.15.39:0/1828233911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa8101620 msgr2=0x7f3fa8197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3fa6d9d700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa8101620 0x7f3fa8197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3fa6d9d700 1 -- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa8102820 msgr2=0x7f3fa8197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:09:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3fa6d9d700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa8102820 0x7f3fa8197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:09:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3fa6d9d700 1 -- 172.21.15.39:0/1828233911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0009d00 con 0x7f3fa81031c0 2023-12-11T20:09:44.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3fa6d9d700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 0x7f3fa819eab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00079f0 tx=0x7f3fa000bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:09:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3f977fe700 1 -- 172.21.15.39:0/1828233911 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000e040 con 0x7f3fa81031c0 2023-12-11T20:09:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3f977fe700 1 -- 172.21.15.39:0/1828233911 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fa0003e10 con 0x7f3fa81031c0 2023-12-11T20:09:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa8073800 con 0x7f3fa81031c0 2023-12-11T20:09:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.776+0000 7f3f977fe700 1 -- 172.21.15.39:0/1828233911 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00052a0 con 0x7f3fa81031c0 2023-12-11T20:09:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.777+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa8073cf0 con 0x7f3fa81031c0 2023-12-11T20:09:44.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.778+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa8108aa0 con 0x7f3fa81031c0 2023-12-11T20:09:44.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.780+0000 7f3f977fe700 1 -- 172.21.15.39:0/1828233911 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3fa0005400 con 0x7f3fa81031c0 2023-12-11T20:09:44.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.782+0000 7f3f977fe700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f900a1500 0x7f3f900a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:09:44.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.782+0000 7f3f977fe700 1 -- 172.21.15.39:0/1828233911 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f3fa00ccd80 con 0x7f3fa81031c0 2023-12-11T20:09:44.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.782+0000 7f3fa659c700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f900a1500 0x7f3f900a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:09:44.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.783+0000 7f3fa659c700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f900a1500 0x7f3f900a39c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8102680 tx=0x7f3f98007400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:09:44.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:44.787+0000 7f3f977fe700 1 -- 172.21.15.39:0/1828233911 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3fa0097440 con 0x7f3fa81031c0 2023-12-11T20:09:45.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:09:45.007+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fa8061a10 con 0x7f3f900a1500 2023-12-11T20:09:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:09:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:09:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:45 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:45.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:45 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:09:45.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:45 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:09:45.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:45 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:45.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:45 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:09:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:45 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:09:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:45 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:46 smithi012 ceph-mon[128787]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:46 smithi012 ceph-mon[128787]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:09:46.397 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:46 smithi039 ceph-mon[102205]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:46.397 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:46 smithi039 ceph-mon[102205]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:09:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:46 smithi032 ceph-mon[132488]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:46 smithi032 ceph-mon[132488]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:09:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:48 smithi012 ceph-mon[128787]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:48.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:48 smithi032 ceph-mon[132488]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:48.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:48 smithi039 ceph-mon[102205]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:49 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/320828153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]: dispatch 2023-12-11T20:09:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:49 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]: dispatch 2023-12-11T20:09:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:49 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]': finished 2023-12-11T20:09:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:49 smithi012 ceph-mon[128787]: osdmap e35: 6 total, 5 up, 6 in 2023-12-11T20:09:49.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:09:49.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:49 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/1492934634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:09:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:49 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/320828153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]: dispatch 2023-12-11T20:09:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:49 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]: dispatch 2023-12-11T20:09:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:49 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]': finished 2023-12-11T20:09:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:49 smithi032 ceph-mon[132488]: osdmap e35: 6 total, 5 up, 6 in 2023-12-11T20:09:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:49 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:09:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:49 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/1492934634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:09:49.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:49 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/320828153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]: dispatch 2023-12-11T20:09:49.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:49 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]: dispatch 2023-12-11T20:09:49.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:49 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a466cf2-6909-4fc8-8439-6b033c5e942f"}]': finished 2023-12-11T20:09:49.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:49 smithi039 ceph-mon[102205]: osdmap e35: 6 total, 5 up, 6 in 2023-12-11T20:09:49.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:49 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:09:49.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:49 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/1492934634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:09:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:50 smithi012 ceph-mon[128787]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:50.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:50 smithi032 ceph-mon[132488]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:50.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:50 smithi039 ceph-mon[102205]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:52.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:52 smithi012 ceph-mon[128787]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:52.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:52 smithi032 ceph-mon[132488]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:52.539 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:52 smithi039 ceph-mon[102205]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:53.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:53 smithi032 ceph-mon[132488]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:53.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:53 smithi039 ceph-mon[102205]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:53 smithi012 ceph-mon[128787]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:56.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:56 smithi039 ceph-mon[102205]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:56.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-11T20:09:56.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:56 smithi012 ceph-mon[128787]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-11T20:09:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:56 smithi032 ceph-mon[132488]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-11T20:09:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:09:57.255 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:57 smithi039 ceph-mon[102205]: Deploying daemon osd.5 on smithi039 2023-12-11T20:09:57.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:57 smithi012 ceph-mon[128787]: Deploying daemon osd.5 on smithi039 2023-12-11T20:09:57.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:57 smithi032 ceph-mon[132488]: Deploying daemon osd.5 on smithi039 2023-12-11T20:09:58.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:58 smithi039 ceph-mon[102205]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:58 smithi012 ceph-mon[128787]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:58.466 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:58 smithi032 ceph-mon[132488]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:59.462 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:09:59 smithi039 ceph-mon[102205]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:09:59 smithi032 ceph-mon[132488]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:09:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:09:59 smithi012 ceph-mon[128787]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:00.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:00 smithi039 ceph-mon[102205]: overall HEALTH_OK 2023-12-11T20:10:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:00 smithi032 ceph-mon[132488]: overall HEALTH_OK 2023-12-11T20:10:00.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:00 smithi012 ceph-mon[128787]: overall HEALTH_OK 2023-12-11T20:10:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:01 smithi032 ceph-mon[132488]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:01 smithi039 ceph-mon[102205]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:01 smithi012 ceph-mon[128787]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:03.430 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:03.430 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:03.431 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:03.431 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:03 smithi039 ceph-mon[102205]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:03 smithi032 ceph-mon[132488]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:03 smithi012 ceph-mon[128787]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 5 on host 'smithi039' 2023-12-11T20:10:05.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.886+0000 7f3f977fe700 1 -- 172.21.15.39:0/1828233911 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3fa8061a10 con 0x7f3f900a1500 2023-12-11T20:10:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f900a1500 msgr2=0x7f3f900a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f900a1500 0x7f3f900a39c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8102680 tx=0x7f3f98007400 comp rx=0 tx=0).stop 2023-12-11T20:10:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 msgr2=0x7f3fa819eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 0x7f3fa819eab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00079f0 tx=0x7f3fa000bce0 comp rx=0 tx=0).stop 2023-12-11T20:10:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 shutdown_connections 2023-12-11T20:10:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f900a1500 0x7f3f900a39c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fa8101620 0x7f3fa8197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fa81031c0 0x7f3fa819eab0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 --2- 172.21.15.39:0/1828233911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa8102820 0x7f3fa8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 >> 172.21.15.39:0/1828233911 conn(0x7f3fa80fcbe0 msgr2=0x7f3fa8105be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:10:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 shutdown_connections 2023-12-11T20:10:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:10:05.890+0000 7f3fac987700 1 -- 172.21.15.39:0/1828233911 wait complete. 2023-12-11T20:10:05.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:06.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:06.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:06.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:06.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:06.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:06.358 DEBUG:teuthology.orchestra.run.smithi039:osd.5> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.5.service 2023-12-11T20:10:06.363 INFO:tasks.cephadm:Deploying osd.6 on smithi012 with /dev/vg_nvme/lv_2... 2023-12-11T20:10:06.363 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-11T20:10:06.437 INFO:journalctl@ceph.osd.5.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:10:07.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:06 smithi039 ceph-mon[102205]: from='osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-11T20:10:07.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:06 smithi039 ceph-mon[102205]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-11T20:10:07.163 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:10:07.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:06 smithi032 ceph-mon[132488]: from='osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-11T20:10:07.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:06 smithi032 ceph-mon[132488]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-11T20:10:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:06 smithi012 ceph-mon[128787]: from='osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-11T20:10:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:06 smithi012 ceph-mon[128787]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-11T20:10:08.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:07 smithi012 ceph-mon[128787]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-11T20:10:08.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:07 smithi012 ceph-mon[128787]: osdmap e36: 6 total, 5 up, 6 in 2023-12-11T20:10:08.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:08.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:07 smithi012 ceph-mon[128787]: from='osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:10:08.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:07 smithi012 ceph-mon[128787]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:10:08.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:07 smithi012 ceph-mon[128787]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:08.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:07 smithi039 ceph-mon[102205]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-11T20:10:08.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:07 smithi039 ceph-mon[102205]: osdmap e36: 6 total, 5 up, 6 in 2023-12-11T20:10:08.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:08.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:07 smithi039 ceph-mon[102205]: from='osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:10:08.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:07 smithi039 ceph-mon[102205]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:10:08.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:07 smithi039 ceph-mon[102205]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:08.302 INFO:journalctl@ceph.osd.5.smithi039.stdout:Dec 11 20:10:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-5[116350]: 2023-12-11T20:10:07.989+0000 7f11e77d9700 -1 osd.5 0 waiting for initial osdmap 2023-12-11T20:10:08.303 INFO:journalctl@ceph.osd.5.smithi039.stdout:Dec 11 20:10:08 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-5[116350]: 2023-12-11T20:10:08.001+0000 7f11e35d3700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:10:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:07 smithi032 ceph-mon[132488]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-11T20:10:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:07 smithi032 ceph-mon[132488]: osdmap e36: 6 total, 5 up, 6 in 2023-12-11T20:10:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:07 smithi032 ceph-mon[132488]: from='osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:10:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:07 smithi032 ceph-mon[132488]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:10:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:07 smithi032 ceph-mon[132488]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-11T20:10:09.257 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-11T20:10:09.258 INFO:teuthology.orchestra.run.smithi012.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-11T20:10:09.258 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10+0 records in 2023-12-11T20:10:09.258 INFO:teuthology.orchestra.run.smithi012.stderr:10+0 records out 2023-12-11T20:10:09.258 INFO:teuthology.orchestra.run.smithi012.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0407157 s, 258 MB/s 2023-12-11T20:10:09.258 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping successful for: 2023-12-11T20:10:09.296 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:08 smithi012 ceph-mon[128787]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:10:09.297 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:08 smithi012 ceph-mon[128787]: osdmap e37: 6 total, 5 up, 6 in 2023-12-11T20:10:09.297 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.297 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.297 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:08 smithi012 ceph-mon[128787]: osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] boot 2023-12-11T20:10:09.297 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:08 smithi012 ceph-mon[128787]: osdmap e38: 6 total, 6 up, 6 in 2023-12-11T20:10:09.297 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:08 smithi039 ceph-mon[102205]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:10:09.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:08 smithi039 ceph-mon[102205]: osdmap e37: 6 total, 5 up, 6 in 2023-12-11T20:10:09.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:08 smithi039 ceph-mon[102205]: osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] boot 2023-12-11T20:10:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:08 smithi039 ceph-mon[102205]: osdmap e38: 6 total, 6 up, 6 in 2023-12-11T20:10:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:08 smithi032 ceph-mon[132488]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:10:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:08 smithi032 ceph-mon[132488]: osdmap e37: 6 total, 5 up, 6 in 2023-12-11T20:10:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:08 smithi032 ceph-mon[132488]: osd.5 [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] boot 2023-12-11T20:10:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:08 smithi032 ceph-mon[132488]: osdmap e38: 6 total, 6 up, 6 in 2023-12-11T20:10:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-11T20:10:09.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi012:vg_nvme/lv_2 2023-12-11T20:10:10.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:09 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:10:10.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:09 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:10:10.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:09 smithi039 ceph-mon[102205]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:10.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:09 smithi039 ceph-mon[102205]: osdmap e39: 6 total, 6 up, 6 in 2023-12-11T20:10:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:09 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:10:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:09 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:10:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:09 smithi012 ceph-mon[128787]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:09 smithi012 ceph-mon[128787]: osdmap e39: 6 total, 6 up, 6 in 2023-12-11T20:10:10.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:09 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:10:10.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:09 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:10:10.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:09 smithi032 ceph-mon[132488]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:10.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:09 smithi032 ceph-mon[132488]: osdmap e39: 6 total, 6 up, 6 in 2023-12-11T20:10:10.559 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:10:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi039 2023-12-11T20:10:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi039 to 8635M 2023-12-11T20:10:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:11.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:11.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:11 smithi012 ceph-mon[128787]: osdmap e40: 6 total, 6 up, 6 in 2023-12-11T20:10:11.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi039 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi039 to 8635M 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:11 smithi039 ceph-mon[102205]: osdmap e40: 6 total, 6 up, 6 in 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi039 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi039 to 8635M 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:11.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:11 smithi032 ceph-mon[132488]: osdmap e40: 6 total, 6 up, 6 in 2023-12-11T20:10:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 -- 172.21.15.12:0/2839731888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 msgr2=0x7f7d2c101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/2839731888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 0x7f7d2c101a40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d280099c0 tx=0x7f7d28009cd0 comp rx=0 tx=0).stop 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 -- 172.21.15.12:0/2839731888 shutdown_connections 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/2839731888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d2c1031c0 0x7f7d2c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/2839731888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 0x7f7d2c101a40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/2839731888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d2c102820 0x7f7d2c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 -- 172.21.15.12:0/2839731888 >> 172.21.15.12:0/2839731888 conn(0x7f7d2c0fcbe0 msgr2=0x7f7d2c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 -- 172.21.15.12:0/2839731888 shutdown_connections 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.179+0000 7f7d33d1f700 1 -- 172.21.15.12:0/2839731888 wait complete. 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.180+0000 7f7d33d1f700 1 Processor -- start 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.180+0000 7f7d33d1f700 1 -- start start 2023-12-11T20:10:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d33d1f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 0x7f7d2c1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d33d1f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d2c102820 0x7f7d2c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d33d1f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d2c1031c0 0x7f7d2c19ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d33d1f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c19efe0 con 0x7f7d2c101620 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d31abb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 0x7f7d2c1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d33d1f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c19f120 con 0x7f7d2c1031c0 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d33d1f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c19f2b0 con 0x7f7d2c102820 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d31abb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 0x7f7d2c1974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35724/0 (socket says 172.21.15.12:35724) 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d31abb700 1 -- 172.21.15.12:0/1960510939 learned_addr learned my addr 172.21.15.12:0/1960510939 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d322bc700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d2c1031c0 0x7f7d2c19ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d312ba700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d2c102820 0x7f7d2c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d31abb700 1 -- 172.21.15.12:0/1960510939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d2c102820 msgr2=0x7f7d2c197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.181+0000 7f7d31abb700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d2c102820 0x7f7d2c197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d31abb700 1 -- 172.21.15.12:0/1960510939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d2c1031c0 msgr2=0x7f7d2c19ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d31abb700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d2c1031c0 0x7f7d2c19ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d31abb700 1 -- 172.21.15.12:0/1960510939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d280095f0 con 0x7f7d2c101620 2023-12-11T20:10:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d31abb700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 0x7f7d2c1974f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009990 tx=0x7f7d28005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:10:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d22ffd700 1 -- 172.21.15.12:0/1960510939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2801d070 con 0x7f7d2c101620 2023-12-11T20:10:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d22ffd700 1 -- 172.21.15.12:0/1960510939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d2800bda0 con 0x7f7d2c101620 2023-12-11T20:10:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2c19f530 con 0x7f7d2c101620 2023-12-11T20:10:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d22ffd700 1 -- 172.21.15.12:0/1960510939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28022ca0 con 0x7f7d2c101620 2023-12-11T20:10:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.182+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2c19f9a0 con 0x7f7d2c101620 2023-12-11T20:10:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.183+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2c108b50 con 0x7f7d2c101620 2023-12-11T20:10:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.185+0000 7f7d22ffd700 1 -- 172.21.15.12:0/1960510939 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7d28022470 con 0x7f7d2c101620 2023-12-11T20:10:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.187+0000 7f7d22ffd700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7d180a1500 0x7f7d180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:10:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.188+0000 7f7d22ffd700 1 -- 172.21.15.12:0/1960510939 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4533+0+0 (secure 0 0 0) 0x7f7d280cd150 con 0x7f7d2c101620 2023-12-11T20:10:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.188+0000 7f7d312ba700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7d180a1500 0x7f7d180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:10:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.188+0000 7f7d312ba700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7d180a1500 0x7f7d180a39c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c005950 tx=0x7f7d1c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:10:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.192+0000 7f7d22ffd700 1 -- 172.21.15.12:0/1960510939 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7d28097660 con 0x7f7d2c101620 2023-12-11T20:10:12.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:12 smithi039 ceph-mon[102205]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:12.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:12 smithi039 ceph-mon[102205]: osdmap e41: 6 total, 6 up, 6 in 2023-12-11T20:10:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:12 smithi012 ceph-mon[128787]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:12 smithi012 ceph-mon[128787]: osdmap e41: 6 total, 6 up, 6 in 2023-12-11T20:10:12.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:12.411+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d2c061a10 con 0x7f7d180a1500 2023-12-11T20:10:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:12 smithi032 ceph-mon[132488]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:12 smithi032 ceph-mon[132488]: osdmap e41: 6 total, 6 up, 6 in 2023-12-11T20:10:13.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:13 smithi012 ceph-mon[128787]: osdmap e42: 6 total, 6 up, 6 in 2023-12-11T20:10:13.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:13 smithi012 ceph-mon[128787]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:10:13.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:10:13.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:10:13.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:13.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:13 smithi012 ceph-mon[128787]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:13.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:13 smithi039 ceph-mon[102205]: osdmap e42: 6 total, 6 up, 6 in 2023-12-11T20:10:13.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:13 smithi039 ceph-mon[102205]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:10:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:10:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:10:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:13 smithi039 ceph-mon[102205]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:13 smithi032 ceph-mon[132488]: osdmap e42: 6 total, 6 up, 6 in 2023-12-11T20:10:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:13 smithi032 ceph-mon[132488]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:10:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:10:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:10:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:13 smithi032 ceph-mon[132488]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:16.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:16 smithi039 ceph-mon[102205]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-12-11T20:10:16.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:16 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/911680663' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c12c5683-1166-46dc-8ae9-1acc04f75ac4"}]: dispatch 2023-12-11T20:10:16.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:16 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/911680663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c12c5683-1166-46dc-8ae9-1acc04f75ac4"}]': finished 2023-12-11T20:10:16.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:16 smithi039 ceph-mon[102205]: osdmap e43: 7 total, 6 up, 7 in 2023-12-11T20:10:16.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:16 smithi012 ceph-mon[128787]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-12-11T20:10:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:16 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/911680663' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c12c5683-1166-46dc-8ae9-1acc04f75ac4"}]: dispatch 2023-12-11T20:10:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:16 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/911680663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c12c5683-1166-46dc-8ae9-1acc04f75ac4"}]': finished 2023-12-11T20:10:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:16 smithi012 ceph-mon[128787]: osdmap e43: 7 total, 6 up, 7 in 2023-12-11T20:10:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:16 smithi032 ceph-mon[132488]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2023-12-11T20:10:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:16 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/911680663' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c12c5683-1166-46dc-8ae9-1acc04f75ac4"}]: dispatch 2023-12-11T20:10:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:16 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/911680663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c12c5683-1166-46dc-8ae9-1acc04f75ac4"}]': finished 2023-12-11T20:10:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:16 smithi032 ceph-mon[132488]: osdmap e43: 7 total, 6 up, 7 in 2023-12-11T20:10:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:17 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1165390701' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:10:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:17 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1165390701' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:10:17.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:17 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1165390701' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:10:18.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:18 smithi039 ceph-mon[102205]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-11T20:10:18.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:18 smithi012 ceph-mon[128787]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-11T20:10:18.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:18 smithi032 ceph-mon[132488]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-11T20:10:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:19 smithi032 ceph-mon[132488]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-12-11T20:10:19.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:19 smithi039 ceph-mon[102205]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-12-11T20:10:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:19 smithi012 ceph-mon[128787]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-12-11T20:10:22.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:22 smithi039 ceph-mon[102205]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-12-11T20:10:22.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:22 smithi012 ceph-mon[128787]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-12-11T20:10:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:22 smithi032 ceph-mon[132488]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-12-11T20:10:24.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:24 smithi039 ceph-mon[102205]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-11T20:10:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-11T20:10:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:24 smithi012 ceph-mon[128787]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-11T20:10:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-11T20:10:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:24.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:24 smithi032 ceph-mon[132488]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-11T20:10:24.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-11T20:10:24.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:25 smithi012 ceph-mon[128787]: Deploying daemon osd.6 on smithi012 2023-12-11T20:10:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:25 smithi032 ceph-mon[132488]: Deploying daemon osd.6 on smithi012 2023-12-11T20:10:25.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:25 smithi039 ceph-mon[102205]: Deploying daemon osd.6 on smithi012 2023-12-11T20:10:26.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:26 smithi039 ceph-mon[102205]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:26.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:26 smithi012 ceph-mon[128787]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:26.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:26 smithi032 ceph-mon[132488]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:28 smithi012 ceph-mon[128787]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:28.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:28 smithi032 ceph-mon[132488]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:28.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:28 smithi039 ceph-mon[102205]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:29.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:29 smithi032 ceph-mon[132488]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:29 smithi039 ceph-mon[102205]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:29 smithi012 ceph-mon[128787]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:31.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:31.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:31.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:31.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:31.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:31.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:32.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:31 smithi039 ceph-mon[102205]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:31 smithi012 ceph-mon[128787]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:31 smithi032 ceph-mon[132488]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:33.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.924+0000 7f7d22ffd700 1 -- 172.21.15.12:0/1960510939 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7d2c061a10 con 0x7f7d180a1500 2023-12-11T20:10:33.924 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 6 on host 'smithi012' 2023-12-11T20:10:33.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.926+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7d180a1500 msgr2=0x7f7d180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:33.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.926+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7d180a1500 0x7f7d180a39c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c005950 tx=0x7f7d1c00b410 comp rx=0 tx=0).stop 2023-12-11T20:10:33.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.926+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 msgr2=0x7f7d2c1974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:33.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.926+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 0x7f7d2c1974f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009990 tx=0x7f7d28005b00 comp rx=0 tx=0).stop 2023-12-11T20:10:33.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.927+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 shutdown_connections 2023-12-11T20:10:33.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.927+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7d180a1500 0x7f7d180a39c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:33.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.927+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d2c1031c0 0x7f7d2c19ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.927+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d2c101620 0x7f7d2c1974f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.927+0000 7f7d33d1f700 1 --2- 172.21.15.12:0/1960510939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d2c102820 0x7f7d2c197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.927+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 >> 172.21.15.12:0/1960510939 conn(0x7f7d2c0fcbe0 msgr2=0x7f7d2c105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:10:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.927+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 shutdown_connections 2023-12-11T20:10:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:10:33.927+0000 7f7d33d1f700 1 -- 172.21.15.12:0/1960510939 wait complete. 2023-12-11T20:10:34.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:34.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:34.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:34.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:34.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:34 smithi012 ceph-mon[128787]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-11T20:10:34.396 DEBUG:teuthology.orchestra.run.smithi012:osd.6> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.6.service 2023-12-11T20:10:34.401 INFO:tasks.cephadm:Deploying osd.7 on smithi032 with /dev/vg_nvme/lv_2... 2023-12-11T20:10:34.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-11T20:10:34.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:34 smithi032 ceph-mon[132488]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-11T20:10:34.477 INFO:journalctl@ceph.osd.6.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:34.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:34 smithi039 ceph-mon[102205]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-11T20:10:35.204 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:10:36.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:35 smithi032 ceph-mon[132488]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-11T20:10:36.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:35 smithi032 ceph-mon[132488]: osdmap e44: 7 total, 6 up, 7 in 2023-12-11T20:10:36.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:35 smithi032 ceph-mon[132488]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:10:36.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:36.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:35 smithi032 ceph-mon[132488]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:36.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:35 smithi039 ceph-mon[102205]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-11T20:10:36.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:35 smithi039 ceph-mon[102205]: osdmap e44: 7 total, 6 up, 7 in 2023-12-11T20:10:36.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:35 smithi039 ceph-mon[102205]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:10:36.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:36.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:35 smithi039 ceph-mon[102205]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:36.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:35 smithi012 ceph-mon[128787]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-11T20:10:36.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:35 smithi012 ceph-mon[128787]: osdmap e44: 7 total, 6 up, 7 in 2023-12-11T20:10:36.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:35 smithi012 ceph-mon[128787]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:10:36.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:36.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:35 smithi012 ceph-mon[128787]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-11T20:10:36.331 INFO:journalctl@ceph.osd.6.smithi012.stdout:Dec 11 20:10:35 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-6[161096]: 2023-12-11T20:10:35.919+0000 7fd15abea700 -1 osd.6 0 waiting for initial osdmap 2023-12-11T20:10:36.331 INFO:journalctl@ceph.osd.6.smithi012.stdout:Dec 11 20:10:35 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-6[161096]: 2023-12-11T20:10:35.931+0000 7fd1561e3700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:10:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:36 smithi032 ceph-mon[132488]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:10:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:36 smithi032 ceph-mon[132488]: osdmap e45: 7 total, 6 up, 7 in 2023-12-11T20:10:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:36 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:36 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:37.225 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-11T20:10:37.225 INFO:teuthology.orchestra.run.smithi032.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-11T20:10:37.225 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10+0 records in 2023-12-11T20:10:37.225 INFO:teuthology.orchestra.run.smithi032.stderr:10+0 records out 2023-12-11T20:10:37.225 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0308062 s, 340 MB/s 2023-12-11T20:10:37.226 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping successful for: 2023-12-11T20:10:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:36 smithi039 ceph-mon[102205]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:10:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:36 smithi039 ceph-mon[102205]: osdmap e45: 7 total, 6 up, 7 in 2023-12-11T20:10:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:36 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:36 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:36 smithi012 ceph-mon[128787]: from='osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:10:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:36 smithi012 ceph-mon[128787]: osdmap e45: 7 total, 6 up, 7 in 2023-12-11T20:10:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:36 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:36 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:37.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi032:vg_nvme/lv_2 2023-12-11T20:10:38.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:10:38.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:10:38.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] boot 2023-12-11T20:10:38.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: osdmap e46: 7 total, 7 up, 7 in 2023-12-11T20:10:38.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:38.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:38.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] boot 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: osdmap e46: 7 total, 7 up, 7 in 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:38.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:38.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: osd.6 [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] boot 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: osdmap e46: 7 total, 7 up, 7 in 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:38.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:10:38.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:38.504 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:10:39.045 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:38 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi012 2023-12-11T20:10:39.045 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:38 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi012 to 5758M 2023-12-11T20:10:39.046 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:38 smithi032 ceph-mon[132488]: osdmap e47: 7 total, 7 up, 7 in 2023-12-11T20:10:39.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:38 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi012 2023-12-11T20:10:39.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:38 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi012 to 5758M 2023-12-11T20:10:39.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:38 smithi039 ceph-mon[102205]: osdmap e47: 7 total, 7 up, 7 in 2023-12-11T20:10:39.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:38 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi012 2023-12-11T20:10:39.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:38 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi012 to 5758M 2023-12-11T20:10:39.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:38 smithi012 ceph-mon[128787]: osdmap e47: 7 total, 7 up, 7 in 2023-12-11T20:10:39.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 -- 172.21.15.32:0/2392498222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc074030 msgr2=0x7f43fc0744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:39.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2392498222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc074030 0x7f43fc0744b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009990 tx=0x7f43f0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:10:39.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 -- 172.21.15.32:0/2392498222 shutdown_connections 2023-12-11T20:10:39.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2392498222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc10dc00 0x7f43fc10fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:39.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2392498222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc075600 0x7f43fc073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:39.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2392498222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc074030 0x7f43fc0744b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:39.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 -- 172.21.15.32:0/2392498222 >> 172.21.15.32:0/2392498222 conn(0x7f43fc0fcbe0 msgr2=0x7f43fc0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:10:39.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 -- 172.21.15.32:0/2392498222 shutdown_connections 2023-12-11T20:10:39.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.992+0000 7f4400ca2700 1 -- 172.21.15.32:0/2392498222 wait complete. 2023-12-11T20:10:39.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.993+0000 7f4400ca2700 1 Processor -- start 2023-12-11T20:10:39.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.993+0000 7f4400ca2700 1 -- start start 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.993+0000 7f4400ca2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc074030 0x7f43fc19daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f4400ca2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc075600 0x7f43fc19dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f4400ca2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc10dc00 0x7f43fc1a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f4400ca2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1a55e0 con 0x7f43fc074030 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f4400ca2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1a5720 con 0x7f43fc075600 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f4400ca2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1a58b0 con 0x7f43fc10dc00 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43f9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc075600 0x7f43fc19dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43f9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc075600 0x7f43fc19dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47074/0 (socket says 172.21.15.32:47074) 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43f9d9b700 1 -- 172.21.15.32:0/2902801326 learned_addr learned my addr 172.21.15.32:0/2902801326 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43fad9d700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc10dc00 0x7f43fc1a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43fa59c700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc074030 0x7f43fc19daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:10:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43f9d9b700 1 -- 172.21.15.32:0/2902801326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc10dc00 msgr2=0x7f43fc1a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43f9d9b700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc10dc00 0x7f43fc1a5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43f9d9b700 1 -- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc074030 msgr2=0x7f43fc19daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:10:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43f9d9b700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc074030 0x7f43fc19daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:10:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43f9d9b700 1 -- 172.21.15.32:0/2902801326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f00095f0 con 0x7f43fc075600 2023-12-11T20:10:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.994+0000 7f43fad9d700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc10dc00 0x7f43fc1a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:10:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.995+0000 7f43f9d9b700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc075600 0x7f43fc19dfe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c010 tx=0x7f43f0005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:10:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.995+0000 7f43eb7fe700 1 -- 172.21.15.32:0/2902801326 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f001d070 con 0x7f43fc075600 2023-12-11T20:10:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.995+0000 7f43eb7fe700 1 -- 172.21.15.32:0/2902801326 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43f000bd70 con 0x7f43fc075600 2023-12-11T20:10:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.995+0000 7f43eb7fe700 1 -- 172.21.15.32:0/2902801326 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0022c20 con 0x7f43fc075600 2023-12-11T20:10:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.995+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc1a5b30 con 0x7f43fc075600 2023-12-11T20:10:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.995+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc1a5ef0 con 0x7f43fc075600 2023-12-11T20:10:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.996+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc103e60 con 0x7f43fc075600 2023-12-11T20:10:39.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:39.998+0000 7f43eb7fe700 1 -- 172.21.15.32:0/2902801326 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f43f0003e20 con 0x7f43fc075600 2023-12-11T20:10:39.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:40.000+0000 7f43eb7fe700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43e40a1500 0x7f43e40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:10:39.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:40.000+0000 7f43eb7fe700 1 -- 172.21.15.32:0/2902801326 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f43f00cd5b0 con 0x7f43fc075600 2023-12-11T20:10:39.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:40.000+0000 7f43fa59c700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43e40a1500 0x7f43e40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:10:39.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:40.001+0000 7f43fa59c700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43e40a1500 0x7f43e40a39c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0759e0 tx=0x7f43ec00a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:10:40.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:40.004+0000 7f43eb7fe700 1 -- 172.21.15.32:0/2902801326 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f43f0097910 con 0x7f43fc075600 2023-12-11T20:10:40.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:39 smithi032 ceph-mon[132488]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:10:40.223+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f43fc02d380 con 0x7f43e40a1500 2023-12-11T20:10:40.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:39 smithi039 ceph-mon[102205]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:40.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:39 smithi012 ceph-mon[128787]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:41.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:10:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:10:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:41.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:10:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:10:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:41.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:10:41.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:10:41.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:42.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:41 smithi032 ceph-mon[132488]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:10:42.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:41 smithi032 ceph-mon[132488]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:42.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:41 smithi039 ceph-mon[102205]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:10:42.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:41 smithi039 ceph-mon[102205]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:41 smithi012 ceph-mon[128787]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:10:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:41 smithi012 ceph-mon[128787]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:44.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:44 smithi039 ceph-mon[102205]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:44 smithi039 ceph-mon[102205]: from='client.? 172.21.15.32:0/2943409629' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]: dispatch 2023-12-11T20:10:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:44 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]: dispatch 2023-12-11T20:10:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:44 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]': finished 2023-12-11T20:10:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:44 smithi039 ceph-mon[102205]: osdmap e48: 8 total, 7 up, 8 in 2023-12-11T20:10:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:44 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:10:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:44 smithi012 ceph-mon[128787]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:44 smithi012 ceph-mon[128787]: from='client.? 172.21.15.32:0/2943409629' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]: dispatch 2023-12-11T20:10:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:44 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]: dispatch 2023-12-11T20:10:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:44 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]': finished 2023-12-11T20:10:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:44 smithi012 ceph-mon[128787]: osdmap e48: 8 total, 7 up, 8 in 2023-12-11T20:10:44.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:44 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:10:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:44 smithi032 ceph-mon[132488]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:44 smithi032 ceph-mon[132488]: from='client.? 172.21.15.32:0/2943409629' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]: dispatch 2023-12-11T20:10:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:44 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]: dispatch 2023-12-11T20:10:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:44 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f81d15a2-358b-4de6-af22-fdb5476b625e"}]': finished 2023-12-11T20:10:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:44 smithi032 ceph-mon[132488]: osdmap e48: 8 total, 7 up, 8 in 2023-12-11T20:10:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:44 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:10:45.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:45 smithi039 ceph-mon[102205]: from='client.? 172.21.15.32:0/555353297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:10:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:45 smithi012 ceph-mon[128787]: from='client.? 172.21.15.32:0/555353297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:10:45.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:45 smithi032 ceph-mon[132488]: from='client.? 172.21.15.32:0/555353297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:10:46.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:46 smithi039 ceph-mon[102205]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:46 smithi012 ceph-mon[128787]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:46.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:46 smithi032 ceph-mon[132488]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:48 smithi012 ceph-mon[128787]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:48.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:48 smithi032 ceph-mon[132488]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:48.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:48 smithi039 ceph-mon[102205]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:49.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:49 smithi032 ceph-mon[132488]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:49.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:49 smithi039 ceph-mon[102205]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:49 smithi012 ceph-mon[128787]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:51.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-11T20:10:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:51.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-11T20:10:51.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-11T20:10:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:10:52.176 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:51 smithi032 ceph-mon[132488]: Deploying daemon osd.7 on smithi032 2023-12-11T20:10:52.177 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:51 smithi032 ceph-mon[132488]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:52.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:51 smithi039 ceph-mon[102205]: Deploying daemon osd.7 on smithi032 2023-12-11T20:10:52.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:51 smithi039 ceph-mon[102205]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:52.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:51 smithi012 ceph-mon[128787]: Deploying daemon osd.7 on smithi032 2023-12-11T20:10:52.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:51 smithi012 ceph-mon[128787]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:54.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:54 smithi039 ceph-mon[102205]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:54.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:54 smithi012 ceph-mon[128787]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:54.338 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:54 smithi032 ceph-mon[132488]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:56.241 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:56 smithi032 ceph-mon[132488]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:56.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:56 smithi039 ceph-mon[102205]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:56 smithi012 ceph-mon[128787]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:58.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:58 smithi039 ceph-mon[102205]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:58 smithi012 ceph-mon[128787]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:58.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:58 smithi032 ceph-mon[132488]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:10:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:10:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:10:59 smithi032 ceph-mon[132488]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:10:59 smithi039 ceph-mon[102205]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:10:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:10:59 smithi012 ceph-mon[128787]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:01.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.158+0000 7f43eb7fe700 1 -- 172.21.15.32:0/2902801326 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f43fc02d380 con 0x7f43e40a1500 2023-12-11T20:11:01.158 INFO:teuthology.orchestra.run.smithi032.stdout:Created osd(s) 7 on host 'smithi032' 2023-12-11T20:11:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43e40a1500 msgr2=0x7f43e40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43e40a1500 0x7f43e40a39c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0759e0 tx=0x7f43ec00a380 comp rx=0 tx=0).stop 2023-12-11T20:11:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc075600 msgr2=0x7f43fc19dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc075600 0x7f43fc19dfe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c010 tx=0x7f43f0005b00 comp rx=0 tx=0).stop 2023-12-11T20:11:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 shutdown_connections 2023-12-11T20:11:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43e40a1500 0x7f43e40a39c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43fc10dc00 0x7f43fc1a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:01.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc074030 0x7f43fc19daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:01.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 --2- 172.21.15.32:0/2902801326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43fc075600 0x7f43fc19dfe0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:01.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 >> 172.21.15.32:0/2902801326 conn(0x7f43fc0fcbe0 msgr2=0x7f43fc100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:11:01.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 shutdown_connections 2023-12-11T20:11:01.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:11:01.161+0000 7f4400ca2700 1 -- 172.21.15.32:0/2902801326 wait complete. 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.431 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:01.583 DEBUG:teuthology.orchestra.run.smithi032:osd.7> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.7.service 2023-12-11T20:11:01.589 INFO:tasks.cephadm:Deploying osd.8 on smithi039 with /dev/vg_nvme/lv_2... 2023-12-11T20:11:01.589 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-11T20:11:01.661 INFO:journalctl@ceph.osd.7.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:11:01.662 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.662 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.662 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:01.662 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:01.662 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.662 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:01.663 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.663 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.663 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:01.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:02.387 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:11:02.626 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:02 smithi032 ceph-mon[132488]: from='osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-11T20:11:02.626 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:02 smithi032 ceph-mon[132488]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-11T20:11:02.684 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:02 smithi039 ceph-mon[102205]: from='osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-11T20:11:02.684 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:02 smithi039 ceph-mon[102205]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-11T20:11:02.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:02 smithi012 ceph-mon[128787]: from='osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-11T20:11:02.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:02 smithi012 ceph-mon[128787]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-11T20:11:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:03 smithi039 ceph-mon[102205]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-11T20:11:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:03 smithi039 ceph-mon[102205]: osdmap e49: 8 total, 7 up, 8 in 2023-12-11T20:11:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:03 smithi039 ceph-mon[102205]: from='osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:11:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:03 smithi039 ceph-mon[102205]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:11:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:03 smithi039 ceph-mon[102205]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:03.713 INFO:journalctl@ceph.osd.7.smithi032.stdout:Dec 11 20:11:03 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-7[153449]: 2023-12-11T20:11:03.457+0000 7f171f5e1700 -1 osd.7 0 waiting for initial osdmap 2023-12-11T20:11:03.713 INFO:journalctl@ceph.osd.7.smithi032.stdout:Dec 11 20:11:03 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-7[153449]: 2023-12-11T20:11:03.469+0000 7f171a3d9700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:11:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:03 smithi032 ceph-mon[132488]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-11T20:11:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:03 smithi032 ceph-mon[132488]: osdmap e49: 8 total, 7 up, 8 in 2023-12-11T20:11:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:03 smithi032 ceph-mon[132488]: from='osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:11:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:03 smithi032 ceph-mon[132488]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:11:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:03 smithi032 ceph-mon[132488]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:03.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:03 smithi012 ceph-mon[128787]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-11T20:11:03.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:03 smithi012 ceph-mon[128787]: osdmap e49: 8 total, 7 up, 8 in 2023-12-11T20:11:03.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:03 smithi012 ceph-mon[128787]: from='osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:11:03.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:03.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:03 smithi012 ceph-mon[128787]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:11:03.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:03 smithi012 ceph-mon[128787]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:04.558 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-11T20:11:04.558 INFO:teuthology.orchestra.run.smithi039.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-11T20:11:04.558 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10+0 records in 2023-12-11T20:11:04.558 INFO:teuthology.orchestra.run.smithi039.stderr:10+0 records out 2023-12-11T20:11:04.558 INFO:teuthology.orchestra.run.smithi039.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0328148 s, 320 MB/s 2023-12-11T20:11:04.558 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping successful for: 2023-12-11T20:11:04.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:04 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:11:04.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:04 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:11:04.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:04 smithi032 ceph-mon[132488]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:11:04.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:04 smithi032 ceph-mon[132488]: osdmap e50: 8 total, 7 up, 8 in 2023-12-11T20:11:04.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:04.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:04.719 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:04 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:11:04.719 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:04 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:11:04.720 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:04 smithi039 ceph-mon[102205]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:11:04.720 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:04 smithi039 ceph-mon[102205]: osdmap e50: 8 total, 7 up, 8 in 2023-12-11T20:11:04.720 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:04.720 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:04 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:11:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:04 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:11:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:04 smithi012 ceph-mon[128787]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:11:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:04 smithi012 ceph-mon[128787]: osdmap e50: 8 total, 7 up, 8 in 2023-12-11T20:11:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:05.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi039:vg_nvme/lv_2 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] boot 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: osdmap e51: 8 total, 8 up, 8 in 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] boot 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: osdmap e51: 8 total, 8 up, 8 in 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: osd.7 [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] boot 2023-12-11T20:11:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: osdmap e51: 8 total, 8 up, 8 in 2023-12-11T20:11:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-11T20:11:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-11T20:11:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:05.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:05.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:05.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:05.873 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:11:06.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:06 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi032 2023-12-11T20:11:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:06 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi032 to 5758M 2023-12-11T20:11:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:06 smithi032 ceph-mon[132488]: osdmap e52: 8 total, 8 up, 8 in 2023-12-11T20:11:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:06 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi032 2023-12-11T20:11:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:06 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi032 to 5758M 2023-12-11T20:11:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:06 smithi039 ceph-mon[102205]: osdmap e52: 8 total, 8 up, 8 in 2023-12-11T20:11:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:06 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi032 2023-12-11T20:11:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:06 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi032 to 5758M 2023-12-11T20:11:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:06 smithi012 ceph-mon[128787]: osdmap e52: 8 total, 8 up, 8 in 2023-12-11T20:11:07.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.296+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/695533737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb4074030 msgr2=0x7f9fb40744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:07.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.296+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/695533737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb4074030 0x7f9fb40744b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009990 tx=0x7f9fa4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:11:07.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.297+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/695533737 shutdown_connections 2023-12-11T20:11:07.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.297+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/695533737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb4075600 0x7f9fb4073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.297+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/695533737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb41094f0 0x7f9fb410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.297+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/695533737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb4074030 0x7f9fb40744b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.297+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/695533737 >> 172.21.15.39:0/695533737 conn(0x7f9fb40fcbe0 msgr2=0x7f9fb40ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:11:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.297+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/695533737 shutdown_connections 2023-12-11T20:11:07.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.297+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/695533737 wait complete. 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.298+0000 7f9fbc3c7700 1 Processor -- start 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.298+0000 7f9fbc3c7700 1 -- start start 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.298+0000 7f9fbc3c7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb4074030 0x7f9fb4199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.298+0000 7f9fbc3c7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb4075600 0x7f9fb4199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.298+0000 7f9fbc3c7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb41094f0 0x7f9fb41a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.298+0000 7f9fbc3c7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb41a1140 con 0x7f9fb4075600 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.298+0000 7f9fbc3c7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb41a1280 con 0x7f9fb4074030 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.298+0000 7f9fbc3c7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb41a1410 con 0x7f9fb41094f0 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb4074030 0x7f9fb4199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:11:07.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb4074030 0x7f9fb4199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.39:60646/0 (socket says 172.21.15.39:60646) 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 -- 172.21.15.39:0/1905563783 learned_addr learned my addr 172.21.15.39:0/1905563783 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba964700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb41094f0 0x7f9fb41a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fb9962700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb4075600 0x7f9fb4199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 -- 172.21.15.39:0/1905563783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb41094f0 msgr2=0x7f9fb41a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb41094f0 0x7f9fb41a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 -- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb4075600 msgr2=0x7f9fb4199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb4075600 0x7f9fb4199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 -- 172.21.15.39:0/1905563783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa40095f0 con 0x7f9fb4074030 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba964700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb41094f0 0x7f9fb41a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.299+0000 7f9fba163700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb4074030 0x7f9fb4199600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000c9e0 tx=0x7f9fb000ccf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.300+0000 7f9fab7fe700 1 -- 172.21.15.39:0/1905563783 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0007aa0 con 0x7f9fb4074030 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.300+0000 7f9fab7fe700 1 -- 172.21.15.39:0/1905563783 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9fb000ce80 con 0x7f9fb4074030 2023-12-11T20:11:07.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.300+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb41a16f0 con 0x7f9fb4074030 2023-12-11T20:11:07.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.300+0000 7f9fab7fe700 1 -- 172.21.15.39:0/1905563783 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0018400 con 0x7f9fb4074030 2023-12-11T20:11:07.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.300+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb41a1c40 con 0x7f9fb4074030 2023-12-11T20:11:07.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.301+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb41082b0 con 0x7f9fb4074030 2023-12-11T20:11:07.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.303+0000 7f9fab7fe700 1 -- 172.21.15.39:0/1905563783 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9fb000f450 con 0x7f9fb4074030 2023-12-11T20:11:07.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.304+0000 7f9fab7fe700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fa00a1500 0x7f9fa00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:11:07.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.305+0000 7f9fab7fe700 1 -- 172.21.15.39:0/1905563783 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5430+0+0 (secure 0 0 0) 0x7f9fb00cc400 con 0x7f9fb4074030 2023-12-11T20:11:07.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.305+0000 7f9fb9962700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fa00a1500 0x7f9fa00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:11:07.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.306+0000 7f9fb9962700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fa00a1500 0x7f9fa00a39c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4000c00 tx=0x7f9fa4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:11:07.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.307+0000 7f9fab7fe700 1 -- 172.21.15.39:0/1905563783 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9fb0096610 con 0x7f9fb4074030 2023-12-11T20:11:07.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:07.529+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fb402d380 con 0x7f9fa00a1500 2023-12-11T20:11:07.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:07 smithi039 ceph-mon[102205]: osdmap e53: 8 total, 8 up, 8 in 2023-12-11T20:11:07.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:07 smithi039 ceph-mon[102205]: pgmap v195: 1 pgs: 1 unknown; 0 B data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:07 smithi012 ceph-mon[128787]: osdmap e53: 8 total, 8 up, 8 in 2023-12-11T20:11:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:07 smithi012 ceph-mon[128787]: pgmap v195: 1 pgs: 1 unknown; 0 B data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:07 smithi032 ceph-mon[132488]: osdmap e53: 8 total, 8 up, 8 in 2023-12-11T20:11:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:07 smithi032 ceph-mon[132488]: pgmap v195: 1 pgs: 1 unknown; 0 B data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:08.751 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:08 smithi039 ceph-mon[102205]: osdmap e54: 8 total, 8 up, 8 in 2023-12-11T20:11:08.751 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:08 smithi039 ceph-mon[102205]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:11:08.751 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:11:08.751 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:11:08.751 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:08.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:08 smithi012 ceph-mon[128787]: osdmap e54: 8 total, 8 up, 8 in 2023-12-11T20:11:08.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:08 smithi012 ceph-mon[128787]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:11:08.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:11:08.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:11:08.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:08.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:08 smithi032 ceph-mon[132488]: osdmap e54: 8 total, 8 up, 8 in 2023-12-11T20:11:08.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:08 smithi032 ceph-mon[132488]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:11:08.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:11:08.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:11:08.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:09.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:09 smithi039 ceph-mon[102205]: osdmap e55: 8 total, 8 up, 8 in 2023-12-11T20:11:09.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:09 smithi039 ceph-mon[102205]: pgmap v198: 1 pgs: 1 unknown; 0 B data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:09.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:09 smithi012 ceph-mon[128787]: osdmap e55: 8 total, 8 up, 8 in 2023-12-11T20:11:09.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:09 smithi012 ceph-mon[128787]: pgmap v198: 1 pgs: 1 unknown; 0 B data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:09.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:09 smithi032 ceph-mon[132488]: osdmap e55: 8 total, 8 up, 8 in 2023-12-11T20:11:09.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:09 smithi032 ceph-mon[132488]: pgmap v198: 1 pgs: 1 unknown; 0 B data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:10.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:10 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/1192496155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]: dispatch 2023-12-11T20:11:10.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:10 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]: dispatch 2023-12-11T20:11:10.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:10 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]': finished 2023-12-11T20:11:10.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:10 smithi032 ceph-mon[132488]: osdmap e56: 9 total, 8 up, 9 in 2023-12-11T20:11:10.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:11.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:10 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/1192496155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]: dispatch 2023-12-11T20:11:11.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:10 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]: dispatch 2023-12-11T20:11:11.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:10 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]': finished 2023-12-11T20:11:11.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:10 smithi039 ceph-mon[102205]: osdmap e56: 9 total, 8 up, 9 in 2023-12-11T20:11:11.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:10 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/1192496155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]: dispatch 2023-12-11T20:11:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:10 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]: dispatch 2023-12-11T20:11:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:10 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ac0416b-ec57-468d-8340-9732d86f108d"}]': finished 2023-12-11T20:11:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:10 smithi012 ceph-mon[128787]: osdmap e56: 9 total, 8 up, 9 in 2023-12-11T20:11:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:11.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:11 smithi032 ceph-mon[132488]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:11.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:11 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/1463936244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:11:12.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:11 smithi039 ceph-mon[102205]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:12.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:11 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/1463936244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:11:12.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:11 smithi012 ceph-mon[128787]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:12.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:11 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/1463936244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:11:14.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:14 smithi039 ceph-mon[102205]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:14 smithi012 ceph-mon[128787]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:14 smithi032 ceph-mon[132488]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:16.317 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:16 smithi039 ceph-mon[102205]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:16 smithi012 ceph-mon[128787]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:16.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:16 smithi032 ceph-mon[132488]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:18.220 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:18 smithi039 ceph-mon[102205]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:18.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:18 smithi012 ceph-mon[128787]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:18 smithi032 ceph-mon[132488]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:19.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-11T20:11:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:19 smithi032 ceph-mon[132488]: Deploying daemon osd.8 on smithi039 2023-12-11T20:11:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:19 smithi032 ceph-mon[132488]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:19.484 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-11T20:11:19.485 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:19.485 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:19 smithi039 ceph-mon[102205]: Deploying daemon osd.8 on smithi039 2023-12-11T20:11:19.485 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:19 smithi039 ceph-mon[102205]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-11T20:11:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:19 smithi012 ceph-mon[128787]: Deploying daemon osd.8 on smithi039 2023-12-11T20:11:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:19 smithi012 ceph-mon[128787]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:22 smithi039 ceph-mon[102205]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:22 smithi012 ceph-mon[128787]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:22.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:22 smithi032 ceph-mon[132488]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:24 smithi012 ceph-mon[128787]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:24.443 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:24 smithi039 ceph-mon[102205]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:24.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:24 smithi032 ceph-mon[132488]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:25.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:25.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:25.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:25.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:25 smithi032 ceph-mon[132488]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:25.999 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:25.999 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:25.999 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:25.999 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:25 smithi039 ceph-mon[102205]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:26.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:25 smithi012 ceph-mon[128787]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:28.262 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:28 smithi039 ceph-mon[102205]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:28.263 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.263 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.263 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:28.263 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:28.263 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:28 smithi012 ceph-mon[128787]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.408+0000 7f9fab7fe700 1 -- 172.21.15.39:0/1905563783 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9fb402d380 con 0x7f9fa00a1500 2023-12-11T20:11:28.407 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 8 on host 'smithi039' 2023-12-11T20:11:28.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fa00a1500 msgr2=0x7f9fa00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fa00a1500 0x7f9fa00a39c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4000c00 tx=0x7f9fa4005fb0 comp rx=0 tx=0).stop 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb4074030 msgr2=0x7f9fb4199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb4074030 0x7f9fb4199600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000c9e0 tx=0x7f9fb000ccf0 comp rx=0 tx=0).stop 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 shutdown_connections 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fa00a1500 0x7f9fa00a39c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fb4074030 0x7f9fb4199600 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fb41094f0 0x7f9fb41a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 --2- 172.21.15.39:0/1905563783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb4075600 0x7f9fb4199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 >> 172.21.15.39:0/1905563783 conn(0x7f9fb40fcbe0 msgr2=0x7f9fb41053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 shutdown_connections 2023-12-11T20:11:28.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:11:28.410+0000 7f9fbc3c7700 1 -- 172.21.15.39:0/1905563783 wait complete. 2023-12-11T20:11:28.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:28 smithi032 ceph-mon[132488]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:28.907 DEBUG:teuthology.orchestra.run.smithi039:osd.8> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.8.service 2023-12-11T20:11:28.912 INFO:tasks.cephadm:Deploying osd.9 on smithi012 with /dev/vg_nvme/lv_1... 2023-12-11T20:11:28.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-11T20:11:28.985 INFO:journalctl@ceph.osd.8.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:11:29.707 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:29 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:29.707 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:29 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:29.707 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:29 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:29.707 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:29 smithi039 ceph-mon[102205]: from='osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-11T20:11:29.707 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:29 smithi039 ceph-mon[102205]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-11T20:11:29.707 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:29 smithi039 ceph-mon[102205]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:29 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:29 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:29 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:29.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:29 smithi032 ceph-mon[132488]: from='osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-11T20:11:29.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:29 smithi032 ceph-mon[132488]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-11T20:11:29.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:29 smithi032 ceph-mon[132488]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:29.717 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:11:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:29 smithi012 ceph-mon[128787]: from='osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-11T20:11:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:29 smithi012 ceph-mon[128787]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-11T20:11:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:29 smithi012 ceph-mon[128787]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:30 smithi012 ceph-mon[128787]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-11T20:11:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:30 smithi012 ceph-mon[128787]: osdmap e57: 9 total, 8 up, 9 in 2023-12-11T20:11:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:30 smithi012 ceph-mon[128787]: from='osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:11:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:30 smithi012 ceph-mon[128787]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:11:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:30 smithi032 ceph-mon[132488]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-11T20:11:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:30 smithi032 ceph-mon[132488]: osdmap e57: 9 total, 8 up, 9 in 2023-12-11T20:11:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:30 smithi032 ceph-mon[132488]: from='osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:11:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:30 smithi032 ceph-mon[132488]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:11:30.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:30 smithi039 ceph-mon[102205]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-11T20:11:30.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:30 smithi039 ceph-mon[102205]: osdmap e57: 9 total, 8 up, 9 in 2023-12-11T20:11:30.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:30.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:30 smithi039 ceph-mon[102205]: from='osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:11:30.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:30 smithi039 ceph-mon[102205]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:11:30.802 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:11:30 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:11:30.422+0000 7fb7e683c700 -1 osd.8 0 waiting for initial osdmap 2023-12-11T20:11:30.803 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:11:30 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:11:30.442+0000 7fb7de62e700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:11:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:31 smithi032 ceph-mon[132488]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:11:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:31 smithi032 ceph-mon[132488]: osdmap e58: 9 total, 8 up, 9 in 2023-12-11T20:11:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:31 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:31 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:31 smithi032 ceph-mon[132488]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:31.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:31 smithi032 ceph-mon[132488]: osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] boot 2023-12-11T20:11:31.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:31 smithi032 ceph-mon[132488]: osdmap e59: 9 total, 9 up, 9 in 2023-12-11T20:11:31.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:31 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:31 smithi039 ceph-mon[102205]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:11:31.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:31 smithi039 ceph-mon[102205]: osdmap e58: 9 total, 8 up, 9 in 2023-12-11T20:11:31.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:31 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:31 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:31 smithi039 ceph-mon[102205]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:31.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:31 smithi039 ceph-mon[102205]: osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] boot 2023-12-11T20:11:31.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:31 smithi039 ceph-mon[102205]: osdmap e59: 9 total, 9 up, 9 in 2023-12-11T20:11:31.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:31 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:31 smithi012 ceph-mon[128787]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:11:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:31 smithi012 ceph-mon[128787]: osdmap e58: 9 total, 8 up, 9 in 2023-12-11T20:11:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:31 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:31 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:31 smithi012 ceph-mon[128787]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-12-11T20:11:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:31 smithi012 ceph-mon[128787]: osd.8 [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] boot 2023-12-11T20:11:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:31 smithi012 ceph-mon[128787]: osdmap e59: 9 total, 9 up, 9 in 2023-12-11T20:11:31.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:31 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-11T20:11:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-11T20:11:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-11T20:11:31.977 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10+0 records in 2023-12-11T20:11:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:10+0 records out 2023-12-11T20:11:31.978 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0480564 s, 218 MB/s 2023-12-11T20:11:31.978 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping successful for: 2023-12-11T20:11:32.509 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi012:vg_nvme/lv_1 2023-12-11T20:11:32.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:32 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:11:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:32 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:11:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:32 smithi032 ceph-mon[132488]: osdmap e60: 9 total, 9 up, 9 in 2023-12-11T20:11:32.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:32 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:11:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:32 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:11:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:32 smithi039 ceph-mon[102205]: osdmap e60: 9 total, 9 up, 9 in 2023-12-11T20:11:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:32 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:11:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:32 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:11:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:32 smithi012 ceph-mon[128787]: osdmap e60: 9 total, 9 up, 9 in 2023-12-11T20:11:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:11:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi039 2023-12-11T20:11:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi039 to 5757M 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:33.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:33 smithi039 ceph-mon[102205]: osdmap e61: 9 total, 9 up, 9 in 2023-12-11T20:11:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi039 2023-12-11T20:11:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi039 to 5757M 2023-12-11T20:11:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:33 smithi012 ceph-mon[128787]: osdmap e61: 9 total, 9 up, 9 in 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi039 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi039 to 5757M 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:33.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:33.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:33.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:33.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:33 smithi032 ceph-mon[132488]: osdmap e61: 9 total, 9 up, 9 in 2023-12-11T20:11:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.845+0000 7f58d3c58700 1 -- 172.21.15.12:0/878776099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 msgr2=0x7f58cc109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.845+0000 7f58d3c58700 1 --2- 172.21.15.12:0/878776099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 0x7f58cc109a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58c400b0d0 tx=0x7f58c400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:11:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.845+0000 7f58d3c58700 1 -- 172.21.15.12:0/878776099 shutdown_connections 2023-12-11T20:11:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.845+0000 7f58d3c58700 1 --2- 172.21.15.12:0/878776099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58cc101620 0x7f58cc101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.845+0000 7f58d3c58700 1 --2- 172.21.15.12:0/878776099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 0x7f58cc109a70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.845+0000 7f58d3c58700 1 --2- 172.21.15.12:0/878776099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58cc102820 0x7f58cc102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.845+0000 7f58d3c58700 1 -- 172.21.15.12:0/878776099 >> 172.21.15.12:0/878776099 conn(0x7f58cc0fcbe0 msgr2=0x7f58cc0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:11:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.846+0000 7f58d3c58700 1 -- 172.21.15.12:0/878776099 shutdown_connections 2023-12-11T20:11:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.846+0000 7f58d3c58700 1 -- 172.21.15.12:0/878776099 wait complete. 2023-12-11T20:11:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.847+0000 7f58d3c58700 1 Processor -- start 2023-12-11T20:11:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.847+0000 7f58d3c58700 1 -- start start 2023-12-11T20:11:34.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d3c58700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58cc101620 0x7f58cc075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:11:34.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d3c58700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58cc102820 0x7f58cc0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:11:34.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d3c58700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 0x7f58cc073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:11:34.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d3c58700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0746a0 con 0x7f58cc1031c0 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d3c58700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc074810 con 0x7f58cc102820 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d3c58700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc1a15e0 con 0x7f58cc101620 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d21f5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 0x7f58cc073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d21f5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 0x7f58cc073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46622/0 (socket says 172.21.15.12:46622) 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d19f4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58cc101620 0x7f58cc075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d21f5700 1 -- 172.21.15.12:0/3434514047 learned_addr learned my addr 172.21.15.12:0/3434514047 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.848+0000 7f58d11f3700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58cc102820 0x7f58cc0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d21f5700 1 -- 172.21.15.12:0/3434514047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58cc101620 msgr2=0x7f58cc075320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d21f5700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58cc101620 0x7f58cc075320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d21f5700 1 -- 172.21.15.12:0/3434514047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58cc102820 msgr2=0x7f58cc0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d21f5700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58cc102820 0x7f58cc0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d21f5700 1 -- 172.21.15.12:0/3434514047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4009d00 con 0x7f58cc1031c0 2023-12-11T20:11:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d11f3700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58cc102820 0x7f58cc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:11:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d21f5700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 0x7f58cc073f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58c40079c0 tx=0x7f58c400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:11:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58c2ffd700 1 -- 172.21.15.12:0/3434514047 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c400e040 con 0x7f58cc1031c0 2023-12-11T20:11:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc1a1810 con 0x7f58cc1031c0 2023-12-11T20:11:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58c2ffd700 1 -- 172.21.15.12:0/3434514047 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58c4004e60 con 0x7f58cc1031c0 2023-12-11T20:11:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58c2ffd700 1 -- 172.21.15.12:0/3434514047 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c401b6b0 con 0x7f58cc1031c0 2023-12-11T20:11:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.849+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc1a1c30 con 0x7f58cc1031c0 2023-12-11T20:11:34.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.850+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc108a80 con 0x7f58cc1031c0 2023-12-11T20:11:34.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.852+0000 7f58c2ffd700 1 -- 172.21.15.12:0/3434514047 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f58c401d9a0 con 0x7f58cc1031c0 2023-12-11T20:11:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.854+0000 7f58c2ffd700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58b80a1480 0x7f58b80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:11:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.854+0000 7f58c2ffd700 1 -- 172.21.15.12:0/3434514047 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f58c40cde40 con 0x7f58cc1031c0 2023-12-11T20:11:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.854+0000 7f58d19f4700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58b80a1480 0x7f58b80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:11:34.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.854+0000 7f58d19f4700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58b80a1480 0x7f58b80a3940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58cc102680 tx=0x7f58c8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:11:34.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:34.858+0000 7f58c2ffd700 1 -- 172.21.15.12:0/3434514047 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f58c4097e40 con 0x7f58cc1031c0 2023-12-11T20:11:35.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:35.079+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f58cc02d3d0 con 0x7f58b80a1480 2023-12-11T20:11:35.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:35 smithi012 ceph-mon[128787]: osdmap e62: 9 total, 9 up, 9 in 2023-12-11T20:11:35.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:35 smithi012 ceph-mon[128787]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:35.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:35 smithi012 ceph-mon[128787]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:11:35.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:11:35.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:11:35.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:35 smithi032 ceph-mon[132488]: osdmap e62: 9 total, 9 up, 9 in 2023-12-11T20:11:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:35 smithi032 ceph-mon[132488]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:35 smithi032 ceph-mon[132488]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:11:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:11:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:11:35.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:36.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:35 smithi039 ceph-mon[102205]: osdmap e62: 9 total, 9 up, 9 in 2023-12-11T20:11:36.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:35 smithi039 ceph-mon[102205]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:36.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:35 smithi039 ceph-mon[102205]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:11:36.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:11:36.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:11:36.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:36.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:36 smithi012 ceph-mon[128787]: osdmap e63: 9 total, 9 up, 9 in 2023-12-11T20:11:36.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:36 smithi032 ceph-mon[132488]: osdmap e63: 9 total, 9 up, 9 in 2023-12-11T20:11:37.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:36 smithi039 ceph-mon[102205]: osdmap e63: 9 total, 9 up, 9 in 2023-12-11T20:11:37.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:37 smithi032 ceph-mon[132488]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-12-11T20:11:38.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:37 smithi039 ceph-mon[102205]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-12-11T20:11:38.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:37 smithi012 ceph-mon[128787]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-12-11T20:11:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2629658054' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e53870-78e8-499e-8244-1415187611a3"}]: dispatch 2023-12-11T20:11:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2629658054' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e53870-78e8-499e-8244-1415187611a3"}]': finished 2023-12-11T20:11:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:39 smithi039 ceph-mon[102205]: osdmap e64: 10 total, 9 up, 10 in 2023-12-11T20:11:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:39 smithi039 ceph-mon[102205]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2023-12-11T20:11:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1766312655' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:11:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2629658054' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e53870-78e8-499e-8244-1415187611a3"}]: dispatch 2023-12-11T20:11:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2629658054' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e53870-78e8-499e-8244-1415187611a3"}]': finished 2023-12-11T20:11:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:39 smithi012 ceph-mon[128787]: osdmap e64: 10 total, 9 up, 10 in 2023-12-11T20:11:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:39 smithi012 ceph-mon[128787]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2023-12-11T20:11:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1766312655' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:11:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2629658054' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e53870-78e8-499e-8244-1415187611a3"}]: dispatch 2023-12-11T20:11:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2629658054' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e53870-78e8-499e-8244-1415187611a3"}]': finished 2023-12-11T20:11:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:39 smithi032 ceph-mon[132488]: osdmap e64: 10 total, 9 up, 10 in 2023-12-11T20:11:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:39 smithi032 ceph-mon[132488]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2023-12-11T20:11:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1766312655' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:11:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:42 smithi012 ceph-mon[128787]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-12-11T20:11:42.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:42 smithi032 ceph-mon[132488]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-12-11T20:11:42.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:42 smithi039 ceph-mon[102205]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-12-11T20:11:44.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:44 smithi012 ceph-mon[128787]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-11T20:11:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:44 smithi032 ceph-mon[132488]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-11T20:11:44.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:44 smithi039 ceph-mon[102205]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-11T20:11:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:46 smithi012 ceph-mon[128787]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:46.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:46 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-11T20:11:46.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:46 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:46 smithi032 ceph-mon[132488]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:46 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-11T20:11:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:46 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:46.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:46 smithi039 ceph-mon[102205]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:46 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-11T20:11:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:46 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:47.115 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:47 smithi012 ceph-mon[128787]: Deploying daemon osd.9 on smithi012 2023-12-11T20:11:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:47 smithi032 ceph-mon[132488]: Deploying daemon osd.9 on smithi012 2023-12-11T20:11:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:47 smithi039 ceph-mon[102205]: Deploying daemon osd.9 on smithi012 2023-12-11T20:11:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:48 smithi012 ceph-mon[128787]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:48.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:48 smithi032 ceph-mon[132488]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:48.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:48 smithi039 ceph-mon[102205]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:49.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:49 smithi039 ceph-mon[102205]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:49 smithi012 ceph-mon[128787]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:49.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:49 smithi032 ceph-mon[132488]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:52.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:52 smithi012 ceph-mon[128787]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:52.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:52 smithi032 ceph-mon[132488]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:52.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:52 smithi039 ceph-mon[102205]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:53.691 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:53.691 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:53.691 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:53.691 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:53 smithi012 ceph-mon[128787]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:53.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:53 smithi032 ceph-mon[132488]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:53.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:53 smithi039 ceph-mon[102205]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 9 on host 'smithi012' 2023-12-11T20:11:56.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.091+0000 7f58c2ffd700 1 -- 172.21.15.12:0/3434514047 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f58cc02d3d0 con 0x7f58b80a1480 2023-12-11T20:11:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58b80a1480 msgr2=0x7f58b80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58b80a1480 0x7f58b80a3940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58cc102680 tx=0x7f58c8009260 comp rx=0 tx=0).stop 2023-12-11T20:11:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 msgr2=0x7f58cc073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:11:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 0x7f58cc073f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58c40079c0 tx=0x7f58c400ccc0 comp rx=0 tx=0).stop 2023-12-11T20:11:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 shutdown_connections 2023-12-11T20:11:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58b80a1480 0x7f58b80a3940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58cc1031c0 0x7f58cc073f00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58cc101620 0x7f58cc075320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 --2- 172.21.15.12:0/3434514047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58cc102820 0x7f58cc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:11:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 >> 172.21.15.12:0/3434514047 conn(0x7f58cc0fcbe0 msgr2=0x7f58cc105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:11:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 shutdown_connections 2023-12-11T20:11:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:11:56.095+0000 7f58d3c58700 1 -- 172.21.15.12:0/3434514047 wait complete. 2023-12-11T20:11:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:56 smithi012 ceph-mon[128787]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:56.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:56.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:56 smithi032 ceph-mon[132488]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:56 smithi039 ceph-mon[102205]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:11:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:11:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:11:56.653 DEBUG:teuthology.orchestra.run.smithi012:osd.9> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.9.service 2023-12-11T20:11:56.657 INFO:tasks.cephadm:Deploying osd.10 on smithi032 with /dev/vg_nvme/lv_1... 2023-12-11T20:11:56.657 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-11T20:11:56.733 INFO:journalctl@ceph.osd.9.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:11:57.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:57 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:57.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:57 smithi012 ceph-mon[128787]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-11T20:11:57.455 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:11:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:57 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:57 smithi032 ceph-mon[132488]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-11T20:11:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:57 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:11:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:57 smithi039 ceph-mon[102205]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-11T20:11:58.330 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:11:58.076+0000 7f666f059700 -1 osd.9 0 waiting for initial osdmap 2023-12-11T20:11:58.331 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:11:58.091+0000 7f666864e700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:11:58.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-mon[128787]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:58.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-mon[128787]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-11T20:11:58.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-mon[128787]: osdmap e65: 10 total, 9 up, 10 in 2023-12-11T20:11:58.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-mon[128787]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:11:58.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:58.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-mon[128787]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:11:58.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-mon[128787]: osdmap e66: 10 total, 9 up, 10 in 2023-12-11T20:11:58.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:58.352 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:58 smithi032 ceph-mon[132488]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:58.353 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:58 smithi032 ceph-mon[132488]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-11T20:11:58.353 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:58 smithi032 ceph-mon[132488]: osdmap e65: 10 total, 9 up, 10 in 2023-12-11T20:11:58.353 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:58 smithi032 ceph-mon[132488]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:11:58.353 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:58.353 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:58 smithi032 ceph-mon[132488]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:11:58.353 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:58 smithi032 ceph-mon[132488]: osdmap e66: 10 total, 9 up, 10 in 2023-12-11T20:11:58.353 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:58.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:58 smithi039 ceph-mon[102205]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:11:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:58 smithi039 ceph-mon[102205]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-11T20:11:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:58 smithi039 ceph-mon[102205]: osdmap e65: 10 total, 9 up, 10 in 2023-12-11T20:11:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:58 smithi039 ceph-mon[102205]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2023-12-11T20:11:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:58 smithi039 ceph-mon[102205]: from='osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2023-12-11T20:11:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:58 smithi039 ceph-mon[102205]: osdmap e66: 10 total, 9 up, 10 in 2023-12-11T20:11:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:59.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:59 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:59.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:11:59 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:11:59 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:11:59 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:11:59.588 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-11T20:11:59.588 INFO:teuthology.orchestra.run.smithi032.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-11T20:11:59.588 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10+0 records in 2023-12-11T20:11:59.588 INFO:teuthology.orchestra.run.smithi032.stderr:10+0 records out 2023-12-11T20:11:59.588 INFO:teuthology.orchestra.run.smithi032.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0399052 s, 263 MB/s 2023-12-11T20:11:59.589 INFO:teuthology.orchestra.run.smithi032.stderr:--> Zapping successful for: 2023-12-11T20:12:00.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi032:vg_nvme/lv_1 2023-12-11T20:12:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:12:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:12:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:12:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] boot 2023-12-11T20:12:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: osdmap e67: 10 total, 10 up, 10 in 2023-12-11T20:12:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:12:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:00.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] boot 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: osdmap e67: 10 total, 10 up, 10 in 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:00.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:00.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:12:00.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:12:00.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-11T20:12:00.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: osd.9 [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] boot 2023-12-11T20:12:00.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: osdmap e67: 10 total, 10 up, 10 in 2023-12-11T20:12:00.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-11T20:12:00.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:00.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.554 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:00.554 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:00.554 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:12:01.335 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:01 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi012 2023-12-11T20:12:01.336 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:01 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi012 to 4319M 2023-12-11T20:12:01.336 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:01 smithi032 ceph-mon[132488]: osdmap e68: 10 total, 10 up, 10 in 2023-12-11T20:12:01.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:01 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi012 2023-12-11T20:12:01.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:01 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi012 to 4319M 2023-12-11T20:12:01.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:01 smithi039 ceph-mon[102205]: osdmap e68: 10 total, 10 up, 10 in 2023-12-11T20:12:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:01 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi012 2023-12-11T20:12:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:01 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi012 to 4319M 2023-12-11T20:12:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:01 smithi012 ceph-mon[128787]: osdmap e68: 10 total, 10 up, 10 in 2023-12-11T20:12:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.380+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2694863762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14104a30 msgr2=0x7f3f14106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.380+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2694863762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14104a30 0x7f3f14106e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009990 tx=0x7f3f00009ca0 comp rx=0 tx=0).stop 2023-12-11T20:12:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.381+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2694863762 shutdown_connections 2023-12-11T20:12:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.381+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2694863762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f14107360 0x7f3f14109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:02.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.381+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2694863762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f14102100 0x7f3f141044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:02.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.381+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2694863762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14104a30 0x7f3f14106e20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:02.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.381+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2694863762 >> 172.21.15.32:0/2694863762 conn(0x7f3f140fbad0 msgr2=0x7f3f140fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:02.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.381+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2694863762 shutdown_connections 2023-12-11T20:12:02.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.381+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2694863762 wait complete. 2023-12-11T20:12:02.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f1b1e0700 1 Processor -- start 2023-12-11T20:12:02.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f1b1e0700 1 -- start start 2023-12-11T20:12:02.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f1b1e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14102100 0x7f3f141995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:02.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f1b1e0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f14104a30 0x7f3f14199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:02.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f1b1e0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f14107360 0x7f3f141a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:02.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f1b1e0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f141a10f0 con 0x7f3f14107360 2023-12-11T20:12:02.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f1b1e0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f141a1230 con 0x7f3f14102100 2023-12-11T20:12:02.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f1b1e0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f141a13c0 con 0x7f3f14104a30 2023-12-11T20:12:02.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f18f7c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14102100 0x7f3f141995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:02.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f18f7c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14102100 0x7f3f141995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37660/0 (socket says 172.21.15.32:37660) 2023-12-11T20:12:02.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.382+0000 7f3f18f7c700 1 -- 172.21.15.32:0/2628872535 learned_addr learned my addr 172.21.15.32:0/2628872535 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-12-11T20:12:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f13fff700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f14104a30 0x7f3f14199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f1977d700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f14107360 0x7f3f141a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f18f7c700 1 -- 172.21.15.32:0/2628872535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f14104a30 msgr2=0x7f3f14199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f18f7c700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f14104a30 0x7f3f14199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f18f7c700 1 -- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f14107360 msgr2=0x7f3f141a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f18f7c700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f14107360 0x7f3f141a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f18f7c700 1 -- 172.21.15.32:0/2628872535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f000095f0 con 0x7f3f14102100 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f13fff700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f14104a30 0x7f3f14199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f1977d700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f14107360 0x7f3f141a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f18f7c700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14102100 0x7f3f141995b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800c9b0 tx=0x7f3f0800cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f11ffb700 1 -- 172.21.15.32:0/2628872535 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08007b00 con 0x7f3f14102100 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f11ffb700 1 -- 172.21.15.32:0/2628872535 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f08007c60 con 0x7f3f14102100 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f11ffb700 1 -- 172.21.15.32:0/2628872535 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08018660 con 0x7f3f14102100 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.383+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f141a16a0 con 0x7f3f14102100 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.384+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f141a1b50 con 0x7f3f14102100 2023-12-11T20:12:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.385+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f14108f00 con 0x7f3f14102100 2023-12-11T20:12:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.386+0000 7f3f11ffb700 1 -- 172.21.15.32:0/2628872535 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3f0800f450 con 0x7f3f14102100 2023-12-11T20:12:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.388+0000 7f3f11ffb700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f040a1500 0x7f3f040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:02.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.388+0000 7f3f11ffb700 1 -- 172.21.15.32:0/2628872535 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f3f080cc580 con 0x7f3f14102100 2023-12-11T20:12:02.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.388+0000 7f3f13fff700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f040a1500 0x7f3f040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:02.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.389+0000 7f3f13fff700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f040a1500 0x7f3f040a39c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f00003780 tx=0x7f3f00005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:02.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.392+0000 7f3f11ffb700 1 -- 172.21.15.32:0/2628872535 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3f08096340 con 0x7f3f14102100 2023-12-11T20:12:02.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:02 smithi032 ceph-mon[132488]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:02.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:02 smithi039 ceph-mon[102205]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:02.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:02 smithi012 ceph-mon[128787]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:02.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:02.611+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f1402d400 con 0x7f3f040a1500 2023-12-11T20:12:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:12:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:12:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:03.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:12:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:12:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:12:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:12:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:04.315 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:04 smithi032 ceph-mon[132488]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:12:04.315 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:04 smithi032 ceph-mon[132488]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:04.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:04 smithi039 ceph-mon[102205]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:12:04.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:04 smithi039 ceph-mon[102205]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:04 smithi012 ceph-mon[128787]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi032:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:12:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:04 smithi012 ceph-mon[128787]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:06 smithi032 ceph-mon[132488]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:06 smithi032 ceph-mon[132488]: from='client.? 172.21.15.32:0/1272946936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]: dispatch 2023-12-11T20:12:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:06 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]: dispatch 2023-12-11T20:12:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:06 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]': finished 2023-12-11T20:12:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:06 smithi032 ceph-mon[132488]: osdmap e69: 11 total, 10 up, 11 in 2023-12-11T20:12:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:06 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:06 smithi039 ceph-mon[102205]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:06 smithi039 ceph-mon[102205]: from='client.? 172.21.15.32:0/1272946936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]: dispatch 2023-12-11T20:12:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:06 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]: dispatch 2023-12-11T20:12:06.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:06 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]': finished 2023-12-11T20:12:06.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:06 smithi039 ceph-mon[102205]: osdmap e69: 11 total, 10 up, 11 in 2023-12-11T20:12:06.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:06 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:06 smithi012 ceph-mon[128787]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:06 smithi012 ceph-mon[128787]: from='client.? 172.21.15.32:0/1272946936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]: dispatch 2023-12-11T20:12:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:06 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]: dispatch 2023-12-11T20:12:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:06 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23a020ac-a8b6-4da5-91ce-9d9490d4594d"}]': finished 2023-12-11T20:12:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:06 smithi012 ceph-mon[128787]: osdmap e69: 11 total, 10 up, 11 in 2023-12-11T20:12:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:06 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:07 smithi032 ceph-mon[132488]: from='client.? 172.21.15.32:0/1164834808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:12:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:07 smithi039 ceph-mon[102205]: from='client.? 172.21.15.32:0/1164834808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:12:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:07 smithi012 ceph-mon[128787]: from='client.? 172.21.15.32:0/1164834808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:12:08.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:08 smithi032 ceph-mon[132488]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:08.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:08 smithi039 ceph-mon[102205]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:08.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:08 smithi012 ceph-mon[128787]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:09.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:09 smithi039 ceph-mon[102205]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:09 smithi012 ceph-mon[128787]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:09.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:09 smithi032 ceph-mon[132488]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:12.282 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:12 smithi032 ceph-mon[132488]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:12 smithi012 ceph-mon[128787]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:12.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:12 smithi039 ceph-mon[102205]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:14 smithi012 ceph-mon[128787]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-11T20:12:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:14.412 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:14 smithi032 ceph-mon[132488]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:14.412 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-11T20:12:14.412 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:14.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:14 smithi039 ceph-mon[102205]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-11T20:12:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:15 smithi012 ceph-mon[128787]: Deploying daemon osd.10 on smithi032 2023-12-11T20:12:15.432 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:15 smithi032 ceph-mon[132488]: Deploying daemon osd.10 on smithi032 2023-12-11T20:12:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:15 smithi039 ceph-mon[102205]: Deploying daemon osd.10 on smithi032 2023-12-11T20:12:16.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:16 smithi032 ceph-mon[132488]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:16 smithi012 ceph-mon[128787]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:16 smithi039 ceph-mon[102205]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:18.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:18 smithi012 ceph-mon[128787]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:18.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:18 smithi032 ceph-mon[132488]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:18 smithi039 ceph-mon[102205]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:19.529 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:19 smithi032 ceph-mon[132488]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:19 smithi039 ceph-mon[102205]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:19 smithi012 ceph-mon[128787]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:21.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:21.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:21.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:21.078 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:21.078 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:21.078 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:21.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:21 smithi032 ceph-mon[132488]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:22.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:21 smithi039 ceph-mon[102205]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:22.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:21 smithi012 ceph-mon[128787]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:23.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.296+0000 7f3f11ffb700 1 -- 172.21.15.32:0/2628872535 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f3f1402d400 con 0x7f3f040a1500 2023-12-11T20:12:23.295 INFO:teuthology.orchestra.run.smithi032.stdout:Created osd(s) 10 on host 'smithi032' 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.298+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f040a1500 msgr2=0x7f3f040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.298+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f040a1500 0x7f3f040a39c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f00003780 tx=0x7f3f00005fb0 comp rx=0 tx=0).stop 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.298+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14102100 msgr2=0x7f3f141995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.298+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14102100 0x7f3f141995b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800c9b0 tx=0x7f3f0800cd70 comp rx=0 tx=0).stop 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.299+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 shutdown_connections 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.299+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f040a1500 0x7f3f040a39c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.299+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f14102100 0x7f3f141995b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.299+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f14107360 0x7f3f141a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.299+0000 7f3f1b1e0700 1 --2- 172.21.15.32:0/2628872535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f14104a30 0x7f3f14199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:23.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.299+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 >> 172.21.15.32:0/2628872535 conn(0x7f3f140fbad0 msgr2=0x7f3f141017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:23.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.299+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 shutdown_connections 2023-12-11T20:12:23.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-12-11T20:12:23.299+0000 7f3f1b1e0700 1 -- 172.21.15.32:0/2628872535 wait complete. 2023-12-11T20:12:23.799 DEBUG:teuthology.orchestra.run.smithi032:osd.10> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.10.service 2023-12-11T20:12:23.804 INFO:tasks.cephadm:Deploying osd.11 on smithi039 with /dev/vg_nvme/lv_1... 2023-12-11T20:12:23.804 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-11T20:12:23.886 INFO:journalctl@ceph.osd.10.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-11T20:12:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:24 smithi032 ceph-mon[132488]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-11T20:12:24.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-11T20:12:24.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:24 smithi039 ceph-mon[102205]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-11T20:12:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-11T20:12:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:24 smithi012 ceph-mon[128787]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-11T20:12:24.604 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:12:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:25 smithi039 ceph-mon[102205]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-11T20:12:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:25 smithi039 ceph-mon[102205]: osdmap e70: 11 total, 10 up, 11 in 2023-12-11T20:12:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:25 smithi039 ceph-mon[102205]: from='osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:12:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:25 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:25.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:25 smithi039 ceph-mon[102205]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:12:25.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:25 smithi039 ceph-mon[102205]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:25 smithi012 ceph-mon[128787]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-11T20:12:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:25 smithi012 ceph-mon[128787]: osdmap e70: 11 total, 10 up, 11 in 2023-12-11T20:12:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:25 smithi012 ceph-mon[128787]: from='osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:12:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:25 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:25 smithi012 ceph-mon[128787]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:12:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:25 smithi012 ceph-mon[128787]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:25 smithi032 ceph-mon[132488]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-11T20:12:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:25 smithi032 ceph-mon[132488]: osdmap e70: 11 total, 10 up, 11 in 2023-12-11T20:12:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:25 smithi032 ceph-mon[132488]: from='osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:12:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:25 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:25.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:25 smithi032 ceph-mon[132488]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]: dispatch 2023-12-11T20:12:25.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:25 smithi032 ceph-mon[132488]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-11T20:12:25.714 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:12:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:12:25.304+0000 7f615a69e700 -1 osd.10 0 waiting for initial osdmap 2023-12-11T20:12:25.714 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:12:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:12:25.322+0000 7f6154494700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:12:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:26 smithi039 ceph-mon[102205]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:12:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:26 smithi039 ceph-mon[102205]: osdmap e71: 11 total, 10 up, 11 in 2023-12-11T20:12:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:26 smithi012 ceph-mon[128787]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:12:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:26 smithi012 ceph-mon[128787]: osdmap e71: 11 total, 10 up, 11 in 2023-12-11T20:12:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:26.620 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-11T20:12:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-11T20:12:26.621 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10+0 records in 2023-12-11T20:12:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:10+0 records out 2023-12-11T20:12:26.621 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0465268 s, 225 MB/s 2023-12-11T20:12:26.621 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping successful for: 2023-12-11T20:12:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:26 smithi032 ceph-mon[132488]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi032", "root=default"]}]': finished 2023-12-11T20:12:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:26 smithi032 ceph-mon[132488]: osdmap e71: 11 total, 10 up, 11 in 2023-12-11T20:12:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:27.095 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi039:vg_nvme/lv_1 2023-12-11T20:12:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:27 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:12:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:27 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:12:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:27 smithi012 ceph-mon[128787]: osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] boot 2023-12-11T20:12:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:27 smithi012 ceph-mon[128787]: osdmap e72: 11 total, 11 up, 11 in 2023-12-11T20:12:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:27 smithi012 ceph-mon[128787]: pgmap v254: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:27 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:12:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:27 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:12:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:27 smithi032 ceph-mon[132488]: osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] boot 2023-12-11T20:12:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:27 smithi032 ceph-mon[132488]: osdmap e72: 11 total, 11 up, 11 in 2023-12-11T20:12:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:27 smithi032 ceph-mon[132488]: pgmap v254: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:27 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:12:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:27 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:12:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:27 smithi039 ceph-mon[102205]: osd.10 [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] boot 2023-12-11T20:12:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:27 smithi039 ceph-mon[102205]: osdmap e72: 11 total, 11 up, 11 in 2023-12-11T20:12:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-11T20:12:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:27 smithi039 ceph-mon[102205]: pgmap v254: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:27.889 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:12:28.403 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: osdmap e73: 11 total, 11 up, 11 in 2023-12-11T20:12:28.403 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi032 2023-12-11T20:12:28.403 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.403 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi032 to 4319M 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:28.404 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: osdmap e73: 11 total, 11 up, 11 in 2023-12-11T20:12:28.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi032 2023-12-11T20:12:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi032 to 4319M 2023-12-11T20:12:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:28.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:28.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: osdmap e73: 11 total, 11 up, 11 in 2023-12-11T20:12:28.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi032 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi032 to 4319M 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:28.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:29.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.283+0000 7f00dafbf700 1 -- 172.21.15.39:0/2926143505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4102820 msgr2=0x7f00d4102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:29.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.283+0000 7f00dafbf700 1 --2- 172.21.15.39:0/2926143505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4102820 0x7f00d4102c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009990 tx=0x7f00c0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:12:29.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.283+0000 7f00dafbf700 1 -- 172.21.15.39:0/2926143505 shutdown_connections 2023-12-11T20:12:29.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.283+0000 7f00dafbf700 1 --2- 172.21.15.39:0/2926143505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00d4101620 0x7f00d4101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:29.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.283+0000 7f00dafbf700 1 --2- 172.21.15.39:0/2926143505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00d41031c0 0x7f00d4109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:29.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.283+0000 7f00dafbf700 1 --2- 172.21.15.39:0/2926143505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4102820 0x7f00d4102c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:29.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.283+0000 7f00dafbf700 1 -- 172.21.15.39:0/2926143505 >> 172.21.15.39:0/2926143505 conn(0x7f00d40fcbe0 msgr2=0x7f00d40ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:29.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.283+0000 7f00dafbf700 1 -- 172.21.15.39:0/2926143505 shutdown_connections 2023-12-11T20:12:29.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.284+0000 7f00dafbf700 1 -- 172.21.15.39:0/2926143505 wait complete. 2023-12-11T20:12:29.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.284+0000 7f00dafbf700 1 Processor -- start 2023-12-11T20:12:29.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00dafbf700 1 -- start start 2023-12-11T20:12:29.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00dafbf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4101620 0x7f00d4197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:29.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00dafbf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00d4102820 0x7f00d4197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:29.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00dafbf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00d41031c0 0x7f00d419ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:29.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00dafbf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d419eff0 con 0x7f00d41031c0 2023-12-11T20:12:29.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00dafbf700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d419f130 con 0x7f00d4102820 2023-12-11T20:12:29.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00dafbf700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d419f2c0 con 0x7f00d4101620 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00d8d5b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4101620 0x7f00d4197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00d8d5b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4101620 0x7f00d4197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40412/0 (socket says 172.21.15.39:40412) 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00d8d5b700 1 -- 172.21.15.39:0/3425647817 learned_addr learned my addr 172.21.15.39:0/3425647817 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.285+0000 7f00d3fff700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00d4102820 0x7f00d4197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d955c700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00d41031c0 0x7f00d419ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d8d5b700 1 -- 172.21.15.39:0/3425647817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00d4102820 msgr2=0x7f00d4197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d8d5b700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00d4102820 0x7f00d4197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d8d5b700 1 -- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00d41031c0 msgr2=0x7f00d419ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:29.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d8d5b700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00d41031c0 0x7f00d419ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:29.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d8d5b700 1 -- 172.21.15.39:0/3425647817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c00095f0 con 0x7f00d4101620 2023-12-11T20:12:29.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d8d5b700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4101620 0x7f00d4197500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00c800d9b0 tx=0x7f00c800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:29.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d1ffb700 1 -- 172.21.15.39:0/3425647817 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8004020 con 0x7f00d4101620 2023-12-11T20:12:29.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d419f5a0 con 0x7f00d4101620 2023-12-11T20:12:29.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d1ffb700 1 -- 172.21.15.39:0/3425647817 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00c8009730 con 0x7f00d4101620 2023-12-11T20:12:29.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00d1ffb700 1 -- 172.21.15.39:0/3425647817 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80039c0 con 0x7f00d4101620 2023-12-11T20:12:29.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.286+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d419faa0 con 0x7f00d4101620 2023-12-11T20:12:29.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.287+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d4108b50 con 0x7f00d4101620 2023-12-11T20:12:29.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.289+0000 7f00d1ffb700 1 -- 172.21.15.39:0/3425647817 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f00c80098a0 con 0x7f00d4101620 2023-12-11T20:12:29.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.291+0000 7f00d1ffb700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00c40a1480 0x7f00c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:29.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.291+0000 7f00d1ffb700 1 -- 172.21.15.39:0/3425647817 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f00c80cc460 con 0x7f00d4101620 2023-12-11T20:12:29.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.291+0000 7f00d3fff700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00c40a1480 0x7f00c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:29.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.292+0000 7f00d3fff700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00c40a1480 0x7f00c40a3940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b2e0 tx=0x7f00c000b6b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:29.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.296+0000 7f00d1ffb700 1 -- 172.21.15.39:0/3425647817 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f00c8096050 con 0x7f00d4101620 2023-12-11T20:12:29.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:29.522+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f00d4061a10 con 0x7f00c40a1480 2023-12-11T20:12:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:29 smithi012 ceph-mon[128787]: osdmap e74: 11 total, 11 up, 11 in 2023-12-11T20:12:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:29 smithi012 ceph-mon[128787]: pgmap v257: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:29 smithi032 ceph-mon[132488]: osdmap e74: 11 total, 11 up, 11 in 2023-12-11T20:12:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:29 smithi032 ceph-mon[132488]: pgmap v257: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:29.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:29 smithi039 ceph-mon[102205]: osdmap e74: 11 total, 11 up, 11 in 2023-12-11T20:12:29.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:29 smithi039 ceph-mon[102205]: pgmap v257: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:30 smithi012 ceph-mon[128787]: osdmap e75: 11 total, 11 up, 11 in 2023-12-11T20:12:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:30 smithi012 ceph-mon[128787]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:12:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:12:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:12:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:30.670 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:30 smithi039 ceph-mon[102205]: osdmap e75: 11 total, 11 up, 11 in 2023-12-11T20:12:30.671 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:30 smithi039 ceph-mon[102205]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:12:30.671 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:12:30.671 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:12:30.671 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:30.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:30 smithi032 ceph-mon[132488]: osdmap e75: 11 total, 11 up, 11 in 2023-12-11T20:12:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:30 smithi032 ceph-mon[132488]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:12:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-11T20:12:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-11T20:12:30.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:31.661 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:31 smithi039 ceph-mon[102205]: osdmap e76: 11 total, 11 up, 11 in 2023-12-11T20:12:31.661 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:31 smithi039 ceph-mon[102205]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-11T20:12:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:31 smithi032 ceph-mon[132488]: osdmap e76: 11 total, 11 up, 11 in 2023-12-11T20:12:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:31 smithi032 ceph-mon[132488]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-11T20:12:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:31 smithi012 ceph-mon[128787]: osdmap e76: 11 total, 11 up, 11 in 2023-12-11T20:12:31.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:31 smithi012 ceph-mon[128787]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-11T20:12:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:32 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/2400737164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]: dispatch 2023-12-11T20:12:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:32 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]: dispatch 2023-12-11T20:12:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:32 smithi012 ceph-mon[128787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]': finished 2023-12-11T20:12:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:32 smithi012 ceph-mon[128787]: osdmap e77: 12 total, 11 up, 12 in 2023-12-11T20:12:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:32 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:32 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/2400737164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]: dispatch 2023-12-11T20:12:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:32 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]: dispatch 2023-12-11T20:12:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:32 smithi032 ceph-mon[132488]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]': finished 2023-12-11T20:12:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:32 smithi032 ceph-mon[132488]: osdmap e77: 12 total, 11 up, 12 in 2023-12-11T20:12:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:32 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:33.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:32 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/2400737164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]: dispatch 2023-12-11T20:12:33.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:32 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]: dispatch 2023-12-11T20:12:33.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:32 smithi039 ceph-mon[102205]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f0f6457-4ef9-495a-b399-8fdaf347f3c2"}]': finished 2023-12-11T20:12:33.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:32 smithi039 ceph-mon[102205]: osdmap e77: 12 total, 11 up, 12 in 2023-12-11T20:12:33.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:32 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:34.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:33 smithi032 ceph-mon[132488]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2023-12-11T20:12:34.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:33 smithi032 ceph-mon[132488]: from='client.? 172.21.15.39:0/2305871030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:12:34.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:33 smithi039 ceph-mon[102205]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2023-12-11T20:12:34.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:33 smithi039 ceph-mon[102205]: from='client.? 172.21.15.39:0/2305871030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:12:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:33 smithi012 ceph-mon[128787]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 123 KiB/s, 0 objects/s recovering 2023-12-11T20:12:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:33 smithi012 ceph-mon[128787]: from='client.? 172.21.15.39:0/2305871030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-11T20:12:36.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:36 smithi012 ceph-mon[128787]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-11T20:12:36.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:36 smithi032 ceph-mon[132488]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-11T20:12:36.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:36 smithi039 ceph-mon[102205]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-11T20:12:38.327 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:38 smithi039 ceph-mon[102205]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-11T20:12:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:38 smithi012 ceph-mon[128787]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-11T20:12:38.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:38 smithi032 ceph-mon[132488]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-11T20:12:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:39 smithi039 ceph-mon[102205]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-12-11T20:12:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:39 smithi012 ceph-mon[128787]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-12-11T20:12:39.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:39 smithi032 ceph-mon[132488]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-12-11T20:12:40.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-11T20:12:40.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-11T20:12:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-11T20:12:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:41.389 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:41 smithi039 ceph-mon[102205]: Deploying daemon osd.11 on smithi039 2023-12-11T20:12:41.389 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:41 smithi039 ceph-mon[102205]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:41 smithi012 ceph-mon[128787]: Deploying daemon osd.11 on smithi039 2023-12-11T20:12:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:41 smithi012 ceph-mon[128787]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:41 smithi032 ceph-mon[132488]: Deploying daemon osd.11 on smithi039 2023-12-11T20:12:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:41 smithi032 ceph-mon[132488]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:44 smithi039 ceph-mon[102205]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:44.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:44 smithi012 ceph-mon[128787]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:44.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:44 smithi032 ceph-mon[132488]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:46 smithi012 ceph-mon[128787]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:46.360 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:46 smithi039 ceph-mon[102205]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:46.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:46 smithi032 ceph-mon[132488]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:47.781 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:47.781 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:47.781 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:47.781 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:47 smithi039 ceph-mon[102205]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:47 smithi012 ceph-mon[128787]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:47.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:47 smithi032 ceph-mon[132488]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:49.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:49 smithi039 ceph-mon[102205]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:49 smithi012 ceph-mon[128787]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:49.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:49 smithi032 ceph-mon[132488]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:50.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.300+0000 7f00d1ffb700 1 -- 172.21.15.39:0/3425647817 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f00d4061a10 con 0x7f00c40a1480 2023-12-11T20:12:50.300 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 11 on host 'smithi039' 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00c40a1480 msgr2=0x7f00c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00c40a1480 0x7f00c40a3940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b2e0 tx=0x7f00c000b6b0 comp rx=0 tx=0).stop 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4101620 msgr2=0x7f00d4197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4101620 0x7f00d4197500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00c800d9b0 tx=0x7f00c800dcc0 comp rx=0 tx=0).stop 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 shutdown_connections 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00c40a1480 0x7f00c40a3940 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00d41031c0 0x7f00d419ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00d4101620 0x7f00d4197500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 --2- 172.21.15.39:0/3425647817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00d4102820 0x7f00d4197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:50.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.303+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 >> 172.21.15.39:0/3425647817 conn(0x7f00d40fcbe0 msgr2=0x7f00d4105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:50.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.304+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 shutdown_connections 2023-12-11T20:12:50.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:12:50.304+0000 7f00dafbf700 1 -- 172.21.15.39:0/3425647817 wait complete. 2023-12-11T20:12:50.825 DEBUG:teuthology.orchestra.run.smithi039:osd.11> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.11.service 2023-12-11T20:12:50.830 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-12-11T20:12:50.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-11T20:12:50.906 INFO:journalctl@ceph.osd.11.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:12:51.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:51.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:51.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:51.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-11T20:12:51.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:50 smithi039 ceph-mon[102205]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-11T20:12:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:50 smithi032 ceph-mon[132488]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-11T20:12:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:50 smithi012 ceph-mon[128787]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-11T20:12:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:12:52.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:51 smithi039 ceph-mon[102205]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:52.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:51 smithi039 ceph-mon[102205]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-11T20:12:52.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:51 smithi039 ceph-mon[102205]: osdmap e78: 12 total, 11 up, 12 in 2023-12-11T20:12:52.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:52.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:51 smithi039 ceph-mon[102205]: from='osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:12:52.040 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:51 smithi039 ceph-mon[102205]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:12:52.150 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:51 smithi012 ceph-mon[128787]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:52.150 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:51 smithi012 ceph-mon[128787]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-11T20:12:52.150 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:51 smithi012 ceph-mon[128787]: osdmap e78: 12 total, 11 up, 12 in 2023-12-11T20:12:52.151 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:52.151 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:51 smithi012 ceph-mon[128787]: from='osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:12:52.151 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:51 smithi012 ceph-mon[128787]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:12:52.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:51 smithi032 ceph-mon[132488]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:52.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:51 smithi032 ceph-mon[132488]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-11T20:12:52.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:51 smithi032 ceph-mon[132488]: osdmap e78: 12 total, 11 up, 12 in 2023-12-11T20:12:52.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:52.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:51 smithi032 ceph-mon[132488]: from='osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:12:52.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:51 smithi032 ceph-mon[132488]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2023-12-11T20:12:52.299 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:12:52 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:12:52.281+0000 7f1331cd1700 -1 osd.11 0 waiting for initial osdmap 2023-12-11T20:12:52.299 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:12:52 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:12:52.299+0000 7f132bac7700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/515423740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e941031c0 msgr2=0x7f4e94109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/515423740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e941031c0 0x7f4e94109a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b0d0 tx=0x7f4e8c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/515423740 shutdown_connections 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/515423740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e94101620 0x7f4e94101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/515423740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e941031c0 0x7f4e94109a70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/515423740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e94102820 0x7f4e94102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/515423740 >> 172.21.15.12:0/515423740 conn(0x7f4e940fcbe0 msgr2=0x7f4e940ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/515423740 shutdown_connections 2023-12-11T20:12:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.041+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/515423740 wait complete. 2023-12-11T20:12:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.042+0000 7f4e9bbfa700 1 Processor -- start 2023-12-11T20:12:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e9bbfa700 1 -- start start 2023-12-11T20:12:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e9bbfa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e94101620 0x7f4e94199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e9bbfa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e94102820 0x7f4e94199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e9bbfa700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e941031c0 0x7f4e941a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e9bbfa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e941a1280 con 0x7f4e94102820 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e9bbfa700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e941a13c0 con 0x7f4e941031c0 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e9bbfa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e941a1550 con 0x7f4e94101620 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e99195700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e94102820 0x7f4e94199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e99996700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e94101620 0x7f4e94199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e99195700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e94102820 0x7f4e94199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53186/0 (socket says 172.21.15.12:53186) 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.043+0000 7f4e99195700 1 -- 172.21.15.12:0/706997010 learned_addr learned my addr 172.21.15.12:0/706997010 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e9a197700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e941031c0 0x7f4e941a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e99195700 1 -- 172.21.15.12:0/706997010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e94101620 msgr2=0x7f4e94199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e99195700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e94101620 0x7f4e94199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e99195700 1 -- 172.21.15.12:0/706997010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e941031c0 msgr2=0x7f4e941a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e99195700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e941031c0 0x7f4e941a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e99195700 1 -- 172.21.15.12:0/706997010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c009d00 con 0x7f4e94102820 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e99195700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e94102820 0x7f4e94199c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400e9d0 tx=0x7f4e8400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e8affd700 1 -- 172.21.15.12:0/706997010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84009790 con 0x7f4e94102820 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e8affd700 1 -- 172.21.15.12:0/706997010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e8400cbd0 con 0x7f4e94102820 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e8affd700 1 -- 172.21.15.12:0/706997010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84018680 con 0x7f4e94102820 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e941a1830 con 0x7f4e94102820 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.044+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e941a1ce0 con 0x7f4e94102820 2023-12-11T20:12:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.045+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9404f290 con 0x7f4e94102820 2023-12-11T20:12:53.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.048+0000 7f4e8affd700 1 -- 172.21.15.12:0/706997010 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4e8400cd40 con 0x7f4e94102820 2023-12-11T20:12:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.049+0000 7f4e8affd700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e800a1500 0x7f4e800a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.049+0000 7f4e8affd700 1 -- 172.21.15.12:0/706997010 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f4e84014070 con 0x7f4e94102820 2023-12-11T20:12:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.049+0000 7f4e99996700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e800a1500 0x7f4e800a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:53.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.050+0000 7f4e99996700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e800a1500 0x7f4e800a39c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e94102680 tx=0x7f4e9000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:53.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.051+0000 7f4e8affd700 1 -- 172.21.15.12:0/706997010 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4e84096910 con 0x7f4e94102820 2023-12-11T20:12:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.260+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4e9410ceb0 con 0x7f4e94102820 2023-12-11T20:12:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.260+0000 7f4e8affd700 1 -- 172.21.15.12:0/706997010 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f4e84099f30 con 0x7f4e94102820 2023-12-11T20:12:53.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.262+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e800a1500 msgr2=0x7f4e800a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.262+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e800a1500 0x7f4e800a39c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e94102680 tx=0x7f4e9000b410 comp rx=0 tx=0).stop 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.262+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e94102820 msgr2=0x7f4e94199c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.262+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e94102820 0x7f4e94199c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400e9d0 tx=0x7f4e8400ece0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.262+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 shutdown_connections 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.262+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e800a1500 0x7f4e800a39c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.262+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e941031c0 0x7f4e941a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.262+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e94101620 0x7f4e94199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.263+0000 7f4e9bbfa700 1 --2- 172.21.15.12:0/706997010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e94102820 0x7f4e94199c80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.263+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 >> 172.21.15.12:0/706997010 conn(0x7f4e940fcbe0 msgr2=0x7f4e94073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.263+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 shutdown_connections 2023-12-11T20:12:53.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:53.263+0000 7f4e9bbfa700 1 -- 172.21.15.12:0/706997010 wait complete. 2023-12-11T20:12:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:53 smithi039 ceph-mon[102205]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:12:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:53 smithi039 ceph-mon[102205]: osdmap e79: 12 total, 11 up, 12 in 2023-12-11T20:12:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:53 smithi039 ceph-mon[102205]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:53 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/706997010' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-11T20:12:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:53 smithi012 ceph-mon[128787]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:12:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:53 smithi012 ceph-mon[128787]: osdmap e79: 12 total, 11 up, 12 in 2023-12-11T20:12:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:53.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:53.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:53 smithi012 ceph-mon[128787]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:53.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:53 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/706997010' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-11T20:12:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:53 smithi032 ceph-mon[132488]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2023-12-11T20:12:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:53 smithi032 ceph-mon[132488]: osdmap e79: 12 total, 11 up, 12 in 2023-12-11T20:12:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:53 smithi032 ceph-mon[132488]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-11T20:12:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:53 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/706997010' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-11T20:12:53.726 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1702325546,"num_in_osds":12,"osd_in_since":1702325552,"num_remapped_pgs":0} 2023-12-11T20:12:54.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:54 smithi039 ceph-mon[102205]: purged_snaps scrub starts 2023-12-11T20:12:54.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:54 smithi039 ceph-mon[102205]: purged_snaps scrub ok 2023-12-11T20:12:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:54 smithi039 ceph-mon[102205]: osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] boot 2023-12-11T20:12:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:54 smithi039 ceph-mon[102205]: osdmap e80: 12 total, 12 up, 12 in 2023-12-11T20:12:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:54 smithi012 ceph-mon[128787]: purged_snaps scrub starts 2023-12-11T20:12:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:54 smithi012 ceph-mon[128787]: purged_snaps scrub ok 2023-12-11T20:12:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:54 smithi012 ceph-mon[128787]: osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] boot 2023-12-11T20:12:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:54 smithi012 ceph-mon[128787]: osdmap e80: 12 total, 12 up, 12 in 2023-12-11T20:12:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:54 smithi032 ceph-mon[132488]: purged_snaps scrub starts 2023-12-11T20:12:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:54 smithi032 ceph-mon[132488]: purged_snaps scrub ok 2023-12-11T20:12:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:54 smithi032 ceph-mon[132488]: osd.11 [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] boot 2023-12-11T20:12:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:54 smithi032 ceph-mon[132488]: osdmap e80: 12 total, 12 up, 12 in 2023-12-11T20:12:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:54 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-11T20:12:54.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-11T20:12:55.519 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:12:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: Detected new or changed devices on smithi039 2023-12-11T20:12:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: osdmap e81: 12 total, 12 up, 12 in 2023-12-11T20:12:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi039 to 4317M 2023-12-11T20:12:55.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:55.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:55.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:55 smithi039 ceph-mon[102205]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: Detected new or changed devices on smithi039 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: osdmap e81: 12 total, 12 up, 12 in 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi039 to 4317M 2023-12-11T20:12:55.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:55.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:55.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:55 smithi012 ceph-mon[128787]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: Detected new or changed devices on smithi039 2023-12-11T20:12:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: osdmap e81: 12 total, 12 up, 12 in 2023-12-11T20:12:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:12:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi039 to 4317M 2023-12-11T20:12:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:12:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:12:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:12:55.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:55 smithi032 ceph-mon[132488]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/3131188456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a481031c0 msgr2=0x7f1a48109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/3131188456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a481031c0 0x7f1a48109a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000b0d0 tx=0x7f1a4000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/3131188456 shutdown_connections 2023-12-11T20:12:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/3131188456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a48101620 0x7f1a48101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/3131188456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a481031c0 0x7f1a48109a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/3131188456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a48102820 0x7f1a48102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/3131188456 >> 172.21.15.12:0/3131188456 conn(0x7f1a480fcbe0 msgr2=0x7f1a480ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/3131188456 shutdown_connections 2023-12-11T20:12:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.033+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/3131188456 wait complete. 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.034+0000 7f1a4cdfb700 1 Processor -- start 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.034+0000 7f1a4cdfb700 1 -- start start 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a4cdfb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a48101620 0x7f1a48075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a4cdfb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a48102820 0x7f1a480739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a4cdfb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a481031c0 0x7f1a48073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a4cdfb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480746a0 con 0x7f1a48102820 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a4cdfb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a48074810 con 0x7f1a48101620 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a4cdfb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a481a1570 con 0x7f1a481031c0 2023-12-11T20:12:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a45d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a48102820 0x7f1a480739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a45d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a48102820 0x7f1a480739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53218/0 (socket says 172.21.15.12:53218) 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a45d9b700 1 -- 172.21.15.12:0/224210274 learned_addr learned my addr 172.21.15.12:0/224210274 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a46d9d700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a481031c0 0x7f1a48073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a4659c700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a48101620 0x7f1a48075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a45d9b700 1 -- 172.21.15.12:0/224210274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a481031c0 msgr2=0x7f1a48073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a45d9b700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a481031c0 0x7f1a48073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a45d9b700 1 -- 172.21.15.12:0/224210274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a48101620 msgr2=0x7f1a48075320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a45d9b700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a48101620 0x7f1a48075320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.035+0000 7f1a45d9b700 1 -- 172.21.15.12:0/224210274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a40009d00 con 0x7f1a48102820 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.036+0000 7f1a45d9b700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a48102820 0x7f1a480739c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00e9a0 tx=0x7f1a3c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.036+0000 7f1a377fe700 1 -- 172.21.15.12:0/224210274 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c009790 con 0x7f1a48102820 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.036+0000 7f1a377fe700 1 -- 172.21.15.12:0/224210274 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a3c00cbd0 con 0x7f1a48102820 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.036+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a481a1800 con 0x7f1a48102820 2023-12-11T20:12:57.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.036+0000 7f1a377fe700 1 -- 172.21.15.12:0/224210274 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c018680 con 0x7f1a48102820 2023-12-11T20:12:57.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.036+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a481a1d00 con 0x7f1a48102820 2023-12-11T20:12:57.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.037+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a48108a80 con 0x7f1a48102820 2023-12-11T20:12:57.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.039+0000 7f1a377fe700 1 -- 172.21.15.12:0/224210274 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1a3c00cd40 con 0x7f1a48102820 2023-12-11T20:12:57.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.040+0000 7f1a377fe700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a300a1480 0x7f1a300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:57.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.041+0000 7f1a377fe700 1 -- 172.21.15.12:0/224210274 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1a3c014070 con 0x7f1a48102820 2023-12-11T20:12:57.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.041+0000 7f1a4659c700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a300a1480 0x7f1a300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:57.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.041+0000 7f1a4659c700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a300a1480 0x7f1a300a3940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005950 tx=0x7f1a380058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:57.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.043+0000 7f1a377fe700 1 -- 172.21.15.12:0/224210274 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1a3c0969c0 con 0x7f1a48102820 2023-12-11T20:12:57.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.255+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f1a4804f290 con 0x7f1a48102820 2023-12-11T20:12:57.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.255+0000 7f1a377fe700 1 -- 172.21.15.12:0/224210274 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7f1a3c099fe0 con 0x7f1a48102820 2023-12-11T20:12:57.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:12:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a300a1480 msgr2=0x7f1a300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a300a1480 0x7f1a300a3940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005950 tx=0x7f1a380058e0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a48102820 msgr2=0x7f1a480739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a48102820 0x7f1a480739c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00e9a0 tx=0x7f1a3c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 shutdown_connections 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a300a1480 0x7f1a300a3940 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a48101620 0x7f1a48075320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a481031c0 0x7f1a48073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 --2- 172.21.15.12:0/224210274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a48102820 0x7f1a480739c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.257+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 >> 172.21.15.12:0/224210274 conn(0x7f1a480fcbe0 msgr2=0x7f1a48105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.258+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 shutdown_connections 2023-12-11T20:12:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:57.258+0000 7f1a4cdfb700 1 -- 172.21.15.12:0/224210274 wait complete. 2023-12-11T20:12:57.708 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1702325573,"num_in_osds":12,"osd_in_since":1702325552,"num_remapped_pgs":0} 2023-12-11T20:12:57.709 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-11T20:12:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:58 smithi012 ceph-mon[128787]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:58 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/224210274' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-11T20:12:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:58 smithi032 ceph-mon[132488]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:58 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/224210274' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-11T20:12:58.498 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:12:58.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:58 smithi039 ceph-mon[102205]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:58 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/224210274' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-11T20:12:59.277 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:12:59 smithi012 ceph-mon[128787]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:12:59 smithi039 ceph-mon[102205]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:12:59 smithi032 ceph-mon[132488]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:12:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.916+0000 7f12e29bb700 1 -- 172.21.15.12:0/1269949875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 msgr2=0x7f12dc101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.916+0000 7f12e29bb700 1 --2- 172.21.15.12:0/1269949875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 0x7f12dc101b00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009990 tx=0x7f12d0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:12:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.916+0000 7f12e29bb700 1 -- 172.21.15.12:0/1269949875 shutdown_connections 2023-12-11T20:12:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.916+0000 7f12e29bb700 1 --2- 172.21.15.12:0/1269949875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12dc1076f0 0x7f12dc107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.916+0000 7f12e29bb700 1 --2- 172.21.15.12:0/1269949875 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12dc102040 0x7f12dc10e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.916+0000 7f12e29bb700 1 --2- 172.21.15.12:0/1269949875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 0x7f12dc101b00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.916+0000 7f12e29bb700 1 -- 172.21.15.12:0/1269949875 >> 172.21.15.12:0/1269949875 conn(0x7f12dc0787c0 msgr2=0x7f12dc078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:12:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.917+0000 7f12e29bb700 1 -- 172.21.15.12:0/1269949875 shutdown_connections 2023-12-11T20:12:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.917+0000 7f12e29bb700 1 -- 172.21.15.12:0/1269949875 wait complete. 2023-12-11T20:12:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12e29bb700 1 Processor -- start 2023-12-11T20:12:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12e29bb700 1 -- start start 2023-12-11T20:12:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12e29bb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 0x7f12dc19d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12e29bb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12dc102040 0x7f12dc19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12e29bb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12dc1076f0 0x7f12dc1976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:59.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12e29bb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc197d00 con 0x7f12dc101680 2023-12-11T20:12:59.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12e29bb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc197e70 con 0x7f12dc102040 2023-12-11T20:12:59.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12e29bb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc198030 con 0x7f12dc1076f0 2023-12-11T20:12:59.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.918+0000 7f12dbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 0x7f12dc19d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12dbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 0x7f12dc19d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42932/0 (socket says 172.21.15.12:42932) 2023-12-11T20:12:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12dbfff700 1 -- 172.21.15.12:0/2441339602 learned_addr learned my addr 172.21.15.12:0/2441339602 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:12:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12db7fe700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12dc102040 0x7f12dc19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12dbfff700 1 -- 172.21.15.12:0/2441339602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12dc1076f0 msgr2=0x7f12dc1976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12dbfff700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12dc1076f0 0x7f12dc1976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12dbfff700 1 -- 172.21.15.12:0/2441339602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12dc102040 msgr2=0x7f12dc19da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:12:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12dbfff700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12dc102040 0x7f12dc19da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:12:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12dbfff700 1 -- 172.21.15.12:0/2441339602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00095f0 con 0x7f12dc101680 2023-12-11T20:12:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12dbfff700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 0x7f12dc19d510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00d950 tx=0x7f12cc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.919+0000 7f12d97fa700 1 -- 172.21.15.12:0/2441339602 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc009940 con 0x7f12dc101680 2023-12-11T20:12:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.920+0000 7f12d97fa700 1 -- 172.21.15.12:0/2441339602 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12cc010460 con 0x7f12dc101680 2023-12-11T20:12:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.920+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc198310 con 0x7f12dc101680 2023-12-11T20:12:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.920+0000 7f12d97fa700 1 -- 172.21.15.12:0/2441339602 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00f620 con 0x7f12dc101680 2023-12-11T20:12:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.920+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc1a4500 con 0x7f12dc101680 2023-12-11T20:12:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.921+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc109b80 con 0x7f12dc101680 2023-12-11T20:12:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.923+0000 7f12d97fa700 1 -- 172.21.15.12:0/2441339602 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f12cc0105d0 con 0x7f12dc101680 2023-12-11T20:12:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.924+0000 7f12d97fa700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c40a1480 0x7f12c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:12:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.924+0000 7f12d97fa700 1 -- 172.21.15.12:0/2441339602 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f12cc0cc700 con 0x7f12dc101680 2023-12-11T20:12:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.924+0000 7f12db7fe700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c40a1480 0x7f12c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:12:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.925+0000 7f12db7fe700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c40a1480 0x7f12c40a3940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f12dc198d60 tx=0x7f12d0005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:12:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:12:59.928+0000 7f12d97fa700 1 -- 172.21.15.12:0/2441339602 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f12cc096160 con 0x7f12dc101680 2023-12-11T20:13:00.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.138+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12dc102d10 con 0x7f12dc101680 2023-12-11T20:13:00.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.139+0000 7f12d97fa700 1 -- 172.21.15.12:0/2441339602 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f12cc099780 con 0x7f12dc101680 2023-12-11T20:13:00.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:00.138 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:12:54.270944+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:13:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c40a1480 msgr2=0x7f12c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c40a1480 0x7f12c40a3940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f12dc198d60 tx=0x7f12d0005fb0 comp rx=0 tx=0).stop 2023-12-11T20:13:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 msgr2=0x7f12dc19d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 0x7f12dc19d510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00d950 tx=0x7f12cc00dc60 comp rx=0 tx=0).stop 2023-12-11T20:13:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 shutdown_connections 2023-12-11T20:13:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c40a1480 0x7f12c40a3940 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12dc1076f0 0x7f12dc1976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12dc101680 0x7f12dc19d510 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 --2- 172.21.15.12:0/2441339602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12dc102040 0x7f12dc19da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 >> 172.21.15.12:0/2441339602 conn(0x7f12dc0787c0 msgr2=0x7f12dc100400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 shutdown_connections 2023-12-11T20:13:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:00.141+0000 7f12e29bb700 1 -- 172.21.15.12:0/2441339602 wait complete. 2023-12-11T20:13:00.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:00 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2441339602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:00.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:00 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2441339602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:00.593 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:13:00.594 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-11T20:13:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:00 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2441339602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:01.384 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:13:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:01 smithi039 ceph-mon[102205]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:01 smithi012 ceph-mon[128787]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:01.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:01 smithi032 ceph-mon[132488]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:02.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.783+0000 7ff7d3588700 1 -- 172.21.15.12:0/4131880681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc073800 msgr2=0x7ff7cc073be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:02.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.783+0000 7ff7d3588700 1 --2- 172.21.15.12:0/4131880681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc073800 0x7ff7cc073be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009990 tx=0x7ff7c8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.784+0000 7ff7d3588700 1 -- 172.21.15.12:0/4131880681 shutdown_connections 2023-12-11T20:13:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.784+0000 7ff7d3588700 1 --2- 172.21.15.12:0/4131880681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7cc10e030 0x7ff7cc110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.784+0000 7ff7d3588700 1 --2- 172.21.15.12:0/4131880681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc073800 0x7ff7cc073be0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.784+0000 7ff7d3588700 1 --2- 172.21.15.12:0/4131880681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7cc074120 0x7ff7cc10daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.784+0000 7ff7d3588700 1 -- 172.21.15.12:0/4131880681 >> 172.21.15.12:0/4131880681 conn(0x7ff7cc0787c0 msgr2=0x7ff7cc078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.784+0000 7ff7d3588700 1 -- 172.21.15.12:0/4131880681 shutdown_connections 2023-12-11T20:13:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.784+0000 7ff7d3588700 1 -- 172.21.15.12:0/4131880681 wait complete. 2023-12-11T20:13:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.785+0000 7ff7d3588700 1 Processor -- start 2023-12-11T20:13:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.785+0000 7ff7d3588700 1 -- start start 2023-12-11T20:13:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.785+0000 7ff7d3588700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7cc073800 0x7ff7cc19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.785+0000 7ff7d3588700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc074120 0x7ff7cc19fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.785+0000 7ff7d3588700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7cc10e030 0x7ff7cc199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.785+0000 7ff7d3588700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc19a120 con 0x7ff7cc074120 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.785+0000 7ff7d3588700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc19a290 con 0x7ff7cc10e030 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.785+0000 7ff7d3588700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc19a450 con 0x7ff7cc073800 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc074120 0x7ff7cc19fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc074120 0x7ff7cc19fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42946/0 (socket says 172.21.15.12:42946) 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 -- 172.21.15.12:0/415743663 learned_addr learned my addr 172.21.15.12:0/415743663 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d1324700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7cc073800 0x7ff7cc19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d1b25700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7cc10e030 0x7ff7cc199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 -- 172.21.15.12:0/415743663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7cc073800 msgr2=0x7ff7cc19f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7cc073800 0x7ff7cc19f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 -- 172.21.15.12:0/415743663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7cc10e030 msgr2=0x7ff7cc199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7cc10e030 0x7ff7cc199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 -- 172.21.15.12:0/415743663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80095f0 con 0x7ff7cc074120 2023-12-11T20:13:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d1b25700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7cc10e030 0x7ff7cc199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.786+0000 7ff7d0b23700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc074120 0x7ff7cc19fec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00d950 tx=0x7ff7bc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.787+0000 7ff7c27fc700 1 -- 172.21.15.12:0/415743663 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc009940 con 0x7ff7cc074120 2023-12-11T20:13:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.787+0000 7ff7c27fc700 1 -- 172.21.15.12:0/415743663 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7bc010460 con 0x7ff7cc074120 2023-12-11T20:13:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.787+0000 7ff7c27fc700 1 -- 172.21.15.12:0/415743663 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00f620 con 0x7ff7cc074120 2023-12-11T20:13:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.787+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc19a730 con 0x7ff7cc074120 2023-12-11T20:13:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.787+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc1a6970 con 0x7ff7cc074120 2023-12-11T20:13:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.788+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc109240 con 0x7ff7cc074120 2023-12-11T20:13:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.790+0000 7ff7c27fc700 1 -- 172.21.15.12:0/415743663 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff7bc0105d0 con 0x7ff7cc074120 2023-12-11T20:13:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.791+0000 7ff7c27fc700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7b80a1500 0x7ff7b80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.791+0000 7ff7c27fc700 1 -- 172.21.15.12:0/415743663 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff7bc0cc6e0 con 0x7ff7cc074120 2023-12-11T20:13:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.791+0000 7ff7d1324700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7b80a1500 0x7ff7b80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.792+0000 7ff7d1324700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7b80a1500 0x7ff7b80a39c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800b5c0 tx=0x7ff7c8005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:02.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:02.795+0000 7ff7c27fc700 1 -- 172.21.15.12:0/415743663 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff7bc096140 con 0x7ff7cc074120 2023-12-11T20:13:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.005+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7cc19af80 con 0x7ff7cc074120 2023-12-11T20:13:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.005+0000 7ff7c27fc700 1 -- 172.21.15.12:0/415743663 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7bc099760 con 0x7ff7cc074120 2023-12-11T20:13:03.004 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7b80a1500 msgr2=0x7ff7b80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7b80a1500 0x7ff7b80a39c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800b5c0 tx=0x7ff7c8005fb0 comp rx=0 tx=0).stop 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc074120 msgr2=0x7ff7cc19fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc074120 0x7ff7cc19fec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00d950 tx=0x7ff7bc00dc60 comp rx=0 tx=0).stop 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 shutdown_connections 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7b80a1500 0x7ff7b80a39c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7cc10e030 0x7ff7cc199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7cc073800 0x7ff7cc19f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 --2- 172.21.15.12:0/415743663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7cc074120 0x7ff7cc19fec0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 >> 172.21.15.12:0/415743663 conn(0x7ff7cc0787c0 msgr2=0x7ff7cc0fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 shutdown_connections 2023-12-11T20:13:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:03.008+0000 7ff7d3588700 1 -- 172.21.15.12:0/415743663 wait complete. 2023-12-11T20:13:03.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:03 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/415743663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:03 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/415743663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.a on smithi012 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.d on smithi012 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.g on smithi012 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.j on smithi012 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.b on smithi032 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.e on smithi032 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.h on smithi032 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.k on smithi032 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.c on smithi039 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.f on smithi039 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.i on smithi039 2023-12-11T20:13:03.480 INFO:tasks.cephadm:Adding mds.l on smithi039 2023-12-11T20:13:03.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph orch apply mds all '12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l' 2023-12-11T20:13:03.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:03 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/415743663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:04.284 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:13:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:04 smithi012 ceph-mon[128787]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:04.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:04 smithi032 ceph-mon[132488]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:04.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:04 smithi039 ceph-mon[102205]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:05.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 -- 172.21.15.39:0/3904255371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 msgr2=0x7f1158106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:05.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 --2- 172.21.15.39:0/3904255371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 0x7f1158106dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f114c009990 tx=0x7f114c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:05.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 -- 172.21.15.39:0/3904255371 shutdown_connections 2023-12-11T20:13:05.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 --2- 172.21.15.39:0/3904255371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11581020a0 0x7f1158104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:05.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 --2- 172.21.15.39:0/3904255371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1158107300 0x7f1158109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:05.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 --2- 172.21.15.39:0/3904255371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 0x7f1158106dc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:05.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 -- 172.21.15.39:0/3904255371 >> 172.21.15.39:0/3904255371 conn(0x7f11580fbad0 msgr2=0x7f11580fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:05.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 -- 172.21.15.39:0/3904255371 shutdown_connections 2023-12-11T20:13:05.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.953+0000 7f115e4fe700 1 -- 172.21.15.39:0/3904255371 wait complete. 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.954+0000 7f115e4fe700 1 Processor -- start 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.954+0000 7f115e4fe700 1 -- start start 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.954+0000 7f115e4fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11581020a0 0x7f11581974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.954+0000 7f115e4fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 0x7f11581979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.954+0000 7f115e4fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1158107300 0x7f115819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.954+0000 7f115e4fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115819efe0 con 0x7f1158107300 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.954+0000 7f115e4fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115819f120 con 0x7f11581020a0 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.954+0000 7f115e4fe700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115819f2b0 con 0x7f11581049d0 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 0x7f11581979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 0x7f11581979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43040/0 (socket says 172.21.15.39:43040) 2023-12-11T20:13:05.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 -- 172.21.15.39:0/2629562472 learned_addr learned my addr 172.21.15.39:0/2629562472 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f115ca9b700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1158107300 0x7f115819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f1157fff700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11581020a0 0x7f11581974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 -- 172.21.15.39:0/2629562472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11581020a0 msgr2=0x7f11581974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11581020a0 0x7f11581974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 -- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1158107300 msgr2=0x7f115819ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1158107300 0x7f115819ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 -- 172.21.15.39:0/2629562472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c0095f0 con 0x7f11581049d0 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.955+0000 7f11577fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 0x7f11581979e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f114c005910 tx=0x7f114c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.956+0000 7f11557fa700 1 -- 172.21.15.39:0/2629562472 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c01d070 con 0x7f11581049d0 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.956+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115819f530 con 0x7f11581049d0 2023-12-11T20:13:05.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.956+0000 7f11557fa700 1 -- 172.21.15.39:0/2629562472 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f114c00bdb0 con 0x7f11581049d0 2023-12-11T20:13:05.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.956+0000 7f11557fa700 1 -- 172.21.15.39:0/2629562472 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00fdf0 con 0x7f11581049d0 2023-12-11T20:13:05.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.956+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115819f9a0 con 0x7f11581049d0 2023-12-11T20:13:05.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.957+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11580fd650 con 0x7f11581049d0 2023-12-11T20:13:05.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.959+0000 7f11557fa700 1 -- 172.21.15.39:0/2629562472 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f114c00b920 con 0x7f11581049d0 2023-12-11T20:13:05.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.960+0000 7f11557fa700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11400a1480 0x7f11400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:05.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.960+0000 7f11557fa700 1 -- 172.21.15.39:0/2629562472 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f114c0cdca0 con 0x7f11581049d0 2023-12-11T20:13:05.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.960+0000 7f1157fff700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11400a1480 0x7f11400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:05.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.961+0000 7f1157fff700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11400a1480 0x7f11400a3940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1148009bf0 tx=0x7f1148009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:05.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:05.964+0000 7f11557fa700 1 -- 172.21.15.39:0/2629562472 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f114c097790 con 0x7f11581049d0 2023-12-11T20:13:06.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.185+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f1158061b10 con 0x7f11400a1480 2023-12-11T20:13:06.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.194+0000 7f11557fa700 1 -- 172.21.15.39:0/2629562472 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f1158061b10 con 0x7f11400a1480 2023-12-11T20:13:06.193 INFO:teuthology.orchestra.run.smithi039.stdout:Scheduled mds.all update... 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11400a1480 msgr2=0x7f11400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11400a1480 0x7f11400a3940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1148009bf0 tx=0x7f1148009260 comp rx=0 tx=0).stop 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 msgr2=0x7f11581979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 0x7f11581979e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f114c005910 tx=0x7f114c004730 comp rx=0 tx=0).stop 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 shutdown_connections 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11400a1480 0x7f11400a3940 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11581020a0 0x7f11581974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1158107300 0x7f115819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:06.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 --2- 172.21.15.39:0/2629562472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11581049d0 0x7f11581979e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:06.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.196+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 >> 172.21.15.39:0/2629562472 conn(0x7f11580fbad0 msgr2=0x7f1158103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:06.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.197+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 shutdown_connections 2023-12-11T20:13:06.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-12-11T20:13:06.197+0000 7f115e4fe700 1 -- 172.21.15.39:0/2629562472 wait complete. 2023-12-11T20:13:06.326 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:06 smithi039 ceph-mon[102205]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:06.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:06 smithi012 ceph-mon[128787]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:06.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:06 smithi032 ceph-mon[132488]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:06.683 DEBUG:teuthology.orchestra.run.smithi012:mds.a> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.a.service 2023-12-11T20:13:06.689 DEBUG:teuthology.orchestra.run.smithi012:mds.d> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.d.service 2023-12-11T20:13:06.735 DEBUG:teuthology.orchestra.run.smithi012:mds.g> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.g.service 2023-12-11T20:13:06.770 INFO:journalctl@ceph.mds.a.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:13:06.774 DEBUG:teuthology.orchestra.run.smithi012:mds.j> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.j.service 2023-12-11T20:13:06.809 INFO:journalctl@ceph.mds.d.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:13:06.812 DEBUG:teuthology.orchestra.run.smithi032:mds.b> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.b.service 2023-12-11T20:13:06.818 DEBUG:teuthology.orchestra.run.smithi032:mds.e> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.e.service 2023-12-11T20:13:06.846 INFO:journalctl@ceph.mds.g.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:13:06.864 DEBUG:teuthology.orchestra.run.smithi032:mds.h> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.h.service 2023-12-11T20:13:06.882 INFO:journalctl@ceph.mds.j.smithi012.stdout:-- Logs begin at Mon 2023-12-11 19:45:50 UTC. -- 2023-12-11T20:13:06.900 INFO:journalctl@ceph.mds.b.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:13:06.904 DEBUG:teuthology.orchestra.run.smithi032:mds.k> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.k.service 2023-12-11T20:13:06.941 INFO:journalctl@ceph.mds.e.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:13:06.944 DEBUG:teuthology.orchestra.run.smithi039:mds.c> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.c.service 2023-12-11T20:13:06.949 DEBUG:teuthology.orchestra.run.smithi039:mds.f> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.f.service 2023-12-11T20:13:06.976 INFO:journalctl@ceph.mds.h.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:13:06.997 DEBUG:teuthology.orchestra.run.smithi039:mds.i> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.i.service 2023-12-11T20:13:07.013 INFO:journalctl@ceph.mds.k.smithi032.stdout:-- Logs begin at Mon 2023-12-11 19:45:55 UTC. -- 2023-12-11T20:13:07.022 INFO:journalctl@ceph.mds.c.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:13:07.026 DEBUG:teuthology.orchestra.run.smithi039:mds.l> sudo journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.l.service 2023-12-11T20:13:07.073 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-12-11T20:13:07.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:13:07.075 INFO:journalctl@ceph.mds.f.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:13:07.103 INFO:journalctl@ceph.mds.i.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:13:07.144 INFO:journalctl@ceph.mds.l.smithi039.stdout:-- Logs begin at Mon 2023-12-11 19:46:50 UTC. -- 2023-12-11T20:13:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 -- 172.21.15.12:0/1805377893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 msgr2=0x7fc334102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/1805377893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 0x7fc334102af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc3240099c0 tx=0x7fc324009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 -- 172.21.15.12:0/1805377893 shutdown_connections 2023-12-11T20:13:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/1805377893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3341014a0 0x7fc3341018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/1805377893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc334103030 0x7fc3341098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/1805377893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 0x7fc334102af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 -- 172.21.15.12:0/1805377893 >> 172.21.15.12:0/1805377893 conn(0x7fc3340fca10 msgr2=0x7fc3340fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 -- 172.21.15.12:0/1805377893 shutdown_connections 2023-12-11T20:13:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.290+0000 7fc33c7ff700 1 -- 172.21.15.12:0/1805377893 wait complete. 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.291+0000 7fc33c7ff700 1 Processor -- start 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.291+0000 7fc33c7ff700 1 -- start start 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33c7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3341014a0 0x7fc3340752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33c7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 0x7fc3340739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33c7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc334103030 0x7fc334073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33c7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc334074600 con 0x7fc334102690 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33c7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc334074770 con 0x7fc3341014a0 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33c7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3341a1400 con 0x7fc334103030 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc339d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 0x7fc3340739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:07.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33ad9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc334103030 0x7fc334073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc339d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 0x7fc3340739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42962/0 (socket says 172.21.15.12:42962) 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc339d9a700 1 -- 172.21.15.12:0/2555452701 learned_addr learned my addr 172.21.15.12:0/2555452701 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33a59b700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3341014a0 0x7fc3340752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33ad9c700 1 -- 172.21.15.12:0/2555452701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3341014a0 msgr2=0x7fc3340752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33ad9c700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3341014a0 0x7fc3340752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33ad9c700 1 -- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 msgr2=0x7fc3340739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33ad9c700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 0x7fc3340739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc33ad9c700 1 -- 172.21.15.12:0/2555452701 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3240095f0 con 0x7fc334103030 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.292+0000 7fc339d9a700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 0x7fc3340739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.293+0000 7fc33ad9c700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc334103030 0x7fc334073f00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00efc0 tx=0x7fc32c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.293+0000 7fc32b7fe700 1 -- 172.21.15.12:0/2555452701 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c018070 con 0x7fc334103030 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.293+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3341a1600 con 0x7fc334103030 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.293+0000 7fc32b7fe700 1 -- 172.21.15.12:0/2555452701 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc32c00f040 con 0x7fc334103030 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.293+0000 7fc32b7fe700 1 -- 172.21.15.12:0/2555452701 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00cba0 con 0x7fc334103030 2023-12-11T20:13:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.293+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3341a1b10 con 0x7fc334103030 2023-12-11T20:13:07.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.295+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc334108990 con 0x7fc334103030 2023-12-11T20:13:07.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.296+0000 7fc32b7fe700 1 -- 172.21.15.12:0/2555452701 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc32c003a00 con 0x7fc334103030 2023-12-11T20:13:07.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.297+0000 7fc32b7fe700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3200a1480 0x7fc3200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:07.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.297+0000 7fc32b7fe700 1 -- 172.21.15.12:0/2555452701 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc32c0cc360 con 0x7fc334103030 2023-12-11T20:13:07.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.298+0000 7fc33a59b700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3200a1480 0x7fc3200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:07.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.298+0000 7fc33a59b700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3200a1480 0x7fc3200a3940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3341024f0 tx=0x7fc330009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:07.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.301+0000 7fc32b7fe700 1 -- 172.21.15.12:0/2555452701 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc32c095ef0 con 0x7fc334103030 2023-12-11T20:13:07.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l;count:12 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:13:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l;count:12 2023-12-11T20:13:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:07.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:07.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:07.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:07.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.512+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc33410cbc0 con 0x7fc334103030 2023-12-11T20:13:07.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.513+0000 7fc32b7fe700 1 -- 172.21.15.12:0/2555452701 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18352 (secure 0 0 0) 0x7fc32c099510 con 0x7fc334103030 2023-12-11T20:13:07.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:07.512 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:12:54.270944+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:13:07.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3200a1480 msgr2=0x7fc3200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3200a1480 0x7fc3200a3940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3341024f0 tx=0x7fc330009260 comp rx=0 tx=0).stop 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc334103030 msgr2=0x7fc334073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc334103030 0x7fc334073f00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00efc0 tx=0x7fc32c00c3a0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 shutdown_connections 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3200a1480 0x7fc3200a3940 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3341014a0 0x7fc3340752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc334103030 0x7fc334073f00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 --2- 172.21.15.12:0/2555452701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc334102690 0x7fc3340739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.515+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 >> 172.21.15.12:0/2555452701 conn(0x7fc3340fca10 msgr2=0x7fc334105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.516+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 shutdown_connections 2023-12-11T20:13:07.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.516+0000 7fc33c7ff700 1 -- 172.21.15.12:0/2555452701 wait complete. 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l;count:12 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:07.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:07.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:13:07.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.743+0000 7fa34ddff700 1 -- 172.21.15.12:0/3731576738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3481026a0 msgr2=0x7fa348102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.743+0000 7fa34ddff700 1 --2- 172.21.15.12:0/3731576738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3481026a0 0x7fa348102b00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3300099c0 tx=0x7fa330009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.744+0000 7fa34ddff700 1 -- 172.21.15.12:0/3731576738 shutdown_connections 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.744+0000 7fa34ddff700 1 --2- 172.21.15.12:0/3731576738 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3481014b0 0x7fa3481018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.744+0000 7fa34ddff700 1 --2- 172.21.15.12:0/3731576738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348103040 0x7fa3481098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.744+0000 7fa34ddff700 1 --2- 172.21.15.12:0/3731576738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3481026a0 0x7fa348102b00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.744+0000 7fa34ddff700 1 -- 172.21.15.12:0/3731576738 >> 172.21.15.12:0/3731576738 conn(0x7fa3480fca00 msgr2=0x7fa3480fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.744+0000 7fa34ddff700 1 -- 172.21.15.12:0/3731576738 shutdown_connections 2023-12-11T20:13:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.744+0000 7fa34ddff700 1 -- 172.21.15.12:0/3731576738 wait complete. 2023-12-11T20:13:07.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.745+0000 7fa34ddff700 1 Processor -- start 2023-12-11T20:13:07.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.745+0000 7fa34ddff700 1 -- start start 2023-12-11T20:13:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa34ddff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3481014b0 0x7fa348199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa34ddff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3481026a0 0x7fa348199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa34ddff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348103040 0x7fa3481a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa34ddff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3481a10b0 con 0x7fa3481026a0 2023-12-11T20:13:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa34ddff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3481a11f0 con 0x7fa348103040 2023-12-11T20:13:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa34ddff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3481a1380 con 0x7fa3481014b0 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa33ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3481026a0 0x7fa348199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa3477fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3481014b0 0x7fa348199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa3477fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3481014b0 0x7fa348199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40244/0 (socket says 172.21.15.12:40244) 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa3477fe700 1 -- 172.21.15.12:0/2459223389 learned_addr learned my addr 172.21.15.12:0/2459223389 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa347fff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348103040 0x7fa3481a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa3477fe700 1 -- 172.21.15.12:0/2459223389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348103040 msgr2=0x7fa3481a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.746+0000 7fa3477fe700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348103040 0x7fa3481a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa3477fe700 1 -- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3481026a0 msgr2=0x7fa348199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa3477fe700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3481026a0 0x7fa348199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa3477fe700 1 -- 172.21.15.12:0/2459223389 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa340009c40 con 0x7fa3481014b0 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa3477fe700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3481014b0 0x7fa348199580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa33800e970 tx=0x7fa33800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa3457fa700 1 -- 172.21.15.12:0/2459223389 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338009790 con 0x7fa3481014b0 2023-12-11T20:13:07.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa3457fa700 1 -- 172.21.15.12:0/2459223389 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa33800eec0 con 0x7fa3481014b0 2023-12-11T20:13:07.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3300095f0 con 0x7fa3481014b0 2023-12-11T20:13:07.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa3457fa700 1 -- 172.21.15.12:0/2459223389 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338003c10 con 0x7fa3481014b0 2023-12-11T20:13:07.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.747+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3481a19e0 con 0x7fa3481014b0 2023-12-11T20:13:07.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.748+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa348068330 con 0x7fa3481014b0 2023-12-11T20:13:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.751+0000 7fa3457fa700 1 -- 172.21.15.12:0/2459223389 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa338003d90 con 0x7fa3481014b0 2023-12-11T20:13:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.752+0000 7fa3457fa700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3340a1480 0x7fa3340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.752+0000 7fa3457fa700 1 -- 172.21.15.12:0/2459223389 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa338014070 con 0x7fa3481014b0 2023-12-11T20:13:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.752+0000 7fa33ffff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3340a1480 0x7fa3340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.753+0000 7fa33ffff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3340a1480 0x7fa3340a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa330009990 tx=0x7fa330003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:07.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.754+0000 7fa3457fa700 1 -- 172.21.15.12:0/2459223389 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa338096760 con 0x7fa3481014b0 2023-12-11T20:13:07.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.968+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa34810ce60 con 0x7fa3481014b0 2023-12-11T20:13:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.969+0000 7fa3457fa700 1 -- 172.21.15.12:0/2459223389 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa338099d80 con 0x7fa3481014b0 2023-12-11T20:13:07.968 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3340a1480 msgr2=0x7fa3340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3340a1480 0x7fa3340a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa330009990 tx=0x7fa330003680 comp rx=0 tx=0).stop 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3481014b0 msgr2=0x7fa348199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3481014b0 0x7fa348199580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa33800e970 tx=0x7fa33800ec80 comp rx=0 tx=0).stop 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 shutdown_connections 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3340a1480 0x7fa3340a3940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348103040 0x7fa3481a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3481014b0 0x7fa348199580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 --2- 172.21.15.12:0/2459223389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3481026a0 0x7fa348199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 >> 172.21.15.12:0/2459223389 conn(0x7fa3480fca00 msgr2=0x7fa348107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:07.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 shutdown_connections 2023-12-11T20:13:07.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:07.972+0000 7fa34ddff700 1 -- 172.21.15.12:0/2459223389 wait complete. 2023-12-11T20:13:07.990 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 -- 172.21.15.12:0/3835991037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 msgr2=0x7f08241018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 --2- 172.21.15.12:0/3835991037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 0x7f08241018c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f08140099c0 tx=0x7f0814009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 -- 172.21.15.12:0/3835991037 shutdown_connections 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 --2- 172.21.15.12:0/3835991037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0824103030 0x7f08241098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 --2- 172.21.15.12:0/3835991037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 0x7f08241018c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 --2- 172.21.15.12:0/3835991037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0824102690 0x7f0824102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 -- 172.21.15.12:0/3835991037 >> 172.21.15.12:0/3835991037 conn(0x7f08240fca10 msgr2=0x7f08240fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 -- 172.21.15.12:0/3835991037 shutdown_connections 2023-12-11T20:13:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.195+0000 7f08291ff700 1 -- 172.21.15.12:0/3835991037 wait complete. 2023-12-11T20:13:08.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.196+0000 7f08291ff700 1 Processor -- start 2023-12-11T20:13:08.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.196+0000 7f08291ff700 1 -- start start 2023-12-11T20:13:08.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f08291ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 0x7f0824197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:08.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f08291ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0824102690 0x7f08241978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f08291ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0824103030 0x7f082419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f08291ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082419ee90 con 0x7f08241014a0 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f08291ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082419efd0 con 0x7f0824102690 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f08291ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082419f160 con 0x7f0824103030 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f0822d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 0x7f0824197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f0822d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 0x7f0824197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43018/0 (socket says 172.21.15.12:43018) 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f0822d9d700 1 -- 172.21.15.12:0/1698576985 learned_addr learned my addr 172.21.15.12:0/1698576985 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f082359e700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0824103030 0x7f082419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f082259c700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0824102690 0x7f08241978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f0822d9d700 1 -- 172.21.15.12:0/1698576985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0824103030 msgr2=0x7f082419e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f0822d9d700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0824103030 0x7f082419e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f0822d9d700 1 -- 172.21.15.12:0/1698576985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0824102690 msgr2=0x7f08241978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f0822d9d700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0824102690 0x7f08241978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.197+0000 7f0822d9d700 1 -- 172.21.15.12:0/1698576985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140095f0 con 0x7f08241014a0 2023-12-11T20:13:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.198+0000 7f0822d9d700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 0x7f0824197360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0814009fd0 tx=0x7f081400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.198+0000 7f080bfff700 1 -- 172.21.15.12:0/1698576985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081401d070 con 0x7f08241014a0 2023-12-11T20:13:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.198+0000 7f080bfff700 1 -- 172.21.15.12:0/1698576985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f081400bd10 con 0x7f08241014a0 2023-12-11T20:13:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.198+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082419f3e0 con 0x7f08241014a0 2023-12-11T20:13:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.198+0000 7f080bfff700 1 -- 172.21.15.12:0/1698576985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814004b30 con 0x7f08241014a0 2023-12-11T20:13:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.198+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082419f860 con 0x7f08241014a0 2023-12-11T20:13:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.199+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0824108910 con 0x7f08241014a0 2023-12-11T20:13:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.201+0000 7f080bfff700 1 -- 172.21.15.12:0/1698576985 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0814004c90 con 0x7f08241014a0 2023-12-11T20:13:08.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.202+0000 7f080bfff700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f080c0a1500 0x7f080c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:08.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.203+0000 7f080bfff700 1 -- 172.21.15.12:0/1698576985 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f08140cd5a0 con 0x7f08241014a0 2023-12-11T20:13:08.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.203+0000 7f082259c700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f080c0a1500 0x7f080c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:08.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.203+0000 7f082259c700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f080c0a1500 0x7f080c0a39c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0818009c60 tx=0x7f0818009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:08.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.207+0000 7f080bfff700 1 -- 172.21.15.12:0/1698576985 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0814097090 con 0x7f08241014a0 2023-12-11T20:13:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:08 smithi012 ceph-mon[128787]: Deploying daemon mds.l on smithi039 2023-12-11T20:13:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:08 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2555452701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:08.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:08 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2459223389' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:08 smithi032 ceph-mon[132488]: Deploying daemon mds.l on smithi039 2023-12-11T20:13:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:08 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2555452701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:08 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2459223389' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:08.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.467+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0824068330 con 0x7f08241014a0 2023-12-11T20:13:08.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.467+0000 7f080bfff700 1 -- 172.21.15.12:0/1698576985 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f081409a6b0 con 0x7f08241014a0 2023-12-11T20:13:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f080c0a1500 msgr2=0x7f080c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f080c0a1500 0x7f080c0a39c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0818009c60 tx=0x7f0818009260 comp rx=0 tx=0).stop 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 msgr2=0x7f0824197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 0x7f0824197360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0814009fd0 tx=0x7f081400fa00 comp rx=0 tx=0).stop 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 shutdown_connections 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f080c0a1500 0x7f080c0a39c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0824103030 0x7f082419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08241014a0 0x7f0824197360 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 --2- 172.21.15.12:0/1698576985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0824102690 0x7f08241978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 >> 172.21.15.12:0/1698576985 conn(0x7f08240fca10 msgr2=0x7f0824105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 shutdown_connections 2023-12-11T20:13:08.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:08.470+0000 7f08291ff700 1 -- 172.21.15.12:0/1698576985 wait complete. 2023-12-11T20:13:08.470 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 1 2023-12-11T20:13:08.509 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:08 smithi039 ceph-mon[102205]: Deploying daemon mds.l on smithi039 2023-12-11T20:13:08.509 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:08 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2555452701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:08.509 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:08 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2459223389' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:09.498 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:09 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1698576985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:09.499 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:09 smithi039 ceph-mon[102205]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:09 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1698576985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:09 smithi012 ceph-mon[128787]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:09.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:09 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1698576985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:09 smithi032 ceph-mon[132488]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:09.801 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:13:09 smithi039 systemd[1]: Starting Ceph mds.l for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:10.260 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:13:09 smithi039 podman[139022]: 2023-12-11T20:13:10.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:10.551 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:13:10 smithi039 ceph-mds[139062]: -- 172.21.15.39:0/3078096686 <== mon.1 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5576b725b520 con 0x5576b7232800 2023-12-11T20:13:10.552 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:13:10 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-l[139038]: starting mds.l at 2023-12-11T20:13:10.552 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:13:10 smithi039 bash[139022]: a24cec9edceb51ea58a9f724daf37ea4f4bc707c3c99e70dd1ba9e7dec07d901 2023-12-11T20:13:10.552 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:13:10 smithi039 systemd[1]: Started Ceph mds.l for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 -- 172.21.15.12:0/2541997501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe480101f90 msgr2=0x7fe480104380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 --2- 172.21.15.12:0/2541997501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe480101f90 0x7fe480104380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe470009990 tx=0x7fe470009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 -- 172.21.15.12:0/2541997501 shutdown_connections 2023-12-11T20:13:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 --2- 172.21.15.12:0/2541997501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4801071f0 0x7fe480109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 --2- 172.21.15.12:0/2541997501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe480101f90 0x7fe480104380 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 --2- 172.21.15.12:0/2541997501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4801048c0 0x7fe480106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 -- 172.21.15.12:0/2541997501 >> 172.21.15.12:0/2541997501 conn(0x7fe4800fb980 msgr2=0x7fe4800fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 -- 172.21.15.12:0/2541997501 shutdown_connections 2023-12-11T20:13:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.704+0000 7fe485fff700 1 -- 172.21.15.12:0/2541997501 wait complete. 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.705+0000 7fe485fff700 1 Processor -- start 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.705+0000 7fe485fff700 1 -- start start 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.705+0000 7fe485fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe480101f90 0x7fe4801018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe485fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4801048c0 0x7fe4800fff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe485fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4801071f0 0x7fe480100480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe485fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480100c20 con 0x7fe4801048c0 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe485fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480100d90 con 0x7fe4801071f0 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe485fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801a1390 con 0x7fe480101f90 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe47f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe480101f90 0x7fe4801018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe47f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe480101f90 0x7fe4801018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:35874/0 (socket says 172.21.15.12:35874) 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe47f7fe700 1 -- 172.21.15.12:0/1063559183 learned_addr learned my addr 172.21.15.12:0/1063559183 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe477fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4801048c0 0x7fe4800fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe47ffff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4801071f0 0x7fe480100480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe477fff700 1 -- 172.21.15.12:0/1063559183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe480101f90 msgr2=0x7fe4801018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe477fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe480101f90 0x7fe4801018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe477fff700 1 -- 172.21.15.12:0/1063559183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4801071f0 msgr2=0x7fe480100480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe477fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4801071f0 0x7fe480100480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.706+0000 7fe477fff700 1 -- 172.21.15.12:0/1063559183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700095f0 con 0x7fe4801048c0 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.707+0000 7fe477fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4801048c0 0x7fe4800fff40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe46800d950 tx=0x7fe46800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.707+0000 7fe47d7fa700 1 -- 172.21.15.12:0/1063559183 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800f890 con 0x7fe4801048c0 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.707+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4801a1620 con 0x7fe4801048c0 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.707+0000 7fe47d7fa700 1 -- 172.21.15.12:0/1063559183 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe46800fe80 con 0x7fe4801048c0 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.707+0000 7fe47d7fa700 1 -- 172.21.15.12:0/1063559183 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46801b450 con 0x7fe4801048c0 2023-12-11T20:13:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.707+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4801a1b80 con 0x7fe4801048c0 2023-12-11T20:13:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.708+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4800fd500 con 0x7fe4801048c0 2023-12-11T20:13:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.710+0000 7fe47d7fa700 1 -- 172.21.15.12:0/1063559183 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe46800f9f0 con 0x7fe4801048c0 2023-12-11T20:13:10.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.712+0000 7fe47d7fa700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe46c0a1480 0x7fe46c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:10.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.712+0000 7fe47d7fa700 1 -- 172.21.15.12:0/1063559183 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe4680cc900 con 0x7fe4801048c0 2023-12-11T20:13:10.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.712+0000 7fe47f7fe700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe46c0a1480 0x7fe46c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:10.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.713+0000 7fe47f7fe700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe46c0a1480 0x7fe46c0a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe47000b5c0 tx=0x7fe470003720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:10.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.717+0000 7fe47d7fa700 1 -- 172.21.15.12:0/1063559183 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe468096360 con 0x7fe4801048c0 2023-12-11T20:13:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.976+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe480068330 con 0x7fe4801048c0 2023-12-11T20:13:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.977+0000 7fe47d7fa700 1 -- 172.21.15.12:0/1063559183 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7fe468099980 con 0x7fe4801048c0 2023-12-11T20:13:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:10.976 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-11T20:13:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe46c0a1480 msgr2=0x7fe46c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe46c0a1480 0x7fe46c0a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe47000b5c0 tx=0x7fe470003720 comp rx=0 tx=0).stop 2023-12-11T20:13:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4801048c0 msgr2=0x7fe4800fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4801048c0 0x7fe4800fff40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe46800d950 tx=0x7fe46800dc60 comp rx=0 tx=0).stop 2023-12-11T20:13:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 shutdown_connections 2023-12-11T20:13:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe46c0a1480 0x7fe46c0a3940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4801071f0 0x7fe480100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe480101f90 0x7fe4801018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 --2- 172.21.15.12:0/1063559183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4801048c0 0x7fe4800fff40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 >> 172.21.15.12:0/1063559183 conn(0x7fe4800fb980 msgr2=0x7fe480103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 shutdown_connections 2023-12-11T20:13:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:10.979+0000 7fe485fff700 1 -- 172.21.15.12:0/1063559183 wait complete. 2023-12-11T20:13:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.39:6832/3471280196,v1:172.21.15.39:6833/3471280196] up:boot 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: fsmap 1 up:standby 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: Deploying daemon mds.k on smithi032 2023-12-11T20:13:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1063559183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:11.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:11 smithi039 ceph-mon[102205]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.39:6832/3471280196,v1:172.21.15.39:6833/3471280196] up:boot 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: fsmap 1 up:standby 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: Deploying daemon mds.k on smithi032 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1063559183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:11.561 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:11 smithi032 ceph-mon[132488]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.39:6832/3471280196,v1:172.21.15.39:6833/3471280196] up:boot 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: fsmap 1 up:standby 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:11.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: Deploying daemon mds.k on smithi032 2023-12-11T20:13:11.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1063559183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:11.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:11 smithi012 ceph-mon[128787]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:12.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:13.213 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:13:12 smithi032 systemd[1]: Starting Ceph mds.k for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 -- 172.21.15.12:0/1882934790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c1014a0 msgr2=0x7f2a7c1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 --2- 172.21.15.12:0/1882934790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c1014a0 0x7f2a7c1018c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2a780099c0 tx=0x7f2a78009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 -- 172.21.15.12:0/1882934790 shutdown_connections 2023-12-11T20:13:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 --2- 172.21.15.12:0/1882934790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a7c103030 0x7f2a7c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 --2- 172.21.15.12:0/1882934790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c1014a0 0x7f2a7c1018c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 --2- 172.21.15.12:0/1882934790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c102690 0x7f2a7c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 -- 172.21.15.12:0/1882934790 >> 172.21.15.12:0/1882934790 conn(0x7f2a7c0fca10 msgr2=0x7f2a7c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:13.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 -- 172.21.15.12:0/1882934790 shutdown_connections 2023-12-11T20:13:13.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.215+0000 7f2a83bff700 1 -- 172.21.15.12:0/1882934790 wait complete. 2023-12-11T20:13:13.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.216+0000 7f2a83bff700 1 Processor -- start 2023-12-11T20:13:13.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.216+0000 7f2a83bff700 1 -- start start 2023-12-11T20:13:13.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a83bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a7c1014a0 0x7f2a7c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:13.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a83bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c102690 0x7f2a7c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:13.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a83bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c103030 0x7f2a7c1a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:13.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a83bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c1a10e0 con 0x7f2a7c102690 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a83bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c1a1220 con 0x7f2a7c103030 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a83bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c1a13b0 con 0x7f2a7c1014a0 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c102690 0x7f2a7c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c102690 0x7f2a7c199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55212/0 (socket says 172.21.15.12:55212) 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8199b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a7c1014a0 0x7f2a7c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8219c700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c103030 0x7f2a7c1a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8119a700 1 -- 172.21.15.12:0/3013716851 learned_addr learned my addr 172.21.15.12:0/3013716851 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8219c700 1 -- 172.21.15.12:0/3013716851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a7c1014a0 msgr2=0x7f2a7c1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8219c700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a7c1014a0 0x7f2a7c1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8219c700 1 -- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c102690 msgr2=0x7f2a7c199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8219c700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c102690 0x7f2a7c199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8219c700 1 -- 172.21.15.12:0/3013716851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a780095f0 con 0x7f2a7c103030 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.217+0000 7f2a8119a700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c102690 0x7f2a7c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:13.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.218+0000 7f2a8219c700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c103030 0x7f2a7c1a0b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400efc0 tx=0x7f2a7400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:13.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.218+0000 7f2a72ffd700 1 -- 172.21.15.12:0/3013716851 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74018070 con 0x7f2a7c103030 2023-12-11T20:13:13.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.218+0000 7f2a72ffd700 1 -- 172.21.15.12:0/3013716851 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a7400f040 con 0x7f2a7c103030 2023-12-11T20:13:13.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.218+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c1a1630 con 0x7f2a7c103030 2023-12-11T20:13:13.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.218+0000 7f2a72ffd700 1 -- 172.21.15.12:0/3013716851 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400cba0 con 0x7f2a7c103030 2023-12-11T20:13:13.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.218+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c1a1af0 con 0x7f2a7c103030 2023-12-11T20:13:13.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.219+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c068330 con 0x7f2a7c103030 2023-12-11T20:13:13.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.221+0000 7f2a72ffd700 1 -- 172.21.15.12:0/3013716851 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2a74003a00 con 0x7f2a7c103030 2023-12-11T20:13:13.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.222+0000 7f2a72ffd700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a680a1480 0x7f2a680a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:13.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.222+0000 7f2a72ffd700 1 -- 172.21.15.12:0/3013716851 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2a740ccda0 con 0x7f2a7c103030 2023-12-11T20:13:13.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.223+0000 7f2a8199b700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a680a1480 0x7f2a680a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:13.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.223+0000 7f2a8199b700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a680a1480 0x7f2a680a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009990 tx=0x7f2a78003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:13.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.225+0000 7f2a72ffd700 1 -- 172.21.15.12:0/3013716851 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2a74096890 con 0x7f2a7c103030 2023-12-11T20:13:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.485+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a7c10cbb0 con 0x7f2a7c103030 2023-12-11T20:13:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.486+0000 7f2a72ffd700 1 -- 172.21.15.12:0/3013716851 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7f2a74099eb0 con 0x7f2a7c103030 2023-12-11T20:13:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-11T20:13:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a680a1480 msgr2=0x7f2a680a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a680a1480 0x7f2a680a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009990 tx=0x7f2a78003680 comp rx=0 tx=0).stop 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c103030 msgr2=0x7f2a7c1a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c103030 0x7f2a7c1a0b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400efc0 tx=0x7f2a7400c3a0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 shutdown_connections 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a680a1480 0x7f2a680a3940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a7c103030 0x7f2a7c1a0b10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a7c1014a0 0x7f2a7c1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 --2- 172.21.15.12:0/3013716851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7c102690 0x7f2a7c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.488+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 >> 172.21.15.12:0/3013716851 conn(0x7f2a7c0fca10 msgr2=0x7f2a7c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.489+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 shutdown_connections 2023-12-11T20:13:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:13.489+0000 7f2a83bff700 1 -- 172.21.15.12:0/3013716851 wait complete. 2023-12-11T20:13:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2023-12-11T20:13:13.502 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:13:13 smithi032 podman[168083]: 2023-12-11T20:13:13.502 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:13:13 smithi032 bash[168083]: 8f057dada619c528a899648d9e8226a923f81651ac426ba9c85c0988d43e35fd 2023-12-11T20:13:13.503 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:13:13 smithi032 ceph-mds[168123]: -- 172.21.15.32:0/258581436 <== mon.2 v2:172.21.15.32:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5575f50c7520 con 0x5575f509ec00 2023-12-11T20:13:13.503 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:13:13 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-k[168099]: starting mds.k at 2023-12-11T20:13:13.962 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:13:13 smithi032 systemd[1]: Started Ceph mds.k for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:14 smithi012 ceph-mon[128787]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:14 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3013716851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:14.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:14.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:14 smithi032 ceph-mon[132488]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:14 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3013716851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:14.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:14 smithi039 ceph-mon[102205]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:14 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3013716851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:15.176 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:15 smithi012 ceph-mon[128787]: Deploying daemon mds.j on smithi012 2023-12-11T20:13:15.176 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:15 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.32:6832/2096200170,v1:172.21.15.32:6833/2096200170] up:boot 2023-12-11T20:13:15.176 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:15 smithi012 ceph-mon[128787]: fsmap 2 up:standby 2023-12-11T20:13:15.176 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-11T20:13:15.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:15 smithi032 ceph-mon[132488]: Deploying daemon mds.j on smithi012 2023-12-11T20:13:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:15 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.32:6832/2096200170,v1:172.21.15.32:6833/2096200170] up:boot 2023-12-11T20:13:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:15 smithi032 ceph-mon[132488]: fsmap 2 up:standby 2023-12-11T20:13:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-11T20:13:15.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:15 smithi039 ceph-mon[102205]: Deploying daemon mds.j on smithi012 2023-12-11T20:13:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:15 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.32:6832/2096200170,v1:172.21.15.32:6833/2096200170] up:boot 2023-12-11T20:13:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:15 smithi039 ceph-mon[102205]: fsmap 2 up:standby 2023-12-11T20:13:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-11T20:13:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.738+0000 7f91a67ff700 1 -- 172.21.15.12:0/3914430977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0108c90 msgr2=0x7f91a01090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.738+0000 7f91a67ff700 1 --2- 172.21.15.12:0/3914430977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0108c90 0x7f91a01090f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91940099c0 tx=0x7f9194009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.739+0000 7f91a67ff700 1 -- 172.21.15.12:0/3914430977 shutdown_connections 2023-12-11T20:13:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.739+0000 7f91a67ff700 1 --2- 172.21.15.12:0/3914430977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91a0109630 0x7f91a010fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.739+0000 7f91a67ff700 1 --2- 172.21.15.12:0/3914430977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a0107af0 0x7f91a0107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.739+0000 7f91a67ff700 1 --2- 172.21.15.12:0/3914430977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0108c90 0x7f91a01090f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.739+0000 7f91a67ff700 1 -- 172.21.15.12:0/3914430977 >> 172.21.15.12:0/3914430977 conn(0x7f91a0076a40 msgr2=0x7f91a0078e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.739+0000 7f91a67ff700 1 -- 172.21.15.12:0/3914430977 shutdown_connections 2023-12-11T20:13:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.739+0000 7f91a67ff700 1 -- 172.21.15.12:0/3914430977 wait complete. 2023-12-11T20:13:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.740+0000 7f91a67ff700 1 Processor -- start 2023-12-11T20:13:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.741+0000 7f91a67ff700 1 -- start start 2023-12-11T20:13:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.741+0000 7f91a67ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a0107af0 0x7f91a019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.741+0000 7f91a67ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91a0108c90 0x7f91a019de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.741+0000 7f91a67ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0109630 0x7f91a01a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.741+0000 7f91a67ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a01a5480 con 0x7f91a0109630 2023-12-11T20:13:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.741+0000 7f91a67ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a01a55c0 con 0x7f91a0108c90 2023-12-11T20:13:15.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.741+0000 7f91a67ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a01a5750 con 0x7f91a0107af0 2023-12-11T20:13:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f91a4d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0109630 0x7f91a01a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f919f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91a0108c90 0x7f91a019de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f91a4d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0109630 0x7f91a01a4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55230/0 (socket says 172.21.15.12:55230) 2023-12-11T20:13:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f91a4d9c700 1 -- 172.21.15.12:0/16813069 learned_addr learned my addr 172.21.15.12:0/16813069 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:15.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f919ffff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a0107af0 0x7f91a019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:15.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f919f7fe700 1 -- 172.21.15.12:0/16813069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a0107af0 msgr2=0x7f91a019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:15.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f919f7fe700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a0107af0 0x7f91a019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:15.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f919f7fe700 1 -- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0109630 msgr2=0x7f91a01a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:15.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f919f7fe700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0109630 0x7f91a01a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:15.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f919f7fe700 1 -- 172.21.15.12:0/16813069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940095f0 con 0x7f91a0108c90 2023-12-11T20:13:15.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.742+0000 7f91a4d9c700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0109630 0x7f91a01a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:15.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.743+0000 7f919f7fe700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91a0108c90 0x7f91a019de90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91940098e0 tx=0x7f919400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:15.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.743+0000 7f919d7fa700 1 -- 172.21.15.12:0/16813069 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919401d070 con 0x7f91a0108c90 2023-12-11T20:13:15.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.743+0000 7f919d7fa700 1 -- 172.21.15.12:0/16813069 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f919400bd10 con 0x7f91a0108c90 2023-12-11T20:13:15.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.743+0000 7f919d7fa700 1 -- 172.21.15.12:0/16813069 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91940173f0 con 0x7f91a0108c90 2023-12-11T20:13:15.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.743+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a01a59d0 con 0x7f91a0108c90 2023-12-11T20:13:15.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.743+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a01a5da0 con 0x7f91a0108c90 2023-12-11T20:13:15.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.745+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a010ef60 con 0x7f91a0108c90 2023-12-11T20:13:15.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.749+0000 7f919d7fa700 1 -- 172.21.15.12:0/16813069 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9194022470 con 0x7f91a0108c90 2023-12-11T20:13:15.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.750+0000 7f919d7fa700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91880a1480 0x7f91880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:15.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.750+0000 7f919d7fa700 1 -- 172.21.15.12:0/16813069 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f91940cd8d0 con 0x7f91a0108c90 2023-12-11T20:13:15.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.751+0000 7f919ffff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91880a1480 0x7f91880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:15.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.751+0000 7f919d7fa700 1 -- 172.21.15.12:0/16813069 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f919405d2f0 con 0x7f91a0108c90 2023-12-11T20:13:15.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:15.751+0000 7f919ffff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91880a1480 0x7f91880a3940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91a0108af0 tx=0x7f919800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.024+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91a0068330 con 0x7f91a0108c90 2023-12-11T20:13:16.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.025+0000 7f919d7fa700 1 -- 172.21.15.12:0/16813069 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7f91940973c0 con 0x7f91a0108c90 2023-12-11T20:13:16.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:16.023 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.027+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91880a1480 msgr2=0x7f91880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.027+0000 7f91a67ff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91880a1480 0x7f91880a3940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91a0108af0 tx=0x7f919800b040 comp rx=0 tx=0).stop 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.027+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91a0108c90 msgr2=0x7f91a019de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.027+0000 7f91a67ff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91a0108c90 0x7f91a019de90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91940098e0 tx=0x7f919400fa00 comp rx=0 tx=0).stop 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.028+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 shutdown_connections 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.028+0000 7f91a67ff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91880a1480 0x7f91880a3940 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.028+0000 7f91a67ff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0109630 0x7f91a01a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.028+0000 7f91a67ff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a0107af0 0x7f91a019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.028+0000 7f91a67ff700 1 --2- 172.21.15.12:0/16813069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91a0108c90 0x7f91a019de90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.028+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 >> 172.21.15.12:0/16813069 conn(0x7f91a0076a40 msgr2=0x7f91a010c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.028+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 shutdown_connections 2023-12-11T20:13:16.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:16.028+0000 7f91a67ff700 1 -- 172.21.15.12:0/16813069 wait complete. 2023-12-11T20:13:16.027 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2023-12-11T20:13:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:16 smithi012 ceph-mon[128787]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:16 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/16813069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:16.330 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:13:15 smithi012 systemd[1]: Starting Ceph mds.j for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:16 smithi032 ceph-mon[132488]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:16 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/16813069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:16 smithi039 ceph-mon[102205]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:16 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/16813069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:16.723 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:13:16 smithi012 podman[175527]: 2023-12-11T20:13:16.723 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:13:16 smithi012 bash[175527]: 9383ad220e426047c356d5e969a71da9cf68bc39388b5fd1ed7b19425e8beb44 2023-12-11T20:13:16.723 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:13:16 smithi012 ceph-mds[175567]: -- 172.21.15.12:0/1934862295 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5568450cf520 con 0x5568450a6800 2023-12-11T20:13:16.723 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:13:16 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-j[175543]: starting mds.j at 2023-12-11T20:13:17.080 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:13:16 smithi012 systemd[1]: Started Ceph mds.j for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:18.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:18.077 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.077 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.077 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.078 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:18.078 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:18.078 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:18.078 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: Deploying daemon mds.d on smithi012 2023-12-11T20:13:18.078 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:18.078 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.12:6834/1084131113,v1:172.21.15.12:6835/1084131113] up:boot 2023-12-11T20:13:18.078 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: fsmap 3 up:standby 2023-12-11T20:13:18.078 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: Deploying daemon mds.d on smithi012 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.12:6834/1084131113,v1:172.21.15.12:6835/1084131113] up:boot 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: fsmap 3 up:standby 2023-12-11T20:13:18.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-11T20:13:18.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 -- 172.21.15.12:0/2762600749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb580102690 msgr2=0x7fb580102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:18.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 --2- 172.21.15.12:0/2762600749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb580102690 0x7fb580102af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb5680099c0 tx=0x7fb568009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 -- 172.21.15.12:0/2762600749 shutdown_connections 2023-12-11T20:13:18.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 --2- 172.21.15.12:0/2762600749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5801014a0 0x7fb5801018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 --2- 172.21.15.12:0/2762600749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb580103030 0x7fb5801098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 --2- 172.21.15.12:0/2762600749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb580102690 0x7fb580102af0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 -- 172.21.15.12:0/2762600749 >> 172.21.15.12:0/2762600749 conn(0x7fb5800fca10 msgr2=0x7fb5800fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:18.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 -- 172.21.15.12:0/2762600749 shutdown_connections 2023-12-11T20:13:18.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.262+0000 7fb584dff700 1 -- 172.21.15.12:0/2762600749 wait complete. 2023-12-11T20:13:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.263+0000 7fb584dff700 1 Processor -- start 2023-12-11T20:13:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.263+0000 7fb584dff700 1 -- start start 2023-12-11T20:13:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb584dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5801014a0 0x7fb5801972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb584dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb580102690 0x7fb5801977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:18.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb584dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb580103030 0x7fb58019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb584dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58019edd0 con 0x7fb5801014a0 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb584dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58019ef10 con 0x7fb580103030 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb584dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58019f0a0 con 0x7fb580102690 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5801014a0 0x7fb5801972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5801014a0 0x7fb5801972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55266/0 (socket says 172.21.15.12:55266) 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57e59c700 1 -- 172.21.15.12:0/1669817039 learned_addr learned my addr 172.21.15.12:0/1669817039 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57dd9b700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb580102690 0x7fb5801977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57e59c700 1 -- 172.21.15.12:0/1669817039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb580102690 msgr2=0x7fb5801977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57e59c700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb580102690 0x7fb5801977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57e59c700 1 -- 172.21.15.12:0/1669817039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb580103030 msgr2=0x7fb58019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57e59c700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb580103030 0x7fb58019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57e59c700 1 -- 172.21.15.12:0/1669817039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680095f0 con 0x7fb5801014a0 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.264+0000 7fb57dd9b700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb580102690 0x7fb5801977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.265+0000 7fb57e59c700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5801014a0 0x7fb5801972a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c990 tx=0x7fb57000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:18.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.265+0000 7fb5777fe700 1 -- 172.21.15.12:0/1669817039 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570007b00 con 0x7fb5801014a0 2023-12-11T20:13:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.265+0000 7fb5777fe700 1 -- 172.21.15.12:0/1669817039 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb570007c60 con 0x7fb5801014a0 2023-12-11T20:13:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.265+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58019f380 con 0x7fb5801014a0 2023-12-11T20:13:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.265+0000 7fb5777fe700 1 -- 172.21.15.12:0/1669817039 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570018660 con 0x7fb5801014a0 2023-12-11T20:13:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.265+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58019f8e0 con 0x7fb5801014a0 2023-12-11T20:13:18.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.266+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5801088d0 con 0x7fb5801014a0 2023-12-11T20:13:18.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.269+0000 7fb5777fe700 1 -- 172.21.15.12:0/1669817039 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb570004020 con 0x7fb5801014a0 2023-12-11T20:13:18.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.270+0000 7fb5777fe700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb56c0a1500 0x7fb56c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:18.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.270+0000 7fb5777fe700 1 -- 172.21.15.12:0/1669817039 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb5700cca00 con 0x7fb5801014a0 2023-12-11T20:13:18.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.270+0000 7fb57dd9b700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb56c0a1500 0x7fb56c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:18.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.271+0000 7fb57dd9b700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb56c0a1500 0x7fb56c0a39c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb568006010 tx=0x7fb568005c00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:18.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.272+0000 7fb5777fe700 1 -- 172.21.15.12:0/1669817039 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb570096570 con 0x7fb5801014a0 2023-12-11T20:13:18.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:18.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:18.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:18.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:18.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: Deploying daemon mds.d on smithi012 2023-12-11T20:13:18.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:18.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.12:6834/1084131113,v1:172.21.15.12:6835/1084131113] up:boot 2023-12-11T20:13:18.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: fsmap 3 up:standby 2023-12-11T20:13:18.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-11T20:13:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.557+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb580068330 con 0x7fb5801014a0 2023-12-11T20:13:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.557+0000 7fb5777fe700 1 -- 172.21.15.12:0/1669817039 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7fb570099b90 con 0x7fb5801014a0 2023-12-11T20:13:18.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-11T20:13:18.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb56c0a1500 msgr2=0x7fb56c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:18.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb56c0a1500 0x7fb56c0a39c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb568006010 tx=0x7fb568005c00 comp rx=0 tx=0).stop 2023-12-11T20:13:18.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5801014a0 msgr2=0x7fb5801972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:18.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5801014a0 0x7fb5801972a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c990 tx=0x7fb57000cd50 comp rx=0 tx=0).stop 2023-12-11T20:13:18.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 shutdown_connections 2023-12-11T20:13:18.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb56c0a1500 0x7fb56c0a39c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb580103030 0x7fb58019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5801014a0 0x7fb5801972a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 --2- 172.21.15.12:0/1669817039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb580102690 0x7fb5801977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:18.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 >> 172.21.15.12:0/1669817039 conn(0x7fb5800fca10 msgr2=0x7fb580105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:18.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 shutdown_connections 2023-12-11T20:13:18.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:18.560+0000 7fb584dff700 1 -- 172.21.15.12:0/1669817039 wait complete. 2023-12-11T20:13:18.560 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 4 2023-12-11T20:13:19.335 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:19 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1669817039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:19.335 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:19 smithi012 ceph-mon[128787]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:19.335 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:13:19 smithi012 systemd[1]: Starting Ceph mds.d for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:19 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1669817039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:19 smithi039 ceph-mon[102205]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:19 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1669817039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:19 smithi032 ceph-mon[132488]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:19.799 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:13:19 smithi012 podman[175910]: 2023-12-11T20:13:19.799 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:13:19 smithi012 bash[175910]: 2803d19e5653ef08f2fe0a1eeb7aeabad44b89933c337f4661572f4a0d21c7b8 2023-12-11T20:13:19.799 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:13:19 smithi012 ceph-mds[175950]: -- 172.21.15.12:0/3514659018 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55727ffe5520 con 0x55727ffbcc00 2023-12-11T20:13:19.799 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:13:19 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-d[175926]: starting mds.d at 2023-12-11T20:13:20.080 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:13:19 smithi012 systemd[1]: Started Ceph mds.d for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:20.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:20.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 -- 172.21.15.12:0/3962870523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f0103030 msgr2=0x7ff4f01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:20.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/3962870523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f0103030 0x7ff4f01098e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800b0d0 tx=0x7ff4e800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:13:20.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 -- 172.21.15.12:0/3962870523 shutdown_connections 2023-12-11T20:13:20.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/3962870523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f0103030 0x7ff4f01098e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/3962870523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f01014a0 0x7ff4f01018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/3962870523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4f0102690 0x7ff4f0102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 -- 172.21.15.12:0/3962870523 >> 172.21.15.12:0/3962870523 conn(0x7ff4f00fca10 msgr2=0x7ff4f00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 -- 172.21.15.12:0/3962870523 shutdown_connections 2023-12-11T20:13:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.802+0000 7ff4f83ff700 1 -- 172.21.15.12:0/3962870523 wait complete. 2023-12-11T20:13:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.803+0000 7ff4f83ff700 1 Processor -- start 2023-12-11T20:13:20.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f83ff700 1 -- start start 2023-12-11T20:13:20.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f83ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f01014a0 0x7ff4f0197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:20.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f83ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f0102690 0x7ff4f0197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f83ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4f0103030 0x7ff4f019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f83ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f019ef30 con 0x7ff4f01014a0 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f83ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f019f070 con 0x7ff4f0103030 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f83ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f019f200 con 0x7ff4f0102690 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f01014a0 0x7ff4f0197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f01014a0 0x7ff4f0197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35266/0 (socket says 172.21.15.12:35266) 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.804+0000 7ff4f619b700 1 -- 172.21.15.12:0/652345952 learned_addr learned my addr 172.21.15.12:0/652345952 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f699c700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4f0103030 0x7ff4f019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f599a700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f0102690 0x7ff4f0197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f619b700 1 -- 172.21.15.12:0/652345952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f0102690 msgr2=0x7ff4f0197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f619b700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f0102690 0x7ff4f0197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f619b700 1 -- 172.21.15.12:0/652345952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4f0103030 msgr2=0x7ff4f019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f619b700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4f0103030 0x7ff4f019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:20.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f619b700 1 -- 172.21.15.12:0/652345952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8009d00 con 0x7ff4f01014a0 2023-12-11T20:13:20.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f599a700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f0102690 0x7ff4f0197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:20.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f619b700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f01014a0 0x7ff4f0197400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00e970 tx=0x7ff4ec00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:20.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4e77fe700 1 -- 172.21.15.12:0/652345952 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec009790 con 0x7ff4f01014a0 2023-12-11T20:13:20.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4e77fe700 1 -- 172.21.15.12:0/652345952 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4ec00eec0 con 0x7ff4f01014a0 2023-12-11T20:13:20.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f019f4e0 con 0x7ff4f01014a0 2023-12-11T20:13:20.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4e77fe700 1 -- 172.21.15.12:0/652345952 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec003c10 con 0x7ff4f01014a0 2023-12-11T20:13:20.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.805+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f019f9f0 con 0x7ff4f01014a0 2023-12-11T20:13:20.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.806+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f01088f0 con 0x7ff4f01014a0 2023-12-11T20:13:20.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.808+0000 7ff4e77fe700 1 -- 172.21.15.12:0/652345952 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff4ec003d90 con 0x7ff4f01014a0 2023-12-11T20:13:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.810+0000 7ff4e77fe700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4dc0a1480 0x7ff4dc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.810+0000 7ff4e77fe700 1 -- 172.21.15.12:0/652345952 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff4ec014070 con 0x7ff4f01014a0 2023-12-11T20:13:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.810+0000 7ff4f599a700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4dc0a1480 0x7ff4dc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.810+0000 7ff4f599a700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4dc0a1480 0x7ff4dc0a3940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000bc10 tx=0x7ff4e000b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:20.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:20.811+0000 7ff4e77fe700 1 -- 172.21.15.12:0/652345952 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff4ec096760 con 0x7ff4f01014a0 2023-12-11T20:13:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.073+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4f0068330 con 0x7ff4f01014a0 2023-12-11T20:13:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.073+0000 7ff4e77fe700 1 -- 172.21.15.12:0/652345952 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3698 (secure 0 0 0) 0x7ff4ec099d80 con 0x7ff4f01014a0 2023-12-11T20:13:21.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:21.072 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-11T20:13:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4dc0a1480 msgr2=0x7ff4dc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4dc0a1480 0x7ff4dc0a3940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000bc10 tx=0x7ff4e000b5f0 comp rx=0 tx=0).stop 2023-12-11T20:13:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f01014a0 msgr2=0x7ff4f0197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f01014a0 0x7ff4f0197400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00e970 tx=0x7ff4ec00ec80 comp rx=0 tx=0).stop 2023-12-11T20:13:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 shutdown_connections 2023-12-11T20:13:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4dc0a1480 0x7ff4dc0a3940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4f0103030 0x7ff4f019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f01014a0 0x7ff4f0197400 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 --2- 172.21.15.12:0/652345952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f0102690 0x7ff4f0197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 >> 172.21.15.12:0/652345952 conn(0x7ff4f00fca10 msgr2=0x7ff4f0105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 shutdown_connections 2023-12-11T20:13:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:21.076+0000 7ff4f83ff700 1 -- 172.21.15.12:0/652345952 wait complete. 2023-12-11T20:13:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 5 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: Deploying daemon mds.e on smithi032 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.12:6836/1410309441,v1:172.21.15.12:6837/1410309441] up:boot 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: fsmap 4 up:standby 2023-12-11T20:13:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-11T20:13:21.166 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.166 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.166 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.166 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:21.166 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:21.166 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:21.166 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: Deploying daemon mds.e on smithi032 2023-12-11T20:13:21.166 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.12:6836/1410309441,v1:172.21.15.12:6837/1410309441] up:boot 2023-12-11T20:13:21.167 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: fsmap 4 up:standby 2023-12-11T20:13:21.167 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: Deploying daemon mds.e on smithi032 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.12:6836/1410309441,v1:172.21.15.12:6837/1410309441] up:boot 2023-12-11T20:13:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: fsmap 4 up:standby 2023-12-11T20:13:21.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-11T20:13:22.119 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:21 smithi032 ceph-mon[132488]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:22.119 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:21 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/652345952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:21 smithi039 ceph-mon[102205]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:21 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/652345952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:21 smithi012 ceph-mon[128787]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:21 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/652345952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:22.463 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:13:22 smithi032 systemd[1]: Starting Ceph mds.e for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:22.880 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:13:22 smithi032 podman[168422]: 2023-12-11T20:13:23.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:23.213 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:13:22 smithi032 bash[168422]: b11aa64768fd9a78ed1e07c96a18116d18706a7b9b0a07d63a20087fa2937492 2023-12-11T20:13:23.213 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:13:22 smithi032 ceph-mds[168462]: -- 172.21.15.32:0/288460928 <== mon.2 v2:172.21.15.32:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555ab131b520 con 0x555ab12f3000 2023-12-11T20:13:23.213 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:13:22 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-e[168438]: starting mds.e at 2023-12-11T20:13:23.213 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:13:22 smithi032 systemd[1]: Started Ceph mds.e for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 -- 172.21.15.12:0/30745820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0103030 msgr2=0x7f56e01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 --2- 172.21.15.12:0/30745820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0103030 0x7f56e01098e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f56d800b0d0 tx=0x7f56d800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 -- 172.21.15.12:0/30745820 shutdown_connections 2023-12-11T20:13:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 --2- 172.21.15.12:0/30745820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56e01014a0 0x7f56e01018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 --2- 172.21.15.12:0/30745820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0103030 0x7f56e01098e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 --2- 172.21.15.12:0/30745820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56e0102690 0x7f56e0102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 -- 172.21.15.12:0/30745820 >> 172.21.15.12:0/30745820 conn(0x7f56e00fca10 msgr2=0x7f56e00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 -- 172.21.15.12:0/30745820 shutdown_connections 2023-12-11T20:13:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.310+0000 7f56e51ff700 1 -- 172.21.15.12:0/30745820 wait complete. 2023-12-11T20:13:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.311+0000 7f56e51ff700 1 Processor -- start 2023-12-11T20:13:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56e51ff700 1 -- start start 2023-12-11T20:13:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56e51ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56e01014a0 0x7f56e0197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56e51ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102690 0x7f56e0197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56e51ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56e0103030 0x7f56e019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56e51ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e019ef30 con 0x7f56e0102690 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56e51ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e019f070 con 0x7f56e0103030 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56e51ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e019f200 con 0x7f56e01014a0 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56ded9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56e01014a0 0x7f56e0197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56de59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102690 0x7f56e0197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56ded9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56e01014a0 0x7f56e0197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48988/0 (socket says 172.21.15.12:48988) 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56ded9d700 1 -- 172.21.15.12:0/3840702965 learned_addr learned my addr 172.21.15.12:0/3840702965 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.312+0000 7f56df59e700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56e0103030 0x7f56e019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56ded9d700 1 -- 172.21.15.12:0/3840702965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56e0103030 msgr2=0x7f56e019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56ded9d700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56e0103030 0x7f56e019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56ded9d700 1 -- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102690 msgr2=0x7f56e0197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56ded9d700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102690 0x7f56e0197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56ded9d700 1 -- 172.21.15.12:0/3840702965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8009d00 con 0x7f56e01014a0 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56df59e700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56e0103030 0x7f56e019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56de59c700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102690 0x7f56e0197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56ded9d700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56e01014a0 0x7f56e0197400 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56d000e970 tx=0x7f56d000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56c7fff700 1 -- 172.21.15.12:0/3840702965 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0009790 con 0x7f56e01014a0 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e019f4e0 con 0x7f56e01014a0 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56c7fff700 1 -- 172.21.15.12:0/3840702965 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56d000c7e0 con 0x7f56e01014a0 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56c7fff700 1 -- 172.21.15.12:0/3840702965 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0003bd0 con 0x7f56e01014a0 2023-12-11T20:13:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.313+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e019f9f0 con 0x7f56e01014a0 2023-12-11T20:13:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.314+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e01088f0 con 0x7f56e01014a0 2023-12-11T20:13:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.316+0000 7f56c7fff700 1 -- 172.21.15.12:0/3840702965 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f56d000c950 con 0x7f56e01014a0 2023-12-11T20:13:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.318+0000 7f56c7fff700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56c80a1480 0x7f56c80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.318+0000 7f56c7fff700 1 -- 172.21.15.12:0/3840702965 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f56d0014070 con 0x7f56e01014a0 2023-12-11T20:13:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.318+0000 7f56de59c700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56c80a1480 0x7f56c80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.318+0000 7f56de59c700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56c80a1480 0x7f56c80a3940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56d4011490 tx=0x7f56d4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:23.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.325+0000 7f56c7fff700 1 -- 172.21.15.12:0/3840702965 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f56d0096910 con 0x7f56e01014a0 2023-12-11T20:13:23.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.585+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56e0068330 con 0x7f56e01014a0 2023-12-11T20:13:23.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.586+0000 7f56c7fff700 1 -- 172.21.15.12:0/3840702965 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f56d0099f30 con 0x7f56e01014a0 2023-12-11T20:13:23.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:23.585 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-12-11T20:13:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.588+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56c80a1480 msgr2=0x7f56c80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.588+0000 7f56e51ff700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56c80a1480 0x7f56c80a3940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56d4011490 tx=0x7f56d4009260 comp rx=0 tx=0).stop 2023-12-11T20:13:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.588+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56e01014a0 msgr2=0x7f56e0197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.588+0000 7f56e51ff700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56e01014a0 0x7f56e0197400 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56d000e970 tx=0x7f56d000ec80 comp rx=0 tx=0).stop 2023-12-11T20:13:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.589+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 shutdown_connections 2023-12-11T20:13:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.589+0000 7f56e51ff700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56c80a1480 0x7f56c80a3940 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.589+0000 7f56e51ff700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56e0103030 0x7f56e019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.589+0000 7f56e51ff700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56e01014a0 0x7f56e0197400 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.589+0000 7f56e51ff700 1 --2- 172.21.15.12:0/3840702965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102690 0x7f56e0197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.589+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 >> 172.21.15.12:0/3840702965 conn(0x7f56e00fca10 msgr2=0x7f56e0105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.589+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 shutdown_connections 2023-12-11T20:13:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:23.589+0000 7f56e51ff700 1 -- 172.21.15.12:0/3840702965 wait complete. 2023-12-11T20:13:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 6 2023-12-11T20:13:24.207 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.32:6834/1999108930,v1:172.21.15.32:6835/1999108930] up:boot 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: fsmap 5 up:standby 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: Deploying daemon mds.f on smithi039 2023-12-11T20:13:24.208 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:23 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3840702965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.32:6834/1999108930,v1:172.21.15.32:6835/1999108930] up:boot 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: fsmap 5 up:standby 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: Deploying daemon mds.f on smithi039 2023-12-11T20:13:24.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:23 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3840702965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.32:6834/1999108930,v1:172.21.15.32:6835/1999108930] up:boot 2023-12-11T20:13:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: fsmap 5 up:standby 2023-12-11T20:13:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-11T20:13:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: Deploying daemon mds.f on smithi039 2023-12-11T20:13:24.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:23 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3840702965' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:25.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:25.802 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:13:25 smithi039 systemd[1]: Starting Ceph mds.f for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.824+0000 7f75481ff700 1 -- 172.21.15.12:0/3560677091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 msgr2=0x7f754010b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.824+0000 7f75481ff700 1 --2- 172.21.15.12:0/3560677091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 0x7f754010b800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f753800b0a0 tx=0x7f753800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.824+0000 7f75481ff700 1 -- 172.21.15.12:0/3560677091 shutdown_connections 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.824+0000 7f75481ff700 1 --2- 172.21.15.12:0/3560677091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 0x7f754010b800 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.824+0000 7f75481ff700 1 --2- 172.21.15.12:0/3560677091 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7540075610 0x7f7540073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.824+0000 7f75481ff700 1 --2- 172.21.15.12:0/3560677091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7540074030 0x7f75400744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.824+0000 7f75481ff700 1 -- 172.21.15.12:0/3560677091 >> 172.21.15.12:0/3560677091 conn(0x7f75400fca40 msgr2=0x7f75400fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.824+0000 7f75481ff700 1 -- 172.21.15.12:0/3560677091 shutdown_connections 2023-12-11T20:13:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.825+0000 7f75481ff700 1 -- 172.21.15.12:0/3560677091 wait complete. 2023-12-11T20:13:25.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.825+0000 7f75481ff700 1 Processor -- start 2023-12-11T20:13:25.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f75481ff700 1 -- start start 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f75481ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7540074030 0x7f7540199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f75481ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7540075610 0x7f7540199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f75481ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 0x7f75401a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f75481ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75401a1160 con 0x7f7540109370 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f75481ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75401a12a0 con 0x7f7540074030 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f75481ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75401a1430 con 0x7f7540075610 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f754679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 0x7f75401a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f754679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 0x7f75401a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35314/0 (socket says 172.21.15.12:35314) 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f754679c700 1 -- 172.21.15.12:0/3291418275 learned_addr learned my addr 172.21.15.12:0/3291418275 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.826+0000 7f754579a700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7540075610 0x7f7540199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f7545f9b700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7540074030 0x7f7540199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:25.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f754679c700 1 -- 172.21.15.12:0/3291418275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7540075610 msgr2=0x7f7540199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f754679c700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7540075610 0x7f7540199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f754679c700 1 -- 172.21.15.12:0/3291418275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7540074030 msgr2=0x7f7540199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f754679c700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7540074030 0x7f7540199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f754679c700 1 -- 172.21.15.12:0/3291418275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538009d00 con 0x7f7540109370 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f7545f9b700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7540074030 0x7f7540199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f754679c700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 0x7f75401a0b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f753800b780 tx=0x7f753800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f7536ffd700 1 -- 172.21.15.12:0/3291418275 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800e040 con 0x7f7540109370 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f7536ffd700 1 -- 172.21.15.12:0/3291418275 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7538003c00 con 0x7f7540109370 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75401a16b0 con 0x7f7540109370 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f7536ffd700 1 -- 172.21.15.12:0/3291418275 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75380052a0 con 0x7f7540109370 2023-12-11T20:13:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.827+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75401a1ad0 con 0x7f7540109370 2023-12-11T20:13:25.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.828+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7540108130 con 0x7f7540109370 2023-12-11T20:13:25.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.830+0000 7f7536ffd700 1 -- 172.21.15.12:0/3291418275 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7538005400 con 0x7f7540109370 2023-12-11T20:13:25.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.831+0000 7f7536ffd700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f752c0a1480 0x7f752c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:25.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.832+0000 7f7536ffd700 1 -- 172.21.15.12:0/3291418275 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f75380cd940 con 0x7f7540109370 2023-12-11T20:13:25.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.832+0000 7f7545f9b700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f752c0a1480 0x7f752c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:25.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.832+0000 7f7545f9b700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f752c0a1480 0x7f752c0a3940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f753c009be0 tx=0x7f753c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:25.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:25.836+0000 7f7536ffd700 1 -- 172.21.15.12:0/3291418275 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7538097430 con 0x7f7540109370 2023-12-11T20:13:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.096+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f754010ed50 con 0x7f7540109370 2023-12-11T20:13:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.097+0000 7f7536ffd700 1 -- 172.21.15.12:0/3291418275 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f753809aa50 con 0x7f7540109370 2023-12-11T20:13:26.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:26.095 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-12-11T20:13:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f752c0a1480 msgr2=0x7f752c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f752c0a1480 0x7f752c0a3940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f753c009be0 tx=0x7f753c009260 comp rx=0 tx=0).stop 2023-12-11T20:13:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 msgr2=0x7f75401a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 0x7f75401a0b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f753800b780 tx=0x7f753800bab0 comp rx=0 tx=0).stop 2023-12-11T20:13:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 shutdown_connections 2023-12-11T20:13:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f752c0a1480 0x7f752c0a3940 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7540074030 0x7f7540199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7540109370 0x7f75401a0b90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 --2- 172.21.15.12:0/3291418275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7540075610 0x7f7540199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 >> 172.21.15.12:0/3291418275 conn(0x7f75400fca40 msgr2=0x7f7540105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 shutdown_connections 2023-12-11T20:13:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:26.100+0000 7f75481ff700 1 -- 172.21.15.12:0/3291418275 wait complete. 2023-12-11T20:13:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 6 2023-12-11T20:13:26.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:26 smithi039 ceph-mon[102205]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:26.302 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:13:26 smithi039 podman[139366]: 2023-12-11T20:13:26.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:26 smithi012 ceph-mon[128787]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:26.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:26 smithi032 ceph-mon[132488]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:26.801 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:13:26 smithi039 bash[139366]: 9821f6d7045d7d0b685f4b19f2dff08913cf39cb8737d8f7f291462bac9db513 2023-12-11T20:13:26.802 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:13:26 smithi039 ceph-mds[139406]: -- 172.21.15.39:0/3165526425 <== mon.1 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ead09bd520 con 0x55ead0995000 2023-12-11T20:13:26.802 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:13:26 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-f[139382]: starting mds.f at 2023-12-11T20:13:26.802 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:13:26 smithi039 systemd[1]: Started Ceph mds.f for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:27 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3291418275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:27 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3291418275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:27 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3291418275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:28.118 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:28.223 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:28 smithi039 ceph-mon[102205]: Deploying daemon mds.c on smithi039 2023-12-11T20:13:28.223 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:28 smithi039 ceph-mon[102205]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:28.223 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:28 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.39:6834/2029236451,v1:172.21.15.39:6835/2029236451] up:boot 2023-12-11T20:13:28.223 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:28 smithi039 ceph-mon[102205]: fsmap 6 up:standby 2023-12-11T20:13:28.223 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:28 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-11T20:13:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.336+0000 7fabdcfff700 1 -- 172.21.15.12:0/3804703207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8109360 msgr2=0x7fabd810b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.336+0000 7fabdcfff700 1 --2- 172.21.15.12:0/3804703207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8109360 0x7fabd810b7f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009f90 tx=0x7fabd000b330 comp rx=0 tx=0).stop 2023-12-11T20:13:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.337+0000 7fabdcfff700 1 -- 172.21.15.12:0/3804703207 shutdown_connections 2023-12-11T20:13:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.337+0000 7fabdcfff700 1 --2- 172.21.15.12:0/3804703207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabd8075610 0x7fabd8073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.337+0000 7fabdcfff700 1 --2- 172.21.15.12:0/3804703207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8109360 0x7fabd810b7f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.337+0000 7fabdcfff700 1 --2- 172.21.15.12:0/3804703207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd8074030 0x7fabd80744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.337+0000 7fabdcfff700 1 -- 172.21.15.12:0/3804703207 >> 172.21.15.12:0/3804703207 conn(0x7fabd80fca10 msgr2=0x7fabd80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.337+0000 7fabdcfff700 1 -- 172.21.15.12:0/3804703207 shutdown_connections 2023-12-11T20:13:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.337+0000 7fabdcfff700 1 -- 172.21.15.12:0/3804703207 wait complete. 2023-12-11T20:13:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.338+0000 7fabdcfff700 1 Processor -- start 2023-12-11T20:13:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.338+0000 7fabdcfff700 1 -- start start 2023-12-11T20:13:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.338+0000 7fabdcfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8074030 0x7fabd8199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.338+0000 7fabdcfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabd8075610 0x7fabd8199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.338+0000 7fabdcfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd8109360 0x7fabd81a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.338+0000 7fabdcfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81a1150 con 0x7fabd8109360 2023-12-11T20:13:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.338+0000 7fabdcfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81a1290 con 0x7fabd8075610 2023-12-11T20:13:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.338+0000 7fabdcfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81a1420 con 0x7fabd8074030 2023-12-11T20:13:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8074030 0x7fabd8199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd8109360 0x7fabd81a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8074030 0x7fabd8199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49012/0 (socket says 172.21.15.12:49012) 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd659c700 1 -- 172.21.15.12:0/361440617 learned_addr learned my addr 172.21.15.12:0/361440617 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd5d9b700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabd8075610 0x7fabd8199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd6d9d700 1 -- 172.21.15.12:0/361440617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8074030 msgr2=0x7fabd8199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd6d9d700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8074030 0x7fabd8199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd6d9d700 1 -- 172.21.15.12:0/361440617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabd8075610 msgr2=0x7fabd8199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd6d9d700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabd8075610 0x7fabd8199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd6d9d700 1 -- 172.21.15.12:0/361440617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0009c40 con 0x7fabd8109360 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabd6d9d700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd8109360 0x7fabd81a0b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fabd000b6c0 tx=0x7fabd0008d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabc77fe700 1 -- 172.21.15.12:0/361440617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000e040 con 0x7fabd8109360 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.339+0000 7fabc77fe700 1 -- 172.21.15.12:0/361440617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabd000bc00 con 0x7fabd8109360 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.340+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd81a16a0 con 0x7fabd8109360 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.340+0000 7fabc77fe700 1 -- 172.21.15.12:0/361440617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0005040 con 0x7fabd8109360 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.340+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd81a1b70 con 0x7fabd8109360 2023-12-11T20:13:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.341+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd8108120 con 0x7fabd8109360 2023-12-11T20:13:28.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.343+0000 7fabc77fe700 1 -- 172.21.15.12:0/361440617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fabd001d470 con 0x7fabd8109360 2023-12-11T20:13:28.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.344+0000 7fabc77fe700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fabc00a1500 0x7fabc00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:28.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.344+0000 7fabc77fe700 1 -- 172.21.15.12:0/361440617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fabd00ce0f0 con 0x7fabd8109360 2023-12-11T20:13:28.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.344+0000 7fabd659c700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fabc00a1500 0x7fabc00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:28.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.345+0000 7fabd659c700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fabc00a1500 0x7fabc00a39c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009d20 tx=0x7fabc8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.346+0000 7fabc77fe700 1 -- 172.21.15.12:0/361440617 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fabd0097d00 con 0x7fabd8109360 2023-12-11T20:13:28.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:28 smithi032 ceph-mon[132488]: Deploying daemon mds.c on smithi039 2023-12-11T20:13:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:28 smithi032 ceph-mon[132488]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:28 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.39:6834/2029236451,v1:172.21.15.39:6835/2029236451] up:boot 2023-12-11T20:13:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:28 smithi032 ceph-mon[132488]: fsmap 6 up:standby 2023-12-11T20:13:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:28 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-11T20:13:28.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:28 smithi012 ceph-mon[128787]: Deploying daemon mds.c on smithi039 2023-12-11T20:13:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:28 smithi012 ceph-mon[128787]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:28 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.39:6834/2029236451,v1:172.21.15.39:6835/2029236451] up:boot 2023-12-11T20:13:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:28 smithi012 ceph-mon[128787]: fsmap 6 up:standby 2023-12-11T20:13:28.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:28 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-11T20:13:28.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.609+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabd8068330 con 0x7fabd8109360 2023-12-11T20:13:28.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.610+0000 7fabc77fe700 1 -- 172.21.15.12:0/361440617 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5280 (secure 0 0 0) 0x7fabd009b320 con 0x7fabd8109360 2023-12-11T20:13:28.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:28.608 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-12-11T20:13:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fabc00a1500 msgr2=0x7fabc00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fabc00a1500 0x7fabc00a39c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009d20 tx=0x7fabc8009260 comp rx=0 tx=0).stop 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd8109360 msgr2=0x7fabd81a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd8109360 0x7fabd81a0b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fabd000b6c0 tx=0x7fabd0008d00 comp rx=0 tx=0).stop 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 shutdown_connections 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fabc00a1500 0x7fabc00a39c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd8109360 0x7fabd81a0b80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabd8074030 0x7fabd8199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 --2- 172.21.15.12:0/361440617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabd8075610 0x7fabd8199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.612+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 >> 172.21.15.12:0/361440617 conn(0x7fabd80fca10 msgr2=0x7fabd8105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.613+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 shutdown_connections 2023-12-11T20:13:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:28.613+0000 7fabdcfff700 1 -- 172.21.15.12:0/361440617 wait complete. 2023-12-11T20:13:28.612 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-12-11T20:13:29.251 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:13:28 smithi039 systemd[1]: Starting Ceph mds.c for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:29.551 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:13:29 smithi039 podman[139712]: 2023-12-11T20:13:29.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:29 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/361440617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:29.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:29 smithi039 ceph-mon[102205]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:29 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/361440617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:29 smithi012 ceph-mon[128787]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:29 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/361440617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:29 smithi032 ceph-mon[132488]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:30.052 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:13:29 smithi039 bash[139712]: 5a3499861c042f104247aba5b72bf9d4282210a238e8e260ba133ef6685b072b 2023-12-11T20:13:30.052 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:13:29 smithi039 ceph-mds[139752]: -- 172.21.15.39:0/1390319591 <== mon.1 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557829d35520 con 0x557829d0cc00 2023-12-11T20:13:30.052 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:13:29 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-c[139728]: starting mds.c at 2023-12-11T20:13:30.052 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:13:29 smithi039 systemd[1]: Started Ceph mds.c for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:30.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.846+0000 7f14869ff700 1 -- 172.21.15.12:0/900707969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480075610 msgr2=0x7f1480073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.846+0000 7f14869ff700 1 --2- 172.21.15.12:0/900707969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480075610 0x7f1480073a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1470009990 tx=0x7f1470009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.846+0000 7f14869ff700 1 -- 172.21.15.12:0/900707969 shutdown_connections 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.846+0000 7f14869ff700 1 --2- 172.21.15.12:0/900707969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1480109360 0x7f148010b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.846+0000 7f14869ff700 1 --2- 172.21.15.12:0/900707969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480075610 0x7f1480073a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.846+0000 7f14869ff700 1 --2- 172.21.15.12:0/900707969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1480074030 0x7f14800744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.846+0000 7f14869ff700 1 -- 172.21.15.12:0/900707969 >> 172.21.15.12:0/900707969 conn(0x7f14800fca10 msgr2=0x7f14800fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.847+0000 7f14869ff700 1 -- 172.21.15.12:0/900707969 shutdown_connections 2023-12-11T20:13:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.847+0000 7f14869ff700 1 -- 172.21.15.12:0/900707969 wait complete. 2023-12-11T20:13:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.847+0000 7f14869ff700 1 Processor -- start 2023-12-11T20:13:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f14869ff700 1 -- start start 2023-12-11T20:13:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f14869ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480074030 0x7f14801994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f14869ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1480075610 0x7f14801999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f14869ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1480109360 0x7f14801a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f14869ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14801a0fe0 con 0x7f1480074030 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f14869ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14801a1120 con 0x7f1480109360 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f14869ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14801a12b0 con 0x7f1480075610 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f147ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480074030 0x7f14801994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f1484f9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1480109360 0x7f14801a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f1484f9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1480109360 0x7f14801a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54976/0 (socket says 172.21.15.12:54976) 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f1484f9c700 1 -- 172.21.15.12:0/349293229 learned_addr learned my addr 172.21.15.12:0/349293229 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.848+0000 7f147f7fe700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1480075610 0x7f14801999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f1484f9c700 1 -- 172.21.15.12:0/349293229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1480075610 msgr2=0x7f14801999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f1484f9c700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1480075610 0x7f14801999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f1484f9c700 1 -- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480074030 msgr2=0x7f14801994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f1484f9c700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480074030 0x7f14801994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f1484f9c700 1 -- 172.21.15.12:0/349293229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700095f0 con 0x7f1480109360 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f147ffff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480074030 0x7f14801994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f1484f9c700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1480109360 0x7f14801a0a10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f147800ef30 tx=0x7f147800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f147d7fa700 1 -- 172.21.15.12:0/349293229 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478018070 con 0x7f1480109360 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14801a1530 con 0x7f1480109360 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f147d7fa700 1 -- 172.21.15.12:0/349293229 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f147800f040 con 0x7f1480109360 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f147d7fa700 1 -- 172.21.15.12:0/349293229 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147800cbc0 con 0x7f1480109360 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.849+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14801a1a40 con 0x7f1480109360 2023-12-11T20:13:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.850+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1480108120 con 0x7f1480109360 2023-12-11T20:13:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.852+0000 7f147d7fa700 1 -- 172.21.15.12:0/349293229 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1478003a00 con 0x7f1480109360 2023-12-11T20:13:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.853+0000 7f147d7fa700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14680a1480 0x7f14680a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.854+0000 7f147d7fa700 1 -- 172.21.15.12:0/349293229 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f14780cc430 con 0x7f1480109360 2023-12-11T20:13:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.854+0000 7f147ffff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14680a1480 0x7f14680a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.854+0000 7f147ffff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14680a1480 0x7f14680a3940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1470005910 tx=0x7f147000b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:30.856+0000 7f147d7fa700 1 -- 172.21.15.12:0/349293229 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1478095f20 con 0x7f1480109360 2023-12-11T20:13:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: Deploying daemon mds.h on smithi032 2023-12-11T20:13:31.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.39:6836/2148366648,v1:172.21.15.39:6837/2148366648] up:boot 2023-12-11T20:13:31.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: fsmap 7 up:standby 2023-12-11T20:13:31.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-11T20:13:31.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.116+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1480068330 con 0x7f1480109360 2023-12-11T20:13:31.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.117+0000 7f147d7fa700 1 -- 172.21.15.12:0/349293229 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6071 (secure 0 0 0) 0x7f1478099540 con 0x7f1480109360 2023-12-11T20:13:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:31.116 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-12-11T20:13:31.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14680a1480 msgr2=0x7f14680a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:31.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14680a1480 0x7f14680a3940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1470005910 tx=0x7f147000b610 comp rx=0 tx=0).stop 2023-12-11T20:13:31.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1480109360 msgr2=0x7f14801a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:31.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1480109360 0x7f14801a0a10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f147800ef30 tx=0x7f147800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:13:31.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 shutdown_connections 2023-12-11T20:13:31.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14680a1480 0x7f14680a3940 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:31.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1480109360 0x7f14801a0a10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:31.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1480074030 0x7f14801994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:31.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 --2- 172.21.15.12:0/349293229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1480075610 0x7f14801999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:31.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 >> 172.21.15.12:0/349293229 conn(0x7f14800fca10 msgr2=0x7f1480105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:31.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 shutdown_connections 2023-12-11T20:13:31.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:31.120+0000 7f14869ff700 1 -- 172.21.15.12:0/349293229 wait complete. 2023-12-11T20:13:31.119 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: Deploying daemon mds.h on smithi032 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.39:6836/2148366648,v1:172.21.15.39:6837/2148366648] up:boot 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: fsmap 7 up:standby 2023-12-11T20:13:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: Deploying daemon mds.h on smithi032 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.39:6836/2148366648,v1:172.21.15.39:6837/2148366648] up:boot 2023-12-11T20:13:31.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: fsmap 7 up:standby 2023-12-11T20:13:31.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-11T20:13:32.144 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:31 smithi032 ceph-mon[132488]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:32.144 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:31 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/349293229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:32.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:31 smithi039 ceph-mon[102205]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:32.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:31 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/349293229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:31 smithi012 ceph-mon[128787]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:31 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/349293229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:32.713 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:13:32 smithi032 systemd[1]: Starting Ceph mds.h for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:33.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:33.204 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:13:32 smithi032 podman[168763]: 2023-12-11T20:13:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 -- 172.21.15.12:0/2386948992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938074030 msgr2=0x7f69380744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 --2- 172.21.15.12:0/2386948992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938074030 0x7f69380744b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6928009990 tx=0x7f6928009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 -- 172.21.15.12:0/2386948992 shutdown_connections 2023-12-11T20:13:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 --2- 172.21.15.12:0/2386948992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6938075610 0x7f6938073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 --2- 172.21.15.12:0/2386948992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6938109360 0x7f693810b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 --2- 172.21.15.12:0/2386948992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938074030 0x7f69380744b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 -- 172.21.15.12:0/2386948992 >> 172.21.15.12:0/2386948992 conn(0x7f69380fca10 msgr2=0x7f69380fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:33.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 -- 172.21.15.12:0/2386948992 shutdown_connections 2023-12-11T20:13:33.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.355+0000 7f693fbff700 1 -- 172.21.15.12:0/2386948992 wait complete. 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.356+0000 7f693fbff700 1 Processor -- start 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.356+0000 7f693fbff700 1 -- start start 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.356+0000 7f693fbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6938074030 0x7f6938199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.356+0000 7f693fbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938075610 0x7f6938199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.356+0000 7f693fbff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6938109360 0x7f69381a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.356+0000 7f693fbff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69381a1090 con 0x7f6938075610 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.356+0000 7f693fbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69381a11d0 con 0x7f6938074030 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.356+0000 7f693fbff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69381a1360 con 0x7f6938109360 2023-12-11T20:13:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6938074030 0x7f6938199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6938074030 0x7f6938199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54994/0 (socket says 172.21.15.12:54994) 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 -- 172.21.15.12:0/4072603587 learned_addr learned my addr 172.21.15.12:0/4072603587 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d19a700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938075610 0x7f6938199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 -- 172.21.15.12:0/4072603587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6938109360 msgr2=0x7f69381a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6938109360 0x7f69381a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 -- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938075610 msgr2=0x7f6938199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938075610 0x7f6938199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 -- 172.21.15.12:0/4072603587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69280095f0 con 0x7f6938074030 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d19a700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938075610 0x7f6938199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693d99b700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6938074030 0x7f6938199560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f693400e9a0 tx=0x7f693400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f692effd700 1 -- 172.21.15.12:0/4072603587 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934009790 con 0x7f6938074030 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f692effd700 1 -- 172.21.15.12:0/4072603587 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f693400cbd0 con 0x7f6938074030 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.357+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69381a1640 con 0x7f6938074030 2023-12-11T20:13:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.358+0000 7f692effd700 1 -- 172.21.15.12:0/4072603587 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934018680 con 0x7f6938074030 2023-12-11T20:13:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.358+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69381a1b50 con 0x7f6938074030 2023-12-11T20:13:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.358+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6938108120 con 0x7f6938074030 2023-12-11T20:13:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.361+0000 7f692effd700 1 -- 172.21.15.12:0/4072603587 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f693400cd40 con 0x7f6938074030 2023-12-11T20:13:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.362+0000 7f692effd700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69240a1480 0x7f69240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.362+0000 7f692effd700 1 -- 172.21.15.12:0/4072603587 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6934014070 con 0x7f6938074030 2023-12-11T20:13:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.362+0000 7f693d19a700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69240a1480 0x7f69240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.363+0000 7f693d19a700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69240a1480 0x7f69240a3940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6928006010 tx=0x7f692800b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.364+0000 7f692effd700 1 -- 172.21.15.12:0/4072603587 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f69340969c0 con 0x7f6938074030 2023-12-11T20:13:33.463 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:13:33 smithi032 bash[168763]: f98334d9c5ea5eaf2ed7ab9b0c2b4856aa20062d6ad81b6886a3163509258b13 2023-12-11T20:13:33.463 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:13:33 smithi032 ceph-mds[168803]: -- 172.21.15.32:0/4063302796 <== mon.2 v2:172.21.15.32:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5619754f1520 con 0x5619754c8c00 2023-12-11T20:13:33.463 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:13:33 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-h[168779]: starting mds.h at 2023-12-11T20:13:33.463 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:13:33 smithi032 systemd[1]: Started Ceph mds.h for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.626+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f693810ed90 con 0x7f6938074030 2023-12-11T20:13:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.627+0000 7f692effd700 1 -- 172.21.15.12:0/4072603587 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6071 (secure 0 0 0) 0x7f6934099fe0 con 0x7f6938074030 2023-12-11T20:13:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:33.625 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-12-11T20:13:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69240a1480 msgr2=0x7f69240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69240a1480 0x7f69240a3940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6928006010 tx=0x7f692800b610 comp rx=0 tx=0).stop 2023-12-11T20:13:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6938074030 msgr2=0x7f6938199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6938074030 0x7f6938199560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f693400e9a0 tx=0x7f693400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 shutdown_connections 2023-12-11T20:13:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69240a1480 0x7f69240a3940 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6938074030 0x7f6938199560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6938109360 0x7f69381a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 --2- 172.21.15.12:0/4072603587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6938075610 0x7f6938199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 >> 172.21.15.12:0/4072603587 conn(0x7f69380fca10 msgr2=0x7f6938105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 shutdown_connections 2023-12-11T20:13:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:33.629+0000 7f693fbff700 1 -- 172.21.15.12:0/4072603587 wait complete. 2023-12-11T20:13:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-12-11T20:13:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:34 smithi012 ceph-mon[128787]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:34.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:34 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4072603587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:34 smithi032 ceph-mon[132488]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:34 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4072603587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:34.543 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:34 smithi039 ceph-mon[102205]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:34.543 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.543 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.543 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:34.543 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:34.543 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:34.543 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:34.543 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:34 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4072603587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:35.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:35 smithi032 ceph-mon[132488]: Deploying daemon mds.i on smithi039 2023-12-11T20:13:35.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:35 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] up:boot 2023-12-11T20:13:35.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:35 smithi032 ceph-mon[132488]: fsmap 8 up:standby 2023-12-11T20:13:35.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:35 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-11T20:13:35.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:35 smithi039 ceph-mon[102205]: Deploying daemon mds.i on smithi039 2023-12-11T20:13:35.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:35 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] up:boot 2023-12-11T20:13:35.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:35 smithi039 ceph-mon[102205]: fsmap 8 up:standby 2023-12-11T20:13:35.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:35 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-11T20:13:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:35 smithi012 ceph-mon[128787]: Deploying daemon mds.i on smithi039 2023-12-11T20:13:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:35 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] up:boot 2023-12-11T20:13:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:35 smithi012 ceph-mon[128787]: fsmap 8 up:standby 2023-12-11T20:13:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:35 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-11T20:13:35.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 -- 172.21.15.12:0/102450682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c1014b0 msgr2=0x7f839c1018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 --2- 172.21.15.12:0/102450682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c1014b0 0x7f839c1018d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f83980099c0 tx=0x7f8398009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 -- 172.21.15.12:0/102450682 shutdown_connections 2023-12-11T20:13:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 --2- 172.21.15.12:0/102450682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f839c103040 0x7f839c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 --2- 172.21.15.12:0/102450682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c1014b0 0x7f839c1018d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 --2- 172.21.15.12:0/102450682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839c1026a0 0x7f839c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 -- 172.21.15.12:0/102450682 >> 172.21.15.12:0/102450682 conn(0x7f839c0fca40 msgr2=0x7f839c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 -- 172.21.15.12:0/102450682 shutdown_connections 2023-12-11T20:13:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.865+0000 7f83a3fff700 1 -- 172.21.15.12:0/102450682 wait complete. 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.866+0000 7f83a3fff700 1 Processor -- start 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.866+0000 7f83a3fff700 1 -- start start 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.866+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f839c1014b0 0x7f839c197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.866+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839c1026a0 0x7f839c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.866+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c103040 0x7f839c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.866+0000 7f83a3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c19ee90 con 0x7f839c103040 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.866+0000 7f83a3fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c19efd0 con 0x7f839c1026a0 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.866+0000 7f83a3fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c19f160 con 0x7f839c1014b0 2023-12-11T20:13:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f839c1014b0 0x7f839c197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f839c1014b0 0x7f839c197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60114/0 (socket says 172.21.15.12:60114) 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 -- 172.21.15.12:0/1725898864 learned_addr learned my addr 172.21.15.12:0/1725898864 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a259c700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c103040 0x7f839c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a159a700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839c1026a0 0x7f839c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 -- 172.21.15.12:0/1725898864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839c1026a0 msgr2=0x7f839c1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839c1026a0 0x7f839c1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 -- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c103040 msgr2=0x7f839c19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c103040 0x7f839c19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 -- 172.21.15.12:0/1725898864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980095f0 con 0x7f839c1014b0 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f83a1d9b700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f839c1014b0 0x7f839c197360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8398009990 tx=0x7f839800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.867+0000 7f8392ffd700 1 -- 172.21.15.12:0/1725898864 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839801d070 con 0x7f839c1014b0 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.868+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c19f3e0 con 0x7f839c1014b0 2023-12-11T20:13:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.868+0000 7f8392ffd700 1 -- 172.21.15.12:0/1725898864 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f839800bd10 con 0x7f839c1014b0 2023-12-11T20:13:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.868+0000 7f8392ffd700 1 -- 172.21.15.12:0/1725898864 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398017650 con 0x7f839c1014b0 2023-12-11T20:13:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.868+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c19f800 con 0x7f839c1014b0 2023-12-11T20:13:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.869+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c108970 con 0x7f839c1014b0 2023-12-11T20:13:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.871+0000 7f8392ffd700 1 -- 172.21.15.12:0/1725898864 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8398022470 con 0x7f839c1014b0 2023-12-11T20:13:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.872+0000 7f8392ffd700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83880a1480 0x7f83880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.872+0000 7f8392ffd700 1 -- 172.21.15.12:0/1725898864 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f83980cdff0 con 0x7f839c1014b0 2023-12-11T20:13:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.872+0000 7f83a159a700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83880a1480 0x7f83880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.873+0000 7f83a159a700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83880a1480 0x7f83880a3940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f838c007c60 tx=0x7f838c0073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:35.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:35.875+0000 7f8392ffd700 1 -- 172.21.15.12:0/1725898864 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8398097ae0 con 0x7f839c1014b0 2023-12-11T20:13:36.100 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:13:35 smithi039 systemd[1]: Starting Ceph mds.i for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.133+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f839c10ccd0 con 0x7f839c1014b0 2023-12-11T20:13:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.134+0000 7f8392ffd700 1 -- 172.21.15.12:0/1725898864 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6859 (secure 0 0 0) 0x7f839809b100 con 0x7f839c1014b0 2023-12-11T20:13:36.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:36.133 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-12-11T20:13:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83880a1480 msgr2=0x7f83880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83880a1480 0x7f83880a3940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f838c007c60 tx=0x7f838c0073d0 comp rx=0 tx=0).stop 2023-12-11T20:13:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f839c1014b0 msgr2=0x7f839c197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f839c1014b0 0x7f839c197360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8398009990 tx=0x7f839800fa00 comp rx=0 tx=0).stop 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 shutdown_connections 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83880a1480 0x7f83880a3940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f839c103040 0x7f839c19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f839c1014b0 0x7f839c197360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 --2- 172.21.15.12:0/1725898864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f839c1026a0 0x7f839c1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 >> 172.21.15.12:0/1725898864 conn(0x7f839c0fca40 msgr2=0x7f839c105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 shutdown_connections 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:36.137+0000 7f83a3fff700 1 -- 172.21.15.12:0/1725898864 wait complete. 2023-12-11T20:13:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-12-11T20:13:36.421 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:36 smithi039 ceph-mon[102205]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:36.421 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:13:36 smithi039 podman[140048]: 2023-12-11T20:13:36.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:36 smithi032 ceph-mon[132488]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:36.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:36 smithi012 ceph-mon[128787]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:36.801 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:13:36 smithi039 bash[140048]: 071a91142e4ccbe5b3c388a452973c07786720dd54ee3533af3f70ec3d7511f8 2023-12-11T20:13:36.802 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:13:36 smithi039 ceph-mds[140088]: -- 172.21.15.39:0/899672965 <== mon.1 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fa54c07520 con 0x55fa54bde800 2023-12-11T20:13:36.802 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:13:36 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: starting mds.i at 2023-12-11T20:13:36.802 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:13:36 smithi039 systemd[1]: Started Ceph mds.i for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:37 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1725898864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:37 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1725898864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:37.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:37 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1725898864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:38.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:38 smithi012 ceph-mon[128787]: Deploying daemon mds.g on smithi012 2023-12-11T20:13:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:38 smithi012 ceph-mon[128787]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:38 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:boot 2023-12-11T20:13:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:38 smithi012 ceph-mon[128787]: fsmap 9 up:standby 2023-12-11T20:13:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:38 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-11T20:13:38.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.371+0000 7f777b1ff700 1 -- 172.21.15.12:0/2080438860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 msgr2=0x7f7774104380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:38.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.371+0000 7f777b1ff700 1 --2- 172.21.15.12:0/2080438860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 0x7f7774104380 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7768009990 tx=0x7f7768009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.371+0000 7f777b1ff700 1 -- 172.21.15.12:0/2080438860 shutdown_connections 2023-12-11T20:13:38.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.371+0000 7f777b1ff700 1 --2- 172.21.15.12:0/2080438860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77741071f0 0x7f7774109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.371+0000 7f777b1ff700 1 --2- 172.21.15.12:0/2080438860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 0x7f7774104380 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.371+0000 7f777b1ff700 1 --2- 172.21.15.12:0/2080438860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77741048c0 0x7f7774106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.371+0000 7f777b1ff700 1 -- 172.21.15.12:0/2080438860 >> 172.21.15.12:0/2080438860 conn(0x7f77740fb980 msgr2=0x7f77740fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:38.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.372+0000 7f777b1ff700 1 -- 172.21.15.12:0/2080438860 shutdown_connections 2023-12-11T20:13:38.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.372+0000 7f777b1ff700 1 -- 172.21.15.12:0/2080438860 wait complete. 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f777b1ff700 1 Processor -- start 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f777b1ff700 1 -- start start 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f777b1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 0x7f7774199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f777b1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77741048c0 0x7f7774199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f777b1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77741071f0 0x7f77741a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f777b1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77741a1070 con 0x7f7774101f90 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f777b1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77741a11b0 con 0x7f77741048c0 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f777b1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77741a1340 con 0x7f77741071f0 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f7778f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 0x7f7774199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:38.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f7778f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 0x7f7774199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59746/0 (socket says 172.21.15.12:59746) 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f7778f9b700 1 -- 172.21.15.12:0/3304747808 learned_addr learned my addr 172.21.15.12:0/3304747808 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.373+0000 7f7773fff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77741048c0 0x7f7774199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f777979c700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77741071f0 0x7f77741a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f7778f9b700 1 -- 172.21.15.12:0/3304747808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77741071f0 msgr2=0x7f77741a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f7778f9b700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77741071f0 0x7f77741a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f7778f9b700 1 -- 172.21.15.12:0/3304747808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77741048c0 msgr2=0x7f7774199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f7778f9b700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77741048c0 0x7f7774199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f7778f9b700 1 -- 172.21.15.12:0/3304747808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c009c40 con 0x7f7774101f90 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f777979c700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77741071f0 0x7f77741a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f7778f9b700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 0x7f7774199540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7768003ec0 tx=0x7f7768005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f7771ffb700 1 -- 172.21.15.12:0/3304747808 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776801d070 con 0x7f7774101f90 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.374+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77680095f0 con 0x7f7774101f90 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.375+0000 7f7771ffb700 1 -- 172.21.15.12:0/3304747808 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f776800bdb0 con 0x7f7774101f90 2023-12-11T20:13:38.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.375+0000 7f7771ffb700 1 -- 172.21.15.12:0/3304747808 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768021410 con 0x7f7774101f90 2023-12-11T20:13:38.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.375+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77741a1860 con 0x7f7774101f90 2023-12-11T20:13:38.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.376+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7774108df0 con 0x7f7774101f90 2023-12-11T20:13:38.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.378+0000 7f7771ffb700 1 -- 172.21.15.12:0/3304747808 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f776800f660 con 0x7f7774101f90 2023-12-11T20:13:38.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.380+0000 7f7771ffb700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77640a1480 0x7f77640a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:38.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.380+0000 7f7771ffb700 1 -- 172.21.15.12:0/3304747808 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f77680cdff0 con 0x7f7774101f90 2023-12-11T20:13:38.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.380+0000 7f7773fff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77640a1480 0x7f77640a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:38.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.380+0000 7f7773fff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77640a1480 0x7f77640a3940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7760009c60 tx=0x7f7760009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:38.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.382+0000 7f7771ffb700 1 -- 172.21.15.12:0/3304747808 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7768097b00 con 0x7f7774101f90 2023-12-11T20:13:38.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:38 smithi032 ceph-mon[132488]: Deploying daemon mds.g on smithi012 2023-12-11T20:13:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:38 smithi032 ceph-mon[132488]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:38 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:boot 2023-12-11T20:13:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:38 smithi032 ceph-mon[132488]: fsmap 9 up:standby 2023-12-11T20:13:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:38 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-11T20:13:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:38 smithi039 ceph-mon[102205]: Deploying daemon mds.g on smithi012 2023-12-11T20:13:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:38 smithi039 ceph-mon[102205]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:38 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:boot 2023-12-11T20:13:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:38 smithi039 ceph-mon[102205]: fsmap 9 up:standby 2023-12-11T20:13:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:38 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-11T20:13:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.673+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7774068330 con 0x7f7774101f90 2023-12-11T20:13:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.674+0000 7f7771ffb700 1 -- 172.21.15.12:0/3304747808 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7652 (secure 0 0 0) 0x7f776809b120 con 0x7f7774101f90 2023-12-11T20:13:38.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:38.672 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24577,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-12-11T20:13:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77640a1480 msgr2=0x7f77640a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77640a1480 0x7f77640a3940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7760009c60 tx=0x7f7760009260 comp rx=0 tx=0).stop 2023-12-11T20:13:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 msgr2=0x7f7774199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 0x7f7774199540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7768003ec0 tx=0x7f7768005740 comp rx=0 tx=0).stop 2023-12-11T20:13:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 shutdown_connections 2023-12-11T20:13:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77640a1480 0x7f77640a3940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77741071f0 0x7f77741a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7774101f90 0x7f7774199540 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 --2- 172.21.15.12:0/3304747808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77741048c0 0x7f7774199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 >> 172.21.15.12:0/3304747808 conn(0x7f77740fb980 msgr2=0x7f7774101770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 shutdown_connections 2023-12-11T20:13:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:38.678+0000 7f777b1ff700 1 -- 172.21.15.12:0/3304747808 wait complete. 2023-12-11T20:13:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 10 2023-12-11T20:13:39.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3304747808' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:39.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:39 smithi012 ceph-mon[128787]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:39.331 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:13:39 smithi012 systemd[1]: Starting Ceph mds.g for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3304747808' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:39 smithi039 ceph-mon[102205]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3304747808' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:39 smithi032 ceph-mon[132488]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:39.784 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:13:39 smithi012 podman[176611]: 2023-12-11T20:13:39.784 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:13:39 smithi012 bash[176611]: 81c1d4be3947e4a3e8cdddac70b15a089602cebb435fd9a5b1d108bd220e66b0 2023-12-11T20:13:39.784 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:13:39 smithi012 ceph-mds[176651]: -- 172.21.15.12:0/1343377517 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561304f51520 con 0x561304f28800 2023-12-11T20:13:40.080 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:13:39 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-g[176627]: starting mds.g at 2023-12-11T20:13:40.080 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:13:39 smithi012 systemd[1]: Started Ceph mds.g for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:40.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:40.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 -- 172.21.15.12:0/1224752881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc074030 msgr2=0x7f25cc0744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 --2- 172.21.15.12:0/1224752881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc074030 0x7f25cc0744b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009990 tx=0x7f25c0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 -- 172.21.15.12:0/1224752881 shutdown_connections 2023-12-11T20:13:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 --2- 172.21.15.12:0/1224752881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25cc075610 0x7f25cc073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 --2- 172.21.15.12:0/1224752881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25cc10da80 0x7f25cc10fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 --2- 172.21.15.12:0/1224752881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc074030 0x7f25cc0744b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 -- 172.21.15.12:0/1224752881 >> 172.21.15.12:0/1224752881 conn(0x7f25cc0fca40 msgr2=0x7f25cc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 -- 172.21.15.12:0/1224752881 shutdown_connections 2023-12-11T20:13:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.926+0000 7f25d1dff700 1 -- 172.21.15.12:0/1224752881 wait complete. 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.927+0000 7f25d1dff700 1 Processor -- start 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25d1dff700 1 -- start start 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25d1dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25cc074030 0x7f25cc19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25d1dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25cc075610 0x7f25cc19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25d1dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc10da80 0x7f25cc1a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25d1dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a5570 con 0x7f25cc10da80 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25d1dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a56b0 con 0x7f25cc075610 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25d1dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a5840 con 0x7f25cc074030 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc10da80 0x7f25cc1a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc10da80 0x7f25cc1a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45814/0 (socket says 172.21.15.12:45814) 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25cbfff700 1 -- 172.21.15.12:0/3701549408 learned_addr learned my addr 172.21.15.12:0/3701549408 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25caffd700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25cc075610 0x7f25cc19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.928+0000 7f25cb7fe700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25cc074030 0x7f25cc19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25cbfff700 1 -- 172.21.15.12:0/3701549408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25cc074030 msgr2=0x7f25cc19da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25cbfff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25cc074030 0x7f25cc19da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25cbfff700 1 -- 172.21.15.12:0/3701549408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25cc075610 msgr2=0x7f25cc19dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25cbfff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25cc075610 0x7f25cc19dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25cbfff700 1 -- 172.21.15.12:0/3701549408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00095f0 con 0x7f25cc10da80 2023-12-11T20:13:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25caffd700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25cc075610 0x7f25cc19dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25cbfff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc10da80 0x7f25cc1a4fa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25c400ef30 tx=0x7f25c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25c8ff9700 1 -- 172.21.15.12:0/3701549408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4018070 con 0x7f25cc10da80 2023-12-11T20:13:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc1a5ac0 con 0x7f25cc10da80 2023-12-11T20:13:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.929+0000 7f25c8ff9700 1 -- 172.21.15.12:0/3701549408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25c400f040 con 0x7f25cc10da80 2023-12-11T20:13:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.930+0000 7f25c8ff9700 1 -- 172.21.15.12:0/3701549408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400cbc0 con 0x7f25cc10da80 2023-12-11T20:13:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.930+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1a5fd0 con 0x7f25cc10da80 2023-12-11T20:13:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.931+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc103ce0 con 0x7f25cc10da80 2023-12-11T20:13:40.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.933+0000 7f25c8ff9700 1 -- 172.21.15.12:0/3701549408 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f25c400cd80 con 0x7f25cc10da80 2023-12-11T20:13:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.934+0000 7f25c8ff9700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f25b40a1500 0x7f25b40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.934+0000 7f25c8ff9700 1 -- 172.21.15.12:0/3701549408 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f25c40cc360 con 0x7f25cc10da80 2023-12-11T20:13:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.935+0000 7f25cb7fe700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f25b40a1500 0x7f25b40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.935+0000 7f25cb7fe700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f25b40a1500 0x7f25b40a39c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009c60 tx=0x7f25bc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:40.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:40.939+0000 7f25c8ff9700 1 -- 172.21.15.12:0/3701549408 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f25c4095e50 con 0x7f25cc10da80 2023-12-11T20:13:41.056 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.056 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.056 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.056 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:41.056 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:41.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:41.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: Deploying daemon mds.a on smithi012 2023-12-11T20:13:41.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.12:6838/3831802568,v1:172.21.15.12:6839/3831802568] up:boot 2023-12-11T20:13:41.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: fsmap 10 up:standby 2023-12-11T20:13:41.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:40 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: Deploying daemon mds.a on smithi012 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.12:6838/3831802568,v1:172.21.15.12:6839/3831802568] up:boot 2023-12-11T20:13:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: fsmap 10 up:standby 2023-12-11T20:13:41.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:40 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-11T20:13:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.222+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25cc113450 con 0x7f25cc10da80 2023-12-11T20:13:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.222+0000 7f25c8ff9700 1 -- 172.21.15.12:0/3701549408 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8444 (secure 0 0 0) 0x7f25c4099470 con 0x7f25cc10da80 2023-12-11T20:13:41.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:41.221 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24577,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-12-11T20:13:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f25b40a1500 msgr2=0x7f25b40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f25b40a1500 0x7f25b40a39c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009c60 tx=0x7f25bc009260 comp rx=0 tx=0).stop 2023-12-11T20:13:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc10da80 msgr2=0x7f25cc1a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc10da80 0x7f25cc1a4fa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25c400ef30 tx=0x7f25c400c3a0 comp rx=0 tx=0).stop 2023-12-11T20:13:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 shutdown_connections 2023-12-11T20:13:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f25b40a1500 0x7f25b40a39c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25cc10da80 0x7f25cc1a4fa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25cc074030 0x7f25cc19da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 --2- 172.21.15.12:0/3701549408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25cc075610 0x7f25cc19dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 >> 172.21.15.12:0/3701549408 conn(0x7f25cc0fca40 msgr2=0x7f25cc100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 shutdown_connections 2023-12-11T20:13:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:41.225+0000 7f25d1dff700 1 -- 172.21.15.12:0/3701549408 wait complete. 2023-12-11T20:13:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 11 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: Deploying daemon mds.a on smithi012 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.12:6838/3831802568,v1:172.21.15.12:6839/3831802568] up:boot 2023-12-11T20:13:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: fsmap 10 up:standby 2023-12-11T20:13:41.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:40 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-11T20:13:42.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:41 smithi012 ceph-mon[128787]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:42.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:41 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3701549408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:42.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:41 smithi032 ceph-mon[132488]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:42.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:41 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3701549408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:42.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:41 smithi039 ceph-mon[102205]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:42.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:41 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3701549408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:42.575 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:13:42 smithi012 systemd[1]: Starting Ceph mds.a for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:42.830 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:13:42 smithi012 podman[176998]: 2023-12-11T20:13:42.830 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:13:42 smithi012 bash[176998]: 2283cb5ce424e6a521d840b44e75006d36acbd58980a81a20f1ed3ded6d764ba 2023-12-11T20:13:42.830 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:13:42 smithi012 ceph-mds[177038]: -- 172.21.15.12:0/2320977269 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563d3db73520 con 0x563d3db4ac00 2023-12-11T20:13:42.830 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:13:42 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-a[177014]: starting mds.a at 2023-12-11T20:13:43.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:43.309 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:13:42 smithi012 systemd[1]: Started Ceph mds.a for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:43.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 -- 172.21.15.12:0/151233755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18701014b0 msgr2=0x7f18701018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:43.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 --2- 172.21.15.12:0/151233755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18701014b0 0x7f18701018d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f186c0099c0 tx=0x7f186c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 -- 172.21.15.12:0/151233755 shutdown_connections 2023-12-11T20:13:43.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 --2- 172.21.15.12:0/151233755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1870103040 0x7f18701098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 --2- 172.21.15.12:0/151233755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18701014b0 0x7f18701018d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 --2- 172.21.15.12:0/151233755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18701026a0 0x7f1870102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 -- 172.21.15.12:0/151233755 >> 172.21.15.12:0/151233755 conn(0x7f18700fca40 msgr2=0x7f18700fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:43.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 -- 172.21.15.12:0/151233755 shutdown_connections 2023-12-11T20:13:43.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.458+0000 7f18783ff700 1 -- 172.21.15.12:0/151233755 wait complete. 2023-12-11T20:13:43.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.459+0000 7f18783ff700 1 Processor -- start 2023-12-11T20:13:43.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.459+0000 7f18783ff700 1 -- start start 2023-12-11T20:13:43.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.459+0000 7f18783ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18701014b0 0x7f18701973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:43.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.459+0000 7f18783ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18701026a0 0x7f18701978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.459+0000 7f18783ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1870103040 0x7f187019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.459+0000 7f18783ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187019eed0 con 0x7f1870103040 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.459+0000 7f18783ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187019f010 con 0x7f18701026a0 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.459+0000 7f18783ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187019f1a0 con 0x7f18701014b0 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1870103040 0x7f187019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187599a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18701026a0 0x7f18701978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1870103040 0x7f187019e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45864/0 (socket says 172.21.15.12:45864) 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 -- 172.21.15.12:0/3521675151 learned_addr learned my addr 172.21.15.12:0/3521675151 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187619b700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18701014b0 0x7f18701973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 -- 172.21.15.12:0/3521675151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18701014b0 msgr2=0x7f18701973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18701014b0 0x7f18701973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 -- 172.21.15.12:0/3521675151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18701026a0 msgr2=0x7f18701978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18701026a0 0x7f18701978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 -- 172.21.15.12:0/3521675151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0095f0 con 0x7f1870103040 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187599a700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18701026a0 0x7f18701978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187619b700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18701014b0 0x7f18701973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.460+0000 7f187699c700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1870103040 0x7f187019e900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f186800ef30 tx=0x7f186800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.461+0000 7f18677fe700 1 -- 172.21.15.12:0/3521675151 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868018070 con 0x7f1870103040 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.461+0000 7f18677fe700 1 -- 172.21.15.12:0/3521675151 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f186800f040 con 0x7f1870103040 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.461+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187019f420 con 0x7f1870103040 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.461+0000 7f18677fe700 1 -- 172.21.15.12:0/3521675151 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800cc70 con 0x7f1870103040 2023-12-11T20:13:43.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.461+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187019f8e0 con 0x7f1870103040 2023-12-11T20:13:43.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.462+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1870108a20 con 0x7f1870103040 2023-12-11T20:13:43.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.464+0000 7f18677fe700 1 -- 172.21.15.12:0/3521675151 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1868007500 con 0x7f1870103040 2023-12-11T20:13:43.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.465+0000 7f18677fe700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f185c0a1480 0x7f185c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:43.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.465+0000 7f18677fe700 1 -- 172.21.15.12:0/3521675151 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f18680cc470 con 0x7f1870103040 2023-12-11T20:13:43.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.465+0000 7f187619b700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f185c0a1480 0x7f185c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:43.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.466+0000 7f187619b700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f185c0a1480 0x7f185c0a3940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f186c009990 tx=0x7f186c01a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:43.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.469+0000 7f18677fe700 1 -- 172.21.15.12:0/3521675151 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1868095f60 con 0x7f1870103040 2023-12-11T20:13:43.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.731+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1870068330 con 0x7f1870103040 2023-12-11T20:13:43.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.732+0000 7f18677fe700 1 -- 172.21.15.12:0/3521675151 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9236 (secure 0 0 0) 0x7f1868099580 con 0x7f1870103040 2023-12-11T20:13:43.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:43.730 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24577,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f185c0a1480 msgr2=0x7f185c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f185c0a1480 0x7f185c0a3940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f186c009990 tx=0x7f186c01a040 comp rx=0 tx=0).stop 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1870103040 msgr2=0x7f187019e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1870103040 0x7f187019e900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f186800ef30 tx=0x7f186800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 shutdown_connections 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f185c0a1480 0x7f185c0a3940 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1870103040 0x7f187019e900 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18701014b0 0x7f18701973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 --2- 172.21.15.12:0/3521675151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18701026a0 0x7f18701978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 >> 172.21.15.12:0/3521675151 conn(0x7f18700fca40 msgr2=0x7f1870105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 shutdown_connections 2023-12-11T20:13:43.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:43.735+0000 7f18783ff700 1 -- 172.21.15.12:0/3521675151 wait complete. 2023-12-11T20:13:43.734 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 12 2023-12-11T20:13:44.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.12:6840/3948008588,v1:172.21.15.12:6841/3948008588] up:boot 2023-12-11T20:13:44.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: fsmap 11 up:standby 2023-12-11T20:13:44.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-11T20:13:44.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:44.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:44.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:44.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: Deploying daemon mds.b on smithi032 2023-12-11T20:13:44.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:44.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:43 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3521675151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:44.181 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.12:6840/3948008588,v1:172.21.15.12:6841/3948008588] up:boot 2023-12-11T20:13:44.181 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: fsmap 11 up:standby 2023-12-11T20:13:44.181 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-11T20:13:44.181 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.181 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.182 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.182 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:44.182 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:44.182 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:44.182 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: Deploying daemon mds.b on smithi032 2023-12-11T20:13:44.182 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:44.182 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:43 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3521675151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.12:6840/3948008588,v1:172.21.15.12:6841/3948008588] up:boot 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: fsmap 11 up:standby 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:44.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: Deploying daemon mds.b on smithi032 2023-12-11T20:13:44.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:44.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:43 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3521675151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:45.713 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:13:45 smithi032 systemd[1]: Starting Ceph mds.b for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:13:45.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:45.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/3239092643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d28102690 msgr2=0x7f2d28102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:45.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/3239092643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d28102690 0x7f2d28102af0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0099c0 tx=0x7f2d1c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/3239092643 shutdown_connections 2023-12-11T20:13:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/3239092643 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d281014a0 0x7f2d281018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/3239092643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d28103030 0x7f2d281098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/3239092643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d28102690 0x7f2d28102af0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/3239092643 >> 172.21.15.12:0/3239092643 conn(0x7f2d280fca10 msgr2=0x7f2d280fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/3239092643 shutdown_connections 2023-12-11T20:13:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.970+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/3239092643 wait complete. 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.971+0000 7f2d2e5ff700 1 Processor -- start 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.971+0000 7f2d2e5ff700 1 -- start start 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d2e5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d281014a0 0x7f2d281995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d2e5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d28102690 0x7f2d28199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d2e5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d28103030 0x7f2d281a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d2e5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281a10a0 con 0x7f2d28103030 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d2e5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281a11e0 con 0x7f2d281014a0 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d2e5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281a1370 con 0x7f2d28102690 2023-12-11T20:13:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d27fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d281014a0 0x7f2d281995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d27fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d281014a0 0x7f2d281995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:33810/0 (socket says 172.21.15.12:33810) 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d27fff700 1 -- 172.21.15.12:0/2289889463 learned_addr learned my addr 172.21.15.12:0/2289889463 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d2cb9c700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d28103030 0x7f2d281a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d277fe700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d28102690 0x7f2d28199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d27fff700 1 -- 172.21.15.12:0/2289889463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d28102690 msgr2=0x7f2d28199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d27fff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d28102690 0x7f2d28199b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d27fff700 1 -- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d28103030 msgr2=0x7f2d281a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d27fff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d28103030 0x7f2d281a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.972+0000 7f2d27fff700 1 -- 172.21.15.12:0/2289889463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c0095f0 con 0x7f2d281014a0 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.973+0000 7f2d27fff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d281014a0 0x7f2d281995c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800e970 tx=0x7f2d1800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.973+0000 7f2d257fa700 1 -- 172.21.15.12:0/2289889463 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18009790 con 0x7f2d281014a0 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.973+0000 7f2d257fa700 1 -- 172.21.15.12:0/2289889463 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d1800c7e0 con 0x7f2d281014a0 2023-12-11T20:13:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.973+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d281a1650 con 0x7f2d281014a0 2023-12-11T20:13:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.973+0000 7f2d257fa700 1 -- 172.21.15.12:0/2289889463 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18003bd0 con 0x7f2d281014a0 2023-12-11T20:13:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.973+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d281a1b60 con 0x7f2d281014a0 2023-12-11T20:13:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.974+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d28068330 con 0x7f2d281014a0 2023-12-11T20:13:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.976+0000 7f2d257fa700 1 -- 172.21.15.12:0/2289889463 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2d1800c950 con 0x7f2d281014a0 2023-12-11T20:13:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.977+0000 7f2d257fa700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d100a1480 0x7f2d100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.977+0000 7f2d257fa700 1 -- 172.21.15.12:0/2289889463 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2d18014070 con 0x7f2d281014a0 2023-12-11T20:13:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.977+0000 7f2d277fe700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d100a1480 0x7f2d100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:45.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.978+0000 7f2d277fe700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d100a1480 0x7f2d100a3940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c000c00 tx=0x7f2d1c003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:45.982+0000 7f2d257fa700 1 -- 172.21.15.12:0/2289889463 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2d18096510 con 0x7f2d281014a0 2023-12-11T20:13:46.070 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:13:45 smithi032 podman[169101]: 2023-12-11T20:13:46.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.247+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d2810cbc0 con 0x7f2d281014a0 2023-12-11T20:13:46.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.248+0000 7f2d257fa700 1 -- 172.21.15.12:0/2289889463 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9236 (secure 0 0 0) 0x7f2d18099b30 con 0x7f2d281014a0 2023-12-11T20:13:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:46.246 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24577,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d100a1480 msgr2=0x7f2d100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d100a1480 0x7f2d100a3940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c000c00 tx=0x7f2d1c003680 comp rx=0 tx=0).stop 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d281014a0 msgr2=0x7f2d281995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d281014a0 0x7f2d281995c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800e970 tx=0x7f2d1800ec80 comp rx=0 tx=0).stop 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 shutdown_connections 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d100a1480 0x7f2d100a3940 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d281014a0 0x7f2d281995c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d28103030 0x7f2d281a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 --2- 172.21.15.12:0/2289889463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d28102690 0x7f2d28199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 >> 172.21.15.12:0/2289889463 conn(0x7f2d280fca10 msgr2=0x7f2d28107ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 shutdown_connections 2023-12-11T20:13:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:46.251+0000 7f2d2e5ff700 1 -- 172.21.15.12:0/2289889463 wait complete. 2023-12-11T20:13:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 12 2023-12-11T20:13:46.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:46 smithi012 ceph-mon[128787]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:46 smithi032 ceph-mon[132488]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:46.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:13:46 smithi032 bash[169101]: 460c845d627e1544020c26d9625298e9a9bdd0d59c99cf1ba4ef53706ed52b13 2023-12-11T20:13:46.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:13:46 smithi032 ceph-mds[169141]: -- 172.21.15.32:0/3777157960 <== mon.1 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561e9f775520 con 0x561e9f74cc00 2023-12-11T20:13:46.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:13:46 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: starting mds.b at 2023-12-11T20:13:46.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:13:46 smithi032 systemd[1]: Started Ceph mds.b for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:13:46.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:46 smithi039 ceph-mon[102205]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2289889463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] up:boot 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: fsmap 12 up:standby 2023-12-11T20:13:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-11T20:13:47.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2289889463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] up:boot 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: fsmap 12 up:standby 2023-12-11T20:13:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2289889463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] up:boot 2023-12-11T20:13:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: fsmap 12 up:standby 2023-12-11T20:13:47.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-11T20:13:48.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:13:48.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1660363734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf81014a0 msgr2=0x7efbf81018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:48.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1660363734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf81014a0 0x7efbf81018c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efbe80099c0 tx=0x7efbe8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1660363734 shutdown_connections 2023-12-11T20:13:48.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1660363734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf8103030 0x7efbf81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1660363734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf81014a0 0x7efbf81018c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1660363734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8102690 0x7efbf8102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1660363734 >> 172.21.15.12:0/1660363734 conn(0x7efbf80fca10 msgr2=0x7efbf80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:48.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1660363734 shutdown_connections 2023-12-11T20:13:48.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.488+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1660363734 wait complete. 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.489+0000 7efbfe1ff700 1 Processor -- start 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.489+0000 7efbfe1ff700 1 -- start start 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbfe1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf81014a0 0x7efbf8199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbfe1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbfe1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8103030 0x7efbf81a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbfe1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a1130 con 0x7efbf8102690 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbfe1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a1270 con 0x7efbf81014a0 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbfe1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a1400 con 0x7efbf8103030 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:48.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45908/0 (socket says 172.21.15.12:45908) 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf6ffd700 1 -- 172.21.15.12:0/1934412882 learned_addr learned my addr 172.21.15.12:0/1934412882 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf7fff700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8103030 0x7efbf81a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf6ffd700 1 -- 172.21.15.12:0/1934412882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8103030 msgr2=0x7efbf81a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf6ffd700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8103030 0x7efbf81a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf6ffd700 1 -- 172.21.15.12:0/1934412882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf81014a0 msgr2=0x7efbf8199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf6ffd700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf81014a0 0x7efbf8199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.490+0000 7efbf6ffd700 1 -- 172.21.15.12:0/1934412882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf0009c40 con 0x7efbf8102690 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.491+0000 7efbf6ffd700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efbec00e9a0 tx=0x7efbec00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.491+0000 7efbf4ff9700 1 -- 172.21.15.12:0/1934412882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec009790 con 0x7efbf8102690 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.491+0000 7efbf4ff9700 1 -- 172.21.15.12:0/1934412882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbec00cbd0 con 0x7efbf8102690 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.491+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe80095f0 con 0x7efbf8102690 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.491+0000 7efbf4ff9700 1 -- 172.21.15.12:0/1934412882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec00eee0 con 0x7efbf8102690 2023-12-11T20:13:48.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.491+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf81a1a60 con 0x7efbf8102690 2023-12-11T20:13:48.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.492+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf8067aa0 con 0x7efbf8102690 2023-12-11T20:13:48.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.494+0000 7efbf4ff9700 1 -- 172.21.15.12:0/1934412882 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7efbec00cd40 con 0x7efbf8102690 2023-12-11T20:13:48.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.495+0000 7efbf4ff9700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe00a1480 0x7efbe00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:48.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.495+0000 7efbf4ff9700 1 -- 172.21.15.12:0/1934412882 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efbec014070 con 0x7efbf8102690 2023-12-11T20:13:48.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.496+0000 7efbf77fe700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe00a1480 0x7efbe00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:48.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.496+0000 7efbf77fe700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe00a1480 0x7efbe00a3940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efbe800bee0 tx=0x7efbe8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:48.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.500+0000 7efbf4ff9700 1 -- 172.21.15.12:0/1934412882 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efbec0522f0 con 0x7efbf8102690 2023-12-11T20:13:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.764+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efbf810cbc0 con 0x7efbf8102690 2023-12-11T20:13:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.765+0000 7efbf4ff9700 1 -- 172.21.15.12:0/1934412882 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10028 (secure 0 0 0) 0x7efbec096600 con 0x7efbf8102690 2023-12-11T20:13:48.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:48.763 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24577,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-12-11T20:13:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe00a1480 msgr2=0x7efbe00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe00a1480 0x7efbe00a3940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efbe800bee0 tx=0x7efbe8000bc0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 msgr2=0x7efbf8199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efbec00e9a0 tx=0x7efbec00ed60 comp rx=0 tx=0).stop 2023-12-11T20:13:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 shutdown_connections 2023-12-11T20:13:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe00a1480 0x7efbe00a3940 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf81014a0 0x7efbf8199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8103030 0x7efbf81a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 --2- 172.21.15.12:0/1934412882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 >> 172.21.15.12:0/1934412882 conn(0x7efbf80fca10 msgr2=0x7efbf8107f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 shutdown_connections 2023-12-11T20:13:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:48.769+0000 7efbfe1ff700 1 -- 172.21.15.12:0/1934412882 wait complete. 2023-12-11T20:13:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2023-12-11T20:13:48.793 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:13:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 -- 172.21.15.12:0/927754864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7950103030 msgr2=0x7f79501098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 --2- 172.21.15.12:0/927754864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7950103030 0x7f79501098e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f794800b0d0 tx=0x7f794800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 -- 172.21.15.12:0/927754864 shutdown_connections 2023-12-11T20:13:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 --2- 172.21.15.12:0/927754864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79501014a0 0x7f79501018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 --2- 172.21.15.12:0/927754864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7950103030 0x7f79501098e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 --2- 172.21.15.12:0/927754864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950102690 0x7f7950102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 -- 172.21.15.12:0/927754864 >> 172.21.15.12:0/927754864 conn(0x7f79500fca10 msgr2=0x7f79500fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 -- 172.21.15.12:0/927754864 shutdown_connections 2023-12-11T20:13:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.008+0000 7f7956fff700 1 -- 172.21.15.12:0/927754864 wait complete. 2023-12-11T20:13:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.009+0000 7f7956fff700 1 Processor -- start 2023-12-11T20:13:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.009+0000 7f7956fff700 1 -- start start 2023-12-11T20:13:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7956fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79501014a0 0x7f7950197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7956fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950102690 0x7f7950197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7956fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950103030 0x7f795019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7956fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795019ef40 con 0x7f79501014a0 2023-12-11T20:13:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7956fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795019f080 con 0x7f7950102690 2023-12-11T20:13:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7956fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795019f210 con 0x7f7950103030 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7954d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79501014a0 0x7f7950197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f794ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950102690 0x7f7950197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f794ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950102690 0x7f7950197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35514/0 (socket says 172.21.15.12:35514) 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7954d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79501014a0 0x7f7950197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37958/0 (socket says 172.21.15.12:37958) 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f794ffff700 1 -- 172.21.15.12:0/231627688 learned_addr learned my addr 172.21.15.12:0/231627688 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f795559c700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950103030 0x7f795019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f794ffff700 1 -- 172.21.15.12:0/231627688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950103030 msgr2=0x7f795019e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f794ffff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950103030 0x7f795019e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f794ffff700 1 -- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79501014a0 msgr2=0x7f7950197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f794ffff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79501014a0 0x7f7950197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f794ffff700 1 -- 172.21.15.12:0/231627688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948009d00 con 0x7f7950102690 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.010+0000 7f7954d9b700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79501014a0 0x7f7950197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.011+0000 7f794ffff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950102690 0x7f7950197950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e9a0 tx=0x7f793c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.011+0000 7f794dffb700 1 -- 172.21.15.12:0/231627688 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c009790 con 0x7f7950102690 2023-12-11T20:13:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.011+0000 7f794dffb700 1 -- 172.21.15.12:0/231627688 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f793c010430 con 0x7f7950102690 2023-12-11T20:13:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.011+0000 7f794dffb700 1 -- 172.21.15.12:0/231627688 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c00cea0 con 0x7f7950102690 2023-12-11T20:13:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.011+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795019f4f0 con 0x7f7950102690 2023-12-11T20:13:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.011+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795019f9b0 con 0x7f7950102690 2023-12-11T20:13:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.012+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7950108970 con 0x7f7950102690 2023-12-11T20:13:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.014+0000 7f794dffb700 1 -- 172.21.15.12:0/231627688 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f793c0105a0 con 0x7f7950102690 2023-12-11T20:13:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.016+0000 7f794dffb700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79400a1480 0x7f79400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.016+0000 7f794dffb700 1 -- 172.21.15.12:0/231627688 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f793c014070 con 0x7f7950102690 2023-12-11T20:13:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.016+0000 7f7954d9b700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79400a1480 0x7f79400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.017+0000 7f7954d9b700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79400a1480 0x7f79400a3940 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f79501024f0 tx=0x7f7944009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:49.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.023+0000 7f794dffb700 1 -- 172.21.15.12:0/231627688 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f793c0522f0 con 0x7f7950102690 2023-12-11T20:13:49.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:49 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:49.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:49 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1934412882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:49.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.251+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7950068780 con 0x7f7950102690 2023-12-11T20:13:49.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.252+0000 7f794dffb700 1 -- 172.21.15.12:0/231627688 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f793c096520 con 0x7f7950102690 2023-12-11T20:13:49.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:49.250 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:12:54.270944+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79400a1480 msgr2=0x7f79400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79400a1480 0x7f79400a3940 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f79501024f0 tx=0x7f7944009260 comp rx=0 tx=0).stop 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950102690 msgr2=0x7f7950197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950102690 0x7f7950197950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e9a0 tx=0x7f793c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 shutdown_connections 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79400a1480 0x7f79400a3940 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950103030 0x7f795019e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79501014a0 0x7f7950197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 --2- 172.21.15.12:0/231627688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950102690 0x7f7950197950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.254+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 >> 172.21.15.12:0/231627688 conn(0x7f79500fca10 msgr2=0x7f7950105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.255+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 shutdown_connections 2023-12-11T20:13:49.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.255+0000 7f7956fff700 1 -- 172.21.15.12:0/231627688 wait complete. 2023-12-11T20:13:49.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:13:49.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:13:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:49 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:49 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1934412882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:49 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:49 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1934412882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:13:49.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 -- 172.21.15.12:0/4256875922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d0103040 msgr2=0x7fe7d01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/4256875922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d0103040 0x7fe7d01098f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80099c0 tx=0x7fe7c8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 -- 172.21.15.12:0/4256875922 shutdown_connections 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/4256875922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d0103040 0x7fe7d01098f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/4256875922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7d01014b0 0x7fe7d01018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/4256875922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d01026a0 0x7fe7d0102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 -- 172.21.15.12:0/4256875922 >> 172.21.15.12:0/4256875922 conn(0x7fe7d00fca00 msgr2=0x7fe7d00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 -- 172.21.15.12:0/4256875922 shutdown_connections 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.494+0000 7fe7d7fff700 1 -- 172.21.15.12:0/4256875922 wait complete. 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.495+0000 7fe7d7fff700 1 Processor -- start 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.495+0000 7fe7d7fff700 1 -- start start 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7d01014b0 0x7fe7d0197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d01026a0 0x7fe7d0197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0103040 0x7fe7d019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d019ee30 con 0x7fe7d01026a0 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d7fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d019ef70 con 0x7fe7d0103040 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d7fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d019f100 con 0x7fe7d01014b0 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d01026a0 0x7fe7d0197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d01026a0 0x7fe7d0197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37968/0 (socket says 172.21.15.12:37968) 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d559a700 1 -- 172.21.15.12:0/2690816996 learned_addr learned my addr 172.21.15.12:0/2690816996 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d5d9b700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7d01014b0 0x7fe7d0197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d659c700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0103040 0x7fe7d019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d559a700 1 -- 172.21.15.12:0/2690816996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7d01014b0 msgr2=0x7fe7d0197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d559a700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7d01014b0 0x7fe7d0197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d559a700 1 -- 172.21.15.12:0/2690816996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0103040 msgr2=0x7fe7d019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d559a700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0103040 0x7fe7d019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d559a700 1 -- 172.21.15.12:0/2690816996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80095f0 con 0x7fe7d01026a0 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.496+0000 7fe7d659c700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0103040 0x7fe7d019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.497+0000 7fe7d559a700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d01026a0 0x7fe7d0197840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000e9a0 tx=0x7fe7c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:49.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.497+0000 7fe7c6ffd700 1 -- 172.21.15.12:0/2690816996 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0009790 con 0x7fe7d01026a0 2023-12-11T20:13:49.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.497+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d019f3e0 con 0x7fe7d01026a0 2023-12-11T20:13:49.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.497+0000 7fe7c6ffd700 1 -- 172.21.15.12:0/2690816996 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7c000ce40 con 0x7fe7d01026a0 2023-12-11T20:13:49.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.497+0000 7fe7c6ffd700 1 -- 172.21.15.12:0/2690816996 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0018420 con 0x7fe7d01026a0 2023-12-11T20:13:49.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.497+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d019f8f0 con 0x7fe7d01026a0 2023-12-11T20:13:49.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.498+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d01089d0 con 0x7fe7d01026a0 2023-12-11T20:13:49.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.500+0000 7fe7c6ffd700 1 -- 172.21.15.12:0/2690816996 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe7c000c9b0 con 0x7fe7d01026a0 2023-12-11T20:13:49.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.501+0000 7fe7c6ffd700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7bc0a1480 0x7fe7bc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.501+0000 7fe7c6ffd700 1 -- 172.21.15.12:0/2690816996 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe7c0014070 con 0x7fe7d01026a0 2023-12-11T20:13:49.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.501+0000 7fe7d5d9b700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7bc0a1480 0x7fe7bc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.502+0000 7fe7d5d9b700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7bc0a1480 0x7fe7bc0a3940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009550 tx=0x7fe7cc0091b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:49.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.505+0000 7fe7c6ffd700 1 -- 172.21.15.12:0/2690816996 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe7c00522f0 con 0x7fe7d01026a0 2023-12-11T20:13:49.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.728+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7d010ce70 con 0x7fe7d01026a0 2023-12-11T20:13:49.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.729+0000 7fe7c6ffd700 1 -- 172.21.15.12:0/2690816996 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7c0096480 con 0x7fe7d01026a0 2023-12-11T20:13:49.727 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:13:49.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7bc0a1480 msgr2=0x7fe7bc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7bc0a1480 0x7fe7bc0a3940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009550 tx=0x7fe7cc0091b0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d01026a0 msgr2=0x7fe7d0197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d01026a0 0x7fe7d0197840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000e9a0 tx=0x7fe7c000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 shutdown_connections 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7bc0a1480 0x7fe7bc0a3940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0103040 0x7fe7d019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7d01014b0 0x7fe7d0197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 --2- 172.21.15.12:0/2690816996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7d01026a0 0x7fe7d0197840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.731+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 >> 172.21.15.12:0/2690816996 conn(0x7fe7d00fca00 msgr2=0x7fe7d0105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.732+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 shutdown_connections 2023-12-11T20:13:49.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.732+0000 7fe7d7fff700 1 -- 172.21.15.12:0/2690816996 wait complete. 2023-12-11T20:13:49.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-11T20:13:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 -- 172.21.15.12:0/2683064555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1320102690 msgr2=0x7f1320102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 --2- 172.21.15.12:0/2683064555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1320102690 0x7f1320102af0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f13100099c0 tx=0x7f1310009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 -- 172.21.15.12:0/2683064555 shutdown_connections 2023-12-11T20:13:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 --2- 172.21.15.12:0/2683064555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13201014a0 0x7f13201018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 --2- 172.21.15.12:0/2683064555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1320103030 0x7f13201098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 --2- 172.21.15.12:0/2683064555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1320102690 0x7f1320102af0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 -- 172.21.15.12:0/2683064555 >> 172.21.15.12:0/2683064555 conn(0x7f13200fca10 msgr2=0x7f13200fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 -- 172.21.15.12:0/2683064555 shutdown_connections 2023-12-11T20:13:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.960+0000 7f1327fff700 1 -- 172.21.15.12:0/2683064555 wait complete. 2023-12-11T20:13:49.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.961+0000 7f1327fff700 1 Processor -- start 2023-12-11T20:13:49.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.961+0000 7f1327fff700 1 -- start start 2023-12-11T20:13:49.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1327fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13201014a0 0x7f1320199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1327fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1320102690 0x7f1320199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1327fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1320103030 0x7f13201a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1327fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13201a10a0 con 0x7f13201014a0 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1327fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13201a11e0 con 0x7f1320102690 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1327fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13201a1370 con 0x7f1320103030 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1325d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13201014a0 0x7f1320199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f132559a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1320102690 0x7f1320199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1325d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13201014a0 0x7f1320199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37986/0 (socket says 172.21.15.12:37986) 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f1325d9b700 1 -- 172.21.15.12:0/1662909560 learned_addr learned my addr 172.21.15.12:0/1662909560 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f132559a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1320102690 0x7f1320199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35556/0 (socket says 172.21.15.12:35556) 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.962+0000 7f132659c700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1320103030 0x7f13201a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f132559a700 1 -- 172.21.15.12:0/1662909560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1320103030 msgr2=0x7f13201a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f132559a700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1320103030 0x7f13201a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f132559a700 1 -- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13201014a0 msgr2=0x7f1320199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f132559a700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13201014a0 0x7f1320199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f132559a700 1 -- 172.21.15.12:0/1662909560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100095f0 con 0x7f1320102690 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f1325d9b700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13201014a0 0x7f1320199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f132659c700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1320103030 0x7f13201a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f132559a700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1320102690 0x7f1320199ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13100098e0 tx=0x7f131000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f1316ffd700 1 -- 172.21.15.12:0/1662909560 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131001d070 con 0x7f1320102690 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13201a15f0 con 0x7f1320102690 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f1316ffd700 1 -- 172.21.15.12:0/1662909560 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13100054b0 con 0x7f1320102690 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f1316ffd700 1 -- 172.21.15.12:0/1662909560 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310004ba0 con 0x7f1320102690 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.963+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13201a1a10 con 0x7f1320102690 2023-12-11T20:13:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.964+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1320068330 con 0x7f1320102690 2023-12-11T20:13:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.966+0000 7f1316ffd700 1 -- 172.21.15.12:0/1662909560 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f131000fc80 con 0x7f1320102690 2023-12-11T20:13:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.968+0000 7f1316ffd700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f130c0a1480 0x7f130c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.968+0000 7f1316ffd700 1 -- 172.21.15.12:0/1662909560 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f13100cd4d0 con 0x7f1320102690 2023-12-11T20:13:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.968+0000 7f1325d9b700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f130c0a1480 0x7f130c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.968+0000 7f1325d9b700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f130c0a1480 0x7f130c0a3940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f131c005950 tx=0x7f131c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:49.972+0000 7f1316ffd700 1 -- 172.21.15.12:0/1662909560 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1310096fc0 con 0x7f1320102690 2023-12-11T20:13:50.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.194+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f13201a1d50 con 0x7f1320102690 2023-12-11T20:13:50.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.194+0000 7f1316ffd700 1 -- 172.21.15.12:0/1662909560 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7f131009a5e0 con 0x7f1320102690 2023-12-11T20:13:50.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:50.193 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-12-11T20:13:50.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:13:50.193 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-12-11T20:13:50.193 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-12-11T20:13:50.193 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:13:50.193 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f130c0a1480 msgr2=0x7f130c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f130c0a1480 0x7f130c0a3940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f131c005950 tx=0x7f131c009260 comp rx=0 tx=0).stop 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1320102690 msgr2=0x7f1320199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1320102690 0x7f1320199ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13100098e0 tx=0x7f131000f690 comp rx=0 tx=0).stop 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 shutdown_connections 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f130c0a1480 0x7f130c0a3940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1320103030 0x7f13201a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13201014a0 0x7f1320199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 --2- 172.21.15.12:0/1662909560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1320102690 0x7f1320199ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 >> 172.21.15.12:0/1662909560 conn(0x7f13200fca10 msgr2=0x7f1320073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:50.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 shutdown_connections 2023-12-11T20:13:50.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.197+0000 7f1327fff700 1 -- 172.21.15.12:0/1662909560 wait complete. 2023-12-11T20:13:50.215 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-11T20:13:50.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-11T20:13:50.281 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:50 smithi012 ceph-mon[128787]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:50.282 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:50 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/231627688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:50.282 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:50 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2690816996' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:50.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:50 smithi039 ceph-mon[102205]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:50.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:50 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/231627688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:50.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:50 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2690816996' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 -- 172.21.15.12:0/2516182338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 msgr2=0x7fc2f00744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/2516182338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 0x7fc2f00744b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40098f0 tx=0x7fc2e4009c00 comp rx=0 tx=0).stop 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 -- 172.21.15.12:0/2516182338 shutdown_connections 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/2516182338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f010da80 0x7fc2f010fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/2516182338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f0075610 0x7fc2f0073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/2516182338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 0x7fc2f00744b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 -- 172.21.15.12:0/2516182338 >> 172.21.15.12:0/2516182338 conn(0x7fc2f00fca00 msgr2=0x7fc2f00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 -- 172.21.15.12:0/2516182338 shutdown_connections 2023-12-11T20:13:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.432+0000 7fc2f4dff700 1 -- 172.21.15.12:0/2516182338 wait complete. 2023-12-11T20:13:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.434+0000 7fc2f4dff700 1 Processor -- start 2023-12-11T20:13:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.434+0000 7fc2f4dff700 1 -- start start 2023-12-11T20:13:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.434+0000 7fc2f4dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 0x7fc2f019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2f4dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f0075610 0x7fc2f019df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2f4dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f010da80 0x7fc2f01a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2f4dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01a5560 con 0x7fc2f010da80 2023-12-11T20:13:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2f4dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01a56a0 con 0x7fc2f0075610 2023-12-11T20:13:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2f4dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01a5830 con 0x7fc2f0074030 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2edd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f0075610 0x7fc2f019df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2edd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f0075610 0x7fc2f019df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35572/0 (socket says 172.21.15.12:35572) 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2edd9b700 1 -- 172.21.15.12:0/4019793399 learned_addr learned my addr 172.21.15.12:0/4019793399 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2eed9d700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f010da80 0x7fc2f01a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2ee59c700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 0x7fc2f019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2edd9b700 1 -- 172.21.15.12:0/4019793399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 msgr2=0x7fc2f019da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2edd9b700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 0x7fc2f019da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2edd9b700 1 -- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f010da80 msgr2=0x7fc2f01a4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2edd9b700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f010da80 0x7fc2f01a4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2edd9b700 1 -- 172.21.15.12:0/4019793399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009520 con 0x7fc2f0075610 2023-12-11T20:13:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.435+0000 7fc2ee59c700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 0x7fc2f019da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.436+0000 7fc2edd9b700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f0075610 0x7fc2f019df70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400fb00 tx=0x7fc2e400b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.436+0000 7fc2df7fe700 1 -- 172.21.15.12:0/4019793399 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e401c070 con 0x7fc2f0075610 2023-12-11T20:13:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.436+0000 7fc2df7fe700 1 -- 172.21.15.12:0/4019793399 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2e400bec0 con 0x7fc2f0075610 2023-12-11T20:13:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.436+0000 7fc2df7fe700 1 -- 172.21.15.12:0/4019793399 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40038e0 con 0x7fc2f0075610 2023-12-11T20:13:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.436+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f01a5ab0 con 0x7fc2f0075610 2023-12-11T20:13:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.436+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f01a5e80 con 0x7fc2f0075610 2023-12-11T20:13:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.437+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f0103ce0 con 0x7fc2f0075610 2023-12-11T20:13:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.439+0000 7fc2df7fe700 1 -- 172.21.15.12:0/4019793399 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc2e4020030 con 0x7fc2f0075610 2023-12-11T20:13:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.440+0000 7fc2df7fe700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2d80a1500 0x7fc2d80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.440+0000 7fc2df7fe700 1 -- 172.21.15.12:0/4019793399 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc2e40cd9e0 con 0x7fc2f0075610 2023-12-11T20:13:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.440+0000 7fc2ee59c700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2d80a1500 0x7fc2d80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.441+0000 7fc2ee59c700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2d80a1500 0x7fc2d80a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0005fd0 tx=0x7fc2e0009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.443+0000 7fc2df7fe700 1 -- 172.21.15.12:0/4019793399 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc2e40974d0 con 0x7fc2f0075610 2023-12-11T20:13:50.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:50 smithi032 ceph-mon[132488]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:50.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:50 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/231627688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:50.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:50 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2690816996' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:13:50.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:50.657+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc2f0068330 con 0x7fc2f0075610 2023-12-11T20:13:51.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.436+0000 7fc2df7fe700 1 -- 172.21.15.12:0/4019793399 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc2e409aaf0 con 0x7fc2f0075610 2023-12-11T20:13:51.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2d80a1500 msgr2=0x7fc2d80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:51.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2d80a1500 0x7fc2d80a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0005fd0 tx=0x7fc2e0009310 comp rx=0 tx=0).stop 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f0075610 msgr2=0x7fc2f019df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f0075610 0x7fc2f019df70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400fb00 tx=0x7fc2e400b790 comp rx=0 tx=0).stop 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 shutdown_connections 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2d80a1500 0x7fc2d80a39c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f010da80 0x7fc2f01a4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2f0074030 0x7fc2f019da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 --2- 172.21.15.12:0/4019793399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f0075610 0x7fc2f019df70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.441+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 >> 172.21.15.12:0/4019793399 conn(0x7fc2f00fca00 msgr2=0x7fc2f0100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.442+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 shutdown_connections 2023-12-11T20:13:51.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.442+0000 7fc2f4dff700 1 -- 172.21.15.12:0/4019793399 wait complete. 2023-12-11T20:13:51.441 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-12-11T20:13:51.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:51 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1662909560' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-11T20:13:51.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.459 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-11T20:13:51.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:51 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1662909560' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-11T20:13:51.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:51 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1662909560' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-11T20:13:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 -- 172.21.15.12:0/2305367943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c1014a0 msgr2=0x7f323c1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 --2- 172.21.15.12:0/2305367943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c1014a0 0x7f323c1018c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f32380099c0 tx=0x7f3238009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 -- 172.21.15.12:0/2305367943 shutdown_connections 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 --2- 172.21.15.12:0/2305367943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f323c103030 0x7f323c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 --2- 172.21.15.12:0/2305367943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c1014a0 0x7f323c1018c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 --2- 172.21.15.12:0/2305367943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f323c102690 0x7f323c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 -- 172.21.15.12:0/2305367943 >> 172.21.15.12:0/2305367943 conn(0x7f323c0fca30 msgr2=0x7f323c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 -- 172.21.15.12:0/2305367943 shutdown_connections 2023-12-11T20:13:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.673+0000 7f32447ff700 1 -- 172.21.15.12:0/2305367943 wait complete. 2023-12-11T20:13:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.674+0000 7f32447ff700 1 Processor -- start 2023-12-11T20:13:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f32447ff700 1 -- start start 2023-12-11T20:13:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f32447ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f323c1014a0 0x7f323c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f32447ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c102690 0x7f323c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f32447ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f323c103030 0x7f323c1a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f32447ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1a10e0 con 0x7f323c102690 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f32447ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1a1220 con 0x7f323c1014a0 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f32447ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1a13b0 con 0x7f323c103030 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f3241d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c102690 0x7f323c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f324259b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f323c1014a0 0x7f323c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f3241d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c102690 0x7f323c199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38010/0 (socket says 172.21.15.12:38010) 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f3241d9a700 1 -- 172.21.15.12:0/79365528 learned_addr learned my addr 172.21.15.12:0/79365528 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.675+0000 7f3242d9c700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f323c103030 0x7f323c1a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f324259b700 1 -- 172.21.15.12:0/79365528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f323c103030 msgr2=0x7f323c1a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f324259b700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f323c103030 0x7f323c1a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f324259b700 1 -- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c102690 msgr2=0x7f323c199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f324259b700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c102690 0x7f323c199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f324259b700 1 -- 172.21.15.12:0/79365528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32380095f0 con 0x7f323c1014a0 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f324259b700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f323c1014a0 0x7f323c1995b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f32380098e0 tx=0x7f323800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f32337fe700 1 -- 172.21.15.12:0/79365528 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323801d070 con 0x7f323c1014a0 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f32337fe700 1 -- 172.21.15.12:0/79365528 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3238005050 con 0x7f323c1014a0 2023-12-11T20:13:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f32337fe700 1 -- 172.21.15.12:0/79365528 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238004a70 con 0x7f323c1014a0 2023-12-11T20:13:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.676+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c1a1630 con 0x7f323c1014a0 2023-12-11T20:13:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.677+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c1a1a50 con 0x7f323c1014a0 2023-12-11T20:13:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.677+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c068780 con 0x7f323c1014a0 2023-12-11T20:13:51.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.680+0000 7f32337fe700 1 -- 172.21.15.12:0/79365528 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f32380051c0 con 0x7f323c1014a0 2023-12-11T20:13:51.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.681+0000 7f32337fe700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32280a1500 0x7f32280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:51.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.681+0000 7f32337fe700 1 -- 172.21.15.12:0/79365528 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f32380cd660 con 0x7f323c1014a0 2023-12-11T20:13:51.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.681+0000 7f3241d9a700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32280a1500 0x7f32280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:51.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.682+0000 7f3241d9a700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32280a1500 0x7f32280a39c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f322c009d20 tx=0x7f322c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:51.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.684+0000 7f32337fe700 1 -- 172.21.15.12:0/79365528 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3238096fe0 con 0x7f323c1014a0 2023-12-11T20:13:51.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:51.919+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f323c10cbb0 con 0x7f323c1014a0 2023-12-11T20:13:52.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.462+0000 7f32337fe700 1 -- 172.21.15.12:0/79365528 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7f323809a600 con 0x7f323c1014a0 2023-12-11T20:13:52.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.468+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32280a1500 msgr2=0x7f32280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:52.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.468+0000 7f32447ff700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32280a1500 0x7f32280a39c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f322c009d20 tx=0x7f322c009260 comp rx=0 tx=0).stop 2023-12-11T20:13:52.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.468+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f323c1014a0 msgr2=0x7f323c1995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:52.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.468+0000 7f32447ff700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f323c1014a0 0x7f323c1995b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f32380098e0 tx=0x7f323800f690 comp rx=0 tx=0).stop 2023-12-11T20:13:52.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.469+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 shutdown_connections 2023-12-11T20:13:52.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.469+0000 7f32447ff700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32280a1500 0x7f32280a39c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.469+0000 7f32447ff700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f323c1014a0 0x7f323c1995b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.469+0000 7f32447ff700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f323c103030 0x7f323c1a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.469+0000 7f32447ff700 1 --2- 172.21.15.12:0/79365528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f323c102690 0x7f323c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.469+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 >> 172.21.15.12:0/79365528 conn(0x7f323c0fca30 msgr2=0x7f323c107e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:52.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.470+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 shutdown_connections 2023-12-11T20:13:52.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.470+0000 7f32447ff700 1 -- 172.21.15.12:0/79365528 wait complete. 2023-12-11T20:13:52.471 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-12-11T20:13:52.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4019793399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: osdmap e82: 12 total, 12 up, 12 in 2023-12-11T20:13:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:52 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.717+0000 7f3d24fff700 1 -- 172.21.15.12:0/1111688225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d20103050 msgr2=0x7f3d20109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.717+0000 7f3d24fff700 1 --2- 172.21.15.12:0/1111688225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d20103050 0x7f3d20109900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800b0d0 tx=0x7f3d1800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.718+0000 7f3d24fff700 1 -- 172.21.15.12:0/1111688225 shutdown_connections 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.718+0000 7f3d24fff700 1 --2- 172.21.15.12:0/1111688225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d20103050 0x7f3d20109900 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.718+0000 7f3d24fff700 1 --2- 172.21.15.12:0/1111688225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d201014c0 0x7f3d201018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.718+0000 7f3d24fff700 1 --2- 172.21.15.12:0/1111688225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d201026b0 0x7f3d20102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.718+0000 7f3d24fff700 1 -- 172.21.15.12:0/1111688225 >> 172.21.15.12:0/1111688225 conn(0x7f3d200fca30 msgr2=0x7f3d200fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.718+0000 7f3d24fff700 1 -- 172.21.15.12:0/1111688225 shutdown_connections 2023-12-11T20:13:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.718+0000 7f3d24fff700 1 -- 172.21.15.12:0/1111688225 wait complete. 2023-12-11T20:13:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d24fff700 1 Processor -- start 2023-12-11T20:13:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d24fff700 1 -- start start 2023-12-11T20:13:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d24fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d201014c0 0x7f3d20199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d24fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d201026b0 0x7f3d20199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d24fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103050 0x7f3d201a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d24fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d201a1150 con 0x7f3d201014c0 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d24fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d201a1290 con 0x7f3d201026b0 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d24fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d201a1420 con 0x7f3d20103050 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d1e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d201014c0 0x7f3d20199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d1e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d201014c0 0x7f3d20199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38028/0 (socket says 172.21.15.12:38028) 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d1e59c700 1 -- 172.21.15.12:0/3979448450 learned_addr learned my addr 172.21.15.12:0/3979448450 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d1ed9d700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103050 0x7f3d201a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.719+0000 7f3d1dd9b700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d201026b0 0x7f3d20199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d1e59c700 1 -- 172.21.15.12:0/3979448450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103050 msgr2=0x7f3d201a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d1e59c700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103050 0x7f3d201a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d1e59c700 1 -- 172.21.15.12:0/3979448450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d201026b0 msgr2=0x7f3d20199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d1e59c700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d201026b0 0x7f3d20199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d1e59c700 1 -- 172.21.15.12:0/3979448450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18009d00 con 0x7f3d201014c0 2023-12-11T20:13:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d1e59c700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d201014c0 0x7f3d20199670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000d980 tx=0x7f3d1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d0f7fe700 1 -- 172.21.15.12:0/3979448450 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10004020 con 0x7f3d201014c0 2023-12-11T20:13:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d0f7fe700 1 -- 172.21.15.12:0/3979448450 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d1000f690 con 0x7f3d201014c0 2023-12-11T20:13:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d0f7fe700 1 -- 172.21.15.12:0/3979448450 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100039e0 con 0x7f3d201014c0 2023-12-11T20:13:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d201a1700 con 0x7f3d201014c0 2023-12-11T20:13:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.720+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d201a1bc0 con 0x7f3d201014c0 2023-12-11T20:13:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.721+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d20068330 con 0x7f3d201014c0 2023-12-11T20:13:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.724+0000 7f3d0f7fe700 1 -- 172.21.15.12:0/3979448450 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3d1000f800 con 0x7f3d201014c0 2023-12-11T20:13:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.725+0000 7f3d0f7fe700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3d080a1500 0x7f3d080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.725+0000 7f3d0f7fe700 1 -- 172.21.15.12:0/3979448450 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f3d100cca60 con 0x7f3d201014c0 2023-12-11T20:13:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.725+0000 7f3d1dd9b700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3d080a1500 0x7f3d080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:52.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.726+0000 7f3d1dd9b700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3d080a1500 0x7f3d080a39c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009c60 tx=0x7f3d14009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:52.728+0000 7f3d0f7fe700 1 -- 172.21.15.12:0/3979448450 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3d10096250 con 0x7f3d201014c0 2023-12-11T20:13:52.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4019793399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-11T20:13:52.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-11T20:13:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-11T20:13:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: osdmap e82: 12 total, 12 up, 12 in 2023-12-11T20:13:52.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:52 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4019793399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-11T20:13:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-11T20:13:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-11T20:13:52.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: osdmap e82: 12 total, 12 up, 12 in 2023-12-11T20:13:52.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:52 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:13:53.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.007+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3d2010cb80 con 0x7f3d201014c0 2023-12-11T20:13:53.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.466+0000 7f3d0f7fe700 1 -- 172.21.15.12:0/3979448450 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3d10099870 con 0x7f3d201014c0 2023-12-11T20:13:53.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.468+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3d080a1500 msgr2=0x7f3d080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:53.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.468+0000 7f3d24fff700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3d080a1500 0x7f3d080a39c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009c60 tx=0x7f3d14009260 comp rx=0 tx=0).stop 2023-12-11T20:13:53.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.468+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d201014c0 msgr2=0x7f3d20199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:53.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.468+0000 7f3d24fff700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d201014c0 0x7f3d20199670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000d980 tx=0x7f3d1000dc90 comp rx=0 tx=0).stop 2023-12-11T20:13:53.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.469+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 shutdown_connections 2023-12-11T20:13:53.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.469+0000 7f3d24fff700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3d080a1500 0x7f3d080a39c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.469+0000 7f3d24fff700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d20103050 0x7f3d201a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.469+0000 7f3d24fff700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d201014c0 0x7f3d20199670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.469+0000 7f3d24fff700 1 --2- 172.21.15.12:0/3979448450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d201026b0 0x7f3d20199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.469+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 >> 172.21.15.12:0/3979448450 conn(0x7f3d200fca30 msgr2=0x7f3d20073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:53.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.469+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 shutdown_connections 2023-12-11T20:13:53.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.469+0000 7f3d24fff700 1 -- 172.21.15.12:0/3979448450 wait complete. 2023-12-11T20:13:53.468 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2023-12-11T20:13:53.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.706+0000 7f732a5ff700 1 -- 172.21.15.12:0/1778902647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 msgr2=0x7f73241042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.706+0000 7f732a5ff700 1 --2- 172.21.15.12:0/1778902647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 0x7f73241042a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7314009990 tx=0x7f7314009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.707+0000 7f732a5ff700 1 -- 172.21.15.12:0/1778902647 shutdown_connections 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.707+0000 7f732a5ff700 1 --2- 172.21.15.12:0/1778902647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7324107110 0x7f7324109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.707+0000 7f732a5ff700 1 --2- 172.21.15.12:0/1778902647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 0x7f73241042a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.707+0000 7f732a5ff700 1 --2- 172.21.15.12:0/1778902647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73241047e0 0x7f7324106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.707+0000 7f732a5ff700 1 -- 172.21.15.12:0/1778902647 >> 172.21.15.12:0/1778902647 conn(0x7f73240fb8c0 msgr2=0x7f73240fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.707+0000 7f732a5ff700 1 -- 172.21.15.12:0/1778902647 shutdown_connections 2023-12-11T20:13:53.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.707+0000 7f732a5ff700 1 -- 172.21.15.12:0/1778902647 wait complete. 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.708+0000 7f732a5ff700 1 Processor -- start 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.708+0000 7f732a5ff700 1 -- start start 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.708+0000 7f732a5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 0x7f73241017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.708+0000 7f732a5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73241047e0 0x7f73240ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.708+0000 7f732a5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7324107110 0x7f73241003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.708+0000 7f732a5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732419b160 con 0x7f7324101eb0 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.708+0000 7f732a5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73241008e0 con 0x7f73241047e0 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.708+0000 7f732a5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7324100aa0 con 0x7f7324107110 2023-12-11T20:13:53.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 0x7f73241017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 0x7f73241017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38050/0 (socket says 172.21.15.12:38050) 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 -- 172.21.15.12:0/346943052 learned_addr learned my addr 172.21.15.12:0/346943052 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f73237fe700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73241047e0 0x7f73240ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7328b9c700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7324107110 0x7f73241003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 -- 172.21.15.12:0/346943052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7324107110 msgr2=0x7f73241003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7324107110 0x7f73241003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 -- 172.21.15.12:0/346943052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73241047e0 msgr2=0x7f73240ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73241047e0 0x7f73240ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 -- 172.21.15.12:0/346943052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140095f0 con 0x7f7324101eb0 2023-12-11T20:13:53.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f73237fe700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73241047e0 0x7f73240ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:13:53.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.709+0000 7f7323fff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 0x7f73241017d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7314003ec0 tx=0x7f7314005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:53.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.710+0000 7f73217fa700 1 -- 172.21.15.12:0/346943052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731401d070 con 0x7f7324101eb0 2023-12-11T20:13:53.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.710+0000 7f73217fa700 1 -- 172.21.15.12:0/346943052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f731400bdb0 con 0x7f7324101eb0 2023-12-11T20:13:53.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.710+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7324100cc0 con 0x7f7324101eb0 2023-12-11T20:13:53.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.710+0000 7f73217fa700 1 -- 172.21.15.12:0/346943052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400fe30 con 0x7f7324101eb0 2023-12-11T20:13:53.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.710+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73241a5e00 con 0x7f7324101eb0 2023-12-11T20:13:53.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.711+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73240fd440 con 0x7f7324101eb0 2023-12-11T20:13:53.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:53 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/79365528' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-11T20:13:53.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:53 smithi032 ceph-mon[132488]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-11T20:13:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:53 smithi032 ceph-mon[132488]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-11T20:13:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:53 smithi032 ceph-mon[132488]: osdmap e83: 12 total, 12 up, 12 in 2023-12-11T20:13:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:53 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3979448450' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-11T20:13:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:53 smithi032 ceph-mon[132488]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-11T20:13:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:53 smithi032 ceph-mon[132488]: pgmap v308: 97 pgs: 6 creating+peering, 1 active+clean, 90 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:53 smithi032 ceph-mon[132488]: osdmap e84: 12 total, 12 up, 12 in 2023-12-11T20:13:53.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.715+0000 7f73217fa700 1 -- 172.21.15.12:0/346943052 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f731400f5d0 con 0x7f7324101eb0 2023-12-11T20:13:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.717+0000 7f73217fa700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f730c0a1500 0x7f730c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.717+0000 7f73217fa700 1 -- 172.21.15.12:0/346943052 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f73140ce2a0 con 0x7f7324101eb0 2023-12-11T20:13:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.718+0000 7f73237fe700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f730c0a1500 0x7f730c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:53.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.718+0000 7f73237fe700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f730c0a1500 0x7f730c0a39c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7318011490 tx=0x7f7318009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:53.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.720+0000 7f73217fa700 1 -- 172.21.15.12:0/346943052 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7314097a40 con 0x7f7324101eb0 2023-12-11T20:13:53.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:53 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/79365528' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-11T20:13:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:53 smithi039 ceph-mon[102205]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-11T20:13:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:53 smithi039 ceph-mon[102205]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-11T20:13:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:53 smithi039 ceph-mon[102205]: osdmap e83: 12 total, 12 up, 12 in 2023-12-11T20:13:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:53 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3979448450' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-11T20:13:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:53 smithi039 ceph-mon[102205]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-11T20:13:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:53 smithi039 ceph-mon[102205]: pgmap v308: 97 pgs: 6 creating+peering, 1 active+clean, 90 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:53.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:53 smithi039 ceph-mon[102205]: osdmap e84: 12 total, 12 up, 12 in 2023-12-11T20:13:53.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:53 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/79365528' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-11T20:13:53.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:53 smithi012 ceph-mon[128787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-11T20:13:53.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:53 smithi012 ceph-mon[128787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-11T20:13:53.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:53 smithi012 ceph-mon[128787]: osdmap e83: 12 total, 12 up, 12 in 2023-12-11T20:13:53.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:53 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3979448450' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-11T20:13:53.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:53 smithi012 ceph-mon[128787]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-11T20:13:53.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:53 smithi012 ceph-mon[128787]: pgmap v308: 97 pgs: 6 creating+peering, 1 active+clean, 90 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-11T20:13:53.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:53 smithi012 ceph-mon[128787]: osdmap e84: 12 total, 12 up, 12 in 2023-12-11T20:13:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.941+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7324068330 con 0x7f7324101eb0 2023-12-11T20:13:53.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.942+0000 7f73217fa700 1 -- 172.21.15.12:0/346943052 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22062 (secure 0 0 0) 0x7f731409b060 con 0x7f7324101eb0 2023-12-11T20:13:53.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:53.941 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":84,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:13:53.008840+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f730c0a1500 msgr2=0x7f730c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f730c0a1500 0x7f730c0a39c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7318011490 tx=0x7f7318009260 comp rx=0 tx=0).stop 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 msgr2=0x7f73241017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 0x7f73241017d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7314003ec0 tx=0x7f7314005740 comp rx=0 tx=0).stop 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 shutdown_connections 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f730c0a1500 0x7f730c0a39c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7324107110 0x7f73241003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7324101eb0 0x7f73241017d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 --2- 172.21.15.12:0/346943052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73241047e0 0x7f73240ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 >> 172.21.15.12:0/346943052 conn(0x7f73240fb8c0 msgr2=0x7f7324103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:53.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 shutdown_connections 2023-12-11T20:13:53.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:53.945+0000 7f732a5ff700 1 -- 172.21.15.12:0/346943052 wait complete. 2023-12-11T20:13:53.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:13:54.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 -- 172.21.15.12:0/2252274436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c4073fd0 msgr2=0x7f63c4074450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:54.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 --2- 172.21.15.12:0/2252274436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c4073fd0 0x7f63c4074450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009990 tx=0x7f63b0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 -- 172.21.15.12:0/2252274436 shutdown_connections 2023-12-11T20:13:54.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 --2- 172.21.15.12:0/2252274436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c40755b0 0x7f63c4073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 --2- 172.21.15.12:0/2252274436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63c4109370 0x7f63c410b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 --2- 172.21.15.12:0/2252274436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c4073fd0 0x7f63c4074450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 -- 172.21.15.12:0/2252274436 >> 172.21.15.12:0/2252274436 conn(0x7f63c40fca10 msgr2=0x7f63c40fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:54.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 -- 172.21.15.12:0/2252274436 shutdown_connections 2023-12-11T20:13:54.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.175+0000 7f63cadff700 1 -- 172.21.15.12:0/2252274436 wait complete. 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.176+0000 7f63cadff700 1 Processor -- start 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.176+0000 7f63cadff700 1 -- start start 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63cadff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63c4073fd0 0x7f63c4199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63cadff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c40755b0 0x7f63c4199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63cadff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c4109370 0x7f63c41a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63cadff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41a1090 con 0x7f63c4109370 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63cadff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41a11d0 con 0x7f63c40755b0 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63cadff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c41a1360 con 0x7f63c4073fd0 2023-12-11T20:13:54.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c939c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c4109370 0x7f63c41a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c8b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63c4073fd0 0x7f63c4199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c40755b0 0x7f63c4199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c8b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63c4073fd0 0x7f63c4199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54404/0 (socket says 172.21.15.12:54404) 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c8b9b700 1 -- 172.21.15.12:0/3657229534 learned_addr learned my addr 172.21.15.12:0/3657229534 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c8b9b700 1 -- 172.21.15.12:0/3657229534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c40755b0 msgr2=0x7f63c4199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c8b9b700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c40755b0 0x7f63c4199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c8b9b700 1 -- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c4109370 msgr2=0x7f63c41a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c8b9b700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c4109370 0x7f63c41a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.177+0000 7f63c8b9b700 1 -- 172.21.15.12:0/3657229534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00095f0 con 0x7f63c4073fd0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.178+0000 7f63c8b9b700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63c4073fd0 0x7f63c4199560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63b800d950 tx=0x7f63b800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.178+0000 7f63c1ffb700 1 -- 172.21.15.12:0/3657229534 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800f890 con 0x7f63c4073fd0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.178+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c41a1640 con 0x7f63c4073fd0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.178+0000 7f63c1ffb700 1 -- 172.21.15.12:0/3657229534 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63b800fe80 con 0x7f63c4073fd0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.178+0000 7f63c1ffb700 1 -- 172.21.15.12:0/3657229534 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800e3b0 con 0x7f63c4073fd0 2023-12-11T20:13:54.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.178+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c41a1b50 con 0x7f63c4073fd0 2023-12-11T20:13:54.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.179+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c4108180 con 0x7f63c4073fd0 2023-12-11T20:13:54.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.181+0000 7f63c1ffb700 1 -- 172.21.15.12:0/3657229534 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f63b8010460 con 0x7f63c4073fd0 2023-12-11T20:13:54.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.182+0000 7f63c1ffb700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f63b40a1480 0x7f63b40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:54.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.182+0000 7f63c1ffb700 1 -- 172.21.15.12:0/3657229534 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f63b80cca30 con 0x7f63c4073fd0 2023-12-11T20:13:54.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.183+0000 7f63c3fff700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f63b40a1480 0x7f63b40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:54.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.183+0000 7f63c3fff700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f63b40a1480 0x7f63b40a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f63b0006010 tx=0x7f63b000b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:54.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.187+0000 7f63c1ffb700 1 -- 172.21.15.12:0/3657229534 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f63b8096140 con 0x7f63c4073fd0 2023-12-11T20:13:54.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.412+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63c4068780 con 0x7f63c4073fd0 2023-12-11T20:13:54.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.414+0000 7f63c1ffb700 1 -- 172.21.15.12:0/3657229534 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22049 (secure 0 0 0) 0x7f63b8016090 con 0x7f63c4073fd0 2023-12-11T20:13:54.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:13:54.412 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:13:54.249592+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:13:54.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f63b40a1480 msgr2=0x7f63b40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:54.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f63b40a1480 0x7f63b40a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f63b0006010 tx=0x7f63b000b610 comp rx=0 tx=0).stop 2023-12-11T20:13:54.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63c4073fd0 msgr2=0x7f63c4199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:54.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63c4073fd0 0x7f63c4199560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63b800d950 tx=0x7f63b800dc60 comp rx=0 tx=0).stop 2023-12-11T20:13:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 shutdown_connections 2023-12-11T20:13:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f63b40a1480 0x7f63b40a3940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c4109370 0x7f63c41a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63c4073fd0 0x7f63c4199560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 --2- 172.21.15.12:0/3657229534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63c40755b0 0x7f63c4199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 >> 172.21.15.12:0/3657229534 conn(0x7f63c40fca10 msgr2=0x7f63c41052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 shutdown_connections 2023-12-11T20:13:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.416+0000 7f63cadff700 1 -- 172.21.15.12:0/3657229534 wait complete. 2023-12-11T20:13:54.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-11T20:13:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.651+0000 7f7ce97ff700 1 -- 172.21.15.12:0/1810079074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41014b0 msgr2=0x7f7ce41018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.651+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/1810079074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41014b0 0x7f7ce41018d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40099c0 tx=0x7f7cd4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.652+0000 7f7ce97ff700 1 -- 172.21.15.12:0/1810079074 shutdown_connections 2023-12-11T20:13:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.652+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/1810079074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ce4103040 0x7f7ce41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.652+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/1810079074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41014b0 0x7f7ce41018d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.652+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/1810079074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce41026a0 0x7f7ce4102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.652+0000 7f7ce97ff700 1 -- 172.21.15.12:0/1810079074 >> 172.21.15.12:0/1810079074 conn(0x7f7ce40fca00 msgr2=0x7f7ce40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.652+0000 7f7ce97ff700 1 -- 172.21.15.12:0/1810079074 shutdown_connections 2023-12-11T20:13:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.652+0000 7f7ce97ff700 1 -- 172.21.15.12:0/1810079074 wait complete. 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce97ff700 1 Processor -- start 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce97ff700 1 -- start start 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce97ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce41014b0 0x7f7ce41995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce97ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41026a0 0x7f7ce4199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce97ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ce4103040 0x7f7ce41a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce97ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce41a10d0 con 0x7f7ce41026a0 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce97ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce41a1210 con 0x7f7ce4103040 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce97ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce41a13a0 con 0x7f7ce41014b0 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.653+0000 7f7ce27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41026a0 0x7f7ce4199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41026a0 0x7f7ce4199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38084/0 (socket says 172.21.15.12:38084) 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce27fc700 1 -- 172.21.15.12:0/852651406 learned_addr learned my addr 172.21.15.12:0/852651406 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce37fe700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ce4103040 0x7f7ce41a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce2ffd700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce41014b0 0x7f7ce41995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce27fc700 1 -- 172.21.15.12:0/852651406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce41014b0 msgr2=0x7f7ce41995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce27fc700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce41014b0 0x7f7ce41995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce27fc700 1 -- 172.21.15.12:0/852651406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ce4103040 msgr2=0x7f7ce41a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce27fc700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ce4103040 0x7f7ce41a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce27fc700 1 -- 172.21.15.12:0/852651406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40095f0 con 0x7f7ce41026a0 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce27fc700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41026a0 0x7f7ce4199ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800e9a0 tx=0x7f7cd800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ccbfff700 1 -- 172.21.15.12:0/852651406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8009790 con 0x7f7ce41026a0 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce41a1680 con 0x7f7ce41026a0 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ccbfff700 1 -- 172.21.15.12:0/852651406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cd800cbd0 con 0x7f7ce41026a0 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.654+0000 7f7ccbfff700 1 -- 172.21.15.12:0/852651406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8018680 con 0x7f7ce41026a0 2023-12-11T20:13:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.655+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce41a1be0 con 0x7f7ce41026a0 2023-12-11T20:13:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.656+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce4193bc0 con 0x7f7ce41026a0 2023-12-11T20:13:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.658+0000 7f7ccbfff700 1 -- 172.21.15.12:0/852651406 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7cd800cd40 con 0x7f7ce41026a0 2023-12-11T20:13:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.659+0000 7f7ccbfff700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ccc0a1480 0x7f7ccc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.659+0000 7f7ccbfff700 1 -- 172.21.15.12:0/852651406 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7cd8014070 con 0x7f7ce41026a0 2023-12-11T20:13:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.659+0000 7f7ce2ffd700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ccc0a1480 0x7f7ccc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.660+0000 7f7ce2ffd700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ccc0a1480 0x7f7ccc0a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009990 tx=0x7f7cd4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:54.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.663+0000 7f7ccbfff700 1 -- 172.21.15.12:0/852651406 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7cd80522f0 con 0x7f7ce41026a0 2023-12-11T20:13:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:54 smithi032 ceph-mon[132488]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-11T20:13:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:54 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3979448450' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-11T20:13:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:54 smithi032 ceph-mon[132488]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-11T20:13:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:54 smithi032 ceph-mon[132488]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-11T20:13:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:54 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/346943052' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:54 smithi032 ceph-mon[132488]: osdmap e85: 12 total, 12 up, 12 in 2023-12-11T20:13:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:54 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3657229534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:54.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:54 smithi039 ceph-mon[102205]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-11T20:13:54.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3979448450' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-11T20:13:54.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:54 smithi039 ceph-mon[102205]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-11T20:13:54.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:54 smithi039 ceph-mon[102205]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-11T20:13:54.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/346943052' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:54.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:54 smithi039 ceph-mon[102205]: osdmap e85: 12 total, 12 up, 12 in 2023-12-11T20:13:54.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3657229534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:54 smithi012 ceph-mon[128787]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-11T20:13:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3979448450' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-11T20:13:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:54 smithi012 ceph-mon[128787]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-11T20:13:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:54 smithi012 ceph-mon[128787]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-11T20:13:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/346943052' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:54 smithi012 ceph-mon[128787]: osdmap e85: 12 total, 12 up, 12 in 2023-12-11T20:13:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3657229534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:13:54.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:54.935+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7ce402d310 con 0x7f7ce41026a0 2023-12-11T20:13:55.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.478+0000 7f7ccbfff700 1 -- 172.21.15.12:0/852651406 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7cd80d2020 con 0x7f7ce41026a0 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ccc0a1480 msgr2=0x7f7ccc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ccc0a1480 0x7f7ccc0a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009990 tx=0x7f7cd4005fb0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41026a0 msgr2=0x7f7ce4199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41026a0 0x7f7ce4199ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800e9a0 tx=0x7f7cd800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 shutdown_connections 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ccc0a1480 0x7f7ccc0a3940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ce4103040 0x7f7ce41a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ce41014b0 0x7f7ce41995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 --2- 172.21.15.12:0/852651406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ce41026a0 0x7f7ce4199ae0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 >> 172.21.15.12:0/852651406 conn(0x7f7ce40fca00 msgr2=0x7f7ce4107f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:55.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 shutdown_connections 2023-12-11T20:13:55.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.481+0000 7f7ce97ff700 1 -- 172.21.15.12:0/852651406 wait complete. 2023-12-11T20:13:55.498 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-12-11T20:13:55.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-11T20:13:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 -- 172.21.15.12:0/583545105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80109370 msgr2=0x7fea8010b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 --2- 172.21.15.12:0/583545105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80109370 0x7fea8010b800 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fea7800b0a0 tx=0x7fea7800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 -- 172.21.15.12:0/583545105 shutdown_connections 2023-12-11T20:13:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 --2- 172.21.15.12:0/583545105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea80075610 0x7fea80073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 --2- 172.21.15.12:0/583545105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80109370 0x7fea8010b800 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 --2- 172.21.15.12:0/583545105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea80074030 0x7fea800744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 -- 172.21.15.12:0/583545105 >> 172.21.15.12:0/583545105 conn(0x7fea800fca00 msgr2=0x7fea800fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 -- 172.21.15.12:0/583545105 shutdown_connections 2023-12-11T20:13:55.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.707+0000 7fea86dff700 1 -- 172.21.15.12:0/583545105 wait complete. 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea86dff700 1 Processor -- start 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea86dff700 1 -- start start 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea86dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80074030 0x7fea80199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea86dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea80075610 0x7fea80199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea86dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea80109370 0x7fea801a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea86dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea801a1160 con 0x7fea80074030 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea86dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea801a12a0 con 0x7fea80075610 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea86dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea801a1430 con 0x7fea80109370 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea84b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80074030 0x7fea80199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:55.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea84b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80074030 0x7fea80199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38100/0 (socket says 172.21.15.12:38100) 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.708+0000 7fea84b9b700 1 -- 172.21.15.12:0/2841666712 learned_addr learned my addr 172.21.15.12:0/2841666712 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea7ffff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea80075610 0x7fea80199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea8539c700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea80109370 0x7fea801a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea84b9b700 1 -- 172.21.15.12:0/2841666712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea80109370 msgr2=0x7fea801a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea84b9b700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea80109370 0x7fea801a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea84b9b700 1 -- 172.21.15.12:0/2841666712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea80075610 msgr2=0x7fea80199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea84b9b700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea80075610 0x7fea80199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea84b9b700 1 -- 172.21.15.12:0/2841666712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009d00 con 0x7fea80074030 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea7ffff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea80075610 0x7fea80199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea8539c700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea80109370 0x7fea801a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea84b9b700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80074030 0x7fea80199630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fea7400e9a0 tx=0x7fea7400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea7dffb700 1 -- 172.21.15.12:0/2841666712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74009790 con 0x7fea80074030 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea7dffb700 1 -- 172.21.15.12:0/2841666712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea7400cbd0 con 0x7fea80074030 2023-12-11T20:13:55.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea801a1710 con 0x7fea80074030 2023-12-11T20:13:55.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea7dffb700 1 -- 172.21.15.12:0/2841666712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74018680 con 0x7fea80074030 2023-12-11T20:13:55.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.709+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea801a1c20 con 0x7fea80074030 2023-12-11T20:13:55.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.711+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea80108130 con 0x7fea80074030 2023-12-11T20:13:55.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.714+0000 7fea7dffb700 1 -- 172.21.15.12:0/2841666712 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fea7400cd40 con 0x7fea80074030 2023-12-11T20:13:55.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.715+0000 7fea7dffb700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea700a1480 0x7fea700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:55.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.716+0000 7fea7dffb700 1 -- 172.21.15.12:0/2841666712 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fea74014070 con 0x7fea80074030 2023-12-11T20:13:55.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.716+0000 7fea7ffff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea700a1480 0x7fea700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:55.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.716+0000 7fea7ffff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea700a1480 0x7fea700a3940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea80075330 tx=0x7fea6c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:55.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.717+0000 7fea7dffb700 1 -- 172.21.15.12:0/2841666712 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fea74096850 con 0x7fea80074030 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] up:active 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/852651406' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: pgmap v311: 97 pgs: 1 active, 6 creating+peering, 34 active+clean, 56 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:55.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:55.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:55 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] up:active 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/852651406' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: pgmap v311: 97 pgs: 1 active, 6 creating+peering, 34 active+clean, 56 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:55.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:55.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:55 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] up:active 2023-12-11T20:13:55.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:55.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:55.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/852651406' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-11T20:13:55.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: pgmap v311: 97 pgs: 1 active, 6 creating+peering, 34 active+clean, 56 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-12-11T20:13:55.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:13:55.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:13:55.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:55 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:13:55.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:55.984+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fea8010f020 con 0x7fea80074030 2023-12-11T20:13:56.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.479+0000 7fea7dffb700 1 -- 172.21.15.12:0/2841666712 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7fea74026020 con 0x7fea80074030 2023-12-11T20:13:56.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea700a1480 msgr2=0x7fea700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea700a1480 0x7fea700a3940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea80075330 tx=0x7fea6c009260 comp rx=0 tx=0).stop 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80074030 msgr2=0x7fea80199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80074030 0x7fea80199630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fea7400e9a0 tx=0x7fea7400ed60 comp rx=0 tx=0).stop 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 shutdown_connections 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea700a1480 0x7fea700a3940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea80109370 0x7fea801a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea80074030 0x7fea80199630 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 --2- 172.21.15.12:0/2841666712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea80075610 0x7fea80199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 >> 172.21.15.12:0/2841666712 conn(0x7fea800fca00 msgr2=0x7fea80105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:56.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 shutdown_connections 2023-12-11T20:13:56.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.482+0000 7fea86dff700 1 -- 172.21.15.12:0/2841666712 wait complete. 2023-12-11T20:13:56.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-12-11T20:13:56.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 -- 172.21.15.12:0/1390056520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1026a0 msgr2=0x7fa56c102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 --2- 172.21.15.12:0/1390056520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1026a0 0x7fa56c102b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0099c0 tx=0x7fa55c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 -- 172.21.15.12:0/1390056520 shutdown_connections 2023-12-11T20:13:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 --2- 172.21.15.12:0/1390056520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c1014b0 0x7fa56c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 --2- 172.21.15.12:0/1390056520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c103040 0x7fa56c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 --2- 172.21.15.12:0/1390056520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1026a0 0x7fa56c102b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 -- 172.21.15.12:0/1390056520 >> 172.21.15.12:0/1390056520 conn(0x7fa56c0fca00 msgr2=0x7fa56c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 -- 172.21.15.12:0/1390056520 shutdown_connections 2023-12-11T20:13:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.714+0000 7fa5737ff700 1 -- 172.21.15.12:0/1390056520 wait complete. 2023-12-11T20:13:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.715+0000 7fa5737ff700 1 Processor -- start 2023-12-11T20:13:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.715+0000 7fa5737ff700 1 -- start start 2023-12-11T20:13:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa5737ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1014b0 0x7fa56c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa5737ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c1026a0 0x7fa56c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa5737ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c103040 0x7fa56c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa5737ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c19ee30 con 0x7fa56c1014b0 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa5737ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c19ef70 con 0x7fa56c1026a0 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa5737ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c19f100 con 0x7fa56c103040 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa57159b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1014b0 0x7fa56c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa57159b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1014b0 0x7fa56c197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38116/0 (socket says 172.21.15.12:38116) 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa57159b700 1 -- 172.21.15.12:0/2330947769 learned_addr learned my addr 172.21.15.12:0/2330947769 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa570d9a700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c1026a0 0x7fa56c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa571d9c700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c103040 0x7fa56c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa57159b700 1 -- 172.21.15.12:0/2330947769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c103040 msgr2=0x7fa56c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa57159b700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c103040 0x7fa56c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa57159b700 1 -- 172.21.15.12:0/2330947769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c1026a0 msgr2=0x7fa56c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa57159b700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c1026a0 0x7fa56c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa57159b700 1 -- 172.21.15.12:0/2330947769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0095f0 con 0x7fa56c1014b0 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa571d9c700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c103040 0x7fa56c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.716+0000 7fa570d9a700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c1026a0 0x7fa56c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.717+0000 7fa57159b700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1014b0 0x7fa56c197300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa56800c990 tx=0x7fa56800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.717+0000 7fa5627fc700 1 -- 172.21.15.12:0/2330947769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa568007b00 con 0x7fa56c1014b0 2023-12-11T20:13:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.717+0000 7fa5627fc700 1 -- 172.21.15.12:0/2330947769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa568007c60 con 0x7fa56c1014b0 2023-12-11T20:13:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.717+0000 7fa5627fc700 1 -- 172.21.15.12:0/2330947769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa568018660 con 0x7fa56c1014b0 2023-12-11T20:13:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.717+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c19f3e0 con 0x7fa56c1014b0 2023-12-11T20:13:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.717+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c19f8a0 con 0x7fa56c1014b0 2023-12-11T20:13:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.718+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c108980 con 0x7fa56c1014b0 2023-12-11T20:13:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.720+0000 7fa5627fc700 1 -- 172.21.15.12:0/2330947769 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa56800f450 con 0x7fa56c1014b0 2023-12-11T20:13:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.721+0000 7fa5627fc700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5580a1500 0x7fa5580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.722+0000 7fa5627fc700 1 -- 172.21.15.12:0/2330947769 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa5680ccbc0 con 0x7fa56c1014b0 2023-12-11T20:13:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.722+0000 7fa570d9a700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5580a1500 0x7fa5580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.722+0000 7fa570d9a700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5580a1500 0x7fa5580a39c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c010 tx=0x7fa55c005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.725+0000 7fa5627fc700 1 -- 172.21.15.12:0/2330947769 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa5680962d0 con 0x7fa56c1014b0 2023-12-11T20:13:56.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:56 smithi039 ceph-mon[102205]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-12-11T20:13:56.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:56 smithi039 ceph-mon[102205]: Cluster is now healthy 2023-12-11T20:13:56.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:56 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/852651406' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-11T20:13:56.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:56 smithi039 ceph-mon[102205]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:56.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:56 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2841666712' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-11T20:13:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:56 smithi012 ceph-mon[128787]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-12-11T20:13:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:56 smithi012 ceph-mon[128787]: Cluster is now healthy 2023-12-11T20:13:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:56 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/852651406' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-11T20:13:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:56 smithi012 ceph-mon[128787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:56 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2841666712' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-11T20:13:56.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:56 smithi032 ceph-mon[132488]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-12-11T20:13:56.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:56 smithi032 ceph-mon[132488]: Cluster is now healthy 2023-12-11T20:13:56.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:56 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/852651406' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-11T20:13:56.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:56 smithi032 ceph-mon[132488]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:56.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:56 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2841666712' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-11T20:13:56.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:56.985+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fa56c068330 con 0x7fa56c1014b0 2023-12-11T20:13:57.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:13:57.091+0000 7f0647f2f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-11T20:13:57.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.491+0000 7fa5627fc700 1 -- 172.21.15.12:0/2330947769 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa5680998f0 con 0x7fa56c1014b0 2023-12-11T20:13:57.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5580a1500 msgr2=0x7fa5580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5580a1500 0x7fa5580a39c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c010 tx=0x7fa55c005fb0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1014b0 msgr2=0x7fa56c197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1014b0 0x7fa56c197300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa56800c990 tx=0x7fa56800cd50 comp rx=0 tx=0).stop 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 shutdown_connections 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5580a1500 0x7fa5580a39c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c103040 0x7fa56c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c1014b0 0x7fa56c197300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 --2- 172.21.15.12:0/2330947769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c1026a0 0x7fa56c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.493+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 >> 172.21.15.12:0/2330947769 conn(0x7fa56c0fca00 msgr2=0x7fa56c105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.494+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 shutdown_connections 2023-12-11T20:13:57.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.494+0000 7fa5737ff700 1 -- 172.21.15.12:0/2330947769 wait complete. 2023-12-11T20:13:57.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.723+0000 7efff51ff700 1 -- 172.21.15.12:0/1217009137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 msgr2=0x7efff0102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.723+0000 7efff51ff700 1 --2- 172.21.15.12:0/1217009137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 0x7efff0102b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7effe40099c0 tx=0x7effe4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.724+0000 7efff51ff700 1 -- 172.21.15.12:0/1217009137 shutdown_connections 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.724+0000 7efff51ff700 1 --2- 172.21.15.12:0/1217009137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efff01014b0 0x7efff01018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.724+0000 7efff51ff700 1 --2- 172.21.15.12:0/1217009137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efff0103040 0x7efff01098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.724+0000 7efff51ff700 1 --2- 172.21.15.12:0/1217009137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 0x7efff0102b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.724+0000 7efff51ff700 1 -- 172.21.15.12:0/1217009137 >> 172.21.15.12:0/1217009137 conn(0x7efff00fca00 msgr2=0x7efff00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.724+0000 7efff51ff700 1 -- 172.21.15.12:0/1217009137 shutdown_connections 2023-12-11T20:13:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.724+0000 7efff51ff700 1 -- 172.21.15.12:0/1217009137 wait complete. 2023-12-11T20:13:57.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7efff51ff700 1 Processor -- start 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7efff51ff700 1 -- start start 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7efff51ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efff01014b0 0x7efff00752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7efff51ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 0x7efff00739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7efff51ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efff0103040 0x7efff0073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7efff51ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0074600 con 0x7efff01026a0 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7efff51ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0074770 con 0x7efff01014b0 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7efff51ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff01a1410 con 0x7efff0103040 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7effee59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 0x7efff00739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7effee59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 0x7efff00739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38132/0 (socket says 172.21.15.12:38132) 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.725+0000 7effee59c700 1 -- 172.21.15.12:0/1167269906 learned_addr learned my addr 172.21.15.12:0/1167269906 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effeed9d700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efff01014b0 0x7efff00752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effef59e700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efff0103040 0x7efff0073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:57.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effee59c700 1 -- 172.21.15.12:0/1167269906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efff0103040 msgr2=0x7efff0073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effee59c700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efff0103040 0x7efff0073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effee59c700 1 -- 172.21.15.12:0/1167269906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efff01014b0 msgr2=0x7efff00752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effee59c700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efff01014b0 0x7efff00752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effee59c700 1 -- 172.21.15.12:0/1167269906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe40095f0 con 0x7efff01026a0 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effee59c700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 0x7efff00739c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7effe4000c00 tx=0x7effe400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effd7fff700 1 -- 172.21.15.12:0/1167269906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe401d070 con 0x7efff01026a0 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effd7fff700 1 -- 172.21.15.12:0/1167269906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effe40054c0 con 0x7efff01026a0 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7effd7fff700 1 -- 172.21.15.12:0/1167269906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4004bd0 con 0x7efff01026a0 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff01a1610 con 0x7efff01026a0 2023-12-11T20:13:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.726+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff01a1a30 con 0x7efff01026a0 2023-12-11T20:13:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.727+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff01089a0 con 0x7efff01026a0 2023-12-11T20:13:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.729+0000 7effd7fff700 1 -- 172.21.15.12:0/1167269906 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7effe400fc80 con 0x7efff01026a0 2023-12-11T20:13:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.731+0000 7effd7fff700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7effd80a1500 0x7effd80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.731+0000 7effd7fff700 1 -- 172.21.15.12:0/1167269906 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7effe40cdd70 con 0x7efff01026a0 2023-12-11T20:13:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.731+0000 7effeed9d700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7effd80a1500 0x7effd80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.732+0000 7effeed9d700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7effd80a1500 0x7effd80a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efff0102500 tx=0x7effe0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.733+0000 7effd7fff700 1 -- 172.21.15.12:0/1167269906 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7effe4097510 con 0x7efff01026a0 2023-12-11T20:13:57.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:57 smithi039 ceph-mon[102205]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-11T20:13:57.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:57 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2841666712' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-11T20:13:57.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:57 smithi039 ceph-mon[102205]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-11T20:13:57.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:57 smithi039 ceph-mon[102205]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:57.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:57 smithi039 ceph-mon[102205]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-11T20:13:57.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:57 smithi039 ceph-mon[102205]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-11T20:13:57.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:57 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2330947769' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-11T20:13:57.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:57 smithi039 ceph-mon[102205]: pgmap v312: 97 pgs: 1 active, 3 creating+peering, 91 active+clean, 2 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-12-11T20:13:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:57 smithi012 ceph-mon[128787]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-11T20:13:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:57 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2841666712' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-11T20:13:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:57 smithi012 ceph-mon[128787]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-11T20:13:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:57 smithi012 ceph-mon[128787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:57 smithi012 ceph-mon[128787]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-11T20:13:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:57 smithi012 ceph-mon[128787]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-11T20:13:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:57 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2330947769' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-11T20:13:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:57 smithi012 ceph-mon[128787]: pgmap v312: 97 pgs: 1 active, 3 creating+peering, 91 active+clean, 2 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-12-11T20:13:57.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-mon[132488]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-11T20:13:57.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2841666712' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-11T20:13:57.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-mon[132488]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-11T20:13:57.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-mon[132488]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-11T20:13:57.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-mon[132488]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-11T20:13:57.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-mon[132488]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-11T20:13:57.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2330947769' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-11T20:13:57.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:57 smithi032 ceph-mon[132488]: pgmap v312: 97 pgs: 1 active, 3 creating+peering, 91 active+clean, 2 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-12-11T20:13:57.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:57.990+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7efff0068330 con 0x7efff01026a0 2023-12-11T20:13:58.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.249+0000 7effd7fff700 1 -- 172.21.15.12:0/1167269906 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7effe40260b0 con 0x7efff01026a0 2023-12-11T20:13:58.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7effd80a1500 msgr2=0x7effd80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:58.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7effd80a1500 0x7effd80a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efff0102500 tx=0x7effe0009260 comp rx=0 tx=0).stop 2023-12-11T20:13:58.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 msgr2=0x7efff00739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:58.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 0x7efff00739c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7effe4000c00 tx=0x7effe400f690 comp rx=0 tx=0).stop 2023-12-11T20:13:58.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 shutdown_connections 2023-12-11T20:13:58.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7effd80a1500 0x7effd80a39c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efff01014b0 0x7efff00752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efff0103040 0x7efff0073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 --2- 172.21.15.12:0/1167269906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff01026a0 0x7efff00739c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 >> 172.21.15.12:0/1167269906 conn(0x7efff00fca00 msgr2=0x7efff0105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:58.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 shutdown_connections 2023-12-11T20:13:58.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.252+0000 7efff51ff700 1 -- 172.21.15.12:0/1167269906 wait complete. 2023-12-11T20:13:58.272 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2023-12-11T20:13:58.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-12-11T20:13:58.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 -- 172.21.15.12:0/668614005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481071e0 msgr2=0x7fd948109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:58.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/668614005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481071e0 0x7fd948109650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd94000b0a0 tx=0x7fd94000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 -- 172.21.15.12:0/668614005 shutdown_connections 2023-12-11T20:13:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/668614005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd948101f80 0x7fd948104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/668614005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481071e0 0x7fd948109650 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/668614005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9481048b0 0x7fd948106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 -- 172.21.15.12:0/668614005 >> 172.21.15.12:0/668614005 conn(0x7fd9480fb930 msgr2=0x7fd9480fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 -- 172.21.15.12:0/668614005 shutdown_connections 2023-12-11T20:13:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.481+0000 7fd94f7ff700 1 -- 172.21.15.12:0/668614005 wait complete. 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.482+0000 7fd94f7ff700 1 Processor -- start 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.482+0000 7fd94f7ff700 1 -- start start 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.482+0000 7fd94f7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd948101f80 0x7fd9481995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.482+0000 7fd94f7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481048b0 0x7fd948199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.482+0000 7fd94f7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9481071e0 0x7fd9481a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94f7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481a10f0 con 0x7fd9481048b0 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94f7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481a1230 con 0x7fd948101f80 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94f7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481a13c0 con 0x7fd9481071e0 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481048b0 0x7fd948199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481048b0 0x7fd948199b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38138/0 (socket says 172.21.15.12:38138) 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 -- 172.21.15.12:0/1449766463 learned_addr learned my addr 172.21.15.12:0/1449766463 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94dd9c700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9481071e0 0x7fd9481a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:58.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94d59b700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd948101f80 0x7fd9481995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 -- 172.21.15.12:0/1449766463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9481071e0 msgr2=0x7fd9481a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9481071e0 0x7fd9481a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 -- 172.21.15.12:0/1449766463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd948101f80 msgr2=0x7fd9481995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd948101f80 0x7fd9481995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 -- 172.21.15.12:0/1449766463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd940009d00 con 0x7fd9481048b0 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94d59b700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd948101f80 0x7fd9481995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.483+0000 7fd94cd9a700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481048b0 0x7fd948199b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd93800d950 tx=0x7fd93800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.484+0000 7fd93e7fc700 1 -- 172.21.15.12:0/1449766463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938009940 con 0x7fd9481048b0 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.484+0000 7fd93e7fc700 1 -- 172.21.15.12:0/1449766463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd938010460 con 0x7fd9481048b0 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.484+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9481a16a0 con 0x7fd9481048b0 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.484+0000 7fd93e7fc700 1 -- 172.21.15.12:0/1449766463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93800f620 con 0x7fd9481048b0 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.484+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9481a1c00 con 0x7fd9481048b0 2023-12-11T20:13:58.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.485+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd948108d60 con 0x7fd9481048b0 2023-12-11T20:13:58.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.487+0000 7fd93e7fc700 1 -- 172.21.15.12:0/1449766463 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd9380105d0 con 0x7fd9481048b0 2023-12-11T20:13:58.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.488+0000 7fd93e7fc700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9340a1500 0x7fd9340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:58.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.488+0000 7fd93e7fc700 1 -- 172.21.15.12:0/1449766463 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd9380cca20 con 0x7fd9481048b0 2023-12-11T20:13:58.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.488+0000 7fd94d59b700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9340a1500 0x7fd9340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:58.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.489+0000 7fd94d59b700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9340a1500 0x7fd9340a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd944005fd0 tx=0x7fd944005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:58.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.491+0000 7fd93e7fc700 1 -- 172.21.15.12:0/1449766463 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd938096130 con 0x7fd9481048b0 2023-12-11T20:13:58.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2330947769' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-11T20:13:58.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:active 2023-12-11T20:13:58.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-11T20:13:58.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-11T20:13:58.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: Cluster is now healthy 2023-12-11T20:13:58.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-12-11T20:13:58.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-12-11T20:13:58.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-12-11T20:13:58.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1167269906' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-11T20:13:58.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1167269906' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-11T20:13:58.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] up:active 2023-12-11T20:13:58.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:13:58.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.738+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fd94802d420 con 0x7fd9340a1500 2023-12-11T20:13:58.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.790+0000 7fd93e7fc700 1 -- 172.21.15.12:0/1449766463 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd94802d420 con 0x7fd9340a1500 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9340a1500 msgr2=0x7fd9340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9340a1500 0x7fd9340a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd944005fd0 tx=0x7fd944005e30 comp rx=0 tx=0).stop 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481048b0 msgr2=0x7fd948199b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481048b0 0x7fd948199b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd93800d950 tx=0x7fd93800dc60 comp rx=0 tx=0).stop 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 shutdown_connections 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9340a1500 0x7fd9340a39c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd948101f80 0x7fd9481995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9481071e0 0x7fd9481a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 --2- 172.21.15.12:0/1449766463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9481048b0 0x7fd948199b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 >> 172.21.15.12:0/1449766463 conn(0x7fd9480fb930 msgr2=0x7fd9481016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 shutdown_connections 2023-12-11T20:13:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:58.793+0000 7fd94f7ff700 1 -- 172.21.15.12:0/1449766463 wait complete. 2023-12-11T20:13:58.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2330947769' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-11T20:13:58.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:active 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: Cluster is now healthy 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1167269906' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1167269906' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] up:active 2023-12-11T20:13:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:58 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:13:58.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2330947769' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:active 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: Cluster is now healthy 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-12-11T20:13:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1167269906' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-11T20:13:58.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1167269906' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-11T20:13:58.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] up:active 2023-12-11T20:13:58.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:58 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:13:59.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 -- 172.21.15.12:0/897878337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824109370 msgr2=0x7f382410b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 --2- 172.21.15.12:0/897878337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824109370 0x7f382410b800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f381c00b0a0 tx=0x7f381c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 -- 172.21.15.12:0/897878337 shutdown_connections 2023-12-11T20:13:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 --2- 172.21.15.12:0/897878337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824109370 0x7f382410b800 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 --2- 172.21.15.12:0/897878337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3824075610 0x7f3824073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 --2- 172.21.15.12:0/897878337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3824074030 0x7f38240744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 -- 172.21.15.12:0/897878337 >> 172.21.15.12:0/897878337 conn(0x7f38240fca00 msgr2=0x7f38240fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 -- 172.21.15.12:0/897878337 shutdown_connections 2023-12-11T20:13:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.020+0000 7f38293ff700 1 -- 172.21.15.12:0/897878337 wait complete. 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.021+0000 7f38293ff700 1 Processor -- start 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.021+0000 7f38293ff700 1 -- start start 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38293ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824074030 0x7f3824199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38293ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3824075610 0x7f3824199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38293ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3824109370 0x7f38241a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38293ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38241a11c0 con 0x7f3824074030 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38293ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38241a1300 con 0x7f3824075610 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38293ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38241a1490 con 0x7f3824109370 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f3822ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824074030 0x7f3824199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:59.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f3822ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824074030 0x7f3824199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43810/0 (socket says 172.21.15.12:43810) 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f3822ffd700 1 -- 172.21.15.12:0/3312173796 learned_addr learned my addr 172.21.15.12:0/3312173796 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38237fe700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3824109370 0x7f38241a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38227fc700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3824075610 0x7f3824199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f3822ffd700 1 -- 172.21.15.12:0/3312173796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3824109370 msgr2=0x7f38241a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f3822ffd700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3824109370 0x7f38241a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f3822ffd700 1 -- 172.21.15.12:0/3312173796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3824075610 msgr2=0x7f3824199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f3822ffd700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3824075610 0x7f3824199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f3822ffd700 1 -- 172.21.15.12:0/3312173796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c009d00 con 0x7f3824074030 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.022+0000 7f38237fe700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3824109370 0x7f38241a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.023+0000 7f3822ffd700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824074030 0x7f3824199690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f381400d950 tx=0x7f381400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.023+0000 7f380bfff700 1 -- 172.21.15.12:0/3312173796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814009b40 con 0x7f3824074030 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.023+0000 7f380bfff700 1 -- 172.21.15.12:0/3312173796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3814009ca0 con 0x7f3824074030 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.023+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38241a1770 con 0x7f3824074030 2023-12-11T20:13:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.023+0000 7f380bfff700 1 -- 172.21.15.12:0/3312173796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381400f620 con 0x7f3824074030 2023-12-11T20:13:59.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.023+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38241a1cd0 con 0x7f3824074030 2023-12-11T20:13:59.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.024+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3824108130 con 0x7f3824074030 2023-12-11T20:13:59.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.026+0000 7f380bfff700 1 -- 172.21.15.12:0/3312173796 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3814010460 con 0x7f3824074030 2023-12-11T20:13:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.028+0000 7f380bfff700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f380c0a1500 0x7f380c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.028+0000 7f380bfff700 1 -- 172.21.15.12:0/3312173796 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f38140ccf70 con 0x7f3824074030 2023-12-11T20:13:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.029+0000 7f38227fc700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f380c0a1500 0x7f380c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.029+0000 7f38227fc700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f380c0a1500 0x7f380c0a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3818005950 tx=0x7f38180058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:59.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.032+0000 7f380bfff700 1 -- 172.21.15.12:0/3312173796 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3814096680 con 0x7f3824074030 2023-12-11T20:13:59.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:13:58.745+0000 7f15640cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-11T20:13:59.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:13:58.745+0000 7f15640cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-11T20:13:59.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:13:58.745+0000 7f15640cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-11T20:13:59.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:13:58.745+0000 7f15640cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-11T20:13:59.080 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:13:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:13:58.745+0000 7f15640cc700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-11T20:13:59.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.282+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f382402d420 con 0x7f380c0a1500 2023-12-11T20:13:59.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.287+0000 7f380bfff700 1 -- 172.21.15.12:0/3312173796 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f382402d420 con 0x7f380c0a1500 2023-12-11T20:13:59.287 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b 2023-12-11T20:13:59.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f380c0a1500 msgr2=0x7f380c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f380c0a1500 0x7f380c0a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3818005950 tx=0x7f38180058e0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824074030 msgr2=0x7f3824199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824074030 0x7f3824199690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f381400d950 tx=0x7f381400dd10 comp rx=0 tx=0).stop 2023-12-11T20:13:59.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 shutdown_connections 2023-12-11T20:13:59.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f380c0a1500 0x7f380c0a39c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3824109370 0x7f38241a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3824074030 0x7f3824199690 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 --2- 172.21.15.12:0/3312173796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3824075610 0x7f3824199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 >> 172.21.15.12:0/3312173796 conn(0x7f38240fca00 msgr2=0x7f3824105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:59.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 shutdown_connections 2023-12-11T20:13:59.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.290+0000 7f38293ff700 1 -- 172.21.15.12:0/3312173796 wait complete. 2023-12-11T20:13:59.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-12-11T20:13:59.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 -- 172.21.15.12:0/906637772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb81014b0 msgr2=0x7fbbb81018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/906637772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb81014b0 0x7fbbb81018d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009f90 tx=0x7fbbb400b330 comp rx=0 tx=0).stop 2023-12-11T20:13:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 -- 172.21.15.12:0/906637772 shutdown_connections 2023-12-11T20:13:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/906637772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb8103040 0x7fbbb81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/906637772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb81014b0 0x7fbbb81018d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/906637772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbb81026a0 0x7fbbb8102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 -- 172.21.15.12:0/906637772 >> 172.21.15.12:0/906637772 conn(0x7fbbb80fca00 msgr2=0x7fbbb80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 -- 172.21.15.12:0/906637772 shutdown_connections 2023-12-11T20:13:59.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.524+0000 7fbbc01ff700 1 -- 172.21.15.12:0/906637772 wait complete. 2023-12-11T20:13:59.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.525+0000 7fbbc01ff700 1 Processor -- start 2023-12-11T20:13:59.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbc01ff700 1 -- start start 2023-12-11T20:13:59.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbc01ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb81014b0 0x7fbbb8197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:59.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbc01ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb81026a0 0x7fbbb8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:59.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbc01ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbb8103040 0x7fbbb819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:59.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbc01ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb819f070 con 0x7fbbb81014b0 2023-12-11T20:13:59.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbc01ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb819f1b0 con 0x7fbbb8103040 2023-12-11T20:13:59.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbc01ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb819f340 con 0x7fbbb81026a0 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbbdf9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb81014b0 0x7fbbb8197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbbdf9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb81014b0 0x7fbbb8197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43828/0 (socket says 172.21.15.12:43828) 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbbdf9b700 1 -- 172.21.15.12:0/580236886 learned_addr learned my addr 172.21.15.12:0/580236886 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbbd79a700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb81026a0 0x7fbbb8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbbdf9b700 1 -- 172.21.15.12:0/580236886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb81026a0 msgr2=0x7fbbb8197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.526+0000 7fbbbdf9b700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb81026a0 0x7fbbb8197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbbdf9b700 1 -- 172.21.15.12:0/580236886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbb8103040 msgr2=0x7fbbb819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbbdf9b700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbb8103040 0x7fbbb819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbbdf9b700 1 -- 172.21.15.12:0/580236886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00095f0 con 0x7fbbb81014b0 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbbdf9b700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb81014b0 0x7fbbb8197540 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4000f80 tx=0x7fbbb4008d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbaeffd700 1 -- 172.21.15.12:0/580236886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb400e040 con 0x7fbbb81014b0 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb4009c40 con 0x7fbbb81014b0 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbaeffd700 1 -- 172.21.15.12:0/580236886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbb400be00 con 0x7fbbb81014b0 2023-12-11T20:13:59.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb819f900 con 0x7fbbb81014b0 2023-12-11T20:13:59.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.527+0000 7fbbaeffd700 1 -- 172.21.15.12:0/580236886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4005240 con 0x7fbbb81014b0 2023-12-11T20:13:59.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.528+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb81089c0 con 0x7fbbb81014b0 2023-12-11T20:13:59.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.530+0000 7fbbaeffd700 1 -- 172.21.15.12:0/580236886 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fbbb401da00 con 0x7fbbb81014b0 2023-12-11T20:13:59.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.531+0000 7fbbaeffd700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbba40a1510 0x7fbba40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:13:59.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.532+0000 7fbbaeffd700 1 -- 172.21.15.12:0/580236886 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbbb40ce080 con 0x7fbbb81014b0 2023-12-11T20:13:59.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.532+0000 7fbbbd79a700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbba40a1510 0x7fbba40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:13:59.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.532+0000 7fbbbd79a700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbba40a1510 0x7fbba40a39d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbba8005950 tx=0x7fbba800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:13:59.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.536+0000 7fbbaeffd700 1 -- 172.21.15.12:0/580236886 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbbb41012f0 con 0x7fbbb81014b0 2023-12-11T20:13:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:59 smithi012 ceph-mon[128787]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:13:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:13:59 smithi012 ceph-mon[128787]: pgmap v313: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 623 B/s rd, 3.7 KiB/s wr, 9 op/s 2023-12-11T20:13:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.784+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbb802d470 con 0x7fbba40a1510 2023-12-11T20:13:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:59 smithi039 ceph-mon[102205]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:13:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:13:59 smithi039 ceph-mon[102205]: pgmap v313: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 623 B/s rd, 3.7 KiB/s wr, 9 op/s 2023-12-11T20:13:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.812+0000 7fbbaeffd700 1 -- 172.21.15.12:0/580236886 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbbb802d470 con 0x7fbba40a1510 2023-12-11T20:13:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbba40a1510 msgr2=0x7fbba40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbba40a1510 0x7fbba40a39d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbba8005950 tx=0x7fbba800b410 comp rx=0 tx=0).stop 2023-12-11T20:13:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb81014b0 msgr2=0x7fbbb8197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb81014b0 0x7fbbb8197540 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4000f80 tx=0x7fbbb4008d50 comp rx=0 tx=0).stop 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 shutdown_connections 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbba40a1510 0x7fbba40a39d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbb8103040 0x7fbbb819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb81014b0 0x7fbbb8197540 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 --2- 172.21.15.12:0/580236886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb81026a0 0x7fbbb8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 >> 172.21.15.12:0/580236886 conn(0x7fbbb80fca00 msgr2=0x7fbbb8105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 shutdown_connections 2023-12-11T20:13:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:13:59.814+0000 7fbbc01ff700 1 -- 172.21.15.12:0/580236886 wait complete. 2023-12-11T20:13:59.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-12-11T20:13:59.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:59 smithi032 ceph-mon[132488]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:13:59.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:13:59 smithi032 ceph-mon[132488]: pgmap v313: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 623 B/s rd, 3.7 KiB/s wr, 9 op/s 2023-12-11T20:14:00.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 -- 172.21.15.12:0/4014660513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c109370 msgr2=0x7fd24c10b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 --2- 172.21.15.12:0/4014660513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c109370 0x7fd24c10b800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd24400b0a0 tx=0x7fd24400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 -- 172.21.15.12:0/4014660513 shutdown_connections 2023-12-11T20:14:00.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 --2- 172.21.15.12:0/4014660513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c109370 0x7fd24c10b800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 --2- 172.21.15.12:0/4014660513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c075610 0x7fd24c073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 --2- 172.21.15.12:0/4014660513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd24c074030 0x7fd24c0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 -- 172.21.15.12:0/4014660513 >> 172.21.15.12:0/4014660513 conn(0x7fd24c0fca00 msgr2=0x7fd24c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:00.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 -- 172.21.15.12:0/4014660513 shutdown_connections 2023-12-11T20:14:00.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.040+0000 7fd252bff700 1 -- 172.21.15.12:0/4014660513 wait complete. 2023-12-11T20:14:00.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.041+0000 7fd252bff700 1 Processor -- start 2023-12-11T20:14:00.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.041+0000 7fd252bff700 1 -- start start 2023-12-11T20:14:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd252bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c074030 0x7fd24c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd252bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd24c075610 0x7fd24c199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd252bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c109370 0x7fd24c1a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd252bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c1a1150 con 0x7fd24c074030 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd252bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c1a1290 con 0x7fd24c075610 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd252bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c1a1420 con 0x7fd24c109370 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd25099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c074030 0x7fd24c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd25099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c074030 0x7fd24c199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43846/0 (socket says 172.21.15.12:43846) 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd25099b700 1 -- 172.21.15.12:0/252079877 learned_addr learned my addr 172.21.15.12:0/252079877 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.042+0000 7fd24bfff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd24c075610 0x7fd24c199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd25099b700 1 -- 172.21.15.12:0/252079877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c109370 msgr2=0x7fd24c1a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd25099b700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c109370 0x7fd24c1a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd25099b700 1 -- 172.21.15.12:0/252079877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd24c075610 msgr2=0x7fd24c199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd25099b700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd24c075610 0x7fd24c199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd25099b700 1 -- 172.21.15.12:0/252079877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244009d00 con 0x7fd24c074030 2023-12-11T20:14:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd25099b700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c074030 0x7fd24c199670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e9a0 tx=0x7fd24000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd249ffb700 1 -- 172.21.15.12:0/252079877 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240009790 con 0x7fd24c074030 2023-12-11T20:14:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd249ffb700 1 -- 172.21.15.12:0/252079877 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd24000cbd0 con 0x7fd24c074030 2023-12-11T20:14:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c1a1700 con 0x7fd24c074030 2023-12-11T20:14:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd249ffb700 1 -- 172.21.15.12:0/252079877 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240018680 con 0x7fd24c074030 2023-12-11T20:14:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.043+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c1a1c60 con 0x7fd24c074030 2023-12-11T20:14:00.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.044+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c108130 con 0x7fd24c074030 2023-12-11T20:14:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.046+0000 7fd249ffb700 1 -- 172.21.15.12:0/252079877 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fd24000cd40 con 0x7fd24c074030 2023-12-11T20:14:00.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.047+0000 7fd249ffb700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd23c0a1590 0x7fd23c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:00.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.048+0000 7fd249ffb700 1 -- 172.21.15.12:0/252079877 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd240014070 con 0x7fd24c074030 2023-12-11T20:14:00.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.048+0000 7fd24bfff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd23c0a1590 0x7fd23c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:00.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.048+0000 7fd24bfff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd23c0a1590 0x7fd23c0a3a50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd238005950 tx=0x7fd2380058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:00.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.050+0000 7fd249ffb700 1 -- 172.21.15.12:0/252079877 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd240096830 con 0x7fd24c074030 2023-12-11T20:14:00.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.299+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd24c02d420 con 0x7fd23c0a1590 2023-12-11T20:14:00.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.303+0000 7fd249ffb700 1 -- 172.21.15.12:0/252079877 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fd24c02d420 con 0x7fd23c0a1590 2023-12-11T20:14:00.302 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/_nogroup/sv_1/25d7ce30-bedf-458c-9784-a8713f3d3c52 2023-12-11T20:14:00.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd23c0a1590 msgr2=0x7fd23c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd23c0a1590 0x7fd23c0a3a50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd238005950 tx=0x7fd2380058e0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c074030 msgr2=0x7fd24c199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c074030 0x7fd24c199670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e9a0 tx=0x7fd24000ed60 comp rx=0 tx=0).stop 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 shutdown_connections 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd23c0a1590 0x7fd23c0a3a50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd24c109370 0x7fd24c1a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd24c074030 0x7fd24c199670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 --2- 172.21.15.12:0/252079877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd24c075610 0x7fd24c199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.305+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 >> 172.21.15.12:0/252079877 conn(0x7fd24c0fca00 msgr2=0x7fd24c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.306+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 shutdown_connections 2023-12-11T20:14:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.306+0000 7fd252bff700 1 -- 172.21.15.12:0/252079877 wait complete. 2023-12-11T20:14:00.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:14:00.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 -- 172.21.15.12:0/898152517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44102690 msgr2=0x7faf44102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/898152517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44102690 0x7faf44102af0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf340099c0 tx=0x7faf34009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 -- 172.21.15.12:0/898152517 shutdown_connections 2023-12-11T20:14:00.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/898152517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf44103030 0x7faf441098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/898152517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf441014a0 0x7faf441018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/898152517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44102690 0x7faf44102af0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 -- 172.21.15.12:0/898152517 >> 172.21.15.12:0/898152517 conn(0x7faf440fca10 msgr2=0x7faf440fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:00.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 -- 172.21.15.12:0/898152517 shutdown_connections 2023-12-11T20:14:00.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.531+0000 7faf4b9ff700 1 -- 172.21.15.12:0/898152517 wait complete. 2023-12-11T20:14:00.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.532+0000 7faf4b9ff700 1 Processor -- start 2023-12-11T20:14:00.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.532+0000 7faf4b9ff700 1 -- start start 2023-12-11T20:14:00.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf4b9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf441014a0 0x7faf44199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:00.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf4b9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf44102690 0x7faf44199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf4b9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44103030 0x7faf441a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf4b9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf441a1030 con 0x7faf44103030 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf4b9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf441a1170 con 0x7faf44102690 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf4b9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf441a1300 con 0x7faf441014a0 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf49f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44103030 0x7faf441a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf49f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44103030 0x7faf441a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43866/0 (socket says 172.21.15.12:43866) 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf49f9c700 1 -- 172.21.15.12:0/1548870636 learned_addr learned my addr 172.21.15.12:0/1548870636 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf48f9a700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf44102690 0x7faf44199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.533+0000 7faf4979b700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf441014a0 0x7faf44199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf49f9c700 1 -- 172.21.15.12:0/1548870636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf441014a0 msgr2=0x7faf44199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf49f9c700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf441014a0 0x7faf44199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf49f9c700 1 -- 172.21.15.12:0/1548870636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf44102690 msgr2=0x7faf44199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf49f9c700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf44102690 0x7faf44199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf49f9c700 1 -- 172.21.15.12:0/1548870636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340095f0 con 0x7faf44103030 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf49f9c700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44103030 0x7faf441a0a60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf3c007ee0 tx=0x7faf3c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf3a7fc700 1 -- 172.21.15.12:0/1548870636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c017070 con 0x7faf44103030 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf3a7fc700 1 -- 172.21.15.12:0/1548870636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf3c00f040 con 0x7faf44103030 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf441a15e0 con 0x7faf44103030 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf3a7fc700 1 -- 172.21.15.12:0/1548870636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c005710 con 0x7faf44103030 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.534+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf441a1aa0 con 0x7faf44103030 2023-12-11T20:14:00.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.535+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf44068330 con 0x7faf44103030 2023-12-11T20:14:00.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.537+0000 7faf3a7fc700 1 -- 172.21.15.12:0/1548870636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7faf3c005870 con 0x7faf44103030 2023-12-11T20:14:00.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.540+0000 7faf3a7fc700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf300a1510 0x7faf300a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:00.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.540+0000 7faf3a7fc700 1 -- 172.21.15.12:0/1548870636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faf3c0ccc70 con 0x7faf44103030 2023-12-11T20:14:00.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.540+0000 7faf4979b700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf300a1510 0x7faf300a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:00.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.540+0000 7faf4979b700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf300a1510 0x7faf300a39d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faf40005fd0 tx=0x7faf40005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:00.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.542+0000 7faf3a7fc700 1 -- 172.21.15.12:0/1548870636 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faf3c096220 con 0x7faf44103030 2023-12-11T20:14:00.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:00 smithi012 ceph-mon[128787]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:00.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:00 smithi012 ceph-mon[128787]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-12-11T20:14:00.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:00 smithi012 ceph-mon[128787]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:00 smithi039 ceph-mon[102205]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:00 smithi039 ceph-mon[102205]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-12-11T20:14:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:00 smithi039 ceph-mon[102205]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:00.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.804+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf4410cbc0 con 0x7faf44103030 2023-12-11T20:14:00.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.805+0000 7faf3a7fc700 1 -- 172.21.15.12:0/1548870636 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7faf3c099840 con 0x7faf44103030 2023-12-11T20:14:00.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:00.804 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf300a1510 msgr2=0x7faf300a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf300a1510 0x7faf300a39d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faf40005fd0 tx=0x7faf40005e50 comp rx=0 tx=0).stop 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44103030 msgr2=0x7faf441a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44103030 0x7faf441a0a60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf3c007ee0 tx=0x7faf3c00d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 shutdown_connections 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf300a1510 0x7faf300a39d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf44103030 0x7faf441a0a60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf441014a0 0x7faf44199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 --2- 172.21.15.12:0/1548870636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf44102690 0x7faf44199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 >> 172.21.15.12:0/1548870636 conn(0x7faf440fca10 msgr2=0x7faf44107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 shutdown_connections 2023-12-11T20:14:00.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:00.808+0000 7faf4b9ff700 1 -- 172.21.15.12:0/1548870636 wait complete. 2023-12-11T20:14:00.808 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:14:00.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:14:00.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:00 smithi032 ceph-mon[132488]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:00.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:00 smithi032 ceph-mon[132488]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-12-11T20:14:00.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:00 smithi032 ceph-mon[132488]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:01.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.032+0000 7f10281ff700 1 -- 172.21.15.12:0/1441683123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10201014a0 msgr2=0x7f10201018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.032+0000 7f10281ff700 1 --2- 172.21.15.12:0/1441683123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10201014a0 0x7f10201018c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f101c0099c0 tx=0x7f101c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.032+0000 7f10281ff700 1 -- 172.21.15.12:0/1441683123 shutdown_connections 2023-12-11T20:14:01.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.032+0000 7f10281ff700 1 --2- 172.21.15.12:0/1441683123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1020103030 0x7f10201098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.032+0000 7f10281ff700 1 --2- 172.21.15.12:0/1441683123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10201014a0 0x7f10201018c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.032+0000 7f10281ff700 1 --2- 172.21.15.12:0/1441683123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1020102690 0x7f1020102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.032+0000 7f10281ff700 1 -- 172.21.15.12:0/1441683123 >> 172.21.15.12:0/1441683123 conn(0x7f10200fca10 msgr2=0x7f10200fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:01.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.033+0000 7f10281ff700 1 -- 172.21.15.12:0/1441683123 shutdown_connections 2023-12-11T20:14:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.033+0000 7f10281ff700 1 -- 172.21.15.12:0/1441683123 wait complete. 2023-12-11T20:14:01.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.033+0000 7f10281ff700 1 Processor -- start 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f10281ff700 1 -- start start 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f10281ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10201014a0 0x7f1020075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f10281ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1020102690 0x7f10200739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f10281ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1020103030 0x7f1020073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f10281ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10200746a0 con 0x7f1020102690 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f10281ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1020074810 con 0x7f10201014a0 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f10281ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10201a1400 con 0x7f1020103030 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f102579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1020102690 0x7f10200739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f102579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1020102690 0x7f10200739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43884/0 (socket says 172.21.15.12:43884) 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f102579a700 1 -- 172.21.15.12:0/4084409523 learned_addr learned my addr 172.21.15.12:0/4084409523 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f102679c700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1020103030 0x7f1020073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.034+0000 7f1025f9b700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10201014a0 0x7f1020075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f102579a700 1 -- 172.21.15.12:0/4084409523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1020103030 msgr2=0x7f1020073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f102579a700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1020103030 0x7f1020073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f102579a700 1 -- 172.21.15.12:0/4084409523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10201014a0 msgr2=0x7f1020075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f102579a700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10201014a0 0x7f1020075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f102579a700 1 -- 172.21.15.12:0/4084409523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0095f0 con 0x7f1020102690 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f1025f9b700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10201014a0 0x7f1020075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f102579a700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1020102690 0x7f10200739c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f101000e9a0 tx=0x7f101000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f1016ffd700 1 -- 172.21.15.12:0/4084409523 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010009790 con 0x7f1020102690 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f1016ffd700 1 -- 172.21.15.12:0/4084409523 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1010010430 con 0x7f1020102690 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f1016ffd700 1 -- 172.21.15.12:0/4084409523 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010018680 con 0x7f1020102690 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10201a1690 con 0x7f1020102690 2023-12-11T20:14:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.035+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10201a1b50 con 0x7f1020102690 2023-12-11T20:14:01.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.036+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1020108960 con 0x7f1020102690 2023-12-11T20:14:01.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.038+0000 7f1016ffd700 1 -- 172.21.15.12:0/4084409523 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f10100105a0 con 0x7f1020102690 2023-12-11T20:14:01.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.039+0000 7f1016ffd700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f100c0a1510 0x7f100c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.040+0000 7f1016ffd700 1 -- 172.21.15.12:0/4084409523 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1010014070 con 0x7f1020102690 2023-12-11T20:14:01.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.040+0000 7f1025f9b700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f100c0a1510 0x7f100c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.040+0000 7f1025f9b700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f100c0a1510 0x7f100c0a39d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f101c009990 tx=0x7f101c01a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:01.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.043+0000 7f1016ffd700 1 -- 172.21.15.12:0/4084409523 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f10100522f0 con 0x7f1020102690 2023-12-11T20:14:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.259+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f102010cbb0 con 0x7f1020102690 2023-12-11T20:14:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.261+0000 7f1016ffd700 1 -- 172.21.15.12:0/4084409523 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22049 (secure 0 0 0) 0x7f1010096630 con 0x7f1020102690 2023-12-11T20:14:01.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:01.260 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:13:54.249592+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:14:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.263+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f100c0a1510 msgr2=0x7f100c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.263+0000 7f10281ff700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f100c0a1510 0x7f100c0a39d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f101c009990 tx=0x7f101c01a040 comp rx=0 tx=0).stop 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.263+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1020102690 msgr2=0x7f10200739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.263+0000 7f10281ff700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1020102690 0x7f10200739c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f101000e9a0 tx=0x7f101000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.264+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 shutdown_connections 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.264+0000 7f10281ff700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f100c0a1510 0x7f100c0a39d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.264+0000 7f10281ff700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10201014a0 0x7f1020075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.264+0000 7f10281ff700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1020103030 0x7f1020073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.264+0000 7f10281ff700 1 --2- 172.21.15.12:0/4084409523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1020102690 0x7f10200739c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.264+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 >> 172.21.15.12:0/4084409523 conn(0x7f10200fca10 msgr2=0x7f1020105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.264+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 shutdown_connections 2023-12-11T20:14:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.264+0000 7f10281ff700 1 -- 172.21.15.12:0/4084409523 wait complete. 2023-12-11T20:14:01.282 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-11T20:14:01.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T20:14:01.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 -- 172.21.15.12:0/2087144741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 msgr2=0x7fba58102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/2087144741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 0x7fba58102af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0099c0 tx=0x7fba4c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 -- 172.21.15.12:0/2087144741 shutdown_connections 2023-12-11T20:14:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/2087144741 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba581014a0 0x7fba581018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/2087144741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba58103030 0x7fba581098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/2087144741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 0x7fba58102af0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 -- 172.21.15.12:0/2087144741 >> 172.21.15.12:0/2087144741 conn(0x7fba580fca10 msgr2=0x7fba580fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 -- 172.21.15.12:0/2087144741 shutdown_connections 2023-12-11T20:14:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.486+0000 7fba5e9ff700 1 -- 172.21.15.12:0/2087144741 wait complete. 2023-12-11T20:14:01.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.487+0000 7fba5e9ff700 1 Processor -- start 2023-12-11T20:14:01.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba5e9ff700 1 -- start start 2023-12-11T20:14:01.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba5e9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba581014a0 0x7fba58199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba5e9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 0x7fba58199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba5e9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba58103030 0x7fba581a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba5e9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba581a1070 con 0x7fba58102690 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba5e9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba581a11b0 con 0x7fba581014a0 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba5e9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba581a1340 con 0x7fba58103030 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 0x7fba58199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 0x7fba58199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43896/0 (socket says 172.21.15.12:43896) 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba577fe700 1 -- 172.21.15.12:0/4155211115 learned_addr learned my addr 172.21.15.12:0/4155211115 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba57fff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba581014a0 0x7fba58199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba5cf9c700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba58103030 0x7fba581a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba577fe700 1 -- 172.21.15.12:0/4155211115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba58103030 msgr2=0x7fba581a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba577fe700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba58103030 0x7fba581a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba577fe700 1 -- 172.21.15.12:0/4155211115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba581014a0 msgr2=0x7fba58199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.488+0000 7fba577fe700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba581014a0 0x7fba58199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.489+0000 7fba577fe700 1 -- 172.21.15.12:0/4155211115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0095f0 con 0x7fba58102690 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.489+0000 7fba5cf9c700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba58103030 0x7fba581a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:01.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.489+0000 7fba577fe700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 0x7fba58199a80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009990 tx=0x7fba4c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:01.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.489+0000 7fba557fa700 1 -- 172.21.15.12:0/4155211115 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c01d070 con 0x7fba58102690 2023-12-11T20:14:01.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.489+0000 7fba557fa700 1 -- 172.21.15.12:0/4155211115 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba4c00bd10 con 0x7fba58102690 2023-12-11T20:14:01.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.489+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba581a15c0 con 0x7fba58102690 2023-12-11T20:14:01.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.489+0000 7fba557fa700 1 -- 172.21.15.12:0/4155211115 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c017650 con 0x7fba58102690 2023-12-11T20:14:01.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.489+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba581a19e0 con 0x7fba58102690 2023-12-11T20:14:01.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.490+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba58068330 con 0x7fba58102690 2023-12-11T20:14:01.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.492+0000 7fba557fa700 1 -- 172.21.15.12:0/4155211115 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fba4c022470 con 0x7fba58102690 2023-12-11T20:14:01.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.493+0000 7fba557fa700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba400a1510 0x7fba400a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.494+0000 7fba557fa700 1 -- 172.21.15.12:0/4155211115 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fba4c0ce060 con 0x7fba58102690 2023-12-11T20:14:01.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.494+0000 7fba57fff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba400a1510 0x7fba400a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.494+0000 7fba57fff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba400a1510 0x7fba400a39d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fba581024f0 tx=0x7fba48007400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.497+0000 7fba557fa700 1 -- 172.21.15.12:0/4155211115 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fba4c0977a0 con 0x7fba58102690 2023-12-11T20:14:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:01 smithi012 ceph-mon[128787]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:01 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1548870636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:01 smithi012 ceph-mon[128787]: pgmap v314: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 3.2 KiB/s wr, 10 op/s 2023-12-11T20:14:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:01 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4084409523' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:01.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.711+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba58109580 con 0x7fba400a1510 2023-12-11T20:14:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.724+0000 7fba557fa700 1 -- 172.21.15.12:0/4155211115 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338560 (secure 0 0 0) 0x7fba58109580 con 0x7fba400a1510 2023-12-11T20:14:01.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba400a1510 msgr2=0x7fba400a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba400a1510 0x7fba400a39d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fba581024f0 tx=0x7fba48007400 comp rx=0 tx=0).stop 2023-12-11T20:14:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 msgr2=0x7fba58199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 0x7fba58199a80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009990 tx=0x7fba4c00fa00 comp rx=0 tx=0).stop 2023-12-11T20:14:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 shutdown_connections 2023-12-11T20:14:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba400a1510 0x7fba400a39d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba581014a0 0x7fba58199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba58103030 0x7fba581a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 --2- 172.21.15.12:0/4155211115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba58102690 0x7fba58199a80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 >> 172.21.15.12:0/4155211115 conn(0x7fba580fca10 msgr2=0x7fba58107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 shutdown_connections 2023-12-11T20:14:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.729+0000 7fba5e9ff700 1 -- 172.21.15.12:0/4155211115 wait complete. 2023-12-11T20:14:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-12-11T20:14:01.747 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-12-11T20:14:01.031820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594584,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":132,"num_read_kb":114,"num_write":262,"num_write_kb":2964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":279,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335240,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606584,"statfs":{"total":1151940427776,"available":1151597142016,"internally_reserved":0,"allocated":11288576,"data_stored":7059266,"data_compressed":109638,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":331855162},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":81,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001852"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604493+0000","last_change":"2023-12-11T20:13:53.282384+0000","last_active":"2023-12-11T20:13:54.604493+0000","last_peered":"2023-12-11T20:13:54.604493+0000","last_clean":"2023-12-11T20:13:54.604493+0000","last_became_active":"2023-12-11T20:13:53.282058+0000","last_became_peered":"2023-12-11T20:13:53.282058+0000","last_unstale":"2023-12-11T20:13:54.604493+0000","last_undegraded":"2023-12-11T20:13:54.604493+0000","last_fullsized":"2023-12-11T20:13:54.604493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:23:31.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582075+0000","last_change":"2023-12-11T20:13:53.282283+0000","last_active":"2023-12-11T20:13:54.582075+0000","last_peered":"2023-12-11T20:13:54.582075+0000","last_clean":"2023-12-11T20:13:54.582075+0000","last_became_active":"2023-12-11T20:13:53.278054+0000","last_became_peered":"2023-12-11T20:13:53.278054+0000","last_unstale":"2023-12-11T20:13:54.582075+0000","last_undegraded":"2023-12-11T20:13:54.582075+0000","last_fullsized":"2023-12-11T20:13:54.582075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:07:50.194732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582270+0000","last_change":"2023-12-11T20:13:53.277704+0000","last_active":"2023-12-11T20:13:54.582270+0000","last_peered":"2023-12-11T20:13:54.582270+0000","last_clean":"2023-12-11T20:13:54.582270+0000","last_became_active":"2023-12-11T20:13:53.277395+0000","last_became_peered":"2023-12-11T20:13:53.277395+0000","last_unstale":"2023-12-11T20:13:54.582270+0000","last_undegraded":"2023-12-11T20:13:54.582270+0000","last_fullsized":"2023-12-11T20:13:54.582270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:54:10.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582526+0000","last_change":"2023-12-11T20:13:53.280854+0000","last_active":"2023-12-11T20:13:54.582526+0000","last_peered":"2023-12-11T20:13:54.582526+0000","last_clean":"2023-12-11T20:13:54.582526+0000","last_became_active":"2023-12-11T20:13:53.277275+0000","last_became_peered":"2023-12-11T20:13:53.277275+0000","last_unstale":"2023-12-11T20:13:54.582526+0000","last_undegraded":"2023-12-11T20:13:54.582526+0000","last_fullsized":"2023-12-11T20:13:54.582526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:32:58.001015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581621+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:13:54.581621+0000","last_peered":"2023-12-11T20:13:54.581621+0000","last_clean":"2023-12-11T20:13:54.581621+0000","last_became_active":"2023-12-11T20:13:53.281659+0000","last_became_peered":"2023-12-11T20:13:53.281659+0000","last_unstale":"2023-12-11T20:13:54.581621+0000","last_undegraded":"2023-12-11T20:13:54.581621+0000","last_fullsized":"2023-12-11T20:13:54.581621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:47:20.764823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253713+0000","last_change":"2023-12-11T20:13:53.284175+0000","last_active":"2023-12-11T20:13:54.253713+0000","last_peered":"2023-12-11T20:13:54.253713+0000","last_clean":"2023-12-11T20:13:54.253713+0000","last_became_active":"2023-12-11T20:13:53.283801+0000","last_became_peered":"2023-12-11T20:13:53.283801+0000","last_unstale":"2023-12-11T20:13:54.253713+0000","last_undegraded":"2023-12-11T20:13:54.253713+0000","last_fullsized":"2023-12-11T20:13:54.253713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:35.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582045+0000","last_change":"2023-12-11T20:13:53.262700+0000","last_active":"2023-12-11T20:13:54.582045+0000","last_peered":"2023-12-11T20:13:54.582045+0000","last_clean":"2023-12-11T20:13:54.582045+0000","last_became_active":"2023-12-11T20:13:53.262322+0000","last_became_peered":"2023-12-11T20:13:53.262322+0000","last_unstale":"2023-12-11T20:13:54.582045+0000","last_undegraded":"2023-12-11T20:13:54.582045+0000","last_fullsized":"2023-12-11T20:13:54.582045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:02:47.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581007+0000","last_change":"2023-12-11T20:13:53.276134+0000","last_active":"2023-12-11T20:13:54.581007+0000","last_peered":"2023-12-11T20:13:54.581007+0000","last_clean":"2023-12-11T20:13:54.581007+0000","last_became_active":"2023-12-11T20:13:53.275837+0000","last_became_peered":"2023-12-11T20:13:53.275837+0000","last_unstale":"2023-12-11T20:13:54.581007+0000","last_undegraded":"2023-12-11T20:13:54.581007+0000","last_fullsized":"2023-12-11T20:13:54.581007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:23.172320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.583204+0000","last_change":"2023-12-11T20:13:53.277384+0000","last_active":"2023-12-11T20:13:54.583204+0000","last_peered":"2023-12-11T20:13:54.583204+0000","last_clean":"2023-12-11T20:13:54.583204+0000","last_became_active":"2023-12-11T20:13:53.277017+0000","last_became_peered":"2023-12-11T20:13:53.277017+0000","last_unstale":"2023-12-11T20:13:54.583204+0000","last_undegraded":"2023-12-11T20:13:54.583204+0000","last_fullsized":"2023-12-11T20:13:54.583204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:04:50.820269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254148+0000","last_change":"2023-12-11T20:13:53.285340+0000","last_active":"2023-12-11T20:13:54.254148+0000","last_peered":"2023-12-11T20:13:54.254148+0000","last_clean":"2023-12-11T20:13:54.254148+0000","last_became_active":"2023-12-11T20:13:53.285040+0000","last_became_peered":"2023-12-11T20:13:53.285040+0000","last_unstale":"2023-12-11T20:13:54.254148+0000","last_undegraded":"2023-12-11T20:13:54.254148+0000","last_fullsized":"2023-12-11T20:13:54.254148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:52:53.312236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582024+0000","last_change":"2023-12-11T20:13:53.274637+0000","last_active":"2023-12-11T20:13:54.582024+0000","last_peered":"2023-12-11T20:13:54.582024+0000","last_clean":"2023-12-11T20:13:54.582024+0000","last_became_active":"2023-12-11T20:13:53.270971+0000","last_became_peered":"2023-12-11T20:13:53.270971+0000","last_unstale":"2023-12-11T20:13:54.582024+0000","last_undegraded":"2023-12-11T20:13:54.582024+0000","last_fullsized":"2023-12-11T20:13:54.582024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:20:35.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582518+0000","last_change":"2023-12-11T20:13:53.280712+0000","last_active":"2023-12-11T20:13:54.582518+0000","last_peered":"2023-12-11T20:13:54.582518+0000","last_clean":"2023-12-11T20:13:54.582518+0000","last_became_active":"2023-12-11T20:13:53.276873+0000","last_became_peered":"2023-12-11T20:13:53.276873+0000","last_unstale":"2023-12-11T20:13:54.582518+0000","last_undegraded":"2023-12-11T20:13:54.582518+0000","last_fullsized":"2023-12-11T20:13:54.582518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:36:08.438862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253684+0000","last_change":"2023-12-11T20:13:53.272378+0000","last_active":"2023-12-11T20:13:54.253684+0000","last_peered":"2023-12-11T20:13:54.253684+0000","last_clean":"2023-12-11T20:13:54.253684+0000","last_became_active":"2023-12-11T20:13:53.271992+0000","last_became_peered":"2023-12-11T20:13:53.271992+0000","last_unstale":"2023-12-11T20:13:54.253684+0000","last_undegraded":"2023-12-11T20:13:54.253684+0000","last_fullsized":"2023-12-11T20:13:54.253684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:01:05.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581723+0000","last_change":"2023-12-11T20:13:53.275078+0000","last_active":"2023-12-11T20:13:54.581723+0000","last_peered":"2023-12-11T20:13:54.581723+0000","last_clean":"2023-12-11T20:13:54.581723+0000","last_became_active":"2023-12-11T20:13:53.273555+0000","last_became_peered":"2023-12-11T20:13:53.273555+0000","last_unstale":"2023-12-11T20:13:54.581723+0000","last_undegraded":"2023-12-11T20:13:54.581723+0000","last_fullsized":"2023-12-11T20:13:54.581723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:23:27.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581738+0000","last_change":"2023-12-11T20:13:53.277135+0000","last_active":"2023-12-11T20:13:54.581738+0000","last_peered":"2023-12-11T20:13:54.581738+0000","last_clean":"2023-12-11T20:13:54.581738+0000","last_became_active":"2023-12-11T20:13:53.276406+0000","last_became_peered":"2023-12-11T20:13:53.276406+0000","last_unstale":"2023-12-11T20:13:54.581738+0000","last_undegraded":"2023-12-11T20:13:54.581738+0000","last_fullsized":"2023-12-11T20:13:54.581738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:20.508685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581278+0000","last_change":"2023-12-11T20:13:53.268845+0000","last_active":"2023-12-11T20:13:54.581278+0000","last_peered":"2023-12-11T20:13:54.581278+0000","last_clean":"2023-12-11T20:13:54.581278+0000","last_became_active":"2023-12-11T20:13:53.268553+0000","last_became_peered":"2023-12-11T20:13:53.268553+0000","last_unstale":"2023-12-11T20:13:54.581278+0000","last_undegraded":"2023-12-11T20:13:54.581278+0000","last_fullsized":"2023-12-11T20:13:54.581278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:55.125792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604661+0000","last_change":"2023-12-11T20:13:53.284361+0000","last_active":"2023-12-11T20:13:54.604661+0000","last_peered":"2023-12-11T20:13:54.604661+0000","last_clean":"2023-12-11T20:13:54.604661+0000","last_became_active":"2023-12-11T20:13:53.282109+0000","last_became_peered":"2023-12-11T20:13:53.282109+0000","last_unstale":"2023-12-11T20:13:54.604661+0000","last_undegraded":"2023-12-11T20:13:54.604661+0000","last_fullsized":"2023-12-11T20:13:54.604661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:44:50.021737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.583219+0000","last_change":"2023-12-11T20:13:53.274005+0000","last_active":"2023-12-11T20:13:54.583219+0000","last_peered":"2023-12-11T20:13:54.583219+0000","last_clean":"2023-12-11T20:13:54.583219+0000","last_became_active":"2023-12-11T20:13:53.273336+0000","last_became_peered":"2023-12-11T20:13:53.273336+0000","last_unstale":"2023-12-11T20:13:54.583219+0000","last_undegraded":"2023-12-11T20:13:54.583219+0000","last_fullsized":"2023-12-11T20:13:54.583219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:56:05.732607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254598+0000","last_change":"2023-12-11T20:13:53.280909+0000","last_active":"2023-12-11T20:13:54.254598+0000","last_peered":"2023-12-11T20:13:54.254598+0000","last_clean":"2023-12-11T20:13:54.254598+0000","last_became_active":"2023-12-11T20:13:53.278124+0000","last_became_peered":"2023-12-11T20:13:53.278124+0000","last_unstale":"2023-12-11T20:13:54.254598+0000","last_undegraded":"2023-12-11T20:13:54.254598+0000","last_fullsized":"2023-12-11T20:13:54.254598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:09:19.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:57.512133+0000","last_change":"2023-12-11T20:13:52.478685+0000","last_active":"2023-12-11T20:13:57.512133+0000","last_peered":"2023-12-11T20:13:57.512133+0000","last_clean":"2023-12-11T20:13:57.512133+0000","last_became_active":"2023-12-11T20:13:52.478391+0000","last_became_peered":"2023-12-11T20:13:52.478391+0000","last_unstale":"2023-12-11T20:13:57.512133+0000","last_undegraded":"2023-12-11T20:13:57.512133+0000","last_fullsized":"2023-12-11T20:13:57.512133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:02:54.039954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582340+0000","last_change":"2023-12-11T20:13:53.279432+0000","last_active":"2023-12-11T20:13:54.582340+0000","last_peered":"2023-12-11T20:13:54.582340+0000","last_clean":"2023-12-11T20:13:54.582340+0000","last_became_active":"2023-12-11T20:13:53.279087+0000","last_became_peered":"2023-12-11T20:13:53.279087+0000","last_unstale":"2023-12-11T20:13:54.582340+0000","last_undegraded":"2023-12-11T20:13:54.582340+0000","last_fullsized":"2023-12-11T20:13:54.582340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.376941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582497+0000","last_change":"2023-12-11T20:13:52.485170+0000","last_active":"2023-12-11T20:13:54.582497+0000","last_peered":"2023-12-11T20:13:54.582497+0000","last_clean":"2023-12-11T20:13:54.582497+0000","last_became_active":"2023-12-11T20:13:52.484885+0000","last_became_peered":"2023-12-11T20:13:52.484885+0000","last_unstale":"2023-12-11T20:13:54.582497+0000","last_undegraded":"2023-12-11T20:13:54.582497+0000","last_fullsized":"2023-12-11T20:13:54.582497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:21:40.746709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582385+0000","last_change":"2023-12-11T20:13:53.274015+0000","last_active":"2023-12-11T20:13:54.582385+0000","last_peered":"2023-12-11T20:13:54.582385+0000","last_clean":"2023-12-11T20:13:54.582385+0000","last_became_active":"2023-12-11T20:13:53.272504+0000","last_became_peered":"2023-12-11T20:13:53.272504+0000","last_unstale":"2023-12-11T20:13:54.582385+0000","last_undegraded":"2023-12-11T20:13:54.582385+0000","last_fullsized":"2023-12-11T20:13:54.582385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:26.155659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582037+0000","last_change":"2023-12-11T20:13:52.474961+0000","last_active":"2023-12-11T20:13:54.582037+0000","last_peered":"2023-12-11T20:13:54.582037+0000","last_clean":"2023-12-11T20:13:54.582037+0000","last_became_active":"2023-12-11T20:13:52.474559+0000","last_became_peered":"2023-12-11T20:13:52.474559+0000","last_unstale":"2023-12-11T20:13:54.582037+0000","last_undegraded":"2023-12-11T20:13:54.582037+0000","last_fullsized":"2023-12-11T20:13:54.582037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:44:37.596075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582034+0000","last_change":"2023-12-11T20:13:53.268907+0000","last_active":"2023-12-11T20:13:54.582034+0000","last_peered":"2023-12-11T20:13:54.582034+0000","last_clean":"2023-12-11T20:13:54.582034+0000","last_became_active":"2023-12-11T20:13:53.268494+0000","last_became_peered":"2023-12-11T20:13:53.268494+0000","last_unstale":"2023-12-11T20:13:54.582034+0000","last_undegraded":"2023-12-11T20:13:54.582034+0000","last_fullsized":"2023-12-11T20:13:54.582034+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:57:36.104687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582153+0000","last_change":"2023-12-11T20:13:52.475425+0000","last_active":"2023-12-11T20:13:54.582153+0000","last_peered":"2023-12-11T20:13:54.582153+0000","last_clean":"2023-12-11T20:13:54.582153+0000","last_became_active":"2023-12-11T20:13:52.475066+0000","last_became_peered":"2023-12-11T20:13:52.475066+0000","last_unstale":"2023-12-11T20:13:54.582153+0000","last_undegraded":"2023-12-11T20:13:54.582153+0000","last_fullsized":"2023-12-11T20:13:54.582153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:01:01.603043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582315+0000","last_change":"2023-12-11T20:13:53.278495+0000","last_active":"2023-12-11T20:13:54.582315+0000","last_peered":"2023-12-11T20:13:54.582315+0000","last_clean":"2023-12-11T20:13:54.582315+0000","last_became_active":"2023-12-11T20:13:53.278164+0000","last_became_peered":"2023-12-11T20:13:53.278164+0000","last_unstale":"2023-12-11T20:13:54.582315+0000","last_undegraded":"2023-12-11T20:13:54.582315+0000","last_fullsized":"2023-12-11T20:13:54.582315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:07:42.942595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:58.263750+0000","last_change":"2023-12-11T20:13:52.481648+0000","last_active":"2023-12-11T20:13:58.263750+0000","last_peered":"2023-12-11T20:13:58.263750+0000","last_clean":"2023-12-11T20:13:58.263750+0000","last_became_active":"2023-12-11T20:13:52.481317+0000","last_became_peered":"2023-12-11T20:13:52.481317+0000","last_unstale":"2023-12-11T20:13:58.263750+0000","last_undegraded":"2023-12-11T20:13:58.263750+0000","last_fullsized":"2023-12-11T20:13:58.263750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:30:32.206757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1011,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581677+0000","last_change":"2023-12-11T20:13:53.261350+0000","last_active":"2023-12-11T20:13:54.581677+0000","last_peered":"2023-12-11T20:13:54.581677+0000","last_clean":"2023-12-11T20:13:54.581677+0000","last_became_active":"2023-12-11T20:13:53.260471+0000","last_became_peered":"2023-12-11T20:13:53.260471+0000","last_unstale":"2023-12-11T20:13:54.581677+0000","last_undegraded":"2023-12-11T20:13:54.581677+0000","last_fullsized":"2023-12-11T20:13:54.581677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:27.844329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253587+0000","last_change":"2023-12-11T20:13:52.482190+0000","last_active":"2023-12-11T20:13:54.253587+0000","last_peered":"2023-12-11T20:13:54.253587+0000","last_clean":"2023-12-11T20:13:54.253587+0000","last_became_active":"2023-12-11T20:13:52.481758+0000","last_became_peered":"2023-12-11T20:13:52.481758+0000","last_unstale":"2023-12-11T20:13:54.253587+0000","last_undegraded":"2023-12-11T20:13:54.253587+0000","last_fullsized":"2023-12-11T20:13:54.253587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:26.226338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582493+0000","last_change":"2023-12-11T20:13:53.279366+0000","last_active":"2023-12-11T20:13:54.582493+0000","last_peered":"2023-12-11T20:13:54.582493+0000","last_clean":"2023-12-11T20:13:54.582493+0000","last_became_active":"2023-12-11T20:13:53.279074+0000","last_became_peered":"2023-12-11T20:13:53.279074+0000","last_unstale":"2023-12-11T20:13:54.582493+0000","last_undegraded":"2023-12-11T20:13:54.582493+0000","last_fullsized":"2023-12-11T20:13:54.582493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:37.856345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-11T20:13:53.251539+0000","last_change":"2023-12-11T20:13:52.480830+0000","last_active":"2023-12-11T20:13:53.251539+0000","last_peered":"2023-12-11T20:13:53.251539+0000","last_clean":"2023-12-11T20:13:53.251539+0000","last_became_active":"2023-12-11T20:13:52.480359+0000","last_became_peered":"2023-12-11T20:13:52.480359+0000","last_unstale":"2023-12-11T20:13:53.251539+0000","last_undegraded":"2023-12-11T20:13:53.251539+0000","last_fullsized":"2023-12-11T20:13:53.251539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:13.756411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.580944+0000","last_change":"2023-12-11T20:13:53.275587+0000","last_active":"2023-12-11T20:13:54.580944+0000","last_peered":"2023-12-11T20:13:54.580944+0000","last_clean":"2023-12-11T20:13:54.580944+0000","last_became_active":"2023-12-11T20:13:53.275014+0000","last_became_peered":"2023-12-11T20:13:53.275014+0000","last_unstale":"2023-12-11T20:13:54.580944+0000","last_undegraded":"2023-12-11T20:13:54.580944+0000","last_fullsized":"2023-12-11T20:13:54.580944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:21:23.179714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581624+0000","last_change":"2023-12-11T20:13:52.485088+0000","last_active":"2023-12-11T20:13:54.581624+0000","last_peered":"2023-12-11T20:13:54.581624+0000","last_clean":"2023-12-11T20:13:54.581624+0000","last_became_active":"2023-12-11T20:13:52.480366+0000","last_became_peered":"2023-12-11T20:13:52.480366+0000","last_unstale":"2023-12-11T20:13:54.581624+0000","last_undegraded":"2023-12-11T20:13:54.581624+0000","last_fullsized":"2023-12-11T20:13:54.581624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:41:17.198234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582526+0000","last_change":"2023-12-11T20:13:53.281254+0000","last_active":"2023-12-11T20:13:54.582526+0000","last_peered":"2023-12-11T20:13:54.582526+0000","last_clean":"2023-12-11T20:13:54.582526+0000","last_became_active":"2023-12-11T20:13:53.278026+0000","last_became_peered":"2023-12-11T20:13:53.278026+0000","last_unstale":"2023-12-11T20:13:54.582526+0000","last_undegraded":"2023-12-11T20:13:54.582526+0000","last_fullsized":"2023-12-11T20:13:54.582526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:25:46.033739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254081+0000","last_change":"2023-12-11T20:13:52.485136+0000","last_active":"2023-12-11T20:13:54.254081+0000","last_peered":"2023-12-11T20:13:54.254081+0000","last_clean":"2023-12-11T20:13:54.254081+0000","last_became_active":"2023-12-11T20:13:52.484743+0000","last_became_peered":"2023-12-11T20:13:52.484743+0000","last_unstale":"2023-12-11T20:13:54.254081+0000","last_undegraded":"2023-12-11T20:13:54.254081+0000","last_fullsized":"2023-12-11T20:13:54.254081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:50.893360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.583044+0000","last_change":"2023-12-11T20:13:53.274566+0000","last_active":"2023-12-11T20:13:54.583044+0000","last_peered":"2023-12-11T20:13:54.583044+0000","last_clean":"2023-12-11T20:13:54.583044+0000","last_became_active":"2023-12-11T20:13:53.273325+0000","last_became_peered":"2023-12-11T20:13:53.273325+0000","last_unstale":"2023-12-11T20:13:54.583044+0000","last_undegraded":"2023-12-11T20:13:54.583044+0000","last_fullsized":"2023-12-11T20:13:54.583044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:29:17.656364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.502323+0000","last_change":"2023-12-11T20:13:52.478639+0000","last_active":"2023-12-11T20:13:56.502323+0000","last_peered":"2023-12-11T20:13:56.502323+0000","last_clean":"2023-12-11T20:13:56.502323+0000","last_became_active":"2023-12-11T20:13:52.478042+0000","last_became_peered":"2023-12-11T20:13:52.478042+0000","last_unstale":"2023-12-11T20:13:56.502323+0000","last_undegraded":"2023-12-11T20:13:56.502323+0000","last_fullsized":"2023-12-11T20:13:56.502323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:18:55.633411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582165+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:13:54.582165+0000","last_peered":"2023-12-11T20:13:54.582165+0000","last_clean":"2023-12-11T20:13:54.582165+0000","last_became_active":"2023-12-11T20:13:53.283287+0000","last_became_peered":"2023-12-11T20:13:53.283287+0000","last_unstale":"2023-12-11T20:13:54.582165+0000","last_undegraded":"2023-12-11T20:13:54.582165+0000","last_fullsized":"2023-12-11T20:13:54.582165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:51:56.643292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.503279+0000","last_change":"2023-12-11T20:13:52.486247+0000","last_active":"2023-12-11T20:13:56.503279+0000","last_peered":"2023-12-11T20:13:56.503279+0000","last_clean":"2023-12-11T20:13:56.503279+0000","last_became_active":"2023-12-11T20:13:52.485343+0000","last_became_peered":"2023-12-11T20:13:52.485343+0000","last_unstale":"2023-12-11T20:13:56.503279+0000","last_undegraded":"2023-12-11T20:13:56.503279+0000","last_fullsized":"2023-12-11T20:13:56.503279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:21:46.587858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582238+0000","last_change":"2023-12-11T20:13:53.281264+0000","last_active":"2023-12-11T20:13:54.582238+0000","last_peered":"2023-12-11T20:13:54.582238+0000","last_clean":"2023-12-11T20:13:54.582238+0000","last_became_active":"2023-12-11T20:13:53.280899+0000","last_became_peered":"2023-12-11T20:13:53.280899+0000","last_unstale":"2023-12-11T20:13:54.582238+0000","last_undegraded":"2023-12-11T20:13:54.582238+0000","last_fullsized":"2023-12-11T20:13:54.582238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:17.675421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253926+0000","last_change":"2023-12-11T20:13:52.475732+0000","last_active":"2023-12-11T20:13:54.253926+0000","last_peered":"2023-12-11T20:13:54.253926+0000","last_clean":"2023-12-11T20:13:54.253926+0000","last_became_active":"2023-12-11T20:13:52.475415+0000","last_became_peered":"2023-12-11T20:13:52.475415+0000","last_unstale":"2023-12-11T20:13:54.253926+0000","last_undegraded":"2023-12-11T20:13:54.253926+0000","last_fullsized":"2023-12-11T20:13:54.253926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:20:31.539997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581939+0000","last_change":"2023-12-11T20:13:53.273365+0000","last_active":"2023-12-11T20:13:54.581939+0000","last_peered":"2023-12-11T20:13:54.581939+0000","last_clean":"2023-12-11T20:13:54.581939+0000","last_became_active":"2023-12-11T20:13:53.268456+0000","last_became_peered":"2023-12-11T20:13:53.268456+0000","last_unstale":"2023-12-11T20:13:54.581939+0000","last_undegraded":"2023-12-11T20:13:54.581939+0000","last_fullsized":"2023-12-11T20:13:54.581939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:13.850229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254482+0000","last_change":"2023-12-11T20:13:52.477609+0000","last_active":"2023-12-11T20:13:54.254482+0000","last_peered":"2023-12-11T20:13:54.254482+0000","last_clean":"2023-12-11T20:13:54.254482+0000","last_became_active":"2023-12-11T20:13:52.477177+0000","last_became_peered":"2023-12-11T20:13:52.477177+0000","last_unstale":"2023-12-11T20:13:54.254482+0000","last_undegraded":"2023-12-11T20:13:54.254482+0000","last_fullsized":"2023-12-11T20:13:54.254482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:46.987026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253465+0000","last_change":"2023-12-11T20:13:53.278247+0000","last_active":"2023-12-11T20:13:54.253465+0000","last_peered":"2023-12-11T20:13:54.253465+0000","last_clean":"2023-12-11T20:13:54.253465+0000","last_became_active":"2023-12-11T20:13:53.277928+0000","last_became_peered":"2023-12-11T20:13:53.277928+0000","last_unstale":"2023-12-11T20:13:54.253465+0000","last_undegraded":"2023-12-11T20:13:54.253465+0000","last_fullsized":"2023-12-11T20:13:54.253465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:52:33.864370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.502606+0000","last_change":"2023-12-11T20:13:52.485985+0000","last_active":"2023-12-11T20:13:56.502606+0000","last_peered":"2023-12-11T20:13:56.502606+0000","last_clean":"2023-12-11T20:13:56.502606+0000","last_became_active":"2023-12-11T20:13:52.484929+0000","last_became_peered":"2023-12-11T20:13:52.484929+0000","last_unstale":"2023-12-11T20:13:56.502606+0000","last_undegraded":"2023-12-11T20:13:56.502606+0000","last_fullsized":"2023-12-11T20:13:56.502606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T08:11:28.665448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582318+0000","last_change":"2023-12-11T20:13:53.277048+0000","last_active":"2023-12-11T20:13:54.582318+0000","last_peered":"2023-12-11T20:13:54.582318+0000","last_clean":"2023-12-11T20:13:54.582318+0000","last_became_active":"2023-12-11T20:13:53.276706+0000","last_became_peered":"2023-12-11T20:13:53.276706+0000","last_unstale":"2023-12-11T20:13:54.582318+0000","last_undegraded":"2023-12-11T20:13:54.582318+0000","last_fullsized":"2023-12-11T20:13:54.582318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:46.815339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-11T20:13:53.271515+0000","last_change":"2023-12-11T20:13:52.477814+0000","last_active":"2023-12-11T20:13:53.271515+0000","last_peered":"2023-12-11T20:13:53.271515+0000","last_clean":"2023-12-11T20:13:53.271515+0000","last_became_active":"2023-12-11T20:13:52.477036+0000","last_became_peered":"2023-12-11T20:13:52.477036+0000","last_unstale":"2023-12-11T20:13:53.271515+0000","last_undegraded":"2023-12-11T20:13:53.271515+0000","last_fullsized":"2023-12-11T20:13:53.271515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:53:44.279968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582182+0000","last_change":"2023-12-11T20:13:53.276279+0000","last_active":"2023-12-11T20:13:54.582182+0000","last_peered":"2023-12-11T20:13:54.582182+0000","last_clean":"2023-12-11T20:13:54.582182+0000","last_became_active":"2023-12-11T20:13:53.273638+0000","last_became_peered":"2023-12-11T20:13:53.273638+0000","last_unstale":"2023-12-11T20:13:54.582182+0000","last_undegraded":"2023-12-11T20:13:54.582182+0000","last_fullsized":"2023-12-11T20:13:54.582182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:07:03.289511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581374+0000","last_change":"2023-12-11T20:13:52.483417+0000","last_active":"2023-12-11T20:13:54.581374+0000","last_peered":"2023-12-11T20:13:54.581374+0000","last_clean":"2023-12-11T20:13:54.581374+0000","last_became_active":"2023-12-11T20:13:52.481395+0000","last_became_peered":"2023-12-11T20:13:52.481395+0000","last_unstale":"2023-12-11T20:13:54.581374+0000","last_undegraded":"2023-12-11T20:13:54.581374+0000","last_fullsized":"2023-12-11T20:13:54.581374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:01:42.053460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582360+0000","last_change":"2023-12-11T20:13:53.280688+0000","last_active":"2023-12-11T20:13:54.582360+0000","last_peered":"2023-12-11T20:13:54.582360+0000","last_clean":"2023-12-11T20:13:54.582360+0000","last_became_active":"2023-12-11T20:13:53.277300+0000","last_became_peered":"2023-12-11T20:13:53.277300+0000","last_unstale":"2023-12-11T20:13:54.582360+0000","last_undegraded":"2023-12-11T20:13:54.582360+0000","last_fullsized":"2023-12-11T20:13:54.582360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:40:58.831909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582131+0000","last_change":"2023-12-11T20:13:52.474978+0000","last_active":"2023-12-11T20:13:54.582131+0000","last_peered":"2023-12-11T20:13:54.582131+0000","last_clean":"2023-12-11T20:13:54.582131+0000","last_became_active":"2023-12-11T20:13:52.472863+0000","last_became_peered":"2023-12-11T20:13:52.472863+0000","last_unstale":"2023-12-11T20:13:54.582131+0000","last_undegraded":"2023-12-11T20:13:54.582131+0000","last_fullsized":"2023-12-11T20:13:54.582131+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:53:44.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604417+0000","last_change":"2023-12-11T20:13:53.285991+0000","last_active":"2023-12-11T20:13:54.604417+0000","last_peered":"2023-12-11T20:13:54.604417+0000","last_clean":"2023-12-11T20:13:54.604417+0000","last_became_active":"2023-12-11T20:13:53.283925+0000","last_became_peered":"2023-12-11T20:13:53.283925+0000","last_unstale":"2023-12-11T20:13:54.604417+0000","last_undegraded":"2023-12-11T20:13:54.604417+0000","last_fullsized":"2023-12-11T20:13:54.604417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:15:48.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.583106+0000","last_change":"2023-12-11T20:13:52.478883+0000","last_active":"2023-12-11T20:13:54.583106+0000","last_peered":"2023-12-11T20:13:54.583106+0000","last_clean":"2023-12-11T20:13:54.583106+0000","last_became_active":"2023-12-11T20:13:52.477070+0000","last_became_peered":"2023-12-11T20:13:52.477070+0000","last_unstale":"2023-12-11T20:13:54.583106+0000","last_undegraded":"2023-12-11T20:13:54.583106+0000","last_fullsized":"2023-12-11T20:13:54.583106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:14:32.504778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254009+0000","last_change":"2023-12-11T20:13:53.278181+0000","last_active":"2023-12-11T20:13:54.254009+0000","last_peered":"2023-12-11T20:13:54.254009+0000","last_clean":"2023-12-11T20:13:54.254009+0000","last_became_active":"2023-12-11T20:13:53.277800+0000","last_became_peered":"2023-12-11T20:13:53.277800+0000","last_unstale":"2023-12-11T20:13:54.254009+0000","last_undegraded":"2023-12-11T20:13:54.254009+0000","last_fullsized":"2023-12-11T20:13:54.254009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:35.424820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:55.461510+0000","last_change":"2023-12-11T20:13:52.481281+0000","last_active":"2023-12-11T20:13:55.461510+0000","last_peered":"2023-12-11T20:13:55.461510+0000","last_clean":"2023-12-11T20:13:55.461510+0000","last_became_active":"2023-12-11T20:13:52.479352+0000","last_became_peered":"2023-12-11T20:13:52.479352+0000","last_unstale":"2023-12-11T20:13:55.461510+0000","last_undegraded":"2023-12-11T20:13:55.461510+0000","last_fullsized":"2023-12-11T20:13:55.461510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:41.815011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253876+0000","last_change":"2023-12-11T20:13:53.282233+0000","last_active":"2023-12-11T20:13:54.253876+0000","last_peered":"2023-12-11T20:13:54.253876+0000","last_clean":"2023-12-11T20:13:54.253876+0000","last_became_active":"2023-12-11T20:13:53.279001+0000","last_became_peered":"2023-12-11T20:13:53.279001+0000","last_unstale":"2023-12-11T20:13:54.253876+0000","last_undegraded":"2023-12-11T20:13:54.253876+0000","last_fullsized":"2023-12-11T20:13:54.253876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:30:21.671414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581849+0000","last_change":"2023-12-11T20:13:53.269361+0000","last_active":"2023-12-11T20:13:54.581849+0000","last_peered":"2023-12-11T20:13:54.581849+0000","last_clean":"2023-12-11T20:13:54.581849+0000","last_became_active":"2023-12-11T20:13:53.268613+0000","last_became_peered":"2023-12-11T20:13:53.268613+0000","last_unstale":"2023-12-11T20:13:54.581849+0000","last_undegraded":"2023-12-11T20:13:54.581849+0000","last_fullsized":"2023-12-11T20:13:54.581849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:08:04.876038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253164+0000","last_change":"2023-12-11T20:13:52.484537+0000","last_active":"2023-12-11T20:13:54.253164+0000","last_peered":"2023-12-11T20:13:54.253164+0000","last_clean":"2023-12-11T20:13:54.253164+0000","last_became_active":"2023-12-11T20:13:52.482732+0000","last_became_peered":"2023-12-11T20:13:52.482732+0000","last_unstale":"2023-12-11T20:13:54.253164+0000","last_undegraded":"2023-12-11T20:13:54.253164+0000","last_fullsized":"2023-12-11T20:13:54.253164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:41:31.332046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581473+0000","last_change":"2023-12-11T20:13:53.270953+0000","last_active":"2023-12-11T20:13:54.581473+0000","last_peered":"2023-12-11T20:13:54.581473+0000","last_clean":"2023-12-11T20:13:54.581473+0000","last_became_active":"2023-12-11T20:13:53.269711+0000","last_became_peered":"2023-12-11T20:13:53.269711+0000","last_unstale":"2023-12-11T20:13:54.581473+0000","last_undegraded":"2023-12-11T20:13:54.581473+0000","last_fullsized":"2023-12-11T20:13:54.581473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:16:50.802953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.499880+0000","last_change":"2023-12-11T20:13:52.473341+0000","last_active":"2023-12-11T20:13:56.499880+0000","last_peered":"2023-12-11T20:13:56.499880+0000","last_clean":"2023-12-11T20:13:56.499880+0000","last_became_active":"2023-12-11T20:13:52.469572+0000","last_became_peered":"2023-12-11T20:13:52.469572+0000","last_unstale":"2023-12-11T20:13:56.499880+0000","last_undegraded":"2023-12-11T20:13:56.499880+0000","last_fullsized":"2023-12-11T20:13:56.499880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:52:47.513645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-11T20:13:53.268990+0000","last_change":"2023-12-11T20:12:30.330188+0000","last_active":"2023-12-11T20:13:53.268990+0000","last_peered":"2023-12-11T20:13:53.268990+0000","last_clean":"2023-12-11T20:13:53.268990+0000","last_became_active":"2023-12-11T20:12:30.329533+0000","last_became_peered":"2023-12-11T20:12:30.329533+0000","last_unstale":"2023-12-11T20:13:53.268990+0000","last_undegraded":"2023-12-11T20:13:53.268990+0000","last_fullsized":"2023-12-11T20:13:53.268990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_clean_scrub_stamp":"2023-12-11T20:08:47.558016+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:18:10.357750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253205+0000","last_change":"2023-12-11T20:13:53.278062+0000","last_active":"2023-12-11T20:13:54.253205+0000","last_peered":"2023-12-11T20:13:54.253205+0000","last_clean":"2023-12-11T20:13:54.253205+0000","last_became_active":"2023-12-11T20:13:53.277664+0000","last_became_peered":"2023-12-11T20:13:53.277664+0000","last_unstale":"2023-12-11T20:13:54.253205+0000","last_undegraded":"2023-12-11T20:13:54.253205+0000","last_fullsized":"2023-12-11T20:13:54.253205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:07:38.751486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:57.510634+0000","last_change":"2023-12-11T20:13:52.481772+0000","last_active":"2023-12-11T20:13:57.510634+0000","last_peered":"2023-12-11T20:13:57.510634+0000","last_clean":"2023-12-11T20:13:57.510634+0000","last_became_active":"2023-12-11T20:13:52.481050+0000","last_became_peered":"2023-12-11T20:13:52.481050+0000","last_unstale":"2023-12-11T20:13:57.510634+0000","last_undegraded":"2023-12-11T20:13:57.510634+0000","last_fullsized":"2023-12-11T20:13:57.510634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:28:50.998994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581891+0000","last_change":"2023-12-11T20:13:52.478823+0000","last_active":"2023-12-11T20:13:54.581891+0000","last_peered":"2023-12-11T20:13:54.581891+0000","last_clean":"2023-12-11T20:13:54.581891+0000","last_became_active":"2023-12-11T20:13:52.478475+0000","last_became_peered":"2023-12-11T20:13:52.478475+0000","last_unstale":"2023-12-11T20:13:54.581891+0000","last_undegraded":"2023-12-11T20:13:54.581891+0000","last_fullsized":"2023-12-11T20:13:54.581891+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:44:36.438152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.255411+0000","last_change":"2023-12-11T20:13:53.272496+0000","last_active":"2023-12-11T20:13:54.255411+0000","last_peered":"2023-12-11T20:13:54.255411+0000","last_clean":"2023-12-11T20:13:54.255411+0000","last_became_active":"2023-12-11T20:13:53.271669+0000","last_became_peered":"2023-12-11T20:13:53.271669+0000","last_unstale":"2023-12-11T20:13:54.255411+0000","last_undegraded":"2023-12-11T20:13:54.255411+0000","last_fullsized":"2023-12-11T20:13:54.255411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:48:31.299659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:57.511840+0000","last_change":"2023-12-11T20:13:52.485866+0000","last_active":"2023-12-11T20:13:57.511840+0000","last_peered":"2023-12-11T20:13:57.511840+0000","last_clean":"2023-12-11T20:13:57.511840+0000","last_became_active":"2023-12-11T20:13:52.485106+0000","last_became_peered":"2023-12-11T20:13:52.485106+0000","last_unstale":"2023-12-11T20:13:57.511840+0000","last_undegraded":"2023-12-11T20:13:57.511840+0000","last_fullsized":"2023-12-11T20:13:57.511840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:24:41.177294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582496+0000","last_change":"2023-12-11T20:13:53.271737+0000","last_active":"2023-12-11T20:13:54.582496+0000","last_peered":"2023-12-11T20:13:54.582496+0000","last_clean":"2023-12-11T20:13:54.582496+0000","last_became_active":"2023-12-11T20:13:53.271228+0000","last_became_peered":"2023-12-11T20:13:53.271228+0000","last_unstale":"2023-12-11T20:13:54.582496+0000","last_undegraded":"2023-12-11T20:13:54.582496+0000","last_fullsized":"2023-12-11T20:13:54.582496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:45.614455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.499503+0000","last_change":"2023-12-11T20:13:52.475488+0000","last_active":"2023-12-11T20:13:56.499503+0000","last_peered":"2023-12-11T20:13:56.499503+0000","last_clean":"2023-12-11T20:13:56.499503+0000","last_became_active":"2023-12-11T20:13:52.475150+0000","last_became_peered":"2023-12-11T20:13:52.475150+0000","last_unstale":"2023-12-11T20:13:56.499503+0000","last_undegraded":"2023-12-11T20:13:56.499503+0000","last_fullsized":"2023-12-11T20:13:56.499503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:42:55.792758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582189+0000","last_change":"2023-12-11T20:13:53.285381+0000","last_active":"2023-12-11T20:13:54.582189+0000","last_peered":"2023-12-11T20:13:54.582189+0000","last_clean":"2023-12-11T20:13:54.582189+0000","last_became_active":"2023-12-11T20:13:53.285069+0000","last_became_peered":"2023-12-11T20:13:53.285069+0000","last_unstale":"2023-12-11T20:13:54.582189+0000","last_undegraded":"2023-12-11T20:13:54.582189+0000","last_fullsized":"2023-12-11T20:13:54.582189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:57:18.630314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.502139+0000","last_change":"2023-12-11T20:13:52.483184+0000","last_active":"2023-12-11T20:13:56.502139+0000","last_peered":"2023-12-11T20:13:56.502139+0000","last_clean":"2023-12-11T20:13:56.502139+0000","last_became_active":"2023-12-11T20:13:52.482853+0000","last_became_peered":"2023-12-11T20:13:52.482853+0000","last_unstale":"2023-12-11T20:13:56.502139+0000","last_undegraded":"2023-12-11T20:13:56.502139+0000","last_fullsized":"2023-12-11T20:13:56.502139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:35.111222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581398+0000","last_change":"2023-12-11T20:13:53.271751+0000","last_active":"2023-12-11T20:13:54.581398+0000","last_peered":"2023-12-11T20:13:54.581398+0000","last_clean":"2023-12-11T20:13:54.581398+0000","last_became_active":"2023-12-11T20:13:53.271385+0000","last_became_peered":"2023-12-11T20:13:53.271385+0000","last_unstale":"2023-12-11T20:13:54.581398+0000","last_undegraded":"2023-12-11T20:13:54.581398+0000","last_fullsized":"2023-12-11T20:13:54.581398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:28:03.856212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.501020+0000","last_change":"2023-12-11T20:13:52.483504+0000","last_active":"2023-12-11T20:13:56.501020+0000","last_peered":"2023-12-11T20:13:56.501020+0000","last_clean":"2023-12-11T20:13:56.501020+0000","last_became_active":"2023-12-11T20:13:52.482796+0000","last_became_peered":"2023-12-11T20:13:52.482796+0000","last_unstale":"2023-12-11T20:13:56.501020+0000","last_undegraded":"2023-12-11T20:13:56.501020+0000","last_fullsized":"2023-12-11T20:13:56.501020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:34:27.162215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604333+0000","last_change":"2023-12-11T20:13:53.276017+0000","last_active":"2023-12-11T20:13:54.604333+0000","last_peered":"2023-12-11T20:13:54.604333+0000","last_clean":"2023-12-11T20:13:54.604333+0000","last_became_active":"2023-12-11T20:13:53.275425+0000","last_became_peered":"2023-12-11T20:13:53.275425+0000","last_unstale":"2023-12-11T20:13:54.604333+0000","last_undegraded":"2023-12-11T20:13:54.604333+0000","last_fullsized":"2023-12-11T20:13:54.604333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:36.762187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254298+0000","last_change":"2023-12-11T20:13:52.477538+0000","last_active":"2023-12-11T20:13:54.254298+0000","last_peered":"2023-12-11T20:13:54.254298+0000","last_clean":"2023-12-11T20:13:54.254298+0000","last_became_active":"2023-12-11T20:13:52.476937+0000","last_became_peered":"2023-12-11T20:13:52.476937+0000","last_unstale":"2023-12-11T20:13:54.254298+0000","last_undegraded":"2023-12-11T20:13:54.254298+0000","last_fullsized":"2023-12-11T20:13:54.254298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:41:25.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581943+0000","last_change":"2023-12-11T20:13:53.276419+0000","last_active":"2023-12-11T20:13:54.581943+0000","last_peered":"2023-12-11T20:13:54.581943+0000","last_clean":"2023-12-11T20:13:54.581943+0000","last_became_active":"2023-12-11T20:13:53.276106+0000","last_became_peered":"2023-12-11T20:13:53.276106+0000","last_unstale":"2023-12-11T20:13:54.581943+0000","last_undegraded":"2023-12-11T20:13:54.581943+0000","last_fullsized":"2023-12-11T20:13:54.581943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:32.720877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581646+0000","last_change":"2023-12-11T20:13:52.480874+0000","last_active":"2023-12-11T20:13:54.581646+0000","last_peered":"2023-12-11T20:13:54.581646+0000","last_clean":"2023-12-11T20:13:54.581646+0000","last_became_active":"2023-12-11T20:13:52.480512+0000","last_became_peered":"2023-12-11T20:13:52.480512+0000","last_unstale":"2023-12-11T20:13:54.581646+0000","last_undegraded":"2023-12-11T20:13:54.581646+0000","last_fullsized":"2023-12-11T20:13:54.581646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:16:07.813113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581764+0000","last_change":"2023-12-11T20:13:53.265917+0000","last_active":"2023-12-11T20:13:54.581764+0000","last_peered":"2023-12-11T20:13:54.581764+0000","last_clean":"2023-12-11T20:13:54.581764+0000","last_became_active":"2023-12-11T20:13:53.265569+0000","last_became_peered":"2023-12-11T20:13:53.265569+0000","last_unstale":"2023-12-11T20:13:54.581764+0000","last_undegraded":"2023-12-11T20:13:54.581764+0000","last_fullsized":"2023-12-11T20:13:54.581764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:37:19.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254453+0000","last_change":"2023-12-11T20:13:52.478688+0000","last_active":"2023-12-11T20:13:54.254453+0000","last_peered":"2023-12-11T20:13:54.254453+0000","last_clean":"2023-12-11T20:13:54.254453+0000","last_became_active":"2023-12-11T20:13:52.477834+0000","last_became_peered":"2023-12-11T20:13:52.477834+0000","last_unstale":"2023-12-11T20:13:54.254453+0000","last_undegraded":"2023-12-11T20:13:54.254453+0000","last_fullsized":"2023-12-11T20:13:54.254453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:57:04.707801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582239+0000","last_change":"2023-12-11T20:13:53.274629+0000","last_active":"2023-12-11T20:13:54.582239+0000","last_peered":"2023-12-11T20:13:54.582239+0000","last_clean":"2023-12-11T20:13:54.582239+0000","last_became_active":"2023-12-11T20:13:53.269650+0000","last_became_peered":"2023-12-11T20:13:53.269650+0000","last_unstale":"2023-12-11T20:13:54.582239+0000","last_undegraded":"2023-12-11T20:13:54.582239+0000","last_fullsized":"2023-12-11T20:13:54.582239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:57:59.865232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582208+0000","last_change":"2023-12-11T20:13:52.485902+0000","last_active":"2023-12-11T20:13:54.582208+0000","last_peered":"2023-12-11T20:13:54.582208+0000","last_clean":"2023-12-11T20:13:54.582208+0000","last_became_active":"2023-12-11T20:13:52.481982+0000","last_became_peered":"2023-12-11T20:13:52.481982+0000","last_unstale":"2023-12-11T20:13:54.582208+0000","last_undegraded":"2023-12-11T20:13:54.582208+0000","last_fullsized":"2023-12-11T20:13:54.582208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:39.411648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:55.461559+0000","last_change":"2023-12-11T20:13:53.280080+0000","last_active":"2023-12-11T20:13:55.461559+0000","last_peered":"2023-12-11T20:13:55.461559+0000","last_clean":"2023-12-11T20:13:55.461559+0000","last_became_active":"2023-12-11T20:13:53.279763+0000","last_became_peered":"2023-12-11T20:13:53.279763+0000","last_unstale":"2023-12-11T20:13:55.461559+0000","last_undegraded":"2023-12-11T20:13:55.461559+0000","last_fullsized":"2023-12-11T20:13:55.461559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:22:27.369360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-11T20:13:53.481090+0000","last_change":"2023-12-11T20:13:52.486510+0000","last_active":"2023-12-11T20:13:53.481090+0000","last_peered":"2023-12-11T20:13:53.481090+0000","last_clean":"2023-12-11T20:13:53.481090+0000","last_became_active":"2023-12-11T20:13:52.483852+0000","last_became_peered":"2023-12-11T20:13:52.483852+0000","last_unstale":"2023-12-11T20:13:53.481090+0000","last_undegraded":"2023-12-11T20:13:53.481090+0000","last_fullsized":"2023-12-11T20:13:53.481090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:40:05.242000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582145+0000","last_change":"2023-12-11T20:13:53.270545+0000","last_active":"2023-12-11T20:13:54.582145+0000","last_peered":"2023-12-11T20:13:54.582145+0000","last_clean":"2023-12-11T20:13:54.582145+0000","last_became_active":"2023-12-11T20:13:53.270213+0000","last_became_peered":"2023-12-11T20:13:53.270213+0000","last_unstale":"2023-12-11T20:13:54.582145+0000","last_undegraded":"2023-12-11T20:13:54.582145+0000","last_fullsized":"2023-12-11T20:13:54.582145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:35.442471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604248+0000","last_change":"2023-12-11T20:13:53.276886+0000","last_active":"2023-12-11T20:13:54.604248+0000","last_peered":"2023-12-11T20:13:54.604248+0000","last_clean":"2023-12-11T20:13:54.604248+0000","last_became_active":"2023-12-11T20:13:53.276149+0000","last_became_peered":"2023-12-11T20:13:53.276149+0000","last_unstale":"2023-12-11T20:13:54.604248+0000","last_undegraded":"2023-12-11T20:13:54.604248+0000","last_fullsized":"2023-12-11T20:13:54.604248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:34:19.562002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254179+0000","last_change":"2023-12-11T20:13:53.279990+0000","last_active":"2023-12-11T20:13:54.254179+0000","last_peered":"2023-12-11T20:13:54.254179+0000","last_clean":"2023-12-11T20:13:54.254179+0000","last_became_active":"2023-12-11T20:13:53.279685+0000","last_became_peered":"2023-12-11T20:13:53.279685+0000","last_unstale":"2023-12-11T20:13:54.254179+0000","last_undegraded":"2023-12-11T20:13:54.254179+0000","last_fullsized":"2023-12-11T20:13:54.254179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:21:36.526683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254186+0000","last_change":"2023-12-11T20:13:53.279128+0000","last_active":"2023-12-11T20:13:54.254186+0000","last_peered":"2023-12-11T20:13:54.254186+0000","last_clean":"2023-12-11T20:13:54.254186+0000","last_became_active":"2023-12-11T20:13:53.278821+0000","last_became_peered":"2023-12-11T20:13:53.278821+0000","last_unstale":"2023-12-11T20:13:54.254186+0000","last_undegraded":"2023-12-11T20:13:54.254186+0000","last_fullsized":"2023-12-11T20:13:54.254186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:49:36.013115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581899+0000","last_change":"2023-12-11T20:13:53.281004+0000","last_active":"2023-12-11T20:13:54.581899+0000","last_peered":"2023-12-11T20:13:54.581899+0000","last_clean":"2023-12-11T20:13:54.581899+0000","last_became_active":"2023-12-11T20:13:53.280691+0000","last_became_peered":"2023-12-11T20:13:53.280691+0000","last_unstale":"2023-12-11T20:13:54.581899+0000","last_undegraded":"2023-12-11T20:13:54.581899+0000","last_fullsized":"2023-12-11T20:13:54.581899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:00.336975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.255475+0000","last_change":"2023-12-11T20:13:53.272690+0000","last_active":"2023-12-11T20:13:54.255475+0000","last_peered":"2023-12-11T20:13:54.255475+0000","last_clean":"2023-12-11T20:13:54.255475+0000","last_became_active":"2023-12-11T20:13:53.272194+0000","last_became_peered":"2023-12-11T20:13:53.272194+0000","last_unstale":"2023-12-11T20:13:54.255475+0000","last_undegraded":"2023-12-11T20:13:54.255475+0000","last_fullsized":"2023-12-11T20:13:54.255475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:58:45.312035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604794+0000","last_change":"2023-12-11T20:13:53.277625+0000","last_active":"2023-12-11T20:13:54.604794+0000","last_peered":"2023-12-11T20:13:54.604794+0000","last_clean":"2023-12-11T20:13:54.604794+0000","last_became_active":"2023-12-11T20:13:53.277174+0000","last_became_peered":"2023-12-11T20:13:53.277174+0000","last_unstale":"2023-12-11T20:13:54.604794+0000","last_undegraded":"2023-12-11T20:13:54.604794+0000","last_fullsized":"2023-12-11T20:13:54.604794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:01:41.057178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254654+0000","last_change":"2023-12-11T20:13:53.278685+0000","last_active":"2023-12-11T20:13:54.254654+0000","last_peered":"2023-12-11T20:13:54.254654+0000","last_clean":"2023-12-11T20:13:54.254654+0000","last_became_active":"2023-12-11T20:13:53.276894+0000","last_became_peered":"2023-12-11T20:13:53.276894+0000","last_unstale":"2023-12-11T20:13:54.254654+0000","last_undegraded":"2023-12-11T20:13:54.254654+0000","last_fullsized":"2023-12-11T20:13:54.254654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:21:00.004496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582345+0000","last_change":"2023-12-11T20:13:53.285596+0000","last_active":"2023-12-11T20:13:54.582345+0000","last_peered":"2023-12-11T20:13:54.582345+0000","last_clean":"2023-12-11T20:13:54.582345+0000","last_became_active":"2023-12-11T20:13:53.285289+0000","last_became_peered":"2023-12-11T20:13:53.285289+0000","last_unstale":"2023-12-11T20:13:54.582345+0000","last_undegraded":"2023-12-11T20:13:54.582345+0000","last_fullsized":"2023-12-11T20:13:54.582345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:53:59.939751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581951+0000","last_change":"2023-12-11T20:13:53.272600+0000","last_active":"2023-12-11T20:13:54.581951+0000","last_peered":"2023-12-11T20:13:54.581951+0000","last_clean":"2023-12-11T20:13:54.581951+0000","last_became_active":"2023-12-11T20:13:53.272308+0000","last_became_peered":"2023-12-11T20:13:53.272308+0000","last_unstale":"2023-12-11T20:13:54.581951+0000","last_undegraded":"2023-12-11T20:13:54.581951+0000","last_fullsized":"2023-12-11T20:13:54.581951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.458731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581139+0000","last_change":"2023-12-11T20:13:53.280833+0000","last_active":"2023-12-11T20:13:54.581139+0000","last_peered":"2023-12-11T20:13:54.581139+0000","last_clean":"2023-12-11T20:13:54.581139+0000","last_became_active":"2023-12-11T20:13:53.280384+0000","last_became_peered":"2023-12-11T20:13:53.280384+0000","last_unstale":"2023-12-11T20:13:54.581139+0000","last_undegraded":"2023-12-11T20:13:54.581139+0000","last_fullsized":"2023-12-11T20:13:54.581139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:37:38.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581911+0000","last_change":"2023-12-11T20:13:53.271825+0000","last_active":"2023-12-11T20:13:54.581911+0000","last_peered":"2023-12-11T20:13:54.581911+0000","last_clean":"2023-12-11T20:13:54.581911+0000","last_became_active":"2023-12-11T20:13:53.271460+0000","last_became_peered":"2023-12-11T20:13:53.271460+0000","last_unstale":"2023-12-11T20:13:54.581911+0000","last_undegraded":"2023-12-11T20:13:54.581911+0000","last_fullsized":"2023-12-11T20:13:54.581911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:46:46.147904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253615+0000","last_change":"2023-12-11T20:13:53.270103+0000","last_active":"2023-12-11T20:13:54.253615+0000","last_peered":"2023-12-11T20:13:54.253615+0000","last_clean":"2023-12-11T20:13:54.253615+0000","last_became_active":"2023-12-11T20:13:53.269781+0000","last_became_peered":"2023-12-11T20:13:53.269781+0000","last_unstale":"2023-12-11T20:13:54.253615+0000","last_undegraded":"2023-12-11T20:13:54.253615+0000","last_fullsized":"2023-12-11T20:13:54.253615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.865347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604263+0000","last_change":"2023-12-11T20:13:53.284310+0000","last_active":"2023-12-11T20:13:54.604263+0000","last_peered":"2023-12-11T20:13:54.604263+0000","last_clean":"2023-12-11T20:13:54.604263+0000","last_became_active":"2023-12-11T20:13:53.283969+0000","last_became_peered":"2023-12-11T20:13:53.283969+0000","last_unstale":"2023-12-11T20:13:54.604263+0000","last_undegraded":"2023-12-11T20:13:54.604263+0000","last_fullsized":"2023-12-11T20:13:54.604263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:00:47.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":217636,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4093,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":30651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383695,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":438870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.4610000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.1399999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.274},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":2.0510000000000002}]},{"osd":5,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":6.1970000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":3.9489999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.494},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.659}]},{"osd":7,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":2.0230000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.431}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.732},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.54}]},{"osd":10,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":2.1669999999999998},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":4.0979999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":1030462,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.81699999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.92100000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.0620000000000001}]},{"osd":6,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.99199999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93799999999999994}]},{"osd":8,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.03}]},{"osd":9,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.05},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0940000000000001}]},{"osd":11,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.127}]}]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.745}]},{"osd":2,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.68700000000000006}]},{"osd":5,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.72899999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.90800000000000003}]},{"osd":8,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.77900000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.80900000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.72299999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89000000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.72099999999999997,"15min":0.71499999999999997},"min":{"1min":0.433,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97999999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.746},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":1.079,"15min":1.079},"last":0.61499999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0049999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.40600000000000003}]},{"osd":3,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96199999999999997,"5min":1.081,"15min":1.081},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0629999999999999,"5min":1.226,"15min":1.226},"last":0.78500000000000003}]},{"osd":4,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.05,"5min":1.115,"15min":1.115},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80900000000000005,"15min":0.81100000000000005},"min":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.054,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.1279999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.1060000000000001,"5min":1.232,"15min":1.232},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.95299999999999996},"min":{"1min":0.69099999999999995,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2310000000000001,"5min":1.284,"15min":1.284},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0920000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.875,"15min":0.879},"min":{"1min":0.64100000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.087,"5min":1.298,"15min":1.298},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.94399999999999995,"15min":0.94899999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.159,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.67500000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82999999999999996}]},{"osd":10,"last update":"Mon Dec 11 20:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.874},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":1031349,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.94499999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.77600000000000002,"15min":0.76600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.0349999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.871},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77500000000000002,"15min":0.76700000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.85199999999999998,"15min":0.84099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.135},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.879,"15min":0.86699999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.93100000000000005}]},{"osd":6,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.874,"15min":0.86499999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.876,"15min":0.86399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.74199999999999999}]},{"osd":8,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.236,"5min":1.544,"15min":1.544},"last":1.097},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.69899999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.385,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.98599999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0009999999999999}]},{"osd":10,"last update":"Mon Dec 11 20:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.113}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]}]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":438288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.58199999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.159,"5min":0.82199999999999995,"15min":0.76400000000000001},"min":{"1min":0.61499999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":8.1080000000000005,"5min":8.1080000000000005,"15min":8.1080000000000005},"last":1.069}]},{"osd":2,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.93200000000000005,"15min":1.012},"min":{"1min":0.48899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.21,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.877,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.0229999999999999,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1599999999999999,"5min":6.9489999999999998,"15min":6.9489999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.089,"5min":1.167,"15min":1.167},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0169999999999999,"5min":1.226,"15min":1.226},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90300000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92000000000000004,"15min":0.84499999999999997},"min":{"1min":0.65400000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":8.3079999999999998,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.69899999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88600000000000001,"15min":0.88700000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1679999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.153},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83799999999999997,"15min":0.84499999999999997},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0329999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.93200000000000005}]},{"osd":9,"last update":"Mon Dec 11 20:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.1850000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":456921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.60899999999999999,"15min":0.56499999999999995},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.60899999999999999,"15min":0.55900000000000005},"min":{"1min":0.41399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64100000000000001,"15min":0.58499999999999996},"min":{"1min":0.49299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.61699999999999999,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.66200000000000003,"15min":0.623},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.70599999999999996}]},{"osd":4,"last update":"Mon Dec 11 20:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58799999999999997,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.53500000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99199999999999999,"5min":0.997,"15min":0.997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97499999999999998,"5min":1.069,"15min":1.069},"last":0.748}]},{"osd":6,"last update":"Mon Dec 11 20:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.77800000000000002,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.53700000000000003}]},{"osd":7,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.117,"5min":1.147,"15min":1.147},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.66900000000000004}]},{"osd":8,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.77500000000000002,"15min":0.76400000000000001},"min":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.872,"15min":0.85399999999999998},"min":{"1min":0.75600000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.876}]},{"osd":9,"last update":"Mon Dec 11 20:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79100000000000004}]},{"osd":10,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.89700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":439766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 20:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.61199999999999999,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98299999999999998,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.60699999999999998,"15min":0.56999999999999995},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Dec 11 20:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.627},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.35299999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66800000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68400000000000005,"15min":0.64800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.909,"15min":1.909},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Dec 11 20:13:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68600000000000005,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95699999999999996,"5min":1.036,"15min":1.036},"last":0.86199999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:13:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95799999999999996,"5min":1.028,"15min":1.028},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.496}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.93999999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.82299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.89500000000000002,"15min":0.90000000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.747}]},{"osd":9,"last update":"Mon Dec 11 20:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.57199999999999995}]},{"osd":10,"last update":"Mon Dec 11 20:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76200000000000001}]},{"osd":11,"last update":"Mon Dec 11 20:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.90900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":439591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.504},{"interface":"front","average":{"1min":0.624,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.435}]},{"osd":1,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63700000000000001,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":1.0369999999999999,"5min":1.089,"15min":1.089},"last":0.378},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.42899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0129999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.623},"min":{"1min":0.46999999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Dec 11 20:13:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.64500000000000002,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Dec 11 20:13:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1080000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.05,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.69999999999999996,"15min":0.66600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.62},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.76900000000000002,"15min":0.73199999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83599999999999997}]},{"osd":7,"last update":"Mon Dec 11 20:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.101,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59799999999999998}]},{"osd":8,"last update":"Mon Dec 11 20:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.254,"15min":1.254},"last":0.80300000000000005}]},{"osd":9,"last update":"Mon Dec 11 20:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.71599999999999997}]},{"osd":10,"last update":"Mon Dec 11 20:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.0640000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":438241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.438,"15min":0.40799999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.46400000000000002,"15min":0.432},"min":{"1min":0.42399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.44}]},{"osd":1,"last update":"Mon Dec 11 20:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64500000000000002,"15min":0.61499999999999999},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.052,"5min":1.085,"15min":1.085},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.67500000000000004,"15min":0.63500000000000001},"min":{"1min":0.54300000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Mon Dec 11 20:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.67200000000000004,"15min":0.61599999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65500000000000003,"15min":0.63800000000000001},"min":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.79300000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.65300000000000002},"min":{"1min":0.61799999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.71699999999999997,"15min":0.67200000000000004},"min":{"1min":0.59599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Dec 11 20:13:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.52500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.752},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.751,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.056,"5min":1.145,"15min":1.145},"last":0.85999999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.073,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86399999999999999,"15min":0.84999999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.76300000000000001}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.85799999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.66200000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.80800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":438310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57999999999999996,"15min":0.53900000000000003},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.496}]},{"osd":1,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78600000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003}]},{"osd":2,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65200000000000002,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.69399999999999995},"min":{"1min":0.60099999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64400000000000002,"15min":0.62},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83899999999999997,"5min":0.872,"15min":0.872},"last":0.73299999999999998}]},{"osd":5,"last update":"Mon Dec 11 20:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73199999999999998,"15min":0.71599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.875}]},{"osd":6,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.036,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.64300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.079,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.077,"5min":1.161,"15min":1.161},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1020000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77700000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.119,"5min":1.169,"15min":1.169},"last":0.92200000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.90800000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1029801,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.45900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61699999999999999,"15min":0.60199999999999998},"min":{"1min":0.46200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0780000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.498}]},{"osd":1,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.61799999999999999,"15min":0.59399999999999997},"min":{"1min":0.46600000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55300000000000005}]},{"osd":3,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.64000000000000001,"15min":0.60999999999999999},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63},"min":{"1min":0.51700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92200000000000004,"5min":1.127,"15min":1.127},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.70099999999999996},"min":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.70399999999999996,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.83199999999999996}]},{"osd":6,"last update":"Mon Dec 11 20:13:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":0.82699999999999996,"15min":0.76900000000000002},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76200000000000001,"15min":0.751},"min":{"1min":0.623,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Dec 11 20:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.78400000000000003,"15min":0.77400000000000002},"min":{"1min":0.65300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.77600000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.746}]},{"osd":9,"last update":"Mon Dec 11 20:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72599999999999998}]},{"osd":10,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34906,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":18976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T20:14:01.754 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T20:14:01.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:01 smithi039 ceph-mon[102205]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:01.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:01 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1548870636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:01.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:01 smithi039 ceph-mon[102205]: pgmap v314: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 3.2 KiB/s wr, 10 op/s 2023-12-11T20:14:01.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:01 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4084409523' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:01.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:01 smithi032 ceph-mon[132488]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:14:01.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:01 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1548870636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:01.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:01 smithi032 ceph-mon[132488]: pgmap v314: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 3.2 KiB/s wr, 10 op/s 2023-12-11T20:14:01.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:01 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4084409523' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.993+0000 7fd2bddff700 1 -- 172.21.15.12:0/3461173180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b81014a0 msgr2=0x7fd2b81018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.993+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3461173180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b81014a0 0x7fd2b81018c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80099c0 tx=0x7fd2a8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.993+0000 7fd2bddff700 1 -- 172.21.15.12:0/3461173180 shutdown_connections 2023-12-11T20:14:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.993+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3461173180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b8103030 0x7fd2b81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.993+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3461173180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b81014a0 0x7fd2b81018c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.993+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3461173180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2b8102690 0x7fd2b8102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.994+0000 7fd2bddff700 1 -- 172.21.15.12:0/3461173180 >> 172.21.15.12:0/3461173180 conn(0x7fd2b80fca10 msgr2=0x7fd2b80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.994+0000 7fd2bddff700 1 -- 172.21.15.12:0/3461173180 shutdown_connections 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.994+0000 7fd2bddff700 1 -- 172.21.15.12:0/3461173180 wait complete. 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2bddff700 1 Processor -- start 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2bddff700 1 -- start start 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2bddff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b81014a0 0x7fd2b8075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2bddff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2b8102690 0x7fd2b80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2bddff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b8103030 0x7fd2b8073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2bddff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b819b200 con 0x7fd2b8103030 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2bddff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8074440 con 0x7fd2b81014a0 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2bddff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8074600 con 0x7fd2b8102690 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b8103030 0x7fd2b8073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b8103030 0x7fd2b8073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43914/0 (socket says 172.21.15.12:43914) 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2b7fff700 1 -- 172.21.15.12:0/3296493047 learned_addr learned my addr 172.21.15.12:0/3296493047 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:01.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.995+0000 7fd2b77fe700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b81014a0 0x7fd2b8075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b6ffd700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2b8102690 0x7fd2b80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b7fff700 1 -- 172.21.15.12:0/3296493047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2b8102690 msgr2=0x7fd2b80739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b7fff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2b8102690 0x7fd2b80739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b7fff700 1 -- 172.21.15.12:0/3296493047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b81014a0 msgr2=0x7fd2b8075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b7fff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b81014a0 0x7fd2b8075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b7fff700 1 -- 172.21.15.12:0/3296493047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80095f0 con 0x7fd2b8103030 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b7fff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b8103030 0x7fd2b8073f00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0007ee0 tx=0x7fd2b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b4ff9700 1 -- 172.21.15.12:0/3296493047 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0017070 con 0x7fd2b8103030 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b4ff9700 1 -- 172.21.15.12:0/3296493047 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd2b000f040 con 0x7fd2b8103030 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2b4ff9700 1 -- 172.21.15.12:0/3296493047 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0005710 con 0x7fd2b8103030 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b81a5bb0 con 0x7fd2b8103030 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.996+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b81a5f20 con 0x7fd2b8103030 2023-12-11T20:14:01.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.997+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b8108910 con 0x7fd2b8103030 2023-12-11T20:14:01.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:01.999+0000 7fd2b4ff9700 1 -- 172.21.15.12:0/3296493047 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fd2b0005870 con 0x7fd2b8103030 2023-12-11T20:14:02.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.001+0000 7fd2b4ff9700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2a00a1590 0x7fd2a00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:02.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.001+0000 7fd2b4ff9700 1 -- 172.21.15.12:0/3296493047 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd2b00cc4a0 con 0x7fd2b8103030 2023-12-11T20:14:02.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.001+0000 7fd2b77fe700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2a00a1590 0x7fd2a00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:02.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.002+0000 7fd2b77fe700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2a00a1590 0x7fd2a00a3a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8006010 tx=0x7fd2a8003740 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:02.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.005+0000 7fd2b4ff9700 1 -- 172.21.15.12:0/3296493047 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd2b0095b50 con 0x7fd2b8103030 2023-12-11T20:14:02.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.210+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2b802d420 con 0x7fd2a00a1590 2023-12-11T20:14:02.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.221+0000 7fd2b4ff9700 1 -- 172.21.15.12:0/3296493047 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338560 (secure 0 0 0) 0x7fd2b802d420 con 0x7fd2a00a1590 2023-12-11T20:14:02.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2a00a1590 msgr2=0x7fd2a00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2a00a1590 0x7fd2a00a3a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8006010 tx=0x7fd2a8003740 comp rx=0 tx=0).stop 2023-12-11T20:14:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b8103030 msgr2=0x7fd2b8073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b8103030 0x7fd2b8073f00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0007ee0 tx=0x7fd2b000d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 shutdown_connections 2023-12-11T20:14:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2a00a1590 0x7fd2a00a3a50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2b81014a0 0x7fd2b8075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:02.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2b8103030 0x7fd2b8073f00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:02.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 --2- 172.21.15.12:0/3296493047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd2b8102690 0x7fd2b80739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:02.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 >> 172.21.15.12:0/3296493047 conn(0x7fd2b80fca10 msgr2=0x7fd2b8105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:02.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 shutdown_connections 2023-12-11T20:14:02.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:02.226+0000 7fd2bddff700 1 -- 172.21.15.12:0/3296493047 wait complete. 2023-12-11T20:14:02.228 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-12-11T20:14:02.244 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-12-11T20:14:01.031820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594584,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":132,"num_read_kb":114,"num_write":262,"num_write_kb":2964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":279,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335240,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606584,"statfs":{"total":1151940427776,"available":1151597142016,"internally_reserved":0,"allocated":11288576,"data_stored":7059266,"data_compressed":109638,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":331855162},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":81,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001852"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604493+0000","last_change":"2023-12-11T20:13:53.282384+0000","last_active":"2023-12-11T20:13:54.604493+0000","last_peered":"2023-12-11T20:13:54.604493+0000","last_clean":"2023-12-11T20:13:54.604493+0000","last_became_active":"2023-12-11T20:13:53.282058+0000","last_became_peered":"2023-12-11T20:13:53.282058+0000","last_unstale":"2023-12-11T20:13:54.604493+0000","last_undegraded":"2023-12-11T20:13:54.604493+0000","last_fullsized":"2023-12-11T20:13:54.604493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:23:31.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582075+0000","last_change":"2023-12-11T20:13:53.282283+0000","last_active":"2023-12-11T20:13:54.582075+0000","last_peered":"2023-12-11T20:13:54.582075+0000","last_clean":"2023-12-11T20:13:54.582075+0000","last_became_active":"2023-12-11T20:13:53.278054+0000","last_became_peered":"2023-12-11T20:13:53.278054+0000","last_unstale":"2023-12-11T20:13:54.582075+0000","last_undegraded":"2023-12-11T20:13:54.582075+0000","last_fullsized":"2023-12-11T20:13:54.582075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:07:50.194732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582270+0000","last_change":"2023-12-11T20:13:53.277704+0000","last_active":"2023-12-11T20:13:54.582270+0000","last_peered":"2023-12-11T20:13:54.582270+0000","last_clean":"2023-12-11T20:13:54.582270+0000","last_became_active":"2023-12-11T20:13:53.277395+0000","last_became_peered":"2023-12-11T20:13:53.277395+0000","last_unstale":"2023-12-11T20:13:54.582270+0000","last_undegraded":"2023-12-11T20:13:54.582270+0000","last_fullsized":"2023-12-11T20:13:54.582270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:54:10.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582526+0000","last_change":"2023-12-11T20:13:53.280854+0000","last_active":"2023-12-11T20:13:54.582526+0000","last_peered":"2023-12-11T20:13:54.582526+0000","last_clean":"2023-12-11T20:13:54.582526+0000","last_became_active":"2023-12-11T20:13:53.277275+0000","last_became_peered":"2023-12-11T20:13:53.277275+0000","last_unstale":"2023-12-11T20:13:54.582526+0000","last_undegraded":"2023-12-11T20:13:54.582526+0000","last_fullsized":"2023-12-11T20:13:54.582526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:32:58.001015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581621+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:13:54.581621+0000","last_peered":"2023-12-11T20:13:54.581621+0000","last_clean":"2023-12-11T20:13:54.581621+0000","last_became_active":"2023-12-11T20:13:53.281659+0000","last_became_peered":"2023-12-11T20:13:53.281659+0000","last_unstale":"2023-12-11T20:13:54.581621+0000","last_undegraded":"2023-12-11T20:13:54.581621+0000","last_fullsized":"2023-12-11T20:13:54.581621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:47:20.764823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253713+0000","last_change":"2023-12-11T20:13:53.284175+0000","last_active":"2023-12-11T20:13:54.253713+0000","last_peered":"2023-12-11T20:13:54.253713+0000","last_clean":"2023-12-11T20:13:54.253713+0000","last_became_active":"2023-12-11T20:13:53.283801+0000","last_became_peered":"2023-12-11T20:13:53.283801+0000","last_unstale":"2023-12-11T20:13:54.253713+0000","last_undegraded":"2023-12-11T20:13:54.253713+0000","last_fullsized":"2023-12-11T20:13:54.253713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:35.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582045+0000","last_change":"2023-12-11T20:13:53.262700+0000","last_active":"2023-12-11T20:13:54.582045+0000","last_peered":"2023-12-11T20:13:54.582045+0000","last_clean":"2023-12-11T20:13:54.582045+0000","last_became_active":"2023-12-11T20:13:53.262322+0000","last_became_peered":"2023-12-11T20:13:53.262322+0000","last_unstale":"2023-12-11T20:13:54.582045+0000","last_undegraded":"2023-12-11T20:13:54.582045+0000","last_fullsized":"2023-12-11T20:13:54.582045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:02:47.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581007+0000","last_change":"2023-12-11T20:13:53.276134+0000","last_active":"2023-12-11T20:13:54.581007+0000","last_peered":"2023-12-11T20:13:54.581007+0000","last_clean":"2023-12-11T20:13:54.581007+0000","last_became_active":"2023-12-11T20:13:53.275837+0000","last_became_peered":"2023-12-11T20:13:53.275837+0000","last_unstale":"2023-12-11T20:13:54.581007+0000","last_undegraded":"2023-12-11T20:13:54.581007+0000","last_fullsized":"2023-12-11T20:13:54.581007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:23.172320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.583204+0000","last_change":"2023-12-11T20:13:53.277384+0000","last_active":"2023-12-11T20:13:54.583204+0000","last_peered":"2023-12-11T20:13:54.583204+0000","last_clean":"2023-12-11T20:13:54.583204+0000","last_became_active":"2023-12-11T20:13:53.277017+0000","last_became_peered":"2023-12-11T20:13:53.277017+0000","last_unstale":"2023-12-11T20:13:54.583204+0000","last_undegraded":"2023-12-11T20:13:54.583204+0000","last_fullsized":"2023-12-11T20:13:54.583204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:04:50.820269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254148+0000","last_change":"2023-12-11T20:13:53.285340+0000","last_active":"2023-12-11T20:13:54.254148+0000","last_peered":"2023-12-11T20:13:54.254148+0000","last_clean":"2023-12-11T20:13:54.254148+0000","last_became_active":"2023-12-11T20:13:53.285040+0000","last_became_peered":"2023-12-11T20:13:53.285040+0000","last_unstale":"2023-12-11T20:13:54.254148+0000","last_undegraded":"2023-12-11T20:13:54.254148+0000","last_fullsized":"2023-12-11T20:13:54.254148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:52:53.312236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582024+0000","last_change":"2023-12-11T20:13:53.274637+0000","last_active":"2023-12-11T20:13:54.582024+0000","last_peered":"2023-12-11T20:13:54.582024+0000","last_clean":"2023-12-11T20:13:54.582024+0000","last_became_active":"2023-12-11T20:13:53.270971+0000","last_became_peered":"2023-12-11T20:13:53.270971+0000","last_unstale":"2023-12-11T20:13:54.582024+0000","last_undegraded":"2023-12-11T20:13:54.582024+0000","last_fullsized":"2023-12-11T20:13:54.582024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:20:35.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582518+0000","last_change":"2023-12-11T20:13:53.280712+0000","last_active":"2023-12-11T20:13:54.582518+0000","last_peered":"2023-12-11T20:13:54.582518+0000","last_clean":"2023-12-11T20:13:54.582518+0000","last_became_active":"2023-12-11T20:13:53.276873+0000","last_became_peered":"2023-12-11T20:13:53.276873+0000","last_unstale":"2023-12-11T20:13:54.582518+0000","last_undegraded":"2023-12-11T20:13:54.582518+0000","last_fullsized":"2023-12-11T20:13:54.582518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:36:08.438862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253684+0000","last_change":"2023-12-11T20:13:53.272378+0000","last_active":"2023-12-11T20:13:54.253684+0000","last_peered":"2023-12-11T20:13:54.253684+0000","last_clean":"2023-12-11T20:13:54.253684+0000","last_became_active":"2023-12-11T20:13:53.271992+0000","last_became_peered":"2023-12-11T20:13:53.271992+0000","last_unstale":"2023-12-11T20:13:54.253684+0000","last_undegraded":"2023-12-11T20:13:54.253684+0000","last_fullsized":"2023-12-11T20:13:54.253684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:01:05.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581723+0000","last_change":"2023-12-11T20:13:53.275078+0000","last_active":"2023-12-11T20:13:54.581723+0000","last_peered":"2023-12-11T20:13:54.581723+0000","last_clean":"2023-12-11T20:13:54.581723+0000","last_became_active":"2023-12-11T20:13:53.273555+0000","last_became_peered":"2023-12-11T20:13:53.273555+0000","last_unstale":"2023-12-11T20:13:54.581723+0000","last_undegraded":"2023-12-11T20:13:54.581723+0000","last_fullsized":"2023-12-11T20:13:54.581723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:23:27.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581738+0000","last_change":"2023-12-11T20:13:53.277135+0000","last_active":"2023-12-11T20:13:54.581738+0000","last_peered":"2023-12-11T20:13:54.581738+0000","last_clean":"2023-12-11T20:13:54.581738+0000","last_became_active":"2023-12-11T20:13:53.276406+0000","last_became_peered":"2023-12-11T20:13:53.276406+0000","last_unstale":"2023-12-11T20:13:54.581738+0000","last_undegraded":"2023-12-11T20:13:54.581738+0000","last_fullsized":"2023-12-11T20:13:54.581738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:20.508685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581278+0000","last_change":"2023-12-11T20:13:53.268845+0000","last_active":"2023-12-11T20:13:54.581278+0000","last_peered":"2023-12-11T20:13:54.581278+0000","last_clean":"2023-12-11T20:13:54.581278+0000","last_became_active":"2023-12-11T20:13:53.268553+0000","last_became_peered":"2023-12-11T20:13:53.268553+0000","last_unstale":"2023-12-11T20:13:54.581278+0000","last_undegraded":"2023-12-11T20:13:54.581278+0000","last_fullsized":"2023-12-11T20:13:54.581278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:55.125792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604661+0000","last_change":"2023-12-11T20:13:53.284361+0000","last_active":"2023-12-11T20:13:54.604661+0000","last_peered":"2023-12-11T20:13:54.604661+0000","last_clean":"2023-12-11T20:13:54.604661+0000","last_became_active":"2023-12-11T20:13:53.282109+0000","last_became_peered":"2023-12-11T20:13:53.282109+0000","last_unstale":"2023-12-11T20:13:54.604661+0000","last_undegraded":"2023-12-11T20:13:54.604661+0000","last_fullsized":"2023-12-11T20:13:54.604661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:44:50.021737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.583219+0000","last_change":"2023-12-11T20:13:53.274005+0000","last_active":"2023-12-11T20:13:54.583219+0000","last_peered":"2023-12-11T20:13:54.583219+0000","last_clean":"2023-12-11T20:13:54.583219+0000","last_became_active":"2023-12-11T20:13:53.273336+0000","last_became_peered":"2023-12-11T20:13:53.273336+0000","last_unstale":"2023-12-11T20:13:54.583219+0000","last_undegraded":"2023-12-11T20:13:54.583219+0000","last_fullsized":"2023-12-11T20:13:54.583219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:56:05.732607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254598+0000","last_change":"2023-12-11T20:13:53.280909+0000","last_active":"2023-12-11T20:13:54.254598+0000","last_peered":"2023-12-11T20:13:54.254598+0000","last_clean":"2023-12-11T20:13:54.254598+0000","last_became_active":"2023-12-11T20:13:53.278124+0000","last_became_peered":"2023-12-11T20:13:53.278124+0000","last_unstale":"2023-12-11T20:13:54.254598+0000","last_undegraded":"2023-12-11T20:13:54.254598+0000","last_fullsized":"2023-12-11T20:13:54.254598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:09:19.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:57.512133+0000","last_change":"2023-12-11T20:13:52.478685+0000","last_active":"2023-12-11T20:13:57.512133+0000","last_peered":"2023-12-11T20:13:57.512133+0000","last_clean":"2023-12-11T20:13:57.512133+0000","last_became_active":"2023-12-11T20:13:52.478391+0000","last_became_peered":"2023-12-11T20:13:52.478391+0000","last_unstale":"2023-12-11T20:13:57.512133+0000","last_undegraded":"2023-12-11T20:13:57.512133+0000","last_fullsized":"2023-12-11T20:13:57.512133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:02:54.039954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582340+0000","last_change":"2023-12-11T20:13:53.279432+0000","last_active":"2023-12-11T20:13:54.582340+0000","last_peered":"2023-12-11T20:13:54.582340+0000","last_clean":"2023-12-11T20:13:54.582340+0000","last_became_active":"2023-12-11T20:13:53.279087+0000","last_became_peered":"2023-12-11T20:13:53.279087+0000","last_unstale":"2023-12-11T20:13:54.582340+0000","last_undegraded":"2023-12-11T20:13:54.582340+0000","last_fullsized":"2023-12-11T20:13:54.582340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.376941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582497+0000","last_change":"2023-12-11T20:13:52.485170+0000","last_active":"2023-12-11T20:13:54.582497+0000","last_peered":"2023-12-11T20:13:54.582497+0000","last_clean":"2023-12-11T20:13:54.582497+0000","last_became_active":"2023-12-11T20:13:52.484885+0000","last_became_peered":"2023-12-11T20:13:52.484885+0000","last_unstale":"2023-12-11T20:13:54.582497+0000","last_undegraded":"2023-12-11T20:13:54.582497+0000","last_fullsized":"2023-12-11T20:13:54.582497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:21:40.746709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582385+0000","last_change":"2023-12-11T20:13:53.274015+0000","last_active":"2023-12-11T20:13:54.582385+0000","last_peered":"2023-12-11T20:13:54.582385+0000","last_clean":"2023-12-11T20:13:54.582385+0000","last_became_active":"2023-12-11T20:13:53.272504+0000","last_became_peered":"2023-12-11T20:13:53.272504+0000","last_unstale":"2023-12-11T20:13:54.582385+0000","last_undegraded":"2023-12-11T20:13:54.582385+0000","last_fullsized":"2023-12-11T20:13:54.582385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:26.155659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582037+0000","last_change":"2023-12-11T20:13:52.474961+0000","last_active":"2023-12-11T20:13:54.582037+0000","last_peered":"2023-12-11T20:13:54.582037+0000","last_clean":"2023-12-11T20:13:54.582037+0000","last_became_active":"2023-12-11T20:13:52.474559+0000","last_became_peered":"2023-12-11T20:13:52.474559+0000","last_unstale":"2023-12-11T20:13:54.582037+0000","last_undegraded":"2023-12-11T20:13:54.582037+0000","last_fullsized":"2023-12-11T20:13:54.582037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:44:37.596075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582034+0000","last_change":"2023-12-11T20:13:53.268907+0000","last_active":"2023-12-11T20:13:54.582034+0000","last_peered":"2023-12-11T20:13:54.582034+0000","last_clean":"2023-12-11T20:13:54.582034+0000","last_became_active":"2023-12-11T20:13:53.268494+0000","last_became_peered":"2023-12-11T20:13:53.268494+0000","last_unstale":"2023-12-11T20:13:54.582034+0000","last_undegraded":"2023-12-11T20:13:54.582034+0000","last_fullsized":"2023-12-11T20:13:54.582034+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:57:36.104687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582153+0000","last_change":"2023-12-11T20:13:52.475425+0000","last_active":"2023-12-11T20:13:54.582153+0000","last_peered":"2023-12-11T20:13:54.582153+0000","last_clean":"2023-12-11T20:13:54.582153+0000","last_became_active":"2023-12-11T20:13:52.475066+0000","last_became_peered":"2023-12-11T20:13:52.475066+0000","last_unstale":"2023-12-11T20:13:54.582153+0000","last_undegraded":"2023-12-11T20:13:54.582153+0000","last_fullsized":"2023-12-11T20:13:54.582153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:01:01.603043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582315+0000","last_change":"2023-12-11T20:13:53.278495+0000","last_active":"2023-12-11T20:13:54.582315+0000","last_peered":"2023-12-11T20:13:54.582315+0000","last_clean":"2023-12-11T20:13:54.582315+0000","last_became_active":"2023-12-11T20:13:53.278164+0000","last_became_peered":"2023-12-11T20:13:53.278164+0000","last_unstale":"2023-12-11T20:13:54.582315+0000","last_undegraded":"2023-12-11T20:13:54.582315+0000","last_fullsized":"2023-12-11T20:13:54.582315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:07:42.942595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:58.263750+0000","last_change":"2023-12-11T20:13:52.481648+0000","last_active":"2023-12-11T20:13:58.263750+0000","last_peered":"2023-12-11T20:13:58.263750+0000","last_clean":"2023-12-11T20:13:58.263750+0000","last_became_active":"2023-12-11T20:13:52.481317+0000","last_became_peered":"2023-12-11T20:13:52.481317+0000","last_unstale":"2023-12-11T20:13:58.263750+0000","last_undegraded":"2023-12-11T20:13:58.263750+0000","last_fullsized":"2023-12-11T20:13:58.263750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:30:32.206757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1011,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581677+0000","last_change":"2023-12-11T20:13:53.261350+0000","last_active":"2023-12-11T20:13:54.581677+0000","last_peered":"2023-12-11T20:13:54.581677+0000","last_clean":"2023-12-11T20:13:54.581677+0000","last_became_active":"2023-12-11T20:13:53.260471+0000","last_became_peered":"2023-12-11T20:13:53.260471+0000","last_unstale":"2023-12-11T20:13:54.581677+0000","last_undegraded":"2023-12-11T20:13:54.581677+0000","last_fullsized":"2023-12-11T20:13:54.581677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:27.844329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253587+0000","last_change":"2023-12-11T20:13:52.482190+0000","last_active":"2023-12-11T20:13:54.253587+0000","last_peered":"2023-12-11T20:13:54.253587+0000","last_clean":"2023-12-11T20:13:54.253587+0000","last_became_active":"2023-12-11T20:13:52.481758+0000","last_became_peered":"2023-12-11T20:13:52.481758+0000","last_unstale":"2023-12-11T20:13:54.253587+0000","last_undegraded":"2023-12-11T20:13:54.253587+0000","last_fullsized":"2023-12-11T20:13:54.253587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:26.226338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582493+0000","last_change":"2023-12-11T20:13:53.279366+0000","last_active":"2023-12-11T20:13:54.582493+0000","last_peered":"2023-12-11T20:13:54.582493+0000","last_clean":"2023-12-11T20:13:54.582493+0000","last_became_active":"2023-12-11T20:13:53.279074+0000","last_became_peered":"2023-12-11T20:13:53.279074+0000","last_unstale":"2023-12-11T20:13:54.582493+0000","last_undegraded":"2023-12-11T20:13:54.582493+0000","last_fullsized":"2023-12-11T20:13:54.582493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:37.856345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-11T20:13:53.251539+0000","last_change":"2023-12-11T20:13:52.480830+0000","last_active":"2023-12-11T20:13:53.251539+0000","last_peered":"2023-12-11T20:13:53.251539+0000","last_clean":"2023-12-11T20:13:53.251539+0000","last_became_active":"2023-12-11T20:13:52.480359+0000","last_became_peered":"2023-12-11T20:13:52.480359+0000","last_unstale":"2023-12-11T20:13:53.251539+0000","last_undegraded":"2023-12-11T20:13:53.251539+0000","last_fullsized":"2023-12-11T20:13:53.251539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:13.756411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.580944+0000","last_change":"2023-12-11T20:13:53.275587+0000","last_active":"2023-12-11T20:13:54.580944+0000","last_peered":"2023-12-11T20:13:54.580944+0000","last_clean":"2023-12-11T20:13:54.580944+0000","last_became_active":"2023-12-11T20:13:53.275014+0000","last_became_peered":"2023-12-11T20:13:53.275014+0000","last_unstale":"2023-12-11T20:13:54.580944+0000","last_undegraded":"2023-12-11T20:13:54.580944+0000","last_fullsized":"2023-12-11T20:13:54.580944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:21:23.179714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581624+0000","last_change":"2023-12-11T20:13:52.485088+0000","last_active":"2023-12-11T20:13:54.581624+0000","last_peered":"2023-12-11T20:13:54.581624+0000","last_clean":"2023-12-11T20:13:54.581624+0000","last_became_active":"2023-12-11T20:13:52.480366+0000","last_became_peered":"2023-12-11T20:13:52.480366+0000","last_unstale":"2023-12-11T20:13:54.581624+0000","last_undegraded":"2023-12-11T20:13:54.581624+0000","last_fullsized":"2023-12-11T20:13:54.581624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:41:17.198234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582526+0000","last_change":"2023-12-11T20:13:53.281254+0000","last_active":"2023-12-11T20:13:54.582526+0000","last_peered":"2023-12-11T20:13:54.582526+0000","last_clean":"2023-12-11T20:13:54.582526+0000","last_became_active":"2023-12-11T20:13:53.278026+0000","last_became_peered":"2023-12-11T20:13:53.278026+0000","last_unstale":"2023-12-11T20:13:54.582526+0000","last_undegraded":"2023-12-11T20:13:54.582526+0000","last_fullsized":"2023-12-11T20:13:54.582526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:25:46.033739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254081+0000","last_change":"2023-12-11T20:13:52.485136+0000","last_active":"2023-12-11T20:13:54.254081+0000","last_peered":"2023-12-11T20:13:54.254081+0000","last_clean":"2023-12-11T20:13:54.254081+0000","last_became_active":"2023-12-11T20:13:52.484743+0000","last_became_peered":"2023-12-11T20:13:52.484743+0000","last_unstale":"2023-12-11T20:13:54.254081+0000","last_undegraded":"2023-12-11T20:13:54.254081+0000","last_fullsized":"2023-12-11T20:13:54.254081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:50.893360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.583044+0000","last_change":"2023-12-11T20:13:53.274566+0000","last_active":"2023-12-11T20:13:54.583044+0000","last_peered":"2023-12-11T20:13:54.583044+0000","last_clean":"2023-12-11T20:13:54.583044+0000","last_became_active":"2023-12-11T20:13:53.273325+0000","last_became_peered":"2023-12-11T20:13:53.273325+0000","last_unstale":"2023-12-11T20:13:54.583044+0000","last_undegraded":"2023-12-11T20:13:54.583044+0000","last_fullsized":"2023-12-11T20:13:54.583044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:29:17.656364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.502323+0000","last_change":"2023-12-11T20:13:52.478639+0000","last_active":"2023-12-11T20:13:56.502323+0000","last_peered":"2023-12-11T20:13:56.502323+0000","last_clean":"2023-12-11T20:13:56.502323+0000","last_became_active":"2023-12-11T20:13:52.478042+0000","last_became_peered":"2023-12-11T20:13:52.478042+0000","last_unstale":"2023-12-11T20:13:56.502323+0000","last_undegraded":"2023-12-11T20:13:56.502323+0000","last_fullsized":"2023-12-11T20:13:56.502323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:18:55.633411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582165+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:13:54.582165+0000","last_peered":"2023-12-11T20:13:54.582165+0000","last_clean":"2023-12-11T20:13:54.582165+0000","last_became_active":"2023-12-11T20:13:53.283287+0000","last_became_peered":"2023-12-11T20:13:53.283287+0000","last_unstale":"2023-12-11T20:13:54.582165+0000","last_undegraded":"2023-12-11T20:13:54.582165+0000","last_fullsized":"2023-12-11T20:13:54.582165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:51:56.643292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.503279+0000","last_change":"2023-12-11T20:13:52.486247+0000","last_active":"2023-12-11T20:13:56.503279+0000","last_peered":"2023-12-11T20:13:56.503279+0000","last_clean":"2023-12-11T20:13:56.503279+0000","last_became_active":"2023-12-11T20:13:52.485343+0000","last_became_peered":"2023-12-11T20:13:52.485343+0000","last_unstale":"2023-12-11T20:13:56.503279+0000","last_undegraded":"2023-12-11T20:13:56.503279+0000","last_fullsized":"2023-12-11T20:13:56.503279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:21:46.587858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582238+0000","last_change":"2023-12-11T20:13:53.281264+0000","last_active":"2023-12-11T20:13:54.582238+0000","last_peered":"2023-12-11T20:13:54.582238+0000","last_clean":"2023-12-11T20:13:54.582238+0000","last_became_active":"2023-12-11T20:13:53.280899+0000","last_became_peered":"2023-12-11T20:13:53.280899+0000","last_unstale":"2023-12-11T20:13:54.582238+0000","last_undegraded":"2023-12-11T20:13:54.582238+0000","last_fullsized":"2023-12-11T20:13:54.582238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:17.675421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253926+0000","last_change":"2023-12-11T20:13:52.475732+0000","last_active":"2023-12-11T20:13:54.253926+0000","last_peered":"2023-12-11T20:13:54.253926+0000","last_clean":"2023-12-11T20:13:54.253926+0000","last_became_active":"2023-12-11T20:13:52.475415+0000","last_became_peered":"2023-12-11T20:13:52.475415+0000","last_unstale":"2023-12-11T20:13:54.253926+0000","last_undegraded":"2023-12-11T20:13:54.253926+0000","last_fullsized":"2023-12-11T20:13:54.253926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:20:31.539997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581939+0000","last_change":"2023-12-11T20:13:53.273365+0000","last_active":"2023-12-11T20:13:54.581939+0000","last_peered":"2023-12-11T20:13:54.581939+0000","last_clean":"2023-12-11T20:13:54.581939+0000","last_became_active":"2023-12-11T20:13:53.268456+0000","last_became_peered":"2023-12-11T20:13:53.268456+0000","last_unstale":"2023-12-11T20:13:54.581939+0000","last_undegraded":"2023-12-11T20:13:54.581939+0000","last_fullsized":"2023-12-11T20:13:54.581939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:13.850229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254482+0000","last_change":"2023-12-11T20:13:52.477609+0000","last_active":"2023-12-11T20:13:54.254482+0000","last_peered":"2023-12-11T20:13:54.254482+0000","last_clean":"2023-12-11T20:13:54.254482+0000","last_became_active":"2023-12-11T20:13:52.477177+0000","last_became_peered":"2023-12-11T20:13:52.477177+0000","last_unstale":"2023-12-11T20:13:54.254482+0000","last_undegraded":"2023-12-11T20:13:54.254482+0000","last_fullsized":"2023-12-11T20:13:54.254482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:46.987026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253465+0000","last_change":"2023-12-11T20:13:53.278247+0000","last_active":"2023-12-11T20:13:54.253465+0000","last_peered":"2023-12-11T20:13:54.253465+0000","last_clean":"2023-12-11T20:13:54.253465+0000","last_became_active":"2023-12-11T20:13:53.277928+0000","last_became_peered":"2023-12-11T20:13:53.277928+0000","last_unstale":"2023-12-11T20:13:54.253465+0000","last_undegraded":"2023-12-11T20:13:54.253465+0000","last_fullsized":"2023-12-11T20:13:54.253465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:52:33.864370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.502606+0000","last_change":"2023-12-11T20:13:52.485985+0000","last_active":"2023-12-11T20:13:56.502606+0000","last_peered":"2023-12-11T20:13:56.502606+0000","last_clean":"2023-12-11T20:13:56.502606+0000","last_became_active":"2023-12-11T20:13:52.484929+0000","last_became_peered":"2023-12-11T20:13:52.484929+0000","last_unstale":"2023-12-11T20:13:56.502606+0000","last_undegraded":"2023-12-11T20:13:56.502606+0000","last_fullsized":"2023-12-11T20:13:56.502606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T08:11:28.665448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582318+0000","last_change":"2023-12-11T20:13:53.277048+0000","last_active":"2023-12-11T20:13:54.582318+0000","last_peered":"2023-12-11T20:13:54.582318+0000","last_clean":"2023-12-11T20:13:54.582318+0000","last_became_active":"2023-12-11T20:13:53.276706+0000","last_became_peered":"2023-12-11T20:13:53.276706+0000","last_unstale":"2023-12-11T20:13:54.582318+0000","last_undegraded":"2023-12-11T20:13:54.582318+0000","last_fullsized":"2023-12-11T20:13:54.582318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:46.815339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-11T20:13:53.271515+0000","last_change":"2023-12-11T20:13:52.477814+0000","last_active":"2023-12-11T20:13:53.271515+0000","last_peered":"2023-12-11T20:13:53.271515+0000","last_clean":"2023-12-11T20:13:53.271515+0000","last_became_active":"2023-12-11T20:13:52.477036+0000","last_became_peered":"2023-12-11T20:13:52.477036+0000","last_unstale":"2023-12-11T20:13:53.271515+0000","last_undegraded":"2023-12-11T20:13:53.271515+0000","last_fullsized":"2023-12-11T20:13:53.271515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:53:44.279968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582182+0000","last_change":"2023-12-11T20:13:53.276279+0000","last_active":"2023-12-11T20:13:54.582182+0000","last_peered":"2023-12-11T20:13:54.582182+0000","last_clean":"2023-12-11T20:13:54.582182+0000","last_became_active":"2023-12-11T20:13:53.273638+0000","last_became_peered":"2023-12-11T20:13:53.273638+0000","last_unstale":"2023-12-11T20:13:54.582182+0000","last_undegraded":"2023-12-11T20:13:54.582182+0000","last_fullsized":"2023-12-11T20:13:54.582182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:07:03.289511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581374+0000","last_change":"2023-12-11T20:13:52.483417+0000","last_active":"2023-12-11T20:13:54.581374+0000","last_peered":"2023-12-11T20:13:54.581374+0000","last_clean":"2023-12-11T20:13:54.581374+0000","last_became_active":"2023-12-11T20:13:52.481395+0000","last_became_peered":"2023-12-11T20:13:52.481395+0000","last_unstale":"2023-12-11T20:13:54.581374+0000","last_undegraded":"2023-12-11T20:13:54.581374+0000","last_fullsized":"2023-12-11T20:13:54.581374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:01:42.053460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582360+0000","last_change":"2023-12-11T20:13:53.280688+0000","last_active":"2023-12-11T20:13:54.582360+0000","last_peered":"2023-12-11T20:13:54.582360+0000","last_clean":"2023-12-11T20:13:54.582360+0000","last_became_active":"2023-12-11T20:13:53.277300+0000","last_became_peered":"2023-12-11T20:13:53.277300+0000","last_unstale":"2023-12-11T20:13:54.582360+0000","last_undegraded":"2023-12-11T20:13:54.582360+0000","last_fullsized":"2023-12-11T20:13:54.582360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:40:58.831909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582131+0000","last_change":"2023-12-11T20:13:52.474978+0000","last_active":"2023-12-11T20:13:54.582131+0000","last_peered":"2023-12-11T20:13:54.582131+0000","last_clean":"2023-12-11T20:13:54.582131+0000","last_became_active":"2023-12-11T20:13:52.472863+0000","last_became_peered":"2023-12-11T20:13:52.472863+0000","last_unstale":"2023-12-11T20:13:54.582131+0000","last_undegraded":"2023-12-11T20:13:54.582131+0000","last_fullsized":"2023-12-11T20:13:54.582131+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:53:44.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604417+0000","last_change":"2023-12-11T20:13:53.285991+0000","last_active":"2023-12-11T20:13:54.604417+0000","last_peered":"2023-12-11T20:13:54.604417+0000","last_clean":"2023-12-11T20:13:54.604417+0000","last_became_active":"2023-12-11T20:13:53.283925+0000","last_became_peered":"2023-12-11T20:13:53.283925+0000","last_unstale":"2023-12-11T20:13:54.604417+0000","last_undegraded":"2023-12-11T20:13:54.604417+0000","last_fullsized":"2023-12-11T20:13:54.604417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:15:48.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.583106+0000","last_change":"2023-12-11T20:13:52.478883+0000","last_active":"2023-12-11T20:13:54.583106+0000","last_peered":"2023-12-11T20:13:54.583106+0000","last_clean":"2023-12-11T20:13:54.583106+0000","last_became_active":"2023-12-11T20:13:52.477070+0000","last_became_peered":"2023-12-11T20:13:52.477070+0000","last_unstale":"2023-12-11T20:13:54.583106+0000","last_undegraded":"2023-12-11T20:13:54.583106+0000","last_fullsized":"2023-12-11T20:13:54.583106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:14:32.504778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254009+0000","last_change":"2023-12-11T20:13:53.278181+0000","last_active":"2023-12-11T20:13:54.254009+0000","last_peered":"2023-12-11T20:13:54.254009+0000","last_clean":"2023-12-11T20:13:54.254009+0000","last_became_active":"2023-12-11T20:13:53.277800+0000","last_became_peered":"2023-12-11T20:13:53.277800+0000","last_unstale":"2023-12-11T20:13:54.254009+0000","last_undegraded":"2023-12-11T20:13:54.254009+0000","last_fullsized":"2023-12-11T20:13:54.254009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:35.424820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:55.461510+0000","last_change":"2023-12-11T20:13:52.481281+0000","last_active":"2023-12-11T20:13:55.461510+0000","last_peered":"2023-12-11T20:13:55.461510+0000","last_clean":"2023-12-11T20:13:55.461510+0000","last_became_active":"2023-12-11T20:13:52.479352+0000","last_became_peered":"2023-12-11T20:13:52.479352+0000","last_unstale":"2023-12-11T20:13:55.461510+0000","last_undegraded":"2023-12-11T20:13:55.461510+0000","last_fullsized":"2023-12-11T20:13:55.461510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:41.815011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253876+0000","last_change":"2023-12-11T20:13:53.282233+0000","last_active":"2023-12-11T20:13:54.253876+0000","last_peered":"2023-12-11T20:13:54.253876+0000","last_clean":"2023-12-11T20:13:54.253876+0000","last_became_active":"2023-12-11T20:13:53.279001+0000","last_became_peered":"2023-12-11T20:13:53.279001+0000","last_unstale":"2023-12-11T20:13:54.253876+0000","last_undegraded":"2023-12-11T20:13:54.253876+0000","last_fullsized":"2023-12-11T20:13:54.253876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:30:21.671414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581849+0000","last_change":"2023-12-11T20:13:53.269361+0000","last_active":"2023-12-11T20:13:54.581849+0000","last_peered":"2023-12-11T20:13:54.581849+0000","last_clean":"2023-12-11T20:13:54.581849+0000","last_became_active":"2023-12-11T20:13:53.268613+0000","last_became_peered":"2023-12-11T20:13:53.268613+0000","last_unstale":"2023-12-11T20:13:54.581849+0000","last_undegraded":"2023-12-11T20:13:54.581849+0000","last_fullsized":"2023-12-11T20:13:54.581849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:08:04.876038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253164+0000","last_change":"2023-12-11T20:13:52.484537+0000","last_active":"2023-12-11T20:13:54.253164+0000","last_peered":"2023-12-11T20:13:54.253164+0000","last_clean":"2023-12-11T20:13:54.253164+0000","last_became_active":"2023-12-11T20:13:52.482732+0000","last_became_peered":"2023-12-11T20:13:52.482732+0000","last_unstale":"2023-12-11T20:13:54.253164+0000","last_undegraded":"2023-12-11T20:13:54.253164+0000","last_fullsized":"2023-12-11T20:13:54.253164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:41:31.332046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581473+0000","last_change":"2023-12-11T20:13:53.270953+0000","last_active":"2023-12-11T20:13:54.581473+0000","last_peered":"2023-12-11T20:13:54.581473+0000","last_clean":"2023-12-11T20:13:54.581473+0000","last_became_active":"2023-12-11T20:13:53.269711+0000","last_became_peered":"2023-12-11T20:13:53.269711+0000","last_unstale":"2023-12-11T20:13:54.581473+0000","last_undegraded":"2023-12-11T20:13:54.581473+0000","last_fullsized":"2023-12-11T20:13:54.581473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:16:50.802953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.499880+0000","last_change":"2023-12-11T20:13:52.473341+0000","last_active":"2023-12-11T20:13:56.499880+0000","last_peered":"2023-12-11T20:13:56.499880+0000","last_clean":"2023-12-11T20:13:56.499880+0000","last_became_active":"2023-12-11T20:13:52.469572+0000","last_became_peered":"2023-12-11T20:13:52.469572+0000","last_unstale":"2023-12-11T20:13:56.499880+0000","last_undegraded":"2023-12-11T20:13:56.499880+0000","last_fullsized":"2023-12-11T20:13:56.499880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:52:47.513645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-11T20:13:53.268990+0000","last_change":"2023-12-11T20:12:30.330188+0000","last_active":"2023-12-11T20:13:53.268990+0000","last_peered":"2023-12-11T20:13:53.268990+0000","last_clean":"2023-12-11T20:13:53.268990+0000","last_became_active":"2023-12-11T20:12:30.329533+0000","last_became_peered":"2023-12-11T20:12:30.329533+0000","last_unstale":"2023-12-11T20:13:53.268990+0000","last_undegraded":"2023-12-11T20:13:53.268990+0000","last_fullsized":"2023-12-11T20:13:53.268990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_clean_scrub_stamp":"2023-12-11T20:08:47.558016+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:18:10.357750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253205+0000","last_change":"2023-12-11T20:13:53.278062+0000","last_active":"2023-12-11T20:13:54.253205+0000","last_peered":"2023-12-11T20:13:54.253205+0000","last_clean":"2023-12-11T20:13:54.253205+0000","last_became_active":"2023-12-11T20:13:53.277664+0000","last_became_peered":"2023-12-11T20:13:53.277664+0000","last_unstale":"2023-12-11T20:13:54.253205+0000","last_undegraded":"2023-12-11T20:13:54.253205+0000","last_fullsized":"2023-12-11T20:13:54.253205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:07:38.751486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:57.510634+0000","last_change":"2023-12-11T20:13:52.481772+0000","last_active":"2023-12-11T20:13:57.510634+0000","last_peered":"2023-12-11T20:13:57.510634+0000","last_clean":"2023-12-11T20:13:57.510634+0000","last_became_active":"2023-12-11T20:13:52.481050+0000","last_became_peered":"2023-12-11T20:13:52.481050+0000","last_unstale":"2023-12-11T20:13:57.510634+0000","last_undegraded":"2023-12-11T20:13:57.510634+0000","last_fullsized":"2023-12-11T20:13:57.510634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:28:50.998994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581891+0000","last_change":"2023-12-11T20:13:52.478823+0000","last_active":"2023-12-11T20:13:54.581891+0000","last_peered":"2023-12-11T20:13:54.581891+0000","last_clean":"2023-12-11T20:13:54.581891+0000","last_became_active":"2023-12-11T20:13:52.478475+0000","last_became_peered":"2023-12-11T20:13:52.478475+0000","last_unstale":"2023-12-11T20:13:54.581891+0000","last_undegraded":"2023-12-11T20:13:54.581891+0000","last_fullsized":"2023-12-11T20:13:54.581891+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:44:36.438152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.255411+0000","last_change":"2023-12-11T20:13:53.272496+0000","last_active":"2023-12-11T20:13:54.255411+0000","last_peered":"2023-12-11T20:13:54.255411+0000","last_clean":"2023-12-11T20:13:54.255411+0000","last_became_active":"2023-12-11T20:13:53.271669+0000","last_became_peered":"2023-12-11T20:13:53.271669+0000","last_unstale":"2023-12-11T20:13:54.255411+0000","last_undegraded":"2023-12-11T20:13:54.255411+0000","last_fullsized":"2023-12-11T20:13:54.255411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:48:31.299659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:57.511840+0000","last_change":"2023-12-11T20:13:52.485866+0000","last_active":"2023-12-11T20:13:57.511840+0000","last_peered":"2023-12-11T20:13:57.511840+0000","last_clean":"2023-12-11T20:13:57.511840+0000","last_became_active":"2023-12-11T20:13:52.485106+0000","last_became_peered":"2023-12-11T20:13:52.485106+0000","last_unstale":"2023-12-11T20:13:57.511840+0000","last_undegraded":"2023-12-11T20:13:57.511840+0000","last_fullsized":"2023-12-11T20:13:57.511840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:24:41.177294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582496+0000","last_change":"2023-12-11T20:13:53.271737+0000","last_active":"2023-12-11T20:13:54.582496+0000","last_peered":"2023-12-11T20:13:54.582496+0000","last_clean":"2023-12-11T20:13:54.582496+0000","last_became_active":"2023-12-11T20:13:53.271228+0000","last_became_peered":"2023-12-11T20:13:53.271228+0000","last_unstale":"2023-12-11T20:13:54.582496+0000","last_undegraded":"2023-12-11T20:13:54.582496+0000","last_fullsized":"2023-12-11T20:13:54.582496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:45.614455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.499503+0000","last_change":"2023-12-11T20:13:52.475488+0000","last_active":"2023-12-11T20:13:56.499503+0000","last_peered":"2023-12-11T20:13:56.499503+0000","last_clean":"2023-12-11T20:13:56.499503+0000","last_became_active":"2023-12-11T20:13:52.475150+0000","last_became_peered":"2023-12-11T20:13:52.475150+0000","last_unstale":"2023-12-11T20:13:56.499503+0000","last_undegraded":"2023-12-11T20:13:56.499503+0000","last_fullsized":"2023-12-11T20:13:56.499503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:42:55.792758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582189+0000","last_change":"2023-12-11T20:13:53.285381+0000","last_active":"2023-12-11T20:13:54.582189+0000","last_peered":"2023-12-11T20:13:54.582189+0000","last_clean":"2023-12-11T20:13:54.582189+0000","last_became_active":"2023-12-11T20:13:53.285069+0000","last_became_peered":"2023-12-11T20:13:53.285069+0000","last_unstale":"2023-12-11T20:13:54.582189+0000","last_undegraded":"2023-12-11T20:13:54.582189+0000","last_fullsized":"2023-12-11T20:13:54.582189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:57:18.630314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.502139+0000","last_change":"2023-12-11T20:13:52.483184+0000","last_active":"2023-12-11T20:13:56.502139+0000","last_peered":"2023-12-11T20:13:56.502139+0000","last_clean":"2023-12-11T20:13:56.502139+0000","last_became_active":"2023-12-11T20:13:52.482853+0000","last_became_peered":"2023-12-11T20:13:52.482853+0000","last_unstale":"2023-12-11T20:13:56.502139+0000","last_undegraded":"2023-12-11T20:13:56.502139+0000","last_fullsized":"2023-12-11T20:13:56.502139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:35.111222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581398+0000","last_change":"2023-12-11T20:13:53.271751+0000","last_active":"2023-12-11T20:13:54.581398+0000","last_peered":"2023-12-11T20:13:54.581398+0000","last_clean":"2023-12-11T20:13:54.581398+0000","last_became_active":"2023-12-11T20:13:53.271385+0000","last_became_peered":"2023-12-11T20:13:53.271385+0000","last_unstale":"2023-12-11T20:13:54.581398+0000","last_undegraded":"2023-12-11T20:13:54.581398+0000","last_fullsized":"2023-12-11T20:13:54.581398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:28:03.856212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:56.501020+0000","last_change":"2023-12-11T20:13:52.483504+0000","last_active":"2023-12-11T20:13:56.501020+0000","last_peered":"2023-12-11T20:13:56.501020+0000","last_clean":"2023-12-11T20:13:56.501020+0000","last_became_active":"2023-12-11T20:13:52.482796+0000","last_became_peered":"2023-12-11T20:13:52.482796+0000","last_unstale":"2023-12-11T20:13:56.501020+0000","last_undegraded":"2023-12-11T20:13:56.501020+0000","last_fullsized":"2023-12-11T20:13:56.501020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:34:27.162215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604333+0000","last_change":"2023-12-11T20:13:53.276017+0000","last_active":"2023-12-11T20:13:54.604333+0000","last_peered":"2023-12-11T20:13:54.604333+0000","last_clean":"2023-12-11T20:13:54.604333+0000","last_became_active":"2023-12-11T20:13:53.275425+0000","last_became_peered":"2023-12-11T20:13:53.275425+0000","last_unstale":"2023-12-11T20:13:54.604333+0000","last_undegraded":"2023-12-11T20:13:54.604333+0000","last_fullsized":"2023-12-11T20:13:54.604333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:36.762187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254298+0000","last_change":"2023-12-11T20:13:52.477538+0000","last_active":"2023-12-11T20:13:54.254298+0000","last_peered":"2023-12-11T20:13:54.254298+0000","last_clean":"2023-12-11T20:13:54.254298+0000","last_became_active":"2023-12-11T20:13:52.476937+0000","last_became_peered":"2023-12-11T20:13:52.476937+0000","last_unstale":"2023-12-11T20:13:54.254298+0000","last_undegraded":"2023-12-11T20:13:54.254298+0000","last_fullsized":"2023-12-11T20:13:54.254298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:41:25.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581943+0000","last_change":"2023-12-11T20:13:53.276419+0000","last_active":"2023-12-11T20:13:54.581943+0000","last_peered":"2023-12-11T20:13:54.581943+0000","last_clean":"2023-12-11T20:13:54.581943+0000","last_became_active":"2023-12-11T20:13:53.276106+0000","last_became_peered":"2023-12-11T20:13:53.276106+0000","last_unstale":"2023-12-11T20:13:54.581943+0000","last_undegraded":"2023-12-11T20:13:54.581943+0000","last_fullsized":"2023-12-11T20:13:54.581943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:32.720877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581646+0000","last_change":"2023-12-11T20:13:52.480874+0000","last_active":"2023-12-11T20:13:54.581646+0000","last_peered":"2023-12-11T20:13:54.581646+0000","last_clean":"2023-12-11T20:13:54.581646+0000","last_became_active":"2023-12-11T20:13:52.480512+0000","last_became_peered":"2023-12-11T20:13:52.480512+0000","last_unstale":"2023-12-11T20:13:54.581646+0000","last_undegraded":"2023-12-11T20:13:54.581646+0000","last_fullsized":"2023-12-11T20:13:54.581646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:16:07.813113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581764+0000","last_change":"2023-12-11T20:13:53.265917+0000","last_active":"2023-12-11T20:13:54.581764+0000","last_peered":"2023-12-11T20:13:54.581764+0000","last_clean":"2023-12-11T20:13:54.581764+0000","last_became_active":"2023-12-11T20:13:53.265569+0000","last_became_peered":"2023-12-11T20:13:53.265569+0000","last_unstale":"2023-12-11T20:13:54.581764+0000","last_undegraded":"2023-12-11T20:13:54.581764+0000","last_fullsized":"2023-12-11T20:13:54.581764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:37:19.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254453+0000","last_change":"2023-12-11T20:13:52.478688+0000","last_active":"2023-12-11T20:13:54.254453+0000","last_peered":"2023-12-11T20:13:54.254453+0000","last_clean":"2023-12-11T20:13:54.254453+0000","last_became_active":"2023-12-11T20:13:52.477834+0000","last_became_peered":"2023-12-11T20:13:52.477834+0000","last_unstale":"2023-12-11T20:13:54.254453+0000","last_undegraded":"2023-12-11T20:13:54.254453+0000","last_fullsized":"2023-12-11T20:13:54.254453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:57:04.707801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582239+0000","last_change":"2023-12-11T20:13:53.274629+0000","last_active":"2023-12-11T20:13:54.582239+0000","last_peered":"2023-12-11T20:13:54.582239+0000","last_clean":"2023-12-11T20:13:54.582239+0000","last_became_active":"2023-12-11T20:13:53.269650+0000","last_became_peered":"2023-12-11T20:13:53.269650+0000","last_unstale":"2023-12-11T20:13:54.582239+0000","last_undegraded":"2023-12-11T20:13:54.582239+0000","last_fullsized":"2023-12-11T20:13:54.582239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:57:59.865232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582208+0000","last_change":"2023-12-11T20:13:52.485902+0000","last_active":"2023-12-11T20:13:54.582208+0000","last_peered":"2023-12-11T20:13:54.582208+0000","last_clean":"2023-12-11T20:13:54.582208+0000","last_became_active":"2023-12-11T20:13:52.481982+0000","last_became_peered":"2023-12-11T20:13:52.481982+0000","last_unstale":"2023-12-11T20:13:54.582208+0000","last_undegraded":"2023-12-11T20:13:54.582208+0000","last_fullsized":"2023-12-11T20:13:54.582208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:39.411648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:55.461559+0000","last_change":"2023-12-11T20:13:53.280080+0000","last_active":"2023-12-11T20:13:55.461559+0000","last_peered":"2023-12-11T20:13:55.461559+0000","last_clean":"2023-12-11T20:13:55.461559+0000","last_became_active":"2023-12-11T20:13:53.279763+0000","last_became_peered":"2023-12-11T20:13:53.279763+0000","last_unstale":"2023-12-11T20:13:55.461559+0000","last_undegraded":"2023-12-11T20:13:55.461559+0000","last_fullsized":"2023-12-11T20:13:55.461559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:22:27.369360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-11T20:13:53.481090+0000","last_change":"2023-12-11T20:13:52.486510+0000","last_active":"2023-12-11T20:13:53.481090+0000","last_peered":"2023-12-11T20:13:53.481090+0000","last_clean":"2023-12-11T20:13:53.481090+0000","last_became_active":"2023-12-11T20:13:52.483852+0000","last_became_peered":"2023-12-11T20:13:52.483852+0000","last_unstale":"2023-12-11T20:13:53.481090+0000","last_undegraded":"2023-12-11T20:13:53.481090+0000","last_fullsized":"2023-12-11T20:13:53.481090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:40:05.242000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582145+0000","last_change":"2023-12-11T20:13:53.270545+0000","last_active":"2023-12-11T20:13:54.582145+0000","last_peered":"2023-12-11T20:13:54.582145+0000","last_clean":"2023-12-11T20:13:54.582145+0000","last_became_active":"2023-12-11T20:13:53.270213+0000","last_became_peered":"2023-12-11T20:13:53.270213+0000","last_unstale":"2023-12-11T20:13:54.582145+0000","last_undegraded":"2023-12-11T20:13:54.582145+0000","last_fullsized":"2023-12-11T20:13:54.582145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:35.442471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604248+0000","last_change":"2023-12-11T20:13:53.276886+0000","last_active":"2023-12-11T20:13:54.604248+0000","last_peered":"2023-12-11T20:13:54.604248+0000","last_clean":"2023-12-11T20:13:54.604248+0000","last_became_active":"2023-12-11T20:13:53.276149+0000","last_became_peered":"2023-12-11T20:13:53.276149+0000","last_unstale":"2023-12-11T20:13:54.604248+0000","last_undegraded":"2023-12-11T20:13:54.604248+0000","last_fullsized":"2023-12-11T20:13:54.604248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:34:19.562002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254179+0000","last_change":"2023-12-11T20:13:53.279990+0000","last_active":"2023-12-11T20:13:54.254179+0000","last_peered":"2023-12-11T20:13:54.254179+0000","last_clean":"2023-12-11T20:13:54.254179+0000","last_became_active":"2023-12-11T20:13:53.279685+0000","last_became_peered":"2023-12-11T20:13:53.279685+0000","last_unstale":"2023-12-11T20:13:54.254179+0000","last_undegraded":"2023-12-11T20:13:54.254179+0000","last_fullsized":"2023-12-11T20:13:54.254179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:21:36.526683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254186+0000","last_change":"2023-12-11T20:13:53.279128+0000","last_active":"2023-12-11T20:13:54.254186+0000","last_peered":"2023-12-11T20:13:54.254186+0000","last_clean":"2023-12-11T20:13:54.254186+0000","last_became_active":"2023-12-11T20:13:53.278821+0000","last_became_peered":"2023-12-11T20:13:53.278821+0000","last_unstale":"2023-12-11T20:13:54.254186+0000","last_undegraded":"2023-12-11T20:13:54.254186+0000","last_fullsized":"2023-12-11T20:13:54.254186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:49:36.013115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581899+0000","last_change":"2023-12-11T20:13:53.281004+0000","last_active":"2023-12-11T20:13:54.581899+0000","last_peered":"2023-12-11T20:13:54.581899+0000","last_clean":"2023-12-11T20:13:54.581899+0000","last_became_active":"2023-12-11T20:13:53.280691+0000","last_became_peered":"2023-12-11T20:13:53.280691+0000","last_unstale":"2023-12-11T20:13:54.581899+0000","last_undegraded":"2023-12-11T20:13:54.581899+0000","last_fullsized":"2023-12-11T20:13:54.581899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:00.336975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.255475+0000","last_change":"2023-12-11T20:13:53.272690+0000","last_active":"2023-12-11T20:13:54.255475+0000","last_peered":"2023-12-11T20:13:54.255475+0000","last_clean":"2023-12-11T20:13:54.255475+0000","last_became_active":"2023-12-11T20:13:53.272194+0000","last_became_peered":"2023-12-11T20:13:53.272194+0000","last_unstale":"2023-12-11T20:13:54.255475+0000","last_undegraded":"2023-12-11T20:13:54.255475+0000","last_fullsized":"2023-12-11T20:13:54.255475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:58:45.312035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604794+0000","last_change":"2023-12-11T20:13:53.277625+0000","last_active":"2023-12-11T20:13:54.604794+0000","last_peered":"2023-12-11T20:13:54.604794+0000","last_clean":"2023-12-11T20:13:54.604794+0000","last_became_active":"2023-12-11T20:13:53.277174+0000","last_became_peered":"2023-12-11T20:13:53.277174+0000","last_unstale":"2023-12-11T20:13:54.604794+0000","last_undegraded":"2023-12-11T20:13:54.604794+0000","last_fullsized":"2023-12-11T20:13:54.604794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:01:41.057178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.254654+0000","last_change":"2023-12-11T20:13:53.278685+0000","last_active":"2023-12-11T20:13:54.254654+0000","last_peered":"2023-12-11T20:13:54.254654+0000","last_clean":"2023-12-11T20:13:54.254654+0000","last_became_active":"2023-12-11T20:13:53.276894+0000","last_became_peered":"2023-12-11T20:13:53.276894+0000","last_unstale":"2023-12-11T20:13:54.254654+0000","last_undegraded":"2023-12-11T20:13:54.254654+0000","last_fullsized":"2023-12-11T20:13:54.254654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:21:00.004496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.582345+0000","last_change":"2023-12-11T20:13:53.285596+0000","last_active":"2023-12-11T20:13:54.582345+0000","last_peered":"2023-12-11T20:13:54.582345+0000","last_clean":"2023-12-11T20:13:54.582345+0000","last_became_active":"2023-12-11T20:13:53.285289+0000","last_became_peered":"2023-12-11T20:13:53.285289+0000","last_unstale":"2023-12-11T20:13:54.582345+0000","last_undegraded":"2023-12-11T20:13:54.582345+0000","last_fullsized":"2023-12-11T20:13:54.582345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:53:59.939751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581951+0000","last_change":"2023-12-11T20:13:53.272600+0000","last_active":"2023-12-11T20:13:54.581951+0000","last_peered":"2023-12-11T20:13:54.581951+0000","last_clean":"2023-12-11T20:13:54.581951+0000","last_became_active":"2023-12-11T20:13:53.272308+0000","last_became_peered":"2023-12-11T20:13:53.272308+0000","last_unstale":"2023-12-11T20:13:54.581951+0000","last_undegraded":"2023-12-11T20:13:54.581951+0000","last_fullsized":"2023-12-11T20:13:54.581951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.458731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581139+0000","last_change":"2023-12-11T20:13:53.280833+0000","last_active":"2023-12-11T20:13:54.581139+0000","last_peered":"2023-12-11T20:13:54.581139+0000","last_clean":"2023-12-11T20:13:54.581139+0000","last_became_active":"2023-12-11T20:13:53.280384+0000","last_became_peered":"2023-12-11T20:13:53.280384+0000","last_unstale":"2023-12-11T20:13:54.581139+0000","last_undegraded":"2023-12-11T20:13:54.581139+0000","last_fullsized":"2023-12-11T20:13:54.581139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:37:38.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.581911+0000","last_change":"2023-12-11T20:13:53.271825+0000","last_active":"2023-12-11T20:13:54.581911+0000","last_peered":"2023-12-11T20:13:54.581911+0000","last_clean":"2023-12-11T20:13:54.581911+0000","last_became_active":"2023-12-11T20:13:53.271460+0000","last_became_peered":"2023-12-11T20:13:53.271460+0000","last_unstale":"2023-12-11T20:13:54.581911+0000","last_undegraded":"2023-12-11T20:13:54.581911+0000","last_fullsized":"2023-12-11T20:13:54.581911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:46:46.147904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.253615+0000","last_change":"2023-12-11T20:13:53.270103+0000","last_active":"2023-12-11T20:13:54.253615+0000","last_peered":"2023-12-11T20:13:54.253615+0000","last_clean":"2023-12-11T20:13:54.253615+0000","last_became_active":"2023-12-11T20:13:53.269781+0000","last_became_peered":"2023-12-11T20:13:53.269781+0000","last_unstale":"2023-12-11T20:13:54.253615+0000","last_undegraded":"2023-12-11T20:13:54.253615+0000","last_fullsized":"2023-12-11T20:13:54.253615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.865347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-11T20:13:54.604263+0000","last_change":"2023-12-11T20:13:53.284310+0000","last_active":"2023-12-11T20:13:54.604263+0000","last_peered":"2023-12-11T20:13:54.604263+0000","last_clean":"2023-12-11T20:13:54.604263+0000","last_became_active":"2023-12-11T20:13:53.283969+0000","last_became_peered":"2023-12-11T20:13:53.283969+0000","last_unstale":"2023-12-11T20:13:54.604263+0000","last_undegraded":"2023-12-11T20:13:54.604263+0000","last_fullsized":"2023-12-11T20:13:54.604263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:00:47.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":217636,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4093,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":30651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383695,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":438870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.4610000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.1399999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.274},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":2.0510000000000002}]},{"osd":5,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":6.1970000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":3.9489999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.494},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.659}]},{"osd":7,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":2.0230000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.431}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.732},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.54}]},{"osd":10,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":2.1669999999999998},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":4.0979999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":1030462,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.81699999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.92100000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.0620000000000001}]},{"osd":6,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.99199999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93799999999999994}]},{"osd":8,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.03}]},{"osd":9,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.05},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0940000000000001}]},{"osd":11,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.127}]}]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.745}]},{"osd":2,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.68700000000000006}]},{"osd":5,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.72899999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.90800000000000003}]},{"osd":8,"last update":"Mon Dec 11 20:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.77900000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.80900000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.71099999999999997,"15min":0.72299999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89000000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76200000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.72099999999999997,"15min":0.71499999999999997},"min":{"1min":0.433,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97999999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.746},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.51800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":1.079,"15min":1.079},"last":0.61499999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0049999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.40600000000000003}]},{"osd":3,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96199999999999997,"5min":1.081,"15min":1.081},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0629999999999999,"5min":1.226,"15min":1.226},"last":0.78500000000000003}]},{"osd":4,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.05,"5min":1.115,"15min":1.115},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80900000000000005,"15min":0.81100000000000005},"min":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.054,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.1279999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.1060000000000001,"5min":1.232,"15min":1.232},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.95299999999999996},"min":{"1min":0.69099999999999995,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2310000000000001,"5min":1.284,"15min":1.284},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0920000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.875,"15min":0.879},"min":{"1min":0.64100000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.087,"5min":1.298,"15min":1.298},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.94399999999999995,"15min":0.94899999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.159,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.67500000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82999999999999996}]},{"osd":10,"last update":"Mon Dec 11 20:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.874},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.90300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332134,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":1031349,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.94499999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.77600000000000002,"15min":0.76600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.0349999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.871},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77500000000000002,"15min":0.76700000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.85199999999999998,"15min":0.84099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.135},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.879,"15min":0.86699999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.93100000000000005}]},{"osd":6,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.874,"15min":0.86499999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.876,"15min":0.86399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.74199999999999999}]},{"osd":8,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.236,"5min":1.544,"15min":1.544},"last":1.097},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.69899999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.385,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.98599999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0009999999999999}]},{"osd":10,"last update":"Mon Dec 11 20:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.113}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]}]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":438288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.58199999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.159,"5min":0.82199999999999995,"15min":0.76400000000000001},"min":{"1min":0.61499999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":8.1080000000000005,"5min":8.1080000000000005,"15min":8.1080000000000005},"last":1.069}]},{"osd":2,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.93200000000000005,"15min":1.012},"min":{"1min":0.48899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.21,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.877,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.0229999999999999,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1599999999999999,"5min":6.9489999999999998,"15min":6.9489999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.089,"5min":1.167,"15min":1.167},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0169999999999999,"5min":1.226,"15min":1.226},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90300000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.92000000000000004,"15min":0.84499999999999997},"min":{"1min":0.65400000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":8.3079999999999998,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.69899999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88600000000000001,"15min":0.88700000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1679999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.153},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83799999999999997,"15min":0.84499999999999997},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0329999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.93200000000000005}]},{"osd":9,"last update":"Mon Dec 11 20:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.1850000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":456921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.60899999999999999,"15min":0.56499999999999995},"min":{"1min":0.46999999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.60899999999999999,"15min":0.55900000000000005},"min":{"1min":0.41399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64100000000000001,"15min":0.58499999999999996},"min":{"1min":0.49299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.61699999999999999,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.66200000000000003,"15min":0.623},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.70599999999999996}]},{"osd":4,"last update":"Mon Dec 11 20:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58799999999999997,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.53500000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99199999999999999,"5min":0.997,"15min":0.997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97499999999999998,"5min":1.069,"15min":1.069},"last":0.748}]},{"osd":6,"last update":"Mon Dec 11 20:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.77800000000000002,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.53700000000000003}]},{"osd":7,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.117,"5min":1.147,"15min":1.147},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.66900000000000004}]},{"osd":8,"last update":"Mon Dec 11 20:13:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.77500000000000002,"15min":0.76400000000000001},"min":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.872,"15min":0.85399999999999998},"min":{"1min":0.75600000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.876}]},{"osd":9,"last update":"Mon Dec 11 20:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79100000000000004}]},{"osd":10,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.89700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":439766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 20:13:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.61199999999999999,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98299999999999998,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.60699999999999998,"15min":0.56999999999999995},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Dec 11 20:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.627},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.35299999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66800000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68400000000000005,"15min":0.64800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.909,"15min":1.909},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Dec 11 20:13:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68600000000000005,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95699999999999996,"5min":1.036,"15min":1.036},"last":0.86199999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:13:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95799999999999996,"5min":1.028,"15min":1.028},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.496}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.93999999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.82299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.89500000000000002,"15min":0.90000000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.747}]},{"osd":9,"last update":"Mon Dec 11 20:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.57199999999999995}]},{"osd":10,"last update":"Mon Dec 11 20:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76200000000000001}]},{"osd":11,"last update":"Mon Dec 11 20:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.90900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":439591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.504},{"interface":"front","average":{"1min":0.624,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.435}]},{"osd":1,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63700000000000001,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":1.0369999999999999,"5min":1.089,"15min":1.089},"last":0.378},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:13:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63200000000000001,"15min":0.60299999999999998},"min":{"1min":0.42899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0129999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.623},"min":{"1min":0.46999999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Dec 11 20:13:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.64500000000000002,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Dec 11 20:13:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1080000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.05,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.69999999999999996,"15min":0.66600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.62},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.76900000000000002,"15min":0.73199999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83599999999999997}]},{"osd":7,"last update":"Mon Dec 11 20:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.101,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59799999999999998}]},{"osd":8,"last update":"Mon Dec 11 20:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.254,"15min":1.254},"last":0.80300000000000005}]},{"osd":9,"last update":"Mon Dec 11 20:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.71599999999999997}]},{"osd":10,"last update":"Mon Dec 11 20:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.0640000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":438241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.438,"15min":0.40799999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.46400000000000002,"15min":0.432},"min":{"1min":0.42399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.44}]},{"osd":1,"last update":"Mon Dec 11 20:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64500000000000002,"15min":0.61499999999999999},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.052,"5min":1.085,"15min":1.085},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.67500000000000004,"15min":0.63500000000000001},"min":{"1min":0.54300000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Mon Dec 11 20:13:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.67200000000000004,"15min":0.61599999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65500000000000003,"15min":0.63800000000000001},"min":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.79300000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.65300000000000002},"min":{"1min":0.61799999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.71699999999999997,"15min":0.67200000000000004},"min":{"1min":0.59599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Dec 11 20:13:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.52500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.752},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.751,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.056,"5min":1.145,"15min":1.145},"last":0.85999999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.073,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86399999999999999,"15min":0.84999999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.76300000000000001}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.85799999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.66200000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.80800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":438310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57999999999999996,"15min":0.53900000000000003},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.496}]},{"osd":1,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78600000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003}]},{"osd":2,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65200000000000002,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.69399999999999995},"min":{"1min":0.60099999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64400000000000002,"15min":0.62},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83899999999999997,"5min":0.872,"15min":0.872},"last":0.73299999999999998}]},{"osd":5,"last update":"Mon Dec 11 20:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.45500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73199999999999998,"15min":0.71599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.875}]},{"osd":6,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.036,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.64300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.079,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.077,"5min":1.161,"15min":1.161},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1020000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77700000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.624,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.119,"5min":1.169,"15min":1.169},"last":0.92200000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.90800000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1029801,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.45900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61699999999999999,"15min":0.60199999999999998},"min":{"1min":0.46200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0780000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.498}]},{"osd":1,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.61799999999999999,"15min":0.59399999999999997},"min":{"1min":0.46600000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55300000000000005}]},{"osd":3,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.64000000000000001,"15min":0.60999999999999999},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.63},"min":{"1min":0.51700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92200000000000004,"5min":1.127,"15min":1.127},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:13:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.70099999999999996},"min":{"1min":0.51700000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.70399999999999996,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.83199999999999996}]},{"osd":6,"last update":"Mon Dec 11 20:13:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":0.82699999999999996,"15min":0.76900000000000002},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76200000000000001,"15min":0.751},"min":{"1min":0.623,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Dec 11 20:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.78400000000000003,"15min":0.77400000000000002},"min":{"1min":0.65300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.77600000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.746}]},{"osd":9,"last update":"Mon Dec 11 20:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72599999999999998}]},{"osd":10,"last update":"Mon Dec 11 20:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34906,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":18976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T20:14:02.250 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-11T20:14:02.251 INFO:tasks.cephadm:Setting up client nodes... 2023-12-11T20:14:02.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-11T20:14:02.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:02 smithi039 ceph-mon[102205]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:02.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:02 smithi012 ceph-mon[128787]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:02.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:02 smithi032 ceph-mon[132488]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:03.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:03.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2023-12-11T20:14:03.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2023-12-11T20:14:03.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]: dispatch 2023-12-11T20:14:03.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]: dispatch 2023-12-11T20:14:03.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2023-12-11T20:14:03.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]: dispatch 2023-12-11T20:14:03.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2023-12-11T20:14:03.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2023-12-11T20:14:03.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2023-12-11T20:14:03.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:03 smithi012 ceph-mon[128787]: pgmap v315: 97 pgs: 97 active+clean; 622 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 KiB/s wr, 18 op/s 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2023-12-11T20:14:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:03 smithi039 ceph-mon[102205]: pgmap v315: 97 pgs: 97 active+clean; 622 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 KiB/s wr, 18 op/s 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2023-12-11T20:14:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:03 smithi032 ceph-mon[132488]: pgmap v315: 97 pgs: 97 active+clean; 622 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.6 KiB/s wr, 18 op/s 2023-12-11T20:14:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 -- 172.21.15.12:0/1657472686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba101015e0 msgr2=0x7fba10101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 --2- 172.21.15.12:0/1657472686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba101015e0 0x7fba10101a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0099c0 tx=0x7fba0c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 -- 172.21.15.12:0/1657472686 shutdown_connections 2023-12-11T20:14:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 --2- 172.21.15.12:0/1657472686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba10103180 0x7fba10109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 --2- 172.21.15.12:0/1657472686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba101015e0 0x7fba10101a00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 --2- 172.21.15.12:0/1657472686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba101027e0 0x7fba10102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 -- 172.21.15.12:0/1657472686 >> 172.21.15.12:0/1657472686 conn(0x7fba100fcb80 msgr2=0x7fba100fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 -- 172.21.15.12:0/1657472686 shutdown_connections 2023-12-11T20:14:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.631+0000 7fba18566700 1 -- 172.21.15.12:0/1657472686 wait complete. 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.632+0000 7fba18566700 1 Processor -- start 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.632+0000 7fba18566700 1 -- start start 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.632+0000 7fba18566700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba101015e0 0x7fba101996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.632+0000 7fba18566700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba101027e0 0x7fba10199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.632+0000 7fba18566700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba10103180 0x7fba101a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.632+0000 7fba18566700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101a11d0 con 0x7fba10103180 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.632+0000 7fba18566700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101a1310 con 0x7fba101027e0 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.632+0000 7fba18566700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101a14a0 con 0x7fba101015e0 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba10103180 0x7fba101a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba10103180 0x7fba101a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43932/0 (socket says 172.21.15.12:43932) 2023-12-11T20:14:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 -- 172.21.15.12:0/336017914 learned_addr learned my addr 172.21.15.12:0/336017914 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:04.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba15b01700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba101027e0 0x7fba10199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:04.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16302700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba101015e0 0x7fba101996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:04.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 -- 172.21.15.12:0/336017914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba101015e0 msgr2=0x7fba101996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:04.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba101015e0 0x7fba101996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 -- 172.21.15.12:0/336017914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba101027e0 msgr2=0x7fba10199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:04.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba101027e0 0x7fba10199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 -- 172.21.15.12:0/336017914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0095f0 con 0x7fba10103180 2023-12-11T20:14:04.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.633+0000 7fba16b03700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba10103180 0x7fba101a0c00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba08007f10 tx=0x7fba0800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:04.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.634+0000 7fba077fe700 1 -- 172.21.15.12:0/336017914 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800ddd0 con 0x7fba10103180 2023-12-11T20:14:04.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.634+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba101a1780 con 0x7fba10103180 2023-12-11T20:14:04.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.634+0000 7fba077fe700 1 -- 172.21.15.12:0/336017914 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba0800f040 con 0x7fba10103180 2023-12-11T20:14:04.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.634+0000 7fba077fe700 1 -- 172.21.15.12:0/336017914 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08004870 con 0x7fba10103180 2023-12-11T20:14:04.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.634+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba101a1c30 con 0x7fba10103180 2023-12-11T20:14:04.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.635+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1004f290 con 0x7fba10103180 2023-12-11T20:14:04.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.637+0000 7fba077fe700 1 -- 172.21.15.12:0/336017914 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fba08003a00 con 0x7fba10103180 2023-12-11T20:14:04.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.638+0000 7fba077fe700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9fc0a1510 0x7fb9fc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:04.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.638+0000 7fba077fe700 1 -- 172.21.15.12:0/336017914 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fba080ccff0 con 0x7fba10103180 2023-12-11T20:14:04.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.638+0000 7fba16302700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9fc0a1510 0x7fb9fc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:04.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.639+0000 7fba16302700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9fc0a1510 0x7fb9fc0a39d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009990 tx=0x7fba0c01a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:04.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.640+0000 7fba077fe700 1 -- 172.21.15.12:0/336017914 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fba080964a0 con 0x7fba10103180 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]': finished 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]': finished 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2023-12-11T20:14:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2023-12-11T20:14:04.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:04 smithi039 ceph-mon[102205]: osdmap e86: 12 total, 12 up, 12 in 2023-12-11T20:14:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2023-12-11T20:14:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2023-12-11T20:14:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]': finished 2023-12-11T20:14:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]': finished 2023-12-11T20:14:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2023-12-11T20:14:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2023-12-11T20:14:04.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2023-12-11T20:14:04.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2023-12-11T20:14:04.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2023-12-11T20:14:04.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:04 smithi012 ceph-mon[128787]: osdmap e86: 12 total, 12 up, 12 in 2023-12-11T20:14:04.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.938+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fba1010ccb0 con 0x7fba10103180 2023-12-11T20:14:04.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.941+0000 7fba077fe700 1 -- 172.21.15.12:0/336017914 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fba080230f0 con 0x7fba10103180 2023-12-11T20:14:04.940 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2023-12-11T20:14:04.941 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCMbXdluL8SOBAADhjsm2JSZod1zk5EcBidhg== 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9fc0a1510 msgr2=0x7fb9fc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9fc0a1510 0x7fb9fc0a39d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009990 tx=0x7fba0c01a040 comp rx=0 tx=0).stop 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba10103180 msgr2=0x7fba101a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba10103180 0x7fba101a0c00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba08007f10 tx=0x7fba0800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 shutdown_connections 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9fc0a1510 0x7fb9fc0a39d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba10103180 0x7fba101a0c00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba101015e0 0x7fba101996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 --2- 172.21.15.12:0/336017914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba101027e0 0x7fba10199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 >> 172.21.15.12:0/336017914 conn(0x7fba100fcb80 msgr2=0x7fba10107fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:04.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 shutdown_connections 2023-12-11T20:14:04.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:04.944+0000 7fba18566700 1 -- 172.21.15.12:0/336017914 wait complete. 2023-12-11T20:14:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2023-12-11T20:14:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2023-12-11T20:14:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]': finished 2023-12-11T20:14:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]': finished 2023-12-11T20:14:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4, 8, 11]}]': finished 2023-12-11T20:14:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2023-12-11T20:14:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2023-12-11T20:14:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2023-12-11T20:14:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2023-12-11T20:14:04.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:04 smithi032 ceph-mon[132488]: osdmap e86: 12 total, 12 up, 12 in 2023-12-11T20:14:05.364 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:14:05.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-11T20:14:05.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-11T20:14:05.464 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-11T20:14:05.465 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-11T20:14:05.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph mgr dump --format=json 2023-12-11T20:14:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:05 smithi039 ceph-mon[102205]: osdmap e87: 12 total, 12 up, 12 in 2023-12-11T20:14:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:05 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/336017914' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-11T20:14:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:05 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/336017914' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-11T20:14:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:05 smithi039 ceph-mon[102205]: pgmap v318: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.7 KiB/s wr, 18 op/s 2023-12-11T20:14:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:05 smithi012 ceph-mon[128787]: osdmap e87: 12 total, 12 up, 12 in 2023-12-11T20:14:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:05 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/336017914' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-11T20:14:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:05 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/336017914' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-11T20:14:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:05 smithi012 ceph-mon[128787]: pgmap v318: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.7 KiB/s wr, 18 op/s 2023-12-11T20:14:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:05 smithi032 ceph-mon[132488]: osdmap e87: 12 total, 12 up, 12 in 2023-12-11T20:14:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:05 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/336017914' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-11T20:14:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:05 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/336017914' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-11T20:14:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:05 smithi032 ceph-mon[132488]: pgmap v318: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.7 KiB/s wr, 18 op/s 2023-12-11T20:14:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.907+0000 7f245f49a700 1 -- 172.21.15.12:0/275196403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2458102040 msgr2=0x7f245810e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.907+0000 7f245f49a700 1 --2- 172.21.15.12:0/275196403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2458102040 0x7f245810e430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f245000b0a0 tx=0x7f245000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.907+0000 7f245f49a700 1 -- 172.21.15.12:0/275196403 shutdown_connections 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.907+0000 7f245f49a700 1 --2- 172.21.15.12:0/275196403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2458102040 0x7f245810e430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.907+0000 7f245f49a700 1 --2- 172.21.15.12:0/275196403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24581076f0 0x7f2458107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.907+0000 7f245f49a700 1 --2- 172.21.15.12:0/275196403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2458101680 0x7f2458101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.907+0000 7f245f49a700 1 -- 172.21.15.12:0/275196403 >> 172.21.15.12:0/275196403 conn(0x7f24580787c0 msgr2=0x7f2458078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.907+0000 7f245f49a700 1 -- 172.21.15.12:0/275196403 shutdown_connections 2023-12-11T20:14:07.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.908+0000 7f245f49a700 1 -- 172.21.15.12:0/275196403 wait complete. 2023-12-11T20:14:07.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245f49a700 1 Processor -- start 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245f49a700 1 -- start start 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245f49a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2458101680 0x7f245819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245f49a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2458102040 0x7f245819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245f49a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581076f0 0x7f24581977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245f49a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458197e10 con 0x7f24581076f0 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245f49a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458197f80 con 0x7f2458101680 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245f49a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458198140 con 0x7f2458102040 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245da37700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581076f0 0x7f24581977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.909+0000 7f245da37700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581076f0 0x7f24581977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43946/0 (socket says 172.21.15.12:43946) 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245da37700 1 -- 172.21.15.12:0/2003301653 learned_addr learned my addr 172.21.15.12:0/2003301653 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:07.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245d236700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2458101680 0x7f245819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245ca35700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2458102040 0x7f245819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245da37700 1 -- 172.21.15.12:0/2003301653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2458102040 msgr2=0x7f245819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245da37700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2458102040 0x7f245819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245da37700 1 -- 172.21.15.12:0/2003301653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2458101680 msgr2=0x7f245819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245da37700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2458101680 0x7f245819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245da37700 1 -- 172.21.15.12:0/2003301653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450009d00 con 0x7f24581076f0 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245ca35700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2458102040 0x7f245819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245d236700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2458101680 0x7f245819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245da37700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581076f0 0x7f24581977a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f245000b070 tx=0x7f245000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f244e7fc700 1 -- 172.21.15.12:0/2003301653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245000e040 con 0x7f24581076f0 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f244e7fc700 1 -- 172.21.15.12:0/2003301653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2450003c00 con 0x7f24581076f0 2023-12-11T20:14:07.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.910+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24581983c0 con 0x7f24581076f0 2023-12-11T20:14:07.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.911+0000 7f244e7fc700 1 -- 172.21.15.12:0/2003301653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450005040 con 0x7f24581076f0 2023-12-11T20:14:07.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.911+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24581a4650 con 0x7f24581076f0 2023-12-11T20:14:07.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.912+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2458109b80 con 0x7f24581076f0 2023-12-11T20:14:07.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.914+0000 7f244e7fc700 1 -- 172.21.15.12:0/2003301653 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f245001d480 con 0x7f24581076f0 2023-12-11T20:14:07.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.915+0000 7f244e7fc700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24440a1590 0x7f24440a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:07.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.915+0000 7f244e7fc700 1 -- 172.21.15.12:0/2003301653 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f24500cddd0 con 0x7f24581076f0 2023-12-11T20:14:07.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.915+0000 7f245d236700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24440a1590 0x7f24440a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:07.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.916+0000 7f245d236700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24440a1590 0x7f24440a3a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2454005950 tx=0x7f24540058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:07.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:07.919+0000 7f244e7fc700 1 -- 172.21.15.12:0/2003301653 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f24500972f0 con 0x7f24581076f0 2023-12-11T20:14:08.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.187+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2458102d10 con 0x7f24581076f0 2023-12-11T20:14:08.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.193+0000 7f244e7fc700 1 -- 172.21.15.12:0/2003301653 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260410 (secure 0 0 0) 0x7f245009a910 con 0x7f24581076f0 2023-12-11T20:14:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24440a1590 msgr2=0x7f24440a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24440a1590 0x7f24440a3a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2454005950 tx=0x7f24540058e0 comp rx=0 tx=0).stop 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581076f0 msgr2=0x7f24581977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581076f0 0x7f24581977a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f245000b070 tx=0x7f245000bed0 comp rx=0 tx=0).stop 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 shutdown_connections 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24440a1590 0x7f24440a3a50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2458101680 0x7f245819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24581076f0 0x7f24581977a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 --2- 172.21.15.12:0/2003301653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2458102040 0x7f245819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 >> 172.21.15.12:0/2003301653 conn(0x7f24580787c0 msgr2=0x7f2458100360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 shutdown_connections 2023-12-11T20:14:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:08.197+0000 7f245f49a700 1 -- 172.21.15.12:0/2003301653 wait complete. 2023-12-11T20:14:08.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:08 smithi012 ceph-mon[128787]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 19 op/s; 15 B/s, 0 objects/s recovering 2023-12-11T20:14:08.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:08 smithi032 ceph-mon[132488]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 19 op/s; 15 B/s, 0 objects/s recovering 2023-12-11T20:14:08.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:08 smithi039 ceph-mon[102205]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 19 op/s; 15 B/s, 0 objects/s recovering 2023-12-11T20:14:08.687 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1969938581},{"type":"v1","addr":"172.21.15.12:6801","nonce":1969938581}]},"active_addr":"172.21.15.12:6801/1969938581","active_change":"2023-12-11T20:06:02.927654+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14214,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.12:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2604531932}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1336767852}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3748541661}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1265360928}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":973797016}]}]} 2023-12-11T20:14:08.692 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-11T20:14:08.692 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-11T20:14:08.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-11T20:14:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:09 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2003301653' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-11T20:14:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:09.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:09 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2003301653' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-11T20:14:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:09 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2003301653' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-11T20:14:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:10 smithi012 ceph-mon[128787]: pgmap v320: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 17 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:10.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:10 smithi032 ceph-mon[132488]: pgmap v320: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 17 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:10.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:10 smithi039 ceph-mon[102205]: pgmap v320: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 17 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:11.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 -- 172.21.15.12:0/1269372682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5638102040 msgr2=0x7f563810e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:11.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 --2- 172.21.15.12:0/1269372682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5638102040 0x7f563810e430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f563000b0a0 tx=0x7f563000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 -- 172.21.15.12:0/1269372682 shutdown_connections 2023-12-11T20:14:11.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 --2- 172.21.15.12:0/1269372682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56381076f0 0x7f5638107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 --2- 172.21.15.12:0/1269372682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5638102040 0x7f563810e430 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 --2- 172.21.15.12:0/1269372682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5638101680 0x7f5638101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 -- 172.21.15.12:0/1269372682 >> 172.21.15.12:0/1269372682 conn(0x7f56380787c0 msgr2=0x7f5638078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:11.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 -- 172.21.15.12:0/1269372682 shutdown_connections 2023-12-11T20:14:11.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.040+0000 7f563df6a700 1 -- 172.21.15.12:0/1269372682 wait complete. 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.041+0000 7f563df6a700 1 Processor -- start 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f563df6a700 1 -- start start 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f563df6a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5638101680 0x7f563819f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f563df6a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5638102040 0x7f563819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f563df6a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56381076f0 0x7f56381999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f563df6a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563819a010 con 0x7f56381076f0 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f563df6a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563819a180 con 0x7f5638101680 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f563df6a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563819a340 con 0x7f5638102040 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f5637fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56381076f0 0x7f56381999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f5637fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56381076f0 0x7f56381999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56648/0 (socket says 172.21.15.12:56648) 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f5637fff700 1 -- 172.21.15.12:0/2365168686 learned_addr learned my addr 172.21.15.12:0/2365168686 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.042+0000 7f56377fe700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5638101680 0x7f563819f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5636ffd700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5638102040 0x7f563819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:11.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5637fff700 1 -- 172.21.15.12:0/2365168686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5638102040 msgr2=0x7f563819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:11.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5637fff700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5638102040 0x7f563819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5637fff700 1 -- 172.21.15.12:0/2365168686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5638101680 msgr2=0x7f563819f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:11.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5637fff700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5638101680 0x7f563819f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5637fff700 1 -- 172.21.15.12:0/2365168686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630009d00 con 0x7f56381076f0 2023-12-11T20:14:11.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5636ffd700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5638102040 0x7f563819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:14:11.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5637fff700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56381076f0 0x7f56381999b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f563000b070 tx=0x7f563000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:11.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5634ff9700 1 -- 172.21.15.12:0/2365168686 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563000e040 con 0x7f56381076f0 2023-12-11T20:14:11.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5634ff9700 1 -- 172.21.15.12:0/2365168686 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5630007e20 con 0x7f56381076f0 2023-12-11T20:14:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f5634ff9700 1 -- 172.21.15.12:0/2365168686 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630005040 con 0x7f56381076f0 2023-12-11T20:14:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563819a5c0 con 0x7f56381076f0 2023-12-11T20:14:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.043+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56381a6860 con 0x7f56381076f0 2023-12-11T20:14:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.044+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5638104940 con 0x7f56381076f0 2023-12-11T20:14:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.046+0000 7f5634ff9700 1 -- 172.21.15.12:0/2365168686 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f563001d480 con 0x7f56381076f0 2023-12-11T20:14:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.048+0000 7f5634ff9700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56200a1510 0x7f56200a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:11.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.048+0000 7f5634ff9700 1 -- 172.21.15.12:0/2365168686 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f56300cdfe0 con 0x7f56381076f0 2023-12-11T20:14:11.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.048+0000 7f56377fe700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56200a1510 0x7f56200a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:11.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.048+0000 7f56377fe700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56200a1510 0x7f56200a39d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5628005950 tx=0x7f562800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:11.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.052+0000 7f5634ff9700 1 -- 172.21.15.12:0/2365168686 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5630097540 con 0x7f56381076f0 2023-12-11T20:14:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.263+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5638102d10 con 0x7f56381076f0 2023-12-11T20:14:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.264+0000 7f5634ff9700 1 -- 172.21.15.12:0/2365168686 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22547 (secure 0 0 0) 0x7f563009ab60 con 0x7f56381076f0 2023-12-11T20:14:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:11.264 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:14:04.519931+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56200a1510 msgr2=0x7f56200a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56200a1510 0x7f56200a39d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5628005950 tx=0x7f562800b410 comp rx=0 tx=0).stop 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56381076f0 msgr2=0x7f56381999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56381076f0 0x7f56381999b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f563000b070 tx=0x7f563000be20 comp rx=0 tx=0).stop 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 shutdown_connections 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56200a1510 0x7f56200a39d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5638101680 0x7f563819f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56381076f0 0x7f56381999b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 --2- 172.21.15.12:0/2365168686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5638102040 0x7f563819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 >> 172.21.15.12:0/2365168686 conn(0x7f56380787c0 msgr2=0x7f563810caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 shutdown_connections 2023-12-11T20:14:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:11.267+0000 7f563df6a700 1 -- 172.21.15.12:0/2365168686 wait complete. 2023-12-11T20:14:11.775 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-11T20:14:11.775 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-11T20:14:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:12 smithi032 ceph-mon[132488]: pgmap v321: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.0 KiB/s wr, 5 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:12 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2365168686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:12.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:12 smithi039 ceph-mon[102205]: pgmap v321: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.0 KiB/s wr, 5 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:12.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:12 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2365168686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:12.564 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:12 smithi012 ceph-mon[128787]: pgmap v321: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.0 KiB/s wr, 5 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:12 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2365168686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 -- 172.21.15.12:0/1720590659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20102040 msgr2=0x7f6c2010e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 --2- 172.21.15.12:0/1720590659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20102040 0x7f6c2010e430 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800b0a0 tx=0x7f6c1800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 -- 172.21.15.12:0/1720590659 shutdown_connections 2023-12-11T20:14:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 --2- 172.21.15.12:0/1720590659 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c201076f0 0x7f6c20107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 --2- 172.21.15.12:0/1720590659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20102040 0x7f6c2010e430 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 --2- 172.21.15.12:0/1720590659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c20101680 0x7f6c20101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 -- 172.21.15.12:0/1720590659 >> 172.21.15.12:0/1720590659 conn(0x7f6c200787c0 msgr2=0x7f6c20078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 -- 172.21.15.12:0/1720590659 shutdown_connections 2023-12-11T20:14:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.072+0000 7f6c27242700 1 -- 172.21.15.12:0/1720590659 wait complete. 2023-12-11T20:14:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.073+0000 7f6c27242700 1 Processor -- start 2023-12-11T20:14:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.073+0000 7f6c27242700 1 -- start start 2023-12-11T20:14:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c27242700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20101680 0x7f6c200738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c27242700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c20102040 0x7f6c20073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c27242700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c201076f0 0x7f6c20074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c27242700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c201a5d30 con 0x7f6c20101680 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c27242700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c201a5ea0 con 0x7f6c201076f0 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c27242700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c201a6060 con 0x7f6c20102040 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c24fde700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20101680 0x7f6c200738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c24fde700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20101680 0x7f6c200738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56680/0 (socket says 172.21.15.12:56680) 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c24fde700 1 -- 172.21.15.12:0/1462404243 learned_addr learned my addr 172.21.15.12:0/1462404243 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c1ffff700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c20102040 0x7f6c20073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.074+0000 7f6c257df700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c201076f0 0x7f6c20074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c24fde700 1 -- 172.21.15.12:0/1462404243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c20102040 msgr2=0x7f6c20073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c24fde700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c20102040 0x7f6c20073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c24fde700 1 -- 172.21.15.12:0/1462404243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c201076f0 msgr2=0x7f6c20074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c24fde700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c201076f0 0x7f6c20074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c24fde700 1 -- 172.21.15.12:0/1462404243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c18009d00 con 0x7f6c20101680 2023-12-11T20:14:14.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c24fde700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20101680 0x7f6c200738d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400d950 tx=0x7f6c1400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:14.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c1dffb700 1 -- 172.21.15.12:0/1462404243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400f890 con 0x7f6c20101680 2023-12-11T20:14:14.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c201a6340 con 0x7f6c20101680 2023-12-11T20:14:14.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c1dffb700 1 -- 172.21.15.12:0/1462404243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c1400fe80 con 0x7f6c20101680 2023-12-11T20:14:14.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c1dffb700 1 -- 172.21.15.12:0/1462404243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400e3b0 con 0x7f6c20101680 2023-12-11T20:14:14.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.075+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c201a6840 con 0x7f6c20101680 2023-12-11T20:14:14.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.076+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c20109b80 con 0x7f6c20101680 2023-12-11T20:14:14.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.078+0000 7f6c1dffb700 1 -- 172.21.15.12:0/1462404243 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f6c14010460 con 0x7f6c20101680 2023-12-11T20:14:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.080+0000 7f6c1dffb700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6c100a1510 0x7f6c100a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.080+0000 7f6c1dffb700 1 -- 172.21.15.12:0/1462404243 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f6c140ccce0 con 0x7f6c20101680 2023-12-11T20:14:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.080+0000 7f6c1ffff700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6c100a1510 0x7f6c100a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:14.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.080+0000 7f6c1ffff700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6c100a1510 0x7f6c100a39d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c20074fb0 tx=0x7f6c0c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:14.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.084+0000 7f6c1dffb700 1 -- 172.21.15.12:0/1462404243 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6c14096170 con 0x7f6c20101680 2023-12-11T20:14:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.295+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c20074d60 con 0x7f6c20101680 2023-12-11T20:14:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.296+0000 7f6c1dffb700 1 -- 172.21.15.12:0/1462404243 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22547 (secure 0 0 0) 0x7f6c14016090 con 0x7f6c20101680 2023-12-11T20:14:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:14.296 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:14:04.519931+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:14:14.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6c100a1510 msgr2=0x7f6c100a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:14.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6c100a1510 0x7f6c100a39d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c20074fb0 tx=0x7f6c0c009260 comp rx=0 tx=0).stop 2023-12-11T20:14:14.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20101680 msgr2=0x7f6c200738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:14.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20101680 0x7f6c200738d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400d950 tx=0x7f6c1400dc60 comp rx=0 tx=0).stop 2023-12-11T20:14:14.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 shutdown_connections 2023-12-11T20:14:14.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6c100a1510 0x7f6c100a39d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c201076f0 0x7f6c20074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c20101680 0x7f6c200738d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 --2- 172.21.15.12:0/1462404243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c20102040 0x7f6c20073e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 >> 172.21.15.12:0/1462404243 conn(0x7f6c200787c0 msgr2=0x7f6c201003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 shutdown_connections 2023-12-11T20:14:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:14.299+0000 7f6c27242700 1 -- 172.21.15.12:0/1462404243 wait complete. 2023-12-11T20:14:14.407 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:14 smithi012 ceph-mon[128787]: pgmap v322: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 12 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:14.466 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:14 smithi032 ceph-mon[132488]: pgmap v322: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 12 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:14.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:14 smithi039 ceph-mon[102205]: pgmap v322: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 12 B/s, 1 keys/s, 0 objects/s recovering 2023-12-11T20:14:14.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-11T20:14:14.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-11T20:14:14.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-11T20:14:14.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-11T20:14:14.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-11T20:14:14.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-11T20:14:14.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2023-12-11T20:14:14.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2023-12-11T20:14:14.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2023-12-11T20:14:14.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2023-12-11T20:14:14.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2023-12-11T20:14:14.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2023-12-11T20:14:15.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:15 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1462404243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:15 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1462404243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:15.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:15 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1462404243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:16.447 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:16 smithi032 ceph-mon[132488]: pgmap v323: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:16 smithi039 ceph-mon[102205]: pgmap v323: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:16 smithi012 ceph-mon[128787]: pgmap v323: 97 pgs: 97 active+clean; 635 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 6 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:17.065 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:17.801 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:18.025 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:18 smithi032 ceph-mon[132488]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:18.504 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:18.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:18 smithi039 ceph-mon[102205]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:18 smithi012 ceph-mon[128787]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:19.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:19 smithi012 ceph-mon[128787]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:19 smithi039 ceph-mon[102205]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:19 smithi032 ceph-mon[132488]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-12-11T20:14:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 -- 172.21.15.12:0/3299646593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 msgr2=0x7f2404106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 --2- 172.21.15.12:0/3299646593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 0x7f2404106980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009990 tx=0x7f23f4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 -- 172.21.15.12:0/3299646593 shutdown_connections 2023-12-11T20:14:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 --2- 172.21.15.12:0/3299646593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2404101fe0 0x7f240410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 --2- 172.21.15.12:0/3299646593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 0x7f2404106980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 --2- 172.21.15.12:0/3299646593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2404101620 0x7f2404101aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 -- 172.21.15.12:0/3299646593 >> 172.21.15.12:0/3299646593 conn(0x7f2404078730 msgr2=0x7f2404078b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 -- 172.21.15.12:0/3299646593 shutdown_connections 2023-12-11T20:14:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.578+0000 7f2409e3d700 1 -- 172.21.15.12:0/3299646593 wait complete. 2023-12-11T20:14:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.579+0000 7f2409e3d700 1 Processor -- start 2023-12-11T20:14:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.579+0000 7f2409e3d700 1 -- start start 2023-12-11T20:14:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2409e3d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2404101620 0x7f240419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2409e3d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2404101fe0 0x7f240419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2409e3d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 0x7f2404199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2409e3d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404199fc0 con 0x7f24041065a0 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2409e3d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240419a130 con 0x7f2404101620 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2409e3d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240419a2f0 con 0x7f2404101fe0 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2403fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 0x7f2404199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2403fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 0x7f2404199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44850/0 (socket says 172.21.15.12:44850) 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2403fff700 1 -- 172.21.15.12:0/2074994920 learned_addr learned my addr 172.21.15.12:0/2074994920 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f24037fe700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2404101620 0x7f240419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2402ffd700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2404101fe0 0x7f240419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2403fff700 1 -- 172.21.15.12:0/2074994920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2404101fe0 msgr2=0x7f240419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2403fff700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2404101fe0 0x7f240419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2403fff700 1 -- 172.21.15.12:0/2074994920 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2404101620 msgr2=0x7f240419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.580+0000 7f2403fff700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2404101620 0x7f240419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.581+0000 7f2403fff700 1 -- 172.21.15.12:0/2074994920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40095f0 con 0x7f24041065a0 2023-12-11T20:14:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.581+0000 7f2403fff700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 0x7f2404199960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f23fc007ee0 tx=0x7f23fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.581+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc017070 con 0x7f24041065a0 2023-12-11T20:14:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.581+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23fc00f040 con 0x7f24041065a0 2023-12-11T20:14:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.581+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240419a5d0 con 0x7f24041065a0 2023-12-11T20:14:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.581+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc005710 con 0x7f24041065a0 2023-12-11T20:14:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.581+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24041a67c0 con 0x7f24041065a0 2023-12-11T20:14:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.582+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2404111680 con 0x7f24041065a0 2023-12-11T20:14:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.584+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f23fc005870 con 0x7f24041065a0 2023-12-11T20:14:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.586+0000 7f2400ff9700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f23ec0a1510 0x7f23ec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.586+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f23fc0ccde0 con 0x7f24041065a0 2023-12-11T20:14:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.586+0000 7f24037fe700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f23ec0a1510 0x7f23ec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.586+0000 7f2400ff9700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] conn(0x7f23ec0ab0d0 0x7f23ec0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.586+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 --> [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23ec0adc40 con 0x7f23ec0ab0d0 2023-12-11T20:14:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.586+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23fc0cd150 con 0x7f24041065a0 2023-12-11T20:14:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.586+0000 7f2402ffd700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] conn(0x7f23ec0ab0d0 0x7f23ec0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.587+0000 7f24037fe700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f23ec0a1510 0x7f23ec0a39d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f23f400b5c0 tx=0x7f23f4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.587+0000 7f2402ffd700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] conn(0x7f23ec0ab0d0 0x7f23ec0ad570 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.588+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 <== osd.0 v2:172.21.15.12:6802/3118387286 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f23ec0adc40 con 0x7f23ec0ab0d0 2023-12-11T20:14:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.605+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 --> [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24040ffe60 con 0x7f23ec0ab0d0 2023-12-11T20:14:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.605+0000 7f2400ff9700 1 -- 172.21.15.12:0/2074994920 <== osd.0 v2:172.21.15.12:6802/3118387286 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f24040ffe60 con 0x7f23ec0ab0d0 2023-12-11T20:14:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] conn(0x7f23ec0ab0d0 msgr2=0x7f23ec0ad570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] conn(0x7f23ec0ab0d0 0x7f23ec0ad570 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f23ec0a1510 msgr2=0x7f23ec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f23ec0a1510 0x7f23ec0a39d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f23f400b5c0 tx=0x7f23f4005fb0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 msgr2=0x7f2404199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 --2- 172.21.15.12:0/2074994920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24041065a0 0x7f2404199960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f23fc007ee0 tx=0x7f23fc00d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2403fff700 1 -- 172.21.15.12:0/2074994920 reap_dead start 2023-12-11T20:14:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 shutdown_connections 2023-12-11T20:14:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 >> 172.21.15.12:0/2074994920 conn(0x7f2404078730 msgr2=0x7f24040ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 shutdown_connections 2023-12-11T20:14:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:20.606+0000 7f2409e3d700 1 -- 172.21.15.12:0/2074994920 wait complete. 2023-12-11T20:14:22.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:22 smithi012 ceph-mon[128787]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-11T20:14:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:22 smithi032 ceph-mon[132488]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-11T20:14:22.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:22 smithi039 ceph-mon[102205]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 -- 172.21.15.12:0/2255963841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24102040 msgr2=0x7fbe2410e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 --2- 172.21.15.12:0/2255963841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24102040 0x7fbe2410e430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b0a0 tx=0x7fbe1c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 -- 172.21.15.12:0/2255963841 shutdown_connections 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 --2- 172.21.15.12:0/2255963841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24102040 0x7fbe2410e430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 --2- 172.21.15.12:0/2255963841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe241076f0 0x7fbe24107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 --2- 172.21.15.12:0/2255963841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe24101680 0x7fbe24101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 -- 172.21.15.12:0/2255963841 >> 172.21.15.12:0/2255963841 conn(0x7fbe240787c0 msgr2=0x7fbe24078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 -- 172.21.15.12:0/2255963841 shutdown_connections 2023-12-11T20:14:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.426+0000 7fbe2c67b700 1 -- 172.21.15.12:0/2255963841 wait complete. 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.427+0000 7fbe2c67b700 1 Processor -- start 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.427+0000 7fbe2c67b700 1 -- start start 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2c67b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24101680 0x7fbe240738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2c67b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe24102040 0x7fbe24073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2c67b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe241076f0 0x7fbe24074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2c67b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241a5cf0 con 0x7fbe24101680 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2c67b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241a5e60 con 0x7fbe24102040 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2c67b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241a6020 con 0x7fbe241076f0 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2a417700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24101680 0x7fbe240738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2a417700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24101680 0x7fbe240738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44868/0 (socket says 172.21.15.12:44868) 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2a417700 1 -- 172.21.15.12:0/3591309370 learned_addr learned my addr 172.21.15.12:0/3591309370 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2ac18700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe241076f0 0x7fbe24074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe29c16700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe24102040 0x7fbe24073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:22.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.428+0000 7fbe2a417700 1 -- 172.21.15.12:0/3591309370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe241076f0 msgr2=0x7fbe24074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe2a417700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe241076f0 0x7fbe24074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe2a417700 1 -- 172.21.15.12:0/3591309370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe24102040 msgr2=0x7fbe24073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe2a417700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe24102040 0x7fbe24073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe2a417700 1 -- 172.21.15.12:0/3591309370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009d00 con 0x7fbe24101680 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe2a417700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24101680 0x7fbe240738d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000e9a0 tx=0x7fbe2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20009790 con 0x7fbe24101680 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe2000cbd0 con 0x7fbe24101680 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe241a6300 con 0x7fbe24101680 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20018680 con 0x7fbe24101680 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.429+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe241a67b0 con 0x7fbe24101680 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.430+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe24111640 con 0x7fbe24101680 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.432+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fbe2000cd40 con 0x7fbe24101680 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.434+0000 7fbe1b7fe700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe100a1510 0x7fbe100a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.434+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fbe20014070 con 0x7fbe24101680 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.434+0000 7fbe29c16700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe100a1510 0x7fbe100a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.434+0000 7fbe1b7fe700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] conn(0x7fbe100ab0d0 0x7fbe100ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.434+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 --> [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe100adc40 con 0x7fbe100ab0d0 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.434+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe200cd960 con 0x7fbe24101680 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.434+0000 7fbe29c16700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe100a1510 0x7fbe100a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe14005950 tx=0x7fbe140058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.435+0000 7fbe2ac18700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] conn(0x7fbe100ab0d0 0x7fbe100ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.435+0000 7fbe2ac18700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] conn(0x7fbe100ab0d0 0x7fbe100ad570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.436+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 <== osd.10 v2:172.21.15.32:6824/2249244334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbe100adc40 con 0x7fbe100ab0d0 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.454+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 --> [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe24102d10 con 0x7fbe100ab0d0 2023-12-11T20:14:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.455+0000 7fbe1b7fe700 1 -- 172.21.15.12:0/3591309370 <== osd.10 v2:172.21.15.32:6824/2249244334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbe24102d10 con 0x7fbe100ab0d0 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.455+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 >> [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] conn(0x7fbe100ab0d0 msgr2=0x7fbe100ad570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.455+0000 7fbe2c67b700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] conn(0x7fbe100ab0d0 0x7fbe100ad570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.455+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe100a1510 msgr2=0x7fbe100a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.455+0000 7fbe2c67b700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe100a1510 0x7fbe100a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe14005950 tx=0x7fbe140058e0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.455+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24101680 msgr2=0x7fbe240738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.455+0000 7fbe2c67b700 1 --2- 172.21.15.12:0/3591309370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe24101680 0x7fbe240738d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000e9a0 tx=0x7fbe2000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.455+0000 7fbe2ac18700 1 -- 172.21.15.12:0/3591309370 reap_dead start 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.456+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 shutdown_connections 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.456+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 >> 172.21.15.12:0/3591309370 conn(0x7fbe240787c0 msgr2=0x7fbe24100360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.456+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 shutdown_connections 2023-12-11T20:14:22.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:21.456+0000 7fbe2c67b700 1 -- 172.21.15.12:0/3591309370 wait complete. 2023-12-11T20:14:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.240+0000 7fd9fc06c700 1 -- 172.21.15.12:0/2676909086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f410fd70 msgr2=0x7fd9f41085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.240+0000 7fd9fc06c700 1 --2- 172.21.15.12:0/2676909086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f410fd70 0x7fd9f41085d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40099c0 tx=0x7fd9e4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.240+0000 7fd9fc06c700 1 -- 172.21.15.12:0/2676909086 shutdown_connections 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.240+0000 7fd9fc06c700 1 --2- 172.21.15.12:0/2676909086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f411adb0 0x7fd9f411d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.240+0000 7fd9fc06c700 1 --2- 172.21.15.12:0/2676909086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f410fd70 0x7fd9f41085d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.241+0000 7fd9fc06c700 1 --2- 172.21.15.12:0/2676909086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f4108b10 0x7fd9f4108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.241+0000 7fd9fc06c700 1 -- 172.21.15.12:0/2676909086 >> 172.21.15.12:0/2676909086 conn(0x7fd9f406c6a0 msgr2=0x7fd9f406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.241+0000 7fd9fc06c700 1 -- 172.21.15.12:0/2676909086 shutdown_connections 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.241+0000 7fd9fc06c700 1 -- 172.21.15.12:0/2676909086 wait complete. 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.243+0000 7fd9fc06c700 1 Processor -- start 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.244+0000 7fd9fc06c700 1 -- start start 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.244+0000 7fd9fc06c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f4108b10 0x7fd9f41a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.244+0000 7fd9fc06c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f410fd70 0x7fd9f41a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.244+0000 7fd9fc06c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f411adb0 0x7fd9f41a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.244+0000 7fd9fc06c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41aa5d0 con 0x7fd9f411adb0 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.244+0000 7fd9fc06c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41aa740 con 0x7fd9f4108b10 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.244+0000 7fd9fc06c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41aa900 con 0x7fd9f410fd70 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9e08700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f4108b10 0x7fd9f41a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9e08700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f4108b10 0x7fd9f41a6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:55844/0 (socket says 172.21.15.12:55844) 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9e08700 1 -- 172.21.15.12:0/315735820 learned_addr learned my addr 172.21.15.12:0/315735820 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9607700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f410fd70 0x7fd9f41a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9fa609700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f411adb0 0x7fd9f41a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9e08700 1 -- 172.21.15.12:0/315735820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f410fd70 msgr2=0x7fd9f41a6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9e08700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f410fd70 0x7fd9f41a6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9e08700 1 -- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f411adb0 msgr2=0x7fd9f41a9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9e08700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f411adb0 0x7fd9f41a9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9f9e08700 1 -- 172.21.15.12:0/315735820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40095f0 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.245+0000 7fd9fa609700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f411adb0 0x7fd9f41a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.246+0000 7fd9f9e08700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f4108b10 0x7fd9f41a6790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009fd0 tx=0x7fd9e4009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.247+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e401c070 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.247+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f41aab80 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.247+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9e400fc70 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.247+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4022ce0 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.247+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f4112770 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.248+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9f4120540 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.251+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fd9e4020070 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.253+0000 7fd9eaffd700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15d0 0x7fd9e00a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.253+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fd9e4022e40 con 0x7fd9f4108b10 2023-12-11T20:14:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.253+0000 7fd9eaffd700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] conn(0x7fd9e00ab190 0x7fd9e00ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.253+0000 7fd9f9607700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15d0 0x7fd9e00a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.253+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 --> [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9e00add00 con 0x7fd9e00ab190 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.253+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9e40ce1f0 con 0x7fd9f4108b10 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.254+0000 7fd9fa609700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] conn(0x7fd9e00ab190 0x7fd9e00ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.254+0000 7fd9f9607700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15d0 0x7fd9e00a3a90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd9f41a7cf0 tx=0x7fd9f0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.255+0000 7fd9fa609700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] conn(0x7fd9e00ab190 0x7fd9e00ad630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.257+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 <== osd.9 v2:172.21.15.12:6826/3572865206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd9e00add00 con 0x7fd9e00ab190 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.289+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 --> [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9f406dc70 con 0x7fd9e00ab190 2023-12-11T20:14:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.291+0000 7fd9eaffd700 1 -- 172.21.15.12:0/315735820 <== osd.9 v2:172.21.15.12:6826/3572865206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd9f406dc70 con 0x7fd9e00ab190 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.291+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] conn(0x7fd9e00ab190 msgr2=0x7fd9e00ad630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.291+0000 7fd9fc06c700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] conn(0x7fd9e00ab190 0x7fd9e00ad630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15d0 msgr2=0x7fd9e00a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fc06c700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15d0 0x7fd9e00a3a90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd9f41a7cf0 tx=0x7fd9f0009260 comp rx=0 tx=0).stop 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f4108b10 msgr2=0x7fd9f41a6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fc06c700 1 --2- 172.21.15.12:0/315735820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f4108b10 0x7fd9f41a6790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009fd0 tx=0x7fd9e4009580 comp rx=0 tx=0).stop 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fa609700 1 -- 172.21.15.12:0/315735820 reap_dead start 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 shutdown_connections 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 >> 172.21.15.12:0/315735820 conn(0x7fd9f406c6a0 msgr2=0x7fd9f4118da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 shutdown_connections 2023-12-11T20:14:23.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:23.295+0000 7fd9fc06c700 1 -- 172.21.15.12:0/315735820 wait complete. 2023-12-11T20:14:24.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:24 smithi012 ceph-mon[128787]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-11T20:14:24.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:24 smithi032 ceph-mon[132488]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-11T20:14:24.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:24 smithi039 ceph-mon[102205]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2023-12-11T20:14:24.780 INFO:teuthology.orchestra.run.smithi012.stdout:34359738448 2023-12-11T20:14:24.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-11T20:14:24.942 INFO:teuthology.orchestra.run.smithi012.stdout:309237645338 2023-12-11T20:14:24.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.10 2023-12-11T20:14:25.348 INFO:teuthology.orchestra.run.smithi012.stdout:287762808863 2023-12-11T20:14:25.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.9 2023-12-11T20:14:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.496+0000 7f33f7fd5700 1 -- 172.21.15.12:0/1162106155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0069b80 msgr2=0x7f33f01061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.496+0000 7f33f7fd5700 1 --2- 172.21.15.12:0/1162106155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0069b80 0x7f33f01061b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009990 tx=0x7f33e0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.497+0000 7f33f7fd5700 1 -- 172.21.15.12:0/1162106155 shutdown_connections 2023-12-11T20:14:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.497+0000 7f33f7fd5700 1 --2- 172.21.15.12:0/1162106155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33f00691d0 0x7f33f00695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.497+0000 7f33f7fd5700 1 --2- 172.21.15.12:0/1162106155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0106890 0x7f33f010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.497+0000 7f33f7fd5700 1 --2- 172.21.15.12:0/1162106155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0069b80 0x7f33f01061b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.497+0000 7f33f7fd5700 1 -- 172.21.15.12:0/1162106155 >> 172.21.15.12:0/1162106155 conn(0x7f33f0076570 msgr2=0x7f33f0076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.500+0000 7f33f7fd5700 1 -- 172.21.15.12:0/1162106155 shutdown_connections 2023-12-11T20:14:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.500+0000 7f33f7fd5700 1 -- 172.21.15.12:0/1162106155 wait complete. 2023-12-11T20:14:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.501+0000 7f33f7fd5700 1 Processor -- start 2023-12-11T20:14:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.502+0000 7f33f7fd5700 1 -- start start 2023-12-11T20:14:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.502+0000 7f33f7fd5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33f00691d0 0x7f33f019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.502+0000 7f33f7fd5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0069b80 0x7f33f019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.502+0000 7f33f7fd5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0106890 0x7f33f0199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.502+0000 7f33f7fd5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f019a0d0 con 0x7f33f0069b80 2023-12-11T20:14:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.502+0000 7f33f7fd5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f019a240 con 0x7f33f00691d0 2023-12-11T20:14:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.502+0000 7f33f7fd5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f019a400 con 0x7f33f0106890 2023-12-11T20:14:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.503+0000 7f33f5d71700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33f00691d0 0x7f33f019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.503+0000 7f33f5d71700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33f00691d0 0x7f33f019f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:55862/0 (socket says 172.21.15.12:55862) 2023-12-11T20:14:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.503+0000 7f33f5d71700 1 -- 172.21.15.12:0/300592514 learned_addr learned my addr 172.21.15.12:0/300592514 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.503+0000 7f33f5570700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0069b80 0x7f33f019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.503+0000 7f33f6572700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0106890 0x7f33f0199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.504+0000 7f33f5570700 1 -- 172.21.15.12:0/300592514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0106890 msgr2=0x7f33f0199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.504+0000 7f33f5570700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0106890 0x7f33f0199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.504+0000 7f33f5570700 1 -- 172.21.15.12:0/300592514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33f00691d0 msgr2=0x7f33f019f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.504+0000 7f33f5570700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33f00691d0 0x7f33f019f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.504+0000 7f33f5570700 1 -- 172.21.15.12:0/300592514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00095f0 con 0x7f33f0069b80 2023-12-11T20:14:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.504+0000 7f33f5570700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0069b80 0x7f33f019fe20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33e00098e0 tx=0x7f33e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.505+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e001d070 con 0x7f33f0069b80 2023-12-11T20:14:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.505+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33e0022470 con 0x7f33f0069b80 2023-12-11T20:14:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.505+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0017650 con 0x7f33f0069b80 2023-12-11T20:14:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.505+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f019a680 con 0x7f33f0069b80 2023-12-11T20:14:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.506+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f019a8d0 con 0x7f33f0069b80 2023-12-11T20:14:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.507+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33f0111690 con 0x7f33f0069b80 2023-12-11T20:14:25.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.511+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f33e00225e0 con 0x7f33f0069b80 2023-12-11T20:14:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.514+0000 7f33e6ffd700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33dc0a16e0 0x7f33dc0a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.514+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f33e00ce790 con 0x7f33f0069b80 2023-12-11T20:14:25.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.515+0000 7f33f5d71700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33dc0a16e0 0x7f33dc0a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.515+0000 7f33e6ffd700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] conn(0x7f33dc0ab2a0 0x7f33dc0ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.516+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 --> [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33dc0ade10 con 0x7f33dc0ab2a0 2023-12-11T20:14:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.516+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33e00ceb40 con 0x7f33f0069b80 2023-12-11T20:14:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.516+0000 7f33f5d71700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33dc0a16e0 0x7f33dc0a3ba0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007c90 tx=0x7f33ec007480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.517+0000 7f33f6572700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] conn(0x7f33dc0ab2a0 0x7f33dc0ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.517+0000 7f33f6572700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] conn(0x7f33dc0ab2a0 0x7f33dc0ad740 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.518+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 <== osd.2 v2:172.21.15.39:6800/2638974966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f33dc0ade10 con 0x7f33dc0ab2a0 2023-12-11T20:14:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.537+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 --> [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33f010d230 con 0x7f33dc0ab2a0 2023-12-11T20:14:25.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.538+0000 7f33e6ffd700 1 -- 172.21.15.12:0/300592514 <== osd.2 v2:172.21.15.39:6800/2638974966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33f010d230 con 0x7f33dc0ab2a0 2023-12-11T20:14:25.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.538+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 >> [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] conn(0x7f33dc0ab2a0 msgr2=0x7f33dc0ad740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.538+0000 7f33f7fd5700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] conn(0x7f33dc0ab2a0 0x7f33dc0ad740 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33dc0a16e0 msgr2=0x7f33dc0a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f7fd5700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33dc0a16e0 0x7f33dc0a3ba0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007c90 tx=0x7f33ec007480 comp rx=0 tx=0).stop 2023-12-11T20:14:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0069b80 msgr2=0x7f33f019fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f7fd5700 1 --2- 172.21.15.12:0/300592514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0069b80 0x7f33f019fe20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33e00098e0 tx=0x7f33e0004730 comp rx=0 tx=0).stop 2023-12-11T20:14:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f6572700 1 -- 172.21.15.12:0/300592514 reap_dead start 2023-12-11T20:14:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 shutdown_connections 2023-12-11T20:14:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 >> 172.21.15.12:0/300592514 conn(0x7f33f0076570 msgr2=0x7f33f010c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 shutdown_connections 2023-12-11T20:14:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.539+0000 7f33f7fd5700 1 -- 172.21.15.12:0/300592514 wait complete. 2023-12-11T20:14:25.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 -- 172.21.15.12:0/1042285011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83f01076f0 msgr2=0x7f83f0107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 --2- 172.21.15.12:0/1042285011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83f01076f0 0x7f83f0107ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0098f0 tx=0x7f83ec009c00 comp rx=0 tx=0).stop 2023-12-11T20:14:25.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 -- 172.21.15.12:0/1042285011 shutdown_connections 2023-12-11T20:14:25.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 --2- 172.21.15.12:0/1042285011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f0102040 0x7f83f010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 --2- 172.21.15.12:0/1042285011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83f01076f0 0x7f83f0107ad0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 --2- 172.21.15.12:0/1042285011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83f0101680 0x7f83f0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 -- 172.21.15.12:0/1042285011 >> 172.21.15.12:0/1042285011 conn(0x7f83f00787c0 msgr2=0x7f83f0078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:25.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 -- 172.21.15.12:0/1042285011 shutdown_connections 2023-12-11T20:14:25.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.593+0000 7f83f7926700 1 -- 172.21.15.12:0/1042285011 wait complete. 2023-12-11T20:14:25.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.594+0000 7f83f7926700 1 Processor -- start 2023-12-11T20:14:25.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.594+0000 7f83f7926700 1 -- start start 2023-12-11T20:14:25.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f7926700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f0101680 0x7f83f019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f7926700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83f0102040 0x7f83f019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f7926700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83f01076f0 0x7f83f0199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f7926700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0199fe0 con 0x7f83f01076f0 2023-12-11T20:14:25.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f7926700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019a150 con 0x7f83f0101680 2023-12-11T20:14:25.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f7926700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019a310 con 0x7f83f0102040 2023-12-11T20:14:25.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f5ec3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83f01076f0 0x7f83f0199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f5ec3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83f01076f0 0x7f83f0199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44928/0 (socket says 172.21.15.12:44928) 2023-12-11T20:14:25.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f5ec3700 1 -- 172.21.15.12:0/620392536 learned_addr learned my addr 172.21.15.12:0/620392536 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:25.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.595+0000 7f83f56c2700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f0101680 0x7f83f019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83f4ec1700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83f0102040 0x7f83f019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83f5ec3700 1 -- 172.21.15.12:0/620392536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83f0102040 msgr2=0x7f83f019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83f5ec3700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83f0102040 0x7f83f019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83f5ec3700 1 -- 172.21.15.12:0/620392536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f0101680 msgr2=0x7f83f019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83f5ec3700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f0101680 0x7f83f019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83f5ec3700 1 -- 172.21.15.12:0/620392536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00095f0 con 0x7f83f01076f0 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83f5ec3700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83f01076f0 0x7f83f0199980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83e8007f10 tx=0x7f83e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e8017070 con 0x7f83f01076f0 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.597+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83e800f040 con 0x7f83f01076f0 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.596+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec009520 con 0x7f83f01076f0 2023-12-11T20:14:25.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.597+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e8005570 con 0x7f83f01076f0 2023-12-11T20:14:25.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.597+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f019a7e0 con 0x7f83f01076f0 2023-12-11T20:14:25.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.598+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83f0111690 con 0x7f83f01076f0 2023-12-11T20:14:25.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.600+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f83e800db20 con 0x7f83f01076f0 2023-12-11T20:14:25.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.601+0000 7f83e67fc700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83dc0a1590 0x7f83dc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.602+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f83e80cc4f0 con 0x7f83f01076f0 2023-12-11T20:14:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.602+0000 7f83f56c2700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83dc0a1590 0x7f83dc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.602+0000 7f83e67fc700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] conn(0x7f83dc0ab150 0x7f83dc0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.602+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 --> [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83dc0adcc0 con 0x7f83dc0ab150 2023-12-11T20:14:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.602+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83e80cead0 con 0x7f83f01076f0 2023-12-11T20:14:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.602+0000 7f83f4ec1700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] conn(0x7f83dc0ab150 0x7f83dc0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:25.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.603+0000 7f83f56c2700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83dc0a1590 0x7f83dc0a3a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0098c0 tx=0x7f83ec019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:25.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.603+0000 7f83f4ec1700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] conn(0x7f83dc0ab150 0x7f83dc0ad5f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:25.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.604+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 <== osd.6 v2:172.21.15.12:6818/1028787749 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f83dc0adcc0 con 0x7f83dc0ab150 2023-12-11T20:14:25.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.621+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 --> [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83f0061c50 con 0x7f83dc0ab150 2023-12-11T20:14:25.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.621+0000 7f83e67fc700 1 -- 172.21.15.12:0/620392536 <== osd.6 v2:172.21.15.12:6818/1028787749 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f83f0061c50 con 0x7f83dc0ab150 2023-12-11T20:14:25.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] conn(0x7f83dc0ab150 msgr2=0x7f83dc0ad5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] conn(0x7f83dc0ab150 0x7f83dc0ad5f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83dc0a1590 msgr2=0x7f83dc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83dc0a1590 0x7f83dc0a3a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0098c0 tx=0x7f83ec019040 comp rx=0 tx=0).stop 2023-12-11T20:14:25.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83f01076f0 msgr2=0x7f83f0199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 --2- 172.21.15.12:0/620392536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83f01076f0 0x7f83f0199980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83e8007f10 tx=0x7f83e800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f5ec3700 1 -- 172.21.15.12:0/620392536 reap_dead start 2023-12-11T20:14:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 shutdown_connections 2023-12-11T20:14:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 >> 172.21.15.12:0/620392536 conn(0x7f83f00787c0 msgr2=0x7f83f010cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 shutdown_connections 2023-12-11T20:14:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:25.622+0000 7f83f7926700 1 -- 172.21.15.12:0/620392536 wait complete. 2023-12-11T20:14:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 -- 172.21.15.12:0/2818153110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 msgr2=0x7f996810e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 --2- 172.21.15.12:0/2818153110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 0x7f996810e430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f996000b0a0 tx=0x7f996000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 -- 172.21.15.12:0/2818153110 shutdown_connections 2023-12-11T20:14:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 --2- 172.21.15.12:0/2818153110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99681076f0 0x7f9968107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 --2- 172.21.15.12:0/2818153110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 0x7f996810e430 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 --2- 172.21.15.12:0/2818153110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9968101680 0x7f9968101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 -- 172.21.15.12:0/2818153110 >> 172.21.15.12:0/2818153110 conn(0x7f99680787c0 msgr2=0x7f9968078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 -- 172.21.15.12:0/2818153110 shutdown_connections 2023-12-11T20:14:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.194+0000 7f996dbd2700 1 -- 172.21.15.12:0/2818153110 wait complete. 2023-12-11T20:14:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.195+0000 7f996dbd2700 1 Processor -- start 2023-12-11T20:14:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.195+0000 7f996dbd2700 1 -- start start 2023-12-11T20:14:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f996dbd2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9968101680 0x7f996819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f996dbd2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 0x7f996819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f996dbd2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99681076f0 0x7f99681998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f996dbd2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996819a090 con 0x7f9968102040 2023-12-11T20:14:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f996dbd2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996819a200 con 0x7f9968101680 2023-12-11T20:14:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f996dbd2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996819a3c0 con 0x7f99681076f0 2023-12-11T20:14:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9966ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 0x7f996819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9966ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 0x7f996819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44952/0 (socket says 172.21.15.12:44952) 2023-12-11T20:14:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9966ffd700 1 -- 172.21.15.12:0/2882792969 learned_addr learned my addr 172.21.15.12:0/2882792969 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f99677fe700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9968101680 0x7f996819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9967fff700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99681076f0 0x7f99681998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:26.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9966ffd700 1 -- 172.21.15.12:0/2882792969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99681076f0 msgr2=0x7f99681998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:26.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9966ffd700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99681076f0 0x7f99681998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:26.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9966ffd700 1 -- 172.21.15.12:0/2882792969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9968101680 msgr2=0x7f996819f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:26.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9966ffd700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9968101680 0x7f996819f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:26.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.196+0000 7f9966ffd700 1 -- 172.21.15.12:0/2882792969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960009d00 con 0x7f9968102040 2023-12-11T20:14:26.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.197+0000 7f9966ffd700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 0x7f996819fd70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f995c00e9a0 tx=0x7f995c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.197+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c009790 con 0x7f9968102040 2023-12-11T20:14:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.197+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f995c00cbd0 con 0x7f9968102040 2023-12-11T20:14:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.197+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c018680 con 0x7f9968102040 2023-12-11T20:14:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.197+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996819a6a0 con 0x7f9968102040 2023-12-11T20:14:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.197+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99681a67b0 con 0x7f9968102040 2023-12-11T20:14:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.198+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9968111640 con 0x7f9968102040 2023-12-11T20:14:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.200+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f995c00cd40 con 0x7f9968102040 2023-12-11T20:14:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.201+0000 7f9964ff9700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f99500a1590 0x7f99500a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.202+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f995c014070 con 0x7f9968102040 2023-12-11T20:14:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.202+0000 7f99677fe700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f99500a1590 0x7f99500a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.202+0000 7f9964ff9700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] conn(0x7f99500ab150 0x7f99500ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.202+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 --> [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99500adcc0 con 0x7f99500ab150 2023-12-11T20:14:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.202+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f995c0cd780 con 0x7f9968102040 2023-12-11T20:14:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.202+0000 7f9967fff700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] conn(0x7f99500ab150 0x7f99500ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.202+0000 7f99677fe700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f99500a1590 0x7f99500a3a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9958005ea0 tx=0x7f9958005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.203+0000 7f9967fff700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] conn(0x7f99500ab150 0x7f99500ad5f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:26.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.204+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 <== osd.5 v2:172.21.15.39:6808/1408420882 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f99500adcc0 con 0x7f99500ab150 2023-12-11T20:14:26.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.222+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 --> [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9968100a90 con 0x7f99500ab150 2023-12-11T20:14:26.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f9964ff9700 1 -- 172.21.15.12:0/2882792969 <== osd.5 v2:172.21.15.39:6808/1408420882 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9968100a90 con 0x7f99500ab150 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 >> [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] conn(0x7f99500ab150 msgr2=0x7f99500ad5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] conn(0x7f99500ab150 0x7f99500ad5f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f99500a1590 msgr2=0x7f99500a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f99500a1590 0x7f99500a3a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9958005ea0 tx=0x7f9958005e30 comp rx=0 tx=0).stop 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 msgr2=0x7f996819fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 --2- 172.21.15.12:0/2882792969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9968102040 0x7f996819fd70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f995c00e9a0 tx=0x7f995c00ed60 comp rx=0 tx=0).stop 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f9967fff700 1 -- 172.21.15.12:0/2882792969 reap_dead start 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 shutdown_connections 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 >> 172.21.15.12:0/2882792969 conn(0x7f99680787c0 msgr2=0x7f99681000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:26.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 shutdown_connections 2023-12-11T20:14:26.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:26.223+0000 7f996dbd2700 1 -- 172.21.15.12:0/2882792969 wait complete. 2023-12-11T20:14:26.359 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:26 smithi012 ceph-mon[128787]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-11T20:14:26.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:26 smithi032 ceph-mon[132488]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-11T20:14:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:26 smithi039 ceph-mon[102205]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-12-11T20:14:27.228 INFO:teuthology.orchestra.run.smithi012.stdout:197568495664 2023-12-11T20:14:27.228 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.6 2023-12-11T20:14:27.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.260+0000 7feccfed4700 1 -- 172.21.15.12:0/2586642559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 msgr2=0x7fecc8107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.260+0000 7feccfed4700 1 --2- 172.21.15.12:0/2586642559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 0x7fecc8107a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fecc40099c0 tx=0x7fecc4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.260+0000 7feccfed4700 1 -- 172.21.15.12:0/2586642559 shutdown_connections 2023-12-11T20:14:27.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.260+0000 7feccfed4700 1 --2- 172.21.15.12:0/2586642559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecc8069930 0x7fecc810e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.260+0000 7feccfed4700 1 --2- 172.21.15.12:0/2586642559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 0x7fecc8107a00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.260+0000 7feccfed4700 1 --2- 172.21.15.12:0/2586642559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecc8068f70 0x7fecc80693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.260+0000 7feccfed4700 1 -- 172.21.15.12:0/2586642559 >> 172.21.15.12:0/2586642559 conn(0x7fecc8076570 msgr2=0x7fecc8076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:27.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.261+0000 7feccfed4700 1 -- 172.21.15.12:0/2586642559 shutdown_connections 2023-12-11T20:14:27.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.262+0000 7feccfed4700 1 -- 172.21.15.12:0/2586642559 wait complete. 2023-12-11T20:14:27.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.263+0000 7feccfed4700 1 Processor -- start 2023-12-11T20:14:27.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.264+0000 7feccfed4700 1 -- start start 2023-12-11T20:14:27.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.264+0000 7feccfed4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecc8068f70 0x7fecc819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.264+0000 7feccfed4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecc8069930 0x7fecc819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.264+0000 7feccfed4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 0x7fecc81999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.264+0000 7feccfed4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc819a040 con 0x7fecc8107620 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.264+0000 7feccfed4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc819a1b0 con 0x7fecc8068f70 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.264+0000 7feccfed4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc819a370 con 0x7fecc8069930 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7fecce471700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 0x7fecc81999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7feccdc70700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecc8068f70 0x7fecc819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7fecce471700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 0x7fecc81999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44978/0 (socket says 172.21.15.12:44978) 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7fecce471700 1 -- 172.21.15.12:0/1471820017 learned_addr learned my addr 172.21.15.12:0/1471820017 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:27.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7feccd46f700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecc8069930 0x7fecc819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7feccdc70700 1 -- 172.21.15.12:0/1471820017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecc8069930 msgr2=0x7fecc819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7feccdc70700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecc8069930 0x7fecc819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7feccdc70700 1 -- 172.21.15.12:0/1471820017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 msgr2=0x7fecc81999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7feccdc70700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 0x7fecc81999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7feccdc70700 1 -- 172.21.15.12:0/1471820017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40095f0 con 0x7fecc8068f70 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.265+0000 7fecce471700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc8107620 0x7fecc81999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.266+0000 7feccdc70700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecc8068f70 0x7fecc819f8a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009f50 tx=0x7fecc4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.266+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc401d070 con 0x7fecc8068f70 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.266+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecc400fb80 con 0x7fecc8068f70 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.266+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4022be0 con 0x7fecc8068f70 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.266+0000 7feccfed4700 1 -- 172.21.15.12:0/1471820017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc819a5f0 con 0x7fecc8068f70 2023-12-11T20:14:27.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.266+0000 7feccfed4700 1 -- 172.21.15.12:0/1471820017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc806b1c0 con 0x7fecc8068f70 2023-12-11T20:14:27.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.268+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecc81116a0 con 0x7fecc8068f70 2023-12-11T20:14:27.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.270+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fecc400fcf0 con 0x7fecc8068f70 2023-12-11T20:14:27.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.273+0000 7fecbeffd700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fecb40a1590 0x7fecb40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.273+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fecc40ce320 con 0x7fecc8068f70 2023-12-11T20:14:27.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.273+0000 7fecbeffd700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] conn(0x7fecb40ab150 0x7fecb40ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.273+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 --> [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecb40adcc0 con 0x7fecb40ab150 2023-12-11T20:14:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.273+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecc40ce690 con 0x7fecc8068f70 2023-12-11T20:14:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.274+0000 7feccd46f700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fecb40a1590 0x7fecb40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.274+0000 7fecce471700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] conn(0x7fecb40ab150 0x7fecb40ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.274+0000 7feccd46f700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fecb40a1590 0x7fecb40a3a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fecc819aba0 tx=0x7fecb800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:27.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.274+0000 7fecce471700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] conn(0x7fecb40ab150 0x7fecb40ad5f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:27.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.275+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 <== osd.1 v2:172.21.15.32:6800/1010988585 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fecb40adcc0 con 0x7fecb40ab150 2023-12-11T20:14:27.286 INFO:teuthology.orchestra.run.smithi012.stdout:163208757302 2023-12-11T20:14:27.286 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-11T20:14:27.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.300+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 --> [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecc8061cd0 con 0x7fecb40ab150 2023-12-11T20:14:27.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.300+0000 7fecbeffd700 1 -- 172.21.15.12:0/1471820017 <== osd.1 v2:172.21.15.32:6800/1010988585 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fecc8061cd0 con 0x7fecb40ab150 2023-12-11T20:14:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.301+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 >> [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] conn(0x7fecb40ab150 msgr2=0x7fecb40ad5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.301+0000 7fecbcff9700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] conn(0x7fecb40ab150 0x7fecb40ad5f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.301+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fecb40a1590 msgr2=0x7fecb40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.301+0000 7fecbcff9700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fecb40a1590 0x7fecb40a3a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fecc819aba0 tx=0x7fecb800b410 comp rx=0 tx=0).stop 2023-12-11T20:14:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.301+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecc8068f70 msgr2=0x7fecc819f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.301+0000 7fecbcff9700 1 --2- 172.21.15.12:0/1471820017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecc8068f70 0x7fecc819f8a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009f50 tx=0x7fecc4005740 comp rx=0 tx=0).stop 2023-12-11T20:14:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.301+0000 7fecce471700 1 -- 172.21.15.12:0/1471820017 reap_dead start 2023-12-11T20:14:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.302+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 shutdown_connections 2023-12-11T20:14:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.302+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 >> 172.21.15.12:0/1471820017 conn(0x7fecc8076570 msgr2=0x7fecc810c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.302+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 shutdown_connections 2023-12-11T20:14:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.302+0000 7fecbcff9700 1 -- 172.21.15.12:0/1471820017 wait complete. 2023-12-11T20:14:27.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.673+0000 7f967935b700 1 -- 172.21.15.12:0/3020125011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9674109620 msgr2=0x7f9674109a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.673+0000 7f967935b700 1 --2- 172.21.15.12:0/3020125011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9674109620 0x7f9674109a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9664009920 tx=0x7f9664009c30 comp rx=0 tx=0).stop 2023-12-11T20:14:27.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.673+0000 7f967935b700 1 -- 172.21.15.12:0/3020125011 shutdown_connections 2023-12-11T20:14:27.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.673+0000 7f967935b700 1 --2- 172.21.15.12:0/3020125011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9674103f30 0x7f96741103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.673+0000 7f967935b700 1 --2- 172.21.15.12:0/3020125011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9674109620 0x7f9674109a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.673+0000 7f967935b700 1 --2- 172.21.15.12:0/3020125011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9674103570 0x7f96741039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.673+0000 7f967935b700 1 -- 172.21.15.12:0/3020125011 >> 172.21.15.12:0/3020125011 conn(0x7f96740ff000 msgr2=0x7f9674101420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:27.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.674+0000 7f967935b700 1 -- 172.21.15.12:0/3020125011 shutdown_connections 2023-12-11T20:14:27.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.675+0000 7f967935b700 1 -- 172.21.15.12:0/3020125011 wait complete. 2023-12-11T20:14:27.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.676+0000 7f967935b700 1 Processor -- start 2023-12-11T20:14:27.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.676+0000 7f967935b700 1 -- start start 2023-12-11T20:14:27.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f967935b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9674103570 0x7f9674075ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f967935b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9674103f30 0x7f9674076020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f967935b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9674109620 0x7f9674076560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f967935b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96741a9ff0 con 0x7f9674109620 2023-12-11T20:14:27.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f967935b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96741aa130 con 0x7f9674103570 2023-12-11T20:14:27.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f967935b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96741aa270 con 0x7f9674103f30 2023-12-11T20:14:27.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f96737fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9674103f30 0x7f9674076020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f96737fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9674103f30 0x7f9674076020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48718/0 (socket says 172.21.15.12:48718) 2023-12-11T20:14:27.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.677+0000 7f96737fe700 1 -- 172.21.15.12:0/2112075910 learned_addr learned my addr 172.21.15.12:0/2112075910 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:27.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.678+0000 7f9678b5a700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9674109620 0x7f9674076560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.678+0000 7f9673fff700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9674103570 0x7f9674075ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.678+0000 7f9678b5a700 1 -- 172.21.15.12:0/2112075910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9674103f30 msgr2=0x7f9674076020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.678+0000 7f9678b5a700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9674103f30 0x7f9674076020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.678+0000 7f9678b5a700 1 -- 172.21.15.12:0/2112075910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9674103570 msgr2=0x7f9674075ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.678+0000 7f9678b5a700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9674103570 0x7f9674075ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.678+0000 7f9678b5a700 1 -- 172.21.15.12:0/2112075910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9664009520 con 0x7f9674109620 2023-12-11T20:14:27.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.678+0000 7f9673fff700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9674103570 0x7f9674075ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:27.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.679+0000 7f9678b5a700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9674109620 0x7f9674076560 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f966c00efc0 tx=0x7f966c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:27.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.679+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c018070 con 0x7f9674109620 2023-12-11T20:14:27.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.679+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f966c00f040 con 0x7f9674109620 2023-12-11T20:14:27.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.679+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96741aa4f0 con 0x7f9674109620 2023-12-11T20:14:27.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.679+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c00cc50 con 0x7f9674109620 2023-12-11T20:14:27.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.680+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96741aa9f0 con 0x7f9674109620 2023-12-11T20:14:27.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.681+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9674113650 con 0x7f9674109620 2023-12-11T20:14:27.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.685+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f966c007500 con 0x7f9674109620 2023-12-11T20:14:27.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.686+0000 7f96717fa700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f965c0a1590 0x7f965c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.686+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f966c0cc950 con 0x7f9674109620 2023-12-11T20:14:27.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.687+0000 7f96717fa700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] conn(0x7f965c0ab150 0x7f965c0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:27.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.687+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 --> [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f965c0adcc0 con 0x7f965c0ab150 2023-12-11T20:14:27.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.687+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f966c0d12c0 con 0x7f9674109620 2023-12-11T20:14:27.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.687+0000 7f9673fff700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f965c0a1590 0x7f965c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.687+0000 7f96737fe700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] conn(0x7f965c0ab150 0x7f965c0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:27.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.688+0000 7f96737fe700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] conn(0x7f965c0ab150 0x7f965c0ad5f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:27.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.688+0000 7f9673fff700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f965c0a1590 0x7f965c0a3a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9664005e90 tx=0x7f9664019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:27.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.689+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 <== osd.3 v2:172.21.15.12:6810/2780370696 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f965c0adcc0 con 0x7f965c0ab150 2023-12-11T20:14:27.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.709+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 --> [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9674104c90 con 0x7f965c0ab150 2023-12-11T20:14:27.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.710+0000 7f96717fa700 1 -- 172.21.15.12:0/2112075910 <== osd.3 v2:172.21.15.12:6810/2780370696 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9674104c90 con 0x7f965c0ab150 2023-12-11T20:14:27.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] conn(0x7f965c0ab150 msgr2=0x7f965c0ad5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f967935b700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] conn(0x7f965c0ab150 0x7f965c0ad5f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f965c0a1590 msgr2=0x7f965c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f967935b700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f965c0a1590 0x7f965c0a3a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9664005e90 tx=0x7f9664019040 comp rx=0 tx=0).stop 2023-12-11T20:14:27.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9674109620 msgr2=0x7f9674076560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:27.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f967935b700 1 --2- 172.21.15.12:0/2112075910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9674109620 0x7f9674076560 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f966c00efc0 tx=0x7f966c00c3a0 comp rx=0 tx=0).stop 2023-12-11T20:14:27.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f9678b5a700 1 -- 172.21.15.12:0/2112075910 reap_dead start 2023-12-11T20:14:27.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 shutdown_connections 2023-12-11T20:14:27.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.711+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 >> 172.21.15.12:0/2112075910 conn(0x7f96740ff000 msgr2=0x7f96741009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:27.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.714+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 shutdown_connections 2023-12-11T20:14:27.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.714+0000 7f967935b700 1 -- 172.21.15.12:0/2112075910 wait complete. 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 -- 172.21.15.12:0/505545837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95241076f0 msgr2=0x7f9524107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 --2- 172.21.15.12:0/505545837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95241076f0 0x7f9524107ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9514009990 tx=0x7f9514009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 -- 172.21.15.12:0/505545837 shutdown_connections 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 --2- 172.21.15.12:0/505545837 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524102040 0x7f952410e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 --2- 172.21.15.12:0/505545837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95241076f0 0x7f9524107ad0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 --2- 172.21.15.12:0/505545837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9524101680 0x7f9524101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 -- 172.21.15.12:0/505545837 >> 172.21.15.12:0/505545837 conn(0x7f95240787c0 msgr2=0x7f9524078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 -- 172.21.15.12:0/505545837 shutdown_connections 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.873+0000 7f952a8d1700 1 -- 172.21.15.12:0/505545837 wait complete. 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.874+0000 7f952a8d1700 1 Processor -- start 2023-12-11T20:14:28.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.874+0000 7f952a8d1700 1 -- start start 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.874+0000 7f952a8d1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9524101680 0x7f9524199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.874+0000 7f952a8d1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524102040 0x7f9524199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.874+0000 7f952a8d1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95241076f0 0x7f952419e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.874+0000 7f952a8d1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419e930 con 0x7f9524101680 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.874+0000 7f952a8d1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419eaa0 con 0x7f9524102040 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.874+0000 7f952a8d1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419ec60 con 0x7f95241076f0 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9524101680 0x7f9524199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f95237fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524102040 0x7f9524199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9524101680 0x7f9524199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45022/0 (socket says 172.21.15.12:45022) 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 -- 172.21.15.12:0/2684987747 learned_addr learned my addr 172.21.15.12:0/2684987747 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9528e6e700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95241076f0 0x7f952419e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 -- 172.21.15.12:0/2684987747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95241076f0 msgr2=0x7f952419e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95241076f0 0x7f952419e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 -- 172.21.15.12:0/2684987747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524102040 msgr2=0x7f9524199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524102040 0x7f9524199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 -- 172.21.15.12:0/2684987747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140095f0 con 0x7f9524101680 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f95237fe700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9524102040 0x7f9524199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.875+0000 7f9523fff700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9524101680 0x7f9524199a40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f95140036c0 tx=0x7f9514004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.876+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951401d070 con 0x7f9524101680 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.876+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f951400fb00 con 0x7f9524101680 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.876+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514021b30 con 0x7f9524101680 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.876+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952419eee0 con 0x7f9524101680 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.876+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95241a6610 con 0x7f9524101680 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.877+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9524111690 con 0x7f9524101680 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.879+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f951400fc70 con 0x7f9524101680 2023-12-11T20:14:28.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.880+0000 7f95217fa700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1590 0x7f950c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.880+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f95140ce5b0 con 0x7f9524101680 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.880+0000 7f95237fe700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1590 0x7f950c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.880+0000 7f95217fa700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] conn(0x7f950c0ab010 0x7f950c0ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.880+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 --> [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f950c0adb80 con 0x7f950c0ab010 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.881+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95140ce920 con 0x7f9524101680 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.881+0000 7f95237fe700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1590 0x7f950c0a3a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f952419afa0 tx=0x7f951800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.881+0000 7f9528e6e700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] conn(0x7f950c0ab010 0x7f950c0ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.882+0000 7f9528e6e700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] conn(0x7f950c0ab010 0x7f950c0ad4b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.883+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 <== osd.7 v2:172.21.15.32:6816/1475605108 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f950c0adb80 con 0x7f950c0ab010 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.904+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 --> [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9524102d10 con 0x7f950c0ab010 2023-12-11T20:14:28.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.905+0000 7f95217fa700 1 -- 172.21.15.12:0/2684987747 <== osd.7 v2:172.21.15.32:6816/1475605108 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9524102d10 con 0x7f950c0ab010 2023-12-11T20:14:28.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 >> [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] conn(0x7f950c0ab010 msgr2=0x7f950c0ad4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] conn(0x7f950c0ab010 0x7f950c0ad4b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1590 msgr2=0x7f950c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1590 0x7f950c0a3a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f952419afa0 tx=0x7f951800b410 comp rx=0 tx=0).stop 2023-12-11T20:14:28.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9524101680 msgr2=0x7f9524199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 --2- 172.21.15.12:0/2684987747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9524101680 0x7f9524199a40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f95140036c0 tx=0x7f9514004730 comp rx=0 tx=0).stop 2023-12-11T20:14:28.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f9528e6e700 1 -- 172.21.15.12:0/2684987747 reap_dead start 2023-12-11T20:14:28.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 shutdown_connections 2023-12-11T20:14:28.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 >> 172.21.15.12:0/2684987747 conn(0x7f95240787c0 msgr2=0x7f952410caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:28.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 shutdown_connections 2023-12-11T20:14:28.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:27.906+0000 7f952a8d1700 1 -- 172.21.15.12:0/2684987747 wait complete. 2023-12-11T20:14:28.080 INFO:teuthology.orchestra.run.smithi012.stdout:77309411399 2023-12-11T20:14:28.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-11T20:14:28.200 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:28.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.316+0000 7fc98df6c700 1 -- 172.21.15.12:0/4185761371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc988074120 msgr2=0x7fc98810db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.316+0000 7fc98df6c700 1 --2- 172.21.15.12:0/4185761371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc988074120 0x7fc98810db20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009990 tx=0x7fc97c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.317+0000 7fc98df6c700 1 -- 172.21.15.12:0/4185761371 shutdown_connections 2023-12-11T20:14:28.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.317+0000 7fc98df6c700 1 --2- 172.21.15.12:0/4185761371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc98810e060 0x7fc988110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.317+0000 7fc98df6c700 1 --2- 172.21.15.12:0/4185761371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc988073800 0x7fc988073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.317+0000 7fc98df6c700 1 --2- 172.21.15.12:0/4185761371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc988074120 0x7fc98810db20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.317+0000 7fc98df6c700 1 -- 172.21.15.12:0/4185761371 >> 172.21.15.12:0/4185761371 conn(0x7fc9880786b0 msgr2=0x7fc988078ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:28.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.317+0000 7fc98df6c700 1 -- 172.21.15.12:0/4185761371 shutdown_connections 2023-12-11T20:14:28.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.317+0000 7fc98df6c700 1 -- 172.21.15.12:0/4185761371 wait complete. 2023-12-11T20:14:28.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.319+0000 7fc98df6c700 1 Processor -- start 2023-12-11T20:14:28.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.319+0000 7fc98df6c700 1 -- start start 2023-12-11T20:14:28.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc98df6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc988073800 0x7fc98819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc98df6c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc988074120 0x7fc98819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc98df6c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc98810e060 0x7fc9881999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc98df6c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98819a000 con 0x7fc988073800 2023-12-11T20:14:28.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc98df6c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98819a170 con 0x7fc98810e060 2023-12-11T20:14:28.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc98df6c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98819a330 con 0x7fc988074120 2023-12-11T20:14:28.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc9877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc988073800 0x7fc98819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc9877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc988073800 0x7fc98819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45026/0 (socket says 172.21.15.12:45026) 2023-12-11T20:14:28.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc9877fe700 1 -- 172.21.15.12:0/212951025 learned_addr learned my addr 172.21.15.12:0/212951025 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc987fff700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc98810e060 0x7fc9881999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.320+0000 7fc986ffd700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc988074120 0x7fc98819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.321+0000 7fc987fff700 1 -- 172.21.15.12:0/212951025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc988074120 msgr2=0x7fc98819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.321+0000 7fc987fff700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc988074120 0x7fc98819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.321+0000 7fc987fff700 1 -- 172.21.15.12:0/212951025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc988073800 msgr2=0x7fc98819f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.321+0000 7fc987fff700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc988073800 0x7fc98819f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.321+0000 7fc987fff700 1 -- 172.21.15.12:0/212951025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0095f0 con 0x7fc98810e060 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.321+0000 7fc987fff700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc98810e060 0x7fc9881999a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc98000ef90 tx=0x7fc98000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.322+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980018070 con 0x7fc98810e060 2023-12-11T20:14:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.322+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc98000f040 con 0x7fc98810e060 2023-12-11T20:14:28.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.322+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98000cba0 con 0x7fc98810e060 2023-12-11T20:14:28.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.322+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98819a5b0 con 0x7fc98810e060 2023-12-11T20:14:28.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.322+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9881a6850 con 0x7fc98810e060 2023-12-11T20:14:28.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.323+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9881138a0 con 0x7fc98810e060 2023-12-11T20:14:28.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.327+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fc98000cd00 con 0x7fc98810e060 2023-12-11T20:14:28.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.330+0000 7fc984ff9700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9700a1610 0x7fc9700a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.330+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fc9800cd680 con 0x7fc98810e060 2023-12-11T20:14:28.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.331+0000 7fc984ff9700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] conn(0x7fc9700ab1d0 0x7fc9700ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.331+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 --> [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9700add40 con 0x7fc9700ab1d0 2023-12-11T20:14:28.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.331+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9800cda30 con 0x7fc98810e060 2023-12-11T20:14:28.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.331+0000 7fc9877fe700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9700a1610 0x7fc9700a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.332+0000 7fc986ffd700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] conn(0x7fc9700ab1d0 0x7fc9700ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.332+0000 7fc9877fe700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9700a1610 0x7fc9700a3ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc978007c90 tx=0x7fc978007480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.333 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:28 smithi012 ceph-mon[128787]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-11T20:14:28.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.337+0000 7fc986ffd700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] conn(0x7fc9700ab1d0 0x7fc9700ad670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.342+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 <== osd.4 v2:172.21.15.32:6808/773206736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc9700add40 con 0x7fc9700ab1d0 2023-12-11T20:14:28.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.375+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 --> [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc988061cd0 con 0x7fc9700ab1d0 2023-12-11T20:14:28.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.376+0000 7fc984ff9700 1 -- 172.21.15.12:0/212951025 <== osd.4 v2:172.21.15.32:6808/773206736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc988061cd0 con 0x7fc9700ab1d0 2023-12-11T20:14:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.377+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] conn(0x7fc9700ab1d0 msgr2=0x7fc9700ad670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.377+0000 7fc98df6c700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] conn(0x7fc9700ab1d0 0x7fc9700ad670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.377+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9700a1610 msgr2=0x7fc9700a3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.377+0000 7fc98df6c700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9700a1610 0x7fc9700a3ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc978007c90 tx=0x7fc978007480 comp rx=0 tx=0).stop 2023-12-11T20:14:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.377+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc98810e060 msgr2=0x7fc9881999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.377+0000 7fc98df6c700 1 --2- 172.21.15.12:0/212951025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc98810e060 0x7fc9881999a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc98000ef90 tx=0x7fc98000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.378+0000 7fc987fff700 1 -- 172.21.15.12:0/212951025 reap_dead start 2023-12-11T20:14:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.378+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 shutdown_connections 2023-12-11T20:14:28.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.378+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 >> 172.21.15.12:0/212951025 conn(0x7fc9880786b0 msgr2=0x7fc9880fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:28.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.378+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 shutdown_connections 2023-12-11T20:14:28.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.379+0000 7fc98df6c700 1 -- 172.21.15.12:0/212951025 wait complete. 2023-12-11T20:14:28.431 INFO:teuthology.orchestra.run.smithi012.stdout:55834574924 2023-12-11T20:14:28.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-11T20:14:28.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:28 smithi032 ceph-mon[132488]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-11T20:14:28.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:28 smithi039 ceph-mon[102205]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-11T20:14:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.755+0000 7f390a06e700 1 -- 172.21.15.12:0/1990437037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3904073800 msgr2=0x7f3904073be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.755+0000 7f390a06e700 1 --2- 172.21.15.12:0/1990437037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3904073800 0x7f3904073be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009990 tx=0x7f38f4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.756+0000 7f390a06e700 1 -- 172.21.15.12:0/1990437037 shutdown_connections 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.756+0000 7f390a06e700 1 --2- 172.21.15.12:0/1990437037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390410e030 0x7f3904110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.756+0000 7f390a06e700 1 --2- 172.21.15.12:0/1990437037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3904073800 0x7f3904073be0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.756+0000 7f390a06e700 1 --2- 172.21.15.12:0/1990437037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3904074120 0x7f390410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.756+0000 7f390a06e700 1 -- 172.21.15.12:0/1990437037 >> 172.21.15.12:0/1990437037 conn(0x7f39040787c0 msgr2=0x7f3904078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.756+0000 7f390a06e700 1 -- 172.21.15.12:0/1990437037 shutdown_connections 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.756+0000 7f390a06e700 1 -- 172.21.15.12:0/1990437037 wait complete. 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.757+0000 7f390a06e700 1 Processor -- start 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.757+0000 7f390a06e700 1 -- start start 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.757+0000 7f390a06e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3904073800 0x7f390419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.757+0000 7f390a06e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3904074120 0x7f390419fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f390a06e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f390410e030 0x7f3904199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f390a06e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390419a0d0 con 0x7f390410e030 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f390a06e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390419a240 con 0x7f3904074120 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f390a06e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390419a400 con 0x7f3904073800 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3903fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f390410e030 0x7f3904199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f39037fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3904073800 0x7f390419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3903fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f390410e030 0x7f3904199a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45044/0 (socket says 172.21.15.12:45044) 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3903fff700 1 -- 172.21.15.12:0/252718632 learned_addr learned my addr 172.21.15.12:0/252718632 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3902ffd700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3904074120 0x7f390419fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3903fff700 1 -- 172.21.15.12:0/252718632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3904073800 msgr2=0x7f390419f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3903fff700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3904073800 0x7f390419f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3903fff700 1 -- 172.21.15.12:0/252718632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3904074120 msgr2=0x7f390419fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3903fff700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3904074120 0x7f390419fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.758+0000 7f3903fff700 1 -- 172.21.15.12:0/252718632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40095f0 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.759+0000 7f3903fff700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f390410e030 0x7f3904199a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38fc007ee0 tx=0x7f38fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.759+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc004db0 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.759+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38fc00f040 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.759+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390419a6e0 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.759+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0057e0 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.759+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39041a6920 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.760+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39041139d0 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.763+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f38fc005940 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.764+0000 7f3900ff9700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f38ec0a1510 0x7f38ec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.764+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f38fc0cc7c0 con 0x7f390410e030 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.765+0000 7f39037fe700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f38ec0a1510 0x7f38ec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.765+0000 7f3900ff9700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] conn(0x7f38ec0ab0d0 0x7f38ec0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.765+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 --> [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38ec0adc40 con 0x7f38ec0ab0d0 2023-12-11T20:14:28.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.765+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38fc0ceda0 con 0x7f390410e030 2023-12-11T20:14:28.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.765+0000 7f3902ffd700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] conn(0x7f38ec0ab0d0 0x7f38ec0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:28.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.766+0000 7f39037fe700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f38ec0a1510 0x7f38ec0a39d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38f4006010 tx=0x7f38f400b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.766+0000 7f3902ffd700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] conn(0x7f38ec0ab0d0 0x7f38ec0ad570 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:28.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.767+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 <== osd.11 v2:172.21.15.39:6824/1041735400 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f38ec0adc40 con 0x7f38ec0ab0d0 2023-12-11T20:14:28.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.789+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 --> [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3904061c50 con 0x7f38ec0ab0d0 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.789+0000 7f3900ff9700 1 -- 172.21.15.12:0/252718632 <== osd.11 v2:172.21.15.39:6824/1041735400 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3904061c50 con 0x7f38ec0ab0d0 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 >> [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] conn(0x7f38ec0ab0d0 msgr2=0x7f38ec0ad570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] conn(0x7f38ec0ab0d0 0x7f38ec0ad570 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f38ec0a1510 msgr2=0x7f38ec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f38ec0a1510 0x7f38ec0a39d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38f4006010 tx=0x7f38f400b260 comp rx=0 tx=0).stop 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f390410e030 msgr2=0x7f3904199a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 --2- 172.21.15.12:0/252718632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f390410e030 0x7f3904199a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38fc007ee0 tx=0x7f38fc00d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f3903fff700 1 -- 172.21.15.12:0/252718632 reap_dead start 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 shutdown_connections 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 >> 172.21.15.12:0/252718632 conn(0x7f39040787c0 msgr2=0x7f39040fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.790+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 shutdown_connections 2023-12-11T20:14:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:28.791+0000 7f390a06e700 1 -- 172.21.15.12:0/252718632 wait complete. 2023-12-11T20:14:29.073 INFO:teuthology.orchestra.run.smithi012.stdout:219043332140 2023-12-11T20:14:29.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.7 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/2864358008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9c80694b0 msgr2=0x7fa9c8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 --2- 172.21.15.12:0/2864358008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9c80694b0 0x7fa9c8069930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009990 tx=0x7fa9bc009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/2864358008 shutdown_connections 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 --2- 172.21.15.12:0/2864358008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9c81064d0 0x7fa9c8068f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 --2- 172.21.15.12:0/2864358008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c8104030 0x7fa9c81044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 --2- 172.21.15.12:0/2864358008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9c80694b0 0x7fa9c8069930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/2864358008 >> 172.21.15.12:0/2864358008 conn(0x7fa9c8076570 msgr2=0x7fa9c8076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/2864358008 shutdown_connections 2023-12-11T20:14:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.293+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/2864358008 wait complete. 2023-12-11T20:14:29.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.295+0000 7fa9ce7ec700 1 Processor -- start 2023-12-11T20:14:29.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.295+0000 7fa9ce7ec700 1 -- start start 2023-12-11T20:14:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9ce7ec700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9c80694b0 0x7fa9c819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9ce7ec700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c8104030 0x7fa9c819e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9ce7ec700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9c81064d0 0x7fa9c81a2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9ce7ec700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c81a2ea0 con 0x7fa9c8104030 2023-12-11T20:14:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9ce7ec700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c81a3010 con 0x7fa9c80694b0 2023-12-11T20:14:29.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9ce7ec700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c81a31d0 con 0x7fa9c81064d0 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c8104030 0x7fa9c819e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c8104030 0x7fa9c819e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51468/0 (socket says 172.21.15.12:51468) 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9c77fe700 1 -- 172.21.15.12:0/392310327 learned_addr learned my addr 172.21.15.12:0/392310327 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.296+0000 7fa9ccd89700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9c81064d0 0x7fa9c81a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.297+0000 7fa9c7fff700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9c80694b0 0x7fa9c819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.297+0000 7fa9ccd89700 1 -- 172.21.15.12:0/392310327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9c80694b0 msgr2=0x7fa9c819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.297+0000 7fa9ccd89700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9c80694b0 0x7fa9c819dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.297+0000 7fa9ccd89700 1 -- 172.21.15.12:0/392310327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c8104030 msgr2=0x7fa9c819e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.297+0000 7fa9ccd89700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c8104030 0x7fa9c819e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.297+0000 7fa9ccd89700 1 -- 172.21.15.12:0/392310327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc0095f0 con 0x7fa9c81064d0 2023-12-11T20:14:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.297+0000 7fa9ccd89700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9c81064d0 0x7fa9c81a2890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000efc0 tx=0x7fa9c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.298+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0018070 con 0x7fa9c81064d0 2023-12-11T20:14:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.298+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c81a3450 con 0x7fa9c81064d0 2023-12-11T20:14:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.298+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c81aad10 con 0x7fa9c81064d0 2023-12-11T20:14:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.298+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9c000f040 con 0x7fa9c81064d0 2023-12-11T20:14:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.298+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c000cbc0 con 0x7fa9c81064d0 2023-12-11T20:14:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.299+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9b4000fc0 con 0x7fa9c81064d0 2023-12-11T20:14:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.303+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fa9c0004ad0 con 0x7fa9c81064d0 2023-12-11T20:14:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.304+0000 7fa9c57fa700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9b00a1590 0x7fa9b00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.305+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fa9c00cd110 con 0x7fa9c81064d0 2023-12-11T20:14:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.305+0000 7fa9c7fff700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9b00a1590 0x7fa9b00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.305+0000 7fa9c57fa700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] conn(0x7fa9b00ab150 0x7fa9b00ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.305+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 --> [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9b00adcc0 con 0x7fa9b00ab150 2023-12-11T20:14:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.305+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9c00cd520 con 0x7fa9c81064d0 2023-12-11T20:14:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.306+0000 7fa9c7fff700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9b00a1590 0x7fa9b00a3a50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8005950 tx=0x7fa9b800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:29.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.306+0000 7fa9c77fe700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] conn(0x7fa9b00ab150 0x7fa9b00ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:29.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.306+0000 7fa9c77fe700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] conn(0x7fa9b00ab150 0x7fa9b00ad5f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.307+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 <== osd.8 v2:172.21.15.39:6816/2259242252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa9b00adcc0 con 0x7fa9b00ab150 2023-12-11T20:14:29.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.325+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 --> [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9b4002d40 con 0x7fa9b00ab150 2023-12-11T20:14:29.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.326+0000 7fa9c57fa700 1 -- 172.21.15.12:0/392310327 <== osd.8 v2:172.21.15.39:6816/2259242252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa9b4002d40 con 0x7fa9b00ab150 2023-12-11T20:14:29.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.326+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] conn(0x7fa9b00ab150 msgr2=0x7fa9b00ad5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:29.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.326+0000 7fa9ce7ec700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] conn(0x7fa9b00ab150 0x7fa9b00ad5f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:29.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9b00a1590 msgr2=0x7fa9b00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:29.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ce7ec700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9b00a1590 0x7fa9b00a3a50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8005950 tx=0x7fa9b800b410 comp rx=0 tx=0).stop 2023-12-11T20:14:29.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9c81064d0 msgr2=0x7fa9c81a2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:29.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ce7ec700 1 --2- 172.21.15.12:0/392310327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9c81064d0 0x7fa9c81a2890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000efc0 tx=0x7fa9c000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:14:29.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ccd89700 1 -- 172.21.15.12:0/392310327 reap_dead start 2023-12-11T20:14:29.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 shutdown_connections 2023-12-11T20:14:29.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 >> 172.21.15.12:0/392310327 conn(0x7fa9c8076570 msgr2=0x7fa9c8101000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:29.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 shutdown_connections 2023-12-11T20:14:29.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:29.327+0000 7fa9ce7ec700 1 -- 172.21.15.12:0/392310327 wait complete. 2023-12-11T20:14:29.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:29 smithi012 ceph-mon[128787]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-11T20:14:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:29 smithi039 ceph-mon[102205]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-11T20:14:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:29 smithi032 ceph-mon[132488]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-11T20:14:30.383 INFO:teuthology.orchestra.run.smithi012.stdout:141733920829 2023-12-11T20:14:30.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-11T20:14:30.472 INFO:teuthology.orchestra.run.smithi012.stdout:107374182465 2023-12-11T20:14:30.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-11T20:14:30.959 INFO:teuthology.orchestra.run.smithi012.stdout:253403070501 2023-12-11T20:14:30.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.8 2023-12-11T20:14:30.986 INFO:teuthology.orchestra.run.smithi012.stdout:343597383702 2023-12-11T20:14:30.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.11 2023-12-11T20:14:31.073 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:31.170 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:31.354 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:31.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 -- 172.21.15.12:0/4294804185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 msgr2=0x7f3e00107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4294804185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 0x7f3e00107ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009990 tx=0x7f3df0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 -- 172.21.15.12:0/4294804185 shutdown_connections 2023-12-11T20:14:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4294804185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e00102040 0x7f3e0010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4294804185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 0x7f3e00107ad0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4294804185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e00101680 0x7f3e00101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 -- 172.21.15.12:0/4294804185 >> 172.21.15.12:0/4294804185 conn(0x7f3e000787c0 msgr2=0x7f3e00078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:31.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 -- 172.21.15.12:0/4294804185 shutdown_connections 2023-12-11T20:14:31.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.692+0000 7f3e0502d700 1 -- 172.21.15.12:0/4294804185 wait complete. 2023-12-11T20:14:31.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.693+0000 7f3e0502d700 1 Processor -- start 2023-12-11T20:14:31.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.693+0000 7f3e0502d700 1 -- start start 2023-12-11T20:14:31.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3e0502d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e00101680 0x7f3e0019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3e0502d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e00102040 0x7f3e0019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3e0502d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 0x7f3e00199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3e0502d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00199fb0 con 0x7f3e001076f0 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3e0502d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0019a120 con 0x7f3e00101680 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3e0502d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0019a2e0 con 0x7f3e00102040 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3dff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 0x7f3e00199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3dff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 0x7f3e00199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51486/0 (socket says 172.21.15.12:51486) 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3dff59e700 1 -- 172.21.15.12:0/4041171110 learned_addr learned my addr 172.21.15.12:0/4041171110 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3dfed9d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e00101680 0x7f3e0019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.694+0000 7f3dfe59c700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e00102040 0x7f3e0019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:31.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3dff59e700 1 -- 172.21.15.12:0/4041171110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e00102040 msgr2=0x7f3e0019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3dff59e700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e00102040 0x7f3e0019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3dff59e700 1 -- 172.21.15.12:0/4041171110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e00101680 msgr2=0x7f3e0019f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3dff59e700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e00101680 0x7f3e0019f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3dff59e700 1 -- 172.21.15.12:0/4041171110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00095f0 con 0x7f3e001076f0 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3dff59e700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 0x7f3e00199940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3df8007f10 tx=0x7f3df800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3de7fff700 1 -- 172.21.15.12:0/4041171110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8017070 con 0x7f3e001076f0 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3de7fff700 1 -- 172.21.15.12:0/4041171110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3df800f040 con 0x7f3e001076f0 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0019a5c0 con 0x7f3e001076f0 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3de7fff700 1 -- 172.21.15.12:0/4041171110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8005570 con 0x7f3e001076f0 2023-12-11T20:14:31.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.695+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e001a67f0 con 0x7f3e001076f0 2023-12-11T20:14:31.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.697+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e00104940 con 0x7f3e001076f0 2023-12-11T20:14:31.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.699+0000 7f3de7fff700 1 -- 172.21.15.12:0/4041171110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f3df800db20 con 0x7f3e001076f0 2023-12-11T20:14:31.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.701+0000 7f3de7fff700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3de80a1510 0x7f3de80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:31.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.702+0000 7f3de7fff700 1 -- 172.21.15.12:0/4041171110 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f3df80cc580 con 0x7f3e001076f0 2023-12-11T20:14:31.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.702+0000 7f3dfed9d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3de80a1510 0x7f3de80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:31.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.703+0000 7f3dfed9d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3de80a1510 0x7f3de80a39d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3df000b5c0 tx=0x7f3df0005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:31.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.708+0000 7f3de7fff700 1 -- 172.21.15.12:0/4041171110 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3df8095a10 con 0x7f3e001076f0 2023-12-11T20:14:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:31.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.973+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e00102d10 con 0x7f3e001076f0 2023-12-11T20:14:31.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.973+0000 7f3de7fff700 1 -- 172.21.15.12:0/4041171110 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3df8099030 con 0x7f3e001076f0 2023-12-11T20:14:31.974 INFO:teuthology.orchestra.run.smithi012.stdout:34359738450 2023-12-11T20:14:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3de80a1510 msgr2=0x7f3de80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3de80a1510 0x7f3de80a39d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3df000b5c0 tx=0x7f3df0005fb0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 msgr2=0x7f3e00199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 0x7f3e00199940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3df8007f10 tx=0x7f3df800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 shutdown_connections 2023-12-11T20:14:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3de80a1510 0x7f3de80a39d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e00101680 0x7f3e0019f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e001076f0 0x7f3e00199940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 --2- 172.21.15.12:0/4041171110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e00102040 0x7f3e0019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 >> 172.21.15.12:0/4041171110 conn(0x7f3e000787c0 msgr2=0x7f3e0010cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 shutdown_connections 2023-12-11T20:14:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:31.976+0000 7f3e0502d700 1 -- 172.21.15.12:0/4041171110 wait complete. 2023-12-11T20:14:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:32.156 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:32 smithi012 ceph-mon[128787]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-11T20:14:32.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:32 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4041171110' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-11T20:14:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:32.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:32 smithi032 ceph-mon[132488]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-11T20:14:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:32 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4041171110' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-11T20:14:32.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:32 smithi039 ceph-mon[102205]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-11T20:14:32.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:32 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4041171110' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-11T20:14:33.463 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738448 got 34359738450 for osd.0 2023-12-11T20:14:33.463 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:33.712 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:33.712 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:34 smithi032 ceph-mon[132488]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-11T20:14:34.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:34 smithi012 ceph-mon[128787]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-11T20:14:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:34 smithi039 ceph-mon[102205]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-11T20:14:36.239 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:36 smithi012 ceph-mon[128787]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-11T20:14:36.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:36 smithi032 ceph-mon[132488]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-11T20:14:36.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:36 smithi039 ceph-mon[102205]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-11T20:14:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 -- 172.21.15.12:0/1968340938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c2c107df0 msgr2=0x7f4c2c1081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 --2- 172.21.15.12:0/1968340938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c2c107df0 0x7f4c2c1081d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009990 tx=0x7f4c1c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 -- 172.21.15.12:0/1968340938 shutdown_connections 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 --2- 172.21.15.12:0/1968340938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c2c107df0 0x7f4c2c1081d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 --2- 172.21.15.12:0/1968340938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c2c10ced0 0x7f4c2c114aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 --2- 172.21.15.12:0/1968340938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c2c1087a0 0x7f4c2c10c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 -- 172.21.15.12:0/1968340938 >> 172.21.15.12:0/1968340938 conn(0x7f4c2c074da0 msgr2=0x7f4c2c0771c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 -- 172.21.15.12:0/1968340938 shutdown_connections 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.690+0000 7f4c30e89700 1 -- 172.21.15.12:0/1968340938 wait complete. 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.692+0000 7f4c30e89700 1 Processor -- start 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.692+0000 7f4c30e89700 1 -- start start 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.692+0000 7f4c30e89700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c2c107df0 0x7f4c2c19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.692+0000 7f4c30e89700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c2c1087a0 0x7f4c2c19e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.693+0000 7f4c30e89700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c2c10ced0 0x7f4c2c1a2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.693+0000 7f4c30e89700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c1a2e70 con 0x7f4c2c107df0 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.693+0000 7f4c30e89700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c1a2fe0 con 0x7f4c2c10ced0 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.693+0000 7f4c30e89700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c1a31a0 con 0x7f4c2c1087a0 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.693+0000 7f4c29d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c2c1087a0 0x7f4c2c19e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.693+0000 7f4c29d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c2c1087a0 0x7f4c2c19e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:59552/0 (socket says 172.21.15.12:59552) 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.693+0000 7f4c29d9b700 1 -- 172.21.15.12:0/291957453 learned_addr learned my addr 172.21.15.12:0/291957453 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.693+0000 7f4c2ad9d700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c2c10ced0 0x7f4c2c1a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c2a59c700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c2c107df0 0x7f4c2c19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c29d9b700 1 -- 172.21.15.12:0/291957453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c2c10ced0 msgr2=0x7f4c2c1a2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c29d9b700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c2c10ced0 0x7f4c2c1a2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c29d9b700 1 -- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c2c107df0 msgr2=0x7f4c2c19df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c29d9b700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c2c107df0 0x7f4c2c19df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c29d9b700 1 -- 172.21.15.12:0/291957453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0095f0 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c2a59c700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c2c107df0 0x7f4c2c19df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c29d9b700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c2c1087a0 0x7f4c2c19e4b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000e970 tx=0x7f4c2000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c1b7fe700 1 -- 172.21.15.12:0/291957453 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20009790 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.694+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c1a3480 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.695+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c1aace0 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.696+0000 7f4c1b7fe700 1 -- 172.21.15.12:0/291957453 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c2000eec0 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.696+0000 7f4c1b7fe700 1 -- 172.21.15.12:0/291957453 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20004a30 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.697+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c0052f0 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.701+0000 7f4c1b7fe700 1 -- 172.21.15.12:0/291957453 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f4c20005230 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.703+0000 7f4c1b7fe700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c140a1590 0x7f4c140a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.704+0000 7f4c1b7fe700 1 -- 172.21.15.12:0/291957453 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f4c20014070 con 0x7f4c2c1087a0 2023-12-11T20:14:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.704+0000 7f4c2a59c700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c140a1590 0x7f4c140a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.704+0000 7f4c1b7fe700 1 -- 172.21.15.12:0/291957453 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4c200963b0 con 0x7f4c2c1087a0 2023-12-11T20:14:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.705+0000 7f4c2a59c700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c140a1590 0x7f4c140a3a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00b2e0 tx=0x7f4c1c005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.736+0000 7efbf7490700 1 -- 172.21.15.12:0/1322469869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf0101680 msgr2=0x7efbf0101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.736+0000 7efbf7490700 1 --2- 172.21.15.12:0/1322469869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf0101680 0x7efbf0101b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efbe000dc80 tx=0x7efbe000df90 comp rx=0 tx=0).stop 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.736+0000 7efbf7490700 1 -- 172.21.15.12:0/1322469869 shutdown_connections 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.736+0000 7efbf7490700 1 --2- 172.21.15.12:0/1322469869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0102040 0x7efbf010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.736+0000 7efbf7490700 1 --2- 172.21.15.12:0/1322469869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf01076f0 0x7efbf0107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.736+0000 7efbf7490700 1 --2- 172.21.15.12:0/1322469869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf0101680 0x7efbf0101b00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.736+0000 7efbf7490700 1 -- 172.21.15.12:0/1322469869 >> 172.21.15.12:0/1322469869 conn(0x7efbf00787c0 msgr2=0x7efbf0078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.737+0000 7efbf7490700 1 -- 172.21.15.12:0/1322469869 shutdown_connections 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.737+0000 7efbf7490700 1 -- 172.21.15.12:0/1322469869 wait complete. 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.738+0000 7efbf7490700 1 Processor -- start 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.738+0000 7efbf7490700 1 -- start start 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.739+0000 7efbf7490700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf0101680 0x7efbf0195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.739+0000 7efbf7490700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0102040 0x7efbf0195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.739+0000 7efbf7490700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf01076f0 0x7efbf019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.739+0000 7efbf7490700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf019a620 con 0x7efbf01076f0 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.739+0000 7efbf7490700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf019a790 con 0x7efbf0102040 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.739+0000 7efbf7490700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf019a950 con 0x7efbf0101680 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf522c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf0101680 0x7efbf0195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf5a2d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf01076f0 0x7efbf019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf5a2d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf01076f0 0x7efbf019a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51534/0 (socket says 172.21.15.12:51534) 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf5a2d700 1 -- 172.21.15.12:0/4086479196 learned_addr learned my addr 172.21.15.12:0/4086479196 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf4a2b700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0102040 0x7efbf0195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf5a2d700 1 -- 172.21.15.12:0/4086479196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf0101680 msgr2=0x7efbf0195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf5a2d700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf0101680 0x7efbf0195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf5a2d700 1 -- 172.21.15.12:0/4086479196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0102040 msgr2=0x7efbf0195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.740+0000 7efbf5a2d700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0102040 0x7efbf0195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.741+0000 7efbf5a2d700 1 -- 172.21.15.12:0/4086479196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec0095f0 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.741+0000 7efbf4a2b700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0102040 0x7efbf0195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.741+0000 7efbf5a2d700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf01076f0 0x7efbf019a010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efbe8007f10 tx=0x7efbe800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.741+0000 7efbe67fc700 1 -- 172.21.15.12:0/4086479196 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8009ea0 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.742+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe000d930 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.742+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf01aaad0 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.742+0000 7efbe67fc700 1 -- 172.21.15.12:0/4086479196 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbe800f040 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.742+0000 7efbe67fc700 1 -- 172.21.15.12:0/4086479196 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8004640 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.744+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbd40052f0 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.754+0000 7efbe67fc700 1 -- 172.21.15.12:0/4086479196 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7efbe80047a0 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.755+0000 7efbe67fc700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbdc0a1610 0x7efbdc0a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.756+0000 7efbe67fc700 1 -- 172.21.15.12:0/4086479196 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7efbe80cce20 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.756+0000 7efbe67fc700 1 -- 172.21.15.12:0/4086479196 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efbe80996f0 con 0x7efbf01076f0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.756+0000 7efbf522c700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbdc0a1610 0x7efbdc0a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.757+0000 7efbf522c700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbdc0a1610 0x7efbdc0a3ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efbec005fd0 tx=0x7efbec009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:36.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.958+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f4c0c005870 con 0x7f4c2c1087a0 2023-12-11T20:14:36.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.959+0000 7f4c1b7fe700 1 -- 172.21.15.12:0/291957453 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f4c20005000 con 0x7f4c2c1087a0 2023-12-11T20:14:36.958 INFO:teuthology.orchestra.run.smithi012.stdout:309237645340 2023-12-11T20:14:36.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.962+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c140a1590 msgr2=0x7f4c140a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.962+0000 7f4c30e89700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c140a1590 0x7f4c140a3a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00b2e0 tx=0x7f4c1c005fb0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.962+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c2c1087a0 msgr2=0x7f4c2c19e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.962+0000 7f4c30e89700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c2c1087a0 0x7f4c2c19e4b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000e970 tx=0x7f4c2000ec80 comp rx=0 tx=0).stop 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.962+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 shutdown_connections 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.963+0000 7f4c30e89700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4c140a1590 0x7f4c140a3a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.963+0000 7f4c30e89700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c2c10ced0 0x7f4c2c1a2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.963+0000 7f4c30e89700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c2c107df0 0x7f4c2c19df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.963+0000 7f4c30e89700 1 --2- 172.21.15.12:0/291957453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c2c1087a0 0x7f4c2c19e4b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.963+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 >> 172.21.15.12:0/291957453 conn(0x7f4c2c074da0 msgr2=0x7f4c2c076200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.963+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 shutdown_connections 2023-12-11T20:14:36.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.963+0000 7f4c30e89700 1 -- 172.21.15.12:0/291957453 wait complete. 2023-12-11T20:14:36.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.997+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7efbd4005160 con 0x7efbf01076f0 2023-12-11T20:14:36.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:36.998+0000 7efbe67fc700 1 -- 172.21.15.12:0/4086479196 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efbe80998d0 con 0x7efbf01076f0 2023-12-11T20:14:36.997 INFO:teuthology.orchestra.run.smithi012.stdout:287762808865 2023-12-11T20:14:36.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbdc0a1610 msgr2=0x7efbdc0a3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:36.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbdc0a1610 0x7efbdc0a3ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efbec005fd0 tx=0x7efbec009310 comp rx=0 tx=0).stop 2023-12-11T20:14:36.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf01076f0 msgr2=0x7efbf019a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf01076f0 0x7efbf019a010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efbe8007f10 tx=0x7efbe800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 shutdown_connections 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbdc0a1610 0x7efbdc0a3ad0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf01076f0 0x7efbf019a010 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf0101680 0x7efbf0195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 --2- 172.21.15.12:0/4086479196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0102040 0x7efbf0195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 >> 172.21.15.12:0/4086479196 conn(0x7efbf00787c0 msgr2=0x7efbf01004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.000+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 shutdown_connections 2023-12-11T20:14:37.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.001+0000 7efbf7490700 1 -- 172.21.15.12:0/4086479196 wait complete. 2023-12-11T20:14:37.191 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:37 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/291957453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-11T20:14:37.192 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:37 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4086479196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-11T20:14:37.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:37 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/291957453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-11T20:14:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:37 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4086479196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-11T20:14:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 -- 172.21.15.12:0/37800879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c102040 msgr2=0x7f892c10e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 --2- 172.21.15.12:0/37800879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c102040 0x7f892c10e430 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f892400b0a0 tx=0x7f892400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 -- 172.21.15.12:0/37800879 shutdown_connections 2023-12-11T20:14:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 --2- 172.21.15.12:0/37800879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c102040 0x7f892c10e430 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 --2- 172.21.15.12:0/37800879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f892c1076f0 0x7f892c107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 --2- 172.21.15.12:0/37800879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f892c101680 0x7f892c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 -- 172.21.15.12:0/37800879 >> 172.21.15.12:0/37800879 conn(0x7f892c0787c0 msgr2=0x7f892c078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 -- 172.21.15.12:0/37800879 shutdown_connections 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.066+0000 7f89347fc700 1 -- 172.21.15.12:0/37800879 wait complete. 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.067+0000 7f89347fc700 1 Processor -- start 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f89347fc700 1 -- start start 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f89347fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c101680 0x7f892c19f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f89347fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f892c102040 0x7f892c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f89347fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f892c1076f0 0x7f892c199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f89347fc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c19a0a0 con 0x7f892c101680 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f89347fc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c19a210 con 0x7f892c102040 2023-12-11T20:14:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f89347fc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c19a3d0 con 0x7f892c1076f0 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f8932598700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c101680 0x7f892c19f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f8932598700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c101680 0x7f892c19f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51564/0 (socket says 172.21.15.12:51564) 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.068+0000 7f8932598700 1 -- 172.21.15.12:0/1717981008 learned_addr learned my addr 172.21.15.12:0/1717981008 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f8931d97700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f892c102040 0x7f892c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f8932598700 1 -- 172.21.15.12:0/1717981008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f892c1076f0 msgr2=0x7f892c199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f8932598700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f892c1076f0 0x7f892c199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f8932598700 1 -- 172.21.15.12:0/1717981008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f892c102040 msgr2=0x7f892c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f8932598700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f892c102040 0x7f892c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f8932598700 1 -- 172.21.15.12:0/1717981008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928009520 con 0x7f892c101680 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f8932598700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c101680 0x7f892c19f900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f892800eb30 tx=0x7f892800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f89237fe700 1 -- 172.21.15.12:0/1717981008 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928009880 con 0x7f892c101680 2023-12-11T20:14:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f89237fe700 1 -- 172.21.15.12:0/1717981008 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89280044b0 con 0x7f892c101680 2023-12-11T20:14:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8924009d00 con 0x7f892c101680 2023-12-11T20:14:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.069+0000 7f89237fe700 1 -- 172.21.15.12:0/1717981008 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928003e40 con 0x7f892c101680 2023-12-11T20:14:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.070+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892c1a6720 con 0x7f892c101680 2023-12-11T20:14:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.071+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892c104940 con 0x7f892c101680 2023-12-11T20:14:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.073+0000 7f89237fe700 1 -- 172.21.15.12:0/1717981008 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f8928003fa0 con 0x7f892c101680 2023-12-11T20:14:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.074+0000 7f89237fe700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89180a1510 0x7f89180a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.074+0000 7f89237fe700 1 -- 172.21.15.12:0/1717981008 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f8928014070 con 0x7f892c101680 2023-12-11T20:14:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.074+0000 7f8931d97700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89180a1510 0x7f89180a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.075+0000 7f8931d97700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89180a1510 0x7f89180a39d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f891c005fd0 tx=0x7f891c005f60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.078+0000 7f89237fe700 1 -- 172.21.15.12:0/1717981008 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f89280967a0 con 0x7f892c101680 2023-12-11T20:14:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.304+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f892c102d10 con 0x7f892c101680 2023-12-11T20:14:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.305+0000 7f89237fe700 1 -- 172.21.15.12:0/1717981008 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8928099dc0 con 0x7f892c101680 2023-12-11T20:14:37.553 INFO:teuthology.orchestra.run.smithi012.stdout:163208757304 2023-12-11T20:14:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.307+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89180a1510 msgr2=0x7f89180a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.307+0000 7f89347fc700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89180a1510 0x7f89180a39d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f891c005fd0 tx=0x7f891c005f60 comp rx=0 tx=0).stop 2023-12-11T20:14:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.307+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c101680 msgr2=0x7f892c19f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.307+0000 7f89347fc700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c101680 0x7f892c19f900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f892800eb30 tx=0x7f892800eef0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.308+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 shutdown_connections 2023-12-11T20:14:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.308+0000 7f89347fc700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89180a1510 0x7f89180a39d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.308+0000 7f89347fc700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f892c1076f0 0x7f892c199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.308+0000 7f89347fc700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f892c101680 0x7f892c19f900 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.308+0000 7f89347fc700 1 --2- 172.21.15.12:0/1717981008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f892c102040 0x7f892c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.308+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 >> 172.21.15.12:0/1717981008 conn(0x7f892c0787c0 msgr2=0x7f892c10caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.308+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 shutdown_connections 2023-12-11T20:14:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:37.308+0000 7f89347fc700 1 -- 172.21.15.12:0/1717981008 wait complete. 2023-12-11T20:14:37.556 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:37 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/291957453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-11T20:14:37.556 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:37 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4086479196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-11T20:14:38.410 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:38 smithi012 ceph-mon[128787]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-11T20:14:38.410 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:38 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1717981008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-11T20:14:38.458 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645338 got 309237645340 for osd.10 2023-12-11T20:14:38.458 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:38 smithi032 ceph-mon[132488]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-11T20:14:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:38 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1717981008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-11T20:14:38.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:38 smithi039 ceph-mon[102205]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-11T20:14:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:38 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1717981008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-11T20:14:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.651+0000 7f6e18ad5700 1 -- 172.21.15.12:0/2838224240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 msgr2=0x7f6e1410e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.651+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/2838224240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 0x7f6e1410e420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00b0d0 tx=0x7f6e0c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.652+0000 7f6e18ad5700 1 -- 172.21.15.12:0/2838224240 shutdown_connections 2023-12-11T20:14:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.652+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/2838224240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e14107620 0x7f6e14107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.652+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/2838224240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 0x7f6e1410e420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.652+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/2838224240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e14068f70 0x7f6e140693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.652+0000 7f6e18ad5700 1 -- 172.21.15.12:0/2838224240 >> 172.21.15.12:0/2838224240 conn(0x7f6e14076570 msgr2=0x7f6e14076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.652+0000 7f6e18ad5700 1 -- 172.21.15.12:0/2838224240 shutdown_connections 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.653+0000 7f6e18ad5700 1 -- 172.21.15.12:0/2838224240 wait complete. 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.654+0000 7f6e18ad5700 1 Processor -- start 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.654+0000 7f6e18ad5700 1 -- start start 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e18ad5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 0x7f6e14108350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e18ad5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e14107620 0x7f6e14108890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e18ad5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e14108dd0 0x7f6e141aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e18ad5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1410c530 con 0x7f6e14069930 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e18ad5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141aa7f0 con 0x7f6e14107620 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e18ad5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141aa9b0 con 0x7f6e14108dd0 2023-12-11T20:14:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e1259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 0x7f6e14108350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e1259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 0x7f6e14108350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51602/0 (socket says 172.21.15.12:51602) 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e1259c700 1 -- 172.21.15.12:0/653977551 learned_addr learned my addr 172.21.15.12:0/653977551 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e11d9b700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e14107620 0x7f6e14108890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.655+0000 7f6e12d9d700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e14108dd0 0x7f6e141aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e1259c700 1 -- 172.21.15.12:0/653977551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e14108dd0 msgr2=0x7f6e141aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e1259c700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e14108dd0 0x7f6e141aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e1259c700 1 -- 172.21.15.12:0/653977551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e14107620 msgr2=0x7f6e14108890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e1259c700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e14107620 0x7f6e14108890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e1259c700 1 -- 172.21.15.12:0/653977551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c009d00 con 0x7f6e14069930 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e11d9b700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e14107620 0x7f6e14108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e1259c700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 0x7f6e14108350 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400e9a0 tx=0x7f6e0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e037fe700 1 -- 172.21.15.12:0/653977551 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04009790 con 0x7f6e14069930 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e037fe700 1 -- 172.21.15.12:0/653977551 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e04010430 con 0x7f6e14069930 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e037fe700 1 -- 172.21.15.12:0/653977551 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400cea0 con 0x7f6e14069930 2023-12-11T20:14:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.656+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e141aac90 con 0x7f6e14069930 2023-12-11T20:14:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.657+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e141ab140 con 0x7f6e14069930 2023-12-11T20:14:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.658+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e14102cc0 con 0x7f6e14069930 2023-12-11T20:14:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.661+0000 7f6e037fe700 1 -- 172.21.15.12:0/653977551 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f6e040105a0 con 0x7f6e14069930 2023-12-11T20:14:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.663+0000 7f6e037fe700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6dfc0a1590 0x7f6dfc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.663+0000 7f6e037fe700 1 -- 172.21.15.12:0/653977551 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f6e04014070 con 0x7f6e14069930 2023-12-11T20:14:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.663+0000 7f6e11d9b700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6dfc0a1590 0x7f6dfc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.664+0000 7f6e11d9b700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6dfc0a1590 0x7f6dfc0a3a50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e14109a80 tx=0x7f6e0800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:39.018 INFO:teuthology.orchestra.run.smithi012.stdout:77309411402 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.668+0000 7f6e037fe700 1 -- 172.21.15.12:0/653977551 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6e04096330 con 0x7f6e14069930 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.892+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e141114a0 con 0x7f6e14069930 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.892+0000 7f6e037fe700 1 -- 172.21.15.12:0/653977551 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e04099950 con 0x7f6e14069930 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.894+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6dfc0a1590 msgr2=0x7f6dfc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.894+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6dfc0a1590 0x7f6dfc0a3a50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e14109a80 tx=0x7f6e0800b390 comp rx=0 tx=0).stop 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.894+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 msgr2=0x7f6e14108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.894+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 0x7f6e14108350 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400e9a0 tx=0x7f6e0400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.895+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 shutdown_connections 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.895+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6dfc0a1590 0x7f6dfc0a3a50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.895+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e14108dd0 0x7f6e141aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.895+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e14069930 0x7f6e14108350 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.895+0000 7f6e18ad5700 1 --2- 172.21.15.12:0/653977551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e14107620 0x7f6e14108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.895+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 >> 172.21.15.12:0/653977551 conn(0x7f6e14076570 msgr2=0x7f6e140ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.895+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 shutdown_connections 2023-12-11T20:14:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.895+0000 7f6e18ad5700 1 -- 172.21.15.12:0/653977551 wait complete. 2023-12-11T20:14:39.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.614+0000 7faa4e1e0700 1 -- 172.21.15.12:0/2786735825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa48069890 msgr2=0x7faa4810dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.614+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/2786735825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa48069890 0x7faa4810dba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009990 tx=0x7faa3c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.614+0000 7faa4e1e0700 1 -- 172.21.15.12:0/2786735825 shutdown_connections 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.614+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/2786735825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa4810e0e0 0x7faa481104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.614+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/2786735825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa48068f70 0x7faa48069350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.614+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/2786735825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa48069890 0x7faa4810dba0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.614+0000 7faa4e1e0700 1 -- 172.21.15.12:0/2786735825 >> 172.21.15.12:0/2786735825 conn(0x7faa48076570 msgr2=0x7faa48076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.615+0000 7faa4e1e0700 1 -- 172.21.15.12:0/2786735825 shutdown_connections 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.615+0000 7faa4e1e0700 1 -- 172.21.15.12:0/2786735825 wait complete. 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.617+0000 7faa4e1e0700 1 Processor -- start 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.617+0000 7faa4e1e0700 1 -- start start 2023-12-11T20:14:39.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.618+0000 7faa4e1e0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa48068f70 0x7faa4819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.618+0000 7faa4e1e0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa48069890 0x7faa4819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.618+0000 7faa4e1e0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4810e0e0 0x7faa48199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.618+0000 7faa4e1e0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48199fe0 con 0x7faa4810e0e0 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.618+0000 7faa4e1e0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4819a150 con 0x7faa48068f70 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.618+0000 7faa4e1e0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4819a310 con 0x7faa48069890 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa47fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4810e0e0 0x7faa48199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa46ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa48069890 0x7faa4819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa47fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4810e0e0 0x7faa48199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51576/0 (socket says 172.21.15.12:51576) 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa47fff700 1 -- 172.21.15.12:0/1309767859 learned_addr learned my addr 172.21.15.12:0/1309767859 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa477fe700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa48068f70 0x7faa4819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa477fe700 1 -- 172.21.15.12:0/1309767859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa48069890 msgr2=0x7faa4819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa477fe700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa48069890 0x7faa4819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa477fe700 1 -- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4810e0e0 msgr2=0x7faa48199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa477fe700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4810e0e0 0x7faa48199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa477fe700 1 -- 172.21.15.12:0/1309767859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c0095f0 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa46ffd700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa48069890 0x7faa4819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.619+0000 7faa477fe700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa48068f70 0x7faa4819f840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d950 tx=0x7faa3800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.620+0000 7faa44ff9700 1 -- 172.21.15.12:0/1309767859 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800f890 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.620+0000 7faa44ff9700 1 -- 172.21.15.12:0/1309767859 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa3800fe80 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.620+0000 7faa44ff9700 1 -- 172.21.15.12:0/1309767859 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800e3b0 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.620+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4819a5f0 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.620+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa481a6830 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.622+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa48109300 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.624+0000 7faa44ff9700 1 -- 172.21.15.12:0/1309767859 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7faa3800f9f0 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.626+0000 7faa44ff9700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faa300a1510 0x7faa300a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.626+0000 7faa44ff9700 1 -- 172.21.15.12:0/1309767859 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7faa380ccb90 con 0x7faa48068f70 2023-12-11T20:14:39.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.627+0000 7faa46ffd700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faa300a1510 0x7faa300a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:39.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.628+0000 7faa46ffd700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faa300a1510 0x7faa300a39d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa4819ab40 tx=0x7faa3c00b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:39.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.630+0000 7faa44ff9700 1 -- 172.21.15.12:0/1309767859 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faa38096080 con 0x7faa48068f70 2023-12-11T20:14:39.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.858+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa4819ae40 con 0x7faa48068f70 2023-12-11T20:14:39.202 INFO:teuthology.orchestra.run.smithi012.stdout:55834574926 2023-12-11T20:14:39.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.859+0000 7faa44ff9700 1 -- 172.21.15.12:0/1309767859 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa38016090 con 0x7faa48068f70 2023-12-11T20:14:39.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faa300a1510 msgr2=0x7faa300a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faa300a1510 0x7faa300a39d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa4819ab40 tx=0x7faa3c00b260 comp rx=0 tx=0).stop 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa48068f70 msgr2=0x7faa4819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa48068f70 0x7faa4819f840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d950 tx=0x7faa3800dc60 comp rx=0 tx=0).stop 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 shutdown_connections 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faa300a1510 0x7faa300a39d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa48068f70 0x7faa4819f840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4810e0e0 0x7faa48199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 --2- 172.21.15.12:0/1309767859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa48069890 0x7faa4819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.861+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 >> 172.21.15.12:0/1309767859 conn(0x7faa48076570 msgr2=0x7faa4810f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.862+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 shutdown_connections 2023-12-11T20:14:39.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:38.862+0000 7faa4e1e0700 1 -- 172.21.15.12:0/1309767859 wait complete. 2023-12-11T20:14:39.489 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1309767859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-11T20:14:39.489 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/653977551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-11T20:14:39.489 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:39 smithi012 ceph-mon[128787]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-11T20:14:39.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1309767859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-11T20:14:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/653977551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-11T20:14:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:39 smithi039 ceph-mon[102205]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-11T20:14:39.646 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757302 got 163208757304 for osd.5 2023-12-11T20:14:39.646 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1309767859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-11T20:14:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/653977551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-11T20:14:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:39 smithi032 ceph-mon[132488]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-11T20:14:39.783 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411399 got 77309411402 for osd.2 2023-12-11T20:14:39.783 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:40.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 -- 172.21.15.12:0/439813430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0112350 msgr2=0x7fcae0114780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 --2- 172.21.15.12:0/439813430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0112350 0x7fcae0114780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcad800b0a0 tx=0x7fcad800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 -- 172.21.15.12:0/439813430 shutdown_connections 2023-12-11T20:14:40.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 --2- 172.21.15.12:0/439813430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0112350 0x7fcae0114780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 --2- 172.21.15.12:0/439813430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0075550 0x7fcae0073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 --2- 172.21.15.12:0/439813430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0073d40 0x7fcae00741c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 -- 172.21.15.12:0/439813430 >> 172.21.15.12:0/439813430 conn(0x7fcae00787c0 msgr2=0x7fcae0078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:40.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 -- 172.21.15.12:0/439813430 shutdown_connections 2023-12-11T20:14:40.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.046+0000 7fcae625b700 1 -- 172.21.15.12:0/439813430 wait complete. 2023-12-11T20:14:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.047+0000 7fcae625b700 1 Processor -- start 2023-12-11T20:14:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.047+0000 7fcae625b700 1 -- start start 2023-12-11T20:14:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcae625b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0073d40 0x7fcae019e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcae625b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0075550 0x7fcae019e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcae625b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0112350 0x7fcae01a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcae625b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae01a2fb0 con 0x7fcae0075550 2023-12-11T20:14:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcae625b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae01a3120 con 0x7fcae0112350 2023-12-11T20:14:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcae625b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae01a32e0 con 0x7fcae0073d40 2023-12-11T20:14:40.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcadeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0075550 0x7fcae019e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcadf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0073d40 0x7fcae019e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcadeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0075550 0x7fcae019e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47108/0 (socket says 172.21.15.12:47108) 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.048+0000 7fcadeffd700 1 -- 172.21.15.12:0/1461158169 learned_addr learned my addr 172.21.15.12:0/1461158169 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadffff700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0112350 0x7fcae01a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadeffd700 1 -- 172.21.15.12:0/1461158169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0073d40 msgr2=0x7fcae019e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadeffd700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0073d40 0x7fcae019e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadeffd700 1 -- 172.21.15.12:0/1461158169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0112350 msgr2=0x7fcae01a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadeffd700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0112350 0x7fcae01a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadeffd700 1 -- 172.21.15.12:0/1461158169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8009d00 con 0x7fcae0075550 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadffff700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0112350 0x7fcae01a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadf7fe700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0073d40 0x7fcae019e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadeffd700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0075550 0x7fcae019e5f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcad400e9a0 tx=0x7fcad400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadcff9700 1 -- 172.21.15.12:0/1461158169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4009790 con 0x7fcae0075550 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadcff9700 1 -- 172.21.15.12:0/1461158169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcad400cbd0 con 0x7fcae0075550 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae01a35c0 con 0x7fcae0075550 2023-12-11T20:14:40.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.049+0000 7fcadcff9700 1 -- 172.21.15.12:0/1461158169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4018680 con 0x7fcae0075550 2023-12-11T20:14:40.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.050+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae01aae20 con 0x7fcae0075550 2023-12-11T20:14:40.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.051+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae0074e90 con 0x7fcae0075550 2023-12-11T20:14:40.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.053+0000 7fcadcff9700 1 -- 172.21.15.12:0/1461158169 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fcad400cd40 con 0x7fcae0075550 2023-12-11T20:14:40.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.054+0000 7fcadcff9700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a1590 0x7fcac80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.054+0000 7fcadcff9700 1 -- 172.21.15.12:0/1461158169 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fcad4014070 con 0x7fcae0075550 2023-12-11T20:14:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.054+0000 7fcadf7fe700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a1590 0x7fcac80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.055+0000 7fcadf7fe700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a1590 0x7fcac80a3a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcad0007fd0 tx=0x7fcad00073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.062+0000 7fcadcff9700 1 -- 172.21.15.12:0/1461158169 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcad40522f0 con 0x7fcae0075550 2023-12-11T20:14:40.092 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:40.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.164+0000 7f5796063700 1 -- 172.21.15.12:0/2221088384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57901013d0 msgr2=0x7f5790101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.164+0000 7f5796063700 1 --2- 172.21.15.12:0/2221088384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57901013d0 0x7f5790101850 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5780009990 tx=0x7f5780009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.164+0000 7f5796063700 1 -- 172.21.15.12:0/2221088384 shutdown_connections 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.164+0000 7f5796063700 1 --2- 172.21.15.12:0/2221088384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5790107460 0x7f5790107840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.164+0000 7f5796063700 1 --2- 172.21.15.12:0/2221088384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5790101d90 0x7f579010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.164+0000 7f5796063700 1 --2- 172.21.15.12:0/2221088384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57901013d0 0x7f5790101850 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.164+0000 7f5796063700 1 -- 172.21.15.12:0/2221088384 >> 172.21.15.12:0/2221088384 conn(0x7f57900fcf00 msgr2=0x7f57900ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.165+0000 7f5796063700 1 -- 172.21.15.12:0/2221088384 shutdown_connections 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.165+0000 7f5796063700 1 -- 172.21.15.12:0/2221088384 wait complete. 2023-12-11T20:14:40.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.166+0000 7f5796063700 1 Processor -- start 2023-12-11T20:14:40.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.166+0000 7f5796063700 1 -- start start 2023-12-11T20:14:40.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5796063700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57901013d0 0x7f579019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5796063700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5790101d90 0x7f579019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5796063700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5790107460 0x7f5790199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5796063700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790199ea0 con 0x7f5790101d90 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5796063700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579019a010 con 0x7f5790107460 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5796063700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579019a1d0 con 0x7f57901013d0 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5794860700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5790101d90 0x7f579019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5795061700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57901013d0 0x7f579019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5794860700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5790101d90 0x7f579019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47116/0 (socket says 172.21.15.12:47116) 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5794860700 1 -- 172.21.15.12:0/1035803843 learned_addr learned my addr 172.21.15.12:0/1035803843 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.167+0000 7f5795862700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5790107460 0x7f5790199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.168+0000 7f5794860700 1 -- 172.21.15.12:0/1035803843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57901013d0 msgr2=0x7f579019f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.168+0000 7f5794860700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57901013d0 0x7f579019f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.168+0000 7f5794860700 1 -- 172.21.15.12:0/1035803843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5790107460 msgr2=0x7f5790199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.168+0000 7f5794860700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5790107460 0x7f5790199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.168+0000 7f5794860700 1 -- 172.21.15.12:0/1035803843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800095f0 con 0x7f5790101d90 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.168+0000 7f5795061700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57901013d0 0x7f579019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.168+0000 7f5794860700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5790101d90 0x7f579019fc30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f57800098e0 tx=0x7f5780005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:40.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.169+0000 7f57867fc700 1 -- 172.21.15.12:0/1035803843 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578001d070 con 0x7f5790101d90 2023-12-11T20:14:40.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.169+0000 7f57867fc700 1 -- 172.21.15.12:0/1035803843 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f578000fb00 con 0x7f5790101d90 2023-12-11T20:14:40.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.169+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579019a450 con 0x7f5790101d90 2023-12-11T20:14:40.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.169+0000 7f57867fc700 1 -- 172.21.15.12:0/1035803843 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780022aa0 con 0x7f5790101d90 2023-12-11T20:14:40.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.169+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5790108420 con 0x7f5790101d90 2023-12-11T20:14:40.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.171+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5790102b10 con 0x7f5790101d90 2023-12-11T20:14:40.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.174+0000 7f57867fc700 1 -- 172.21.15.12:0/1035803843 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f578000f670 con 0x7f5790101d90 2023-12-11T20:14:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.176+0000 7f57867fc700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f577c0a1590 0x7f577c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.176+0000 7f57867fc700 1 -- 172.21.15.12:0/1035803843 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f57800ce3b0 con 0x7f5790101d90 2023-12-11T20:14:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.176+0000 7f5795061700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f577c0a1590 0x7f577c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.177+0000 7f5795061700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f577c0a1590 0x7f577c0a3a50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f578c005950 tx=0x7f578c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:40.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.179+0000 7f57867fc700 1 -- 172.21.15.12:0/1035803843 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f57800979f0 con 0x7f5790101d90 2023-12-11T20:14:40.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.285+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcae004f290 con 0x7fcae0075550 2023-12-11T20:14:40.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.285+0000 7fcadcff9700 1 -- 172.21.15.12:0/1461158169 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcad40965a0 con 0x7fcae0075550 2023-12-11T20:14:40.284 INFO:teuthology.orchestra.run.smithi012.stdout:219043332142 2023-12-11T20:14:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.288+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a1590 msgr2=0x7fcac80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.288+0000 7fcae625b700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a1590 0x7fcac80a3a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcad0007fd0 tx=0x7fcad00073d0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.288+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0075550 msgr2=0x7fcae019e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.288+0000 7fcae625b700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0075550 0x7fcae019e5f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcad400e9a0 tx=0x7fcad400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.289+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 shutdown_connections 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.289+0000 7fcae625b700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a1590 0x7fcac80a3a50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.289+0000 7fcae625b700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0112350 0x7fcae01a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.289+0000 7fcae625b700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0073d40 0x7fcae019e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.289+0000 7fcae625b700 1 --2- 172.21.15.12:0/1461158169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0075550 0x7fcae019e5f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.289+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 >> 172.21.15.12:0/1461158169 conn(0x7fcae00787c0 msgr2=0x7fcae0110f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.289+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 shutdown_connections 2023-12-11T20:14:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.289+0000 7fcae625b700 1 -- 172.21.15.12:0/1461158169 wait complete. 2023-12-11T20:14:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.399+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f579004f290 con 0x7f5790101d90 2023-12-11T20:14:40.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.400+0000 7f57867fc700 1 -- 172.21.15.12:0/1035803843 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5780027090 con 0x7f5790101d90 2023-12-11T20:14:40.399 INFO:teuthology.orchestra.run.smithi012.stdout:141733920831 2023-12-11T20:14:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f577c0a1590 msgr2=0x7f577c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f577c0a1590 0x7f577c0a3a50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f578c005950 tx=0x7f578c00b410 comp rx=0 tx=0).stop 2023-12-11T20:14:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5790101d90 msgr2=0x7f579019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5790101d90 0x7f579019fc30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f57800098e0 tx=0x7f5780005740 comp rx=0 tx=0).stop 2023-12-11T20:14:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 shutdown_connections 2023-12-11T20:14:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f577c0a1590 0x7f577c0a3a50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5790107460 0x7f5790199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57901013d0 0x7f579019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 --2- 172.21.15.12:0/1035803843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5790101d90 0x7f579019fc30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 >> 172.21.15.12:0/1035803843 conn(0x7f57900fcf00 msgr2=0x7f579010cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 shutdown_connections 2023-12-11T20:14:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.402+0000 7f5796063700 1 -- 172.21.15.12:0/1035803843 wait complete. 2023-12-11T20:14:40.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.410+0000 7fe14d7c0700 1 -- 172.21.15.12:0/1370693709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148069930 msgr2=0x7fe14810e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.410+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/1370693709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148069930 0x7fe14810e410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe14000b0d0 tx=0x7fe14000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.411+0000 7fe14d7c0700 1 -- 172.21.15.12:0/1370693709 shutdown_connections 2023-12-11T20:14:40.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.411+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/1370693709 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe148107640 0x7fe148107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.411+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/1370693709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148069930 0x7fe14810e410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.411+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/1370693709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148068f70 0x7fe1480693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.411+0000 7fe14d7c0700 1 -- 172.21.15.12:0/1370693709 >> 172.21.15.12:0/1370693709 conn(0x7fe148076570 msgr2=0x7fe148076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:40.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.411+0000 7fe14d7c0700 1 -- 172.21.15.12:0/1370693709 shutdown_connections 2023-12-11T20:14:40.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.411+0000 7fe14d7c0700 1 -- 172.21.15.12:0/1370693709 wait complete. 2023-12-11T20:14:40.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.412+0000 7fe14d7c0700 1 Processor -- start 2023-12-11T20:14:40.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.412+0000 7fe14d7c0700 1 -- start start 2023-12-11T20:14:40.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.413+0000 7fe14d7c0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148068f70 0x7fe14819e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.413+0000 7fe14d7c0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148069930 0x7fe14819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.413+0000 7fe146ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148068f70 0x7fe14819e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe146ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148068f70 0x7fe14819e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47138/0 (socket says 172.21.15.12:47138) 2023-12-11T20:14:40.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe14d7c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe148107640 0x7fe14810d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14810e020 con 0x7fe148068f70 2023-12-11T20:14:40.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe146ffd700 1 -- 172.21.15.12:0/2627292641 learned_addr learned my addr 172.21.15.12:0/2627292641 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:40.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14810e190 con 0x7fe148107640 2023-12-11T20:14:40.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14810e350 con 0x7fe148069930 2023-12-11T20:14:40.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe1477fe700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe148107640 0x7fe14810d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe1467fc700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148069930 0x7fe14819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe146ffd700 1 -- 172.21.15.12:0/2627292641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148069930 msgr2=0x7fe14819ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe146ffd700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148069930 0x7fe14819ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe146ffd700 1 -- 172.21.15.12:0/2627292641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe148107640 msgr2=0x7fe14810d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe146ffd700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe148107640 0x7fe14810d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe146ffd700 1 -- 172.21.15.12:0/2627292641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c009520 con 0x7fe148068f70 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.414+0000 7fe1477fe700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe148107640 0x7fe14810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.415+0000 7fe146ffd700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148068f70 0x7fe14819e720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe13800d950 tx=0x7fe13800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.415+0000 7fe12ffff700 1 -- 172.21.15.12:0/2627292641 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138009b40 con 0x7fe148068f70 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.415+0000 7fe12ffff700 1 -- 172.21.15.12:0/2627292641 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe138009ca0 con 0x7fe148068f70 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.415+0000 7fe12ffff700 1 -- 172.21.15.12:0/2627292641 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800f620 con 0x7fe148068f70 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.415+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe140009d00 con 0x7fe148068f70 2023-12-11T20:14:40.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.415+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14819a400 con 0x7fe148068f70 2023-12-11T20:14:40.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.417+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe148102cb0 con 0x7fe148068f70 2023-12-11T20:14:40.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.420+0000 7fe12ffff700 1 -- 172.21.15.12:0/2627292641 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fe138010460 con 0x7fe148068f70 2023-12-11T20:14:40.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.421+0000 7fe12ffff700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1300a1590 0x7fe1300a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:40.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.421+0000 7fe12ffff700 1 -- 172.21.15.12:0/2627292641 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fe1380ccd50 con 0x7fe148068f70 2023-12-11T20:14:40.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.421+0000 7fe1467fc700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1300a1590 0x7fe1300a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:40.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.422+0000 7fe1467fc700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1300a1590 0x7fe1300a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe148196ea0 tx=0x7fe13c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:40.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.425+0000 7fe12ffff700 1 -- 172.21.15.12:0/2627292641 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe138096240 con 0x7fe148068f70 2023-12-11T20:14:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:40 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1461158169' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-11T20:14:40.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.676+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fe14819adf0 con 0x7fe148068f70 2023-12-11T20:14:40.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.676+0000 7fe12ffff700 1 -- 172.21.15.12:0/2627292641 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe138020020 con 0x7fe148068f70 2023-12-11T20:14:40.676 INFO:teuthology.orchestra.run.smithi012.stdout:253403070503 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1300a1590 msgr2=0x7fe1300a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1300a1590 0x7fe1300a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe148196ea0 tx=0x7fe13c009260 comp rx=0 tx=0).stop 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148068f70 msgr2=0x7fe14819e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148068f70 0x7fe14819e720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe13800d950 tx=0x7fe13800dd10 comp rx=0 tx=0).stop 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 shutdown_connections 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1300a1590 0x7fe1300a3a50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe148107640 0x7fe14810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148068f70 0x7fe14819e720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 --2- 172.21.15.12:0/2627292641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe148069930 0x7fe14819ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:40.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 >> 172.21.15.12:0/2627292641 conn(0x7fe148076570 msgr2=0x7fe1480ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:40.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 shutdown_connections 2023-12-11T20:14:40.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:40.679+0000 7fe14d7c0700 1 -- 172.21.15.12:0/2627292641 wait complete. 2023-12-11T20:14:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:40 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1461158169' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-11T20:14:40.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:40 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1461158169' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-11T20:14:40.853 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574924 got 55834574926 for osd.1 2023-12-11T20:14:40.854 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:40.966 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808863 got 287762808865 for osd.9 2023-12-11T20:14:40.966 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:41.208 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332140 got 219043332142 for osd.7 2023-12-11T20:14:41.208 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:41.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:41 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1035803843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-11T20:14:41.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:41 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2627292641' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-11T20:14:41.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:41 smithi012 ceph-mon[128787]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 -- 172.21.15.12:0/1649105055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 msgr2=0x7fd3c810e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/1649105055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 0x7fd3c810e430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000b0a0 tx=0x7fd3c000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 -- 172.21.15.12:0/1649105055 shutdown_connections 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/1649105055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 0x7fd3c810e430 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/1649105055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3c81076f0 0x7fd3c8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/1649105055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3c8101680 0x7fd3c8101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 -- 172.21.15.12:0/1649105055 >> 172.21.15.12:0/1649105055 conn(0x7fd3c80787c0 msgr2=0x7fd3c8078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 -- 172.21.15.12:0/1649105055 shutdown_connections 2023-12-11T20:14:41.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.586+0000 7fd3cdb46700 1 -- 172.21.15.12:0/1649105055 wait complete. 2023-12-11T20:14:41.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.588+0000 7fd3cdb46700 1 Processor -- start 2023-12-11T20:14:41.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.588+0000 7fd3cdb46700 1 -- start start 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.588+0000 7fd3cdb46700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3c8101680 0x7fd3c819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.588+0000 7fd3cdb46700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 0x7fd3c819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3cdb46700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3c81076f0 0x7fd3c81977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3cdb46700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8197e10 con 0x7fd3c8102040 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3cdb46700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8197f80 con 0x7fd3c81076f0 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3cdb46700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8198140 con 0x7fd3c8101680 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 0x7fd3c819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3c8101680 0x7fd3c819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3c8101680 0x7fd3c819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:33984/0 (socket says 172.21.15.12:33984) 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 0x7fd3c819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47152/0 (socket says 172.21.15.12:47152) 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c77fe700 1 -- 172.21.15.12:0/780148210 learned_addr learned my addr 172.21.15.12:0/780148210 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c7fff700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3c81076f0 0x7fd3c81977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c6ffd700 1 -- 172.21.15.12:0/780148210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3c8101680 msgr2=0x7fd3c819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c6ffd700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3c8101680 0x7fd3c819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c6ffd700 1 -- 172.21.15.12:0/780148210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3c81076f0 msgr2=0x7fd3c81977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c6ffd700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3c81076f0 0x7fd3c81977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c6ffd700 1 -- 172.21.15.12:0/780148210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009d00 con 0x7fd3c8102040 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.589+0000 7fd3c77fe700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3c8101680 0x7fd3c819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.590+0000 7fd3c6ffd700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 0x7fd3c819dba0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00e9f0 tx=0x7fd3bc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.590+0000 7fd3c4ff9700 1 -- 172.21.15.12:0/780148210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00c9c0 con 0x7fd3c8102040 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.590+0000 7fd3c4ff9700 1 -- 172.21.15.12:0/780148210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3bc010430 con 0x7fd3c8102040 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.590+0000 7fd3c4ff9700 1 -- 172.21.15.12:0/780148210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc018680 con 0x7fd3c8102040 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.590+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c8198420 con 0x7fd3c8102040 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.590+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c81a4650 con 0x7fd3c8102040 2023-12-11T20:14:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.591+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c8109b80 con 0x7fd3c8102040 2023-12-11T20:14:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.593+0000 7fd3c4ff9700 1 -- 172.21.15.12:0/780148210 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fd3bc0105a0 con 0x7fd3c8102040 2023-12-11T20:14:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.596+0000 7fd3c4ff9700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd3b00a1590 0x7fd3b00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.596+0000 7fd3c4ff9700 1 -- 172.21.15.12:0/780148210 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fd3bc014070 con 0x7fd3c8102040 2023-12-11T20:14:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.596+0000 7fd3c77fe700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd3b00a1590 0x7fd3b00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.597+0000 7fd3c77fe700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd3b00a1590 0x7fd3b00a3a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8011550 tx=0x7fd3b8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:41.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.600+0000 7fd3c4ff9700 1 -- 172.21.15.12:0/780148210 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd3bc096430 con 0x7fd3c8102040 2023-12-11T20:14:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:41 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1035803843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-11T20:14:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:41 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2627292641' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-11T20:14:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:41 smithi032 ceph-mon[132488]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2023-12-11T20:14:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:41 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1035803843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-11T20:14:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:41 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2627292641' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-11T20:14:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:41 smithi039 ceph-mon[102205]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2023-12-11T20:14:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.824+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd3c8111380 con 0x7fd3c8102040 2023-12-11T20:14:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.825+0000 7fd3c4ff9700 1 -- 172.21.15.12:0/780148210 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3bc099a50 con 0x7fd3c8102040 2023-12-11T20:14:41.824 INFO:teuthology.orchestra.run.smithi012.stdout:197568495667 2023-12-11T20:14:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd3b00a1590 msgr2=0x7fd3b00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd3b00a1590 0x7fd3b00a3a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8011550 tx=0x7fd3b8009260 comp rx=0 tx=0).stop 2023-12-11T20:14:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 msgr2=0x7fd3c819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 0x7fd3c819dba0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00e9f0 tx=0x7fd3bc00ed00 comp rx=0 tx=0).stop 2023-12-11T20:14:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 shutdown_connections 2023-12-11T20:14:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd3b00a1590 0x7fd3b00a3a50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3c81076f0 0x7fd3c81977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3c8101680 0x7fd3c819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 --2- 172.21.15.12:0/780148210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3c8102040 0x7fd3c819dba0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 >> 172.21.15.12:0/780148210 conn(0x7fd3c80787c0 msgr2=0x7fd3c8100360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 shutdown_connections 2023-12-11T20:14:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:41.827+0000 7fd3cdb46700 1 -- 172.21.15.12:0/780148210 wait complete. 2023-12-11T20:14:42.355 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070501 got 253403070503 for osd.8 2023-12-11T20:14:42.355 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 -- 172.21.15.12:0/588093052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc1076f0 msgr2=0x7f14bc107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/588093052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc1076f0 0x7f14bc107ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009990 tx=0x7f14ac009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 -- 172.21.15.12:0/588093052 shutdown_connections 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/588093052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14bc102040 0x7f14bc10e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/588093052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc1076f0 0x7f14bc107ad0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/588093052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14bc101680 0x7f14bc101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 -- 172.21.15.12:0/588093052 >> 172.21.15.12:0/588093052 conn(0x7f14bc0787c0 msgr2=0x7f14bc078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 -- 172.21.15.12:0/588093052 shutdown_connections 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.531+0000 7f14c1dfc700 1 -- 172.21.15.12:0/588093052 wait complete. 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.532+0000 7f14c1dfc700 1 Processor -- start 2023-12-11T20:14:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.532+0000 7f14c1dfc700 1 -- start start 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14c1dfc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14bc101680 0x7f14bc19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14c1dfc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc102040 0x7f14bc19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14c1dfc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14bc1076f0 0x7f14bc1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14c1dfc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc19a000 con 0x7f14bc102040 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14c1dfc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc19a140 con 0x7f14bc101680 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14c1dfc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc19a300 con 0x7f14bc1076f0 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14baffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc102040 0x7f14bc19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14bb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14bc101680 0x7f14bc19f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14baffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc102040 0x7f14bc19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47180/0 (socket says 172.21.15.12:47180) 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.533+0000 7f14baffd700 1 -- 172.21.15.12:0/1033083968 learned_addr learned my addr 172.21.15.12:0/1033083968 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.534+0000 7f14bbfff700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14bc1076f0 0x7f14bc1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.534+0000 7f14bb7fe700 1 -- 172.21.15.12:0/1033083968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14bc1076f0 msgr2=0x7f14bc1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.534+0000 7f14bb7fe700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14bc1076f0 0x7f14bc1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.534+0000 7f14bb7fe700 1 -- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc102040 msgr2=0x7f14bc19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.534+0000 7f14bb7fe700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc102040 0x7f14bc19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.534+0000 7f14bb7fe700 1 -- 172.21.15.12:0/1033083968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0095f0 con 0x7f14bc101680 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.534+0000 7f14baffd700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc102040 0x7f14bc19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.534+0000 7f14bb7fe700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14bc101680 0x7f14bc19f790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005910 tx=0x7f14ac004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.535+0000 7f14b8ff9700 1 -- 172.21.15.12:0/1033083968 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac01d070 con 0x7f14bc101680 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.535+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc19a580 con 0x7f14bc101680 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.535+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc1a6830 con 0x7f14bc101680 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.535+0000 7f14b8ff9700 1 -- 172.21.15.12:0/1033083968 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14ac022470 con 0x7f14bc101680 2023-12-11T20:14:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.535+0000 7f14b8ff9700 1 -- 172.21.15.12:0/1033083968 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac017650 con 0x7f14bc101680 2023-12-11T20:14:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.536+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc102d10 con 0x7f14bc101680 2023-12-11T20:14:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.538+0000 7f14b8ff9700 1 -- 172.21.15.12:0/1033083968 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f14ac0225e0 con 0x7f14bc101680 2023-12-11T20:14:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.539+0000 7f14b8ff9700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14a40a1510 0x7f14a40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.540+0000 7f14b8ff9700 1 -- 172.21.15.12:0/1033083968 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f14ac0ce190 con 0x7f14bc101680 2023-12-11T20:14:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.540+0000 7f14baffd700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14a40a1510 0x7f14a40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.540+0000 7f14baffd700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14a40a1510 0x7f14a40a39d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14bc075860 tx=0x7f14b0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.544+0000 7f14b8ff9700 1 -- 172.21.15.12:0/1033083968 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f14ac0977d0 con 0x7f14bc101680 2023-12-11T20:14:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:42 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/780148210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-11T20:14:42.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:42 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/780148210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-11T20:14:42.736 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920829 got 141733920831 for osd.4 2023-12-11T20:14:42.736 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:42.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.787+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f14bc19ae80 con 0x7f14bc101680 2023-12-11T20:14:42.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.787+0000 7f14b8ff9700 1 -- 172.21.15.12:0/1033083968 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14ac027090 con 0x7f14bc101680 2023-12-11T20:14:42.787 INFO:teuthology.orchestra.run.smithi012.stdout:107374182468 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14a40a1510 msgr2=0x7f14a40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14a40a1510 0x7f14a40a39d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14bc075860 tx=0x7f14b0009260 comp rx=0 tx=0).stop 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14bc101680 msgr2=0x7f14bc19f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14bc101680 0x7f14bc19f790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005910 tx=0x7f14ac004730 comp rx=0 tx=0).stop 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 shutdown_connections 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14a40a1510 0x7f14a40a39d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14bc101680 0x7f14bc19f790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14bc1076f0 0x7f14bc1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 --2- 172.21.15.12:0/1033083968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14bc102040 0x7f14bc19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 >> 172.21.15.12:0/1033083968 conn(0x7f14bc0787c0 msgr2=0x7f14bc1001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:42.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 shutdown_connections 2023-12-11T20:14:42.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:42.790+0000 7f14c1dfc700 1 -- 172.21.15.12:0/1033083968 wait complete. 2023-12-11T20:14:42.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:42 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/780148210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-11T20:14:43.026 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495664 got 197568495667 for osd.6 2023-12-11T20:14:43.026 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:43.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182465 got 107374182468 for osd.3 2023-12-11T20:14:43.410 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.675+0000 7fa9a7030700 1 -- 172.21.15.12:0/3150214572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 msgr2=0x7fa9a0107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.675+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3150214572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 0x7fa9a0107ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa994009990 tx=0x7fa994009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.675+0000 7fa9a7030700 1 -- 172.21.15.12:0/3150214572 shutdown_connections 2023-12-11T20:14:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.675+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3150214572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a0102040 0x7fa9a010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.675+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3150214572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 0x7fa9a0107ad0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.675+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3150214572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a0101680 0x7fa9a0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.675+0000 7fa9a7030700 1 -- 172.21.15.12:0/3150214572 >> 172.21.15.12:0/3150214572 conn(0x7fa9a00787c0 msgr2=0x7fa9a0078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.676+0000 7fa9a7030700 1 -- 172.21.15.12:0/3150214572 shutdown_connections 2023-12-11T20:14:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.676+0000 7fa9a7030700 1 -- 172.21.15.12:0/3150214572 wait complete. 2023-12-11T20:14:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a7030700 1 Processor -- start 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a7030700 1 -- start start 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a7030700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a0101680 0x7fa9a019f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a7030700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a0102040 0x7fa9a019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a7030700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 0x7fa9a0199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a7030700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a019a090 con 0x7fa9a01076f0 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a7030700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a019a200 con 0x7fa9a0101680 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a7030700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a019a3c0 con 0x7fa9a0102040 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a55cd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 0x7fa9a0199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a55cd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 0x7fa9a0199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47208/0 (socket says 172.21.15.12:47208) 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.677+0000 7fa9a55cd700 1 -- 172.21.15.12:0/3467554997 learned_addr learned my addr 172.21.15.12:0/3467554997 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa99ffff700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a0102040 0x7fa9a019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa9a4dcc700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a0101680 0x7fa9a019f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa9a55cd700 1 -- 172.21.15.12:0/3467554997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a0102040 msgr2=0x7fa9a019fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa9a55cd700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a0102040 0x7fa9a019fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa9a55cd700 1 -- 172.21.15.12:0/3467554997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a0101680 msgr2=0x7fa9a019f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa9a55cd700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a0101680 0x7fa9a019f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa9a55cd700 1 -- 172.21.15.12:0/3467554997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9940095f0 con 0x7fa9a01076f0 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa9a55cd700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 0x7fa9a0199a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa998007f10 tx=0x7fa99800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa99dffb700 1 -- 172.21.15.12:0/3467554997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998009ea0 con 0x7fa9a01076f0 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa99dffb700 1 -- 172.21.15.12:0/3467554997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa99800f040 con 0x7fa9a01076f0 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a019a6a0 con 0x7fa9a01076f0 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.678+0000 7fa99dffb700 1 -- 172.21.15.12:0/3467554997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998004640 con 0x7fa9a01076f0 2023-12-11T20:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.679+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a01a68e0 con 0x7fa9a01076f0 2023-12-11T20:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.680+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a0104940 con 0x7fa9a01076f0 2023-12-11T20:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.682+0000 7fa99dffb700 1 -- 172.21.15.12:0/3467554997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fa9980047a0 con 0x7fa9a01076f0 2023-12-11T20:14:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.684+0000 7fa99dffb700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9900a1590 0x7fa9900a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.684+0000 7fa99dffb700 1 -- 172.21.15.12:0/3467554997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fa9980cc610 con 0x7fa9a01076f0 2023-12-11T20:14:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.684+0000 7fa9a4dcc700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9900a1590 0x7fa9900a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.685+0000 7fa9a4dcc700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9900a1590 0x7fa9900a3a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa99400b5c0 tx=0x7fa994005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.688+0000 7fa99dffb700 1 -- 172.21.15.12:0/3467554997 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa99804f2f0 con 0x7fa9a01076f0 2023-12-11T20:14:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:43 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1033083968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-11T20:14:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:43 smithi032 ceph-mon[132488]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2023-12-11T20:14:43.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:43 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1033083968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-11T20:14:43.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:43 smithi039 ceph-mon[102205]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2023-12-11T20:14:43.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:43 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1033083968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-11T20:14:43.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:43 smithi012 ceph-mon[128787]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2023-12-11T20:14:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.900+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fa9a0102d10 con 0x7fa9a01076f0 2023-12-11T20:14:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.900+0000 7fa99dffb700 1 -- 172.21.15.12:0/3467554997 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fa998095aa0 con 0x7fa9a01076f0 2023-12-11T20:14:43.899 INFO:teuthology.orchestra.run.smithi012.stdout:343597383704 2023-12-11T20:14:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9900a1590 msgr2=0x7fa9900a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9900a1590 0x7fa9900a3a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa99400b5c0 tx=0x7fa994005fb0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 msgr2=0x7fa9a0199a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 0x7fa9a0199a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa998007f10 tx=0x7fa99800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 shutdown_connections 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa9900a1590 0x7fa9900a3a50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9a0101680 0x7fa9a019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9a01076f0 0x7fa9a0199a30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.902+0000 7fa9a7030700 1 --2- 172.21.15.12:0/3467554997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9a0102040 0x7fa9a019fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.903+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 >> 172.21.15.12:0/3467554997 conn(0x7fa9a00787c0 msgr2=0x7fa9a010cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.903+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 shutdown_connections 2023-12-11T20:14:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:43.903+0000 7fa9a7030700 1 -- 172.21.15.12:0/3467554997 wait complete. 2023-12-11T20:14:44.400 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383702 got 343597383704 for osd.11 2023-12-11T20:14:44.400 DEBUG:teuthology.parallel:result is None 2023-12-11T20:14:44.401 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-11T20:14:44.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-11T20:14:44.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:44 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3467554997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-11T20:14:44.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:44 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3467554997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-11T20:14:44.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:44 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3467554997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-11T20:14:45.189 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:45.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:45 smithi032 ceph-mon[132488]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:45.747 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:45 smithi012 ceph-mon[128787]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:45.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:45 smithi039 ceph-mon[102205]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 -- 172.21.15.12:0/2357246130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4074120 msgr2=0x7f12d410daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 --2- 172.21.15.12:0/2357246130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4074120 0x7f12d410daf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f12c4009990 tx=0x7f12c4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 -- 172.21.15.12:0/2357246130 shutdown_connections 2023-12-11T20:14:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 --2- 172.21.15.12:0/2357246130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d410e030 0x7f12d4110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 --2- 172.21.15.12:0/2357246130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d4073800 0x7f12d4073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 --2- 172.21.15.12:0/2357246130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4074120 0x7f12d410daf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 -- 172.21.15.12:0/2357246130 >> 172.21.15.12:0/2357246130 conn(0x7f12d40787c0 msgr2=0x7f12d4078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 -- 172.21.15.12:0/2357246130 shutdown_connections 2023-12-11T20:14:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.808+0000 7f12dbdba700 1 -- 172.21.15.12:0/2357246130 wait complete. 2023-12-11T20:14:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.809+0000 7f12dbdba700 1 Processor -- start 2023-12-11T20:14:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.809+0000 7f12dbdba700 1 -- start start 2023-12-11T20:14:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12dbdba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4073800 0x7f12d419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12dbdba700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d4074120 0x7f12d419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12dbdba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d410e030 0x7f12d4199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:46.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12dbdba700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4199ff0 con 0x7f12d4073800 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12dbdba700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d419a160 con 0x7f12d4074120 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12dbdba700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d419a320 con 0x7f12d410e030 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9b56700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4073800 0x7f12d419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9b56700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4073800 0x7f12d419f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47228/0 (socket says 172.21.15.12:47228) 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9b56700 1 -- 172.21.15.12:0/86832514 learned_addr learned my addr 172.21.15.12:0/86832514 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9355700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d4074120 0x7f12d419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12da357700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d410e030 0x7f12d4199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9b56700 1 -- 172.21.15.12:0/86832514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d410e030 msgr2=0x7f12d4199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9b56700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d410e030 0x7f12d4199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9b56700 1 -- 172.21.15.12:0/86832514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d4074120 msgr2=0x7f12d419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9b56700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d4074120 0x7f12d419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.810+0000 7f12d9b56700 1 -- 172.21.15.12:0/86832514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c40095f0 con 0x7f12d4073800 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.811+0000 7f12d9b56700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4073800 0x7f12d419f850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12d000d980 tx=0x7f12d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.811+0000 7f12caffd700 1 -- 172.21.15.12:0/86832514 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0004a30 con 0x7f12d4073800 2023-12-11T20:14:46.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.811+0000 7f12caffd700 1 -- 172.21.15.12:0/86832514 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12d00054b0 con 0x7f12d4073800 2023-12-11T20:14:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.811+0000 7f12caffd700 1 -- 172.21.15.12:0/86832514 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0009bf0 con 0x7f12d4073800 2023-12-11T20:14:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.811+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d419a600 con 0x7f12d4073800 2023-12-11T20:14:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.811+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d41a6840 con 0x7f12d4073800 2023-12-11T20:14:46.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.812+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d4109240 con 0x7f12d4073800 2023-12-11T20:14:46.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.814+0000 7f12caffd700 1 -- 172.21.15.12:0/86832514 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f12d0009d50 con 0x7f12d4073800 2023-12-11T20:14:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.816+0000 7f12caffd700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c00a1510 0x7f12c00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:46.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.816+0000 7f12caffd700 1 -- 172.21.15.12:0/86832514 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f12d00cce10 con 0x7f12d4073800 2023-12-11T20:14:46.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.816+0000 7f12d9355700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c00a1510 0x7f12c00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:46.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.816+0000 7f12d9355700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c00a1510 0x7f12c00a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f12d419ab50 tx=0x7f12c4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:46.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:46.820+0000 7f12caffd700 1 -- 172.21.15.12:0/86832514 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f12d00d0030 con 0x7f12d4073800 2023-12-11T20:14:47.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.025+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12d404f300 con 0x7f12c00a1510 2023-12-11T20:14:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.037+0000 7f12caffd700 1 -- 172.21.15.12:0/86832514 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338630 (secure 0 0 0) 0x7f12d404f300 con 0x7f12c00a1510 2023-12-11T20:14:47.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.041+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c00a1510 msgr2=0x7f12c00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.041+0000 7f12dbdba700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c00a1510 0x7f12c00a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f12d419ab50 tx=0x7f12c4005fb0 comp rx=0 tx=0).stop 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.041+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4073800 msgr2=0x7f12d419f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.041+0000 7f12dbdba700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4073800 0x7f12d419f850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12d000d980 tx=0x7f12d000dc90 comp rx=0 tx=0).stop 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.042+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 shutdown_connections 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.042+0000 7f12dbdba700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12c00a1510 0x7f12c00a39d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.042+0000 7f12dbdba700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12d410e030 0x7f12d4199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.042+0000 7f12dbdba700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d4073800 0x7f12d419f850 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.042+0000 7f12dbdba700 1 --2- 172.21.15.12:0/86832514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d4074120 0x7f12d419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.042+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 >> 172.21.15.12:0/86832514 conn(0x7f12d40787c0 msgr2=0x7f12d40fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.042+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 shutdown_connections 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:47.042+0000 7f12dbdba700 1 -- 172.21.15.12:0/86832514 wait complete. 2023-12-11T20:14:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-12-11T20:14:47.478 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2023-12-11T20:14:45.044270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655011,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":416,"num_read_kb":319,"num_write":333,"num_write_kb":3045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2951963,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335796,"kb_used_data":11548,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606028,"statfs":{"total":1151940427776,"available":1151596572672,"internally_reserved":0,"allocated":11825152,"data_stored":7429366,"data_compressed":179850,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":331855162},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003452"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530023+0000","last_change":"2023-12-11T20:13:53.282384+0000","last_active":"2023-12-11T20:14:03.530023+0000","last_peered":"2023-12-11T20:14:03.530023+0000","last_clean":"2023-12-11T20:14:03.530023+0000","last_became_active":"2023-12-11T20:13:53.282058+0000","last_became_peered":"2023-12-11T20:13:53.282058+0000","last_unstale":"2023-12-11T20:14:03.530023+0000","last_undegraded":"2023-12-11T20:14:03.530023+0000","last_fullsized":"2023-12-11T20:14:03.530023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:23:31.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530727+0000","last_change":"2023-12-11T20:13:53.282283+0000","last_active":"2023-12-11T20:14:03.530727+0000","last_peered":"2023-12-11T20:14:03.530727+0000","last_clean":"2023-12-11T20:14:03.530727+0000","last_became_active":"2023-12-11T20:13:53.278054+0000","last_became_peered":"2023-12-11T20:13:53.278054+0000","last_unstale":"2023-12-11T20:14:03.530727+0000","last_undegraded":"2023-12-11T20:14:03.530727+0000","last_fullsized":"2023-12-11T20:14:03.530727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:07:50.194732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530417+0000","last_change":"2023-12-11T20:13:53.277704+0000","last_active":"2023-12-11T20:14:03.530417+0000","last_peered":"2023-12-11T20:14:03.530417+0000","last_clean":"2023-12-11T20:14:03.530417+0000","last_became_active":"2023-12-11T20:13:53.277395+0000","last_became_peered":"2023-12-11T20:13:53.277395+0000","last_unstale":"2023-12-11T20:14:03.530417+0000","last_undegraded":"2023-12-11T20:14:03.530417+0000","last_fullsized":"2023-12-11T20:14:03.530417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:54:10.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529912+0000","last_change":"2023-12-11T20:13:53.280854+0000","last_active":"2023-12-11T20:14:03.529912+0000","last_peered":"2023-12-11T20:14:03.529912+0000","last_clean":"2023-12-11T20:14:03.529912+0000","last_became_active":"2023-12-11T20:13:53.277275+0000","last_became_peered":"2023-12-11T20:13:53.277275+0000","last_unstale":"2023-12-11T20:14:03.529912+0000","last_undegraded":"2023-12-11T20:14:03.529912+0000","last_fullsized":"2023-12-11T20:14:03.529912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:32:58.001015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.533768+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:14:03.533768+0000","last_peered":"2023-12-11T20:14:03.533768+0000","last_clean":"2023-12-11T20:14:03.533768+0000","last_became_active":"2023-12-11T20:13:53.281659+0000","last_became_peered":"2023-12-11T20:13:53.281659+0000","last_unstale":"2023-12-11T20:14:03.533768+0000","last_undegraded":"2023-12-11T20:14:03.533768+0000","last_fullsized":"2023-12-11T20:14:03.533768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:47:20.764823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531566+0000","last_change":"2023-12-11T20:13:53.284175+0000","last_active":"2023-12-11T20:14:03.531566+0000","last_peered":"2023-12-11T20:14:03.531566+0000","last_clean":"2023-12-11T20:14:03.531566+0000","last_became_active":"2023-12-11T20:13:53.283801+0000","last_became_peered":"2023-12-11T20:13:53.283801+0000","last_unstale":"2023-12-11T20:14:03.531566+0000","last_undegraded":"2023-12-11T20:14:03.531566+0000","last_fullsized":"2023-12-11T20:14:03.531566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:35.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525576+0000","last_change":"2023-12-11T20:13:53.262700+0000","last_active":"2023-12-11T20:14:03.525576+0000","last_peered":"2023-12-11T20:14:03.525576+0000","last_clean":"2023-12-11T20:14:03.525576+0000","last_became_active":"2023-12-11T20:13:53.262322+0000","last_became_peered":"2023-12-11T20:13:53.262322+0000","last_unstale":"2023-12-11T20:14:03.525576+0000","last_undegraded":"2023-12-11T20:14:03.525576+0000","last_fullsized":"2023-12-11T20:14:03.525576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:02:47.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.764415+0000","last_change":"2023-12-11T20:14:04.763447+0000","last_active":"2023-12-11T20:14:04.764415+0000","last_peered":"2023-12-11T20:14:04.764415+0000","last_clean":"2023-12-11T20:14:04.764415+0000","last_became_active":"2023-12-11T20:14:04.763036+0000","last_became_peered":"2023-12-11T20:14:04.763036+0000","last_unstale":"2023-12-11T20:14:04.764415+0000","last_undegraded":"2023-12-11T20:14:04.764415+0000","last_fullsized":"2023-12-11T20:14:04.764415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:48.188993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523444+0000","last_change":"2023-12-11T20:13:53.277384+0000","last_active":"2023-12-11T20:14:03.523444+0000","last_peered":"2023-12-11T20:14:03.523444+0000","last_clean":"2023-12-11T20:14:03.523444+0000","last_became_active":"2023-12-11T20:13:53.277017+0000","last_became_peered":"2023-12-11T20:13:53.277017+0000","last_unstale":"2023-12-11T20:14:03.523444+0000","last_undegraded":"2023-12-11T20:14:03.523444+0000","last_fullsized":"2023-12-11T20:14:03.523444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:04:50.820269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531949+0000","last_change":"2023-12-11T20:13:53.285340+0000","last_active":"2023-12-11T20:14:03.531949+0000","last_peered":"2023-12-11T20:14:03.531949+0000","last_clean":"2023-12-11T20:14:03.531949+0000","last_became_active":"2023-12-11T20:13:53.285040+0000","last_became_peered":"2023-12-11T20:13:53.285040+0000","last_unstale":"2023-12-11T20:14:03.531949+0000","last_undegraded":"2023-12-11T20:14:03.531949+0000","last_fullsized":"2023-12-11T20:14:03.531949+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:52:53.312236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526270+0000","last_change":"2023-12-11T20:13:53.274637+0000","last_active":"2023-12-11T20:14:03.526270+0000","last_peered":"2023-12-11T20:14:03.526270+0000","last_clean":"2023-12-11T20:14:03.526270+0000","last_became_active":"2023-12-11T20:13:53.270971+0000","last_became_peered":"2023-12-11T20:13:53.270971+0000","last_unstale":"2023-12-11T20:14:03.526270+0000","last_undegraded":"2023-12-11T20:14:03.526270+0000","last_fullsized":"2023-12-11T20:14:03.526270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:20:35.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529815+0000","last_change":"2023-12-11T20:13:53.280712+0000","last_active":"2023-12-11T20:14:03.529815+0000","last_peered":"2023-12-11T20:14:03.529815+0000","last_clean":"2023-12-11T20:14:03.529815+0000","last_became_active":"2023-12-11T20:13:53.276873+0000","last_became_peered":"2023-12-11T20:13:53.276873+0000","last_unstale":"2023-12-11T20:14:03.529815+0000","last_undegraded":"2023-12-11T20:14:03.529815+0000","last_fullsized":"2023-12-11T20:14:03.529815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:36:08.438862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523794+0000","last_change":"2023-12-11T20:13:53.272378+0000","last_active":"2023-12-11T20:14:03.523794+0000","last_peered":"2023-12-11T20:14:03.523794+0000","last_clean":"2023-12-11T20:14:03.523794+0000","last_became_active":"2023-12-11T20:13:53.271992+0000","last_became_peered":"2023-12-11T20:13:53.271992+0000","last_unstale":"2023-12-11T20:14:03.523794+0000","last_undegraded":"2023-12-11T20:14:03.523794+0000","last_fullsized":"2023-12-11T20:14:03.523794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:01:05.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529629+0000","last_change":"2023-12-11T20:13:53.275078+0000","last_active":"2023-12-11T20:14:03.529629+0000","last_peered":"2023-12-11T20:14:03.529629+0000","last_clean":"2023-12-11T20:14:03.529629+0000","last_became_active":"2023-12-11T20:13:53.273555+0000","last_became_peered":"2023-12-11T20:13:53.273555+0000","last_unstale":"2023-12-11T20:14:03.529629+0000","last_undegraded":"2023-12-11T20:14:03.529629+0000","last_fullsized":"2023-12-11T20:14:03.529629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:23:27.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529664+0000","last_change":"2023-12-11T20:13:53.277135+0000","last_active":"2023-12-11T20:14:03.529664+0000","last_peered":"2023-12-11T20:14:03.529664+0000","last_clean":"2023-12-11T20:14:03.529664+0000","last_became_active":"2023-12-11T20:13:53.276406+0000","last_became_peered":"2023-12-11T20:13:53.276406+0000","last_unstale":"2023-12-11T20:14:03.529664+0000","last_undegraded":"2023-12-11T20:14:03.529664+0000","last_fullsized":"2023-12-11T20:14:03.529664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:20.508685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.522774+0000","last_change":"2023-12-11T20:13:53.268845+0000","last_active":"2023-12-11T20:14:03.522774+0000","last_peered":"2023-12-11T20:14:03.522774+0000","last_clean":"2023-12-11T20:14:03.522774+0000","last_became_active":"2023-12-11T20:13:53.268553+0000","last_became_peered":"2023-12-11T20:13:53.268553+0000","last_unstale":"2023-12-11T20:14:03.522774+0000","last_undegraded":"2023-12-11T20:14:03.522774+0000","last_fullsized":"2023-12-11T20:14:03.522774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:55.125792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530340+0000","last_change":"2023-12-11T20:13:53.284361+0000","last_active":"2023-12-11T20:14:03.530340+0000","last_peered":"2023-12-11T20:14:03.530340+0000","last_clean":"2023-12-11T20:14:03.530340+0000","last_became_active":"2023-12-11T20:13:53.282109+0000","last_became_peered":"2023-12-11T20:13:53.282109+0000","last_unstale":"2023-12-11T20:14:03.530340+0000","last_undegraded":"2023-12-11T20:14:03.530340+0000","last_fullsized":"2023-12-11T20:14:03.530340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:44:50.021737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530178+0000","last_change":"2023-12-11T20:13:53.274005+0000","last_active":"2023-12-11T20:14:03.530178+0000","last_peered":"2023-12-11T20:14:03.530178+0000","last_clean":"2023-12-11T20:14:03.530178+0000","last_became_active":"2023-12-11T20:13:53.273336+0000","last_became_peered":"2023-12-11T20:13:53.273336+0000","last_unstale":"2023-12-11T20:14:03.530178+0000","last_undegraded":"2023-12-11T20:14:03.530178+0000","last_fullsized":"2023-12-11T20:14:03.530178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:56:05.732607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531344+0000","last_change":"2023-12-11T20:13:53.280909+0000","last_active":"2023-12-11T20:14:03.531344+0000","last_peered":"2023-12-11T20:14:03.531344+0000","last_clean":"2023-12-11T20:14:03.531344+0000","last_became_active":"2023-12-11T20:13:53.278124+0000","last_became_peered":"2023-12-11T20:13:53.278124+0000","last_unstale":"2023-12-11T20:14:03.531344+0000","last_undegraded":"2023-12-11T20:14:03.531344+0000","last_fullsized":"2023-12-11T20:14:03.531344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:09:19.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530175+0000","last_change":"2023-12-11T20:13:52.478685+0000","last_active":"2023-12-11T20:14:03.530175+0000","last_peered":"2023-12-11T20:14:03.530175+0000","last_clean":"2023-12-11T20:14:03.530175+0000","last_became_active":"2023-12-11T20:13:52.478391+0000","last_became_peered":"2023-12-11T20:13:52.478391+0000","last_unstale":"2023-12-11T20:14:03.530175+0000","last_undegraded":"2023-12-11T20:14:03.530175+0000","last_fullsized":"2023-12-11T20:14:03.530175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:02:54.039954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524734+0000","last_change":"2023-12-11T20:13:53.279432+0000","last_active":"2023-12-11T20:14:03.524734+0000","last_peered":"2023-12-11T20:14:03.524734+0000","last_clean":"2023-12-11T20:14:03.524734+0000","last_became_active":"2023-12-11T20:13:53.279087+0000","last_became_peered":"2023-12-11T20:13:53.279087+0000","last_unstale":"2023-12-11T20:14:03.524734+0000","last_undegraded":"2023-12-11T20:14:03.524734+0000","last_fullsized":"2023-12-11T20:14:03.524734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.376941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524737+0000","last_change":"2023-12-11T20:13:52.485170+0000","last_active":"2023-12-11T20:14:03.524737+0000","last_peered":"2023-12-11T20:14:03.524737+0000","last_clean":"2023-12-11T20:14:03.524737+0000","last_became_active":"2023-12-11T20:13:52.484885+0000","last_became_peered":"2023-12-11T20:13:52.484885+0000","last_unstale":"2023-12-11T20:14:03.524737+0000","last_undegraded":"2023-12-11T20:14:03.524737+0000","last_fullsized":"2023-12-11T20:14:03.524737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:21:40.746709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.537069+0000","last_change":"2023-12-11T20:13:53.274015+0000","last_active":"2023-12-11T20:14:03.537069+0000","last_peered":"2023-12-11T20:14:03.537069+0000","last_clean":"2023-12-11T20:14:03.537069+0000","last_became_active":"2023-12-11T20:13:53.272504+0000","last_became_peered":"2023-12-11T20:13:53.272504+0000","last_unstale":"2023-12-11T20:14:03.537069+0000","last_undegraded":"2023-12-11T20:14:03.537069+0000","last_fullsized":"2023-12-11T20:14:03.537069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:26.155659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.561173+0000","last_change":"2023-12-11T20:14:04.560730+0000","last_active":"2023-12-11T20:14:04.561173+0000","last_peered":"2023-12-11T20:14:04.561173+0000","last_clean":"2023-12-11T20:14:04.561173+0000","last_became_active":"2023-12-11T20:14:04.549828+0000","last_became_peered":"2023-12-11T20:14:04.549828+0000","last_unstale":"2023-12-11T20:14:04.561173+0000","last_undegraded":"2023-12-11T20:14:04.561173+0000","last_fullsized":"2023-12-11T20:14:04.561173+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:47:10.046705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.522932+0000","last_change":"2023-12-11T20:13:53.268907+0000","last_active":"2023-12-11T20:14:03.522932+0000","last_peered":"2023-12-11T20:14:03.522932+0000","last_clean":"2023-12-11T20:14:03.522932+0000","last_became_active":"2023-12-11T20:13:53.268494+0000","last_became_peered":"2023-12-11T20:13:53.268494+0000","last_unstale":"2023-12-11T20:14:03.522932+0000","last_undegraded":"2023-12-11T20:14:03.522932+0000","last_fullsized":"2023-12-11T20:14:03.522932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:57:36.104687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.534274+0000","last_change":"2023-12-11T20:13:52.475425+0000","last_active":"2023-12-11T20:14:03.534274+0000","last_peered":"2023-12-11T20:14:03.534274+0000","last_clean":"2023-12-11T20:14:03.534274+0000","last_became_active":"2023-12-11T20:13:52.475066+0000","last_became_peered":"2023-12-11T20:13:52.475066+0000","last_unstale":"2023-12-11T20:14:03.534274+0000","last_undegraded":"2023-12-11T20:14:03.534274+0000","last_fullsized":"2023-12-11T20:14:03.534274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:01:01.603043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.546865+0000","last_change":"2023-12-11T20:14:04.546865+0000","last_active":"2023-12-11T20:14:04.546865+0000","last_peered":"2023-12-11T20:14:04.546865+0000","last_clean":"2023-12-11T20:14:04.546865+0000","last_became_active":"2023-12-11T20:14:04.546475+0000","last_became_peered":"2023-12-11T20:14:04.546475+0000","last_unstale":"2023-12-11T20:14:04.546865+0000","last_undegraded":"2023-12-11T20:14:04.546865+0000","last_fullsized":"2023-12-11T20:14:04.546865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:54.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:42.338683+0000","last_change":"2023-12-11T20:13:52.481648+0000","last_active":"2023-12-11T20:14:42.338683+0000","last_peered":"2023-12-11T20:14:42.338683+0000","last_clean":"2023-12-11T20:14:42.338683+0000","last_became_active":"2023-12-11T20:13:52.481317+0000","last_became_peered":"2023-12-11T20:13:52.481317+0000","last_unstale":"2023-12-11T20:14:42.338683+0000","last_undegraded":"2023-12-11T20:14:42.338683+0000","last_fullsized":"2023-12-11T20:14:42.338683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:30:32.206757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1011,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.533990+0000","last_change":"2023-12-11T20:13:53.261350+0000","last_active":"2023-12-11T20:14:03.533990+0000","last_peered":"2023-12-11T20:14:03.533990+0000","last_clean":"2023-12-11T20:14:03.533990+0000","last_became_active":"2023-12-11T20:13:53.260471+0000","last_became_peered":"2023-12-11T20:13:53.260471+0000","last_unstale":"2023-12-11T20:14:03.533990+0000","last_undegraded":"2023-12-11T20:14:03.533990+0000","last_fullsized":"2023-12-11T20:14:03.533990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:27.844329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531502+0000","last_change":"2023-12-11T20:13:52.482190+0000","last_active":"2023-12-11T20:14:03.531502+0000","last_peered":"2023-12-11T20:14:03.531502+0000","last_clean":"2023-12-11T20:14:03.531502+0000","last_became_active":"2023-12-11T20:13:52.481758+0000","last_became_peered":"2023-12-11T20:13:52.481758+0000","last_unstale":"2023-12-11T20:14:03.531502+0000","last_undegraded":"2023-12-11T20:14:03.531502+0000","last_fullsized":"2023-12-11T20:14:03.531502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:26.226338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526862+0000","last_change":"2023-12-11T20:13:53.279366+0000","last_active":"2023-12-11T20:14:03.526862+0000","last_peered":"2023-12-11T20:14:03.526862+0000","last_clean":"2023-12-11T20:14:03.526862+0000","last_became_active":"2023-12-11T20:13:53.279074+0000","last_became_peered":"2023-12-11T20:13:53.279074+0000","last_unstale":"2023-12-11T20:14:03.526862+0000","last_undegraded":"2023-12-11T20:14:03.526862+0000","last_fullsized":"2023-12-11T20:14:03.526862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:37.856345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523503+0000","last_change":"2023-12-11T20:13:52.480830+0000","last_active":"2023-12-11T20:14:03.523503+0000","last_peered":"2023-12-11T20:14:03.523503+0000","last_clean":"2023-12-11T20:14:03.523503+0000","last_became_active":"2023-12-11T20:13:52.480359+0000","last_became_peered":"2023-12-11T20:13:52.480359+0000","last_unstale":"2023-12-11T20:14:03.523503+0000","last_undegraded":"2023-12-11T20:14:03.523503+0000","last_fullsized":"2023-12-11T20:14:03.523503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:13.756411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524157+0000","last_change":"2023-12-11T20:13:53.275587+0000","last_active":"2023-12-11T20:14:03.524157+0000","last_peered":"2023-12-11T20:14:03.524157+0000","last_clean":"2023-12-11T20:14:03.524157+0000","last_became_active":"2023-12-11T20:13:53.275014+0000","last_became_peered":"2023-12-11T20:13:53.275014+0000","last_unstale":"2023-12-11T20:14:03.524157+0000","last_undegraded":"2023-12-11T20:14:03.524157+0000","last_fullsized":"2023-12-11T20:14:03.524157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:21:23.179714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.550030+0000","last_change":"2023-12-11T20:14:04.548868+0000","last_active":"2023-12-11T20:14:04.550030+0000","last_peered":"2023-12-11T20:14:04.550030+0000","last_clean":"2023-12-11T20:14:04.550030+0000","last_became_active":"2023-12-11T20:14:04.548198+0000","last_became_peered":"2023-12-11T20:14:04.548198+0000","last_unstale":"2023-12-11T20:14:04.550030+0000","last_undegraded":"2023-12-11T20:14:04.550030+0000","last_fullsized":"2023-12-11T20:14:04.550030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:11:16.117241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529916+0000","last_change":"2023-12-11T20:13:53.281254+0000","last_active":"2023-12-11T20:14:03.529916+0000","last_peered":"2023-12-11T20:14:03.529916+0000","last_clean":"2023-12-11T20:14:03.529916+0000","last_became_active":"2023-12-11T20:13:53.278026+0000","last_became_peered":"2023-12-11T20:13:53.278026+0000","last_unstale":"2023-12-11T20:14:03.529916+0000","last_undegraded":"2023-12-11T20:14:03.529916+0000","last_fullsized":"2023-12-11T20:14:03.529916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:25:46.033739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":61,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:39.333219+0000","last_change":"2023-12-11T20:13:52.485136+0000","last_active":"2023-12-11T20:14:39.333219+0000","last_peered":"2023-12-11T20:14:39.333219+0000","last_clean":"2023-12-11T20:14:39.333219+0000","last_became_active":"2023-12-11T20:13:52.484743+0000","last_became_peered":"2023-12-11T20:13:52.484743+0000","last_unstale":"2023-12-11T20:14:39.333219+0000","last_undegraded":"2023-12-11T20:14:39.333219+0000","last_fullsized":"2023-12-11T20:14:39.333219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:50.893360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523217+0000","last_change":"2023-12-11T20:13:53.274566+0000","last_active":"2023-12-11T20:14:03.523217+0000","last_peered":"2023-12-11T20:14:03.523217+0000","last_clean":"2023-12-11T20:14:03.523217+0000","last_became_active":"2023-12-11T20:13:53.273325+0000","last_became_peered":"2023-12-11T20:13:53.273325+0000","last_unstale":"2023-12-11T20:14:03.523217+0000","last_undegraded":"2023-12-11T20:14:03.523217+0000","last_fullsized":"2023-12-11T20:14:03.523217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:29:17.656364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.766961+0000","last_change":"2023-12-11T20:14:04.766961+0000","last_active":"2023-12-11T20:14:04.766961+0000","last_peered":"2023-12-11T20:14:04.766961+0000","last_clean":"2023-12-11T20:14:04.766961+0000","last_became_active":"2023-12-11T20:14:04.763504+0000","last_became_peered":"2023-12-11T20:14:04.763504+0000","last_unstale":"2023-12-11T20:14:04.766961+0000","last_undegraded":"2023-12-11T20:14:04.766961+0000","last_fullsized":"2023-12-11T20:14:04.766961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:50:38.795524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.764089+0000","last_change":"2023-12-11T20:14:04.764089+0000","last_active":"2023-12-11T20:14:04.764089+0000","last_peered":"2023-12-11T20:14:04.764089+0000","last_clean":"2023-12-11T20:14:04.764089+0000","last_became_active":"2023-12-11T20:14:04.763556+0000","last_became_peered":"2023-12-11T20:14:04.763556+0000","last_unstale":"2023-12-11T20:14:04.764089+0000","last_undegraded":"2023-12-11T20:14:04.764089+0000","last_fullsized":"2023-12-11T20:14:04.764089+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:39.851342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526954+0000","last_change":"2023-12-11T20:13:52.486247+0000","last_active":"2023-12-11T20:14:03.526954+0000","last_peered":"2023-12-11T20:14:03.526954+0000","last_clean":"2023-12-11T20:14:03.526954+0000","last_became_active":"2023-12-11T20:13:52.485343+0000","last_became_peered":"2023-12-11T20:13:52.485343+0000","last_unstale":"2023-12-11T20:14:03.526954+0000","last_undegraded":"2023-12-11T20:14:03.526954+0000","last_fullsized":"2023-12-11T20:14:03.526954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:21:46.587858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523142+0000","last_change":"2023-12-11T20:13:53.281264+0000","last_active":"2023-12-11T20:14:03.523142+0000","last_peered":"2023-12-11T20:14:03.523142+0000","last_clean":"2023-12-11T20:14:03.523142+0000","last_became_active":"2023-12-11T20:13:53.280899+0000","last_became_peered":"2023-12-11T20:13:53.280899+0000","last_unstale":"2023-12-11T20:14:03.523142+0000","last_undegraded":"2023-12-11T20:14:03.523142+0000","last_fullsized":"2023-12-11T20:14:03.523142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:17.675421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'27","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:40.347493+0000","last_change":"2023-12-11T20:13:52.475732+0000","last_active":"2023-12-11T20:14:40.347493+0000","last_peered":"2023-12-11T20:14:40.347493+0000","last_clean":"2023-12-11T20:14:40.347493+0000","last_became_active":"2023-12-11T20:13:52.475415+0000","last_became_peered":"2023-12-11T20:13:52.475415+0000","last_unstale":"2023-12-11T20:14:40.347493+0000","last_undegraded":"2023-12-11T20:14:40.347493+0000","last_fullsized":"2023-12-11T20:14:40.347493+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:20:31.539997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60009,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":105,"num_write":28,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.534318+0000","last_change":"2023-12-11T20:13:53.273365+0000","last_active":"2023-12-11T20:14:03.534318+0000","last_peered":"2023-12-11T20:14:03.534318+0000","last_clean":"2023-12-11T20:14:03.534318+0000","last_became_active":"2023-12-11T20:13:53.268456+0000","last_became_peered":"2023-12-11T20:13:53.268456+0000","last_unstale":"2023-12-11T20:14:03.534318+0000","last_undegraded":"2023-12-11T20:14:03.534318+0000","last_fullsized":"2023-12-11T20:14:03.534318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:13.850229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531623+0000","last_change":"2023-12-11T20:13:52.477609+0000","last_active":"2023-12-11T20:14:03.531623+0000","last_peered":"2023-12-11T20:14:03.531623+0000","last_clean":"2023-12-11T20:14:03.531623+0000","last_became_active":"2023-12-11T20:13:52.477177+0000","last_became_peered":"2023-12-11T20:13:52.477177+0000","last_unstale":"2023-12-11T20:14:03.531623+0000","last_undegraded":"2023-12-11T20:14:03.531623+0000","last_fullsized":"2023-12-11T20:14:03.531623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:46.987026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523631+0000","last_change":"2023-12-11T20:13:53.278247+0000","last_active":"2023-12-11T20:14:03.523631+0000","last_peered":"2023-12-11T20:14:03.523631+0000","last_clean":"2023-12-11T20:14:03.523631+0000","last_became_active":"2023-12-11T20:13:53.277928+0000","last_became_peered":"2023-12-11T20:13:53.277928+0000","last_unstale":"2023-12-11T20:14:03.523631+0000","last_undegraded":"2023-12-11T20:14:03.523631+0000","last_fullsized":"2023-12-11T20:14:03.523631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:52:33.864370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526510+0000","last_change":"2023-12-11T20:13:52.485985+0000","last_active":"2023-12-11T20:14:03.526510+0000","last_peered":"2023-12-11T20:14:03.526510+0000","last_clean":"2023-12-11T20:14:03.526510+0000","last_became_active":"2023-12-11T20:13:52.484929+0000","last_became_peered":"2023-12-11T20:13:52.484929+0000","last_unstale":"2023-12-11T20:14:03.526510+0000","last_undegraded":"2023-12-11T20:14:03.526510+0000","last_fullsized":"2023-12-11T20:14:03.526510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T08:11:28.665448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526938+0000","last_change":"2023-12-11T20:13:53.277048+0000","last_active":"2023-12-11T20:14:03.526938+0000","last_peered":"2023-12-11T20:14:03.526938+0000","last_clean":"2023-12-11T20:14:03.526938+0000","last_became_active":"2023-12-11T20:13:53.276706+0000","last_became_peered":"2023-12-11T20:13:53.276706+0000","last_unstale":"2023-12-11T20:14:03.526938+0000","last_undegraded":"2023-12-11T20:14:03.526938+0000","last_fullsized":"2023-12-11T20:14:03.526938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:46.815339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":67,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:41.336173+0000","last_change":"2023-12-11T20:13:52.477814+0000","last_active":"2023-12-11T20:14:41.336173+0000","last_peered":"2023-12-11T20:14:41.336173+0000","last_clean":"2023-12-11T20:14:41.336173+0000","last_became_active":"2023-12-11T20:13:52.477036+0000","last_became_peered":"2023-12-11T20:13:52.477036+0000","last_unstale":"2023-12-11T20:14:41.336173+0000","last_undegraded":"2023-12-11T20:14:41.336173+0000","last_fullsized":"2023-12-11T20:14:41.336173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:53:44.279968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525477+0000","last_change":"2023-12-11T20:13:53.276279+0000","last_active":"2023-12-11T20:14:03.525477+0000","last_peered":"2023-12-11T20:14:03.525477+0000","last_clean":"2023-12-11T20:14:03.525477+0000","last_became_active":"2023-12-11T20:13:53.273638+0000","last_became_peered":"2023-12-11T20:13:53.273638+0000","last_unstale":"2023-12-11T20:14:03.525477+0000","last_undegraded":"2023-12-11T20:14:03.525477+0000","last_fullsized":"2023-12-11T20:14:03.525477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:07:03.289511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.533700+0000","last_change":"2023-12-11T20:13:52.483417+0000","last_active":"2023-12-11T20:14:03.533700+0000","last_peered":"2023-12-11T20:14:03.533700+0000","last_clean":"2023-12-11T20:14:03.533700+0000","last_became_active":"2023-12-11T20:13:52.481395+0000","last_became_peered":"2023-12-11T20:13:52.481395+0000","last_unstale":"2023-12-11T20:14:03.533700+0000","last_undegraded":"2023-12-11T20:14:03.533700+0000","last_fullsized":"2023-12-11T20:14:03.533700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:01:42.053460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525956+0000","last_change":"2023-12-11T20:13:53.280688+0000","last_active":"2023-12-11T20:14:03.525956+0000","last_peered":"2023-12-11T20:14:03.525956+0000","last_clean":"2023-12-11T20:14:03.525956+0000","last_became_active":"2023-12-11T20:13:53.277300+0000","last_became_peered":"2023-12-11T20:13:53.277300+0000","last_unstale":"2023-12-11T20:14:03.525956+0000","last_undegraded":"2023-12-11T20:14:03.525956+0000","last_fullsized":"2023-12-11T20:14:03.525956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:40:58.831909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.534651+0000","last_change":"2023-12-11T20:13:52.474978+0000","last_active":"2023-12-11T20:14:03.534651+0000","last_peered":"2023-12-11T20:14:03.534651+0000","last_clean":"2023-12-11T20:14:03.534651+0000","last_became_active":"2023-12-11T20:13:52.472863+0000","last_became_peered":"2023-12-11T20:13:52.472863+0000","last_unstale":"2023-12-11T20:14:03.534651+0000","last_undegraded":"2023-12-11T20:14:03.534651+0000","last_fullsized":"2023-12-11T20:14:03.534651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:53:44.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530033+0000","last_change":"2023-12-11T20:13:53.285991+0000","last_active":"2023-12-11T20:14:03.530033+0000","last_peered":"2023-12-11T20:14:03.530033+0000","last_clean":"2023-12-11T20:14:03.530033+0000","last_became_active":"2023-12-11T20:13:53.283925+0000","last_became_peered":"2023-12-11T20:13:53.283925+0000","last_unstale":"2023-12-11T20:14:03.530033+0000","last_undegraded":"2023-12-11T20:14:03.530033+0000","last_fullsized":"2023-12-11T20:14:03.530033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:15:48.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530050+0000","last_change":"2023-12-11T20:13:52.478883+0000","last_active":"2023-12-11T20:14:03.530050+0000","last_peered":"2023-12-11T20:14:03.530050+0000","last_clean":"2023-12-11T20:14:03.530050+0000","last_became_active":"2023-12-11T20:13:52.477070+0000","last_became_peered":"2023-12-11T20:13:52.477070+0000","last_unstale":"2023-12-11T20:14:03.530050+0000","last_undegraded":"2023-12-11T20:14:03.530050+0000","last_fullsized":"2023-12-11T20:14:03.530050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:14:32.504778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531860+0000","last_change":"2023-12-11T20:13:53.278181+0000","last_active":"2023-12-11T20:14:03.531860+0000","last_peered":"2023-12-11T20:14:03.531860+0000","last_clean":"2023-12-11T20:14:03.531860+0000","last_became_active":"2023-12-11T20:13:53.277800+0000","last_became_peered":"2023-12-11T20:13:53.277800+0000","last_unstale":"2023-12-11T20:14:03.531860+0000","last_undegraded":"2023-12-11T20:14:03.531860+0000","last_fullsized":"2023-12-11T20:14:03.531860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:35.424820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525796+0000","last_change":"2023-12-11T20:13:52.481281+0000","last_active":"2023-12-11T20:14:03.525796+0000","last_peered":"2023-12-11T20:14:03.525796+0000","last_clean":"2023-12-11T20:14:03.525796+0000","last_became_active":"2023-12-11T20:13:52.479352+0000","last_became_peered":"2023-12-11T20:13:52.479352+0000","last_unstale":"2023-12-11T20:14:03.525796+0000","last_undegraded":"2023-12-11T20:14:03.525796+0000","last_fullsized":"2023-12-11T20:14:03.525796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:41.815011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531573+0000","last_change":"2023-12-11T20:13:53.282233+0000","last_active":"2023-12-11T20:14:03.531573+0000","last_peered":"2023-12-11T20:14:03.531573+0000","last_clean":"2023-12-11T20:14:03.531573+0000","last_became_active":"2023-12-11T20:13:53.279001+0000","last_became_peered":"2023-12-11T20:13:53.279001+0000","last_unstale":"2023-12-11T20:14:03.531573+0000","last_undegraded":"2023-12-11T20:14:03.531573+0000","last_fullsized":"2023-12-11T20:14:03.531573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:30:21.671414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.527164+0000","last_change":"2023-12-11T20:13:53.269361+0000","last_active":"2023-12-11T20:14:03.527164+0000","last_peered":"2023-12-11T20:14:03.527164+0000","last_clean":"2023-12-11T20:14:03.527164+0000","last_became_active":"2023-12-11T20:13:53.268613+0000","last_became_peered":"2023-12-11T20:13:53.268613+0000","last_unstale":"2023-12-11T20:14:03.527164+0000","last_undegraded":"2023-12-11T20:14:03.527164+0000","last_fullsized":"2023-12-11T20:14:03.527164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:08:04.876038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:40.333201+0000","last_change":"2023-12-11T20:13:52.484537+0000","last_active":"2023-12-11T20:14:40.333201+0000","last_peered":"2023-12-11T20:14:40.333201+0000","last_clean":"2023-12-11T20:14:40.333201+0000","last_became_active":"2023-12-11T20:13:52.482732+0000","last_became_peered":"2023-12-11T20:13:52.482732+0000","last_unstale":"2023-12-11T20:14:40.333201+0000","last_undegraded":"2023-12-11T20:14:40.333201+0000","last_fullsized":"2023-12-11T20:14:40.333201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:41:31.332046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524454+0000","last_change":"2023-12-11T20:13:53.270953+0000","last_active":"2023-12-11T20:14:03.524454+0000","last_peered":"2023-12-11T20:14:03.524454+0000","last_clean":"2023-12-11T20:14:03.524454+0000","last_became_active":"2023-12-11T20:13:53.269711+0000","last_became_peered":"2023-12-11T20:13:53.269711+0000","last_unstale":"2023-12-11T20:14:03.524454+0000","last_undegraded":"2023-12-11T20:14:03.524454+0000","last_fullsized":"2023-12-11T20:14:03.524454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:16:50.802953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529699+0000","last_change":"2023-12-11T20:13:52.473341+0000","last_active":"2023-12-11T20:14:03.529699+0000","last_peered":"2023-12-11T20:14:03.529699+0000","last_clean":"2023-12-11T20:14:03.529699+0000","last_became_active":"2023-12-11T20:13:52.469572+0000","last_became_peered":"2023-12-11T20:13:52.469572+0000","last_unstale":"2023-12-11T20:14:03.529699+0000","last_undegraded":"2023-12-11T20:14:03.529699+0000","last_fullsized":"2023-12-11T20:14:03.529699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:52:47.513645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525590+0000","last_change":"2023-12-11T20:12:30.330188+0000","last_active":"2023-12-11T20:14:03.525590+0000","last_peered":"2023-12-11T20:14:03.525590+0000","last_clean":"2023-12-11T20:14:03.525590+0000","last_became_active":"2023-12-11T20:12:30.329533+0000","last_became_peered":"2023-12-11T20:12:30.329533+0000","last_unstale":"2023-12-11T20:14:03.525590+0000","last_undegraded":"2023-12-11T20:14:03.525590+0000","last_fullsized":"2023-12-11T20:14:03.525590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_clean_scrub_stamp":"2023-12-11T20:08:47.558016+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:18:10.357750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523412+0000","last_change":"2023-12-11T20:13:53.278062+0000","last_active":"2023-12-11T20:14:03.523412+0000","last_peered":"2023-12-11T20:14:03.523412+0000","last_clean":"2023-12-11T20:14:03.523412+0000","last_became_active":"2023-12-11T20:13:53.277664+0000","last_became_peered":"2023-12-11T20:13:53.277664+0000","last_unstale":"2023-12-11T20:14:03.523412+0000","last_undegraded":"2023-12-11T20:14:03.523412+0000","last_fullsized":"2023-12-11T20:14:03.523412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:07:38.751486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.550614+0000","last_change":"2023-12-11T20:14:04.550614+0000","last_active":"2023-12-11T20:14:04.550614+0000","last_peered":"2023-12-11T20:14:04.550614+0000","last_clean":"2023-12-11T20:14:04.550614+0000","last_became_active":"2023-12-11T20:14:04.544469+0000","last_became_peered":"2023-12-11T20:14:04.544469+0000","last_unstale":"2023-12-11T20:14:04.550614+0000","last_undegraded":"2023-12-11T20:14:04.550614+0000","last_fullsized":"2023-12-11T20:14:04.550614+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:33.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.534431+0000","last_change":"2023-12-11T20:13:52.478823+0000","last_active":"2023-12-11T20:14:03.534431+0000","last_peered":"2023-12-11T20:14:03.534431+0000","last_clean":"2023-12-11T20:14:03.534431+0000","last_became_active":"2023-12-11T20:13:52.478475+0000","last_became_peered":"2023-12-11T20:13:52.478475+0000","last_unstale":"2023-12-11T20:14:03.534431+0000","last_undegraded":"2023-12-11T20:14:03.534431+0000","last_fullsized":"2023-12-11T20:14:03.534431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:44:36.438152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523651+0000","last_change":"2023-12-11T20:13:53.272496+0000","last_active":"2023-12-11T20:14:03.523651+0000","last_peered":"2023-12-11T20:14:03.523651+0000","last_clean":"2023-12-11T20:14:03.523651+0000","last_became_active":"2023-12-11T20:13:53.271669+0000","last_became_peered":"2023-12-11T20:13:53.271669+0000","last_unstale":"2023-12-11T20:14:03.523651+0000","last_undegraded":"2023-12-11T20:14:03.523651+0000","last_fullsized":"2023-12-11T20:14:03.523651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:48:31.299659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.539961+0000","last_change":"2023-12-11T20:13:52.485866+0000","last_active":"2023-12-11T20:14:04.539961+0000","last_peered":"2023-12-11T20:14:04.539961+0000","last_clean":"2023-12-11T20:14:04.539961+0000","last_became_active":"2023-12-11T20:13:52.485106+0000","last_became_peered":"2023-12-11T20:13:52.485106+0000","last_unstale":"2023-12-11T20:14:04.539961+0000","last_undegraded":"2023-12-11T20:14:04.539961+0000","last_fullsized":"2023-12-11T20:14:04.539961+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:24:41.177294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524733+0000","last_change":"2023-12-11T20:13:53.271737+0000","last_active":"2023-12-11T20:14:03.524733+0000","last_peered":"2023-12-11T20:14:03.524733+0000","last_clean":"2023-12-11T20:14:03.524733+0000","last_became_active":"2023-12-11T20:13:53.271228+0000","last_became_peered":"2023-12-11T20:13:53.271228+0000","last_unstale":"2023-12-11T20:14:03.524733+0000","last_undegraded":"2023-12-11T20:14:03.524733+0000","last_fullsized":"2023-12-11T20:14:03.524733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:45.614455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530437+0000","last_change":"2023-12-11T20:13:52.475488+0000","last_active":"2023-12-11T20:14:03.530437+0000","last_peered":"2023-12-11T20:14:03.530437+0000","last_clean":"2023-12-11T20:14:03.530437+0000","last_became_active":"2023-12-11T20:13:52.475150+0000","last_became_peered":"2023-12-11T20:13:52.475150+0000","last_unstale":"2023-12-11T20:14:03.530437+0000","last_undegraded":"2023-12-11T20:14:03.530437+0000","last_fullsized":"2023-12-11T20:14:03.530437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:42:55.792758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530746+0000","last_change":"2023-12-11T20:13:53.285381+0000","last_active":"2023-12-11T20:14:03.530746+0000","last_peered":"2023-12-11T20:14:03.530746+0000","last_clean":"2023-12-11T20:14:03.530746+0000","last_became_active":"2023-12-11T20:13:53.285069+0000","last_became_peered":"2023-12-11T20:13:53.285069+0000","last_unstale":"2023-12-11T20:14:03.530746+0000","last_undegraded":"2023-12-11T20:14:03.530746+0000","last_fullsized":"2023-12-11T20:14:03.530746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:57:18.630314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.522903+0000","last_change":"2023-12-11T20:13:52.483184+0000","last_active":"2023-12-11T20:14:03.522903+0000","last_peered":"2023-12-11T20:14:03.522903+0000","last_clean":"2023-12-11T20:14:03.522903+0000","last_became_active":"2023-12-11T20:13:52.482853+0000","last_became_peered":"2023-12-11T20:13:52.482853+0000","last_unstale":"2023-12-11T20:14:03.522903+0000","last_undegraded":"2023-12-11T20:14:03.522903+0000","last_fullsized":"2023-12-11T20:14:03.522903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:35.111222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.533766+0000","last_change":"2023-12-11T20:13:53.271751+0000","last_active":"2023-12-11T20:14:03.533766+0000","last_peered":"2023-12-11T20:14:03.533766+0000","last_clean":"2023-12-11T20:14:03.533766+0000","last_became_active":"2023-12-11T20:13:53.271385+0000","last_became_peered":"2023-12-11T20:13:53.271385+0000","last_unstale":"2023-12-11T20:14:03.533766+0000","last_undegraded":"2023-12-11T20:14:03.533766+0000","last_fullsized":"2023-12-11T20:14:03.533766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:28:03.856212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524287+0000","last_change":"2023-12-11T20:13:52.483504+0000","last_active":"2023-12-11T20:14:03.524287+0000","last_peered":"2023-12-11T20:14:03.524287+0000","last_clean":"2023-12-11T20:14:03.524287+0000","last_became_active":"2023-12-11T20:13:52.482796+0000","last_became_peered":"2023-12-11T20:13:52.482796+0000","last_unstale":"2023-12-11T20:14:03.524287+0000","last_undegraded":"2023-12-11T20:14:03.524287+0000","last_fullsized":"2023-12-11T20:14:03.524287+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:34:27.162215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529747+0000","last_change":"2023-12-11T20:13:53.276017+0000","last_active":"2023-12-11T20:14:03.529747+0000","last_peered":"2023-12-11T20:14:03.529747+0000","last_clean":"2023-12-11T20:14:03.529747+0000","last_became_active":"2023-12-11T20:13:53.275425+0000","last_became_peered":"2023-12-11T20:13:53.275425+0000","last_unstale":"2023-12-11T20:14:03.529747+0000","last_undegraded":"2023-12-11T20:14:03.529747+0000","last_fullsized":"2023-12-11T20:14:03.529747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:36.762187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531389+0000","last_change":"2023-12-11T20:13:52.477538+0000","last_active":"2023-12-11T20:14:03.531389+0000","last_peered":"2023-12-11T20:14:03.531389+0000","last_clean":"2023-12-11T20:14:03.531389+0000","last_became_active":"2023-12-11T20:13:52.476937+0000","last_became_peered":"2023-12-11T20:13:52.476937+0000","last_unstale":"2023-12-11T20:14:03.531389+0000","last_undegraded":"2023-12-11T20:14:03.531389+0000","last_fullsized":"2023-12-11T20:14:03.531389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:41:25.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524611+0000","last_change":"2023-12-11T20:13:53.276419+0000","last_active":"2023-12-11T20:14:03.524611+0000","last_peered":"2023-12-11T20:14:03.524611+0000","last_clean":"2023-12-11T20:14:03.524611+0000","last_became_active":"2023-12-11T20:13:53.276106+0000","last_became_peered":"2023-12-11T20:13:53.276106+0000","last_unstale":"2023-12-11T20:14:03.524611+0000","last_undegraded":"2023-12-11T20:14:03.524611+0000","last_fullsized":"2023-12-11T20:14:03.524611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:32.720877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.554132+0000","last_change":"2023-12-11T20:14:04.554132+0000","last_active":"2023-12-11T20:14:04.554132+0000","last_peered":"2023-12-11T20:14:04.554132+0000","last_clean":"2023-12-11T20:14:04.554132+0000","last_became_active":"2023-12-11T20:14:04.546343+0000","last_became_peered":"2023-12-11T20:14:04.546343+0000","last_unstale":"2023-12-11T20:14:04.554132+0000","last_undegraded":"2023-12-11T20:14:04.554132+0000","last_fullsized":"2023-12-11T20:14:04.554132+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:16:37.790659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525955+0000","last_change":"2023-12-11T20:13:53.265917+0000","last_active":"2023-12-11T20:14:03.525955+0000","last_peered":"2023-12-11T20:14:03.525955+0000","last_clean":"2023-12-11T20:14:03.525955+0000","last_became_active":"2023-12-11T20:13:53.265569+0000","last_became_peered":"2023-12-11T20:13:53.265569+0000","last_unstale":"2023-12-11T20:14:03.525955+0000","last_undegraded":"2023-12-11T20:14:03.525955+0000","last_fullsized":"2023-12-11T20:14:03.525955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:37:19.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531843+0000","last_change":"2023-12-11T20:13:52.478688+0000","last_active":"2023-12-11T20:14:03.531843+0000","last_peered":"2023-12-11T20:14:03.531843+0000","last_clean":"2023-12-11T20:14:03.531843+0000","last_became_active":"2023-12-11T20:13:52.477834+0000","last_became_peered":"2023-12-11T20:13:52.477834+0000","last_unstale":"2023-12-11T20:14:03.531843+0000","last_undegraded":"2023-12-11T20:14:03.531843+0000","last_fullsized":"2023-12-11T20:14:03.531843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:57:04.707801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526401+0000","last_change":"2023-12-11T20:13:53.274629+0000","last_active":"2023-12-11T20:14:03.526401+0000","last_peered":"2023-12-11T20:14:03.526401+0000","last_clean":"2023-12-11T20:14:03.526401+0000","last_became_active":"2023-12-11T20:13:53.269650+0000","last_became_peered":"2023-12-11T20:13:53.269650+0000","last_unstale":"2023-12-11T20:14:03.526401+0000","last_undegraded":"2023-12-11T20:14:03.526401+0000","last_fullsized":"2023-12-11T20:14:03.526401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:57:59.865232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526741+0000","last_change":"2023-12-11T20:13:52.485902+0000","last_active":"2023-12-11T20:14:03.526741+0000","last_peered":"2023-12-11T20:14:03.526741+0000","last_clean":"2023-12-11T20:14:03.526741+0000","last_became_active":"2023-12-11T20:13:52.481982+0000","last_became_peered":"2023-12-11T20:13:52.481982+0000","last_unstale":"2023-12-11T20:14:03.526741+0000","last_undegraded":"2023-12-11T20:14:03.526741+0000","last_fullsized":"2023-12-11T20:14:03.526741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:39.411648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.553595+0000","last_change":"2023-12-11T20:14:04.553595+0000","last_active":"2023-12-11T20:14:04.553595+0000","last_peered":"2023-12-11T20:14:04.553595+0000","last_clean":"2023-12-11T20:14:04.553595+0000","last_became_active":"2023-12-11T20:14:04.546235+0000","last_became_peered":"2023-12-11T20:14:04.546235+0000","last_unstale":"2023-12-11T20:14:04.553595+0000","last_undegraded":"2023-12-11T20:14:04.553595+0000","last_fullsized":"2023-12-11T20:14:04.553595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:45:21.354015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523713+0000","last_change":"2023-12-11T20:13:52.486510+0000","last_active":"2023-12-11T20:14:03.523713+0000","last_peered":"2023-12-11T20:14:03.523713+0000","last_clean":"2023-12-11T20:14:03.523713+0000","last_became_active":"2023-12-11T20:13:52.483852+0000","last_became_peered":"2023-12-11T20:13:52.483852+0000","last_unstale":"2023-12-11T20:14:03.523713+0000","last_undegraded":"2023-12-11T20:14:03.523713+0000","last_fullsized":"2023-12-11T20:14:03.523713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:40:05.242000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526137+0000","last_change":"2023-12-11T20:13:53.270545+0000","last_active":"2023-12-11T20:14:03.526137+0000","last_peered":"2023-12-11T20:14:03.526137+0000","last_clean":"2023-12-11T20:14:03.526137+0000","last_became_active":"2023-12-11T20:13:53.270213+0000","last_became_peered":"2023-12-11T20:13:53.270213+0000","last_unstale":"2023-12-11T20:14:03.526137+0000","last_undegraded":"2023-12-11T20:14:03.526137+0000","last_fullsized":"2023-12-11T20:14:03.526137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:35.442471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529557+0000","last_change":"2023-12-11T20:13:53.276886+0000","last_active":"2023-12-11T20:14:03.529557+0000","last_peered":"2023-12-11T20:14:03.529557+0000","last_clean":"2023-12-11T20:14:03.529557+0000","last_became_active":"2023-12-11T20:13:53.276149+0000","last_became_peered":"2023-12-11T20:13:53.276149+0000","last_unstale":"2023-12-11T20:14:03.529557+0000","last_undegraded":"2023-12-11T20:14:03.529557+0000","last_fullsized":"2023-12-11T20:14:03.529557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:34:19.562002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530923+0000","last_change":"2023-12-11T20:13:53.279990+0000","last_active":"2023-12-11T20:14:03.530923+0000","last_peered":"2023-12-11T20:14:03.530923+0000","last_clean":"2023-12-11T20:14:03.530923+0000","last_became_active":"2023-12-11T20:13:53.279685+0000","last_became_peered":"2023-12-11T20:13:53.279685+0000","last_unstale":"2023-12-11T20:14:03.530923+0000","last_undegraded":"2023-12-11T20:14:03.530923+0000","last_fullsized":"2023-12-11T20:14:03.530923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:21:36.526683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530995+0000","last_change":"2023-12-11T20:13:53.279128+0000","last_active":"2023-12-11T20:14:03.530995+0000","last_peered":"2023-12-11T20:14:03.530995+0000","last_clean":"2023-12-11T20:14:03.530995+0000","last_became_active":"2023-12-11T20:13:53.278821+0000","last_became_peered":"2023-12-11T20:13:53.278821+0000","last_unstale":"2023-12-11T20:14:03.530995+0000","last_undegraded":"2023-12-11T20:14:03.530995+0000","last_fullsized":"2023-12-11T20:14:03.530995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:49:36.013115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530152+0000","last_change":"2023-12-11T20:13:53.281004+0000","last_active":"2023-12-11T20:14:03.530152+0000","last_peered":"2023-12-11T20:14:03.530152+0000","last_clean":"2023-12-11T20:14:03.530152+0000","last_became_active":"2023-12-11T20:13:53.280691+0000","last_became_peered":"2023-12-11T20:13:53.280691+0000","last_unstale":"2023-12-11T20:14:03.530152+0000","last_undegraded":"2023-12-11T20:14:03.530152+0000","last_fullsized":"2023-12-11T20:14:03.530152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:00.336975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523682+0000","last_change":"2023-12-11T20:13:53.272690+0000","last_active":"2023-12-11T20:14:03.523682+0000","last_peered":"2023-12-11T20:14:03.523682+0000","last_clean":"2023-12-11T20:14:03.523682+0000","last_became_active":"2023-12-11T20:13:53.272194+0000","last_became_peered":"2023-12-11T20:13:53.272194+0000","last_unstale":"2023-12-11T20:14:03.523682+0000","last_undegraded":"2023-12-11T20:14:03.523682+0000","last_fullsized":"2023-12-11T20:14:03.523682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:58:45.312035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529998+0000","last_change":"2023-12-11T20:13:53.277625+0000","last_active":"2023-12-11T20:14:03.529998+0000","last_peered":"2023-12-11T20:14:03.529998+0000","last_clean":"2023-12-11T20:14:03.529998+0000","last_became_active":"2023-12-11T20:13:53.277174+0000","last_became_peered":"2023-12-11T20:13:53.277174+0000","last_unstale":"2023-12-11T20:14:03.529998+0000","last_undegraded":"2023-12-11T20:14:03.529998+0000","last_fullsized":"2023-12-11T20:14:03.529998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:01:41.057178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.532373+0000","last_change":"2023-12-11T20:13:53.278685+0000","last_active":"2023-12-11T20:14:03.532373+0000","last_peered":"2023-12-11T20:14:03.532373+0000","last_clean":"2023-12-11T20:14:03.532373+0000","last_became_active":"2023-12-11T20:13:53.276894+0000","last_became_peered":"2023-12-11T20:13:53.276894+0000","last_unstale":"2023-12-11T20:14:03.532373+0000","last_undegraded":"2023-12-11T20:14:03.532373+0000","last_fullsized":"2023-12-11T20:14:03.532373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:21:00.004496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524669+0000","last_change":"2023-12-11T20:13:53.285596+0000","last_active":"2023-12-11T20:14:03.524669+0000","last_peered":"2023-12-11T20:14:03.524669+0000","last_clean":"2023-12-11T20:14:03.524669+0000","last_became_active":"2023-12-11T20:13:53.285289+0000","last_became_peered":"2023-12-11T20:13:53.285289+0000","last_unstale":"2023-12-11T20:14:03.524669+0000","last_undegraded":"2023-12-11T20:14:03.524669+0000","last_fullsized":"2023-12-11T20:14:03.524669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:53:59.939751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.527062+0000","last_change":"2023-12-11T20:13:53.272600+0000","last_active":"2023-12-11T20:14:03.527062+0000","last_peered":"2023-12-11T20:14:03.527062+0000","last_clean":"2023-12-11T20:14:03.527062+0000","last_became_active":"2023-12-11T20:13:53.272308+0000","last_became_peered":"2023-12-11T20:13:53.272308+0000","last_unstale":"2023-12-11T20:14:03.527062+0000","last_undegraded":"2023-12-11T20:14:03.527062+0000","last_fullsized":"2023-12-11T20:14:03.527062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.458731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524229+0000","last_change":"2023-12-11T20:13:53.280833+0000","last_active":"2023-12-11T20:14:03.524229+0000","last_peered":"2023-12-11T20:14:03.524229+0000","last_clean":"2023-12-11T20:14:03.524229+0000","last_became_active":"2023-12-11T20:13:53.280384+0000","last_became_peered":"2023-12-11T20:13:53.280384+0000","last_unstale":"2023-12-11T20:14:03.524229+0000","last_undegraded":"2023-12-11T20:14:03.524229+0000","last_fullsized":"2023-12-11T20:14:03.524229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:37:38.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.522928+0000","last_change":"2023-12-11T20:13:53.271825+0000","last_active":"2023-12-11T20:14:03.522928+0000","last_peered":"2023-12-11T20:14:03.522928+0000","last_clean":"2023-12-11T20:14:03.522928+0000","last_became_active":"2023-12-11T20:13:53.271460+0000","last_became_peered":"2023-12-11T20:13:53.271460+0000","last_unstale":"2023-12-11T20:14:03.522928+0000","last_undegraded":"2023-12-11T20:14:03.522928+0000","last_fullsized":"2023-12-11T20:14:03.522928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:46:46.147904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523799+0000","last_change":"2023-12-11T20:13:53.270103+0000","last_active":"2023-12-11T20:14:03.523799+0000","last_peered":"2023-12-11T20:14:03.523799+0000","last_clean":"2023-12-11T20:14:03.523799+0000","last_became_active":"2023-12-11T20:13:53.269781+0000","last_became_peered":"2023-12-11T20:13:53.269781+0000","last_unstale":"2023-12-11T20:14:03.523799+0000","last_undegraded":"2023-12-11T20:14:03.523799+0000","last_fullsized":"2023-12-11T20:14:03.523799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.865347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529183+0000","last_change":"2023-12-11T20:13:53.284310+0000","last_active":"2023-12-11T20:14:03.529183+0000","last_peered":"2023-12-11T20:14:03.529183+0000","last_clean":"2023-12-11T20:14:03.529183+0000","last_became_active":"2023-12-11T20:13:53.283969+0000","last_became_peered":"2023-12-11T20:13:53.283969+0000","last_unstale":"2023-12-11T20:14:03.529183+0000","last_undegraded":"2023-12-11T20:14:03.529183+0000","last_fullsized":"2023-12-11T20:14:03.529183+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:00:47.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":217636,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64397,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":290,"num_read_kb":210,"num_write":150,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383705,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":456083,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.74299999999999999}]},{"osd":1,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.94899999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.89100000000000001}]},{"osd":6,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.77400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.97199999999999998}]},{"osd":10,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.01},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.98799999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645342,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":1107968,"data_compressed":42397,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.629,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89200000000000002,"5min":1.268,"15min":1.268},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89400000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70199999999999996}]},{"osd":2,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92600000000000005,"5min":1.107,"15min":1.107},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0900000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.98499999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94799999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.81699999999999995,"15min":0.84199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.042,"5min":1.323,"15min":1.323},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.82299999999999995,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.069,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.84399999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.92500000000000004,"15min":0.94799999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.04,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.90300000000000002,"15min":0.92100000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1359999999999999,"5min":1.641,"15min":1.641},"last":1.04}]},{"osd":6,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93600000000000005,"15min":0.95799999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0900000000000001,"5min":1.484,"15min":1.484},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.99199999999999999,"15min":1.022},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.107,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.95799999999999996}]},{"osd":7,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93799999999999994}]},{"osd":8,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":1.032,"15min":1.0649999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1839999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.0489999999999999,"15min":1.0800000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.135,"5min":1.667,"15min":1.667},"last":1.018}]},{"osd":9,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.056,"15min":1.087},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.238,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.083,"15min":1.1200000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.208,"5min":1.615,"15min":1.615},"last":1.1950000000000001}]},{"osd":11,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.214},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.157}]}]},{"osd":9,"up_from":67,"seq":287762808867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":456319,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59099999999999997}]},{"osd":1,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.69199999999999995,"15min":0.70299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.872,"15min":0.89600000000000002},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1539999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.753,"15min":0.76900000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94799999999999995,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.751}]},{"osd":3,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.85599999999999998,"15min":0.878},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1020000000000001,"5min":1.504,"15min":1.504},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0189999999999999,"5min":1.071,"15min":1.071},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.069,"5min":1.302,"15min":1.302},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.873,"15min":0.89700000000000002},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.125,"5min":1.508,"15min":1.508},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":0.86199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93300000000000005,"5min":1.375,"15min":1.375},"last":5.915}]},{"osd":6,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":1.006,"15min":1.038},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.21,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.88600000000000001,"15min":0.91700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0529999999999999,"5min":1.484,"15min":1.484},"last":0.47499999999999998}]},{"osd":7,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.95499999999999996,"15min":0.97899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1779999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.0589999999999999,"15min":1.087},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.302,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.81599999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.0680000000000001,"15min":1.099},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.26,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":5.9539999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.96699999999999997,"15min":0.99299999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0900000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.63800000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.94699999999999995,"15min":0.96499999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.083,"5min":1.53,"15min":1.53},"last":5.9379999999999997}]}]},{"osd":8,"up_from":59,"seq":253403070504,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":456031,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":1.079,"15min":1.079},"last":0.51100000000000001}]},{"osd":2,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.054,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.70799999999999996}]},{"osd":3,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.80400000000000005},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92400000000000004,"5min":1.081,"15min":1.081},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.81100000000000005,"5min":1.226,"15min":1.226},"last":0.55500000000000005}]},{"osd":4,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0529999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.0760000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.627},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.018,"5min":1.232,"15min":1.232},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.028,"5min":1.284,"15min":1.284},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.55200000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97199999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.93799999999999994}]},{"osd":7,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0049999999999999,"5min":1.298,"15min":1.298},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94699999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1619999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.78000000000000003}]},{"osd":9,"last update":"Mon Dec 11 20:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":0.94299999999999995},"min":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.84399999999999997}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96199999999999997,"15min":0.96299999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90300000000000002,"15min":0.89600000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.167,"5min":1.331,"15min":1.331},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":7,"up_from":51,"seq":219043332143,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":1048562,"data_compressed":42397,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76800000000000002,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.99299999999999999,"5min":1.327,"15min":1.327},"last":0.64300000000000002}]},{"osd":2,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98399999999999999,"5min":1.518,"15min":1.518},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.76400000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0349999999999999,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.749,"15min":0.73499999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99199999999999999,"5min":1.383,"15min":1.383},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98799999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71699999999999997}]},{"osd":4,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47599999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93700000000000006,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.115},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0009999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84599999999999997,"15min":0.83899999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.135,"5min":1.294,"15min":1.294},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.044,"5min":1.474,"15min":1.474},"last":1.0580000000000001}]},{"osd":6,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.59199999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0309999999999999,"5min":1.327,"15min":1.327},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.86599999999999999,"15min":0.85999999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.05,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.96999999999999997}]},{"osd":8,"last update":"Mon Dec 11 20:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96899999999999997},"min":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.133,"5min":1.544,"15min":1.544},"last":1.034},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.0669999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.087}]},{"osd":9,"last update":"Mon Dec 11 20:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.98999999999999999,"15min":1.002},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.1479999999999999,"5min":1.573,"15min":1.573},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.0169999999999999,"15min":1.0329999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.103,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.137}]},{"osd":10,"last update":"Mon Dec 11 20:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0980000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.01,"15min":1.026},"min":{"1min":0.66800000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1200000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.165}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":455714,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.58199999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.159,"5min":0.82199999999999995,"15min":0.76400000000000001},"min":{"1min":0.61499999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":8.1080000000000005,"5min":8.1080000000000005,"15min":8.1080000000000005},"last":0.68600000000000005}]},{"osd":2,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.93200000000000005,"15min":1.012},"min":{"1min":0.48899999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.21,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.997}]},{"osd":3,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.877,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.0229999999999999,"15min":1.109},"min":{"1min":0.65500000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1599999999999999,"5min":6.9489999999999998,"15min":6.9489999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.089,"5min":1.167,"15min":1.167},"last":0.87}]},{"osd":5,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0169999999999999,"5min":1.226,"15min":1.226},"last":1.022},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90300000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":1.012}]},{"osd":7,"last update":"Mon Dec 11 20:14:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.84799999999999998},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.25,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1559999999999999,"5min":1.228,"15min":1.228},"last":0.94899999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88600000000000001,"15min":0.88700000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1679999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83799999999999997,"15min":0.84499999999999997},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0329999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.071}]},{"osd":9,"last update":"Mon Dec 11 20:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.89500000000000002,"15min":0.91500000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.107,"5min":1.204,"15min":1.204},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.99399999999999999,"15min":1.014},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2130000000000001,"5min":1.319,"15min":1.319},"last":0.93200000000000005}]},{"osd":10,"last update":"Mon Dec 11 20:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0720000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.048},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.97899999999999998,"15min":0.99099999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.1850000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0860000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":515167,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.66700000000000004,"15min":0.57899999999999996},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":4.6319999999999997,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64100000000000001,"15min":0.58499999999999996},"min":{"1min":0.49299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.61699999999999999,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68700000000000006,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96299999999999997,"5min":1.075,"15min":1.075},"last":0.79800000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58799999999999997,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Mon Dec 11 20:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.70199999999999996},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.74099999999999999,"15min":0.69499999999999995},"min":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":1.036}]},{"osd":6,"last update":"Mon Dec 11 20:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.77800000000000002,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.69199999999999995}]},{"osd":7,"last update":"Mon Dec 11 20:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.82599999999999996,"15min":0.81999999999999995},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.998},{"interface":"front","average":{"1min":0.751,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.379,"15min":0.379},"max":{"1min":1.0780000000000001,"5min":1.099,"15min":1.099},"last":0.77100000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80200000000000005,"15min":0.77300000000000002},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1459999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.90400000000000003,"15min":0.86399999999999999},"min":{"1min":0.71099999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.24,"15min":1.24},"last":1.0740000000000001}]},{"osd":9,"last update":"Mon Dec 11 20:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.94599999999999995},"min":{"1min":0.747,"5min":0.628,"15min":0.628},"max":{"1min":1.208,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88100000000000001,"15min":0.88600000000000001},"min":{"1min":0.70799999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.97699999999999998}]},{"osd":10,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.026,"15min":1.032},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2589999999999999,"5min":1.381,"15min":1.381},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0249999999999999,"15min":1.0189999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.143}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":456979,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 20:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.626,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86299999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.626,"15min":0.57599999999999996},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38},"max":{"1min":0.88300000000000001,"5min":1.048,"15min":1.048},"last":0.95699999999999996}]},{"osd":2,"last update":"Mon Dec 11 20:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.81100000000000005}]},{"osd":3,"last update":"Mon Dec 11 20:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.35299999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68400000000000005,"15min":0.64800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.909,"15min":1.909},"last":0.77400000000000002}]},{"osd":5,"last update":"Mon Dec 11 20:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73099999999999998,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.01,"5min":1.036,"15min":1.036},"last":0.63600000000000001}]},{"osd":6,"last update":"Mon Dec 11 20:13:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95799999999999996,"5min":1.028,"15min":1.028},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.52200000000000002}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.93999999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.64900000000000002}]},{"osd":9,"last update":"Mon Dec 11 20:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.51200000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.88,"15min":0.89000000000000001},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.67300000000000004}]},{"osd":10,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.94099999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.90800000000000003,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.86699999999999999}]},{"osd":11,"last update":"Mon Dec 11 20:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.84399999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":516906,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63700000000000001,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":1.0369999999999999,"5min":1.089,"15min":1.089},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.53100000000000003}]},{"osd":3,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65300000000000002,"15min":0.60999999999999999},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64300000000000002,"15min":0.624},"min":{"1min":0.436,"5min":0.373,"15min":0.373},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.70299999999999996}]},{"osd":4,"last update":"Mon Dec 11 20:13:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.64500000000000002,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.63800000000000001,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0409999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65600000000000003,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.69999999999999996,"15min":0.66600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.76900000000000002,"15min":0.73199999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Mon Dec 11 20:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.101,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59799999999999998}]},{"osd":8,"last update":"Mon Dec 11 20:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.78100000000000003},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1579999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.86099999999999999,"15min":0.85899999999999999},"min":{"1min":0.53900000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.089,"5min":1.254,"15min":1.254},"last":1.006}]},{"osd":9,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.91700000000000004,"15min":0.91500000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.92800000000000005}]},{"osd":10,"last update":"Mon Dec 11 20:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.67300000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.165,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96799999999999997,"15min":0.96399999999999997},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.034}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":455700,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.46300000000000002,"15min":0.41599999999999998},"min":{"1min":0.32100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.88500000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.99299999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.0920000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66400000000000003,"15min":0.622},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.044,"5min":1.085,"15min":1.085},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70299999999999996,"15min":0.64500000000000002},"min":{"1min":0.53000000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.93799999999999994}]},{"osd":2,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69099999999999995,"15min":0.622},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90700000000000003,"5min":1.288,"15min":1.288},"last":0.624}]},{"osd":4,"last update":"Mon Dec 11 20:13:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.65300000000000002},"min":{"1min":0.61799999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.71699999999999997,"15min":0.67200000000000004},"min":{"1min":0.59599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.0429999999999999}]},{"osd":5,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.47599999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.871,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76800000000000002,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.111,"5min":1.145,"15min":1.145},"last":1.0229999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":2.0419999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.98599999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80300000000000005,"15min":0.78700000000000003},"min":{"1min":0.497,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88200000000000001,"15min":0.85599999999999998},"min":{"1min":0.66900000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0820000000000001}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.85799999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.071}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96899999999999997,"15min":0.97499999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.1000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]}]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":456534,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57999999999999996,"15min":0.53900000000000003},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.496}]},{"osd":1,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78600000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65200000000000002,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.69399999999999995},"min":{"1min":0.60099999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64400000000000002,"15min":0.62},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83899999999999997,"5min":0.872,"15min":0.872},"last":0.499}]},{"osd":5,"last update":"Mon Dec 11 20:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.753,"15min":0.70899999999999996},"min":{"1min":0.61599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.075},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.72399999999999998},"min":{"1min":0.56299999999999994,"5min":0.435,"15min":0.435},"max":{"1min":1.004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Mon Dec 11 20:13:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.036,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.64300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.079,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.95899999999999996}]},{"osd":7,"last update":"Mon Dec 11 20:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.626,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.66700000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73399999999999999}]},{"osd":8,"last update":"Mon Dec 11 20:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.90200000000000002,"15min":0.88800000000000001},"min":{"1min":0.80300000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.878}]},{"osd":9,"last update":"Mon Dec 11 20:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.88100000000000001,"15min":0.871},"min":{"1min":0.76500000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.89500000000000002,"15min":0.88300000000000001},"min":{"1min":0.73599999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.1240000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.94999999999999996,"15min":0.94399999999999995},"min":{"1min":0.79400000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.177},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78100000000000003},"min":{"1min":0.628,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.65400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":1047403,"data_compressed":42397,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59699999999999998,"15min":0.57499999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63500000000000001,"15min":0.60799999999999998},"min":{"1min":0.49199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.879}]},{"osd":1,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.69899999999999995,"15min":0.65700000000000003},"min":{"1min":0.499,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.96799999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.41299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65800000000000003,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.028,"5min":1.127,"15min":1.127},"last":0.71699999999999997}]},{"osd":4,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.74399999999999999,"15min":0.71199999999999997},"min":{"1min":0.626,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.74099999999999999,"15min":0.69499999999999995},"min":{"1min":0.57199999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.92400000000000004}]},{"osd":6,"last update":"Mon Dec 11 20:13:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":0.82699999999999996,"15min":0.76900000000000002},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":6.5039999999999996,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76200000000000001,"15min":0.751},"min":{"1min":0.623,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Mon Dec 11 20:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.80700000000000005,"15min":0.78000000000000003},"min":{"1min":0.60799999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.82699999999999996,"15min":0.78800000000000003},"min":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.89500000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77300000000000002,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0309999999999999,"5min":1.589,"15min":1.589},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.85499999999999998,"15min":0.82699999999999996},"min":{"1min":0.72299999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.27,"5min":1.403,"15min":1.403},"last":1.0700000000000001}]},{"osd":9,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93700000000000006,"15min":0.93600000000000005},"min":{"1min":0.69999999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.03},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85399999999999998,"15min":0.84899999999999998},"min":{"1min":0.72599999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.95099999999999996}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98099999999999998,"15min":0.98299999999999998},"min":{"1min":0.76200000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.244,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.76700000000000002,"5min":0.752,"15min":0.752},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34906,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T20:14:47.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-11T20:14:48.274 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:48.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:48 smithi032 ceph-mon[132488]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:48.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:48 smithi032 ceph-mon[132488]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:48.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:48 smithi012 ceph-mon[128787]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:48.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:48 smithi012 ceph-mon[128787]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:48.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:48 smithi039 ceph-mon[102205]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:48.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:48 smithi039 ceph-mon[102205]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:49.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:49 smithi012 ceph-mon[128787]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:49.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:49 smithi039 ceph-mon[102205]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:49 smithi032 ceph-mon[132488]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 -- 172.21.15.12:0/3569289661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7441076f0 msgr2=0x7fd744107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 --2- 172.21.15.12:0/3569289661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7441076f0 0x7fd744107ad0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd740009990 tx=0x7fd740009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 -- 172.21.15.12:0/3569289661 shutdown_connections 2023-12-11T20:14:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 --2- 172.21.15.12:0/3569289661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd744102040 0x7fd74410e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 --2- 172.21.15.12:0/3569289661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7441076f0 0x7fd744107ad0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 --2- 172.21.15.12:0/3569289661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd744101680 0x7fd744101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 -- 172.21.15.12:0/3569289661 >> 172.21.15.12:0/3569289661 conn(0x7fd7440787c0 msgr2=0x7fd744078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 -- 172.21.15.12:0/3569289661 shutdown_connections 2023-12-11T20:14:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.816+0000 7fd74be1d700 1 -- 172.21.15.12:0/3569289661 wait complete. 2023-12-11T20:14:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.818+0000 7fd74be1d700 1 Processor -- start 2023-12-11T20:14:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.818+0000 7fd74be1d700 1 -- start start 2023-12-11T20:14:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd74be1d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd744101680 0x7fd74419f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd74be1d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd744102040 0x7fd74419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd74be1d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7441076f0 0x7fd744199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd74be1d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd744199f80 con 0x7fd744101680 2023-12-11T20:14:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd74be1d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74419a0f0 con 0x7fd7441076f0 2023-12-11T20:14:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd74be1d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74419a2b0 con 0x7fd744102040 2023-12-11T20:14:49.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd749bb9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd744101680 0x7fd74419f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd749bb9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd744101680 0x7fd74419f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40244/0 (socket says 172.21.15.12:40244) 2023-12-11T20:14:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd749bb9700 1 -- 172.21.15.12:0/320519507 learned_addr learned my addr 172.21.15.12:0/320519507 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd74a3ba700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7441076f0 0x7fd744199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd7493b8700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd744102040 0x7fd74419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd749bb9700 1 -- 172.21.15.12:0/320519507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd744102040 msgr2=0x7fd74419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd749bb9700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd744102040 0x7fd74419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd749bb9700 1 -- 172.21.15.12:0/320519507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7441076f0 msgr2=0x7fd744199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd749bb9700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7441076f0 0x7fd744199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.819+0000 7fd749bb9700 1 -- 172.21.15.12:0/320519507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400095f0 con 0x7fd744101680 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.820+0000 7fd749bb9700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd744101680 0x7fd74419f7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd740004730 tx=0x7fd740004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.820+0000 7fd73affd700 1 -- 172.21.15.12:0/320519507 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74001d070 con 0x7fd744101680 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.820+0000 7fd73affd700 1 -- 172.21.15.12:0/320519507 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd74000be50 con 0x7fd744101680 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.820+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74419a530 con 0x7fd744101680 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.820+0000 7fd73affd700 1 -- 172.21.15.12:0/320519507 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740022e00 con 0x7fd744101680 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.820+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7441a67d0 con 0x7fd744101680 2023-12-11T20:14:49.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.821+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd744104940 con 0x7fd744101680 2023-12-11T20:14:49.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.823+0000 7fd73affd700 1 -- 172.21.15.12:0/320519507 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fd74000fac0 con 0x7fd744101680 2023-12-11T20:14:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.824+0000 7fd73affd700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7300a1510 0x7fd7300a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.824+0000 7fd73affd700 1 -- 172.21.15.12:0/320519507 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fd7400ce160 con 0x7fd744101680 2023-12-11T20:14:49.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.825+0000 7fd7493b8700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7300a1510 0x7fd7300a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.825+0000 7fd7493b8700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7300a1510 0x7fd7300a39d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd74419aae0 tx=0x7fd734009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:49.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:49.829+0000 7fd73affd700 1 -- 172.21.15.12:0/320519507 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd740097680 con 0x7fd744101680 2023-12-11T20:14:50.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.033+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd74419ade0 con 0x7fd7300a1510 2023-12-11T20:14:50.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.044+0000 7fd73affd700 1 -- 172.21.15.12:0/320519507 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338681 (secure 0 0 0) 0x7fd74419ade0 con 0x7fd7300a1510 2023-12-11T20:14:50.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7300a1510 msgr2=0x7fd7300a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7300a1510 0x7fd7300a39d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd74419aae0 tx=0x7fd734009260 comp rx=0 tx=0).stop 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd744101680 msgr2=0x7fd74419f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd744101680 0x7fd74419f7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd740004730 tx=0x7fd740004760 comp rx=0 tx=0).stop 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 shutdown_connections 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7300a1510 0x7fd7300a39d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7441076f0 0x7fd744199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd744101680 0x7fd74419f7e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 --2- 172.21.15.12:0/320519507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd744102040 0x7fd74419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 >> 172.21.15.12:0/320519507 conn(0x7fd7440787c0 msgr2=0x7fd74410cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 shutdown_connections 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:50.050+0000 7fd74be1d700 1 -- 172.21.15.12:0/320519507 wait complete. 2023-12-11T20:14:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-12-11T20:14:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:50 smithi012 ceph-mon[128787]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:50.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:50 smithi039 ceph-mon[102205]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:50.672 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2023-12-11T20:14:49.045238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655011,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":445,"num_read_kb":334,"num_write":333,"num_write_kb":3045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2951963,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335796,"kb_used_data":11548,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606028,"statfs":{"total":1151940427776,"available":1151596572672,"internally_reserved":0,"allocated":11825152,"data_stored":7429366,"data_compressed":179850,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":331855162},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002944"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530023+0000","last_change":"2023-12-11T20:13:53.282384+0000","last_active":"2023-12-11T20:14:03.530023+0000","last_peered":"2023-12-11T20:14:03.530023+0000","last_clean":"2023-12-11T20:14:03.530023+0000","last_became_active":"2023-12-11T20:13:53.282058+0000","last_became_peered":"2023-12-11T20:13:53.282058+0000","last_unstale":"2023-12-11T20:14:03.530023+0000","last_undegraded":"2023-12-11T20:14:03.530023+0000","last_fullsized":"2023-12-11T20:14:03.530023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:23:31.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530727+0000","last_change":"2023-12-11T20:13:53.282283+0000","last_active":"2023-12-11T20:14:03.530727+0000","last_peered":"2023-12-11T20:14:03.530727+0000","last_clean":"2023-12-11T20:14:03.530727+0000","last_became_active":"2023-12-11T20:13:53.278054+0000","last_became_peered":"2023-12-11T20:13:53.278054+0000","last_unstale":"2023-12-11T20:14:03.530727+0000","last_undegraded":"2023-12-11T20:14:03.530727+0000","last_fullsized":"2023-12-11T20:14:03.530727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:07:50.194732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530417+0000","last_change":"2023-12-11T20:13:53.277704+0000","last_active":"2023-12-11T20:14:03.530417+0000","last_peered":"2023-12-11T20:14:03.530417+0000","last_clean":"2023-12-11T20:14:03.530417+0000","last_became_active":"2023-12-11T20:13:53.277395+0000","last_became_peered":"2023-12-11T20:13:53.277395+0000","last_unstale":"2023-12-11T20:14:03.530417+0000","last_undegraded":"2023-12-11T20:14:03.530417+0000","last_fullsized":"2023-12-11T20:14:03.530417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:54:10.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529912+0000","last_change":"2023-12-11T20:13:53.280854+0000","last_active":"2023-12-11T20:14:03.529912+0000","last_peered":"2023-12-11T20:14:03.529912+0000","last_clean":"2023-12-11T20:14:03.529912+0000","last_became_active":"2023-12-11T20:13:53.277275+0000","last_became_peered":"2023-12-11T20:13:53.277275+0000","last_unstale":"2023-12-11T20:14:03.529912+0000","last_undegraded":"2023-12-11T20:14:03.529912+0000","last_fullsized":"2023-12-11T20:14:03.529912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:32:58.001015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.533768+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:14:03.533768+0000","last_peered":"2023-12-11T20:14:03.533768+0000","last_clean":"2023-12-11T20:14:03.533768+0000","last_became_active":"2023-12-11T20:13:53.281659+0000","last_became_peered":"2023-12-11T20:13:53.281659+0000","last_unstale":"2023-12-11T20:14:03.533768+0000","last_undegraded":"2023-12-11T20:14:03.533768+0000","last_fullsized":"2023-12-11T20:14:03.533768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:47:20.764823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531566+0000","last_change":"2023-12-11T20:13:53.284175+0000","last_active":"2023-12-11T20:14:03.531566+0000","last_peered":"2023-12-11T20:14:03.531566+0000","last_clean":"2023-12-11T20:14:03.531566+0000","last_became_active":"2023-12-11T20:13:53.283801+0000","last_became_peered":"2023-12-11T20:13:53.283801+0000","last_unstale":"2023-12-11T20:14:03.531566+0000","last_undegraded":"2023-12-11T20:14:03.531566+0000","last_fullsized":"2023-12-11T20:14:03.531566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:35.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525576+0000","last_change":"2023-12-11T20:13:53.262700+0000","last_active":"2023-12-11T20:14:03.525576+0000","last_peered":"2023-12-11T20:14:03.525576+0000","last_clean":"2023-12-11T20:14:03.525576+0000","last_became_active":"2023-12-11T20:13:53.262322+0000","last_became_peered":"2023-12-11T20:13:53.262322+0000","last_unstale":"2023-12-11T20:14:03.525576+0000","last_undegraded":"2023-12-11T20:14:03.525576+0000","last_fullsized":"2023-12-11T20:14:03.525576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:02:47.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.764415+0000","last_change":"2023-12-11T20:14:04.763447+0000","last_active":"2023-12-11T20:14:04.764415+0000","last_peered":"2023-12-11T20:14:04.764415+0000","last_clean":"2023-12-11T20:14:04.764415+0000","last_became_active":"2023-12-11T20:14:04.763036+0000","last_became_peered":"2023-12-11T20:14:04.763036+0000","last_unstale":"2023-12-11T20:14:04.764415+0000","last_undegraded":"2023-12-11T20:14:04.764415+0000","last_fullsized":"2023-12-11T20:14:04.764415+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:48.188993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523444+0000","last_change":"2023-12-11T20:13:53.277384+0000","last_active":"2023-12-11T20:14:03.523444+0000","last_peered":"2023-12-11T20:14:03.523444+0000","last_clean":"2023-12-11T20:14:03.523444+0000","last_became_active":"2023-12-11T20:13:53.277017+0000","last_became_peered":"2023-12-11T20:13:53.277017+0000","last_unstale":"2023-12-11T20:14:03.523444+0000","last_undegraded":"2023-12-11T20:14:03.523444+0000","last_fullsized":"2023-12-11T20:14:03.523444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:04:50.820269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531949+0000","last_change":"2023-12-11T20:13:53.285340+0000","last_active":"2023-12-11T20:14:03.531949+0000","last_peered":"2023-12-11T20:14:03.531949+0000","last_clean":"2023-12-11T20:14:03.531949+0000","last_became_active":"2023-12-11T20:13:53.285040+0000","last_became_peered":"2023-12-11T20:13:53.285040+0000","last_unstale":"2023-12-11T20:14:03.531949+0000","last_undegraded":"2023-12-11T20:14:03.531949+0000","last_fullsized":"2023-12-11T20:14:03.531949+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:52:53.312236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526270+0000","last_change":"2023-12-11T20:13:53.274637+0000","last_active":"2023-12-11T20:14:03.526270+0000","last_peered":"2023-12-11T20:14:03.526270+0000","last_clean":"2023-12-11T20:14:03.526270+0000","last_became_active":"2023-12-11T20:13:53.270971+0000","last_became_peered":"2023-12-11T20:13:53.270971+0000","last_unstale":"2023-12-11T20:14:03.526270+0000","last_undegraded":"2023-12-11T20:14:03.526270+0000","last_fullsized":"2023-12-11T20:14:03.526270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:20:35.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529815+0000","last_change":"2023-12-11T20:13:53.280712+0000","last_active":"2023-12-11T20:14:03.529815+0000","last_peered":"2023-12-11T20:14:03.529815+0000","last_clean":"2023-12-11T20:14:03.529815+0000","last_became_active":"2023-12-11T20:13:53.276873+0000","last_became_peered":"2023-12-11T20:13:53.276873+0000","last_unstale":"2023-12-11T20:14:03.529815+0000","last_undegraded":"2023-12-11T20:14:03.529815+0000","last_fullsized":"2023-12-11T20:14:03.529815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:36:08.438862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523794+0000","last_change":"2023-12-11T20:13:53.272378+0000","last_active":"2023-12-11T20:14:03.523794+0000","last_peered":"2023-12-11T20:14:03.523794+0000","last_clean":"2023-12-11T20:14:03.523794+0000","last_became_active":"2023-12-11T20:13:53.271992+0000","last_became_peered":"2023-12-11T20:13:53.271992+0000","last_unstale":"2023-12-11T20:14:03.523794+0000","last_undegraded":"2023-12-11T20:14:03.523794+0000","last_fullsized":"2023-12-11T20:14:03.523794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:01:05.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529629+0000","last_change":"2023-12-11T20:13:53.275078+0000","last_active":"2023-12-11T20:14:03.529629+0000","last_peered":"2023-12-11T20:14:03.529629+0000","last_clean":"2023-12-11T20:14:03.529629+0000","last_became_active":"2023-12-11T20:13:53.273555+0000","last_became_peered":"2023-12-11T20:13:53.273555+0000","last_unstale":"2023-12-11T20:14:03.529629+0000","last_undegraded":"2023-12-11T20:14:03.529629+0000","last_fullsized":"2023-12-11T20:14:03.529629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:23:27.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529664+0000","last_change":"2023-12-11T20:13:53.277135+0000","last_active":"2023-12-11T20:14:03.529664+0000","last_peered":"2023-12-11T20:14:03.529664+0000","last_clean":"2023-12-11T20:14:03.529664+0000","last_became_active":"2023-12-11T20:13:53.276406+0000","last_became_peered":"2023-12-11T20:13:53.276406+0000","last_unstale":"2023-12-11T20:14:03.529664+0000","last_undegraded":"2023-12-11T20:14:03.529664+0000","last_fullsized":"2023-12-11T20:14:03.529664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:20.508685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.522774+0000","last_change":"2023-12-11T20:13:53.268845+0000","last_active":"2023-12-11T20:14:03.522774+0000","last_peered":"2023-12-11T20:14:03.522774+0000","last_clean":"2023-12-11T20:14:03.522774+0000","last_became_active":"2023-12-11T20:13:53.268553+0000","last_became_peered":"2023-12-11T20:13:53.268553+0000","last_unstale":"2023-12-11T20:14:03.522774+0000","last_undegraded":"2023-12-11T20:14:03.522774+0000","last_fullsized":"2023-12-11T20:14:03.522774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:55.125792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530340+0000","last_change":"2023-12-11T20:13:53.284361+0000","last_active":"2023-12-11T20:14:03.530340+0000","last_peered":"2023-12-11T20:14:03.530340+0000","last_clean":"2023-12-11T20:14:03.530340+0000","last_became_active":"2023-12-11T20:13:53.282109+0000","last_became_peered":"2023-12-11T20:13:53.282109+0000","last_unstale":"2023-12-11T20:14:03.530340+0000","last_undegraded":"2023-12-11T20:14:03.530340+0000","last_fullsized":"2023-12-11T20:14:03.530340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:44:50.021737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530178+0000","last_change":"2023-12-11T20:13:53.274005+0000","last_active":"2023-12-11T20:14:03.530178+0000","last_peered":"2023-12-11T20:14:03.530178+0000","last_clean":"2023-12-11T20:14:03.530178+0000","last_became_active":"2023-12-11T20:13:53.273336+0000","last_became_peered":"2023-12-11T20:13:53.273336+0000","last_unstale":"2023-12-11T20:14:03.530178+0000","last_undegraded":"2023-12-11T20:14:03.530178+0000","last_fullsized":"2023-12-11T20:14:03.530178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:56:05.732607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531344+0000","last_change":"2023-12-11T20:13:53.280909+0000","last_active":"2023-12-11T20:14:03.531344+0000","last_peered":"2023-12-11T20:14:03.531344+0000","last_clean":"2023-12-11T20:14:03.531344+0000","last_became_active":"2023-12-11T20:13:53.278124+0000","last_became_peered":"2023-12-11T20:13:53.278124+0000","last_unstale":"2023-12-11T20:14:03.531344+0000","last_undegraded":"2023-12-11T20:14:03.531344+0000","last_fullsized":"2023-12-11T20:14:03.531344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:09:19.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530175+0000","last_change":"2023-12-11T20:13:52.478685+0000","last_active":"2023-12-11T20:14:03.530175+0000","last_peered":"2023-12-11T20:14:03.530175+0000","last_clean":"2023-12-11T20:14:03.530175+0000","last_became_active":"2023-12-11T20:13:52.478391+0000","last_became_peered":"2023-12-11T20:13:52.478391+0000","last_unstale":"2023-12-11T20:14:03.530175+0000","last_undegraded":"2023-12-11T20:14:03.530175+0000","last_fullsized":"2023-12-11T20:14:03.530175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:02:54.039954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524734+0000","last_change":"2023-12-11T20:13:53.279432+0000","last_active":"2023-12-11T20:14:03.524734+0000","last_peered":"2023-12-11T20:14:03.524734+0000","last_clean":"2023-12-11T20:14:03.524734+0000","last_became_active":"2023-12-11T20:13:53.279087+0000","last_became_peered":"2023-12-11T20:13:53.279087+0000","last_unstale":"2023-12-11T20:14:03.524734+0000","last_undegraded":"2023-12-11T20:14:03.524734+0000","last_fullsized":"2023-12-11T20:14:03.524734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.376941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524737+0000","last_change":"2023-12-11T20:13:52.485170+0000","last_active":"2023-12-11T20:14:03.524737+0000","last_peered":"2023-12-11T20:14:03.524737+0000","last_clean":"2023-12-11T20:14:03.524737+0000","last_became_active":"2023-12-11T20:13:52.484885+0000","last_became_peered":"2023-12-11T20:13:52.484885+0000","last_unstale":"2023-12-11T20:14:03.524737+0000","last_undegraded":"2023-12-11T20:14:03.524737+0000","last_fullsized":"2023-12-11T20:14:03.524737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:21:40.746709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.537069+0000","last_change":"2023-12-11T20:13:53.274015+0000","last_active":"2023-12-11T20:14:03.537069+0000","last_peered":"2023-12-11T20:14:03.537069+0000","last_clean":"2023-12-11T20:14:03.537069+0000","last_became_active":"2023-12-11T20:13:53.272504+0000","last_became_peered":"2023-12-11T20:13:53.272504+0000","last_unstale":"2023-12-11T20:14:03.537069+0000","last_undegraded":"2023-12-11T20:14:03.537069+0000","last_fullsized":"2023-12-11T20:14:03.537069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:26.155659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.561173+0000","last_change":"2023-12-11T20:14:04.560730+0000","last_active":"2023-12-11T20:14:04.561173+0000","last_peered":"2023-12-11T20:14:04.561173+0000","last_clean":"2023-12-11T20:14:04.561173+0000","last_became_active":"2023-12-11T20:14:04.549828+0000","last_became_peered":"2023-12-11T20:14:04.549828+0000","last_unstale":"2023-12-11T20:14:04.561173+0000","last_undegraded":"2023-12-11T20:14:04.561173+0000","last_fullsized":"2023-12-11T20:14:04.561173+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:47:10.046705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.522932+0000","last_change":"2023-12-11T20:13:53.268907+0000","last_active":"2023-12-11T20:14:03.522932+0000","last_peered":"2023-12-11T20:14:03.522932+0000","last_clean":"2023-12-11T20:14:03.522932+0000","last_became_active":"2023-12-11T20:13:53.268494+0000","last_became_peered":"2023-12-11T20:13:53.268494+0000","last_unstale":"2023-12-11T20:14:03.522932+0000","last_undegraded":"2023-12-11T20:14:03.522932+0000","last_fullsized":"2023-12-11T20:14:03.522932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:57:36.104687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.534274+0000","last_change":"2023-12-11T20:13:52.475425+0000","last_active":"2023-12-11T20:14:03.534274+0000","last_peered":"2023-12-11T20:14:03.534274+0000","last_clean":"2023-12-11T20:14:03.534274+0000","last_became_active":"2023-12-11T20:13:52.475066+0000","last_became_peered":"2023-12-11T20:13:52.475066+0000","last_unstale":"2023-12-11T20:14:03.534274+0000","last_undegraded":"2023-12-11T20:14:03.534274+0000","last_fullsized":"2023-12-11T20:14:03.534274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:01:01.603043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.546865+0000","last_change":"2023-12-11T20:14:04.546865+0000","last_active":"2023-12-11T20:14:04.546865+0000","last_peered":"2023-12-11T20:14:04.546865+0000","last_clean":"2023-12-11T20:14:04.546865+0000","last_became_active":"2023-12-11T20:14:04.546475+0000","last_became_peered":"2023-12-11T20:14:04.546475+0000","last_unstale":"2023-12-11T20:14:04.546865+0000","last_undegraded":"2023-12-11T20:14:04.546865+0000","last_fullsized":"2023-12-11T20:14:04.546865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:54.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:47.346930+0000","last_change":"2023-12-11T20:13:52.481648+0000","last_active":"2023-12-11T20:14:47.346930+0000","last_peered":"2023-12-11T20:14:47.346930+0000","last_clean":"2023-12-11T20:14:47.346930+0000","last_became_active":"2023-12-11T20:13:52.481317+0000","last_became_peered":"2023-12-11T20:13:52.481317+0000","last_unstale":"2023-12-11T20:14:47.346930+0000","last_undegraded":"2023-12-11T20:14:47.346930+0000","last_fullsized":"2023-12-11T20:14:47.346930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:30:32.206757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1011,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.533990+0000","last_change":"2023-12-11T20:13:53.261350+0000","last_active":"2023-12-11T20:14:03.533990+0000","last_peered":"2023-12-11T20:14:03.533990+0000","last_clean":"2023-12-11T20:14:03.533990+0000","last_became_active":"2023-12-11T20:13:53.260471+0000","last_became_peered":"2023-12-11T20:13:53.260471+0000","last_unstale":"2023-12-11T20:14:03.533990+0000","last_undegraded":"2023-12-11T20:14:03.533990+0000","last_fullsized":"2023-12-11T20:14:03.533990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:27.844329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531502+0000","last_change":"2023-12-11T20:13:52.482190+0000","last_active":"2023-12-11T20:14:03.531502+0000","last_peered":"2023-12-11T20:14:03.531502+0000","last_clean":"2023-12-11T20:14:03.531502+0000","last_became_active":"2023-12-11T20:13:52.481758+0000","last_became_peered":"2023-12-11T20:13:52.481758+0000","last_unstale":"2023-12-11T20:14:03.531502+0000","last_undegraded":"2023-12-11T20:14:03.531502+0000","last_fullsized":"2023-12-11T20:14:03.531502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:26.226338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526862+0000","last_change":"2023-12-11T20:13:53.279366+0000","last_active":"2023-12-11T20:14:03.526862+0000","last_peered":"2023-12-11T20:14:03.526862+0000","last_clean":"2023-12-11T20:14:03.526862+0000","last_became_active":"2023-12-11T20:13:53.279074+0000","last_became_peered":"2023-12-11T20:13:53.279074+0000","last_unstale":"2023-12-11T20:14:03.526862+0000","last_undegraded":"2023-12-11T20:14:03.526862+0000","last_fullsized":"2023-12-11T20:14:03.526862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:37.856345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523503+0000","last_change":"2023-12-11T20:13:52.480830+0000","last_active":"2023-12-11T20:14:03.523503+0000","last_peered":"2023-12-11T20:14:03.523503+0000","last_clean":"2023-12-11T20:14:03.523503+0000","last_became_active":"2023-12-11T20:13:52.480359+0000","last_became_peered":"2023-12-11T20:13:52.480359+0000","last_unstale":"2023-12-11T20:14:03.523503+0000","last_undegraded":"2023-12-11T20:14:03.523503+0000","last_fullsized":"2023-12-11T20:14:03.523503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:13.756411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524157+0000","last_change":"2023-12-11T20:13:53.275587+0000","last_active":"2023-12-11T20:14:03.524157+0000","last_peered":"2023-12-11T20:14:03.524157+0000","last_clean":"2023-12-11T20:14:03.524157+0000","last_became_active":"2023-12-11T20:13:53.275014+0000","last_became_peered":"2023-12-11T20:13:53.275014+0000","last_unstale":"2023-12-11T20:14:03.524157+0000","last_undegraded":"2023-12-11T20:14:03.524157+0000","last_fullsized":"2023-12-11T20:14:03.524157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:21:23.179714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.550030+0000","last_change":"2023-12-11T20:14:04.548868+0000","last_active":"2023-12-11T20:14:04.550030+0000","last_peered":"2023-12-11T20:14:04.550030+0000","last_clean":"2023-12-11T20:14:04.550030+0000","last_became_active":"2023-12-11T20:14:04.548198+0000","last_became_peered":"2023-12-11T20:14:04.548198+0000","last_unstale":"2023-12-11T20:14:04.550030+0000","last_undegraded":"2023-12-11T20:14:04.550030+0000","last_fullsized":"2023-12-11T20:14:04.550030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:11:16.117241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529916+0000","last_change":"2023-12-11T20:13:53.281254+0000","last_active":"2023-12-11T20:14:03.529916+0000","last_peered":"2023-12-11T20:14:03.529916+0000","last_clean":"2023-12-11T20:14:03.529916+0000","last_became_active":"2023-12-11T20:13:53.278026+0000","last_became_peered":"2023-12-11T20:13:53.278026+0000","last_unstale":"2023-12-11T20:14:03.529916+0000","last_undegraded":"2023-12-11T20:14:03.529916+0000","last_fullsized":"2023-12-11T20:14:03.529916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:25:46.033739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":66,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:44.341215+0000","last_change":"2023-12-11T20:13:52.485136+0000","last_active":"2023-12-11T20:14:44.341215+0000","last_peered":"2023-12-11T20:14:44.341215+0000","last_clean":"2023-12-11T20:14:44.341215+0000","last_became_active":"2023-12-11T20:13:52.484743+0000","last_became_peered":"2023-12-11T20:13:52.484743+0000","last_unstale":"2023-12-11T20:14:44.341215+0000","last_undegraded":"2023-12-11T20:14:44.341215+0000","last_fullsized":"2023-12-11T20:14:44.341215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:50.893360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523217+0000","last_change":"2023-12-11T20:13:53.274566+0000","last_active":"2023-12-11T20:14:03.523217+0000","last_peered":"2023-12-11T20:14:03.523217+0000","last_clean":"2023-12-11T20:14:03.523217+0000","last_became_active":"2023-12-11T20:13:53.273325+0000","last_became_peered":"2023-12-11T20:13:53.273325+0000","last_unstale":"2023-12-11T20:14:03.523217+0000","last_undegraded":"2023-12-11T20:14:03.523217+0000","last_fullsized":"2023-12-11T20:14:03.523217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:29:17.656364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.766961+0000","last_change":"2023-12-11T20:14:04.766961+0000","last_active":"2023-12-11T20:14:04.766961+0000","last_peered":"2023-12-11T20:14:04.766961+0000","last_clean":"2023-12-11T20:14:04.766961+0000","last_became_active":"2023-12-11T20:14:04.763504+0000","last_became_peered":"2023-12-11T20:14:04.763504+0000","last_unstale":"2023-12-11T20:14:04.766961+0000","last_undegraded":"2023-12-11T20:14:04.766961+0000","last_fullsized":"2023-12-11T20:14:04.766961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:50:38.795524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.764089+0000","last_change":"2023-12-11T20:14:04.764089+0000","last_active":"2023-12-11T20:14:04.764089+0000","last_peered":"2023-12-11T20:14:04.764089+0000","last_clean":"2023-12-11T20:14:04.764089+0000","last_became_active":"2023-12-11T20:14:04.763556+0000","last_became_peered":"2023-12-11T20:14:04.763556+0000","last_unstale":"2023-12-11T20:14:04.764089+0000","last_undegraded":"2023-12-11T20:14:04.764089+0000","last_fullsized":"2023-12-11T20:14:04.764089+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:39.851342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526954+0000","last_change":"2023-12-11T20:13:52.486247+0000","last_active":"2023-12-11T20:14:03.526954+0000","last_peered":"2023-12-11T20:14:03.526954+0000","last_clean":"2023-12-11T20:14:03.526954+0000","last_became_active":"2023-12-11T20:13:52.485343+0000","last_became_peered":"2023-12-11T20:13:52.485343+0000","last_unstale":"2023-12-11T20:14:03.526954+0000","last_undegraded":"2023-12-11T20:14:03.526954+0000","last_fullsized":"2023-12-11T20:14:03.526954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:21:46.587858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523142+0000","last_change":"2023-12-11T20:13:53.281264+0000","last_active":"2023-12-11T20:14:03.523142+0000","last_peered":"2023-12-11T20:14:03.523142+0000","last_clean":"2023-12-11T20:14:03.523142+0000","last_became_active":"2023-12-11T20:13:53.280899+0000","last_became_peered":"2023-12-11T20:13:53.280899+0000","last_unstale":"2023-12-11T20:14:03.523142+0000","last_undegraded":"2023-12-11T20:14:03.523142+0000","last_fullsized":"2023-12-11T20:14:03.523142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:17.675421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'27","reported_seq":146,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:45.355898+0000","last_change":"2023-12-11T20:13:52.475732+0000","last_active":"2023-12-11T20:14:45.355898+0000","last_peered":"2023-12-11T20:14:45.355898+0000","last_clean":"2023-12-11T20:14:45.355898+0000","last_became_active":"2023-12-11T20:13:52.475415+0000","last_became_peered":"2023-12-11T20:13:52.475415+0000","last_unstale":"2023-12-11T20:14:45.355898+0000","last_undegraded":"2023-12-11T20:14:45.355898+0000","last_fullsized":"2023-12-11T20:14:45.355898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:20:31.539997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60009,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":110,"num_write":28,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.534318+0000","last_change":"2023-12-11T20:13:53.273365+0000","last_active":"2023-12-11T20:14:03.534318+0000","last_peered":"2023-12-11T20:14:03.534318+0000","last_clean":"2023-12-11T20:14:03.534318+0000","last_became_active":"2023-12-11T20:13:53.268456+0000","last_became_peered":"2023-12-11T20:13:53.268456+0000","last_unstale":"2023-12-11T20:14:03.534318+0000","last_undegraded":"2023-12-11T20:14:03.534318+0000","last_fullsized":"2023-12-11T20:14:03.534318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:13.850229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531623+0000","last_change":"2023-12-11T20:13:52.477609+0000","last_active":"2023-12-11T20:14:03.531623+0000","last_peered":"2023-12-11T20:14:03.531623+0000","last_clean":"2023-12-11T20:14:03.531623+0000","last_became_active":"2023-12-11T20:13:52.477177+0000","last_became_peered":"2023-12-11T20:13:52.477177+0000","last_unstale":"2023-12-11T20:14:03.531623+0000","last_undegraded":"2023-12-11T20:14:03.531623+0000","last_fullsized":"2023-12-11T20:14:03.531623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:46.987026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523631+0000","last_change":"2023-12-11T20:13:53.278247+0000","last_active":"2023-12-11T20:14:03.523631+0000","last_peered":"2023-12-11T20:14:03.523631+0000","last_clean":"2023-12-11T20:14:03.523631+0000","last_became_active":"2023-12-11T20:13:53.277928+0000","last_became_peered":"2023-12-11T20:13:53.277928+0000","last_unstale":"2023-12-11T20:14:03.523631+0000","last_undegraded":"2023-12-11T20:14:03.523631+0000","last_fullsized":"2023-12-11T20:14:03.523631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:52:33.864370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526510+0000","last_change":"2023-12-11T20:13:52.485985+0000","last_active":"2023-12-11T20:14:03.526510+0000","last_peered":"2023-12-11T20:14:03.526510+0000","last_clean":"2023-12-11T20:14:03.526510+0000","last_became_active":"2023-12-11T20:13:52.484929+0000","last_became_peered":"2023-12-11T20:13:52.484929+0000","last_unstale":"2023-12-11T20:14:03.526510+0000","last_undegraded":"2023-12-11T20:14:03.526510+0000","last_fullsized":"2023-12-11T20:14:03.526510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T08:11:28.665448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526938+0000","last_change":"2023-12-11T20:13:53.277048+0000","last_active":"2023-12-11T20:14:03.526938+0000","last_peered":"2023-12-11T20:14:03.526938+0000","last_clean":"2023-12-11T20:14:03.526938+0000","last_became_active":"2023-12-11T20:13:53.276706+0000","last_became_peered":"2023-12-11T20:13:53.276706+0000","last_unstale":"2023-12-11T20:14:03.526938+0000","last_undegraded":"2023-12-11T20:14:03.526938+0000","last_fullsized":"2023-12-11T20:14:03.526938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:46.815339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:45.342920+0000","last_change":"2023-12-11T20:13:52.477814+0000","last_active":"2023-12-11T20:14:45.342920+0000","last_peered":"2023-12-11T20:14:45.342920+0000","last_clean":"2023-12-11T20:14:45.342920+0000","last_became_active":"2023-12-11T20:13:52.477036+0000","last_became_peered":"2023-12-11T20:13:52.477036+0000","last_unstale":"2023-12-11T20:14:45.342920+0000","last_undegraded":"2023-12-11T20:14:45.342920+0000","last_fullsized":"2023-12-11T20:14:45.342920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:53:44.279968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525477+0000","last_change":"2023-12-11T20:13:53.276279+0000","last_active":"2023-12-11T20:14:03.525477+0000","last_peered":"2023-12-11T20:14:03.525477+0000","last_clean":"2023-12-11T20:14:03.525477+0000","last_became_active":"2023-12-11T20:13:53.273638+0000","last_became_peered":"2023-12-11T20:13:53.273638+0000","last_unstale":"2023-12-11T20:14:03.525477+0000","last_undegraded":"2023-12-11T20:14:03.525477+0000","last_fullsized":"2023-12-11T20:14:03.525477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:07:03.289511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.533700+0000","last_change":"2023-12-11T20:13:52.483417+0000","last_active":"2023-12-11T20:14:03.533700+0000","last_peered":"2023-12-11T20:14:03.533700+0000","last_clean":"2023-12-11T20:14:03.533700+0000","last_became_active":"2023-12-11T20:13:52.481395+0000","last_became_peered":"2023-12-11T20:13:52.481395+0000","last_unstale":"2023-12-11T20:14:03.533700+0000","last_undegraded":"2023-12-11T20:14:03.533700+0000","last_fullsized":"2023-12-11T20:14:03.533700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:01:42.053460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525956+0000","last_change":"2023-12-11T20:13:53.280688+0000","last_active":"2023-12-11T20:14:03.525956+0000","last_peered":"2023-12-11T20:14:03.525956+0000","last_clean":"2023-12-11T20:14:03.525956+0000","last_became_active":"2023-12-11T20:13:53.277300+0000","last_became_peered":"2023-12-11T20:13:53.277300+0000","last_unstale":"2023-12-11T20:14:03.525956+0000","last_undegraded":"2023-12-11T20:14:03.525956+0000","last_fullsized":"2023-12-11T20:14:03.525956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:40:58.831909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.534651+0000","last_change":"2023-12-11T20:13:52.474978+0000","last_active":"2023-12-11T20:14:03.534651+0000","last_peered":"2023-12-11T20:14:03.534651+0000","last_clean":"2023-12-11T20:14:03.534651+0000","last_became_active":"2023-12-11T20:13:52.472863+0000","last_became_peered":"2023-12-11T20:13:52.472863+0000","last_unstale":"2023-12-11T20:14:03.534651+0000","last_undegraded":"2023-12-11T20:14:03.534651+0000","last_fullsized":"2023-12-11T20:14:03.534651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:53:44.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530033+0000","last_change":"2023-12-11T20:13:53.285991+0000","last_active":"2023-12-11T20:14:03.530033+0000","last_peered":"2023-12-11T20:14:03.530033+0000","last_clean":"2023-12-11T20:14:03.530033+0000","last_became_active":"2023-12-11T20:13:53.283925+0000","last_became_peered":"2023-12-11T20:13:53.283925+0000","last_unstale":"2023-12-11T20:14:03.530033+0000","last_undegraded":"2023-12-11T20:14:03.530033+0000","last_fullsized":"2023-12-11T20:14:03.530033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:15:48.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530050+0000","last_change":"2023-12-11T20:13:52.478883+0000","last_active":"2023-12-11T20:14:03.530050+0000","last_peered":"2023-12-11T20:14:03.530050+0000","last_clean":"2023-12-11T20:14:03.530050+0000","last_became_active":"2023-12-11T20:13:52.477070+0000","last_became_peered":"2023-12-11T20:13:52.477070+0000","last_unstale":"2023-12-11T20:14:03.530050+0000","last_undegraded":"2023-12-11T20:14:03.530050+0000","last_fullsized":"2023-12-11T20:14:03.530050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:14:32.504778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531860+0000","last_change":"2023-12-11T20:13:53.278181+0000","last_active":"2023-12-11T20:14:03.531860+0000","last_peered":"2023-12-11T20:14:03.531860+0000","last_clean":"2023-12-11T20:14:03.531860+0000","last_became_active":"2023-12-11T20:13:53.277800+0000","last_became_peered":"2023-12-11T20:13:53.277800+0000","last_unstale":"2023-12-11T20:14:03.531860+0000","last_undegraded":"2023-12-11T20:14:03.531860+0000","last_fullsized":"2023-12-11T20:14:03.531860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:35.424820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525796+0000","last_change":"2023-12-11T20:13:52.481281+0000","last_active":"2023-12-11T20:14:03.525796+0000","last_peered":"2023-12-11T20:14:03.525796+0000","last_clean":"2023-12-11T20:14:03.525796+0000","last_became_active":"2023-12-11T20:13:52.479352+0000","last_became_peered":"2023-12-11T20:13:52.479352+0000","last_unstale":"2023-12-11T20:14:03.525796+0000","last_undegraded":"2023-12-11T20:14:03.525796+0000","last_fullsized":"2023-12-11T20:14:03.525796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:41.815011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531573+0000","last_change":"2023-12-11T20:13:53.282233+0000","last_active":"2023-12-11T20:14:03.531573+0000","last_peered":"2023-12-11T20:14:03.531573+0000","last_clean":"2023-12-11T20:14:03.531573+0000","last_became_active":"2023-12-11T20:13:53.279001+0000","last_became_peered":"2023-12-11T20:13:53.279001+0000","last_unstale":"2023-12-11T20:14:03.531573+0000","last_undegraded":"2023-12-11T20:14:03.531573+0000","last_fullsized":"2023-12-11T20:14:03.531573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:30:21.671414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.527164+0000","last_change":"2023-12-11T20:13:53.269361+0000","last_active":"2023-12-11T20:14:03.527164+0000","last_peered":"2023-12-11T20:14:03.527164+0000","last_clean":"2023-12-11T20:14:03.527164+0000","last_became_active":"2023-12-11T20:13:53.268613+0000","last_became_peered":"2023-12-11T20:13:53.268613+0000","last_unstale":"2023-12-11T20:14:03.527164+0000","last_undegraded":"2023-12-11T20:14:03.527164+0000","last_fullsized":"2023-12-11T20:14:03.527164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:08:04.876038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":68,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:45.342232+0000","last_change":"2023-12-11T20:13:52.484537+0000","last_active":"2023-12-11T20:14:45.342232+0000","last_peered":"2023-12-11T20:14:45.342232+0000","last_clean":"2023-12-11T20:14:45.342232+0000","last_became_active":"2023-12-11T20:13:52.482732+0000","last_became_peered":"2023-12-11T20:13:52.482732+0000","last_unstale":"2023-12-11T20:14:45.342232+0000","last_undegraded":"2023-12-11T20:14:45.342232+0000","last_fullsized":"2023-12-11T20:14:45.342232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:41:31.332046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524454+0000","last_change":"2023-12-11T20:13:53.270953+0000","last_active":"2023-12-11T20:14:03.524454+0000","last_peered":"2023-12-11T20:14:03.524454+0000","last_clean":"2023-12-11T20:14:03.524454+0000","last_became_active":"2023-12-11T20:13:53.269711+0000","last_became_peered":"2023-12-11T20:13:53.269711+0000","last_unstale":"2023-12-11T20:14:03.524454+0000","last_undegraded":"2023-12-11T20:14:03.524454+0000","last_fullsized":"2023-12-11T20:14:03.524454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:16:50.802953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529699+0000","last_change":"2023-12-11T20:13:52.473341+0000","last_active":"2023-12-11T20:14:03.529699+0000","last_peered":"2023-12-11T20:14:03.529699+0000","last_clean":"2023-12-11T20:14:03.529699+0000","last_became_active":"2023-12-11T20:13:52.469572+0000","last_became_peered":"2023-12-11T20:13:52.469572+0000","last_unstale":"2023-12-11T20:14:03.529699+0000","last_undegraded":"2023-12-11T20:14:03.529699+0000","last_fullsized":"2023-12-11T20:14:03.529699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:52:47.513645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525590+0000","last_change":"2023-12-11T20:12:30.330188+0000","last_active":"2023-12-11T20:14:03.525590+0000","last_peered":"2023-12-11T20:14:03.525590+0000","last_clean":"2023-12-11T20:14:03.525590+0000","last_became_active":"2023-12-11T20:12:30.329533+0000","last_became_peered":"2023-12-11T20:12:30.329533+0000","last_unstale":"2023-12-11T20:14:03.525590+0000","last_undegraded":"2023-12-11T20:14:03.525590+0000","last_fullsized":"2023-12-11T20:14:03.525590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_clean_scrub_stamp":"2023-12-11T20:08:47.558016+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:18:10.357750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523412+0000","last_change":"2023-12-11T20:13:53.278062+0000","last_active":"2023-12-11T20:14:03.523412+0000","last_peered":"2023-12-11T20:14:03.523412+0000","last_clean":"2023-12-11T20:14:03.523412+0000","last_became_active":"2023-12-11T20:13:53.277664+0000","last_became_peered":"2023-12-11T20:13:53.277664+0000","last_unstale":"2023-12-11T20:14:03.523412+0000","last_undegraded":"2023-12-11T20:14:03.523412+0000","last_fullsized":"2023-12-11T20:14:03.523412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:07:38.751486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.550614+0000","last_change":"2023-12-11T20:14:04.550614+0000","last_active":"2023-12-11T20:14:04.550614+0000","last_peered":"2023-12-11T20:14:04.550614+0000","last_clean":"2023-12-11T20:14:04.550614+0000","last_became_active":"2023-12-11T20:14:04.544469+0000","last_became_peered":"2023-12-11T20:14:04.544469+0000","last_unstale":"2023-12-11T20:14:04.550614+0000","last_undegraded":"2023-12-11T20:14:04.550614+0000","last_fullsized":"2023-12-11T20:14:04.550614+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:33.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.534431+0000","last_change":"2023-12-11T20:13:52.478823+0000","last_active":"2023-12-11T20:14:03.534431+0000","last_peered":"2023-12-11T20:14:03.534431+0000","last_clean":"2023-12-11T20:14:03.534431+0000","last_became_active":"2023-12-11T20:13:52.478475+0000","last_became_peered":"2023-12-11T20:13:52.478475+0000","last_unstale":"2023-12-11T20:14:03.534431+0000","last_undegraded":"2023-12-11T20:14:03.534431+0000","last_fullsized":"2023-12-11T20:14:03.534431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:44:36.438152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523651+0000","last_change":"2023-12-11T20:13:53.272496+0000","last_active":"2023-12-11T20:14:03.523651+0000","last_peered":"2023-12-11T20:14:03.523651+0000","last_clean":"2023-12-11T20:14:03.523651+0000","last_became_active":"2023-12-11T20:13:53.271669+0000","last_became_peered":"2023-12-11T20:13:53.271669+0000","last_unstale":"2023-12-11T20:14:03.523651+0000","last_undegraded":"2023-12-11T20:14:03.523651+0000","last_fullsized":"2023-12-11T20:14:03.523651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:48:31.299659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.539961+0000","last_change":"2023-12-11T20:13:52.485866+0000","last_active":"2023-12-11T20:14:04.539961+0000","last_peered":"2023-12-11T20:14:04.539961+0000","last_clean":"2023-12-11T20:14:04.539961+0000","last_became_active":"2023-12-11T20:13:52.485106+0000","last_became_peered":"2023-12-11T20:13:52.485106+0000","last_unstale":"2023-12-11T20:14:04.539961+0000","last_undegraded":"2023-12-11T20:14:04.539961+0000","last_fullsized":"2023-12-11T20:14:04.539961+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:24:41.177294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524733+0000","last_change":"2023-12-11T20:13:53.271737+0000","last_active":"2023-12-11T20:14:03.524733+0000","last_peered":"2023-12-11T20:14:03.524733+0000","last_clean":"2023-12-11T20:14:03.524733+0000","last_became_active":"2023-12-11T20:13:53.271228+0000","last_became_peered":"2023-12-11T20:13:53.271228+0000","last_unstale":"2023-12-11T20:14:03.524733+0000","last_undegraded":"2023-12-11T20:14:03.524733+0000","last_fullsized":"2023-12-11T20:14:03.524733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:45.614455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530437+0000","last_change":"2023-12-11T20:13:52.475488+0000","last_active":"2023-12-11T20:14:03.530437+0000","last_peered":"2023-12-11T20:14:03.530437+0000","last_clean":"2023-12-11T20:14:03.530437+0000","last_became_active":"2023-12-11T20:13:52.475150+0000","last_became_peered":"2023-12-11T20:13:52.475150+0000","last_unstale":"2023-12-11T20:14:03.530437+0000","last_undegraded":"2023-12-11T20:14:03.530437+0000","last_fullsized":"2023-12-11T20:14:03.530437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:42:55.792758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530746+0000","last_change":"2023-12-11T20:13:53.285381+0000","last_active":"2023-12-11T20:14:03.530746+0000","last_peered":"2023-12-11T20:14:03.530746+0000","last_clean":"2023-12-11T20:14:03.530746+0000","last_became_active":"2023-12-11T20:13:53.285069+0000","last_became_peered":"2023-12-11T20:13:53.285069+0000","last_unstale":"2023-12-11T20:14:03.530746+0000","last_undegraded":"2023-12-11T20:14:03.530746+0000","last_fullsized":"2023-12-11T20:14:03.530746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:57:18.630314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.522903+0000","last_change":"2023-12-11T20:13:52.483184+0000","last_active":"2023-12-11T20:14:03.522903+0000","last_peered":"2023-12-11T20:14:03.522903+0000","last_clean":"2023-12-11T20:14:03.522903+0000","last_became_active":"2023-12-11T20:13:52.482853+0000","last_became_peered":"2023-12-11T20:13:52.482853+0000","last_unstale":"2023-12-11T20:14:03.522903+0000","last_undegraded":"2023-12-11T20:14:03.522903+0000","last_fullsized":"2023-12-11T20:14:03.522903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:35.111222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.533766+0000","last_change":"2023-12-11T20:13:53.271751+0000","last_active":"2023-12-11T20:14:03.533766+0000","last_peered":"2023-12-11T20:14:03.533766+0000","last_clean":"2023-12-11T20:14:03.533766+0000","last_became_active":"2023-12-11T20:13:53.271385+0000","last_became_peered":"2023-12-11T20:13:53.271385+0000","last_unstale":"2023-12-11T20:14:03.533766+0000","last_undegraded":"2023-12-11T20:14:03.533766+0000","last_fullsized":"2023-12-11T20:14:03.533766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:28:03.856212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524287+0000","last_change":"2023-12-11T20:13:52.483504+0000","last_active":"2023-12-11T20:14:03.524287+0000","last_peered":"2023-12-11T20:14:03.524287+0000","last_clean":"2023-12-11T20:14:03.524287+0000","last_became_active":"2023-12-11T20:13:52.482796+0000","last_became_peered":"2023-12-11T20:13:52.482796+0000","last_unstale":"2023-12-11T20:14:03.524287+0000","last_undegraded":"2023-12-11T20:14:03.524287+0000","last_fullsized":"2023-12-11T20:14:03.524287+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:34:27.162215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529747+0000","last_change":"2023-12-11T20:13:53.276017+0000","last_active":"2023-12-11T20:14:03.529747+0000","last_peered":"2023-12-11T20:14:03.529747+0000","last_clean":"2023-12-11T20:14:03.529747+0000","last_became_active":"2023-12-11T20:13:53.275425+0000","last_became_peered":"2023-12-11T20:13:53.275425+0000","last_unstale":"2023-12-11T20:14:03.529747+0000","last_undegraded":"2023-12-11T20:14:03.529747+0000","last_fullsized":"2023-12-11T20:14:03.529747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:36.762187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531389+0000","last_change":"2023-12-11T20:13:52.477538+0000","last_active":"2023-12-11T20:14:03.531389+0000","last_peered":"2023-12-11T20:14:03.531389+0000","last_clean":"2023-12-11T20:14:03.531389+0000","last_became_active":"2023-12-11T20:13:52.476937+0000","last_became_peered":"2023-12-11T20:13:52.476937+0000","last_unstale":"2023-12-11T20:14:03.531389+0000","last_undegraded":"2023-12-11T20:14:03.531389+0000","last_fullsized":"2023-12-11T20:14:03.531389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:41:25.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524611+0000","last_change":"2023-12-11T20:13:53.276419+0000","last_active":"2023-12-11T20:14:03.524611+0000","last_peered":"2023-12-11T20:14:03.524611+0000","last_clean":"2023-12-11T20:14:03.524611+0000","last_became_active":"2023-12-11T20:13:53.276106+0000","last_became_peered":"2023-12-11T20:13:53.276106+0000","last_unstale":"2023-12-11T20:14:03.524611+0000","last_undegraded":"2023-12-11T20:14:03.524611+0000","last_fullsized":"2023-12-11T20:14:03.524611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:32.720877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.554132+0000","last_change":"2023-12-11T20:14:04.554132+0000","last_active":"2023-12-11T20:14:04.554132+0000","last_peered":"2023-12-11T20:14:04.554132+0000","last_clean":"2023-12-11T20:14:04.554132+0000","last_became_active":"2023-12-11T20:14:04.546343+0000","last_became_peered":"2023-12-11T20:14:04.546343+0000","last_unstale":"2023-12-11T20:14:04.554132+0000","last_undegraded":"2023-12-11T20:14:04.554132+0000","last_fullsized":"2023-12-11T20:14:04.554132+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:16:37.790659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.525955+0000","last_change":"2023-12-11T20:13:53.265917+0000","last_active":"2023-12-11T20:14:03.525955+0000","last_peered":"2023-12-11T20:14:03.525955+0000","last_clean":"2023-12-11T20:14:03.525955+0000","last_became_active":"2023-12-11T20:13:53.265569+0000","last_became_peered":"2023-12-11T20:13:53.265569+0000","last_unstale":"2023-12-11T20:14:03.525955+0000","last_undegraded":"2023-12-11T20:14:03.525955+0000","last_fullsized":"2023-12-11T20:14:03.525955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:37:19.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.531843+0000","last_change":"2023-12-11T20:13:52.478688+0000","last_active":"2023-12-11T20:14:03.531843+0000","last_peered":"2023-12-11T20:14:03.531843+0000","last_clean":"2023-12-11T20:14:03.531843+0000","last_became_active":"2023-12-11T20:13:52.477834+0000","last_became_peered":"2023-12-11T20:13:52.477834+0000","last_unstale":"2023-12-11T20:14:03.531843+0000","last_undegraded":"2023-12-11T20:14:03.531843+0000","last_fullsized":"2023-12-11T20:14:03.531843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:57:04.707801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526401+0000","last_change":"2023-12-11T20:13:53.274629+0000","last_active":"2023-12-11T20:14:03.526401+0000","last_peered":"2023-12-11T20:14:03.526401+0000","last_clean":"2023-12-11T20:14:03.526401+0000","last_became_active":"2023-12-11T20:13:53.269650+0000","last_became_peered":"2023-12-11T20:13:53.269650+0000","last_unstale":"2023-12-11T20:14:03.526401+0000","last_undegraded":"2023-12-11T20:14:03.526401+0000","last_fullsized":"2023-12-11T20:14:03.526401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:57:59.865232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526741+0000","last_change":"2023-12-11T20:13:52.485902+0000","last_active":"2023-12-11T20:14:03.526741+0000","last_peered":"2023-12-11T20:14:03.526741+0000","last_clean":"2023-12-11T20:14:03.526741+0000","last_became_active":"2023-12-11T20:13:52.481982+0000","last_became_peered":"2023-12-11T20:13:52.481982+0000","last_unstale":"2023-12-11T20:14:03.526741+0000","last_undegraded":"2023-12-11T20:14:03.526741+0000","last_fullsized":"2023-12-11T20:14:03.526741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:39.411648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-11T20:14:04.553595+0000","last_change":"2023-12-11T20:14:04.553595+0000","last_active":"2023-12-11T20:14:04.553595+0000","last_peered":"2023-12-11T20:14:04.553595+0000","last_clean":"2023-12-11T20:14:04.553595+0000","last_became_active":"2023-12-11T20:14:04.546235+0000","last_became_peered":"2023-12-11T20:14:04.546235+0000","last_unstale":"2023-12-11T20:14:04.553595+0000","last_undegraded":"2023-12-11T20:14:04.553595+0000","last_fullsized":"2023-12-11T20:14:04.553595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:45:21.354015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523713+0000","last_change":"2023-12-11T20:13:52.486510+0000","last_active":"2023-12-11T20:14:03.523713+0000","last_peered":"2023-12-11T20:14:03.523713+0000","last_clean":"2023-12-11T20:14:03.523713+0000","last_became_active":"2023-12-11T20:13:52.483852+0000","last_became_peered":"2023-12-11T20:13:52.483852+0000","last_unstale":"2023-12-11T20:14:03.523713+0000","last_undegraded":"2023-12-11T20:14:03.523713+0000","last_fullsized":"2023-12-11T20:14:03.523713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:40:05.242000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.526137+0000","last_change":"2023-12-11T20:13:53.270545+0000","last_active":"2023-12-11T20:14:03.526137+0000","last_peered":"2023-12-11T20:14:03.526137+0000","last_clean":"2023-12-11T20:14:03.526137+0000","last_became_active":"2023-12-11T20:13:53.270213+0000","last_became_peered":"2023-12-11T20:13:53.270213+0000","last_unstale":"2023-12-11T20:14:03.526137+0000","last_undegraded":"2023-12-11T20:14:03.526137+0000","last_fullsized":"2023-12-11T20:14:03.526137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:35.442471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529557+0000","last_change":"2023-12-11T20:13:53.276886+0000","last_active":"2023-12-11T20:14:03.529557+0000","last_peered":"2023-12-11T20:14:03.529557+0000","last_clean":"2023-12-11T20:14:03.529557+0000","last_became_active":"2023-12-11T20:13:53.276149+0000","last_became_peered":"2023-12-11T20:13:53.276149+0000","last_unstale":"2023-12-11T20:14:03.529557+0000","last_undegraded":"2023-12-11T20:14:03.529557+0000","last_fullsized":"2023-12-11T20:14:03.529557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:34:19.562002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530923+0000","last_change":"2023-12-11T20:13:53.279990+0000","last_active":"2023-12-11T20:14:03.530923+0000","last_peered":"2023-12-11T20:14:03.530923+0000","last_clean":"2023-12-11T20:14:03.530923+0000","last_became_active":"2023-12-11T20:13:53.279685+0000","last_became_peered":"2023-12-11T20:13:53.279685+0000","last_unstale":"2023-12-11T20:14:03.530923+0000","last_undegraded":"2023-12-11T20:14:03.530923+0000","last_fullsized":"2023-12-11T20:14:03.530923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:21:36.526683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530995+0000","last_change":"2023-12-11T20:13:53.279128+0000","last_active":"2023-12-11T20:14:03.530995+0000","last_peered":"2023-12-11T20:14:03.530995+0000","last_clean":"2023-12-11T20:14:03.530995+0000","last_became_active":"2023-12-11T20:13:53.278821+0000","last_became_peered":"2023-12-11T20:13:53.278821+0000","last_unstale":"2023-12-11T20:14:03.530995+0000","last_undegraded":"2023-12-11T20:14:03.530995+0000","last_fullsized":"2023-12-11T20:14:03.530995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:49:36.013115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.530152+0000","last_change":"2023-12-11T20:13:53.281004+0000","last_active":"2023-12-11T20:14:03.530152+0000","last_peered":"2023-12-11T20:14:03.530152+0000","last_clean":"2023-12-11T20:14:03.530152+0000","last_became_active":"2023-12-11T20:13:53.280691+0000","last_became_peered":"2023-12-11T20:13:53.280691+0000","last_unstale":"2023-12-11T20:14:03.530152+0000","last_undegraded":"2023-12-11T20:14:03.530152+0000","last_fullsized":"2023-12-11T20:14:03.530152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:00.336975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523682+0000","last_change":"2023-12-11T20:13:53.272690+0000","last_active":"2023-12-11T20:14:03.523682+0000","last_peered":"2023-12-11T20:14:03.523682+0000","last_clean":"2023-12-11T20:14:03.523682+0000","last_became_active":"2023-12-11T20:13:53.272194+0000","last_became_peered":"2023-12-11T20:13:53.272194+0000","last_unstale":"2023-12-11T20:14:03.523682+0000","last_undegraded":"2023-12-11T20:14:03.523682+0000","last_fullsized":"2023-12-11T20:14:03.523682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:58:45.312035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529998+0000","last_change":"2023-12-11T20:13:53.277625+0000","last_active":"2023-12-11T20:14:03.529998+0000","last_peered":"2023-12-11T20:14:03.529998+0000","last_clean":"2023-12-11T20:14:03.529998+0000","last_became_active":"2023-12-11T20:13:53.277174+0000","last_became_peered":"2023-12-11T20:13:53.277174+0000","last_unstale":"2023-12-11T20:14:03.529998+0000","last_undegraded":"2023-12-11T20:14:03.529998+0000","last_fullsized":"2023-12-11T20:14:03.529998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:01:41.057178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.532373+0000","last_change":"2023-12-11T20:13:53.278685+0000","last_active":"2023-12-11T20:14:03.532373+0000","last_peered":"2023-12-11T20:14:03.532373+0000","last_clean":"2023-12-11T20:14:03.532373+0000","last_became_active":"2023-12-11T20:13:53.276894+0000","last_became_peered":"2023-12-11T20:13:53.276894+0000","last_unstale":"2023-12-11T20:14:03.532373+0000","last_undegraded":"2023-12-11T20:14:03.532373+0000","last_fullsized":"2023-12-11T20:14:03.532373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:21:00.004496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524669+0000","last_change":"2023-12-11T20:13:53.285596+0000","last_active":"2023-12-11T20:14:03.524669+0000","last_peered":"2023-12-11T20:14:03.524669+0000","last_clean":"2023-12-11T20:14:03.524669+0000","last_became_active":"2023-12-11T20:13:53.285289+0000","last_became_peered":"2023-12-11T20:13:53.285289+0000","last_unstale":"2023-12-11T20:14:03.524669+0000","last_undegraded":"2023-12-11T20:14:03.524669+0000","last_fullsized":"2023-12-11T20:14:03.524669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:53:59.939751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.527062+0000","last_change":"2023-12-11T20:13:53.272600+0000","last_active":"2023-12-11T20:14:03.527062+0000","last_peered":"2023-12-11T20:14:03.527062+0000","last_clean":"2023-12-11T20:14:03.527062+0000","last_became_active":"2023-12-11T20:13:53.272308+0000","last_became_peered":"2023-12-11T20:13:53.272308+0000","last_unstale":"2023-12-11T20:14:03.527062+0000","last_undegraded":"2023-12-11T20:14:03.527062+0000","last_fullsized":"2023-12-11T20:14:03.527062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.458731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.524229+0000","last_change":"2023-12-11T20:13:53.280833+0000","last_active":"2023-12-11T20:14:03.524229+0000","last_peered":"2023-12-11T20:14:03.524229+0000","last_clean":"2023-12-11T20:14:03.524229+0000","last_became_active":"2023-12-11T20:13:53.280384+0000","last_became_peered":"2023-12-11T20:13:53.280384+0000","last_unstale":"2023-12-11T20:14:03.524229+0000","last_undegraded":"2023-12-11T20:14:03.524229+0000","last_fullsized":"2023-12-11T20:14:03.524229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:37:38.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.522928+0000","last_change":"2023-12-11T20:13:53.271825+0000","last_active":"2023-12-11T20:14:03.522928+0000","last_peered":"2023-12-11T20:14:03.522928+0000","last_clean":"2023-12-11T20:14:03.522928+0000","last_became_active":"2023-12-11T20:13:53.271460+0000","last_became_peered":"2023-12-11T20:13:53.271460+0000","last_unstale":"2023-12-11T20:14:03.522928+0000","last_undegraded":"2023-12-11T20:14:03.522928+0000","last_fullsized":"2023-12-11T20:14:03.522928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:46:46.147904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.523799+0000","last_change":"2023-12-11T20:13:53.270103+0000","last_active":"2023-12-11T20:14:03.523799+0000","last_peered":"2023-12-11T20:14:03.523799+0000","last_clean":"2023-12-11T20:14:03.523799+0000","last_became_active":"2023-12-11T20:13:53.269781+0000","last_became_peered":"2023-12-11T20:13:53.269781+0000","last_unstale":"2023-12-11T20:14:03.523799+0000","last_undegraded":"2023-12-11T20:14:03.523799+0000","last_fullsized":"2023-12-11T20:14:03.523799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.865347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-12-11T20:14:03.529183+0000","last_change":"2023-12-11T20:13:53.284310+0000","last_active":"2023-12-11T20:14:03.529183+0000","last_peered":"2023-12-11T20:14:03.529183+0000","last_clean":"2023-12-11T20:14:03.529183+0000","last_became_active":"2023-12-11T20:13:53.283969+0000","last_became_peered":"2023-12-11T20:13:53.283969+0000","last_unstale":"2023-12-11T20:14:03.529183+0000","last_undegraded":"2023-12-11T20:14:03.529183+0000","last_fullsized":"2023-12-11T20:14:03.529183+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:00:47.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":217636,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64397,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":319,"num_read_kb":225,"num_write":150,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383706,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":456083,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.502},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.44900000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.751}]},{"osd":5,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.84899999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":9,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.0509999999999999}]},{"osd":10,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.077},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":4.0979999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":1.008}]}]},{"osd":10,"up_from":72,"seq":309237645343,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":1107968,"data_compressed":42397,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.629,"15min":0.63800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89200000000000002,"5min":1.268,"15min":1.268},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89400000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92600000000000005,"5min":1.107,"15min":1.107},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0900000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94799999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.81699999999999995,"15min":0.84199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.042,"5min":1.323,"15min":1.323},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.82299999999999995,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.069,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.92500000000000004,"15min":0.94799999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.04,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.90300000000000002,"15min":0.92100000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1359999999999999,"5min":1.641,"15min":1.641},"last":0.878}]},{"osd":6,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93600000000000005,"15min":0.95799999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0900000000000001,"5min":1.484,"15min":1.484},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.99199999999999999,"15min":1.022},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.107,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93799999999999994}]},{"osd":8,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":1.032,"15min":1.0649999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1839999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":1.0489999999999999,"15min":1.0800000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.135,"5min":1.667,"15min":1.667},"last":0.89400000000000002}]},{"osd":9,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.056,"15min":1.087},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.238,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.083,"15min":1.1200000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.208,"5min":1.615,"15min":1.615},"last":0.80000000000000004}]},{"osd":11,"last update":"Mon Dec 11 20:13:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.86499999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":456319,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.755}]},{"osd":1,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.69199999999999995,"15min":0.70299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.872,"15min":0.89600000000000002},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1539999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.753,"15min":0.76900000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94799999999999995,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.62}]},{"osd":3,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.85599999999999998,"15min":0.878},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1020000000000001,"5min":1.504,"15min":1.504},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0189999999999999,"5min":1.071,"15min":1.071},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.069,"5min":1.302,"15min":1.302},"last":0.439}]},{"osd":5,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.873,"15min":0.89700000000000002},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.125,"5min":1.508,"15min":1.508},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":0.86199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93300000000000005,"5min":1.375,"15min":1.375},"last":0.63700000000000001}]},{"osd":6,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":1.006,"15min":1.038},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.21,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.88600000000000001,"15min":0.91700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0529999999999999,"5min":1.484,"15min":1.484},"last":0.55800000000000005}]},{"osd":7,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.95499999999999996,"15min":0.97899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1779999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.0589999999999999,"15min":1.087},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.302,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.58599999999999997}]},{"osd":8,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":1.0680000000000001,"15min":1.099},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.26,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.96699999999999997,"15min":0.99299999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0900000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.77000000000000002}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.94699999999999995,"15min":0.96499999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.083,"5min":1.53,"15min":1.53},"last":0.68500000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070505,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":456031,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.443},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.49099999999999999}]},{"osd":1,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":1.079,"15min":1.079},"last":1.0429999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.054,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.80400000000000005},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92400000000000004,"5min":1.081,"15min":1.081},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.81100000000000005,"5min":1.226,"15min":1.226},"last":0.46899999999999997}]},{"osd":4,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0529999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.93999999999999995}]},{"osd":5,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.0760000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.018,"5min":1.232,"15min":1.232},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.028,"5min":1.284,"15min":1.284},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.55200000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97199999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.53400000000000003}]},{"osd":7,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0049999999999999,"5min":1.298,"15min":1.298},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94699999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1619999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.071}]},{"osd":9,"last update":"Mon Dec 11 20:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":0.94299999999999995},"min":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.88800000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96199999999999997,"15min":0.96299999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90300000000000002,"15min":0.89600000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.167,"5min":1.331,"15min":1.331},"last":0.98299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":7,"up_from":51,"seq":219043332144,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":1048562,"data_compressed":42397,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76800000000000002,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.99299999999999999,"5min":1.327,"15min":1.327},"last":0.58699999999999997}]},{"osd":2,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98399999999999999,"5min":1.518,"15min":1.518},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.76400000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0349999999999999,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.749,"15min":0.73499999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.99199999999999999,"5min":1.383,"15min":1.383},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98799999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90800000000000003}]},{"osd":4,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47599999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93700000000000006,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0009999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84599999999999997,"15min":0.83899999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.135,"5min":1.294,"15min":1.294},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.044,"5min":1.474,"15min":1.474},"last":1.038}]},{"osd":6,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.59199999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0309999999999999,"5min":1.327,"15min":1.327},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.86599999999999999,"15min":0.85999999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.05,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.89100000000000001}]},{"osd":8,"last update":"Mon Dec 11 20:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96899999999999997},"min":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.133,"5min":1.544,"15min":1.544},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.0669999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.87}]},{"osd":9,"last update":"Mon Dec 11 20:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.98999999999999999,"15min":1.002},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.1479999999999999,"5min":1.573,"15min":1.573},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.0169999999999999,"15min":1.0329999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.103,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.137}]},{"osd":10,"last update":"Mon Dec 11 20:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0980000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.01,"15min":1.026},"min":{"1min":0.66800000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1200000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.81200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":6,"up_from":46,"seq":197568495669,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":455714,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91100000000000003,"5min":1.036,"15min":1.036},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.81799999999999995,"15min":0.76300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.069,"5min":8.1080000000000005,"15min":8.1080000000000005},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.86599999999999999,"15min":0.98999999999999999},"min":{"1min":0.55800000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.751}]},{"osd":3,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.496},{"interface":"front","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0209999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94599999999999995,"15min":1.083},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.137,"5min":6.9489999999999998,"15min":6.9489999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97099999999999997,"5min":1.167,"15min":1.167},"last":0.65700000000000003}]},{"osd":5,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.63800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1120000000000001,"5min":1.226,"15min":1.226},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Mon Dec 11 20:14:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.84799999999999998},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.25,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1559999999999999,"5min":1.228,"15min":1.228},"last":0.63600000000000001}]},{"osd":8,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.153,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.90100000000000002,"15min":0.86599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":8.1289999999999996,"5min":8.1289999999999996,"15min":8.1289999999999996},"last":0.81299999999999994}]},{"osd":9,"last update":"Mon Dec 11 20:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.89500000000000002,"15min":0.91500000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.107,"5min":1.204,"15min":1.204},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.99399999999999999,"15min":1.014},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2130000000000001,"5min":1.319,"15min":1.319},"last":0.745}]},{"osd":10,"last update":"Mon Dec 11 20:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.90200000000000002,"15min":0.91000000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0720000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.103},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.97899999999999998,"15min":0.99099999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.1850000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":515167,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63300000000000001,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.66700000000000004,"15min":0.57899999999999996},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":4.6319999999999997,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64100000000000001,"15min":0.58499999999999996},"min":{"1min":0.49299999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.61699999999999999,"15min":0.57599999999999996},"min":{"1min":0.45100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68700000000000006,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96299999999999997,"5min":1.075,"15min":1.075},"last":0.79800000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58799999999999997,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.96099999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Mon Dec 11 20:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.70199999999999996},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.74099999999999999,"15min":0.69499999999999995},"min":{"1min":0.51500000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":1.036}]},{"osd":6,"last update":"Mon Dec 11 20:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.77800000000000002,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.69199999999999995}]},{"osd":7,"last update":"Mon Dec 11 20:14:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.82599999999999996,"15min":0.81999999999999995},"min":{"1min":0.55100000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.998},{"interface":"front","average":{"1min":0.751,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.379,"15min":0.379},"max":{"1min":1.0780000000000001,"5min":1.099,"15min":1.099},"last":0.77100000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80200000000000005,"15min":0.77300000000000002},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1459999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.90400000000000003,"15min":0.86399999999999999},"min":{"1min":0.71099999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.24,"15min":1.24},"last":1.0740000000000001}]},{"osd":9,"last update":"Mon Dec 11 20:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94499999999999995,"15min":0.94599999999999995},"min":{"1min":0.747,"5min":0.628,"15min":0.628},"max":{"1min":1.208,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88100000000000001,"15min":0.88600000000000001},"min":{"1min":0.70799999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.97699999999999998}]},{"osd":10,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.026,"15min":1.032},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2589999999999999,"5min":1.381,"15min":1.381},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0249999999999999,"15min":1.0189999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.143}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":456979,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 20:14:25 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.626,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86299999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.626,"15min":0.57599999999999996},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38},"max":{"1min":0.88300000000000001,"5min":1.048,"15min":1.048},"last":1.0629999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.82499999999999996}]},{"osd":3,"last update":"Mon Dec 11 20:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.35299999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.90100000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68400000000000005,"15min":0.64800000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.909,"15min":1.909},"last":0.75700000000000001}]},{"osd":5,"last update":"Mon Dec 11 20:14:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73099999999999998,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.01,"5min":1.036,"15min":1.036},"last":0.66300000000000003}]},{"osd":6,"last update":"Mon Dec 11 20:14:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.93999999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.1000000000000001}]},{"osd":9,"last update":"Mon Dec 11 20:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.51200000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.88,"15min":0.89000000000000001},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.86499999999999999}]},{"osd":10,"last update":"Mon Dec 11 20:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.94099999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.026},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.90800000000000003,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.84699999999999998}]},{"osd":11,"last update":"Mon Dec 11 20:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.88500000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":516906,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.622}]},{"osd":1,"last update":"Mon Dec 11 20:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63700000000000001,"15min":0.60899999999999999},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":1.0369999999999999,"5min":1.089,"15min":1.089},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65300000000000002,"15min":0.60999999999999999},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98999999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64300000000000002,"15min":0.624},"min":{"1min":0.436,"5min":0.373,"15min":0.373},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Dec 11 20:13:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.64500000000000002,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.90300000000000002}]},{"osd":5,"last update":"Mon Dec 11 20:14:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.63800000000000001,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0409999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65600000000000003,"15min":0.63400000000000001},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.67300000000000004},"min":{"1min":0.52200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.92200000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.80400000000000005,"15min":0.74399999999999999},"min":{"1min":0.61799999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1579999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.873}]},{"osd":7,"last update":"Mon Dec 11 20:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.101,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59799999999999998}]},{"osd":8,"last update":"Mon Dec 11 20:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79300000000000004,"15min":0.78100000000000003},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1579999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.86099999999999999,"15min":0.85899999999999999},"min":{"1min":0.53900000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.089,"5min":1.254,"15min":1.254},"last":0.92700000000000005}]},{"osd":9,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.91700000000000004,"15min":0.91500000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.0169999999999999}]},{"osd":10,"last update":"Mon Dec 11 20:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.67300000000000004,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.165,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96799999999999997,"15min":0.96399999999999997},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0429999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":455700,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.46300000000000002,"15min":0.41599999999999998},"min":{"1min":0.32100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.88500000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.99299999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.0920000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.66400000000000003,"15min":0.622},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.044,"5min":1.085,"15min":1.085},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70299999999999996,"15min":0.64500000000000002},"min":{"1min":0.53000000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.93799999999999994}]},{"osd":2,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69099999999999995,"15min":0.622},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90700000000000003,"5min":1.288,"15min":1.288},"last":0.624}]},{"osd":4,"last update":"Mon Dec 11 20:13:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.65300000000000002},"min":{"1min":0.61799999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.71699999999999997,"15min":0.67200000000000004},"min":{"1min":0.59599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.0429999999999999}]},{"osd":5,"last update":"Mon Dec 11 20:14:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.47599999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.871,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76800000000000002,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.111,"5min":1.145,"15min":1.145},"last":1.0229999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":2.0419999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.98599999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80300000000000005,"15min":0.78700000000000003},"min":{"1min":0.497,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88200000000000001,"15min":0.85599999999999998},"min":{"1min":0.66900000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0820000000000001}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.85799999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.96499999999999997,"15min":0.97299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.071}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96899999999999997,"15min":0.97499999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.1000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]}]},{"osd":4,"up_from":33,"seq":141733920833,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":456534,"data_compressed":5851,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57999999999999996,"15min":0.53900000000000003},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.496}]},{"osd":1,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78600000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.36099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65200000000000002,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88800000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.72999999999999998,"15min":0.69399999999999995},"min":{"1min":0.60099999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.026,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.95699999999999996}]},{"osd":3,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64400000000000002,"15min":0.62},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83899999999999997,"5min":0.872,"15min":0.872},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Dec 11 20:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.753,"15min":0.70899999999999996},"min":{"1min":0.61599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.72399999999999998},"min":{"1min":0.56299999999999994,"5min":0.435,"15min":0.435},"max":{"1min":1.004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.98499999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.81100000000000005,"15min":0.77500000000000002},"min":{"1min":0.65900000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.86699999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.626,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.66700000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.90300000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.90200000000000002,"15min":0.88800000000000001},"min":{"1min":0.80300000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.1559999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.88100000000000001,"15min":0.871},"min":{"1min":0.76500000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.034},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.89500000000000002,"15min":0.88300000000000001},"min":{"1min":0.73599999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.014}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.94999999999999996,"15min":0.94399999999999995},"min":{"1min":0.79400000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.119},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78100000000000003},"min":{"1min":0.628,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.93200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":1047403,"data_compressed":42397,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59699999999999998,"15min":0.57499999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.5700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63500000000000001,"15min":0.60799999999999998},"min":{"1min":0.49199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.66100000000000003,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.497},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.69899999999999995,"15min":0.65700000000000003},"min":{"1min":0.499,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.96799999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.623},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.41299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.53100000000000003}]},{"osd":3,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65800000000000003,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.028,"5min":1.127,"15min":1.127},"last":0.78100000000000003}]},{"osd":4,"last update":"Mon Dec 11 20:14:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.74399999999999999,"15min":0.71199999999999997},"min":{"1min":0.626,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.74099999999999999,"15min":0.69499999999999995},"min":{"1min":0.57199999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Dec 11 20:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.76900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0369999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78000000000000003,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.5960000000000001}]},{"osd":7,"last update":"Mon Dec 11 20:14:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.80700000000000005,"15min":0.78000000000000003},"min":{"1min":0.60799999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.82699999999999996,"15min":0.78800000000000003},"min":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":0.67700000000000005}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77300000000000002,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0309999999999999,"5min":1.589,"15min":1.589},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.85499999999999998,"15min":0.82699999999999996},"min":{"1min":0.72299999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.27,"5min":1.403,"15min":1.403},"last":0.82199999999999995}]},{"osd":9,"last update":"Mon Dec 11 20:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93700000000000006,"15min":0.93600000000000005},"min":{"1min":0.69999999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.875},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85399999999999998,"15min":0.84899999999999998},"min":{"1min":0.72599999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.88200000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98099999999999998,"15min":0.98299999999999998},"min":{"1min":0.76200000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.244,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.76700000000000002,"5min":0.752,"15min":0.752},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34906,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T20:14:50.679 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-11T20:14:50.679 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-11T20:14:50.679 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-11T20:14:50.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph health --format=json 2023-12-11T20:14:50.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:50 smithi032 ceph-mon[132488]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:14:51.466 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:14:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:51 smithi039 ceph-mon[102205]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:14:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:51 smithi012 ceph-mon[128787]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:14:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:51 smithi032 ceph-mon[132488]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:14:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.013+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3311951425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 msgr2=0x7f4d30101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.013+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3311951425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 0x7f4d30101b00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009990 tx=0x7f4d24009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.013+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3311951425 shutdown_connections 2023-12-11T20:14:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.013+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3311951425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d30102040 0x7f4d3010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.013+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3311951425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d301076f0 0x7f4d30107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.013+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3311951425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 0x7f4d30101b00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.013+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3311951425 >> 172.21.15.12:0/3311951425 conn(0x7f4d300787c0 msgr2=0x7f4d30078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:53.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.014+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3311951425 shutdown_connections 2023-12-11T20:14:53.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.014+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3311951425 wait complete. 2023-12-11T20:14:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d35a3c700 1 Processor -- start 2023-12-11T20:14:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d35a3c700 1 -- start start 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d35a3c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 0x7f4d3019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d35a3c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d30102040 0x7f4d3019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d35a3c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d301076f0 0x7f4d30197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d35a3c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30197f00 con 0x7f4d30101680 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d35a3c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30198070 con 0x7f4d30102040 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d35a3c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30198230 con 0x7f4d301076f0 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.015+0000 7f4d2effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 0x7f4d3019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 0x7f4d3019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40272/0 (socket says 172.21.15.12:40272) 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2effd700 1 -- 172.21.15.12:0/3299784403 learned_addr learned my addr 172.21.15.12:0/3299784403 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2f7fe700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d301076f0 0x7f4d30197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2e7fc700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d30102040 0x7f4d3019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2effd700 1 -- 172.21.15.12:0/3299784403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d301076f0 msgr2=0x7f4d30197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2effd700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d301076f0 0x7f4d30197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2effd700 1 -- 172.21.15.12:0/3299784403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d30102040 msgr2=0x7f4d3019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2effd700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d30102040 0x7f4d3019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2effd700 1 -- 172.21.15.12:0/3299784403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240095f0 con 0x7f4d30101680 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2f7fe700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d301076f0 0x7f4d30197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2e7fc700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d30102040 0x7f4d3019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.016+0000 7f4d2effd700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 0x7f4d3019d6a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e9a0 tx=0x7f4d2000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.017+0000 7f4d34a3a700 1 -- 172.21.15.12:0/3299784403 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20009790 con 0x7f4d30101680 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.017+0000 7f4d34a3a700 1 -- 172.21.15.12:0/3299784403 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d2000cbd0 con 0x7f4d30101680 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.017+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d30198510 con 0x7f4d30101680 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.017+0000 7f4d34a3a700 1 -- 172.21.15.12:0/3299784403 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20018680 con 0x7f4d30101680 2023-12-11T20:14:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.017+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d301a4670 con 0x7f4d30101680 2023-12-11T20:14:53.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.018+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d30109b80 con 0x7f4d30101680 2023-12-11T20:14:53.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.020+0000 7f4d34a3a700 1 -- 172.21.15.12:0/3299784403 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f4d2000cd40 con 0x7f4d30101680 2023-12-11T20:14:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.021+0000 7f4d34a3a700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d180a1590 0x7f4d180a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.021+0000 7f4d34a3a700 1 -- 172.21.15.12:0/3299784403 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f4d20014070 con 0x7f4d30101680 2023-12-11T20:14:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.021+0000 7f4d2e7fc700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d180a1590 0x7f4d180a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.022+0000 7f4d2e7fc700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d180a1590 0x7f4d180a3a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d30198f30 tx=0x7f4d24005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.023+0000 7f4d34a3a700 1 -- 172.21.15.12:0/3299784403 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4d200967a0 con 0x7f4d30101680 2023-12-11T20:14:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.282+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4d30102d10 con 0x7f4d30101680 2023-12-11T20:14:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.282+0000 7f4d34a3a700 1 -- 172.21.15.12:0/3299784403 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4d20099dc0 con 0x7f4d30101680 2023-12-11T20:14:53.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:53.282 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d180a1590 msgr2=0x7f4d180a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d180a1590 0x7f4d180a3a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d30198f30 tx=0x7f4d24005fd0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 msgr2=0x7f4d3019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 0x7f4d3019d6a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000e9a0 tx=0x7f4d2000ed60 comp rx=0 tx=0).stop 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 shutdown_connections 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d180a1590 0x7f4d180a3a50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d301076f0 0x7f4d30197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d30101680 0x7f4d3019d6a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 --2- 172.21.15.12:0/3299784403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d30102040 0x7f4d3019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 >> 172.21.15.12:0/3299784403 conn(0x7f4d300787c0 msgr2=0x7f4d301004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:53.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 shutdown_connections 2023-12-11T20:14:53.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.285+0000 7f4d35a3c700 1 -- 172.21.15.12:0/3299784403 wait complete. 2023-12-11T20:14:53.763 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-11T20:14:53.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:14:53.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 -- 172.21.15.12:0/802923537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 msgr2=0x7f789c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:53.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 --2- 172.21.15.12:0/802923537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 0x7f789c1098e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f789400b0d0 tx=0x7f789400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 -- 172.21.15.12:0/802923537 shutdown_connections 2023-12-11T20:14:53.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 --2- 172.21.15.12:0/802923537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f789c1014a0 0x7f789c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 --2- 172.21.15.12:0/802923537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 0x7f789c1098e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 --2- 172.21.15.12:0/802923537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f789c102690 0x7f789c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 -- 172.21.15.12:0/802923537 >> 172.21.15.12:0/802923537 conn(0x7f789c0fca10 msgr2=0x7f789c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:53.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 -- 172.21.15.12:0/802923537 shutdown_connections 2023-12-11T20:14:53.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.973+0000 7f78a25ff700 1 -- 172.21.15.12:0/802923537 wait complete. 2023-12-11T20:14:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.974+0000 7f78a25ff700 1 Processor -- start 2023-12-11T20:14:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.974+0000 7f78a25ff700 1 -- start start 2023-12-11T20:14:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a25ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f789c1014a0 0x7f789c1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a25ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f789c102690 0x7f789c1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a25ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 0x7f789c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a25ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c19eee0 con 0x7f789c103030 2023-12-11T20:14:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a25ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c19f020 con 0x7f789c102690 2023-12-11T20:14:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a25ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c19f1b0 con 0x7f789c1014a0 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 0x7f789c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 0x7f789c19e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40284/0 (socket says 172.21.15.12:40284) 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a0b9c700 1 -- 172.21.15.12:0/680338851 learned_addr learned my addr 172.21.15.12:0/680338851 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f789b7fe700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f789c102690 0x7f789c1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f789bfff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f789c1014a0 0x7f789c1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a0b9c700 1 -- 172.21.15.12:0/680338851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f789c1014a0 msgr2=0x7f789c1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a0b9c700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f789c1014a0 0x7f789c1973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a0b9c700 1 -- 172.21.15.12:0/680338851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f789c102690 msgr2=0x7f789c1978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a0b9c700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f789c102690 0x7f789c1978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.975+0000 7f78a0b9c700 1 -- 172.21.15.12:0/680338851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894009d00 con 0x7f789c103030 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.976+0000 7f78a0b9c700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 0x7f789c19e910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7894007b60 tx=0x7f7894009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.976+0000 7f78997fa700 1 -- 172.21.15.12:0/680338851 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789400e040 con 0x7f789c103030 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.976+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c19f430 con 0x7f789c103030 2023-12-11T20:14:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.976+0000 7f78997fa700 1 -- 172.21.15.12:0/680338851 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7894012d90 con 0x7f789c103030 2023-12-11T20:14:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.976+0000 7f78997fa700 1 -- 172.21.15.12:0/680338851 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789401de80 con 0x7f789c103030 2023-12-11T20:14:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.976+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c19f8b0 con 0x7f789c103030 2023-12-11T20:14:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.977+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789c108850 con 0x7f789c103030 2023-12-11T20:14:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.979+0000 7f78997fa700 1 -- 172.21.15.12:0/680338851 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f7894012900 con 0x7f789c103030 2023-12-11T20:14:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.980+0000 7f78997fa700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f78840a1510 0x7f78840a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.980+0000 7f78997fa700 1 -- 172.21.15.12:0/680338851 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f78940cecf0 con 0x7f789c103030 2023-12-11T20:14:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.980+0000 7f789bfff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f78840a1510 0x7f78840a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:53.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.981+0000 7f789bfff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f78840a1510 0x7f78840a39d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f789c1024f0 tx=0x7f788c00b5b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:53.984+0000 7f78997fa700 1 -- 172.21.15.12:0/680338851 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7894098210 con 0x7f789c103030 2023-12-11T20:14:54.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.204+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f789c10cbb0 con 0x7f789c103030 2023-12-11T20:14:54.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.205+0000 7f78997fa700 1 -- 172.21.15.12:0/680338851 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22547 (secure 0 0 0) 0x7f789409b830 con 0x7f789c103030 2023-12-11T20:14:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:54.205 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:14:04.519931+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f78840a1510 msgr2=0x7f78840a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f78840a1510 0x7f78840a39d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f789c1024f0 tx=0x7f788c00b5b0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 msgr2=0x7f789c19e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 0x7f789c19e910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7894007b60 tx=0x7f7894009440 comp rx=0 tx=0).stop 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 shutdown_connections 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f78840a1510 0x7f78840a39d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f789c103030 0x7f789c19e910 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f789c1014a0 0x7f789c1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 --2- 172.21.15.12:0/680338851 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f789c102690 0x7f789c1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 >> 172.21.15.12:0/680338851 conn(0x7f789c0fca10 msgr2=0x7f789c105990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:54.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 shutdown_connections 2023-12-11T20:14:54.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.208+0000 7f78a25ff700 1 -- 172.21.15.12:0/680338851 wait complete. 2023-12-11T20:14:54.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:14:54.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:14:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 -- 172.21.15.12:0/3986502702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 msgr2=0x7fc5401098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 --2- 172.21.15.12:0/3986502702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 0x7fc5401098f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc53800b0d0 tx=0x7fc53800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 -- 172.21.15.12:0/3986502702 shutdown_connections 2023-12-11T20:14:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 --2- 172.21.15.12:0/3986502702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 0x7fc5401098f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 --2- 172.21.15.12:0/3986502702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5401014b0 0x7fc5401018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 --2- 172.21.15.12:0/3986502702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5401026a0 0x7fc540102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 -- 172.21.15.12:0/3986502702 >> 172.21.15.12:0/3986502702 conn(0x7fc5400fca00 msgr2=0x7fc5400fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 -- 172.21.15.12:0/3986502702 shutdown_connections 2023-12-11T20:14:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.435+0000 7fc544bff700 1 -- 172.21.15.12:0/3986502702 wait complete. 2023-12-11T20:14:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.437+0000 7fc544bff700 1 Processor -- start 2023-12-11T20:14:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.437+0000 7fc544bff700 1 -- start start 2023-12-11T20:14:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.437+0000 7fc544bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5401014b0 0x7fc540197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.437+0000 7fc544bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5401026a0 0x7fc5401979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc544bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 0x7fc54019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc544bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54019ef90 con 0x7fc540103040 2023-12-11T20:14:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc544bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54019f0d0 con 0x7fc5401014b0 2023-12-11T20:14:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc544bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54019f260 con 0x7fc5401026a0 2023-12-11T20:14:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 0x7fc54019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 0x7fc54019e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40312/0 (socket says 172.21.15.12:40312) 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 -- 172.21.15.12:0/664140610 learned_addr learned my addr 172.21.15.12:0/664140610 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53dd9b700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5401026a0 0x7fc5401979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53e59c700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5401014b0 0x7fc540197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 -- 172.21.15.12:0/664140610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5401026a0 msgr2=0x7fc5401979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5401026a0 0x7fc5401979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 -- 172.21.15.12:0/664140610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5401014b0 msgr2=0x7fc540197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5401014b0 0x7fc540197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 -- 172.21.15.12:0/664140610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc538009d00 con 0x7fc540103040 2023-12-11T20:14:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.438+0000 7fc53ed9d700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 0x7fc54019e9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc538007b60 tx=0x7fc538009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.439+0000 7fc52f7fe700 1 -- 172.21.15.12:0/664140610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53800e040 con 0x7fc540103040 2023-12-11T20:14:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.439+0000 7fc52f7fe700 1 -- 172.21.15.12:0/664140610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc538012d90 con 0x7fc540103040 2023-12-11T20:14:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.439+0000 7fc52f7fe700 1 -- 172.21.15.12:0/664140610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53801de80 con 0x7fc540103040 2023-12-11T20:14:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.439+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54019f4e0 con 0x7fc540103040 2023-12-11T20:14:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.439+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54019f910 con 0x7fc540103040 2023-12-11T20:14:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.440+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5401089d0 con 0x7fc540103040 2023-12-11T20:14:54.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.442+0000 7fc52f7fe700 1 -- 172.21.15.12:0/664140610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fc538012900 con 0x7fc540103040 2023-12-11T20:14:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.443+0000 7fc52f7fe700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5280a1590 0x7fc5280a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.443+0000 7fc52f7fe700 1 -- 172.21.15.12:0/664140610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fc5380ceca0 con 0x7fc540103040 2023-12-11T20:14:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.443+0000 7fc53e59c700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5280a1590 0x7fc5280a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.444+0000 7fc53e59c700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5280a1590 0x7fc5280a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc530005950 tx=0x7fc5300058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.447+0000 7fc52f7fe700 1 -- 172.21.15.12:0/664140610 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc5380981c0 con 0x7fc540103040 2023-12-11T20:14:54.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:54 smithi032 ceph-mon[132488]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:54.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:54 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3299784403' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-11T20:14:54.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:54 smithi039 ceph-mon[102205]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3299784403' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-11T20:14:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:54 smithi012 ceph-mon[128787]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3299784403' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-11T20:14:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.657+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc54010cbc0 con 0x7fc540103040 2023-12-11T20:14:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.657+0000 7fc52f7fe700 1 -- 172.21.15.12:0/664140610 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc53809b7e0 con 0x7fc540103040 2023-12-11T20:14:54.657 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.659+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5280a1590 msgr2=0x7fc5280a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.659+0000 7fc544bff700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5280a1590 0x7fc5280a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc530005950 tx=0x7fc5300058e0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 msgr2=0x7fc54019e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 0x7fc54019e9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc538007b60 tx=0x7fc538009440 comp rx=0 tx=0).stop 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 shutdown_connections 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5280a1590 0x7fc5280a3a50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5401014b0 0x7fc540197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc540103040 0x7fc54019e9c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 --2- 172.21.15.12:0/664140610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5401026a0 0x7fc5401979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 >> 172.21.15.12:0/664140610 conn(0x7fc5400fca00 msgr2=0x7fc540105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 shutdown_connections 2023-12-11T20:14:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.660+0000 7fc544bff700 1 -- 172.21.15.12:0/664140610 wait complete. 2023-12-11T20:14:54.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:14:54.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 -- 172.21.15.12:0/346680718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8010101f80 msgr2=0x7f8010104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 --2- 172.21.15.12:0/346680718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8010101f80 0x7f8010104370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8000009990 tx=0x7f8000009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 -- 172.21.15.12:0/346680718 shutdown_connections 2023-12-11T20:14:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 --2- 172.21.15.12:0/346680718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80101071e0 0x7f8010109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 --2- 172.21.15.12:0/346680718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8010101f80 0x7f8010104370 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 --2- 172.21.15.12:0/346680718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80101048b0 0x7f8010106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 -- 172.21.15.12:0/346680718 >> 172.21.15.12:0/346680718 conn(0x7f80100fb930 msgr2=0x7f80100fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 -- 172.21.15.12:0/346680718 shutdown_connections 2023-12-11T20:14:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.885+0000 7f80167ff700 1 -- 172.21.15.12:0/346680718 wait complete. 2023-12-11T20:14:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.886+0000 7f80167ff700 1 Processor -- start 2023-12-11T20:14:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.886+0000 7f80167ff700 1 -- start start 2023-12-11T20:14:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f80167ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8010101f80 0x7f80101018a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f80167ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80101048b0 0x7f80100fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f80167ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80101071e0 0x7f8010100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f80167ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8010100c10 con 0x7f80101071e0 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f80167ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8010100d80 con 0x7f8010101f80 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f80167ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80101a1380 con 0x7f80101048b0 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f8014d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80101071e0 0x7f8010100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f8014d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80101071e0 0x7f8010100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40336/0 (socket says 172.21.15.12:40336) 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f8014d9c700 1 -- 172.21.15.12:0/192336212 learned_addr learned my addr 172.21.15.12:0/192336212 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f800ffff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8010101f80 0x7f80101018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f800f7fe700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80101048b0 0x7f80100fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f8014d9c700 1 -- 172.21.15.12:0/192336212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80101048b0 msgr2=0x7f80100fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.887+0000 7f8014d9c700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80101048b0 0x7f80100fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f8014d9c700 1 -- 172.21.15.12:0/192336212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8010101f80 msgr2=0x7f80101018a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f8014d9c700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8010101f80 0x7f80101018a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f8014d9c700 1 -- 172.21.15.12:0/192336212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000095f0 con 0x7f80101071e0 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f800f7fe700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80101048b0 0x7f80100fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f8014d9c700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80101071e0 0x7f8010100470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f800800ef30 tx=0x7f800800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f800d7fa700 1 -- 172.21.15.12:0/192336212 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008018070 con 0x7f80101071e0 2023-12-11T20:14:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f800d7fa700 1 -- 172.21.15.12:0/192336212 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f800800f040 con 0x7f80101071e0 2023-12-11T20:14:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80101a15b0 con 0x7f80101071e0 2023-12-11T20:14:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f800d7fa700 1 -- 172.21.15.12:0/192336212 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800cc10 con 0x7f80101071e0 2023-12-11T20:14:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.888+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80101a1a70 con 0x7f80101071e0 2023-12-11T20:14:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.889+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80100fd4b0 con 0x7f80101071e0 2023-12-11T20:14:54.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.891+0000 7f800d7fa700 1 -- 172.21.15.12:0/192336212 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f8008007500 con 0x7f80101071e0 2023-12-11T20:14:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.892+0000 7f800d7fa700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff80a1510 0x7f7ff80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.893+0000 7f800d7fa700 1 -- 172.21.15.12:0/192336212 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f80080cca80 con 0x7f80101071e0 2023-12-11T20:14:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.893+0000 7f800ffff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff80a1510 0x7f7ff80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:54.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.893+0000 7f800ffff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff80a1510 0x7f7ff80a39d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8000006010 tx=0x7f800000b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:54.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:54.897+0000 7f800d7fa700 1 -- 172.21.15.12:0/192336212 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8008095fa0 con 0x7f80101071e0 2023-12-11T20:14:55.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.113+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f801010cbb0 con 0x7f80101071e0 2023-12-11T20:14:55.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.113+0000 7f800d7fa700 1 -- 172.21.15.12:0/192336212 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80080995c0 con 0x7f80101071e0 2023-12-11T20:14:55.112 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:14:55.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff80a1510 msgr2=0x7f7ff80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff80a1510 0x7f7ff80a39d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8000006010 tx=0x7f800000b610 comp rx=0 tx=0).stop 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80101071e0 msgr2=0x7f8010100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80101071e0 0x7f8010100470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f800800ef30 tx=0x7f800800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 shutdown_connections 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff80a1510 0x7f7ff80a39d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8010101f80 0x7f80101018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80101071e0 0x7f8010100470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 --2- 172.21.15.12:0/192336212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80101048b0 0x7f80100fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.115+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 >> 172.21.15.12:0/192336212 conn(0x7f80100fb930 msgr2=0x7f8010103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.116+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 shutdown_connections 2023-12-11T20:14:55.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.116+0000 7f80167ff700 1 -- 172.21.15.12:0/192336212 wait complete. 2023-12-11T20:14:55.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:14:55.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/260628027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f41014b0 msgr2=0x7fb2f41018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/260628027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f41014b0 0x7fb2f41018d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80099c0 tx=0x7fb2e8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/260628027 shutdown_connections 2023-12-11T20:14:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/260628027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2f4103040 0x7fb2f41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/260628027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f41014b0 0x7fb2f41018d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/260628027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2f41026a0 0x7fb2f4102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/260628027 >> 172.21.15.12:0/260628027 conn(0x7fb2f40fca00 msgr2=0x7fb2f40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/260628027 shutdown_connections 2023-12-11T20:14:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.341+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/260628027 wait complete. 2023-12-11T20:14:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.342+0000 7fb2fb1ff700 1 Processor -- start 2023-12-11T20:14:55.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2fb1ff700 1 -- start start 2023-12-11T20:14:55.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2fb1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2f41014b0 0x7fb2f4075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:55.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2fb1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2f41026a0 0x7fb2f40739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:55.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2fb1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f4103040 0x7fb2f4073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:55.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2fb1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40746a0 con 0x7fb2f4103040 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2fb1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4074810 con 0x7fb2f41014b0 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2fb1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f41a1420 con 0x7fb2f41026a0 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2f979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f4103040 0x7fb2f4073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2f8f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2f41014b0 0x7fb2f4075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2f979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f4103040 0x7fb2f4073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40360/0 (socket says 172.21.15.12:40360) 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.343+0000 7fb2f979c700 1 -- 172.21.15.12:0/1103684029 learned_addr learned my addr 172.21.15.12:0/1103684029 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f3fff700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2f41026a0 0x7fb2f40739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f979c700 1 -- 172.21.15.12:0/1103684029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2f41026a0 msgr2=0x7fb2f40739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f979c700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2f41026a0 0x7fb2f40739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f979c700 1 -- 172.21.15.12:0/1103684029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2f41014b0 msgr2=0x7fb2f4075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f979c700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2f41014b0 0x7fb2f4075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f979c700 1 -- 172.21.15.12:0/1103684029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80095f0 con 0x7fb2f4103040 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f3fff700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2f41026a0 0x7fb2f40739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:14:55.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f979c700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f4103040 0x7fb2f4073f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007ee0 tx=0x7fb2ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:55.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f1ffb700 1 -- 172.21.15.12:0/1103684029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec017070 con 0x7fb2f4103040 2023-12-11T20:14:55.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f1ffb700 1 -- 172.21.15.12:0/1103684029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2ec00f040 con 0x7fb2f4103040 2023-12-11T20:14:55.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f41a16b0 con 0x7fb2f4103040 2023-12-11T20:14:55.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.344+0000 7fb2f1ffb700 1 -- 172.21.15.12:0/1103684029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec005570 con 0x7fb2f4103040 2023-12-11T20:14:55.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.345+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f41a1b70 con 0x7fb2f4103040 2023-12-11T20:14:55.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.345+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f4108a70 con 0x7fb2f4103040 2023-12-11T20:14:55.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.348+0000 7fb2f1ffb700 1 -- 172.21.15.12:0/1103684029 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fb2ec00db70 con 0x7fb2f4103040 2023-12-11T20:14:55.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.350+0000 7fb2f1ffb700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2e40a1510 0x7fb2e40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:55.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.350+0000 7fb2f1ffb700 1 -- 172.21.15.12:0/1103684029 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fb2ec0cc680 con 0x7fb2f4103040 2023-12-11T20:14:55.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.350+0000 7fb2f8f9b700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2e40a1510 0x7fb2e40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:55.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.351+0000 7fb2f8f9b700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2e40a1510 0x7fb2e40a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8006010 tx=0x7fb2e8003740 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:55.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.354+0000 7fb2f1ffb700 1 -- 172.21.15.12:0/1103684029 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb2ec095b70 con 0x7fb2f4103040 2023-12-11T20:14:55.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:55 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/680338851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:55.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:55 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/664140610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:14:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:55 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/680338851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:55 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/664140610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:14:55.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.568+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2f410cbc0 con 0x7fb2f4103040 2023-12-11T20:14:55.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.568+0000 7fb2f1ffb700 1 -- 172.21.15.12:0/1103684029 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2ec082e60 con 0x7fb2f4103040 2023-12-11T20:14:55.568 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:14:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2e40a1510 msgr2=0x7fb2e40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2e40a1510 0x7fb2e40a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8006010 tx=0x7fb2e8003740 comp rx=0 tx=0).stop 2023-12-11T20:14:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f4103040 msgr2=0x7fb2f4073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f4103040 0x7fb2f4073f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007ee0 tx=0x7fb2ec00d3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 shutdown_connections 2023-12-11T20:14:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2e40a1510 0x7fb2e40a39d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2f41014b0 0x7fb2f4075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2f4103040 0x7fb2f4073f00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 --2- 172.21.15.12:0/1103684029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2f41026a0 0x7fb2f40739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 >> 172.21.15.12:0/1103684029 conn(0x7fb2f40fca00 msgr2=0x7fb2f4105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 shutdown_connections 2023-12-11T20:14:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.571+0000 7fb2fb1ff700 1 -- 172.21.15.12:0/1103684029 wait complete. 2023-12-11T20:14:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:55 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/680338851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:55 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/664140610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:14:55.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.797+0000 7fe1c5dff700 1 -- 172.21.15.12:0/270443754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 msgr2=0x7fe1c0106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.797+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/270443754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 0x7fe1c0106cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40098f0 tx=0x7fe1b4009c00 comp rx=0 tx=0).stop 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.798+0000 7fe1c5dff700 1 -- 172.21.15.12:0/270443754 shutdown_connections 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.798+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/270443754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1c01071f0 0x7fe1c0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.798+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/270443754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c0101f90 0x7fe1c0104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.798+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/270443754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 0x7fe1c0106cb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.798+0000 7fe1c5dff700 1 -- 172.21.15.12:0/270443754 >> 172.21.15.12:0/270443754 conn(0x7fe1c00fb980 msgr2=0x7fe1c00fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.798+0000 7fe1c5dff700 1 -- 172.21.15.12:0/270443754 shutdown_connections 2023-12-11T20:14:55.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.798+0000 7fe1c5dff700 1 -- 172.21.15.12:0/270443754 wait complete. 2023-12-11T20:14:55.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.799+0000 7fe1c5dff700 1 Processor -- start 2023-12-11T20:14:55.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.799+0000 7fe1c5dff700 1 -- start start 2023-12-11T20:14:55.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1c5dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c0101f90 0x7fe1c0199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:55.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1c5dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 0x7fe1c0199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1c5dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1c01071f0 0x7fe1c01a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1c5dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01a1040 con 0x7fe1c0101f90 2023-12-11T20:14:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1c5dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01a1180 con 0x7fe1c01048c0 2023-12-11T20:14:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1c5dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01a1310 con 0x7fe1c01071f0 2023-12-11T20:14:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c0101f90 0x7fe1c0199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c0101f90 0x7fe1c0199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40374/0 (socket says 172.21.15.12:40374) 2023-12-11T20:14:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1bf7fe700 1 -- 172.21.15.12:0/785106411 learned_addr learned my addr 172.21.15.12:0/785106411 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:55.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1bffff700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1c01071f0 0x7fe1c01a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:55.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.800+0000 7fe1beffd700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 0x7fe1c0199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:55.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bf7fe700 1 -- 172.21.15.12:0/785106411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1c01071f0 msgr2=0x7fe1c01a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bf7fe700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1c01071f0 0x7fe1c01a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bf7fe700 1 -- 172.21.15.12:0/785106411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 msgr2=0x7fe1c0199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:55.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bf7fe700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 0x7fe1c0199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:55.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bf7fe700 1 -- 172.21.15.12:0/785106411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4009520 con 0x7fe1c0101f90 2023-12-11T20:14:55.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1beffd700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 0x7fe1c0199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:55.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bf7fe700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c0101f90 0x7fe1c0199510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000e9c0 tx=0x7fe1b000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bcff9700 1 -- 172.21.15.12:0/785106411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000cbd0 con 0x7fe1c0101f90 2023-12-11T20:14:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c01a15f0 con 0x7fe1c0101f90 2023-12-11T20:14:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bcff9700 1 -- 172.21.15.12:0/785106411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1b000eeb0 con 0x7fe1c0101f90 2023-12-11T20:14:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1bcff9700 1 -- 172.21.15.12:0/785106411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0005420 con 0x7fe1c0101f90 2023-12-11T20:14:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.801+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c01a1b00 con 0x7fe1c0101f90 2023-12-11T20:14:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.803+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0068330 con 0x7fe1c0101f90 2023-12-11T20:14:55.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.804+0000 7fe1bcff9700 1 -- 172.21.15.12:0/785106411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fe1b0005580 con 0x7fe1c0101f90 2023-12-11T20:14:55.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.806+0000 7fe1bcff9700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1a80a1510 0x7fe1a80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:55.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.806+0000 7fe1bcff9700 1 -- 172.21.15.12:0/785106411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fe1b0014070 con 0x7fe1c0101f90 2023-12-11T20:14:55.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.806+0000 7fe1beffd700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1a80a1510 0x7fe1a80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:55.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.807+0000 7fe1beffd700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1a80a1510 0x7fe1a80a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400f9d0 tx=0x7fe1b4019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:55.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:55.810+0000 7fe1bcff9700 1 -- 172.21.15.12:0/785106411 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe1b0096610 con 0x7fe1c0101f90 2023-12-11T20:14:56.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.090+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1c010cb70 con 0x7fe1c0101f90 2023-12-11T20:14:56.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.091+0000 7fe1bcff9700 1 -- 172.21.15.12:0/785106411 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7fe1b0099c30 con 0x7fe1c0101f90 2023-12-11T20:14:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:56.090 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:14:56.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1a80a1510 msgr2=0x7fe1a80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1a80a1510 0x7fe1a80a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400f9d0 tx=0x7fe1b4019040 comp rx=0 tx=0).stop 2023-12-11T20:14:56.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c0101f90 msgr2=0x7fe1c0199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c0101f90 0x7fe1c0199510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000e9c0 tx=0x7fe1b000ecd0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 shutdown_connections 2023-12-11T20:14:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe1a80a1510 0x7fe1a80a39d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1c01071f0 0x7fe1c01a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c0101f90 0x7fe1c0199510 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 --2- 172.21.15.12:0/785106411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c01048c0 0x7fe1c0199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 >> 172.21.15.12:0/785106411 conn(0x7fe1c00fb980 msgr2=0x7fe1c00fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:56.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 shutdown_connections 2023-12-11T20:14:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.093+0000 7fe1c5dff700 1 -- 172.21.15.12:0/785106411 wait complete. 2023-12-11T20:14:56.095 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:14:56.112 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:14:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.334+0000 7f60fc1ff700 1 -- 172.21.15.12:0/316758892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f41014a0 msgr2=0x7f60f41018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.334+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/316758892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f41014a0 0x7f60f41018c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f60f00099c0 tx=0x7f60f0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.334+0000 7f60fc1ff700 1 -- 172.21.15.12:0/316758892 shutdown_connections 2023-12-11T20:14:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.334+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/316758892 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f4103030 0x7f60f41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.334+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/316758892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f41014a0 0x7f60f41018c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.334+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/316758892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f4102690 0x7f60f4102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.334+0000 7f60fc1ff700 1 -- 172.21.15.12:0/316758892 >> 172.21.15.12:0/316758892 conn(0x7f60f40fca10 msgr2=0x7f60f40fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.334+0000 7f60fc1ff700 1 -- 172.21.15.12:0/316758892 shutdown_connections 2023-12-11T20:14:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.335+0000 7f60fc1ff700 1 -- 172.21.15.12:0/316758892 wait complete. 2023-12-11T20:14:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.335+0000 7f60fc1ff700 1 Processor -- start 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60fc1ff700 1 -- start start 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60fc1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f41014a0 0x7f60f4075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60fc1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f4102690 0x7f60f40739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60fc1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4103030 0x7f60f4073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60fc1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40746a0 con 0x7f60f4103030 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60fc1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4074810 con 0x7f60f4102690 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60fc1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f41a13b0 con 0x7f60f41014a0 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60fa79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4103030 0x7f60f4073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60f9f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f41014a0 0x7f60f4075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60f9f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f41014a0 0x7f60f4075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47006/0 (socket says 172.21.15.12:47006) 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60f979a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f4102690 0x7f60f40739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.336+0000 7f60f9f9b700 1 -- 172.21.15.12:0/3919012799 learned_addr learned my addr 172.21.15.12:0/3919012799 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.337+0000 7f60f9f9b700 1 -- 172.21.15.12:0/3919012799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f4102690 msgr2=0x7f60f40739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.337+0000 7f60f9f9b700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f4102690 0x7f60f40739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.337+0000 7f60f9f9b700 1 -- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4103030 msgr2=0x7f60f4073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.337+0000 7f60f9f9b700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4103030 0x7f60f4073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.337+0000 7f60f9f9b700 1 -- 172.21.15.12:0/3919012799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f00095f0 con 0x7f60f41014a0 2023-12-11T20:14:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.337+0000 7f60f9f9b700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f41014a0 0x7f60f4075330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000c00 tx=0x7f60f000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.338+0000 7f60eaffd700 1 -- 172.21.15.12:0/3919012799 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f001d070 con 0x7f60f41014a0 2023-12-11T20:14:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.338+0000 7f60eaffd700 1 -- 172.21.15.12:0/3919012799 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60f0005030 con 0x7f60f41014a0 2023-12-11T20:14:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.338+0000 7f60eaffd700 1 -- 172.21.15.12:0/3919012799 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0004b30 con 0x7f60f41014a0 2023-12-11T20:14:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.338+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f41a15e0 con 0x7f60f41014a0 2023-12-11T20:14:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.339+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f41a1950 con 0x7f60f41014a0 2023-12-11T20:14:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.340+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f4108990 con 0x7f60f41014a0 2023-12-11T20:14:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.341+0000 7f60eaffd700 1 -- 172.21.15.12:0/3919012799 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f60f0004c90 con 0x7f60f41014a0 2023-12-11T20:14:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.343+0000 7f60eaffd700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60e00a1660 0x7f60e00a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.343+0000 7f60eaffd700 1 -- 172.21.15.12:0/3919012799 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f60f00cda50 con 0x7f60f41014a0 2023-12-11T20:14:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.343+0000 7f60f979a700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60e00a1660 0x7f60e00a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.344+0000 7f60f979a700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60e00a1660 0x7f60e00a3b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009c60 tx=0x7f60e4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.347+0000 7f60eaffd700 1 -- 172.21.15.12:0/3919012799 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f60f0096f70 con 0x7f60f41014a0 2023-12-11T20:14:56.465 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:56 smithi032 ceph-mon[132488]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:56.466 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:56 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/192336212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:14:56.466 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:56 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1103684029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:14:56.466 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:56 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:14:56.466 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:56 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/785106411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:56.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:56 smithi039 ceph-mon[102205]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:56.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:56 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/192336212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:14:56.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:56 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1103684029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:14:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:56 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:14:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:56 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/785106411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.571+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60f410cbb0 con 0x7f60f41014a0 2023-12-11T20:14:56.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.573+0000 7f60eaffd700 1 -- 172.21.15.12:0/3919012799 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22547 (secure 0 0 0) 0x7f60f0026090 con 0x7f60f41014a0 2023-12-11T20:14:56.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:56.572 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:14:04.519931+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:14:56.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.575+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60e00a1660 msgr2=0x7f60e00a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.575+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60e00a1660 0x7f60e00a3b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009c60 tx=0x7f60e4009260 comp rx=0 tx=0).stop 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.575+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f41014a0 msgr2=0x7f60f4075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.575+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f41014a0 0x7f60f4075330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000c00 tx=0x7f60f000f690 comp rx=0 tx=0).stop 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.576+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 shutdown_connections 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.576+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60e00a1660 0x7f60e00a3b20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.576+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4103030 0x7f60f4073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.576+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f41014a0 0x7f60f4075330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.576+0000 7f60fc1ff700 1 --2- 172.21.15.12:0/3919012799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f4102690 0x7f60f40739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.576+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 >> 172.21.15.12:0/3919012799 conn(0x7f60f40fca10 msgr2=0x7f60f4105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.576+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 shutdown_connections 2023-12-11T20:14:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.576+0000 7f60fc1ff700 1 -- 172.21.15.12:0/3919012799 wait complete. 2023-12-11T20:14:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:56 smithi012 ceph-mon[128787]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:56 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/192336212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:14:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:56 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1103684029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:14:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:56 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:14:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:56 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/785106411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:56.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:14:56.595 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:14:56.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 -- 172.21.15.12:0/3669365734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d8102690 msgr2=0x7f90d8102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 --2- 172.21.15.12:0/3669365734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d8102690 0x7f90d8102af0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f90c00099c0 tx=0x7f90c0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 -- 172.21.15.12:0/3669365734 shutdown_connections 2023-12-11T20:14:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 --2- 172.21.15.12:0/3669365734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90d81014a0 0x7f90d81018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 --2- 172.21.15.12:0/3669365734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90d8103030 0x7f90d81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 --2- 172.21.15.12:0/3669365734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d8102690 0x7f90d8102af0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 -- 172.21.15.12:0/3669365734 >> 172.21.15.12:0/3669365734 conn(0x7f90d80fca30 msgr2=0x7f90d80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 -- 172.21.15.12:0/3669365734 shutdown_connections 2023-12-11T20:14:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.810+0000 7f90ddbff700 1 -- 172.21.15.12:0/3669365734 wait complete. 2023-12-11T20:14:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.811+0000 7f90ddbff700 1 Processor -- start 2023-12-11T20:14:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.811+0000 7f90ddbff700 1 -- start start 2023-12-11T20:14:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.811+0000 7f90ddbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d81014a0 0x7f90d8199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90ddbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90d8102690 0x7f90d8199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90ddbff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90d8103030 0x7f90d81a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90ddbff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d81a1090 con 0x7f90d81014a0 2023-12-11T20:14:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90ddbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d81a11d0 con 0x7f90d8102690 2023-12-11T20:14:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90ddbff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d81a1360 con 0x7f90d8103030 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90d77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d81014a0 0x7f90d8199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90cffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90d8102690 0x7f90d8199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90d77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d81014a0 0x7f90d8199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40406/0 (socket says 172.21.15.12:40406) 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90d77fe700 1 -- 172.21.15.12:0/2532471526 learned_addr learned my addr 172.21.15.12:0/2532471526 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90d7fff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90d8103030 0x7f90d81a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90cffff700 1 -- 172.21.15.12:0/2532471526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90d8103030 msgr2=0x7f90d81a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90cffff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90d8103030 0x7f90d81a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90cffff700 1 -- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d81014a0 msgr2=0x7f90d8199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90cffff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d81014a0 0x7f90d8199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90cffff700 1 -- 172.21.15.12:0/2532471526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00095f0 con 0x7f90d8102690 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.812+0000 7f90cffff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90d8102690 0x7f90d8199aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90c00098e0 tx=0x7f90c000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.813+0000 7f90d57fa700 1 -- 172.21.15.12:0/2532471526 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c001d070 con 0x7f90d8102690 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.813+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d81a15e0 con 0x7f90d8102690 2023-12-11T20:14:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.813+0000 7f90d57fa700 1 -- 172.21.15.12:0/2532471526 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90c0005020 con 0x7f90d8102690 2023-12-11T20:14:56.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.813+0000 7f90d57fa700 1 -- 172.21.15.12:0/2532471526 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0004b00 con 0x7f90d8102690 2023-12-11T20:14:56.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.813+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d81a1a00 con 0x7f90d8102690 2023-12-11T20:14:56.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.814+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d8068780 con 0x7f90d8102690 2023-12-11T20:14:56.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.816+0000 7f90d57fa700 1 -- 172.21.15.12:0/2532471526 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f90c0005190 con 0x7f90d8102690 2023-12-11T20:14:56.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.817+0000 7f90d57fa700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90c40a1510 0x7f90c40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:56.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.817+0000 7f90d57fa700 1 -- 172.21.15.12:0/2532471526 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f90c00cd860 con 0x7f90d8102690 2023-12-11T20:14:56.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.817+0000 7f90d77fe700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90c40a1510 0x7f90c40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:56.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.818+0000 7f90d77fe700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90c40a1510 0x7f90c40a39d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90c8005950 tx=0x7f90c8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:56.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:56.820+0000 7f90d57fa700 1 -- 172.21.15.12:0/2532471526 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f90c0096d80 con 0x7f90d8102690 2023-12-11T20:14:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.059+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90d810cbc0 con 0x7f90d8102690 2023-12-11T20:14:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.059+0000 7f90d57fa700 1 -- 172.21.15.12:0/2532471526 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90c009a3a0 con 0x7f90d8102690 2023-12-11T20:14:57.059 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:14:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90c40a1510 msgr2=0x7f90c40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90c40a1510 0x7f90c40a39d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90c8005950 tx=0x7f90c8009260 comp rx=0 tx=0).stop 2023-12-11T20:14:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90d8102690 msgr2=0x7f90d8199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90d8102690 0x7f90d8199aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90c00098e0 tx=0x7f90c000f690 comp rx=0 tx=0).stop 2023-12-11T20:14:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 shutdown_connections 2023-12-11T20:14:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90c40a1510 0x7f90c40a39d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90d8103030 0x7f90d81a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90d81014a0 0x7f90d8199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 --2- 172.21.15.12:0/2532471526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90d8102690 0x7f90d8199aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 >> 172.21.15.12:0/2532471526 conn(0x7f90d80fca30 msgr2=0x7f90d8107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 shutdown_connections 2023-12-11T20:14:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.062+0000 7f90ddbff700 1 -- 172.21.15.12:0/2532471526 wait complete. 2023-12-11T20:14:57.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.300+0000 7fd27e3ff700 1 -- 172.21.15.12:0/139494885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 msgr2=0x7fd278073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.300+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/139494885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 0x7fd278073a60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd268009990 tx=0x7fd268009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.300+0000 7fd27e3ff700 1 -- 172.21.15.12:0/139494885 shutdown_connections 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.300+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/139494885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd27810da80 0x7fd27810fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.300+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/139494885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 0x7fd278073a60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.300+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/139494885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd278074030 0x7fd2780744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.300+0000 7fd27e3ff700 1 -- 172.21.15.12:0/139494885 >> 172.21.15.12:0/139494885 conn(0x7fd2780fca00 msgr2=0x7fd2780fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.300+0000 7fd27e3ff700 1 -- 172.21.15.12:0/139494885 shutdown_connections 2023-12-11T20:14:57.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.301+0000 7fd27e3ff700 1 -- 172.21.15.12:0/139494885 wait complete. 2023-12-11T20:14:57.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.301+0000 7fd27e3ff700 1 Processor -- start 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd27e3ff700 1 -- start start 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd27e3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd278074030 0x7fd27819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd27e3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 0x7fd27819ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd27e3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd27810da80 0x7fd2781a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd27e3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2781a54c0 con 0x7fd278075610 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd27e3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2781a5600 con 0x7fd278074030 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd27e3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2781a5790 con 0x7fd27810da80 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd2777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 0x7fd27819ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd277fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd278074030 0x7fd27819d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd2777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 0x7fd27819ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40412/0 (socket says 172.21.15.12:40412) 2023-12-11T20:14:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd2777fe700 1 -- 172.21.15.12:0/4228246890 learned_addr learned my addr 172.21.15.12:0/4228246890 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.302+0000 7fd27c99c700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd27810da80 0x7fd2781a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd277fff700 1 -- 172.21.15.12:0/4228246890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd27810da80 msgr2=0x7fd2781a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd277fff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd27810da80 0x7fd2781a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd277fff700 1 -- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 msgr2=0x7fd27819ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd277fff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 0x7fd27819ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd277fff700 1 -- 172.21.15.12:0/4228246890 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2680095f0 con 0x7fd278074030 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd2777fe700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 0x7fd27819ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd277fff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd278074030 0x7fd27819d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2680098e0 tx=0x7fd268004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd2757fa700 1 -- 172.21.15.12:0/4228246890 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26801d070 con 0x7fd278074030 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2781a5a10 con 0x7fd278074030 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd2757fa700 1 -- 172.21.15.12:0/4228246890 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd26800bdb0 con 0x7fd278074030 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.303+0000 7fd2757fa700 1 -- 172.21.15.12:0/4228246890 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268022d60 con 0x7fd278074030 2023-12-11T20:14:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.304+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2781a5e90 con 0x7fd278074030 2023-12-11T20:14:57.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.304+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd278103ce0 con 0x7fd278074030 2023-12-11T20:14:57.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.306+0000 7fd2757fa700 1 -- 172.21.15.12:0/4228246890 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fd268022470 con 0x7fd278074030 2023-12-11T20:14:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.308+0000 7fd2757fa700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2600a1510 0x7fd2600a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:57.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.308+0000 7fd2757fa700 1 -- 172.21.15.12:0/4228246890 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fd2680ce310 con 0x7fd278074030 2023-12-11T20:14:57.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.308+0000 7fd2777fe700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2600a1510 0x7fd2600a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:57.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.309+0000 7fd2777fe700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2600a1510 0x7fd2600a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd26c005950 tx=0x7fd26c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:57.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.310+0000 7fd2757fa700 1 -- 172.21.15.12:0/4228246890 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd268097830 con 0x7fd278074030 2023-12-11T20:14:57.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:57 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3919012799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:57.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:57 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2532471526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:14:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:57 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3919012799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:57 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2532471526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:14:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.547+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd278068330 con 0x7fd278074030 2023-12-11T20:14:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.548+0000 7fd2757fa700 1 -- 172.21.15.12:0/4228246890 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd26809ae50 con 0x7fd278074030 2023-12-11T20:14:57.547 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.550+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2600a1510 msgr2=0x7fd2600a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.550+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2600a1510 0x7fd2600a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd26c005950 tx=0x7fd26c009260 comp rx=0 tx=0).stop 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.550+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd278074030 msgr2=0x7fd27819d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.550+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd278074030 0x7fd27819d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2680098e0 tx=0x7fd268004730 comp rx=0 tx=0).stop 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.551+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 shutdown_connections 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.551+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd2600a1510 0x7fd2600a39d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.551+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd278074030 0x7fd27819d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.551+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd27810da80 0x7fd2781a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.551+0000 7fd27e3ff700 1 --2- 172.21.15.12:0/4228246890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278075610 0x7fd27819ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.551+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 >> 172.21.15.12:0/4228246890 conn(0x7fd2780fca00 msgr2=0x7fd278100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.551+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 shutdown_connections 2023-12-11T20:14:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.551+0000 7fd27e3ff700 1 -- 172.21.15.12:0/4228246890 wait complete. 2023-12-11T20:14:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:57 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3919012799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:57 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2532471526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:14:57.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.788+0000 7fe2d2dff700 1 -- 172.21.15.12:0/2561585557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 msgr2=0x7fe2cc0744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.789+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/2561585557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 0x7fe2cc0744b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009990 tx=0x7fe2b8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.789+0000 7fe2d2dff700 1 -- 172.21.15.12:0/2561585557 shutdown_connections 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.789+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/2561585557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2cc109370 0x7fe2cc10b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.789+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/2561585557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2cc075610 0x7fe2cc073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.789+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/2561585557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 0x7fe2cc0744b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.789+0000 7fe2d2dff700 1 -- 172.21.15.12:0/2561585557 >> 172.21.15.12:0/2561585557 conn(0x7fe2cc0fca00 msgr2=0x7fe2cc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.789+0000 7fe2d2dff700 1 -- 172.21.15.12:0/2561585557 shutdown_connections 2023-12-11T20:14:57.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.789+0000 7fe2d2dff700 1 -- 172.21.15.12:0/2561585557 wait complete. 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d2dff700 1 Processor -- start 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d2dff700 1 -- start start 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d2dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 0x7fe2cc1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d2dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2cc075610 0x7fe2cc199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d2dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2cc109370 0x7fe2cc1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d2dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1a10d0 con 0x7fe2cc074030 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d2dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1a1210 con 0x7fe2cc109370 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d2dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1a13a0 con 0x7fe2cc075610 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.790+0000 7fe2d0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 0x7fe2cc1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 0x7fe2cc1995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40428/0 (socket says 172.21.15.12:40428) 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d0b9b700 1 -- 172.21.15.12:0/3470157503 learned_addr learned my addr 172.21.15.12:0/3470157503 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2cbfff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2cc075610 0x7fe2cc199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d139c700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2cc109370 0x7fe2cc1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:57.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d0b9b700 1 -- 172.21.15.12:0/3470157503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2cc075610 msgr2=0x7fe2cc199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d0b9b700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2cc075610 0x7fe2cc199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d0b9b700 1 -- 172.21.15.12:0/3470157503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2cc109370 msgr2=0x7fe2cc1a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:57.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d0b9b700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2cc109370 0x7fe2cc1a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:57.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d0b9b700 1 -- 172.21.15.12:0/3470157503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0009520 con 0x7fe2cc074030 2023-12-11T20:14:57.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d0b9b700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 0x7fe2cc1995a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000eb30 tx=0x7fe2c000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:57.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2c9ffb700 1 -- 172.21.15.12:0/3470157503 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0009880 con 0x7fe2cc074030 2023-12-11T20:14:57.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.791+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b80095f0 con 0x7fe2cc074030 2023-12-11T20:14:57.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.792+0000 7fe2c9ffb700 1 -- 172.21.15.12:0/3470157503 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2c00044b0 con 0x7fe2cc074030 2023-12-11T20:14:57.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.792+0000 7fe2c9ffb700 1 -- 172.21.15.12:0/3470157503 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0003ce0 con 0x7fe2cc074030 2023-12-11T20:14:57.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.792+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc1a1a50 con 0x7fe2cc074030 2023-12-11T20:14:57.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.793+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc108130 con 0x7fe2cc074030 2023-12-11T20:14:57.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.795+0000 7fe2c9ffb700 1 -- 172.21.15.12:0/3470157503 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fe2c0003ee0 con 0x7fe2cc074030 2023-12-11T20:14:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.796+0000 7fe2c9ffb700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2bc0a1590 0x7fe2bc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.797+0000 7fe2c9ffb700 1 -- 172.21.15.12:0/3470157503 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fe2c0014070 con 0x7fe2cc074030 2023-12-11T20:14:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.797+0000 7fe2cbfff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2bc0a1590 0x7fe2bc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.797+0000 7fe2cbfff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2bc0a1590 0x7fe2bc0a3a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8006010 tx=0x7fe2b800b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:57.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:57.800+0000 7fe2c9ffb700 1 -- 172.21.15.12:0/3470157503 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe2c00967d0 con 0x7fe2cc074030 2023-12-11T20:14:58.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.042+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2cc10ef30 con 0x7fe2cc074030 2023-12-11T20:14:58.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.043+0000 7fe2c9ffb700 1 -- 172.21.15.12:0/3470157503 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2c0099df0 con 0x7fe2cc074030 2023-12-11T20:14:58.042 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:14:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2bc0a1590 msgr2=0x7fe2bc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2bc0a1590 0x7fe2bc0a3a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8006010 tx=0x7fe2b800b610 comp rx=0 tx=0).stop 2023-12-11T20:14:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 msgr2=0x7fe2cc1995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 0x7fe2cc1995a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000eb30 tx=0x7fe2c000ee40 comp rx=0 tx=0).stop 2023-12-11T20:14:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 shutdown_connections 2023-12-11T20:14:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2bc0a1590 0x7fe2bc0a3a50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2cc109370 0x7fe2cc1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2cc074030 0x7fe2cc1995a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 --2- 172.21.15.12:0/3470157503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2cc075610 0x7fe2cc199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 >> 172.21.15.12:0/3470157503 conn(0x7fe2cc0fca00 msgr2=0x7fe2cc105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.046+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 shutdown_connections 2023-12-11T20:14:58.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.047+0000 7fe2d2dff700 1 -- 172.21.15.12:0/3470157503 wait complete. 2023-12-11T20:14:58.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:14:58.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 -- 172.21.15.12:0/2539693444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 msgr2=0x7efc04073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/2539693444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 0x7efc04073a60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009990 tx=0x7efbf8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 -- 172.21.15.12:0/2539693444 shutdown_connections 2023-12-11T20:14:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/2539693444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc0410da70 0x7efc0410fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/2539693444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 0x7efc04073a60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/2539693444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc04074030 0x7efc040744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 -- 172.21.15.12:0/2539693444 >> 172.21.15.12:0/2539693444 conn(0x7efc040fca10 msgr2=0x7efc040fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 -- 172.21.15.12:0/2539693444 shutdown_connections 2023-12-11T20:14:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.291+0000 7efc0b1ff700 1 -- 172.21.15.12:0/2539693444 wait complete. 2023-12-11T20:14:58.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.292+0000 7efc0b1ff700 1 Processor -- start 2023-12-11T20:14:58.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc0b1ff700 1 -- start start 2023-12-11T20:14:58.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc0b1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc04074030 0x7efc0419d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:58.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc0b1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 0x7efc0419de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc0b1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0410da70 0x7efc041a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc0b1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc041a5460 con 0x7efc04075610 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc0b1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc041a55a0 con 0x7efc04074030 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc0b1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc041a5730 con 0x7efc0410da70 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 0x7efc0419de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc0979c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0410da70 0x7efc041a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 0x7efc0419de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40448/0 (socket says 172.21.15.12:40448) 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc03fff700 1 -- 172.21.15.12:0/1494978794 learned_addr learned my addr 172.21.15.12:0/1494978794 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:58.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.293+0000 7efc08f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc04074030 0x7efc0419d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc08f9b700 1 -- 172.21.15.12:0/1494978794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0410da70 msgr2=0x7efc041a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc08f9b700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0410da70 0x7efc041a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc08f9b700 1 -- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 msgr2=0x7efc0419de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc08f9b700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 0x7efc0419de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc08f9b700 1 -- 172.21.15.12:0/1494978794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80095f0 con 0x7efc04074030 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc03fff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 0x7efc0419de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc08f9b700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc04074030 0x7efc0419d930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efbf8003f60 tx=0x7efbf8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc01ffb700 1 -- 172.21.15.12:0/1494978794 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf801d070 con 0x7efc04074030 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc041a59b0 con 0x7efc04074030 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc01ffb700 1 -- 172.21.15.12:0/1494978794 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbf800be70 con 0x7efc04074030 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.294+0000 7efc01ffb700 1 -- 172.21.15.12:0/1494978794 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800fe60 con 0x7efc04074030 2023-12-11T20:14:58.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.295+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc041a5dd0 con 0x7efc04074030 2023-12-11T20:14:58.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.296+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc04103cd0 con 0x7efc04074030 2023-12-11T20:14:58.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.298+0000 7efc01ffb700 1 -- 172.21.15.12:0/1494978794 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7efbf800f5f0 con 0x7efc04074030 2023-12-11T20:14:58.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.299+0000 7efc01ffb700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbf40a1550 0x7efbf40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:58.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.299+0000 7efc01ffb700 1 -- 172.21.15.12:0/1494978794 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7efbf80ce610 con 0x7efc04074030 2023-12-11T20:14:58.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.299+0000 7efc03fff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbf40a1550 0x7efbf40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:58.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.300+0000 7efc03fff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbf40a1550 0x7efbf40a3a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efbf0007fd0 tx=0x7efbf0007480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:58.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.302+0000 7efc01ffb700 1 -- 172.21.15.12:0/1494978794 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efbf8097b30 con 0x7efc04074030 2023-12-11T20:14:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:58 smithi012 ceph-mon[128787]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:58 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4228246890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:14:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:58 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3470157503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:14:58.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:58 smithi032 ceph-mon[132488]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:58.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:58 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4228246890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:14:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:58 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3470157503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:14:58.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:58 smithi039 ceph-mon[102205]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:14:58.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:58 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4228246890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:14:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:58 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3470157503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:14:58.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.566+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc04068330 con 0x7efc04074030 2023-12-11T20:14:58.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.568+0000 7efc01ffb700 1 -- 172.21.15.12:0/1494978794 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7efbf809b150 con 0x7efc04074030 2023-12-11T20:14:58.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:58.567 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:14:58.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbf40a1550 msgr2=0x7efbf40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbf40a1550 0x7efbf40a3a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efbf0007fd0 tx=0x7efbf0007480 comp rx=0 tx=0).stop 2023-12-11T20:14:58.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc04074030 msgr2=0x7efc0419d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc04074030 0x7efc0419d930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efbf8003f60 tx=0x7efbf8005740 comp rx=0 tx=0).stop 2023-12-11T20:14:58.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 shutdown_connections 2023-12-11T20:14:58.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbf40a1550 0x7efbf40a3a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc04074030 0x7efc0419d930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc0410da70 0x7efc041a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 --2- 172.21.15.12:0/1494978794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04075610 0x7efc0419de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 >> 172.21.15.12:0/1494978794 conn(0x7efc040fca10 msgr2=0x7efc04100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:58.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 shutdown_connections 2023-12-11T20:14:58.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.570+0000 7efc0b1ff700 1 -- 172.21.15.12:0/1494978794 wait complete. 2023-12-11T20:14:58.570 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:14:58.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.806+0000 7fe54afff700 1 -- 172.21.15.12:0/1045519455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102690 msgr2=0x7fe544102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.806+0000 7fe54afff700 1 --2- 172.21.15.12:0/1045519455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102690 0x7fe544102af0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe5300099c0 tx=0x7fe530009cd0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.806+0000 7fe54afff700 1 -- 172.21.15.12:0/1045519455 shutdown_connections 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.806+0000 7fe54afff700 1 --2- 172.21.15.12:0/1045519455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe544103030 0x7fe5441098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.806+0000 7fe54afff700 1 --2- 172.21.15.12:0/1045519455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5441014a0 0x7fe5441018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.806+0000 7fe54afff700 1 --2- 172.21.15.12:0/1045519455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102690 0x7fe544102af0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.806+0000 7fe54afff700 1 -- 172.21.15.12:0/1045519455 >> 172.21.15.12:0/1045519455 conn(0x7fe5440fca10 msgr2=0x7fe5440fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.806+0000 7fe54afff700 1 -- 172.21.15.12:0/1045519455 shutdown_connections 2023-12-11T20:14:58.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.807+0000 7fe54afff700 1 -- 172.21.15.12:0/1045519455 wait complete. 2023-12-11T20:14:58.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.808+0000 7fe54afff700 1 Processor -- start 2023-12-11T20:14:58.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.808+0000 7fe54afff700 1 -- start start 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe54afff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5441014a0 0x7fe544197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe54afff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe544102690 0x7fe5441978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe54afff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe544103030 0x7fe54419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe54afff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54419eea0 con 0x7fe5441014a0 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe54afff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54419efe0 con 0x7fe544103030 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe54afff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54419f170 con 0x7fe544102690 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe548d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5441014a0 0x7fe544197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe548d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5441014a0 0x7fe544197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40464/0 (socket says 172.21.15.12:40464) 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe548d9b700 1 -- 172.21.15.12:0/2839769480 learned_addr learned my addr 172.21.15.12:0/2839769480 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:58.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe543fff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe544102690 0x7fe5441978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe54959c700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe544103030 0x7fe54419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe548d9b700 1 -- 172.21.15.12:0/2839769480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe544102690 msgr2=0x7fe5441978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe548d9b700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe544102690 0x7fe5441978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe548d9b700 1 -- 172.21.15.12:0/2839769480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe544103030 msgr2=0x7fe54419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe548d9b700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe544103030 0x7fe54419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.809+0000 7fe548d9b700 1 -- 172.21.15.12:0/2839769480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c009c40 con 0x7fe5441014a0 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.810+0000 7fe548d9b700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5441014a0 0x7fe544197370 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e970 tx=0x7fe53800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.810+0000 7fe541ffb700 1 -- 172.21.15.12:0/2839769480 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538009790 con 0x7fe5441014a0 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.810+0000 7fe541ffb700 1 -- 172.21.15.12:0/2839769480 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe53800eec0 con 0x7fe5441014a0 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.810+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5300095f0 con 0x7fe5441014a0 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.810+0000 7fe541ffb700 1 -- 172.21.15.12:0/2839769480 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538003c10 con 0x7fe5441014a0 2023-12-11T20:14:58.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.810+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54419f7d0 con 0x7fe5441014a0 2023-12-11T20:14:58.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.811+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5441089c0 con 0x7fe5441014a0 2023-12-11T20:14:58.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.813+0000 7fe541ffb700 1 -- 172.21.15.12:0/2839769480 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fe538003db0 con 0x7fe5441014a0 2023-12-11T20:14:58.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.815+0000 7fe541ffb700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5340a1510 0x7fe5340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:58.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.816+0000 7fe541ffb700 1 -- 172.21.15.12:0/2839769480 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fe538014070 con 0x7fe5441014a0 2023-12-11T20:14:58.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.816+0000 7fe543fff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5340a1510 0x7fe5340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:58.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.817+0000 7fe543fff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5340a1510 0x7fe5340a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe530009990 tx=0x7fe530003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:58.819+0000 7fe541ffb700 1 -- 172.21.15.12:0/2839769480 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe5380965f0 con 0x7fe5441014a0 2023-12-11T20:14:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.040+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe544068330 con 0x7fe5441014a0 2023-12-11T20:14:59.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.042+0000 7fe541ffb700 1 -- 172.21.15.12:0/2839769480 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22547 (secure 0 0 0) 0x7fe538099c10 con 0x7fe5441014a0 2023-12-11T20:14:59.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:59.041 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:14:04.519931+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:14:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5340a1510 msgr2=0x7fe5340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5340a1510 0x7fe5340a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe530009990 tx=0x7fe530003680 comp rx=0 tx=0).stop 2023-12-11T20:14:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5441014a0 msgr2=0x7fe544197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5441014a0 0x7fe544197370 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e970 tx=0x7fe53800ec80 comp rx=0 tx=0).stop 2023-12-11T20:14:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 shutdown_connections 2023-12-11T20:14:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5340a1510 0x7fe5340a39d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe544103030 0x7fe54419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5441014a0 0x7fe544197370 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 --2- 172.21.15.12:0/2839769480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe544102690 0x7fe5441978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 >> 172.21.15.12:0/2839769480 conn(0x7fe5440fca10 msgr2=0x7fe544105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 shutdown_connections 2023-12-11T20:14:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.044+0000 7fe54afff700 1 -- 172.21.15.12:0/2839769480 wait complete. 2023-12-11T20:14:59.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:14:59.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 -- 172.21.15.12:0/1653712962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8073ff0 msgr2=0x7fc7d8074450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/1653712962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8073ff0 0x7fc7d8074450 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80098f0 tx=0x7fc7c8009c00 comp rx=0 tx=0).stop 2023-12-11T20:14:59.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 -- 172.21.15.12:0/1653712962 shutdown_connections 2023-12-11T20:14:59.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/1653712962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d80755d0 0x7fc7d8073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/1653712962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d8109350 0x7fc7d810b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/1653712962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8073ff0 0x7fc7d8074450 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 -- 172.21.15.12:0/1653712962 >> 172.21.15.12:0/1653712962 conn(0x7fc7d80fca10 msgr2=0x7fc7d80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 -- 172.21.15.12:0/1653712962 shutdown_connections 2023-12-11T20:14:59.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.281+0000 7fc7df5ff700 1 -- 172.21.15.12:0/1653712962 wait complete. 2023-12-11T20:14:59.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.282+0000 7fc7df5ff700 1 Processor -- start 2023-12-11T20:14:59.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.282+0000 7fc7df5ff700 1 -- start start 2023-12-11T20:14:59.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7df5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d8073ff0 0x7fc7d8199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7df5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d80755d0 0x7fc7d8199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7df5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8109350 0x7fc7d81a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7df5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81a1080 con 0x7fc7d8109350 2023-12-11T20:14:59.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7df5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81a11c0 con 0x7fc7d80755d0 2023-12-11T20:14:59.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7df5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81a1350 con 0x7fc7d8073ff0 2023-12-11T20:14:59.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7dd39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d8073ff0 0x7fc7d8199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7dd39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d8073ff0 0x7fc7d8199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54810/0 (socket says 172.21.15.12:54810) 2023-12-11T20:14:59.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7ddb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8109350 0x7fc7d81a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7dcb9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d80755d0 0x7fc7d8199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.283+0000 7fc7dd39b700 1 -- 172.21.15.12:0/4101185253 learned_addr learned my addr 172.21.15.12:0/4101185253 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7dd39b700 1 -- 172.21.15.12:0/4101185253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d80755d0 msgr2=0x7fc7d8199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7dd39b700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d80755d0 0x7fc7d8199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7dd39b700 1 -- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8109350 msgr2=0x7fc7d81a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7dd39b700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8109350 0x7fc7d81a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7dd39b700 1 -- 172.21.15.12:0/4101185253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c8009520 con 0x7fc7d8073ff0 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7ddb9c700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8109350 0x7fc7d81a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7dd39b700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d8073ff0 0x7fc7d8199550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400e9c0 tx=0x7fc7d400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7ce7fc700 1 -- 172.21.15.12:0/4101185253 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4004a30 con 0x7fc7d8073ff0 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7ce7fc700 1 -- 172.21.15.12:0/4101185253 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7d400cc50 con 0x7fc7d8073ff0 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d81a1630 con 0x7fc7d8073ff0 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7ce7fc700 1 -- 172.21.15.12:0/4101185253 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4005410 con 0x7fc7d8073ff0 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.284+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d81a1b90 con 0x7fc7d8073ff0 2023-12-11T20:14:59.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.285+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d8108160 con 0x7fc7d8073ff0 2023-12-11T20:14:59.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.287+0000 7fc7ce7fc700 1 -- 172.21.15.12:0/4101185253 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7fc7d4005570 con 0x7fc7d8073ff0 2023-12-11T20:14:59.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.288+0000 7fc7ce7fc700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7c40a1590 0x7fc7c40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.288+0000 7fc7ce7fc700 1 -- 172.21.15.12:0/4101185253 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fc7d4014070 con 0x7fc7d8073ff0 2023-12-11T20:14:59.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.288+0000 7fc7dcb9a700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7c40a1590 0x7fc7c40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.289+0000 7fc7dcb9a700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7c40a1590 0x7fc7c40a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800f9d0 tx=0x7fc7c8019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:59.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.292+0000 7fc7ce7fc700 1 -- 172.21.15.12:0/4101185253 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc7d40963d0 con 0x7fc7d8073ff0 2023-12-11T20:14:59.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:59 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1494978794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:59.333 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:59 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2839769480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:59.333 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:14:59 smithi012 ceph-mon[128787]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:59 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1494978794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:59 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2839769480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:59.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:14:59 smithi039 ceph-mon[102205]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:59.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.574+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7d8068330 con 0x7fc7d8073ff0 2023-12-11T20:14:59.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.575+0000 7fc7ce7fc700 1 -- 172.21.15.12:0/4101185253 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7fc7d8068330 con 0x7fc7d8073ff0 2023-12-11T20:14:59.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:14:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7c40a1590 msgr2=0x7fc7c40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7c40a1590 0x7fc7c40a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800f9d0 tx=0x7fc7c8019040 comp rx=0 tx=0).stop 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d8073ff0 msgr2=0x7fc7d8199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d8073ff0 0x7fc7d8199550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400e9c0 tx=0x7fc7d400ecd0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 shutdown_connections 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7c40a1590 0x7fc7c40a3a50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7d8109350 0x7fc7d81a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d8073ff0 0x7fc7d8199550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 --2- 172.21.15.12:0/4101185253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d80755d0 0x7fc7d8199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 >> 172.21.15.12:0/4101185253 conn(0x7fc7d80fca10 msgr2=0x7fc7d81052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 shutdown_connections 2023-12-11T20:14:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.578+0000 7fc7df5ff700 1 -- 172.21.15.12:0/4101185253 wait complete. 2023-12-11T20:14:59.578 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:14:59.598 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-11T20:13:53.009335+0000', 'modified': '2023-12-11T20:13:58.248579+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24620, 'mds_1': 24577, 'mds_2': 24566}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24530': {'gid': 24530, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.32:6835/1999108930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6834', 'nonce': 1999108930}, {'type': 'v1', 'addr': '172.21.15.32:6835', 'nonce': 1999108930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24541': {'gid': 24541, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6835/2029236451', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6834', 'nonce': 2029236451}, {'type': 'v1', 'addr': '172.21.15.39:6835', 'nonce': 2029236451}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24553': {'gid': 24553, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6837/2148366648', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6836', 'nonce': 2148366648}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 2148366648}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24566': {'gid': 24566, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.32:6837/173395142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6836', 'nonce': 173395142}, {'type': 'v1', 'addr': '172.21.15.32:6837', 'nonce': 173395142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24577': {'gid': 24577, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.39:6839/2020485308', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6838', 'nonce': 2020485308}, {'type': 'v1', 'addr': '172.21.15.39:6839', 'nonce': 2020485308}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24620': {'gid': 24620, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.32:6839/3894896449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6838', 'nonce': 3894896449}, {'type': 'v1', 'addr': '172.21.15.32:6839', 'nonce': 3894896449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-11T20:14:59.598 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-11T20:14:59.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-12-11T20:14:59.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:59 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1494978794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:14:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:59 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2839769480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:14:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:14:59 smithi032 ceph-mon[132488]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:14:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 -- 172.21.15.12:0/455478015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8107170 msgr2=0x7f9ea81095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 --2- 172.21.15.12:0/455478015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8107170 0x7f9ea81095e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000b0a0 tx=0x7f9ea000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 -- 172.21.15.12:0/455478015 shutdown_connections 2023-12-11T20:14:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 --2- 172.21.15.12:0/455478015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8107170 0x7f9ea81095e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 --2- 172.21.15.12:0/455478015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ea8101f10 0x7f9ea8104300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 --2- 172.21.15.12:0/455478015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ea8104840 0x7f9ea8106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 -- 172.21.15.12:0/455478015 >> 172.21.15.12:0/455478015 conn(0x7f9ea80fb940 msgr2=0x7f9ea80fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 -- 172.21.15.12:0/455478015 shutdown_connections 2023-12-11T20:14:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.810+0000 7f9eaebff700 1 -- 172.21.15.12:0/455478015 wait complete. 2023-12-11T20:14:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.812+0000 7f9eaebff700 1 Processor -- start 2023-12-11T20:14:59.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.812+0000 7f9eaebff700 1 -- start start 2023-12-11T20:14:59.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.812+0000 7f9eaebff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ea8101f10 0x7f9ea8199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.812+0000 7f9eaebff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8104840 0x7f9ea8199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.812+0000 7f9eaebff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ea8107170 0x7f9ea81a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.812+0000 7f9eaebff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81a1150 con 0x7f9ea8104840 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.812+0000 7f9eaebff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81a1290 con 0x7f9ea8107170 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.812+0000 7f9eaebff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81a1420 con 0x7f9ea8101f10 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9eac99b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ea8101f10 0x7f9ea8199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ea7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8104840 0x7f9ea8199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9eac99b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ea8101f10 0x7f9ea8199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54826/0 (socket says 172.21.15.12:54826) 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ead19c700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ea8107170 0x7f9ea81a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9eac99b700 1 -- 172.21.15.12:0/1499705236 learned_addr learned my addr 172.21.15.12:0/1499705236 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ead19c700 1 -- 172.21.15.12:0/1499705236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ea8101f10 msgr2=0x7f9ea8199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ead19c700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ea8101f10 0x7f9ea8199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ead19c700 1 -- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8104840 msgr2=0x7f9ea8199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ead19c700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8104840 0x7f9ea8199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ead19c700 1 -- 172.21.15.12:0/1499705236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea0009d00 con 0x7f9ea8107170 2023-12-11T20:14:59.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8104840 0x7f9ea8199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.813+0000 7f9ead19c700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ea8107170 0x7f9ea81a0b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000b070 tx=0x7f9ea0007840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.814+0000 7f9ea5ffb700 1 -- 172.21.15.12:0/1499705236 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000e040 con 0x7f9ea8107170 2023-12-11T20:14:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.814+0000 7f9ea5ffb700 1 -- 172.21.15.12:0/1499705236 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ea000be40 con 0x7f9ea8107170 2023-12-11T20:14:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.814+0000 7f9eaebff700 1 -- 172.21.15.12:0/1499705236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea81a16a0 con 0x7f9ea8107170 2023-12-11T20:14:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.814+0000 7f9ea5ffb700 1 -- 172.21.15.12:0/1499705236 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0005040 con 0x7f9ea8107170 2023-12-11T20:14:59.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.814+0000 7f9eaebff700 1 -- 172.21.15.12:0/1499705236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea81a1b20 con 0x7f9ea8107170 2023-12-11T20:14:59.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.818+0000 7f9ea5ffb700 1 -- 172.21.15.12:0/1499705236 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f9ea00051a0 con 0x7f9ea8107170 2023-12-11T20:14:59.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.819+0000 7f9ec24bfb80 1 Processor -- start 2023-12-11T20:14:59.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ec24bfb80 1 -- start start 2023-12-11T20:14:59.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ea5ffb700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9e980a1590 0x7f9e980a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c94c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 0x55f87c94d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c94e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c8a7b00 con 0x55f87c94c380 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c8a5420 con 0x55f87c94cce0 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c8a0d10 con 0x55f87c94dbd0 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ea5ffb700 1 -- 172.21.15.12:0/1499705236 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f9ea00cdd60 con 0x7f9ea8107170 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9e980a1590 0x7f9e980a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9eac99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c94c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ea7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 0x55f87c94d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9ead19c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c94e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9eac99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c94c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34638/0 (socket says 172.21.15.12:34638) 2023-12-11T20:14:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.820+0000 7f9eac99b700 1 -- 172.21.15.12:0/582597576 learned_addr learned my addr 172.21.15.12:0/582597576 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:59.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9eac99b700 1 -- 172.21.15.12:0/582597576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 msgr2=0x55f87c94e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9eac99b700 1 --2- 172.21.15.12:0/582597576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c94e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9eac99b700 1 -- 172.21.15.12:0/582597576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 msgr2=0x55f87c94d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9eac99b700 1 --2- 172.21.15.12:0/582597576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 0x55f87c94d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9eac99b700 1 -- 172.21.15.12:0/582597576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f87c71d5e0 con 0x55f87c94c380 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9e980a1590 0x7f9e980a3a50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9e940139a0 tx=0x7f9e94009d30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9eac99b700 1 --2- 172.21.15.12:0/582597576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c94c7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009e50 tx=0x7f9e9c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f980dfcb91c9a563 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9e92ffd700 1 -- 172.21.15.12:0/582597576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c004a30 con 0x55f87c94c380 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9e92ffd700 1 -- 172.21.15.12:0/582597576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e9c0054b0 con 0x55f87c94c380 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.821+0000 7f9e92ffd700 1 -- 172.21.15.12:0/582597576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0198d0 con 0x55f87c94c380 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/582597576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 msgr2=0x55f87c94c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/582597576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c94c7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009e50 tx=0x7f9e9c011720 comp rx=0 tx=0).stop 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/582597576 shutdown_connections 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/582597576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c94e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/582597576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c94c7a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/582597576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 0x55f87c94d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/582597576 >> 172.21.15.12:0/582597576 conn(0x55f87c87b790 msgr2=0x55f87c948d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/582597576 shutdown_connections 2023-12-11T20:14:59.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.822+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/582597576 wait complete. 2023-12-11T20:14:59.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.823+0000 7f9ec24bfb80 1 -- start start 2023-12-11T20:14:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.823+0000 7f9ec24bfb80 1 Processor -- start 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c956170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c9566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c85a510 con 0x55f87c94dbd0 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c85a1b0 con 0x55f87c94c380 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c71f8d0 con 0x55f87c94cce0 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ec24bfb80 10 client.0 _ll_register_callbacks cb 0x55f87c785a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9eac99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c956170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ead19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ea7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c9566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9eac99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c956170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58816/0 (socket says 172.21.15.12:58816) 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9eac99b700 1 -- 172.21.15.12:0/1266786492 learned_addr learned my addr 172.21.15.12:0/1266786492 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.824+0000 7f9ead19c700 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34646/0 (socket says 172.21.15.12:34646) 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9eac99b700 1 -- 172.21.15.12:0/1266786492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 msgr2=0x55f87c9566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9eac99b700 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c9566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9eac99b700 1 -- 172.21.15.12:0/1266786492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 msgr2=0x55f87c95d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9eac99b700 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9eac99b700 1 -- 172.21.15.12:0/1266786492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c009a80 con 0x55f87c94c380 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c9566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9ead19c700 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9eac99b700 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c956170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c01b040 tx=0x7f9e9c004980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b1274c6e5194c99 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9e87fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9e87fff700 1 -- 172.21.15.12:0/1266786492 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c004450 con 0x55f87c94c380 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9e87fff700 1 -- 172.21.15.12:0/1266786492 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f9e9c005620 con 0x55f87c94c380 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.825+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/1266786492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f87c93faf0 con 0x55f87c94c380 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9e87fff700 1 -- 172.21.15.12:0/1266786492 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e9c0045b0 con 0x55f87c94c380 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9ec24bfb80 10 client.24995 fetch_fsmap learned FSMap version 22 2023-12-11T20:14:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/1266786492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55f87c6c9d90 con 0x55f87c94c380 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9e87fff700 1 -- 172.21.15.12:0/1266786492 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f87c93faf0 con 0x55f87c94c380 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9e87fff700 1 -- 172.21.15.12:0/1266786492 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9e9c021040 con 0x55f87c94c380 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9ec24bfb80 10 client.24995 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9ec24bfb80 10 client.24995 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9ec24bfb80 20 client.24995 populate_metadata read hostname 'smithi012' 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f87c961cd0 0x55f87c9607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9ec24bfb80 4 client.24995 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.826+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/1266786492 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f87c91bef0 con 0x55f87c961cd0 2023-12-11T20:14:59.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.827+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f87c961cd0 0x55f87c9607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.827+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f87c961cd0 0x55f87c9607e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54e3cc5b1b6d00fa server_cookie=15b2a23e2ea9397a in_seq=0 out_seq=0 2023-12-11T20:14:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.827+0000 7f9e87fff700 10 client.24995 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:14:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.828+0000 7f9e87fff700 1 -- 172.21.15.12:0/1266786492 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f87c91bef0 con 0x55f87c961cd0 2023-12-11T20:14:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.828+0000 7f9e87fff700 10 client.24995 handle_command_reply: tid=0 2023-12-11T20:14:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.828+0000 7f9ec24bfb80 1 client.24995 shutdown 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/1266786492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 msgr2=0x55f87c956170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c956170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c01b040 tx=0x7f9e9c004980 comp rx=0 tx=0).stop 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/1266786492 shutdown_connections 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f87c961cd0 0x55f87c9607e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c956170 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9e87fff700 0 client.24995 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/1266786492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c9566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/1266786492 >> 172.21.15.12:0/1266786492 conn(0x55f87c87b790 msgr2=0x55f87c9479f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/1266786492 shutdown_connections 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/1266786492 wait complete. 2023-12-11T20:14:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.829+0000 7f9ec24bfb80 20 client.24995 trim_cache size 0 max 16384 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9ec24bfb80 1 Processor -- start 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9ec24bfb80 1 -- start start 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c954190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 0x55f87c95d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c950bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c843830 con 0x55f87c94c380 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c94da50 con 0x55f87c94cce0 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c95e870 con 0x55f87c94dbd0 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.869+0000 7f9eac99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c954190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9eac99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c954190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34662/0 (socket says 172.21.15.12:34662) 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9eac99b700 1 -- 172.21.15.12:0/872352163 learned_addr learned my addr 172.21.15.12:0/872352163 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9ead19c700 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c950bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 0x55f87c95d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9eac99b700 1 -- 172.21.15.12:0/872352163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 msgr2=0x55f87c950bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9eac99b700 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c950bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9eac99b700 1 -- 172.21.15.12:0/872352163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 msgr2=0x55f87c95d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9eac99b700 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 0x55f87c95d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9eac99b700 1 -- 172.21.15.12:0/872352163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f87c6b2c10 con 0x55f87c94c380 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9ead19c700 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c950bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:14:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9eac99b700 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c954190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c000be0 tx=0x7f9e9c005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0999d0c4803e14 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:59.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9e937fe700 1 -- 172.21.15.12:0/872352163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c004d80 con 0x55f87c94c380 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9e937fe700 1 -- 172.21.15.12:0/872352163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e9c005620 con 0x55f87c94c380 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.870+0000 7f9e937fe700 1 -- 172.21.15.12:0/872352163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c003680 con 0x55f87c94c380 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/872352163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 msgr2=0x55f87c954190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c954190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c000be0 tx=0x7f9e9c005a40 comp rx=0 tx=0).stop 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/872352163 shutdown_connections 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94dbd0 0x55f87c950bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94c380 0x55f87c954190 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/872352163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94cce0 0x55f87c95d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/872352163 >> 172.21.15.12:0/872352163 conn(0x55f87c87b790 msgr2=0x55f87c955680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/872352163 shutdown_connections 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.871+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/872352163 wait complete. 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 1 -- start start 2023-12-11T20:14:59.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 1 Processor -- start 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c95d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c959e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c95aa80 con 0x55f87c94dbd0 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c95d960 con 0x55f87c94c380 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f87c95db20 con 0x55f87c94cce0 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.872+0000 7f9ec24bfb80 10 client.0 _ll_register_callbacks cb 0x55f87c785a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34672/0 (socket says 172.21.15.12:34672) 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 -- 172.21.15.12:0/857432472 learned_addr learned my addr 172.21.15.12:0/857432472 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c959e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9eac99b700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c95d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 -- 172.21.15.12:0/857432472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 msgr2=0x55f87c959e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:14:59.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c959e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 -- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 msgr2=0x55f87c95d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c95d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 -- 172.21.15.12:0/857432472 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea81a1b20 con 0x55f87c94dbd0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ea7fff700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c959e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9eac99b700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c95d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9ead19c700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95a380 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00979b0 tx=0x7f9ea0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e3f183cc7c1f61 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9e87fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.873+0000 7f9e87fff700 1 -- 172.21.15.12:0/857432472 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea009b3a0 con 0x55f87c94dbd0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/857432472 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e9c0054b0 con 0x55f87c94dbd0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9e87fff700 1 -- 172.21.15.12:0/857432472 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f9ea00b2020 con 0x55f87c94dbd0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9e87fff700 1 -- 172.21.15.12:0/857432472 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ea009af40 con 0x55f87c94dbd0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 10 client.15135 fetch_fsmap learned FSMap version 22 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/857432472 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55f87c6c9d90 con 0x55f87c94dbd0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9e87fff700 1 -- 172.21.15.12:0/857432472 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ea00a7080 con 0x55f87c94dbd0 2023-12-11T20:14:59.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9e87fff700 1 -- 172.21.15.12:0/857432472 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9ea009a550 con 0x55f87c94dbd0 2023-12-11T20:14:59.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 10 client.15135 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:14:59.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 10 client.15135 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-11T20:14:59.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 20 client.15135 populate_metadata read hostname 'smithi012' 2023-12-11T20:14:59.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f87c9bccf0 0x55f87c9b9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:14:59.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 4 client.15135 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T20:14:59.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.874+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/857432472 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f87c866f80 con 0x55f87c9bccf0 2023-12-11T20:14:59.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.875+0000 7f9eac99b700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f87c9bccf0 0x55f87c9b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:14:59.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.875+0000 7f9eac99b700 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f87c9bccf0 0x55f87c9b9150 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7e45e24342fdbbc8 server_cookie=af827f3a82d73ca in_seq=0 out_seq=0 2023-12-11T20:14:59.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.875+0000 7f9e87fff700 10 client.15135 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:14:59.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.875+0000 7f9e87fff700 1 -- 172.21.15.12:0/857432472 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55f87c866f80 con 0x55f87c9bccf0 2023-12-11T20:14:59.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.875+0000 7f9e87fff700 10 client.15135 handle_command_reply: tid=0 2023-12-11T20:14:59.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.875+0000 7f9ec24bfb80 1 client.15135 shutdown 2023-12-11T20:14:59.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/857432472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 msgr2=0x55f87c95a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95a380 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00979b0 tx=0x7f9ea0009780 comp rx=0 tx=0).stop 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/857432472 shutdown_connections 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f87c9bccf0 0x55f87c9b9150 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f87c94c380 0x55f87c95d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f87c94dbd0 0x55f87c95a380 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9e87fff700 0 client.15135 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 --2- 172.21.15.12:0/857432472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f87c94cce0 0x55f87c959e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/857432472 >> 172.21.15.12:0/857432472 conn(0x55f87c87b790 msgr2=0x55f87c96a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/857432472 shutdown_connections 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 1 -- 172.21.15.12:0/857432472 wait complete. 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.876+0000 7f9ec24bfb80 20 client.15135 trim_cache size 0 max 16384 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:14:59.879 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "732461f0-9860-11ee-95a3-87774f69a715", 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24566, 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 62.378048612000001, 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 22, 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 87, 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 86.663173153000002 2023-12-11T20:14:59.880 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 -- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9e980a1590 msgr2=0x7f9e980a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9e980a1590 0x7f9e980a3a50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9e940139a0 tx=0x7f9e94009d30 comp rx=0 tx=0).stop 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 -- 172.21.15.12:0/1499705236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ea8107170 msgr2=0x7f9ea81a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ea8107170 0x7f9ea81a0b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000b070 tx=0x7f9ea0007840 comp rx=0 tx=0).stop 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 -- 172.21.15.12:0/1499705236 shutdown_connections 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9e980a1590 0x7f9e980a3a50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ea8107170 0x7f9ea81a0b80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ea8101f10 0x7f9ea8199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 --2- 172.21.15.12:0/1499705236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ea8104840 0x7f9ea8199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:14:59.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 -- 172.21.15.12:0/1499705236 >> 172.21.15.12:0/1499705236 conn(0x7f9ea80fb940 msgr2=0x7f9ea8101700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:14:59.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 -- 172.21.15.12:0/1499705236 shutdown_connections 2023-12-11T20:14:59.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:14:59.877+0000 7f9eaebff700 1 -- 172.21.15.12:0/1499705236 wait complete. 2023-12-11T20:14:59.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-12-11T20:15:00.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.106+0000 7f49a35ff700 1 -- 172.21.15.12:0/3319646027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c074030 msgr2=0x7f499c0744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.106+0000 7f49a35ff700 1 --2- 172.21.15.12:0/3319646027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c074030 0x7f499c0744b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f498c009990 tx=0x7f498c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.107+0000 7f49a35ff700 1 -- 172.21.15.12:0/3319646027 shutdown_connections 2023-12-11T20:15:00.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.107+0000 7f49a35ff700 1 --2- 172.21.15.12:0/3319646027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f499c109370 0x7f499c10b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.107+0000 7f49a35ff700 1 --2- 172.21.15.12:0/3319646027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f499c075610 0x7f499c073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.107+0000 7f49a35ff700 1 --2- 172.21.15.12:0/3319646027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c074030 0x7f499c0744b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.107+0000 7f49a35ff700 1 -- 172.21.15.12:0/3319646027 >> 172.21.15.12:0/3319646027 conn(0x7f499c0fca00 msgr2=0x7f499c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.107+0000 7f49a35ff700 1 -- 172.21.15.12:0/3319646027 shutdown_connections 2023-12-11T20:15:00.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.107+0000 7f49a35ff700 1 -- 172.21.15.12:0/3319646027 wait complete. 2023-12-11T20:15:00.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.108+0000 7f49a35ff700 1 Processor -- start 2023-12-11T20:15:00.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a35ff700 1 -- start start 2023-12-11T20:15:00.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a35ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f499c074030 0x7f499c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a35ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c075610 0x7f499c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a35ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f499c109370 0x7f499c1a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a35ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c1a10e0 con 0x7f499c075610 2023-12-11T20:15:00.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a35ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c1a1220 con 0x7f499c074030 2023-12-11T20:15:00.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a35ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c1a13b0 con 0x7f499c109370 2023-12-11T20:15:00.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a139b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f499c074030 0x7f499c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a0b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c075610 0x7f499c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a139b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f499c074030 0x7f499c1995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58854/0 (socket says 172.21.15.12:58854) 2023-12-11T20:15:00.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a139b700 1 -- 172.21.15.12:0/1535690946 learned_addr learned my addr 172.21.15.12:0/1535690946 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.109+0000 7f49a1b9c700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f499c109370 0x7f499c1a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a0b9a700 1 -- 172.21.15.12:0/1535690946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f499c109370 msgr2=0x7f499c1a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f499c109370 0x7f499c1a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a0b9a700 1 -- 172.21.15.12:0/1535690946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f499c074030 msgr2=0x7f499c1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f499c074030 0x7f499c1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a0b9a700 1 -- 172.21.15.12:0/1535690946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0095f0 con 0x7f499c075610 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a139b700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f499c074030 0x7f499c1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c075610 0x7f499c199af0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f498c000c00 tx=0x7f498c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49927fc700 1 -- 172.21.15.12:0/1535690946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c01d070 con 0x7f499c075610 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49927fc700 1 -- 172.21.15.12:0/1535690946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f498c00bdb0 con 0x7f499c075610 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a35ff700 1 -- 172.21.15.12:0/1535690946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c1a1630 con 0x7f499c075610 2023-12-11T20:15:00.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49927fc700 1 -- 172.21.15.12:0/1535690946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c00fcb0 con 0x7f499c075610 2023-12-11T20:15:00.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.110+0000 7f49a35ff700 1 -- 172.21.15.12:0/1535690946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c1a1a50 con 0x7f499c075610 2023-12-11T20:15:00.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.115+0000 7f49927fc700 1 -- 172.21.15.12:0/1535690946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f498c00f460 con 0x7f499c075610 2023-12-11T20:15:00.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49b6fb1b80 1 Processor -- start 2023-12-11T20:15:00.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49b6fb1b80 1 -- start start 2023-12-11T20:15:00.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 0x5595f80e5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f803eb00 con 0x5595f80e3380 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f803c420 con 0x5595f80e4bd0 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f8037d10 con 0x5595f80e3ce0 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.116+0000 7f49927fc700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49880a1510 0x7f49880a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80e45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54894/0 (socket says 172.21.15.12:54894) 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 -- 172.21.15.12:0/3026862564 learned_addr learned my addr 172.21.15.12:0/3026862564 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49927fc700 1 -- 172.21.15.12:0/1535690946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f498c0ce230 con 0x7f499c075610 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a1b9c700 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 0x5595f80e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a1b9c700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49880a1510 0x7f49880a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 -- 172.21.15.12:0/3026862564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 msgr2=0x5595f80e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 0x5595f80e5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 -- 172.21.15.12:0/3026862564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 msgr2=0x5595f80e37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 -- 172.21.15.12:0/3026862564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f7eb45e0 con 0x5595f80e3ce0 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.117+0000 7f49a139b700 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80e45f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49980107a0 tx=0x7f4998010ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53d8372fe0f330d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.118+0000 7f49a1b9c700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49880a1510 0x7f49880a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4994009ec0 tx=0x7f499400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.118+0000 7f49877fe700 1 -- 172.21.15.12:0/3026862564 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998011640 con 0x5595f80e3ce0 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.118+0000 7f49877fe700 1 -- 172.21.15.12:0/3026862564 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4998015070 con 0x5595f80e3ce0 2023-12-11T20:15:00.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.118+0000 7f49877fe700 1 -- 172.21.15.12:0/3026862564 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998019ae0 con 0x5595f80e3ce0 2023-12-11T20:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.118+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3026862564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 msgr2=0x5595f80e45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.118+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80e45f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49980107a0 tx=0x7f4998010ab0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.119+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3026862564 shutdown_connections 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.119+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 0x5595f80e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.119+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.119+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/3026862564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80e45f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.119+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3026862564 >> 172.21.15.12:0/3026862564 conn(0x5595f8012790 msgr2=0x5595f80dfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.119+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3026862564 shutdown_connections 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.119+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3026862564 wait complete. 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.119+0000 7f49b6fb1b80 1 -- start start 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49b6fb1b80 1 Processor -- start 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80ed130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80ed670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 0x5595f80f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f7ff1510 con 0x5595f80e3380 2023-12-11T20:15:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f7ff11b0 con 0x5595f80e4bd0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f7eb68d0 con 0x5595f80e3ce0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49b6fb1b80 10 client.0 _ll_register_callbacks cb 0x5595f7f1ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49a139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49a0b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49a1b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 0x5595f80f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49a0b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80ed670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54904/0 (socket says 172.21.15.12:54904) 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.120+0000 7f49a0b9a700 1 -- 172.21.15.12:0/1287729640 learned_addr learned my addr 172.21.15.12:0/1287729640 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49a0b9a700 1 -- 172.21.15.12:0/1287729640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 msgr2=0x5595f80f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 0x5595f80f46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49a0b9a700 1 -- 172.21.15.12:0/1287729640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 msgr2=0x5595f80ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80ed130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49a0b9a700 1 -- 172.21.15.12:0/1287729640 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49980103d0 con 0x5595f80e3ce0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80ed670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f498c00f7b0 tx=0x7f498c02bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=938760b16b9f2aae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f4984ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:15:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f4984ff9700 1 -- 172.21.15.12:0/1287729640 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c09b870 con 0x5595f80e3ce0 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f4984ff9700 1 -- 172.21.15.12:0/1287729640 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f498c09bb10 con 0x5595f80e3ce0 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/1287729640 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595f80d6af0 con 0x5595f80e3ce0 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f4984ff9700 1 -- 172.21.15.12:0/1287729640 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f498c013460 con 0x5595f80e3ce0 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49b6fb1b80 10 client.25003 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.121+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/1287729640 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5595f7e60d90 con 0x5595f80e3ce0 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f4984ff9700 1 -- 172.21.15.12:0/1287729640 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5595f80d6af0 con 0x5595f80e3ce0 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f4984ff9700 1 -- 172.21.15.12:0/1287729640 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f498c09a900 con 0x5595f80e3ce0 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f49b6fb1b80 10 client.25003 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f49b6fb1b80 10 client.25003 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f49b6fb1b80 20 client.25003 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5595f80f8980 0x5595f80f7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f49b6fb1b80 4 client.25003 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/1287729640 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595f80b2ef0 con 0x5595f80f8980 2023-12-11T20:15:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.122+0000 7f49a139b700 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5595f80f8980 0x5595f80f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.123+0000 7f49a139b700 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5595f80f8980 0x5595f80f7680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a02ea8302da35cb server_cookie=b0e558767e92f865 in_seq=0 out_seq=0 2023-12-11T20:15:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.123+0000 7f4984ff9700 10 client.25003 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f4984ff9700 1 -- 172.21.15.12:0/1287729640 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5595f80b2ef0 con 0x5595f80f8980 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f4984ff9700 10 client.25003 handle_command_reply: tid=0 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 client.25003 shutdown 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/1287729640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 msgr2=0x5595f80ed670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80ed670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f498c00f7b0 tx=0x7f498c02bf90 comp rx=0 tx=0).stop 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/1287729640 shutdown_connections 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5595f80f8980 0x5595f80f7680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e4bd0 0x5595f80f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f4984ff9700 0 client.25003 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/1287729640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3ce0 0x5595f80ed670 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/1287729640 >> 172.21.15.12:0/1287729640 conn(0x5595f8012790 msgr2=0x5595f80de9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/1287729640 shutdown_connections 2023-12-11T20:15:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/1287729640 wait complete. 2023-12-11T20:15:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.124+0000 7f49b6fb1b80 20 client.25003 trim_cache size 0 max 16384 2023-12-11T20:15:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.143+0000 7f49b6fb1b80 1 Processor -- start 2023-12-11T20:15:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.143+0000 7f49b6fb1b80 1 -- start start 2023-12-11T20:15:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.143+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.143+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.143+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e4bd0 0x5595f80df920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.143+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f8033e00 con 0x5595f80e3380 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.143+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f7fdcb50 con 0x5595f80e3ce0 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.143+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f7fd3360 con 0x5595f80e4bd0 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a0b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34706/0 (socket says 172.21.15.12:34706) 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a139b700 1 -- 172.21.15.12:0/3719111504 learned_addr learned my addr 172.21.15.12:0/3719111504 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a0b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58892/0 (socket says 172.21.15.12:58892) 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a1b9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e4bd0 0x5595f80df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a0b9a700 1 -- 172.21.15.12:0/3719111504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e4bd0 msgr2=0x5595f80df920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/3719111504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e4bd0 0x5595f80df920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a0b9a700 1 -- 172.21.15.12:0/3719111504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 msgr2=0x5595f80e4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/3719111504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a0b9a700 1 -- 172.21.15.12:0/3719111504 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f7e49c10 con 0x5595f80e3ce0 2023-12-11T20:15:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/3719111504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f498c020000 tx=0x7f498c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa9330e0a0ab21c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f4987fff700 1 -- 172.21.15.12:0/3719111504 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0a3710 con 0x5595f80e3ce0 2023-12-11T20:15:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f4987fff700 1 -- 172.21.15.12:0/3719111504 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f498c013460 con 0x5595f80e3ce0 2023-12-11T20:15:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.144+0000 7f4987fff700 1 -- 172.21.15.12:0/3719111504 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0a3280 con 0x5595f80e3ce0 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3719111504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 msgr2=0x5595f80f45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/3719111504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f498c020000 tx=0x7f498c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3719111504 shutdown_connections 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/3719111504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e4bd0 0x5595f80df920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/3719111504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e3380 0x5595f80e4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/3719111504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3719111504 >> 172.21.15.12:0/3719111504 conn(0x5595f8012790 msgr2=0x5595f80eb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3719111504 shutdown_connections 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.145+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/3719111504 wait complete. 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 1 -- start start 2023-12-11T20:15:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 1 Processor -- start 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3380 0x5595f80ea300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e4bd0 0x5595f80e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f80e8fc0 con 0x5595f80e4bd0 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f80e9130 con 0x5595f80e3ce0 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f80e92f0 con 0x5595f80e3380 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49b6fb1b80 10 client.0 _ll_register_callbacks cb 0x5595f7f1ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.146+0000 7f49a1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e4bd0 0x5595f80e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e4bd0 0x5595f80e8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34720/0 (socket says 172.21.15.12:34720) 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a0b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a139b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3380 0x5595f80ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a1b9c700 1 -- 172.21.15.12:0/2902882163 learned_addr learned my addr 172.21.15.12:0/2902882163 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a1b9c700 1 -- 172.21.15.12:0/2902882163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3380 msgr2=0x5595f80ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a1b9c700 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3380 0x5595f80ea300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a1b9c700 1 -- 172.21.15.12:0/2902882163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 msgr2=0x5595f80f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a1b9c700 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a1b9c700 1 -- 172.21.15.12:0/2902882163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595f7e60d90 con 0x5595f80e4bd0 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a0b9a700 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a139b700 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3380 0x5595f80ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f49a1b9c700 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e4bd0 0x5595f80e8a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4994019ca0 tx=0x7f4994004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b529af3d32bbe74c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f4984ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.147+0000 7f4984ff9700 1 -- 172.21.15.12:0/2902882163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499400e070 con 0x5595f80e4bd0 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/2902882163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595f7ffdf80 con 0x5595f80e4bd0 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f4984ff9700 1 -- 172.21.15.12:0/2902882163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f4994004bb0 con 0x5595f80e4bd0 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f4984ff9700 1 -- 172.21.15.12:0/2902882163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4994004d70 con 0x5595f80e4bd0 2023-12-11T20:15:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 10 client.15153 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/2902882163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5595f7e87200 con 0x5595f80e4bd0 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f4984ff9700 1 -- 172.21.15.12:0/2902882163 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4994035020 con 0x5595f80e4bd0 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f4984ff9700 1 -- 172.21.15.12:0/2902882163 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f49940266c0 con 0x5595f80e4bd0 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 10 client.15153 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 10 client.15153 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 20 client.15153 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5595f815bdc0 0x5595f8158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 4 client.15153 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.148+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/2902882163 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5595f7ff0440 con 0x5595f815bdc0 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.149+0000 7f49a139b700 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5595f815bdc0 0x5595f8158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.149+0000 7f49a139b700 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5595f815bdc0 0x5595f8158240 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f35c42108ea450a server_cookie=de678c1746a1f9ea in_seq=0 out_seq=0 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.149+0000 7f4984ff9700 10 client.15153 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.149+0000 7f4984ff9700 1 -- 172.21.15.12:0/2902882163 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5595f7ff0440 con 0x5595f815bdc0 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.149+0000 7f4984ff9700 10 client.15153 handle_command_reply: tid=0 2023-12-11T20:15:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.149+0000 7f49b6fb1b80 1 client.15153 shutdown 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.149+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/2902882163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e4bd0 msgr2=0x5595f80e8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.149+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e4bd0 0x5595f80e8a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4994019ca0 tx=0x7f4994004b40 comp rx=0 tx=0).stop 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/2902882163 shutdown_connections 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5595f815bdc0 0x5595f8158240 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595f80e4bd0 0x5595f80e8a80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595f80e3380 0x5595f80ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 1 --2- 172.21.15.12:0/2902882163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595f80e3ce0 0x5595f80f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/2902882163 >> 172.21.15.12:0/2902882163 conn(0x5595f8012790 msgr2=0x5595f80eb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f4984ff9700 0 client.15153 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/2902882163 shutdown_connections 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 1 -- 172.21.15.12:0/2902882163 wait complete. 2023-12-11T20:15:00.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49b6fb1b80 20 client.15153 trim_cache size 0 max 16384 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "732461f0-9860-11ee-95a3-87774f69a715", 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24577, 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 63.662892065999998, 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 22, 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 87, 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 83.620706779000002 2023-12-11T20:15:00.154 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:15:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49a35ff700 1 -- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49880a1510 msgr2=0x7f49880a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49a35ff700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49880a1510 0x7f49880a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4994009ec0 tx=0x7f499400b040 comp rx=0 tx=0).stop 2023-12-11T20:15:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49a35ff700 1 -- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c075610 msgr2=0x7f499c199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.150+0000 7f49a35ff700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c075610 0x7f499c199af0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f498c000c00 tx=0x7f498c004730 comp rx=0 tx=0).stop 2023-12-11T20:15:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.151+0000 7f49a35ff700 1 -- 172.21.15.12:0/1535690946 shutdown_connections 2023-12-11T20:15:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.151+0000 7f49a35ff700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49880a1510 0x7f49880a39d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.151+0000 7f49a35ff700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f499c074030 0x7f499c1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.151+0000 7f49a35ff700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f499c109370 0x7f499c1a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.151+0000 7f49a35ff700 1 --2- 172.21.15.12:0/1535690946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c075610 0x7f499c199af0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.151+0000 7f49a35ff700 1 -- 172.21.15.12:0/1535690946 >> 172.21.15.12:0/1535690946 conn(0x7f499c0fca00 msgr2=0x7f499c0fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.151+0000 7f49a35ff700 1 -- 172.21.15.12:0/1535690946 shutdown_connections 2023-12-11T20:15:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.151+0000 7f49a35ff700 1 -- 172.21.15.12:0/1535690946 wait complete. 2023-12-11T20:15:00.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-11T20:15:00.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 -- 172.21.15.12:0/1335586111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff388075610 msgr2=0x7ff388073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/1335586111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff388075610 0x7ff388073a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3780098f0 tx=0x7ff378009c00 comp rx=0 tx=0).stop 2023-12-11T20:15:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 -- 172.21.15.12:0/1335586111 shutdown_connections 2023-12-11T20:15:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/1335586111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff388075610 0x7ff388073a60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/1335586111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff38810da80 0x7ff38810fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/1335586111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff388074030 0x7ff3880744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 -- 172.21.15.12:0/1335586111 >> 172.21.15.12:0/1335586111 conn(0x7ff3880fca00 msgr2=0x7ff3880fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 -- 172.21.15.12:0/1335586111 shutdown_connections 2023-12-11T20:15:00.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.383+0000 7ff38e7ff700 1 -- 172.21.15.12:0/1335586111 wait complete. 2023-12-11T20:15:00.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.384+0000 7ff38e7ff700 1 Processor -- start 2023-12-11T20:15:00.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.384+0000 7ff38e7ff700 1 -- start start 2023-12-11T20:15:00.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff38e7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff388074030 0x7ff38819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff38e7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff388075610 0x7ff38819df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff38e7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff38810da80 0x7ff3881a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff38e7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881a5500 con 0x7ff388074030 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff38e7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881a5640 con 0x7ff38810da80 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff38e7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881a57d0 con 0x7ff388075610 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff387fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff388074030 0x7ff38819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff388075610 0x7ff38819df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff387fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff388074030 0x7ff38819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34736/0 (socket says 172.21.15.12:34736) 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff388075610 0x7ff38819df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54916/0 (socket says 172.21.15.12:54916) 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff387fff700 1 -- 172.21.15.12:0/3193156507 learned_addr learned my addr 172.21.15.12:0/3193156507 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff38810da80 0x7ff3881a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff387fff700 1 -- 172.21.15.12:0/3193156507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff388075610 msgr2=0x7ff38819df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff387fff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff388075610 0x7ff38819df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff387fff700 1 -- 172.21.15.12:0/3193156507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff38810da80 msgr2=0x7ff3881a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff387fff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff38810da80 0x7ff3881a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff387fff700 1 -- 172.21.15.12:0/3193156507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0095f0 con 0x7ff388074030 2023-12-11T20:15:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff3877fe700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff388075610 0x7ff38819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.385+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff38810da80 0x7ff3881a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.386+0000 7ff387fff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff388074030 0x7ff38819da20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff378009810 tx=0x7ff37800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.386+0000 7ff3857fa700 1 -- 172.21.15.12:0/3193156507 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37801c070 con 0x7ff388074030 2023-12-11T20:15:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.386+0000 7ff3857fa700 1 -- 172.21.15.12:0/3193156507 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff37800f7b0 con 0x7ff388074030 2023-12-11T20:15:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.386+0000 7ff38e7ff700 1 -- 172.21.15.12:0/3193156507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff378009520 con 0x7ff388074030 2023-12-11T20:15:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.386+0000 7ff3857fa700 1 -- 172.21.15.12:0/3193156507 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780038e0 con 0x7ff388074030 2023-12-11T20:15:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.386+0000 7ff38e7ff700 1 -- 172.21.15.12:0/3193156507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3881a5ce0 con 0x7ff388074030 2023-12-11T20:15:00.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.389+0000 7ff3857fa700 1 -- 172.21.15.12:0/3193156507 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7ff378020030 con 0x7ff388074030 2023-12-11T20:15:00.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.391+0000 7ff3a204cb80 1 Processor -- start 2023-12-11T20:15:00.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.391+0000 7ff3a204cb80 1 -- start start 2023-12-11T20:15:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bc77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bc85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff3857fa700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3700a1510 0x7ff3700a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc8bd0 0x55dc52bc9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52b22b00 con 0x55dc52bc8bd0 2023-12-11T20:15:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52b20420 con 0x55dc52bc7ce0 2023-12-11T20:15:00.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52b1bd10 con 0x55dc52bc7380 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff3857fa700 1 -- 172.21.15.12:0/3193156507 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7ff3780cdfe0 con 0x7ff388074030 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bc77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bc77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54930/0 (socket says 172.21.15.12:54930) 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff38cd9c700 1 -- 172.21.15.12:0/4124363493 learned_addr learned my addr 172.21.15.12:0/4124363493 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.392+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc8bd0 0x55dc52bc9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff3877fe700 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bc85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff387fff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3700a1510 0x7ff3700a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff38cd9c700 1 -- 172.21.15.12:0/4124363493 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 msgr2=0x55dc52bc85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bc85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff38cd9c700 1 -- 172.21.15.12:0/4124363493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc8bd0 msgr2=0x55dc52bc9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc8bd0 0x55dc52bc9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff38cd9c700 1 -- 172.21.15.12:0/4124363493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc529985e0 con 0x55dc52bc7380 2023-12-11T20:15:00.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bc77a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff380009550 tx=0x7ff380009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11c160371649850 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff387fff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3700a1510 0x7ff3700a39d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff3780cb990 tx=0x7ff378005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff36e7fc700 1 -- 172.21.15.12:0/4124363493 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380008260 con 0x55dc52bc7380 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff36e7fc700 1 -- 172.21.15.12:0/4124363493 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff38000f040 con 0x55dc52bc7380 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.393+0000 7ff36e7fc700 1 -- 172.21.15.12:0/4124363493 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380007820 con 0x55dc52bc7380 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 -- 172.21.15.12:0/4124363493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 msgr2=0x55dc52bc77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bc77a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff380009550 tx=0x7ff380009920 comp rx=0 tx=0).stop 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 -- 172.21.15.12:0/4124363493 shutdown_connections 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc8bd0 0x55dc52bc9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bc77a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/4124363493 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bc85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 -- 172.21.15.12:0/4124363493 >> 172.21.15.12:0/4124363493 conn(0x55dc52af6790 msgr2=0x55dc52bc3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 -- 172.21.15.12:0/4124363493 shutdown_connections 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.394+0000 7ff3a204cb80 1 -- 172.21.15.12:0/4124363493 wait complete. 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.395+0000 7ff3a204cb80 1 -- start start 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.395+0000 7ff3a204cb80 1 Processor -- start 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bd1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 0x55dc52bd8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52ad5510 con 0x55dc52bc7380 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52ad51b0 con 0x55dc52bc7ce0 2023-12-11T20:15:00.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc5299a8d0 con 0x55dc52bc8bd0 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff3a204cb80 10 client.0 _ll_register_callbacks cb 0x55dc52a00a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bd1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bd1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34756/0 (socket says 172.21.15.12:34756) 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff38cd9c700 1 -- 172.21.15.12:0/1430308133 learned_addr learned my addr 172.21.15.12:0/1430308133 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 0x55dc52bd8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.396+0000 7ff3877fe700 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3877fe700 1 -- 172.21.15.12:0/1430308133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 msgr2=0x55dc52bd8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3877fe700 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 0x55dc52bd8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3877fe700 1 -- 172.21.15.12:0/1430308133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 msgr2=0x55dc52bd1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3877fe700 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bd1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3877fe700 1 -- 172.21.15.12:0/1430308133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff380008990 con 0x55dc52bc7ce0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bd1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3877fe700 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd1740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff37c005fd0 tx=0x7ff37c00f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a289610ec8632d9a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3677fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3677fe700 1 -- 172.21.15.12:0/1430308133 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c017070 con 0x55dc52bc7ce0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3677fe700 1 -- 172.21.15.12:0/1430308133 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7ff37c00f990 con 0x55dc52bc7ce0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3a204cb80 1 -- 172.21.15.12:0/1430308133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc52bbaaf0 con 0x55dc52bc7ce0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3677fe700 1 -- 172.21.15.12:0/1430308133 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff37c00fb50 con 0x55dc52bc7ce0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3a204cb80 10 client.25028 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3a204cb80 1 -- 172.21.15.12:0/1430308133 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55dc52944d90 con 0x55dc52bc7ce0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.397+0000 7ff3677fe700 1 -- 172.21.15.12:0/1430308133 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dc52bbaaf0 con 0x55dc52bc7ce0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.398+0000 7ff3677fe700 1 -- 172.21.15.12:0/1430308133 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff37c010430 con 0x55dc52bc7ce0 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.398+0000 7ff3a204cb80 10 client.25028 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.398+0000 7ff3a204cb80 10 client.25028 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-11T20:15:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.398+0000 7ff3a204cb80 20 client.25028 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.398+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dc52bdce80 0x55dc52bdb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.398+0000 7ff3a204cb80 4 client.25028 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.398+0000 7ff3a204cb80 1 -- 172.21.15.12:0/1430308133 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc52b96ef0 con 0x55dc52bdce80 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.398+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dc52bdce80 0x55dc52bdb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.399+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dc52bdce80 0x55dc52bdb980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f246d77048de7c5 server_cookie=c4a58a330d9565f1 in_seq=0 out_seq=0 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.399+0000 7ff3677fe700 10 client.25028 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3677fe700 1 -- 172.21.15.12:0/1430308133 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dc52b96ef0 con 0x55dc52bdce80 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3677fe700 10 client.25028 handle_command_reply: tid=0 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 client.25028 shutdown 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 -- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 msgr2=0x55dc52bd1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd1740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff37c005fd0 tx=0x7ff37c00f3c0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 -- 172.21.15.12:0/1430308133 shutdown_connections 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dc52bdce80 0x55dc52bdb980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 0x55dc52bd8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bd1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3677fe700 0 client.25028 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/1430308133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd1740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 -- 172.21.15.12:0/1430308133 >> 172.21.15.12:0/1430308133 conn(0x55dc52af6790 msgr2=0x55dc52bc29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 -- 172.21.15.12:0/1430308133 shutdown_connections 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.400+0000 7ff3a204cb80 1 -- 172.21.15.12:0/1430308133 wait complete. 2023-12-11T20:15:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.401+0000 7ff3a204cb80 20 client.25028 trim_cache size 0 max 16384 2023-12-11T20:15:00.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3a204cb80 1 Processor -- start 2023-12-11T20:15:00.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3a204cb80 1 -- start start 2023-12-11T20:15:00.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bcb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 0x55dc52bcbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52abe860 con 0x55dc52bc7380 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52bda540 con 0x55dc52bc7ce0 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52bbaad0 con 0x55dc52bc8bd0 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bcb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bcb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34758/0 (socket says 172.21.15.12:34758) 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff38cd9c700 1 -- 172.21.15.12:0/300668126 learned_addr learned my addr 172.21.15.12:0/300668126 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.420+0000 7ff3877fe700 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 0x55dc52bcbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff38cd9c700 1 -- 172.21.15.12:0/300668126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 msgr2=0x55dc52bcbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 0x55dc52bcbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff38cd9c700 1 -- 172.21.15.12:0/300668126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 msgr2=0x55dc52bd8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff38cd9c700 1 -- 172.21.15.12:0/300668126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc5292dc10 con 0x55dc52bc7380 2023-12-11T20:15:00.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff3877fe700 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:00.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bcb0e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff3800085c0 tx=0x7ff3800088f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe67b044993913c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff36effd700 1 -- 172.21.15.12:0/300668126 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380003d40 con 0x55dc52bc7380 2023-12-11T20:15:00.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff36effd700 1 -- 172.21.15.12:0/300668126 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff38000ec60 con 0x55dc52bc7380 2023-12-11T20:15:00.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.421+0000 7ff36effd700 1 -- 172.21.15.12:0/300668126 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380005670 con 0x55dc52bc7380 2023-12-11T20:15:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 -- 172.21.15.12:0/300668126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 msgr2=0x55dc52bcb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bcb0e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff3800085c0 tx=0x7ff3800088f0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 -- 172.21.15.12:0/300668126 shutdown_connections 2023-12-11T20:15:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc8bd0 0x55dc52bcbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7380 0x55dc52bcb0e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/300668126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 -- 172.21.15.12:0/300668126 >> 172.21.15.12:0/300668126 conn(0x55dc52af6790 msgr2=0x55dc52bcf220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 -- 172.21.15.12:0/300668126 shutdown_connections 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.422+0000 7ff3a204cb80 1 -- 172.21.15.12:0/300668126 wait complete. 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 1 -- start start 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 1 Processor -- start 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bd28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc8bd0 0x55dc52bd7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52bd8140 con 0x55dc52bc7ce0 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52bd82b0 con 0x55dc52bc8bd0 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc52bd8470 con 0x55dc52bc7380 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3a204cb80 10 client.0 _ll_register_callbacks cb 0x55dc52a00a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.423+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bd28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff38cd9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bd28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54942/0 (socket says 172.21.15.12:54942) 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34774/0 (socket says 172.21.15.12:34774) 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff38cd9c700 1 -- 172.21.15.12:0/3621462553 learned_addr learned my addr 172.21.15.12:0/3621462553 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc8bd0 0x55dc52bd7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3877fe700 1 -- 172.21.15.12:0/3621462553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 msgr2=0x55dc52bd28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3877fe700 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bd28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3877fe700 1 -- 172.21.15.12:0/3621462553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc8bd0 msgr2=0x55dc52bd7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3877fe700 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc8bd0 0x55dc52bd7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3877fe700 1 -- 172.21.15.12:0/3621462553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc52944d90 con 0x55dc52bc7ce0 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3877fe700 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd2ea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001eb0 tx=0x7ff37c005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbf6760213b5712 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3677fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.424+0000 7ff3677fe700 1 -- 172.21.15.12:0/3621462553 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c017040 con 0x55dc52bc7ce0 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 1 -- 172.21.15.12:0/3621462553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff38000f040 con 0x55dc52bc7ce0 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3677fe700 1 -- 172.21.15.12:0/3621462553 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7ff37c0046f0 con 0x55dc52bc7ce0 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3677fe700 1 -- 172.21.15.12:0/3621462553 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff37c0048d0 con 0x55dc52bc7ce0 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 10 client.15171 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 1 -- 172.21.15.12:0/3621462553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55dc529985e0 con 0x55dc52bc7ce0 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3677fe700 1 -- 172.21.15.12:0/3621462553 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff38000f040 con 0x55dc52bc7ce0 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3677fe700 1 -- 172.21.15.12:0/3621462553 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff37c005500 con 0x55dc52bc7ce0 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 10 client.15171 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 10 client.15171 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-11T20:15:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 20 client.15171 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dc52c379c0 0x55dc52c33e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 4 client.15171 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.425+0000 7ff3a204cb80 1 -- 172.21.15.12:0/3621462553 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dc52ae1f80 con 0x55dc52c379c0 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.426+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dc52c379c0 0x55dc52c33e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.426+0000 7ff38cd9c700 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dc52c379c0 0x55dc52c33e60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9aa90ceb36b3899 server_cookie=bce1f59e3a06bc7 in_seq=0 out_seq=0 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.426+0000 7ff3677fe700 10 client.15171 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.426+0000 7ff3677fe700 1 -- 172.21.15.12:0/3621462553 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55dc52ae1f80 con 0x55dc52c379c0 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.426+0000 7ff3677fe700 10 client.15171 handle_command_reply: tid=0 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 client.15171 shutdown 2023-12-11T20:15:00.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 -- 172.21.15.12:0/3621462553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7ce0 msgr2=0x55dc52bd2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd2ea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001eb0 tx=0x7ff37c005da0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 -- 172.21.15.12:0/3621462553 shutdown_connections 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dc52c379c0 0x55dc52c33e60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dc52bc8bd0 0x55dc52bd7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dc52bc7380 0x55dc52bd28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 --2- 172.21.15.12:0/3621462553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dc52bc7ce0 0x55dc52bd2ea0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3677fe700 0 client.15171 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 -- 172.21.15.12:0/3621462553 >> 172.21.15.12:0/3621462553 conn(0x55dc52af6790 msgr2=0x55dc52bcbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 -- 172.21.15.12:0/3621462553 shutdown_connections 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 1 -- 172.21.15.12:0/3621462553 wait complete. 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.427+0000 7ff3a204cb80 20 client.15171 trim_cache size 0 max 16384 2023-12-11T20:15:00.433 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "732461f0-9860-11ee-95a3-87774f69a715", 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24620, 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 66.959684889000002, 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 22, 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 87, 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 74.334080886999999 2023-12-11T20:15:00.434 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:15:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 -- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3700a1510 msgr2=0x7ff3700a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3700a1510 0x7ff3700a39d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff3780cb990 tx=0x7ff378005e30 comp rx=0 tx=0).stop 2023-12-11T20:15:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 -- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff388074030 msgr2=0x7ff38819da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff388074030 0x7ff38819da20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff378009810 tx=0x7ff37800b790 comp rx=0 tx=0).stop 2023-12-11T20:15:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 -- 172.21.15.12:0/3193156507 shutdown_connections 2023-12-11T20:15:00.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3700a1510 0x7ff3700a39d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff38810da80 0x7ff3881a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff388074030 0x7ff38819da20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 --2- 172.21.15.12:0/3193156507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff388075610 0x7ff38819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 -- 172.21.15.12:0/3193156507 >> 172.21.15.12:0/3193156507 conn(0x7ff3880fca00 msgr2=0x7ff388100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 -- 172.21.15.12:0/3193156507 shutdown_connections 2023-12-11T20:15:00.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:00.428+0000 7ff38e7ff700 1 -- 172.21.15.12:0/3193156507 wait complete. 2023-12-11T20:15:00.446 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.446 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.446 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.446 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.446 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.446 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.446 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:00 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4101185253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:00.448 INFO:tasks.cephadm:Setup complete, yielding 2023-12-11T20:15:00.448 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-11T20:15:00.457 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2023-12-11T20:15:00.458 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- bash -c 'ceph orch status' 2023-12-11T20:15:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:00 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4101185253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:00.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:00 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4101185253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:01.245 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:15:01.661 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:15:01.662 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:15:01.662 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:01.662 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:01 smithi012 ceph-mon[128787]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:15:01.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:15:01.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:15:01.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:01.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:01 smithi032 ceph-mon[132488]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:15:01.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:15:01.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:15:01.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:15:01.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:01 smithi039 ceph-mon[102205]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.997+0000 7f15245ee700 1 -- 172.21.15.12:0/2276202523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 msgr2=0x7f151c102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.997+0000 7f15245ee700 1 --2- 172.21.15.12:0/2276202523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 0x7f151c102c70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f150c0099c0 tx=0x7f150c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.997+0000 7f15245ee700 1 -- 172.21.15.12:0/2276202523 shutdown_connections 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.997+0000 7f15245ee700 1 --2- 172.21.15.12:0/2276202523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f151c1031b0 0x7f151c109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.997+0000 7f15245ee700 1 --2- 172.21.15.12:0/2276202523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c101610 0x7f151c101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.997+0000 7f15245ee700 1 --2- 172.21.15.12:0/2276202523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 0x7f151c102c70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.997+0000 7f15245ee700 1 -- 172.21.15.12:0/2276202523 >> 172.21.15.12:0/2276202523 conn(0x7f151c0fcbb0 msgr2=0x7f151c0feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.997+0000 7f15245ee700 1 -- 172.21.15.12:0/2276202523 shutdown_connections 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.998+0000 7f15245ee700 1 -- 172.21.15.12:0/2276202523 wait complete. 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.999+0000 7f15245ee700 1 Processor -- start 2023-12-11T20:15:02.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.999+0000 7f15245ee700 1 -- start start 2023-12-11T20:15:03.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.999+0000 7f15245ee700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f151c101610 0x7f151c197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:03.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.999+0000 7f15245ee700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 0x7f151c1979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:03.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.999+0000 7f15245ee700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c1031b0 0x7f151c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:03.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.999+0000 7f15245ee700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c19efd0 con 0x7f151c102810 2023-12-11T20:15:03.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.999+0000 7f15245ee700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c19f110 con 0x7f151c101610 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:02.999+0000 7f15245ee700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c19f2a0 con 0x7f151c1031b0 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 0x7f151c1979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 0x7f151c1979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34792/0 (socket says 172.21.15.12:34792) 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 -- 172.21.15.12:0/3233566132 learned_addr learned my addr 172.21.15.12:0/3233566132 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f152238a700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f151c101610 0x7f151c197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1522b8b700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c1031b0 0x7f151c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 -- 172.21.15.12:0/3233566132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c1031b0 msgr2=0x7f151c19ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c1031b0 0x7f151c19ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 -- 172.21.15.12:0/3233566132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f151c101610 msgr2=0x7f151c197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f151c101610 0x7f151c197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 -- 172.21.15.12:0/3233566132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0095f0 con 0x7f151c102810 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.000+0000 7f1521b89700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 0x7f151c1979d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f150c00b580 tx=0x7f150c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.001+0000 7f15137fe700 1 -- 172.21.15.12:0/3233566132 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c01d070 con 0x7f151c102810 2023-12-11T20:15:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.001+0000 7f15137fe700 1 -- 172.21.15.12:0/3233566132 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f150c00bd30 con 0x7f151c102810 2023-12-11T20:15:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.001+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c19f520 con 0x7f151c102810 2023-12-11T20:15:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.001+0000 7f15137fe700 1 -- 172.21.15.12:0/3233566132 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c022bd0 con 0x7f151c102810 2023-12-11T20:15:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.001+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c19f990 con 0x7f151c102810 2023-12-11T20:15:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.002+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c108b30 con 0x7f151c102810 2023-12-11T20:15:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.004+0000 7f15137fe700 1 -- 172.21.15.12:0/3233566132 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136057+0+0 (secure 0 0 0) 0x7f150c022d50 con 0x7f151c102810 2023-12-11T20:15:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.005+0000 7f15137fe700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15080a1590 0x7f15080a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.005+0000 7f15137fe700 1 -- 172.21.15.12:0/3233566132 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f150c0ce1c0 con 0x7f151c102810 2023-12-11T20:15:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.005+0000 7f152238a700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15080a1590 0x7f15080a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.006+0000 7f152238a700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15080a1590 0x7f15080a3a50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f151c102670 tx=0x7f151800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.009+0000 7f15137fe700 1 -- 172.21.15.12:0/3233566132 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f150c0976e0 con 0x7f151c102810 2023-12-11T20:15:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.273+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f151c061a10 con 0x7f15080a1590 2023-12-11T20:15:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.274+0000 7f15137fe700 1 -- 172.21.15.12:0/3233566132 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f151c061a10 con 0x7f15080a1590 2023-12-11T20:15:03.273 INFO:teuthology.orchestra.run.smithi012.stdout:Backend: cephadm 2023-12-11T20:15:03.273 INFO:teuthology.orchestra.run.smithi012.stdout:Available: Yes 2023-12-11T20:15:03.273 INFO:teuthology.orchestra.run.smithi012.stdout:Paused: No 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.276+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15080a1590 msgr2=0x7f15080a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.276+0000 7f15245ee700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15080a1590 0x7f15080a3a50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f151c102670 tx=0x7f151800b410 comp rx=0 tx=0).stop 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 msgr2=0x7f151c1979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 0x7f151c1979d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f150c00b580 tx=0x7f150c003a50 comp rx=0 tx=0).stop 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 shutdown_connections 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15080a1590 0x7f15080a3a50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f151c101610 0x7f151c197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c1031b0 0x7f151c19ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 --2- 172.21.15.12:0/3233566132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f151c102810 0x7f151c1979d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 >> 172.21.15.12:0/3233566132 conn(0x7f151c0fcbb0 msgr2=0x7f151c105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 shutdown_connections 2023-12-11T20:15:03.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:03.277+0000 7f15245ee700 1 -- 172.21.15.12:0/3233566132 wait complete. 2023-12-11T20:15:03.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-11T20:15:04.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:04 smithi032 ceph-mon[132488]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:04.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2023-12-11T20:15:04.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:04 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-12-11T20:15:04.549 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:15:04.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:04 smithi039 ceph-mon[102205]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:04.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2023-12-11T20:15:04.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:04 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-12-11T20:15:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:04 smithi012 ceph-mon[128787]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2023-12-11T20:15:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:04 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-12-11T20:15:05.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:05 smithi012 ceph-mon[128787]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:05.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:05 smithi012 ceph-mon[128787]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-12-11T20:15:05.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2023-12-11T20:15:05.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-12-11T20:15:05.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:05 smithi012 ceph-mon[128787]: osdmap e88: 12 total, 12 up, 12 in 2023-12-11T20:15:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:05 smithi032 ceph-mon[132488]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:05 smithi032 ceph-mon[132488]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-12-11T20:15:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2023-12-11T20:15:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-12-11T20:15:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:05 smithi032 ceph-mon[132488]: osdmap e88: 12 total, 12 up, 12 in 2023-12-11T20:15:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:05 smithi039 ceph-mon[102205]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:05 smithi039 ceph-mon[102205]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-12-11T20:15:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2023-12-11T20:15:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-12-11T20:15:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:05 smithi039 ceph-mon[102205]: osdmap e88: 12 total, 12 up, 12 in 2023-12-11T20:15:06.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 -- 172.21.15.12:0/1618194747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 msgr2=0x7f774c102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:06.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 --2- 172.21.15.12:0/1618194747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 0x7f774c102c80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77400099c0 tx=0x7f7740009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 -- 172.21.15.12:0/1618194747 shutdown_connections 2023-12-11T20:15:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 --2- 172.21.15.12:0/1618194747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c1031c0 0x7f774c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 --2- 172.21.15.12:0/1618194747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f774c101620 0x7f774c101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 --2- 172.21.15.12:0/1618194747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 0x7f774c102c80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 -- 172.21.15.12:0/1618194747 >> 172.21.15.12:0/1618194747 conn(0x7f774c0fcbe0 msgr2=0x7f774c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 -- 172.21.15.12:0/1618194747 shutdown_connections 2023-12-11T20:15:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.101+0000 7f77529f0700 1 -- 172.21.15.12:0/1618194747 wait complete. 2023-12-11T20:15:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.102+0000 7f77529f0700 1 Processor -- start 2023-12-11T20:15:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.102+0000 7f77529f0700 1 -- start start 2023-12-11T20:15:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.102+0000 7f77529f0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c101620 0x7f774c1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f77529f0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 0x7f774c199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f77529f0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f774c1031c0 0x7f774c1a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f77529f0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c1a1200 con 0x7f774c102820 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f77529f0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c1a1340 con 0x7f774c101620 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f77529f0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c1a14d0 con 0x7f774c1031c0 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 0x7f774c199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c101620 0x7f774c1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 0x7f774c199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34810/0 (socket says 172.21.15.12:34810) 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774b7fe700 1 -- 172.21.15.12:0/2965239800 learned_addr learned my addr 172.21.15.12:0/2965239800 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f7750f8d700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f774c1031c0 0x7f774c1a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774b7fe700 1 -- 172.21.15.12:0/2965239800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f774c1031c0 msgr2=0x7f774c1a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774b7fe700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f774c1031c0 0x7f774c1a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774b7fe700 1 -- 172.21.15.12:0/2965239800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c101620 msgr2=0x7f774c1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774b7fe700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c101620 0x7f774c1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.103+0000 7f774b7fe700 1 -- 172.21.15.12:0/2965239800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77400095f0 con 0x7f774c102820 2023-12-11T20:15:06.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.104+0000 7f774b7fe700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 0x7f774c199c00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7740009fd0 tx=0x7f774000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:06.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.104+0000 7f77497fa700 1 -- 172.21.15.12:0/2965239800 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774001d070 con 0x7f774c102820 2023-12-11T20:15:06.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.104+0000 7f77497fa700 1 -- 172.21.15.12:0/2965239800 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7740005050 con 0x7f774c102820 2023-12-11T20:15:06.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.104+0000 7f77497fa700 1 -- 172.21.15.12:0/2965239800 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740004a50 con 0x7f774c102820 2023-12-11T20:15:06.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.104+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774c1a1750 con 0x7f774c102820 2023-12-11T20:15:06.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.104+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774c1a1b10 con 0x7f774c102820 2023-12-11T20:15:06.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.105+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774c04f290 con 0x7f774c102820 2023-12-11T20:15:06.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.109+0000 7f77497fa700 1 -- 172.21.15.12:0/2965239800 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f77400051c0 con 0x7f774c102820 2023-12-11T20:15:06.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.110+0000 7f77497fa700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77340a1500 0x7f77340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:06.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.110+0000 7f77497fa700 1 -- 172.21.15.12:0/2965239800 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f77400cd9f0 con 0x7f774c102820 2023-12-11T20:15:06.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.110+0000 7f774bfff700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77340a1500 0x7f77340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:06.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.111+0000 7f774bfff700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77340a1500 0x7f77340a39c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f774c102680 tx=0x7f773c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:06.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.114+0000 7f77497fa700 1 -- 172.21.15.12:0/2965239800 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7740097030 con 0x7f774c102820 2023-12-11T20:15:06.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.336+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f774c1097b0 con 0x7f77340a1500 2023-12-11T20:15:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.362+0000 7f77497fa700 1 -- 172.21.15.12:0/2965239800 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4154 (secure 0 0 0) 0x7f774c1097b0 con 0x7f77340a1500 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (83s) 6s ago 83s 13.8M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2283cb5ce424 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi032 running (80s) 6s ago 80s 29.0M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 460c845d627e 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.c smithi039 running (97s) 6s ago 96s 18.9M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 5a3499861c04 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.d smithi012 running (106s) 6s ago 106s 16.0M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2803d19e5653 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.e smithi032 running (103s) 6s ago 103s 17.9M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 b11aa64768fd 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.f smithi039 running (100s) 6s ago 99s 17.6M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 9821f6d7045d 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.g smithi012 running (86s) 6s ago 86s 13.8M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 81c1d4be3947 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.h smithi032 running (93s) 6s ago 93s 18.5M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 f98334d9c5ea 2023-12-11T20:15:06.362 INFO:teuthology.orchestra.run.smithi012.stdout:mds.i smithi039 running (90s) 6s ago 89s 18.5M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 071a91142e4c 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mds.j smithi012 running (110s) 6s ago 109s 14.0M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 9383ad220e42 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mds.k smithi032 running (113s) 6s ago 112s 13.9M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 8f057dada619 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mds.l smithi039 running (116s) 6s ago 116s 14.0M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 a24cec9edceb 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi012 *:9283,8765 running (9m) 6s ago 9m 532M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 c9a94701935a 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi032 *:8443,8765 running (7m) 6s ago 7m 453M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 76487194e7c4 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.z smithi039 *:8443,8765 running (7m) 6s ago 7m 453M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 132abf5df346 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (9m) 6s ago 10m 99.5M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a0d27fe7a478 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi032 running (8m) 6s ago 8m 66.2M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 c48e67637911 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi039 running (8m) 6s ago 8m 64.5M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 ce8243392c3e 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (7m) 6s ago 7m 71.4M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 0e1914fb6a6f 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi032 running (6m) 6s ago 6m 75.6M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 b6488e590bf9 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi039 running (6m) 6s ago 6m 71.8M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 be0db2e0e551 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (5m) 6s ago 5m 61.7M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 6aa536da6678 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi032 running (5m) 6s ago 5m 61.7M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 e0e7916f4e99 2023-12-11T20:15:06.363 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi039 running (5m) 6s ago 5m 65.5M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 279ac96482d9 2023-12-11T20:15:06.364 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi012 running (4m) 6s ago 4m 58.8M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 6750720ac55c 2023-12-11T20:15:06.364 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi032 running (4m) 6s ago 4m 62.9M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 91d640dd233c 2023-12-11T20:15:06.364 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 smithi039 running (3m) 6s ago 3m 61.4M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 b25346dad347 2023-12-11T20:15:06.364 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 smithi012 running (3m) 6s ago 3m 54.8M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 e2606bc83274 2023-12-11T20:15:06.364 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 smithi032 running (2m) 6s ago 2m 60.9M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 ce5cb7daf9e5 2023-12-11T20:15:06.364 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 smithi039 running (2m) 6s ago 2m 51.8M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 4cac6209c502 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77340a1500 msgr2=0x7f77340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77340a1500 0x7f77340a39c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f774c102680 tx=0x7f773c009260 comp rx=0 tx=0).stop 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 msgr2=0x7f774c199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 0x7f774c199c00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7740009fd0 tx=0x7f774000f690 comp rx=0 tx=0).stop 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 shutdown_connections 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77340a1500 0x7f77340a39c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f774c101620 0x7f774c1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f774c1031c0 0x7f774c1a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 --2- 172.21.15.12:0/2965239800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f774c102820 0x7f774c199c00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:06.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 >> 172.21.15.12:0/2965239800 conn(0x7f774c0fcbe0 msgr2=0x7f774c108090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:06.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.365+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 shutdown_connections 2023-12-11T20:15:06.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:06.366+0000 7f77529f0700 1 -- 172.21.15.12:0/2965239800 wait complete. 2023-12-11T20:15:06.387 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:06 smithi012 ceph-mon[128787]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-11T20:15:06.387 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:06 smithi012 ceph-mon[128787]: osdmap e89: 12 total, 12 up, 12 in 2023-12-11T20:15:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:06 smithi032 ceph-mon[132488]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-11T20:15:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:06 smithi032 ceph-mon[132488]: osdmap e89: 12 total, 12 up, 12 in 2023-12-11T20:15:06.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:06 smithi039 ceph-mon[102205]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-12-11T20:15:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:06 smithi039 ceph-mon[102205]: osdmap e89: 12 total, 12 up, 12 in 2023-12-11T20:15:06.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-11T20:15:07.649 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:15:08.177 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:08 smithi012 ceph-mon[128787]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:08.178 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:08 smithi012 ceph-mon[128787]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 7 op/s 2023-12-11T20:15:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:08 smithi032 ceph-mon[132488]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:08 smithi032 ceph-mon[132488]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 7 op/s 2023-12-11T20:15:08.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:08 smithi039 ceph-mon[102205]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:08.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:08 smithi039 ceph-mon[102205]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 7 op/s 2023-12-11T20:15:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.187+0000 7f06a325d700 1 -- 172.21.15.12:0/1023616744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c1049d0 msgr2=0x7f069c106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.187+0000 7f06a325d700 1 --2- 172.21.15.12:0/1023616744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c1049d0 0x7f069c106dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0688009990 tx=0x7f0688009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.187+0000 7f06a325d700 1 -- 172.21.15.12:0/1023616744 shutdown_connections 2023-12-11T20:15:09.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.187+0000 7f06a325d700 1 --2- 172.21.15.12:0/1023616744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f069c1020a0 0x7f069c104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.187+0000 7f06a325d700 1 --2- 172.21.15.12:0/1023616744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f069c107300 0x7f069c109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.187+0000 7f06a325d700 1 --2- 172.21.15.12:0/1023616744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c1049d0 0x7f069c106dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.187+0000 7f06a325d700 1 -- 172.21.15.12:0/1023616744 >> 172.21.15.12:0/1023616744 conn(0x7f069c0fbad0 msgr2=0x7f069c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:09.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.188+0000 7f06a325d700 1 -- 172.21.15.12:0/1023616744 shutdown_connections 2023-12-11T20:15:09.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.188+0000 7f06a325d700 1 -- 172.21.15.12:0/1023616744 wait complete. 2023-12-11T20:15:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.189+0000 7f06a325d700 1 Processor -- start 2023-12-11T20:15:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.189+0000 7f06a325d700 1 -- start start 2023-12-11T20:15:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.189+0000 7f06a325d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f069c1020a0 0x7f069c197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.189+0000 7f06a325d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f069c1049d0 0x7f069c1979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.189+0000 7f06a325d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c107300 0x7f069c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.189+0000 7f06a325d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c19efd0 con 0x7f069c107300 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.189+0000 7f06a325d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c19f110 con 0x7f069c1020a0 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.189+0000 7f06a325d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c19f2a0 con 0x7f069c1049d0 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c107300 0x7f069c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c107300 0x7f069c19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49332/0 (socket says 172.21.15.12:49332) 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 -- 172.21.15.12:0/259241899 learned_addr learned my addr 172.21.15.12:0/259241899 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a0ff9700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f069c1020a0 0x7f069c197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f069bfff700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f069c1049d0 0x7f069c1979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 -- 172.21.15.12:0/259241899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f069c1049d0 msgr2=0x7f069c1979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f069c1049d0 0x7f069c1979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 -- 172.21.15.12:0/259241899 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f069c1020a0 msgr2=0x7f069c197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f069c1020a0 0x7f069c197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 -- 172.21.15.12:0/259241899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06880095f0 con 0x7f069c107300 2023-12-11T20:15:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f06a17fa700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c107300 0x7f069c19ea00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0694007ee0 tx=0x7f069400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.190+0000 7f0699ffb700 1 -- 172.21.15.12:0/259241899 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694004db0 con 0x7f069c107300 2023-12-11T20:15:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.191+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c19f580 con 0x7f069c107300 2023-12-11T20:15:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.191+0000 7f0699ffb700 1 -- 172.21.15.12:0/259241899 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f069400f040 con 0x7f069c107300 2023-12-11T20:15:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.191+0000 7f0699ffb700 1 -- 172.21.15.12:0/259241899 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694005800 con 0x7f069c107300 2023-12-11T20:15:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.191+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c19fa30 con 0x7f069c107300 2023-12-11T20:15:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.192+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c0fd650 con 0x7f069c107300 2023-12-11T20:15:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.194+0000 7f0699ffb700 1 -- 172.21.15.12:0/259241899 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f069400db20 con 0x7f069c107300 2023-12-11T20:15:09.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.195+0000 7f0699ffb700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f068c0a1480 0x7f068c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:09.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.195+0000 7f0699ffb700 1 -- 172.21.15.12:0/259241899 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f06940cc790 con 0x7f069c107300 2023-12-11T20:15:09.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.195+0000 7f06a0ff9700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f068c0a1480 0x7f068c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:09.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.196+0000 7f06a0ff9700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f068c0a1480 0x7f068c0a3940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0690005950 tx=0x7f069000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.199+0000 7f0699ffb700 1 -- 172.21.15.12:0/259241899 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f069404f2f0 con 0x7f069c107300 2023-12-11T20:15:09.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.418+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f069c061a10 con 0x7f068c0a1480 2023-12-11T20:15:09.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.425+0000 7f0699ffb700 1 -- 172.21.15.12:0/259241899 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f069c061a10 con 0x7f068c0a1480 2023-12-11T20:15:09.424 INFO:teuthology.orchestra.run.smithi012.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-11T20:15:09.424 INFO:teuthology.orchestra.run.smithi012.stdout:mds.all 12/12 10s ago 2m smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi032=b;smithi032=e;smithi032=h;smithi032=k;smithi039=c;smithi039=f;smithi039=i;smithi039=l;count:12 2023-12-11T20:15:09.424 INFO:teuthology.orchestra.run.smithi012.stdout:mgr 3/3 10s ago 7m smithi012=x;smithi032=y;smithi039=z;count:3 2023-12-11T20:15:09.424 INFO:teuthology.orchestra.run.smithi012.stdout:mon 3/3 10s ago 8m smithi012:172.21.15.12=a;smithi032:172.21.15.32=b;smithi039:172.21.15.39=c;count:3 2023-12-11T20:15:09.424 INFO:teuthology.orchestra.run.smithi012.stdout:osd 12 10s ago - 2023-12-11T20:15:09.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f068c0a1480 msgr2=0x7f068c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f068c0a1480 0x7f068c0a3940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0690005950 tx=0x7f069000b410 comp rx=0 tx=0).stop 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c107300 msgr2=0x7f069c19ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c107300 0x7f069c19ea00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0694007ee0 tx=0x7f069400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 shutdown_connections 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f068c0a1480 0x7f068c0a3940 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f069c1020a0 0x7f069c197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f069c107300 0x7f069c19ea00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 --2- 172.21.15.12:0/259241899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f069c1049d0 0x7f069c1979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 >> 172.21.15.12:0/259241899 conn(0x7f069c0fbad0 msgr2=0x7f069c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:09.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 shutdown_connections 2023-12-11T20:15:09.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:09.427+0000 7f06a325d700 1 -- 172.21.15.12:0/259241899 wait complete. 2023-12-11T20:15:09.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:09 smithi039 ceph-mon[102205]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s 2023-12-11T20:15:09.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:09 smithi012 ceph-mon[128787]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s 2023-12-11T20:15:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:09 smithi032 ceph-mon[132488]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s 2023-12-11T20:15:09.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-11T20:15:10.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:10 smithi039 ceph-mon[102205]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:10.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:10 smithi012 ceph-mon[128787]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:10.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:10 smithi032 ceph-mon[132488]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:10.725 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:15:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:11 smithi039 ceph-mon[102205]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s 2023-12-11T20:15:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:11 smithi012 ceph-mon[128787]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s 2023-12-11T20:15:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:11 smithi032 ceph-mon[132488]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s 2023-12-11T20:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.161+0000 7f83b5308700 1 -- 172.21.15.12:0/1088840565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0102820 msgr2=0x7f83b0102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.161+0000 7f83b5308700 1 --2- 172.21.15.12:0/1088840565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0102820 0x7f83b0102c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f83a40099c0 tx=0x7f83a4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.162+0000 7f83b5308700 1 -- 172.21.15.12:0/1088840565 shutdown_connections 2023-12-11T20:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.162+0000 7f83b5308700 1 --2- 172.21.15.12:0/1088840565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b01031c0 0x7f83b0109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.162+0000 7f83b5308700 1 --2- 172.21.15.12:0/1088840565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b0101620 0x7f83b0101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.162+0000 7f83b5308700 1 --2- 172.21.15.12:0/1088840565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0102820 0x7f83b0102c80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.162+0000 7f83b5308700 1 -- 172.21.15.12:0/1088840565 >> 172.21.15.12:0/1088840565 conn(0x7f83b00fcbe0 msgr2=0x7f83b00ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.162+0000 7f83b5308700 1 -- 172.21.15.12:0/1088840565 shutdown_connections 2023-12-11T20:15:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.162+0000 7f83b5308700 1 -- 172.21.15.12:0/1088840565 wait complete. 2023-12-11T20:15:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.163+0000 7f83b5308700 1 Processor -- start 2023-12-11T20:15:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.163+0000 7f83b5308700 1 -- start start 2023-12-11T20:15:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.163+0000 7f83b5308700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0101620 0x7f83b0199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.163+0000 7f83b5308700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b0102820 0x7f83b0199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83b5308700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b01031c0 0x7f83b01a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83b5308700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01a1220 con 0x7f83b0101620 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83b5308700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01a1360 con 0x7f83b0102820 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83b5308700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01a14f0 con 0x7f83b01031c0 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0101620 0x7f83b0199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0101620 0x7f83b0199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49350/0 (socket says 172.21.15.12:49350) 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 -- 172.21.15.12:0/1571573630 learned_addr learned my addr 172.21.15.12:0/1571573630 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83af7fe700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b01031c0 0x7f83b01a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83ae7fc700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b0102820 0x7f83b0199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 -- 172.21.15.12:0/1571573630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b01031c0 msgr2=0x7f83b01a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b01031c0 0x7f83b01a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 -- 172.21.15.12:0/1571573630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b0102820 msgr2=0x7f83b0199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b0102820 0x7f83b0199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 -- 172.21.15.12:0/1571573630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40095f0 con 0x7f83b0101620 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83ae7fc700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b0102820 0x7f83b0199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.164+0000 7f83aeffd700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0101620 0x7f83b0199730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83a000d9b0 tx=0x7f83a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.165+0000 7f8397fff700 1 -- 172.21.15.12:0/1571573630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0004020 con 0x7f83b0101620 2023-12-11T20:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.165+0000 7f8397fff700 1 -- 172.21.15.12:0/1571573630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a0009730 con 0x7f83b0101620 2023-12-11T20:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.165+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b01a17d0 con 0x7f83b0101620 2023-12-11T20:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.165+0000 7f8397fff700 1 -- 172.21.15.12:0/1571573630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00039c0 con 0x7f83b0101620 2023-12-11T20:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.165+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b01a1cd0 con 0x7f83b0101620 2023-12-11T20:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.166+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b004f290 con 0x7f83b0101620 2023-12-11T20:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.168+0000 7f8397fff700 1 -- 172.21.15.12:0/1571573630 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f83a00098a0 con 0x7f83b0101620 2023-12-11T20:15:12.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.169+0000 7f8397fff700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83980a1480 0x7f83980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:12.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.169+0000 7f8397fff700 1 -- 172.21.15.12:0/1571573630 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f83a00ccaa0 con 0x7f83b0101620 2023-12-11T20:15:12.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.170+0000 7f83ae7fc700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83980a1480 0x7f83980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:12.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.170+0000 7f83ae7fc700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83980a1480 0x7f83980a3940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c010 tx=0x7f83a4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:12.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.173+0000 7f8397fff700 1 -- 172.21.15.12:0/1571573630 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f83a0096050 con 0x7f83b0101620 2023-12-11T20:15:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.392+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f83b0074f20 con 0x7f83980a1480 2023-12-11T20:15:12.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.394+0000 7f8397fff700 1 -- 172.21.15.12:0/1571573630 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+187 (secure 0 0 0) 0x7f83b0074f20 con 0x7f83980a1480 2023-12-11T20:15:12.393 INFO:teuthology.orchestra.run.smithi012.stdout:HOST ADDR LABELS STATUS 2023-12-11T20:15:12.393 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 172.21.15.12 2023-12-11T20:15:12.393 INFO:teuthology.orchestra.run.smithi012.stdout:smithi032 172.21.15.32 2023-12-11T20:15:12.393 INFO:teuthology.orchestra.run.smithi012.stdout:smithi039 172.21.15.39 2023-12-11T20:15:12.393 INFO:teuthology.orchestra.run.smithi012.stdout:3 hosts in cluster 2023-12-11T20:15:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83980a1480 msgr2=0x7f83980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83980a1480 0x7f83980a3940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c010 tx=0x7f83a4005fb0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0101620 msgr2=0x7f83b0199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0101620 0x7f83b0199730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83a000d9b0 tx=0x7f83a000dcc0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 shutdown_connections 2023-12-11T20:15:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f83980a1480 0x7f83980a3940 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b01031c0 0x7f83b01a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83b0101620 0x7f83b0199730 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 --2- 172.21.15.12:0/1571573630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83b0102820 0x7f83b0199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 >> 172.21.15.12:0/1571573630 conn(0x7f83b00fcbe0 msgr2=0x7f83b0073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.396+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 shutdown_connections 2023-12-11T20:15:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:12.397+0000 7f83b5308700 1 -- 172.21.15.12:0/1571573630 wait complete. 2023-12-11T20:15:12.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-11T20:15:13.616 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:15:14.194 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:14 smithi012 ceph-mon[128787]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:14.194 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:14 smithi012 ceph-mon[128787]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 700 B/s wr, 7 op/s 2023-12-11T20:15:14.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:14 smithi032 ceph-mon[132488]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:14 smithi032 ceph-mon[132488]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 700 B/s wr, 7 op/s 2023-12-11T20:15:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:14 smithi039 ceph-mon[102205]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:14 smithi039 ceph-mon[102205]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 700 B/s wr, 7 op/s 2023-12-11T20:15:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 -- 172.21.15.12:0/476501813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c801031c0 msgr2=0x7f3c80109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 --2- 172.21.15.12:0/476501813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c801031c0 0x7f3c80109a70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800b0d0 tx=0x7f3c7800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 -- 172.21.15.12:0/476501813 shutdown_connections 2023-12-11T20:15:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 --2- 172.21.15.12:0/476501813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c801031c0 0x7f3c80109a70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 --2- 172.21.15.12:0/476501813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c80101620 0x7f3c80101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 --2- 172.21.15.12:0/476501813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c80102820 0x7f3c80102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 -- 172.21.15.12:0/476501813 >> 172.21.15.12:0/476501813 conn(0x7f3c800fcbe0 msgr2=0x7f3c800ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 -- 172.21.15.12:0/476501813 shutdown_connections 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.121+0000 7f3c8669b700 1 -- 172.21.15.12:0/476501813 wait complete. 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.122+0000 7f3c8669b700 1 Processor -- start 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c8669b700 1 -- start start 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c8669b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c80101620 0x7f3c801975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c8669b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c80102820 0x7f3c80197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c8669b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c801031c0 0x7f3c8019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c8669b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8019f0c0 con 0x7f3c80101620 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c8669b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8019f200 con 0x7f3c80102820 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c8669b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8019f390 con 0x7f3c801031c0 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c80101620 0x7f3c801975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c80101620 0x7f3c801975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49362/0 (socket says 172.21.15.12:49362) 2023-12-11T20:15:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c7ffff700 1 -- 172.21.15.12:0/772896465 learned_addr learned my addr 172.21.15.12:0/772896465 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c84c38700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c801031c0 0x7f3c8019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c7f7fe700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c80102820 0x7f3c80197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c7ffff700 1 -- 172.21.15.12:0/772896465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c801031c0 msgr2=0x7f3c8019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.123+0000 7f3c7ffff700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c801031c0 0x7f3c8019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c7ffff700 1 -- 172.21.15.12:0/772896465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c80102820 msgr2=0x7f3c80197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c7ffff700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c80102820 0x7f3c80197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c7ffff700 1 -- 172.21.15.12:0/772896465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009d00 con 0x7f3c80101620 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c7f7fe700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c80102820 0x7f3c80197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c7ffff700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c80101620 0x7f3c801975d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000d9b0 tx=0x7f3c7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c7d7fa700 1 -- 172.21.15.12:0/772896465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70004020 con 0x7f3c80101620 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c7d7fa700 1 -- 172.21.15.12:0/772896465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c70009730 con 0x7f3c80101620 2023-12-11T20:15:15.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8019f670 con 0x7f3c80101620 2023-12-11T20:15:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c7d7fa700 1 -- 172.21.15.12:0/772896465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c700039c0 con 0x7f3c80101620 2023-12-11T20:15:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.124+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8019fb70 con 0x7f3c80101620 2023-12-11T20:15:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.125+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c80108b00 con 0x7f3c80101620 2023-12-11T20:15:15.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.127+0000 7f3c7d7fa700 1 -- 172.21.15.12:0/772896465 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3c700098a0 con 0x7f3c80101620 2023-12-11T20:15:15.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.129+0000 7f3c7d7fa700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c680a1480 0x7f3c680a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:15.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.129+0000 7f3c7d7fa700 1 -- 172.21.15.12:0/772896465 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3c700ccaa0 con 0x7f3c80101620 2023-12-11T20:15:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.129+0000 7f3c7f7fe700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c680a1480 0x7f3c680a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.129+0000 7f3c7f7fe700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c680a1480 0x7f3c680a3940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c74005fd0 tx=0x7f3c74005ee0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:15.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.133+0000 7f3c7d7fa700 1 -- 172.21.15.12:0/772896465 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3c70096050 con 0x7f3c80101620 2023-12-11T20:15:15.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.352+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c8002d380 con 0x7f3c680a1480 2023-12-11T20:15:15.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.354+0000 7f3c7d7fa700 1 -- 172.21.15.12:0/772896465 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f3c8002d380 con 0x7f3c680a1480 2023-12-11T20:15:15.353 INFO:teuthology.orchestra.run.smithi012.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-11T20:15:15.353 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005J400BGN 372G No 3m ago Has a FileSystem, LVM detected 2023-12-11T20:15:15.353 INFO:teuthology.orchestra.run.smithi012.stdout:smithi032 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402DN480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-12-11T20:15:15.353 INFO:teuthology.orchestra.run.smithi012.stdout:smithi039 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN 3726G No 2m ago Has a FileSystem, LVM detected 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c680a1480 msgr2=0x7f3c680a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c680a1480 0x7f3c680a3940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c74005fd0 tx=0x7f3c74005ee0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c80101620 msgr2=0x7f3c801975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c80101620 0x7f3c801975d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000d9b0 tx=0x7f3c7000dcc0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 shutdown_connections 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c680a1480 0x7f3c680a3940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c801031c0 0x7f3c8019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c80101620 0x7f3c801975d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 --2- 172.21.15.12:0/772896465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c80102820 0x7f3c80197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 >> 172.21.15.12:0/772896465 conn(0x7f3c800fcbe0 msgr2=0x7f3c80105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:15.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 shutdown_connections 2023-12-11T20:15:15.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:15.357+0000 7f3c8669b700 1 -- 172.21.15.12:0/772896465 wait complete. 2023-12-11T20:15:15.811 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-11T20:15:15.821 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2023-12-11T20:15:15.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-11T20:15:16.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:16 smithi032 ceph-mon[132488]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2023-12-11T20:15:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:16 smithi039 ceph-mon[102205]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2023-12-11T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:16 smithi012 ceph-mon[128787]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2023-12-11T20:15:16.612 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:15:17.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:17 smithi012 ceph-mon[128787]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:17 smithi032 ceph-mon[132488]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:17 smithi039 ceph-mon[102205]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1578564314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea81031c0 msgr2=0x7f3ea8109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1578564314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea81031c0 0x7f3ea8109a70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000b0d0 tx=0x7f3ea000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1578564314 shutdown_connections 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1578564314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ea8101620 0x7f3ea8101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1578564314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea81031c0 0x7f3ea8109a70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1578564314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea8102820 0x7f3ea8102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1578564314 >> 172.21.15.12:0/1578564314 conn(0x7f3ea80fcbe0 msgr2=0x7f3ea80ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1578564314 shutdown_connections 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.028+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1578564314 wait complete. 2023-12-11T20:15:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.029+0000 7f3eac9ef700 1 Processor -- start 2023-12-11T20:15:18.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.029+0000 7f3eac9ef700 1 -- start start 2023-12-11T20:15:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.029+0000 7f3eac9ef700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea8101620 0x7f3ea8075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.029+0000 7f3eac9ef700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea8102820 0x7f3ea80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.029+0000 7f3eac9ef700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ea81031c0 0x7f3ea8073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.029+0000 7f3eac9ef700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80746a0 con 0x7f3ea8101620 2023-12-11T20:15:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.029+0000 7f3eac9ef700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea8074810 con 0x7f3ea81031c0 2023-12-11T20:15:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.029+0000 7f3eac9ef700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea81a1570 con 0x7f3ea8102820 2023-12-11T20:15:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea8101620 0x7f3ea8075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea8101620 0x7f3ea8075320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49370/0 (socket says 172.21.15.12:49370) 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 -- 172.21.15.12:0/1661922686 learned_addr learned my addr 172.21.15.12:0/1661922686 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea5d9b700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea8102820 0x7f3ea80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea6d9d700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ea81031c0 0x7f3ea8073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 -- 172.21.15.12:0/1661922686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea8102820 msgr2=0x7f3ea80739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea8102820 0x7f3ea80739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 -- 172.21.15.12:0/1661922686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ea81031c0 msgr2=0x7f3ea8073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ea81031c0 0x7f3ea8073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 -- 172.21.15.12:0/1661922686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0009d00 con 0x7f3ea8101620 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3ea659c700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea8101620 0x7f3ea8075320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800e970 tx=0x7f3e9800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.030+0000 7f3e977fe700 1 -- 172.21.15.12:0/1661922686 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98009790 con 0x7f3ea8101620 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.031+0000 7f3e977fe700 1 -- 172.21.15.12:0/1661922686 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e9800eec0 con 0x7f3ea8101620 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.031+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea81a1800 con 0x7f3ea8101620 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.031+0000 7f3e977fe700 1 -- 172.21.15.12:0/1661922686 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98003c10 con 0x7f3ea8101620 2023-12-11T20:15:18.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.031+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea81a1d00 con 0x7f3ea8101620 2023-12-11T20:15:18.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.032+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea8108a80 con 0x7f3ea8101620 2023-12-11T20:15:18.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.034+0000 7f3e977fe700 1 -- 172.21.15.12:0/1661922686 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3e98003db0 con 0x7f3ea8101620 2023-12-11T20:15:18.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.035+0000 7f3e977fe700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e900a1480 0x7f3e900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:18.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.035+0000 7f3e977fe700 1 -- 172.21.15.12:0/1661922686 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3e98014070 con 0x7f3ea8101620 2023-12-11T20:15:18.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.035+0000 7f3ea5d9b700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e900a1480 0x7f3e900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:18.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.036+0000 7f3ea5d9b700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e900a1480 0x7f3e900a3940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009c60 tx=0x7f3e9c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:18.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.039+0000 7f3e977fe700 1 -- 172.21.15.12:0/1661922686 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3e980965c0 con 0x7f3ea8101620 2023-12-11T20:15:18.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.297+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ea804f290 con 0x7f3ea8101620 2023-12-11T20:15:18.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.298+0000 7f3e977fe700 1 -- 172.21.15.12:0/1661922686 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+2931 (secure 0 0 0) 0x7f3e98099be0 con 0x7f3ea8101620 2023-12-11T20:15:18.297 INFO:teuthology.orchestra.run.smithi012.stdout:e22 2023-12-11T20:15:18.297 INFO:teuthology.orchestra.run.smithi012.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-11T20:15:18.297 INFO:teuthology.orchestra.run.smithi012.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-11T20:15:18.297 INFO:teuthology.orchestra.run.smithi012.stdout:legacy client fscid: 1 2023-12-11T20:15:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:Filesystem 'cephfs' (1) 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:fs_name cephfs 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 22 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:created 2023-12-11T20:13:53.009335+0000 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2023-12-11T20:13:58.248579+0000 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:tableserver 0 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:root 0 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:session_timeout 300 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:session_autoclose 300 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:max_file_size 1099511627776 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:max_xattr_size 65536 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:required_client_features {} 2023-12-11T20:15:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure 0 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure_osd_epoch 0 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:max_mds 3 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:in 0,1,2 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:up {0=24620,1=24577,2=24566} 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:failed 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:damaged 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:stopped 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:data_pools [3] 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:metadata_pool 2 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:inline_data disabled 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:balancer 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:bal_rank_mask -1 2023-12-11T20:15:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:standby_count_wanted 0 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b{0:24620} state up:active seq 3 addr [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c{0:24553} state up:standby-replay seq 1 addr [v2:172.21.15.39:6836/2148366648,v1:172.21.15.39:6837/2148366648] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.i{1:24577} state up:active seq 6 addr [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f{1:24541} state up:standby-replay seq 1 addr [v2:172.21.15.39:6834/2029236451,v1:172.21.15.39:6835/2029236451] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.h{2:24566} state up:active seq 8 addr [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e{2:24530} state up:standby-replay seq 1 addr [v2:172.21.15.32:6834/1999108930,v1:172.21.15.32:6835/1999108930] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:Standby daemons: 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.j{-1:14607} state up:standby seq 1 addr [v2:172.21.15.12:6834/1084131113,v1:172.21.15.12:6835/1084131113] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d{-1:14619} state up:standby seq 1 addr [v2:172.21.15.12:6836/1410309441,v1:172.21.15.12:6837/1410309441] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.g{-1:14703} state up:standby seq 1 addr [v2:172.21.15.12:6838/3831802568,v1:172.21.15.12:6839/3831802568] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a{-1:14715} state up:standby seq 1 addr [v2:172.21.15.12:6840/3948008588,v1:172.21.15.12:6841/3948008588] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.301 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.l{-1:24475} state up:standby seq 1 addr [v2:172.21.15.39:6832/3471280196,v1:172.21.15.39:6833/3471280196] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.301 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.k{-1:24503} state up:standby seq 1 addr [v2:172.21.15.32:6832/2096200170,v1:172.21.15.32:6833/2096200170] compat {c=[1],r=[1],i=[fff]}] 2023-12-11T20:15:18.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e900a1480 msgr2=0x7f3e900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:18.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e900a1480 0x7f3e900a3940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009c60 tx=0x7f3e9c009260 comp rx=0 tx=0).stop 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea8101620 msgr2=0x7f3ea8075320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea8101620 0x7f3ea8075320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800e970 tx=0x7f3e9800ec80 comp rx=0 tx=0).stop 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 shutdown_connections 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e900a1480 0x7f3e900a3940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ea81031c0 0x7f3ea8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ea8101620 0x7f3ea8075320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 --2- 172.21.15.12:0/1661922686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea8102820 0x7f3ea80739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.300+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 >> 172.21.15.12:0/1661922686 conn(0x7f3ea80fcbe0 msgr2=0x7f3ea8105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.301+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 shutdown_connections 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:18.301+0000 7f3eac9ef700 1 -- 172.21.15.12:0/1661922686 wait complete. 2023-12-11T20:15:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:15:18.442 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:18 smithi012 ceph-mon[128787]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 521 B/s wr, 7 op/s 2023-12-11T20:15:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:18 smithi032 ceph-mon[132488]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 521 B/s wr, 7 op/s 2023-12-11T20:15:18.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:18 smithi039 ceph-mon[102205]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 521 B/s wr, 7 op/s 2023-12-11T20:15:18.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- bash -c 'ceph osd dump' 2023-12-11T20:15:19.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:19 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1661922686' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-11T20:15:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:19 smithi039 ceph-mon[102205]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2023-12-11T20:15:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:19 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1661922686' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-11T20:15:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:19 smithi012 ceph-mon[128787]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2023-12-11T20:15:19.595 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:15:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:19 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1661922686' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-11T20:15:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:19 smithi032 ceph-mon[132488]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.119+0000 7faf64621700 1 -- 172.21.15.12:0/2924209823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c101620 msgr2=0x7faf5c101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.119+0000 7faf64621700 1 --2- 172.21.15.12:0/2924209823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c101620 0x7faf5c101a40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faf580099c0 tx=0x7faf58009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.120+0000 7faf64621700 1 -- 172.21.15.12:0/2924209823 shutdown_connections 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.120+0000 7faf64621700 1 --2- 172.21.15.12:0/2924209823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf5c1031c0 0x7faf5c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.120+0000 7faf64621700 1 --2- 172.21.15.12:0/2924209823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c101620 0x7faf5c101a40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.120+0000 7faf64621700 1 --2- 172.21.15.12:0/2924209823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf5c102820 0x7faf5c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.120+0000 7faf64621700 1 -- 172.21.15.12:0/2924209823 >> 172.21.15.12:0/2924209823 conn(0x7faf5c0fcbe0 msgr2=0x7faf5c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.120+0000 7faf64621700 1 -- 172.21.15.12:0/2924209823 shutdown_connections 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.120+0000 7faf64621700 1 -- 172.21.15.12:0/2924209823 wait complete. 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf64621700 1 Processor -- start 2023-12-11T20:15:21.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf64621700 1 -- start start 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf64621700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf5c101620 0x7faf5c075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf64621700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf5c102820 0x7faf5c0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf64621700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c1031c0 0x7faf5c073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf64621700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0746a0 con 0x7faf5c1031c0 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf64621700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c074810 con 0x7faf5c102820 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf64621700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c1a1540 con 0x7faf5c101620 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.121+0000 7faf62bbe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c1031c0 0x7faf5c073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf62bbe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c1031c0 0x7faf5c073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37808/0 (socket says 172.21.15.12:37808) 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf62bbe700 1 -- 172.21.15.12:0/3901193770 learned_addr learned my addr 172.21.15.12:0/3901193770 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf61bbc700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf5c102820 0x7faf5c0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf623bd700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf5c101620 0x7faf5c075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf62bbe700 1 -- 172.21.15.12:0/3901193770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf5c101620 msgr2=0x7faf5c075320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf62bbe700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf5c101620 0x7faf5c075320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf62bbe700 1 -- 172.21.15.12:0/3901193770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf5c102820 msgr2=0x7faf5c0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf62bbe700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf5c102820 0x7faf5c0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf62bbe700 1 -- 172.21.15.12:0/3901193770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580095f0 con 0x7faf5c1031c0 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf623bd700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf5c101620 0x7faf5c075320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf62bbe700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c1031c0 0x7faf5c073f00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faf54007ee0 tx=0x7faf5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.122+0000 7faf537fe700 1 -- 172.21.15.12:0/3901193770 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54017070 con 0x7faf5c1031c0 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.123+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c1a17d0 con 0x7faf5c1031c0 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.123+0000 7faf537fe700 1 -- 172.21.15.12:0/3901193770 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf5400f040 con 0x7faf5c1031c0 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.123+0000 7faf537fe700 1 -- 172.21.15.12:0/3901193770 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54005710 con 0x7faf5c1031c0 2023-12-11T20:15:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.123+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c1a1c80 con 0x7faf5c1031c0 2023-12-11T20:15:21.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.124+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c108ba0 con 0x7faf5c1031c0 2023-12-11T20:15:21.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.126+0000 7faf537fe700 1 -- 172.21.15.12:0/3901193770 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7faf54005870 con 0x7faf5c1031c0 2023-12-11T20:15:21.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.127+0000 7faf537fe700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf480a1480 0x7faf480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:21.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.127+0000 7faf537fe700 1 -- 172.21.15.12:0/3901193770 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faf540cc560 con 0x7faf5c1031c0 2023-12-11T20:15:21.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.127+0000 7faf623bd700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf480a1480 0x7faf480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:21.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.128+0000 7faf623bd700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf480a1480 0x7faf480a3940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf58000c00 tx=0x7faf58005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:21.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.131+0000 7faf537fe700 1 -- 172.21.15.12:0/3901193770 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faf54095b70 con 0x7faf5c1031c0 2023-12-11T20:15:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.343+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7faf5c04f290 con 0x7faf5c1031c0 2023-12-11T20:15:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.344+0000 7faf537fe700 1 -- 172.21.15.12:0/3901193770 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) v1 ==== 56+0+5342 (secure 0 0 0) 0x7faf54099190 con 0x7faf5c1031c0 2023-12-11T20:15:21.342 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 89 2023-12-11T20:15:21.342 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:15:21.342 INFO:teuthology.orchestra.run.smithi012.stdout:created 2023-12-11T20:05:01.329428+0000 2023-12-11T20:15:21.342 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2023-12-11T20:15:05.279887+0000 2023-12-11T20:15:21.342 INFO:teuthology.orchestra.run.smithi012.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-12-11T20:15:21.343 INFO:teuthology.orchestra.run.smithi012.stdout:crush_version 26 2023-12-11T20:15:21.343 INFO:teuthology.orchestra.run.smithi012.stdout:full_ratio 0.95 2023-12-11T20:15:21.343 INFO:teuthology.orchestra.run.smithi012.stdout:backfillfull_ratio 0.9 2023-12-11T20:15:21.343 INFO:teuthology.orchestra.run.smithi012.stdout:nearfull_ratio 0.85 2023-12-11T20:15:21.343 INFO:teuthology.orchestra.run.smithi012.stdout:require_min_compat_client luminous 2023-12-11T20:15:21.343 INFO:teuthology.orchestra.run.smithi012.stdout:min_compat_client luminous 2023-12-11T20:15:21.343 INFO:teuthology.orchestra.run.smithi012.stdout:require_osd_release reef 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:stretch_mode_enabled false 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:max_osd 12 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 up in weight 1 up_from 8 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6802/3118387286,v1:172.21.15.12:6803/3118387286] [v2:172.21.15.12:6804/3118387286,v1:172.21.15.12:6805/3118387286] exists,up ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/1010988585,v1:172.21.15.32:6801/1010988585] [v2:172.21.15.32:6802/1010988585,v1:172.21.15.32:6803/1010988585] exists,up ced82c4f-0fb8-4d33-a889-952c83e51c99 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6800/2638974966,v1:172.21.15.39:6801/2638974966] [v2:172.21.15.39:6802/2638974966,v1:172.21.15.39:6803/2638974966] exists,up 447b88d3-b083-4d3e-aa61-1c9971321335 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6810/2780370696,v1:172.21.15.12:6811/2780370696] [v2:172.21.15.12:6812/2780370696,v1:172.21.15.12:6813/2780370696] exists,up f9e8e074-7466-40c2-8850-fa247fe45dc6 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 up in weight 1 up_from 33 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/773206736,v1:172.21.15.32:6809/773206736] [v2:172.21.15.32:6810/773206736,v1:172.21.15.32:6811/773206736] exists,up ee6f15ff-052e-4621-9d90-4d2e6790b314 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 up in weight 1 up_from 38 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6808/1408420882,v1:172.21.15.39:6809/1408420882] [v2:172.21.15.39:6810/1408420882,v1:172.21.15.39:6811/1408420882] exists,up 8a466cf2-6909-4fc8-8439-6b033c5e942f 2023-12-11T20:15:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 up in weight 1 up_from 46 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6818/1028787749,v1:172.21.15.12:6819/1028787749] [v2:172.21.15.12:6820/1028787749,v1:172.21.15.12:6821/1028787749] exists,up c12c5683-1166-46dc-8ae9-1acc04f75ac4 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 up in weight 1 up_from 51 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6816/1475605108,v1:172.21.15.32:6817/1475605108] [v2:172.21.15.32:6818/1475605108,v1:172.21.15.32:6819/1475605108] exists,up f81d15a2-358b-4de6-af22-fdb5476b625e 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 up in weight 1 up_from 59 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6816/2259242252,v1:172.21.15.39:6817/2259242252] [v2:172.21.15.39:6818/2259242252,v1:172.21.15.39:6819/2259242252] exists,up 2ac0416b-ec57-468d-8340-9732d86f108d 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 up in weight 1 up_from 67 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6826/3572865206,v1:172.21.15.12:6827/3572865206] [v2:172.21.15.12:6828/3572865206,v1:172.21.15.12:6829/3572865206] exists,up a1e53870-78e8-499e-8244-1415187611a3 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 up in weight 1 up_from 72 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/2249244334,v1:172.21.15.32:6825/2249244334] [v2:172.21.15.32:6826/2249244334,v1:172.21.15.32:6827/2249244334] exists,up 23a020ac-a8b6-4da5-91ce-9d9490d4594d 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 up in weight 1 up_from 80 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6824/1041735400,v1:172.21.15.39:6825/1041735400] [v2:172.21.15.39:6826/1041735400,v1:172.21.15.39:6827/1041735400] exists,up 0f0f6457-4ef9-495a-b399-8fdaf347f3c2 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.0 [8,4] 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.b [2,1] 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.16 [2,6] 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.18 [5,11] 2023-12-11T20:15:21.345 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1d [2,4,8,11] 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.c [5,8] 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.10 [5,9] 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.17 [4,6] 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.1d [4,8] 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.2c [4,9] 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.38 [3,9] 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/2124039140 expires 2023-12-12T20:06:02.927546+0000 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/3786645349 expires 2023-12-12T20:06:02.927546+0000 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/1214012838 expires 2023-12-12T20:05:33.970421+0000 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1620764312 expires 2023-12-12T20:05:33.970421+0000 2023-12-11T20:15:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/3786645349 expires 2023-12-12T20:06:02.927546+0000 2023-12-11T20:15:21.347 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/1214012838 expires 2023-12-12T20:05:33.970421+0000 2023-12-11T20:15:21.347 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1991414308 expires 2023-12-12T20:06:02.927546+0000 2023-12-11T20:15:21.347 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/4022688169 expires 2023-12-12T20:06:02.927546+0000 2023-12-11T20:15:21.347 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/3706548929 expires 2023-12-12T20:05:33.970421+0000 2023-12-11T20:15:21.347 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/3589244140 expires 2023-12-12T20:05:33.970421+0000 2023-12-11T20:15:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf480a1480 msgr2=0x7faf480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf480a1480 0x7faf480a3940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf58000c00 tx=0x7faf58005fb0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c1031c0 msgr2=0x7faf5c073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c1031c0 0x7faf5c073f00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faf54007ee0 tx=0x7faf5400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 shutdown_connections 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf480a1480 0x7faf480a3940 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf5c1031c0 0x7faf5c073f00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf5c101620 0x7faf5c075320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 --2- 172.21.15.12:0/3901193770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf5c102820 0x7faf5c0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.346+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 >> 172.21.15.12:0/3901193770 conn(0x7faf5c0fcbe0 msgr2=0x7faf5c105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.347+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 shutdown_connections 2023-12-11T20:15:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:21.347+0000 7faf64621700 1 -- 172.21.15.12:0/3901193770 wait complete. 2023-12-11T20:15:21.885 INFO:teuthology.run_tasks:Running task fs.ready... 2023-12-11T20:15:21.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:15:22.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 -- 172.21.15.12:0/838482917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41071f0 msgr2=0x7f52e4109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 --2- 172.21.15.12:0/838482917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41071f0 0x7f52e4109660 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00b0a0 tx=0x7f52dc00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 -- 172.21.15.12:0/838482917 shutdown_connections 2023-12-11T20:15:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 --2- 172.21.15.12:0/838482917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52e4101f90 0x7f52e4104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 --2- 172.21.15.12:0/838482917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41071f0 0x7f52e4109660 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 --2- 172.21.15.12:0/838482917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e41048c0 0x7f52e4106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 -- 172.21.15.12:0/838482917 >> 172.21.15.12:0/838482917 conn(0x7f52e40fb980 msgr2=0x7f52e40fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 -- 172.21.15.12:0/838482917 shutdown_connections 2023-12-11T20:15:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.112+0000 7f52e9fff700 1 -- 172.21.15.12:0/838482917 wait complete. 2023-12-11T20:15:22.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.113+0000 7f52e9fff700 1 Processor -- start 2023-12-11T20:15:22.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.113+0000 7f52e9fff700 1 -- start start 2023-12-11T20:15:22.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.113+0000 7f52e9fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e4101f90 0x7f52e41973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:22.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e9fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41048c0 0x7f52e41978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:22.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e9fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52e41071f0 0x7f52e419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e9fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e419eed0 con 0x7f52e41048c0 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e9fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e419f010 con 0x7f52e41071f0 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e9fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e419f1a0 con 0x7f52e4101f90 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41048c0 0x7f52e41978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41048c0 0x7f52e41978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37814/0 (socket says 172.21.15.12:37814) 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 -- 172.21.15.12:0/4251405182 learned_addr learned my addr 172.21.15.12:0/4251405182 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e3fff700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52e41071f0 0x7f52e419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e37fe700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e4101f90 0x7f52e41973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 -- 172.21.15.12:0/4251405182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e4101f90 msgr2=0x7f52e41973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e4101f90 0x7f52e41973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 -- 172.21.15.12:0/4251405182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52e41071f0 msgr2=0x7f52e419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52e41071f0 0x7f52e419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 -- 172.21.15.12:0/4251405182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc009d00 con 0x7f52e41048c0 2023-12-11T20:15:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.114+0000 7f52e2ffd700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41048c0 0x7f52e41978e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f52d800e9a0 tx=0x7f52d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.115+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4251405182 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8009790 con 0x7f52e41048c0 2023-12-11T20:15:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.115+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4251405182 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52d800cbd0 con 0x7f52e41048c0 2023-12-11T20:15:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.115+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e419f480 con 0x7f52e41048c0 2023-12-11T20:15:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.115+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4251405182 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8018680 con 0x7f52e41048c0 2023-12-11T20:15:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.115+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e419f9e0 con 0x7f52e41048c0 2023-12-11T20:15:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.116+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e40fd500 con 0x7f52e41048c0 2023-12-11T20:15:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.118+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4251405182 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f52d800cd40 con 0x7f52e41048c0 2023-12-11T20:15:22.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.120+0000 7f52e0ff9700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52cc0a1500 0x7f52cc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:22.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.120+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4251405182 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f52d8014070 con 0x7f52e41048c0 2023-12-11T20:15:22.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.120+0000 7f52e37fe700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52cc0a1500 0x7f52cc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:22.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.121+0000 7f52e37fe700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52cc0a1500 0x7f52cc0a39c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009bf0 tx=0x7f52d4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.124+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4251405182 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f52d80522f0 con 0x7f52e41048c0 2023-12-11T20:15:22.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.339+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52e4068330 con 0x7f52e41048c0 2023-12-11T20:15:22.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.340+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4251405182 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7f52d8096570 con 0x7f52e41048c0 2023-12-11T20:15:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:22.339 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52cc0a1500 msgr2=0x7f52cc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52cc0a1500 0x7f52cc0a39c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009bf0 tx=0x7f52d4009260 comp rx=0 tx=0).stop 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41048c0 msgr2=0x7f52e41978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41048c0 0x7f52e41978e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f52d800e9a0 tx=0x7f52d800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 shutdown_connections 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52cc0a1500 0x7f52cc0a39c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52e41071f0 0x7f52e419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52e4101f90 0x7f52e41973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 --2- 172.21.15.12:0/4251405182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e41048c0 0x7f52e41978e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 >> 172.21.15.12:0/4251405182 conn(0x7f52e40fb980 msgr2=0x7f52e41028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:22.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 shutdown_connections 2023-12-11T20:15:22.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.343+0000 7f52e9fff700 1 -- 172.21.15.12:0/4251405182 wait complete. 2023-12-11T20:15:22.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:22 smithi012 ceph-mon[128787]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-11T20:15:22.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:22 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3901193770' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-11T20:15:22.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:15:22.362 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:15:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:22 smithi032 ceph-mon[132488]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-11T20:15:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:22 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3901193770' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-11T20:15:22.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:22 smithi039 ceph-mon[102205]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-11T20:15:22.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:22 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3901193770' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-11T20:15:22.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 -- 172.21.15.12:0/1726464547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 msgr2=0x7fcc6c102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1726464547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 0x7fcc6c102b00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcc600099c0 tx=0x7fcc60009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 -- 172.21.15.12:0/1726464547 shutdown_connections 2023-12-11T20:15:22.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1726464547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc6c103040 0x7fcc6c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1726464547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc6c1014b0 0x7fcc6c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1726464547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 0x7fcc6c102b00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 -- 172.21.15.12:0/1726464547 >> 172.21.15.12:0/1726464547 conn(0x7fcc6c0fca00 msgr2=0x7fcc6c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 -- 172.21.15.12:0/1726464547 shutdown_connections 2023-12-11T20:15:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.572+0000 7fcc71fff700 1 -- 172.21.15.12:0/1726464547 wait complete. 2023-12-11T20:15:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.573+0000 7fcc71fff700 1 Processor -- start 2023-12-11T20:15:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.573+0000 7fcc71fff700 1 -- start start 2023-12-11T20:15:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.573+0000 7fcc71fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc6c1014b0 0x7fcc6c197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc71fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 0x7fcc6c1978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc71fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc6c103040 0x7fcc6c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc71fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c19eea0 con 0x7fcc6c1026a0 2023-12-11T20:15:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc71fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c19efe0 con 0x7fcc6c103040 2023-12-11T20:15:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc71fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c19f170 con 0x7fcc6c1014b0 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 0x7fcc6c1978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 0x7fcc6c1978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37834/0 (socket says 172.21.15.12:37834) 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6affd700 1 -- 172.21.15.12:0/1585237787 learned_addr learned my addr 172.21.15.12:0/1585237787 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6b7fe700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc6c1014b0 0x7fcc6c197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6bfff700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc6c103040 0x7fcc6c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6affd700 1 -- 172.21.15.12:0/1585237787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc6c1014b0 msgr2=0x7fcc6c197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6affd700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc6c1014b0 0x7fcc6c197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6affd700 1 -- 172.21.15.12:0/1585237787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc6c103040 msgr2=0x7fcc6c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6affd700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc6c103040 0x7fcc6c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.574+0000 7fcc6affd700 1 -- 172.21.15.12:0/1585237787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600095f0 con 0x7fcc6c1026a0 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.575+0000 7fcc6affd700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 0x7fcc6c1978b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009fd0 tx=0x7fcc6000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.575+0000 7fcc68ff9700 1 -- 172.21.15.12:0/1585237787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6001d070 con 0x7fcc6c1026a0 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.575+0000 7fcc68ff9700 1 -- 172.21.15.12:0/1585237787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc6000bd10 con 0x7fcc6c1026a0 2023-12-11T20:15:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.575+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c19f3f0 con 0x7fcc6c1026a0 2023-12-11T20:15:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.575+0000 7fcc68ff9700 1 -- 172.21.15.12:0/1585237787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc60004ae0 con 0x7fcc6c1026a0 2023-12-11T20:15:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.575+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c19f810 con 0x7fcc6c1026a0 2023-12-11T20:15:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.576+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c1089f0 con 0x7fcc6c1026a0 2023-12-11T20:15:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.578+0000 7fcc68ff9700 1 -- 172.21.15.12:0/1585237787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcc60004c40 con 0x7fcc6c1026a0 2023-12-11T20:15:22.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.579+0000 7fcc68ff9700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc540a1480 0x7fcc540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:22.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.579+0000 7fcc68ff9700 1 -- 172.21.15.12:0/1585237787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc600cdb30 con 0x7fcc6c1026a0 2023-12-11T20:15:22.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.579+0000 7fcc6b7fe700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc540a1480 0x7fcc540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:22.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.580+0000 7fcc6b7fe700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc540a1480 0x7fcc540a3940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c102500 tx=0x7fcc5c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.583+0000 7fcc68ff9700 1 -- 172.21.15.12:0/1585237787 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcc60097170 con 0x7fcc6c1026a0 2023-12-11T20:15:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.795+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc6c02d470 con 0x7fcc6c1026a0 2023-12-11T20:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.796+0000 7fcc68ff9700 1 -- 172.21.15.12:0/1585237787 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc6009a790 con 0x7fcc6c1026a0 2023-12-11T20:15:22.794 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:15:22.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc540a1480 msgr2=0x7fcc540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc540a1480 0x7fcc540a3940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c102500 tx=0x7fcc5c009260 comp rx=0 tx=0).stop 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 msgr2=0x7fcc6c1978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 0x7fcc6c1978b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009fd0 tx=0x7fcc6000fa00 comp rx=0 tx=0).stop 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 shutdown_connections 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc540a1480 0x7fcc540a3940 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc6c103040 0x7fcc6c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc6c1014b0 0x7fcc6c197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 --2- 172.21.15.12:0/1585237787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc6c1026a0 0x7fcc6c1978b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 >> 172.21.15.12:0/1585237787 conn(0x7fcc6c0fca00 msgr2=0x7fcc6c105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.798+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 shutdown_connections 2023-12-11T20:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:22.799+0000 7fcc71fff700 1 -- 172.21.15.12:0/1585237787 wait complete. 2023-12-11T20:15:22.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:15:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1721901601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1026a0 msgr2=0x7fc9cc102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1721901601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1026a0 0x7fc9cc102b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0099c0 tx=0x7fc9bc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1721901601 shutdown_connections 2023-12-11T20:15:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1721901601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9cc1014b0 0x7fc9cc1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1721901601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9cc103040 0x7fc9cc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1721901601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1026a0 0x7fc9cc102b00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1721901601 >> 172.21.15.12:0/1721901601 conn(0x7fc9cc0fca00 msgr2=0x7fc9cc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1721901601 shutdown_connections 2023-12-11T20:15:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.027+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1721901601 wait complete. 2023-12-11T20:15:23.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.028+0000 7fc9d37ff700 1 Processor -- start 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.028+0000 7fc9d37ff700 1 -- start start 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.028+0000 7fc9d37ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1014b0 0x7fc9cc075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.028+0000 7fc9d37ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9cc1026a0 0x7fc9cc0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.028+0000 7fc9d37ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9cc103040 0x7fc9cc073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.028+0000 7fc9d37ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0746a0 con 0x7fc9cc1014b0 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.028+0000 7fc9d37ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc074810 con 0x7fc9cc103040 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.028+0000 7fc9d37ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1a1360 con 0x7fc9cc1026a0 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1014b0 0x7fc9cc075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1014b0 0x7fc9cc075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37848/0 (socket says 172.21.15.12:37848) 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 -- 172.21.15.12:0/1898515114 learned_addr learned my addr 172.21.15.12:0/1898515114 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d1d9c700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9cc103040 0x7fc9cc073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 -- 172.21.15.12:0/1898515114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9cc1026a0 msgr2=0x7fc9cc0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d0d9a700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9cc1026a0 0x7fc9cc0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9cc1026a0 0x7fc9cc0739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 -- 172.21.15.12:0/1898515114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9cc103040 msgr2=0x7fc9cc073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9cc103040 0x7fc9cc073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 -- 172.21.15.12:0/1898515114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0095f0 con 0x7fc9cc1014b0 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.029+0000 7fc9d159b700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1014b0 0x7fc9cc075330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800e970 tx=0x7fc9c800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.030+0000 7fc9c27fc700 1 -- 172.21.15.12:0/1898515114 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8009790 con 0x7fc9cc1014b0 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.030+0000 7fc9c27fc700 1 -- 172.21.15.12:0/1898515114 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9c8004020 con 0x7fc9cc1014b0 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.030+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc1a15f0 con 0x7fc9cc1014b0 2023-12-11T20:15:23.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.030+0000 7fc9c27fc700 1 -- 172.21.15.12:0/1898515114 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8003c50 con 0x7fc9cc1014b0 2023-12-11T20:15:23.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.030+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc1a1b50 con 0x7fc9cc1014b0 2023-12-11T20:15:23.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.031+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc108980 con 0x7fc9cc1014b0 2023-12-11T20:15:23.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.033+0000 7fc9c27fc700 1 -- 172.21.15.12:0/1898515114 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc9c8004190 con 0x7fc9cc1014b0 2023-12-11T20:15:23.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.035+0000 7fc9c27fc700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9b80a1500 0x7fc9b80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.035+0000 7fc9c27fc700 1 -- 172.21.15.12:0/1898515114 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc9c8014070 con 0x7fc9cc1014b0 2023-12-11T20:15:23.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.035+0000 7fc9d0d9a700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9b80a1500 0x7fc9b80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.036+0000 7fc9d0d9a700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9b80a1500 0x7fc9b80a39c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0098e0 tx=0x7fc9bc00b540 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:23.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.039+0000 7fc9c27fc700 1 -- 172.21.15.12:0/1898515114 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc9c80965a0 con 0x7fc9cc1014b0 2023-12-11T20:15:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.253+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9cc02d310 con 0x7fc9cc1014b0 2023-12-11T20:15:23.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.254+0000 7fc9c27fc700 1 -- 172.21.15.12:0/1898515114 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9c8099bc0 con 0x7fc9cc1014b0 2023-12-11T20:15:23.252 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:15:23.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9b80a1500 msgr2=0x7fc9b80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9b80a1500 0x7fc9b80a39c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0098e0 tx=0x7fc9bc00b540 comp rx=0 tx=0).stop 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1014b0 msgr2=0x7fc9cc075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1014b0 0x7fc9cc075330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800e970 tx=0x7fc9c800ed30 comp rx=0 tx=0).stop 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 shutdown_connections 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc9b80a1500 0x7fc9b80a39c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9cc103040 0x7fc9cc073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1014b0 0x7fc9cc075330 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 --2- 172.21.15.12:0/1898515114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9cc1026a0 0x7fc9cc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 >> 172.21.15.12:0/1898515114 conn(0x7fc9cc0fca00 msgr2=0x7fc9cc105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 shutdown_connections 2023-12-11T20:15:23.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.256+0000 7fc9d37ff700 1 -- 172.21.15.12:0/1898515114 wait complete. 2023-12-11T20:15:23.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:15:23.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:23 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4251405182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:23.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:23 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1585237787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 -- 172.21.15.12:0/1249013347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc103040 msgr2=0x7f1ddc1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 --2- 172.21.15.12:0/1249013347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc103040 0x7f1ddc1098f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400b0d0 tx=0x7f1dd400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 -- 172.21.15.12:0/1249013347 shutdown_connections 2023-12-11T20:15:23.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 --2- 172.21.15.12:0/1249013347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc1014b0 0x7f1ddc1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 --2- 172.21.15.12:0/1249013347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc103040 0x7f1ddc1098f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 --2- 172.21.15.12:0/1249013347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ddc1026a0 0x7f1ddc102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 -- 172.21.15.12:0/1249013347 >> 172.21.15.12:0/1249013347 conn(0x7f1ddc0fca00 msgr2=0x7f1ddc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:23.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 -- 172.21.15.12:0/1249013347 shutdown_connections 2023-12-11T20:15:23.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.482+0000 7f1de1fff700 1 -- 172.21.15.12:0/1249013347 wait complete. 2023-12-11T20:15:23.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.483+0000 7f1de1fff700 1 Processor -- start 2023-12-11T20:15:23.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.483+0000 7f1de1fff700 1 -- start start 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.483+0000 7f1de1fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc1014b0 0x7f1ddc197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1de1fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ddc1026a0 0x7f1ddc197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1de1fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc103040 0x7f1ddc19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1de1fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc19ef40 con 0x7f1ddc1014b0 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1de1fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc19f080 con 0x7f1ddc103040 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1de1fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc19f210 con 0x7f1ddc1026a0 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc1014b0 0x7f1ddc197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc1014b0 0x7f1ddc197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37876/0 (socket says 172.21.15.12:37876) 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddb7fe700 1 -- 172.21.15.12:0/4192317387 learned_addr learned my addr 172.21.15.12:0/4192317387 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:23.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddaffd700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ddc1026a0 0x7f1ddc197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddbfff700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc103040 0x7f1ddc19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddb7fe700 1 -- 172.21.15.12:0/4192317387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ddc1026a0 msgr2=0x7f1ddc197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddb7fe700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ddc1026a0 0x7f1ddc197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddb7fe700 1 -- 172.21.15.12:0/4192317387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc103040 msgr2=0x7f1ddc19e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddb7fe700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc103040 0x7f1ddc19e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.484+0000 7f1ddb7fe700 1 -- 172.21.15.12:0/4192317387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd4009d00 con 0x7f1ddc1014b0 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.485+0000 7f1ddb7fe700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc1014b0 0x7f1ddc197410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00e970 tx=0x7f1dcc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.485+0000 7f1dd8ff9700 1 -- 172.21.15.12:0/4192317387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc009790 con 0x7f1ddc1014b0 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.485+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc19f4f0 con 0x7f1ddc1014b0 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.485+0000 7f1dd8ff9700 1 -- 172.21.15.12:0/4192317387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dcc0044b0 con 0x7f1ddc1014b0 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.485+0000 7f1dd8ff9700 1 -- 172.21.15.12:0/4192317387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc003dd0 con 0x7f1ddc1014b0 2023-12-11T20:15:23.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.485+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc19fa00 con 0x7f1ddc1014b0 2023-12-11T20:15:23.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.486+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc1089d0 con 0x7f1ddc1014b0 2023-12-11T20:15:23.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.488+0000 7f1dd8ff9700 1 -- 172.21.15.12:0/4192317387 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1dcc003f30 con 0x7f1ddc1014b0 2023-12-11T20:15:23.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.489+0000 7f1dd8ff9700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1dc40a1480 0x7f1dc40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.489+0000 7f1dd8ff9700 1 -- 172.21.15.12:0/4192317387 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1dcc014070 con 0x7f1ddc1014b0 2023-12-11T20:15:23.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.490+0000 7f1ddaffd700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1dc40a1480 0x7f1dc40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.490+0000 7f1ddaffd700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1dc40a1480 0x7f1dc40a3940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009bf0 tx=0x7f1dd0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.493+0000 7f1dd8ff9700 1 -- 172.21.15.12:0/4192317387 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1dcc096650 con 0x7f1ddc1014b0 2023-12-11T20:15:23.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:23 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4251405182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:23.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:23 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1585237787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:23 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4251405182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:23 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1585237787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:23.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.704+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ddc02d310 con 0x7f1ddc1014b0 2023-12-11T20:15:23.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.705+0000 7f1dd8ff9700 1 -- 172.21.15.12:0/4192317387 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1dcc099c70 con 0x7f1ddc1014b0 2023-12-11T20:15:23.703 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1dc40a1480 msgr2=0x7f1dc40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1dc40a1480 0x7f1dc40a3940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009bf0 tx=0x7f1dd0009260 comp rx=0 tx=0).stop 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc1014b0 msgr2=0x7f1ddc197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc1014b0 0x7f1ddc197410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00e970 tx=0x7f1dcc00ed30 comp rx=0 tx=0).stop 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 shutdown_connections 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1dc40a1480 0x7f1dc40a3940 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc103040 0x7f1ddc19e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ddc1014b0 0x7f1ddc197410 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 --2- 172.21.15.12:0/4192317387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ddc1026a0 0x7f1ddc197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 >> 172.21.15.12:0/4192317387 conn(0x7f1ddc0fca00 msgr2=0x7f1ddc105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:23.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 shutdown_connections 2023-12-11T20:15:23.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.707+0000 7f1de1fff700 1 -- 172.21.15.12:0/4192317387 wait complete. 2023-12-11T20:15:23.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:15:23.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.930+0000 7f2c80dff700 1 -- 172.21.15.12:0/1775613679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c104920 msgr2=0x7f2c7c106d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.930+0000 7f2c80dff700 1 --2- 172.21.15.12:0/1775613679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c104920 0x7f2c7c106d10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009990 tx=0x7f2c70009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.930+0000 7f2c80dff700 1 -- 172.21.15.12:0/1775613679 shutdown_connections 2023-12-11T20:15:23.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.930+0000 7f2c80dff700 1 --2- 172.21.15.12:0/1775613679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c7c107250 0x7f2c7c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.930+0000 7f2c80dff700 1 --2- 172.21.15.12:0/1775613679 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7c101ff0 0x7f2c7c1043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.930+0000 7f2c80dff700 1 --2- 172.21.15.12:0/1775613679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c104920 0x7f2c7c106d10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.930+0000 7f2c80dff700 1 -- 172.21.15.12:0/1775613679 >> 172.21.15.12:0/1775613679 conn(0x7f2c7c0fb980 msgr2=0x7f2c7c0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:23.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.931+0000 7f2c80dff700 1 -- 172.21.15.12:0/1775613679 shutdown_connections 2023-12-11T20:15:23.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.931+0000 7f2c80dff700 1 -- 172.21.15.12:0/1775613679 wait complete. 2023-12-11T20:15:23.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.931+0000 7f2c80dff700 1 Processor -- start 2023-12-11T20:15:23.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c80dff700 1 -- start start 2023-12-11T20:15:23.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c80dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c7c101ff0 0x7f2c7c199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c80dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7c104920 0x7f2c7c199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c80dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c107250 0x7f2c7c1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c80dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1a1080 con 0x7f2c7c107250 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c80dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1a11c0 con 0x7f2c7c101ff0 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c80dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1a1350 con 0x7f2c7c104920 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c7ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c107250 0x7f2c7c1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c79d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7c104920 0x7f2c7c199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c7ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c107250 0x7f2c7c1a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37894/0 (socket says 172.21.15.12:37894) 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c7ad9d700 1 -- 172.21.15.12:0/3180576564 learned_addr learned my addr 172.21.15.12:0/3180576564 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.932+0000 7f2c7a59c700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c7c101ff0 0x7f2c7c199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c79d9b700 1 -- 172.21.15.12:0/3180576564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c7c101ff0 msgr2=0x7f2c7c199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c79d9b700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c7c101ff0 0x7f2c7c199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c79d9b700 1 -- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c107250 msgr2=0x7f2c7c1a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c79d9b700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c107250 0x7f2c7c1a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c79d9b700 1 -- 172.21.15.12:0/3180576564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700095f0 con 0x7f2c7c104920 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c7ad9d700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c107250 0x7f2c7c1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:23.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c79d9b700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7c104920 0x7f2c7c199a90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c70003f60 tx=0x7f2c70004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:23.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c6b7fe700 1 -- 172.21.15.12:0/3180576564 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7001d070 con 0x7f2c7c104920 2023-12-11T20:15:23.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c1a15d0 con 0x7f2c7c104920 2023-12-11T20:15:23.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c6b7fe700 1 -- 172.21.15.12:0/3180576564 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c7000bdb0 con 0x7f2c7c104920 2023-12-11T20:15:23.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c6b7fe700 1 -- 172.21.15.12:0/3180576564 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70022cc0 con 0x7f2c7c104920 2023-12-11T20:15:23.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.933+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c1a1a00 con 0x7f2c7c104920 2023-12-11T20:15:23.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.934+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c068330 con 0x7f2c7c104920 2023-12-11T20:15:23.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.937+0000 7f2c6b7fe700 1 -- 172.21.15.12:0/3180576564 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2c70022470 con 0x7f2c7c104920 2023-12-11T20:15:23.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.938+0000 7f2c6b7fe700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c640a1480 0x7f2c640a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:23.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.938+0000 7f2c6b7fe700 1 -- 172.21.15.12:0/3180576564 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2c70022e40 con 0x7f2c7c104920 2023-12-11T20:15:23.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.938+0000 7f2c7a59c700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c640a1480 0x7f2c640a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:23.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.939+0000 7f2c7a59c700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c640a1480 0x7f2c640a3940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009c60 tx=0x7f2c6c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:23.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:23.941+0000 7f2c6b7fe700 1 -- 172.21.15.12:0/3180576564 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2c70097e30 con 0x7f2c7c104920 2023-12-11T20:15:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.201+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c7c10cbb0 con 0x7f2c7c104920 2023-12-11T20:15:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.202+0000 7f2c6b7fe700 1 -- 172.21.15.12:0/3180576564 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f2c7009b450 con 0x7f2c7c104920 2023-12-11T20:15:24.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:24.201 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:15:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c640a1480 msgr2=0x7f2c640a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c640a1480 0x7f2c640a3940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009c60 tx=0x7f2c6c009260 comp rx=0 tx=0).stop 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7c104920 msgr2=0x7f2c7c199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7c104920 0x7f2c7c199a90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c70003f60 tx=0x7f2c70004730 comp rx=0 tx=0).stop 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 shutdown_connections 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c640a1480 0x7f2c640a3940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c7c101ff0 0x7f2c7c199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c7c107250 0x7f2c7c1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 --2- 172.21.15.12:0/3180576564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c7c104920 0x7f2c7c199a90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 >> 172.21.15.12:0/3180576564 conn(0x7f2c7c0fb980 msgr2=0x7f2c7c100020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 shutdown_connections 2023-12-11T20:15:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.205+0000 7f2c80dff700 1 -- 172.21.15.12:0/3180576564 wait complete. 2023-12-11T20:15:24.205 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:15:24.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:15:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 -- 172.21.15.12:0/1905369172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24981014a0 msgr2=0x7f24981018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 --2- 172.21.15.12:0/1905369172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24981014a0 0x7f24981018c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f249400b0d0 tx=0x7f249400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 -- 172.21.15.12:0/1905369172 shutdown_connections 2023-12-11T20:15:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 --2- 172.21.15.12:0/1905369172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2498103030 0x7f24981098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 --2- 172.21.15.12:0/1905369172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24981014a0 0x7f24981018c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 --2- 172.21.15.12:0/1905369172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2498102690 0x7f2498102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 -- 172.21.15.12:0/1905369172 >> 172.21.15.12:0/1905369172 conn(0x7f24980fca10 msgr2=0x7f24980fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 -- 172.21.15.12:0/1905369172 shutdown_connections 2023-12-11T20:15:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.430+0000 7f249f5ff700 1 -- 172.21.15.12:0/1905369172 wait complete. 2023-12-11T20:15:24.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.432+0000 7f249f5ff700 1 Processor -- start 2023-12-11T20:15:24.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.432+0000 7f249f5ff700 1 -- start start 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.432+0000 7f249f5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24981014a0 0x7f2498197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.432+0000 7f249f5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2498102690 0x7f2498197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.432+0000 7f249f5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2498103030 0x7f249819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.432+0000 7f249f5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249819f080 con 0x7f2498103030 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.432+0000 7f249f5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249819f1c0 con 0x7f24981014a0 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.432+0000 7f249f5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249819f350 con 0x7f2498102690 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249d39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24981014a0 0x7f2498197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2498103030 0x7f249819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249d39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24981014a0 0x7f2498197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:33504/0 (socket says 172.21.15.12:33504) 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249d39b700 1 -- 172.21.15.12:0/2483162583 learned_addr learned my addr 172.21.15.12:0/2483162583 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249cb9a700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2498102690 0x7f2498197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249db9c700 1 -- 172.21.15.12:0/2483162583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2498102690 msgr2=0x7f2498197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249db9c700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2498102690 0x7f2498197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249db9c700 1 -- 172.21.15.12:0/2483162583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24981014a0 msgr2=0x7f2498197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249db9c700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24981014a0 0x7f2498197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249db9c700 1 -- 172.21.15.12:0/2483162583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009d00 con 0x7f2498103030 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249d39b700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24981014a0 0x7f2498197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f249db9c700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2498103030 0x7f249819eab0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f249000b3f0 tx=0x7f249000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.433+0000 7f248e7fc700 1 -- 172.21.15.12:0/2483162583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490011830 con 0x7f2498103030 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.434+0000 7f248e7fc700 1 -- 172.21.15.12:0/2483162583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2490011e20 con 0x7f2498103030 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.434+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249819f630 con 0x7f2498103030 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.434+0000 7f248e7fc700 1 -- 172.21.15.12:0/2483162583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490010c60 con 0x7f2498103030 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.434+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249819fbc0 con 0x7f2498103030 2023-12-11T20:15:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.435+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2498108990 con 0x7f2498103030 2023-12-11T20:15:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.437+0000 7f248e7fc700 1 -- 172.21.15.12:0/2483162583 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2490011990 con 0x7f2498103030 2023-12-11T20:15:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.438+0000 7f248e7fc700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24840a1500 0x7f24840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.438+0000 7f248e7fc700 1 -- 172.21.15.12:0/2483162583 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f24900cc6a0 con 0x7f2498103030 2023-12-11T20:15:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.438+0000 7f249d39b700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24840a1500 0x7f24840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.439+0000 7f249d39b700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24840a1500 0x7f24840a39c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2494007990 tx=0x7f249400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:24.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.442+0000 7f248e7fc700 1 -- 172.21.15.12:0/2483162583 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2490095c50 con 0x7f2498103030 2023-12-11T20:15:24.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:24 smithi032 ceph-mon[132488]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:24.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:24 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1898515114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:24.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:24 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4192317387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:24.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:24 smithi039 ceph-mon[102205]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:24.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:24 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1898515114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:24.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:24 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4192317387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:24.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:24 smithi012 ceph-mon[128787]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:24.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:24 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1898515114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:24.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:24 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4192317387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:24.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.657+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2498068330 con 0x7f2498103030 2023-12-11T20:15:24.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.658+0000 7f248e7fc700 1 -- 172.21.15.12:0/2483162583 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7f2490099270 con 0x7f2498103030 2023-12-11T20:15:24.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:24.657 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:15:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24840a1500 msgr2=0x7f24840a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24840a1500 0x7f24840a39c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2494007990 tx=0x7f249400b040 comp rx=0 tx=0).stop 2023-12-11T20:15:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2498103030 msgr2=0x7f249819eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2498103030 0x7f249819eab0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f249000b3f0 tx=0x7f249000b700 comp rx=0 tx=0).stop 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 shutdown_connections 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f24840a1500 0x7f24840a39c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24981014a0 0x7f2498197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2498103030 0x7f249819eab0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 --2- 172.21.15.12:0/2483162583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2498102690 0x7f2498197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 >> 172.21.15.12:0/2483162583 conn(0x7f24980fca10 msgr2=0x7f2498105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.661+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 shutdown_connections 2023-12-11T20:15:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.662+0000 7f249f5ff700 1 -- 172.21.15.12:0/2483162583 wait complete. 2023-12-11T20:15:24.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:15:24.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:15:24.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 -- 172.21.15.12:0/695813797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 msgr2=0x7f613010b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 --2- 172.21.15.12:0/695813797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 0x7f613010b800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f612800b0a0 tx=0x7f612800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 -- 172.21.15.12:0/695813797 shutdown_connections 2023-12-11T20:15:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 --2- 172.21.15.12:0/695813797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 0x7f613010b800 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 --2- 172.21.15.12:0/695813797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6130075610 0x7f6130073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 --2- 172.21.15.12:0/695813797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6130074030 0x7f61300744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 -- 172.21.15.12:0/695813797 >> 172.21.15.12:0/695813797 conn(0x7f61300fca00 msgr2=0x7f61300fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 -- 172.21.15.12:0/695813797 shutdown_connections 2023-12-11T20:15:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.889+0000 7f6136fff700 1 -- 172.21.15.12:0/695813797 wait complete. 2023-12-11T20:15:24.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.891+0000 7f6136fff700 1 Processor -- start 2023-12-11T20:15:24.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.891+0000 7f6136fff700 1 -- start start 2023-12-11T20:15:24.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.891+0000 7f6136fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6130074030 0x7f6130199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.891+0000 7f6136fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6130075610 0x7f6130199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f6136fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 0x7f61301a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f6136fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61301a1170 con 0x7f6130109370 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f6136fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61301a12b0 con 0x7f6130075610 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f6136fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61301a1440 con 0x7f6130074030 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 0x7f61301a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f6127fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6130075610 0x7f6130199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 0x7f61301a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37916/0 (socket says 172.21.15.12:37916) 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 -- 172.21.15.12:0/2261922081 learned_addr learned my addr 172.21.15.12:0/2261922081 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f6134d9b700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6130074030 0x7f6130199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 -- 172.21.15.12:0/2261922081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6130074030 msgr2=0x7f6130199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6130074030 0x7f6130199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 -- 172.21.15.12:0/2261922081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6130075610 msgr2=0x7f6130199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6130075610 0x7f6130199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 -- 172.21.15.12:0/2261922081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6128009d00 con 0x7f6130109370 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.892+0000 7f613559c700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 0x7f61301a0ba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f612800b780 tx=0x7f612800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.893+0000 7f6125ffb700 1 -- 172.21.15.12:0/2261922081 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612800e040 con 0x7f6130109370 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.893+0000 7f6125ffb700 1 -- 172.21.15.12:0/2261922081 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6128009480 con 0x7f6130109370 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.893+0000 7f6125ffb700 1 -- 172.21.15.12:0/2261922081 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61280052c0 con 0x7f6130109370 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.893+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61301a16c0 con 0x7f6130109370 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.893+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61301a1a90 con 0x7f6130109370 2023-12-11T20:15:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.894+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6130108130 con 0x7f6130109370 2023-12-11T20:15:24.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.896+0000 7f6125ffb700 1 -- 172.21.15.12:0/2261922081 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f612801d9a0 con 0x7f6130109370 2023-12-11T20:15:24.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.897+0000 7f6125ffb700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61180a1480 0x7f61180a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:24.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.897+0000 7f6125ffb700 1 -- 172.21.15.12:0/2261922081 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f61280cde50 con 0x7f6130109370 2023-12-11T20:15:24.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.897+0000 7f6134d9b700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61180a1480 0x7f61180a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:24.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.898+0000 7f6134d9b700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61180a1480 0x7f61180a3940 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f612c009c60 tx=0x7f612c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:24.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:24.901+0000 7f6125ffb700 1 -- 172.21.15.12:0/2261922081 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f61280974f0 con 0x7f6130109370 2023-12-11T20:15:25.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.114+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f613002d470 con 0x7f6130109370 2023-12-11T20:15:25.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.114+0000 7f6125ffb700 1 -- 172.21.15.12:0/2261922081 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f612809ab10 con 0x7f6130109370 2023-12-11T20:15:25.113 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:15:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61180a1480 msgr2=0x7f61180a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61180a1480 0x7f61180a3940 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f612c009c60 tx=0x7f612c009260 comp rx=0 tx=0).stop 2023-12-11T20:15:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 msgr2=0x7f61301a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 0x7f61301a0ba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f612800b780 tx=0x7f612800bcc0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 shutdown_connections 2023-12-11T20:15:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61180a1480 0x7f61180a3940 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130109370 0x7f61301a0ba0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6130074030 0x7f6130199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 --2- 172.21.15.12:0/2261922081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6130075610 0x7f6130199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 >> 172.21.15.12:0/2261922081 conn(0x7f61300fca00 msgr2=0x7f6130105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 shutdown_connections 2023-12-11T20:15:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.117+0000 7f6136fff700 1 -- 172.21.15.12:0/2261922081 wait complete. 2023-12-11T20:15:25.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:15:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.343+0000 7f0662fff700 1 -- 172.21.15.12:0/2778869059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c1014b0 msgr2=0x7f065c1018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.343+0000 7f0662fff700 1 --2- 172.21.15.12:0/2778869059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c1014b0 0x7f065c1018d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f06500099c0 tx=0x7f0650009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.344+0000 7f0662fff700 1 -- 172.21.15.12:0/2778869059 shutdown_connections 2023-12-11T20:15:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.344+0000 7f0662fff700 1 --2- 172.21.15.12:0/2778869059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c103040 0x7f065c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.344+0000 7f0662fff700 1 --2- 172.21.15.12:0/2778869059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c1014b0 0x7f065c1018d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.344+0000 7f0662fff700 1 --2- 172.21.15.12:0/2778869059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065c1026a0 0x7f065c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.344+0000 7f0662fff700 1 -- 172.21.15.12:0/2778869059 >> 172.21.15.12:0/2778869059 conn(0x7f065c0fca00 msgr2=0x7f065c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.344+0000 7f0662fff700 1 -- 172.21.15.12:0/2778869059 shutdown_connections 2023-12-11T20:15:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.344+0000 7f0662fff700 1 -- 172.21.15.12:0/2778869059 wait complete. 2023-12-11T20:15:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f0662fff700 1 Processor -- start 2023-12-11T20:15:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f0662fff700 1 -- start start 2023-12-11T20:15:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f0662fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065c1014b0 0x7f065c0752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f0662fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c1026a0 0x7f065c0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f0662fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c103040 0x7f065c073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f0662fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c074600 con 0x7f065c103040 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f0662fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c074770 con 0x7f065c1014b0 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f0662fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c1a1530 con 0x7f065c1026a0 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f066159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c103040 0x7f065c073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f066159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c103040 0x7f065c073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37934/0 (socket says 172.21.15.12:37934) 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.345+0000 7f066159c700 1 -- 172.21.15.12:0/2426381370 learned_addr learned my addr 172.21.15.12:0/2426381370 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f0660d9b700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065c1014b0 0x7f065c0752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f065bfff700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c1026a0 0x7f065c0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f066159c700 1 -- 172.21.15.12:0/2426381370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c1026a0 msgr2=0x7f065c0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f066159c700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c1026a0 0x7f065c0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f066159c700 1 -- 172.21.15.12:0/2426381370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065c1014b0 msgr2=0x7f065c0752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f066159c700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065c1014b0 0x7f065c0752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f066159c700 1 -- 172.21.15.12:0/2426381370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500095f0 con 0x7f065c103040 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f0660d9b700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065c1014b0 0x7f065c0752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f066159c700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c103040 0x7f065c073f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f065400b970 tx=0x7f065400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:25.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f0659ffb700 1 -- 172.21.15.12:0/2426381370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065400c9b0 con 0x7f065c103040 2023-12-11T20:15:25.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f0659ffb700 1 -- 172.21.15.12:0/2426381370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0654014440 con 0x7f065c103040 2023-12-11T20:15:25.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c1a1790 con 0x7f065c103040 2023-12-11T20:15:25.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f0659ffb700 1 -- 172.21.15.12:0/2426381370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540075d0 con 0x7f065c103040 2023-12-11T20:15:25.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.346+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c1a1d20 con 0x7f065c103040 2023-12-11T20:15:25.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.347+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c108a70 con 0x7f065c103040 2023-12-11T20:15:25.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.349+0000 7f0659ffb700 1 -- 172.21.15.12:0/2426381370 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f06540145b0 con 0x7f065c103040 2023-12-11T20:15:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.352+0000 7f0659ffb700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f064c0a1500 0x7f064c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.352+0000 7f0659ffb700 1 -- 172.21.15.12:0/2426381370 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0654006e40 con 0x7f065c103040 2023-12-11T20:15:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.352+0000 7f0660d9b700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f064c0a1500 0x7f064c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.353+0000 7f0660d9b700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f064c0a1500 0x7f064c0a39c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0650000c00 tx=0x7f0650003740 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.354+0000 7f0659ffb700 1 -- 172.21.15.12:0/2426381370 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0654096310 con 0x7f065c103040 2023-12-11T20:15:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:25 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3180576564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:25 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2483162583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:25 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2261922081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:25 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3180576564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:25 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2483162583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:25 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2261922081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:25.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.568+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f065c10ccc0 con 0x7f065c103040 2023-12-11T20:15:25.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.568+0000 7f0659ffb700 1 -- 172.21.15.12:0/2426381370 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0654019020 con 0x7f065c103040 2023-12-11T20:15:25.567 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.570+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f064c0a1500 msgr2=0x7f064c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.570+0000 7f0662fff700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f064c0a1500 0x7f064c0a39c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0650000c00 tx=0x7f0650003740 comp rx=0 tx=0).stop 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.570+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c103040 msgr2=0x7f065c073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.570+0000 7f0662fff700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c103040 0x7f065c073f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f065400b970 tx=0x7f065400bd30 comp rx=0 tx=0).stop 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.571+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 shutdown_connections 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.571+0000 7f0662fff700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f064c0a1500 0x7f064c0a39c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.571+0000 7f0662fff700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065c1014b0 0x7f065c0752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.571+0000 7f0662fff700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f065c103040 0x7f065c073f00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.571+0000 7f0662fff700 1 --2- 172.21.15.12:0/2426381370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c1026a0 0x7f065c0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.571+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 >> 172.21.15.12:0/2426381370 conn(0x7f065c0fca00 msgr2=0x7f065c105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.571+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 shutdown_connections 2023-12-11T20:15:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.571+0000 7f0662fff700 1 -- 172.21.15.12:0/2426381370 wait complete. 2023-12-11T20:15:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:25 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3180576564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:25 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2483162583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:25 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2261922081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:25.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:15:25.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 -- 172.21.15.12:0/3306746524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c103040 msgr2=0x7fb71c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 --2- 172.21.15.12:0/3306746524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c103040 0x7fb71c1098f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb71400b0d0 tx=0x7fb71400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 -- 172.21.15.12:0/3306746524 shutdown_connections 2023-12-11T20:15:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 --2- 172.21.15.12:0/3306746524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c103040 0x7fb71c1098f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 --2- 172.21.15.12:0/3306746524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb71c1014b0 0x7fb71c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 --2- 172.21.15.12:0/3306746524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb71c1026a0 0x7fb71c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 -- 172.21.15.12:0/3306746524 >> 172.21.15.12:0/3306746524 conn(0x7fb71c0fca00 msgr2=0x7fb71c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 -- 172.21.15.12:0/3306746524 shutdown_connections 2023-12-11T20:15:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.796+0000 7fb7227ff700 1 -- 172.21.15.12:0/3306746524 wait complete. 2023-12-11T20:15:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.797+0000 7fb7227ff700 1 Processor -- start 2023-12-11T20:15:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.797+0000 7fb7227ff700 1 -- start start 2023-12-11T20:15:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb7227ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c1014b0 0x7fb71c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb7227ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb71c1026a0 0x7fb71c199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb7227ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb71c103040 0x7fb71c1a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb7227ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1a1170 con 0x7fb71c1014b0 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb7227ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1a12b0 con 0x7fb71c1026a0 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb7227ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1a1440 con 0x7fb71c103040 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c1014b0 0x7fb71c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c1014b0 0x7fb71c1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37938/0 (socket says 172.21.15.12:37938) 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71bfff700 1 -- 172.21.15.12:0/2519246419 learned_addr learned my addr 172.21.15.12:0/2519246419 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb720d9c700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb71c103040 0x7fb71c1a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71b7fe700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb71c1026a0 0x7fb71c199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71bfff700 1 -- 172.21.15.12:0/2519246419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb71c103040 msgr2=0x7fb71c1a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71bfff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb71c103040 0x7fb71c1a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71bfff700 1 -- 172.21.15.12:0/2519246419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb71c1026a0 msgr2=0x7fb71c199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71bfff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb71c1026a0 0x7fb71c199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.798+0000 7fb71bfff700 1 -- 172.21.15.12:0/2519246419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714009d00 con 0x7fb71c1014b0 2023-12-11T20:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.799+0000 7fb71bfff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c1014b0 0x7fb71c1996e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e970 tx=0x7fb70c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.799+0000 7fb7197fa700 1 -- 172.21.15.12:0/2519246419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c009790 con 0x7fb71c1014b0 2023-12-11T20:15:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.799+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c1a1720 con 0x7fb71c1014b0 2023-12-11T20:15:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.799+0000 7fb7197fa700 1 -- 172.21.15.12:0/2519246419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb70c00eec0 con 0x7fb71c1014b0 2023-12-11T20:15:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.799+0000 7fb7197fa700 1 -- 172.21.15.12:0/2519246419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c003c10 con 0x7fb71c1014b0 2023-12-11T20:15:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.799+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c1a1c80 con 0x7fb71c1014b0 2023-12-11T20:15:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.800+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c068330 con 0x7fb71c1014b0 2023-12-11T20:15:25.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.802+0000 7fb7197fa700 1 -- 172.21.15.12:0/2519246419 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb70c003d90 con 0x7fb71c1014b0 2023-12-11T20:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.803+0000 7fb7197fa700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb7040a1480 0x7fb7040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.804+0000 7fb7197fa700 1 -- 172.21.15.12:0/2519246419 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb70c014070 con 0x7fb71c1014b0 2023-12-11T20:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.804+0000 7fb71b7fe700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb7040a1480 0x7fb7040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.804+0000 7fb71b7fe700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb7040a1480 0x7fb7040a3940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb710005fd0 tx=0x7fb710005f60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:25.805+0000 7fb7197fa700 1 -- 172.21.15.12:0/2519246419 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb70c096760 con 0x7fb71c1014b0 2023-12-11T20:15:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.017+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb71c1a2050 con 0x7fb71c1014b0 2023-12-11T20:15:26.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.018+0000 7fb7197fa700 1 -- 172.21.15.12:0/2519246419 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb70c099d80 con 0x7fb71c1014b0 2023-12-11T20:15:26.016 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:15:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb7040a1480 msgr2=0x7fb7040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb7040a1480 0x7fb7040a3940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb710005fd0 tx=0x7fb710005f60 comp rx=0 tx=0).stop 2023-12-11T20:15:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c1014b0 msgr2=0x7fb71c1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c1014b0 0x7fb71c1996e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e970 tx=0x7fb70c00ec80 comp rx=0 tx=0).stop 2023-12-11T20:15:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 shutdown_connections 2023-12-11T20:15:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb7040a1480 0x7fb7040a3940 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb71c103040 0x7fb71c1a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c1014b0 0x7fb71c1996e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 --2- 172.21.15.12:0/2519246419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb71c1026a0 0x7fb71c199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 >> 172.21.15.12:0/2519246419 conn(0x7fb71c0fca00 msgr2=0x7fb71c107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 shutdown_connections 2023-12-11T20:15:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.020+0000 7fb7227ff700 1 -- 172.21.15.12:0/2519246419 wait complete. 2023-12-11T20:15:26.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.244+0000 7f0d659ff700 1 -- 172.21.15.12:0/4031423825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 msgr2=0x7f0d60102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.244+0000 7f0d659ff700 1 --2- 172.21.15.12:0/4031423825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 0x7f0d60102af0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0d480099c0 tx=0x7f0d48009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.245+0000 7f0d659ff700 1 -- 172.21.15.12:0/4031423825 shutdown_connections 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.245+0000 7f0d659ff700 1 --2- 172.21.15.12:0/4031423825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d601014a0 0x7f0d601018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.245+0000 7f0d659ff700 1 --2- 172.21.15.12:0/4031423825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d60103030 0x7f0d601098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.245+0000 7f0d659ff700 1 --2- 172.21.15.12:0/4031423825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 0x7f0d60102af0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.245+0000 7f0d659ff700 1 -- 172.21.15.12:0/4031423825 >> 172.21.15.12:0/4031423825 conn(0x7f0d600fca10 msgr2=0x7f0d600fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.245+0000 7f0d659ff700 1 -- 172.21.15.12:0/4031423825 shutdown_connections 2023-12-11T20:15:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.245+0000 7f0d659ff700 1 -- 172.21.15.12:0/4031423825 wait complete. 2023-12-11T20:15:26.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d659ff700 1 Processor -- start 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d659ff700 1 -- start start 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d659ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d601014a0 0x7f0d601995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d659ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 0x7f0d60199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d659ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d60103030 0x7f0d601a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d659ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601a10d0 con 0x7f0d60102690 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d659ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601a1210 con 0x7f0d601014a0 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d659ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601a13a0 con 0x7f0d60103030 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 0x7f0d60199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 0x7f0d60199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37960/0 (socket says 172.21.15.12:37960) 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.246+0000 7f0d57fff700 1 -- 172.21.15.12:0/223710021 learned_addr learned my addr 172.21.15.12:0/223710021 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d5f7fe700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d60103030 0x7f0d601a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d5effd700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d601014a0 0x7f0d601995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d57fff700 1 -- 172.21.15.12:0/223710021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d60103030 msgr2=0x7f0d601a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d57fff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d60103030 0x7f0d601a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d57fff700 1 -- 172.21.15.12:0/223710021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d601014a0 msgr2=0x7f0d601995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d57fff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d601014a0 0x7f0d601995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d57fff700 1 -- 172.21.15.12:0/223710021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480095f0 con 0x7f0d60102690 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d57fff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 0x7f0d60199ae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0d48000c00 tx=0x7f0d48003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d649fd700 1 -- 172.21.15.12:0/223710021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4801d070 con 0x7f0d60102690 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d649fd700 1 -- 172.21.15.12:0/223710021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d4800bd30 con 0x7f0d60102690 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d649fd700 1 -- 172.21.15.12:0/223710021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48022bd0 con 0x7f0d60102690 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.247+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d601a1620 con 0x7f0d60102690 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.248+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d601a19f0 con 0x7f0d60102690 2023-12-11T20:15:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.249+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60068330 con 0x7f0d60102690 2023-12-11T20:15:26.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.251+0000 7f0d649fd700 1 -- 172.21.15.12:0/223710021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0d48022d50 con 0x7f0d60102690 2023-12-11T20:15:26.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.253+0000 7f0d649fd700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d4c0a1480 0x7f0d4c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:26.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.253+0000 7f0d649fd700 1 -- 172.21.15.12:0/223710021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0d480ce040 con 0x7f0d60102690 2023-12-11T20:15:26.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.253+0000 7f0d5effd700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d4c0a1480 0x7f0d4c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:26.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.254+0000 7f0d5effd700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d4c0a1480 0x7f0d4c0a3940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d601024f0 tx=0x7f0d50007400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:26.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.256+0000 7f0d649fd700 1 -- 172.21.15.12:0/223710021 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0d480976e0 con 0x7f0d60102690 2023-12-11T20:15:26.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:26 smithi012 ceph-mon[128787]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:15:26.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:26 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2426381370' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:26.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:26 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2519246419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:26.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:26 smithi032 ceph-mon[132488]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:15:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:26 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2426381370' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:26 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2519246419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.518+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d6010cbc0 con 0x7f0d60102690 2023-12-11T20:15:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.518+0000 7f0d649fd700 1 -- 172.21.15.12:0/223710021 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f0d4809ad00 con 0x7f0d60102690 2023-12-11T20:15:26.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:26.516 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:15:26.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d4c0a1480 msgr2=0x7f0d4c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d4c0a1480 0x7f0d4c0a3940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d601024f0 tx=0x7f0d50007400 comp rx=0 tx=0).stop 2023-12-11T20:15:26.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 msgr2=0x7f0d60199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 0x7f0d60199ae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0d48000c00 tx=0x7f0d48003a50 comp rx=0 tx=0).stop 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 shutdown_connections 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0d4c0a1480 0x7f0d4c0a3940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d601014a0 0x7f0d601995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d60103030 0x7f0d601a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 --2- 172.21.15.12:0/223710021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d60102690 0x7f0d60199ae0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 >> 172.21.15.12:0/223710021 conn(0x7f0d600fca10 msgr2=0x7f0d60107e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 shutdown_connections 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.521+0000 7f0d659ff700 1 -- 172.21.15.12:0/223710021 wait complete. 2023-12-11T20:15:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:15:26.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:15:26.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:26 smithi039 ceph-mon[102205]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:15:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:26 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2426381370' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:26 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2519246419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.744+0000 7fc2917ff700 1 -- 172.21.15.12:0/1952055027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c075610 msgr2=0x7fc28c073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.744+0000 7fc2917ff700 1 --2- 172.21.15.12:0/1952055027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c075610 0x7fc28c073a60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009990 tx=0x7fc27c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.744+0000 7fc2917ff700 1 -- 172.21.15.12:0/1952055027 shutdown_connections 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.744+0000 7fc2917ff700 1 --2- 172.21.15.12:0/1952055027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c109360 0x7fc28c10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.744+0000 7fc2917ff700 1 --2- 172.21.15.12:0/1952055027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c075610 0x7fc28c073a60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.744+0000 7fc2917ff700 1 --2- 172.21.15.12:0/1952055027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc28c074030 0x7fc28c0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.744+0000 7fc2917ff700 1 -- 172.21.15.12:0/1952055027 >> 172.21.15.12:0/1952055027 conn(0x7fc28c0fca10 msgr2=0x7fc28c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.744+0000 7fc2917ff700 1 -- 172.21.15.12:0/1952055027 shutdown_connections 2023-12-11T20:15:26.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.745+0000 7fc2917ff700 1 -- 172.21.15.12:0/1952055027 wait complete. 2023-12-11T20:15:26.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc2917ff700 1 Processor -- start 2023-12-11T20:15:26.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc2917ff700 1 -- start start 2023-12-11T20:15:26.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc2917ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c074030 0x7fc28c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:26.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc2917ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc28c075610 0x7fc28c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:26.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc2917ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c109360 0x7fc28c1a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:26.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc2917ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1a1070 con 0x7fc28c074030 2023-12-11T20:15:26.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc2917ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1a11b0 con 0x7fc28c075610 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc2917ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1a1340 con 0x7fc28c109360 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc28affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c074030 0x7fc28c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc28affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c074030 0x7fc28c199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37980/0 (socket says 172.21.15.12:37980) 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.746+0000 7fc28affd700 1 -- 172.21.15.12:0/134681727 learned_addr learned my addr 172.21.15.12:0/134681727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc28affd700 1 -- 172.21.15.12:0/134681727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c109360 msgr2=0x7fc28c1a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc28affd700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c109360 0x7fc28c1a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc28affd700 1 -- 172.21.15.12:0/134681727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc28c075610 msgr2=0x7fc28c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc28a7fc700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc28c075610 0x7fc28c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc28affd700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc28c075610 0x7fc28c199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc28affd700 1 -- 172.21.15.12:0/134681727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c0095f0 con 0x7fc28c074030 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc28affd700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c074030 0x7fc28c199590 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc27c000c00 tx=0x7fc27c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc273fff700 1 -- 172.21.15.12:0/134681727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c01d070 con 0x7fc28c074030 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc273fff700 1 -- 172.21.15.12:0/134681727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc27c004100 con 0x7fc28c074030 2023-12-11T20:15:26.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc273fff700 1 -- 172.21.15.12:0/134681727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c022d70 con 0x7fc28c074030 2023-12-11T20:15:26.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c1a15c0 con 0x7fc28c074030 2023-12-11T20:15:26.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.747+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c1a1990 con 0x7fc28c074030 2023-12-11T20:15:26.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.748+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c108120 con 0x7fc28c074030 2023-12-11T20:15:26.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.750+0000 7fc273fff700 1 -- 172.21.15.12:0/134681727 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc27c022570 con 0x7fc28c074030 2023-12-11T20:15:26.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.753+0000 7fc273fff700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2740a1480 0x7fc2740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:26.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.753+0000 7fc273fff700 1 -- 172.21.15.12:0/134681727 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc27c0ce6f0 con 0x7fc28c074030 2023-12-11T20:15:26.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.753+0000 7fc28a7fc700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2740a1480 0x7fc2740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:26.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.753+0000 7fc28a7fc700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2740a1480 0x7fc2740a3940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc280005fd0 tx=0x7fc280005f60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:26.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.755+0000 7fc273fff700 1 -- 172.21.15.12:0/134681727 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc27c097e50 con 0x7fc28c074030 2023-12-11T20:15:26.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.974+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc28c10ed90 con 0x7fc28c074030 2023-12-11T20:15:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.975+0000 7fc273fff700 1 -- 172.21.15.12:0/134681727 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7fc27c027020 con 0x7fc28c074030 2023-12-11T20:15:26.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:26.974 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2740a1480 msgr2=0x7fc2740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2740a1480 0x7fc2740a3940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc280005fd0 tx=0x7fc280005f60 comp rx=0 tx=0).stop 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c074030 msgr2=0x7fc28c199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c074030 0x7fc28c199590 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc27c000c00 tx=0x7fc27c005ef0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 shutdown_connections 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2740a1480 0x7fc2740a3940 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc28c109360 0x7fc28c1a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc28c074030 0x7fc28c199590 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 --2- 172.21.15.12:0/134681727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc28c075610 0x7fc28c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:26.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 >> 172.21.15.12:0/134681727 conn(0x7fc28c0fca10 msgr2=0x7fc28c105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:26.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 shutdown_connections 2023-12-11T20:15:26.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:26.978+0000 7fc2917ff700 1 -- 172.21.15.12:0/134681727 wait complete. 2023-12-11T20:15:26.995 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-11T20:13:53.009335+0000', 'modified': '2023-12-11T20:13:58.248579+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24620, 'mds_1': 24577, 'mds_2': 24566}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24530': {'gid': 24530, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.32:6835/1999108930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6834', 'nonce': 1999108930}, {'type': 'v1', 'addr': '172.21.15.32:6835', 'nonce': 1999108930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24541': {'gid': 24541, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6835/2029236451', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6834', 'nonce': 2029236451}, {'type': 'v1', 'addr': '172.21.15.39:6835', 'nonce': 2029236451}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24553': {'gid': 24553, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6837/2148366648', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6836', 'nonce': 2148366648}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 2148366648}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24566': {'gid': 24566, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.32:6837/173395142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6836', 'nonce': 173395142}, {'type': 'v1', 'addr': '172.21.15.32:6837', 'nonce': 173395142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24577': {'gid': 24577, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.39:6839/2020485308', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6838', 'nonce': 2020485308}, {'type': 'v1', 'addr': '172.21.15.39:6839', 'nonce': 2020485308}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24620': {'gid': 24620, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.32:6839/3894896449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6838', 'nonce': 3894896449}, {'type': 'v1', 'addr': '172.21.15.32:6839', 'nonce': 3894896449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-11T20:15:26.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-11T20:15:26.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-12-11T20:15:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 -- 172.21.15.12:0/1013139498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c109370 msgr2=0x7f587c10b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 --2- 172.21.15.12:0/1013139498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c109370 0x7f587c10b800 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f587400b0a0 tx=0x7f587400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 -- 172.21.15.12:0/1013139498 shutdown_connections 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 --2- 172.21.15.12:0/1013139498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f587c075610 0x7f587c073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 --2- 172.21.15.12:0/1013139498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c109370 0x7f587c10b800 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 --2- 172.21.15.12:0/1013139498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f587c074030 0x7f587c0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 -- 172.21.15.12:0/1013139498 >> 172.21.15.12:0/1013139498 conn(0x7f587c0fca00 msgr2=0x7f587c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 -- 172.21.15.12:0/1013139498 shutdown_connections 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.203+0000 7f5882fff700 1 -- 172.21.15.12:0/1013139498 wait complete. 2023-12-11T20:15:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.205+0000 7f5882fff700 1 Processor -- start 2023-12-11T20:15:27.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.205+0000 7f5882fff700 1 -- start start 2023-12-11T20:15:27.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.205+0000 7f5882fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c074030 0x7f587c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.205+0000 7f5882fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f587c075610 0x7f587c199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.205+0000 7f5882fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f587c109370 0x7f587c1a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.205+0000 7f5882fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c1a1150 con 0x7f587c074030 2023-12-11T20:15:27.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.205+0000 7f5882fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c1a1290 con 0x7f587c109370 2023-12-11T20:15:27.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.205+0000 7f5882fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c1a1420 con 0x7f587c075610 2023-12-11T20:15:27.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c074030 0x7f587c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c074030 0x7f587c199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37994/0 (socket says 172.21.15.12:37994) 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 -- 172.21.15.12:0/1080497117 learned_addr learned my addr 172.21.15.12:0/1080497117 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f588159c700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f587c109370 0x7f587c1a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f587bfff700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f587c075610 0x7f587c199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 -- 172.21.15.12:0/1080497117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f587c075610 msgr2=0x7f587c199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f587c075610 0x7f587c199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 -- 172.21.15.12:0/1080497117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f587c109370 msgr2=0x7f587c1a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f587c109370 0x7f587c1a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 -- 172.21.15.12:0/1080497117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874009d00 con 0x7f587c074030 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f588159c700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f587c109370 0x7f587c1a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5880d9b700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c074030 0x7f587c199670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f587000d950 tx=0x7f587000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.206+0000 7f5879ffb700 1 -- 172.21.15.12:0/1080497117 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870009b40 con 0x7f587c074030 2023-12-11T20:15:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.207+0000 7f5879ffb700 1 -- 172.21.15.12:0/1080497117 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5870009ca0 con 0x7f587c074030 2023-12-11T20:15:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.207+0000 7f5882fff700 1 -- 172.21.15.12:0/1080497117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c1a1700 con 0x7f587c074030 2023-12-11T20:15:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.207+0000 7f5879ffb700 1 -- 172.21.15.12:0/1080497117 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000f620 con 0x7f587c074030 2023-12-11T20:15:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.207+0000 7f5882fff700 1 -- 172.21.15.12:0/1080497117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c1a1bc0 con 0x7f587c074030 2023-12-11T20:15:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.210+0000 7f5879ffb700 1 -- 172.21.15.12:0/1080497117 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5870010460 con 0x7f587c074030 2023-12-11T20:15:27.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.211+0000 7f5896954b80 1 Processor -- start 2023-12-11T20:15:27.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.211+0000 7f5896954b80 1 -- start start 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.211+0000 7f5896954b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 0x55593b8387a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.211+0000 7f5896954b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.211+0000 7f5896954b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b839bd0 0x55593b83a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.211+0000 7f5896954b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b793b00 con 0x55593b838ce0 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.211+0000 7f5896954b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b791420 con 0x55593b839bd0 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.211+0000 7f5896954b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b78cd10 con 0x55593b838380 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38004/0 (socket says 172.21.15.12:38004) 2023-12-11T20:15:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 -- 172.21.15.12:0/498934100 learned_addr learned my addr 172.21.15.12:0/498934100 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f588159c700 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 0x55593b8387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5879ffb700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f586c0a1480 0x7f586c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f587bfff700 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b839bd0 0x55593b83a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5879ffb700 1 -- 172.21.15.12:0/1080497117 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f58700cd150 con 0x7f587c074030 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f588159c700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f586c0a1480 0x7f586c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 -- 172.21.15.12:0/498934100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 msgr2=0x55593b8387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 0x55593b8387a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 -- 172.21.15.12:0/498934100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b839bd0 msgr2=0x55593b83a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b839bd0 0x55593b83a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 -- 172.21.15.12:0/498934100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55593b6095e0 con 0x55593b838ce0 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.212+0000 7f5880d9b700 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8395f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f587009a350 tx=0x7f5870005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac23b03e058daba server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5866ffd700 1 -- 172.21.15.12:0/498934100 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870099f00 con 0x55593b838ce0 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5866ffd700 1 -- 172.21.15.12:0/498934100 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5870099d20 con 0x55593b838ce0 2023-12-11T20:15:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5866ffd700 1 -- 172.21.15.12:0/498934100 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587009e510 con 0x55593b838ce0 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5896954b80 1 -- 172.21.15.12:0/498934100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 msgr2=0x55593b8395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f588159c700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f586c0a1480 0x7f586c0a3940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5874009fd0 tx=0x7f587400b3b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5896954b80 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8395f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f587009a350 tx=0x7f5870005910 comp rx=0 tx=0).stop 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5896954b80 1 -- 172.21.15.12:0/498934100 shutdown_connections 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5896954b80 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b839bd0 0x55593b83a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5896954b80 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 0x55593b8387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5896954b80 1 --2- 172.21.15.12:0/498934100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8395f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.213+0000 7f5896954b80 1 -- 172.21.15.12:0/498934100 >> 172.21.15.12:0/498934100 conn(0x55593b767790 msgr2=0x55593b834d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.214+0000 7f5896954b80 1 -- 172.21.15.12:0/498934100 shutdown_connections 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.214+0000 7f5896954b80 1 -- 172.21.15.12:0/498934100 wait complete. 2023-12-11T20:15:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.214+0000 7f5896954b80 1 -- start start 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.214+0000 7f5896954b80 1 Processor -- start 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5896954b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838380 0x55593b8420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5896954b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8425e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5896954b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 0x55593b849620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5896954b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b746510 con 0x55593b838380 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5896954b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b7461b0 con 0x55593b838ce0 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5896954b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b60b8d0 con 0x55593b839bd0 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5896954b80 10 client.0 _ll_register_callbacks cb 0x55593b671a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5880d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838380 0x55593b8420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5880d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838380 0x55593b8420a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38014/0 (socket says 172.21.15.12:38014) 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5880d9b700 1 -- 172.21.15.12:0/1827416237 learned_addr learned my addr 172.21.15.12:0/1827416237 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5880d9b700 1 -- 172.21.15.12:0/1827416237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 msgr2=0x55593b849620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5880d9b700 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 0x55593b849620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5880d9b700 1 -- 172.21.15.12:0/1827416237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 msgr2=0x55593b8425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5880d9b700 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.215+0000 7f5880d9b700 1 -- 172.21.15.12:0/1827416237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c1a1bc0 con 0x55593b838380 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f5880d9b700 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838380 0x55593b8420a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870099f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fc00540d0672ee server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f585bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f585bfff700 1 -- 172.21.15.12:0/1827416237 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700a2750 con 0x55593b838380 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f585bfff700 1 -- 172.21.15.12:0/1827416237 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f587009e510 con 0x55593b838380 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f5896954b80 1 -- 172.21.15.12:0/1827416237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55593b82baf0 con 0x55593b838380 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f585bfff700 1 -- 172.21.15.12:0/1827416237 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f587009a620 con 0x55593b838380 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f5896954b80 10 client.15291 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f5896954b80 1 -- 172.21.15.12:0/1827416237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55593b5b5d90 con 0x55593b838380 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f585bfff700 1 -- 172.21.15.12:0/1827416237 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55593b82baf0 con 0x55593b838380 2023-12-11T20:15:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f585bfff700 1 -- 172.21.15.12:0/1827416237 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f58700a22c0 con 0x55593b838380 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.216+0000 7f5896954b80 10 client.15291 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.217+0000 7f5896954b80 10 client.15291 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.217+0000 7f5896954b80 20 client.15291 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.217+0000 7f5896954b80 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55593b84d900 0x55593b84c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.217+0000 7f5896954b80 4 client.15291 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.217+0000 7f5896954b80 1 -- 172.21.15.12:0/1827416237 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55593b807ef0 con 0x55593b84d900 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.217+0000 7f587bfff700 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55593b84d900 0x55593b84c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.217+0000 7f587bfff700 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55593b84d900 0x55593b84c5f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=519025a9d6f23b67 server_cookie=27d329ad915e80cd in_seq=0 out_seq=0 2023-12-11T20:15:27.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.217+0000 7f585bfff700 10 client.15291 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:15:27.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.218+0000 7f585bfff700 1 -- 172.21.15.12:0/1827416237 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55593b807ef0 con 0x55593b84d900 2023-12-11T20:15:27.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.218+0000 7f585bfff700 10 client.15291 handle_command_reply: tid=0 2023-12-11T20:15:27.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.218+0000 7f5896954b80 1 client.15291 shutdown 2023-12-11T20:15:27.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 -- 172.21.15.12:0/1827416237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838380 msgr2=0x55593b8420a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838380 0x55593b8420a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f587000e010 tx=0x7f5870099f00 comp rx=0 tx=0).stop 2023-12-11T20:15:27.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 -- 172.21.15.12:0/1827416237 shutdown_connections 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55593b84d900 0x55593b84c5f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 0x55593b849620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838380 0x55593b8420a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f585bfff700 0 client.15291 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 --2- 172.21.15.12:0/1827416237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 -- 172.21.15.12:0/1827416237 >> 172.21.15.12:0/1827416237 conn(0x55593b767790 msgr2=0x55593b8339f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 -- 172.21.15.12:0/1827416237 shutdown_connections 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 1 -- 172.21.15.12:0/1827416237 wait complete. 2023-12-11T20:15:27.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.219+0000 7f5896954b80 20 client.15291 trim_cache size 0 max 16384 2023-12-11T20:15:27.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f5896954b80 1 Processor -- start 2023-12-11T20:15:27.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f5896954b80 1 -- start start 2023-12-11T20:15:27.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f5896954b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838380 0x55593b839fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f5896954b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f5896954b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 0x55593b834920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f5896954b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b731b50 con 0x55593b838ce0 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f5896954b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b728360 con 0x55593b838380 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f5896954b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b72f830 con 0x55593b839bd0 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.238+0000 7f587bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f587bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38020/0 (socket says 172.21.15.12:38020) 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f587bfff700 1 -- 172.21.15.12:0/544565232 learned_addr learned my addr 172.21.15.12:0/544565232 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f5880d9b700 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838380 0x55593b839fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f588159c700 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 0x55593b834920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f587bfff700 1 -- 172.21.15.12:0/544565232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 msgr2=0x55593b834920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f587bfff700 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 0x55593b834920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f587bfff700 1 -- 172.21.15.12:0/544565232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838380 msgr2=0x55593b839fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f587bfff700 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838380 0x55593b839fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f587bfff700 1 -- 172.21.15.12:0/544565232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55593b59ec10 con 0x55593b838ce0 2023-12-11T20:15:27.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f5880d9b700 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838380 0x55593b839fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:27.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f587bfff700 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8495e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55593b84ec90 tx=0x7f5868014750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70933835e0539d54 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f58677fe700 1 -- 172.21.15.12:0/544565232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868017040 con 0x55593b838ce0 2023-12-11T20:15:27.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f58677fe700 1 -- 172.21.15.12:0/544565232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58680142d0 con 0x55593b838ce0 2023-12-11T20:15:27.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.239+0000 7f58677fe700 1 -- 172.21.15.12:0/544565232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680127d0 con 0x55593b838ce0 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 -- 172.21.15.12:0/544565232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 msgr2=0x55593b8495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8495e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55593b84ec90 tx=0x7f5868014750 comp rx=0 tx=0).stop 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 -- 172.21.15.12:0/544565232 shutdown_connections 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838380 0x55593b839fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b839bd0 0x55593b834920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 --2- 172.21.15.12:0/544565232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b838ce0 0x55593b8495e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 -- 172.21.15.12:0/544565232 >> 172.21.15.12:0/544565232 conn(0x55593b767790 msgr2=0x55593b83cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 -- 172.21.15.12:0/544565232 shutdown_connections 2023-12-11T20:15:27.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 -- 172.21.15.12:0/544565232 wait complete. 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.240+0000 7f5896954b80 1 -- start start 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.241+0000 7f5896954b80 1 Processor -- start 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.241+0000 7f5896954b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 0x55593b846380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.241+0000 7f5896954b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.241+0000 7f5896954b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b839bd0 0x55593b8a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.241+0000 7f5896954b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b846e00 con 0x55593b839bd0 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.241+0000 7f5896954b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b846f70 con 0x55593b838ce0 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f5896954b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55593b8a3f00 con 0x55593b838380 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f5896954b80 10 client.0 _ll_register_callbacks cb 0x55593b671a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f588159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b839bd0 0x55593b8a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f587bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f587bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:33630/0 (socket says 172.21.15.12:33630) 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f587bfff700 1 -- 172.21.15.12:0/3391995147 learned_addr learned my addr 172.21.15.12:0/3391995147 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f588159c700 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b839bd0 0x55593b8a39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38030/0 (socket says 172.21.15.12:38030) 2023-12-11T20:15:27.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f5880d9b700 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 0x55593b846380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f588159c700 1 -- 172.21.15.12:0/3391995147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 msgr2=0x55593b846380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f588159c700 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 0x55593b846380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f588159c700 1 -- 172.21.15.12:0/3391995147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 msgr2=0x55593b8468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f588159c700 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f588159c700 1 -- 172.21.15.12:0/3391995147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55593b5dc200 con 0x55593b839bd0 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f587bfff700 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f588159c700 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b839bd0 0x55593b8a39c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5874007af0 tx=0x7f5874009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a7be114cc04fe3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.242+0000 7f585bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f585bfff700 1 -- 172.21.15.12:0/3391995147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400e040 con 0x55593b839bd0 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f5896954b80 1 -- 172.21.15.12:0/3391995147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5870099d20 con 0x55593b839bd0 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f585bfff700 1 -- 172.21.15.12:0/3391995147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5874025070 con 0x55593b839bd0 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f585bfff700 1 -- 172.21.15.12:0/3391995147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f587400be00 con 0x55593b839bd0 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f5896954b80 10 client.15297 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:27.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f5896954b80 1 -- 172.21.15.12:0/3391995147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55593b5b4260 con 0x55593b839bd0 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f585bfff700 1 -- 172.21.15.12:0/3391995147 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5870099d20 con 0x55593b839bd0 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f585bfff700 1 -- 172.21.15.12:0/3391995147 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5874005560 con 0x55593b839bd0 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f5896954b80 10 client.15297 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f5896954b80 10 client.15297 resolve_mds: resolved name 'h' to daemon mds.h 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.243+0000 7f5896954b80 20 client.15297 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.244+0000 7f5896954b80 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55593b8a91a0 0x55593b8a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.244+0000 7f5896954b80 4 client.15297 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.244+0000 7f5896954b80 1 -- 172.21.15.12:0/3391995147 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55593b752f80 con 0x55593b8a91a0 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.244+0000 7f5880d9b700 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55593b8a91a0 0x55593b8a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.244+0000 7f5880d9b700 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55593b8a91a0 0x55593b8a55e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4743f2f0def69ab7 server_cookie=bbd497d49528b06e in_seq=0 out_seq=0 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.244+0000 7f585bfff700 10 client.15297 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f585bfff700 1 -- 172.21.15.12:0/3391995147 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55593b752f80 con 0x55593b8a91a0 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f585bfff700 10 client.15297 handle_command_reply: tid=0 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 client.15297 shutdown 2023-12-11T20:15:27.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 -- 172.21.15.12:0/3391995147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b839bd0 msgr2=0x55593b8a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b839bd0 0x55593b8a39c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5874007af0 tx=0x7f5874009380 comp rx=0 tx=0).stop 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 -- 172.21.15.12:0/3391995147 shutdown_connections 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55593b8a91a0 0x55593b8a55e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55593b839bd0 0x55593b8a39c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55593b838380 0x55593b846380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 --2- 172.21.15.12:0/3391995147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55593b838ce0 0x55593b8468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f585bfff700 0 client.15297 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 -- 172.21.15.12:0/3391995147 >> 172.21.15.12:0/3391995147 conn(0x55593b767790 msgr2=0x55593b834920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 -- 172.21.15.12:0/3391995147 shutdown_connections 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 1 -- 172.21.15.12:0/3391995147 wait complete. 2023-12-11T20:15:27.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.245+0000 7f5896954b80 20 client.15297 trim_cache size 0 max 16384 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "732461f0-9860-11ee-95a3-87774f69a715", 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24566, 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 89.746203090999998, 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 22, 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 114.03132700899999 2023-12-11T20:15:27.248 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:15:27.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 -- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f586c0a1480 msgr2=0x7f586c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f586c0a1480 0x7f586c0a3940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5874009fd0 tx=0x7f587400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 -- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c074030 msgr2=0x7f587c199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c074030 0x7f587c199670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f587000d950 tx=0x7f587000dd10 comp rx=0 tx=0).stop 2023-12-11T20:15:27.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 -- 172.21.15.12:0/1080497117 shutdown_connections 2023-12-11T20:15:27.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f586c0a1480 0x7f586c0a3940 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f587c109370 0x7f587c1a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f587c074030 0x7f587c199670 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 --2- 172.21.15.12:0/1080497117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f587c075610 0x7f587c199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 -- 172.21.15.12:0/1080497117 >> 172.21.15.12:0/1080497117 conn(0x7f587c0fca00 msgr2=0x7f587c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 -- 172.21.15.12:0/1080497117 shutdown_connections 2023-12-11T20:15:27.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.246+0000 7f5882fff700 1 -- 172.21.15.12:0/1080497117 wait complete. 2023-12-11T20:15:27.260 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:27 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/223710021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:27.260 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:27 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/134681727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:27.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-12-11T20:15:27.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:27 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/223710021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:27 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/134681727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:27.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 -- 172.21.15.12:0/1751428975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8075610 msgr2=0x7f11c8073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/1751428975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8075610 0x7f11c8073a60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009990 tx=0x7f11b8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 -- 172.21.15.12:0/1751428975 shutdown_connections 2023-12-11T20:15:27.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/1751428975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11c810da80 0x7f11c810fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/1751428975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8075610 0x7f11c8073a60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/1751428975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11c8074030 0x7f11c80744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 -- 172.21.15.12:0/1751428975 >> 172.21.15.12:0/1751428975 conn(0x7f11c80fca00 msgr2=0x7f11c80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 -- 172.21.15.12:0/1751428975 shutdown_connections 2023-12-11T20:15:27.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.469+0000 7f11cc9ff700 1 -- 172.21.15.12:0/1751428975 wait complete. 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.470+0000 7f11cc9ff700 1 Processor -- start 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.470+0000 7f11cc9ff700 1 -- start start 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11cc9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8074030 0x7f11c819d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11cc9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11c8075610 0x7f11c819df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11cc9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11c810da80 0x7f11c81a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11cc9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81a5470 con 0x7f11c8074030 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11cc9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81a55b0 con 0x7f11c810da80 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11cc9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81a5740 con 0x7f11c8075610 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8074030 0x7f11c819d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8074030 0x7f11c819d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38050/0 (socket says 172.21.15.12:38050) 2023-12-11T20:15:27.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c659c700 1 -- 172.21.15.12:0/956448744 learned_addr learned my addr 172.21.15.12:0/956448744 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11bffff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11c8075610 0x7f11c819df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c6d9d700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11c810da80 0x7f11c81a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c659c700 1 -- 172.21.15.12:0/956448744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11c8075610 msgr2=0x7f11c819df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c659c700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11c8075610 0x7f11c819df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c659c700 1 -- 172.21.15.12:0/956448744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11c810da80 msgr2=0x7f11c81a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c659c700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11c810da80 0x7f11c81a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.471+0000 7f11c659c700 1 -- 172.21.15.12:0/956448744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009520 con 0x7f11c8074030 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.472+0000 7f11c659c700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8074030 0x7f11c819d9e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f11b8003ec0 tx=0x7f11b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.472+0000 7f11bf7fe700 1 -- 172.21.15.12:0/956448744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b801d070 con 0x7f11c8074030 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.472+0000 7f11bf7fe700 1 -- 172.21.15.12:0/956448744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11b800be30 con 0x7f11c8074030 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.472+0000 7f11bf7fe700 1 -- 172.21.15.12:0/956448744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800fe90 con 0x7f11c8074030 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.472+0000 7f11cc9ff700 1 -- 172.21.15.12:0/956448744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b80095f0 con 0x7f11c8074030 2023-12-11T20:15:27.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.472+0000 7f11cc9ff700 1 -- 172.21.15.12:0/956448744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c81a5c00 con 0x7f11c8074030 2023-12-11T20:15:27.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.475+0000 7f11bf7fe700 1 -- 172.21.15.12:0/956448744 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f11b800f660 con 0x7f11c8074030 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.476+0000 7f11e02f5b80 1 Processor -- start 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.476+0000 7f11bf7fe700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11b40a1500 0x7f11b40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11e02f5b80 1 -- start start 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11bf7fe700 1 -- 172.21.15.12:0/956448744 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11b80ce0f0 con 0x7f11c8074030 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11bffff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11b40a1500 0x7f11b40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb4347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434ce0 0x5575cb4355f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb435bd0 0x5575cb436050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb38fb00 con 0x5575cb434380 2023-12-11T20:15:27.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb38d420 con 0x5575cb434ce0 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb388d10 con 0x5575cb435bd0 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb4347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb4347a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38066/0 (socket says 172.21.15.12:38066) 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11c659c700 1 -- 172.21.15.12:0/394661202 learned_addr learned my addr 172.21.15.12:0/394661202 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11bffff700 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434ce0 0x5575cb4355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.477+0000 7f11bffff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11b40a1500 0x7f11b40a39c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11c8075330 tx=0x7f11b0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11c6d9d700 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb435bd0 0x5575cb436050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11c659c700 1 -- 172.21.15.12:0/394661202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb435bd0 msgr2=0x5575cb436050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11c659c700 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb435bd0 0x5575cb436050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11c659c700 1 -- 172.21.15.12:0/394661202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434ce0 msgr2=0x5575cb4355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11c659c700 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434ce0 0x5575cb4355f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11c659c700 1 -- 172.21.15.12:0/394661202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575cb2055e0 con 0x5575cb434380 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11c6d9d700 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb435bd0 0x5575cb436050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:27.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11c659c700 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb4347a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f11b809b0f0 tx=0x7f11b800bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f20ccffe862f5a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11bcff9700 1 -- 172.21.15.12:0/394661202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b809baf0 con 0x5575cb434380 2023-12-11T20:15:27.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11bcff9700 1 -- 172.21.15.12:0/394661202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11b809b3f0 con 0x5575cb434380 2023-12-11T20:15:27.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.478+0000 7f11bcff9700 1 -- 172.21.15.12:0/394661202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b809a8e0 con 0x5575cb434380 2023-12-11T20:15:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 -- 172.21.15.12:0/394661202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 msgr2=0x5575cb4347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb4347a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f11b809b0f0 tx=0x7f11b800bfa0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 -- 172.21.15.12:0/394661202 shutdown_connections 2023-12-11T20:15:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb435bd0 0x5575cb436050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb4347a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/394661202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434ce0 0x5575cb4355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 -- 172.21.15.12:0/394661202 >> 172.21.15.12:0/394661202 conn(0x5575cb363790 msgr2=0x5575cb430d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 -- 172.21.15.12:0/394661202 shutdown_connections 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 -- 172.21.15.12:0/394661202 wait complete. 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.479+0000 7f11e02f5b80 1 -- start start 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.480+0000 7f11e02f5b80 1 Processor -- start 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.480+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434380 0x5575cb43dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.480+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb43e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.480+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb435bd0 0x5575cb445420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.480+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb342510 con 0x5575cb435bd0 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.480+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb3421b0 con 0x5575cb434380 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.480+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb2078d0 con 0x5575cb434ce0 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.480+0000 7f11e02f5b80 10 client.0 _ll_register_callbacks cb 0x5575cb26da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb435bd0 0x5575cb445420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb435bd0 0x5575cb445420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38074/0 (socket says 172.21.15.12:38074) 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 -- 172.21.15.12:0/1969376683 learned_addr learned my addr 172.21.15.12:0/1969376683 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c659c700 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434380 0x5575cb43dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11bffff700 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb43e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 -- 172.21.15.12:0/1969376683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 msgr2=0x5575cb43e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb43e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 -- 172.21.15.12:0/1969376683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434380 msgr2=0x5575cb43dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434380 0x5575cb43dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 -- 172.21.15.12:0/1969376683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c81a5c00 con 0x5575cb435bd0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c659c700 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434380 0x5575cb43dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11c6d9d700 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb435bd0 0x5575cb445420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f11c0007ab0 tx=0x7f11c0007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d643825e7dc1e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11adffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.481+0000 7f11adffb700 1 -- 172.21.15.12:0/1969376683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c000e030 con 0x5575cb435bd0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11adffb700 1 -- 172.21.15.12:0/1969376683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11c000f070 con 0x5575cb435bd0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1969376683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575cb427af0 con 0x5575cb435bd0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11adffb700 1 -- 172.21.15.12:0/1969376683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11c00117f0 con 0x5575cb435bd0 2023-12-11T20:15:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 10 client.15309 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1969376683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5575cb1b1d90 con 0x5575cb435bd0 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11adffb700 1 -- 172.21.15.12:0/1969376683 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575cb427af0 con 0x5575cb435bd0 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11adffb700 1 -- 172.21.15.12:0/1969376683 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11c001d060 con 0x5575cb435bd0 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 10 client.15309 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 20 client.15309 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575cb449b10 0x5575cb448590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 4 client.15309 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.482+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1969376683 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575cb403ef0 con 0x5575cb449b10 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.483+0000 7f11c659c700 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575cb449b10 0x5575cb448590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.483+0000 7f11c659c700 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575cb449b10 0x5575cb448590 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e7c28f790dac23d7 server_cookie=c50a19151fc76d8 in_seq=0 out_seq=0 2023-12-11T20:15:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.483+0000 7f11adffb700 10 client.15309 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:15:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11adffb700 1 -- 172.21.15.12:0/1969376683 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575cb403ef0 con 0x5575cb449b10 2023-12-11T20:15:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11adffb700 10 client.15309 handle_command_reply: tid=0 2023-12-11T20:15:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 client.15309 shutdown 2023-12-11T20:15:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1969376683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb435bd0 msgr2=0x5575cb445420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb435bd0 0x5575cb445420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f11c0007ab0 tx=0x7f11c0007dc0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1969376683 shutdown_connections 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575cb449b10 0x5575cb448590 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb434380 0x5575cb43dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb435bd0 0x5575cb445420 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11adffb700 0 client.15309 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1969376683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb43e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1969376683 >> 172.21.15.12:0/1969376683 conn(0x5575cb363790 msgr2=0x5575cb42f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.484+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1969376683 shutdown_connections 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.485+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1969376683 wait complete. 2023-12-11T20:15:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.485+0000 7f11e02f5b80 20 client.15309 trim_cache size 0 max 16384 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.503+0000 7f11e02f5b80 1 Processor -- start 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.503+0000 7f11e02f5b80 1 -- start start 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434380 0x5575cb438b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434ce0 0x5575cb4390b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 0x5575cb445340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb427ad0 con 0x5575cb434ce0 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb43eda0 con 0x5575cb435bd0 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb4465c0 con 0x5575cb434380 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11bffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434ce0 0x5575cb4390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11bffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434ce0 0x5575cb4390b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38088/0 (socket says 172.21.15.12:38088) 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11bffff700 1 -- 172.21.15.12:0/1224903576 learned_addr learned my addr 172.21.15.12:0/1224903576 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.504+0000 7f11c659c700 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434380 0x5575cb438b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bffff700 1 -- 172.21.15.12:0/1224903576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434380 msgr2=0x5575cb438b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11c6d9d700 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 0x5575cb445340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bffff700 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434380 0x5575cb438b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bffff700 1 -- 172.21.15.12:0/1224903576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 msgr2=0x5575cb445340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bffff700 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 0x5575cb445340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bffff700 1 -- 172.21.15.12:0/1224903576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575cb19ac10 con 0x5575cb434ce0 2023-12-11T20:15:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11c6d9d700 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 0x5575cb445340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bffff700 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434ce0 0x5575cb4390b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f11b0012550 tx=0x7f11b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23aa6d2a8554811 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bd7fa700 1 -- 172.21.15.12:0/1224903576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0024070 con 0x5575cb434ce0 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bd7fa700 1 -- 172.21.15.12:0/1224903576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11b0012c70 con 0x5575cb434ce0 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.505+0000 7f11bd7fa700 1 -- 172.21.15.12:0/1224903576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0028670 con 0x5575cb434ce0 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1224903576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434ce0 msgr2=0x5575cb4390b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434ce0 0x5575cb4390b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f11b0012550 tx=0x7f11b0019000 comp rx=0 tx=0).stop 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1224903576 shutdown_connections 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 0x5575cb445340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434380 0x5575cb438b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/1224903576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434ce0 0x5575cb4390b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1224903576 >> 172.21.15.12:0/1224903576 conn(0x5575cb363790 msgr2=0x5575cb43c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1224903576 shutdown_connections 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 -- 172.21.15.12:0/1224903576 wait complete. 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.506+0000 7f11e02f5b80 1 -- start start 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11e02f5b80 1 Processor -- start 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb442000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb442540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11e02f5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 0x5575cb49fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb445420 con 0x5575cb434380 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb445590 con 0x5575cb435bd0 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11e02f5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575cb445750 con 0x5575cb434ce0 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11e02f5b80 10 client.0 _ll_register_callbacks cb 0x5575cb26da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb442000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb442000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38098/0 (socket says 172.21.15.12:38098) 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11c659c700 1 -- 172.21.15.12:0/4196472302 learned_addr learned my addr 172.21.15.12:0/4196472302 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.507+0000 7f11bffff700 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb442540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11c659c700 1 -- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 msgr2=0x5575cb442540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11c659c700 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb442540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11c659c700 1 -- 172.21.15.12:0/4196472302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 msgr2=0x5575cb49fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11c659c700 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 0x5575cb49fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11c659c700 1 -- 172.21.15.12:0/4196472302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b0018070 con 0x5575cb434380 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11bffff700 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb442540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11c659c700 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb442000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f11b809b380 tx=0x7f11b8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f8b3c3b3e24e5b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11adffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11adffb700 1 -- 172.21.15.12:0/4196472302 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b809aae0 con 0x5575cb434380 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11adffb700 1 -- 172.21.15.12:0/4196472302 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11b80a36f0 con 0x5575cb434380 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11e02f5b80 1 -- 172.21.15.12:0/4196472302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11b809b3f0 con 0x5575cb434380 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11adffb700 1 -- 172.21.15.12:0/4196472302 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11b80a3260 con 0x5575cb434380 2023-12-11T20:15:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11e02f5b80 10 client.15315 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.508+0000 7f11e02f5b80 1 -- 172.21.15.12:0/4196472302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5575cb1d8200 con 0x5575cb434380 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11adffb700 1 -- 172.21.15.12:0/4196472302 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11b809b3f0 con 0x5575cb434380 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11adffb700 1 -- 172.21.15.12:0/4196472302 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11b80971e0 con 0x5575cb434380 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11e02f5b80 10 client.15315 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11e02f5b80 10 client.15315 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11e02f5b80 20 client.15315 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575cb4a4e30 0x5575cb4a1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11e02f5b80 4 client.15315 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11e02f5b80 1 -- 172.21.15.12:0/4196472302 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5575cb34ef80 con 0x5575cb4a4e30 2023-12-11T20:15:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.509+0000 7f11bffff700 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575cb4a4e30 0x5575cb4a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11bffff700 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575cb4a4e30 0x5575cb4a1270 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f29f69e9b54ae500 server_cookie=659331d4af0dd55c in_seq=0 out_seq=0 2023-12-11T20:15:27.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11adffb700 10 client.15315 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:15:27.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11adffb700 1 -- 172.21.15.12:0/4196472302 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5575cb34ef80 con 0x5575cb4a4e30 2023-12-11T20:15:27.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11adffb700 10 client.15315 handle_command_reply: tid=0 2023-12-11T20:15:27.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 client.15315 shutdown 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 -- 172.21.15.12:0/4196472302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 msgr2=0x5575cb442000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb442000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f11b809b380 tx=0x7f11b8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 -- 172.21.15.12:0/4196472302 shutdown_connections 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575cb4a4e30 0x5575cb4a1270 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575cb435bd0 0x5575cb49fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575cb434380 0x5575cb442000 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 --2- 172.21.15.12:0/4196472302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575cb434ce0 0x5575cb442540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11adffb700 0 client.15315 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 -- 172.21.15.12:0/4196472302 >> 172.21.15.12:0/4196472302 conn(0x5575cb363790 msgr2=0x5575cb438b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 -- 172.21.15.12:0/4196472302 shutdown_connections 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.510+0000 7f11e02f5b80 1 -- 172.21.15.12:0/4196472302 wait complete. 2023-12-11T20:15:27.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11e02f5b80 20 client.15315 trim_cache size 0 max 16384 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "732461f0-9860-11ee-95a3-87774f69a715", 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24577, 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 91.022518501999997, 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 22, 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 110.980332653 2023-12-11T20:15:27.513 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:15:27.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 -- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11b40a1500 msgr2=0x7f11b40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11b40a1500 0x7f11b40a39c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11c8075330 tx=0x7f11b0009260 comp rx=0 tx=0).stop 2023-12-11T20:15:27.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 -- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8074030 msgr2=0x7f11c819d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8074030 0x7f11c819d9e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f11b8003ec0 tx=0x7f11b80057f0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 -- 172.21.15.12:0/956448744 shutdown_connections 2023-12-11T20:15:27.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11b40a1500 0x7f11b40a39c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11c810da80 0x7f11c81a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c8074030 0x7f11c819d9e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 --2- 172.21.15.12:0/956448744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11c8075610 0x7f11c819df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 -- 172.21.15.12:0/956448744 >> 172.21.15.12:0/956448744 conn(0x7f11c80fca00 msgr2=0x7f11c8100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 -- 172.21.15.12:0/956448744 shutdown_connections 2023-12-11T20:15:27.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.511+0000 7f11cc9ff700 1 -- 172.21.15.12:0/956448744 wait complete. 2023-12-11T20:15:27.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-11T20:15:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:27 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/223710021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:27 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/134681727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:27.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 -- 172.21.15.12:0/273522367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 msgr2=0x7f8a50102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 --2- 172.21.15.12:0/273522367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 0x7f8a50102b00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8a400099c0 tx=0x7f8a40009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 -- 172.21.15.12:0/273522367 shutdown_connections 2023-12-11T20:15:27.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 --2- 172.21.15.12:0/273522367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a501014b0 0x7f8a501018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 --2- 172.21.15.12:0/273522367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a50103040 0x7f8a501098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 --2- 172.21.15.12:0/273522367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 0x7f8a50102b00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 -- 172.21.15.12:0/273522367 >> 172.21.15.12:0/273522367 conn(0x7f8a500fca00 msgr2=0x7f8a500fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 -- 172.21.15.12:0/273522367 shutdown_connections 2023-12-11T20:15:27.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.734+0000 7f8a583ff700 1 -- 172.21.15.12:0/273522367 wait complete. 2023-12-11T20:15:27.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.735+0000 7f8a583ff700 1 Processor -- start 2023-12-11T20:15:27.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.735+0000 7f8a583ff700 1 -- start start 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a583ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a501014b0 0x7f8a501973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a583ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 0x7f8a501978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a583ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a50103040 0x7f8a5019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a583ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5019ee80 con 0x7f8a501026a0 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a583ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5019efc0 con 0x7f8a50103040 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a583ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5019f150 con 0x7f8a501014b0 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a5599a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 0x7f8a501978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a5599a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 0x7f8a501978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38110/0 (socket says 172.21.15.12:38110) 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a5599a700 1 -- 172.21.15.12:0/3577941012 learned_addr learned my addr 172.21.15.12:0/3577941012 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a5619b700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a501014b0 0x7f8a501973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.736+0000 7f8a5699c700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a50103040 0x7f8a5019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a5599a700 1 -- 172.21.15.12:0/3577941012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a501014b0 msgr2=0x7f8a501973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a5599a700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a501014b0 0x7f8a501973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a5599a700 1 -- 172.21.15.12:0/3577941012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a50103040 msgr2=0x7f8a5019e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a5599a700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a50103040 0x7f8a5019e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a5599a700 1 -- 172.21.15.12:0/3577941012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400095f0 con 0x7f8a501026a0 2023-12-11T20:15:27.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a5599a700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 0x7f8a501978e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009fd0 tx=0x7f8a4000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a477fe700 1 -- 172.21.15.12:0/3577941012 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4001d070 con 0x7f8a501026a0 2023-12-11T20:15:27.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a477fe700 1 -- 172.21.15.12:0/3577941012 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a4000bd10 con 0x7f8a501026a0 2023-12-11T20:15:27.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a583ff700 1 -- 172.21.15.12:0/3577941012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5019f3d0 con 0x7f8a501026a0 2023-12-11T20:15:27.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a477fe700 1 -- 172.21.15.12:0/3577941012 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40004ae0 con 0x7f8a501026a0 2023-12-11T20:15:27.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.737+0000 7f8a583ff700 1 -- 172.21.15.12:0/3577941012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5019f7f0 con 0x7f8a501026a0 2023-12-11T20:15:27.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.741+0000 7f8a477fe700 1 -- 172.21.15.12:0/3577941012 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8a40004c40 con 0x7f8a501026a0 2023-12-11T20:15:27.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.742+0000 7f8a6bc73b80 1 Processor -- start 2023-12-11T20:15:27.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a6bc73b80 1 -- start start 2023-12-11T20:15:27.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a477fe700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a3c0a1480 0x7f8a3c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312e47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d3312e6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33123fb00 con 0x55d3312e5bd0 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33123d420 con 0x55d3312e4380 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d331238d10 con 0x55d3312e4ce0 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.743+0000 7f8a477fe700 1 -- 172.21.15.12:0/3577941012 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a400cdb20 con 0x7f8a501026a0 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5699c700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a3c0a1480 0x7f8a3c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d3312e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5619b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312e47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41294/0 (socket says 172.21.15.12:41294) 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5619b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312e47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:33720/0 (socket says 172.21.15.12:33720) 2023-12-11T20:15:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d3312e6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38112/0 (socket says 172.21.15.12:38112) 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 -- 172.21.15.12:0/976463661 learned_addr learned my addr 172.21.15.12:0/976463661 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 -- 172.21.15.12:0/976463661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 msgr2=0x55d3312e47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 --2- 172.21.15.12:0/976463661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312e47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 -- 172.21.15.12:0/976463661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 msgr2=0x55d3312e6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 --2- 172.21.15.12:0/976463661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d3312e6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 -- 172.21.15.12:0/976463661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3310b55e0 con 0x55d3312e4ce0 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5699c700 1 --2- 172.21.15.12:0/976463661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d3312e6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5699c700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a3c0a1480 0x7f8a3c0a3940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a48007b70 tx=0x7f8a48009c70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.744+0000 7f8a5599a700 1 --2- 172.21.15.12:0/976463661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e55f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a4009adb0 tx=0x7f8a40009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0046639e198a0a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a44bfe700 1 -- 172.21.15.12:0/976463661 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4009a780 con 0x55d3312e4ce0 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a44bfe700 1 -- 172.21.15.12:0/976463661 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a40090840 con 0x55d3312e4ce0 2023-12-11T20:15:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a44bfe700 1 -- 172.21.15.12:0/976463661 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400cb680 con 0x55d3312e4ce0 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/976463661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 msgr2=0x55d3312e55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/976463661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e55f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a4009adb0 tx=0x7f8a40009580 comp rx=0 tx=0).stop 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/976463661 shutdown_connections 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/976463661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312e47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/976463661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d3312e6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/976463661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e55f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/976463661 >> 172.21.15.12:0/976463661 conn(0x55d331213790 msgr2=0x55d3312e0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.745+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/976463661 shutdown_connections 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.746+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/976463661 wait complete. 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.746+0000 7f8a6bc73b80 1 -- start start 2023-12-11T20:15:27.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.746+0000 7f8a6bc73b80 1 Processor -- start 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ede60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312ee3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3311f2510 con 0x55d3312e4380 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3311f21b0 con 0x55d3312e5bd0 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3310b78d0 con 0x55d3312e4ce0 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a6bc73b80 10 client.0 _ll_register_callbacks cb 0x55d33111da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ede60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38122/0 (socket says 172.21.15.12:38122) 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5619b700 1 -- 172.21.15.12:0/4015768994 learned_addr learned my addr 172.21.15.12:0/4015768994 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5699c700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5599a700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312ee3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5619b700 1 -- 172.21.15.12:0/4015768994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 msgr2=0x55d3312ee3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5619b700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312ee3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5619b700 1 -- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 msgr2=0x55d3312f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5619b700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5619b700 1 -- 172.21.15.12:0/4015768994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a48011040 con 0x55d3312e4380 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5599a700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312ee3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.747+0000 7f8a5699c700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a5619b700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ede60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0117c0 tx=0x7f8a4c011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ae4791df00bc0b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4015768994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c016070 con 0x55d3312e4380 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4015768994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a4c004320 con 0x55d3312e4380 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4015768994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3312d7af0 con 0x55d3312e4380 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4015768994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a4c0044e0 con 0x55d3312e4380 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a6bc73b80 10 client.15327 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4015768994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f8a5019f7f0 con 0x55d3312e4380 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.748+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4015768994 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a4c029080 con 0x55d3312e4380 2023-12-11T20:15:27.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.749+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4015768994 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a4c00f900 con 0x55d3312e4380 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.749+0000 7f8a6bc73b80 10 client.15327 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.749+0000 7f8a6bc73b80 10 client.15327 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.749+0000 7f8a6bc73b80 20 client.15327 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.749+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d3312f9b50 0x55d3312f8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.749+0000 7f8a6bc73b80 4 client.15327 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.749+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4015768994 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3312b3ef0 con 0x55d3312f9b50 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.749+0000 7f8a5599a700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d3312f9b50 0x55d3312f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.750+0000 7f8a5599a700 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d3312f9b50 0x55d3312f8630 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca3cb45185eb837 server_cookie=6c9d1896c8ffd6a8 in_seq=0 out_seq=0 2023-12-11T20:15:27.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.750+0000 7f8a39ffb700 10 client.15327 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:27.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4015768994 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d3312b3ef0 con 0x55d3312f9b50 2023-12-11T20:15:27.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a39ffb700 10 client.15327 handle_command_reply: tid=0 2023-12-11T20:15:27.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 client.15327 shutdown 2023-12-11T20:15:27.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4015768994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 msgr2=0x55d3312ede60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ede60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0117c0 tx=0x7f8a4c011b80 comp rx=0 tx=0).stop 2023-12-11T20:15:27.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4015768994 shutdown_connections 2023-12-11T20:15:27.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d3312f9b50 0x55d3312f8630 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ede60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a39ffb700 0 client.15327 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:27.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4015768994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312ee3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4015768994 >> 172.21.15.12:0/4015768994 conn(0x55d331213790 msgr2=0x55d3312df9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4015768994 shutdown_connections 2023-12-11T20:15:27.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4015768994 wait complete. 2023-12-11T20:15:27.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.751+0000 7f8a6bc73b80 20 client.15327 trim_cache size 0 max 16384 2023-12-11T20:15:27.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.770+0000 7f8a6bc73b80 1 Processor -- start 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.770+0000 7f8a6bc73b80 1 -- start start 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.770+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.770+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.770+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.770+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3311ddb50 con 0x55d3312e4380 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.770+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3311d4360 con 0x55d3312e5bd0 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.770+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3311db830 con 0x55d3312e4ce0 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ec440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38132/0 (socket says 172.21.15.12:38132) 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 -- 172.21.15.12:0/607645972 learned_addr learned my addr 172.21.15.12:0/607645972 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5599a700 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5699c700 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 -- 172.21.15.12:0/607645972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 msgr2=0x55d3312e1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 -- 172.21.15.12:0/607645972 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 msgr2=0x55d3312f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 -- 172.21.15.12:0/607645972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d331061d90 con 0x55d3312e4380 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5599a700 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a5619b700 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ec440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009950 tx=0x7f8a4c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d7f9416cfd550c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.771+0000 7f8a453ff700 1 -- 172.21.15.12:0/607645972 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c016030 con 0x55d3312e4380 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a453ff700 1 -- 172.21.15.12:0/607645972 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d3312d7af0 con 0x55d3312e4380 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a453ff700 1 -- 172.21.15.12:0/607645972 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c003a00 con 0x55d3312e4380 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/607645972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 msgr2=0x55d3312ec440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ec440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009950 tx=0x7f8a4c00f3c0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/607645972 shutdown_connections 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e5bd0 0x55d3312f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e4380 0x55d3312ec440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/607645972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312e1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/607645972 >> 172.21.15.12:0/607645972 conn(0x55d331213790 msgr2=0x55d3312e0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/607645972 shutdown_connections 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.772+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/607645972 wait complete. 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 1 -- start start 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 1 Processor -- start 2023-12-11T20:15:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312f2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d33134fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3312f5490 con 0x55d3312e5bd0 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3312f5600 con 0x55d3312e4380 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3312f57c0 con 0x55d3312e4ce0 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.773+0000 7f8a6bc73b80 10 client.0 _ll_register_callbacks cb 0x55d33111da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d33134fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5619b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d33134fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38140/0 (socket says 172.21.15.12:38140) 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 -- 172.21.15.12:0/4026745791 learned_addr learned my addr 172.21.15.12:0/4026745791 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5599a700 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 -- 172.21.15.12:0/4026745791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 msgr2=0x55d3312f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 -- 172.21.15.12:0/4026745791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 msgr2=0x55d3312f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 -- 172.21.15.12:0/4026745791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3310b55e0 con 0x55d3312e5bd0 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5619b700 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a5699c700 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d33134fc10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a48019650 tx=0x7f8a48009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb64441859f9d5d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.774+0000 7f8a39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4026745791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48007500 con 0x55d3312e5bd0 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4026745791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a40090840 con 0x55d3312e5bd0 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4026745791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a4801bda0 con 0x55d3312e5bd0 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4026745791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a48004bb0 con 0x55d3312e5bd0 2023-12-11T20:15:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 10 client.15333 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4026745791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f8a5019f7f0 con 0x55d3312e5bd0 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4026745791 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a40090840 con 0x55d3312e5bd0 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4026745791 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a48023050 con 0x55d3312e5bd0 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 10 client.15333 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 10 client.15333 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 20 client.15333 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d331355420 0x55d331351860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 4 client.15333 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.775+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4026745791 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d3311fef80 con 0x55d331355420 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.776+0000 7f8a5619b700 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d331355420 0x55d331351860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a5619b700 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d331355420 0x55d331351860 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f39a31de5490e3 server_cookie=25215367c950bbcd in_seq=0 out_seq=0 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a39ffb700 10 client.15333 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a39ffb700 1 -- 172.21.15.12:0/4026745791 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55d3311fef80 con 0x55d331355420 2023-12-11T20:15:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a39ffb700 10 client.15333 handle_command_reply: tid=0 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 client.15333 shutdown 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4026745791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 msgr2=0x55d33134fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d33134fc10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a48019650 tx=0x7f8a48009100 comp rx=0 tx=0).stop 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4026745791 shutdown_connections 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d331355420 0x55d331351860 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d3312e4380 0x55d3312f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d3312e5bd0 0x55d33134fc10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a39ffb700 0 client.15333 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 --2- 172.21.15.12:0/4026745791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d3312e4ce0 0x55d3312f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4026745791 >> 172.21.15.12:0/4026745791 conn(0x55d331213790 msgr2=0x55d3312f8630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4026745791 shutdown_connections 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 1 -- 172.21.15.12:0/4026745791 wait complete. 2023-12-11T20:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.777+0000 7f8a6bc73b80 20 client.15333 trim_cache size 0 max 16384 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "732461f0-9860-11ee-95a3-87774f69a715", 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24620, 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 94.309032760999997, 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 22, 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 101.68342683 2023-12-11T20:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:15:27.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 -- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a3c0a1480 msgr2=0x7f8a3c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a3c0a1480 0x7f8a3c0a3940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a48007b70 tx=0x7f8a48009c70 comp rx=0 tx=0).stop 2023-12-11T20:15:27.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 -- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 msgr2=0x7f8a501978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:27.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 0x7f8a501978e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009fd0 tx=0x7f8a4000fa00 comp rx=0 tx=0).stop 2023-12-11T20:15:27.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 -- 172.21.15.12:0/3577941012 shutdown_connections 2023-12-11T20:15:27.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a3c0a1480 0x7f8a3c0a3940 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a50103040 0x7f8a5019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a501014b0 0x7f8a501973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 --2- 172.21.15.12:0/3577941012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a501026a0 0x7f8a501978e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 -- 172.21.15.12:0/3577941012 >> 172.21.15.12:0/3577941012 conn(0x7f8a500fca00 msgr2=0x7f8a50105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 -- 172.21.15.12:0/3577941012 shutdown_connections 2023-12-11T20:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:27.778+0000 7f8a583ff700 1 -- 172.21.15.12:0/3577941012 wait complete. 2023-12-11T20:15:27.794 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-11T20:15:27.820 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-11T20:15:27.821 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-11T20:15:27.821 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2023-12-11T20:15:27.821 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-11T20:15:27.821 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:27.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:27.821 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-12-11T20:15:27.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:27.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-12-11T20:15:27.979 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2023-12-11T20:15:27.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T20:15:27.982 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-11T20:15:27.983 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph fs ls 2023-12-11T20:15:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:28 smithi012 ceph-mon[128787]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:15:28.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:28 smithi032 ceph-mon[132488]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:15:28.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:28 smithi039 ceph-mon[102205]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:15:28.773 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:15:29.322 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:29 smithi012 ceph-mon[128787]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:15:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:29 smithi039 ceph-mon[102205]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:15:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:29 smithi032 ceph-mon[132488]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:15:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 -- 172.21.15.12:0/1699061537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82601076f0 msgr2=0x7f8260107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 --2- 172.21.15.12:0/1699061537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82601076f0 0x7f8260107ad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8250009990 tx=0x7f8250009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 -- 172.21.15.12:0/1699061537 shutdown_connections 2023-12-11T20:15:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 --2- 172.21.15.12:0/1699061537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8260102040 0x7f826010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 --2- 172.21.15.12:0/1699061537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82601076f0 0x7f8260107ad0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 --2- 172.21.15.12:0/1699061537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8260101680 0x7f8260101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 -- 172.21.15.12:0/1699061537 >> 172.21.15.12:0/1699061537 conn(0x7f82600787c0 msgr2=0x7f8260078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 -- 172.21.15.12:0/1699061537 shutdown_connections 2023-12-11T20:15:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.207+0000 7f826653c700 1 -- 172.21.15.12:0/1699061537 wait complete. 2023-12-11T20:15:30.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.208+0000 7f826653c700 1 Processor -- start 2023-12-11T20:15:30.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.208+0000 7f826653c700 1 -- start start 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f826653c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8260101680 0x7f8260199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f826653c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8260102040 0x7f8260199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f826653c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82601076f0 0x7f826019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f826653c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826019e930 con 0x7f8260102040 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f826653c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826019eaa0 con 0x7f82601076f0 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f826653c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826019ec60 con 0x7f8260101680 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8260102040 0x7f8260199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8260102040 0x7f8260199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59078/0 (socket says 172.21.15.12:59078) 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825f7fe700 1 -- 172.21.15.12:0/1107240129 learned_addr learned my addr 172.21.15.12:0/1107240129 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f8264ad9700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82601076f0 0x7f826019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825ffff700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8260101680 0x7f8260199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825f7fe700 1 -- 172.21.15.12:0/1107240129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8260101680 msgr2=0x7f8260199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825f7fe700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8260101680 0x7f8260199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825f7fe700 1 -- 172.21.15.12:0/1107240129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82601076f0 msgr2=0x7f826019e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825f7fe700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82601076f0 0x7f826019e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.209+0000 7f825f7fe700 1 -- 172.21.15.12:0/1107240129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82500095f0 con 0x7f8260102040 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.210+0000 7f825f7fe700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8260102040 0x7f8260199f80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f825400e9a0 tx=0x7f825400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.210+0000 7f825d7fa700 1 -- 172.21.15.12:0/1107240129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254009790 con 0x7f8260102040 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.210+0000 7f825d7fa700 1 -- 172.21.15.12:0/1107240129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8254010430 con 0x7f8260102040 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.210+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826019ef40 con 0x7f8260102040 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.210+0000 7f825d7fa700 1 -- 172.21.15.12:0/1107240129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400cea0 con 0x7f8260102040 2023-12-11T20:15:30.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.210+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82601a67e0 con 0x7f8260102040 2023-12-11T20:15:30.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.211+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8260104940 con 0x7f8260102040 2023-12-11T20:15:30.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.213+0000 7f825d7fa700 1 -- 172.21.15.12:0/1107240129 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f82540105a0 con 0x7f8260102040 2023-12-11T20:15:30.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.214+0000 7f825d7fa700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82480a1480 0x7f82480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:30.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.215+0000 7f825d7fa700 1 -- 172.21.15.12:0/1107240129 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8254014070 con 0x7f8260102040 2023-12-11T20:15:30.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.215+0000 7f825ffff700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82480a1480 0x7f82480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:30.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.215+0000 7f825ffff700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82480a1480 0x7f82480a3940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8250006010 tx=0x7f825000b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.219+0000 7f825d7fa700 1 -- 172.21.15.12:0/1107240129 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f82540522f0 con 0x7f8260102040 2023-12-11T20:15:30.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.474+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f826019ad50 con 0x7f8260102040 2023-12-11T20:15:30.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.474+0000 7f825d7fa700 1 -- 172.21.15.12:0/1107240129 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7f82540d1070 con 0x7f8260102040 2023-12-11T20:15:30.473 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-11T20:15:30.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82480a1480 msgr2=0x7f82480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82480a1480 0x7f82480a3940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8250006010 tx=0x7f825000b260 comp rx=0 tx=0).stop 2023-12-11T20:15:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8260102040 msgr2=0x7f8260199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8260102040 0x7f8260199f80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f825400e9a0 tx=0x7f825400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 shutdown_connections 2023-12-11T20:15:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82480a1480 0x7f82480a3940 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82601076f0 0x7f826019e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8260101680 0x7f8260199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 --2- 172.21.15.12:0/1107240129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8260102040 0x7f8260199f80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 >> 172.21.15.12:0/1107240129 conn(0x7f82600787c0 msgr2=0x7f826010ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 shutdown_connections 2023-12-11T20:15:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:30.477+0000 7f826653c700 1 -- 172.21.15.12:0/1107240129 wait complete. 2023-12-11T20:15:30.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:30 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1107240129' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-11T20:15:30.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:30 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1107240129' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-11T20:15:30.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:30 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1107240129' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-11T20:15:30.965 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-11T20:15:30.965 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-11T20:15:30.965 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-12-11T20:15:30.965 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-11T20:15:30.965 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:30.965 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-11T20:15:30.965 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-11T20:15:30.965 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-11T20:15:30.966 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-11T20:15:30.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:30.966 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-12-11T20:15:31.012 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T20:15:31.012 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T20:15:31.012 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-11T20:15:31.013 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 41438sec preferred_lft 41438sec 2023-12-11T20:15:31.014 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2023-12-11T20:15:31.014 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-12-11T20:15:31.014 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T20:15:31.014 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-12-11T20:15:31.014 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-12-11T20:15:31.014 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-11T20:15:31.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:31.015 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-12-11T20:15:31.015 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-12-11T20:15:31.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2023-12-11T20:15:31.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2023-12-11T20:15:31.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2023-12-11T20:15:31.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-11T20:15:31.015 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-12-11T20:15:31.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:31.493 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-11T20:15:31.567 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-12-11T20:15:31.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:31.571 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-12-11T20:15:31.632 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-12-11T20:15:31.632 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-11T20:15:31.632 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-11T20:15:31.632 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-11T20:15:31.632 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-11T20:15:31.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:31.633 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-12-11T20:15:31.633 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-12-11T20:15:31.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-11T20:15:31.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-11T20:15:31.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-11T20:15:31.633 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-12-11T20:15:31.738 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:31 smithi012 ceph-mon[128787]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:15:31.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:31 smithi039 ceph-mon[102205]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:15:31.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:31 smithi032 ceph-mon[132488]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:15:32.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:32.350 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-12-11T20:15:32.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:32.395 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2023-12-11T20:15:32.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:32.480 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-12-11T20:15:32.480 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-12-11T20:15:32.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T20:15:32.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-11T20:15:32.480 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-12-11T20:15:32.668 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-11T20:15:32.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:32.668 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-12-11T20:15:32.668 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-12-11T20:15:32.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-11T20:15:32.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-11T20:15:32.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-11T20:15:32.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-11T20:15:32.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-11T20:15:32.668 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-12-11T20:15:32.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:32.952 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-12-11T20:15:32.952 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-12-11T20:15:32.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-12-11T20:15:32.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2023-12-11T20:15:32.952 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-12-11T20:15:33.128 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2023-12-11T20:15:33.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T20:15:33.128 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:33.172 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-11T20:15:33.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T20:15:33.173 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:33.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2023-12-11T20:15:33.369 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2023-12-11T20:15:33.414 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2023-12-11T20:15:33.414 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2023-12-11T20:15:33.414 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2023-12-11T20:15:33.414 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2023-12-11T20:15:33.414 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2023-12-11T20:15:33.414 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2023-12-11T20:15:33.414 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/systemd 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/blkio 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/perf_event 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/pids 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/hugetlb 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/cpuset 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/devices 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/freezer 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/memory 2023-12-11T20:15:33.415 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay 2023-12-11T20:15:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/5c0622825a49292769e417bc31915bcfe920aa262982259da746e4347c7ef89e/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/4aea5a483da190b3680f58df6a0917eccda00a13775759bd463e94df284a9e7a/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/0 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/8f8a19a91f4d943dbacdeb9c3e1822611fd12d6fb2f9f2653ebd0c4acc819a66/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/8c8c0c36a93f5ab8f8aff80991d45c09377ed35e62c6c014253df34725da5f5f/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/90bc8f620c2b49e86468ebd2c0a0ccb8c036f9922743512d7d729c63330139eb/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/7300c489ee478dff5954f93a1735755919887aea87e82a29f5218053f1f95508/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/9c2dd3562789db084bcd3753d5afa2f346f4e0b36e547774d7cf2b412133c62d/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/882504e71681ef5534ec6b540c948ccbf76b866e491b3a006a69c1a3bea7d004/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/060e759fa8a246de643276070ef94f9621d81b8cb2dfdc7b8d8dd2b541791218/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/5e5bf18b736aa25b3bc9ab1ffbd6a713cef9d61f0ebdc4aeb19a87ca11fcbab6/merged 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T20:15:33.417 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T20:15:33.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:33.419 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2023-12-11T20:15:33.503 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-11T20:15:33.503 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b --client_fs=cephfs) 2023-12-11T20:15:33.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2023-12-11T20:15:33.619 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2023-12-11T20:15:33.665 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/systemd 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/blkio 2023-12-11T20:15:33.666 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/perf_event 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/pids 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/hugetlb 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/cpuset 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/devices 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/freezer 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/memory 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2023-12-11T20:15:33.667 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/5c0622825a49292769e417bc31915bcfe920aa262982259da746e4347c7ef89e/merged 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/4aea5a483da190b3680f58df6a0917eccda00a13775759bd463e94df284a9e7a/merged 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/0 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/8f8a19a91f4d943dbacdeb9c3e1822611fd12d6fb2f9f2653ebd0c4acc819a66/merged 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/8c8c0c36a93f5ab8f8aff80991d45c09377ed35e62c6c014253df34725da5f5f/merged 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/90bc8f620c2b49e86468ebd2c0a0ccb8c036f9922743512d7d729c63330139eb/merged 2023-12-11T20:15:33.668 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/7300c489ee478dff5954f93a1735755919887aea87e82a29f5218053f1f95508/merged 2023-12-11T20:15:33.669 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/9c2dd3562789db084bcd3753d5afa2f346f4e0b36e547774d7cf2b412133c62d/merged 2023-12-11T20:15:33.669 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/882504e71681ef5534ec6b540c948ccbf76b866e491b3a006a69c1a3bea7d004/merged 2023-12-11T20:15:33.669 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/060e759fa8a246de643276070ef94f9621d81b8cb2dfdc7b8d8dd2b541791218/merged 2023-12-11T20:15:33.669 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/5e5bf18b736aa25b3bc9ab1ffbd6a713cef9d61f0ebdc4aeb19a87ca11fcbab6/merged 2023-12-11T20:15:33.669 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2023-12-11T20:15:33.669 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T20:15:33.669 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T20:15:33.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:33.671 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2023-12-11T20:15:33.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:2023-12-11T20:15:33.761+0000 7f99e99865c0 -1 init, newargv = 0x56215dad7cd0 newargc=15 2023-12-11T20:15:33.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[190277]: starting ceph client 2023-12-11T20:15:33.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[190277]: starting fuse 2023-12-11T20:15:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:34 smithi032 ceph-mon[132488]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:34 smithi039 ceph-mon[102205]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:34.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:34 smithi012 ceph-mon[128787]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:15:34.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2023-12-11T20:15:34.895 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/systemd 2023-12-11T20:15:34.942 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/blkio 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/perf_event 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/pids 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/hugetlb 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/cpuset 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/devices 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/freezer 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup/memory 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2023-12-11T20:15:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/5c0622825a49292769e417bc31915bcfe920aa262982259da746e4347c7ef89e/merged 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/4aea5a483da190b3680f58df6a0917eccda00a13775759bd463e94df284a9e7a/merged 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/0 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/8f8a19a91f4d943dbacdeb9c3e1822611fd12d6fb2f9f2653ebd0c4acc819a66/merged 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/8c8c0c36a93f5ab8f8aff80991d45c09377ed35e62c6c014253df34725da5f5f/merged 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/90bc8f620c2b49e86468ebd2c0a0ccb8c036f9922743512d7d729c63330139eb/merged 2023-12-11T20:15:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/7300c489ee478dff5954f93a1735755919887aea87e82a29f5218053f1f95508/merged 2023-12-11T20:15:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/9c2dd3562789db084bcd3753d5afa2f346f4e0b36e547774d7cf2b412133c62d/merged 2023-12-11T20:15:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/882504e71681ef5534ec6b540c948ccbf76b866e491b3a006a69c1a3bea7d004/merged 2023-12-11T20:15:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/060e759fa8a246de643276070ef94f9621d81b8cb2dfdc7b8d8dd2b541791218/merged 2023-12-11T20:15:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/containers/storage/overlay/5e5bf18b736aa25b3bc9ab1ffbd6a713cef9d61f0ebdc4aeb19a87ca11fcbab6/merged 2023-12-11T20:15:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2023-12-11T20:15:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T20:15:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T20:15:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:34.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:34.946 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2023-12-11T20:15:34.990 INFO:teuthology.orchestra.run.smithi012.stdout:121 2023-12-11T20:15:34.990 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-12-11T20:15:34.990 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2023-12-11T20:15:34.990 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> import re 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> import os 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2023-12-11T20:15:34.991 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> return f 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2023-12-11T20:15:34.992 DEBUG:teuthology.orchestra.run.smithi012:> ' 2023-12-11T20:15:35.175 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.190277.asok 2023-12-11T20:15:35.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-11T20:15:35.189 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.190277.asok 2023-12-11T20:15:35.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:35.189 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.190277.asok status 2023-12-11T20:15:35.420 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "a62fda73efba5520d409bb5a21bd8373289dda5d", 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "0", 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "190277", 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b" 2023-12-11T20:15:35.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 15345, 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 15345 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2023-12-11T20:15:35.422 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 865215947 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 865215947 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.15345 192.168.0.1:0/865215947", 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/865215947", 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 5, 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 22, 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 89, 2023-12-11T20:15:35.423 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2023-12-11T20:15:35.424 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2023-12-11T20:15:35.424 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2023-12-11T20:15:35.424 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:15:35.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:35.436 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2023-12-11T20:15:35.436 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:35.481 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2023-12-11T20:15:35.481 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:35.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:15:35.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:35.593 INFO:teuthology.run_tasks:Running task check-counter... 2023-12-11T20:15:35.604 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-12-11T20:15:35.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:15:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.842+0000 7fe91cbff700 1 -- 172.21.15.12:0/3518380855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe918109370 msgr2=0x7fe91810b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:35.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.842+0000 7fe91cbff700 1 --2- 172.21.15.12:0/3518380855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe918109370 0x7fe91810b7e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe91000b0a0 tx=0x7fe91000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.842+0000 7fe91cbff700 1 -- 172.21.15.12:0/3518380855 shutdown_connections 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.842+0000 7fe91cbff700 1 --2- 172.21.15.12:0/3518380855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe918109370 0x7fe91810b7e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.842+0000 7fe91cbff700 1 --2- 172.21.15.12:0/3518380855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9180755b0 0x7fe918073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.842+0000 7fe91cbff700 1 --2- 172.21.15.12:0/3518380855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe918073fd0 0x7fe918074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.842+0000 7fe91cbff700 1 -- 172.21.15.12:0/3518380855 >> 172.21.15.12:0/3518380855 conn(0x7fe9180fca10 msgr2=0x7fe9180fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.843+0000 7fe91cbff700 1 -- 172.21.15.12:0/3518380855 shutdown_connections 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.843+0000 7fe91cbff700 1 -- 172.21.15.12:0/3518380855 wait complete. 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.844+0000 7fe91cbff700 1 Processor -- start 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.844+0000 7fe91cbff700 1 -- start start 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe91cbff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe918073fd0 0x7fe918199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe91cbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180755b0 0x7fe918199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe91cbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe918109370 0x7fe9181a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe91cbff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181a1140 con 0x7fe9180755b0 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe91cbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181a1280 con 0x7fe918109370 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe91cbff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181a1410 con 0x7fe918073fd0 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe915d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180755b0 0x7fe918199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe915d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180755b0 0x7fe918199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59098/0 (socket says 172.21.15.12:59098) 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe915d9b700 1 -- 172.21.15.12:0/457481997 learned_addr learned my addr 172.21.15.12:0/457481997 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe91659c700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe918073fd0 0x7fe918199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe916d9d700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe918109370 0x7fe9181a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe915d9b700 1 -- 172.21.15.12:0/457481997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe918073fd0 msgr2=0x7fe918199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe915d9b700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe918073fd0 0x7fe918199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe915d9b700 1 -- 172.21.15.12:0/457481997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe918109370 msgr2=0x7fe9181a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe915d9b700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe918109370 0x7fe9181a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe915d9b700 1 -- 172.21.15.12:0/457481997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009d00 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe916d9d700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe918109370 0x7fe9181a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.845+0000 7fe91659c700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe918073fd0 0x7fe918199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.846+0000 7fe915d9b700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180755b0 0x7fe918199b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00d950 tx=0x7fe90c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.846+0000 7fe9077fe700 1 -- 172.21.15.12:0/457481997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c009b40 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.846+0000 7fe9077fe700 1 -- 172.21.15.12:0/457481997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe90c009ca0 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.846+0000 7fe9077fe700 1 -- 172.21.15.12:0/457481997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c00f620 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.846+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9181a16f0 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.846+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9181a1c00 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.847+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe918108180 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.849+0000 7fe9077fe700 1 -- 172.21.15.12:0/457481997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe90c010460 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.851+0000 7fe9077fe700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9000a1500 0x7fe9000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.852+0000 7fe9077fe700 1 -- 172.21.15.12:0/457481997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe90c0cd0d0 con 0x7fe9180755b0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.852+0000 7fe91659c700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9000a1500 0x7fe9000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.852+0000 7fe91659c700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9000a1500 0x7fe9000a39c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe908005950 tx=0x7fe9080058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:35.856+0000 7fe9077fe700 1 -- 172.21.15.12:0/457481997 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe90c096680 con 0x7fe9180755b0 2023-12-11T20:15:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.071+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe918068330 con 0x7fe9180755b0 2023-12-11T20:15:36.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.073+0000 7fe9077fe700 1 -- 172.21.15.12:0/457481997 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7fe90c099ca0 con 0x7fe9180755b0 2023-12-11T20:15:36.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:36.075 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9000a1500 msgr2=0x7fe9000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9000a1500 0x7fe9000a39c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe908005950 tx=0x7fe9080058e0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180755b0 msgr2=0x7fe918199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180755b0 0x7fe918199b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00d950 tx=0x7fe90c00dd10 comp rx=0 tx=0).stop 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 shutdown_connections 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9000a1500 0x7fe9000a39c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe918109370 0x7fe9181a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe918073fd0 0x7fe918199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 --2- 172.21.15.12:0/457481997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9180755b0 0x7fe918199b50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 >> 172.21.15.12:0/457481997 conn(0x7fe9180fca10 msgr2=0x7fe9181052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 shutdown_connections 2023-12-11T20:15:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.076+0000 7fe91cbff700 1 -- 172.21.15.12:0/457481997 wait complete. 2023-12-11T20:15:36.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:15:36.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:15:36.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.308+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/1607923331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41026a0 msgr2=0x7f9dd4102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.308+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/1607923331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41026a0 0x7f9dd4102b00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40099c0 tx=0x7f9dc4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.308+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/1607923331 shutdown_connections 2023-12-11T20:15:36.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.308+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/1607923331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dd41014b0 0x7f9dd41018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.308+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/1607923331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd4103040 0x7f9dd41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.308+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/1607923331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41026a0 0x7f9dd4102b00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.308+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/1607923331 >> 172.21.15.12:0/1607923331 conn(0x7f9dd40fca00 msgr2=0x7f9dd40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:36.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.309+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/1607923331 shutdown_connections 2023-12-11T20:15:36.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.309+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/1607923331 wait complete. 2023-12-11T20:15:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.309+0000 7f9ddc1ff700 1 Processor -- start 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9ddc1ff700 1 -- start start 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9ddc1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41014b0 0x7f9dd4197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9ddc1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd41026a0 0x7f9dd41978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9ddc1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dd4103040 0x7f9dd419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9ddc1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd419eec0 con 0x7f9dd41014b0 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9ddc1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd419f000 con 0x7f9dd4103040 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9ddc1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd419f190 con 0x7f9dd41026a0 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9dd9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41014b0 0x7f9dd4197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9dd9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41014b0 0x7f9dd4197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59114/0 (socket says 172.21.15.12:59114) 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9dd9f9b700 1 -- 172.21.15.12:0/2306301696 learned_addr learned my addr 172.21.15.12:0/2306301696 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9dd979a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd41026a0 0x7f9dd41978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.310+0000 7f9dda79c700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dd4103040 0x7f9dd419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:36.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dd9f9b700 1 -- 172.21.15.12:0/2306301696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd41026a0 msgr2=0x7f9dd41978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dd9f9b700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd41026a0 0x7f9dd41978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dd9f9b700 1 -- 172.21.15.12:0/2306301696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dd4103040 msgr2=0x7f9dd419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dd9f9b700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dd4103040 0x7f9dd419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dd9f9b700 1 -- 172.21.15.12:0/2306301696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc40095f0 con 0x7f9dd41014b0 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dd9f9b700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41014b0 0x7f9dd4197390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c990 tx=0x7f9dd000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dcaffd700 1 -- 172.21.15.12:0/2306301696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0007b00 con 0x7f9dd41014b0 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dcaffd700 1 -- 172.21.15.12:0/2306301696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9dd0007c60 con 0x7f9dd41014b0 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd419f470 con 0x7f9dd41014b0 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9dcaffd700 1 -- 172.21.15.12:0/2306301696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0018660 con 0x7f9dd41014b0 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.311+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd419f980 con 0x7f9dd41014b0 2023-12-11T20:15:36.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.312+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd4108980 con 0x7f9dd41014b0 2023-12-11T20:15:36.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.314+0000 7f9dcaffd700 1 -- 172.21.15.12:0/2306301696 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9dd000f450 con 0x7f9dd41014b0 2023-12-11T20:15:36.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.317+0000 7f9dcaffd700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9dc00a1480 0x7f9dc00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:36.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.317+0000 7f9dcaffd700 1 -- 172.21.15.12:0/2306301696 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9dd00cccf0 con 0x7f9dd41014b0 2023-12-11T20:15:36.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.317+0000 7f9dd979a700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9dc00a1480 0x7f9dc00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:36.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.317+0000 7f9dd979a700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9dc00a1480 0x7f9dc00a3940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009990 tx=0x7f9dc4000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.321+0000 7f9dcaffd700 1 -- 172.21.15.12:0/2306301696 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9dd00962a0 con 0x7f9dd41014b0 2023-12-11T20:15:36.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:36 smithi032 ceph-mon[132488]: pgmap v365: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-11T20:15:36.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:36 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/457481997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:36.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.535+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9dd410cef0 con 0x7f9dd41014b0 2023-12-11T20:15:36.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.536+0000 7f9dcaffd700 1 -- 172.21.15.12:0/2306301696 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9dd000fe60 con 0x7f9dd41014b0 2023-12-11T20:15:36.534 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:15:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.538+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9dc00a1480 msgr2=0x7f9dc00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.538+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9dc00a1480 0x7f9dc00a3940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009990 tx=0x7f9dc4000bc0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.538+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41014b0 msgr2=0x7f9dd4197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.538+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41014b0 0x7f9dd4197390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c990 tx=0x7f9dd000cca0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.539+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 shutdown_connections 2023-12-11T20:15:36.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.539+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9dc00a1480 0x7f9dc00a3940 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.539+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9dd4103040 0x7f9dd419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.539+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9dd41014b0 0x7f9dd4197390 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.539+0000 7f9ddc1ff700 1 --2- 172.21.15.12:0/2306301696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dd41026a0 0x7f9dd41978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.539+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 >> 172.21.15.12:0/2306301696 conn(0x7f9dd40fca00 msgr2=0x7f9dd4105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:36.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.539+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 shutdown_connections 2023-12-11T20:15:36.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.539+0000 7f9ddc1ff700 1 -- 172.21.15.12:0/2306301696 wait complete. 2023-12-11T20:15:36.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:36 smithi039 ceph-mon[102205]: pgmap v365: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-11T20:15:36.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:36 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/457481997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:36.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:36 smithi012 ceph-mon[128787]: pgmap v365: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-11T20:15:36.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:36 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/457481997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:36.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 -- 172.21.15.12:0/1457772580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 msgr2=0x7f74581098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 --2- 172.21.15.12:0/1457772580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 0x7f74581098f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f745000b0d0 tx=0x7f745000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 -- 172.21.15.12:0/1457772580 shutdown_connections 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 --2- 172.21.15.12:0/1457772580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74581014b0 0x7f74581018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 --2- 172.21.15.12:0/1457772580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 0x7f74581098f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 --2- 172.21.15.12:0/1457772580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74581026a0 0x7f7458102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 -- 172.21.15.12:0/1457772580 >> 172.21.15.12:0/1457772580 conn(0x7f74580fca00 msgr2=0x7f74580fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 -- 172.21.15.12:0/1457772580 shutdown_connections 2023-12-11T20:15:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.765+0000 7f745edff700 1 -- 172.21.15.12:0/1457772580 wait complete. 2023-12-11T20:15:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.766+0000 7f745edff700 1 Processor -- start 2023-12-11T20:15:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.766+0000 7f745edff700 1 -- start start 2023-12-11T20:15:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.766+0000 7f745edff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74581014b0 0x7f7458199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.766+0000 7f745edff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74581026a0 0x7f7458199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.766+0000 7f745edff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 0x7f74581a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.766+0000 7f745edff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581a1150 con 0x7f7458103040 2023-12-11T20:15:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.766+0000 7f745edff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581a1290 con 0x7f74581026a0 2023-12-11T20:15:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.766+0000 7f745edff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581a1420 con 0x7f74581014b0 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 0x7f74581a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 0x7f74581a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59128/0 (socket says 172.21.15.12:59128) 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 -- 172.21.15.12:0/2619840380 learned_addr learned my addr 172.21.15.12:0/2619840380 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745cb9b700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74581014b0 0x7f7458199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f7457fff700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74581026a0 0x7f7458199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 -- 172.21.15.12:0/2619840380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74581014b0 msgr2=0x7f7458199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74581014b0 0x7f7458199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 -- 172.21.15.12:0/2619840380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74581026a0 msgr2=0x7f7458199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74581026a0 0x7f7458199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 -- 172.21.15.12:0/2619840380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7450009d00 con 0x7f7458103040 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f7457fff700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74581026a0 0x7f7458199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.767+0000 7f745d39c700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 0x7f74581a0b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74500079c0 tx=0x7f745000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.768+0000 7f7455ffb700 1 -- 172.21.15.12:0/2619840380 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745000e040 con 0x7f7458103040 2023-12-11T20:15:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.768+0000 7f7455ffb700 1 -- 172.21.15.12:0/2619840380 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7450004c50 con 0x7f7458103040 2023-12-11T20:15:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.768+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74581a16a0 con 0x7f7458103040 2023-12-11T20:15:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.768+0000 7f7455ffb700 1 -- 172.21.15.12:0/2619840380 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745001b6b0 con 0x7f7458103040 2023-12-11T20:15:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.768+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74581a1b20 con 0x7f7458103040 2023-12-11T20:15:36.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.769+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7458068330 con 0x7f7458103040 2023-12-11T20:15:36.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.771+0000 7f7455ffb700 1 -- 172.21.15.12:0/2619840380 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f745001d480 con 0x7f7458103040 2023-12-11T20:15:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.772+0000 7f7455ffb700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74480a1480 0x7f74480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.772+0000 7f7455ffb700 1 -- 172.21.15.12:0/2619840380 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f74500ce670 con 0x7f7458103040 2023-12-11T20:15:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.772+0000 7f745cb9b700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74480a1480 0x7f74480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.773+0000 7f745cb9b700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74480a1480 0x7f74480a3940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7458102500 tx=0x7f744c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.776+0000 7f7455ffb700 1 -- 172.21.15.12:0/2619840380 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7450097cb0 con 0x7f7458103040 2023-12-11T20:15:36.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.990+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74581a1ee0 con 0x7f7458103040 2023-12-11T20:15:36.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.990+0000 7f7455ffb700 1 -- 172.21.15.12:0/2619840380 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f745009b2d0 con 0x7f7458103040 2023-12-11T20:15:36.988 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:15:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74480a1480 msgr2=0x7f74480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74480a1480 0x7f74480a3940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7458102500 tx=0x7f744c009260 comp rx=0 tx=0).stop 2023-12-11T20:15:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 msgr2=0x7f74581a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 0x7f74581a0b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74500079c0 tx=0x7f745000cab0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 shutdown_connections 2023-12-11T20:15:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74480a1480 0x7f74480a3940 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7458103040 0x7f74581a0b80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74581014b0 0x7f7458199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 --2- 172.21.15.12:0/2619840380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74581026a0 0x7f7458199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:36.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 >> 172.21.15.12:0/2619840380 conn(0x7f74580fca00 msgr2=0x7f7458107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:36.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 shutdown_connections 2023-12-11T20:15:36.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:36.993+0000 7f745edff700 1 -- 172.21.15.12:0/2619840380 wait complete. 2023-12-11T20:15:37.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.220+0000 7f145e5ff700 1 -- 172.21.15.12:0/105479917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581026a0 msgr2=0x7f1458102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.220+0000 7f145e5ff700 1 --2- 172.21.15.12:0/105479917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581026a0 0x7f1458102b00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f144c0099c0 tx=0x7f144c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.221+0000 7f145e5ff700 1 -- 172.21.15.12:0/105479917 shutdown_connections 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.221+0000 7f145e5ff700 1 --2- 172.21.15.12:0/105479917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1458103040 0x7f14581098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.221+0000 7f145e5ff700 1 --2- 172.21.15.12:0/105479917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14581014b0 0x7f14581018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.221+0000 7f145e5ff700 1 --2- 172.21.15.12:0/105479917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581026a0 0x7f1458102b00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.221+0000 7f145e5ff700 1 -- 172.21.15.12:0/105479917 >> 172.21.15.12:0/105479917 conn(0x7f14580fca00 msgr2=0x7f14580fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.221+0000 7f145e5ff700 1 -- 172.21.15.12:0/105479917 shutdown_connections 2023-12-11T20:15:37.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.221+0000 7f145e5ff700 1 -- 172.21.15.12:0/105479917 wait complete. 2023-12-11T20:15:37.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.222+0000 7f145e5ff700 1 Processor -- start 2023-12-11T20:15:37.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.222+0000 7f145e5ff700 1 -- start start 2023-12-11T20:15:37.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.222+0000 7f145e5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581014b0 0x7f1458075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.222+0000 7f145e5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14581026a0 0x7f14580739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.222+0000 7f145e5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1458103040 0x7f1458073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.222+0000 7f145e5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14580746a0 con 0x7f14581014b0 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.222+0000 7f145e5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458074810 con 0x7f1458103040 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.222+0000 7f145e5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14581a13a0 con 0x7f14581026a0 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581014b0 0x7f1458075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581014b0 0x7f1458075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59142/0 (socket says 172.21.15.12:59142) 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 -- 172.21.15.12:0/4062746480 learned_addr learned my addr 172.21.15.12:0/4062746480 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f14577fe700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14581026a0 0x7f14580739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f145cb9c700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1458103040 0x7f1458073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 -- 172.21.15.12:0/4062746480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14581026a0 msgr2=0x7f14580739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14581026a0 0x7f14580739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 -- 172.21.15.12:0/4062746480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1458103040 msgr2=0x7f1458073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1458103040 0x7f1458073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 -- 172.21.15.12:0/4062746480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c0095f0 con 0x7f14581014b0 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.223+0000 7f1457fff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581014b0 0x7f1458075330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f144800e970 tx=0x7f144800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.224+0000 7f14557fa700 1 -- 172.21.15.12:0/4062746480 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448009790 con 0x7f14581014b0 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.224+0000 7f14557fa700 1 -- 172.21.15.12:0/4062746480 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f144800c780 con 0x7f14581014b0 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.224+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14581a1630 con 0x7f14581014b0 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.224+0000 7f14557fa700 1 -- 172.21.15.12:0/4062746480 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448003b40 con 0x7f14581014b0 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.224+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14581a1b40 con 0x7f14581014b0 2023-12-11T20:15:37.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.225+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14581089d0 con 0x7f14581014b0 2023-12-11T20:15:37.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.227+0000 7f14557fa700 1 -- 172.21.15.12:0/4062746480 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f144800cbf0 con 0x7f14581014b0 2023-12-11T20:15:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.229+0000 7f14557fa700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14400a1480 0x7f14400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.229+0000 7f14557fa700 1 -- 172.21.15.12:0/4062746480 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1448014070 con 0x7f14581014b0 2023-12-11T20:15:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.229+0000 7f14577fe700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14400a1480 0x7f14400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:37.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.230+0000 7f14577fe700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14400a1480 0x7f14400a3940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f144c000c00 tx=0x7f144c003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.233+0000 7f14557fa700 1 -- 172.21.15.12:0/4062746480 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f14480964d0 con 0x7f14581014b0 2023-12-11T20:15:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:37 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2306301696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:37 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2619840380' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:37.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.447+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f145810ce80 con 0x7f14581014b0 2023-12-11T20:15:37.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.448+0000 7f14557fa700 1 -- 172.21.15.12:0/4062746480 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1448099af0 con 0x7f14581014b0 2023-12-11T20:15:37.446 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:15:37.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.450+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14400a1480 msgr2=0x7f14400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.450+0000 7f145e5ff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14400a1480 0x7f14400a3940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f144c000c00 tx=0x7f144c003680 comp rx=0 tx=0).stop 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.450+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581014b0 msgr2=0x7f1458075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.450+0000 7f145e5ff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581014b0 0x7f1458075330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f144800e970 tx=0x7f144800ec80 comp rx=0 tx=0).stop 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.451+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 shutdown_connections 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.451+0000 7f145e5ff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14400a1480 0x7f14400a3940 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.451+0000 7f145e5ff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1458103040 0x7f1458073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.451+0000 7f145e5ff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14581014b0 0x7f1458075330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.451+0000 7f145e5ff700 1 --2- 172.21.15.12:0/4062746480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14581026a0 0x7f14580739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.451+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 >> 172.21.15.12:0/4062746480 conn(0x7f14580fca00 msgr2=0x7f1458105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.451+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 shutdown_connections 2023-12-11T20:15:37.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.451+0000 7f145e5ff700 1 -- 172.21.15.12:0/4062746480 wait complete. 2023-12-11T20:15:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:37 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2306301696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:37 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2619840380' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:37.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:15:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:37 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2306301696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:37 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2619840380' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 -- 172.21.15.12:0/96287995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c103040 msgr2=0x7fcf3c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 --2- 172.21.15.12:0/96287995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c103040 0x7fcf3c1098f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b0d0 tx=0x7fcf3400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 -- 172.21.15.12:0/96287995 shutdown_connections 2023-12-11T20:15:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 --2- 172.21.15.12:0/96287995 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf3c1014b0 0x7fcf3c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 --2- 172.21.15.12:0/96287995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c103040 0x7fcf3c1098f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 --2- 172.21.15.12:0/96287995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf3c1026a0 0x7fcf3c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 -- 172.21.15.12:0/96287995 >> 172.21.15.12:0/96287995 conn(0x7fcf3c0fca40 msgr2=0x7fcf3c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 -- 172.21.15.12:0/96287995 shutdown_connections 2023-12-11T20:15:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.672+0000 7fcf41bff700 1 -- 172.21.15.12:0/96287995 wait complete. 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.673+0000 7fcf41bff700 1 Processor -- start 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.673+0000 7fcf41bff700 1 -- start start 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf41bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf3c1014b0 0x7fcf3c197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf41bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c1026a0 0x7fcf3c1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf41bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf3c103040 0x7fcf3c19e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf41bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c19efb0 con 0x7fcf3c1026a0 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf41bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c19f0f0 con 0x7fcf3c1014b0 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf41bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c19f280 con 0x7fcf3c103040 2023-12-11T20:15:37.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf33fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c1026a0 0x7fcf3c1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf33fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c1026a0 0x7fcf3c1979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59162/0 (socket says 172.21.15.12:59162) 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf33fff700 1 -- 172.21.15.12:0/3570448324 learned_addr learned my addr 172.21.15.12:0/3570448324 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf3b7fe700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf3c1014b0 0x7fcf3c197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf3bfff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf3c103040 0x7fcf3c19e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf33fff700 1 -- 172.21.15.12:0/3570448324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf3c103040 msgr2=0x7fcf3c19e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf33fff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf3c103040 0x7fcf3c19e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf33fff700 1 -- 172.21.15.12:0/3570448324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf3c1014b0 msgr2=0x7fcf3c197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf33fff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf3c1014b0 0x7fcf3c197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf33fff700 1 -- 172.21.15.12:0/3570448324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009d00 con 0x7fcf3c1026a0 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf3bfff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf3c103040 0x7fcf3c19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.674+0000 7fcf3b7fe700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf3c1014b0 0x7fcf3c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.675+0000 7fcf33fff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c1026a0 0x7fcf3c1979c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400d950 tx=0x7fcf2400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.675+0000 7fcf397fa700 1 -- 172.21.15.12:0/3570448324 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24009b40 con 0x7fcf3c1026a0 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.675+0000 7fcf397fa700 1 -- 172.21.15.12:0/3570448324 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf24009ca0 con 0x7fcf3c1026a0 2023-12-11T20:15:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.675+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c19f560 con 0x7fcf3c1026a0 2023-12-11T20:15:37.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.675+0000 7fcf397fa700 1 -- 172.21.15.12:0/3570448324 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400f620 con 0x7fcf3c1026a0 2023-12-11T20:15:37.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.675+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c19fac0 con 0x7fcf3c1026a0 2023-12-11T20:15:37.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.676+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c108930 con 0x7fcf3c1026a0 2023-12-11T20:15:37.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.678+0000 7fcf397fa700 1 -- 172.21.15.12:0/3570448324 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcf24010460 con 0x7fcf3c1026a0 2023-12-11T20:15:37.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.679+0000 7fcf397fa700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:37.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.679+0000 7fcf397fa700 1 -- 172.21.15.12:0/3570448324 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf240cd0d0 con 0x7fcf3c1026a0 2023-12-11T20:15:37.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.680+0000 7fcf3b7fe700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:37.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.680+0000 7fcf3b7fe700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c005fd0 tx=0x7fcf2c005f00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:37.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.683+0000 7fcf397fa700 1 -- 172.21.15.12:0/3570448324 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcf24096680 con 0x7fcf3c1026a0 2023-12-11T20:15:37.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.898+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf3c068330 con 0x7fcf3c1026a0 2023-12-11T20:15:37.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.900+0000 7fcf397fa700 1 -- 172.21.15.12:0/3570448324 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7fcf24099ca0 con 0x7fcf3c1026a0 2023-12-11T20:15:37.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:37.898 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:15:37.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.902+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 msgr2=0x7fcf280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.902+0000 7fcf41bff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c005fd0 tx=0x7fcf2c005f00 comp rx=0 tx=0).stop 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.902+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c1026a0 msgr2=0x7fcf3c1979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.902+0000 7fcf41bff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c1026a0 0x7fcf3c1979c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400d950 tx=0x7fcf2400dd10 comp rx=0 tx=0).stop 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.903+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 shutdown_connections 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.903+0000 7fcf41bff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.903+0000 7fcf41bff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf3c1014b0 0x7fcf3c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.903+0000 7fcf41bff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf3c103040 0x7fcf3c19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.903+0000 7fcf41bff700 1 --2- 172.21.15.12:0/3570448324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf3c1026a0 0x7fcf3c1979c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.903+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 >> 172.21.15.12:0/3570448324 conn(0x7fcf3c0fca40 msgr2=0x7fcf3c105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.903+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 shutdown_connections 2023-12-11T20:15:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:37.903+0000 7fcf41bff700 1 -- 172.21.15.12:0/3570448324 wait complete. 2023-12-11T20:15:37.920 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:15:37.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:15:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 -- 172.21.15.12:0/4204063324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 msgr2=0x7ff5841018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 --2- 172.21.15.12:0/4204063324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 0x7ff5841018d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff5740099c0 tx=0x7ff574009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 -- 172.21.15.12:0/4204063324 shutdown_connections 2023-12-11T20:15:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 --2- 172.21.15.12:0/4204063324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff584103040 0x7ff5841098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 --2- 172.21.15.12:0/4204063324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 0x7ff5841018d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 --2- 172.21.15.12:0/4204063324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5841026a0 0x7ff584102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 -- 172.21.15.12:0/4204063324 >> 172.21.15.12:0/4204063324 conn(0x7ff5840fca00 msgr2=0x7ff5840fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 -- 172.21.15.12:0/4204063324 shutdown_connections 2023-12-11T20:15:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.130+0000 7ff5893ff700 1 -- 172.21.15.12:0/4204063324 wait complete. 2023-12-11T20:15:38.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff5893ff700 1 Processor -- start 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff5893ff700 1 -- start start 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff5893ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 0x7ff584197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff5893ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5841026a0 0x7ff5841978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff5893ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff584103040 0x7ff58419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff5893ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419eea0 con 0x7ff5841014b0 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff5893ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419efe0 con 0x7ff584103040 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff5893ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419f170 con 0x7ff5841026a0 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.131+0000 7ff582ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 0x7ff584197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff582ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 0x7ff584197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59174/0 (socket says 172.21.15.12:59174) 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff582ffd700 1 -- 172.21.15.12:0/268999253 learned_addr learned my addr 172.21.15.12:0/268999253 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff5827fc700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5841026a0 0x7ff5841978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff5837fe700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff584103040 0x7ff58419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff582ffd700 1 -- 172.21.15.12:0/268999253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5841026a0 msgr2=0x7ff5841978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff582ffd700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5841026a0 0x7ff5841978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff582ffd700 1 -- 172.21.15.12:0/268999253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff584103040 msgr2=0x7ff58419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff582ffd700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff584103040 0x7ff58419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff582ffd700 1 -- 172.21.15.12:0/268999253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5740095f0 con 0x7ff5841014b0 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff582ffd700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 0x7ff584197370 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff574000c00 tx=0x7ff57400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff56bfff700 1 -- 172.21.15.12:0/268999253 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57401d070 con 0x7ff5841014b0 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58419f3f0 con 0x7ff5841014b0 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff56bfff700 1 -- 172.21.15.12:0/268999253 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5740054c0 con 0x7ff5841014b0 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.132+0000 7ff56bfff700 1 -- 172.21.15.12:0/268999253 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574004c70 con 0x7ff5841014b0 2023-12-11T20:15:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.133+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58419f810 con 0x7ff5841014b0 2023-12-11T20:15:38.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.134+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5841089a0 con 0x7ff5841014b0 2023-12-11T20:15:38.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.135+0000 7ff56bfff700 1 -- 172.21.15.12:0/268999253 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff574005030 con 0x7ff5841014b0 2023-12-11T20:15:38.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.138+0000 7ff56bfff700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff56c0a1480 0x7ff56c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:38.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.138+0000 7ff56bfff700 1 -- 172.21.15.12:0/268999253 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5740cdd10 con 0x7ff5841014b0 2023-12-11T20:15:38.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.138+0000 7ff5827fc700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff56c0a1480 0x7ff56c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:38.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.139+0000 7ff5827fc700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff56c0a1480 0x7ff56c0a3940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff578009bf0 tx=0x7ff578009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:38.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.140+0000 7ff56bfff700 1 -- 172.21.15.12:0/268999253 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff574097350 con 0x7ff5841014b0 2023-12-11T20:15:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:38 smithi012 ceph-mon[128787]: pgmap v366: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-11T20:15:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:38 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4062746480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:38 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3570448324' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:38.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.352+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff58410cbd0 con 0x7ff5841014b0 2023-12-11T20:15:38.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.353+0000 7ff56bfff700 1 -- 172.21.15.12:0/268999253 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff57409a970 con 0x7ff5841014b0 2023-12-11T20:15:38.351 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff56c0a1480 msgr2=0x7ff56c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff56c0a1480 0x7ff56c0a3940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff578009bf0 tx=0x7ff578009260 comp rx=0 tx=0).stop 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 msgr2=0x7ff584197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 0x7ff584197370 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff574000c00 tx=0x7ff57400f740 comp rx=0 tx=0).stop 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 shutdown_connections 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff56c0a1480 0x7ff56c0a3940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff584103040 0x7ff58419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5841014b0 0x7ff584197370 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 --2- 172.21.15.12:0/268999253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5841026a0 0x7ff5841978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 >> 172.21.15.12:0/268999253 conn(0x7ff5840fca00 msgr2=0x7ff584105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 shutdown_connections 2023-12-11T20:15:38.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.356+0000 7ff5893ff700 1 -- 172.21.15.12:0/268999253 wait complete. 2023-12-11T20:15:38.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:15:38.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:38 smithi032 ceph-mon[132488]: pgmap v366: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-11T20:15:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:38 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4062746480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:38 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3570448324' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:38 smithi039 ceph-mon[102205]: pgmap v366: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-11T20:15:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:38 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4062746480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:38 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3570448324' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2600344836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 msgr2=0x7f12c4102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2600344836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 0x7f12c4102b00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f12b80099c0 tx=0x7f12b8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2600344836 shutdown_connections 2023-12-11T20:15:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2600344836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c41014b0 0x7f12c41018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2600344836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12c4103040 0x7f12c41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2600344836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 0x7f12c4102b00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2600344836 >> 172.21.15.12:0/2600344836 conn(0x7f12c40fca00 msgr2=0x7f12c40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:38.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2600344836 shutdown_connections 2023-12-11T20:15:38.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.582+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2600344836 wait complete. 2023-12-11T20:15:38.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.583+0000 7f12ca1ff700 1 Processor -- start 2023-12-11T20:15:38.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.583+0000 7f12ca1ff700 1 -- start start 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.583+0000 7f12ca1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c41014b0 0x7f12c4197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.583+0000 7f12ca1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 0x7f12c41978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.583+0000 7f12ca1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12c4103040 0x7f12c419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.583+0000 7f12ca1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c419eea0 con 0x7f12c41026a0 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.583+0000 7f12ca1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c419efe0 con 0x7f12c41014b0 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.583+0000 7f12ca1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c419f170 con 0x7f12c4103040 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 0x7f12c41978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 0x7f12c41978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59186/0 (socket says 172.21.15.12:59186) 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 -- 172.21.15.12:0/2341484969 learned_addr learned my addr 172.21.15.12:0/2341484969 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c37fe700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c41014b0 0x7f12c4197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c3fff700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12c4103040 0x7f12c419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 -- 172.21.15.12:0/2341484969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12c4103040 msgr2=0x7f12c419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12c4103040 0x7f12c419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 -- 172.21.15.12:0/2341484969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c41014b0 msgr2=0x7f12c4197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c41014b0 0x7f12c4197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 -- 172.21.15.12:0/2341484969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80095f0 con 0x7f12c41026a0 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c2ffd700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 0x7f12c41978b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009990 tx=0x7f12b800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.584+0000 7f12c0ff9700 1 -- 172.21.15.12:0/2341484969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b801d070 con 0x7f12c41026a0 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.585+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c419f3f0 con 0x7f12c41026a0 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.585+0000 7f12c0ff9700 1 -- 172.21.15.12:0/2341484969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12b800bd10 con 0x7f12c41026a0 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.585+0000 7f12c0ff9700 1 -- 172.21.15.12:0/2341484969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8017650 con 0x7f12c41026a0 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.585+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c419f870 con 0x7f12c41026a0 2023-12-11T20:15:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.586+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c4108970 con 0x7f12c41026a0 2023-12-11T20:15:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.589+0000 7f12c0ff9700 1 -- 172.21.15.12:0/2341484969 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f12b8022470 con 0x7f12c41026a0 2023-12-11T20:15:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.591+0000 7f12c0ff9700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12ac0a1480 0x7f12ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.591+0000 7f12c0ff9700 1 -- 172.21.15.12:0/2341484969 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f12b80ce470 con 0x7f12c41026a0 2023-12-11T20:15:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.591+0000 7f12c37fe700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12ac0a1480 0x7f12ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.592+0000 7f12c37fe700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12ac0a1480 0x7f12ac0a3940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12c4102500 tx=0x7f12b4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.593+0000 7f12c0ff9700 1 -- 172.21.15.12:0/2341484969 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f12b8097ab0 con 0x7f12c41026a0 2023-12-11T20:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.803+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12c4068330 con 0x7f12c41026a0 2023-12-11T20:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.803+0000 7f12c0ff9700 1 -- 172.21.15.12:0/2341484969 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12b809b0d0 con 0x7f12c41026a0 2023-12-11T20:15:38.801 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.805+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12ac0a1480 msgr2=0x7f12ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.805+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12ac0a1480 0x7f12ac0a3940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12c4102500 tx=0x7f12b4009260 comp rx=0 tx=0).stop 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.805+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 msgr2=0x7f12c41978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.805+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 0x7f12c41978b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009990 tx=0x7f12b800fa00 comp rx=0 tx=0).stop 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.806+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 shutdown_connections 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.806+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12ac0a1480 0x7f12ac0a3940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.806+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c41014b0 0x7f12c4197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.806+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12c4103040 0x7f12c419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.806+0000 7f12ca1ff700 1 --2- 172.21.15.12:0/2341484969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c41026a0 0x7f12c41978b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.806+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 >> 172.21.15.12:0/2341484969 conn(0x7f12c40fca00 msgr2=0x7f12c4105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.806+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 shutdown_connections 2023-12-11T20:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:38.806+0000 7f12ca1ff700 1 -- 172.21.15.12:0/2341484969 wait complete. 2023-12-11T20:15:38.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:15:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.030+0000 7f947c9ff700 1 -- 172.21.15.12:0/3750549454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781014b0 msgr2=0x7f94781018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.030+0000 7f947c9ff700 1 --2- 172.21.15.12:0/3750549454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781014b0 0x7f94781018d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f94680099c0 tx=0x7f9468009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.031+0000 7f947c9ff700 1 -- 172.21.15.12:0/3750549454 shutdown_connections 2023-12-11T20:15:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.031+0000 7f947c9ff700 1 --2- 172.21.15.12:0/3750549454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9478103040 0x7f94781098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.031+0000 7f947c9ff700 1 --2- 172.21.15.12:0/3750549454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781014b0 0x7f94781018d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.031+0000 7f947c9ff700 1 --2- 172.21.15.12:0/3750549454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94781026a0 0x7f9478102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.031+0000 7f947c9ff700 1 -- 172.21.15.12:0/3750549454 >> 172.21.15.12:0/3750549454 conn(0x7f94780fca00 msgr2=0x7f94780fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.031+0000 7f947c9ff700 1 -- 172.21.15.12:0/3750549454 shutdown_connections 2023-12-11T20:15:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.031+0000 7f947c9ff700 1 -- 172.21.15.12:0/3750549454 wait complete. 2023-12-11T20:15:39.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f947c9ff700 1 Processor -- start 2023-12-11T20:15:39.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f947c9ff700 1 -- start start 2023-12-11T20:15:39.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f947c9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94781014b0 0x7f94781994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f947c9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781026a0 0x7f94781999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f947c9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9478103040 0x7f94781a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f947c9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94781a0fd0 con 0x7f94781026a0 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f947c9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94781a1110 con 0x7f94781014b0 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f947c9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94781a12a0 con 0x7f9478103040 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f9475d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781026a0 0x7f94781999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f9475d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781026a0 0x7f94781999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32984/0 (socket says 172.21.15.12:32984) 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.032+0000 7f9475d9b700 1 -- 172.21.15.12:0/138392478 learned_addr learned my addr 172.21.15.12:0/138392478 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f9476d9d700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9478103040 0x7f94781a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f947659c700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94781014b0 0x7f94781994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f9475d9b700 1 -- 172.21.15.12:0/138392478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9478103040 msgr2=0x7f94781a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f9475d9b700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9478103040 0x7f94781a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f9475d9b700 1 -- 172.21.15.12:0/138392478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94781014b0 msgr2=0x7f94781994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f9475d9b700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94781014b0 0x7f94781994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f9475d9b700 1 -- 172.21.15.12:0/138392478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680095f0 con 0x7f94781026a0 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f947659c700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94781014b0 0x7f94781994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f9475d9b700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781026a0 0x7f94781999e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f946c00c9b0 tx=0x7f946c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f94677fe700 1 -- 172.21.15.12:0/138392478 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c007b00 con 0x7f94781026a0 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94781a1580 con 0x7f94781026a0 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f94677fe700 1 -- 172.21.15.12:0/138392478 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f946c007c60 con 0x7f94781026a0 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f94677fe700 1 -- 172.21.15.12:0/138392478 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c004a30 con 0x7f94781026a0 2023-12-11T20:15:39.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.033+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94781a1ae0 con 0x7f94781026a0 2023-12-11T20:15:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.035+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9478068330 con 0x7f94781026a0 2023-12-11T20:15:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.037+0000 7f94677fe700 1 -- 172.21.15.12:0/138392478 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f946c004b90 con 0x7f94781026a0 2023-12-11T20:15:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.038+0000 7f94677fe700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94600a1480 0x7f94600a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.038+0000 7f94677fe700 1 -- 172.21.15.12:0/138392478 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f946c0ccdf0 con 0x7f94781026a0 2023-12-11T20:15:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.038+0000 7f947659c700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94600a1480 0x7f94600a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.039+0000 7f947659c700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94600a1480 0x7f94600a3940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9468003780 tx=0x7f9468000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:39.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.042+0000 7f94677fe700 1 -- 172.21.15.12:0/138392478 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f946c0963a0 con 0x7f94781026a0 2023-12-11T20:15:39.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.251+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f947810cd90 con 0x7f94781026a0 2023-12-11T20:15:39.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.251+0000 7f94677fe700 1 -- 172.21.15.12:0/138392478 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f946c0999c0 con 0x7f94781026a0 2023-12-11T20:15:39.249 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:15:39.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94600a1480 msgr2=0x7f94600a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94600a1480 0x7f94600a3940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9468003780 tx=0x7f9468000bc0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781026a0 msgr2=0x7f94781999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781026a0 0x7f94781999e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f946c00c9b0 tx=0x7f946c00ccc0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 shutdown_connections 2023-12-11T20:15:39.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94600a1480 0x7f94600a3940 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94781014b0 0x7f94781994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9478103040 0x7f94781a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 --2- 172.21.15.12:0/138392478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94781026a0 0x7f94781999e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 >> 172.21.15.12:0/138392478 conn(0x7f94780fca00 msgr2=0x7f9478073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:39.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 shutdown_connections 2023-12-11T20:15:39.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.254+0000 7f947c9ff700 1 -- 172.21.15.12:0/138392478 wait complete. 2023-12-11T20:15:39.270 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-12-11T20:15:39.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:15:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 -- 172.21.15.12:0/3831376214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014103030 msgr2=0x7f10141098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 --2- 172.21.15.12:0/3831376214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014103030 0x7f10141098e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f100c00b0d0 tx=0x7f100c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 -- 172.21.15.12:0/3831376214 shutdown_connections 2023-12-11T20:15:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 --2- 172.21.15.12:0/3831376214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014103030 0x7f10141098e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 --2- 172.21.15.12:0/3831376214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10141014a0 0x7f10141018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 --2- 172.21.15.12:0/3831376214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1014102690 0x7f1014102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 -- 172.21.15.12:0/3831376214 >> 172.21.15.12:0/3831376214 conn(0x7f10140fca10 msgr2=0x7f10140fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:39.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 -- 172.21.15.12:0/3831376214 shutdown_connections 2023-12-11T20:15:39.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.479+0000 7f10199ff700 1 -- 172.21.15.12:0/3831376214 wait complete. 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.480+0000 7f10199ff700 1 Processor -- start 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.480+0000 7f10199ff700 1 -- start start 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.480+0000 7f10199ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10141014a0 0x7f1014199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.480+0000 7f10199ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014102690 0x7f1014199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.480+0000 7f10199ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014103030 0x7f10141a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.480+0000 7f10199ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10141a1170 con 0x7f1014102690 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.480+0000 7f10199ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10141a12b0 con 0x7f10141014a0 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.480+0000 7f10199ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10141a1440 con 0x7f1014103030 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014102690 0x7f1014199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f1012ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10141014a0 0x7f1014199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014102690 0x7f1014199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33014/0 (socket says 172.21.15.12:33014) 2023-12-11T20:15:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 -- 172.21.15.12:0/635175728 learned_addr learned my addr 172.21.15.12:0/635175728 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f10137fe700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014103030 0x7f10141a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 -- 172.21.15.12:0/635175728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014103030 msgr2=0x7f10141a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014103030 0x7f10141a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 -- 172.21.15.12:0/635175728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10141014a0 msgr2=0x7f1014199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10141014a0 0x7f1014199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 -- 172.21.15.12:0/635175728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c009d00 con 0x7f1014102690 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.481+0000 7f100bfff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014102690 0x7f1014199b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e9a0 tx=0x7f0ffc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.482+0000 7f10189fd700 1 -- 172.21.15.12:0/635175728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc009790 con 0x7f1014102690 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.482+0000 7f10189fd700 1 -- 172.21.15.12:0/635175728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ffc00cbd0 con 0x7f1014102690 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.482+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10141a1720 con 0x7f1014102690 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.482+0000 7f10189fd700 1 -- 172.21.15.12:0/635175728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc018680 con 0x7f1014102690 2023-12-11T20:15:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.482+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10141a1c30 con 0x7f1014102690 2023-12-11T20:15:39.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.483+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1014068330 con 0x7f1014102690 2023-12-11T20:15:39.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.485+0000 7f10189fd700 1 -- 172.21.15.12:0/635175728 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0ffc00cd40 con 0x7f1014102690 2023-12-11T20:15:39.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.487+0000 7f10189fd700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10000a1480 0x7f10000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.487+0000 7f10189fd700 1 -- 172.21.15.12:0/635175728 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0ffc014070 con 0x7f1014102690 2023-12-11T20:15:39.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.487+0000 7f1012ffd700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10000a1480 0x7f10000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.488+0000 7f1012ffd700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10000a1480 0x7f10000a3940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10141024f0 tx=0x7f1004007400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.490+0000 7f10189fd700 1 -- 172.21.15.12:0/635175728 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0ffc0522f0 con 0x7f1014102690 2023-12-11T20:15:39.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/268999253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2341484969' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:39 smithi039 ceph-mon[102205]: pgmap v367: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-11T20:15:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:39 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/138392478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/268999253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2341484969' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:39 smithi012 ceph-mon[128787]: pgmap v367: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-11T20:15:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:39 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/138392478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/268999253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2341484969' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:39 smithi032 ceph-mon[132488]: pgmap v367: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-11T20:15:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:39 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/138392478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:39.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.751+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f101410cb70 con 0x7f1014102690 2023-12-11T20:15:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.751+0000 7f10189fd700 1 -- 172.21.15.12:0/635175728 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f0ffc0d0030 con 0x7f1014102690 2023-12-11T20:15:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:39.750 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:15:39.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10000a1480 msgr2=0x7f10000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10000a1480 0x7f10000a3940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10141024f0 tx=0x7f1004007400 comp rx=0 tx=0).stop 2023-12-11T20:15:39.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014102690 msgr2=0x7f1014199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014102690 0x7f1014199b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e9a0 tx=0x7f0ffc00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 shutdown_connections 2023-12-11T20:15:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10000a1480 0x7f10000a3940 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10141014a0 0x7f1014199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014103030 0x7f10141a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 --2- 172.21.15.12:0/635175728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1014102690 0x7f1014199b80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 >> 172.21.15.12:0/635175728 conn(0x7f10140fca10 msgr2=0x7f1014073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 shutdown_connections 2023-12-11T20:15:39.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.754+0000 7f10199ff700 1 -- 172.21.15.12:0/635175728 wait complete. 2023-12-11T20:15:39.754 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:15:39.771 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-12-11T20:15:39.771 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-12-11T20:15:39.771 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T20:15:39.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 -- 172.21.15.12:0/2475545306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c075610 msgr2=0x7f456c073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 --2- 172.21.15.12:0/2475545306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c075610 0x7f456c073a60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f455c009990 tx=0x7f455c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 -- 172.21.15.12:0/2475545306 shutdown_connections 2023-12-11T20:15:39.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 --2- 172.21.15.12:0/2475545306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f456c109360 0x7f456c10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 --2- 172.21.15.12:0/2475545306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c075610 0x7f456c073a60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 --2- 172.21.15.12:0/2475545306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f456c074030 0x7f456c0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 -- 172.21.15.12:0/2475545306 >> 172.21.15.12:0/2475545306 conn(0x7f456c0fca10 msgr2=0x7f456c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:39.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 -- 172.21.15.12:0/2475545306 shutdown_connections 2023-12-11T20:15:39.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.976+0000 7f4571dff700 1 -- 172.21.15.12:0/2475545306 wait complete. 2023-12-11T20:15:39.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.977+0000 7f4571dff700 1 Processor -- start 2023-12-11T20:15:39.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.977+0000 7f4571dff700 1 -- start start 2023-12-11T20:15:39.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f4571dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c074030 0x7f456c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f4571dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f456c075610 0x7f456c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f4571dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f456c109360 0x7f456c1a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f4571dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c1a1070 con 0x7f456c074030 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f4571dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c1a11b0 con 0x7f456c075610 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f4571dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c1a1340 con 0x7f456c109360 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c074030 0x7f456c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c074030 0x7f456c199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33040/0 (socket says 172.21.15.12:33040) 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456b7fe700 1 -- 172.21.15.12:0/2608016441 learned_addr learned my addr 172.21.15.12:0/2608016441 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456affd700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f456c075610 0x7f456c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456bfff700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f456c109360 0x7f456c1a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456b7fe700 1 -- 172.21.15.12:0/2608016441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f456c109360 msgr2=0x7f456c1a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456b7fe700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f456c109360 0x7f456c1a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456b7fe700 1 -- 172.21.15.12:0/2608016441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f456c075610 msgr2=0x7f456c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:39.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456b7fe700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f456c075610 0x7f456c199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:39.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.978+0000 7f456b7fe700 1 -- 172.21.15.12:0/2608016441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c0095f0 con 0x7f456c074030 2023-12-11T20:15:39.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.979+0000 7f456b7fe700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c074030 0x7f456c199590 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f455c00b2e0 tx=0x7f455c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:39.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.979+0000 7f4568ff9700 1 -- 172.21.15.12:0/2608016441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c01d070 con 0x7f456c074030 2023-12-11T20:15:39.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.979+0000 7f4568ff9700 1 -- 172.21.15.12:0/2608016441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f455c00beb0 con 0x7f456c074030 2023-12-11T20:15:39.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.979+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c1a15c0 con 0x7f456c074030 2023-12-11T20:15:39.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.979+0000 7f4568ff9700 1 -- 172.21.15.12:0/2608016441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c021410 con 0x7f456c074030 2023-12-11T20:15:39.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.979+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c1a19e0 con 0x7f456c074030 2023-12-11T20:15:39.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.980+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c108120 con 0x7f456c074030 2023-12-11T20:15:39.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.982+0000 7f4568ff9700 1 -- 172.21.15.12:0/2608016441 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f455c00f640 con 0x7f456c074030 2023-12-11T20:15:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.984+0000 7f4568ff9700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45540a1480 0x7f45540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.985+0000 7f4568ff9700 1 -- 172.21.15.12:0/2608016441 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f455c0ce170 con 0x7f456c074030 2023-12-11T20:15:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.985+0000 7f456affd700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45540a1480 0x7f45540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.985+0000 7f456affd700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45540a1480 0x7f45540a3940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f456c075330 tx=0x7f456000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:39.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:39.988+0000 7f4568ff9700 1 -- 172.21.15.12:0/2608016441 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f455c0977b0 con 0x7f456c074030 2023-12-11T20:15:40.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.199+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f456c061a10 con 0x7f45540a1480 2023-12-11T20:15:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.211+0000 7f4568ff9700 1 -- 172.21.15.12:0/2608016441 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342472 (secure 0 0 0) 0x7f456c061a10 con 0x7f45540a1480 2023-12-11T20:15:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45540a1480 msgr2=0x7f45540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45540a1480 0x7f45540a3940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f456c075330 tx=0x7f456000b410 comp rx=0 tx=0).stop 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c074030 msgr2=0x7f456c199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c074030 0x7f456c199590 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f455c00b2e0 tx=0x7f455c004730 comp rx=0 tx=0).stop 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 shutdown_connections 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45540a1480 0x7f45540a3940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f456c109360 0x7f456c1a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456c074030 0x7f456c199590 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 --2- 172.21.15.12:0/2608016441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f456c075610 0x7f456c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 >> 172.21.15.12:0/2608016441 conn(0x7f456c0fca10 msgr2=0x7f456c105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 shutdown_connections 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.215+0000 7f4571dff700 1 -- 172.21.15.12:0/2608016441 wait complete. 2023-12-11T20:15:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-12-11T20:15:40.232 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2023-12-11T20:15:39.057669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661356,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":751,"num_read_kb":490,"num_write":349,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2951963,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336072,"kb_used_data":11840,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605752,"statfs":{"total":1151940427776,"available":1151596290048,"internally_reserved":0,"allocated":12124160,"data_stored":7644793,"data_compressed":250086,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19142,"internal_metadata":331855162},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5814,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":33,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002775"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285527+0000","last_change":"2023-12-11T20:13:53.282384+0000","last_active":"2023-12-11T20:15:04.285527+0000","last_peered":"2023-12-11T20:15:04.285527+0000","last_clean":"2023-12-11T20:15:04.285527+0000","last_became_active":"2023-12-11T20:13:53.282058+0000","last_became_peered":"2023-12-11T20:13:53.282058+0000","last_unstale":"2023-12-11T20:15:04.285527+0000","last_undegraded":"2023-12-11T20:15:04.285527+0000","last_fullsized":"2023-12-11T20:15:04.285527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:23:31.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319238+0000","last_change":"2023-12-11T20:13:53.282283+0000","last_active":"2023-12-11T20:15:04.319238+0000","last_peered":"2023-12-11T20:15:04.319238+0000","last_clean":"2023-12-11T20:15:04.319238+0000","last_became_active":"2023-12-11T20:13:53.278054+0000","last_became_peered":"2023-12-11T20:13:53.278054+0000","last_unstale":"2023-12-11T20:15:04.319238+0000","last_undegraded":"2023-12-11T20:15:04.319238+0000","last_fullsized":"2023-12-11T20:15:04.319238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:07:50.194732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319039+0000","last_change":"2023-12-11T20:13:53.277704+0000","last_active":"2023-12-11T20:15:04.319039+0000","last_peered":"2023-12-11T20:15:04.319039+0000","last_clean":"2023-12-11T20:15:04.319039+0000","last_became_active":"2023-12-11T20:13:53.277395+0000","last_became_peered":"2023-12-11T20:13:53.277395+0000","last_unstale":"2023-12-11T20:15:04.319039+0000","last_undegraded":"2023-12-11T20:15:04.319039+0000","last_fullsized":"2023-12-11T20:15:04.319039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:54:10.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288775+0000","last_change":"2023-12-11T20:13:53.280854+0000","last_active":"2023-12-11T20:15:04.288775+0000","last_peered":"2023-12-11T20:15:04.288775+0000","last_clean":"2023-12-11T20:15:04.288775+0000","last_became_active":"2023-12-11T20:13:53.277275+0000","last_became_peered":"2023-12-11T20:13:53.277275+0000","last_unstale":"2023-12-11T20:15:04.288775+0000","last_undegraded":"2023-12-11T20:15:04.288775+0000","last_fullsized":"2023-12-11T20:15:04.288775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:32:58.001015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288323+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:15:04.288323+0000","last_peered":"2023-12-11T20:15:04.288323+0000","last_clean":"2023-12-11T20:15:04.288323+0000","last_became_active":"2023-12-11T20:13:53.281659+0000","last_became_peered":"2023-12-11T20:13:53.281659+0000","last_unstale":"2023-12-11T20:15:04.288323+0000","last_undegraded":"2023-12-11T20:15:04.288323+0000","last_fullsized":"2023-12-11T20:15:04.288323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:47:20.764823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285717+0000","last_change":"2023-12-11T20:13:53.284175+0000","last_active":"2023-12-11T20:15:04.285717+0000","last_peered":"2023-12-11T20:15:04.285717+0000","last_clean":"2023-12-11T20:15:04.285717+0000","last_became_active":"2023-12-11T20:13:53.283801+0000","last_became_peered":"2023-12-11T20:13:53.283801+0000","last_unstale":"2023-12-11T20:15:04.285717+0000","last_undegraded":"2023-12-11T20:15:04.285717+0000","last_fullsized":"2023-12-11T20:15:04.285717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:35.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282949+0000","last_change":"2023-12-11T20:13:53.262700+0000","last_active":"2023-12-11T20:15:04.282949+0000","last_peered":"2023-12-11T20:15:04.282949+0000","last_clean":"2023-12-11T20:15:04.282949+0000","last_became_active":"2023-12-11T20:13:53.262322+0000","last_became_peered":"2023-12-11T20:13:53.262322+0000","last_unstale":"2023-12-11T20:15:04.282949+0000","last_undegraded":"2023-12-11T20:15:04.282949+0000","last_fullsized":"2023-12-11T20:15:04.282949+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:02:47.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.281863+0000","last_change":"2023-12-11T20:14:04.763447+0000","last_active":"2023-12-11T20:15:04.281863+0000","last_peered":"2023-12-11T20:15:04.281863+0000","last_clean":"2023-12-11T20:15:04.281863+0000","last_became_active":"2023-12-11T20:14:04.763036+0000","last_became_peered":"2023-12-11T20:14:04.763036+0000","last_unstale":"2023-12-11T20:15:04.281863+0000","last_undegraded":"2023-12-11T20:15:04.281863+0000","last_fullsized":"2023-12-11T20:15:04.281863+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:48.188993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319992+0000","last_change":"2023-12-11T20:13:53.277384+0000","last_active":"2023-12-11T20:15:04.319992+0000","last_peered":"2023-12-11T20:15:04.319992+0000","last_clean":"2023-12-11T20:15:04.319992+0000","last_became_active":"2023-12-11T20:13:53.277017+0000","last_became_peered":"2023-12-11T20:13:53.277017+0000","last_unstale":"2023-12-11T20:15:04.319992+0000","last_undegraded":"2023-12-11T20:15:04.319992+0000","last_fullsized":"2023-12-11T20:15:04.319992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:04:50.820269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285932+0000","last_change":"2023-12-11T20:13:53.285340+0000","last_active":"2023-12-11T20:15:04.285932+0000","last_peered":"2023-12-11T20:15:04.285932+0000","last_clean":"2023-12-11T20:15:04.285932+0000","last_became_active":"2023-12-11T20:13:53.285040+0000","last_became_peered":"2023-12-11T20:13:53.285040+0000","last_unstale":"2023-12-11T20:15:04.285932+0000","last_undegraded":"2023-12-11T20:15:04.285932+0000","last_fullsized":"2023-12-11T20:15:04.285932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:52:53.312236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283309+0000","last_change":"2023-12-11T20:13:53.274637+0000","last_active":"2023-12-11T20:15:04.283309+0000","last_peered":"2023-12-11T20:15:04.283309+0000","last_clean":"2023-12-11T20:15:04.283309+0000","last_became_active":"2023-12-11T20:13:53.270971+0000","last_became_peered":"2023-12-11T20:13:53.270971+0000","last_unstale":"2023-12-11T20:15:04.283309+0000","last_undegraded":"2023-12-11T20:15:04.283309+0000","last_fullsized":"2023-12-11T20:15:04.283309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:20:35.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288736+0000","last_change":"2023-12-11T20:13:53.280712+0000","last_active":"2023-12-11T20:15:04.288736+0000","last_peered":"2023-12-11T20:15:04.288736+0000","last_clean":"2023-12-11T20:15:04.288736+0000","last_became_active":"2023-12-11T20:13:53.276873+0000","last_became_peered":"2023-12-11T20:13:53.276873+0000","last_unstale":"2023-12-11T20:15:04.288736+0000","last_undegraded":"2023-12-11T20:15:04.288736+0000","last_fullsized":"2023-12-11T20:15:04.288736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:36:08.438862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321129+0000","last_change":"2023-12-11T20:13:53.272378+0000","last_active":"2023-12-11T20:15:04.321129+0000","last_peered":"2023-12-11T20:15:04.321129+0000","last_clean":"2023-12-11T20:15:04.321129+0000","last_became_active":"2023-12-11T20:13:53.271992+0000","last_became_peered":"2023-12-11T20:13:53.271992+0000","last_unstale":"2023-12-11T20:15:04.321129+0000","last_undegraded":"2023-12-11T20:15:04.321129+0000","last_fullsized":"2023-12-11T20:15:04.321129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:01:05.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318845+0000","last_change":"2023-12-11T20:13:53.275078+0000","last_active":"2023-12-11T20:15:04.318845+0000","last_peered":"2023-12-11T20:15:04.318845+0000","last_clean":"2023-12-11T20:15:04.318845+0000","last_became_active":"2023-12-11T20:13:53.273555+0000","last_became_peered":"2023-12-11T20:13:53.273555+0000","last_unstale":"2023-12-11T20:15:04.318845+0000","last_undegraded":"2023-12-11T20:15:04.318845+0000","last_fullsized":"2023-12-11T20:15:04.318845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:23:27.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318921+0000","last_change":"2023-12-11T20:13:53.277135+0000","last_active":"2023-12-11T20:15:04.318921+0000","last_peered":"2023-12-11T20:15:04.318921+0000","last_clean":"2023-12-11T20:15:04.318921+0000","last_became_active":"2023-12-11T20:13:53.276406+0000","last_became_peered":"2023-12-11T20:13:53.276406+0000","last_unstale":"2023-12-11T20:15:04.318921+0000","last_undegraded":"2023-12-11T20:15:04.318921+0000","last_fullsized":"2023-12-11T20:15:04.318921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:20.508685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319466+0000","last_change":"2023-12-11T20:13:53.268845+0000","last_active":"2023-12-11T20:15:04.319466+0000","last_peered":"2023-12-11T20:15:04.319466+0000","last_clean":"2023-12-11T20:15:04.319466+0000","last_became_active":"2023-12-11T20:13:53.268553+0000","last_became_peered":"2023-12-11T20:13:53.268553+0000","last_unstale":"2023-12-11T20:15:04.319466+0000","last_undegraded":"2023-12-11T20:15:04.319466+0000","last_fullsized":"2023-12-11T20:15:04.319466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:55.125792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285660+0000","last_change":"2023-12-11T20:13:53.284361+0000","last_active":"2023-12-11T20:15:04.285660+0000","last_peered":"2023-12-11T20:15:04.285660+0000","last_clean":"2023-12-11T20:15:04.285660+0000","last_became_active":"2023-12-11T20:13:53.282109+0000","last_became_peered":"2023-12-11T20:13:53.282109+0000","last_unstale":"2023-12-11T20:15:04.285660+0000","last_undegraded":"2023-12-11T20:15:04.285660+0000","last_fullsized":"2023-12-11T20:15:04.285660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:44:50.021737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282299+0000","last_change":"2023-12-11T20:13:53.274005+0000","last_active":"2023-12-11T20:15:04.282299+0000","last_peered":"2023-12-11T20:15:04.282299+0000","last_clean":"2023-12-11T20:15:04.282299+0000","last_became_active":"2023-12-11T20:13:53.273336+0000","last_became_peered":"2023-12-11T20:13:53.273336+0000","last_unstale":"2023-12-11T20:15:04.282299+0000","last_undegraded":"2023-12-11T20:15:04.282299+0000","last_fullsized":"2023-12-11T20:15:04.282299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:56:05.732607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319261+0000","last_change":"2023-12-11T20:13:53.280909+0000","last_active":"2023-12-11T20:15:04.319261+0000","last_peered":"2023-12-11T20:15:04.319261+0000","last_clean":"2023-12-11T20:15:04.319261+0000","last_became_active":"2023-12-11T20:13:53.278124+0000","last_became_peered":"2023-12-11T20:13:53.278124+0000","last_unstale":"2023-12-11T20:15:04.319261+0000","last_undegraded":"2023-12-11T20:15:04.319261+0000","last_fullsized":"2023-12-11T20:15:04.319261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:09:19.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282365+0000","last_change":"2023-12-11T20:13:52.478685+0000","last_active":"2023-12-11T20:15:04.282365+0000","last_peered":"2023-12-11T20:15:04.282365+0000","last_clean":"2023-12-11T20:15:04.282365+0000","last_became_active":"2023-12-11T20:13:52.478391+0000","last_became_peered":"2023-12-11T20:13:52.478391+0000","last_unstale":"2023-12-11T20:15:04.282365+0000","last_undegraded":"2023-12-11T20:15:04.282365+0000","last_fullsized":"2023-12-11T20:15:04.282365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:02:54.039954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321172+0000","last_change":"2023-12-11T20:13:53.279432+0000","last_active":"2023-12-11T20:15:04.321172+0000","last_peered":"2023-12-11T20:15:04.321172+0000","last_clean":"2023-12-11T20:15:04.321172+0000","last_became_active":"2023-12-11T20:13:53.279087+0000","last_became_peered":"2023-12-11T20:13:53.279087+0000","last_unstale":"2023-12-11T20:15:04.321172+0000","last_undegraded":"2023-12-11T20:15:04.321172+0000","last_fullsized":"2023-12-11T20:15:04.321172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.376941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321258+0000","last_change":"2023-12-11T20:13:52.485170+0000","last_active":"2023-12-11T20:15:04.321258+0000","last_peered":"2023-12-11T20:15:04.321258+0000","last_clean":"2023-12-11T20:15:04.321258+0000","last_became_active":"2023-12-11T20:13:52.484885+0000","last_became_peered":"2023-12-11T20:13:52.484885+0000","last_unstale":"2023-12-11T20:15:04.321258+0000","last_undegraded":"2023-12-11T20:15:04.321258+0000","last_fullsized":"2023-12-11T20:15:04.321258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:21:40.746709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319348+0000","last_change":"2023-12-11T20:13:53.274015+0000","last_active":"2023-12-11T20:15:04.319348+0000","last_peered":"2023-12-11T20:15:04.319348+0000","last_clean":"2023-12-11T20:15:04.319348+0000","last_became_active":"2023-12-11T20:13:53.272504+0000","last_became_peered":"2023-12-11T20:13:53.272504+0000","last_unstale":"2023-12-11T20:15:04.319348+0000","last_undegraded":"2023-12-11T20:15:04.319348+0000","last_fullsized":"2023-12-11T20:15:04.319348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:26.155659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285339+0000","last_change":"2023-12-11T20:14:04.560730+0000","last_active":"2023-12-11T20:15:04.285339+0000","last_peered":"2023-12-11T20:15:04.285339+0000","last_clean":"2023-12-11T20:15:04.285339+0000","last_became_active":"2023-12-11T20:14:04.549828+0000","last_became_peered":"2023-12-11T20:14:04.549828+0000","last_unstale":"2023-12-11T20:15:04.285339+0000","last_undegraded":"2023-12-11T20:15:04.285339+0000","last_fullsized":"2023-12-11T20:15:04.285339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:47:10.046705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319638+0000","last_change":"2023-12-11T20:13:53.268907+0000","last_active":"2023-12-11T20:15:04.319638+0000","last_peered":"2023-12-11T20:15:04.319638+0000","last_clean":"2023-12-11T20:15:04.319638+0000","last_became_active":"2023-12-11T20:13:53.268494+0000","last_became_peered":"2023-12-11T20:13:53.268494+0000","last_unstale":"2023-12-11T20:15:04.319638+0000","last_undegraded":"2023-12-11T20:15:04.319638+0000","last_fullsized":"2023-12-11T20:15:04.319638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:57:36.104687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.289029+0000","last_change":"2023-12-11T20:13:52.475425+0000","last_active":"2023-12-11T20:15:04.289029+0000","last_peered":"2023-12-11T20:15:04.289029+0000","last_clean":"2023-12-11T20:15:04.289029+0000","last_became_active":"2023-12-11T20:13:52.475066+0000","last_became_peered":"2023-12-11T20:13:52.475066+0000","last_unstale":"2023-12-11T20:15:04.289029+0000","last_undegraded":"2023-12-11T20:15:04.289029+0000","last_fullsized":"2023-12-11T20:15:04.289029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:01:01.603043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286516+0000","last_change":"2023-12-11T20:14:04.546865+0000","last_active":"2023-12-11T20:15:04.286516+0000","last_peered":"2023-12-11T20:15:04.286516+0000","last_clean":"2023-12-11T20:15:04.286516+0000","last_became_active":"2023-12-11T20:14:04.546475+0000","last_became_peered":"2023-12-11T20:14:04.546475+0000","last_unstale":"2023-12-11T20:15:04.286516+0000","last_undegraded":"2023-12-11T20:15:04.286516+0000","last_fullsized":"2023-12-11T20:15:04.286516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:54.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'8","reported_seq":131,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:37.439744+0000","last_change":"2023-12-11T20:13:52.481648+0000","last_active":"2023-12-11T20:15:37.439744+0000","last_peered":"2023-12-11T20:15:37.439744+0000","last_clean":"2023-12-11T20:15:37.439744+0000","last_became_active":"2023-12-11T20:13:52.481317+0000","last_became_peered":"2023-12-11T20:13:52.481317+0000","last_unstale":"2023-12-11T20:15:37.439744+0000","last_undegraded":"2023-12-11T20:15:37.439744+0000","last_fullsized":"2023-12-11T20:15:37.439744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:30:32.206757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288382+0000","last_change":"2023-12-11T20:13:53.261350+0000","last_active":"2023-12-11T20:15:04.288382+0000","last_peered":"2023-12-11T20:15:04.288382+0000","last_clean":"2023-12-11T20:15:04.288382+0000","last_became_active":"2023-12-11T20:13:53.260471+0000","last_became_peered":"2023-12-11T20:13:53.260471+0000","last_unstale":"2023-12-11T20:15:04.288382+0000","last_undegraded":"2023-12-11T20:15:04.288382+0000","last_fullsized":"2023-12-11T20:15:04.288382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:27.844329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285654+0000","last_change":"2023-12-11T20:13:52.482190+0000","last_active":"2023-12-11T20:15:04.285654+0000","last_peered":"2023-12-11T20:15:04.285654+0000","last_clean":"2023-12-11T20:15:04.285654+0000","last_became_active":"2023-12-11T20:13:52.481758+0000","last_became_peered":"2023-12-11T20:13:52.481758+0000","last_unstale":"2023-12-11T20:15:04.285654+0000","last_undegraded":"2023-12-11T20:15:04.285654+0000","last_fullsized":"2023-12-11T20:15:04.285654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:26.226338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286371+0000","last_change":"2023-12-11T20:13:53.279366+0000","last_active":"2023-12-11T20:15:04.286371+0000","last_peered":"2023-12-11T20:15:04.286371+0000","last_clean":"2023-12-11T20:15:04.286371+0000","last_became_active":"2023-12-11T20:13:53.279074+0000","last_became_peered":"2023-12-11T20:13:53.279074+0000","last_unstale":"2023-12-11T20:15:04.286371+0000","last_undegraded":"2023-12-11T20:15:04.286371+0000","last_fullsized":"2023-12-11T20:15:04.286371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:37.856345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320171+0000","last_change":"2023-12-11T20:13:52.480830+0000","last_active":"2023-12-11T20:15:04.320171+0000","last_peered":"2023-12-11T20:15:04.320171+0000","last_clean":"2023-12-11T20:15:04.320171+0000","last_became_active":"2023-12-11T20:13:52.480359+0000","last_became_peered":"2023-12-11T20:13:52.480359+0000","last_unstale":"2023-12-11T20:15:04.320171+0000","last_undegraded":"2023-12-11T20:15:04.320171+0000","last_fullsized":"2023-12-11T20:15:04.320171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:13.756411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319851+0000","last_change":"2023-12-11T20:13:53.275587+0000","last_active":"2023-12-11T20:15:04.319851+0000","last_peered":"2023-12-11T20:15:04.319851+0000","last_clean":"2023-12-11T20:15:04.319851+0000","last_became_active":"2023-12-11T20:13:53.275014+0000","last_became_peered":"2023-12-11T20:13:53.275014+0000","last_unstale":"2023-12-11T20:15:04.319851+0000","last_undegraded":"2023-12-11T20:15:04.319851+0000","last_fullsized":"2023-12-11T20:15:04.319851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:21:23.179714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.284858+0000","last_change":"2023-12-11T20:14:04.548868+0000","last_active":"2023-12-11T20:15:04.284858+0000","last_peered":"2023-12-11T20:15:04.284858+0000","last_clean":"2023-12-11T20:15:04.284858+0000","last_became_active":"2023-12-11T20:14:04.548198+0000","last_became_peered":"2023-12-11T20:14:04.548198+0000","last_unstale":"2023-12-11T20:15:04.284858+0000","last_undegraded":"2023-12-11T20:15:04.284858+0000","last_fullsized":"2023-12-11T20:15:04.284858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:11:16.117241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.281957+0000","last_change":"2023-12-11T20:13:53.281254+0000","last_active":"2023-12-11T20:15:04.281957+0000","last_peered":"2023-12-11T20:15:04.281957+0000","last_clean":"2023-12-11T20:15:04.281957+0000","last_became_active":"2023-12-11T20:13:53.278026+0000","last_became_peered":"2023-12-11T20:13:53.278026+0000","last_unstale":"2023-12-11T20:15:04.281957+0000","last_undegraded":"2023-12-11T20:15:04.281957+0000","last_fullsized":"2023-12-11T20:15:04.281957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:25:46.033739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:34.432516+0000","last_change":"2023-12-11T20:13:52.485136+0000","last_active":"2023-12-11T20:15:34.432516+0000","last_peered":"2023-12-11T20:15:34.432516+0000","last_clean":"2023-12-11T20:15:34.432516+0000","last_became_active":"2023-12-11T20:13:52.484743+0000","last_became_peered":"2023-12-11T20:13:52.484743+0000","last_unstale":"2023-12-11T20:15:34.432516+0000","last_undegraded":"2023-12-11T20:15:34.432516+0000","last_fullsized":"2023-12-11T20:15:34.432516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:50.893360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319974+0000","last_change":"2023-12-11T20:13:53.274566+0000","last_active":"2023-12-11T20:15:04.319974+0000","last_peered":"2023-12-11T20:15:04.319974+0000","last_clean":"2023-12-11T20:15:04.319974+0000","last_became_active":"2023-12-11T20:13:53.273325+0000","last_became_peered":"2023-12-11T20:13:53.273325+0000","last_unstale":"2023-12-11T20:15:04.319974+0000","last_undegraded":"2023-12-11T20:15:04.319974+0000","last_fullsized":"2023-12-11T20:15:04.319974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:29:17.656364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283417+0000","last_change":"2023-12-11T20:14:04.766961+0000","last_active":"2023-12-11T20:15:04.283417+0000","last_peered":"2023-12-11T20:15:04.283417+0000","last_clean":"2023-12-11T20:15:04.283417+0000","last_became_active":"2023-12-11T20:14:04.763504+0000","last_became_peered":"2023-12-11T20:14:04.763504+0000","last_unstale":"2023-12-11T20:15:04.283417+0000","last_undegraded":"2023-12-11T20:15:04.283417+0000","last_fullsized":"2023-12-11T20:15:04.283417+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:50:38.795524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319445+0000","last_change":"2023-12-11T20:14:04.764089+0000","last_active":"2023-12-11T20:15:04.319445+0000","last_peered":"2023-12-11T20:15:04.319445+0000","last_clean":"2023-12-11T20:15:04.319445+0000","last_became_active":"2023-12-11T20:14:04.763556+0000","last_became_peered":"2023-12-11T20:14:04.763556+0000","last_unstale":"2023-12-11T20:15:04.319445+0000","last_undegraded":"2023-12-11T20:15:04.319445+0000","last_fullsized":"2023-12-11T20:15:04.319445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:39.851342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286688+0000","last_change":"2023-12-11T20:13:52.486247+0000","last_active":"2023-12-11T20:15:04.286688+0000","last_peered":"2023-12-11T20:15:04.286688+0000","last_clean":"2023-12-11T20:15:04.286688+0000","last_became_active":"2023-12-11T20:13:52.485343+0000","last_became_peered":"2023-12-11T20:13:52.485343+0000","last_unstale":"2023-12-11T20:15:04.286688+0000","last_undegraded":"2023-12-11T20:15:04.286688+0000","last_fullsized":"2023-12-11T20:15:04.286688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:21:46.587858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319745+0000","last_change":"2023-12-11T20:13:53.281264+0000","last_active":"2023-12-11T20:15:04.319745+0000","last_peered":"2023-12-11T20:15:04.319745+0000","last_clean":"2023-12-11T20:15:04.319745+0000","last_became_active":"2023-12-11T20:13:53.280899+0000","last_became_peered":"2023-12-11T20:13:53.280899+0000","last_unstale":"2023-12-11T20:15:04.319745+0000","last_undegraded":"2023-12-11T20:15:04.319745+0000","last_fullsized":"2023-12-11T20:15:04.319745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:17.675421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":256,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.441967+0000","last_change":"2023-12-11T20:13:52.475732+0000","last_active":"2023-12-11T20:15:35.441967+0000","last_peered":"2023-12-11T20:15:35.441967+0000","last_clean":"2023-12-11T20:15:35.441967+0000","last_became_active":"2023-12-11T20:13:52.475415+0000","last_became_peered":"2023-12-11T20:13:52.475415+0000","last_unstale":"2023-12-11T20:15:35.441967+0000","last_undegraded":"2023-12-11T20:15:35.441967+0000","last_fullsized":"2023-12-11T20:15:35.441967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:20:31.539997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65076,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":162,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288602+0000","last_change":"2023-12-11T20:13:53.273365+0000","last_active":"2023-12-11T20:15:04.288602+0000","last_peered":"2023-12-11T20:15:04.288602+0000","last_clean":"2023-12-11T20:15:04.288602+0000","last_became_active":"2023-12-11T20:13:53.268456+0000","last_became_peered":"2023-12-11T20:13:53.268456+0000","last_unstale":"2023-12-11T20:15:04.288602+0000","last_undegraded":"2023-12-11T20:15:04.288602+0000","last_fullsized":"2023-12-11T20:15:04.288602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:13.850229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319079+0000","last_change":"2023-12-11T20:13:52.477609+0000","last_active":"2023-12-11T20:15:04.319079+0000","last_peered":"2023-12-11T20:15:04.319079+0000","last_clean":"2023-12-11T20:15:04.319079+0000","last_became_active":"2023-12-11T20:13:52.477177+0000","last_became_peered":"2023-12-11T20:13:52.477177+0000","last_unstale":"2023-12-11T20:15:04.319079+0000","last_undegraded":"2023-12-11T20:15:04.319079+0000","last_fullsized":"2023-12-11T20:15:04.319079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:46.987026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320296+0000","last_change":"2023-12-11T20:13:53.278247+0000","last_active":"2023-12-11T20:15:04.320296+0000","last_peered":"2023-12-11T20:15:04.320296+0000","last_clean":"2023-12-11T20:15:04.320296+0000","last_became_active":"2023-12-11T20:13:53.277928+0000","last_became_peered":"2023-12-11T20:13:53.277928+0000","last_unstale":"2023-12-11T20:15:04.320296+0000","last_undegraded":"2023-12-11T20:15:04.320296+0000","last_fullsized":"2023-12-11T20:15:04.320296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:52:33.864370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286178+0000","last_change":"2023-12-11T20:13:52.485985+0000","last_active":"2023-12-11T20:15:04.286178+0000","last_peered":"2023-12-11T20:15:04.286178+0000","last_clean":"2023-12-11T20:15:04.286178+0000","last_became_active":"2023-12-11T20:13:52.484929+0000","last_became_peered":"2023-12-11T20:13:52.484929+0000","last_unstale":"2023-12-11T20:15:04.286178+0000","last_undegraded":"2023-12-11T20:15:04.286178+0000","last_fullsized":"2023-12-11T20:15:04.286178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T08:11:28.665448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283632+0000","last_change":"2023-12-11T20:13:53.277048+0000","last_active":"2023-12-11T20:15:04.283632+0000","last_peered":"2023-12-11T20:15:04.283632+0000","last_clean":"2023-12-11T20:15:04.283632+0000","last_became_active":"2023-12-11T20:13:53.276706+0000","last_became_peered":"2023-12-11T20:13:53.276706+0000","last_unstale":"2023-12-11T20:15:04.283632+0000","last_undegraded":"2023-12-11T20:15:04.283632+0000","last_fullsized":"2023-12-11T20:15:04.283632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:46.815339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.432267+0000","last_change":"2023-12-11T20:13:52.477814+0000","last_active":"2023-12-11T20:15:35.432267+0000","last_peered":"2023-12-11T20:15:35.432267+0000","last_clean":"2023-12-11T20:15:35.432267+0000","last_became_active":"2023-12-11T20:13:52.477036+0000","last_became_peered":"2023-12-11T20:13:52.477036+0000","last_unstale":"2023-12-11T20:15:35.432267+0000","last_undegraded":"2023-12-11T20:15:35.432267+0000","last_fullsized":"2023-12-11T20:15:35.432267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:53:44.279968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.288926+0000","last_change":"2023-12-11T20:15:05.288926+0000","last_active":"2023-12-11T20:15:05.288926+0000","last_peered":"2023-12-11T20:15:05.288926+0000","last_clean":"2023-12-11T20:15:05.288926+0000","last_became_active":"2023-12-11T20:15:05.288443+0000","last_became_peered":"2023-12-11T20:15:05.288443+0000","last_unstale":"2023-12-11T20:15:05.288926+0000","last_undegraded":"2023-12-11T20:15:05.288926+0000","last_fullsized":"2023-12-11T20:15:05.288926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:09:43.778797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288197+0000","last_change":"2023-12-11T20:13:52.483417+0000","last_active":"2023-12-11T20:15:04.288197+0000","last_peered":"2023-12-11T20:15:04.288197+0000","last_clean":"2023-12-11T20:15:04.288197+0000","last_became_active":"2023-12-11T20:13:52.481395+0000","last_became_peered":"2023-12-11T20:13:52.481395+0000","last_unstale":"2023-12-11T20:15:04.288197+0000","last_undegraded":"2023-12-11T20:15:04.288197+0000","last_fullsized":"2023-12-11T20:15:04.288197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:01:42.053460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286310+0000","last_change":"2023-12-11T20:13:53.280688+0000","last_active":"2023-12-11T20:15:04.286310+0000","last_peered":"2023-12-11T20:15:04.286310+0000","last_clean":"2023-12-11T20:15:04.286310+0000","last_became_active":"2023-12-11T20:13:53.277300+0000","last_became_peered":"2023-12-11T20:13:53.277300+0000","last_unstale":"2023-12-11T20:15:04.286310+0000","last_undegraded":"2023-12-11T20:15:04.286310+0000","last_fullsized":"2023-12-11T20:15:04.286310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:40:58.831909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288583+0000","last_change":"2023-12-11T20:13:52.474978+0000","last_active":"2023-12-11T20:15:04.288583+0000","last_peered":"2023-12-11T20:15:04.288583+0000","last_clean":"2023-12-11T20:15:04.288583+0000","last_became_active":"2023-12-11T20:13:52.472863+0000","last_became_peered":"2023-12-11T20:13:52.472863+0000","last_unstale":"2023-12-11T20:15:04.288583+0000","last_undegraded":"2023-12-11T20:15:04.288583+0000","last_fullsized":"2023-12-11T20:15:04.288583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:53:44.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285363+0000","last_change":"2023-12-11T20:13:53.285991+0000","last_active":"2023-12-11T20:15:04.285363+0000","last_peered":"2023-12-11T20:15:04.285363+0000","last_clean":"2023-12-11T20:15:04.285363+0000","last_became_active":"2023-12-11T20:13:53.283925+0000","last_became_peered":"2023-12-11T20:13:53.283925+0000","last_unstale":"2023-12-11T20:15:04.285363+0000","last_undegraded":"2023-12-11T20:15:04.285363+0000","last_fullsized":"2023-12-11T20:15:04.285363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:15:48.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282190+0000","last_change":"2023-12-11T20:13:52.478883+0000","last_active":"2023-12-11T20:15:04.282190+0000","last_peered":"2023-12-11T20:15:04.282190+0000","last_clean":"2023-12-11T20:15:04.282190+0000","last_became_active":"2023-12-11T20:13:52.477070+0000","last_became_peered":"2023-12-11T20:13:52.477070+0000","last_unstale":"2023-12-11T20:15:04.282190+0000","last_undegraded":"2023-12-11T20:15:04.282190+0000","last_fullsized":"2023-12-11T20:15:04.282190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:14:32.504778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286113+0000","last_change":"2023-12-11T20:13:53.278181+0000","last_active":"2023-12-11T20:15:04.286113+0000","last_peered":"2023-12-11T20:15:04.286113+0000","last_clean":"2023-12-11T20:15:04.286113+0000","last_became_active":"2023-12-11T20:13:53.277800+0000","last_became_peered":"2023-12-11T20:13:53.277800+0000","last_unstale":"2023-12-11T20:15:04.286113+0000","last_undegraded":"2023-12-11T20:15:04.286113+0000","last_fullsized":"2023-12-11T20:15:04.286113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:35.424820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283043+0000","last_change":"2023-12-11T20:13:52.481281+0000","last_active":"2023-12-11T20:15:04.283043+0000","last_peered":"2023-12-11T20:15:04.283043+0000","last_clean":"2023-12-11T20:15:04.283043+0000","last_became_active":"2023-12-11T20:13:52.479352+0000","last_became_peered":"2023-12-11T20:13:52.479352+0000","last_unstale":"2023-12-11T20:15:04.283043+0000","last_undegraded":"2023-12-11T20:15:04.283043+0000","last_fullsized":"2023-12-11T20:15:04.283043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:41.815011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285882+0000","last_change":"2023-12-11T20:13:53.282233+0000","last_active":"2023-12-11T20:15:04.285882+0000","last_peered":"2023-12-11T20:15:04.285882+0000","last_clean":"2023-12-11T20:15:04.285882+0000","last_became_active":"2023-12-11T20:13:53.279001+0000","last_became_peered":"2023-12-11T20:13:53.279001+0000","last_unstale":"2023-12-11T20:15:04.285882+0000","last_undegraded":"2023-12-11T20:15:04.285882+0000","last_fullsized":"2023-12-11T20:15:04.285882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:30:21.671414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286370+0000","last_change":"2023-12-11T20:13:53.269361+0000","last_active":"2023-12-11T20:15:04.286370+0000","last_peered":"2023-12-11T20:15:04.286370+0000","last_clean":"2023-12-11T20:15:04.286370+0000","last_became_active":"2023-12-11T20:13:53.268613+0000","last_became_peered":"2023-12-11T20:13:53.268613+0000","last_unstale":"2023-12-11T20:15:04.286370+0000","last_undegraded":"2023-12-11T20:15:04.286370+0000","last_fullsized":"2023-12-11T20:15:04.286370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:08:04.876038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":122,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.431538+0000","last_change":"2023-12-11T20:13:52.484537+0000","last_active":"2023-12-11T20:15:35.431538+0000","last_peered":"2023-12-11T20:15:35.431538+0000","last_clean":"2023-12-11T20:15:35.431538+0000","last_became_active":"2023-12-11T20:13:52.482732+0000","last_became_peered":"2023-12-11T20:13:52.482732+0000","last_unstale":"2023-12-11T20:15:35.431538+0000","last_undegraded":"2023-12-11T20:15:35.431538+0000","last_fullsized":"2023-12-11T20:15:35.431538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:41:31.332046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320996+0000","last_change":"2023-12-11T20:13:53.270953+0000","last_active":"2023-12-11T20:15:04.320996+0000","last_peered":"2023-12-11T20:15:04.320996+0000","last_clean":"2023-12-11T20:15:04.320996+0000","last_became_active":"2023-12-11T20:13:53.269711+0000","last_became_peered":"2023-12-11T20:13:53.269711+0000","last_unstale":"2023-12-11T20:15:04.320996+0000","last_undegraded":"2023-12-11T20:15:04.320996+0000","last_fullsized":"2023-12-11T20:15:04.320996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:16:50.802953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288519+0000","last_change":"2023-12-11T20:13:52.473341+0000","last_active":"2023-12-11T20:15:04.288519+0000","last_peered":"2023-12-11T20:15:04.288519+0000","last_clean":"2023-12-11T20:15:04.288519+0000","last_became_active":"2023-12-11T20:13:52.469572+0000","last_became_peered":"2023-12-11T20:13:52.469572+0000","last_unstale":"2023-12-11T20:15:04.288519+0000","last_undegraded":"2023-12-11T20:15:04.288519+0000","last_fullsized":"2023-12-11T20:15:04.288519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:52:47.513645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.287290+0000","last_change":"2023-12-11T20:12:30.330188+0000","last_active":"2023-12-11T20:15:05.287290+0000","last_peered":"2023-12-11T20:15:05.287290+0000","last_clean":"2023-12-11T20:15:05.287290+0000","last_became_active":"2023-12-11T20:12:30.329533+0000","last_became_peered":"2023-12-11T20:12:30.329533+0000","last_unstale":"2023-12-11T20:15:05.287290+0000","last_undegraded":"2023-12-11T20:15:05.287290+0000","last_fullsized":"2023-12-11T20:15:05.287290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_clean_scrub_stamp":"2023-12-11T20:08:47.558016+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:18:10.357750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319964+0000","last_change":"2023-12-11T20:13:53.278062+0000","last_active":"2023-12-11T20:15:04.319964+0000","last_peered":"2023-12-11T20:15:04.319964+0000","last_clean":"2023-12-11T20:15:04.319964+0000","last_became_active":"2023-12-11T20:13:53.277664+0000","last_became_peered":"2023-12-11T20:13:53.277664+0000","last_unstale":"2023-12-11T20:15:04.319964+0000","last_undegraded":"2023-12-11T20:15:04.319964+0000","last_fullsized":"2023-12-11T20:15:04.319964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:07:38.751486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283369+0000","last_change":"2023-12-11T20:14:04.550614+0000","last_active":"2023-12-11T20:15:04.283369+0000","last_peered":"2023-12-11T20:15:04.283369+0000","last_clean":"2023-12-11T20:15:04.283369+0000","last_became_active":"2023-12-11T20:14:04.544469+0000","last_became_peered":"2023-12-11T20:14:04.544469+0000","last_unstale":"2023-12-11T20:15:04.283369+0000","last_undegraded":"2023-12-11T20:15:04.283369+0000","last_fullsized":"2023-12-11T20:15:04.283369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:33.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288626+0000","last_change":"2023-12-11T20:13:52.478823+0000","last_active":"2023-12-11T20:15:04.288626+0000","last_peered":"2023-12-11T20:15:04.288626+0000","last_clean":"2023-12-11T20:15:04.288626+0000","last_became_active":"2023-12-11T20:13:52.478475+0000","last_became_peered":"2023-12-11T20:13:52.478475+0000","last_unstale":"2023-12-11T20:15:04.288626+0000","last_undegraded":"2023-12-11T20:15:04.288626+0000","last_fullsized":"2023-12-11T20:15:04.288626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:44:36.438152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320508+0000","last_change":"2023-12-11T20:13:53.272496+0000","last_active":"2023-12-11T20:15:04.320508+0000","last_peered":"2023-12-11T20:15:04.320508+0000","last_clean":"2023-12-11T20:15:04.320508+0000","last_became_active":"2023-12-11T20:13:53.271669+0000","last_became_peered":"2023-12-11T20:13:53.271669+0000","last_unstale":"2023-12-11T20:15:04.320508+0000","last_undegraded":"2023-12-11T20:15:04.320508+0000","last_fullsized":"2023-12-11T20:15:04.320508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:48:31.299659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.283829+0000","last_change":"2023-12-11T20:13:52.485866+0000","last_active":"2023-12-11T20:15:05.283829+0000","last_peered":"2023-12-11T20:15:05.283829+0000","last_clean":"2023-12-11T20:15:05.283829+0000","last_became_active":"2023-12-11T20:13:52.485106+0000","last_became_peered":"2023-12-11T20:13:52.485106+0000","last_unstale":"2023-12-11T20:15:05.283829+0000","last_undegraded":"2023-12-11T20:15:05.283829+0000","last_fullsized":"2023-12-11T20:15:05.283829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:24:41.177294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321338+0000","last_change":"2023-12-11T20:13:53.271737+0000","last_active":"2023-12-11T20:15:04.321338+0000","last_peered":"2023-12-11T20:15:04.321338+0000","last_clean":"2023-12-11T20:15:04.321338+0000","last_became_active":"2023-12-11T20:13:53.271228+0000","last_became_peered":"2023-12-11T20:13:53.271228+0000","last_unstale":"2023-12-11T20:15:04.321338+0000","last_undegraded":"2023-12-11T20:15:04.321338+0000","last_fullsized":"2023-12-11T20:15:04.321338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:45.614455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288608+0000","last_change":"2023-12-11T20:13:52.475488+0000","last_active":"2023-12-11T20:15:04.288608+0000","last_peered":"2023-12-11T20:15:04.288608+0000","last_clean":"2023-12-11T20:15:04.288608+0000","last_became_active":"2023-12-11T20:13:52.475150+0000","last_became_peered":"2023-12-11T20:13:52.475150+0000","last_unstale":"2023-12-11T20:15:04.288608+0000","last_undegraded":"2023-12-11T20:15:04.288608+0000","last_fullsized":"2023-12-11T20:15:04.288608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:42:55.792758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319347+0000","last_change":"2023-12-11T20:13:53.285381+0000","last_active":"2023-12-11T20:15:04.319347+0000","last_peered":"2023-12-11T20:15:04.319347+0000","last_clean":"2023-12-11T20:15:04.319347+0000","last_became_active":"2023-12-11T20:13:53.285069+0000","last_became_peered":"2023-12-11T20:13:53.285069+0000","last_unstale":"2023-12-11T20:15:04.319347+0000","last_undegraded":"2023-12-11T20:15:04.319347+0000","last_fullsized":"2023-12-11T20:15:04.319347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:57:18.630314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319509+0000","last_change":"2023-12-11T20:13:52.483184+0000","last_active":"2023-12-11T20:15:04.319509+0000","last_peered":"2023-12-11T20:15:04.319509+0000","last_clean":"2023-12-11T20:15:04.319509+0000","last_became_active":"2023-12-11T20:13:52.482853+0000","last_became_peered":"2023-12-11T20:13:52.482853+0000","last_unstale":"2023-12-11T20:15:04.319509+0000","last_undegraded":"2023-12-11T20:15:04.319509+0000","last_fullsized":"2023-12-11T20:15:04.319509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:35.111222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288169+0000","last_change":"2023-12-11T20:13:53.271751+0000","last_active":"2023-12-11T20:15:04.288169+0000","last_peered":"2023-12-11T20:15:04.288169+0000","last_clean":"2023-12-11T20:15:04.288169+0000","last_became_active":"2023-12-11T20:13:53.271385+0000","last_became_peered":"2023-12-11T20:13:53.271385+0000","last_unstale":"2023-12-11T20:15:04.288169+0000","last_undegraded":"2023-12-11T20:15:04.288169+0000","last_fullsized":"2023-12-11T20:15:04.288169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:28:03.856212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320155+0000","last_change":"2023-12-11T20:13:52.483504+0000","last_active":"2023-12-11T20:15:04.320155+0000","last_peered":"2023-12-11T20:15:04.320155+0000","last_clean":"2023-12-11T20:15:04.320155+0000","last_became_active":"2023-12-11T20:13:52.482796+0000","last_became_peered":"2023-12-11T20:13:52.482796+0000","last_unstale":"2023-12-11T20:15:04.320155+0000","last_undegraded":"2023-12-11T20:15:04.320155+0000","last_fullsized":"2023-12-11T20:15:04.320155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:34:27.162215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285003+0000","last_change":"2023-12-11T20:13:53.276017+0000","last_active":"2023-12-11T20:15:04.285003+0000","last_peered":"2023-12-11T20:15:04.285003+0000","last_clean":"2023-12-11T20:15:04.285003+0000","last_became_active":"2023-12-11T20:13:53.275425+0000","last_became_peered":"2023-12-11T20:13:53.275425+0000","last_unstale":"2023-12-11T20:15:04.285003+0000","last_undegraded":"2023-12-11T20:15:04.285003+0000","last_fullsized":"2023-12-11T20:15:04.285003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:36.762187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319137+0000","last_change":"2023-12-11T20:13:52.477538+0000","last_active":"2023-12-11T20:15:04.319137+0000","last_peered":"2023-12-11T20:15:04.319137+0000","last_clean":"2023-12-11T20:15:04.319137+0000","last_became_active":"2023-12-11T20:13:52.476937+0000","last_became_peered":"2023-12-11T20:13:52.476937+0000","last_unstale":"2023-12-11T20:15:04.319137+0000","last_undegraded":"2023-12-11T20:15:04.319137+0000","last_fullsized":"2023-12-11T20:15:04.319137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:41:25.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320696+0000","last_change":"2023-12-11T20:13:53.276419+0000","last_active":"2023-12-11T20:15:04.320696+0000","last_peered":"2023-12-11T20:15:04.320696+0000","last_clean":"2023-12-11T20:15:04.320696+0000","last_became_active":"2023-12-11T20:13:53.276106+0000","last_became_peered":"2023-12-11T20:13:53.276106+0000","last_unstale":"2023-12-11T20:15:04.320696+0000","last_undegraded":"2023-12-11T20:15:04.320696+0000","last_fullsized":"2023-12-11T20:15:04.320696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:32.720877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288350+0000","last_change":"2023-12-11T20:14:04.554132+0000","last_active":"2023-12-11T20:15:04.288350+0000","last_peered":"2023-12-11T20:15:04.288350+0000","last_clean":"2023-12-11T20:15:04.288350+0000","last_became_active":"2023-12-11T20:14:04.546343+0000","last_became_peered":"2023-12-11T20:14:04.546343+0000","last_unstale":"2023-12-11T20:15:04.288350+0000","last_undegraded":"2023-12-11T20:15:04.288350+0000","last_fullsized":"2023-12-11T20:15:04.288350+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:16:37.790659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283263+0000","last_change":"2023-12-11T20:13:53.265917+0000","last_active":"2023-12-11T20:15:04.283263+0000","last_peered":"2023-12-11T20:15:04.283263+0000","last_clean":"2023-12-11T20:15:04.283263+0000","last_became_active":"2023-12-11T20:13:53.265569+0000","last_became_peered":"2023-12-11T20:13:53.265569+0000","last_unstale":"2023-12-11T20:15:04.283263+0000","last_undegraded":"2023-12-11T20:15:04.283263+0000","last_fullsized":"2023-12-11T20:15:04.283263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:37:19.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319256+0000","last_change":"2023-12-11T20:13:52.478688+0000","last_active":"2023-12-11T20:15:04.319256+0000","last_peered":"2023-12-11T20:15:04.319256+0000","last_clean":"2023-12-11T20:15:04.319256+0000","last_became_active":"2023-12-11T20:13:52.477834+0000","last_became_peered":"2023-12-11T20:13:52.477834+0000","last_unstale":"2023-12-11T20:15:04.319256+0000","last_undegraded":"2023-12-11T20:15:04.319256+0000","last_fullsized":"2023-12-11T20:15:04.319256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:57:04.707801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283269+0000","last_change":"2023-12-11T20:13:53.274629+0000","last_active":"2023-12-11T20:15:04.283269+0000","last_peered":"2023-12-11T20:15:04.283269+0000","last_clean":"2023-12-11T20:15:04.283269+0000","last_became_active":"2023-12-11T20:13:53.269650+0000","last_became_peered":"2023-12-11T20:13:53.269650+0000","last_unstale":"2023-12-11T20:15:04.283269+0000","last_undegraded":"2023-12-11T20:15:04.283269+0000","last_fullsized":"2023-12-11T20:15:04.283269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:57:59.865232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286560+0000","last_change":"2023-12-11T20:13:52.485902+0000","last_active":"2023-12-11T20:15:04.286560+0000","last_peered":"2023-12-11T20:15:04.286560+0000","last_clean":"2023-12-11T20:15:04.286560+0000","last_became_active":"2023-12-11T20:13:52.481982+0000","last_became_peered":"2023-12-11T20:13:52.481982+0000","last_unstale":"2023-12-11T20:15:04.286560+0000","last_undegraded":"2023-12-11T20:15:04.286560+0000","last_fullsized":"2023-12-11T20:15:04.286560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:39.411648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283046+0000","last_change":"2023-12-11T20:14:04.553595+0000","last_active":"2023-12-11T20:15:04.283046+0000","last_peered":"2023-12-11T20:15:04.283046+0000","last_clean":"2023-12-11T20:15:04.283046+0000","last_became_active":"2023-12-11T20:14:04.546235+0000","last_became_peered":"2023-12-11T20:14:04.546235+0000","last_unstale":"2023-12-11T20:15:04.283046+0000","last_undegraded":"2023-12-11T20:15:04.283046+0000","last_fullsized":"2023-12-11T20:15:04.283046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:45:21.354015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320711+0000","last_change":"2023-12-11T20:13:52.486510+0000","last_active":"2023-12-11T20:15:04.320711+0000","last_peered":"2023-12-11T20:15:04.320711+0000","last_clean":"2023-12-11T20:15:04.320711+0000","last_became_active":"2023-12-11T20:13:52.483852+0000","last_became_peered":"2023-12-11T20:13:52.483852+0000","last_unstale":"2023-12-11T20:15:04.320711+0000","last_undegraded":"2023-12-11T20:15:04.320711+0000","last_fullsized":"2023-12-11T20:15:04.320711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:40:05.242000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283465+0000","last_change":"2023-12-11T20:13:53.270545+0000","last_active":"2023-12-11T20:15:04.283465+0000","last_peered":"2023-12-11T20:15:04.283465+0000","last_clean":"2023-12-11T20:15:04.283465+0000","last_became_active":"2023-12-11T20:13:53.270213+0000","last_became_peered":"2023-12-11T20:13:53.270213+0000","last_unstale":"2023-12-11T20:15:04.283465+0000","last_undegraded":"2023-12-11T20:15:04.283465+0000","last_fullsized":"2023-12-11T20:15:04.283465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:35.442471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285045+0000","last_change":"2023-12-11T20:13:53.276886+0000","last_active":"2023-12-11T20:15:04.285045+0000","last_peered":"2023-12-11T20:15:04.285045+0000","last_clean":"2023-12-11T20:15:04.285045+0000","last_became_active":"2023-12-11T20:13:53.276149+0000","last_became_peered":"2023-12-11T20:13:53.276149+0000","last_unstale":"2023-12-11T20:15:04.285045+0000","last_undegraded":"2023-12-11T20:15:04.285045+0000","last_fullsized":"2023-12-11T20:15:04.285045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:34:19.562002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319090+0000","last_change":"2023-12-11T20:13:53.279990+0000","last_active":"2023-12-11T20:15:04.319090+0000","last_peered":"2023-12-11T20:15:04.319090+0000","last_clean":"2023-12-11T20:15:04.319090+0000","last_became_active":"2023-12-11T20:13:53.279685+0000","last_became_peered":"2023-12-11T20:13:53.279685+0000","last_unstale":"2023-12-11T20:15:04.319090+0000","last_undegraded":"2023-12-11T20:15:04.319090+0000","last_fullsized":"2023-12-11T20:15:04.319090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:21:36.526683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319010+0000","last_change":"2023-12-11T20:13:53.279128+0000","last_active":"2023-12-11T20:15:04.319010+0000","last_peered":"2023-12-11T20:15:04.319010+0000","last_clean":"2023-12-11T20:15:04.319010+0000","last_became_active":"2023-12-11T20:13:53.278821+0000","last_became_peered":"2023-12-11T20:13:53.278821+0000","last_unstale":"2023-12-11T20:15:04.319010+0000","last_undegraded":"2023-12-11T20:15:04.319010+0000","last_fullsized":"2023-12-11T20:15:04.319010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:49:36.013115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318953+0000","last_change":"2023-12-11T20:13:53.281004+0000","last_active":"2023-12-11T20:15:04.318953+0000","last_peered":"2023-12-11T20:15:04.318953+0000","last_clean":"2023-12-11T20:15:04.318953+0000","last_became_active":"2023-12-11T20:13:53.280691+0000","last_became_peered":"2023-12-11T20:13:53.280691+0000","last_unstale":"2023-12-11T20:15:04.318953+0000","last_undegraded":"2023-12-11T20:15:04.318953+0000","last_fullsized":"2023-12-11T20:15:04.318953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:00.336975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320598+0000","last_change":"2023-12-11T20:13:53.272690+0000","last_active":"2023-12-11T20:15:04.320598+0000","last_peered":"2023-12-11T20:15:04.320598+0000","last_clean":"2023-12-11T20:15:04.320598+0000","last_became_active":"2023-12-11T20:13:53.272194+0000","last_became_peered":"2023-12-11T20:13:53.272194+0000","last_unstale":"2023-12-11T20:15:04.320598+0000","last_undegraded":"2023-12-11T20:15:04.320598+0000","last_fullsized":"2023-12-11T20:15:04.320598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:58:45.312035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285477+0000","last_change":"2023-12-11T20:13:53.277625+0000","last_active":"2023-12-11T20:15:04.285477+0000","last_peered":"2023-12-11T20:15:04.285477+0000","last_clean":"2023-12-11T20:15:04.285477+0000","last_became_active":"2023-12-11T20:13:53.277174+0000","last_became_peered":"2023-12-11T20:13:53.277174+0000","last_unstale":"2023-12-11T20:15:04.285477+0000","last_undegraded":"2023-12-11T20:15:04.285477+0000","last_fullsized":"2023-12-11T20:15:04.285477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:01:41.057178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319413+0000","last_change":"2023-12-11T20:13:53.278685+0000","last_active":"2023-12-11T20:15:04.319413+0000","last_peered":"2023-12-11T20:15:04.319413+0000","last_clean":"2023-12-11T20:15:04.319413+0000","last_became_active":"2023-12-11T20:13:53.276894+0000","last_became_peered":"2023-12-11T20:13:53.276894+0000","last_unstale":"2023-12-11T20:15:04.319413+0000","last_undegraded":"2023-12-11T20:15:04.319413+0000","last_fullsized":"2023-12-11T20:15:04.319413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:21:00.004496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321269+0000","last_change":"2023-12-11T20:13:53.285596+0000","last_active":"2023-12-11T20:15:04.321269+0000","last_peered":"2023-12-11T20:15:04.321269+0000","last_clean":"2023-12-11T20:15:04.321269+0000","last_became_active":"2023-12-11T20:13:53.285289+0000","last_became_peered":"2023-12-11T20:13:53.285289+0000","last_unstale":"2023-12-11T20:15:04.321269+0000","last_undegraded":"2023-12-11T20:15:04.321269+0000","last_fullsized":"2023-12-11T20:15:04.321269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:53:59.939751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286024+0000","last_change":"2023-12-11T20:13:53.272600+0000","last_active":"2023-12-11T20:15:04.286024+0000","last_peered":"2023-12-11T20:15:04.286024+0000","last_clean":"2023-12-11T20:15:04.286024+0000","last_became_active":"2023-12-11T20:13:53.272308+0000","last_became_peered":"2023-12-11T20:13:53.272308+0000","last_unstale":"2023-12-11T20:15:04.286024+0000","last_undegraded":"2023-12-11T20:15:04.286024+0000","last_fullsized":"2023-12-11T20:15:04.286024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.458731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320063+0000","last_change":"2023-12-11T20:13:53.280833+0000","last_active":"2023-12-11T20:15:04.320063+0000","last_peered":"2023-12-11T20:15:04.320063+0000","last_clean":"2023-12-11T20:15:04.320063+0000","last_became_active":"2023-12-11T20:13:53.280384+0000","last_became_peered":"2023-12-11T20:13:53.280384+0000","last_unstale":"2023-12-11T20:15:04.320063+0000","last_undegraded":"2023-12-11T20:15:04.320063+0000","last_fullsized":"2023-12-11T20:15:04.320063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:37:38.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319663+0000","last_change":"2023-12-11T20:13:53.271825+0000","last_active":"2023-12-11T20:15:04.319663+0000","last_peered":"2023-12-11T20:15:04.319663+0000","last_clean":"2023-12-11T20:15:04.319663+0000","last_became_active":"2023-12-11T20:13:53.271460+0000","last_became_peered":"2023-12-11T20:13:53.271460+0000","last_unstale":"2023-12-11T20:15:04.319663+0000","last_undegraded":"2023-12-11T20:15:04.319663+0000","last_fullsized":"2023-12-11T20:15:04.319663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:46:46.147904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320441+0000","last_change":"2023-12-11T20:13:53.270103+0000","last_active":"2023-12-11T20:15:04.320441+0000","last_peered":"2023-12-11T20:15:04.320441+0000","last_clean":"2023-12-11T20:15:04.320441+0000","last_became_active":"2023-12-11T20:13:53.269781+0000","last_became_peered":"2023-12-11T20:13:53.269781+0000","last_unstale":"2023-12-11T20:15:04.320441+0000","last_undegraded":"2023-12-11T20:15:04.320441+0000","last_fullsized":"2023-12-11T20:15:04.320441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.865347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.293259+0000","last_change":"2023-12-11T20:15:05.293259+0000","last_active":"2023-12-11T20:15:05.293259+0000","last_peered":"2023-12-11T20:15:05.293259+0000","last_clean":"2023-12-11T20:15:05.293259+0000","last_became_active":"2023-12-11T20:15:05.292789+0000","last_became_peered":"2023-12-11T20:15:05.292789+0000","last_unstale":"2023-12-11T20:15:05.293259+0000","last_undegraded":"2023-12-11T20:15:05.293259+0000","last_fullsized":"2023-12-11T20:15:05.293259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:48.751350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":217636,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70742,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":625,"num_read_kb":381,"num_write":166,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":207906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383716,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":473169,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91700000000000004,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.81599999999999995,"15min":0.77200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.202,"5min":10.202,"15min":10.202},"last":0.60099999999999998}]},{"osd":1,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.071,"5min":1.212,"15min":1.212},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.56899999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.018,"5min":1.369,"15min":1.369},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95199999999999996,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.026,"5min":1.097,"15min":1.097},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.083,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.91300000000000003,"15min":0.91400000000000003},"min":{"1min":0.71399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.216,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.76400000000000001}]},{"osd":5,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":1.0980000000000001,"15min":1.1539999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.98299999999999998,"15min":1.0129999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.97799999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.89700000000000002,"15min":0.91800000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.105,"5min":1.782,"15min":1.782},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.96799999999999997,"15min":1},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98299999999999998,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.04,"15min":1.0529999999999999},"min":{"1min":0.749,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.202,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.749},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.77400000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.3240000000000001,"5min":1.857,"15min":1.857},"last":0.80300000000000005}]},{"osd":8,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.92300000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0209999999999999,"15min":1.0449999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.155,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.282,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.876}]},{"osd":10,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.0840000000000001},"min":{"1min":0.90700000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.349,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.204,"15min":1.242},"min":{"1min":0.84099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.89400000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":1130760,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42299999999999999}]},{"osd":1,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.268,"15min":1.268},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.40799999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72799999999999998,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.503}]},{"osd":2,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95199999999999996,"5min":1.107,"15min":1.107},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78900000000000003,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.004,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89800000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.80900000000000005},"min":{"1min":0.48999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93500000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82699999999999996,"15min":0.86099999999999999},"min":{"1min":0.52500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79600000000000004,"15min":0.83499999999999996},"min":{"1min":0.49299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":1.323,"15min":1.323},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.78400000000000003,"15min":0.83999999999999997},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0089999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.93700000000000006},"min":{"1min":0.60699999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0509999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88900000000000001,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.1519999999999999,"5min":1.641,"15min":1.641},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.91300000000000003,"15min":0.95099999999999996},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.121,"5min":1.484,"15min":1.484},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.95499999999999996,"15min":1.01},"min":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0940000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.93999999999999995}]},{"osd":7,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93799999999999994}]},{"osd":8,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.0009999999999999,"15min":1.0549999999999999},"min":{"1min":0.70199999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.1359999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.056},{"interface":"front","average":{"1min":0.88,"5min":1.006,"15min":1.0660000000000001},"min":{"1min":0.628,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.119,"5min":1.667,"15min":1.667},"last":0.92500000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.022,"15min":1.0760000000000001},"min":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1799999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.024,"15min":1.1000000000000001},"min":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1950000000000001,"5min":1.615,"15min":1.615},"last":0.72199999999999998}]},{"osd":11,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1,"15min":1},"min":{"1min":0.78500000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.214,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.999,"15min":1.01},"min":{"1min":0.68999999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.198,"5min":1.768,"15min":1.768},"last":0.97199999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":473405,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.69899999999999995,"15min":0.72499999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.77000000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.70199999999999996},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.81499999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85899999999999999,"15min":0.89200000000000002},"min":{"1min":0.55000000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89800000000000002,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82499999999999996,"15min":0.86699999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4079999999999999,"5min":1.504,"15min":1.504},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65200000000000002,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.77900000000000003,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.81299999999999994,"15min":0.85699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0580000000000001,"5min":1.302,"15min":1.302},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.83299999999999996,"15min":0.88300000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.508,"15min":1.508},"last":1.123},{"interface":"front","average":{"1min":1.1020000000000001,"5min":0.88800000000000001,"15min":0.878},"min":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":5.915,"5min":5.915,"15min":5.915},"last":1.018}]},{"osd":6,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.95999999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.575,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.85999999999999999,"15min":0.90800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.86499999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0269999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.022,"15min":1.075},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.617,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.94899999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.0920000000000001,"15min":1.107},"min":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":5.9539999999999997,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":1.093},{"interface":"front","average":{"1min":0.872,"5min":0.93999999999999995,"15min":0.98399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.073}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.97699999999999998,"15min":0.97099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":6.423,"5min":6.423,"15min":6.423},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.96599999999999997,"15min":0.97199999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":5.9379999999999997,"5min":5.9379999999999997,"15min":5.9379999999999997},"last":0.97699999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":473117,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":1.079,"15min":1.079},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.054,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.80400000000000005},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92400000000000004,"5min":1.081,"15min":1.081},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.81100000000000005,"5min":1.226,"15min":1.226},"last":0.94699999999999995}]},{"osd":4,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0529999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.0760000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.018,"5min":1.232,"15min":1.232},"last":0.78800000000000003}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.028,"5min":1.284,"15min":1.284},"last":1.004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.55200000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97199999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0049999999999999,"5min":1.298,"15min":1.298},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94699999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1619999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.026}]},{"osd":9,"last update":"Mon Dec 11 20:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.68700000000000006,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1779999999999999,"5min":1.304,"15min":1.304},"last":1.109},{"interface":"front","average":{"1min":1.28,"5min":1.008,"15min":0.96599999999999997},"min":{"1min":0.84399999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":6.4790000000000001,"5min":6.4790000000000001,"15min":6.4790000000000001},"last":1.0700000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.80100000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.139,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.083},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.91600000000000004,"15min":0.90000000000000002},"min":{"1min":0.68200000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1830000000000001,"5min":1.331,"15min":1.331},"last":1.048}]},{"osd":11,"last update":"Mon Dec 11 20:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.131}]}]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":1066926,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81000000000000005,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":1.327,"15min":1.327},"last":0.64500000000000002}]},{"osd":2,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.55200000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.518,"15min":1.518},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.052,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93100000000000005,"5min":1.383,"15min":1.383},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90800000000000003,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.115,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85199999999999998,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.054,"5min":1.294,"15min":1.294},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.873,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0580000000000001,"5min":1.474,"15min":1.474},"last":0.88500000000000001}]},{"osd":6,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98799999999999999,"5min":1.327,"15min":1.327},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96999999999999997,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55500000000000005}]},{"osd":8,"last update":"Mon Dec 11 20:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96899999999999997},"min":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.133,"5min":1.544,"15min":1.544},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.0669999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.90000000000000002}]},{"osd":9,"last update":"Mon Dec 11 20:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.99099999999999999},"min":{"1min":0.69299999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.0409999999999999,"5min":1.573,"15min":1.573},"last":0.872},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.98999999999999999,"15min":1.024},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.137,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.008}]},{"osd":10,"last update":"Mon Dec 11 20:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0980000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.01,"15min":1.026},"min":{"1min":0.66800000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1200000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.81200000000000006}]},{"osd":11,"last update":"Mon Dec 11 20:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.099},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.0549999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":472800,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91100000000000003,"5min":1.036,"15min":1.036},"last":0.873},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.81799999999999995,"15min":0.76300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.069,"5min":8.1080000000000005,"15min":8.1080000000000005},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.86599999999999999,"15min":0.98999999999999999},"min":{"1min":0.55800000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0209999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94599999999999995,"15min":1.083},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.137,"5min":6.9489999999999998,"15min":6.9489999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97099999999999997,"5min":1.167,"15min":1.167},"last":0.93400000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.63800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1120000000000001,"5min":1.226,"15min":1.226},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Dec 11 20:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.92600000000000005,"15min":0.84699999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0529999999999999,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.61199999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.228,"15min":1.228},"last":0.82099999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.153,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.90100000000000002,"15min":0.86599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":8.1289999999999996,"5min":8.1289999999999996,"15min":8.1289999999999996},"last":0.71299999999999997}]},{"osd":9,"last update":"Mon Dec 11 20:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.84699999999999998,"15min":0.89900000000000002},"min":{"1min":0.51400000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.88900000000000001,"5min":1.204,"15min":1.204},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.94999999999999996,"15min":0.999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.097,"5min":1.319,"15min":1.319},"last":0.97099999999999997}]},{"osd":10,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.70699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.94499999999999995,"15min":0.97999999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0860000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":533000,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.99299999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.505},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68100000000000005,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.83399999999999996,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.69699999999999995,"15min":0.60299999999999998},"min":{"1min":0.495,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.69199999999999995,"15min":0.60099999999999998},"min":{"1min":0.61799999999999999,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.92700000000000005}]},{"osd":3,"last update":"Mon Dec 11 20:15:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79800000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.64300000000000002},"min":{"1min":0.55900000000000005,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.046,"5min":1.075,"15min":1.075},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.55700000000000005},"min":{"1min":0.47299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.628,"15min":0.57799999999999996},"min":{"1min":0.54800000000000004,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.80500000000000005,"15min":0.72299999999999998},"min":{"1min":0.73599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.018,"5min":0.81000000000000005,"15min":0.71799999999999997},"min":{"1min":0.56299999999999994,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.0049999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.80800000000000005,"15min":0.76800000000000002},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.53700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92400000000000004,"5min":1.081,"15min":1.081},"last":0.88300000000000001}]},{"osd":7,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":0.876,"15min":0.83699999999999997},"min":{"1min":0.76700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.60699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95699999999999996}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80200000000000005,"15min":0.77300000000000002},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1459999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.90400000000000003,"15min":0.86399999999999999},"min":{"1min":0.71099999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.24,"15min":1.24},"last":0.97699999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.97899999999999998,"15min":0.95699999999999996},"min":{"1min":0.94299999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.2929999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.133},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0600000000000001,"5min":1.294,"15min":1.294},"last":0.995}]},{"osd":10,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.86499999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2609999999999999,"5min":1.381,"15min":1.381},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.056,"15min":1.03},"min":{"1min":0.99399999999999999,"5min":0.746,"15min":0.746},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.1719999999999999}]},{"osd":11,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.2030000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":474065,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 20:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65000000000000002,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.32800000000000001},"max":{"1min":1.512,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.625},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65600000000000003,"15min":0.58599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63900000000000001,"15min":0.61499999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.70999999999999996,"15min":0.64400000000000002},"min":{"1min":0.61799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.50600000000000001}]},{"osd":4,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.72799999999999998,"15min":0.66300000000000003},"min":{"1min":0.59199999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.64300000000000002},"min":{"1min":0.52900000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.73,"5min":1.909,"15min":1.909},"last":0.77700000000000002}]},{"osd":5,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.76700000000000002,"15min":0.72299999999999998},"min":{"1min":0.66200000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.751},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:14:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.93999999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.84999999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82799999999999996,"15min":0.84599999999999997},"min":{"1min":0.51700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.55400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.69599999999999995}]},{"osd":10,"last update":"Mon Dec 11 20:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.026,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.90900000000000003},"min":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98999999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.88700000000000001}]},{"osd":11,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90500000000000003,"15min":0.90100000000000002},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.88,"15min":0.874},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.90500000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":535378,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.53400000000000003},"min":{"1min":0.45100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.98799999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61099999999999999,"15min":0.54900000000000004},"min":{"1min":0.45900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.70099999999999996,"15min":0.63},"min":{"1min":0.55100000000000005,"5min":0.371,"15min":0.371},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.67500000000000004,"15min":0.63400000000000001},"min":{"1min":0.53100000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1180000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67500000000000004,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96599999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.63},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.68700000000000006,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.68300000000000005,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.95599999999999996}]},{"osd":6,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.67300000000000004},"min":{"1min":0.52200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.92200000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.80400000000000005,"15min":0.74399999999999999},"min":{"1min":0.61799999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1579999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.746}]},{"osd":7,"last update":"Mon Dec 11 20:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.101,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59799999999999998}]},{"osd":8,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80200000000000005,"15min":0.78400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98399999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.877,"15min":0.86499999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.85999999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":0.91500000000000004},"min":{"1min":0.67500000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.173,"5min":1.379,"15min":1.379},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2250000000000001,"5min":1.268,"15min":1.268},"last":0.88200000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.97599999999999998,"15min":0.96699999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3069999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.91500000000000004}]},{"osd":11,"last update":"Mon Dec 11 20:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.0069999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":472786,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47799999999999998,"15min":0.42099999999999999},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.67100000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.52500000000000002,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":1.1519999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68600000000000005,"15min":0.629},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.753},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.749,"15min":0.66000000000000003},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72599999999999998,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.69399999999999995,"15min":0.65100000000000002},"min":{"1min":0.57199999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Dec 11 20:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.752,"15min":0.66600000000000004},"min":{"1min":0.56499999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.76600000000000001,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.3969999999999998,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.71999999999999997,"15min":0.69699999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.81100000000000005,"15min":0.75600000000000001},"min":{"1min":0.53700000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.45500000000000002}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.625}]},{"osd":7,"last update":"Mon Dec 11 20:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.79400000000000004},"min":{"1min":0.621,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.91000000000000003,"15min":0.86599999999999999},"min":{"1min":0.78600000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.66700000000000004}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.85799999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.95799999999999996,"15min":0.97099999999999997},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.502},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.91300000000000003,"15min":0.91600000000000004},"min":{"1min":0.59799999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.65800000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94299999999999995,"15min":0.96599999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1899999999999999,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.022,"15min":1.0249999999999999},"min":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.79300000000000004}]},{"osd":11,"last update":"Mon Dec 11 20:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.69799999999999995}]}]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":474259,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57999999999999996,"15min":0.53900000000000003},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.496}]},{"osd":1,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.377,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70899999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.42299999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.49299999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.75800000000000001,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66100000000000003,"15min":0.625},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94199999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.63500000000000001,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.7080000000000002,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79400000000000004,"15min":0.72199999999999998},"min":{"1min":0.67600000000000005,"5min":0.441,"15min":0.441},"max":{"1min":1.075,"5min":1.177,"15min":1.177},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.65200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.026,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Mon Dec 11 20:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.81100000000000005,"15min":0.77500000000000002},"min":{"1min":0.65900000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.204,"5min":1.407,"15min":1.407},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.73399999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0469999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.96099999999999997}]},{"osd":8,"last update":"Mon Dec 11 20:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.66200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.876,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91500000000000004,"15min":0.89300000000000002},"min":{"1min":0.77800000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1559999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0349999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.90000000000000002,"15min":0.878},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.26,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.997},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.89000000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.282,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.97899999999999998}]},{"osd":10,"last update":"Mon Dec 11 20:15:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.96799999999999997,"15min":0.94999999999999996},"min":{"1min":0.755,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.234,"5min":1.333,"15min":1.333},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.78200000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.92600000000000005}]},{"osd":11,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.054},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0700000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":1065128,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61699999999999999,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95499999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.56000000000000005}]},{"osd":1,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.69499999999999995,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0529999999999999,"5min":1.101,"15min":1.101},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94399999999999995,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81399999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.57399999999999995,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94799999999999995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.69499999999999995,"15min":0.628},"min":{"1min":0.502,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.054,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.499},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1240000000000001,"5min":1.127,"15min":1.127},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.76800000000000002,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1519999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.78100000000000003,"15min":0.70899999999999996},"min":{"1min":0.55800000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2210000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Mon Dec 11 20:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.76900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0369999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78000000000000003,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.83099999999999996,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1399999999999999,"5min":1.216,"15min":1.216},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.84999999999999998,"15min":0.79600000000000004},"min":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.141,"5min":2.992,"15min":2.992},"last":0.92500000000000004}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77300000000000002,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0309999999999999,"5min":1.589,"15min":1.589},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.85499999999999998,"15min":0.82699999999999996},"min":{"1min":0.72299999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.27,"5min":1.403,"15min":1.403},"last":0.68500000000000005}]},{"osd":9,"last update":"Mon Dec 11 20:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.93999999999999995,"15min":0.93700000000000006},"min":{"1min":0.752,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.272,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.63200000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.66200000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:15:32 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.99199999999999999,"15min":0.98699999999999999},"min":{"1min":0.77700000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.254,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.94099999999999995,"15min":0.92800000000000005},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.874}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34906,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T20:15:40.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T20:15:40.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 -- 172.21.15.12:0/163486481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641071f0 msgr2=0x7fc864109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 --2- 172.21.15.12:0/163486481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641071f0 0x7fc864109660 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009990 tx=0x7fc85c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 -- 172.21.15.12:0/163486481 shutdown_connections 2023-12-11T20:15:40.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 --2- 172.21.15.12:0/163486481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641071f0 0x7fc864109660 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 --2- 172.21.15.12:0/163486481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc864101f90 0x7fc864104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 --2- 172.21.15.12:0/163486481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8641048c0 0x7fc864106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 -- 172.21.15.12:0/163486481 >> 172.21.15.12:0/163486481 conn(0x7fc8640fb980 msgr2=0x7fc8640fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:40.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 -- 172.21.15.12:0/163486481 shutdown_connections 2023-12-11T20:15:40.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.478+0000 7fc868bff700 1 -- 172.21.15.12:0/163486481 wait complete. 2023-12-11T20:15:40.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.479+0000 7fc868bff700 1 Processor -- start 2023-12-11T20:15:40.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.479+0000 7fc868bff700 1 -- start start 2023-12-11T20:15:40.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc868bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc864101f90 0x7fc864199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:40.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc868bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641048c0 0x7fc8641999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:40.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc868bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8641071f0 0x7fc8641a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:40.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc868bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641a0fc0 con 0x7fc8641048c0 2023-12-11T20:15:40.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc868bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641a1100 con 0x7fc8641071f0 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc868bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641a1290 con 0x7fc864101f90 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641048c0 0x7fc8641999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc85bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641048c0 0x7fc8641999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33062/0 (socket says 172.21.15.12:33062) 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc85bfff700 1 -- 172.21.15.12:0/1801478159 learned_addr learned my addr 172.21.15.12:0/1801478159 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc862d9d700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8641071f0 0x7fc8641a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc86259c700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc864101f90 0x7fc864199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc85bfff700 1 -- 172.21.15.12:0/1801478159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc864101f90 msgr2=0x7fc864199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc85bfff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc864101f90 0x7fc864199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc85bfff700 1 -- 172.21.15.12:0/1801478159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8641071f0 msgr2=0x7fc8641a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc85bfff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8641071f0 0x7fc8641a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc85bfff700 1 -- 172.21.15.12:0/1801478159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0095f0 con 0x7fc8641048c0 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.480+0000 7fc86259c700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc864101f90 0x7fc864199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.481+0000 7fc85bfff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641048c0 0x7fc8641999d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00d950 tx=0x7fc84c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.481+0000 7fc85b7fe700 1 -- 172.21.15.12:0/1801478159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c009940 con 0x7fc8641048c0 2023-12-11T20:15:40.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.481+0000 7fc85b7fe700 1 -- 172.21.15.12:0/1801478159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc84c010460 con 0x7fc8641048c0 2023-12-11T20:15:40.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.481+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8641a1570 con 0x7fc8641048c0 2023-12-11T20:15:40.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.481+0000 7fc85b7fe700 1 -- 172.21.15.12:0/1801478159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00f620 con 0x7fc8641048c0 2023-12-11T20:15:40.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.481+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8641a1a80 con 0x7fc8641048c0 2023-12-11T20:15:40.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.482+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc864108d70 con 0x7fc8641048c0 2023-12-11T20:15:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.484+0000 7fc85b7fe700 1 -- 172.21.15.12:0/1801478159 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc84c0105d0 con 0x7fc8641048c0 2023-12-11T20:15:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.485+0000 7fc85b7fe700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8500a1480 0x7fc8500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.485+0000 7fc85b7fe700 1 -- 172.21.15.12:0/1801478159 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc84c0ccc10 con 0x7fc8641048c0 2023-12-11T20:15:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.486+0000 7fc86259c700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8500a1480 0x7fc8500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:40.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.486+0000 7fc86259c700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8500a1480 0x7fc8500a3940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc854009fd0 tx=0x7fc85400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:40.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.489+0000 7fc85b7fe700 1 -- 172.21.15.12:0/1801478159 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc84c0961c0 con 0x7fc8641048c0 2023-12-11T20:15:40.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:40 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/635175728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:40.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:40 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/635175728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:40.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.697+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc86402d470 con 0x7fc8500a1480 2023-12-11T20:15:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.708+0000 7fc85b7fe700 1 -- 172.21.15.12:0/1801478159 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342472 (secure 0 0 0) 0x7fc86402d470 con 0x7fc8500a1480 2023-12-11T20:15:40.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8500a1480 msgr2=0x7fc8500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8500a1480 0x7fc8500a3940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc854009fd0 tx=0x7fc85400b040 comp rx=0 tx=0).stop 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641048c0 msgr2=0x7fc8641999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641048c0 0x7fc8641999d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00d950 tx=0x7fc84c00dc60 comp rx=0 tx=0).stop 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 shutdown_connections 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8500a1480 0x7fc8500a3940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8641071f0 0x7fc8641a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc864101f90 0x7fc864199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 --2- 172.21.15.12:0/1801478159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8641048c0 0x7fc8641999d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 >> 172.21.15.12:0/1801478159 conn(0x7fc8640fb980 msgr2=0x7fc864101730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.712+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 shutdown_connections 2023-12-11T20:15:40.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.713+0000 7fc868bff700 1 -- 172.21.15.12:0/1801478159 wait complete. 2023-12-11T20:15:40.714 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-12-11T20:15:40.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:40 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/635175728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:40.729 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2023-12-11T20:15:39.057669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661356,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":751,"num_read_kb":490,"num_write":349,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2951963,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336072,"kb_used_data":11840,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605752,"statfs":{"total":1151940427776,"available":1151596290048,"internally_reserved":0,"allocated":12124160,"data_stored":7644793,"data_compressed":250086,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19142,"internal_metadata":331855162},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5814,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":33,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002775"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285527+0000","last_change":"2023-12-11T20:13:53.282384+0000","last_active":"2023-12-11T20:15:04.285527+0000","last_peered":"2023-12-11T20:15:04.285527+0000","last_clean":"2023-12-11T20:15:04.285527+0000","last_became_active":"2023-12-11T20:13:53.282058+0000","last_became_peered":"2023-12-11T20:13:53.282058+0000","last_unstale":"2023-12-11T20:15:04.285527+0000","last_undegraded":"2023-12-11T20:15:04.285527+0000","last_fullsized":"2023-12-11T20:15:04.285527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:23:31.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319238+0000","last_change":"2023-12-11T20:13:53.282283+0000","last_active":"2023-12-11T20:15:04.319238+0000","last_peered":"2023-12-11T20:15:04.319238+0000","last_clean":"2023-12-11T20:15:04.319238+0000","last_became_active":"2023-12-11T20:13:53.278054+0000","last_became_peered":"2023-12-11T20:13:53.278054+0000","last_unstale":"2023-12-11T20:15:04.319238+0000","last_undegraded":"2023-12-11T20:15:04.319238+0000","last_fullsized":"2023-12-11T20:15:04.319238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:07:50.194732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319039+0000","last_change":"2023-12-11T20:13:53.277704+0000","last_active":"2023-12-11T20:15:04.319039+0000","last_peered":"2023-12-11T20:15:04.319039+0000","last_clean":"2023-12-11T20:15:04.319039+0000","last_became_active":"2023-12-11T20:13:53.277395+0000","last_became_peered":"2023-12-11T20:13:53.277395+0000","last_unstale":"2023-12-11T20:15:04.319039+0000","last_undegraded":"2023-12-11T20:15:04.319039+0000","last_fullsized":"2023-12-11T20:15:04.319039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:54:10.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288775+0000","last_change":"2023-12-11T20:13:53.280854+0000","last_active":"2023-12-11T20:15:04.288775+0000","last_peered":"2023-12-11T20:15:04.288775+0000","last_clean":"2023-12-11T20:15:04.288775+0000","last_became_active":"2023-12-11T20:13:53.277275+0000","last_became_peered":"2023-12-11T20:13:53.277275+0000","last_unstale":"2023-12-11T20:15:04.288775+0000","last_undegraded":"2023-12-11T20:15:04.288775+0000","last_fullsized":"2023-12-11T20:15:04.288775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:32:58.001015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288323+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:15:04.288323+0000","last_peered":"2023-12-11T20:15:04.288323+0000","last_clean":"2023-12-11T20:15:04.288323+0000","last_became_active":"2023-12-11T20:13:53.281659+0000","last_became_peered":"2023-12-11T20:13:53.281659+0000","last_unstale":"2023-12-11T20:15:04.288323+0000","last_undegraded":"2023-12-11T20:15:04.288323+0000","last_fullsized":"2023-12-11T20:15:04.288323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:47:20.764823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285717+0000","last_change":"2023-12-11T20:13:53.284175+0000","last_active":"2023-12-11T20:15:04.285717+0000","last_peered":"2023-12-11T20:15:04.285717+0000","last_clean":"2023-12-11T20:15:04.285717+0000","last_became_active":"2023-12-11T20:13:53.283801+0000","last_became_peered":"2023-12-11T20:13:53.283801+0000","last_unstale":"2023-12-11T20:15:04.285717+0000","last_undegraded":"2023-12-11T20:15:04.285717+0000","last_fullsized":"2023-12-11T20:15:04.285717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:35.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282949+0000","last_change":"2023-12-11T20:13:53.262700+0000","last_active":"2023-12-11T20:15:04.282949+0000","last_peered":"2023-12-11T20:15:04.282949+0000","last_clean":"2023-12-11T20:15:04.282949+0000","last_became_active":"2023-12-11T20:13:53.262322+0000","last_became_peered":"2023-12-11T20:13:53.262322+0000","last_unstale":"2023-12-11T20:15:04.282949+0000","last_undegraded":"2023-12-11T20:15:04.282949+0000","last_fullsized":"2023-12-11T20:15:04.282949+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:02:47.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.281863+0000","last_change":"2023-12-11T20:14:04.763447+0000","last_active":"2023-12-11T20:15:04.281863+0000","last_peered":"2023-12-11T20:15:04.281863+0000","last_clean":"2023-12-11T20:15:04.281863+0000","last_became_active":"2023-12-11T20:14:04.763036+0000","last_became_peered":"2023-12-11T20:14:04.763036+0000","last_unstale":"2023-12-11T20:15:04.281863+0000","last_undegraded":"2023-12-11T20:15:04.281863+0000","last_fullsized":"2023-12-11T20:15:04.281863+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:48.188993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319992+0000","last_change":"2023-12-11T20:13:53.277384+0000","last_active":"2023-12-11T20:15:04.319992+0000","last_peered":"2023-12-11T20:15:04.319992+0000","last_clean":"2023-12-11T20:15:04.319992+0000","last_became_active":"2023-12-11T20:13:53.277017+0000","last_became_peered":"2023-12-11T20:13:53.277017+0000","last_unstale":"2023-12-11T20:15:04.319992+0000","last_undegraded":"2023-12-11T20:15:04.319992+0000","last_fullsized":"2023-12-11T20:15:04.319992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:04:50.820269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285932+0000","last_change":"2023-12-11T20:13:53.285340+0000","last_active":"2023-12-11T20:15:04.285932+0000","last_peered":"2023-12-11T20:15:04.285932+0000","last_clean":"2023-12-11T20:15:04.285932+0000","last_became_active":"2023-12-11T20:13:53.285040+0000","last_became_peered":"2023-12-11T20:13:53.285040+0000","last_unstale":"2023-12-11T20:15:04.285932+0000","last_undegraded":"2023-12-11T20:15:04.285932+0000","last_fullsized":"2023-12-11T20:15:04.285932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:52:53.312236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283309+0000","last_change":"2023-12-11T20:13:53.274637+0000","last_active":"2023-12-11T20:15:04.283309+0000","last_peered":"2023-12-11T20:15:04.283309+0000","last_clean":"2023-12-11T20:15:04.283309+0000","last_became_active":"2023-12-11T20:13:53.270971+0000","last_became_peered":"2023-12-11T20:13:53.270971+0000","last_unstale":"2023-12-11T20:15:04.283309+0000","last_undegraded":"2023-12-11T20:15:04.283309+0000","last_fullsized":"2023-12-11T20:15:04.283309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:20:35.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288736+0000","last_change":"2023-12-11T20:13:53.280712+0000","last_active":"2023-12-11T20:15:04.288736+0000","last_peered":"2023-12-11T20:15:04.288736+0000","last_clean":"2023-12-11T20:15:04.288736+0000","last_became_active":"2023-12-11T20:13:53.276873+0000","last_became_peered":"2023-12-11T20:13:53.276873+0000","last_unstale":"2023-12-11T20:15:04.288736+0000","last_undegraded":"2023-12-11T20:15:04.288736+0000","last_fullsized":"2023-12-11T20:15:04.288736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:36:08.438862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321129+0000","last_change":"2023-12-11T20:13:53.272378+0000","last_active":"2023-12-11T20:15:04.321129+0000","last_peered":"2023-12-11T20:15:04.321129+0000","last_clean":"2023-12-11T20:15:04.321129+0000","last_became_active":"2023-12-11T20:13:53.271992+0000","last_became_peered":"2023-12-11T20:13:53.271992+0000","last_unstale":"2023-12-11T20:15:04.321129+0000","last_undegraded":"2023-12-11T20:15:04.321129+0000","last_fullsized":"2023-12-11T20:15:04.321129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:01:05.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318845+0000","last_change":"2023-12-11T20:13:53.275078+0000","last_active":"2023-12-11T20:15:04.318845+0000","last_peered":"2023-12-11T20:15:04.318845+0000","last_clean":"2023-12-11T20:15:04.318845+0000","last_became_active":"2023-12-11T20:13:53.273555+0000","last_became_peered":"2023-12-11T20:13:53.273555+0000","last_unstale":"2023-12-11T20:15:04.318845+0000","last_undegraded":"2023-12-11T20:15:04.318845+0000","last_fullsized":"2023-12-11T20:15:04.318845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:23:27.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318921+0000","last_change":"2023-12-11T20:13:53.277135+0000","last_active":"2023-12-11T20:15:04.318921+0000","last_peered":"2023-12-11T20:15:04.318921+0000","last_clean":"2023-12-11T20:15:04.318921+0000","last_became_active":"2023-12-11T20:13:53.276406+0000","last_became_peered":"2023-12-11T20:13:53.276406+0000","last_unstale":"2023-12-11T20:15:04.318921+0000","last_undegraded":"2023-12-11T20:15:04.318921+0000","last_fullsized":"2023-12-11T20:15:04.318921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:20.508685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319466+0000","last_change":"2023-12-11T20:13:53.268845+0000","last_active":"2023-12-11T20:15:04.319466+0000","last_peered":"2023-12-11T20:15:04.319466+0000","last_clean":"2023-12-11T20:15:04.319466+0000","last_became_active":"2023-12-11T20:13:53.268553+0000","last_became_peered":"2023-12-11T20:13:53.268553+0000","last_unstale":"2023-12-11T20:15:04.319466+0000","last_undegraded":"2023-12-11T20:15:04.319466+0000","last_fullsized":"2023-12-11T20:15:04.319466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:55.125792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285660+0000","last_change":"2023-12-11T20:13:53.284361+0000","last_active":"2023-12-11T20:15:04.285660+0000","last_peered":"2023-12-11T20:15:04.285660+0000","last_clean":"2023-12-11T20:15:04.285660+0000","last_became_active":"2023-12-11T20:13:53.282109+0000","last_became_peered":"2023-12-11T20:13:53.282109+0000","last_unstale":"2023-12-11T20:15:04.285660+0000","last_undegraded":"2023-12-11T20:15:04.285660+0000","last_fullsized":"2023-12-11T20:15:04.285660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:44:50.021737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282299+0000","last_change":"2023-12-11T20:13:53.274005+0000","last_active":"2023-12-11T20:15:04.282299+0000","last_peered":"2023-12-11T20:15:04.282299+0000","last_clean":"2023-12-11T20:15:04.282299+0000","last_became_active":"2023-12-11T20:13:53.273336+0000","last_became_peered":"2023-12-11T20:13:53.273336+0000","last_unstale":"2023-12-11T20:15:04.282299+0000","last_undegraded":"2023-12-11T20:15:04.282299+0000","last_fullsized":"2023-12-11T20:15:04.282299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:56:05.732607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319261+0000","last_change":"2023-12-11T20:13:53.280909+0000","last_active":"2023-12-11T20:15:04.319261+0000","last_peered":"2023-12-11T20:15:04.319261+0000","last_clean":"2023-12-11T20:15:04.319261+0000","last_became_active":"2023-12-11T20:13:53.278124+0000","last_became_peered":"2023-12-11T20:13:53.278124+0000","last_unstale":"2023-12-11T20:15:04.319261+0000","last_undegraded":"2023-12-11T20:15:04.319261+0000","last_fullsized":"2023-12-11T20:15:04.319261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:09:19.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282365+0000","last_change":"2023-12-11T20:13:52.478685+0000","last_active":"2023-12-11T20:15:04.282365+0000","last_peered":"2023-12-11T20:15:04.282365+0000","last_clean":"2023-12-11T20:15:04.282365+0000","last_became_active":"2023-12-11T20:13:52.478391+0000","last_became_peered":"2023-12-11T20:13:52.478391+0000","last_unstale":"2023-12-11T20:15:04.282365+0000","last_undegraded":"2023-12-11T20:15:04.282365+0000","last_fullsized":"2023-12-11T20:15:04.282365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:02:54.039954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321172+0000","last_change":"2023-12-11T20:13:53.279432+0000","last_active":"2023-12-11T20:15:04.321172+0000","last_peered":"2023-12-11T20:15:04.321172+0000","last_clean":"2023-12-11T20:15:04.321172+0000","last_became_active":"2023-12-11T20:13:53.279087+0000","last_became_peered":"2023-12-11T20:13:53.279087+0000","last_unstale":"2023-12-11T20:15:04.321172+0000","last_undegraded":"2023-12-11T20:15:04.321172+0000","last_fullsized":"2023-12-11T20:15:04.321172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.376941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321258+0000","last_change":"2023-12-11T20:13:52.485170+0000","last_active":"2023-12-11T20:15:04.321258+0000","last_peered":"2023-12-11T20:15:04.321258+0000","last_clean":"2023-12-11T20:15:04.321258+0000","last_became_active":"2023-12-11T20:13:52.484885+0000","last_became_peered":"2023-12-11T20:13:52.484885+0000","last_unstale":"2023-12-11T20:15:04.321258+0000","last_undegraded":"2023-12-11T20:15:04.321258+0000","last_fullsized":"2023-12-11T20:15:04.321258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:21:40.746709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319348+0000","last_change":"2023-12-11T20:13:53.274015+0000","last_active":"2023-12-11T20:15:04.319348+0000","last_peered":"2023-12-11T20:15:04.319348+0000","last_clean":"2023-12-11T20:15:04.319348+0000","last_became_active":"2023-12-11T20:13:53.272504+0000","last_became_peered":"2023-12-11T20:13:53.272504+0000","last_unstale":"2023-12-11T20:15:04.319348+0000","last_undegraded":"2023-12-11T20:15:04.319348+0000","last_fullsized":"2023-12-11T20:15:04.319348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:26.155659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285339+0000","last_change":"2023-12-11T20:14:04.560730+0000","last_active":"2023-12-11T20:15:04.285339+0000","last_peered":"2023-12-11T20:15:04.285339+0000","last_clean":"2023-12-11T20:15:04.285339+0000","last_became_active":"2023-12-11T20:14:04.549828+0000","last_became_peered":"2023-12-11T20:14:04.549828+0000","last_unstale":"2023-12-11T20:15:04.285339+0000","last_undegraded":"2023-12-11T20:15:04.285339+0000","last_fullsized":"2023-12-11T20:15:04.285339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:47:10.046705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319638+0000","last_change":"2023-12-11T20:13:53.268907+0000","last_active":"2023-12-11T20:15:04.319638+0000","last_peered":"2023-12-11T20:15:04.319638+0000","last_clean":"2023-12-11T20:15:04.319638+0000","last_became_active":"2023-12-11T20:13:53.268494+0000","last_became_peered":"2023-12-11T20:13:53.268494+0000","last_unstale":"2023-12-11T20:15:04.319638+0000","last_undegraded":"2023-12-11T20:15:04.319638+0000","last_fullsized":"2023-12-11T20:15:04.319638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:57:36.104687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.289029+0000","last_change":"2023-12-11T20:13:52.475425+0000","last_active":"2023-12-11T20:15:04.289029+0000","last_peered":"2023-12-11T20:15:04.289029+0000","last_clean":"2023-12-11T20:15:04.289029+0000","last_became_active":"2023-12-11T20:13:52.475066+0000","last_became_peered":"2023-12-11T20:13:52.475066+0000","last_unstale":"2023-12-11T20:15:04.289029+0000","last_undegraded":"2023-12-11T20:15:04.289029+0000","last_fullsized":"2023-12-11T20:15:04.289029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:01:01.603043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286516+0000","last_change":"2023-12-11T20:14:04.546865+0000","last_active":"2023-12-11T20:15:04.286516+0000","last_peered":"2023-12-11T20:15:04.286516+0000","last_clean":"2023-12-11T20:15:04.286516+0000","last_became_active":"2023-12-11T20:14:04.546475+0000","last_became_peered":"2023-12-11T20:14:04.546475+0000","last_unstale":"2023-12-11T20:15:04.286516+0000","last_undegraded":"2023-12-11T20:15:04.286516+0000","last_fullsized":"2023-12-11T20:15:04.286516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:54.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'8","reported_seq":131,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:37.439744+0000","last_change":"2023-12-11T20:13:52.481648+0000","last_active":"2023-12-11T20:15:37.439744+0000","last_peered":"2023-12-11T20:15:37.439744+0000","last_clean":"2023-12-11T20:15:37.439744+0000","last_became_active":"2023-12-11T20:13:52.481317+0000","last_became_peered":"2023-12-11T20:13:52.481317+0000","last_unstale":"2023-12-11T20:15:37.439744+0000","last_undegraded":"2023-12-11T20:15:37.439744+0000","last_fullsized":"2023-12-11T20:15:37.439744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:30:32.206757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288382+0000","last_change":"2023-12-11T20:13:53.261350+0000","last_active":"2023-12-11T20:15:04.288382+0000","last_peered":"2023-12-11T20:15:04.288382+0000","last_clean":"2023-12-11T20:15:04.288382+0000","last_became_active":"2023-12-11T20:13:53.260471+0000","last_became_peered":"2023-12-11T20:13:53.260471+0000","last_unstale":"2023-12-11T20:15:04.288382+0000","last_undegraded":"2023-12-11T20:15:04.288382+0000","last_fullsized":"2023-12-11T20:15:04.288382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:27.844329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285654+0000","last_change":"2023-12-11T20:13:52.482190+0000","last_active":"2023-12-11T20:15:04.285654+0000","last_peered":"2023-12-11T20:15:04.285654+0000","last_clean":"2023-12-11T20:15:04.285654+0000","last_became_active":"2023-12-11T20:13:52.481758+0000","last_became_peered":"2023-12-11T20:13:52.481758+0000","last_unstale":"2023-12-11T20:15:04.285654+0000","last_undegraded":"2023-12-11T20:15:04.285654+0000","last_fullsized":"2023-12-11T20:15:04.285654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:26.226338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286371+0000","last_change":"2023-12-11T20:13:53.279366+0000","last_active":"2023-12-11T20:15:04.286371+0000","last_peered":"2023-12-11T20:15:04.286371+0000","last_clean":"2023-12-11T20:15:04.286371+0000","last_became_active":"2023-12-11T20:13:53.279074+0000","last_became_peered":"2023-12-11T20:13:53.279074+0000","last_unstale":"2023-12-11T20:15:04.286371+0000","last_undegraded":"2023-12-11T20:15:04.286371+0000","last_fullsized":"2023-12-11T20:15:04.286371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:37.856345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320171+0000","last_change":"2023-12-11T20:13:52.480830+0000","last_active":"2023-12-11T20:15:04.320171+0000","last_peered":"2023-12-11T20:15:04.320171+0000","last_clean":"2023-12-11T20:15:04.320171+0000","last_became_active":"2023-12-11T20:13:52.480359+0000","last_became_peered":"2023-12-11T20:13:52.480359+0000","last_unstale":"2023-12-11T20:15:04.320171+0000","last_undegraded":"2023-12-11T20:15:04.320171+0000","last_fullsized":"2023-12-11T20:15:04.320171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:13.756411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319851+0000","last_change":"2023-12-11T20:13:53.275587+0000","last_active":"2023-12-11T20:15:04.319851+0000","last_peered":"2023-12-11T20:15:04.319851+0000","last_clean":"2023-12-11T20:15:04.319851+0000","last_became_active":"2023-12-11T20:13:53.275014+0000","last_became_peered":"2023-12-11T20:13:53.275014+0000","last_unstale":"2023-12-11T20:15:04.319851+0000","last_undegraded":"2023-12-11T20:15:04.319851+0000","last_fullsized":"2023-12-11T20:15:04.319851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:21:23.179714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.284858+0000","last_change":"2023-12-11T20:14:04.548868+0000","last_active":"2023-12-11T20:15:04.284858+0000","last_peered":"2023-12-11T20:15:04.284858+0000","last_clean":"2023-12-11T20:15:04.284858+0000","last_became_active":"2023-12-11T20:14:04.548198+0000","last_became_peered":"2023-12-11T20:14:04.548198+0000","last_unstale":"2023-12-11T20:15:04.284858+0000","last_undegraded":"2023-12-11T20:15:04.284858+0000","last_fullsized":"2023-12-11T20:15:04.284858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:11:16.117241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.281957+0000","last_change":"2023-12-11T20:13:53.281254+0000","last_active":"2023-12-11T20:15:04.281957+0000","last_peered":"2023-12-11T20:15:04.281957+0000","last_clean":"2023-12-11T20:15:04.281957+0000","last_became_active":"2023-12-11T20:13:53.278026+0000","last_became_peered":"2023-12-11T20:13:53.278026+0000","last_unstale":"2023-12-11T20:15:04.281957+0000","last_undegraded":"2023-12-11T20:15:04.281957+0000","last_fullsized":"2023-12-11T20:15:04.281957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:25:46.033739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:34.432516+0000","last_change":"2023-12-11T20:13:52.485136+0000","last_active":"2023-12-11T20:15:34.432516+0000","last_peered":"2023-12-11T20:15:34.432516+0000","last_clean":"2023-12-11T20:15:34.432516+0000","last_became_active":"2023-12-11T20:13:52.484743+0000","last_became_peered":"2023-12-11T20:13:52.484743+0000","last_unstale":"2023-12-11T20:15:34.432516+0000","last_undegraded":"2023-12-11T20:15:34.432516+0000","last_fullsized":"2023-12-11T20:15:34.432516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:50.893360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319974+0000","last_change":"2023-12-11T20:13:53.274566+0000","last_active":"2023-12-11T20:15:04.319974+0000","last_peered":"2023-12-11T20:15:04.319974+0000","last_clean":"2023-12-11T20:15:04.319974+0000","last_became_active":"2023-12-11T20:13:53.273325+0000","last_became_peered":"2023-12-11T20:13:53.273325+0000","last_unstale":"2023-12-11T20:15:04.319974+0000","last_undegraded":"2023-12-11T20:15:04.319974+0000","last_fullsized":"2023-12-11T20:15:04.319974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:29:17.656364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283417+0000","last_change":"2023-12-11T20:14:04.766961+0000","last_active":"2023-12-11T20:15:04.283417+0000","last_peered":"2023-12-11T20:15:04.283417+0000","last_clean":"2023-12-11T20:15:04.283417+0000","last_became_active":"2023-12-11T20:14:04.763504+0000","last_became_peered":"2023-12-11T20:14:04.763504+0000","last_unstale":"2023-12-11T20:15:04.283417+0000","last_undegraded":"2023-12-11T20:15:04.283417+0000","last_fullsized":"2023-12-11T20:15:04.283417+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:50:38.795524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319445+0000","last_change":"2023-12-11T20:14:04.764089+0000","last_active":"2023-12-11T20:15:04.319445+0000","last_peered":"2023-12-11T20:15:04.319445+0000","last_clean":"2023-12-11T20:15:04.319445+0000","last_became_active":"2023-12-11T20:14:04.763556+0000","last_became_peered":"2023-12-11T20:14:04.763556+0000","last_unstale":"2023-12-11T20:15:04.319445+0000","last_undegraded":"2023-12-11T20:15:04.319445+0000","last_fullsized":"2023-12-11T20:15:04.319445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:39.851342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286688+0000","last_change":"2023-12-11T20:13:52.486247+0000","last_active":"2023-12-11T20:15:04.286688+0000","last_peered":"2023-12-11T20:15:04.286688+0000","last_clean":"2023-12-11T20:15:04.286688+0000","last_became_active":"2023-12-11T20:13:52.485343+0000","last_became_peered":"2023-12-11T20:13:52.485343+0000","last_unstale":"2023-12-11T20:15:04.286688+0000","last_undegraded":"2023-12-11T20:15:04.286688+0000","last_fullsized":"2023-12-11T20:15:04.286688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:21:46.587858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319745+0000","last_change":"2023-12-11T20:13:53.281264+0000","last_active":"2023-12-11T20:15:04.319745+0000","last_peered":"2023-12-11T20:15:04.319745+0000","last_clean":"2023-12-11T20:15:04.319745+0000","last_became_active":"2023-12-11T20:13:53.280899+0000","last_became_peered":"2023-12-11T20:13:53.280899+0000","last_unstale":"2023-12-11T20:15:04.319745+0000","last_undegraded":"2023-12-11T20:15:04.319745+0000","last_fullsized":"2023-12-11T20:15:04.319745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:17.675421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":256,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.441967+0000","last_change":"2023-12-11T20:13:52.475732+0000","last_active":"2023-12-11T20:15:35.441967+0000","last_peered":"2023-12-11T20:15:35.441967+0000","last_clean":"2023-12-11T20:15:35.441967+0000","last_became_active":"2023-12-11T20:13:52.475415+0000","last_became_peered":"2023-12-11T20:13:52.475415+0000","last_unstale":"2023-12-11T20:15:35.441967+0000","last_undegraded":"2023-12-11T20:15:35.441967+0000","last_fullsized":"2023-12-11T20:15:35.441967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:20:31.539997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65076,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":162,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288602+0000","last_change":"2023-12-11T20:13:53.273365+0000","last_active":"2023-12-11T20:15:04.288602+0000","last_peered":"2023-12-11T20:15:04.288602+0000","last_clean":"2023-12-11T20:15:04.288602+0000","last_became_active":"2023-12-11T20:13:53.268456+0000","last_became_peered":"2023-12-11T20:13:53.268456+0000","last_unstale":"2023-12-11T20:15:04.288602+0000","last_undegraded":"2023-12-11T20:15:04.288602+0000","last_fullsized":"2023-12-11T20:15:04.288602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:13.850229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319079+0000","last_change":"2023-12-11T20:13:52.477609+0000","last_active":"2023-12-11T20:15:04.319079+0000","last_peered":"2023-12-11T20:15:04.319079+0000","last_clean":"2023-12-11T20:15:04.319079+0000","last_became_active":"2023-12-11T20:13:52.477177+0000","last_became_peered":"2023-12-11T20:13:52.477177+0000","last_unstale":"2023-12-11T20:15:04.319079+0000","last_undegraded":"2023-12-11T20:15:04.319079+0000","last_fullsized":"2023-12-11T20:15:04.319079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:46.987026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320296+0000","last_change":"2023-12-11T20:13:53.278247+0000","last_active":"2023-12-11T20:15:04.320296+0000","last_peered":"2023-12-11T20:15:04.320296+0000","last_clean":"2023-12-11T20:15:04.320296+0000","last_became_active":"2023-12-11T20:13:53.277928+0000","last_became_peered":"2023-12-11T20:13:53.277928+0000","last_unstale":"2023-12-11T20:15:04.320296+0000","last_undegraded":"2023-12-11T20:15:04.320296+0000","last_fullsized":"2023-12-11T20:15:04.320296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:52:33.864370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286178+0000","last_change":"2023-12-11T20:13:52.485985+0000","last_active":"2023-12-11T20:15:04.286178+0000","last_peered":"2023-12-11T20:15:04.286178+0000","last_clean":"2023-12-11T20:15:04.286178+0000","last_became_active":"2023-12-11T20:13:52.484929+0000","last_became_peered":"2023-12-11T20:13:52.484929+0000","last_unstale":"2023-12-11T20:15:04.286178+0000","last_undegraded":"2023-12-11T20:15:04.286178+0000","last_fullsized":"2023-12-11T20:15:04.286178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T08:11:28.665448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283632+0000","last_change":"2023-12-11T20:13:53.277048+0000","last_active":"2023-12-11T20:15:04.283632+0000","last_peered":"2023-12-11T20:15:04.283632+0000","last_clean":"2023-12-11T20:15:04.283632+0000","last_became_active":"2023-12-11T20:13:53.276706+0000","last_became_peered":"2023-12-11T20:13:53.276706+0000","last_unstale":"2023-12-11T20:15:04.283632+0000","last_undegraded":"2023-12-11T20:15:04.283632+0000","last_fullsized":"2023-12-11T20:15:04.283632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:46.815339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.432267+0000","last_change":"2023-12-11T20:13:52.477814+0000","last_active":"2023-12-11T20:15:35.432267+0000","last_peered":"2023-12-11T20:15:35.432267+0000","last_clean":"2023-12-11T20:15:35.432267+0000","last_became_active":"2023-12-11T20:13:52.477036+0000","last_became_peered":"2023-12-11T20:13:52.477036+0000","last_unstale":"2023-12-11T20:15:35.432267+0000","last_undegraded":"2023-12-11T20:15:35.432267+0000","last_fullsized":"2023-12-11T20:15:35.432267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:53:44.279968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.288926+0000","last_change":"2023-12-11T20:15:05.288926+0000","last_active":"2023-12-11T20:15:05.288926+0000","last_peered":"2023-12-11T20:15:05.288926+0000","last_clean":"2023-12-11T20:15:05.288926+0000","last_became_active":"2023-12-11T20:15:05.288443+0000","last_became_peered":"2023-12-11T20:15:05.288443+0000","last_unstale":"2023-12-11T20:15:05.288926+0000","last_undegraded":"2023-12-11T20:15:05.288926+0000","last_fullsized":"2023-12-11T20:15:05.288926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:09:43.778797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288197+0000","last_change":"2023-12-11T20:13:52.483417+0000","last_active":"2023-12-11T20:15:04.288197+0000","last_peered":"2023-12-11T20:15:04.288197+0000","last_clean":"2023-12-11T20:15:04.288197+0000","last_became_active":"2023-12-11T20:13:52.481395+0000","last_became_peered":"2023-12-11T20:13:52.481395+0000","last_unstale":"2023-12-11T20:15:04.288197+0000","last_undegraded":"2023-12-11T20:15:04.288197+0000","last_fullsized":"2023-12-11T20:15:04.288197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:01:42.053460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286310+0000","last_change":"2023-12-11T20:13:53.280688+0000","last_active":"2023-12-11T20:15:04.286310+0000","last_peered":"2023-12-11T20:15:04.286310+0000","last_clean":"2023-12-11T20:15:04.286310+0000","last_became_active":"2023-12-11T20:13:53.277300+0000","last_became_peered":"2023-12-11T20:13:53.277300+0000","last_unstale":"2023-12-11T20:15:04.286310+0000","last_undegraded":"2023-12-11T20:15:04.286310+0000","last_fullsized":"2023-12-11T20:15:04.286310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:40:58.831909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288583+0000","last_change":"2023-12-11T20:13:52.474978+0000","last_active":"2023-12-11T20:15:04.288583+0000","last_peered":"2023-12-11T20:15:04.288583+0000","last_clean":"2023-12-11T20:15:04.288583+0000","last_became_active":"2023-12-11T20:13:52.472863+0000","last_became_peered":"2023-12-11T20:13:52.472863+0000","last_unstale":"2023-12-11T20:15:04.288583+0000","last_undegraded":"2023-12-11T20:15:04.288583+0000","last_fullsized":"2023-12-11T20:15:04.288583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:53:44.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285363+0000","last_change":"2023-12-11T20:13:53.285991+0000","last_active":"2023-12-11T20:15:04.285363+0000","last_peered":"2023-12-11T20:15:04.285363+0000","last_clean":"2023-12-11T20:15:04.285363+0000","last_became_active":"2023-12-11T20:13:53.283925+0000","last_became_peered":"2023-12-11T20:13:53.283925+0000","last_unstale":"2023-12-11T20:15:04.285363+0000","last_undegraded":"2023-12-11T20:15:04.285363+0000","last_fullsized":"2023-12-11T20:15:04.285363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:15:48.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282190+0000","last_change":"2023-12-11T20:13:52.478883+0000","last_active":"2023-12-11T20:15:04.282190+0000","last_peered":"2023-12-11T20:15:04.282190+0000","last_clean":"2023-12-11T20:15:04.282190+0000","last_became_active":"2023-12-11T20:13:52.477070+0000","last_became_peered":"2023-12-11T20:13:52.477070+0000","last_unstale":"2023-12-11T20:15:04.282190+0000","last_undegraded":"2023-12-11T20:15:04.282190+0000","last_fullsized":"2023-12-11T20:15:04.282190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:14:32.504778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286113+0000","last_change":"2023-12-11T20:13:53.278181+0000","last_active":"2023-12-11T20:15:04.286113+0000","last_peered":"2023-12-11T20:15:04.286113+0000","last_clean":"2023-12-11T20:15:04.286113+0000","last_became_active":"2023-12-11T20:13:53.277800+0000","last_became_peered":"2023-12-11T20:13:53.277800+0000","last_unstale":"2023-12-11T20:15:04.286113+0000","last_undegraded":"2023-12-11T20:15:04.286113+0000","last_fullsized":"2023-12-11T20:15:04.286113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:35.424820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283043+0000","last_change":"2023-12-11T20:13:52.481281+0000","last_active":"2023-12-11T20:15:04.283043+0000","last_peered":"2023-12-11T20:15:04.283043+0000","last_clean":"2023-12-11T20:15:04.283043+0000","last_became_active":"2023-12-11T20:13:52.479352+0000","last_became_peered":"2023-12-11T20:13:52.479352+0000","last_unstale":"2023-12-11T20:15:04.283043+0000","last_undegraded":"2023-12-11T20:15:04.283043+0000","last_fullsized":"2023-12-11T20:15:04.283043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:41.815011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285882+0000","last_change":"2023-12-11T20:13:53.282233+0000","last_active":"2023-12-11T20:15:04.285882+0000","last_peered":"2023-12-11T20:15:04.285882+0000","last_clean":"2023-12-11T20:15:04.285882+0000","last_became_active":"2023-12-11T20:13:53.279001+0000","last_became_peered":"2023-12-11T20:13:53.279001+0000","last_unstale":"2023-12-11T20:15:04.285882+0000","last_undegraded":"2023-12-11T20:15:04.285882+0000","last_fullsized":"2023-12-11T20:15:04.285882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:30:21.671414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286370+0000","last_change":"2023-12-11T20:13:53.269361+0000","last_active":"2023-12-11T20:15:04.286370+0000","last_peered":"2023-12-11T20:15:04.286370+0000","last_clean":"2023-12-11T20:15:04.286370+0000","last_became_active":"2023-12-11T20:13:53.268613+0000","last_became_peered":"2023-12-11T20:13:53.268613+0000","last_unstale":"2023-12-11T20:15:04.286370+0000","last_undegraded":"2023-12-11T20:15:04.286370+0000","last_fullsized":"2023-12-11T20:15:04.286370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:08:04.876038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":122,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.431538+0000","last_change":"2023-12-11T20:13:52.484537+0000","last_active":"2023-12-11T20:15:35.431538+0000","last_peered":"2023-12-11T20:15:35.431538+0000","last_clean":"2023-12-11T20:15:35.431538+0000","last_became_active":"2023-12-11T20:13:52.482732+0000","last_became_peered":"2023-12-11T20:13:52.482732+0000","last_unstale":"2023-12-11T20:15:35.431538+0000","last_undegraded":"2023-12-11T20:15:35.431538+0000","last_fullsized":"2023-12-11T20:15:35.431538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:41:31.332046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320996+0000","last_change":"2023-12-11T20:13:53.270953+0000","last_active":"2023-12-11T20:15:04.320996+0000","last_peered":"2023-12-11T20:15:04.320996+0000","last_clean":"2023-12-11T20:15:04.320996+0000","last_became_active":"2023-12-11T20:13:53.269711+0000","last_became_peered":"2023-12-11T20:13:53.269711+0000","last_unstale":"2023-12-11T20:15:04.320996+0000","last_undegraded":"2023-12-11T20:15:04.320996+0000","last_fullsized":"2023-12-11T20:15:04.320996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:16:50.802953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288519+0000","last_change":"2023-12-11T20:13:52.473341+0000","last_active":"2023-12-11T20:15:04.288519+0000","last_peered":"2023-12-11T20:15:04.288519+0000","last_clean":"2023-12-11T20:15:04.288519+0000","last_became_active":"2023-12-11T20:13:52.469572+0000","last_became_peered":"2023-12-11T20:13:52.469572+0000","last_unstale":"2023-12-11T20:15:04.288519+0000","last_undegraded":"2023-12-11T20:15:04.288519+0000","last_fullsized":"2023-12-11T20:15:04.288519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:52:47.513645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.287290+0000","last_change":"2023-12-11T20:12:30.330188+0000","last_active":"2023-12-11T20:15:05.287290+0000","last_peered":"2023-12-11T20:15:05.287290+0000","last_clean":"2023-12-11T20:15:05.287290+0000","last_became_active":"2023-12-11T20:12:30.329533+0000","last_became_peered":"2023-12-11T20:12:30.329533+0000","last_unstale":"2023-12-11T20:15:05.287290+0000","last_undegraded":"2023-12-11T20:15:05.287290+0000","last_fullsized":"2023-12-11T20:15:05.287290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_clean_scrub_stamp":"2023-12-11T20:08:47.558016+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:18:10.357750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319964+0000","last_change":"2023-12-11T20:13:53.278062+0000","last_active":"2023-12-11T20:15:04.319964+0000","last_peered":"2023-12-11T20:15:04.319964+0000","last_clean":"2023-12-11T20:15:04.319964+0000","last_became_active":"2023-12-11T20:13:53.277664+0000","last_became_peered":"2023-12-11T20:13:53.277664+0000","last_unstale":"2023-12-11T20:15:04.319964+0000","last_undegraded":"2023-12-11T20:15:04.319964+0000","last_fullsized":"2023-12-11T20:15:04.319964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:07:38.751486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283369+0000","last_change":"2023-12-11T20:14:04.550614+0000","last_active":"2023-12-11T20:15:04.283369+0000","last_peered":"2023-12-11T20:15:04.283369+0000","last_clean":"2023-12-11T20:15:04.283369+0000","last_became_active":"2023-12-11T20:14:04.544469+0000","last_became_peered":"2023-12-11T20:14:04.544469+0000","last_unstale":"2023-12-11T20:15:04.283369+0000","last_undegraded":"2023-12-11T20:15:04.283369+0000","last_fullsized":"2023-12-11T20:15:04.283369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:33.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288626+0000","last_change":"2023-12-11T20:13:52.478823+0000","last_active":"2023-12-11T20:15:04.288626+0000","last_peered":"2023-12-11T20:15:04.288626+0000","last_clean":"2023-12-11T20:15:04.288626+0000","last_became_active":"2023-12-11T20:13:52.478475+0000","last_became_peered":"2023-12-11T20:13:52.478475+0000","last_unstale":"2023-12-11T20:15:04.288626+0000","last_undegraded":"2023-12-11T20:15:04.288626+0000","last_fullsized":"2023-12-11T20:15:04.288626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:44:36.438152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320508+0000","last_change":"2023-12-11T20:13:53.272496+0000","last_active":"2023-12-11T20:15:04.320508+0000","last_peered":"2023-12-11T20:15:04.320508+0000","last_clean":"2023-12-11T20:15:04.320508+0000","last_became_active":"2023-12-11T20:13:53.271669+0000","last_became_peered":"2023-12-11T20:13:53.271669+0000","last_unstale":"2023-12-11T20:15:04.320508+0000","last_undegraded":"2023-12-11T20:15:04.320508+0000","last_fullsized":"2023-12-11T20:15:04.320508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:48:31.299659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.283829+0000","last_change":"2023-12-11T20:13:52.485866+0000","last_active":"2023-12-11T20:15:05.283829+0000","last_peered":"2023-12-11T20:15:05.283829+0000","last_clean":"2023-12-11T20:15:05.283829+0000","last_became_active":"2023-12-11T20:13:52.485106+0000","last_became_peered":"2023-12-11T20:13:52.485106+0000","last_unstale":"2023-12-11T20:15:05.283829+0000","last_undegraded":"2023-12-11T20:15:05.283829+0000","last_fullsized":"2023-12-11T20:15:05.283829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:24:41.177294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321338+0000","last_change":"2023-12-11T20:13:53.271737+0000","last_active":"2023-12-11T20:15:04.321338+0000","last_peered":"2023-12-11T20:15:04.321338+0000","last_clean":"2023-12-11T20:15:04.321338+0000","last_became_active":"2023-12-11T20:13:53.271228+0000","last_became_peered":"2023-12-11T20:13:53.271228+0000","last_unstale":"2023-12-11T20:15:04.321338+0000","last_undegraded":"2023-12-11T20:15:04.321338+0000","last_fullsized":"2023-12-11T20:15:04.321338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:45.614455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288608+0000","last_change":"2023-12-11T20:13:52.475488+0000","last_active":"2023-12-11T20:15:04.288608+0000","last_peered":"2023-12-11T20:15:04.288608+0000","last_clean":"2023-12-11T20:15:04.288608+0000","last_became_active":"2023-12-11T20:13:52.475150+0000","last_became_peered":"2023-12-11T20:13:52.475150+0000","last_unstale":"2023-12-11T20:15:04.288608+0000","last_undegraded":"2023-12-11T20:15:04.288608+0000","last_fullsized":"2023-12-11T20:15:04.288608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:42:55.792758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319347+0000","last_change":"2023-12-11T20:13:53.285381+0000","last_active":"2023-12-11T20:15:04.319347+0000","last_peered":"2023-12-11T20:15:04.319347+0000","last_clean":"2023-12-11T20:15:04.319347+0000","last_became_active":"2023-12-11T20:13:53.285069+0000","last_became_peered":"2023-12-11T20:13:53.285069+0000","last_unstale":"2023-12-11T20:15:04.319347+0000","last_undegraded":"2023-12-11T20:15:04.319347+0000","last_fullsized":"2023-12-11T20:15:04.319347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:57:18.630314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319509+0000","last_change":"2023-12-11T20:13:52.483184+0000","last_active":"2023-12-11T20:15:04.319509+0000","last_peered":"2023-12-11T20:15:04.319509+0000","last_clean":"2023-12-11T20:15:04.319509+0000","last_became_active":"2023-12-11T20:13:52.482853+0000","last_became_peered":"2023-12-11T20:13:52.482853+0000","last_unstale":"2023-12-11T20:15:04.319509+0000","last_undegraded":"2023-12-11T20:15:04.319509+0000","last_fullsized":"2023-12-11T20:15:04.319509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:35.111222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288169+0000","last_change":"2023-12-11T20:13:53.271751+0000","last_active":"2023-12-11T20:15:04.288169+0000","last_peered":"2023-12-11T20:15:04.288169+0000","last_clean":"2023-12-11T20:15:04.288169+0000","last_became_active":"2023-12-11T20:13:53.271385+0000","last_became_peered":"2023-12-11T20:13:53.271385+0000","last_unstale":"2023-12-11T20:15:04.288169+0000","last_undegraded":"2023-12-11T20:15:04.288169+0000","last_fullsized":"2023-12-11T20:15:04.288169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:28:03.856212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320155+0000","last_change":"2023-12-11T20:13:52.483504+0000","last_active":"2023-12-11T20:15:04.320155+0000","last_peered":"2023-12-11T20:15:04.320155+0000","last_clean":"2023-12-11T20:15:04.320155+0000","last_became_active":"2023-12-11T20:13:52.482796+0000","last_became_peered":"2023-12-11T20:13:52.482796+0000","last_unstale":"2023-12-11T20:15:04.320155+0000","last_undegraded":"2023-12-11T20:15:04.320155+0000","last_fullsized":"2023-12-11T20:15:04.320155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:34:27.162215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285003+0000","last_change":"2023-12-11T20:13:53.276017+0000","last_active":"2023-12-11T20:15:04.285003+0000","last_peered":"2023-12-11T20:15:04.285003+0000","last_clean":"2023-12-11T20:15:04.285003+0000","last_became_active":"2023-12-11T20:13:53.275425+0000","last_became_peered":"2023-12-11T20:13:53.275425+0000","last_unstale":"2023-12-11T20:15:04.285003+0000","last_undegraded":"2023-12-11T20:15:04.285003+0000","last_fullsized":"2023-12-11T20:15:04.285003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:36.762187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319137+0000","last_change":"2023-12-11T20:13:52.477538+0000","last_active":"2023-12-11T20:15:04.319137+0000","last_peered":"2023-12-11T20:15:04.319137+0000","last_clean":"2023-12-11T20:15:04.319137+0000","last_became_active":"2023-12-11T20:13:52.476937+0000","last_became_peered":"2023-12-11T20:13:52.476937+0000","last_unstale":"2023-12-11T20:15:04.319137+0000","last_undegraded":"2023-12-11T20:15:04.319137+0000","last_fullsized":"2023-12-11T20:15:04.319137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:41:25.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320696+0000","last_change":"2023-12-11T20:13:53.276419+0000","last_active":"2023-12-11T20:15:04.320696+0000","last_peered":"2023-12-11T20:15:04.320696+0000","last_clean":"2023-12-11T20:15:04.320696+0000","last_became_active":"2023-12-11T20:13:53.276106+0000","last_became_peered":"2023-12-11T20:13:53.276106+0000","last_unstale":"2023-12-11T20:15:04.320696+0000","last_undegraded":"2023-12-11T20:15:04.320696+0000","last_fullsized":"2023-12-11T20:15:04.320696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:32.720877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288350+0000","last_change":"2023-12-11T20:14:04.554132+0000","last_active":"2023-12-11T20:15:04.288350+0000","last_peered":"2023-12-11T20:15:04.288350+0000","last_clean":"2023-12-11T20:15:04.288350+0000","last_became_active":"2023-12-11T20:14:04.546343+0000","last_became_peered":"2023-12-11T20:14:04.546343+0000","last_unstale":"2023-12-11T20:15:04.288350+0000","last_undegraded":"2023-12-11T20:15:04.288350+0000","last_fullsized":"2023-12-11T20:15:04.288350+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:16:37.790659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283263+0000","last_change":"2023-12-11T20:13:53.265917+0000","last_active":"2023-12-11T20:15:04.283263+0000","last_peered":"2023-12-11T20:15:04.283263+0000","last_clean":"2023-12-11T20:15:04.283263+0000","last_became_active":"2023-12-11T20:13:53.265569+0000","last_became_peered":"2023-12-11T20:13:53.265569+0000","last_unstale":"2023-12-11T20:15:04.283263+0000","last_undegraded":"2023-12-11T20:15:04.283263+0000","last_fullsized":"2023-12-11T20:15:04.283263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:37:19.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319256+0000","last_change":"2023-12-11T20:13:52.478688+0000","last_active":"2023-12-11T20:15:04.319256+0000","last_peered":"2023-12-11T20:15:04.319256+0000","last_clean":"2023-12-11T20:15:04.319256+0000","last_became_active":"2023-12-11T20:13:52.477834+0000","last_became_peered":"2023-12-11T20:13:52.477834+0000","last_unstale":"2023-12-11T20:15:04.319256+0000","last_undegraded":"2023-12-11T20:15:04.319256+0000","last_fullsized":"2023-12-11T20:15:04.319256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:57:04.707801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283269+0000","last_change":"2023-12-11T20:13:53.274629+0000","last_active":"2023-12-11T20:15:04.283269+0000","last_peered":"2023-12-11T20:15:04.283269+0000","last_clean":"2023-12-11T20:15:04.283269+0000","last_became_active":"2023-12-11T20:13:53.269650+0000","last_became_peered":"2023-12-11T20:13:53.269650+0000","last_unstale":"2023-12-11T20:15:04.283269+0000","last_undegraded":"2023-12-11T20:15:04.283269+0000","last_fullsized":"2023-12-11T20:15:04.283269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:57:59.865232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286560+0000","last_change":"2023-12-11T20:13:52.485902+0000","last_active":"2023-12-11T20:15:04.286560+0000","last_peered":"2023-12-11T20:15:04.286560+0000","last_clean":"2023-12-11T20:15:04.286560+0000","last_became_active":"2023-12-11T20:13:52.481982+0000","last_became_peered":"2023-12-11T20:13:52.481982+0000","last_unstale":"2023-12-11T20:15:04.286560+0000","last_undegraded":"2023-12-11T20:15:04.286560+0000","last_fullsized":"2023-12-11T20:15:04.286560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:39.411648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283046+0000","last_change":"2023-12-11T20:14:04.553595+0000","last_active":"2023-12-11T20:15:04.283046+0000","last_peered":"2023-12-11T20:15:04.283046+0000","last_clean":"2023-12-11T20:15:04.283046+0000","last_became_active":"2023-12-11T20:14:04.546235+0000","last_became_peered":"2023-12-11T20:14:04.546235+0000","last_unstale":"2023-12-11T20:15:04.283046+0000","last_undegraded":"2023-12-11T20:15:04.283046+0000","last_fullsized":"2023-12-11T20:15:04.283046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:45:21.354015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320711+0000","last_change":"2023-12-11T20:13:52.486510+0000","last_active":"2023-12-11T20:15:04.320711+0000","last_peered":"2023-12-11T20:15:04.320711+0000","last_clean":"2023-12-11T20:15:04.320711+0000","last_became_active":"2023-12-11T20:13:52.483852+0000","last_became_peered":"2023-12-11T20:13:52.483852+0000","last_unstale":"2023-12-11T20:15:04.320711+0000","last_undegraded":"2023-12-11T20:15:04.320711+0000","last_fullsized":"2023-12-11T20:15:04.320711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:40:05.242000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283465+0000","last_change":"2023-12-11T20:13:53.270545+0000","last_active":"2023-12-11T20:15:04.283465+0000","last_peered":"2023-12-11T20:15:04.283465+0000","last_clean":"2023-12-11T20:15:04.283465+0000","last_became_active":"2023-12-11T20:13:53.270213+0000","last_became_peered":"2023-12-11T20:13:53.270213+0000","last_unstale":"2023-12-11T20:15:04.283465+0000","last_undegraded":"2023-12-11T20:15:04.283465+0000","last_fullsized":"2023-12-11T20:15:04.283465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:35.442471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285045+0000","last_change":"2023-12-11T20:13:53.276886+0000","last_active":"2023-12-11T20:15:04.285045+0000","last_peered":"2023-12-11T20:15:04.285045+0000","last_clean":"2023-12-11T20:15:04.285045+0000","last_became_active":"2023-12-11T20:13:53.276149+0000","last_became_peered":"2023-12-11T20:13:53.276149+0000","last_unstale":"2023-12-11T20:15:04.285045+0000","last_undegraded":"2023-12-11T20:15:04.285045+0000","last_fullsized":"2023-12-11T20:15:04.285045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:34:19.562002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319090+0000","last_change":"2023-12-11T20:13:53.279990+0000","last_active":"2023-12-11T20:15:04.319090+0000","last_peered":"2023-12-11T20:15:04.319090+0000","last_clean":"2023-12-11T20:15:04.319090+0000","last_became_active":"2023-12-11T20:13:53.279685+0000","last_became_peered":"2023-12-11T20:13:53.279685+0000","last_unstale":"2023-12-11T20:15:04.319090+0000","last_undegraded":"2023-12-11T20:15:04.319090+0000","last_fullsized":"2023-12-11T20:15:04.319090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:21:36.526683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319010+0000","last_change":"2023-12-11T20:13:53.279128+0000","last_active":"2023-12-11T20:15:04.319010+0000","last_peered":"2023-12-11T20:15:04.319010+0000","last_clean":"2023-12-11T20:15:04.319010+0000","last_became_active":"2023-12-11T20:13:53.278821+0000","last_became_peered":"2023-12-11T20:13:53.278821+0000","last_unstale":"2023-12-11T20:15:04.319010+0000","last_undegraded":"2023-12-11T20:15:04.319010+0000","last_fullsized":"2023-12-11T20:15:04.319010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:49:36.013115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318953+0000","last_change":"2023-12-11T20:13:53.281004+0000","last_active":"2023-12-11T20:15:04.318953+0000","last_peered":"2023-12-11T20:15:04.318953+0000","last_clean":"2023-12-11T20:15:04.318953+0000","last_became_active":"2023-12-11T20:13:53.280691+0000","last_became_peered":"2023-12-11T20:13:53.280691+0000","last_unstale":"2023-12-11T20:15:04.318953+0000","last_undegraded":"2023-12-11T20:15:04.318953+0000","last_fullsized":"2023-12-11T20:15:04.318953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:00.336975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320598+0000","last_change":"2023-12-11T20:13:53.272690+0000","last_active":"2023-12-11T20:15:04.320598+0000","last_peered":"2023-12-11T20:15:04.320598+0000","last_clean":"2023-12-11T20:15:04.320598+0000","last_became_active":"2023-12-11T20:13:53.272194+0000","last_became_peered":"2023-12-11T20:13:53.272194+0000","last_unstale":"2023-12-11T20:15:04.320598+0000","last_undegraded":"2023-12-11T20:15:04.320598+0000","last_fullsized":"2023-12-11T20:15:04.320598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:58:45.312035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285477+0000","last_change":"2023-12-11T20:13:53.277625+0000","last_active":"2023-12-11T20:15:04.285477+0000","last_peered":"2023-12-11T20:15:04.285477+0000","last_clean":"2023-12-11T20:15:04.285477+0000","last_became_active":"2023-12-11T20:13:53.277174+0000","last_became_peered":"2023-12-11T20:13:53.277174+0000","last_unstale":"2023-12-11T20:15:04.285477+0000","last_undegraded":"2023-12-11T20:15:04.285477+0000","last_fullsized":"2023-12-11T20:15:04.285477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:01:41.057178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319413+0000","last_change":"2023-12-11T20:13:53.278685+0000","last_active":"2023-12-11T20:15:04.319413+0000","last_peered":"2023-12-11T20:15:04.319413+0000","last_clean":"2023-12-11T20:15:04.319413+0000","last_became_active":"2023-12-11T20:13:53.276894+0000","last_became_peered":"2023-12-11T20:13:53.276894+0000","last_unstale":"2023-12-11T20:15:04.319413+0000","last_undegraded":"2023-12-11T20:15:04.319413+0000","last_fullsized":"2023-12-11T20:15:04.319413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:21:00.004496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321269+0000","last_change":"2023-12-11T20:13:53.285596+0000","last_active":"2023-12-11T20:15:04.321269+0000","last_peered":"2023-12-11T20:15:04.321269+0000","last_clean":"2023-12-11T20:15:04.321269+0000","last_became_active":"2023-12-11T20:13:53.285289+0000","last_became_peered":"2023-12-11T20:13:53.285289+0000","last_unstale":"2023-12-11T20:15:04.321269+0000","last_undegraded":"2023-12-11T20:15:04.321269+0000","last_fullsized":"2023-12-11T20:15:04.321269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:53:59.939751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286024+0000","last_change":"2023-12-11T20:13:53.272600+0000","last_active":"2023-12-11T20:15:04.286024+0000","last_peered":"2023-12-11T20:15:04.286024+0000","last_clean":"2023-12-11T20:15:04.286024+0000","last_became_active":"2023-12-11T20:13:53.272308+0000","last_became_peered":"2023-12-11T20:13:53.272308+0000","last_unstale":"2023-12-11T20:15:04.286024+0000","last_undegraded":"2023-12-11T20:15:04.286024+0000","last_fullsized":"2023-12-11T20:15:04.286024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.458731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320063+0000","last_change":"2023-12-11T20:13:53.280833+0000","last_active":"2023-12-11T20:15:04.320063+0000","last_peered":"2023-12-11T20:15:04.320063+0000","last_clean":"2023-12-11T20:15:04.320063+0000","last_became_active":"2023-12-11T20:13:53.280384+0000","last_became_peered":"2023-12-11T20:13:53.280384+0000","last_unstale":"2023-12-11T20:15:04.320063+0000","last_undegraded":"2023-12-11T20:15:04.320063+0000","last_fullsized":"2023-12-11T20:15:04.320063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:37:38.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319663+0000","last_change":"2023-12-11T20:13:53.271825+0000","last_active":"2023-12-11T20:15:04.319663+0000","last_peered":"2023-12-11T20:15:04.319663+0000","last_clean":"2023-12-11T20:15:04.319663+0000","last_became_active":"2023-12-11T20:13:53.271460+0000","last_became_peered":"2023-12-11T20:13:53.271460+0000","last_unstale":"2023-12-11T20:15:04.319663+0000","last_undegraded":"2023-12-11T20:15:04.319663+0000","last_fullsized":"2023-12-11T20:15:04.319663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:46:46.147904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320441+0000","last_change":"2023-12-11T20:13:53.270103+0000","last_active":"2023-12-11T20:15:04.320441+0000","last_peered":"2023-12-11T20:15:04.320441+0000","last_clean":"2023-12-11T20:15:04.320441+0000","last_became_active":"2023-12-11T20:13:53.269781+0000","last_became_peered":"2023-12-11T20:13:53.269781+0000","last_unstale":"2023-12-11T20:15:04.320441+0000","last_undegraded":"2023-12-11T20:15:04.320441+0000","last_fullsized":"2023-12-11T20:15:04.320441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.865347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.293259+0000","last_change":"2023-12-11T20:15:05.293259+0000","last_active":"2023-12-11T20:15:05.293259+0000","last_peered":"2023-12-11T20:15:05.293259+0000","last_clean":"2023-12-11T20:15:05.293259+0000","last_became_active":"2023-12-11T20:15:05.292789+0000","last_became_peered":"2023-12-11T20:15:05.292789+0000","last_unstale":"2023-12-11T20:15:05.293259+0000","last_undegraded":"2023-12-11T20:15:05.293259+0000","last_fullsized":"2023-12-11T20:15:05.293259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:48.751350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":217636,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70742,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":625,"num_read_kb":381,"num_write":166,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":207906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383716,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":473169,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91700000000000004,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.81599999999999995,"15min":0.77200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.202,"5min":10.202,"15min":10.202},"last":0.60099999999999998}]},{"osd":1,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.071,"5min":1.212,"15min":1.212},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.56899999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.018,"5min":1.369,"15min":1.369},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95199999999999996,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.026,"5min":1.097,"15min":1.097},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.083,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.91300000000000003,"15min":0.91400000000000003},"min":{"1min":0.71399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.216,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.76400000000000001}]},{"osd":5,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":1.0980000000000001,"15min":1.1539999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.98299999999999998,"15min":1.0129999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.97799999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.89700000000000002,"15min":0.91800000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.105,"5min":1.782,"15min":1.782},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.96799999999999997,"15min":1},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98299999999999998,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.04,"15min":1.0529999999999999},"min":{"1min":0.749,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.202,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.749},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.77400000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.3240000000000001,"5min":1.857,"15min":1.857},"last":0.80300000000000005}]},{"osd":8,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.92300000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0209999999999999,"15min":1.0449999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.155,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.282,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.876}]},{"osd":10,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.0840000000000001},"min":{"1min":0.90700000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.349,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.204,"15min":1.242},"min":{"1min":0.84099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.89400000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":1130760,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42299999999999999}]},{"osd":1,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.268,"15min":1.268},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.40799999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72799999999999998,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.503}]},{"osd":2,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95199999999999996,"5min":1.107,"15min":1.107},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78900000000000003,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.004,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89800000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.80900000000000005},"min":{"1min":0.48999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93500000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82699999999999996,"15min":0.86099999999999999},"min":{"1min":0.52500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79600000000000004,"15min":0.83499999999999996},"min":{"1min":0.49299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":1.323,"15min":1.323},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.78400000000000003,"15min":0.83999999999999997},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0089999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.93700000000000006},"min":{"1min":0.60699999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0509999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88900000000000001,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.1519999999999999,"5min":1.641,"15min":1.641},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.91300000000000003,"15min":0.95099999999999996},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.121,"5min":1.484,"15min":1.484},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.95499999999999996,"15min":1.01},"min":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0940000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.93999999999999995}]},{"osd":7,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93799999999999994}]},{"osd":8,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.0009999999999999,"15min":1.0549999999999999},"min":{"1min":0.70199999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.1359999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.056},{"interface":"front","average":{"1min":0.88,"5min":1.006,"15min":1.0660000000000001},"min":{"1min":0.628,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.119,"5min":1.667,"15min":1.667},"last":0.92500000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.022,"15min":1.0760000000000001},"min":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1799999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.024,"15min":1.1000000000000001},"min":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1950000000000001,"5min":1.615,"15min":1.615},"last":0.72199999999999998}]},{"osd":11,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1,"15min":1},"min":{"1min":0.78500000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.214,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.999,"15min":1.01},"min":{"1min":0.68999999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.198,"5min":1.768,"15min":1.768},"last":0.97199999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":473405,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.69899999999999995,"15min":0.72499999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.77000000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.70199999999999996},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.81499999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85899999999999999,"15min":0.89200000000000002},"min":{"1min":0.55000000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89800000000000002,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82499999999999996,"15min":0.86699999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4079999999999999,"5min":1.504,"15min":1.504},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65200000000000002,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.77900000000000003,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.81299999999999994,"15min":0.85699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0580000000000001,"5min":1.302,"15min":1.302},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.83299999999999996,"15min":0.88300000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.508,"15min":1.508},"last":1.123},{"interface":"front","average":{"1min":1.1020000000000001,"5min":0.88800000000000001,"15min":0.878},"min":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":5.915,"5min":5.915,"15min":5.915},"last":1.018}]},{"osd":6,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.95999999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.575,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.85999999999999999,"15min":0.90800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.86499999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0269999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.022,"15min":1.075},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.617,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.94899999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.0920000000000001,"15min":1.107},"min":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":5.9539999999999997,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":1.093},{"interface":"front","average":{"1min":0.872,"5min":0.93999999999999995,"15min":0.98399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.073}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.97699999999999998,"15min":0.97099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":6.423,"5min":6.423,"15min":6.423},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.96599999999999997,"15min":0.97199999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":5.9379999999999997,"5min":5.9379999999999997,"15min":5.9379999999999997},"last":0.97699999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":473117,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":1.079,"15min":1.079},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.054,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.80400000000000005},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92400000000000004,"5min":1.081,"15min":1.081},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.81100000000000005,"5min":1.226,"15min":1.226},"last":0.94699999999999995}]},{"osd":4,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0529999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.0760000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.018,"5min":1.232,"15min":1.232},"last":0.78800000000000003}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.028,"5min":1.284,"15min":1.284},"last":1.004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.55200000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97199999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0049999999999999,"5min":1.298,"15min":1.298},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94699999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1619999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.026}]},{"osd":9,"last update":"Mon Dec 11 20:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.68700000000000006,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1779999999999999,"5min":1.304,"15min":1.304},"last":1.109},{"interface":"front","average":{"1min":1.28,"5min":1.008,"15min":0.96599999999999997},"min":{"1min":0.84399999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":6.4790000000000001,"5min":6.4790000000000001,"15min":6.4790000000000001},"last":1.0700000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.80100000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.139,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.083},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.91600000000000004,"15min":0.90000000000000002},"min":{"1min":0.68200000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1830000000000001,"5min":1.331,"15min":1.331},"last":1.048}]},{"osd":11,"last update":"Mon Dec 11 20:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.131}]}]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":1066926,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81000000000000005,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":1.327,"15min":1.327},"last":0.64500000000000002}]},{"osd":2,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.55200000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.518,"15min":1.518},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.052,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90800000000000003}]},{"osd":3,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93100000000000005,"5min":1.383,"15min":1.383},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90800000000000003,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.115,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85199999999999998,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.054,"5min":1.294,"15min":1.294},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.873,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0580000000000001,"5min":1.474,"15min":1.474},"last":0.88500000000000001}]},{"osd":6,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98799999999999999,"5min":1.327,"15min":1.327},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96999999999999997,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55500000000000005}]},{"osd":8,"last update":"Mon Dec 11 20:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96899999999999997},"min":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.133,"5min":1.544,"15min":1.544},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.0669999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.90000000000000002}]},{"osd":9,"last update":"Mon Dec 11 20:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.99099999999999999},"min":{"1min":0.69299999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.0409999999999999,"5min":1.573,"15min":1.573},"last":0.872},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.98999999999999999,"15min":1.024},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.137,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.008}]},{"osd":10,"last update":"Mon Dec 11 20:14:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0980000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.01,"15min":1.026},"min":{"1min":0.66800000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1200000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.81200000000000006}]},{"osd":11,"last update":"Mon Dec 11 20:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.099},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.0549999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":472800,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91100000000000003,"5min":1.036,"15min":1.036},"last":0.873},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.81799999999999995,"15min":0.76300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.069,"5min":8.1080000000000005,"15min":8.1080000000000005},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.86599999999999999,"15min":0.98999999999999999},"min":{"1min":0.55800000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0209999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94599999999999995,"15min":1.083},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.137,"5min":6.9489999999999998,"15min":6.9489999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97099999999999997,"5min":1.167,"15min":1.167},"last":0.93400000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.63800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1120000000000001,"5min":1.226,"15min":1.226},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Dec 11 20:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.92600000000000005,"15min":0.84699999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0529999999999999,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.61199999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.228,"15min":1.228},"last":0.82099999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.153,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.90100000000000002,"15min":0.86599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":8.1289999999999996,"5min":8.1289999999999996,"15min":8.1289999999999996},"last":0.71299999999999997}]},{"osd":9,"last update":"Mon Dec 11 20:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.84699999999999998,"15min":0.89900000000000002},"min":{"1min":0.51400000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.88900000000000001,"5min":1.204,"15min":1.204},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.94999999999999996,"15min":0.999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.097,"5min":1.319,"15min":1.319},"last":0.97099999999999997}]},{"osd":10,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.70699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.94499999999999995,"15min":0.97999999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0860000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":533000,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.99299999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.505},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68100000000000005,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.83399999999999996,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.69699999999999995,"15min":0.60299999999999998},"min":{"1min":0.495,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.69199999999999995,"15min":0.60099999999999998},"min":{"1min":0.61799999999999999,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.92700000000000005}]},{"osd":3,"last update":"Mon Dec 11 20:15:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79800000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.64300000000000002},"min":{"1min":0.55900000000000005,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.046,"5min":1.075,"15min":1.075},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.55700000000000005},"min":{"1min":0.47299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.628,"15min":0.57799999999999996},"min":{"1min":0.54800000000000004,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.80500000000000005,"15min":0.72299999999999998},"min":{"1min":0.73599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.018,"5min":0.81000000000000005,"15min":0.71799999999999997},"min":{"1min":0.56299999999999994,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.0049999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.80800000000000005,"15min":0.76800000000000002},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.53700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92400000000000004,"5min":1.081,"15min":1.081},"last":0.88300000000000001}]},{"osd":7,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":0.876,"15min":0.83699999999999997},"min":{"1min":0.76700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.60699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95699999999999996}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80200000000000005,"15min":0.77300000000000002},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1459999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.90400000000000003,"15min":0.86399999999999999},"min":{"1min":0.71099999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.24,"15min":1.24},"last":0.97699999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.97899999999999998,"15min":0.95699999999999996},"min":{"1min":0.94299999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.2929999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.133},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0600000000000001,"5min":1.294,"15min":1.294},"last":0.995}]},{"osd":10,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.86499999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2609999999999999,"5min":1.381,"15min":1.381},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.056,"15min":1.03},"min":{"1min":0.99399999999999999,"5min":0.746,"15min":0.746},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.1719999999999999}]},{"osd":11,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.2030000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":474065,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 20:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65000000000000002,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.32800000000000001},"max":{"1min":1.512,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.625},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65600000000000003,"15min":0.58599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63900000000000001,"15min":0.61499999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.70999999999999996,"15min":0.64400000000000002},"min":{"1min":0.61799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.50600000000000001}]},{"osd":4,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.72799999999999998,"15min":0.66300000000000003},"min":{"1min":0.59199999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.64300000000000002},"min":{"1min":0.52900000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.73,"5min":1.909,"15min":1.909},"last":0.77700000000000002}]},{"osd":5,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.76700000000000002,"15min":0.72299999999999998},"min":{"1min":0.66200000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.751},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:14:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.93999999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.84999999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82799999999999996,"15min":0.84599999999999997},"min":{"1min":0.51700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.55400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.69599999999999995}]},{"osd":10,"last update":"Mon Dec 11 20:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.026,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.90900000000000003},"min":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98999999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.88700000000000001}]},{"osd":11,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90500000000000003,"15min":0.90100000000000002},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.88,"15min":0.874},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.90500000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":535378,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.53400000000000003},"min":{"1min":0.45100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.98799999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61099999999999999,"15min":0.54900000000000004},"min":{"1min":0.45900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.70099999999999996,"15min":0.63},"min":{"1min":0.55100000000000005,"5min":0.371,"15min":0.371},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.67500000000000004,"15min":0.63400000000000001},"min":{"1min":0.53100000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1180000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67500000000000004,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96599999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.63},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.68700000000000006,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.68300000000000005,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.95599999999999996}]},{"osd":6,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.67300000000000004},"min":{"1min":0.52200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.92200000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.80400000000000005,"15min":0.74399999999999999},"min":{"1min":0.61799999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1579999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.746}]},{"osd":7,"last update":"Mon Dec 11 20:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.101,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59799999999999998}]},{"osd":8,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80200000000000005,"15min":0.78400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98399999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.877,"15min":0.86499999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.85999999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":0.91500000000000004},"min":{"1min":0.67500000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.173,"5min":1.379,"15min":1.379},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2250000000000001,"5min":1.268,"15min":1.268},"last":0.88200000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.97599999999999998,"15min":0.96699999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3069999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.91500000000000004}]},{"osd":11,"last update":"Mon Dec 11 20:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.0069999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":472786,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47799999999999998,"15min":0.42099999999999999},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.67100000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.52500000000000002,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":1.1519999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68600000000000005,"15min":0.629},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.753},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.749,"15min":0.66000000000000003},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72599999999999998,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.69399999999999995,"15min":0.65100000000000002},"min":{"1min":0.57199999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.61099999999999999}]},{"osd":4,"last update":"Mon Dec 11 20:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.752,"15min":0.66600000000000004},"min":{"1min":0.56499999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.76600000000000001,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.3969999999999998,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.71999999999999997,"15min":0.69699999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.81100000000000005,"15min":0.75600000000000001},"min":{"1min":0.53700000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.45500000000000002}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.625}]},{"osd":7,"last update":"Mon Dec 11 20:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.79400000000000004},"min":{"1min":0.621,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.91000000000000003,"15min":0.86599999999999999},"min":{"1min":0.78600000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.66700000000000004}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.85799999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.95799999999999996,"15min":0.97099999999999997},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.502},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.91300000000000003,"15min":0.91600000000000004},"min":{"1min":0.59799999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.65800000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94299999999999995,"15min":0.96599999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1899999999999999,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.022,"15min":1.0249999999999999},"min":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.79300000000000004}]},{"osd":11,"last update":"Mon Dec 11 20:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.69799999999999995}]}]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":474259,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57999999999999996,"15min":0.53900000000000003},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.496}]},{"osd":1,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.377,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70899999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.42299999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.49299999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.75800000000000001,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66100000000000003,"15min":0.625},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94199999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.63500000000000001,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.7080000000000002,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79400000000000004,"15min":0.72199999999999998},"min":{"1min":0.67600000000000005,"5min":0.441,"15min":0.441},"max":{"1min":1.075,"5min":1.177,"15min":1.177},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.65200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.026,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Mon Dec 11 20:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.81100000000000005,"15min":0.77500000000000002},"min":{"1min":0.65900000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.204,"5min":1.407,"15min":1.407},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.73399999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0469999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.96099999999999997}]},{"osd":8,"last update":"Mon Dec 11 20:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.66200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.876,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91500000000000004,"15min":0.89300000000000002},"min":{"1min":0.77800000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1559999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0349999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.90000000000000002,"15min":0.878},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.26,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.997},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.89000000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.282,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.97899999999999998}]},{"osd":10,"last update":"Mon Dec 11 20:15:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.96799999999999997,"15min":0.94999999999999996},"min":{"1min":0.755,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.234,"5min":1.333,"15min":1.333},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.78200000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.92600000000000005}]},{"osd":11,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.054},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0700000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":1065128,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61699999999999999,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95499999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.56000000000000005}]},{"osd":1,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.69499999999999995,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0529999999999999,"5min":1.101,"15min":1.101},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94399999999999995,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81399999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.57399999999999995,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94799999999999995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.69499999999999995,"15min":0.628},"min":{"1min":0.502,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.054,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.499},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1240000000000001,"5min":1.127,"15min":1.127},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.76800000000000002,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1519999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.78100000000000003,"15min":0.70899999999999996},"min":{"1min":0.55800000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2210000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Mon Dec 11 20:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.76900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0369999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78000000000000003,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.83099999999999996,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1399999999999999,"5min":1.216,"15min":1.216},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.84999999999999998,"15min":0.79600000000000004},"min":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.141,"5min":2.992,"15min":2.992},"last":0.92500000000000004}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77300000000000002,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0309999999999999,"5min":1.589,"15min":1.589},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.85499999999999998,"15min":0.82699999999999996},"min":{"1min":0.72299999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.27,"5min":1.403,"15min":1.403},"last":0.68500000000000005}]},{"osd":9,"last update":"Mon Dec 11 20:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.93999999999999995,"15min":0.93700000000000006},"min":{"1min":0.752,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.272,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.63200000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.66200000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:15:32 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.99199999999999999,"15min":0.98699999999999999},"min":{"1min":0.77700000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.254,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.94099999999999995,"15min":0.92800000000000005},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.874}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34906,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T20:15:40.736 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-12-11T20:15:40.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.975+0000 7f95265ff700 1 -- 172.21.15.12:0/1165109200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95200ffd80 msgr2=0x7f95201021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.975+0000 7f95265ff700 1 --2- 172.21.15.12:0/1165109200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95200ffd80 0x7f95201021b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9510009990 tx=0x7f9510009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.975+0000 7f95265ff700 1 -- 172.21.15.12:0/1165109200 shutdown_connections 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.975+0000 7f95265ff700 1 --2- 172.21.15.12:0/1165109200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95201050c0 0x7f9520105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.975+0000 7f95265ff700 1 --2- 172.21.15.12:0/1165109200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95200ffd80 0x7f95201021b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.975+0000 7f95265ff700 1 --2- 172.21.15.12:0/1165109200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95201026f0 0x7f9520104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.975+0000 7f95265ff700 1 -- 172.21.15.12:0/1165109200 >> 172.21.15.12:0/1165109200 conn(0x7f95200fb980 msgr2=0x7f95200fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.975+0000 7f95265ff700 1 -- 172.21.15.12:0/1165109200 shutdown_connections 2023-12-11T20:15:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.976+0000 7f95265ff700 1 -- 172.21.15.12:0/1165109200 wait complete. 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.977+0000 7f95265ff700 1 Processor -- start 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.977+0000 7f95265ff700 1 -- start start 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f95265ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95200ffd80 0x7f952019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f95265ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95201026f0 0x7f952019de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f95265ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95201050c0 0x7f95201a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f95265ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95201a5480 con 0x7f95201050c0 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f95265ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95201a55c0 con 0x7f95201026f0 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f95265ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95201a5750 con 0x7f95200ffd80 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9524b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95201050c0 0x7f95201a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9524b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95201050c0 0x7f95201a4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33078/0 (socket says 172.21.15.12:33078) 2023-12-11T20:15:40.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9524b9c700 1 -- 172.21.15.12:0/1985918748 learned_addr learned my addr 172.21.15.12:0/1985918748 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:40.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f951ffff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95201026f0 0x7f952019de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:40.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9517fff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95200ffd80 0x7f952019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9524b9c700 1 -- 172.21.15.12:0/1985918748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95200ffd80 msgr2=0x7f952019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9524b9c700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95200ffd80 0x7f952019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9524b9c700 1 -- 172.21.15.12:0/1985918748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95201026f0 msgr2=0x7f952019de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9524b9c700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95201026f0 0x7f952019de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f9524b9c700 1 -- 172.21.15.12:0/1985918748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95100095f0 con 0x7f95201050c0 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.978+0000 7f951ffff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95201026f0 0x7f952019de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.979+0000 7f9524b9c700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95201050c0 0x7f95201a4eb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f951800ef30 tx=0x7f951800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.979+0000 7f951dffb700 1 -- 172.21.15.12:0/1985918748 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518018070 con 0x7f95201050c0 2023-12-11T20:15:40.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.979+0000 7f951dffb700 1 -- 172.21.15.12:0/1985918748 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f951800f040 con 0x7f95201050c0 2023-12-11T20:15:40.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.979+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95201a59d0 con 0x7f95201050c0 2023-12-11T20:15:40.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.979+0000 7f951dffb700 1 -- 172.21.15.12:0/1985918748 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800cbc0 con 0x7f95201050c0 2023-12-11T20:15:40.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.979+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95201a5ee0 con 0x7f95201050c0 2023-12-11T20:15:40.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.980+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95200fd500 con 0x7f95201050c0 2023-12-11T20:15:40.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.982+0000 7f951dffb700 1 -- 172.21.15.12:0/1985918748 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f951800cd80 con 0x7f95201050c0 2023-12-11T20:15:40.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.984+0000 7f951dffb700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1500 0x7f950c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:40.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.984+0000 7f951dffb700 1 -- 172.21.15.12:0/1985918748 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f95180ccd90 con 0x7f95201050c0 2023-12-11T20:15:40.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.984+0000 7f9517fff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1500 0x7f950c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:40.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.985+0000 7f9517fff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1500 0x7f950c0a39c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9510006010 tx=0x7f951000b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:40.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:40.986+0000 7f951dffb700 1 -- 172.21.15.12:0/1985918748 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f95180963d0 con 0x7f95201050c0 2023-12-11T20:15:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.196+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 --> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f952002d380 con 0x7f950c0a1500 2023-12-11T20:15:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.206+0000 7f951dffb700 1 -- 172.21.15.12:0/1985918748 <== mgr.14148 v2:172.21.15.12:6800/1969938581 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342500 (secure 0 0 0) 0x7f952002d380 con 0x7f950c0a1500 2023-12-11T20:15:41.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1500 msgr2=0x7f950c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1500 0x7f950c0a39c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9510006010 tx=0x7f951000b610 comp rx=0 tx=0).stop 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95201050c0 msgr2=0x7f95201a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95201050c0 0x7f95201a4eb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f951800ef30 tx=0x7f951800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 shutdown_connections 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f950c0a1500 0x7f950c0a39c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95201050c0 0x7f95201a4eb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95200ffd80 0x7f952019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 --2- 172.21.15.12:0/1985918748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95201026f0 0x7f952019de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 >> 172.21.15.12:0/1985918748 conn(0x7f95200fb980 msgr2=0x7f95201045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 shutdown_connections 2023-12-11T20:15:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.211+0000 7f95265ff700 1 -- 172.21.15.12:0/1985918748 wait complete. 2023-12-11T20:15:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-12-11T20:15:41.228 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2023-12-11T20:15:41.058074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661356,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":751,"num_read_kb":490,"num_write":351,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2951963,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336068,"kb_used_data":11844,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605756,"statfs":{"total":1151940427776,"available":1151596294144,"internally_reserved":0,"allocated":12128256,"data_stored":7649113,"data_compressed":250086,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19142,"internal_metadata":331855162},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5814,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002694"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285527+0000","last_change":"2023-12-11T20:13:53.282384+0000","last_active":"2023-12-11T20:15:04.285527+0000","last_peered":"2023-12-11T20:15:04.285527+0000","last_clean":"2023-12-11T20:15:04.285527+0000","last_became_active":"2023-12-11T20:13:53.282058+0000","last_became_peered":"2023-12-11T20:13:53.282058+0000","last_unstale":"2023-12-11T20:15:04.285527+0000","last_undegraded":"2023-12-11T20:15:04.285527+0000","last_fullsized":"2023-12-11T20:15:04.285527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:23:31.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319238+0000","last_change":"2023-12-11T20:13:53.282283+0000","last_active":"2023-12-11T20:15:04.319238+0000","last_peered":"2023-12-11T20:15:04.319238+0000","last_clean":"2023-12-11T20:15:04.319238+0000","last_became_active":"2023-12-11T20:13:53.278054+0000","last_became_peered":"2023-12-11T20:13:53.278054+0000","last_unstale":"2023-12-11T20:15:04.319238+0000","last_undegraded":"2023-12-11T20:15:04.319238+0000","last_fullsized":"2023-12-11T20:15:04.319238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:07:50.194732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319039+0000","last_change":"2023-12-11T20:13:53.277704+0000","last_active":"2023-12-11T20:15:04.319039+0000","last_peered":"2023-12-11T20:15:04.319039+0000","last_clean":"2023-12-11T20:15:04.319039+0000","last_became_active":"2023-12-11T20:13:53.277395+0000","last_became_peered":"2023-12-11T20:13:53.277395+0000","last_unstale":"2023-12-11T20:15:04.319039+0000","last_undegraded":"2023-12-11T20:15:04.319039+0000","last_fullsized":"2023-12-11T20:15:04.319039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:54:10.752891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288775+0000","last_change":"2023-12-11T20:13:53.280854+0000","last_active":"2023-12-11T20:15:04.288775+0000","last_peered":"2023-12-11T20:15:04.288775+0000","last_clean":"2023-12-11T20:15:04.288775+0000","last_became_active":"2023-12-11T20:13:53.277275+0000","last_became_peered":"2023-12-11T20:13:53.277275+0000","last_unstale":"2023-12-11T20:15:04.288775+0000","last_undegraded":"2023-12-11T20:15:04.288775+0000","last_fullsized":"2023-12-11T20:15:04.288775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:32:58.001015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288323+0000","last_change":"2023-12-11T20:13:53.283601+0000","last_active":"2023-12-11T20:15:04.288323+0000","last_peered":"2023-12-11T20:15:04.288323+0000","last_clean":"2023-12-11T20:15:04.288323+0000","last_became_active":"2023-12-11T20:13:53.281659+0000","last_became_peered":"2023-12-11T20:13:53.281659+0000","last_unstale":"2023-12-11T20:15:04.288323+0000","last_undegraded":"2023-12-11T20:15:04.288323+0000","last_fullsized":"2023-12-11T20:15:04.288323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:47:20.764823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285717+0000","last_change":"2023-12-11T20:13:53.284175+0000","last_active":"2023-12-11T20:15:04.285717+0000","last_peered":"2023-12-11T20:15:04.285717+0000","last_clean":"2023-12-11T20:15:04.285717+0000","last_became_active":"2023-12-11T20:13:53.283801+0000","last_became_peered":"2023-12-11T20:13:53.283801+0000","last_unstale":"2023-12-11T20:15:04.285717+0000","last_undegraded":"2023-12-11T20:15:04.285717+0000","last_fullsized":"2023-12-11T20:15:04.285717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:35.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282949+0000","last_change":"2023-12-11T20:13:53.262700+0000","last_active":"2023-12-11T20:15:04.282949+0000","last_peered":"2023-12-11T20:15:04.282949+0000","last_clean":"2023-12-11T20:15:04.282949+0000","last_became_active":"2023-12-11T20:13:53.262322+0000","last_became_peered":"2023-12-11T20:13:53.262322+0000","last_unstale":"2023-12-11T20:15:04.282949+0000","last_undegraded":"2023-12-11T20:15:04.282949+0000","last_fullsized":"2023-12-11T20:15:04.282949+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:02:47.241557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.281863+0000","last_change":"2023-12-11T20:14:04.763447+0000","last_active":"2023-12-11T20:15:04.281863+0000","last_peered":"2023-12-11T20:15:04.281863+0000","last_clean":"2023-12-11T20:15:04.281863+0000","last_became_active":"2023-12-11T20:14:04.763036+0000","last_became_peered":"2023-12-11T20:14:04.763036+0000","last_unstale":"2023-12-11T20:15:04.281863+0000","last_undegraded":"2023-12-11T20:15:04.281863+0000","last_fullsized":"2023-12-11T20:15:04.281863+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:48.188993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319992+0000","last_change":"2023-12-11T20:13:53.277384+0000","last_active":"2023-12-11T20:15:04.319992+0000","last_peered":"2023-12-11T20:15:04.319992+0000","last_clean":"2023-12-11T20:15:04.319992+0000","last_became_active":"2023-12-11T20:13:53.277017+0000","last_became_peered":"2023-12-11T20:13:53.277017+0000","last_unstale":"2023-12-11T20:15:04.319992+0000","last_undegraded":"2023-12-11T20:15:04.319992+0000","last_fullsized":"2023-12-11T20:15:04.319992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:04:50.820269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285932+0000","last_change":"2023-12-11T20:13:53.285340+0000","last_active":"2023-12-11T20:15:04.285932+0000","last_peered":"2023-12-11T20:15:04.285932+0000","last_clean":"2023-12-11T20:15:04.285932+0000","last_became_active":"2023-12-11T20:13:53.285040+0000","last_became_peered":"2023-12-11T20:13:53.285040+0000","last_unstale":"2023-12-11T20:15:04.285932+0000","last_undegraded":"2023-12-11T20:15:04.285932+0000","last_fullsized":"2023-12-11T20:15:04.285932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:52:53.312236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283309+0000","last_change":"2023-12-11T20:13:53.274637+0000","last_active":"2023-12-11T20:15:04.283309+0000","last_peered":"2023-12-11T20:15:04.283309+0000","last_clean":"2023-12-11T20:15:04.283309+0000","last_became_active":"2023-12-11T20:13:53.270971+0000","last_became_peered":"2023-12-11T20:13:53.270971+0000","last_unstale":"2023-12-11T20:15:04.283309+0000","last_undegraded":"2023-12-11T20:15:04.283309+0000","last_fullsized":"2023-12-11T20:15:04.283309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:20:35.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288736+0000","last_change":"2023-12-11T20:13:53.280712+0000","last_active":"2023-12-11T20:15:04.288736+0000","last_peered":"2023-12-11T20:15:04.288736+0000","last_clean":"2023-12-11T20:15:04.288736+0000","last_became_active":"2023-12-11T20:13:53.276873+0000","last_became_peered":"2023-12-11T20:13:53.276873+0000","last_unstale":"2023-12-11T20:15:04.288736+0000","last_undegraded":"2023-12-11T20:15:04.288736+0000","last_fullsized":"2023-12-11T20:15:04.288736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:36:08.438862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321129+0000","last_change":"2023-12-11T20:13:53.272378+0000","last_active":"2023-12-11T20:15:04.321129+0000","last_peered":"2023-12-11T20:15:04.321129+0000","last_clean":"2023-12-11T20:15:04.321129+0000","last_became_active":"2023-12-11T20:13:53.271992+0000","last_became_peered":"2023-12-11T20:13:53.271992+0000","last_unstale":"2023-12-11T20:15:04.321129+0000","last_undegraded":"2023-12-11T20:15:04.321129+0000","last_fullsized":"2023-12-11T20:15:04.321129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:01:05.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318845+0000","last_change":"2023-12-11T20:13:53.275078+0000","last_active":"2023-12-11T20:15:04.318845+0000","last_peered":"2023-12-11T20:15:04.318845+0000","last_clean":"2023-12-11T20:15:04.318845+0000","last_became_active":"2023-12-11T20:13:53.273555+0000","last_became_peered":"2023-12-11T20:13:53.273555+0000","last_unstale":"2023-12-11T20:15:04.318845+0000","last_undegraded":"2023-12-11T20:15:04.318845+0000","last_fullsized":"2023-12-11T20:15:04.318845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:23:27.487647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318921+0000","last_change":"2023-12-11T20:13:53.277135+0000","last_active":"2023-12-11T20:15:04.318921+0000","last_peered":"2023-12-11T20:15:04.318921+0000","last_clean":"2023-12-11T20:15:04.318921+0000","last_became_active":"2023-12-11T20:13:53.276406+0000","last_became_peered":"2023-12-11T20:13:53.276406+0000","last_unstale":"2023-12-11T20:15:04.318921+0000","last_undegraded":"2023-12-11T20:15:04.318921+0000","last_fullsized":"2023-12-11T20:15:04.318921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:19:20.508685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319466+0000","last_change":"2023-12-11T20:13:53.268845+0000","last_active":"2023-12-11T20:15:04.319466+0000","last_peered":"2023-12-11T20:15:04.319466+0000","last_clean":"2023-12-11T20:15:04.319466+0000","last_became_active":"2023-12-11T20:13:53.268553+0000","last_became_peered":"2023-12-11T20:13:53.268553+0000","last_unstale":"2023-12-11T20:15:04.319466+0000","last_undegraded":"2023-12-11T20:15:04.319466+0000","last_fullsized":"2023-12-11T20:15:04.319466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:55.125792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285660+0000","last_change":"2023-12-11T20:13:53.284361+0000","last_active":"2023-12-11T20:15:04.285660+0000","last_peered":"2023-12-11T20:15:04.285660+0000","last_clean":"2023-12-11T20:15:04.285660+0000","last_became_active":"2023-12-11T20:13:53.282109+0000","last_became_peered":"2023-12-11T20:13:53.282109+0000","last_unstale":"2023-12-11T20:15:04.285660+0000","last_undegraded":"2023-12-11T20:15:04.285660+0000","last_fullsized":"2023-12-11T20:15:04.285660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:44:50.021737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282299+0000","last_change":"2023-12-11T20:13:53.274005+0000","last_active":"2023-12-11T20:15:04.282299+0000","last_peered":"2023-12-11T20:15:04.282299+0000","last_clean":"2023-12-11T20:15:04.282299+0000","last_became_active":"2023-12-11T20:13:53.273336+0000","last_became_peered":"2023-12-11T20:13:53.273336+0000","last_unstale":"2023-12-11T20:15:04.282299+0000","last_undegraded":"2023-12-11T20:15:04.282299+0000","last_fullsized":"2023-12-11T20:15:04.282299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:56:05.732607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319261+0000","last_change":"2023-12-11T20:13:53.280909+0000","last_active":"2023-12-11T20:15:04.319261+0000","last_peered":"2023-12-11T20:15:04.319261+0000","last_clean":"2023-12-11T20:15:04.319261+0000","last_became_active":"2023-12-11T20:13:53.278124+0000","last_became_peered":"2023-12-11T20:13:53.278124+0000","last_unstale":"2023-12-11T20:15:04.319261+0000","last_undegraded":"2023-12-11T20:15:04.319261+0000","last_fullsized":"2023-12-11T20:15:04.319261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:09:19.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282365+0000","last_change":"2023-12-11T20:13:52.478685+0000","last_active":"2023-12-11T20:15:04.282365+0000","last_peered":"2023-12-11T20:15:04.282365+0000","last_clean":"2023-12-11T20:15:04.282365+0000","last_became_active":"2023-12-11T20:13:52.478391+0000","last_became_peered":"2023-12-11T20:13:52.478391+0000","last_unstale":"2023-12-11T20:15:04.282365+0000","last_undegraded":"2023-12-11T20:15:04.282365+0000","last_fullsized":"2023-12-11T20:15:04.282365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:02:54.039954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321172+0000","last_change":"2023-12-11T20:13:53.279432+0000","last_active":"2023-12-11T20:15:04.321172+0000","last_peered":"2023-12-11T20:15:04.321172+0000","last_clean":"2023-12-11T20:15:04.321172+0000","last_became_active":"2023-12-11T20:13:53.279087+0000","last_became_peered":"2023-12-11T20:13:53.279087+0000","last_unstale":"2023-12-11T20:15:04.321172+0000","last_undegraded":"2023-12-11T20:15:04.321172+0000","last_fullsized":"2023-12-11T20:15:04.321172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.376941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321258+0000","last_change":"2023-12-11T20:13:52.485170+0000","last_active":"2023-12-11T20:15:04.321258+0000","last_peered":"2023-12-11T20:15:04.321258+0000","last_clean":"2023-12-11T20:15:04.321258+0000","last_became_active":"2023-12-11T20:13:52.484885+0000","last_became_peered":"2023-12-11T20:13:52.484885+0000","last_unstale":"2023-12-11T20:15:04.321258+0000","last_undegraded":"2023-12-11T20:15:04.321258+0000","last_fullsized":"2023-12-11T20:15:04.321258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:21:40.746709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319348+0000","last_change":"2023-12-11T20:13:53.274015+0000","last_active":"2023-12-11T20:15:04.319348+0000","last_peered":"2023-12-11T20:15:04.319348+0000","last_clean":"2023-12-11T20:15:04.319348+0000","last_became_active":"2023-12-11T20:13:53.272504+0000","last_became_peered":"2023-12-11T20:13:53.272504+0000","last_unstale":"2023-12-11T20:15:04.319348+0000","last_undegraded":"2023-12-11T20:15:04.319348+0000","last_fullsized":"2023-12-11T20:15:04.319348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:26.155659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285339+0000","last_change":"2023-12-11T20:14:04.560730+0000","last_active":"2023-12-11T20:15:04.285339+0000","last_peered":"2023-12-11T20:15:04.285339+0000","last_clean":"2023-12-11T20:15:04.285339+0000","last_became_active":"2023-12-11T20:14:04.549828+0000","last_became_peered":"2023-12-11T20:14:04.549828+0000","last_unstale":"2023-12-11T20:15:04.285339+0000","last_undegraded":"2023-12-11T20:15:04.285339+0000","last_fullsized":"2023-12-11T20:15:04.285339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:47:10.046705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319638+0000","last_change":"2023-12-11T20:13:53.268907+0000","last_active":"2023-12-11T20:15:04.319638+0000","last_peered":"2023-12-11T20:15:04.319638+0000","last_clean":"2023-12-11T20:15:04.319638+0000","last_became_active":"2023-12-11T20:13:53.268494+0000","last_became_peered":"2023-12-11T20:13:53.268494+0000","last_unstale":"2023-12-11T20:15:04.319638+0000","last_undegraded":"2023-12-11T20:15:04.319638+0000","last_fullsized":"2023-12-11T20:15:04.319638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:57:36.104687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.289029+0000","last_change":"2023-12-11T20:13:52.475425+0000","last_active":"2023-12-11T20:15:04.289029+0000","last_peered":"2023-12-11T20:15:04.289029+0000","last_clean":"2023-12-11T20:15:04.289029+0000","last_became_active":"2023-12-11T20:13:52.475066+0000","last_became_peered":"2023-12-11T20:13:52.475066+0000","last_unstale":"2023-12-11T20:15:04.289029+0000","last_undegraded":"2023-12-11T20:15:04.289029+0000","last_fullsized":"2023-12-11T20:15:04.289029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:01:01.603043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286516+0000","last_change":"2023-12-11T20:14:04.546865+0000","last_active":"2023-12-11T20:15:04.286516+0000","last_peered":"2023-12-11T20:15:04.286516+0000","last_clean":"2023-12-11T20:15:04.286516+0000","last_became_active":"2023-12-11T20:14:04.546475+0000","last_became_peered":"2023-12-11T20:14:04.546475+0000","last_unstale":"2023-12-11T20:15:04.286516+0000","last_undegraded":"2023-12-11T20:15:04.286516+0000","last_fullsized":"2023-12-11T20:15:04.286516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:54.745514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'8","reported_seq":131,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:37.439744+0000","last_change":"2023-12-11T20:13:52.481648+0000","last_active":"2023-12-11T20:15:37.439744+0000","last_peered":"2023-12-11T20:15:37.439744+0000","last_clean":"2023-12-11T20:15:37.439744+0000","last_became_active":"2023-12-11T20:13:52.481317+0000","last_became_peered":"2023-12-11T20:13:52.481317+0000","last_unstale":"2023-12-11T20:15:37.439744+0000","last_undegraded":"2023-12-11T20:15:37.439744+0000","last_fullsized":"2023-12-11T20:15:37.439744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:30:32.206757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288382+0000","last_change":"2023-12-11T20:13:53.261350+0000","last_active":"2023-12-11T20:15:04.288382+0000","last_peered":"2023-12-11T20:15:04.288382+0000","last_clean":"2023-12-11T20:15:04.288382+0000","last_became_active":"2023-12-11T20:13:53.260471+0000","last_became_peered":"2023-12-11T20:13:53.260471+0000","last_unstale":"2023-12-11T20:15:04.288382+0000","last_undegraded":"2023-12-11T20:15:04.288382+0000","last_fullsized":"2023-12-11T20:15:04.288382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:27.844329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285654+0000","last_change":"2023-12-11T20:13:52.482190+0000","last_active":"2023-12-11T20:15:04.285654+0000","last_peered":"2023-12-11T20:15:04.285654+0000","last_clean":"2023-12-11T20:15:04.285654+0000","last_became_active":"2023-12-11T20:13:52.481758+0000","last_became_peered":"2023-12-11T20:13:52.481758+0000","last_unstale":"2023-12-11T20:15:04.285654+0000","last_undegraded":"2023-12-11T20:15:04.285654+0000","last_fullsized":"2023-12-11T20:15:04.285654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:26.226338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286371+0000","last_change":"2023-12-11T20:13:53.279366+0000","last_active":"2023-12-11T20:15:04.286371+0000","last_peered":"2023-12-11T20:15:04.286371+0000","last_clean":"2023-12-11T20:15:04.286371+0000","last_became_active":"2023-12-11T20:13:53.279074+0000","last_became_peered":"2023-12-11T20:13:53.279074+0000","last_unstale":"2023-12-11T20:15:04.286371+0000","last_undegraded":"2023-12-11T20:15:04.286371+0000","last_fullsized":"2023-12-11T20:15:04.286371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:37.856345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320171+0000","last_change":"2023-12-11T20:13:52.480830+0000","last_active":"2023-12-11T20:15:04.320171+0000","last_peered":"2023-12-11T20:15:04.320171+0000","last_clean":"2023-12-11T20:15:04.320171+0000","last_became_active":"2023-12-11T20:13:52.480359+0000","last_became_peered":"2023-12-11T20:13:52.480359+0000","last_unstale":"2023-12-11T20:15:04.320171+0000","last_undegraded":"2023-12-11T20:15:04.320171+0000","last_fullsized":"2023-12-11T20:15:04.320171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:13:13.756411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319851+0000","last_change":"2023-12-11T20:13:53.275587+0000","last_active":"2023-12-11T20:15:04.319851+0000","last_peered":"2023-12-11T20:15:04.319851+0000","last_clean":"2023-12-11T20:15:04.319851+0000","last_became_active":"2023-12-11T20:13:53.275014+0000","last_became_peered":"2023-12-11T20:13:53.275014+0000","last_unstale":"2023-12-11T20:15:04.319851+0000","last_undegraded":"2023-12-11T20:15:04.319851+0000","last_fullsized":"2023-12-11T20:15:04.319851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:21:23.179714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.284858+0000","last_change":"2023-12-11T20:14:04.548868+0000","last_active":"2023-12-11T20:15:04.284858+0000","last_peered":"2023-12-11T20:15:04.284858+0000","last_clean":"2023-12-11T20:15:04.284858+0000","last_became_active":"2023-12-11T20:14:04.548198+0000","last_became_peered":"2023-12-11T20:14:04.548198+0000","last_unstale":"2023-12-11T20:15:04.284858+0000","last_undegraded":"2023-12-11T20:15:04.284858+0000","last_fullsized":"2023-12-11T20:15:04.284858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:11:16.117241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.281957+0000","last_change":"2023-12-11T20:13:53.281254+0000","last_active":"2023-12-11T20:15:04.281957+0000","last_peered":"2023-12-11T20:15:04.281957+0000","last_clean":"2023-12-11T20:15:04.281957+0000","last_became_active":"2023-12-11T20:13:53.278026+0000","last_became_peered":"2023-12-11T20:13:53.278026+0000","last_unstale":"2023-12-11T20:15:04.281957+0000","last_undegraded":"2023-12-11T20:15:04.281957+0000","last_fullsized":"2023-12-11T20:15:04.281957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:25:46.033739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:34.432516+0000","last_change":"2023-12-11T20:13:52.485136+0000","last_active":"2023-12-11T20:15:34.432516+0000","last_peered":"2023-12-11T20:15:34.432516+0000","last_clean":"2023-12-11T20:15:34.432516+0000","last_became_active":"2023-12-11T20:13:52.484743+0000","last_became_peered":"2023-12-11T20:13:52.484743+0000","last_unstale":"2023-12-11T20:15:34.432516+0000","last_undegraded":"2023-12-11T20:15:34.432516+0000","last_fullsized":"2023-12-11T20:15:34.432516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:50.893360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319974+0000","last_change":"2023-12-11T20:13:53.274566+0000","last_active":"2023-12-11T20:15:04.319974+0000","last_peered":"2023-12-11T20:15:04.319974+0000","last_clean":"2023-12-11T20:15:04.319974+0000","last_became_active":"2023-12-11T20:13:53.273325+0000","last_became_peered":"2023-12-11T20:13:53.273325+0000","last_unstale":"2023-12-11T20:15:04.319974+0000","last_undegraded":"2023-12-11T20:15:04.319974+0000","last_fullsized":"2023-12-11T20:15:04.319974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:29:17.656364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283417+0000","last_change":"2023-12-11T20:14:04.766961+0000","last_active":"2023-12-11T20:15:04.283417+0000","last_peered":"2023-12-11T20:15:04.283417+0000","last_clean":"2023-12-11T20:15:04.283417+0000","last_became_active":"2023-12-11T20:14:04.763504+0000","last_became_peered":"2023-12-11T20:14:04.763504+0000","last_unstale":"2023-12-11T20:15:04.283417+0000","last_undegraded":"2023-12-11T20:15:04.283417+0000","last_fullsized":"2023-12-11T20:15:04.283417+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:50:38.795524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319445+0000","last_change":"2023-12-11T20:14:04.764089+0000","last_active":"2023-12-11T20:15:04.319445+0000","last_peered":"2023-12-11T20:15:04.319445+0000","last_clean":"2023-12-11T20:15:04.319445+0000","last_became_active":"2023-12-11T20:14:04.763556+0000","last_became_peered":"2023-12-11T20:14:04.763556+0000","last_unstale":"2023-12-11T20:15:04.319445+0000","last_undegraded":"2023-12-11T20:15:04.319445+0000","last_fullsized":"2023-12-11T20:15:04.319445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:39.851342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286688+0000","last_change":"2023-12-11T20:13:52.486247+0000","last_active":"2023-12-11T20:15:04.286688+0000","last_peered":"2023-12-11T20:15:04.286688+0000","last_clean":"2023-12-11T20:15:04.286688+0000","last_became_active":"2023-12-11T20:13:52.485343+0000","last_became_peered":"2023-12-11T20:13:52.485343+0000","last_unstale":"2023-12-11T20:15:04.286688+0000","last_undegraded":"2023-12-11T20:15:04.286688+0000","last_fullsized":"2023-12-11T20:15:04.286688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:21:46.587858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319745+0000","last_change":"2023-12-11T20:13:53.281264+0000","last_active":"2023-12-11T20:15:04.319745+0000","last_peered":"2023-12-11T20:15:04.319745+0000","last_clean":"2023-12-11T20:15:04.319745+0000","last_became_active":"2023-12-11T20:13:53.280899+0000","last_became_peered":"2023-12-11T20:13:53.280899+0000","last_unstale":"2023-12-11T20:15:04.319745+0000","last_undegraded":"2023-12-11T20:15:04.319745+0000","last_fullsized":"2023-12-11T20:15:04.319745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:17.675421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":256,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.441967+0000","last_change":"2023-12-11T20:13:52.475732+0000","last_active":"2023-12-11T20:15:35.441967+0000","last_peered":"2023-12-11T20:15:35.441967+0000","last_clean":"2023-12-11T20:15:35.441967+0000","last_became_active":"2023-12-11T20:13:52.475415+0000","last_became_peered":"2023-12-11T20:13:52.475415+0000","last_unstale":"2023-12-11T20:15:35.441967+0000","last_undegraded":"2023-12-11T20:15:35.441967+0000","last_fullsized":"2023-12-11T20:15:35.441967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:20:31.539997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65076,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":162,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288602+0000","last_change":"2023-12-11T20:13:53.273365+0000","last_active":"2023-12-11T20:15:04.288602+0000","last_peered":"2023-12-11T20:15:04.288602+0000","last_clean":"2023-12-11T20:15:04.288602+0000","last_became_active":"2023-12-11T20:13:53.268456+0000","last_became_peered":"2023-12-11T20:13:53.268456+0000","last_unstale":"2023-12-11T20:15:04.288602+0000","last_undegraded":"2023-12-11T20:15:04.288602+0000","last_fullsized":"2023-12-11T20:15:04.288602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:13.850229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319079+0000","last_change":"2023-12-11T20:13:52.477609+0000","last_active":"2023-12-11T20:15:04.319079+0000","last_peered":"2023-12-11T20:15:04.319079+0000","last_clean":"2023-12-11T20:15:04.319079+0000","last_became_active":"2023-12-11T20:13:52.477177+0000","last_became_peered":"2023-12-11T20:13:52.477177+0000","last_unstale":"2023-12-11T20:15:04.319079+0000","last_undegraded":"2023-12-11T20:15:04.319079+0000","last_fullsized":"2023-12-11T20:15:04.319079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:30:46.987026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320296+0000","last_change":"2023-12-11T20:13:53.278247+0000","last_active":"2023-12-11T20:15:04.320296+0000","last_peered":"2023-12-11T20:15:04.320296+0000","last_clean":"2023-12-11T20:15:04.320296+0000","last_became_active":"2023-12-11T20:13:53.277928+0000","last_became_peered":"2023-12-11T20:13:53.277928+0000","last_unstale":"2023-12-11T20:15:04.320296+0000","last_undegraded":"2023-12-11T20:15:04.320296+0000","last_fullsized":"2023-12-11T20:15:04.320296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:52:33.864370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286178+0000","last_change":"2023-12-11T20:13:52.485985+0000","last_active":"2023-12-11T20:15:04.286178+0000","last_peered":"2023-12-11T20:15:04.286178+0000","last_clean":"2023-12-11T20:15:04.286178+0000","last_became_active":"2023-12-11T20:13:52.484929+0000","last_became_peered":"2023-12-11T20:13:52.484929+0000","last_unstale":"2023-12-11T20:15:04.286178+0000","last_undegraded":"2023-12-11T20:15:04.286178+0000","last_fullsized":"2023-12-11T20:15:04.286178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T08:11:28.665448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283632+0000","last_change":"2023-12-11T20:13:53.277048+0000","last_active":"2023-12-11T20:15:04.283632+0000","last_peered":"2023-12-11T20:15:04.283632+0000","last_clean":"2023-12-11T20:15:04.283632+0000","last_became_active":"2023-12-11T20:13:53.276706+0000","last_became_peered":"2023-12-11T20:13:53.276706+0000","last_unstale":"2023-12-11T20:15:04.283632+0000","last_undegraded":"2023-12-11T20:15:04.283632+0000","last_fullsized":"2023-12-11T20:15:04.283632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:46.815339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.432267+0000","last_change":"2023-12-11T20:13:52.477814+0000","last_active":"2023-12-11T20:15:35.432267+0000","last_peered":"2023-12-11T20:15:35.432267+0000","last_clean":"2023-12-11T20:15:35.432267+0000","last_became_active":"2023-12-11T20:13:52.477036+0000","last_became_peered":"2023-12-11T20:13:52.477036+0000","last_unstale":"2023-12-11T20:15:35.432267+0000","last_undegraded":"2023-12-11T20:15:35.432267+0000","last_fullsized":"2023-12-11T20:15:35.432267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:53:44.279968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.288926+0000","last_change":"2023-12-11T20:15:05.288926+0000","last_active":"2023-12-11T20:15:05.288926+0000","last_peered":"2023-12-11T20:15:05.288926+0000","last_clean":"2023-12-11T20:15:05.288926+0000","last_became_active":"2023-12-11T20:15:05.288443+0000","last_became_peered":"2023-12-11T20:15:05.288443+0000","last_unstale":"2023-12-11T20:15:05.288926+0000","last_undegraded":"2023-12-11T20:15:05.288926+0000","last_fullsized":"2023-12-11T20:15:05.288926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:09:43.778797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288197+0000","last_change":"2023-12-11T20:13:52.483417+0000","last_active":"2023-12-11T20:15:04.288197+0000","last_peered":"2023-12-11T20:15:04.288197+0000","last_clean":"2023-12-11T20:15:04.288197+0000","last_became_active":"2023-12-11T20:13:52.481395+0000","last_became_peered":"2023-12-11T20:13:52.481395+0000","last_unstale":"2023-12-11T20:15:04.288197+0000","last_undegraded":"2023-12-11T20:15:04.288197+0000","last_fullsized":"2023-12-11T20:15:04.288197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:01:42.053460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286310+0000","last_change":"2023-12-11T20:13:53.280688+0000","last_active":"2023-12-11T20:15:04.286310+0000","last_peered":"2023-12-11T20:15:04.286310+0000","last_clean":"2023-12-11T20:15:04.286310+0000","last_became_active":"2023-12-11T20:13:53.277300+0000","last_became_peered":"2023-12-11T20:13:53.277300+0000","last_unstale":"2023-12-11T20:15:04.286310+0000","last_undegraded":"2023-12-11T20:15:04.286310+0000","last_fullsized":"2023-12-11T20:15:04.286310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:40:58.831909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288583+0000","last_change":"2023-12-11T20:13:52.474978+0000","last_active":"2023-12-11T20:15:04.288583+0000","last_peered":"2023-12-11T20:15:04.288583+0000","last_clean":"2023-12-11T20:15:04.288583+0000","last_became_active":"2023-12-11T20:13:52.472863+0000","last_became_peered":"2023-12-11T20:13:52.472863+0000","last_unstale":"2023-12-11T20:15:04.288583+0000","last_undegraded":"2023-12-11T20:15:04.288583+0000","last_fullsized":"2023-12-11T20:15:04.288583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:53:44.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285363+0000","last_change":"2023-12-11T20:13:53.285991+0000","last_active":"2023-12-11T20:15:04.285363+0000","last_peered":"2023-12-11T20:15:04.285363+0000","last_clean":"2023-12-11T20:15:04.285363+0000","last_became_active":"2023-12-11T20:13:53.283925+0000","last_became_peered":"2023-12-11T20:13:53.283925+0000","last_unstale":"2023-12-11T20:15:04.285363+0000","last_undegraded":"2023-12-11T20:15:04.285363+0000","last_fullsized":"2023-12-11T20:15:04.285363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:15:48.845668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.282190+0000","last_change":"2023-12-11T20:13:52.478883+0000","last_active":"2023-12-11T20:15:04.282190+0000","last_peered":"2023-12-11T20:15:04.282190+0000","last_clean":"2023-12-11T20:15:04.282190+0000","last_became_active":"2023-12-11T20:13:52.477070+0000","last_became_peered":"2023-12-11T20:13:52.477070+0000","last_unstale":"2023-12-11T20:15:04.282190+0000","last_undegraded":"2023-12-11T20:15:04.282190+0000","last_fullsized":"2023-12-11T20:15:04.282190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:14:32.504778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286113+0000","last_change":"2023-12-11T20:13:53.278181+0000","last_active":"2023-12-11T20:15:04.286113+0000","last_peered":"2023-12-11T20:15:04.286113+0000","last_clean":"2023-12-11T20:15:04.286113+0000","last_became_active":"2023-12-11T20:13:53.277800+0000","last_became_peered":"2023-12-11T20:13:53.277800+0000","last_unstale":"2023-12-11T20:15:04.286113+0000","last_undegraded":"2023-12-11T20:15:04.286113+0000","last_fullsized":"2023-12-11T20:15:04.286113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:35.424820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283043+0000","last_change":"2023-12-11T20:13:52.481281+0000","last_active":"2023-12-11T20:15:04.283043+0000","last_peered":"2023-12-11T20:15:04.283043+0000","last_clean":"2023-12-11T20:15:04.283043+0000","last_became_active":"2023-12-11T20:13:52.479352+0000","last_became_peered":"2023-12-11T20:13:52.479352+0000","last_unstale":"2023-12-11T20:15:04.283043+0000","last_undegraded":"2023-12-11T20:15:04.283043+0000","last_fullsized":"2023-12-11T20:15:04.283043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:41.815011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285882+0000","last_change":"2023-12-11T20:13:53.282233+0000","last_active":"2023-12-11T20:15:04.285882+0000","last_peered":"2023-12-11T20:15:04.285882+0000","last_clean":"2023-12-11T20:15:04.285882+0000","last_became_active":"2023-12-11T20:13:53.279001+0000","last_became_peered":"2023-12-11T20:13:53.279001+0000","last_unstale":"2023-12-11T20:15:04.285882+0000","last_undegraded":"2023-12-11T20:15:04.285882+0000","last_fullsized":"2023-12-11T20:15:04.285882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:30:21.671414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286370+0000","last_change":"2023-12-11T20:13:53.269361+0000","last_active":"2023-12-11T20:15:04.286370+0000","last_peered":"2023-12-11T20:15:04.286370+0000","last_clean":"2023-12-11T20:15:04.286370+0000","last_became_active":"2023-12-11T20:13:53.268613+0000","last_became_peered":"2023-12-11T20:13:53.268613+0000","last_unstale":"2023-12-11T20:15:04.286370+0000","last_undegraded":"2023-12-11T20:15:04.286370+0000","last_fullsized":"2023-12-11T20:15:04.286370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:08:04.876038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":122,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:35.431538+0000","last_change":"2023-12-11T20:13:52.484537+0000","last_active":"2023-12-11T20:15:35.431538+0000","last_peered":"2023-12-11T20:15:35.431538+0000","last_clean":"2023-12-11T20:15:35.431538+0000","last_became_active":"2023-12-11T20:13:52.482732+0000","last_became_peered":"2023-12-11T20:13:52.482732+0000","last_unstale":"2023-12-11T20:15:35.431538+0000","last_undegraded":"2023-12-11T20:15:35.431538+0000","last_fullsized":"2023-12-11T20:15:35.431538+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:41:31.332046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320996+0000","last_change":"2023-12-11T20:13:53.270953+0000","last_active":"2023-12-11T20:15:04.320996+0000","last_peered":"2023-12-11T20:15:04.320996+0000","last_clean":"2023-12-11T20:15:04.320996+0000","last_became_active":"2023-12-11T20:13:53.269711+0000","last_became_peered":"2023-12-11T20:13:53.269711+0000","last_unstale":"2023-12-11T20:15:04.320996+0000","last_undegraded":"2023-12-11T20:15:04.320996+0000","last_fullsized":"2023-12-11T20:15:04.320996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:16:50.802953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288519+0000","last_change":"2023-12-11T20:13:52.473341+0000","last_active":"2023-12-11T20:15:04.288519+0000","last_peered":"2023-12-11T20:15:04.288519+0000","last_clean":"2023-12-11T20:15:04.288519+0000","last_became_active":"2023-12-11T20:13:52.469572+0000","last_became_peered":"2023-12-11T20:13:52.469572+0000","last_unstale":"2023-12-11T20:15:04.288519+0000","last_undegraded":"2023-12-11T20:15:04.288519+0000","last_fullsized":"2023-12-11T20:15:04.288519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:52:47.513645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.287290+0000","last_change":"2023-12-11T20:12:30.330188+0000","last_active":"2023-12-11T20:15:05.287290+0000","last_peered":"2023-12-11T20:15:05.287290+0000","last_clean":"2023-12-11T20:15:05.287290+0000","last_became_active":"2023-12-11T20:12:30.329533+0000","last_became_peered":"2023-12-11T20:12:30.329533+0000","last_unstale":"2023-12-11T20:15:05.287290+0000","last_undegraded":"2023-12-11T20:15:05.287290+0000","last_fullsized":"2023-12-11T20:15:05.287290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:08:47.558016+0000","last_clean_scrub_stamp":"2023-12-11T20:08:47.558016+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:18:10.357750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319964+0000","last_change":"2023-12-11T20:13:53.278062+0000","last_active":"2023-12-11T20:15:04.319964+0000","last_peered":"2023-12-11T20:15:04.319964+0000","last_clean":"2023-12-11T20:15:04.319964+0000","last_became_active":"2023-12-11T20:13:53.277664+0000","last_became_peered":"2023-12-11T20:13:53.277664+0000","last_unstale":"2023-12-11T20:15:04.319964+0000","last_undegraded":"2023-12-11T20:15:04.319964+0000","last_fullsized":"2023-12-11T20:15:04.319964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:07:38.751486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283369+0000","last_change":"2023-12-11T20:14:04.550614+0000","last_active":"2023-12-11T20:15:04.283369+0000","last_peered":"2023-12-11T20:15:04.283369+0000","last_clean":"2023-12-11T20:15:04.283369+0000","last_became_active":"2023-12-11T20:14:04.544469+0000","last_became_peered":"2023-12-11T20:14:04.544469+0000","last_unstale":"2023-12-11T20:15:04.283369+0000","last_undegraded":"2023-12-11T20:15:04.283369+0000","last_fullsized":"2023-12-11T20:15:04.283369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:33.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288626+0000","last_change":"2023-12-11T20:13:52.478823+0000","last_active":"2023-12-11T20:15:04.288626+0000","last_peered":"2023-12-11T20:15:04.288626+0000","last_clean":"2023-12-11T20:15:04.288626+0000","last_became_active":"2023-12-11T20:13:52.478475+0000","last_became_peered":"2023-12-11T20:13:52.478475+0000","last_unstale":"2023-12-11T20:15:04.288626+0000","last_undegraded":"2023-12-11T20:15:04.288626+0000","last_fullsized":"2023-12-11T20:15:04.288626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:44:36.438152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320508+0000","last_change":"2023-12-11T20:13:53.272496+0000","last_active":"2023-12-11T20:15:04.320508+0000","last_peered":"2023-12-11T20:15:04.320508+0000","last_clean":"2023-12-11T20:15:04.320508+0000","last_became_active":"2023-12-11T20:13:53.271669+0000","last_became_peered":"2023-12-11T20:13:53.271669+0000","last_unstale":"2023-12-11T20:15:04.320508+0000","last_undegraded":"2023-12-11T20:15:04.320508+0000","last_fullsized":"2023-12-11T20:15:04.320508+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:48:31.299659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'7","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:06.100758+0000","last_change":"2023-12-11T20:13:52.485866+0000","last_active":"2023-12-11T20:15:06.100758+0000","last_peered":"2023-12-11T20:15:06.100758+0000","last_clean":"2023-12-11T20:15:06.100758+0000","last_became_active":"2023-12-11T20:13:52.485106+0000","last_became_peered":"2023-12-11T20:13:52.485106+0000","last_unstale":"2023-12-11T20:15:06.100758+0000","last_undegraded":"2023-12-11T20:15:06.100758+0000","last_fullsized":"2023-12-11T20:15:06.100758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:24:41.177294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321338+0000","last_change":"2023-12-11T20:13:53.271737+0000","last_active":"2023-12-11T20:15:04.321338+0000","last_peered":"2023-12-11T20:15:04.321338+0000","last_clean":"2023-12-11T20:15:04.321338+0000","last_became_active":"2023-12-11T20:13:53.271228+0000","last_became_peered":"2023-12-11T20:13:53.271228+0000","last_unstale":"2023-12-11T20:15:04.321338+0000","last_undegraded":"2023-12-11T20:15:04.321338+0000","last_fullsized":"2023-12-11T20:15:04.321338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:29:45.614455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288608+0000","last_change":"2023-12-11T20:13:52.475488+0000","last_active":"2023-12-11T20:15:04.288608+0000","last_peered":"2023-12-11T20:15:04.288608+0000","last_clean":"2023-12-11T20:15:04.288608+0000","last_became_active":"2023-12-11T20:13:52.475150+0000","last_became_peered":"2023-12-11T20:13:52.475150+0000","last_unstale":"2023-12-11T20:15:04.288608+0000","last_undegraded":"2023-12-11T20:15:04.288608+0000","last_fullsized":"2023-12-11T20:15:04.288608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:42:55.792758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319347+0000","last_change":"2023-12-11T20:13:53.285381+0000","last_active":"2023-12-11T20:15:04.319347+0000","last_peered":"2023-12-11T20:15:04.319347+0000","last_clean":"2023-12-11T20:15:04.319347+0000","last_became_active":"2023-12-11T20:13:53.285069+0000","last_became_peered":"2023-12-11T20:13:53.285069+0000","last_unstale":"2023-12-11T20:15:04.319347+0000","last_undegraded":"2023-12-11T20:15:04.319347+0000","last_fullsized":"2023-12-11T20:15:04.319347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:57:18.630314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319509+0000","last_change":"2023-12-11T20:13:52.483184+0000","last_active":"2023-12-11T20:15:04.319509+0000","last_peered":"2023-12-11T20:15:04.319509+0000","last_clean":"2023-12-11T20:15:04.319509+0000","last_became_active":"2023-12-11T20:13:52.482853+0000","last_became_peered":"2023-12-11T20:13:52.482853+0000","last_unstale":"2023-12-11T20:15:04.319509+0000","last_undegraded":"2023-12-11T20:15:04.319509+0000","last_fullsized":"2023-12-11T20:15:04.319509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:35.111222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288169+0000","last_change":"2023-12-11T20:13:53.271751+0000","last_active":"2023-12-11T20:15:04.288169+0000","last_peered":"2023-12-11T20:15:04.288169+0000","last_clean":"2023-12-11T20:15:04.288169+0000","last_became_active":"2023-12-11T20:13:53.271385+0000","last_became_peered":"2023-12-11T20:13:53.271385+0000","last_unstale":"2023-12-11T20:15:04.288169+0000","last_undegraded":"2023-12-11T20:15:04.288169+0000","last_fullsized":"2023-12-11T20:15:04.288169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:28:03.856212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320155+0000","last_change":"2023-12-11T20:13:52.483504+0000","last_active":"2023-12-11T20:15:04.320155+0000","last_peered":"2023-12-11T20:15:04.320155+0000","last_clean":"2023-12-11T20:15:04.320155+0000","last_became_active":"2023-12-11T20:13:52.482796+0000","last_became_peered":"2023-12-11T20:13:52.482796+0000","last_unstale":"2023-12-11T20:15:04.320155+0000","last_undegraded":"2023-12-11T20:15:04.320155+0000","last_fullsized":"2023-12-11T20:15:04.320155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:34:27.162215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285003+0000","last_change":"2023-12-11T20:13:53.276017+0000","last_active":"2023-12-11T20:15:04.285003+0000","last_peered":"2023-12-11T20:15:04.285003+0000","last_clean":"2023-12-11T20:15:04.285003+0000","last_became_active":"2023-12-11T20:13:53.275425+0000","last_became_peered":"2023-12-11T20:13:53.275425+0000","last_unstale":"2023-12-11T20:15:04.285003+0000","last_undegraded":"2023-12-11T20:15:04.285003+0000","last_fullsized":"2023-12-11T20:15:04.285003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:05:36.762187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319137+0000","last_change":"2023-12-11T20:13:52.477538+0000","last_active":"2023-12-11T20:15:04.319137+0000","last_peered":"2023-12-11T20:15:04.319137+0000","last_clean":"2023-12-11T20:15:04.319137+0000","last_became_active":"2023-12-11T20:13:52.476937+0000","last_became_peered":"2023-12-11T20:13:52.476937+0000","last_unstale":"2023-12-11T20:15:04.319137+0000","last_undegraded":"2023-12-11T20:15:04.319137+0000","last_fullsized":"2023-12-11T20:15:04.319137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:41:25.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320696+0000","last_change":"2023-12-11T20:13:53.276419+0000","last_active":"2023-12-11T20:15:04.320696+0000","last_peered":"2023-12-11T20:15:04.320696+0000","last_clean":"2023-12-11T20:15:04.320696+0000","last_became_active":"2023-12-11T20:13:53.276106+0000","last_became_peered":"2023-12-11T20:13:53.276106+0000","last_unstale":"2023-12-11T20:15:04.320696+0000","last_undegraded":"2023-12-11T20:15:04.320696+0000","last_fullsized":"2023-12-11T20:15:04.320696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:25:32.720877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.288350+0000","last_change":"2023-12-11T20:14:04.554132+0000","last_active":"2023-12-11T20:15:04.288350+0000","last_peered":"2023-12-11T20:15:04.288350+0000","last_clean":"2023-12-11T20:15:04.288350+0000","last_became_active":"2023-12-11T20:14:04.546343+0000","last_became_peered":"2023-12-11T20:14:04.546343+0000","last_unstale":"2023-12-11T20:15:04.288350+0000","last_undegraded":"2023-12-11T20:15:04.288350+0000","last_fullsized":"2023-12-11T20:15:04.288350+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:16:37.790659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283263+0000","last_change":"2023-12-11T20:13:53.265917+0000","last_active":"2023-12-11T20:15:04.283263+0000","last_peered":"2023-12-11T20:15:04.283263+0000","last_clean":"2023-12-11T20:15:04.283263+0000","last_became_active":"2023-12-11T20:13:53.265569+0000","last_became_peered":"2023-12-11T20:13:53.265569+0000","last_unstale":"2023-12-11T20:15:04.283263+0000","last_undegraded":"2023-12-11T20:15:04.283263+0000","last_fullsized":"2023-12-11T20:15:04.283263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:37:19.900048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319256+0000","last_change":"2023-12-11T20:13:52.478688+0000","last_active":"2023-12-11T20:15:04.319256+0000","last_peered":"2023-12-11T20:15:04.319256+0000","last_clean":"2023-12-11T20:15:04.319256+0000","last_became_active":"2023-12-11T20:13:52.477834+0000","last_became_peered":"2023-12-11T20:13:52.477834+0000","last_unstale":"2023-12-11T20:15:04.319256+0000","last_undegraded":"2023-12-11T20:15:04.319256+0000","last_fullsized":"2023-12-11T20:15:04.319256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:57:04.707801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283269+0000","last_change":"2023-12-11T20:13:53.274629+0000","last_active":"2023-12-11T20:15:04.283269+0000","last_peered":"2023-12-11T20:15:04.283269+0000","last_clean":"2023-12-11T20:15:04.283269+0000","last_became_active":"2023-12-11T20:13:53.269650+0000","last_became_peered":"2023-12-11T20:13:53.269650+0000","last_unstale":"2023-12-11T20:15:04.283269+0000","last_undegraded":"2023-12-11T20:15:04.283269+0000","last_fullsized":"2023-12-11T20:15:04.283269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:57:59.865232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286560+0000","last_change":"2023-12-11T20:13:52.485902+0000","last_active":"2023-12-11T20:15:04.286560+0000","last_peered":"2023-12-11T20:15:04.286560+0000","last_clean":"2023-12-11T20:15:04.286560+0000","last_became_active":"2023-12-11T20:13:52.481982+0000","last_became_peered":"2023-12-11T20:13:52.481982+0000","last_unstale":"2023-12-11T20:15:04.286560+0000","last_undegraded":"2023-12-11T20:15:04.286560+0000","last_fullsized":"2023-12-11T20:15:04.286560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:54:39.411648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283046+0000","last_change":"2023-12-11T20:14:04.553595+0000","last_active":"2023-12-11T20:15:04.283046+0000","last_peered":"2023-12-11T20:15:04.283046+0000","last_clean":"2023-12-11T20:15:04.283046+0000","last_became_active":"2023-12-11T20:14:04.546235+0000","last_became_peered":"2023-12-11T20:14:04.546235+0000","last_unstale":"2023-12-11T20:15:04.283046+0000","last_undegraded":"2023-12-11T20:15:04.283046+0000","last_fullsized":"2023-12-11T20:15:04.283046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:45:21.354015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320711+0000","last_change":"2023-12-11T20:13:52.486510+0000","last_active":"2023-12-11T20:15:04.320711+0000","last_peered":"2023-12-11T20:15:04.320711+0000","last_clean":"2023-12-11T20:15:04.320711+0000","last_became_active":"2023-12-11T20:13:52.483852+0000","last_became_peered":"2023-12-11T20:13:52.483852+0000","last_unstale":"2023-12-11T20:15:04.320711+0000","last_undegraded":"2023-12-11T20:15:04.320711+0000","last_fullsized":"2023-12-11T20:15:04.320711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:51.425929+0000","last_clean_scrub_stamp":"2023-12-11T20:13:51.425929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T06:40:05.242000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.283465+0000","last_change":"2023-12-11T20:13:53.270545+0000","last_active":"2023-12-11T20:15:04.283465+0000","last_peered":"2023-12-11T20:15:04.283465+0000","last_clean":"2023-12-11T20:15:04.283465+0000","last_became_active":"2023-12-11T20:13:53.270213+0000","last_became_peered":"2023-12-11T20:13:53.270213+0000","last_unstale":"2023-12-11T20:15:04.283465+0000","last_undegraded":"2023-12-11T20:15:04.283465+0000","last_fullsized":"2023-12-11T20:15:04.283465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:35.442471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285045+0000","last_change":"2023-12-11T20:13:53.276886+0000","last_active":"2023-12-11T20:15:04.285045+0000","last_peered":"2023-12-11T20:15:04.285045+0000","last_clean":"2023-12-11T20:15:04.285045+0000","last_became_active":"2023-12-11T20:13:53.276149+0000","last_became_peered":"2023-12-11T20:13:53.276149+0000","last_unstale":"2023-12-11T20:15:04.285045+0000","last_undegraded":"2023-12-11T20:15:04.285045+0000","last_fullsized":"2023-12-11T20:15:04.285045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:34:19.562002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319090+0000","last_change":"2023-12-11T20:13:53.279990+0000","last_active":"2023-12-11T20:15:04.319090+0000","last_peered":"2023-12-11T20:15:04.319090+0000","last_clean":"2023-12-11T20:15:04.319090+0000","last_became_active":"2023-12-11T20:13:53.279685+0000","last_became_peered":"2023-12-11T20:13:53.279685+0000","last_unstale":"2023-12-11T20:15:04.319090+0000","last_undegraded":"2023-12-11T20:15:04.319090+0000","last_fullsized":"2023-12-11T20:15:04.319090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:21:36.526683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319010+0000","last_change":"2023-12-11T20:13:53.279128+0000","last_active":"2023-12-11T20:15:04.319010+0000","last_peered":"2023-12-11T20:15:04.319010+0000","last_clean":"2023-12-11T20:15:04.319010+0000","last_became_active":"2023-12-11T20:13:53.278821+0000","last_became_peered":"2023-12-11T20:13:53.278821+0000","last_unstale":"2023-12-11T20:15:04.319010+0000","last_undegraded":"2023-12-11T20:15:04.319010+0000","last_fullsized":"2023-12-11T20:15:04.319010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:49:36.013115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.318953+0000","last_change":"2023-12-11T20:13:53.281004+0000","last_active":"2023-12-11T20:15:04.318953+0000","last_peered":"2023-12-11T20:15:04.318953+0000","last_clean":"2023-12-11T20:15:04.318953+0000","last_became_active":"2023-12-11T20:13:53.280691+0000","last_became_peered":"2023-12-11T20:13:53.280691+0000","last_unstale":"2023-12-11T20:15:04.318953+0000","last_undegraded":"2023-12-11T20:15:04.318953+0000","last_fullsized":"2023-12-11T20:15:04.318953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:29:00.336975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320598+0000","last_change":"2023-12-11T20:13:53.272690+0000","last_active":"2023-12-11T20:15:04.320598+0000","last_peered":"2023-12-11T20:15:04.320598+0000","last_clean":"2023-12-11T20:15:04.320598+0000","last_became_active":"2023-12-11T20:13:53.272194+0000","last_became_peered":"2023-12-11T20:13:53.272194+0000","last_unstale":"2023-12-11T20:15:04.320598+0000","last_undegraded":"2023-12-11T20:15:04.320598+0000","last_fullsized":"2023-12-11T20:15:04.320598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:58:45.312035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.285477+0000","last_change":"2023-12-11T20:13:53.277625+0000","last_active":"2023-12-11T20:15:04.285477+0000","last_peered":"2023-12-11T20:15:04.285477+0000","last_clean":"2023-12-11T20:15:04.285477+0000","last_became_active":"2023-12-11T20:13:53.277174+0000","last_became_peered":"2023-12-11T20:13:53.277174+0000","last_unstale":"2023-12-11T20:15:04.285477+0000","last_undegraded":"2023-12-11T20:15:04.285477+0000","last_fullsized":"2023-12-11T20:15:04.285477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:01:41.057178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319413+0000","last_change":"2023-12-11T20:13:53.278685+0000","last_active":"2023-12-11T20:15:04.319413+0000","last_peered":"2023-12-11T20:15:04.319413+0000","last_clean":"2023-12-11T20:15:04.319413+0000","last_became_active":"2023-12-11T20:13:53.276894+0000","last_became_peered":"2023-12-11T20:13:53.276894+0000","last_unstale":"2023-12-11T20:15:04.319413+0000","last_undegraded":"2023-12-11T20:15:04.319413+0000","last_fullsized":"2023-12-11T20:15:04.319413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:21:00.004496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.321269+0000","last_change":"2023-12-11T20:13:53.285596+0000","last_active":"2023-12-11T20:15:04.321269+0000","last_peered":"2023-12-11T20:15:04.321269+0000","last_clean":"2023-12-11T20:15:04.321269+0000","last_became_active":"2023-12-11T20:13:53.285289+0000","last_became_peered":"2023-12-11T20:13:53.285289+0000","last_unstale":"2023-12-11T20:15:04.321269+0000","last_undegraded":"2023-12-11T20:15:04.321269+0000","last_fullsized":"2023-12-11T20:15:04.321269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:53:59.939751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.286024+0000","last_change":"2023-12-11T20:13:53.272600+0000","last_active":"2023-12-11T20:15:04.286024+0000","last_peered":"2023-12-11T20:15:04.286024+0000","last_clean":"2023-12-11T20:15:04.286024+0000","last_became_active":"2023-12-11T20:13:53.272308+0000","last_became_peered":"2023-12-11T20:13:53.272308+0000","last_unstale":"2023-12-11T20:15:04.286024+0000","last_undegraded":"2023-12-11T20:15:04.286024+0000","last_fullsized":"2023-12-11T20:15:04.286024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.458731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320063+0000","last_change":"2023-12-11T20:13:53.280833+0000","last_active":"2023-12-11T20:15:04.320063+0000","last_peered":"2023-12-11T20:15:04.320063+0000","last_clean":"2023-12-11T20:15:04.320063+0000","last_became_active":"2023-12-11T20:13:53.280384+0000","last_became_peered":"2023-12-11T20:13:53.280384+0000","last_unstale":"2023-12-11T20:15:04.320063+0000","last_undegraded":"2023-12-11T20:15:04.320063+0000","last_fullsized":"2023-12-11T20:15:04.320063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:37:38.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.319663+0000","last_change":"2023-12-11T20:13:53.271825+0000","last_active":"2023-12-11T20:15:04.319663+0000","last_peered":"2023-12-11T20:15:04.319663+0000","last_clean":"2023-12-11T20:15:04.319663+0000","last_became_active":"2023-12-11T20:13:53.271460+0000","last_became_peered":"2023-12-11T20:13:53.271460+0000","last_unstale":"2023-12-11T20:15:04.319663+0000","last_undegraded":"2023-12-11T20:15:04.319663+0000","last_fullsized":"2023-12-11T20:15:04.319663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T07:46:46.147904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-11T20:15:04.320441+0000","last_change":"2023-12-11T20:13:53.270103+0000","last_active":"2023-12-11T20:15:04.320441+0000","last_peered":"2023-12-11T20:15:04.320441+0000","last_clean":"2023-12-11T20:15:04.320441+0000","last_became_active":"2023-12-11T20:13:53.269781+0000","last_became_peered":"2023-12-11T20:13:53.269781+0000","last_unstale":"2023-12-11T20:15:04.320441+0000","last_undegraded":"2023-12-11T20:15:04.320441+0000","last_fullsized":"2023-12-11T20:15:04.320441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:23:57.865347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-11T20:15:05.293259+0000","last_change":"2023-12-11T20:15:05.293259+0000","last_active":"2023-12-11T20:15:05.293259+0000","last_peered":"2023-12-11T20:15:05.293259+0000","last_clean":"2023-12-11T20:15:05.293259+0000","last_became_active":"2023-12-11T20:15:05.292789+0000","last_became_peered":"2023-12-11T20:15:05.292789+0000","last_unstale":"2023-12-11T20:15:05.293259+0000","last_undegraded":"2023-12-11T20:15:05.293259+0000","last_fullsized":"2023-12-11T20:15:05.293259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T20:13:52.446246+0000","last_clean_scrub_stamp":"2023-12-11T20:13:52.446246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:54:48.751350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":217636,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70742,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":625,"num_read_kb":381,"num_write":168,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":212226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383716,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":473169,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91700000000000004,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.81599999999999995,"15min":0.77200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.202,"5min":10.202,"15min":10.202},"last":0.60099999999999998}]},{"osd":1,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.071,"5min":1.212,"15min":1.212},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.56899999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.018,"5min":1.369,"15min":1.369},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95199999999999996,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.026,"5min":1.097,"15min":1.097},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.878,"15min":0.88100000000000001},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.083,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.91300000000000003,"15min":0.91400000000000003},"min":{"1min":0.71399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.216,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.76400000000000001}]},{"osd":5,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":1.0980000000000001,"15min":1.1539999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":6.1970000000000001,"15min":6.1970000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.98299999999999998,"15min":1.0129999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.97799999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.89700000000000002,"15min":0.91800000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.105,"5min":1.782,"15min":1.782},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.96799999999999997,"15min":1},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98299999999999998,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.04,"15min":1.0529999999999999},"min":{"1min":0.749,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.202,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.749},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.0389999999999999},"min":{"1min":0.77400000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.3240000000000001,"5min":1.857,"15min":1.857},"last":0.80300000000000005}]},{"osd":8,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.92300000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0209999999999999,"15min":1.0449999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.155,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.282,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.876}]},{"osd":10,"last update":"Mon Dec 11 20:15:00 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.0840000000000001},"min":{"1min":0.90700000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.349,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.204,"15min":1.242},"min":{"1min":0.84099999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2649999999999999,"5min":4.0979999999999999,"15min":4.0979999999999999},"last":0.89400000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1122304,"data_stored":1130760,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42299999999999999}]},{"osd":1,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61899999999999999,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.268,"15min":1.268},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.40799999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72799999999999998,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.503}]},{"osd":2,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.95199999999999996,"5min":1.107,"15min":1.107},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78900000000000003,"15min":0.80700000000000005},"min":{"1min":0.55700000000000005,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.004,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89800000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.80900000000000005},"min":{"1min":0.48999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93500000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82699999999999996,"15min":0.86099999999999999},"min":{"1min":0.52500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.60799999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79600000000000004,"15min":0.83499999999999996},"min":{"1min":0.49299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":1.323,"15min":1.323},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.78400000000000003,"15min":0.83999999999999997},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0089999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.93700000000000006},"min":{"1min":0.60699999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0509999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88900000000000001,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.1519999999999999,"5min":1.641,"15min":1.641},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.91300000000000003,"15min":0.95099999999999996},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.121,"5min":1.484,"15min":1.484},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.95499999999999996,"15min":1.01},"min":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0940000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.93999999999999995}]},{"osd":7,"last update":"Mon Dec 11 20:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93799999999999994}]},{"osd":8,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.0009999999999999,"15min":1.0549999999999999},"min":{"1min":0.70199999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.1359999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.056},{"interface":"front","average":{"1min":0.88,"5min":1.006,"15min":1.0660000000000001},"min":{"1min":0.628,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.119,"5min":1.667,"15min":1.667},"last":0.92500000000000004}]},{"osd":9,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.022,"15min":1.0760000000000001},"min":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1799999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.024,"15min":1.1000000000000001},"min":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1950000000000001,"5min":1.615,"15min":1.615},"last":0.72199999999999998}]},{"osd":11,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1,"15min":1},"min":{"1min":0.78500000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.214,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.999,"15min":1.01},"min":{"1min":0.68999999999999995,"5min":0.625,"15min":0.625},"max":{"1min":1.198,"5min":1.768,"15min":1.768},"last":0.97199999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":473405,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55400000000000005,"15min":0.56699999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.69899999999999995,"15min":0.72499999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.77000000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.70199999999999996},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.81499999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85899999999999999,"15min":0.89200000000000002},"min":{"1min":0.55000000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89800000000000002,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82499999999999996,"15min":0.86699999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4079999999999999,"5min":1.504,"15min":1.504},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65200000000000002,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.77900000000000003,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.81299999999999994,"15min":0.85699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0580000000000001,"5min":1.302,"15min":1.302},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.83299999999999996,"15min":0.88300000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.508,"15min":1.508},"last":1.123},{"interface":"front","average":{"1min":1.1020000000000001,"5min":0.88800000000000001,"15min":0.878},"min":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":5.915,"5min":5.915,"15min":5.915},"last":1.018}]},{"osd":6,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.95999999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.575,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.85999999999999999,"15min":0.90800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.86499999999999999}]},{"osd":7,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.91300000000000003,"15min":0.96499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0269999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.022,"15min":1.075},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.617,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.94899999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.0920000000000001,"15min":1.107},"min":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":5.9539999999999997,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":1.093},{"interface":"front","average":{"1min":0.872,"5min":0.93999999999999995,"15min":0.98399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.073}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.97699999999999998,"15min":0.97099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":6.423,"5min":6.423,"15min":6.423},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.96599999999999997,"15min":0.97199999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":5.9379999999999997,"5min":5.9379999999999997,"15min":5.9379999999999997},"last":0.97699999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":473117,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.67900000000000005,"15min":0.71299999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81299999999999994,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":1.079,"15min":1.079},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.69499999999999995},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.054,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.80400000000000005},"min":{"1min":0.53600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92400000000000004,"5min":1.081,"15min":1.081},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.81100000000000005,"5min":1.226,"15min":1.226},"last":0.94699999999999995}]},{"osd":4,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1140000000000001,"5min":1.115,"15min":1.115},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0529999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.44600000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.0760000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.018,"5min":1.232,"15min":1.232},"last":0.78800000000000003}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.028,"5min":1.284,"15min":1.284},"last":1.004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.55200000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97199999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0049999999999999,"5min":1.298,"15min":1.298},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.93899999999999995,"15min":0.94699999999999995},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1619999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.026}]},{"osd":9,"last update":"Mon Dec 11 20:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.68700000000000006,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1779999999999999,"5min":1.304,"15min":1.304},"last":1.109},{"interface":"front","average":{"1min":1.28,"5min":1.008,"15min":0.96599999999999997},"min":{"1min":0.84399999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":6.4790000000000001,"5min":6.4790000000000001,"15min":6.4790000000000001},"last":1.0700000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.80100000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.139,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.083},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.91600000000000004,"15min":0.90000000000000002},"min":{"1min":0.68200000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1830000000000001,"5min":1.331,"15min":1.331},"last":1.048}]},{"osd":11,"last update":"Mon Dec 11 20:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.131}]}]},{"osd":7,"up_from":51,"seq":219043332155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":1066926,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81000000000000005,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":1.327,"15min":1.327},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.55200000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99199999999999999,"5min":1.518,"15min":1.518},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.052,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93100000000000005,"5min":1.383,"15min":1.383},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90800000000000003,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.115,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.751}]},{"osd":5,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85199999999999998,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.054,"5min":1.294,"15min":1.294},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.873,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0580000000000001,"5min":1.474,"15min":1.474},"last":1.048}]},{"osd":6,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.84499999999999997,"15min":0.85499999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98799999999999999,"5min":1.327,"15min":1.327},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96999999999999997,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.77600000000000002}]},{"osd":8,"last update":"Mon Dec 11 20:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96899999999999997},"min":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.133,"5min":1.544,"15min":1.544},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.0669999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.83599999999999997}]},{"osd":9,"last update":"Mon Dec 11 20:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.95899999999999996,"15min":0.99099999999999999},"min":{"1min":0.69299999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.0409999999999999,"5min":1.573,"15min":1.573},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.98999999999999999,"15min":1.024},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.137,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.95099999999999996}]},{"osd":10,"last update":"Mon Dec 11 20:15:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.93600000000000005,"15min":0.95799999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1910000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.091},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.97999999999999998,"15min":1.016},"min":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.165,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.008}]},{"osd":11,"last update":"Mon Dec 11 20:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.034},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.0720000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":472800,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65600000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91100000000000003,"5min":1.036,"15min":1.036},"last":0.873},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.81799999999999995,"15min":0.76300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.069,"5min":8.1080000000000005,"15min":8.1080000000000005},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88900000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.86599999999999999,"15min":0.98999999999999999},"min":{"1min":0.55800000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0209999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94599999999999995,"15min":1.083},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.137,"5min":6.9489999999999998,"15min":6.9489999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97099999999999997,"5min":1.167,"15min":1.167},"last":0.93400000000000005}]},{"osd":5,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.63800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1120000000000001,"5min":1.226,"15min":1.226},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Dec 11 20:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.92600000000000005,"15min":0.84699999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0529999999999999,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.61199999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.228,"15min":1.228},"last":0.82099999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.153,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.90100000000000002,"15min":0.86599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":8.1289999999999996,"5min":8.1289999999999996,"15min":8.1289999999999996},"last":0.71299999999999997}]},{"osd":9,"last update":"Mon Dec 11 20:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.84699999999999998,"15min":0.89900000000000002},"min":{"1min":0.51400000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.88900000000000001,"5min":1.204,"15min":1.204},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.94999999999999996,"15min":0.999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.097,"5min":1.319,"15min":1.319},"last":0.97099999999999997}]},{"osd":10,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89600000000000002,"15min":0.90800000000000003},"min":{"1min":0.70699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1459999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.94499999999999995,"15min":0.97999999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0860000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":537320,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.99299999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68100000000000005,"15min":0.58599999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.83399999999999996,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.76100000000000001}]},{"osd":2,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.69699999999999995,"15min":0.60299999999999998},"min":{"1min":0.495,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.69199999999999995,"15min":0.60099999999999998},"min":{"1min":0.61799999999999999,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.89600000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:15:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79800000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72299999999999998,"15min":0.64300000000000002},"min":{"1min":0.55900000000000005,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.046,"5min":1.075,"15min":1.075},"last":0.85699999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.55700000000000005},"min":{"1min":0.47299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.018},{"interface":"front","average":{"1min":0.753,"5min":0.628,"15min":0.57799999999999996},"min":{"1min":0.54800000000000004,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":1.165}]},{"osd":5,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.80500000000000005,"15min":0.72299999999999998},"min":{"1min":0.73599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.81000000000000005,"15min":0.71799999999999997},"min":{"1min":0.56299999999999994,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.004}]},{"osd":6,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.80800000000000005,"15min":0.76800000000000002},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.53700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92400000000000004,"5min":1.081,"15min":1.081},"last":0.91500000000000004}]},{"osd":7,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":0.876,"15min":0.83699999999999997},"min":{"1min":0.76700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.60699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82099999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80200000000000005,"15min":0.77300000000000002},"min":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1459999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.90400000000000003,"15min":0.86399999999999999},"min":{"1min":0.71099999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.24,"15min":1.24},"last":1.1399999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.97899999999999998,"15min":0.95699999999999996},"min":{"1min":0.94299999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.2929999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0600000000000001,"5min":1.294,"15min":1.294},"last":1.0529999999999999}]},{"osd":10,"last update":"Mon Dec 11 20:15:33 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.86499999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2609999999999999,"5min":1.381,"15min":1.381},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.056,"15min":1.03},"min":{"1min":0.99399999999999999,"5min":0.746,"15min":0.746},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.214}]},{"osd":11,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.24},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.26}]}]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":474065,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 20:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65000000000000002,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.32800000000000001},"max":{"1min":1.512,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65600000000000003,"15min":0.58599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.64200000000000002}]},{"osd":2,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.63900000000000001,"15min":0.61499999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.70999999999999996,"15min":0.64400000000000002},"min":{"1min":0.61799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Mon Dec 11 20:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.60299999999999998}]},{"osd":4,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.72799999999999998,"15min":0.66300000000000003},"min":{"1min":0.59199999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.64300000000000002},"min":{"1min":0.52900000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.73,"5min":1.909,"15min":1.909},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.76700000000000002,"15min":0.72299999999999998},"min":{"1min":0.66200000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.53600000000000003}]},{"osd":6,"last update":"Mon Dec 11 20:14:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.84999999999999998}]},{"osd":7,"last update":"Mon Dec 11 20:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.93999999999999995}]},{"osd":8,"last update":"Mon Dec 11 20:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81999999999999995,"15min":0.82199999999999995},"min":{"1min":0.52000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97099999999999997,"5min":1.804,"15min":1.804},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.89700000000000002},"min":{"1min":0.64000000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.883,"15min":1.883},"last":0.89400000000000002}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82799999999999996,"15min":0.84599999999999997},"min":{"1min":0.51700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.55400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.74299999999999999}]},{"osd":10,"last update":"Mon Dec 11 20:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91200000000000003,"15min":0.93200000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.026,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.88700000000000001,"15min":0.90900000000000003},"min":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.98999999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.65400000000000003}]},{"osd":11,"last update":"Mon Dec 11 20:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90500000000000003,"15min":0.90100000000000002},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.88,"15min":0.874},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.80900000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":535378,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.53400000000000003},"min":{"1min":0.45100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.98799999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61099999999999999,"15min":0.54900000000000004},"min":{"1min":0.45900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.70099999999999996,"15min":0.63},"min":{"1min":0.55100000000000005,"5min":0.371,"15min":0.371},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.67500000000000004,"15min":0.63400000000000001},"min":{"1min":0.53100000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1180000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.61099999999999999}]},{"osd":3,"last update":"Mon Dec 11 20:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67500000000000004,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96599999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.63},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Dec 11 20:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.68700000000000006,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.68300000000000005,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.99399999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.95599999999999996}]},{"osd":6,"last update":"Mon Dec 11 20:14:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.67300000000000004},"min":{"1min":0.52200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.92200000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.80400000000000005,"15min":0.74399999999999999},"min":{"1min":0.61799999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1579999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.746}]},{"osd":7,"last update":"Mon Dec 11 20:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.101,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59799999999999998}]},{"osd":8,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80200000000000005,"15min":0.78400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98399999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.877,"15min":0.86499999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.85999999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":0.91500000000000004},"min":{"1min":0.67500000000000004,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.173,"5min":1.379,"15min":1.379},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2250000000000001,"5min":1.268,"15min":1.268},"last":0.88200000000000001}]},{"osd":10,"last update":"Mon Dec 11 20:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.97599999999999998,"15min":0.96699999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3069999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.91500000000000004}]},{"osd":11,"last update":"Mon Dec 11 20:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.0069999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":472786,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47799999999999998,"15min":0.42099999999999999},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.67100000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.627},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.52500000000000002,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":1.1519999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.46000000000000002}]},{"osd":1,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68600000000000005,"15min":0.629},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.749,"15min":0.66000000000000003},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.93999999999999995}]},{"osd":2,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72599999999999998,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.69399999999999995,"15min":0.65100000000000002},"min":{"1min":0.57199999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.58499999999999996}]},{"osd":4,"last update":"Mon Dec 11 20:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.752,"15min":0.66600000000000004},"min":{"1min":0.56499999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.76600000000000001,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.3969999999999998,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":0.83199999999999996}]},{"osd":5,"last update":"Mon Dec 11 20:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.71999999999999997,"15min":0.69699999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.81100000000000005,"15min":0.75600000000000001},"min":{"1min":0.53700000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.84899999999999998}]},{"osd":6,"last update":"Mon Dec 11 20:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Dec 11 20:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.79400000000000004},"min":{"1min":0.621,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.91000000000000003,"15min":0.86599999999999999},"min":{"1min":0.78600000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.91100000000000003}]},{"osd":8,"last update":"Mon Dec 11 20:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.85799999999999998}]},{"osd":9,"last update":"Mon Dec 11 20:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.95799999999999996,"15min":0.97099999999999997},"min":{"1min":0.53300000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.91300000000000003,"15min":0.91600000000000004},"min":{"1min":0.59799999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.69799999999999995}]},{"osd":10,"last update":"Mon Dec 11 20:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94299999999999995,"15min":0.96599999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1899999999999999,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.004,"5min":1.022,"15min":1.0249999999999999},"min":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.96199999999999997}]},{"osd":11,"last update":"Mon Dec 11 20:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.76800000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":474259,"data_compressed":11704,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.57999999999999996,"15min":0.53900000000000003},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.496}]},{"osd":1,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.377,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70899999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.42299999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.49299999999999999}]},{"osd":2,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.75800000000000001,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 11 20:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66100000000000003,"15min":0.625},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94199999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.63500000000000001,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.7080000000000002,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.79400000000000004,"15min":0.72199999999999998},"min":{"1min":0.67600000000000005,"5min":0.441,"15min":0.441},"max":{"1min":1.075,"5min":1.177,"15min":1.177},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.65200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.026,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Mon Dec 11 20:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.81100000000000005,"15min":0.77500000000000002},"min":{"1min":0.65900000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Dec 11 20:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.204,"5min":1.407,"15min":1.407},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.73399999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0469999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.96099999999999997}]},{"osd":8,"last update":"Mon Dec 11 20:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.66200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.876,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91500000000000004,"15min":0.89300000000000002},"min":{"1min":0.77800000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1559999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0349999999999999}]},{"osd":9,"last update":"Mon Dec 11 20:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.90000000000000002,"15min":0.878},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.26,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.997},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.91700000000000004,"15min":0.89000000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.282,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.97899999999999998}]},{"osd":10,"last update":"Mon Dec 11 20:15:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.96799999999999997,"15min":0.94999999999999996},"min":{"1min":0.755,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.234,"5min":1.333,"15min":1.333},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.78200000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97299999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.92600000000000005}]},{"osd":11,"last update":"Mon Dec 11 20:14:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.054},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0700000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":1065128,"data_compressed":48250,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61699999999999999,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64700000000000002,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95499999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.56000000000000005}]},{"osd":1,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.69499999999999995,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0529999999999999,"5min":1.101,"15min":1.101},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94399999999999995,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81399999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.57399999999999995,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94799999999999995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.69499999999999995,"15min":0.628},"min":{"1min":0.502,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.054,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.499},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67500000000000004,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1240000000000001,"5min":1.127,"15min":1.127},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Dec 11 20:15:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.76800000000000002,"15min":0.71999999999999997},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1519999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.78100000000000003,"15min":0.70899999999999996},"min":{"1min":0.55800000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2210000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Mon Dec 11 20:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.76900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0369999999999999,"5min":6.5039999999999996,"15min":6.5039999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78000000000000003,"15min":0.75700000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Dec 11 20:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.83099999999999996,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1399999999999999,"5min":1.216,"15min":1.216},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.84999999999999998,"15min":0.79600000000000004},"min":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.141,"5min":2.992,"15min":2.992},"last":0.92500000000000004}]},{"osd":8,"last update":"Mon Dec 11 20:14:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77300000000000002,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0309999999999999,"5min":1.589,"15min":1.589},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.85499999999999998,"15min":0.82699999999999996},"min":{"1min":0.72299999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.27,"5min":1.403,"15min":1.403},"last":0.68500000000000005}]},{"osd":9,"last update":"Mon Dec 11 20:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.93999999999999995,"15min":0.93700000000000006},"min":{"1min":0.752,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.272,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.63200000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.66200000000000003}]},{"osd":10,"last update":"Mon Dec 11 20:15:32 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.99199999999999999,"15min":0.98699999999999999},"min":{"1min":0.77700000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.254,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.94099999999999995,"15min":0.92800000000000005},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.874}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34906,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36546,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T20:15:41.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.475+0000 7fca699ff700 1 -- 172.21.15.12:0/1429918571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca64103040 msgr2=0x7fca641098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.475+0000 7fca699ff700 1 --2- 172.21.15.12:0/1429918571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca64103040 0x7fca641098f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00b0d0 tx=0x7fca5c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.475+0000 7fca699ff700 1 -- 172.21.15.12:0/1429918571 shutdown_connections 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.475+0000 7fca699ff700 1 --2- 172.21.15.12:0/1429918571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca641014b0 0x7fca641018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.475+0000 7fca699ff700 1 --2- 172.21.15.12:0/1429918571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca64103040 0x7fca641098f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.475+0000 7fca699ff700 1 --2- 172.21.15.12:0/1429918571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca641026a0 0x7fca64102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.475+0000 7fca699ff700 1 -- 172.21.15.12:0/1429918571 >> 172.21.15.12:0/1429918571 conn(0x7fca640fca40 msgr2=0x7fca640fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.475+0000 7fca699ff700 1 -- 172.21.15.12:0/1429918571 shutdown_connections 2023-12-11T20:15:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.476+0000 7fca699ff700 1 -- 172.21.15.12:0/1429918571 wait complete. 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.476+0000 7fca699ff700 1 Processor -- start 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca699ff700 1 -- start start 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca699ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca641014b0 0x7fca64075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca699ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca641026a0 0x7fca640739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca699ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca64103040 0x7fca64073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca699ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640746a0 con 0x7fca641026a0 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca699ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca64074810 con 0x7fca64103040 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca699ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca641a14b0 con 0x7fca641014b0 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca627fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca641026a0 0x7fca640739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca627fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca641026a0 0x7fca640739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33100/0 (socket says 172.21.15.12:33100) 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca627fc700 1 -- 172.21.15.12:0/41842781 learned_addr learned my addr 172.21.15.12:0/41842781 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.477+0000 7fca637fe700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca64103040 0x7fca64073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca62ffd700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca641014b0 0x7fca64075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca627fc700 1 -- 172.21.15.12:0/41842781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca641014b0 msgr2=0x7fca64075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca627fc700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca641014b0 0x7fca64075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca627fc700 1 -- 172.21.15.12:0/41842781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca64103040 msgr2=0x7fca64073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca627fc700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca64103040 0x7fca64073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca627fc700 1 -- 172.21.15.12:0/41842781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c009d00 con 0x7fca641026a0 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca627fc700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca641026a0 0x7fca640739c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca5800d950 tx=0x7fca5800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca689fd700 1 -- 172.21.15.12:0/41842781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800f890 con 0x7fca641026a0 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca689fd700 1 -- 172.21.15.12:0/41842781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5800fe80 con 0x7fca641026a0 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca641a1740 con 0x7fca641026a0 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.478+0000 7fca689fd700 1 -- 172.21.15.12:0/41842781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58019360 con 0x7fca641026a0 2023-12-11T20:15:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.479+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca641a1ca0 con 0x7fca641026a0 2023-12-11T20:15:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.480+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca641088e0 con 0x7fca641026a0 2023-12-11T20:15:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.481+0000 7fca689fd700 1 -- 172.21.15.12:0/41842781 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fca58010460 con 0x7fca641026a0 2023-12-11T20:15:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.483+0000 7fca689fd700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fca4c0a1500 0x7fca4c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.483+0000 7fca689fd700 1 -- 172.21.15.12:0/41842781 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fca580cca20 con 0x7fca641026a0 2023-12-11T20:15:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.483+0000 7fca62ffd700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fca4c0a1500 0x7fca4c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.484+0000 7fca62ffd700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fca4c0a1500 0x7fca4c0a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca64102500 tx=0x7fca54007400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.487+0000 7fca689fd700 1 -- 172.21.15.12:0/41842781 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fca58095fd0 con 0x7fca641026a0 2023-12-11T20:15:41.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:41 smithi012 ceph-mon[128787]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:41.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:41 smithi012 ceph-mon[128787]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:41.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:41 smithi012 ceph-mon[128787]: pgmap v368: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1023 B/s wr, 5 op/s 2023-12-11T20:15:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.704+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca64068330 con 0x7fca641026a0 2023-12-11T20:15:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.705+0000 7fca689fd700 1 -- 172.21.15.12:0/41842781 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7fca58016090 con 0x7fca641026a0 2023-12-11T20:15:41.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:41.704 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:15:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fca4c0a1500 msgr2=0x7fca4c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fca4c0a1500 0x7fca4c0a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca64102500 tx=0x7fca54007400 comp rx=0 tx=0).stop 2023-12-11T20:15:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca641026a0 msgr2=0x7fca640739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca641026a0 0x7fca640739c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca5800d950 tx=0x7fca5800dc60 comp rx=0 tx=0).stop 2023-12-11T20:15:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 shutdown_connections 2023-12-11T20:15:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fca4c0a1500 0x7fca4c0a39c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca64103040 0x7fca64073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca641014b0 0x7fca64075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 --2- 172.21.15.12:0/41842781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca641026a0 0x7fca640739c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 >> 172.21.15.12:0/41842781 conn(0x7fca640fca40 msgr2=0x7fca64105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:41.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 shutdown_connections 2023-12-11T20:15:41.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.708+0000 7fca699ff700 1 -- 172.21.15.12:0/41842781 wait complete. 2023-12-11T20:15:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:41 smithi032 ceph-mon[132488]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:41 smithi032 ceph-mon[132488]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:41 smithi032 ceph-mon[132488]: pgmap v368: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1023 B/s wr, 5 op/s 2023-12-11T20:15:41.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:15:41.726 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:15:41.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:41 smithi039 ceph-mon[102205]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:41 smithi039 ceph-mon[102205]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:41 smithi039 ceph-mon[102205]: pgmap v368: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1023 B/s wr, 5 op/s 2023-12-11T20:15:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 -- 172.21.15.12:0/3059817833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041014b0 msgr2=0x7f81041018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 --2- 172.21.15.12:0/3059817833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041014b0 0x7f81041018d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f80f80099c0 tx=0x7f80f8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 -- 172.21.15.12:0/3059817833 shutdown_connections 2023-12-11T20:15:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 --2- 172.21.15.12:0/3059817833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8104103040 0x7f81041098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 --2- 172.21.15.12:0/3059817833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041014b0 0x7f81041018d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 --2- 172.21.15.12:0/3059817833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81041026a0 0x7f8104102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 -- 172.21.15.12:0/3059817833 >> 172.21.15.12:0/3059817833 conn(0x7f81040fca00 msgr2=0x7f81040fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 -- 172.21.15.12:0/3059817833 shutdown_connections 2023-12-11T20:15:41.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.936+0000 7f810b1ff700 1 -- 172.21.15.12:0/3059817833 wait complete. 2023-12-11T20:15:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.937+0000 7f810b1ff700 1 Processor -- start 2023-12-11T20:15:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.937+0000 7f810b1ff700 1 -- start start 2023-12-11T20:15:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f810b1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81041014b0 0x7f81040752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f810b1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041026a0 0x7f81040739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f810b1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8104103040 0x7f8104073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f810b1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8104074600 con 0x7f81041026a0 2023-12-11T20:15:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f810b1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8104074770 con 0x7f81041014b0 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f810b1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81041a1490 con 0x7f8104103040 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8103fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041026a0 0x7f81040739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8108f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81041014b0 0x7f81040752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8103fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041026a0 0x7f81040739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33126/0 (socket says 172.21.15.12:33126) 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8103fff700 1 -- 172.21.15.12:0/2781544104 learned_addr learned my addr 172.21.15.12:0/2781544104 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f810979c700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8104103040 0x7f8104073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8103fff700 1 -- 172.21.15.12:0/2781544104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8104103040 msgr2=0x7f8104073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8103fff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8104103040 0x7f8104073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8103fff700 1 -- 172.21.15.12:0/2781544104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81041014b0 msgr2=0x7f81040752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8103fff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81041014b0 0x7f81040752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.938+0000 7f8103fff700 1 -- 172.21.15.12:0/2781544104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80095f0 con 0x7f81041026a0 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.939+0000 7f8103fff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041026a0 0x7f81040739c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f80f000e9a0 tx=0x7f80f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.939+0000 7f8101ffb700 1 -- 172.21.15.12:0/2781544104 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0009790 con 0x7f81041026a0 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.939+0000 7f8101ffb700 1 -- 172.21.15.12:0/2781544104 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f80f0010430 con 0x7f81041026a0 2023-12-11T20:15:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.939+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81041a16f0 con 0x7f81041026a0 2023-12-11T20:15:41.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.939+0000 7f8101ffb700 1 -- 172.21.15.12:0/2781544104 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000cea0 con 0x7f81041026a0 2023-12-11T20:15:41.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.939+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81041a1c50 con 0x7f81041026a0 2023-12-11T20:15:41.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.940+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8104108a20 con 0x7f81041026a0 2023-12-11T20:15:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.942+0000 7f8101ffb700 1 -- 172.21.15.12:0/2781544104 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f80f00105a0 con 0x7f81041026a0 2023-12-11T20:15:41.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.944+0000 7f8101ffb700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80f40a1500 0x7f80f40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:41.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.944+0000 7f8101ffb700 1 -- 172.21.15.12:0/2781544104 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f80f0014070 con 0x7f81041026a0 2023-12-11T20:15:41.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.944+0000 7f8108f9b700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80f40a1500 0x7f80f40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:41.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.945+0000 7f8108f9b700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80f40a1500 0x7f80f40a39c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009990 tx=0x7f80f8003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:41.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:41.948+0000 7f8101ffb700 1 -- 172.21.15.12:0/2781544104 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f80f00d2020 con 0x7f81041026a0 2023-12-11T20:15:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.160+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f810402d310 con 0x7f81041026a0 2023-12-11T20:15:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.160+0000 7f8101ffb700 1 -- 172.21.15.12:0/2781544104 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80f0096480 con 0x7f81041026a0 2023-12-11T20:15:42.158 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80f40a1500 msgr2=0x7f80f40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80f40a1500 0x7f80f40a39c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009990 tx=0x7f80f8003680 comp rx=0 tx=0).stop 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041026a0 msgr2=0x7f81040739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041026a0 0x7f81040739c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f80f000e9a0 tx=0x7f80f000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 shutdown_connections 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80f40a1500 0x7f80f40a39c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81041014b0 0x7f81040752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8104103040 0x7f8104073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 --2- 172.21.15.12:0/2781544104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81041026a0 0x7f81040739c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 >> 172.21.15.12:0/2781544104 conn(0x7f81040fca00 msgr2=0x7f8104105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 shutdown_connections 2023-12-11T20:15:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.163+0000 7f810b1ff700 1 -- 172.21.15.12:0/2781544104 wait complete. 2023-12-11T20:15:42.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:15:42.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 -- 172.21.15.12:0/2215059552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe474103040 msgr2=0x7fe4741098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2215059552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe474103040 0x7fe4741098f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00b0d0 tx=0x7fe46c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 -- 172.21.15.12:0/2215059552 shutdown_connections 2023-12-11T20:15:42.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2215059552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe474103040 0x7fe4741098f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2215059552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4741014b0 0x7fe4741018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2215059552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4741026a0 0x7fe474102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 -- 172.21.15.12:0/2215059552 >> 172.21.15.12:0/2215059552 conn(0x7fe4740fca00 msgr2=0x7fe4740fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:42.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 -- 172.21.15.12:0/2215059552 shutdown_connections 2023-12-11T20:15:42.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.392+0000 7fe47bfff700 1 -- 172.21.15.12:0/2215059552 wait complete. 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.393+0000 7fe47bfff700 1 Processor -- start 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.393+0000 7fe47bfff700 1 -- start start 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.393+0000 7fe47bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4741014b0 0x7fe4740752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.393+0000 7fe47bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4741026a0 0x7fe4740739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.393+0000 7fe47bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe474103040 0x7fe474073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.393+0000 7fe47bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474074600 con 0x7fe4741014b0 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.393+0000 7fe47bfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474074770 con 0x7fe474103040 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.393+0000 7fe47bfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4741a14c0 con 0x7fe4741026a0 2023-12-11T20:15:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4741014b0 0x7fe4740752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4741014b0 0x7fe4740752e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33144/0 (socket says 172.21.15.12:33144) 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 -- 172.21.15.12:0/2535982140 learned_addr learned my addr 172.21.15.12:0/2535982140 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe47a59c700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe474103040 0x7fe474073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 -- 172.21.15.12:0/2535982140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4741026a0 msgr2=0x7fe4740739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4741026a0 0x7fe4740739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 -- 172.21.15.12:0/2535982140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe474103040 msgr2=0x7fe474073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe474103040 0x7fe474073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 -- 172.21.15.12:0/2535982140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009d00 con 0x7fe4741014b0 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe47a59c700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe474103040 0x7fe474073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe479d9b700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4741014b0 0x7fe4740752e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe47000e970 tx=0x7fe47000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe46affd700 1 -- 172.21.15.12:0/2535982140 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470009790 con 0x7fe4741014b0 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe46affd700 1 -- 172.21.15.12:0/2535982140 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4700044b0 con 0x7fe4741014b0 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.394+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4741a1720 con 0x7fe4741014b0 2023-12-11T20:15:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.395+0000 7fe46affd700 1 -- 172.21.15.12:0/2535982140 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470003dd0 con 0x7fe4741014b0 2023-12-11T20:15:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.395+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4741a1c30 con 0x7fe4741014b0 2023-12-11T20:15:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.396+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe474108980 con 0x7fe4741014b0 2023-12-11T20:15:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.398+0000 7fe46affd700 1 -- 172.21.15.12:0/2535982140 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe470004000 con 0x7fe4741014b0 2023-12-11T20:15:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.399+0000 7fe46affd700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4600a1500 0x7fe4600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.399+0000 7fe46affd700 1 -- 172.21.15.12:0/2535982140 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe470014070 con 0x7fe4741014b0 2023-12-11T20:15:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.399+0000 7fe47959a700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4600a1500 0x7fe4600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.400+0000 7fe47959a700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4600a1500 0x7fe4600a39c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe464005950 tx=0x7fe4640058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:42.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.403+0000 7fe46affd700 1 -- 172.21.15.12:0/2535982140 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe4700965f0 con 0x7fe4741014b0 2023-12-11T20:15:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:42 smithi012 ceph-mon[128787]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:42 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/41842781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:42 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2781544104' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.616+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe47402d3b0 con 0x7fe4741014b0 2023-12-11T20:15:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.617+0000 7fe46affd700 1 -- 172.21.15.12:0/2535982140 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe470099c10 con 0x7fe4741014b0 2023-12-11T20:15:42.615 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:15:42.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4600a1500 msgr2=0x7fe4600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4600a1500 0x7fe4600a39c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe464005950 tx=0x7fe4640058e0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4741014b0 msgr2=0x7fe4740752e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4741014b0 0x7fe4740752e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe47000e970 tx=0x7fe47000ed30 comp rx=0 tx=0).stop 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 shutdown_connections 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4600a1500 0x7fe4600a39c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe474103040 0x7fe474073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4741014b0 0x7fe4740752e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 --2- 172.21.15.12:0/2535982140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4741026a0 0x7fe4740739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 >> 172.21.15.12:0/2535982140 conn(0x7fe4740fca00 msgr2=0x7fe474105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 shutdown_connections 2023-12-11T20:15:42.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.619+0000 7fe47bfff700 1 -- 172.21.15.12:0/2535982140 wait complete. 2023-12-11T20:15:42.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:15:42.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:42 smithi032 ceph-mon[132488]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:42.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:42 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/41842781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:42.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:42 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2781544104' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:42.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:42 smithi039 ceph-mon[102205]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-11T20:15:42.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:42 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/41842781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:42.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:42 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2781544104' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.845+0000 7f9fd0dff700 1 -- 172.21.15.12:0/973365035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 msgr2=0x7f9fcc1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.845+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/973365035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 0x7f9fcc1098f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400b0d0 tx=0x7f9fc400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.846+0000 7f9fd0dff700 1 -- 172.21.15.12:0/973365035 shutdown_connections 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.846+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/973365035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 0x7f9fcc1098f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.846+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/973365035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fcc1014b0 0x7f9fcc1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.846+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/973365035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fcc1026a0 0x7f9fcc102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.846+0000 7f9fd0dff700 1 -- 172.21.15.12:0/973365035 >> 172.21.15.12:0/973365035 conn(0x7f9fcc0fca00 msgr2=0x7f9fcc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.846+0000 7f9fd0dff700 1 -- 172.21.15.12:0/973365035 shutdown_connections 2023-12-11T20:15:42.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.846+0000 7f9fd0dff700 1 -- 172.21.15.12:0/973365035 wait complete. 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.847+0000 7f9fd0dff700 1 Processor -- start 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.847+0000 7f9fd0dff700 1 -- start start 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.847+0000 7f9fd0dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fcc1014b0 0x7f9fcc199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.847+0000 7f9fd0dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fcc1026a0 0x7f9fcc199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.847+0000 7f9fd0dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 0x7f9fcc1a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.847+0000 7f9fd0dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1a1140 con 0x7f9fcc103040 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.847+0000 7f9fd0dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1a1280 con 0x7f9fcc1014b0 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.847+0000 7f9fd0dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1a1410 con 0x7f9fcc1026a0 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 0x7f9fcc1a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 0x7f9fcc1a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33164/0 (socket says 172.21.15.12:33164) 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 -- 172.21.15.12:0/657302417 learned_addr learned my addr 172.21.15.12:0/657302417 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fca59c700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fcc1014b0 0x7f9fcc199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fc9d9b700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fcc1026a0 0x7f9fcc199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 -- 172.21.15.12:0/657302417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fcc1026a0 msgr2=0x7f9fcc199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fcc1026a0 0x7f9fcc199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 -- 172.21.15.12:0/657302417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fcc1014b0 msgr2=0x7f9fcc199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fcc1014b0 0x7f9fcc199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 -- 172.21.15.12:0/657302417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc4009d00 con 0x7f9fcc103040 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fc9d9b700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fcc1026a0 0x7f9fcc199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.848+0000 7f9fcad9d700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 0x7f9fcc1a0b70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40079c0 tx=0x7f9fc400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.849+0000 7f9fbb7fe700 1 -- 172.21.15.12:0/657302417 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400e040 con 0x7f9fcc103040 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.849+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc1a1690 con 0x7f9fcc103040 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.849+0000 7f9fbb7fe700 1 -- 172.21.15.12:0/657302417 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9fc4004e60 con 0x7f9fcc103040 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.849+0000 7f9fbb7fe700 1 -- 172.21.15.12:0/657302417 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc401b6b0 con 0x7f9fcc103040 2023-12-11T20:15:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.849+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc1a1b60 con 0x7f9fcc103040 2023-12-11T20:15:42.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.850+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc068330 con 0x7f9fcc103040 2023-12-11T20:15:42.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.852+0000 7f9fbb7fe700 1 -- 172.21.15.12:0/657302417 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9fc401d9a0 con 0x7f9fcc103040 2023-12-11T20:15:42.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.853+0000 7f9fbb7fe700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fb40a1500 0x7f9fb40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:42.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.853+0000 7f9fbb7fe700 1 -- 172.21.15.12:0/657302417 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9fc40cea30 con 0x7f9fcc103040 2023-12-11T20:15:42.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.854+0000 7f9fca59c700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fb40a1500 0x7f9fb40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:42.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.854+0000 7f9fca59c700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fb40a1500 0x7f9fb40a39c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc102500 tx=0x7f9fbc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:42.856+0000 7f9fbb7fe700 1 -- 172.21.15.12:0/657302417 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9fc4098070 con 0x7f9fcc103040 2023-12-11T20:15:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.071+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fcc10cd90 con 0x7f9fcc103040 2023-12-11T20:15:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.071+0000 7f9fbb7fe700 1 -- 172.21.15.12:0/657302417 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fc409b690 con 0x7f9fcc103040 2023-12-11T20:15:43.069 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:15:43.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fb40a1500 msgr2=0x7f9fb40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fb40a1500 0x7f9fb40a39c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc102500 tx=0x7f9fbc009260 comp rx=0 tx=0).stop 2023-12-11T20:15:43.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 msgr2=0x7f9fcc1a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 0x7f9fcc1a0b70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40079c0 tx=0x7f9fc400ccc0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 shutdown_connections 2023-12-11T20:15:43.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9fb40a1500 0x7f9fb40a39c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fcc1014b0 0x7f9fcc199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fcc103040 0x7f9fcc1a0b70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 --2- 172.21.15.12:0/657302417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fcc1026a0 0x7f9fcc199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 >> 172.21.15.12:0/657302417 conn(0x7f9fcc0fca00 msgr2=0x7f9fcc107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:43.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 shutdown_connections 2023-12-11T20:15:43.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.074+0000 7f9fd0dff700 1 -- 172.21.15.12:0/657302417 wait complete. 2023-12-11T20:15:43.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.296+0000 7f53e51ff700 1 -- 172.21.15.12:0/1047161042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0074030 msgr2=0x7f53e00744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.296+0000 7f53e51ff700 1 --2- 172.21.15.12:0/1047161042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0074030 0x7f53e00744b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009990 tx=0x7f53d4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.296+0000 7f53e51ff700 1 -- 172.21.15.12:0/1047161042 shutdown_connections 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.296+0000 7f53e51ff700 1 --2- 172.21.15.12:0/1047161042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53e0109360 0x7f53e010b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.296+0000 7f53e51ff700 1 --2- 172.21.15.12:0/1047161042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53e0075610 0x7f53e0073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.296+0000 7f53e51ff700 1 --2- 172.21.15.12:0/1047161042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0074030 0x7f53e00744b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.296+0000 7f53e51ff700 1 -- 172.21.15.12:0/1047161042 >> 172.21.15.12:0/1047161042 conn(0x7f53e00fca10 msgr2=0x7f53e00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.297+0000 7f53e51ff700 1 -- 172.21.15.12:0/1047161042 shutdown_connections 2023-12-11T20:15:43.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.297+0000 7f53e51ff700 1 -- 172.21.15.12:0/1047161042 wait complete. 2023-12-11T20:15:43.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.298+0000 7f53e51ff700 1 Processor -- start 2023-12-11T20:15:43.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.298+0000 7f53e51ff700 1 -- start start 2023-12-11T20:15:43.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53e51ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53e0074030 0x7f53e0199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:43.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53e51ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53e0075610 0x7f53e0199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:43.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53e51ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0109360 0x7f53e01a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:43.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53e51ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01a1020 con 0x7f53e0109360 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53e51ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01a1160 con 0x7f53e0075610 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53e51ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01a12f0 con 0x7f53e0074030 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53df59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0109360 0x7f53e01a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53df59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0109360 0x7f53e01a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33174/0 (socket says 172.21.15.12:33174) 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53df59e700 1 -- 172.21.15.12:0/2713733771 learned_addr learned my addr 172.21.15.12:0/2713733771 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53ded9d700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53e0074030 0x7f53e0199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53de59c700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53e0075610 0x7f53e0199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53df59e700 1 -- 172.21.15.12:0/2713733771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53e0074030 msgr2=0x7f53e0199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53df59e700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53e0074030 0x7f53e0199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53df59e700 1 -- 172.21.15.12:0/2713733771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53e0075610 msgr2=0x7f53e0199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53df59e700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53e0075610 0x7f53e0199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53df59e700 1 -- 172.21.15.12:0/2713733771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40095f0 con 0x7f53e0109360 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.299+0000 7f53de59c700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53e0075610 0x7f53e0199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:43.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.300+0000 7f53df59e700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0109360 0x7f53e01a0a50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f53d800ef30 tx=0x7f53d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:43.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.300+0000 7f53c7fff700 1 -- 172.21.15.12:0/2713733771 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8018070 con 0x7f53e0109360 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.300+0000 7f53c7fff700 1 -- 172.21.15.12:0/2713733771 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53d800f040 con 0x7f53e0109360 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.300+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e01a1570 con 0x7f53e0109360 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.300+0000 7f53c7fff700 1 -- 172.21.15.12:0/2713733771 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d800cc70 con 0x7f53e0109360 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.300+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e01a1a30 con 0x7f53e0109360 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.301+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e0108120 con 0x7f53e0109360 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.303+0000 7f53c7fff700 1 -- 172.21.15.12:0/2713733771 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f53d8007500 con 0x7f53e0109360 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.304+0000 7f53c7fff700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53c80a1480 0x7f53c80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.305+0000 7f53c7fff700 1 -- 172.21.15.12:0/2713733771 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f53d80cc920 con 0x7f53e0109360 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.305+0000 7f53ded9d700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53c80a1480 0x7f53c80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.305+0000 7f53ded9d700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53c80a1480 0x7f53c80a3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f53d000ac50 tx=0x7f53d000a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:43.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.309+0000 7f53c7fff700 1 -- 172.21.15.12:0/2713733771 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f53d8095f60 con 0x7f53e0109360 2023-12-11T20:15:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.569+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53e0068330 con 0x7f53e0109360 2023-12-11T20:15:43.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.570+0000 7f53c7fff700 1 -- 172.21.15.12:0/2713733771 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f53d8099580 con 0x7f53e0109360 2023-12-11T20:15:43.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:43.568 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53c80a1480 msgr2=0x7f53c80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53c80a1480 0x7f53c80a3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f53d000ac50 tx=0x7f53d000a380 comp rx=0 tx=0).stop 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0109360 msgr2=0x7f53e01a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0109360 0x7f53e01a0a50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f53d800ef30 tx=0x7f53d800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 shutdown_connections 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53c80a1480 0x7f53c80a3940 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53e0109360 0x7f53e01a0a50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53e0074030 0x7f53e0199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 --2- 172.21.15.12:0/2713733771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53e0075610 0x7f53e0199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 >> 172.21.15.12:0/2713733771 conn(0x7f53e00fca10 msgr2=0x7f53e0105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 shutdown_connections 2023-12-11T20:15:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.573+0000 7f53e51ff700 1 -- 172.21.15.12:0/2713733771 wait complete. 2023-12-11T20:15:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:15:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:43 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2535982140' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:43 smithi012 ceph-mon[128787]: pgmap v369: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2023-12-11T20:15:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:43 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/657302417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:43.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:15:43.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:43 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2535982140' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:43 smithi032 ceph-mon[132488]: pgmap v369: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2023-12-11T20:15:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:43 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/657302417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:43.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 -- 172.21.15.12:0/2981694510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 msgr2=0x7ff95c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 --2- 172.21.15.12:0/2981694510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 0x7ff95c1098e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff9540099c0 tx=0x7ff954009cd0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 -- 172.21.15.12:0/2981694510 shutdown_connections 2023-12-11T20:15:43.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 --2- 172.21.15.12:0/2981694510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95c1014a0 0x7ff95c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 --2- 172.21.15.12:0/2981694510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 0x7ff95c1098e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 --2- 172.21.15.12:0/2981694510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102690 0x7ff95c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 -- 172.21.15.12:0/2981694510 >> 172.21.15.12:0/2981694510 conn(0x7ff95c0fca10 msgr2=0x7ff95c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 -- 172.21.15.12:0/2981694510 shutdown_connections 2023-12-11T20:15:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.797+0000 7ff9639ff700 1 -- 172.21.15.12:0/2981694510 wait complete. 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.798+0000 7ff9639ff700 1 Processor -- start 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.798+0000 7ff9639ff700 1 -- start start 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.798+0000 7ff9639ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95c1014a0 0x7ff95c1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.798+0000 7ff9639ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102690 0x7ff95c199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.798+0000 7ff9639ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 0x7ff95c1a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.798+0000 7ff9639ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c1a1000 con 0x7ff95c103030 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.798+0000 7ff9639ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c1a1140 con 0x7ff95c1014a0 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.798+0000 7ff9639ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c1a12d0 con 0x7ff95c102690 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 0x7ff95c1a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 0x7ff95c1a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33192/0 (socket says 172.21.15.12:33192) 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 -- 172.21.15.12:0/1345343675 learned_addr learned my addr 172.21.15.12:0/1345343675 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff96179b700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95c1014a0 0x7ff95c1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff960f9a700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102690 0x7ff95c199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 -- 172.21.15.12:0/1345343675 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102690 msgr2=0x7ff95c199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102690 0x7ff95c199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 -- 172.21.15.12:0/1345343675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95c1014a0 msgr2=0x7ff95c1994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95c1014a0 0x7ff95c1994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 -- 172.21.15.12:0/1345343675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540095f0 con 0x7ff95c103030 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.799+0000 7ff961f9c700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 0x7ff95c1a0a30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff954009990 tx=0x7ff954003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.800+0000 7ff9527fc700 1 -- 172.21.15.12:0/1345343675 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95401d070 con 0x7ff95c103030 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.800+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95c1a1550 con 0x7ff95c103030 2023-12-11T20:15:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.800+0000 7ff9527fc700 1 -- 172.21.15.12:0/1345343675 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff95400bd50 con 0x7ff95c103030 2023-12-11T20:15:43.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.800+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95c1a19d0 con 0x7ff95c103030 2023-12-11T20:15:43.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.800+0000 7ff9527fc700 1 -- 172.21.15.12:0/1345343675 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954022d00 con 0x7ff95c103030 2023-12-11T20:15:43.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.801+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95c068330 con 0x7ff95c103030 2023-12-11T20:15:43.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.803+0000 7ff9527fc700 1 -- 172.21.15.12:0/1345343675 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff954022500 con 0x7ff95c103030 2023-12-11T20:15:43.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:43 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2535982140' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:15:43.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:43 smithi039 ceph-mon[102205]: pgmap v369: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2023-12-11T20:15:43.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:43 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/657302417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:15:43.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.804+0000 7ff9527fc700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9480a1480 0x7ff9480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:43.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.804+0000 7ff9527fc700 1 -- 172.21.15.12:0/1345343675 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff9540ce4e0 con 0x7ff95c103030 2023-12-11T20:15:43.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.804+0000 7ff96179b700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9480a1480 0x7ff9480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:43.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.805+0000 7ff96179b700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9480a1480 0x7ff9480a3940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff958009550 tx=0x7ff9580091b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:43.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:43.806+0000 7ff9527fc700 1 -- 172.21.15.12:0/1345343675 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff954097b20 con 0x7ff95c103030 2023-12-11T20:15:44.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.019+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff95c10cbb0 con 0x7ff95c103030 2023-12-11T20:15:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.021+0000 7ff9527fc700 1 -- 172.21.15.12:0/1345343675 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7ff954022e60 con 0x7ff95c103030 2023-12-11T20:15:44.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:15:44.022 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9480a1480 msgr2=0x7ff9480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9480a1480 0x7ff9480a3940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff958009550 tx=0x7ff9580091b0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 msgr2=0x7ff95c1a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 0x7ff95c1a0a30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff954009990 tx=0x7ff954003a50 comp rx=0 tx=0).stop 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 shutdown_connections 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9480a1480 0x7ff9480a3940 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95c1014a0 0x7ff95c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c103030 0x7ff95c1a0a30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 --2- 172.21.15.12:0/1345343675 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102690 0x7ff95c199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 >> 172.21.15.12:0/1345343675 conn(0x7ff95c0fca10 msgr2=0x7ff95c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 shutdown_connections 2023-12-11T20:15:44.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.024+0000 7ff9639ff700 1 -- 172.21.15.12:0/1345343675 wait complete. 2023-12-11T20:15:44.041 DEBUG:tasks.fwd_scrub:Yielding 2023-12-11T20:15:44.041 INFO:teuthology.run_tasks:Running task background_exec... 2023-12-11T20:15:44.051 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2023-12-11T20:15:44.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-12-11T20:15:44.052 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-12-11T20:15:44.052 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:15:44.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:15:44.056 INFO:teuthology.run_tasks:Running task workunit... 2023-12-11T20:15:44.218 INFO:tasks.workunit:Pulling workunits from ref a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:15:44.218 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-11T20:15:44.218 INFO:tasks.workunit:timeout=3h 2023-12-11T20:15:44.218 INFO:tasks.workunit:cleanup=True 2023-12-11T20:15:44.218 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:44.265 INFO:teuthology.orchestra.run.smithi012.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:44.266 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-11T20:15:44.266 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 79h/121d Inode: 1 Links: 2 2023-12-11T20:15:44.266 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T20:15:44.266 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:fusefs_t:s0 2023-12-11T20:15:44.266 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-12-11 20:13:58.770416027 +0000 2023-12-11T20:15:44.266 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-12-11 20:13:58.770416027 +0000 2023-12-11T20:15:44.266 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-12-11 20:15:35.591191180 +0000 2023-12-11T20:15:44.266 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-12-11T20:15:44.267 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-11T20:15:44.267 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-11T20:15:44.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/2720717495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 msgr2=0x7f1a881098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/2720717495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 0x7f1a881098e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000b0d0 tx=0x7f1a8000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/2720717495 shutdown_connections 2023-12-11T20:15:44.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/2720717495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 0x7f1a881098e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/2720717495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a881014a0 0x7f1a881018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/2720717495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a88102690 0x7f1a88102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/2720717495 >> 172.21.15.12:0/2720717495 conn(0x7f1a880fca30 msgr2=0x7f1a880fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/2720717495 shutdown_connections 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.268+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/2720717495 wait complete. 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.269+0000 7f1a8f5ff700 1 Processor -- start 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.269+0000 7f1a8f5ff700 1 -- start start 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.269+0000 7f1a8f5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a881014a0 0x7f1a88075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.269+0000 7f1a8f5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a88102690 0x7f1a880739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.269+0000 7f1a8f5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 0x7f1a88073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.269+0000 7f1a8f5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8819b300 con 0x7f1a88103030 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.269+0000 7f1a8f5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88074440 con 0x7f1a88102690 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.269+0000 7f1a8f5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88074600 con 0x7f1a881014a0 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8cb9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a88102690 0x7f1a880739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 0x7f1a88073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8cb9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a88102690 0x7f1a880739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40856/0 (socket says 172.21.15.12:40856) 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/1953924331 learned_addr learned my addr 172.21.15.12:0/1953924331 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8d39b700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a881014a0 0x7f1a88075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/1953924331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a881014a0 msgr2=0x7f1a88075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a881014a0 0x7f1a88075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 msgr2=0x7f1a88073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 0x7f1a88073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/1953924331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80009d00 con 0x7f1a88102690 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.270+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 0x7f1a88073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.271+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a88102690 0x7f1a880739c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800e9a0 tx=0x7f1a7800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.271+0000 7f1a7e7fc700 1 -- 172.21.15.12:0/1953924331 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78009790 con 0x7f1a88102690 2023-12-11T20:15:44.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.271+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/1953924331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a881a5cb0 con 0x7f1a88102690 2023-12-11T20:15:44.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.271+0000 7f1a7e7fc700 1 -- 172.21.15.12:0/1953924331 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a78010430 con 0x7f1a88102690 2023-12-11T20:15:44.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.271+0000 7f1a7e7fc700 1 -- 172.21.15.12:0/1953924331 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800cea0 con 0x7f1a88102690 2023-12-11T20:15:44.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.271+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/1953924331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a881a6080 con 0x7f1a88102690 2023-12-11T20:15:44.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.274+0000 7f1a7e7fc700 1 -- 172.21.15.12:0/1953924331 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1a780105a0 con 0x7f1a88102690 2023-12-11T20:15:44.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.275+0000 7f1aa2fecb80 1 Processor -- start 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1aa2fecb80 1 -- start start 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3450 0x561fceba3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3db0 0x561fceba46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceba5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fceafebd0 con 0x561fceba3450 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fceafc4f0 con 0x561fceba4ca0 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fceaf7de0 con 0x561fceba3db0 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1a8db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3450 0x561fceba3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.276+0000 7f1a8db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3450 0x561fceba3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33214/0 (socket says 172.21.15.12:33214) 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8db9c700 1 -- 172.21.15.12:0/2636476085 learned_addr learned my addr 172.21.15.12:0/2636476085 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceba5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8d39b700 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3db0 0x561fceba46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8db9c700 1 -- 172.21.15.12:0/2636476085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3db0 msgr2=0x561fceba46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3db0 0x561fceba46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8db9c700 1 -- 172.21.15.12:0/2636476085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 msgr2=0x561fceba5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a7e7fc700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a740a1480 0x7f1a740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceba5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8db9c700 1 -- 172.21.15.12:0/2636476085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fce9746b0 con 0x561fceba3450 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceba5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a7e7fc700 1 -- 172.21.15.12:0/1953924331 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1a78014070 con 0x7f1a88102690 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.277+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a740a1480 0x7f1a740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.278+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3450 0x561fceba3870 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1a80015000 tx=0x7f1a80008ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982a13678419fa0b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.278+0000 7f1a737fe700 1 -- 172.21.15.12:0/2636476085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8000e040 con 0x561fceba3450 2023-12-11T20:15:44.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.278+0000 7f1a737fe700 1 -- 172.21.15.12:0/2636476085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a8000be80 con 0x561fceba3450 2023-12-11T20:15:44.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.278+0000 7f1a737fe700 1 -- 172.21.15.12:0/2636476085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80005730 con 0x561fceba3450 2023-12-11T20:15:44.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a740a1480 0x7f1a740a3940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a80029000 tx=0x7f1a8002c000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/2636476085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3450 msgr2=0x561fceba3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3450 0x561fceba3870 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1a80015000 tx=0x7f1a80008ff0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/2636476085 shutdown_connections 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceba5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3450 0x561fceba3870 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/2636476085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3db0 0x561fceba46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/2636476085 >> 172.21.15.12:0/2636476085 conn(0x561fcead2860 msgr2=0x561fceb9fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/2636476085 shutdown_connections 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.279+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/2636476085 wait complete. 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.280+0000 7f1aa2fecb80 1 -- start start 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.280+0000 7f1aa2fecb80 1 Processor -- start 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 0x561fcebad220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 0x561fcebb47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fceab15e0 con 0x561fceba3db0 2023-12-11T20:15:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fceab1280 con 0x561fceba3450 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fce9769a0 con 0x561fceba4ca0 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1aa2fecb80 10 client.0 _ll_register_callbacks cb 0x561fce9dcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33230/0 (socket says 172.21.15.12:33230) 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/1333763937 learned_addr learned my addr 172.21.15.12:0/1333763937 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8d39b700 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 0x561fcebad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 0x561fcebb47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/1333763937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 msgr2=0x561fcebb47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 0x561fcebb47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/1333763937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 msgr2=0x561fcebad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 0x561fcebad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.281+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/1333763937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8810a230 con 0x561fceba3db0 2023-12-11T20:15:44.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebad760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1a78099ed0 tx=0x7f1a7809a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b3e6f6fd33919a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1a70ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:44.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1a70ff9700 1 -- 172.21.15.12:0/1333763937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780a22d0 con 0x561fceba3db0 2023-12-11T20:15:44.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1a70ff9700 1 -- 172.21.15.12:0/1333763937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1a78010880 con 0x561fceba3db0 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/1333763937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fceb72fc0 con 0x561fceba3db0 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1a70ff9700 1 -- 172.21.15.12:0/1333763937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a7809e150 con 0x561fceba3db0 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1aa2fecb80 10 client.15465 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/1333763937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x561fce920e60 con 0x561fceba3db0 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.282+0000 7f1a70ff9700 1 -- 172.21.15.12:0/1333763937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561fceb72fc0 con 0x561fceba3db0 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.283+0000 7f1a70ff9700 1 -- 172.21.15.12:0/1333763937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1a78095fc0 con 0x561fceba3db0 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.283+0000 7f1aa2fecb80 10 client.15465 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.283+0000 7f1aa2fecb80 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.283+0000 7f1aa2fecb80 20 client.15465 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.283+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561fcebb8f50 0x561fcebbb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.283+0000 7f1aa2fecb80 4 client.15465 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.283+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/1333763937 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fceabe050 con 0x561fcebb8f50 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.283+0000 7f1a8d39b700 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561fcebb8f50 0x561fcebbb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.284+0000 7f1a8d39b700 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561fcebb8f50 0x561fcebbb370 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b39141613c832f server_cookie=e333491c6b403147 in_seq=0 out_seq=0 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.284+0000 7f1a70ff9700 10 client.15465 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1a70ff9700 1 -- 172.21.15.12:0/1333763937 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561fceabe050 con 0x561fcebb8f50 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1a70ff9700 10 client.15465 handle_command_reply: tid=0 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 client.15465 shutdown 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/1333763937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 msgr2=0x561fcebad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebad760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1a78099ed0 tx=0x7f1a7809a710 comp rx=0 tx=0).stop 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/1333763937 shutdown_connections 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561fcebb8f50 0x561fcebbb370 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 0x561fcebad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 0x561fcebb47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1a70ff9700 0 client.15465 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:44.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/1333763937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebad760 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/1333763937 >> 172.21.15.12:0/1333763937 conn(0x561fcead2860 msgr2=0x561fceb9eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/1333763937 shutdown_connections 2023-12-11T20:15:44.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.285+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/1333763937 wait complete. 2023-12-11T20:15:44.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.286+0000 7f1aa2fecb80 20 client.15465 trim_cache size 0 max 16384 2023-12-11T20:15:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.304+0000 7f1aa2fecb80 1 Processor -- start 2023-12-11T20:15:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1aa2fecb80 1 -- start start 2023-12-11T20:15:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3450 0x561fceba0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceb9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcebac5c0 con 0x561fceba3db0 2023-12-11T20:15:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcebb6530 con 0x561fceba4ca0 2023-12-11T20:15:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcebacd90 con 0x561fceba3450 2023-12-11T20:15:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1a8cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1a8cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33240/0 (socket says 172.21.15.12:33240) 2023-12-11T20:15:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/3421791174 learned_addr learned my addr 172.21.15.12:0/3421791174 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1a8d39b700 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3450 0x561fceba0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.305+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceb9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/3421791174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3450 msgr2=0x561fceba0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3450 0x561fceba0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/3421791174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 msgr2=0x561fceb9e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceb9e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/3421791174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fce909ce0 con 0x561fceba3db0 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb4760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1a7809a160 tx=0x7f1a7809a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810a62129d3220c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a73fff700 1 -- 172.21.15.12:0/3421791174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7809e150 con 0x561fceba3db0 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a73fff700 1 -- 172.21.15.12:0/3421791174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a780961c0 con 0x561fceba3db0 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.306+0000 7f1a73fff700 1 -- 172.21.15.12:0/3421791174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780a2330 con 0x561fceba3db0 2023-12-11T20:15:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3421791174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 msgr2=0x561fcebb4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb4760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1a7809a160 tx=0x7f1a7809a780 comp rx=0 tx=0).stop 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3421791174 shutdown_connections 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba4ca0 0x561fceb9e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba3450 0x561fceba0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3421791174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb4760 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3421791174 >> 172.21.15.12:0/3421791174 conn(0x561fcead2860 msgr2=0x561fceb9f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3421791174 shutdown_connections 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3421791174 wait complete. 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 -- start start 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.307+0000 7f1aa2fecb80 1 Processor -- start 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 0x561fcebb3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1aa2fecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 0x561fcec0f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcec0fcc0 con 0x561fceba3db0 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcec0fe00 con 0x561fceba3450 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1aa2fecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcec0ff90 con 0x561fceba4ca0 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1aa2fecb80 10 client.0 _ll_register_callbacks cb 0x561fce9dcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1a8cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1a8cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33256/0 (socket says 172.21.15.12:33256) 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1a8d39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 0x561fcebb3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/3826417887 learned_addr learned my addr 172.21.15.12:0/3826417887 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.308+0000 7f1a8db9c700 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 0x561fcec0f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/3826417887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 msgr2=0x561fcec0f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 0x561fcec0f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/3826417887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 msgr2=0x561fcebb3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 0x561fcebb3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a8cb9a700 1 -- 172.21.15.12:0/3826417887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fce920e60 con 0x561fceba3db0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a8cb9a700 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb3f90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1a7801e000 tx=0x7f1a78010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78688bad4db3ec68 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a70ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a70ff9700 1 -- 172.21.15.12:0/3826417887 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7809e150 con 0x561fceba3db0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1a70ff9700 1 -- 172.21.15.12:0/3826417887 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1a78010880 con 0x561fceba3db0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.309+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3826417887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fceb96bc0 con 0x561fceba3db0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1a70ff9700 1 -- 172.21.15.12:0/3826417887 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a7809e390 con 0x561fceba3db0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1aa2fecb80 10 client.15471 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3826417887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x561fce9472d0 con 0x561fceba3db0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1a70ff9700 1 -- 172.21.15.12:0/3826417887 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561fceb96bc0 con 0x561fceba3db0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1a70ff9700 1 -- 172.21.15.12:0/3826417887 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1a78099340 con 0x561fceba3db0 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1aa2fecb80 10 client.15471 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1aa2fecb80 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:15:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1aa2fecb80 20 client.15471 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561fcec11380 0x561fcec137a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1aa2fecb80 4 client.15471 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:15:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3826417887 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561fceab0510 con 0x561fcec11380 2023-12-11T20:15:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.310+0000 7f1a8d39b700 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561fcec11380 0x561fcec137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.311+0000 7f1a70ff9700 10 client.15471 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.311+0000 7f1a8d39b700 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561fcec11380 0x561fcec137a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfe6bbc72affcc0 server_cookie=8e3a7c5c0a8d6407 in_seq=0 out_seq=0 2023-12-11T20:15:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.312+0000 7f1a70ff9700 1 -- 172.21.15.12:0/3826417887 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561fceab0510 con 0x561fcec11380 2023-12-11T20:15:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.312+0000 7f1a70ff9700 10 client.15471 handle_command_reply: tid=0 2023-12-11T20:15:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.312+0000 7f1aa2fecb80 1 client.15471 shutdown 2023-12-11T20:15:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3826417887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 msgr2=0x561fcebb3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb3f90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1a7801e000 tx=0x7f1a78010b80 comp rx=0 tx=0).stop 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3826417887 shutdown_connections 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561fcec11380 0x561fcec137a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561fceba3450 0x561fcebb3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fceba4ca0 0x561fcec0f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 --2- 172.21.15.12:0/3826417887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fceba3db0 0x561fcebb3f90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1a70ff9700 0 client.15471 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3826417887 >> 172.21.15.12:0/3826417887 conn(0x561fcead2860 msgr2=0x561fceb98550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3826417887 shutdown_connections 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 1 -- 172.21.15.12:0/3826417887 wait complete. 2023-12-11T20:15:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.313+0000 7f1aa2fecb80 20 client.15471 trim_cache size 0 max 16384 2023-12-11T20:15:44.319 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:15:44.319 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:15:44.319 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "9a8be68d-9758-4e48-91a2-d917f01ef44d", 2023-12-11T20:15:44.319 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:15:44.319 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:15:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a740a1480 msgr2=0x7f1a740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a740a1480 0x7f1a740a3940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a80029000 tx=0x7f1a8002c000 comp rx=0 tx=0).stop 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/1953924331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a88102690 msgr2=0x7f1a880739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a88102690 0x7f1a880739c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800e9a0 tx=0x7f1a7800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/1953924331 shutdown_connections 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1a740a1480 0x7f1a740a3940 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a88103030 0x7f1a88073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a881014a0 0x7f1a88075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 --2- 172.21.15.12:0/1953924331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a88102690 0x7f1a880739c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/1953924331 >> 172.21.15.12:0/1953924331 conn(0x7f1a880fca30 msgr2=0x7f1a88105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/1953924331 shutdown_connections 2023-12-11T20:15:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.314+0000 7f1a8f5ff700 1 -- 172.21.15.12:0/1953924331 wait complete. 2023-12-11T20:15:44.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:15:44.354 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T20:15:44.445 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-11T20:15:44.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:44 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2713733771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:44.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:44 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1345343675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 -- 172.21.15.12:0/1514232228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 msgr2=0x7f949c073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 --2- 172.21.15.12:0/1514232228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 0x7f949c073a60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f948c009990 tx=0x7f948c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 -- 172.21.15.12:0/1514232228 shutdown_connections 2023-12-11T20:15:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 --2- 172.21.15.12:0/1514232228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f949c10da80 0x7f949c10fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 --2- 172.21.15.12:0/1514232228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 0x7f949c073a60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 --2- 172.21.15.12:0/1514232228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f949c074030 0x7f949c0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 -- 172.21.15.12:0/1514232228 >> 172.21.15.12:0/1514232228 conn(0x7f949c0fca00 msgr2=0x7f949c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 -- 172.21.15.12:0/1514232228 shutdown_connections 2023-12-11T20:15:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.606+0000 7f94a27ff700 1 -- 172.21.15.12:0/1514232228 wait complete. 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.607+0000 7f94a27ff700 1 Processor -- start 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.607+0000 7f94a27ff700 1 -- start start 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f94a27ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f949c074030 0x7f949c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f94a27ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 0x7f949c19df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f94a27ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f949c10da80 0x7f949c1a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f94a27ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1a54a0 con 0x7f949c075610 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f94a27ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1a55e0 con 0x7f949c074030 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f94a27ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1a5770 con 0x7f949c10da80 2023-12-11T20:15:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 0x7f949c19df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 0x7f949c19df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33268/0 (socket says 172.21.15.12:33268) 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949b7fe700 1 -- 172.21.15.12:0/3744349387 learned_addr learned my addr 172.21.15.12:0/3744349387 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949bfff700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f949c074030 0x7f949c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f94a0d9c700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f949c10da80 0x7f949c1a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949b7fe700 1 -- 172.21.15.12:0/3744349387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f949c10da80 msgr2=0x7f949c1a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949b7fe700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f949c10da80 0x7f949c1a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949b7fe700 1 -- 172.21.15.12:0/3744349387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f949c074030 msgr2=0x7f949c19da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949b7fe700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f949c074030 0x7f949c19da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.608+0000 7f949b7fe700 1 -- 172.21.15.12:0/3744349387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0095f0 con 0x7f949c075610 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.609+0000 7f949b7fe700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 0x7f949c19df50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f949000e970 tx=0x7f949000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.609+0000 7f94997fa700 1 -- 172.21.15.12:0/3744349387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490009790 con 0x7f949c075610 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.609+0000 7f94997fa700 1 -- 172.21.15.12:0/3744349387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f949000eec0 con 0x7f949c075610 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.609+0000 7f94997fa700 1 -- 172.21.15.12:0/3744349387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490003c10 con 0x7f949c075610 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.609+0000 7f94a27ff700 1 -- 172.21.15.12:0/3744349387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c1a5a50 con 0x7f949c075610 2023-12-11T20:15:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.609+0000 7f94a27ff700 1 -- 172.21.15.12:0/3744349387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c1a5f10 con 0x7f949c075610 2023-12-11T20:15:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.614+0000 7f94997fa700 1 -- 172.21.15.12:0/3744349387 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9490003db0 con 0x7f949c075610 2023-12-11T20:15:44.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94b60bbb80 1 Processor -- start 2023-12-11T20:15:44.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94b60bbb80 1 -- start start 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c703d0 0x5605d2c707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c70d30 0x5605d2c71640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c71c20 0x5605d2c720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2bcbb50 con 0x5605d2c703d0 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2bc9470 con 0x5605d2c70d30 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2bc4d60 con 0x5605d2c71c20 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94997fa700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94840a1480 0x7f94840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.615+0000 7f94a0d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c703d0 0x5605d2c707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f94997fa700 1 -- 172.21.15.12:0/3744349387 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9490014070 con 0x7f949c075610 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f94a0d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c703d0 0x5605d2c707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33270/0 (socket says 172.21.15.12:33270) 2023-12-11T20:15:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f94a0d9c700 1 -- 172.21.15.12:0/236576287 learned_addr learned my addr 172.21.15.12:0/236576287 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f949bfff700 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c70d30 0x5605d2c71640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f949b7fe700 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c71c20 0x5605d2c720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f94a0d9c700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94840a1480 0x7f94840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f949bfff700 1 -- 172.21.15.12:0/236576287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c71c20 msgr2=0x5605d2c720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f949bfff700 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c71c20 0x5605d2c720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f949bfff700 1 -- 172.21.15.12:0/236576287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c703d0 msgr2=0x5605d2c707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f949bfff700 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c703d0 0x5605d2c707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.616+0000 7f949bfff700 1 -- 172.21.15.12:0/236576287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605d2a41630 con 0x5605d2c70d30 2023-12-11T20:15:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.617+0000 7f949bfff700 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c70d30 0x5605d2c71640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f948c0098e0 tx=0x7f948c005ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a6614dd5e2fbd42 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.617+0000 7f94a0d9c700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94840a1480 0x7f94840a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9494009510 tx=0x7f9494004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.617+0000 7f94827fc700 1 -- 172.21.15.12:0/236576287 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c01d070 con 0x5605d2c70d30 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.617+0000 7f94827fc700 1 -- 172.21.15.12:0/236576287 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f948c01e040 con 0x5605d2c70d30 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.617+0000 7f94827fc700 1 -- 172.21.15.12:0/236576287 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00b710 con 0x5605d2c70d30 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 -- 172.21.15.12:0/236576287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c70d30 msgr2=0x5605d2c71640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c70d30 0x5605d2c71640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f948c0098e0 tx=0x7f948c005ea0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 -- 172.21.15.12:0/236576287 shutdown_connections 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c71c20 0x5605d2c720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c703d0 0x5605d2c707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/236576287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c70d30 0x5605d2c71640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 -- 172.21.15.12:0/236576287 >> 172.21.15.12:0/236576287 conn(0x5605d2b9f7e0 msgr2=0x5605d2c6cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 -- 172.21.15.12:0/236576287 shutdown_connections 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 -- 172.21.15.12:0/236576287 wait complete. 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.618+0000 7f94b60bbb80 1 -- start start 2023-12-11T20:15:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.619+0000 7f94b60bbb80 1 Processor -- start 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.619+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.619+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.619+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c81670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.619+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2b7e560 con 0x5605d2c71c20 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.619+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2b7e200 con 0x5605d2c703d0 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.619+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2a43920 con 0x5605d2c70d30 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.619+0000 7f94b60bbb80 10 client.0 _ll_register_callbacks cb 0x5605d2aa9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f94a0d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c81670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f949b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f94a0d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c81670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33272/0 (socket says 172.21.15.12:33272) 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f949bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f94a0d9c700 1 -- 172.21.15.12:0/109798707 learned_addr learned my addr 172.21.15.12:0/109798707 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f949bfff700 1 -- 172.21.15.12:0/109798707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 msgr2=0x5605d2c7a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f949bfff700 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f949bfff700 1 -- 172.21.15.12:0/109798707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 msgr2=0x5605d2c81670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f949bfff700 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c81670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f949bfff700 1 -- 172.21.15.12:0/109798707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c110820 con 0x5605d2c703d0 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f94a0d9c700 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c81670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f949bfff700 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7a0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f948c009ce0 tx=0x7f948c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=988117e3a48cfbe2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.620+0000 7f947b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.621+0000 7f947b7fe700 1 -- 172.21.15.12:0/109798707 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c01d040 con 0x5605d2c703d0 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.621+0000 7f94b60bbb80 1 -- 172.21.15.12:0/109798707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605d2c63b40 con 0x5605d2c703d0 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.621+0000 7f947b7fe700 1 -- 172.21.15.12:0/109798707 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f948c00bb20 con 0x5605d2c703d0 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.621+0000 7f947b7fe700 1 -- 172.21.15.12:0/109798707 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f948c00bce0 con 0x5605d2c703d0 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.621+0000 7f94b60bbb80 10 client.25307 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.621+0000 7f94b60bbb80 1 -- 172.21.15.12:0/109798707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5605d29edde0 con 0x5605d2c703d0 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.621+0000 7f947b7fe700 1 -- 172.21.15.12:0/109798707 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5605d2c63b40 con 0x5605d2c703d0 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.621+0000 7f947b7fe700 1 -- 172.21.15.12:0/109798707 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f948c031020 con 0x5605d2c703d0 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.622+0000 7f94b60bbb80 10 client.25307 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.622+0000 7f94b60bbb80 10 client.25307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.622+0000 7f94b60bbb80 20 client.25307 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.622+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5605d2c85a10 0x5605d2c87e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.622+0000 7f94b60bbb80 4 client.25307 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.622+0000 7f94b60bbb80 1 -- 172.21.15.12:0/109798707 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605d2c3ff40 con 0x5605d2c85a10 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.622+0000 7f949b7fe700 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5605d2c85a10 0x5605d2c87e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.623+0000 7f949b7fe700 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5605d2c85a10 0x5605d2c87e00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8744453d892cd292 server_cookie=fee00be1d2dbece7 in_seq=0 out_seq=0 2023-12-11T20:15:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.623+0000 7f947b7fe700 10 client.25307 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.623+0000 7f947b7fe700 1 -- 172.21.15.12:0/109798707 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5605d2c3ff40 con 0x5605d2c85a10 2023-12-11T20:15:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.623+0000 7f947b7fe700 10 client.25307 handle_command_reply: tid=0 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.623+0000 7f94b60bbb80 1 client.25307 shutdown 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 -- 172.21.15.12:0/109798707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 msgr2=0x5605d2c7a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7a0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f948c009ce0 tx=0x7f948c0057c0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 -- 172.21.15.12:0/109798707 shutdown_connections 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5605d2c85a10 0x5605d2c87e00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7a0f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c81670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f947b7fe700 0 client.25307 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/109798707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 -- 172.21.15.12:0/109798707 >> 172.21.15.12:0/109798707 conn(0x5605d2b9f7e0 msgr2=0x5605d2c6ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 -- 172.21.15.12:0/109798707 shutdown_connections 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 1 -- 172.21.15.12:0/109798707 wait complete. 2023-12-11T20:15:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.624+0000 7f94b60bbb80 20 client.25307 trim_cache size 0 max 16384 2023-12-11T20:15:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.642+0000 7f94b60bbb80 1 Processor -- start 2023-12-11T20:15:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.642+0000 7f94b60bbb80 1 -- start start 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c703d0 0x5605d2c74bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c70d30 0x5605d2c75100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c71c20 0x5605d2c81630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2c827f0 con 0x5605d2c70d30 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2c78bb0 con 0x5605d2c71c20 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2c8d000 con 0x5605d2c703d0 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c70d30 0x5605d2c75100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c70d30 0x5605d2c75100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33278/0 (socket says 172.21.15.12:33278) 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949b7fe700 1 -- 172.21.15.12:0/3724345957 learned_addr learned my addr 172.21.15.12:0/3724345957 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949bfff700 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c703d0 0x5605d2c74bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f94a0d9c700 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c71c20 0x5605d2c81630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949b7fe700 1 -- 172.21.15.12:0/3724345957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c703d0 msgr2=0x5605d2c74bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949b7fe700 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c703d0 0x5605d2c74bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949b7fe700 1 -- 172.21.15.12:0/3724345957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c71c20 msgr2=0x5605d2c81630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949b7fe700 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c71c20 0x5605d2c81630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.643+0000 7f949b7fe700 1 -- 172.21.15.12:0/3724345957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605d29d6c60 con 0x5605d2c70d30 2023-12-11T20:15:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.644+0000 7f949b7fe700 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c70d30 0x5605d2c75100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9490004800 tx=0x7f949009d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2973a254277e9619 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.644+0000 7f9482ffd700 1 -- 172.21.15.12:0/3724345957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949009a990 con 0x5605d2c70d30 2023-12-11T20:15:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.644+0000 7f9482ffd700 1 -- 172.21.15.12:0/3724345957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f949009a290 con 0x5605d2c70d30 2023-12-11T20:15:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.644+0000 7f9482ffd700 1 -- 172.21.15.12:0/3724345957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949009e120 con 0x5605d2c70d30 2023-12-11T20:15:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 -- 172.21.15.12:0/3724345957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c70d30 msgr2=0x5605d2c75100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c70d30 0x5605d2c75100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9490004800 tx=0x7f949009d040 comp rx=0 tx=0).stop 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 -- 172.21.15.12:0/3724345957 shutdown_connections 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c71c20 0x5605d2c81630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c703d0 0x5605d2c74bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/3724345957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c70d30 0x5605d2c75100 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 -- 172.21.15.12:0/3724345957 >> 172.21.15.12:0/3724345957 conn(0x5605d2b9f7e0 msgr2=0x5605d2c79600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 -- 172.21.15.12:0/3724345957 shutdown_connections 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 -- 172.21.15.12:0/3724345957 wait complete. 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 -- start start 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.645+0000 7f94b60bbb80 1 Processor -- start 2023-12-11T20:15:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94b60bbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c80830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2c80d70 con 0x5605d2c71c20 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2c80ee0 con 0x5605d2c703d0 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94b60bbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d2c810a0 con 0x5605d2c70d30 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94b60bbb80 10 client.0 _ll_register_callbacks cb 0x5605d2aa9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94a0d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c80830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f949bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94a0d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c80830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33288/0 (socket says 172.21.15.12:33288) 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f94a0d9c700 1 -- 172.21.15.12:0/1680047497 learned_addr learned my addr 172.21.15.12:0/1680047497 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.646+0000 7f949b7fe700 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f949bfff700 1 -- 172.21.15.12:0/1680047497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 msgr2=0x5605d2c7f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f949bfff700 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f949bfff700 1 -- 172.21.15.12:0/1680047497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 msgr2=0x5605d2c80830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f949bfff700 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c80830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f949bfff700 1 -- 172.21.15.12:0/1680047497 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c1a5f10 con 0x5605d2c703d0 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f94a0d9c700 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c80830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f949b7fe700 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f949bfff700 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7f380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f948c0098e0 tx=0x7f948c00bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa83bb81d30b8cae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f947b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f947b7fe700 1 -- 172.21.15.12:0/1680047497 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c033500 con 0x5605d2c703d0 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f947b7fe700 1 -- 172.21.15.12:0/1680047497 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f948c041070 con 0x5605d2c703d0 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.647+0000 7f94b60bbb80 1 -- 172.21.15.12:0/1680047497 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f948c01e040 con 0x5605d2c703d0 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f947b7fe700 1 -- 172.21.15.12:0/1680047497 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f948c0337b0 con 0x5605d2c703d0 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f94b60bbb80 10 client.25313 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f94b60bbb80 1 -- 172.21.15.12:0/1680047497 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5605d2a14250 con 0x5605d2c703d0 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f947b7fe700 1 -- 172.21.15.12:0/1680047497 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f948c01e040 con 0x5605d2c703d0 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f947b7fe700 1 -- 172.21.15.12:0/1680047497 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f948c031070 con 0x5605d2c703d0 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f94b60bbb80 10 client.25313 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f94b60bbb80 10 client.25313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f94b60bbb80 20 client.25313 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5605d2cdc8f0 0x5605d2cdece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f94b60bbb80 4 client.25313 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f94b60bbb80 1 -- 172.21.15.12:0/1680047497 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5605d2b8afd0 con 0x5605d2cdc8f0 2023-12-11T20:15:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.648+0000 7f949b7fe700 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5605d2cdc8f0 0x5605d2cdece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f949b7fe700 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5605d2cdc8f0 0x5605d2cdece0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e2aeb17aeb59d89 server_cookie=26fbe6a7abd90e34 in_seq=0 out_seq=0 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f947b7fe700 10 client.25313 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f947b7fe700 1 -- 172.21.15.12:0/1680047497 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5605d2b8afd0 con 0x5605d2cdc8f0 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f947b7fe700 10 client.25313 handle_command_reply: tid=0 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 client.25313 shutdown 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 -- 172.21.15.12:0/1680047497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 msgr2=0x5605d2c7f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7f380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f948c0098e0 tx=0x7f948c00bf50 comp rx=0 tx=0).stop 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 -- 172.21.15.12:0/1680047497 shutdown_connections 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5605d2cdc8f0 0x5605d2cdece0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5605d2c703d0 0x5605d2c7f380 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5605d2c71c20 0x5605d2c80830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f947b7fe700 0 client.25313 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 --2- 172.21.15.12:0/1680047497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5605d2c70d30 0x5605d2c7f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.649+0000 7f94b60bbb80 1 -- 172.21.15.12:0/1680047497 >> 172.21.15.12:0/1680047497 conn(0x5605d2b9f7e0 msgr2=0x5605d2c74bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94b60bbb80 1 -- 172.21.15.12:0/1680047497 shutdown_connections 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94b60bbb80 1 -- 172.21.15.12:0/1680047497 wait complete. 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94b60bbb80 20 client.25313 trim_cache size 0 max 16384 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "9a8be68d-9758-4e48-91a2-d917f01ef44d": { 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "9a8be68d-9758-4e48-91a2-d917f01ef44d", 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:15:44.653 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:15:44.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:15:44.654 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:15:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 -- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94840a1480 msgr2=0x7f94840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94840a1480 0x7f94840a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9494009510 tx=0x7f9494004b40 comp rx=0 tx=0).stop 2023-12-11T20:15:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 -- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 msgr2=0x7f949c19df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 0x7f949c19df50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f949000e970 tx=0x7f949000ec80 comp rx=0 tx=0).stop 2023-12-11T20:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 -- 172.21.15.12:0/3744349387 shutdown_connections 2023-12-11T20:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94840a1480 0x7f94840a3940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f949c074030 0x7f949c19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f949c10da80 0x7f949c1a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 --2- 172.21.15.12:0/3744349387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949c075610 0x7f949c19df50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.650+0000 7f94a27ff700 1 -- 172.21.15.12:0/3744349387 >> 172.21.15.12:0/3744349387 conn(0x7f949c0fca00 msgr2=0x7f949c100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.651+0000 7f94a27ff700 1 -- 172.21.15.12:0/3744349387 shutdown_connections 2023-12-11T20:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:15:44.651+0000 7f94a27ff700 1 -- 172.21.15.12:0/3744349387 wait complete. 2023-12-11T20:15:44.666 INFO:tasks.cephfs.filesystem:scrub status for tag:9a8be68d-9758-4e48-91a2-d917f01ef44d - {'path': '/', 'tag': '9a8be68d-9758-4e48-91a2-d917f01ef44d', 'options': 'recursive,force'} 2023-12-11T20:15:44.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:44 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2713733771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:44.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:44 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1345343675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:44.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:44 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2713733771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:15:44.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:44 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1345343675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:15:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:45 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:15:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:45 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:15:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:45 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:15:45.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:45 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:15:45.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:45 smithi012 ceph-mon[128787]: pgmap v370: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-12-11T20:15:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:45 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:15:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:45 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:15:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:45 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:15:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:45 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:15:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:45 smithi032 ceph-mon[132488]: pgmap v370: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-12-11T20:15:45.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:45 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:15:45.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:45 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:15:45.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:45 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:15:45.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:45 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:15:45.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:45 smithi039 ceph-mon[102205]: pgmap v370: 97 pgs: 97 active+clean; 646 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-12-11T20:15:48.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:48 smithi032 ceph-mon[132488]: pgmap v371: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-12-11T20:15:48.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:48 smithi039 ceph-mon[102205]: pgmap v371: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-12-11T20:15:48.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:48 smithi012 ceph-mon[128787]: pgmap v371: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-12-11T20:15:49.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:49 smithi039 ceph-mon[102205]: pgmap v372: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-11T20:15:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:49 smithi012 ceph-mon[128787]: pgmap v372: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-11T20:15:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:49 smithi032 ceph-mon[132488]: pgmap v372: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-11T20:15:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:52 smithi032 ceph-mon[132488]: pgmap v373: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 5 op/s 2023-12-11T20:15:52.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:52 smithi039 ceph-mon[102205]: pgmap v373: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 5 op/s 2023-12-11T20:15:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:52 smithi012 ceph-mon[128787]: pgmap v373: 97 pgs: 97 active+clean; 651 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 5 op/s 2023-12-11T20:15:54.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:54 smithi032 ceph-mon[132488]: pgmap v374: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:15:54.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:54 smithi039 ceph-mon[102205]: pgmap v374: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:15:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:54 smithi012 ceph-mon[128787]: pgmap v374: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:15:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:56 smithi032 ceph-mon[132488]: pgmap v375: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-11T20:15:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:56 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:15:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:56 smithi039 ceph-mon[102205]: pgmap v375: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-11T20:15:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:56 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:15:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:56 smithi012 ceph-mon[128787]: pgmap v375: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-12-11T20:15:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:56 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 -- 172.21.15.12:0/3879058172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b8103060 msgr2=0x7f32b8109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 --2- 172.21.15.12:0/3879058172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b8103060 0x7f32b8109910 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b0d0 tx=0x7f32b000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 -- 172.21.15.12:0/3879058172 shutdown_connections 2023-12-11T20:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 --2- 172.21.15.12:0/3879058172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b81014d0 0x7f32b81018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 --2- 172.21.15.12:0/3879058172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b8103060 0x7f32b8109910 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 --2- 172.21.15.12:0/3879058172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b81026c0 0x7f32b8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 -- 172.21.15.12:0/3879058172 >> 172.21.15.12:0/3879058172 conn(0x7f32b80fca60 msgr2=0x7f32b80fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 -- 172.21.15.12:0/3879058172 shutdown_connections 2023-12-11T20:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.314+0000 7f32bebff700 1 -- 172.21.15.12:0/3879058172 wait complete. 2023-12-11T20:15:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.315+0000 7f32bebff700 1 Processor -- start 2023-12-11T20:15:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.315+0000 7f32bebff700 1 -- start start 2023-12-11T20:15:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32bebff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b81014d0 0x7f32b8075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32bebff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81026c0 0x7f32b80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32bebff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b8103060 0x7f32b8073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32bebff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80746a0 con 0x7f32b81026c0 2023-12-11T20:15:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32bebff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8074810 con 0x7f32b8103060 2023-12-11T20:15:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32bebff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b81a14b0 con 0x7f32b81014d0 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81026c0 0x7f32b80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81026c0 0x7f32b80739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33146/0 (socket says 172.21.15.12:33146) 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32b7fff700 1 -- 172.21.15.12:0/1145160226 learned_addr learned my addr 172.21.15.12:0/1145160226 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32bc99b700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b81014d0 0x7f32b8075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32bd19c700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b8103060 0x7f32b8073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32b7fff700 1 -- 172.21.15.12:0/1145160226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b81014d0 msgr2=0x7f32b8075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32b7fff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b81014d0 0x7f32b8075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32b7fff700 1 -- 172.21.15.12:0/1145160226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b8103060 msgr2=0x7f32b8073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32b7fff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b8103060 0x7f32b8073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.316+0000 7f32b7fff700 1 -- 172.21.15.12:0/1145160226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009d00 con 0x7f32b81026c0 2023-12-11T20:15:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.317+0000 7f32b7fff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81026c0 0x7f32b80739c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f32a400d950 tx=0x7f32a400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.317+0000 7f32b5ffb700 1 -- 172.21.15.12:0/1145160226 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400f890 con 0x7f32b81026c0 2023-12-11T20:15:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.317+0000 7f32b5ffb700 1 -- 172.21.15.12:0/1145160226 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32a400fe80 con 0x7f32b81026c0 2023-12-11T20:15:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.317+0000 7f32bebff700 1 -- 172.21.15.12:0/1145160226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b81a1740 con 0x7f32b81026c0 2023-12-11T20:15:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.317+0000 7f32b5ffb700 1 -- 172.21.15.12:0/1145160226 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4019360 con 0x7f32b81026c0 2023-12-11T20:15:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.317+0000 7f32bebff700 1 -- 172.21.15.12:0/1145160226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b81a1ca0 con 0x7f32b81026c0 2023-12-11T20:15:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.320+0000 7f32b5ffb700 1 -- 172.21.15.12:0/1145160226 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f32a4010460 con 0x7f32b81026c0 2023-12-11T20:15:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32b5ffb700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32a80a14f0 0x7f32a80a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32d2522b80 1 Processor -- start 2023-12-11T20:15:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32b5ffb700 1 -- 172.21.15.12:0/1145160226 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32a40cca90 con 0x7f32b81026c0 2023-12-11T20:15:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32d2522b80 1 -- start start 2023-12-11T20:15:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32bc99b700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32a80a14f0 0x7f32a80a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d2152f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d215830 0x55d00d216140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d216720 0x55d00d216ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32d2522b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d170af0 con 0x55d00d216720 2023-12-11T20:15:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32d2522b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d16e410 con 0x55d00d214ed0 2023-12-11T20:15:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.322+0000 7f32d2522b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d169d00 con 0x55d00d215830 2023-12-11T20:15:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bc99b700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32a80a14f0 0x7f32a80a39b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f32b8102520 tx=0x7f32ac00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d216720 0x55d00d216ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d216720 0x55d00d216ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33160/0 (socket says 172.21.15.12:33160) 2023-12-11T20:15:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 -- 172.21.15.12:0/3604053079 learned_addr learned my addr 172.21.15.12:0/3604053079 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bc99b700 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d2152f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32b7fff700 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d215830 0x55d00d216140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 -- 172.21.15.12:0/3604053079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d215830 msgr2=0x55d00d216140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d215830 0x55d00d216140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 -- 172.21.15.12:0/3604053079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 msgr2=0x55d00d2152f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d2152f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 -- 172.21.15.12:0/3604053079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d00cfe65d0 con 0x55d00d216720 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bc99b700 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d2152f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.323+0000 7f32bd19c700 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d216720 0x55d00d216ba0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f32b0015000 tx=0x7f32b00074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756ceb21add01e86 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.324+0000 7f32a2ffd700 1 -- 172.21.15.12:0/3604053079 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b000e070 con 0x55d00d216720 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.324+0000 7f32a2ffd700 1 -- 172.21.15.12:0/3604053079 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32b0003a00 con 0x55d00d216720 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.324+0000 7f32a2ffd700 1 -- 172.21.15.12:0/3604053079 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0005490 con 0x55d00d216720 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.324+0000 7f32d2522b80 1 -- 172.21.15.12:0/3604053079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d216720 msgr2=0x55d00d216ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.324+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d216720 0x55d00d216ba0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f32b0015000 tx=0x7f32b00074e0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.325+0000 7f32d2522b80 1 -- 172.21.15.12:0/3604053079 shutdown_connections 2023-12-11T20:15:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.325+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d2152f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.325+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d216720 0x55d00d216ba0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.325+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3604053079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d215830 0x55d00d216140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.325+0000 7f32d2522b80 1 -- 172.21.15.12:0/3604053079 >> 172.21.15.12:0/3604053079 conn(0x55d00d144780 msgr2=0x55d00d211880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.325+0000 7f32d2522b80 1 -- 172.21.15.12:0/3604053079 shutdown_connections 2023-12-11T20:15:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.325+0000 7f32d2522b80 1 -- 172.21.15.12:0/3604053079 wait complete. 2023-12-11T20:15:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.325+0000 7f32d2522b80 1 -- start start 2023-12-11T20:15:57.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.326+0000 7f32d2522b80 1 Processor -- start 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.326+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d21ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.326+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d21f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.326+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 0x55d00d2261c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.326+0000 7f32d2522b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d123500 con 0x55d00d215830 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.326+0000 7f32d2522b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d1231a0 con 0x55d00d214ed0 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.326+0000 7f32d2522b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00cfe88c0 con 0x55d00d216720 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.326+0000 7f32d2522b80 10 client.0 _ll_register_callbacks cb 0x55d00d04ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d21f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d21f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33166/0 (socket says 172.21.15.12:33166) 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 -- 172.21.15.12:0/3648533015 learned_addr learned my addr 172.21.15.12:0/3648533015 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32bc99b700 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d21ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32bd19c700 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 0x55d00d2261c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 -- 172.21.15.12:0/3648533015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 msgr2=0x55d00d2261c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 0x55d00d2261c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 -- 172.21.15.12:0/3648533015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 msgr2=0x55d00d21ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d21ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 -- 172.21.15.12:0/3648533015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b810a260 con 0x55d00d215830 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32bd19c700 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 0x55d00d2261c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f32b7fff700 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d21f390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f32a4000c00 tx=0x7f32a40108a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0058dab194eed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f3297fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.327+0000 7f3297fff700 1 -- 172.21.15.12:0/3648533015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40993f0 con 0x55d00d215830 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 1 -- 172.21.15.12:0/3648533015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d00d208730 con 0x55d00d215830 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f3297fff700 1 -- 172.21.15.12:0/3648533015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32a409de50 con 0x55d00d215830 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f3297fff700 1 -- 172.21.15.12:0/3648533015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32a40b8020 con 0x55d00d215830 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 10 client.15501 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 1 -- 172.21.15.12:0/3648533015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d00cf92d80 con 0x55d00d215830 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f3297fff700 1 -- 172.21.15.12:0/3648533015 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32a407c080 con 0x55d00d215830 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f3297fff700 1 -- 172.21.15.12:0/3648533015 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f32a40adae0 con 0x55d00d215830 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 10 client.15501 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 20 client.15501 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d00d22ac80 0x55d00d22d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 4 client.15501 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.328+0000 7f32d2522b80 1 -- 172.21.15.12:0/3648533015 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d00d1e4ee0 con 0x55d00d22ac80 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.329+0000 7f32bc99b700 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d00d22ac80 0x55d00d22d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.329+0000 7f32bc99b700 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d00d22ac80 0x55d00d22d070 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799db2b2da0905bc server_cookie=ba681895a6aea9c2 in_seq=0 out_seq=0 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.329+0000 7f3297fff700 10 client.15501 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.330+0000 7f3297fff700 1 -- 172.21.15.12:0/3648533015 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d00d1e4ee0 con 0x55d00d22ac80 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.330+0000 7f3297fff700 10 client.15501 handle_command_reply: tid=0 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.330+0000 7f32d2522b80 1 client.15501 shutdown 2023-12-11T20:15:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.330+0000 7f32d2522b80 1 -- 172.21.15.12:0/3648533015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 msgr2=0x55d00d21f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.330+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d21f390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f32a4000c00 tx=0x7f32a40108a0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.330+0000 7f32d2522b80 1 -- 172.21.15.12:0/3648533015 shutdown_connections 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.330+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d00d22ac80 0x55d00d22d070 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.331+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d21ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.331+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 0x55d00d2261c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.331+0000 7f32d2522b80 1 --2- 172.21.15.12:0/3648533015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d21f390 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.331+0000 7f3297fff700 0 client.15501 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.331+0000 7f32d2522b80 1 -- 172.21.15.12:0/3648533015 >> 172.21.15.12:0/3648533015 conn(0x55d00d144780 msgr2=0x55d00d20fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.331+0000 7f32d2522b80 1 -- 172.21.15.12:0/3648533015 shutdown_connections 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.331+0000 7f32d2522b80 1 -- 172.21.15.12:0/3648533015 wait complete. 2023-12-11T20:15:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.331+0000 7f32d2522b80 20 client.15501 trim_cache size 0 max 16384 2023-12-11T20:15:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.346+0000 7f32d2522b80 1 Processor -- start 2023-12-11T20:15:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.346+0000 7f32d2522b80 1 -- start start 2023-12-11T20:15:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d216b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d226180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 0x55d00d21ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32d2522b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d2267c0 con 0x55d00d215830 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32d2522b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d215f30 con 0x55d00d214ed0 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32d2522b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d21c8a0 con 0x55d00d216720 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d226180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d226180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33176/0 (socket says 172.21.15.12:33176) 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32b7fff700 1 -- 172.21.15.12:0/9043411 learned_addr learned my addr 172.21.15.12:0/9043411 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32bc99b700 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d216b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32b7fff700 1 -- 172.21.15.12:0/9043411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 msgr2=0x55d00d21ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32b7fff700 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 0x55d00d21ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32b7fff700 1 -- 172.21.15.12:0/9043411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 msgr2=0x55d00d216b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32b7fff700 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d216b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32b7fff700 1 -- 172.21.15.12:0/9043411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d00cf7bc00 con 0x55d00d215830 2023-12-11T20:15:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.347+0000 7f32bc99b700 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d216b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:15:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32b7fff700 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d226180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f32a4099c90 tx=0x7f32a4099e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752ec8174feb9dbd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32a37fe700 1 -- 172.21.15.12:0/9043411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4014070 con 0x55d00d215830 2023-12-11T20:15:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32a37fe700 1 -- 172.21.15.12:0/9043411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d00d208730 con 0x55d00d215830 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32a37fe700 1 -- 172.21.15.12:0/9043411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40a1c00 con 0x55d00d215830 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32d2522b80 1 -- 172.21.15.12:0/9043411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 msgr2=0x55d00d226180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32d2522b80 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d226180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f32a4099c90 tx=0x7f32a4099e80 comp rx=0 tx=0).stop 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32d2522b80 1 -- 172.21.15.12:0/9043411 shutdown_connections 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32d2522b80 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d214ed0 0x55d00d216b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32d2522b80 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d216720 0x55d00d21ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32d2522b80 1 --2- 172.21.15.12:0/9043411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d226180 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.348+0000 7f32d2522b80 1 -- 172.21.15.12:0/9043411 >> 172.21.15.12:0/9043411 conn(0x55d00d144780 msgr2=0x55d00d21e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.349+0000 7f32d2522b80 1 -- 172.21.15.12:0/9043411 shutdown_connections 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.349+0000 7f32d2522b80 1 -- 172.21.15.12:0/9043411 wait complete. 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.349+0000 7f32d2522b80 1 -- start start 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.349+0000 7f32d2522b80 1 Processor -- start 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.349+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d214ed0 0x55d00d27b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d27d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32d2522b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d216720 0x55d00d27fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32d2522b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d280130 con 0x55d00d215830 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32d2522b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d280270 con 0x55d00d216720 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32d2522b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00d280430 con 0x55d00d214ed0 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32d2522b80 10 client.0 _ll_register_callbacks cb 0x55d00d04ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d27d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d27d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33178/0 (socket says 172.21.15.12:33178) 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32b7fff700 1 -- 172.21.15.12:0/2085607055 learned_addr learned my addr 172.21.15.12:0/2085607055 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32bd19c700 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d216720 0x55d00d27fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32bc99b700 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d214ed0 0x55d00d27b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32b7fff700 1 -- 172.21.15.12:0/2085607055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d214ed0 msgr2=0x55d00d27b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32b7fff700 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d214ed0 0x55d00d27b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32b7fff700 1 -- 172.21.15.12:0/2085607055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d216720 msgr2=0x55d00d27fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:15:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32b7fff700 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d216720 0x55d00d27fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.350+0000 7f32b7fff700 1 -- 172.21.15.12:0/2085607055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d00cf92d80 con 0x55d00d215830 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f32b7fff700 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d27d660 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f32a40aded0 tx=0x7f32a4010950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8536fa8da41d2997 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f3297fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f3297fff700 1 -- 172.21.15.12:0/2085607055 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4014070 con 0x55d00d215830 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f32d2522b80 1 -- 172.21.15.12:0/2085607055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32b0003a00 con 0x55d00d215830 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f3297fff700 1 -- 172.21.15.12:0/2085607055 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32a4095af0 con 0x55d00d215830 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f3297fff700 1 -- 172.21.15.12:0/2085607055 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32a40993f0 con 0x55d00d215830 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f32d2522b80 10 client.15507 fetch_fsmap learned FSMap version 22 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f32d2522b80 1 -- 172.21.15.12:0/2085607055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d00cfb91f0 con 0x55d00d215830 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f3297fff700 1 -- 172.21.15.12:0/2085607055 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32b0003a00 con 0x55d00d215830 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.351+0000 7f3297fff700 1 -- 172.21.15.12:0/2085607055 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f32a40b2200 con 0x55d00d215830 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.352+0000 7f32d2522b80 10 client.15507 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.352+0000 7f32d2522b80 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:15:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.352+0000 7f32d2522b80 20 client.15507 populate_metadata read hostname 'smithi012' 2023-12-11T20:15:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.352+0000 7f32d2522b80 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d00d2818b0 0x55d00d283ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:15:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.352+0000 7f32d2522b80 4 client.15507 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:15:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.352+0000 7f32d2522b80 1 -- 172.21.15.12:0/2085607055 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d00d12ff70 con 0x55d00d2818b0 2023-12-11T20:15:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.352+0000 7f32bc99b700 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d00d2818b0 0x55d00d283ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:15:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.353+0000 7f32bc99b700 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d00d2818b0 0x55d00d283ca0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2442f1f6bd6883f server_cookie=95b3e184d268a48c in_seq=0 out_seq=0 2023-12-11T20:15:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.353+0000 7f3297fff700 10 client.15507 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f3297fff700 1 -- 172.21.15.12:0/2085607055 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d00d12ff70 con 0x55d00d2818b0 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f3297fff700 10 client.15507 handle_command_reply: tid=0 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 client.15507 shutdown 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 -- 172.21.15.12:0/2085607055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 msgr2=0x55d00d27d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d27d660 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f32a40aded0 tx=0x7f32a4010950 comp rx=0 tx=0).stop 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 -- 172.21.15.12:0/2085607055 shutdown_connections 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d00d2818b0 0x55d00d283ca0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d00d216720 0x55d00d27fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f3297fff700 0 client.15507 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d00d214ed0 0x55d00d27b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 --2- 172.21.15.12:0/2085607055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d00d215830 0x55d00d27d660 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.366+0000 7f32d2522b80 1 -- 172.21.15.12:0/2085607055 >> 172.21.15.12:0/2085607055 conn(0x55d00d144780 msgr2=0x55d00d21edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32d2522b80 1 -- 172.21.15.12:0/2085607055 shutdown_connections 2023-12-11T20:15:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32d2522b80 1 -- 172.21.15.12:0/2085607055 wait complete. 2023-12-11T20:15:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32d2522b80 20 client.15507 trim_cache size 0 max 16384 2023-12-11T20:15:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:15:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:15:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:15:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 -- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32a80a14f0 msgr2=0x7f32a80a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32a80a14f0 0x7f32a80a39b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f32b8102520 tx=0x7f32ac00b410 comp rx=0 tx=0).stop 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 -- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81026c0 msgr2=0x7f32b80739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81026c0 0x7f32b80739c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f32a400d950 tx=0x7f32a400dc60 comp rx=0 tx=0).stop 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 -- 172.21.15.12:0/1145160226 shutdown_connections 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32a80a14f0 0x7f32a80a39b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b8103060 0x7f32b8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b81014d0 0x7f32b8075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 --2- 172.21.15.12:0/1145160226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b81026c0 0x7f32b80739c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:15:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.367+0000 7f32bebff700 1 -- 172.21.15.12:0/1145160226 >> 172.21.15.12:0/1145160226 conn(0x7f32b80fca60 msgr2=0x7f32b8105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:15:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.368+0000 7f32bebff700 1 -- 172.21.15.12:0/1145160226 shutdown_connections 2023-12-11T20:15:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:15:57.368+0000 7f32bebff700 1 -- 172.21.15.12:0/1145160226 wait complete. 2023-12-11T20:15:58.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:58 smithi032 ceph-mon[132488]: pgmap v376: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:15:58.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:58 smithi039 ceph-mon[102205]: pgmap v376: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:15:58.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:58 smithi012 ceph-mon[128787]: pgmap v376: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:15:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:15:59 smithi039 ceph-mon[102205]: pgmap v377: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-11T20:15:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:15:59 smithi012 ceph-mon[128787]: pgmap v377: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-11T20:15:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:15:59 smithi032 ceph-mon[132488]: pgmap v377: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-11T20:16:01.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:16:01.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:16:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:16:02.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:01 smithi032 ceph-mon[132488]: pgmap v378: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:16:02.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:02.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:01 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:02.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:01 smithi039 ceph-mon[102205]: pgmap v378: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:16:02.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:02.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:01 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:01 smithi012 ceph-mon[128787]: pgmap v378: 97 pgs: 97 active+clean; 656 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-11T20:16:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:01 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:04.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:04 smithi032 ceph-mon[132488]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-12-11T20:16:04.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:04 smithi039 ceph-mon[102205]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-12-11T20:16:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:04 smithi012 ceph-mon[128787]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-12-11T20:16:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:05 smithi039 ceph-mon[102205]: pgmap v380: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2023-12-11T20:16:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:05 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:05 smithi012 ceph-mon[128787]: pgmap v380: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2023-12-11T20:16:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:05 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:05 smithi032 ceph-mon[132488]: pgmap v380: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2023-12-11T20:16:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:05.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:05 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:06.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:06 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:16:06.818 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:06 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:16:06.818 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:06 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:06 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:16:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:06 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:16:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:06 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:06.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:06 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:16:06.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:06 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:16:06.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:06 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:16:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:07 smithi039 ceph-mon[102205]: pgmap v381: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-12-11T20:16:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:07 smithi012 ceph-mon[128787]: pgmap v381: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-12-11T20:16:07.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:07 smithi032 ceph-mon[132488]: pgmap v381: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-12-11T20:16:09.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:09 smithi039 ceph-mon[102205]: pgmap v382: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-12-11T20:16:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:09 smithi012 ceph-mon[128787]: pgmap v382: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-12-11T20:16:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:09 smithi032 ceph-mon[132488]: pgmap v382: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-12-11T20:16:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 -- 172.21.15.12:0/2022651432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1026c0 msgr2=0x7f82dc102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 --2- 172.21.15.12:0/2022651432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1026c0 0x7f82dc102b20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0099c0 tx=0x7f82cc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 -- 172.21.15.12:0/2022651432 shutdown_connections 2023-12-11T20:16:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 --2- 172.21.15.12:0/2022651432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82dc1014d0 0x7f82dc1018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 --2- 172.21.15.12:0/2022651432 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82dc103060 0x7f82dc109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 --2- 172.21.15.12:0/2022651432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1026c0 0x7f82dc102b20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 -- 172.21.15.12:0/2022651432 >> 172.21.15.12:0/2022651432 conn(0x7f82dc0fca60 msgr2=0x7f82dc0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 -- 172.21.15.12:0/2022651432 shutdown_connections 2023-12-11T20:16:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.528+0000 7f82e3bff700 1 -- 172.21.15.12:0/2022651432 wait complete. 2023-12-11T20:16:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.529+0000 7f82e3bff700 1 Processor -- start 2023-12-11T20:16:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.529+0000 7f82e3bff700 1 -- start start 2023-12-11T20:16:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e3bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1014d0 0x7f82dc075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e3bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82dc1026c0 0x7f82dc0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e3bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82dc103060 0x7f82dc073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e3bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0746a0 con 0x7f82dc1014d0 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e3bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc074810 con 0x7f82dc1026c0 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e3bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc1a13d0 con 0x7f82dc103060 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e199b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1014d0 0x7f82dc075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e199b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1014d0 0x7f82dc075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58254/0 (socket says 172.21.15.12:58254) 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e199b700 1 -- 172.21.15.12:0/1450341921 learned_addr learned my addr 172.21.15.12:0/1450341921 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e219c700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82dc103060 0x7f82dc073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e119a700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82dc1026c0 0x7f82dc0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e199b700 1 -- 172.21.15.12:0/1450341921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82dc103060 msgr2=0x7f82dc073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e199b700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82dc103060 0x7f82dc073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e199b700 1 -- 172.21.15.12:0/1450341921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82dc1026c0 msgr2=0x7f82dc0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e199b700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82dc1026c0 0x7f82dc0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e199b700 1 -- 172.21.15.12:0/1450341921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0095f0 con 0x7f82dc1014d0 2023-12-11T20:16:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.530+0000 7f82e119a700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82dc1026c0 0x7f82dc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:16:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.531+0000 7f82e199b700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1014d0 0x7f82dc075330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f82d800d980 tx=0x7f82d800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.531+0000 7f82d2ffd700 1 -- 172.21.15.12:0/1450341921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800bb00 con 0x7f82dc1014d0 2023-12-11T20:16:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.531+0000 7f82d2ffd700 1 -- 172.21.15.12:0/1450341921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d8007620 con 0x7f82dc1014d0 2023-12-11T20:16:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.531+0000 7f82d2ffd700 1 -- 172.21.15.12:0/1450341921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800f3c0 con 0x7f82dc1014d0 2023-12-11T20:16:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.531+0000 7f82e3bff700 1 -- 172.21.15.12:0/1450341921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc1a1660 con 0x7f82dc1014d0 2023-12-11T20:16:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.531+0000 7f82e3bff700 1 -- 172.21.15.12:0/1450341921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc1a1b20 con 0x7f82dc1014d0 2023-12-11T20:16:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.534+0000 7f82d2ffd700 1 -- 172.21.15.12:0/1450341921 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f82d8010460 con 0x7f82dc1014d0 2023-12-11T20:16:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.535+0000 7f82f7565b80 1 Processor -- start 2023-12-11T20:16:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82f7565b80 1 -- start start 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82d2ffd700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82c80a14f0 0x7f82c80a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d17830 0x55a5e7d18140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82f7565b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7c72af0 con 0x55a5e7d18720 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82f7565b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7c70410 con 0x55a5e7d17830 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82f7565b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7c6bd00 con 0x55a5e7d16ed0 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82d2ffd700 1 -- 172.21.15.12:0/1450341921 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82d80cccd0 con 0x7f82dc1014d0 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.536+0000 7f82e219c700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82c80a14f0 0x7f82c80a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e119a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d17830 0x55a5e7d18140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e119a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d17830 0x55a5e7d18140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44614/0 (socket says 172.21.15.12:44614) 2023-12-11T20:16:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e119a700 1 -- 172.21.15.12:0/3674112207 learned_addr learned my addr 172.21.15.12:0/3674112207 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e199b700 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e219c700 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e199b700 1 -- 172.21.15.12:0/3674112207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d17830 msgr2=0x55a5e7d18140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e199b700 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d17830 0x55a5e7d18140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e199b700 1 -- 172.21.15.12:0/3674112207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 msgr2=0x55a5e7d18ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e199b700 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e199b700 1 -- 172.21.15.12:0/3674112207 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5e7ae85d0 con 0x55a5e7d16ed0 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e119a700 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d17830 0x55a5e7d18140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.537+0000 7f82e219c700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82c80a14f0 0x7f82c80a39b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009710 tx=0x7f82d4009bf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.538+0000 7f82e199b700 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d172f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82d80ca720 tx=0x7f82d8099940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f917fcbb475ce02 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.538+0000 7f82c7fff700 1 -- 172.21.15.12:0/3674112207 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8099f40 con 0x55a5e7d16ed0 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.538+0000 7f82c7fff700 1 -- 172.21.15.12:0/3674112207 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d809e090 con 0x55a5e7d16ed0 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.538+0000 7f82c7fff700 1 -- 172.21.15.12:0/3674112207 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800bd60 con 0x55a5e7d16ed0 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 -- 172.21.15.12:0/3674112207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 msgr2=0x55a5e7d172f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d172f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82d80ca720 tx=0x7f82d8099940 comp rx=0 tx=0).stop 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 -- 172.21.15.12:0/3674112207 shutdown_connections 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d172f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3674112207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d17830 0x55a5e7d18140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 -- 172.21.15.12:0/3674112207 >> 172.21.15.12:0/3674112207 conn(0x55a5e7c46780 msgr2=0x55a5e7d13880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 -- 172.21.15.12:0/3674112207 shutdown_connections 2023-12-11T20:16:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 -- 172.21.15.12:0/3674112207 wait complete. 2023-12-11T20:16:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.539+0000 7f82f7565b80 1 -- start start 2023-12-11T20:16:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.540+0000 7f82f7565b80 1 Processor -- start 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.540+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d20f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.540+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d21450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.540+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d28280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.540+0000 7f82f7565b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7c25500 con 0x55a5e7d17830 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82f7565b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7c251a0 con 0x55a5e7d18720 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82f7565b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7aea8c0 con 0x55a5e7d16ed0 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82f7565b80 10 client.0 _ll_register_callbacks cb 0x55a5e7b50a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d21450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d21450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58270/0 (socket says 172.21.15.12:58270) 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 -- 172.21.15.12:0/3997013523 learned_addr learned my addr 172.21.15.12:0/3997013523 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e219c700 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d28280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e199b700 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d20f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 -- 172.21.15.12:0/3997013523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 msgr2=0x55a5e7d20f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d20f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 -- 172.21.15.12:0/3997013523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 msgr2=0x55a5e7d28280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d28280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 -- 172.21.15.12:0/3997013523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc10a260 con 0x55a5e7d17830 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82e119a700 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d21450 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f82cc005270 tx=0x7f82cc005350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efa4464e559d266 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.541+0000 7f82c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82c57fa700 1 -- 172.21.15.12:0/3997013523 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc004500 con 0x55a5e7d17830 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82f7565b80 1 -- 172.21.15.12:0/3997013523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5e7d0a730 con 0x55a5e7d17830 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82c57fa700 1 -- 172.21.15.12:0/3997013523 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82cc004660 con 0x55a5e7d17830 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82c57fa700 1 -- 172.21.15.12:0/3997013523 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82cc004820 con 0x55a5e7d17830 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82f7565b80 10 client.15519 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82f7565b80 1 -- 172.21.15.12:0/3997013523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f82dc1a1b20 con 0x55a5e7d17830 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82c57fa700 1 -- 172.21.15.12:0/3997013523 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82cc032020 con 0x55a5e7d17830 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82c57fa700 1 -- 172.21.15.12:0/3997013523 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f82cc0039d0 con 0x55a5e7d17830 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82f7565b80 10 client.15519 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.542+0000 7f82f7565b80 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.543+0000 7f82f7565b80 20 client.15519 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.543+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a5e7d2cd40 0x55a5e7d2f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.543+0000 7f82f7565b80 4 client.15519 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.543+0000 7f82f7565b80 1 -- 172.21.15.12:0/3997013523 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5e7ce6ee0 con 0x55a5e7d2cd40 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.543+0000 7f82e199b700 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a5e7d2cd40 0x55a5e7d2f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.544+0000 7f82e199b700 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a5e7d2cd40 0x55a5e7d2f160 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c2f6262450df85 server_cookie=5ab31d2cdfb5d9a4 in_seq=0 out_seq=0 2023-12-11T20:16:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.544+0000 7f82c57fa700 10 client.15519 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.544+0000 7f82c57fa700 1 -- 172.21.15.12:0/3997013523 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a5e7ce6ee0 con 0x55a5e7d2cd40 2023-12-11T20:16:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.544+0000 7f82c57fa700 10 client.15519 handle_command_reply: tid=0 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.544+0000 7f82f7565b80 1 client.15519 shutdown 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 -- 172.21.15.12:0/3997013523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 msgr2=0x55a5e7d21450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d21450 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f82cc005270 tx=0x7f82cc005350 comp rx=0 tx=0).stop 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 -- 172.21.15.12:0/3997013523 shutdown_connections 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a5e7d2cd40 0x55a5e7d2f160 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d28280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d20f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3997013523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d21450 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82c57fa700 0 client.15519 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 -- 172.21.15.12:0/3997013523 >> 172.21.15.12:0/3997013523 conn(0x55a5e7c46780 msgr2=0x55a5e7d11ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 -- 172.21.15.12:0/3997013523 shutdown_connections 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 1 -- 172.21.15.12:0/3997013523 wait complete. 2023-12-11T20:16:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.545+0000 7f82f7565b80 20 client.15519 trim_cache size 0 max 16384 2023-12-11T20:16:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82f7565b80 1 Processor -- start 2023-12-11T20:16:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82f7565b80 1 -- start start 2023-12-11T20:16:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d20210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d17830 0x55a5e7d28240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82f7565b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7d20870 con 0x55a5e7d18720 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82f7565b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7d21c00 con 0x55a5e7d16ed0 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82f7565b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7d17d20 con 0x55a5e7d17830 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82e219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82e219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58282/0 (socket says 172.21.15.12:58282) 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.561+0000 7f82e219c700 1 -- 172.21.15.12:0/3907297706 learned_addr learned my addr 172.21.15.12:0/3907297706 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e199b700 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d20210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e119a700 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d17830 0x55a5e7d28240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e219c700 1 -- 172.21.15.12:0/3907297706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d17830 msgr2=0x55a5e7d28240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e219c700 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d17830 0x55a5e7d28240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e219c700 1 -- 172.21.15.12:0/3907297706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d16ed0 msgr2=0x55a5e7d20210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e219c700 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d20210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e219c700 1 -- 172.21.15.12:0/3907297706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5e7a94d80 con 0x55a5e7d18720 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e119a700 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d17830 0x55a5e7d28240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82e219c700 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18b00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009230 tx=0x7f82d401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b8da94d54b2e0b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82d0bff700 1 -- 172.21.15.12:0/3907297706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4009260 con 0x55a5e7d18720 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82d0bff700 1 -- 172.21.15.12:0/3907297706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d400f050 con 0x55a5e7d18720 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.562+0000 7f82d0bff700 1 -- 172.21.15.12:0/3907297706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d401a5e0 con 0x55a5e7d18720 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 -- 172.21.15.12:0/3907297706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 msgr2=0x55a5e7d18b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18b00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009230 tx=0x7f82d401b000 comp rx=0 tx=0).stop 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 -- 172.21.15.12:0/3907297706 shutdown_connections 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d20210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d18720 0x55a5e7d18b00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 --2- 172.21.15.12:0/3907297706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d17830 0x55a5e7d28240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 -- 172.21.15.12:0/3907297706 >> 172.21.15.12:0/3907297706 conn(0x55a5e7c46780 msgr2=0x55a5e7d1eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 -- 172.21.15.12:0/3907297706 shutdown_connections 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.563+0000 7f82f7565b80 1 -- 172.21.15.12:0/3907297706 wait complete. 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 1 -- start start 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 1 Processor -- start 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d25f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d264b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d27470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7d279b0 con 0x55a5e7d17830 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7d27b20 con 0x55a5e7d18720 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5e7d27ce0 con 0x55a5e7d16ed0 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.564+0000 7f82f7565b80 10 client.0 _ll_register_callbacks cb 0x55a5e7b50a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d264b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d264b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58298/0 (socket says 172.21.15.12:58298) 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 -- 172.21.15.12:0/4266578316 learned_addr learned my addr 172.21.15.12:0/4266578316 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e199b700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d25f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e219c700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d27470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 -- 172.21.15.12:0/4266578316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 msgr2=0x55a5e7d25f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d25f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 -- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 msgr2=0x55a5e7d27470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d27470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 -- 172.21.15.12:0/4266578316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d40073e0 con 0x55a5e7d17830 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e199b700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d25f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e219c700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d27470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82e119a700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d264b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0054f0 tx=0x7f82cc009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f987d5b023a0e89d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.565+0000 7f82c57fa700 1 -- 172.21.15.12:0/4266578316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00b540 con 0x55a5e7d17830 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 1 -- 172.21.15.12:0/4266578316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82d809e090 con 0x55a5e7d17830 2023-12-11T20:16:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82c57fa700 1 -- 172.21.15.12:0/4266578316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82cc033080 con 0x55a5e7d17830 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82c57fa700 1 -- 172.21.15.12:0/4266578316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82cc009290 con 0x55a5e7d17830 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 10 client.15525 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 1 -- 172.21.15.12:0/4266578316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55a5e7a7dc00 con 0x55a5e7d17830 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82c57fa700 1 -- 172.21.15.12:0/4266578316 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82cc049080 con 0x55a5e7d17830 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82c57fa700 1 -- 172.21.15.12:0/4266578316 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f82cc035070 con 0x55a5e7d17830 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 10 client.15525 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 20 client.15525 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a5e7d83d50 0x55a5e7d86170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 4 client.15525 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.566+0000 7f82f7565b80 1 -- 172.21.15.12:0/4266578316 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a5e7c31f70 con 0x55a5e7d83d50 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.567+0000 7f82e199b700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a5e7d83d50 0x55a5e7d86170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.567+0000 7f82e199b700 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a5e7d83d50 0x55a5e7d86170 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9defe2dd689cf25 server_cookie=7a90cd4586e7ac8e in_seq=0 out_seq=0 2023-12-11T20:16:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.567+0000 7f82c57fa700 10 client.15525 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82c57fa700 1 -- 172.21.15.12:0/4266578316 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a5e7c31f70 con 0x55a5e7d83d50 2023-12-11T20:16:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82c57fa700 10 client.15525 handle_command_reply: tid=0 2023-12-11T20:16:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 client.15525 shutdown 2023-12-11T20:16:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 -- 172.21.15.12:0/4266578316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 msgr2=0x55a5e7d264b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d264b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0054f0 tx=0x7f82cc009f10 comp rx=0 tx=0).stop 2023-12-11T20:16:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 -- 172.21.15.12:0/4266578316 shutdown_connections 2023-12-11T20:16:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a5e7d83d50 0x55a5e7d86170 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a5e7d18720 0x55a5e7d27470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a5e7d16ed0 0x55a5e7d25f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 --2- 172.21.15.12:0/4266578316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a5e7d17830 0x55a5e7d264b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82c57fa700 0 client.15525 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 -- 172.21.15.12:0/4266578316 >> 172.21.15.12:0/4266578316 conn(0x55a5e7c46780 msgr2=0x55a5e7d13460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 -- 172.21.15.12:0/4266578316 shutdown_connections 2023-12-11T20:16:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.572+0000 7f82f7565b80 1 -- 172.21.15.12:0/4266578316 wait complete. 2023-12-11T20:16:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82f7565b80 20 client.15525 trim_cache size 0 max 16384 2023-12-11T20:16:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:16:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:16:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:16:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:16:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 -- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82c80a14f0 msgr2=0x7f82c80a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82c80a14f0 0x7f82c80a39b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009710 tx=0x7f82d4009bf0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 -- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1014d0 msgr2=0x7f82dc075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1014d0 0x7f82dc075330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f82d800d980 tx=0x7f82d800dd40 comp rx=0 tx=0).stop 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 -- 172.21.15.12:0/1450341921 shutdown_connections 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f82c80a14f0 0x7f82c80a39b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82dc103060 0x7f82dc073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82dc1014d0 0x7f82dc075330 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 --2- 172.21.15.12:0/1450341921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f82dc1026c0 0x7f82dc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 -- 172.21.15.12:0/1450341921 >> 172.21.15.12:0/1450341921 conn(0x7f82dc0fca60 msgr2=0x7f82dc105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 -- 172.21.15.12:0/1450341921 shutdown_connections 2023-12-11T20:16:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:10.573+0000 7f82e3bff700 1 -- 172.21.15.12:0/1450341921 wait complete. 2023-12-11T20:16:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:12 smithi032 ceph-mon[132488]: pgmap v383: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-11T20:16:12.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:12 smithi039 ceph-mon[102205]: pgmap v383: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-11T20:16:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:12 smithi012 ceph-mon[128787]: pgmap v383: 97 pgs: 97 active+clean; 657 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-11T20:16:14.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:14 smithi032 ceph-mon[132488]: pgmap v384: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-11T20:16:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:14 smithi039 ceph-mon[102205]: pgmap v384: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-11T20:16:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:14 smithi012 ceph-mon[128787]: pgmap v384: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-12-11T20:16:14.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:16:14.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2363855714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 msgr2=0x7f07b8102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2363855714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 0x7f07b8102b00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f07a80099c0 tx=0x7f07a8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2363855714 shutdown_connections 2023-12-11T20:16:14.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2363855714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07b8103040 0x7f07b81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2363855714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07b81014b0 0x7f07b81018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2363855714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 0x7f07b8102b00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2363855714 >> 172.21.15.12:0/2363855714 conn(0x7f07b80fca20 msgr2=0x7f07b80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:14.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2363855714 shutdown_connections 2023-12-11T20:16:14.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.888+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2363855714 wait complete. 2023-12-11T20:16:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.889+0000 7f07bf7ff700 1 Processor -- start 2023-12-11T20:16:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.889+0000 7f07bf7ff700 1 -- start start 2023-12-11T20:16:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bf7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07b81014b0 0x7f07b8075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bf7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 0x7f07b80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bf7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07b8103040 0x7f07b8073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bf7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80746a0 con 0x7f07b81026a0 2023-12-11T20:16:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bf7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b8074810 con 0x7f07b8103040 2023-12-11T20:16:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bf7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81a13e0 con 0x7f07b81014b0 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bcd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 0x7f07b80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bd59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07b81014b0 0x7f07b8075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bcd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 0x7f07b80739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58320/0 (socket says 172.21.15.12:58320) 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bcd9a700 1 -- 172.21.15.12:0/2812892551 learned_addr learned my addr 172.21.15.12:0/2812892551 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.890+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07b8103040 0x7f07b8073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bcd9a700 1 -- 172.21.15.12:0/2812892551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07b81014b0 msgr2=0x7f07b8075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07b81014b0 0x7f07b8075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bcd9a700 1 -- 172.21.15.12:0/2812892551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07b8103040 msgr2=0x7f07b8073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07b8103040 0x7f07b8073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bcd9a700 1 -- 172.21.15.12:0/2812892551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b0009c40 con 0x7f07b81026a0 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07b8103040 0x7f07b8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 0x7f07b80739c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f07a8000c00 tx=0x7f07a800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07ae7fc700 1 -- 172.21.15.12:0/2812892551 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a801d070 con 0x7f07b81026a0 2023-12-11T20:16:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2812892551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a80095f0 con 0x7f07b81026a0 2023-12-11T20:16:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07ae7fc700 1 -- 172.21.15.12:0/2812892551 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07a80054c0 con 0x7f07b81026a0 2023-12-11T20:16:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07ae7fc700 1 -- 172.21.15.12:0/2812892551 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8004bd0 con 0x7f07b81026a0 2023-12-11T20:16:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.891+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2812892551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b81a1850 con 0x7f07b81026a0 2023-12-11T20:16:14.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.896+0000 7f07d31ecb80 1 Processor -- start 2023-12-11T20:16:14.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.896+0000 7f07ae7fc700 1 -- 172.21.15.12:0/2812892551 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f07a800fc80 con 0x7f07b81026a0 2023-12-11T20:16:14.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.896+0000 7f07d31ecb80 1 -- start start 2023-12-11T20:16:14.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.896+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.896+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7f5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 0x555cfc7f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc74fb50 con 0x555cfc7f43d0 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc74d470 con 0x555cfc7f4d30 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc748d60 con 0x555cfc7f5c20 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bdd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bdd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58336/0 (socket says 172.21.15.12:58336) 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bdd9c700 1 -- 172.21.15.12:0/1553640086 learned_addr learned my addr 172.21.15.12:0/1553640086 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bd59b700 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 0x555cfc7f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bd59b700 1 -- 172.21.15.12:0/1553640086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 msgr2=0x555cfc7f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bd59b700 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 0x555cfc7f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bd59b700 1 -- 172.21.15.12:0/1553640086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 msgr2=0x555cfc7f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:14.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bd59b700 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.897+0000 7f07bd59b700 1 -- 172.21.15.12:0/1553640086 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cfc5c5630 con 0x555cfc7f4d30 2023-12-11T20:16:14.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.898+0000 7f07bd59b700 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7f5640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009c80 tx=0x7f07b4009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf39b8c9107f463 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:14.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.898+0000 7f07ae7fc700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07a40a1480 0x7f07a40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.898+0000 7f07a37fe700 1 -- 172.21.15.12:0/1553640086 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4011cb0 con 0x555cfc7f4d30 2023-12-11T20:16:14.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.898+0000 7f07ae7fc700 1 -- 172.21.15.12:0/2812892551 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f07a80cdb10 con 0x7f07b81026a0 2023-12-11T20:16:14.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.898+0000 7f07a37fe700 1 -- 172.21.15.12:0/1553640086 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07b4011e10 con 0x555cfc7f4d30 2023-12-11T20:16:14.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.898+0000 7f07a37fe700 1 -- 172.21.15.12:0/1553640086 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4005020 con 0x555cfc7f4d30 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.898+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07a40a1480 0x7f07a40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 -- 172.21.15.12:0/1553640086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 msgr2=0x555cfc7f5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7f5640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009c80 tx=0x7f07b4009f90 comp rx=0 tx=0).stop 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07a40a1480 0x7f07a40a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009fd0 tx=0x7f07b0009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 -- 172.21.15.12:0/1553640086 shutdown_connections 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 0x555cfc7f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/1553640086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7f5640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 -- 172.21.15.12:0/1553640086 >> 172.21.15.12:0/1553640086 conn(0x555cfc7237e0 msgr2=0x555cfc7f0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 -- 172.21.15.12:0/1553640086 shutdown_connections 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.899+0000 7f07d31ecb80 1 -- 172.21.15.12:0/1553640086 wait complete. 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.900+0000 7f07d31ecb80 1 -- start start 2023-12-11T20:16:14.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.900+0000 7f07d31ecb80 1 Processor -- start 2023-12-11T20:16:14.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc7fe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7fe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8056d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc702560 con 0x555cfc7f5c20 2023-12-11T20:16:14.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc702200 con 0x555cfc7f4d30 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc5c7920 con 0x555cfc7f43d0 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07d31ecb80 10 client.0 _ll_register_callbacks cb 0x555cfc62da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07bdd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07bdd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8056d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58344/0 (socket says 172.21.15.12:58344) 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07bd59b700 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc7fe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.901+0000 7f07bdd9c700 1 -- 172.21.15.12:0/3200466111 learned_addr learned my addr 172.21.15.12:0/3200466111 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07bdd9c700 1 -- 172.21.15.12:0/3200466111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 msgr2=0x555cfc7fe150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc7fe150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07bdd9c700 1 -- 172.21.15.12:0/3200466111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 msgr2=0x555cfc7fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07bdd9c700 1 -- 172.21.15.12:0/3200466111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b40098e0 con 0x555cfc7f5c20 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07bd59b700 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc7fe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:14.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8056d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f07b0016e00 tx=0x7f07b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4645cfef0996b6c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.902+0000 7f07a0ff9700 1 -- 172.21.15.12:0/3200466111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000e050 con 0x555cfc7f5c20 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3200466111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555cfc7e7b40 con 0x555cfc7f5c20 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07a0ff9700 1 -- 172.21.15.12:0/3200466111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f07b0015b00 con 0x555cfc7f5c20 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07a0ff9700 1 -- 172.21.15.12:0/3200466111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07b0015cc0 con 0x555cfc7f5c20 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 10 client.15537 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3200466111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x555cfc571de0 con 0x555cfc7f5c20 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07a0ff9700 1 -- 172.21.15.12:0/3200466111 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555cfc7e7b40 con 0x555cfc7f5c20 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07a0ff9700 1 -- 172.21.15.12:0/3200466111 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f07b00223a0 con 0x555cfc7f5c20 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 10 client.15537 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 20 client.15537 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555cfc809ff0 0x555cfc80c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 4 client.15537 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:14.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.903+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3200466111 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555cfc7c3f40 con 0x555cfc809ff0 2023-12-11T20:16:14.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.904+0000 7f07bd59b700 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555cfc809ff0 0x555cfc80c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.904+0000 7f07bd59b700 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555cfc809ff0 0x555cfc80c410 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bd62ef3e5f235cd server_cookie=89bedc81fc049c6a in_seq=0 out_seq=0 2023-12-11T20:16:14.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.904+0000 7f07a0ff9700 10 client.15537 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:14.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.905+0000 7f07a0ff9700 1 -- 172.21.15.12:0/3200466111 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555cfc7c3f40 con 0x555cfc809ff0 2023-12-11T20:16:14.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.905+0000 7f07a0ff9700 10 client.15537 handle_command_reply: tid=0 2023-12-11T20:16:14.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.905+0000 7f07d31ecb80 1 client.15537 shutdown 2023-12-11T20:16:14.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3200466111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 msgr2=0x555cfc8056d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8056d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f07b0016e00 tx=0x7f07b000b040 comp rx=0 tx=0).stop 2023-12-11T20:16:14.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3200466111 shutdown_connections 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555cfc809ff0 0x555cfc80c410 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8056d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc7fe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3200466111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc7fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07a0ff9700 0 client.15537 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3200466111 >> 172.21.15.12:0/3200466111 conn(0x555cfc7237e0 msgr2=0x555cfc7efa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3200466111 shutdown_connections 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3200466111 wait complete. 2023-12-11T20:16:14.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.906+0000 7f07d31ecb80 20 client.15537 trim_cache size 0 max 16384 2023-12-11T20:16:14.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.929+0000 7f07d31ecb80 1 Processor -- start 2023-12-11T20:16:14.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07d31ecb80 1 -- start start 2023-12-11T20:16:14.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc805690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 0x555cfc7fe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc811690 con 0x555cfc7f43d0 2023-12-11T20:16:14.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc7ebb50 con 0x555cfc7f4d30 2023-12-11T20:16:14.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc7fd100 con 0x555cfc7f5c20 2023-12-11T20:16:14.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07bd59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07bcd9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc805690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07bcd9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc805690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44672/0 (socket says 172.21.15.12:44672) 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07bd59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58346/0 (socket says 172.21.15.12:58346) 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07bcd9a700 1 -- 172.21.15.12:0/3050257334 learned_addr learned my addr 172.21.15.12:0/3050257334 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.930+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 0x555cfc7fe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07bcd9a700 1 -- 172.21.15.12:0/3050257334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 msgr2=0x555cfc7fe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 0x555cfc7fe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07bcd9a700 1 -- 172.21.15.12:0/3050257334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 msgr2=0x555cfc7f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07bcd9a700 1 -- 172.21.15.12:0/3050257334 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cfc55ac60 con 0x555cfc7f4d30 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07bd59b700 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc805690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07a8097880 tx=0x7f07a80d2040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe7ad34669ba9b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07a3fff700 1 -- 172.21.15.12:0/3050257334 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8097150 con 0x555cfc7f4d30 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07a3fff700 1 -- 172.21.15.12:0/3050257334 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07a809abe0 con 0x555cfc7f4d30 2023-12-11T20:16:14.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.931+0000 7f07a3fff700 1 -- 172.21.15.12:0/3050257334 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a809b580 con 0x555cfc7f4d30 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3050257334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 msgr2=0x555cfc805690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc805690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07a8097880 tx=0x7f07a80d2040 comp rx=0 tx=0).stop 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3050257334 shutdown_connections 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f5c20 0x555cfc7fe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f43d0 0x555cfc7f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/3050257334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc805690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3050257334 >> 172.21.15.12:0/3050257334 conn(0x555cfc7237e0 msgr2=0x555cfc7f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3050257334 shutdown_connections 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 -- 172.21.15.12:0/3050257334 wait complete. 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.932+0000 7f07d31ecb80 1 -- start start 2023-12-11T20:16:14.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07d31ecb80 1 Processor -- start 2023-12-11T20:16:14.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc801060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc8015a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07d31ecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8045c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc804b00 con 0x555cfc7f5c20 2023-12-11T20:16:14.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc804c70 con 0x555cfc7f4d30 2023-12-11T20:16:14.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07d31ecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cfc804e30 con 0x555cfc7f43d0 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07d31ecb80 10 client.0 _ll_register_callbacks cb 0x555cfc62da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.933+0000 7f07bdd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bdd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8045c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58356/0 (socket says 172.21.15.12:58356) 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bdd9c700 1 -- 172.21.15.12:0/2889645038 learned_addr learned my addr 172.21.15.12:0/2889645038 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bcd9a700 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc8015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bd59b700 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc801060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bdd9c700 1 -- 172.21.15.12:0/2889645038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 msgr2=0x555cfc801060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc801060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bdd9c700 1 -- 172.21.15.12:0/2889645038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 msgr2=0x555cfc8015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc8015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bdd9c700 1 -- 172.21.15.12:0/2889645038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b401d040 con 0x555cfc7f5c20 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07bdd9c700 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8045c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b010 tx=0x7f07b0004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf21540fedc3032 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.934+0000 7f07a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07a0ff9700 1 -- 172.21.15.12:0/2889645038 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000e040 con 0x555cfc7f5c20 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07d31ecb80 1 -- 172.21.15.12:0/2889645038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07b4011e10 con 0x555cfc7f5c20 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07a0ff9700 1 -- 172.21.15.12:0/2889645038 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f07b0015d60 con 0x555cfc7f5c20 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07a0ff9700 1 -- 172.21.15.12:0/2889645038 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07b0007e80 con 0x555cfc7f5c20 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07d31ecb80 10 client.15543 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07d31ecb80 1 -- 172.21.15.12:0/2889645038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f07b81a1850 con 0x555cfc7f5c20 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07a0ff9700 1 -- 172.21.15.12:0/2889645038 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07b4011e10 con 0x555cfc7f5c20 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07a0ff9700 1 -- 172.21.15.12:0/2889645038 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f07b0037780 con 0x555cfc7f5c20 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07d31ecb80 10 client.15543 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07d31ecb80 10 client.15543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07d31ecb80 20 client.15543 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555cfc860f20 0x555cfc863340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.935+0000 7f07d31ecb80 4 client.15543 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.936+0000 7f07d31ecb80 1 -- 172.21.15.12:0/2889645038 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555cfc70efd0 con 0x555cfc860f20 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.936+0000 7f07bd59b700 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555cfc860f20 0x555cfc863340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.936+0000 7f07bd59b700 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555cfc860f20 0x555cfc863340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbb417bb6a36de2 server_cookie=da75ed68fe96cbed in_seq=0 out_seq=0 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.936+0000 7f07a0ff9700 10 client.15543 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07a0ff9700 1 -- 172.21.15.12:0/2889645038 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555cfc70efd0 con 0x555cfc860f20 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07a0ff9700 10 client.15543 handle_command_reply: tid=0 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 client.15543 shutdown 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 -- 172.21.15.12:0/2889645038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 msgr2=0x555cfc8045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8045c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b010 tx=0x7f07b0004df0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 -- 172.21.15.12:0/2889645038 shutdown_connections 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555cfc860f20 0x555cfc863340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555cfc7f5c20 0x555cfc8045c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555cfc7f43d0 0x555cfc801060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 --2- 172.21.15.12:0/2889645038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555cfc7f4d30 0x555cfc8015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07a0ff9700 0 client.15543 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 -- 172.21.15.12:0/2889645038 >> 172.21.15.12:0/2889645038 conn(0x555cfc7237e0 msgr2=0x555cfc7fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 -- 172.21.15.12:0/2889645038 shutdown_connections 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 1 -- 172.21.15.12:0/2889645038 wait complete. 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.937+0000 7f07d31ecb80 20 client.15543 trim_cache size 0 max 16384 2023-12-11T20:16:14.941 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:16:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:16:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:16:14.942 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:16:14.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07a40a1480 msgr2=0x7f07a40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07a40a1480 0x7f07a40a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009fd0 tx=0x7f07b0009040 comp rx=0 tx=0).stop 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 msgr2=0x7f07b80739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 0x7f07b80739c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f07a8000c00 tx=0x7f07a800f690 comp rx=0 tx=0).stop 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2812892551 shutdown_connections 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07a40a1480 0x7f07a40a3940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07b8103040 0x7f07b8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07b81014b0 0x7f07b8075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 --2- 172.21.15.12:0/2812892551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b81026a0 0x7f07b80739c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2812892551 >> 172.21.15.12:0/2812892551 conn(0x7f07b80fca20 msgr2=0x7f07b8105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2812892551 shutdown_connections 2023-12-11T20:16:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:14.938+0000 7f07bf7ff700 1 -- 172.21.15.12:0/2812892551 wait complete. 2023-12-11T20:16:14.958 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:16:14.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:16:15.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 -- 172.21.15.12:0/1792071947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 msgr2=0x7f56600744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 --2- 172.21.15.12:0/1792071947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 0x7f56600744b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5654009990 tx=0x7f5654009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 -- 172.21.15.12:0/1792071947 shutdown_connections 2023-12-11T20:16:15.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 --2- 172.21.15.12:0/1792071947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f566010da70 0x7f566010fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 --2- 172.21.15.12:0/1792071947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5660075610 0x7f5660073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 --2- 172.21.15.12:0/1792071947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 0x7f56600744b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 -- 172.21.15.12:0/1792071947 >> 172.21.15.12:0/1792071947 conn(0x7f56600fca10 msgr2=0x7f56600fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:15.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 -- 172.21.15.12:0/1792071947 shutdown_connections 2023-12-11T20:16:15.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.173+0000 7f56667ff700 1 -- 172.21.15.12:0/1792071947 wait complete. 2023-12-11T20:16:15.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.174+0000 7f56667ff700 1 Processor -- start 2023-12-11T20:16:15.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f56667ff700 1 -- start start 2023-12-11T20:16:15.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f56667ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 0x7f566019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f56667ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5660075610 0x7f566019deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f56667ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f566010da70 0x7f56601a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f56667ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56601a54a0 con 0x7f5660074030 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f56667ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56601a55e0 con 0x7f5660075610 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f56667ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56601a5770 con 0x7f566010da70 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f565ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 0x7f566019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f565ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 0x7f566019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58366/0 (socket says 172.21.15.12:58366) 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.175+0000 7f565ffff700 1 -- 172.21.15.12:0/807418596 learned_addr learned my addr 172.21.15.12:0/807418596 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f565f7fe700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5660075610 0x7f566019deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f5664d9c700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f566010da70 0x7f56601a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f565ffff700 1 -- 172.21.15.12:0/807418596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f566010da70 msgr2=0x7f56601a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f565ffff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f566010da70 0x7f56601a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f565ffff700 1 -- 172.21.15.12:0/807418596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5660075610 msgr2=0x7f566019deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f565ffff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5660075610 0x7f566019deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f565ffff700 1 -- 172.21.15.12:0/807418596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56540095f0 con 0x7f5660074030 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f565f7fe700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5660075610 0x7f566019deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.176+0000 7f565ffff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 0x7f566019d970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f565000d950 tx=0x7f565000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.177+0000 7f565d7fa700 1 -- 172.21.15.12:0/807418596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000f890 con 0x7f5660074030 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.177+0000 7f565d7fa700 1 -- 172.21.15.12:0/807418596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f565000fe80 con 0x7f5660074030 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.177+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56601a5a50 con 0x7f5660074030 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.177+0000 7f565d7fa700 1 -- 172.21.15.12:0/807418596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000e3b0 con 0x7f5660074030 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.177+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56601a5fb0 con 0x7f5660074030 2023-12-11T20:16:15.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.178+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5660103cd0 con 0x7f5660074030 2023-12-11T20:16:15.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.180+0000 7f565d7fa700 1 -- 172.21.15.12:0/807418596 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5650010460 con 0x7f5660074030 2023-12-11T20:16:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.182+0000 7f565d7fa700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56480a1500 0x7f56480a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.183+0000 7f565d7fa700 1 -- 172.21.15.12:0/807418596 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f56500ccaf0 con 0x7f5660074030 2023-12-11T20:16:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.183+0000 7f565f7fe700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56480a1500 0x7f56480a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.183+0000 7f565f7fe700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56480a1500 0x7f56480a39c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5654000c00 tx=0x7f5654005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:15.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.186+0000 7f565d7fa700 1 -- 172.21.15.12:0/807418596 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f56500960a0 con 0x7f5660074030 2023-12-11T20:16:15.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.478+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5660068330 con 0x7f5660074030 2023-12-11T20:16:15.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.479+0000 7f565d7fa700 1 -- 172.21.15.12:0/807418596 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f5650016090 con 0x7f5660074030 2023-12-11T20:16:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:16:15.478 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56480a1500 msgr2=0x7f56480a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56480a1500 0x7f56480a39c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5654000c00 tx=0x7f5654005fb0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 msgr2=0x7f566019d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 0x7f566019d970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f565000d950 tx=0x7f565000dc60 comp rx=0 tx=0).stop 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 shutdown_connections 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f56480a1500 0x7f56480a39c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f566010da70 0x7f56601a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5660074030 0x7f566019d970 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 --2- 172.21.15.12:0/807418596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5660075610 0x7f566019deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 >> 172.21.15.12:0/807418596 conn(0x7f56600fca10 msgr2=0x7f5660100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 shutdown_connections 2023-12-11T20:16:15.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.482+0000 7f56667ff700 1 -- 172.21.15.12:0/807418596 wait complete. 2023-12-11T20:16:15.482 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:16:15.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:16:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 -- 172.21.15.12:0/2615764567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4075610 msgr2=0x7f11e4073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 --2- 172.21.15.12:0/2615764567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4075610 0x7f11e4073a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009990 tx=0x7f11d4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 -- 172.21.15.12:0/2615764567 shutdown_connections 2023-12-11T20:16:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 --2- 172.21.15.12:0/2615764567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e410da80 0x7f11e410fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 --2- 172.21.15.12:0/2615764567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4075610 0x7f11e4073a60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 --2- 172.21.15.12:0/2615764567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e4074030 0x7f11e40744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 -- 172.21.15.12:0/2615764567 >> 172.21.15.12:0/2615764567 conn(0x7f11e40fca20 msgr2=0x7f11e40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:15.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 -- 172.21.15.12:0/2615764567 shutdown_connections 2023-12-11T20:16:15.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.718+0000 7f11e9bff700 1 -- 172.21.15.12:0/2615764567 wait complete. 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.719+0000 7f11e9bff700 1 Processor -- start 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.719+0000 7f11e9bff700 1 -- start start 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.719+0000 7f11e9bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4074030 0x7f11e419d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.719+0000 7f11e9bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e4075610 0x7f11e419df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.719+0000 7f11e9bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e410da80 0x7f11e41a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.719+0000 7f11e9bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e41a54b0 con 0x7f11e4075610 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.719+0000 7f11e9bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e41a55f0 con 0x7f11e410da80 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.719+0000 7f11e9bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e41a5780 con 0x7f11e4074030 2023-12-11T20:16:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e4075610 0x7f11e419df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4074030 0x7f11e419d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e4075610 0x7f11e419df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58386/0 (socket says 172.21.15.12:58386) 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 -- 172.21.15.12:0/4081839534 learned_addr learned my addr 172.21.15.12:0/4081839534 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e3fff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e410da80 0x7f11e41a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 -- 172.21.15.12:0/4081839534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4074030 msgr2=0x7f11e419d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4074030 0x7f11e419d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 -- 172.21.15.12:0/4081839534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e410da80 msgr2=0x7f11e41a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e410da80 0x7f11e41a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 -- 172.21.15.12:0/4081839534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40095f0 con 0x7f11e4075610 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e37fe700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4074030 0x7f11e419d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.720+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e4075610 0x7f11e419df10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f11d800e970 tx=0x7f11d800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.721+0000 7f11e0ff9700 1 -- 172.21.15.12:0/4081839534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8009790 con 0x7f11e4075610 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.721+0000 7f11e0ff9700 1 -- 172.21.15.12:0/4081839534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11d800c7e0 con 0x7f11e4075610 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.721+0000 7f11e9bff700 1 -- 172.21.15.12:0/4081839534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e41a5a60 con 0x7f11e4075610 2023-12-11T20:16:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.721+0000 7f11e0ff9700 1 -- 172.21.15.12:0/4081839534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8003bd0 con 0x7f11e4075610 2023-12-11T20:16:15.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.721+0000 7f11e9bff700 1 -- 172.21.15.12:0/4081839534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e41a5fc0 con 0x7f11e4075610 2023-12-11T20:16:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.724+0000 7f11e0ff9700 1 -- 172.21.15.12:0/4081839534 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f11d800c950 con 0x7f11e4075610 2023-12-11T20:16:15.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11fd52eb80 1 Processor -- start 2023-12-11T20:16:15.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11e0ff9700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11cc0a1500 0x7f11cc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11fd52eb80 1 -- start start 2023-12-11T20:16:15.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11e0ff9700 1 -- 172.21.15.12:0/4081839534 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11d8014070 con 0x7f11e4075610 2023-12-11T20:16:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11e3fff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11cc0a1500 0x7f11cc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6f3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f64db50 con 0x55ca6f6f23d0 2023-12-11T20:16:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f64b470 con 0x55ca6f6f3c20 2023-12-11T20:16:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f646d60 con 0x55ca6f6f2d30 2023-12-11T20:16:15.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.726+0000 7f11e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58396/0 (socket says 172.21.15.12:58396) 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e37fe700 1 -- 172.21.15.12:0/4165802156 learned_addr learned my addr 172.21.15.12:0/4165802156 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e3fff700 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e37fe700 1 -- 172.21.15.12:0/4165802156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f2d30 msgr2=0x55ca6f6f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e37fe700 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e37fe700 1 -- 172.21.15.12:0/4165802156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 msgr2=0x55ca6f6f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e37fe700 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e37fe700 1 -- 172.21.15.12:0/4165802156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca6f4c3630 con 0x55ca6f6f23d0 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e3fff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11cc0a1500 0x7f11cc0a39c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00f540 tx=0x7f11dc009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.727+0000 7f11e37fe700 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6f27f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009990 tx=0x7f11d4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0edf0c286fe761c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11c9ffb700 1 -- 172.21.15.12:0/4165802156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d401d050 con 0x55ca6f6f23d0 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11c9ffb700 1 -- 172.21.15.12:0/4165802156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11d401e040 con 0x55ca6f6f23d0 2023-12-11T20:16:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11c9ffb700 1 -- 172.21.15.12:0/4165802156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4005030 con 0x55ca6f6f23d0 2023-12-11T20:16:15.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4165802156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 msgr2=0x55ca6f6f27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6f27f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009990 tx=0x7f11d4005e80 comp rx=0 tx=0).stop 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4165802156 shutdown_connections 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6f27f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4165802156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.728+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4165802156 >> 172.21.15.12:0/4165802156 conn(0x55ca6f6217e0 msgr2=0x55ca6f6eed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.729+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4165802156 shutdown_connections 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.729+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4165802156 wait complete. 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.729+0000 7f11fd52eb80 1 -- start start 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.729+0000 7f11fd52eb80 1 Processor -- start 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6fc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 0x55ca6f7036d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f600560 con 0x55ca6f6f2d30 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f600200 con 0x55ca6f6f23d0 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f4c5920 con 0x55ca6f6f3c20 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11fd52eb80 10 client.0 _ll_register_callbacks cb 0x55ca6f52ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58406/0 (socket says 172.21.15.12:58406) 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11e2ffd700 1 -- 172.21.15.12:0/4238027898 learned_addr learned my addr 172.21.15.12:0/4238027898 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11e37fe700 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.730+0000 7f11e3fff700 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 0x55ca6f7036d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11e2ffd700 1 -- 172.21.15.12:0/4238027898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 msgr2=0x55ca6f7036d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 0x55ca6f7036d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11e2ffd700 1 -- 172.21.15.12:0/4238027898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 msgr2=0x55ca6f6fc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11e2ffd700 1 -- 172.21.15.12:0/4238027898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e4110820 con 0x55ca6f6f2d30 2023-12-11T20:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6fc690 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f11d800cc00 tx=0x7f11d800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51adb4817f95cc50 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11c2ffd700 1 -- 172.21.15.12:0/4238027898 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d809a1e0 con 0x55ca6f6f2d30 2023-12-11T20:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4238027898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca6f6e5b40 con 0x55ca6f6f2d30 2023-12-11T20:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11c2ffd700 1 -- 172.21.15.12:0/4238027898 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11d809e2d0 con 0x55ca6f6f2d30 2023-12-11T20:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11c2ffd700 1 -- 172.21.15.12:0/4238027898 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11d80a2510 con 0x55ca6f6f2d30 2023-12-11T20:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11fd52eb80 10 client.15561 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.731+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4238027898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ca6f46fde0 con 0x55ca6f6f2d30 2023-12-11T20:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11c2ffd700 1 -- 172.21.15.12:0/4238027898 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ca6f6e5b40 con 0x55ca6f6f2d30 2023-12-11T20:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11c2ffd700 1 -- 172.21.15.12:0/4238027898 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11d807e020 con 0x55ca6f6f2d30 2023-12-11T20:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11fd52eb80 10 client.15561 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11fd52eb80 10 client.15561 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11fd52eb80 20 client.15561 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ca6f707fd0 0x55ca6f70a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11fd52eb80 4 client.15561 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4238027898 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca6f6c1f40 con 0x55ca6f707fd0 2023-12-11T20:16:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.732+0000 7f11e37fe700 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ca6f707fd0 0x55ca6f70a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.733+0000 7f11e37fe700 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ca6f707fd0 0x55ca6f70a3f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39d96070753030a8 server_cookie=7e02a69c4808083d in_seq=0 out_seq=0 2023-12-11T20:16:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.733+0000 7f11c2ffd700 10 client.15561 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:16:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11c2ffd700 1 -- 172.21.15.12:0/4238027898 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ca6f6c1f40 con 0x55ca6f707fd0 2023-12-11T20:16:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11c2ffd700 10 client.15561 handle_command_reply: tid=0 2023-12-11T20:16:15.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 client.15561 shutdown 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4238027898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f2d30 msgr2=0x55ca6f6fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6fc690 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f11d800cc00 tx=0x7f11d800ccd0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4238027898 shutdown_connections 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ca6f707fd0 0x55ca6f70a3f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 0x55ca6f7036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/4238027898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f2d30 0x55ca6f6fc690 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11c2ffd700 0 client.15561 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.734+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4238027898 >> 172.21.15.12:0/4238027898 conn(0x55ca6f6217e0 msgr2=0x55ca6f6eda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.735+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4238027898 shutdown_connections 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.735+0000 7f11fd52eb80 1 -- 172.21.15.12:0/4238027898 wait complete. 2023-12-11T20:16:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.735+0000 7f11fd52eb80 20 client.15561 trim_cache size 0 max 16384 2023-12-11T20:16:15.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.749+0000 7f11fd52eb80 1 Processor -- start 2023-12-11T20:16:15.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.749+0000 7f11fd52eb80 1 -- start start 2023-12-11T20:16:15.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.749+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.749+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 0x55ca6f703690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.749+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f7240 0x55ca6f6fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.749+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f6f3110 con 0x55ca6f6f7240 2023-12-11T20:16:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.749+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f6e9b50 con 0x55ca6f6f23d0 2023-12-11T20:16:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.749+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f70f600 con 0x55ca6f6f3c20 2023-12-11T20:16:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f7240 0x55ca6f6fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f7240 0x55ca6f6fc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58418/0 (socket says 172.21.15.12:58418) 2023-12-11T20:16:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e3fff700 1 -- 172.21.15.12:0/156795193 learned_addr learned my addr 172.21.15.12:0/156795193 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/156795193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 0x55ca6f703690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e37fe700 1 -- 172.21.15.12:0/156795193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 msgr2=0x55ca6f703690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e37fe700 1 --2- 172.21.15.12:0/156795193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 0x55ca6f703690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e37fe700 1 -- 172.21.15.12:0/156795193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f7240 msgr2=0x55ca6f6fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e37fe700 1 --2- 172.21.15.12:0/156795193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f7240 0x55ca6f6fc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e37fe700 1 -- 172.21.15.12:0/156795193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca6f458c60 con 0x55ca6f6f23d0 2023-12-11T20:16:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.750+0000 7f11e37fe700 1 --2- 172.21.15.12:0/156795193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fb660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11d40098e0 tx=0x7f11d401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7debe4d61c818d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:15.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11ca7fc700 1 -- 172.21.15.12:0/156795193 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4033070 con 0x55ca6f6f23d0 2023-12-11T20:16:15.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11ca7fc700 1 -- 172.21.15.12:0/156795193 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11d4005910 con 0x55ca6f6f23d0 2023-12-11T20:16:15.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11ca7fc700 1 -- 172.21.15.12:0/156795193 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40344b0 con 0x55ca6f6f23d0 2023-12-11T20:16:15.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11fd52eb80 1 -- 172.21.15.12:0/156795193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 msgr2=0x55ca6f6fb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/156795193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fb660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11d40098e0 tx=0x7f11d401a040 comp rx=0 tx=0).stop 2023-12-11T20:16:15.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11fd52eb80 1 -- 172.21.15.12:0/156795193 shutdown_connections 2023-12-11T20:16:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/156795193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6fb660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/156795193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f7240 0x55ca6f6fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/156795193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f3c20 0x55ca6f703690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.751+0000 7f11fd52eb80 1 -- 172.21.15.12:0/156795193 >> 172.21.15.12:0/156795193 conn(0x55ca6f6217e0 msgr2=0x55ca6f6f6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.752+0000 7f11fd52eb80 1 -- 172.21.15.12:0/156795193 shutdown_connections 2023-12-11T20:16:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.752+0000 7f11fd52eb80 1 -- 172.21.15.12:0/156795193 wait complete. 2023-12-11T20:16:15.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.752+0000 7f11fd52eb80 1 -- start start 2023-12-11T20:16:15.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.752+0000 7f11fd52eb80 1 Processor -- start 2023-12-11T20:16:15.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6ff290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6ff7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11fd52eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f7240 0x55ca6f7027a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f702ce0 con 0x55ca6f6f23d0 2023-12-11T20:16:15.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f702e50 con 0x55ca6f6f3c20 2023-12-11T20:16:15.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11fd52eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6f703010 con 0x55ca6f6f7240 2023-12-11T20:16:15.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11fd52eb80 10 client.0 _ll_register_callbacks cb 0x55ca6f52ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:15.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6ff290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6ff7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6ff7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44756/0 (socket says 172.21.15.12:44756) 2023-12-11T20:16:15.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e2ffd700 1 -- 172.21.15.12:0/41259094 learned_addr learned my addr 172.21.15.12:0/41259094 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e3fff700 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f7240 0x55ca6f7027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e2ffd700 1 -- 172.21.15.12:0/41259094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f7240 msgr2=0x55ca6f7027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f7240 0x55ca6f7027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e2ffd700 1 -- 172.21.15.12:0/41259094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 msgr2=0x55ca6f6ff290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.753+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6ff290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11e2ffd700 1 -- 172.21.15.12:0/41259094 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca6f4c3630 con 0x55ca6f6f3c20 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11e2ffd700 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6ff7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f11d80a1fe0 tx=0x7f11d8003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e8c6202aabe8dc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11c2ffd700 1 -- 172.21.15.12:0/41259094 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d809a880 con 0x55ca6f6f3c20 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11c2ffd700 1 -- 172.21.15.12:0/41259094 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11d807c050 con 0x55ca6f6f3c20 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11fd52eb80 1 -- 172.21.15.12:0/41259094 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11d401e040 con 0x55ca6f6f3c20 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11c2ffd700 1 -- 172.21.15.12:0/41259094 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11d809e2d0 con 0x55ca6f6f3c20 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11fd52eb80 10 client.25382 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.754+0000 7f11fd52eb80 1 -- 172.21.15.12:0/41259094 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ca6f496250 con 0x55ca6f6f3c20 2023-12-11T20:16:15.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11c2ffd700 1 -- 172.21.15.12:0/41259094 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11d401e040 con 0x55ca6f6f3c20 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11c2ffd700 1 -- 172.21.15.12:0/41259094 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11d807e040 con 0x55ca6f6f3c20 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11fd52eb80 10 client.25382 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11fd52eb80 10 client.25382 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11fd52eb80 20 client.25382 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ca6f75ecf0 0x55ca6f7610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11fd52eb80 4 client.25382 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11fd52eb80 1 -- 172.21.15.12:0/41259094 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ca6f60cfd0 con 0x55ca6f75ecf0 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.755+0000 7f11e37fe700 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ca6f75ecf0 0x55ca6f7610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11e37fe700 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ca6f75ecf0 0x55ca6f7610e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf4a3a7a47646851 server_cookie=3311dfb0e8a2f3d9 in_seq=0 out_seq=0 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11c2ffd700 10 client.25382 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11c2ffd700 1 -- 172.21.15.12:0/41259094 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ca6f60cfd0 con 0x55ca6f75ecf0 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11c2ffd700 10 client.25382 handle_command_reply: tid=0 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 client.25382 shutdown 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 -- 172.21.15.12:0/41259094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 msgr2=0x55ca6f6ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6ff7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f11d80a1fe0 tx=0x7f11d8003680 comp rx=0 tx=0).stop 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 -- 172.21.15.12:0/41259094 shutdown_connections 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ca6f75ecf0 0x55ca6f7610e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ca6f6f7240 0x55ca6f7027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca6f6f23d0 0x55ca6f6ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11c2ffd700 0 client.25382 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 --2- 172.21.15.12:0/41259094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ca6f6f3c20 0x55ca6f6ff7d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 -- 172.21.15.12:0/41259094 >> 172.21.15.12:0/41259094 conn(0x55ca6f6217e0 msgr2=0x55ca6f6ee970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.756+0000 7f11fd52eb80 1 -- 172.21.15.12:0/41259094 shutdown_connections 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.757+0000 7f11fd52eb80 1 -- 172.21.15.12:0/41259094 wait complete. 2023-12-11T20:16:15.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.757+0000 7f11fd52eb80 20 client.25382 trim_cache size 0 max 16384 2023-12-11T20:16:15.767 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:16:15.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.757+0000 7f11e9bff700 1 -- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11cc0a1500 msgr2=0x7f11cc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.757+0000 7f11e9bff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11cc0a1500 0x7f11cc0a39c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00f540 tx=0x7f11dc009920 comp rx=0 tx=0).stop 2023-12-11T20:16:15.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.757+0000 7f11e9bff700 1 -- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e4075610 msgr2=0x7f11e419df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:15.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.757+0000 7f11e9bff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e4075610 0x7f11e419df10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f11d800e970 tx=0x7f11d800ec80 comp rx=0 tx=0).stop 2023-12-11T20:16:15.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.758+0000 7f11e9bff700 1 -- 172.21.15.12:0/4081839534 shutdown_connections 2023-12-11T20:16:15.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.758+0000 7f11e9bff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11cc0a1500 0x7f11cc0a39c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.758+0000 7f11e9bff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11e410da80 0x7f11e41a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.758+0000 7f11e9bff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11e4074030 0x7f11e419d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.758+0000 7f11e9bff700 1 --2- 172.21.15.12:0/4081839534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e4075610 0x7f11e419df10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:15.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.758+0000 7f11e9bff700 1 -- 172.21.15.12:0/4081839534 >> 172.21.15.12:0/4081839534 conn(0x7f11e40fca20 msgr2=0x7f11e4100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:15.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.758+0000 7f11e9bff700 1 -- 172.21.15.12:0/4081839534 shutdown_connections 2023-12-11T20:16:15.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:15.758+0000 7f11e9bff700 1 -- 172.21.15.12:0/4081839534 wait complete. 2023-12-11T20:16:15.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:16:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 -- 172.21.15.12:0/1678545946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8103040 msgr2=0x7fb8d81098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/1678545946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8103040 0x7fb8d81098f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b0d0 tx=0x7fb8d000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 -- 172.21.15.12:0/1678545946 shutdown_connections 2023-12-11T20:16:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/1678545946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8d81014b0 0x7fb8d81018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/1678545946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8103040 0x7fb8d81098f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/1678545946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8d81026a0 0x7fb8d8102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 -- 172.21.15.12:0/1678545946 >> 172.21.15.12:0/1678545946 conn(0x7fb8d80fca00 msgr2=0x7fb8d80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 -- 172.21.15.12:0/1678545946 shutdown_connections 2023-12-11T20:16:16.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.006+0000 7fb8e05ff700 1 -- 172.21.15.12:0/1678545946 wait complete. 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.007+0000 7fb8e05ff700 1 Processor -- start 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.007+0000 7fb8e05ff700 1 -- start start 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.007+0000 7fb8e05ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d81014b0 0x7fb8d80752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.007+0000 7fb8e05ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8d81026a0 0x7fb8d80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.007+0000 7fb8e05ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8d8103040 0x7fb8d8073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.007+0000 7fb8e05ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8074600 con 0x7fb8d81014b0 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.007+0000 7fb8e05ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8074770 con 0x7fb8d81026a0 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.007+0000 7fb8e05ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d81a14c0 con 0x7fb8d8103040 2023-12-11T20:16:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8ddb9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8d81026a0 0x7fb8d80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8de39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d81014b0 0x7fb8d80752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8ddb9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8d81026a0 0x7fb8d80739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44768/0 (socket says 172.21.15.12:44768) 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/2174148979 learned_addr learned my addr 172.21.15.12:0/2174148979 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8d8103040 0x7fb8d8073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/2174148979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8d8103040 msgr2=0x7fb8d8073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8d8103040 0x7fb8d8073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d81014b0 msgr2=0x7fb8d80752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d81014b0 0x7fb8d80752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.008+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/2174148979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c8009520 con 0x7fb8d81026a0 2023-12-11T20:16:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.009+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8d81026a0 0x7fb8d80739c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800eb30 tx=0x7fb8c800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.009+0000 7fb8cf7fe700 1 -- 172.21.15.12:0/2174148979 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8009880 con 0x7fb8d81026a0 2023-12-11T20:16:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.009+0000 7fb8cf7fe700 1 -- 172.21.15.12:0/2174148979 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8c80044b0 con 0x7fb8d81026a0 2023-12-11T20:16:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.009+0000 7fb8e05ff700 1 -- 172.21.15.12:0/2174148979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d0009d00 con 0x7fb8d81026a0 2023-12-11T20:16:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.009+0000 7fb8cf7fe700 1 -- 172.21.15.12:0/2174148979 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8003df0 con 0x7fb8d81026a0 2023-12-11T20:16:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.009+0000 7fb8e05ff700 1 -- 172.21.15.12:0/2174148979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d81a1aa0 con 0x7fb8d81026a0 2023-12-11T20:16:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.013+0000 7fb8cf7fe700 1 -- 172.21.15.12:0/2174148979 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb8c8003f50 con 0x7fb8d81026a0 2023-12-11T20:16:16.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8f3fb2b80 1 Processor -- start 2023-12-11T20:16:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8f3fb2b80 1 -- start start 2023-12-11T20:16:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8cf7fe700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8c40a1480 0x7fb8c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 0x55d1745ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d174514b50 con 0x55d1745bac20 2023-12-11T20:16:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d174512470 con 0x55d1745b9d30 2023-12-11T20:16:16.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.014+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17450dd60 con 0x55d1745b93d0 2023-12-11T20:16:16.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8cf7fe700 1 -- 172.21.15.12:0/2174148979 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb8c8014070 con 0x7fb8d81026a0 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8c40a1480 0x7fb8c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8de39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8de39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60908/0 (socket says 172.21.15.12:60908) 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8de39b700 1 -- 172.21.15.12:0/1923016757 learned_addr learned my addr 172.21.15.12:0/1923016757 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/1923016757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 0x55d1745ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8de39b700 1 -- 172.21.15.12:0/1923016757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 msgr2=0x55d1745ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8de39b700 1 --2- 172.21.15.12:0/1923016757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 0x55d1745ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8de39b700 1 -- 172.21.15.12:0/1923016757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 msgr2=0x55d1745bb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8de39b700 1 --2- 172.21.15.12:0/1923016757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.015+0000 7fb8de39b700 1 -- 172.21.15.12:0/1923016757 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d17438a630 con 0x55d1745b93d0 2023-12-11T20:16:16.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.016+0000 7fb8de39b700 1 --2- 172.21.15.12:0/1923016757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745b97f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009d30 tx=0x7fb8d4011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e6b4bcf32cf7956 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.016+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8c40a1480 0x7fb8c40a3940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009850 tx=0x7fb8d00097a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.016+0000 7fb8ccbfe700 1 -- 172.21.15.12:0/1923016757 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4004220 con 0x55d1745b93d0 2023-12-11T20:16:16.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.016+0000 7fb8ccbfe700 1 -- 172.21.15.12:0/1923016757 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8d4004380 con 0x55d1745b93d0 2023-12-11T20:16:16.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.016+0000 7fb8ccbfe700 1 -- 172.21.15.12:0/1923016757 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40197a0 con 0x55d1745b93d0 2023-12-11T20:16:16.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/1923016757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 msgr2=0x55d1745b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/1923016757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745b97f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009d30 tx=0x7fb8d4011720 comp rx=0 tx=0).stop 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/1923016757 shutdown_connections 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/1923016757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745bb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/1923016757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745b97f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/1923016757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 0x55d1745ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/1923016757 >> 172.21.15.12:0/1923016757 conn(0x55d1744e87e0 msgr2=0x55d1745b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/1923016757 shutdown_connections 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.017+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/1923016757 wait complete. 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 1 -- start start 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 1 Processor -- start 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 0x55d1745c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1744c7560 con 0x55d1745bac20 2023-12-11T20:16:16.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1744c7200 con 0x55d1745b9d30 2023-12-11T20:16:16.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17438c920 con 0x55d1745b93d0 2023-12-11T20:16:16.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.018+0000 7fb8f3fb2b80 10 client.0 _ll_register_callbacks cb 0x55d1743f2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:16.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58460/0 (socket says 172.21.15.12:58460) 2023-12-11T20:16:16.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 -- 172.21.15.12:0/2035329979 learned_addr learned my addr 172.21.15.12:0/2035329979 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8de39b700 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 -- 172.21.15.12:0/2035329979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 msgr2=0x55d1745c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 -- 172.21.15.12:0/2035329979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 msgr2=0x55d1745c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 0x55d1745c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 -- 172.21.15.12:0/2035329979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d4009960 con 0x55d1745bac20 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745ca6f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b0d0 tx=0x7fb8d00099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b5e7ada4268284 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.019+0000 7fb8c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.020+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/2035329979 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0022040 con 0x55d1745bac20 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.020+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2035329979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1745acb40 con 0x55d1745bac20 2023-12-11T20:16:16.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.020+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/2035329979 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb8d0005070 con 0x55d1745bac20 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.020+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/2035329979 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8d000e050 con 0x55d1745bac20 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.020+0000 7fb8f3fb2b80 10 client.15576 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.020+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2035329979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d174336de0 con 0x55d1745bac20 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.020+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/2035329979 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8d0034020 con 0x55d1745bac20 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.021+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/2035329979 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb8d0025070 con 0x55d1745bac20 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.021+0000 7fb8f3fb2b80 10 client.15576 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.021+0000 7fb8f3fb2b80 10 client.15576 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.021+0000 7fb8f3fb2b80 20 client.15576 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.021+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55d1745cefd0 0x55d1745d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.021+0000 7fb8f3fb2b80 4 client.15576 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.021+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2035329979 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d174588f40 con 0x55d1745cefd0 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.021+0000 7fb8de39b700 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55d1745cefd0 0x55d1745d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.022+0000 7fb8de39b700 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55d1745cefd0 0x55d1745d1410 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39d60da3c0db9c08 server_cookie=98553798a417c507 in_seq=0 out_seq=0 2023-12-11T20:16:16.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.022+0000 7fb8c1ffb700 10 client.15576 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:16:16.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/2035329979 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d174588f40 con 0x55d1745cefd0 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8c1ffb700 10 client.15576 handle_command_reply: tid=0 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 client.15576 shutdown 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2035329979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 msgr2=0x55d1745ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745ca6f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b0d0 tx=0x7fb8d00099e0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2035329979 shutdown_connections 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55d1745cefd0 0x55d1745d1410 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745ca6f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8c1ffb700 0 client.15576 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2035329979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b9d30 0x55d1745c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2035329979 >> 172.21.15.12:0/2035329979 conn(0x55d1744e87e0 msgr2=0x55d1745b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2035329979 shutdown_connections 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.023+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2035329979 wait complete. 2023-12-11T20:16:16.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.024+0000 7fb8f3fb2b80 20 client.15576 trim_cache size 0 max 16384 2023-12-11T20:16:16.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.038+0000 7fb8f3fb2b80 1 Processor -- start 2023-12-11T20:16:16.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.038+0000 7fb8f3fb2b80 1 -- start start 2023-12-11T20:16:16.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.038+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.038+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745b9d30 0x55d1745ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745bac20 0x55d1745bb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1745b0b50 con 0x55d1745b9d30 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1745d6640 con 0x55d1745bac20 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1745b8f70 con 0x55d1745b93d0 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8ddb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745b9d30 0x55d1745ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8ddb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745b9d30 0x55d1745ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58474/0 (socket says 172.21.15.12:58474) 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/2146306811 learned_addr learned my addr 172.21.15.12:0/2146306811 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8de39b700 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/2146306811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 msgr2=0x55d1745cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745bac20 0x55d1745bb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/2146306811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745bac20 msgr2=0x55d1745bb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745bac20 0x55d1745bb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/2146306811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d17431fc60 con 0x55d1745b9d30 2023-12-11T20:16:16.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.039+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745bac20 0x55d1745bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:16:16.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.040+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745b9d30 0x55d1745ca6b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c5b0 tx=0x7fb8c809a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54016c9a02fd8f48 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.040+0000 7fb8cd3ff700 1 -- 172.21.15.12:0/2146306811 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c809aae0 con 0x55d1745b9d30 2023-12-11T20:16:16.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.040+0000 7fb8cd3ff700 1 -- 172.21.15.12:0/2146306811 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8c800cc90 con 0x55d1745b9d30 2023-12-11T20:16:16.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.040+0000 7fb8cd3ff700 1 -- 172.21.15.12:0/2146306811 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8098780 con 0x55d1745b9d30 2023-12-11T20:16:16.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.040+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2146306811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745b9d30 msgr2=0x55d1745ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.040+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745b9d30 0x55d1745ca6b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c5b0 tx=0x7fb8c809a230 comp rx=0 tx=0).stop 2023-12-11T20:16:16.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2146306811 shutdown_connections 2023-12-11T20:16:16.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745bac20 0x55d1745bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b93d0 0x55d1745cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/2146306811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745b9d30 0x55d1745ca6b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2146306811 >> 172.21.15.12:0/2146306811 conn(0x55d1744e87e0 msgr2=0x55d1745b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2146306811 shutdown_connections 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/2146306811 wait complete. 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 -- start start 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.041+0000 7fb8f3fb2b80 1 Processor -- start 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b93d0 0x55d1745c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b9d30 0x55d1745c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8f3fb2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1745c9d20 con 0x55d1745bac20 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1745c9e90 con 0x55d1745b93d0 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8f3fb2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1745ca050 con 0x55d1745b9d30 2023-12-11T20:16:16.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8f3fb2b80 10 client.0 _ll_register_callbacks cb 0x55d1743f2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8deb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8de39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b93d0 0x55d1745c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8deb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58484/0 (socket says 172.21.15.12:58484) 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8deb9c700 1 -- 172.21.15.12:0/298047955 learned_addr learned my addr 172.21.15.12:0/298047955 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.042+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b9d30 0x55d1745c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/298047955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b93d0 msgr2=0x55d1745c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b93d0 0x55d1745c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/298047955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 msgr2=0x55d1745c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8ddb9a700 1 -- 172.21.15.12:0/298047955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d81a1aa0 con 0x55d1745b9d30 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8de39b700 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b93d0 0x55d1745c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8deb9c700 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8ddb9a700 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b9d30 0x55d1745c6860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55d1745cb340 tx=0x7fb8c800ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=391fe4c4d549add7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:16:16.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/298047955 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c809e530 con 0x55d1745b9d30 2023-12-11T20:16:16.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/298047955 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb8c8086040 con 0x55d1745b9d30 2023-12-11T20:16:16.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/298047955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8d4004380 con 0x55d1745b9d30 2023-12-11T20:16:16.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.043+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/298047955 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8c80b2ea0 con 0x55d1745b9d30 2023-12-11T20:16:16.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8f3fb2b80 10 client.25393 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:16.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/298047955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d17435d250 con 0x55d1745b9d30 2023-12-11T20:16:16.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/298047955 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8d4004380 con 0x55d1745b9d30 2023-12-11T20:16:16.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/298047955 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb8c80998d0 con 0x55d1745b9d30 2023-12-11T20:16:16.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8f3fb2b80 10 client.25393 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8f3fb2b80 10 client.25393 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8f3fb2b80 20 client.25393 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55d174625d90 0x55d1746281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8f3fb2b80 4 client.25393 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/298047955 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d1744d3fd0 con 0x55d174625d90 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.044+0000 7fb8de39b700 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55d174625d90 0x55d1746281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.045+0000 7fb8c1ffb700 10 client.25393 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.045+0000 7fb8de39b700 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55d174625d90 0x55d1746281b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e16116c0d4b8ce76 server_cookie=45934ae67be8e818 in_seq=0 out_seq=0 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.045+0000 7fb8c1ffb700 1 -- 172.21.15.12:0/298047955 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d1744d3fd0 con 0x55d174625d90 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.045+0000 7fb8c1ffb700 10 client.25393 handle_command_reply: tid=0 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.045+0000 7fb8f3fb2b80 1 client.25393 shutdown 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.045+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b9d30 msgr2=0x55d1745c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.045+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b9d30 0x55d1745c6860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55d1745cb340 tx=0x7fb8c800ce00 comp rx=0 tx=0).stop 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/298047955 shutdown_connections 2023-12-11T20:16:16.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55d174625d90 0x55d1746281b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d1745b93d0 0x55d1745c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1745bac20 0x55d1745c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8c1ffb700 0 client.25393 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 1 --2- 172.21.15.12:0/298047955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d1745b9d30 0x55d1745c6860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/298047955 >> 172.21.15.12:0/298047955 conn(0x55d1744e87e0 msgr2=0x55d1745c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/298047955 shutdown_connections 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 1 -- 172.21.15.12:0/298047955 wait complete. 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.046+0000 7fb8f3fb2b80 20 client.25393 trim_cache size 0 max 16384 2023-12-11T20:16:16.048 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:16:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 -- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8c40a1480 msgr2=0x7fb8c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8c40a1480 0x7fb8c40a3940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009850 tx=0x7fb8d00097a0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 -- 172.21.15.12:0/2174148979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8d81026a0 msgr2=0x7fb8d80739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8d81026a0 0x7fb8d80739c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800eb30 tx=0x7fb8c800ee40 comp rx=0 tx=0).stop 2023-12-11T20:16:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 -- 172.21.15.12:0/2174148979 shutdown_connections 2023-12-11T20:16:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8c40a1480 0x7fb8c40a3940 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8d8103040 0x7fb8d8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d81014b0 0x7fb8d80752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 --2- 172.21.15.12:0/2174148979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8d81026a0 0x7fb8d80739c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 -- 172.21.15.12:0/2174148979 >> 172.21.15.12:0/2174148979 conn(0x7fb8d80fca00 msgr2=0x7fb8d8105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 -- 172.21.15.12:0/2174148979 shutdown_connections 2023-12-11T20:16:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.047+0000 7fb8e05ff700 1 -- 172.21.15.12:0/2174148979 wait complete. 2023-12-11T20:16:16.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.286+0000 7f6e3f59e700 1 -- 172.21.15.12:0/1888324043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e401091b0 msgr2=0x7f6e4010b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.286+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/1888324043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e401091b0 0x7f6e4010b640 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800b0a0 tx=0x7f6e3800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.286+0000 7f6e3f59e700 1 -- 172.21.15.12:0/1888324043 shutdown_connections 2023-12-11T20:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.287+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/1888324043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e40075610 0x7f6e40073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.287+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/1888324043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e401091b0 0x7f6e4010b640 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.287+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/1888324043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e40074030 0x7f6e400744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.287+0000 7f6e3f59e700 1 -- 172.21.15.12:0/1888324043 >> 172.21.15.12:0/1888324043 conn(0x7f6e400fc860 msgr2=0x7f6e400feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.287+0000 7f6e3f59e700 1 -- 172.21.15.12:0/1888324043 shutdown_connections 2023-12-11T20:16:16.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.287+0000 7f6e3f59e700 1 -- 172.21.15.12:0/1888324043 wait complete. 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3f59e700 1 Processor -- start 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3f59e700 1 -- start start 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e40074030 0x7f6e401993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e40075610 0x7f6e40199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3f59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e401091b0 0x7f6e401a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401a0ec0 con 0x7f6e40075610 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3f59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401a1000 con 0x7f6e401091b0 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401a1190 con 0x7f6e40074030 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e40075610 0x7f6e40199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e40075610 0x7f6e40199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58506/0 (socket says 172.21.15.12:58506) 2023-12-11T20:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.288+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/578418099 learned_addr learned my addr 172.21.15.12:0/578418099 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e401091b0 0x7f6e401a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e40074030 0x7f6e401993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/578418099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e40074030 msgr2=0x7f6e401993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e40074030 0x7f6e401993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/578418099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e401091b0 msgr2=0x7f6e401a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e401091b0 0x7f6e401a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/578418099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30009520 con 0x7f6e40075610 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e40075610 0x7f6e40199920 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400e950 tx=0x7f6e3400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e2f7fe700 1 -- 172.21.15.12:0/578418099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34009770 con 0x7f6e40075610 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e3f59e700 1 -- 172.21.15.12:0/578418099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e38009d00 con 0x7f6e40075610 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e2f7fe700 1 -- 172.21.15.12:0/578418099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e3400eea0 con 0x7f6e40075610 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.289+0000 7f6e2f7fe700 1 -- 172.21.15.12:0/578418099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34003cc0 con 0x7f6e40075610 2023-12-11T20:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.290+0000 7f6e3f59e700 1 -- 172.21.15.12:0/578418099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e401a17f0 con 0x7f6e40075610 2023-12-11T20:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.293+0000 7f6e2f7fe700 1 -- 172.21.15.12:0/578418099 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6e34003e20 con 0x7f6e40075610 2023-12-11T20:16:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.294+0000 7f6e2f7fe700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e280a15a0 0x7f6e280a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.294+0000 7f6e583eab80 1 Processor -- start 2023-12-11T20:16:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.294+0000 7f6e2f7fe700 1 -- 172.21.15.12:0/578418099 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e34014070 con 0x7f6e40075610 2023-12-11T20:16:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e583eab80 1 -- start start 2023-12-11T20:16:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e280a15a0 0x7f6e280a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c0e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c0d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c152a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e583eab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4b5fb50 con 0x560ea4c0da00 2023-12-11T20:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e583eab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4b5d470 con 0x560ea4c0d040 2023-12-11T20:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e583eab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4b58d60 con 0x560ea4c0e380 2023-12-11T20:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e3ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e3dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c0d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e3dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c0d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44830/0 (socket says 172.21.15.12:44830) 2023-12-11T20:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/1155105147 learned_addr learned my addr 172.21.15.12:0/1155105147 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.295+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/1155105147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c0e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/1155105147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 msgr2=0x560ea4c0e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/1155105147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c0e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/1155105147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 msgr2=0x560ea4c152a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/1155105147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c152a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/1155105147 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ea49d5630 con 0x560ea4c0d040 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e280a15a0 0x7f6e280a3a60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009d90 tx=0x7f6e300116c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/1155105147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c0d4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e340a20c0 tx=0x7f6e34099c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5b4fe52a479899 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e2cff9700 1 -- 172.21.15.12:0/1155105147 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3409e170 con 0x560ea4c0d040 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e2cff9700 1 -- 172.21.15.12:0/1155105147 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e3409e3b0 con 0x560ea4c0d040 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.296+0000 7f6e2cff9700 1 -- 172.21.15.12:0/1155105147 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3409a720 con 0x560ea4c0d040 2023-12-11T20:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 -- 172.21.15.12:0/1155105147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 msgr2=0x560ea4c0d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 --2- 172.21.15.12:0/1155105147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c0d4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e340a20c0 tx=0x7f6e34099c40 comp rx=0 tx=0).stop 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 -- 172.21.15.12:0/1155105147 shutdown_connections 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 --2- 172.21.15.12:0/1155105147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c152a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 --2- 172.21.15.12:0/1155105147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c0e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 --2- 172.21.15.12:0/1155105147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c0d4c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 -- 172.21.15.12:0/1155105147 >> 172.21.15.12:0/1155105147 conn(0x560ea4b337e0 msgr2=0x560ea4bff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 -- 172.21.15.12:0/1155105147 shutdown_connections 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.297+0000 7f6e583eab80 1 -- 172.21.15.12:0/1155105147 wait complete. 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.298+0000 7f6e583eab80 1 -- start start 2023-12-11T20:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.298+0000 7f6e583eab80 1 Processor -- start 2023-12-11T20:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0d040 0x560ea4c16c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 0x560ea4c17150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c1e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e583eab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4b12560 con 0x560ea4c0d040 2023-12-11T20:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e583eab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4b12200 con 0x560ea4c0da00 2023-12-11T20:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e583eab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea49d7920 con 0x560ea4c0e380 2023-12-11T20:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e583eab80 10 client.0 _ll_register_callbacks cb 0x560ea4a3da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e3ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c1e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e3ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c1e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60976/0 (socket says 172.21.15.12:60976) 2023-12-11T20:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e3e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0d040 0x560ea4c16c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e3ed9d700 1 -- 172.21.15.12:0/2602799567 learned_addr learned my addr 172.21.15.12:0/2602799567 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 0x560ea4c17150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e3ed9d700 1 -- 172.21.15.12:0/2602799567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 msgr2=0x560ea4c17150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.299+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 0x560ea4c17150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.300+0000 7f6e3ed9d700 1 -- 172.21.15.12:0/2602799567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0d040 msgr2=0x560ea4c16c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.300+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0d040 0x560ea4c16c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.300+0000 7f6e3ed9d700 1 -- 172.21.15.12:0/2602799567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e401a17f0 con 0x560ea4c0e380 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.300+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c1e190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800b0a0 tx=0x7f6e38007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e4184254591d137 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.300+0000 7f6e25ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.300+0000 7f6e25ffb700 1 -- 172.21.15.12:0/2602799567 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800e040 con 0x560ea4c0e380 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.300+0000 7f6e583eab80 1 -- 172.21.15.12:0/2602799567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ea4bf79e0 con 0x560ea4c0e380 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.300+0000 7f6e25ffb700 1 -- 172.21.15.12:0/2602799567 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e3800bcb0 con 0x560ea4c0e380 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e25ffb700 1 -- 172.21.15.12:0/2602799567 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e3800be70 con 0x560ea4c0e380 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e583eab80 10 client.25405 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e583eab80 1 -- 172.21.15.12:0/2602799567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x560ea4981de0 con 0x560ea4c0e380 2023-12-11T20:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e25ffb700 1 -- 172.21.15.12:0/2602799567 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ea4bf79e0 con 0x560ea4c0e380 2023-12-11T20:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e25ffb700 1 -- 172.21.15.12:0/2602799567 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e38023020 con 0x560ea4c0e380 2023-12-11T20:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e583eab80 10 client.25405 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e583eab80 10 client.25405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e583eab80 20 client.25405 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e583eab80 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560ea4c229c0 0x560ea4c24de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e583eab80 4 client.25405 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.301+0000 7f6e583eab80 1 -- 172.21.15.12:0/2602799567 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ea4bd3f40 con 0x560ea4c229c0 2023-12-11T20:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.302+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560ea4c229c0 0x560ea4c24de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.302+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560ea4c229c0 0x560ea4c24de0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f976c4b062fefe8b server_cookie=483017e97a24b6a4 in_seq=0 out_seq=0 2023-12-11T20:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.302+0000 7f6e25ffb700 10 client.25405 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.303+0000 7f6e25ffb700 1 -- 172.21.15.12:0/2602799567 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560ea4bd3f40 con 0x560ea4c229c0 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.303+0000 7f6e25ffb700 10 client.25405 handle_command_reply: tid=0 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.303+0000 7f6e583eab80 1 client.25405 shutdown 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.303+0000 7f6e583eab80 1 -- 172.21.15.12:0/2602799567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 msgr2=0x560ea4c1e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.303+0000 7f6e583eab80 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c1e190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800b0a0 tx=0x7f6e38007f90 comp rx=0 tx=0).stop 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 1 -- 172.21.15.12:0/2602799567 shutdown_connections 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560ea4c229c0 0x560ea4c24de0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c1e190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0d040 0x560ea4c16c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e25ffb700 0 client.25405 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 1 --2- 172.21.15.12:0/2602799567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 0x560ea4c17150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 1 -- 172.21.15.12:0/2602799567 >> 172.21.15.12:0/2602799567 conn(0x560ea4b337e0 msgr2=0x560ea4c03820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 1 -- 172.21.15.12:0/2602799567 shutdown_connections 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 1 -- 172.21.15.12:0/2602799567 wait complete. 2023-12-11T20:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.304+0000 7f6e583eab80 20 client.25405 trim_cache size 0 max 16384 2023-12-11T20:16:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e583eab80 1 Processor -- start 2023-12-11T20:16:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e583eab80 1 -- start start 2023-12-11T20:16:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c1e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c1e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c15040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e583eab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4c1f340 con 0x560ea4c0da00 2023-12-11T20:16:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e583eab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4c167b0 con 0x560ea4c0d040 2023-12-11T20:16:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e583eab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4c0ef00 con 0x560ea4c0e380 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.319+0000 7f6e3dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c1e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c1e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58528/0 (socket says 172.21.15.12:58528) 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/4125138558 learned_addr learned my addr 172.21.15.12:0/4125138558 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c1e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c15040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/4125138558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 msgr2=0x560ea4c15040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c15040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/4125138558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 msgr2=0x560ea4c1e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c1e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3dd9b700 1 -- 172.21.15.12:0/4125138558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ea496ac60 con 0x560ea4c0da00 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c15040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.320+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c1e150 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6e3409a1f0 tx=0x7f6e340cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d81241e3ce1698 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e2d7fa700 1 -- 172.21.15.12:0/4125138558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3409e170 con 0x560ea4c0da00 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e2d7fa700 1 -- 172.21.15.12:0/4125138558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e340a25f0 con 0x560ea4c0da00 2023-12-11T20:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e2d7fa700 1 -- 172.21.15.12:0/4125138558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34099990 con 0x560ea4c0da00 2023-12-11T20:16:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e583eab80 1 -- 172.21.15.12:0/4125138558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 msgr2=0x560ea4c1e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c1e150 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6e3409a1f0 tx=0x7f6e340cc040 comp rx=0 tx=0).stop 2023-12-11T20:16:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e583eab80 1 -- 172.21.15.12:0/4125138558 shutdown_connections 2023-12-11T20:16:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0d040 0x560ea4c1e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0e380 0x560ea4c15040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4125138558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0da00 0x560ea4c1e150 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.321+0000 7f6e583eab80 1 -- 172.21.15.12:0/4125138558 >> 172.21.15.12:0/4125138558 conn(0x560ea4b337e0 msgr2=0x560ea4bff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.322+0000 7f6e583eab80 1 -- 172.21.15.12:0/4125138558 shutdown_connections 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.322+0000 7f6e583eab80 1 -- 172.21.15.12:0/4125138558 wait complete. 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.322+0000 7f6e583eab80 1 -- start start 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.322+0000 7f6e583eab80 1 Processor -- start 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0d040 0x560ea4c1be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 0x560ea4c1c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e583eab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0e380 0x560ea4c1d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e583eab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4c1d850 con 0x560ea4c0e380 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e583eab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4c1d9c0 con 0x560ea4c0da00 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e583eab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4c1db80 con 0x560ea4c0d040 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e583eab80 10 client.0 _ll_register_callbacks cb 0x560ea4a3da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0e380 0x560ea4c1d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0e380 0x560ea4c1d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58534/0 (socket says 172.21.15.12:58534) 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3ed9d700 1 -- 172.21.15.12:0/4139290861 learned_addr learned my addr 172.21.15.12:0/4139290861 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3dd9b700 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 0x560ea4c1c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0d040 0x560ea4c1be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3ed9d700 1 -- 172.21.15.12:0/4139290861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0d040 msgr2=0x560ea4c1be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0d040 0x560ea4c1be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3ed9d700 1 -- 172.21.15.12:0/4139290861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 msgr2=0x560ea4c1c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 0x560ea4c1c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3ed9d700 1 -- 172.21.15.12:0/4139290861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ea49d5630 con 0x560ea4c0e380 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.323+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0d040 0x560ea4c1be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.324+0000 7f6e3ed9d700 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0e380 0x560ea4c1d310 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6e380079c0 tx=0x7f6e38005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc2c403ba9e8a90 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:16.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.324+0000 7f6e25ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.324+0000 7f6e25ffb700 1 -- 172.21.15.12:0/4139290861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38034070 con 0x560ea4c0e380 2023-12-11T20:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.324+0000 7f6e583eab80 1 -- 172.21.15.12:0/4139290861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e3409e3b0 con 0x560ea4c0e380 2023-12-11T20:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.324+0000 7f6e25ffb700 1 -- 172.21.15.12:0/4139290861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e3802b030 con 0x560ea4c0e380 2023-12-11T20:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.324+0000 7f6e25ffb700 1 -- 172.21.15.12:0/4139290861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e3800e040 con 0x560ea4c0e380 2023-12-11T20:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.324+0000 7f6e583eab80 10 client.15600 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.324+0000 7f6e583eab80 1 -- 172.21.15.12:0/4139290861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x560ea49a8250 con 0x560ea4c0e380 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e25ffb700 1 -- 172.21.15.12:0/4139290861 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e3803e020 con 0x560ea4c0e380 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e25ffb700 1 -- 172.21.15.12:0/4139290861 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e38037030 con 0x560ea4c0e380 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e583eab80 10 client.15600 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e583eab80 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e583eab80 20 client.15600 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560ea4c799d0 0x560ea4c7bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e583eab80 4 client.15600 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e583eab80 1 -- 172.21.15.12:0/4139290861 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560ea4b1efd0 con 0x560ea4c799d0 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.325+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560ea4c799d0 0x560ea4c7bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e3e59c700 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560ea4c799d0 0x560ea4c7bdc0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4330012afc7aa2f2 server_cookie=a0baa8c8fa561583 in_seq=0 out_seq=0 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e25ffb700 10 client.15600 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e25ffb700 1 -- 172.21.15.12:0/4139290861 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560ea4b1efd0 con 0x560ea4c799d0 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e25ffb700 10 client.15600 handle_command_reply: tid=0 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e583eab80 1 client.15600 shutdown 2023-12-11T20:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e583eab80 1 -- 172.21.15.12:0/4139290861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0e380 msgr2=0x560ea4c1d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0e380 0x560ea4c1d310 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6e380079c0 tx=0x7f6e38005b10 comp rx=0 tx=0).stop 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e583eab80 1 -- 172.21.15.12:0/4139290861 shutdown_connections 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.326+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560ea4c799d0 0x560ea4c7bdc0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.327+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ea4c0e380 0x560ea4c1d310 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.327+0000 7f6e25ffb700 0 client.15600 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.327+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ea4c0d040 0x560ea4c1be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.327+0000 7f6e583eab80 1 --2- 172.21.15.12:0/4139290861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560ea4c0da00 0x560ea4c1c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.327+0000 7f6e583eab80 1 -- 172.21.15.12:0/4139290861 >> 172.21.15.12:0/4139290861 conn(0x560ea4b337e0 msgr2=0x560ea4c14fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.327+0000 7f6e583eab80 1 -- 172.21.15.12:0/4139290861 shutdown_connections 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.327+0000 7f6e583eab80 1 -- 172.21.15.12:0/4139290861 wait complete. 2023-12-11T20:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.327+0000 7f6e583eab80 20 client.15600 trim_cache size 0 max 16384 2023-12-11T20:16:16.329 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 -- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e280a15a0 msgr2=0x7f6e280a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e280a15a0 0x7f6e280a3a60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009d90 tx=0x7f6e300116c0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 -- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e40075610 msgr2=0x7f6e40199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e40075610 0x7f6e40199920 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400e950 tx=0x7f6e3400ec60 comp rx=0 tx=0).stop 2023-12-11T20:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 -- 172.21.15.12:0/578418099 shutdown_connections 2023-12-11T20:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e280a15a0 0x7f6e280a3a60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e401091b0 0x7f6e401a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e40074030 0x7f6e401993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 --2- 172.21.15.12:0/578418099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e40075610 0x7f6e40199920 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 -- 172.21.15.12:0/578418099 >> 172.21.15.12:0/578418099 conn(0x7f6e400fc860 msgr2=0x7f6e401050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 -- 172.21.15.12:0/578418099 shutdown_connections 2023-12-11T20:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:16.328+0000 7f6e3f59e700 1 -- 172.21.15.12:0/578418099 wait complete. 2023-12-11T20:16:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:16 smithi012 ceph-mon[128787]: pgmap v385: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:16.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:16 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/807418596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:16:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:16 smithi032 ceph-mon[132488]: pgmap v385: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:16 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/807418596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:16:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:16 smithi039 ceph-mon[102205]: pgmap v385: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:16 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/807418596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:16:17.347 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:16:17.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:16:17.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.574+0000 7f207659d700 1 -- 172.21.15.12:0/2139165480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20701046e0 msgr2=0x7f2070104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.574+0000 7f207659d700 1 --2- 172.21.15.12:0/2139165480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20701046e0 0x7f2070104b40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f20600099c0 tx=0x7f2060009cd0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.574+0000 7f207659d700 1 -- 172.21.15.12:0/2139165480 shutdown_connections 2023-12-11T20:16:17.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.574+0000 7f207659d700 1 --2- 172.21.15.12:0/2139165480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2070105080 0x7f207010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.575+0000 7f207659d700 1 --2- 172.21.15.12:0/2139165480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20701034f0 0x7f2070103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.575+0000 7f207659d700 1 --2- 172.21.15.12:0/2139165480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20701046e0 0x7f2070104b40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.575+0000 7f207659d700 1 -- 172.21.15.12:0/2139165480 >> 172.21.15.12:0/2139165480 conn(0x7f20700feaa0 msgr2=0x7f2070100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.575+0000 7f207659d700 1 -- 172.21.15.12:0/2139165480 shutdown_connections 2023-12-11T20:16:17.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.575+0000 7f207659d700 1 -- 172.21.15.12:0/2139165480 wait complete. 2023-12-11T20:16:17.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.576+0000 7f207659d700 1 Processor -- start 2023-12-11T20:16:17.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.576+0000 7f207659d700 1 -- start start 2023-12-11T20:16:17.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.576+0000 7f207659d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20701034f0 0x7f20701992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.576+0000 7f207659d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20701046e0 0x7f2070199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.576+0000 7f207659d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2070105080 0x7f20701a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.576+0000 7f207659d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20701a0e00 con 0x7f20701046e0 2023-12-11T20:16:17.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.576+0000 7f207659d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20701a0f40 con 0x7f20701034f0 2023-12-11T20:16:17.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.576+0000 7f207659d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20701a10d0 con 0x7f2070105080 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f2074d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20701046e0 0x7f2070199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20701034f0 0x7f20701992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20701034f0 0x7f20701992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44874/0 (socket says 172.21.15.12:44874) 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 -- 172.21.15.12:0/451532014 learned_addr learned my addr 172.21.15.12:0/451532014 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f2075d9c700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2070105080 0x7f20701a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 -- 172.21.15.12:0/451532014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2070105080 msgr2=0x7f20701a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2070105080 0x7f20701a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 -- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20701046e0 msgr2=0x7f2070199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20701046e0 0x7f2070199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 -- 172.21.15.12:0/451532014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600095f0 con 0x7f20701034f0 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.577+0000 7f207559b700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20701034f0 0x7f20701992d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f206c00efc0 tx=0x7f206c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.578+0000 7f20667fc700 1 -- 172.21.15.12:0/451532014 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c018070 con 0x7f20701034f0 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.578+0000 7f20667fc700 1 -- 172.21.15.12:0/451532014 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f206c00f040 con 0x7f20701034f0 2023-12-11T20:16:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.578+0000 7f20667fc700 1 -- 172.21.15.12:0/451532014 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c004280 con 0x7f20701034f0 2023-12-11T20:16:17.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.578+0000 7f207659d700 1 -- 172.21.15.12:0/451532014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20701a1350 con 0x7f20701034f0 2023-12-11T20:16:17.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.578+0000 7f207659d700 1 -- 172.21.15.12:0/451532014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20701a1810 con 0x7f20701034f0 2023-12-11T20:16:17.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.582+0000 7f208b057b80 1 Processor -- start 2023-12-11T20:16:17.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.582+0000 7f20667fc700 1 -- 172.21.15.12:0/451532014 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f206c003a00 con 0x7f20701034f0 2023-12-11T20:16:17.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.583+0000 7f208b057b80 1 -- start start 2023-12-11T20:16:17.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.583+0000 7f208b057b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a47f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.583+0000 7f208b057b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48440 0x558834a48920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.583+0000 7f208b057b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48e60 0x558834a492c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.583+0000 7f208b057b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588349a2bd0 con 0x558834a48440 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.583+0000 7f208b057b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588349a04f0 con 0x558834a47ae0 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.583+0000 7f208b057b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883499bde0 con 0x558834a48e60 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.583+0000 7f207559b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48440 0x558834a48920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f207559b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48440 0x558834a48920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58562/0 (socket says 172.21.15.12:58562) 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f2075d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a47f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f207559b700 1 -- 172.21.15.12:0/2720737721 learned_addr learned my addr 172.21.15.12:0/2720737721 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f2074d9a700 1 --2- 172.21.15.12:0/2720737721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48e60 0x558834a492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f2075d9c700 1 -- 172.21.15.12:0/2720737721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48e60 msgr2=0x558834a492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f2075d9c700 1 --2- 172.21.15.12:0/2720737721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48e60 0x558834a492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f2075d9c700 1 -- 172.21.15.12:0/2720737721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48440 msgr2=0x558834a48920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f2075d9c700 1 --2- 172.21.15.12:0/2720737721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48440 0x558834a48920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f2075d9c700 1 -- 172.21.15.12:0/2720737721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588348186b0 con 0x558834a47ae0 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f20667fc700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f205c0a1520 0x7f205c0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.584+0000 7f2075d9c700 1 --2- 172.21.15.12:0/2720737721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a47f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2068009c10 tx=0x7f2068009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e1d82226e20feab server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.585+0000 7f20667fc700 1 -- 172.21.15.12:0/451532014 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f206c0cccb0 con 0x7f20701034f0 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.585+0000 7f207559b700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f205c0a1520 0x7f205c0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.585+0000 7f205b7fe700 1 -- 172.21.15.12:0/2720737721 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068011cb0 con 0x558834a47ae0 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.585+0000 7f205b7fe700 1 -- 172.21.15.12:0/2720737721 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2068011e10 con 0x558834a47ae0 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.585+0000 7f205b7fe700 1 -- 172.21.15.12:0/2720737721 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068005080 con 0x558834a47ae0 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 -- 172.21.15.12:0/2720737721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 msgr2=0x558834a47f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 --2- 172.21.15.12:0/2720737721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a47f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2068009c10 tx=0x7f2068009f20 comp rx=0 tx=0).stop 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f207559b700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f205c0a1520 0x7f205c0a39e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f206c00ef90 tx=0x7f206c0d06b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 -- 172.21.15.12:0/2720737721 shutdown_connections 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 --2- 172.21.15.12:0/2720737721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a47f00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 --2- 172.21.15.12:0/2720737721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48e60 0x558834a492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 --2- 172.21.15.12:0/2720737721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48440 0x558834a48920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 -- 172.21.15.12:0/2720737721 >> 172.21.15.12:0/2720737721 conn(0x558834976860 msgr2=0x558834a42450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 -- 172.21.15.12:0/2720737721 shutdown_connections 2023-12-11T20:16:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 -- 172.21.15.12:0/2720737721 wait complete. 2023-12-11T20:16:17.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.586+0000 7f208b057b80 1 -- start start 2023-12-11T20:16:17.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.587+0000 7f208b057b80 1 Processor -- start 2023-12-11T20:16:17.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.587+0000 7f208b057b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a51400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.587+0000 7f208b057b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a51940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.587+0000 7f208b057b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a58980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f208b057b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588349555e0 con 0x558834a48e60 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f208b057b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558834955280 con 0x558834a47ae0 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f208b057b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883481a9a0 con 0x558834a48440 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f208b057b80 10 client.0 _ll_register_callbacks cb 0x558834880b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a51400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a51400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44904/0 (socket says 172.21.15.12:44904) 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 -- 172.21.15.12:0/3759714491 learned_addr learned my addr 172.21.15.12:0/3759714491 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2074d9a700 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a51940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a58980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 -- 172.21.15.12:0/3759714491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 msgr2=0x558834a51940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a51940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 -- 172.21.15.12:0/3759714491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 msgr2=0x558834a58980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a58980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2075d9c700 1 -- 172.21.15.12:0/3759714491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20680098c0 con 0x558834a47ae0 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.588+0000 7f2074d9a700 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a51940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.589+0000 7f2075d9c700 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a51400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2068011ce0 tx=0x7f20680058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b104d576a4ae1ad server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.589+0000 7f2058ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.589+0000 7f2058ff9700 1 -- 172.21.15.12:0/3759714491 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068004e10 con 0x558834a47ae0 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.589+0000 7f2058ff9700 1 -- 172.21.15.12:0/3759714491 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f20680056a0 con 0x558834a47ae0 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.589+0000 7f208b057b80 1 -- 172.21.15.12:0/3759714491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558834a3aa60 con 0x558834a47ae0 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.589+0000 7f2058ff9700 1 -- 172.21.15.12:0/3759714491 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2068004250 con 0x558834a47ae0 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.589+0000 7f208b057b80 10 client.25424 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.589+0000 7f208b057b80 1 -- 172.21.15.12:0/3759714491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5588347c4e60 con 0x558834a47ae0 2023-12-11T20:16:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.590+0000 7f2058ff9700 1 -- 172.21.15.12:0/3759714491 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558834a3aa60 con 0x558834a47ae0 2023-12-11T20:16:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.590+0000 7f2058ff9700 1 -- 172.21.15.12:0/3759714491 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f20680193f0 con 0x558834a47ae0 2023-12-11T20:16:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.590+0000 7f208b057b80 10 client.25424 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.590+0000 7f208b057b80 10 client.25424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.590+0000 7f208b057b80 20 client.25424 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.590+0000 7f208b057b80 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558834a5d0f0 0x558834a5f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.590+0000 7f208b057b80 4 client.25424 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:17.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.590+0000 7f208b057b80 1 -- 172.21.15.12:0/3759714491 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558834a16fc0 con 0x558834a5d0f0 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.591+0000 7f2074d9a700 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558834a5d0f0 0x558834a5f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.591+0000 7f2074d9a700 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558834a5d0f0 0x558834a5f510 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db371e9b929bdccc server_cookie=7b449dd7be9cef20 in_seq=0 out_seq=0 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.591+0000 7f2058ff9700 10 client.25424 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f2058ff9700 1 -- 172.21.15.12:0/3759714491 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558834a16fc0 con 0x558834a5d0f0 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f2058ff9700 10 client.25424 handle_command_reply: tid=0 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 client.25424 shutdown 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 -- 172.21.15.12:0/3759714491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 msgr2=0x558834a51400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a51400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2068011ce0 tx=0x7f20680058e0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 -- 172.21.15.12:0/3759714491 shutdown_connections 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558834a5d0f0 0x558834a5f510 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a51400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a58980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f2058ff9700 0 client.25424 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:17.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 --2- 172.21.15.12:0/3759714491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a51940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.592+0000 7f208b057b80 1 -- 172.21.15.12:0/3759714491 >> 172.21.15.12:0/3759714491 conn(0x558834976860 msgr2=0x558834a468a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.593+0000 7f208b057b80 1 -- 172.21.15.12:0/3759714491 shutdown_connections 2023-12-11T20:16:17.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.593+0000 7f208b057b80 1 -- 172.21.15.12:0/3759714491 wait complete. 2023-12-11T20:16:17.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.593+0000 7f208b057b80 20 client.25424 trim_cache size 0 max 16384 2023-12-11T20:16:17.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.615+0000 7f208b057b80 1 Processor -- start 2023-12-11T20:16:17.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.615+0000 7f208b057b80 1 -- start start 2023-12-11T20:16:17.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.615+0000 7f208b057b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.615+0000 7f208b057b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a58940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.615+0000 7f208b057b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a46de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.615+0000 7f208b057b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558834a5cc40 con 0x558834a48e60 2023-12-11T20:16:17.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.615+0000 7f208b057b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558834a50f70 con 0x558834a47ae0 2023-12-11T20:16:17.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.615+0000 7f208b057b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558834a48280 con 0x558834a48440 2023-12-11T20:16:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a46de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a46de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58584/0 (socket says 172.21.15.12:58584) 2023-12-11T20:16:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 -- 172.21.15.12:0/619651637 learned_addr learned my addr 172.21.15.12:0/619651637 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2074d9a700 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a58940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 -- 172.21.15.12:0/619651637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 msgr2=0x558834a58940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a58940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 -- 172.21.15.12:0/619651637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 msgr2=0x558834a468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2075d9c700 1 -- 172.21.15.12:0/619651637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588347adce0 con 0x558834a48e60 2023-12-11T20:16:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.616+0000 7f2074d9a700 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a58940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.617+0000 7f2075d9c700 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a46de0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x558834a3e920 tx=0x7f2068009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1982862d2a65742 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.617+0000 7f205bfff700 1 -- 172.21.15.12:0/619651637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068004dd0 con 0x558834a48e60 2023-12-11T20:16:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.617+0000 7f205bfff700 1 -- 172.21.15.12:0/619651637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2068005080 con 0x558834a48e60 2023-12-11T20:16:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.617+0000 7f205bfff700 1 -- 172.21.15.12:0/619651637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068025cc0 con 0x558834a48e60 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 -- 172.21.15.12:0/619651637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 msgr2=0x558834a46de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a46de0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x558834a3e920 tx=0x7f2068009f20 comp rx=0 tx=0).stop 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 -- 172.21.15.12:0/619651637 shutdown_connections 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a47ae0 0x558834a468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834a46de0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 --2- 172.21.15.12:0/619651637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a48440 0x558834a58940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 -- 172.21.15.12:0/619651637 >> 172.21.15.12:0/619651637 conn(0x558834976860 msgr2=0x558834a63e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 -- 172.21.15.12:0/619651637 shutdown_connections 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.618+0000 7f208b057b80 1 -- 172.21.15.12:0/619651637 wait complete. 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.619+0000 7f208b057b80 1 -- start start 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.619+0000 7f208b057b80 1 Processor -- start 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.619+0000 7f208b057b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a47ae0 0x558834a57b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.619+0000 7f208b057b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a48440 0x558834a580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.619+0000 7f208b057b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834ab3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.619+0000 7f208b057b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558834ab3cc0 con 0x558834a48e60 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.619+0000 7f208b057b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558834ab3e00 con 0x558834a48440 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.619+0000 7f208b057b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558834ab3f90 con 0x558834a47ae0 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f208b057b80 10 client.0 _ll_register_callbacks cb 0x558834880b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2075d9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a47ae0 0x558834a57b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2074d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a48440 0x558834a580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2075d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834ab3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2074d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a48440 0x558834a580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44930/0 (socket says 172.21.15.12:44930) 2023-12-11T20:16:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2074d9a700 1 -- 172.21.15.12:0/2198200510 learned_addr learned my addr 172.21.15.12:0/2198200510 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2074d9a700 1 -- 172.21.15.12:0/2198200510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a47ae0 msgr2=0x558834a57b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2074d9a700 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a47ae0 0x558834a57b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2074d9a700 1 -- 172.21.15.12:0/2198200510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 msgr2=0x558834ab3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2074d9a700 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834ab3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.620+0000 7f2074d9a700 1 -- 172.21.15.12:0/2198200510 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207010c280 con 0x558834a48440 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.621+0000 7f2074d9a700 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a48440 0x558834a580a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20600099c0 tx=0x7f206000bb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=504f7fa8e54fbad4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.621+0000 7f2058ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.621+0000 7f2058ff9700 1 -- 172.21.15.12:0/2198200510 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060005680 con 0x558834a48440 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.621+0000 7f208b057b80 1 -- 172.21.15.12:0/2198200510 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2068011e10 con 0x558834a48440 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.621+0000 7f2058ff9700 1 -- 172.21.15.12:0/2198200510 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2060028e40 con 0x558834a48440 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.621+0000 7f2058ff9700 1 -- 172.21.15.12:0/2198200510 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2060003760 con 0x558834a48440 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.621+0000 7f208b057b80 10 client.25430 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.621+0000 7f208b057b80 1 -- 172.21.15.12:0/2198200510 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5588347c4e60 con 0x558834a48440 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f2058ff9700 1 -- 172.21.15.12:0/2198200510 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2068011e10 con 0x558834a48440 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f2058ff9700 1 -- 172.21.15.12:0/2198200510 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2060028510 con 0x558834a48440 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f208b057b80 10 client.25430 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f208b057b80 10 client.25430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f208b057b80 20 client.25430 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f208b057b80 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558834ab5aa0 0x558834ab7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f208b057b80 4 client.25430 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f208b057b80 1 -- 172.21.15.12:0/2198200510 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558834962050 con 0x558834ab5aa0 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.622+0000 7f2075d9c700 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558834ab5aa0 0x558834ab7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.623+0000 7f2058ff9700 10 client.25430 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:17.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.623+0000 7f2075d9c700 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558834ab5aa0 0x558834ab7ec0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97ef3a0455d97a31 server_cookie=3b8e75281d225799 in_seq=0 out_seq=0 2023-12-11T20:16:17.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f2058ff9700 1 -- 172.21.15.12:0/2198200510 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558834962050 con 0x558834ab5aa0 2023-12-11T20:16:17.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f2058ff9700 10 client.25430 handle_command_reply: tid=0 2023-12-11T20:16:17.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 client.25430 shutdown 2023-12-11T20:16:17.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 -- 172.21.15.12:0/2198200510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a48440 msgr2=0x558834a580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a48440 0x558834a580a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20600099c0 tx=0x7f206000bb70 comp rx=0 tx=0).stop 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 -- 172.21.15.12:0/2198200510 shutdown_connections 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558834ab5aa0 0x558834ab7ec0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558834a48e60 0x558834ab3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558834a47ae0 0x558834a57b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 --2- 172.21.15.12:0/2198200510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558834a48440 0x558834a580a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f2058ff9700 0 client.25430 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.624+0000 7f208b057b80 1 -- 172.21.15.12:0/2198200510 >> 172.21.15.12:0/2198200510 conn(0x558834976860 msgr2=0x558834a468a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.625+0000 7f208b057b80 1 -- 172.21.15.12:0/2198200510 shutdown_connections 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.625+0000 7f208b057b80 1 -- 172.21.15.12:0/2198200510 wait complete. 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.625+0000 7f208b057b80 20 client.25430 trim_cache size 0 max 16384 2023-12-11T20:16:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:16:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:16:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "0bc9e137-5934-4482-9830-7ef497d2644a", 2023-12-11T20:16:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:16:17.626 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 -- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f205c0a1520 msgr2=0x7f205c0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f205c0a1520 0x7f205c0a39e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f206c00ef90 tx=0x7f206c0d06b0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 -- 172.21.15.12:0/451532014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20701034f0 msgr2=0x7f20701992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20701034f0 0x7f20701992d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f206c00efc0 tx=0x7f206c00c3a0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 -- 172.21.15.12:0/451532014 shutdown_connections 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f205c0a1520 0x7f205c0a39e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20701034f0 0x7f20701992d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2070105080 0x7f20701a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 --2- 172.21.15.12:0/451532014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20701046e0 0x7f2070199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 -- 172.21.15.12:0/451532014 >> 172.21.15.12:0/451532014 conn(0x7f20700feaa0 msgr2=0x7f2070107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 -- 172.21.15.12:0/451532014 shutdown_connections 2023-12-11T20:16:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.626+0000 7f207659d700 1 -- 172.21.15.12:0/451532014 wait complete. 2023-12-11T20:16:17.651 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:16:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.870+0000 7f10639ff700 1 -- 172.21.15.12:0/1719416130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c103020 msgr2=0x7f105c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.870+0000 7f10639ff700 1 --2- 172.21.15.12:0/1719416130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c103020 0x7f105c1098d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f105400b0d0 tx=0x7f105400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.871+0000 7f10639ff700 1 -- 172.21.15.12:0/1719416130 shutdown_connections 2023-12-11T20:16:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.871+0000 7f10639ff700 1 --2- 172.21.15.12:0/1719416130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f105c101490 0x7f105c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.871+0000 7f10639ff700 1 --2- 172.21.15.12:0/1719416130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c103020 0x7f105c1098d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.871+0000 7f10639ff700 1 --2- 172.21.15.12:0/1719416130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f105c102680 0x7f105c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.871+0000 7f10639ff700 1 -- 172.21.15.12:0/1719416130 >> 172.21.15.12:0/1719416130 conn(0x7f105c0fca00 msgr2=0x7f105c0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.871+0000 7f10639ff700 1 -- 172.21.15.12:0/1719416130 shutdown_connections 2023-12-11T20:16:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.871+0000 7f10639ff700 1 -- 172.21.15.12:0/1719416130 wait complete. 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.872+0000 7f10639ff700 1 Processor -- start 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.872+0000 7f10639ff700 1 -- start start 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.872+0000 7f10639ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f105c101490 0x7f105c199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.872+0000 7f10639ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c102680 0x7f105c199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.872+0000 7f10639ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f105c103020 0x7f105c1a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.872+0000 7f10639ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c1a1140 con 0x7f105c102680 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.872+0000 7f10639ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c1a1280 con 0x7f105c103020 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.872+0000 7f10639ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c1a1410 con 0x7f105c101490 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1060f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c102680 0x7f105c199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1060f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c102680 0x7f105c199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58608/0 (socket says 172.21.15.12:58608) 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1060f9a700 1 -- 172.21.15.12:0/253318314 learned_addr learned my addr 172.21.15.12:0/253318314 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1061f9c700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f105c103020 0x7f105c1a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f106179b700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f105c101490 0x7f105c199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1060f9a700 1 -- 172.21.15.12:0/253318314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f105c101490 msgr2=0x7f105c199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1060f9a700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f105c101490 0x7f105c199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1060f9a700 1 -- 172.21.15.12:0/253318314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f105c103020 msgr2=0x7f105c1a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1060f9a700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f105c103020 0x7f105c1a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.873+0000 7f1060f9a700 1 -- 172.21.15.12:0/253318314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009d00 con 0x7f105c102680 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.874+0000 7f1060f9a700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c102680 0x7f105c199b50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f104c00e9a0 tx=0x7f104c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.874+0000 7f10527fc700 1 -- 172.21.15.12:0/253318314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c009790 con 0x7f105c102680 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.874+0000 7f10639ff700 1 -- 172.21.15.12:0/253318314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c1a16f0 con 0x7f105c102680 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.874+0000 7f10527fc700 1 -- 172.21.15.12:0/253318314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f104c010430 con 0x7f105c102680 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.874+0000 7f10527fc700 1 -- 172.21.15.12:0/253318314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c00cea0 con 0x7f105c102680 2023-12-11T20:16:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.874+0000 7f10639ff700 1 -- 172.21.15.12:0/253318314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c1a1c00 con 0x7f105c102680 2023-12-11T20:16:17.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.877+0000 7f10527fc700 1 -- 172.21.15.12:0/253318314 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f104c0105a0 con 0x7f105c102680 2023-12-11T20:16:17.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.879+0000 7f10527fc700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10480a1480 0x7f10480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.879+0000 7f10527fc700 1 -- 172.21.15.12:0/253318314 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f104c014070 con 0x7f105c102680 2023-12-11T20:16:17.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.879+0000 7f106179b700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10480a1480 0x7f10480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.879+0000 7f1077288b80 1 Processor -- start 2023-12-11T20:16:17.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.879+0000 7f1077288b80 1 -- start start 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f1077288b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x56006779a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f1077288b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x56006779b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f1077288b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x56006779c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f1077288b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600676f5b50 con 0x56006779a3d0 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f1077288b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600676f3470 con 0x56006779bc20 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f1077288b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600676eed60 con 0x56006779ad30 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f106179b700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10480a1480 0x7f10480a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f105c1024e0 tx=0x7f1058009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f106179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x56006779a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f106179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x56006779a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58624/0 (socket says 172.21.15.12:58624) 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f106179b700 1 -- 172.21.15.12:0/1526264003 learned_addr learned my addr 172.21.15.12:0/1526264003 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f1061f9c700 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x56006779c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.880+0000 7f1060f9a700 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x56006779b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f106179b700 1 -- 172.21.15.12:0/1526264003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 msgr2=0x56006779b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f106179b700 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x56006779b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f106179b700 1 -- 172.21.15.12:0/1526264003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 msgr2=0x56006779c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f106179b700 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x56006779c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f106179b700 1 -- 172.21.15.12:0/1526264003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56006756b630 con 0x56006779a3d0 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f1061f9c700 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x56006779c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f106179b700 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x56006779a7f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1058011d30 tx=0x7f1058014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8912b8da34035529 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f10477fe700 1 -- 172.21.15.12:0/1526264003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800eb20 con 0x56006779a3d0 2023-12-11T20:16:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f10477fe700 1 -- 172.21.15.12:0/1526264003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1058021070 con 0x56006779a3d0 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.881+0000 7f10477fe700 1 -- 172.21.15.12:0/1526264003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580253d0 con 0x56006779a3d0 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 -- 172.21.15.12:0/1526264003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 msgr2=0x56006779a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x56006779a7f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1058011d30 tx=0x7f1058014000 comp rx=0 tx=0).stop 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 -- 172.21.15.12:0/1526264003 shutdown_connections 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x56006779c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x56006779a7f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 --2- 172.21.15.12:0/1526264003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x56006779b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 -- 172.21.15.12:0/1526264003 >> 172.21.15.12:0/1526264003 conn(0x5600676c97e0 msgr2=0x560067796d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 -- 172.21.15.12:0/1526264003 shutdown_connections 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.882+0000 7f1077288b80 1 -- 172.21.15.12:0/1526264003 wait complete. 2023-12-11T20:16:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.883+0000 7f1077288b80 1 -- start start 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.883+0000 7f1077288b80 1 Processor -- start 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1077288b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1077288b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x5600677a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1077288b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677ab730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1077288b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600676a8560 con 0x56006779a3d0 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1077288b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600676a8200 con 0x56006779bc20 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1077288b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006756d920 con 0x56006779ad30 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1077288b80 10 client.0 _ll_register_callbacks cb 0x5600675d3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f106179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f106179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58638/0 (socket says 172.21.15.12:58638) 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f106179b700 1 -- 172.21.15.12:0/350086335 learned_addr learned my addr 172.21.15.12:0/350086335 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1061f9c700 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1060f9a700 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x5600677a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f106179b700 1 -- 172.21.15.12:0/350086335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 msgr2=0x5600677a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f106179b700 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x5600677a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f106179b700 1 -- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 msgr2=0x5600677ab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f106179b700 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677ab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f106179b700 1 -- 172.21.15.12:0/350086335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c10a220 con 0x56006779a3d0 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.884+0000 7f1061f9c700 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.885+0000 7f106179b700 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a41b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f105800ed50 tx=0x7f105800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d448fa7eb56db03 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.885+0000 7f1044ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.885+0000 7f1044ff9700 1 -- 172.21.15.12:0/350086335 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105801d860 con 0x56006779a3d0 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.885+0000 7f1044ff9700 1 -- 172.21.15.12:0/350086335 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1058004020 con 0x56006779a3d0 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.885+0000 7f1077288b80 1 -- 172.21.15.12:0/350086335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56006778db40 con 0x56006779a3d0 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.885+0000 7f1044ff9700 1 -- 172.21.15.12:0/350086335 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1058004220 con 0x56006779a3d0 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.885+0000 7f1077288b80 10 client.15630 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.885+0000 7f1077288b80 1 -- 172.21.15.12:0/350086335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f1058017070 con 0x56006779a3d0 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1044ff9700 1 -- 172.21.15.12:0/350086335 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56006778db40 con 0x56006779a3d0 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1044ff9700 1 -- 172.21.15.12:0/350086335 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1058037070 con 0x56006779a3d0 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1077288b80 10 client.15630 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1077288b80 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1077288b80 20 client.15630 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1077288b80 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600677affa0 0x5600677b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1077288b80 4 client.15630 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1077288b80 1 -- 172.21.15.12:0/350086335 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560067769f40 con 0x5600677affa0 2023-12-11T20:16:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.886+0000 7f1060f9a700 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600677affa0 0x5600677b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.887+0000 7f1060f9a700 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600677affa0 0x5600677b23c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b495adb8d16c6 server_cookie=f024001d567ae97d in_seq=0 out_seq=0 2023-12-11T20:16:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.887+0000 7f1044ff9700 10 client.15630 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1044ff9700 1 -- 172.21.15.12:0/350086335 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560067769f40 con 0x5600677affa0 2023-12-11T20:16:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1044ff9700 10 client.15630 handle_command_reply: tid=0 2023-12-11T20:16:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 client.15630 shutdown 2023-12-11T20:16:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 -- 172.21.15.12:0/350086335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 msgr2=0x5600677a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a41b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f105800ed50 tx=0x7f105800ee30 comp rx=0 tx=0).stop 2023-12-11T20:16:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 -- 172.21.15.12:0/350086335 shutdown_connections 2023-12-11T20:16:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600677affa0 0x5600677b23c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a41b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1044ff9700 0 client.15630 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 --2- 172.21.15.12:0/350086335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x5600677a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 -- 172.21.15.12:0/350086335 >> 172.21.15.12:0/350086335 conn(0x5600676c97e0 msgr2=0x560067795a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 -- 172.21.15.12:0/350086335 shutdown_connections 2023-12-11T20:16:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 1 -- 172.21.15.12:0/350086335 wait complete. 2023-12-11T20:16:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.888+0000 7f1077288b80 20 client.15630 trim_cache size 0 max 16384 2023-12-11T20:16:17.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.908+0000 7f1077288b80 1 Processor -- start 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.908+0000 7f1077288b80 1 -- start start 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.908+0000 7f1077288b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779a3d0 0x560067796970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.908+0000 7f1077288b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779ad30 0x5600677ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.908+0000 7f1077288b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779bc20 0x560067796eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.908+0000 7f1077288b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006779b110 con 0x56006779bc20 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.908+0000 7f1077288b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560067791b50 con 0x56006779ad30 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.908+0000 7f1077288b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600677b7570 con 0x56006779a3d0 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f1061f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779bc20 0x560067796eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f106179b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779a3d0 0x560067796970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f1061f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779bc20 0x560067796eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58650/0 (socket says 172.21.15.12:58650) 2023-12-11T20:16:17.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f1061f9c700 1 -- 172.21.15.12:0/2476704582 learned_addr learned my addr 172.21.15.12:0/2476704582 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f106179b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779a3d0 0x560067796970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:32876/0 (socket says 172.21.15.12:32876) 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f1060f9a700 1 --2- 172.21.15.12:0/2476704582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779ad30 0x5600677ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f106179b700 1 -- 172.21.15.12:0/2476704582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779ad30 msgr2=0x5600677ab6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f106179b700 1 --2- 172.21.15.12:0/2476704582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779ad30 0x5600677ab6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f106179b700 1 -- 172.21.15.12:0/2476704582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779bc20 msgr2=0x560067796eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f106179b700 1 --2- 172.21.15.12:0/2476704582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779bc20 0x560067796eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f106179b700 1 -- 172.21.15.12:0/2476704582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560067517de0 con 0x56006779a3d0 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.909+0000 7f106179b700 1 --2- 172.21.15.12:0/2476704582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779a3d0 0x560067796970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10580048a0 tx=0x7f105800eaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7edbd9122ba30138 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1047fff700 1 -- 172.21.15.12:0/2476704582 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058004a10 con 0x56006779a3d0 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1047fff700 1 -- 172.21.15.12:0/2476704582 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1058004b70 con 0x56006779a3d0 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1047fff700 1 -- 172.21.15.12:0/2476704582 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058003a10 con 0x56006779a3d0 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1077288b80 1 -- 172.21.15.12:0/2476704582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779a3d0 msgr2=0x560067796970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1077288b80 1 --2- 172.21.15.12:0/2476704582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779a3d0 0x560067796970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10580048a0 tx=0x7f105800eaa0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1077288b80 1 -- 172.21.15.12:0/2476704582 shutdown_connections 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1077288b80 1 --2- 172.21.15.12:0/2476704582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779bc20 0x560067796eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1077288b80 1 --2- 172.21.15.12:0/2476704582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779a3d0 0x560067796970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1077288b80 1 --2- 172.21.15.12:0/2476704582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779ad30 0x5600677ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1077288b80 1 -- 172.21.15.12:0/2476704582 >> 172.21.15.12:0/2476704582 conn(0x5600676c97e0 msgr2=0x56006779eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.910+0000 7f1077288b80 1 -- 172.21.15.12:0/2476704582 shutdown_connections 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.911+0000 7f1077288b80 1 -- 172.21.15.12:0/2476704582 wait complete. 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.911+0000 7f1077288b80 1 -- start start 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.911+0000 7f1077288b80 1 Processor -- start 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1077288b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1077288b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x5600677a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1077288b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1077288b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600677aafc0 con 0x56006779a3d0 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1077288b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600677ab130 con 0x56006779bc20 2023-12-11T20:16:17.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1077288b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600677ab2f0 con 0x56006779ad30 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1077288b80 10 client.0 _ll_register_callbacks cb 0x5600675d3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f106179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f106179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58654/0 (socket says 172.21.15.12:58654) 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f106179b700 1 -- 172.21.15.12:0/183718478 learned_addr learned my addr 172.21.15.12:0/183718478 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1060f9a700 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x5600677a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1061f9c700 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f106179b700 1 -- 172.21.15.12:0/183718478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 msgr2=0x5600677a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f106179b700 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x5600677a7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f106179b700 1 -- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 msgr2=0x5600677aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f106179b700 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f106179b700 1 -- 172.21.15.12:0/183718478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1058017070 con 0x56006779a3d0 2023-12-11T20:16:17.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.912+0000 7f1061f9c700 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.913+0000 7f106179b700 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a7570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f105800ee70 tx=0x7f1058005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228b9113e79590de server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.913+0000 7f1044ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.913+0000 7f1044ff9700 1 -- 172.21.15.12:0/183718478 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058047070 con 0x56006779a3d0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.913+0000 7f1044ff9700 1 -- 172.21.15.12:0/183718478 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1058005380 con 0x56006779a3d0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.913+0000 7f1077288b80 1 -- 172.21.15.12:0/183718478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1058021070 con 0x56006779a3d0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.913+0000 7f1044ff9700 1 -- 172.21.15.12:0/183718478 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f105801d910 con 0x56006779a3d0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.913+0000 7f1077288b80 10 client.15636 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.913+0000 7f1077288b80 1 -- 172.21.15.12:0/183718478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x560067500c60 con 0x56006779a3d0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1044ff9700 1 -- 172.21.15.12:0/183718478 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1058051020 con 0x56006779a3d0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1044ff9700 1 -- 172.21.15.12:0/183718478 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f105804a030 con 0x56006779a3d0 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1077288b80 10 client.15636 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1077288b80 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1077288b80 20 client.15636 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:17.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1077288b80 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560067807050 0x560067809470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1077288b80 4 client.15636 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1077288b80 1 -- 172.21.15.12:0/183718478 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5600676b4fd0 con 0x560067807050 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.914+0000 7f1060f9a700 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560067807050 0x560067809470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1060f9a700 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560067807050 0x560067809470 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5ce85e31c399a7a server_cookie=ed14397ee1486108 in_seq=0 out_seq=0 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1044ff9700 10 client.15636 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1044ff9700 1 -- 172.21.15.12:0/183718478 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5600676b4fd0 con 0x560067807050 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1044ff9700 10 client.15636 handle_command_reply: tid=0 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 client.15636 shutdown 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 -- 172.21.15.12:0/183718478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 msgr2=0x5600677a7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a7570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f105800ee70 tx=0x7f1058005050 comp rx=0 tx=0).stop 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 -- 172.21.15.12:0/183718478 shutdown_connections 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560067807050 0x560067809470 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56006779bc20 0x5600677aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56006779a3d0 0x5600677a7570 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 --2- 172.21.15.12:0/183718478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56006779ad30 0x5600677a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1044ff9700 0 client.15636 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.915+0000 7f1077288b80 1 -- 172.21.15.12:0/183718478 >> 172.21.15.12:0/183718478 conn(0x5600676c97e0 msgr2=0x560067796970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.916+0000 7f1077288b80 1 -- 172.21.15.12:0/183718478 shutdown_connections 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.916+0000 7f1077288b80 1 -- 172.21.15.12:0/183718478 wait complete. 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.916+0000 7f1077288b80 20 client.15636 trim_cache size 0 max 16384 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:16:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:16:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:16:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "0bc9e137-5934-4482-9830-7ef497d2644a": { 2023-12-11T20:16:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:16:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "0bc9e137-5934-4482-9830-7ef497d2644a", 2023-12-11T20:16:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:16:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:16:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:16:17.923 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.916+0000 7f10639ff700 1 -- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10480a1480 msgr2=0x7f10480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.916+0000 7f10639ff700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10480a1480 0x7f10480a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f105c1024e0 tx=0x7f1058009260 comp rx=0 tx=0).stop 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.916+0000 7f10639ff700 1 -- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c102680 msgr2=0x7f105c199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.916+0000 7f10639ff700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c102680 0x7f105c199b50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f104c00e9a0 tx=0x7f104c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.917+0000 7f10639ff700 1 -- 172.21.15.12:0/253318314 shutdown_connections 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.917+0000 7f10639ff700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f10480a1480 0x7f10480a3940 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.917+0000 7f10639ff700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f105c103020 0x7f105c1a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.917+0000 7f10639ff700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f105c101490 0x7f105c199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.917+0000 7f10639ff700 1 --2- 172.21.15.12:0/253318314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f105c102680 0x7f105c199b50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:17.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.917+0000 7f10639ff700 1 -- 172.21.15.12:0/253318314 >> 172.21.15.12:0/253318314 conn(0x7f105c0fca00 msgr2=0x7f105c107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:17.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.917+0000 7f10639ff700 1 -- 172.21.15.12:0/253318314 shutdown_connections 2023-12-11T20:16:17.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:17.917+0000 7f10639ff700 1 -- 172.21.15.12:0/253318314 wait complete. 2023-12-11T20:16:17.936 INFO:tasks.cephfs.filesystem:scrub status for tag:0bc9e137-5934-4482-9830-7ef497d2644a - {'path': '/', 'tag': '0bc9e137-5934-4482-9830-7ef497d2644a', 'options': 'recursive,force'} 2023-12-11T20:16:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:18 smithi032 ceph-mon[132488]: pgmap v386: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:18 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:16:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:18 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:18 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:16:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:18 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:18.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:18 smithi039 ceph-mon[102205]: pgmap v386: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:18.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:18 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:16:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:18 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:18 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:16:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:18 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:18 smithi012 ceph-mon[128787]: pgmap v386: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:18 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:16:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:18 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:18 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:16:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:18 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:19 smithi012 ceph-mon[128787]: pgmap v387: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:19 smithi032 ceph-mon[132488]: pgmap v387: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:19.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:19 smithi039 ceph-mon[102205]: pgmap v387: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:21.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:21 smithi032 ceph-mon[132488]: pgmap v388: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:21.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:21 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:16:21.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:21 smithi039 ceph-mon[102205]: pgmap v388: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:21.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:21 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:16:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:21 smithi012 ceph-mon[128787]: pgmap v388: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:21 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:16:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 -- 172.21.15.12:0/2256550258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 msgr2=0x7fe858104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 --2- 172.21.15.12:0/2256550258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 0x7fe858104160 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe848009990 tx=0x7fe848009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 -- 172.21.15.12:0/2256550258 shutdown_connections 2023-12-11T20:16:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 --2- 172.21.15.12:0/2256550258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe858106fd0 0x7fe858109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 --2- 172.21.15.12:0/2256550258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 0x7fe858104160 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 --2- 172.21.15.12:0/2256550258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8581046a0 0x7fe858106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 -- 172.21.15.12:0/2256550258 >> 172.21.15.12:0/2256550258 conn(0x7fe8580fb780 msgr2=0x7fe8580fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 -- 172.21.15.12:0/2256550258 shutdown_connections 2023-12-11T20:16:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.741+0000 7fe85d59d700 1 -- 172.21.15.12:0/2256550258 wait complete. 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.742+0000 7fe85d59d700 1 Processor -- start 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe85d59d700 1 -- start start 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe85d59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 0x7fe858197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe85d59d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8581046a0 0x7fe858197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe85d59d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe858106fd0 0x7fe85819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe85d59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85819ec60 con 0x7fe858101d70 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe85d59d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85819eda0 con 0x7fe8581046a0 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe85d59d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85819ef30 con 0x7fe858106fd0 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe857fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 0x7fe858197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe857fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 0x7fe858197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36440/0 (socket says 172.21.15.12:36440) 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.743+0000 7fe857fff700 1 -- 172.21.15.12:0/3030734059 learned_addr learned my addr 172.21.15.12:0/3030734059 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe8577fe700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8581046a0 0x7fe858197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe85cd9c700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe858106fd0 0x7fe85819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe857fff700 1 -- 172.21.15.12:0/3030734059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe858106fd0 msgr2=0x7fe85819e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe857fff700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe858106fd0 0x7fe85819e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe857fff700 1 -- 172.21.15.12:0/3030734059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8581046a0 msgr2=0x7fe858197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe857fff700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8581046a0 0x7fe858197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe857fff700 1 -- 172.21.15.12:0/3030734059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8480095f0 con 0x7fe858101d70 2023-12-11T20:16:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe857fff700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 0x7fe858197130 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe848006010 tx=0x7fe848004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.744+0000 7fe8557fa700 1 -- 172.21.15.12:0/3030734059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84801d070 con 0x7fe858101d70 2023-12-11T20:16:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.745+0000 7fe8557fa700 1 -- 172.21.15.12:0/3030734059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe84800bdb0 con 0x7fe858101d70 2023-12-11T20:16:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.745+0000 7fe85d59d700 1 -- 172.21.15.12:0/3030734059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85819f1b0 con 0x7fe858101d70 2023-12-11T20:16:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.745+0000 7fe8557fa700 1 -- 172.21.15.12:0/3030734059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800fdf0 con 0x7fe858101d70 2023-12-11T20:16:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.745+0000 7fe85d59d700 1 -- 172.21.15.12:0/3030734059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85819f630 con 0x7fe858101d70 2023-12-11T20:16:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.749+0000 7fe8557fa700 1 -- 172.21.15.12:0/3030734059 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe84800b920 con 0x7fe858101d70 2023-12-11T20:16:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.750+0000 7fe87215eb80 1 Processor -- start 2023-12-11T20:16:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.750+0000 7fe87215eb80 1 -- start start 2023-12-11T20:16:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe8557fa700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8400a14f0 0x7fe8400a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2328b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e232d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe8557fa700 1 -- 172.21.15.12:0/3030734059 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe8480cdfd0 con 0x7fe858101d70 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e232ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe87215eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e2283af0 con 0x5651e23290d0 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe87215eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e2281410 con 0x5651e2328770 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe87215eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e227cd00 con 0x5651e232db80 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe85cd9c700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8400a14f0 0x7fe8400a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe85cd9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e232ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe857fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2328b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe85cd9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e232ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50574/0 (socket says 172.21.15.12:50574) 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.751+0000 7fe85cd9c700 1 -- 172.21.15.12:0/2230044720 learned_addr learned my addr 172.21.15.12:0/2230044720 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe8577fe700 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e232d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe857fff700 1 -- 172.21.15.12:0/2230044720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 msgr2=0x5651e232ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe857fff700 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e232ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe857fff700 1 -- 172.21.15.12:0/2230044720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 msgr2=0x5651e232d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe857fff700 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e232d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe857fff700 1 -- 172.21.15.12:0/2230044720 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651e20f95d0 con 0x5651e2328770 2023-12-11T20:16:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe8577fe700 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e232d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe85cd9c700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8400a14f0 0x7fe8400a39b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe850009510 tx=0x7fe850009300 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe857fff700 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2328b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe8480cba80 tx=0x7fe848005ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39208bd4aaf72878 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe83e7fc700 1 -- 172.21.15.12:0/2230044720 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84809ac90 con 0x5651e2328770 2023-12-11T20:16:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe83e7fc700 1 -- 172.21.15.12:0/2230044720 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe84800bbd0 con 0x5651e2328770 2023-12-11T20:16:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.752+0000 7fe83e7fc700 1 -- 172.21.15.12:0/2230044720 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800f560 con 0x5651e2328770 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.753+0000 7fe87215eb80 1 -- 172.21.15.12:0/2230044720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 msgr2=0x5651e2328b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.753+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2328b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe8480cba80 tx=0x7fe848005ac0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.753+0000 7fe87215eb80 1 -- 172.21.15.12:0/2230044720 shutdown_connections 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.753+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2328b90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.753+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e232ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.753+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2230044720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e232d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.753+0000 7fe87215eb80 1 -- 172.21.15.12:0/2230044720 >> 172.21.15.12:0/2230044720 conn(0x5651e2257780 msgr2=0x5651e2324b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.753+0000 7fe87215eb80 1 -- 172.21.15.12:0/2230044720 shutdown_connections 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.754+0000 7fe87215eb80 1 -- 172.21.15.12:0/2230044720 wait complete. 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.754+0000 7fe87215eb80 1 -- start start 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.754+0000 7fe87215eb80 1 Processor -- start 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2335e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e23363d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e233d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe87215eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e2236500 con 0x5651e23290d0 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe87215eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e22361a0 con 0x5651e2328770 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe87215eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e20fb8c0 con 0x5651e232db80 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe87215eb80 10 client.0 _ll_register_callbacks cb 0x5651e2161a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe857fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2335e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe857fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2335e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:56514/0 (socket says 172.21.15.12:56514) 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe857fff700 1 -- 172.21.15.12:0/1880541560 learned_addr learned my addr 172.21.15.12:0/1880541560 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe8577fe700 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e23363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe85cd9c700 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e233d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe857fff700 1 -- 172.21.15.12:0/1880541560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 msgr2=0x5651e233d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe857fff700 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e233d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe857fff700 1 -- 172.21.15.12:0/1880541560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 msgr2=0x5651e23363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe857fff700 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e23363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.755+0000 7fe857fff700 1 -- 172.21.15.12:0/1880541560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85819f630 con 0x5651e2328770 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe8577fe700 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e23363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe857fff700 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2335e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe84809f640 tx=0x7fe848009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=346b5af6969527d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe8377fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe8377fe700 1 -- 172.21.15.12:0/1880541560 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84809ac90 con 0x5651e2328770 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe8377fe700 1 -- 172.21.15.12:0/1880541560 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe84809b330 con 0x5651e2328770 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe87215eb80 1 -- 172.21.15.12:0/1880541560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651e231b730 con 0x5651e2328770 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe8377fe700 1 -- 172.21.15.12:0/1880541560 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe84809ba30 con 0x5651e2328770 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe87215eb80 10 client.25460 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.756+0000 7fe87215eb80 1 -- 172.21.15.12:0/1880541560 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5651e20a5d80 con 0x5651e2328770 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe8377fe700 1 -- 172.21.15.12:0/1880541560 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5651e231b730 con 0x5651e2328770 2023-12-11T20:16:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe8377fe700 1 -- 172.21.15.12:0/1880541560 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe8480b92a0 con 0x5651e2328770 2023-12-11T20:16:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe87215eb80 10 client.25460 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe87215eb80 10 client.25460 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe87215eb80 20 client.25460 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe87215eb80 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5651e23418c0 0x5651e2343ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe87215eb80 4 client.25460 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe87215eb80 1 -- 172.21.15.12:0/1880541560 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651e22f7ee0 con 0x5651e23418c0 2023-12-11T20:16:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.757+0000 7fe8577fe700 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5651e23418c0 0x5651e2343ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.758+0000 7fe8577fe700 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5651e23418c0 0x5651e2343ce0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30a0d952ddb5002c server_cookie=da4a584324ab3cd in_seq=0 out_seq=0 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.758+0000 7fe8377fe700 10 client.25460 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe8377fe700 1 -- 172.21.15.12:0/1880541560 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5651e22f7ee0 con 0x5651e23418c0 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe8377fe700 10 client.25460 handle_command_reply: tid=0 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 client.25460 shutdown 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 -- 172.21.15.12:0/1880541560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 msgr2=0x5651e2335e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2335e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe84809f640 tx=0x7fe848009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 -- 172.21.15.12:0/1880541560 shutdown_connections 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5651e23418c0 0x5651e2343ce0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e2328770 0x5651e2335e90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e233d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 --2- 172.21.15.12:0/1880541560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e23290d0 0x5651e23363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 -- 172.21.15.12:0/1880541560 >> 172.21.15.12:0/1880541560 conn(0x5651e2257780 msgr2=0x5651e2325560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe8377fe700 0 client.25460 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 -- 172.21.15.12:0/1880541560 shutdown_connections 2023-12-11T20:16:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.759+0000 7fe87215eb80 1 -- 172.21.15.12:0/1880541560 wait complete. 2023-12-11T20:16:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.760+0000 7fe87215eb80 20 client.25460 trim_cache size 0 max 16384 2023-12-11T20:16:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.776+0000 7fe87215eb80 1 Processor -- start 2023-12-11T20:16:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.776+0000 7fe87215eb80 1 -- start start 2023-12-11T20:16:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.776+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e2343ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.776+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e23290d0 0x5651e233d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.776+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e23353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.776+0000 7fe87215eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e231b710 con 0x5651e2328770 2023-12-11T20:16:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.776+0000 7fe87215eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e2335a00 con 0x5651e23290d0 2023-12-11T20:16:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.776+0000 7fe87215eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e231f5f0 con 0x5651e232db80 2023-12-11T20:16:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e2343ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e2343ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36460/0 (socket says 172.21.15.12:36460) 2023-12-11T20:16:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 -- 172.21.15.12:0/3937926174 learned_addr learned my addr 172.21.15.12:0/3937926174 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe85cd9c700 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e23353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe8577fe700 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e23290d0 0x5651e233d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 -- 172.21.15.12:0/3937926174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 msgr2=0x5651e23353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e23353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 -- 172.21.15.12:0/3937926174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e23290d0 msgr2=0x5651e233d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e23290d0 0x5651e233d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 -- 172.21.15.12:0/3937926174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651e208ec00 con 0x5651e2328770 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe8577fe700 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e23290d0 0x5651e233d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.777+0000 7fe857fff700 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e2343ce0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b2e0 tx=0x7fe8480998e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b262525be365c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe83effd700 1 -- 172.21.15.12:0/3937926174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84809ac90 con 0x5651e2328770 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe83effd700 1 -- 172.21.15.12:0/3937926174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe84809ba30 con 0x5651e2328770 2023-12-11T20:16:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe83effd700 1 -- 172.21.15.12:0/3937926174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480b92a0 con 0x5651e2328770 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe87215eb80 1 -- 172.21.15.12:0/3937926174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 msgr2=0x5651e2343ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe87215eb80 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e2343ce0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b2e0 tx=0x7fe8480998e0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe87215eb80 1 -- 172.21.15.12:0/3937926174 shutdown_connections 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe87215eb80 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e232db80 0x5651e23353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe87215eb80 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e2343ce0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe87215eb80 1 --2- 172.21.15.12:0/3937926174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e23290d0 0x5651e233d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.778+0000 7fe87215eb80 1 -- 172.21.15.12:0/3937926174 >> 172.21.15.12:0/3937926174 conn(0x5651e2257780 msgr2=0x5651e23310c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.779+0000 7fe87215eb80 1 -- 172.21.15.12:0/3937926174 shutdown_connections 2023-12-11T20:16:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.779+0000 7fe87215eb80 1 -- 172.21.15.12:0/3937926174 wait complete. 2023-12-11T20:16:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.779+0000 7fe87215eb80 1 -- start start 2023-12-11T20:16:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.779+0000 7fe87215eb80 1 Processor -- start 2023-12-11T20:16:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e233a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e23290d0 0x5651e233add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe87215eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e232db80 0x5651e233bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe87215eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e233c320 con 0x5651e2328770 2023-12-11T20:16:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe87215eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e233c490 con 0x5651e232db80 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe87215eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e233c650 con 0x5651e23290d0 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe87215eb80 10 client.0 _ll_register_callbacks cb 0x5651e2161a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe857fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e233a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe857fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e233a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36476/0 (socket says 172.21.15.12:36476) 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe857fff700 1 -- 172.21.15.12:0/2997542134 learned_addr learned my addr 172.21.15.12:0/2997542134 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe8577fe700 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e23290d0 0x5651e233add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe85cd9c700 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e232db80 0x5651e233bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe857fff700 1 -- 172.21.15.12:0/2997542134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e23290d0 msgr2=0x5651e233add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe857fff700 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e23290d0 0x5651e233add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe857fff700 1 -- 172.21.15.12:0/2997542134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e232db80 msgr2=0x5651e233bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe857fff700 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e232db80 0x5651e233bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.780+0000 7fe857fff700 1 -- 172.21.15.12:0/2997542134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651e20a5d80 con 0x5651e2328770 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe857fff700 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e233a890 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe848097830 tx=0x7fe848009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c7235468a4cae4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe8377fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe8377fe700 1 -- 172.21.15.12:0/2997542134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84809ac90 con 0x5651e2328770 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe8377fe700 1 -- 172.21.15.12:0/2997542134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe848064030 con 0x5651e2328770 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe87215eb80 1 -- 172.21.15.12:0/2997542134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651e231dfb0 con 0x5651e2328770 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe8377fe700 1 -- 172.21.15.12:0/2997542134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe84809b330 con 0x5651e2328770 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe87215eb80 10 client.15654 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe87215eb80 1 -- 172.21.15.12:0/2997542134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5651e20cc1f0 con 0x5651e2328770 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.781+0000 7fe8377fe700 1 -- 172.21.15.12:0/2997542134 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5651e231dfb0 con 0x5651e2328770 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.782+0000 7fe8377fe700 1 -- 172.21.15.12:0/2997542134 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe8480ad030 con 0x5651e2328770 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.782+0000 7fe87215eb80 10 client.15654 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.782+0000 7fe87215eb80 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.782+0000 7fe87215eb80 20 client.15654 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.782+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5651e2397db0 0x5651e239a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.782+0000 7fe87215eb80 4 client.15654 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:16:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.782+0000 7fe87215eb80 1 -- 172.21.15.12:0/2997542134 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fe84800bbd0 con 0x5651e2397db0 2023-12-11T20:16:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.782+0000 7fe8577fe700 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5651e2397db0 0x5651e239a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.783+0000 7fe8577fe700 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5651e2397db0 0x5651e239a1a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9591bcc4cfecbfd server_cookie=3bcbe3431e3bfca6 in_seq=0 out_seq=0 2023-12-11T20:16:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.783+0000 7fe8377fe700 10 client.15654 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.787+0000 7fe8377fe700 1 -- 172.21.15.12:0/2997542134 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fe84800bbd0 con 0x5651e2397db0 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.787+0000 7fe8377fe700 10 client.15654 handle_command_reply: tid=0 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.787+0000 7fe87215eb80 1 client.15654 shutdown 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.787+0000 7fe87215eb80 1 -- 172.21.15.12:0/2997542134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 msgr2=0x5651e233a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.787+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e233a890 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe848097830 tx=0x7fe848009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 1 -- 172.21.15.12:0/2997542134 shutdown_connections 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5651e2397db0 0x5651e239a1a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5651e232db80 0x5651e233bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651e2328770 0x5651e233a890 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 1 --2- 172.21.15.12:0/2997542134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5651e23290d0 0x5651e233add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 1 -- 172.21.15.12:0/2997542134 >> 172.21.15.12:0/2997542134 conn(0x5651e2257780 msgr2=0x5651e2324660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe8377fe700 0 client.15654 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 1 -- 172.21.15.12:0/2997542134 shutdown_connections 2023-12-11T20:16:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 1 -- 172.21.15.12:0/2997542134 wait complete. 2023-12-11T20:16:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.788+0000 7fe87215eb80 20 client.15654 trim_cache size 0 max 16384 2023-12-11T20:16:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:16:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:16:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:16:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:16:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 -- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8400a14f0 msgr2=0x7fe8400a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8400a14f0 0x7fe8400a39b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe850009510 tx=0x7fe850009300 comp rx=0 tx=0).stop 2023-12-11T20:16:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 -- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 msgr2=0x7fe858197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 0x7fe858197130 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe848006010 tx=0x7fe848004730 comp rx=0 tx=0).stop 2023-12-11T20:16:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 -- 172.21.15.12:0/3030734059 shutdown_connections 2023-12-11T20:16:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8400a14f0 0x7fe8400a39b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe858106fd0 0x7fe85819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe858101d70 0x7fe858197130 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 --2- 172.21.15.12:0/3030734059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8581046a0 0x7fe858197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 -- 172.21.15.12:0/3030734059 >> 172.21.15.12:0/3030734059 conn(0x7fe8580fb780 msgr2=0x7fe858103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 -- 172.21.15.12:0/3030734059 shutdown_connections 2023-12-11T20:16:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:23.789+0000 7fe85d59d700 1 -- 172.21.15.12:0/3030734059 wait complete. 2023-12-11T20:16:24.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:24 smithi032 ceph-mon[132488]: pgmap v389: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2023-12-11T20:16:24.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:24 smithi039 ceph-mon[102205]: pgmap v389: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2023-12-11T20:16:24.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:24 smithi012 ceph-mon[128787]: pgmap v389: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 8 op/s 2023-12-11T20:16:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:26 smithi032 ceph-mon[132488]: pgmap v390: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2023-12-11T20:16:26.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:26 smithi039 ceph-mon[102205]: pgmap v390: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2023-12-11T20:16:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:26 smithi012 ceph-mon[128787]: pgmap v390: 97 pgs: 97 active+clean; 658 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2023-12-11T20:16:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:28 smithi032 ceph-mon[132488]: pgmap v391: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-12-11T20:16:28.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:28 smithi039 ceph-mon[102205]: pgmap v391: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-12-11T20:16:28.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:28 smithi012 ceph-mon[128787]: pgmap v391: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-12-11T20:16:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:29 smithi012 ceph-mon[128787]: pgmap v392: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:29 smithi032 ceph-mon[132488]: pgmap v392: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:29.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:29 smithi039 ceph-mon[102205]: pgmap v392: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:32 smithi032 ceph-mon[132488]: pgmap v393: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:32.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:32 smithi039 ceph-mon[102205]: pgmap v393: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:32 smithi012 ceph-mon[128787]: pgmap v393: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:34 smithi032 ceph-mon[132488]: pgmap v394: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:34 smithi039 ceph-mon[102205]: pgmap v394: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:34.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:34 smithi012 ceph-mon[128787]: pgmap v394: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:36.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:36 smithi032 ceph-mon[132488]: pgmap v395: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:36.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:36 smithi039 ceph-mon[102205]: pgmap v395: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:36.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:36 smithi012 ceph-mon[128787]: pgmap v395: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.028+0000 7f97373ff700 1 -- 172.21.15.12:0/338177228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f973010daa0 msgr2=0x7f973010fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.028+0000 7f97373ff700 1 --2- 172.21.15.12:0/338177228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f973010daa0 0x7f973010fe90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f972800b0a0 tx=0x7f972800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.029+0000 7f97373ff700 1 -- 172.21.15.12:0/338177228 shutdown_connections 2023-12-11T20:16:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.029+0000 7f97373ff700 1 --2- 172.21.15.12:0/338177228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f973010daa0 0x7f973010fe90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.029+0000 7f97373ff700 1 --2- 172.21.15.12:0/338177228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9730075610 0x7f9730073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.029+0000 7f97373ff700 1 --2- 172.21.15.12:0/338177228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9730074030 0x7f97300744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.029+0000 7f97373ff700 1 -- 172.21.15.12:0/338177228 >> 172.21.15.12:0/338177228 conn(0x7f97300fca60 msgr2=0x7f97300fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.029+0000 7f97373ff700 1 -- 172.21.15.12:0/338177228 shutdown_connections 2023-12-11T20:16:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.029+0000 7f97373ff700 1 -- 172.21.15.12:0/338177228 wait complete. 2023-12-11T20:16:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.030+0000 7f97373ff700 1 Processor -- start 2023-12-11T20:16:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.031+0000 7f97373ff700 1 -- start start 2023-12-11T20:16:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.031+0000 7f97373ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9730074030 0x7f973019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.031+0000 7f97373ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9730075610 0x7f973019df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.031+0000 7f97373ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f973010daa0 0x7f97301a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f97373ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301a5520 con 0x7f973010daa0 2023-12-11T20:16:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f97373ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301a5660 con 0x7f9730075610 2023-12-11T20:16:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f97373ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301a57f0 con 0x7f9730074030 2023-12-11T20:16:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973499a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9730075610 0x7f973019df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973519b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9730074030 0x7f973019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973499a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9730075610 0x7f973019df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46862/0 (socket says 172.21.15.12:46862) 2023-12-11T20:16:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973599c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f973010daa0 0x7f97301a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973499a700 1 -- 172.21.15.12:0/1410522393 learned_addr learned my addr 172.21.15.12:0/1410522393 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973519b700 1 -- 172.21.15.12:0/1410522393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9730075610 msgr2=0x7f973019df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973519b700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9730075610 0x7f973019df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973519b700 1 -- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f973010daa0 msgr2=0x7f97301a4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973519b700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f973010daa0 0x7f97301a4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.032+0000 7f973519b700 1 -- 172.21.15.12:0/1410522393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720009520 con 0x7f9730074030 2023-12-11T20:16:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.033+0000 7f973519b700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9730074030 0x7f973019d9f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f972c00d950 tx=0x7f972c00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.033+0000 7f97267fc700 1 -- 172.21.15.12:0/1410522393 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00f890 con 0x7f9730074030 2023-12-11T20:16:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.033+0000 7f97267fc700 1 -- 172.21.15.12:0/1410522393 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f972c00fe80 con 0x7f9730074030 2023-12-11T20:16:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.033+0000 7f97267fc700 1 -- 172.21.15.12:0/1410522393 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00e3b0 con 0x7f9730074030 2023-12-11T20:16:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.033+0000 7f97373ff700 1 -- 172.21.15.12:0/1410522393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9728009d00 con 0x7f9730074030 2023-12-11T20:16:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.033+0000 7f97373ff700 1 -- 172.21.15.12:0/1410522393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97301a5e00 con 0x7f9730074030 2023-12-11T20:16:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.038+0000 7f97267fc700 1 -- 172.21.15.12:0/1410522393 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f972c00f9f0 con 0x7f9730074030 2023-12-11T20:16:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.040+0000 7f974ad96b80 1 Processor -- start 2023-12-11T20:16:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f974ad96b80 1 -- start start 2023-12-11T20:16:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f97267fc700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f971c0a1470 0x7f971c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 0x556404a042f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a05140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f97267fc700 1 -- 172.21.15.12:0/1410522393 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f972c0ccab0 con 0x7f9730074030 2023-12-11T20:16:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f974ad96b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640495faf0 con 0x556404a05720 2023-12-11T20:16:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f974ad96b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640495d410 con 0x556404a04830 2023-12-11T20:16:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.041+0000 7f974ad96b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556404958d00 con 0x556404a03ed0 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.042+0000 7f973499a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a05140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.042+0000 7f973499a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a05140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46868/0 (socket says 172.21.15.12:46868) 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.042+0000 7f973499a700 1 -- 172.21.15.12:0/2669523125 learned_addr learned my addr 172.21.15.12:0/2669523125 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.042+0000 7f973599c700 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.042+0000 7f973599c700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f971c0a1470 0x7f971c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.042+0000 7f973519b700 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 0x556404a042f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f973499a700 1 -- 172.21.15.12:0/2669523125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 msgr2=0x556404a042f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f973499a700 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 0x556404a042f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f973499a700 1 -- 172.21.15.12:0/2669523125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 msgr2=0x556404a05ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f973499a700 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f973499a700 1 -- 172.21.15.12:0/2669523125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564047d55d0 con 0x556404a04830 2023-12-11T20:16:37.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f973499a700 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a05140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9720009fa0 tx=0x7f9720011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1555e4799ebe8f28 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f973599c700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f971c0a1470 0x7f971c0a3930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9728009fd0 tx=0x7f9728009c20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f971b7fe700 1 -- 172.21.15.12:0/2669523125 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720004a30 con 0x556404a04830 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f971b7fe700 1 -- 172.21.15.12:0/2669523125 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97200054b0 con 0x556404a04830 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.043+0000 7f971b7fe700 1 -- 172.21.15.12:0/2669523125 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200197f0 con 0x556404a04830 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.044+0000 7f974ad96b80 1 -- 172.21.15.12:0/2669523125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 msgr2=0x556404a05140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.044+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a05140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9720009fa0 tx=0x7f9720011720 comp rx=0 tx=0).stop 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.045+0000 7f974ad96b80 1 -- 172.21.15.12:0/2669523125 shutdown_connections 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.045+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.045+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 0x556404a042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.045+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2669523125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a05140 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.045+0000 7f974ad96b80 1 -- 172.21.15.12:0/2669523125 >> 172.21.15.12:0/2669523125 conn(0x556404933780 msgr2=0x556404a00880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.045+0000 7f974ad96b80 1 -- 172.21.15.12:0/2669523125 shutdown_connections 2023-12-11T20:16:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.045+0000 7f974ad96b80 1 -- 172.21.15.12:0/2669523125 wait complete. 2023-12-11T20:16:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.046+0000 7f974ad96b80 1 -- start start 2023-12-11T20:16:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.046+0000 7f974ad96b80 1 Processor -- start 2023-12-11T20:16:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a04830 0x556404a0e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a05720 0x556404a15220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f974ad96b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556404912500 con 0x556404a04830 2023-12-11T20:16:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f974ad96b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564049121a0 con 0x556404a03ed0 2023-12-11T20:16:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f974ad96b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564047d78c0 con 0x556404a05720 2023-12-11T20:16:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f974ad96b80 10 client.0 _ll_register_callbacks cb 0x55640483da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f973519b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f973519b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46882/0 (socket says 172.21.15.12:46882) 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f973519b700 1 -- 172.21.15.12:0/3758497589 learned_addr learned my addr 172.21.15.12:0/3758497589 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f973499a700 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a04830 0x556404a0e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.047+0000 7f973599c700 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a05720 0x556404a15220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f973519b700 1 -- 172.21.15.12:0/3758497589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a05720 msgr2=0x556404a15220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f973519b700 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a05720 0x556404a15220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f973519b700 1 -- 172.21.15.12:0/3758497589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a04830 msgr2=0x556404a0e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f973519b700 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a04830 0x556404a0e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f973519b700 1 -- 172.21.15.12:0/3758497589 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9720009bd0 con 0x556404a03ed0 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f973499a700 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a04830 0x556404a0e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f973519b700 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0deb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f972c0a1b80 tx=0x7f972c010780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84ec23ee42a780af server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f9718ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f9718ff9700 1 -- 172.21.15.12:0/3758497589 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c099d20 con 0x556404a03ed0 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f9718ff9700 1 -- 172.21.15.12:0/3758497589 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f972c09de70 con 0x556404a03ed0 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.048+0000 7f974ad96b80 1 -- 172.21.15.12:0/3758497589 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564049f7730 con 0x556404a03ed0 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.049+0000 7f9718ff9700 1 -- 172.21.15.12:0/3758497589 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f972c0a20b0 con 0x556404a03ed0 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.049+0000 7f974ad96b80 10 client.25475 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.049+0000 7f974ad96b80 1 -- 172.21.15.12:0/3758497589 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x556404781d80 con 0x556404a03ed0 2023-12-11T20:16:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.049+0000 7f9718ff9700 1 -- 172.21.15.12:0/3758497589 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f972c0b8030 con 0x556404a03ed0 2023-12-11T20:16:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.050+0000 7f9718ff9700 1 -- 172.21.15.12:0/3758497589 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f972c095b10 con 0x556404a03ed0 2023-12-11T20:16:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.050+0000 7f974ad96b80 10 client.25475 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.050+0000 7f974ad96b80 10 client.25475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.050+0000 7f974ad96b80 20 client.25475 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.050+0000 7f974ad96b80 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556404a19d00 0x556404a1c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.050+0000 7f974ad96b80 4 client.25475 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.050+0000 7f974ad96b80 1 -- 172.21.15.12:0/3758497589 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564049d3ee0 con 0x556404a19d00 2023-12-11T20:16:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.051+0000 7f973499a700 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556404a19d00 0x556404a1c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.051+0000 7f973499a700 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556404a19d00 0x556404a1c120 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eea5ac5ac319e896 server_cookie=3fabe3c0dd3c5d66 in_seq=0 out_seq=0 2023-12-11T20:16:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.051+0000 7f9718ff9700 10 client.25475 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.052+0000 7f9718ff9700 1 -- 172.21.15.12:0/3758497589 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5564049d3ee0 con 0x556404a19d00 2023-12-11T20:16:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.052+0000 7f9718ff9700 10 client.25475 handle_command_reply: tid=0 2023-12-11T20:16:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.052+0000 7f974ad96b80 1 client.25475 shutdown 2023-12-11T20:16:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f974ad96b80 1 -- 172.21.15.12:0/3758497589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 msgr2=0x556404a0deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f974ad96b80 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0deb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f972c0a1b80 tx=0x7f972c010780 comp rx=0 tx=0).stop 2023-12-11T20:16:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f974ad96b80 1 -- 172.21.15.12:0/3758497589 shutdown_connections 2023-12-11T20:16:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f974ad96b80 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556404a19d00 0x556404a1c120 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f9718ff9700 0 client.25475 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f974ad96b80 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0deb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f974ad96b80 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a05720 0x556404a15220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f974ad96b80 1 --2- 172.21.15.12:0/3758497589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a04830 0x556404a0e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.053+0000 7f974ad96b80 1 -- 172.21.15.12:0/3758497589 >> 172.21.15.12:0/3758497589 conn(0x556404933780 msgr2=0x5564049feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.054+0000 7f974ad96b80 1 -- 172.21.15.12:0/3758497589 shutdown_connections 2023-12-11T20:16:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.054+0000 7f974ad96b80 1 -- 172.21.15.12:0/3758497589 wait complete. 2023-12-11T20:16:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.054+0000 7f974ad96b80 20 client.25475 trim_cache size 0 max 16384 2023-12-11T20:16:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.084+0000 7f974ad96b80 1 Processor -- start 2023-12-11T20:16:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.085+0000 7f974ad96b80 1 -- start start 2023-12-11T20:16:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a04830 0x556404a151b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f974ad96b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556404a19a70 con 0x556404a05720 2023-12-11T20:16:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f974ad96b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556404a21330 con 0x556404a03ed0 2023-12-11T20:16:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f974ad96b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556404a15820 con 0x556404a04830 2023-12-11T20:16:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f973499a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a04830 0x556404a151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f973499a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a04830 0x556404a151b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53130/0 (socket says 172.21.15.12:53130) 2023-12-11T20:16:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f973499a700 1 -- 172.21.15.12:0/1467116341 learned_addr learned my addr 172.21.15.12:0/1467116341 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f973599c700 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.086+0000 7f973519b700 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f973499a700 1 -- 172.21.15.12:0/1467116341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 msgr2=0x556404a0d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f973499a700 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f973499a700 1 -- 172.21.15.12:0/1467116341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 msgr2=0x556404a05b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f973499a700 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f973499a700 1 -- 172.21.15.12:0/1467116341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55640476ac00 con 0x556404a04830 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f973599c700 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f973499a700 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a04830 0x556404a151b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9720009fd0 tx=0x7f9720009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84b9705c421be247 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f971bfff700 1 -- 172.21.15.12:0/1467116341 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720005ce0 con 0x556404a04830 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f971bfff700 1 -- 172.21.15.12:0/1467116341 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f972002d070 con 0x556404a04830 2023-12-11T20:16:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.087+0000 7f971bfff700 1 -- 172.21.15.12:0/1467116341 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720004710 con 0x556404a04830 2023-12-11T20:16:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.088+0000 7f974ad96b80 1 -- 172.21.15.12:0/1467116341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a04830 msgr2=0x556404a151b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.088+0000 7f974ad96b80 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a04830 0x556404a151b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9720009fd0 tx=0x7f9720009880 comp rx=0 tx=0).stop 2023-12-11T20:16:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.088+0000 7f974ad96b80 1 -- 172.21.15.12:0/1467116341 shutdown_connections 2023-12-11T20:16:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.088+0000 7f974ad96b80 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a03ed0 0x556404a0d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.088+0000 7f974ad96b80 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a05b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.088+0000 7f974ad96b80 1 --2- 172.21.15.12:0/1467116341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a04830 0x556404a151b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.088+0000 7f974ad96b80 1 -- 172.21.15.12:0/1467116341 >> 172.21.15.12:0/1467116341 conn(0x556404933780 msgr2=0x556404a0bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.089+0000 7f974ad96b80 1 -- 172.21.15.12:0/1467116341 shutdown_connections 2023-12-11T20:16:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.089+0000 7f974ad96b80 1 -- 172.21.15.12:0/1467116341 wait complete. 2023-12-11T20:16:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.089+0000 7f974ad96b80 1 -- start start 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.090+0000 7f974ad96b80 1 Processor -- start 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.090+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 0x556404a12e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.090+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a13360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.090+0000 7f974ad96b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a14320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.090+0000 7f974ad96b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556404a14860 con 0x556404a05720 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.090+0000 7f974ad96b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556404a149d0 con 0x556404a04830 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.090+0000 7f974ad96b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556404a14b90 con 0x556404a03ed0 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.090+0000 7f974ad96b80 10 client.0 _ll_register_callbacks cb 0x55640483da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.091+0000 7f973519b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 0x556404a12e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.091+0000 7f973599c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a14320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.091+0000 7f973599c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a14320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34642/0 (socket says 172.21.15.12:34642) 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.091+0000 7f973599c700 1 -- 172.21.15.12:0/2206953046 learned_addr learned my addr 172.21.15.12:0/2206953046 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.091+0000 7f973499a700 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a13360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.091+0000 7f973599c700 1 -- 172.21.15.12:0/2206953046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 msgr2=0x556404a12e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.091+0000 7f973599c700 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 0x556404a12e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.091+0000 7f973599c700 1 -- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 msgr2=0x556404a13360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.092+0000 7f973599c700 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a13360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.092+0000 7f973599c700 1 -- 172.21.15.12:0/2206953046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564047d55d0 con 0x556404a05720 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.092+0000 7f973499a700 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a13360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.092+0000 7f973599c700 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a14320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f972800d010 tx=0x7f9728025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d245e0b68a4678d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.092+0000 7f9718ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.092+0000 7f9718ff9700 1 -- 172.21.15.12:0/2206953046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800e040 con 0x556404a05720 2023-12-11T20:16:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.092+0000 7f9718ff9700 1 -- 172.21.15.12:0/2206953046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f972802b670 con 0x556404a05720 2023-12-11T20:16:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.092+0000 7f974ad96b80 1 -- 172.21.15.12:0/2206953046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97200054b0 con 0x556404a05720 2023-12-11T20:16:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.093+0000 7f9718ff9700 1 -- 172.21.15.12:0/2206953046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9728025070 con 0x556404a05720 2023-12-11T20:16:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.093+0000 7f974ad96b80 10 client.15672 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.093+0000 7f974ad96b80 1 -- 172.21.15.12:0/2206953046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5564047a81f0 con 0x556404a05720 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.093+0000 7f9718ff9700 1 -- 172.21.15.12:0/2206953046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f972803a020 con 0x556404a05720 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.094+0000 7f9718ff9700 1 -- 172.21.15.12:0/2206953046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9728033060 con 0x556404a05720 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.094+0000 7f974ad96b80 10 client.15672 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.094+0000 7f974ad96b80 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.094+0000 7f974ad96b80 20 client.15672 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.094+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556404a19d00 0x556404a84120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.094+0000 7f974ad96b80 4 client.15672 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.094+0000 7f974ad96b80 1 -- 172.21.15.12:0/2206953046 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55640491ef70 con 0x556404a19d00 2023-12-11T20:16:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.095+0000 7f973519b700 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556404a19d00 0x556404a84120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.095+0000 7f973519b700 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556404a19d00 0x556404a84120 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a6311c212bb2ddc server_cookie=f584aff6de6a1060 in_seq=0 out_seq=0 2023-12-11T20:16:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.095+0000 7f9718ff9700 10 client.15672 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.100+0000 7f9718ff9700 1 -- 172.21.15.12:0/2206953046 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55640491ef70 con 0x556404a19d00 2023-12-11T20:16:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.100+0000 7f9718ff9700 10 client.15672 handle_command_reply: tid=0 2023-12-11T20:16:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.100+0000 7f974ad96b80 1 client.15672 shutdown 2023-12-11T20:16:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 -- 172.21.15.12:0/2206953046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 msgr2=0x556404a14320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a14320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f972800d010 tx=0x7f9728025000 comp rx=0 tx=0).stop 2023-12-11T20:16:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 -- 172.21.15.12:0/2206953046 shutdown_connections 2023-12-11T20:16:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556404a19d00 0x556404a84120 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556404a05720 0x556404a14320 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556404a03ed0 0x556404a12e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 --2- 172.21.15.12:0/2206953046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556404a04830 0x556404a13360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 -- 172.21.15.12:0/2206953046 >> 172.21.15.12:0/2206953046 conn(0x556404933780 msgr2=0x556404a08370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f9718ff9700 0 client.15672 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 -- 172.21.15.12:0/2206953046 shutdown_connections 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.101+0000 7f974ad96b80 1 -- 172.21.15.12:0/2206953046 wait complete. 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.102+0000 7f974ad96b80 20 client.15672 trim_cache size 0 max 16384 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:16:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:16:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:16:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.102+0000 7f97373ff700 1 -- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f971c0a1470 msgr2=0x7f971c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.102+0000 7f97373ff700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f971c0a1470 0x7f971c0a3930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9728009fd0 tx=0x7f9728009c20 comp rx=0 tx=0).stop 2023-12-11T20:16:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.102+0000 7f97373ff700 1 -- 172.21.15.12:0/1410522393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9730074030 msgr2=0x7f973019d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.102+0000 7f97373ff700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9730074030 0x7f973019d9f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f972c00d950 tx=0x7f972c00dc60 comp rx=0 tx=0).stop 2023-12-11T20:16:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.103+0000 7f97373ff700 1 -- 172.21.15.12:0/1410522393 shutdown_connections 2023-12-11T20:16:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.103+0000 7f97373ff700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f971c0a1470 0x7f971c0a3930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.103+0000 7f97373ff700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f973010daa0 0x7f97301a4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.103+0000 7f97373ff700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9730074030 0x7f973019d9f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.103+0000 7f97373ff700 1 --2- 172.21.15.12:0/1410522393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9730075610 0x7f973019df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.103+0000 7f97373ff700 1 -- 172.21.15.12:0/1410522393 >> 172.21.15.12:0/1410522393 conn(0x7f97300fca60 msgr2=0x7f9730100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.103+0000 7f97373ff700 1 -- 172.21.15.12:0/1410522393 shutdown_connections 2023-12-11T20:16:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:37.103+0000 7f97373ff700 1 -- 172.21.15.12:0/1410522393 wait complete. 2023-12-11T20:16:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:38 smithi032 ceph-mon[132488]: pgmap v396: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:38.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:38 smithi039 ceph-mon[102205]: pgmap v396: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:38.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:38 smithi012 ceph-mon[128787]: pgmap v396: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:39 smithi012 ceph-mon[128787]: pgmap v397: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:16:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:39 smithi032 ceph-mon[132488]: pgmap v397: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:16:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:39 smithi039 ceph-mon[102205]: pgmap v397: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:16:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:42 smithi032 ceph-mon[132488]: pgmap v398: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-11T20:16:42.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:42 smithi039 ceph-mon[102205]: pgmap v398: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-11T20:16:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:42 smithi012 ceph-mon[128787]: pgmap v398: 97 pgs: 97 active+clean; 659 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-11T20:16:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:44 smithi032 ceph-mon[132488]: pgmap v399: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:44.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:44 smithi039 ceph-mon[102205]: pgmap v399: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:44.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:44 smithi012 ceph-mon[128787]: pgmap v399: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:46 smithi032 ceph-mon[132488]: pgmap v400: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:46 smithi039 ceph-mon[102205]: pgmap v400: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:46.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:46 smithi012 ceph-mon[128787]: pgmap v400: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:47.940 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:16:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 -- 172.21.15.12:0/1743359366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13a81024e0 msgr2=0x7f13a8102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 --2- 172.21.15.12:0/1743359366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13a81024e0 0x7f13a8102940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f139c009990 tx=0x7f139c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 -- 172.21.15.12:0/1743359366 shutdown_connections 2023-12-11T20:16:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 --2- 172.21.15.12:0/1743359366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13a81012f0 0x7f13a8101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 --2- 172.21.15.12:0/1743359366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13a8102e80 0x7f13a8109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 --2- 172.21.15.12:0/1743359366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13a81024e0 0x7f13a8102940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 -- 172.21.15.12:0/1743359366 >> 172.21.15.12:0/1743359366 conn(0x7f13a80fc860 msgr2=0x7f13a80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:48.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 -- 172.21.15.12:0/1743359366 shutdown_connections 2023-12-11T20:16:48.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.292+0000 7f13a759e700 1 -- 172.21.15.12:0/1743359366 wait complete. 2023-12-11T20:16:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.294+0000 7f13a759e700 1 Processor -- start 2023-12-11T20:16:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.294+0000 7f13a759e700 1 -- start start 2023-12-11T20:16:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.294+0000 7f13a759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13a81012f0 0x7f13a819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.294+0000 7f13a759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13a81024e0 0x7f13a819dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.294+0000 7f13a759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13a8102e80 0x7f13a81a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.294+0000 7f13a759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81a5200 con 0x7f13a8102e80 2023-12-11T20:16:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.294+0000 7f13a759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81a5370 con 0x7f13a81012f0 2023-12-11T20:16:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.294+0000 7f13a759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81a5530 con 0x7f13a81024e0 2023-12-11T20:16:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13a81012f0 0x7f13a819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a5d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13a81024e0 0x7f13a819dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13a81012f0 0x7f13a819d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54504/0 (socket says 172.21.15.12:54504) 2023-12-11T20:16:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a659c700 1 -- 172.21.15.12:0/2012080972 learned_addr learned my addr 172.21.15.12:0/2012080972 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13a8102e80 0x7f13a81a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a659c700 1 -- 172.21.15.12:0/2012080972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13a81024e0 msgr2=0x7f13a819dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a659c700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13a81024e0 0x7f13a819dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a659c700 1 -- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13a8102e80 msgr2=0x7f13a81a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a659c700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13a8102e80 0x7f13a81a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.295+0000 7f13a659c700 1 -- 172.21.15.12:0/2012080972 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a0009c40 con 0x7f13a81012f0 2023-12-11T20:16:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.296+0000 7f13a659c700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13a81012f0 0x7f13a819d6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f139800e970 tx=0x7f139800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.296+0000 7f13977fe700 1 -- 172.21.15.12:0/2012080972 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398009790 con 0x7f13a81012f0 2023-12-11T20:16:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.296+0000 7f13977fe700 1 -- 172.21.15.12:0/2012080972 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f139800c7c0 con 0x7f13a81012f0 2023-12-11T20:16:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.296+0000 7f13977fe700 1 -- 172.21.15.12:0/2012080972 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398003b60 con 0x7f13a81012f0 2023-12-11T20:16:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.297+0000 7f13a759e700 1 -- 172.21.15.12:0/2012080972 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c0095f0 con 0x7f13a81012f0 2023-12-11T20:16:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.297+0000 7f13a759e700 1 -- 172.21.15.12:0/2012080972 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a81a5b40 con 0x7f13a81012f0 2023-12-11T20:16:48.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.302+0000 7f13977fe700 1 -- 172.21.15.12:0/2012080972 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f139800c930 con 0x7f13a81012f0 2023-12-11T20:16:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.303+0000 7f13c049cb80 1 Processor -- start 2023-12-11T20:16:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.304+0000 7f13c049cb80 1 -- start start 2023-12-11T20:16:48.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.305+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb5a60 0x56281feb5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.305+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281feb68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.305+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb6de0 0x56281feb7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.305+0000 7f13c049cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fe10b50 con 0x56281feb6de0 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.305+0000 7f13c049cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fe0e470 con 0x56281feb5a60 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.305+0000 7f13c049cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fe09d60 con 0x56281feb63c0 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.306+0000 7f13977fe700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13900a15a0 0x7f13900a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.306+0000 7f13977fe700 1 -- 172.21.15.12:0/2012080972 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1398014070 con 0x7f13a81012f0 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.306+0000 7f13a5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb6de0 0x56281feb7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.306+0000 7f13a659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281feb68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.306+0000 7f13a659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281feb68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54306/0 (socket says 172.21.15.12:54306) 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a659c700 1 -- 172.21.15.12:0/309384001 learned_addr learned my addr 172.21.15.12:0/309384001 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.306+0000 7f13a5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb6de0 0x56281feb7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39368/0 (socket says 172.21.15.12:39368) 2023-12-11T20:16:48.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb5a60 0x56281feb5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a659c700 1 -- 172.21.15.12:0/309384001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb5a60 msgr2=0x56281feb5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a659c700 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb5a60 0x56281feb5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a659c700 1 -- 172.21.15.12:0/309384001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb6de0 msgr2=0x56281feb7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a659c700 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb6de0 0x56281feb7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a659c700 1 -- 172.21.15.12:0/309384001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281fc86630 con 0x56281feb63c0 2023-12-11T20:16:48.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a5d9b700 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb6de0 0x56281feb7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb5a60 0x56281feb5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:16:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13900a15a0 0x7f13900a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.307+0000 7f13a659c700 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281feb68a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13980ca8f0 tx=0x7f1398099af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=331e2a8eb6803212 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.308+0000 7f1394ff9700 1 -- 172.21.15.12:0/309384001 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139809e260 con 0x56281feb63c0 2023-12-11T20:16:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.308+0000 7f1394ff9700 1 -- 172.21.15.12:0/309384001 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13980a24a0 con 0x56281feb63c0 2023-12-11T20:16:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.308+0000 7f1394ff9700 1 -- 172.21.15.12:0/309384001 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398096820 con 0x56281feb63c0 2023-12-11T20:16:48.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 -- 172.21.15.12:0/309384001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 msgr2=0x56281feb68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281feb68a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13980ca8f0 tx=0x7f1398099af0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13900a15a0 0x7f13900a3a60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009fd0 tx=0x7f13a0009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 -- 172.21.15.12:0/309384001 shutdown_connections 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb5a60 0x56281feb5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb6de0 0x56281feb7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 --2- 172.21.15.12:0/309384001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281feb68a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 -- 172.21.15.12:0/309384001 >> 172.21.15.12:0/309384001 conn(0x56281fde47e0 msgr2=0x56281feb03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 -- 172.21.15.12:0/309384001 shutdown_connections 2023-12-11T20:16:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.309+0000 7f13c049cb80 1 -- 172.21.15.12:0/309384001 wait complete. 2023-12-11T20:16:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.310+0000 7f13c049cb80 1 -- start start 2023-12-11T20:16:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.310+0000 7f13c049cb80 1 Processor -- start 2023-12-11T20:16:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.311+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.311+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281febf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.311+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.311+0000 7f13c049cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fdc3560 con 0x56281feb5a60 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.311+0000 7f13c049cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fdc3200 con 0x56281feb6de0 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.311+0000 7f13c049cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fc88920 con 0x56281feb63c0 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.311+0000 7f13c049cb80 10 client.0 _ll_register_callbacks cb 0x56281fceea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39370/0 (socket says 172.21.15.12:39370) 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a659c700 1 -- 172.21.15.12:0/3688064083 learned_addr learned my addr 172.21.15.12:0/3688064083 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a5d9b700 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281febf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a659c700 1 -- 172.21.15.12:0/3688064083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 msgr2=0x56281febf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a659c700 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281febf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a659c700 1 -- 172.21.15.12:0/3688064083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 msgr2=0x56281fec6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a659c700 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a659c700 1 -- 172.21.15.12:0/3688064083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a810a080 con 0x56281feb5a60 2023-12-11T20:16:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.312+0000 7f13a5d9b700 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281febf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.313+0000 7f13a659c700 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febf480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1398000c00 tx=0x7f139809e380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6136977f09fd10 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.313+0000 7f138dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.313+0000 7f138dffb700 1 -- 172.21.15.12:0/3688064083 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980b8070 con 0x56281feb5a60 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.313+0000 7f138dffb700 1 -- 172.21.15.12:0/3688064083 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f13980b81d0 con 0x56281feb5a60 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.313+0000 7f13c049cb80 1 -- 172.21.15.12:0/3688064083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56281fea89e0 con 0x56281feb5a60 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.313+0000 7f138dffb700 1 -- 172.21.15.12:0/3688064083 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13980b8390 con 0x56281feb5a60 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.313+0000 7f13c049cb80 10 client.15684 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.313+0000 7f13c049cb80 1 -- 172.21.15.12:0/3688064083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f13a81a5b40 con 0x56281feb5a60 2023-12-11T20:16:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.314+0000 7f138dffb700 1 -- 172.21.15.12:0/3688064083 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56281fea89e0 con 0x56281feb5a60 2023-12-11T20:16:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.315+0000 7f138dffb700 1 -- 172.21.15.12:0/3688064083 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1398082030 con 0x56281feb5a60 2023-12-11T20:16:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.315+0000 7f13c049cb80 10 client.15684 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.315+0000 7f13c049cb80 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.315+0000 7f13c049cb80 20 client.15684 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.315+0000 7f13c049cb80 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56281fecaca0 0x56281fecd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.315+0000 7f13c049cb80 4 client.15684 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.315+0000 7f13c049cb80 1 -- 172.21.15.12:0/3688064083 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56281fe84f40 con 0x56281fecaca0 2023-12-11T20:16:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.315+0000 7f13a5d9b700 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56281fecaca0 0x56281fecd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.316+0000 7f13a5d9b700 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56281fecaca0 0x56281fecd090 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b892e1c70400e30a server_cookie=4b5137fdd5227d47 in_seq=0 out_seq=0 2023-12-11T20:16:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.316+0000 7f138dffb700 10 client.15684 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:48.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f138dffb700 1 -- 172.21.15.12:0/3688064083 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56281fe84f40 con 0x56281fecaca0 2023-12-11T20:16:48.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f138dffb700 10 client.15684 handle_command_reply: tid=0 2023-12-11T20:16:48.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 client.15684 shutdown 2023-12-11T20:16:48.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 -- 172.21.15.12:0/3688064083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 msgr2=0x56281febf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febf480 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1398000c00 tx=0x7f139809e380 comp rx=0 tx=0).stop 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 -- 172.21.15.12:0/3688064083 shutdown_connections 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56281fecaca0 0x56281fecd090 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f138dffb700 0 client.15684 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febf480 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 --2- 172.21.15.12:0/3688064083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281febf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.317+0000 7f13c049cb80 1 -- 172.21.15.12:0/3688064083 >> 172.21.15.12:0/3688064083 conn(0x56281fde47e0 msgr2=0x56281feb4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.318+0000 7f13c049cb80 1 -- 172.21.15.12:0/3688064083 shutdown_connections 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.318+0000 7f13c049cb80 1 -- 172.21.15.12:0/3688064083 wait complete. 2023-12-11T20:16:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.318+0000 7f13c049cb80 20 client.15684 trim_cache size 0 max 16384 2023-12-11T20:16:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:48 smithi012 ceph-mon[128787]: pgmap v401: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:48.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.353+0000 7f13c049cb80 1 Processor -- start 2023-12-11T20:16:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.353+0000 7f13c049cb80 1 -- start start 2023-12-11T20:16:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.354+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febe990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.354+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb63c0 0x56281fec69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.354+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb6de0 0x56281feb71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.354+0000 7f13c049cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281feb12a0 con 0x56281feb5a60 2023-12-11T20:16:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.354+0000 7f13c049cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fec7b80 con 0x56281feb63c0 2023-12-11T20:16:48.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.354+0000 7f13c049cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fed2260 con 0x56281feb6de0 2023-12-11T20:16:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.354+0000 7f13a659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febe990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febe990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39386/0 (socket says 172.21.15.12:39386) 2023-12-11T20:16:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a659c700 1 -- 172.21.15.12:0/284907218 learned_addr learned my addr 172.21.15.12:0/284907218 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb6de0 0x56281feb71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a5d9b700 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb63c0 0x56281fec69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a6d9d700 1 -- 172.21.15.12:0/284907218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb63c0 msgr2=0x56281fec69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb63c0 0x56281fec69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a6d9d700 1 -- 172.21.15.12:0/284907218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 msgr2=0x56281febe990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febe990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a6d9d700 1 -- 172.21.15.12:0/284907218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281fc32de0 con 0x56281feb6de0 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.355+0000 7f13a659c700 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febe990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.356+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb6de0 0x56281feb71c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13a0008380 tx=0x7f13a0010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38a11a18ceed139d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.356+0000 7f13957fa700 1 -- 172.21.15.12:0/284907218 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000e030 con 0x56281feb6de0 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.356+0000 7f13957fa700 1 -- 172.21.15.12:0/284907218 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13a000f040 con 0x56281feb6de0 2023-12-11T20:16:48.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.356+0000 7f13957fa700 1 -- 172.21.15.12:0/284907218 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0018c40 con 0x56281feb6de0 2023-12-11T20:16:48.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.357+0000 7f13c049cb80 1 -- 172.21.15.12:0/284907218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb6de0 msgr2=0x56281feb71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.357+0000 7f13c049cb80 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb6de0 0x56281feb71c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13a0008380 tx=0x7f13a0010000 comp rx=0 tx=0).stop 2023-12-11T20:16:48.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.357+0000 7f13c049cb80 1 -- 172.21.15.12:0/284907218 shutdown_connections 2023-12-11T20:16:48.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.357+0000 7f13c049cb80 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb6de0 0x56281feb71c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.357+0000 7f13c049cb80 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281febe990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.357+0000 7f13c049cb80 1 --2- 172.21.15.12:0/284907218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb63c0 0x56281fec69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.357+0000 7f13c049cb80 1 -- 172.21.15.12:0/284907218 >> 172.21.15.12:0/284907218 conn(0x56281fde47e0 msgr2=0x56281febd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.357+0000 7f13c049cb80 1 -- 172.21.15.12:0/284907218 shutdown_connections 2023-12-11T20:16:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.358+0000 7f13c049cb80 1 -- 172.21.15.12:0/284907218 wait complete. 2023-12-11T20:16:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.358+0000 7f13c049cb80 1 -- start start 2023-12-11T20:16:48.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.358+0000 7f13c049cb80 1 Processor -- start 2023-12-11T20:16:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.359+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281fec65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.359+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281fec4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.359+0000 7f13c049cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.359+0000 7f13c049cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fec6df0 con 0x56281feb5a60 2023-12-11T20:16:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.359+0000 7f13c049cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fec56d0 con 0x56281feb6de0 2023-12-11T20:16:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.359+0000 7f13c049cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281fec5890 con 0x56281feb63c0 2023-12-11T20:16:48.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.359+0000 7f13c049cb80 10 client.0 _ll_register_callbacks cb 0x56281fceea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281fec65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a6d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281fec65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39402/0 (socket says 172.21.15.12:39402) 2023-12-11T20:16:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a659c700 1 -- 172.21.15.12:0/2295493176 learned_addr learned my addr 172.21.15.12:0/2295493176 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a6d9d700 1 -- 172.21.15.12:0/2295493176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 msgr2=0x56281fec4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281fec4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a6d9d700 1 -- 172.21.15.12:0/2295493176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 msgr2=0x56281fec65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:48.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281fec65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.360+0000 7f13a6d9d700 1 -- 172.21.15.12:0/2295493176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a81a5b40 con 0x56281feb6de0 2023-12-11T20:16:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.361+0000 7f13a6d9d700 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec5160 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x56281fec6fb0 tx=0x7f13a0004da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef18ce564ec5afe5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.361+0000 7f138dffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:16:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.361+0000 7f138dffb700 1 -- 172.21.15.12:0/2295493176 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000e040 con 0x56281feb6de0 2023-12-11T20:16:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.361+0000 7f13c049cb80 1 -- 172.21.15.12:0/2295493176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13980a24a0 con 0x56281feb6de0 2023-12-11T20:16:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.361+0000 7f138dffb700 1 -- 172.21.15.12:0/2295493176 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f13a0018bc0 con 0x56281feb6de0 2023-12-11T20:16:48.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f138dffb700 1 -- 172.21.15.12:0/2295493176 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13a0018da0 con 0x56281feb6de0 2023-12-11T20:16:48.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f13c049cb80 10 client.25496 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:48.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f13c049cb80 1 -- 172.21.15.12:0/2295493176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f13a0008060 con 0x56281feb6de0 2023-12-11T20:16:48.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f138dffb700 1 -- 172.21.15.12:0/2295493176 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13980a24a0 con 0x56281feb6de0 2023-12-11T20:16:48.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f138dffb700 1 -- 172.21.15.12:0/2295493176 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f13a0029020 con 0x56281feb6de0 2023-12-11T20:16:48.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f13c049cb80 10 client.25496 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f13c049cb80 10 client.25496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f13c049cb80 20 client.25496 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.362+0000 7f13c049cb80 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56281ff227b0 0x56281ff24bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.363+0000 7f13c049cb80 4 client.25496 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:16:48.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.363+0000 7f13c049cb80 1 -- 172.21.15.12:0/2295493176 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56281fdcffd0 con 0x56281ff227b0 2023-12-11T20:16:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.363+0000 7f13a659c700 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56281ff227b0 0x56281ff24bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.363+0000 7f13a659c700 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56281ff227b0 0x56281ff24bd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b029e46a5c28012 server_cookie=ea6175cc1f773385 in_seq=0 out_seq=0 2023-12-11T20:16:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.363+0000 7f138dffb700 10 client.25496 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f138dffb700 1 -- 172.21.15.12:0/2295493176 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56281fdcffd0 con 0x56281ff227b0 2023-12-11T20:16:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f138dffb700 10 client.25496 handle_command_reply: tid=0 2023-12-11T20:16:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 client.25496 shutdown 2023-12-11T20:16:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 -- 172.21.15.12:0/2295493176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 msgr2=0x56281fec5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec5160 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x56281fec6fb0 tx=0x7f13a0004da0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 -- 172.21.15.12:0/2295493176 shutdown_connections 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56281ff227b0 0x56281ff24bd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56281feb6de0 0x56281fec5160 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56281feb5a60 0x56281fec65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 --2- 172.21.15.12:0/2295493176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56281feb63c0 0x56281fec4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f13c049cb80 1 -- 172.21.15.12:0/2295493176 >> 172.21.15.12:0/2295493176 conn(0x56281fde47e0 msgr2=0x56281feafec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.364+0000 7f138dffb700 0 client.25496 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.365+0000 7f13c049cb80 1 -- 172.21.15.12:0/2295493176 shutdown_connections 2023-12-11T20:16:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.365+0000 7f13c049cb80 1 -- 172.21.15.12:0/2295493176 wait complete. 2023-12-11T20:16:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.365+0000 7f13c049cb80 20 client.25496 trim_cache size 0 max 16384 2023-12-11T20:16:48.365 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:16:48.365 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:16:48.365 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:16:48.365 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 -- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13900a15a0 msgr2=0x7f13900a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13900a15a0 0x7f13900a3a60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009fd0 tx=0x7f13a0009040 comp rx=0 tx=0).stop 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 -- 172.21.15.12:0/2012080972 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13a81012f0 msgr2=0x7f13a819d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13a81012f0 0x7f13a819d6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f139800e970 tx=0x7f139800ec80 comp rx=0 tx=0).stop 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 -- 172.21.15.12:0/2012080972 shutdown_connections 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13900a15a0 0x7f13900a3a60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13a81012f0 0x7f13a819d6f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13a8102e80 0x7f13a81a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 --2- 172.21.15.12:0/2012080972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13a81024e0 0x7f13a819dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 -- 172.21.15.12:0/2012080972 >> 172.21.15.12:0/2012080972 conn(0x7f13a80fc860 msgr2=0x7f13a80fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 -- 172.21.15.12:0/2012080972 shutdown_connections 2023-12-11T20:16:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.366+0000 7f13a759e700 1 -- 172.21.15.12:0/2012080972 wait complete. 2023-12-11T20:16:48.393 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:16:48.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:16:48.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:48 smithi032 ceph-mon[132488]: pgmap v401: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:48.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:48 smithi039 ceph-mon[102205]: pgmap v401: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-11T20:16:48.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.734+0000 7efbff5ff700 1 -- 172.21.15.12:0/2762055438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8102690 msgr2=0x7efbf8102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.734+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2762055438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8102690 0x7efbf8102af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009990 tx=0x7efbe8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.734+0000 7efbff5ff700 1 -- 172.21.15.12:0/2762055438 shutdown_connections 2023-12-11T20:16:48.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.734+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2762055438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf8103030 0x7efbf81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.734+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2762055438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf81014a0 0x7efbf81018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.734+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2762055438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf8102690 0x7efbf8102af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.734+0000 7efbff5ff700 1 -- 172.21.15.12:0/2762055438 >> 172.21.15.12:0/2762055438 conn(0x7efbf80fca10 msgr2=0x7efbf80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:48.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.734+0000 7efbff5ff700 1 -- 172.21.15.12:0/2762055438 shutdown_connections 2023-12-11T20:16:48.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.735+0000 7efbff5ff700 1 -- 172.21.15.12:0/2762055438 wait complete. 2023-12-11T20:16:48.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.736+0000 7efbff5ff700 1 Processor -- start 2023-12-11T20:16:48.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.736+0000 7efbff5ff700 1 -- start start 2023-12-11T20:16:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbff5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf81014a0 0x7efbf8199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbff5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbff5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf8103030 0x7efbf81a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbff5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a10b0 con 0x7efbf8102690 2023-12-11T20:16:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbff5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a11f0 con 0x7efbf8103030 2023-12-11T20:16:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbff5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a1380 con 0x7efbf81014a0 2023-12-11T20:16:48.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbfd39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf81014a0 0x7efbf8199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbfd39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf81014a0 0x7efbf8199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54360/0 (socket says 172.21.15.12:54360) 2023-12-11T20:16:48.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbfd39b700 1 -- 172.21.15.12:0/2374453442 learned_addr learned my addr 172.21.15.12:0/2374453442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:48.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbfcb9a700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.737+0000 7efbfdb9c700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf8103030 0x7efbf81a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.738+0000 7efbfd39b700 1 -- 172.21.15.12:0/2374453442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf8103030 msgr2=0x7efbf81a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.738+0000 7efbfd39b700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf8103030 0x7efbf81a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.738+0000 7efbfd39b700 1 -- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 msgr2=0x7efbf8199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.738+0000 7efbfd39b700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.738+0000 7efbfd39b700 1 -- 172.21.15.12:0/2374453442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf4009520 con 0x7efbf81014a0 2023-12-11T20:16:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.738+0000 7efbfdb9c700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf8103030 0x7efbf81a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.738+0000 7efbfd39b700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf81014a0 0x7efbf8199620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efbf400ea50 tx=0x7efbf400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.739+0000 7efbee7fc700 1 -- 172.21.15.12:0/2374453442 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400cbd0 con 0x7efbf81014a0 2023-12-11T20:16:48.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.739+0000 7efbee7fc700 1 -- 172.21.15.12:0/2374453442 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbf400cd30 con 0x7efbf81014a0 2023-12-11T20:16:48.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.739+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe80095f0 con 0x7efbf81014a0 2023-12-11T20:16:48.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.739+0000 7efbee7fc700 1 -- 172.21.15.12:0/2374453442 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4018680 con 0x7efbf81014a0 2023-12-11T20:16:48.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.739+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf81a1a30 con 0x7efbf81014a0 2023-12-11T20:16:48.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.741+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf8068330 con 0x7efbf81014a0 2023-12-11T20:16:48.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.744+0000 7efbee7fc700 1 -- 172.21.15.12:0/2374453442 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7efbf4010430 con 0x7efbf81014a0 2023-12-11T20:16:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.746+0000 7efbee7fc700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe40a1500 0x7efbe40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.746+0000 7efbee7fc700 1 -- 172.21.15.12:0/2374453442 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efbf4014070 con 0x7efbf81014a0 2023-12-11T20:16:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.747+0000 7efbfcb9a700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe40a1500 0x7efbe40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.748+0000 7efbfcb9a700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe40a1500 0x7efbe40a39c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efbe800b2e0 tx=0x7efbe8005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:48.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:48.750+0000 7efbee7fc700 1 -- 172.21.15.12:0/2374453442 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efbf40968e0 con 0x7efbf81014a0 2023-12-11T20:16:49.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.268+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efbf810ce40 con 0x7efbf81014a0 2023-12-11T20:16:49.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.269+0000 7efbee7fc700 1 -- 172.21.15.12:0/2374453442 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11303 (secure 0 0 0) 0x7efbf4099f00 con 0x7efbf81014a0 2023-12-11T20:16:49.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:16:49.269 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:13:58.248579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:16:49.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe40a1500 msgr2=0x7efbe40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe40a1500 0x7efbe40a39c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efbe800b2e0 tx=0x7efbe8005fd0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf81014a0 msgr2=0x7efbf8199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf81014a0 0x7efbf8199620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efbf400ea50 tx=0x7efbf400ed60 comp rx=0 tx=0).stop 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 shutdown_connections 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbe40a1500 0x7efbe40a39c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf8103030 0x7efbf81a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf81014a0 0x7efbf8199620 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 --2- 172.21.15.12:0/2374453442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf8102690 0x7efbf8199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.272+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 >> 172.21.15.12:0/2374453442 conn(0x7efbf80fca10 msgr2=0x7efbf8073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.273+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 shutdown_connections 2023-12-11T20:16:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.273+0000 7efbff5ff700 1 -- 172.21.15.12:0/2374453442 wait complete. 2023-12-11T20:16:49.273 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 22 2023-12-11T20:16:49.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:16:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:49 smithi012 ceph-mon[128787]: pgmap v402: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:49.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:49 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2374453442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:16:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2457723445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac107240 msgr2=0x7f7fac109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2457723445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac107240 0x7f7fac109650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400b0a0 tx=0x7f7fa400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2457723445 shutdown_connections 2023-12-11T20:16:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2457723445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac101fe0 0x7f7fac1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2457723445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac107240 0x7f7fac109650 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2457723445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fac104910 0x7f7fac106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2457723445 >> 172.21.15.12:0/2457723445 conn(0x7f7fac0fb930 msgr2=0x7f7fac0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2457723445 shutdown_connections 2023-12-11T20:16:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.649+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2457723445 wait complete. 2023-12-11T20:16:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.650+0000 7f7fb1bff700 1 Processor -- start 2023-12-11T20:16:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.650+0000 7f7fb1bff700 1 -- start start 2023-12-11T20:16:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.650+0000 7f7fb1bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac101fe0 0x7f7fac199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.650+0000 7f7fb1bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fac104910 0x7f7fac199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.650+0000 7f7fb1bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac107240 0x7f7fac1a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.650+0000 7f7fb1bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac1a1140 con 0x7f7fac101fe0 2023-12-11T20:16:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.650+0000 7f7fb1bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac1a1280 con 0x7f7fac107240 2023-12-11T20:16:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.650+0000 7f7fb1bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac1a1410 con 0x7f7fac104910 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac101fe0 0x7f7fac199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac101fe0 0x7f7fac199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55522/0 (socket says 172.21.15.12:55522) 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fab7fe700 1 -- 172.21.15.12:0/2654879858 learned_addr learned my addr 172.21.15.12:0/2654879858 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fabfff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac107240 0x7f7fac1a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7faaffd700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fac104910 0x7f7fac199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fab7fe700 1 -- 172.21.15.12:0/2654879858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fac104910 msgr2=0x7f7fac199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fac104910 0x7f7fac199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fab7fe700 1 -- 172.21.15.12:0/2654879858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac107240 msgr2=0x7f7fac1a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac107240 0x7f7fac1a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.651+0000 7f7fab7fe700 1 -- 172.21.15.12:0/2654879858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009d00 con 0x7f7fac101fe0 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.652+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac101fe0 0x7f7fac199610 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00e9a0 tx=0x7f7f9c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.652+0000 7f7fa8ff9700 1 -- 172.21.15.12:0/2654879858 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c009790 con 0x7f7fac101fe0 2023-12-11T20:16:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.652+0000 7f7fa8ff9700 1 -- 172.21.15.12:0/2654879858 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f9c010430 con 0x7f7fac101fe0 2023-12-11T20:16:49.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.652+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2654879858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac1a16f0 con 0x7f7fac101fe0 2023-12-11T20:16:49.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.652+0000 7f7fa8ff9700 1 -- 172.21.15.12:0/2654879858 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00cea0 con 0x7f7fac101fe0 2023-12-11T20:16:49.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.652+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2654879858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac1a1c00 con 0x7f7fac101fe0 2023-12-11T20:16:49.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.655+0000 7f7fa8ff9700 1 -- 172.21.15.12:0/2654879858 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7f9c0105a0 con 0x7f7fac101fe0 2023-12-11T20:16:49.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.656+0000 7f7fc543eb80 1 Processor -- start 2023-12-11T20:16:49.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.656+0000 7f7fc543eb80 1 -- start start 2023-12-11T20:16:49.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e1523d0 0x56079e1527f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e153640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fa8ff9700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f940a1480 0x7f7f940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e0adb50 con 0x56079e152d30 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e0ab470 con 0x56079e1523d0 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e0a6d60 con 0x56079e153c20 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fa8ff9700 1 -- 172.21.15.12:0/2654879858 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f9c014070 con 0x7f7fac101fe0 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fabfff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f940a1480 0x7f7f940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55524/0 (socket says 172.21.15.12:55524) 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3663913798 learned_addr learned my addr 172.21.15.12:0/3663913798 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.657+0000 7f7fabfff700 1 --2- 172.21.15.12:0/3663913798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e1523d0 0x56079e1527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7faaffd700 1 -- 172.21.15.12:0/3663913798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e1523d0 msgr2=0x56079e1527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3663913798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e1523d0 0x56079e1527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7faaffd700 1 -- 172.21.15.12:0/3663913798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 msgr2=0x56079e153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3663913798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7faaffd700 1 -- 172.21.15.12:0/3663913798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56079df23630 con 0x56079e153c20 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3663913798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e1540a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009cb0 tx=0x7f7fa0011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fac59af21b6cb4f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7fabfff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f940a1480 0x7f7f940a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40062a0 tx=0x7f7fa4006230 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7f91ffb700 1 -- 172.21.15.12:0/3663913798 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0011d20 con 0x56079e153c20 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7f91ffb700 1 -- 172.21.15.12:0/3663913798 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7fa0011e80 con 0x56079e153c20 2023-12-11T20:16:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.658+0000 7f7f91ffb700 1 -- 172.21.15.12:0/3663913798 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0005280 con 0x56079e153c20 2023-12-11T20:16:49.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3663913798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 msgr2=0x56079e1540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3663913798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e1540a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009cb0 tx=0x7f7fa0011440 comp rx=0 tx=0).stop 2023-12-11T20:16:49.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3663913798 shutdown_connections 2023-12-11T20:16:49.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3663913798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e1523d0 0x56079e1527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3663913798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e1540a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3663913798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3663913798 >> 172.21.15.12:0/3663913798 conn(0x56079e0817e0 msgr2=0x56079e14ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3663913798 shutdown_connections 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.659+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3663913798 wait complete. 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.660+0000 7f7fc543eb80 1 -- start start 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.660+0000 7f7fc543eb80 1 Processor -- start 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e15c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e152d30 0x56079e15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e060560 con 0x56079e1523d0 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e060200 con 0x56079e153c20 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079df25920 con 0x56079e152d30 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fc543eb80 10 client.0 _ll_register_callbacks cb 0x56079df8ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e15c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55534/0 (socket says 172.21.15.12:55534) 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.661+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3314384680 learned_addr learned my addr 172.21.15.12:0/3314384680 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e152d30 0x56079e15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3314384680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e152d30 msgr2=0x56079e15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e152d30 0x56079e15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fabfff700 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 msgr2=0x56079e1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3314384680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa00098e0 con 0x56079e1523d0 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fabfff700 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e15c190 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c099ee0 tx=0x7f7f9c0109b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bba46ce56168e79 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7f8affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7f8affd700 1 -- 172.21.15.12:0/3314384680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c09a1e0 con 0x56079e1523d0 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7f8affd700 1 -- 172.21.15.12:0/3314384680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f9c09e330 con 0x56079e1523d0 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3314384680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56079e121f40 con 0x56079e1523d0 2023-12-11T20:16:49.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7f8affd700 1 -- 172.21.15.12:0/3314384680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f9c0a2570 con 0x56079e1523d0 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fc543eb80 10 client.15708 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.662+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3314384680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56079decfde0 con 0x56079e1523d0 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.663+0000 7f7f8affd700 1 -- 172.21.15.12:0/3314384680 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f9c063080 con 0x56079e1523d0 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.663+0000 7f7f8affd700 1 -- 172.21.15.12:0/3314384680 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7f9c0a20e0 con 0x56079e1523d0 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.663+0000 7f7fc543eb80 10 client.15708 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.663+0000 7f7fc543eb80 10 client.15708 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.663+0000 7f7fc543eb80 20 client.15708 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.663+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56079e167f50 0x56079e16a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.663+0000 7f7fc543eb80 4 client.15708 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:49.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.663+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3314384680 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56079e06cfd0 con 0x56079e167f50 2023-12-11T20:16:49.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.664+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56079e167f50 0x56079e16a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.664+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56079e167f50 0x56079e16a370 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1a630998ce8a6df2 server_cookie=1b46e62b2a4728b5 in_seq=0 out_seq=0 2023-12-11T20:16:49.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.664+0000 7f7f8affd700 10 client.15708 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:16:49.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7f8affd700 1 -- 172.21.15.12:0/3314384680 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56079e06cfd0 con 0x56079e167f50 2023-12-11T20:16:49.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7f8affd700 10 client.15708 handle_command_reply: tid=0 2023-12-11T20:16:49.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 client.15708 shutdown 2023-12-11T20:16:49.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3314384680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 msgr2=0x56079e15c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e15c190 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c099ee0 tx=0x7f7f9c0109b0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3314384680 shutdown_connections 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56079e167f50 0x56079e16a370 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e15c190 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3314384680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e152d30 0x56079e15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3314384680 >> 172.21.15.12:0/3314384680 conn(0x56079e0817e0 msgr2=0x56079e14da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.665+0000 7f7f8affd700 0 client.15708 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.666+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3314384680 shutdown_connections 2023-12-11T20:16:49.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.666+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3314384680 wait complete. 2023-12-11T20:16:49.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.666+0000 7f7fc543eb80 20 client.15708 trim_cache size 0 max 16384 2023-12-11T20:16:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.680+0000 7f7fc543eb80 1 Processor -- start 2023-12-11T20:16:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.680+0000 7f7fc543eb80 1 -- start start 2023-12-11T20:16:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.680+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e1523d0 0x56079e15b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.680+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.680+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e16ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.680+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e149b50 con 0x56079e152d30 2023-12-11T20:16:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.680+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e14f200 con 0x56079e153c20 2023-12-11T20:16:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.680+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e15d310 con 0x56079e1523d0 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7fabfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e16ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55544/0 (socket says 172.21.15.12:55544) 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7fabfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e16ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41932/0 (socket says 172.21.15.12:41932) 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7faaffd700 1 -- 172.21.15.12:0/766961201 learned_addr learned my addr 172.21.15.12:0/766961201 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e1523d0 0x56079e15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7fab7fe700 1 -- 172.21.15.12:0/766961201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 msgr2=0x56079e16ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e16ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7fab7fe700 1 -- 172.21.15.12:0/766961201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 msgr2=0x56079e163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e163660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7fab7fe700 1 -- 172.21.15.12:0/766961201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56079deb8c60 con 0x56079e1523d0 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.681+0000 7f7faaffd700 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.682+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e1523d0 0x56079e15b710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0966e0 tx=0x7f7f9c096650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e394ee3eff1d756 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.682+0000 7f7f927fc700 1 -- 172.21.15.12:0/766961201 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c09a1e0 con 0x56079e1523d0 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.682+0000 7f7f927fc700 1 -- 172.21.15.12:0/766961201 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56079e121f40 con 0x56079e1523d0 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.682+0000 7f7f927fc700 1 -- 172.21.15.12:0/766961201 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c099930 con 0x56079e1523d0 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 -- 172.21.15.12:0/766961201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e1523d0 msgr2=0x56079e15b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e1523d0 0x56079e15b710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0966e0 tx=0x7f7f9c096650 comp rx=0 tx=0).stop 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 -- 172.21.15.12:0/766961201 shutdown_connections 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e153c20 0x56079e16ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e1523d0 0x56079e15b710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/766961201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e152d30 0x56079e163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 -- 172.21.15.12:0/766961201 >> 172.21.15.12:0/766961201 conn(0x56079e0817e0 msgr2=0x56079e15a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 -- 172.21.15.12:0/766961201 shutdown_connections 2023-12-11T20:16:49.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 -- 172.21.15.12:0/766961201 wait complete. 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 -- start start 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.683+0000 7f7fc543eb80 1 Processor -- start 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e160be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e152d30 0x56079e161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fc543eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e162130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e162670 con 0x56079e1523d0 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e1627e0 con 0x56079e152d30 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fc543eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079e1629a0 con 0x56079e153c20 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fc543eb80 10 client.0 _ll_register_callbacks cb 0x56079e164270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e160be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55556/0 (socket says 172.21.15.12:55556) 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e152d30 0x56079e161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3419323841 learned_addr learned my addr 172.21.15.12:0/3419323841 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.684+0000 7f7fabfff700 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3419323841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 msgr2=0x56079e162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e162130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3419323841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e152d30 msgr2=0x56079e161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e152d30 0x56079e161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fab7fe700 1 -- 172.21.15.12:0/3419323841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa001d040 con 0x56079e1523d0 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e152d30 0x56079e161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fab7fe700 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e160be0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c013040 tx=0x7f7f9c0a2570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7487eee2be8af665 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7f8affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7f8affd700 1 -- 172.21.15.12:0/3419323841 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0998e0 con 0x56079e1523d0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3419323841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56079e145b40 con 0x56079e1523d0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7f8affd700 1 -- 172.21.15.12:0/3419323841 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f9c0b8170 con 0x56079e1523d0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7f8affd700 1 -- 172.21.15.12:0/3419323841 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f9c0b8330 con 0x56079e1523d0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fc543eb80 10 client.15714 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.685+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3419323841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56079decfde0 con 0x56079e1523d0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7f8affd700 1 -- 172.21.15.12:0/3419323841 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f9c063080 con 0x56079e1523d0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7f8affd700 1 -- 172.21.15.12:0/3419323841 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7f9c09f070 con 0x56079e1523d0 2023-12-11T20:16:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7fc543eb80 10 client.15714 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7fc543eb80 10 client.15714 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7fc543eb80 20 client.15714 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56079e1be790 0x56079e1c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7fc543eb80 4 client.15714 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3419323841 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56079e05f490 con 0x56079e1be790 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.686+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56079e1be790 0x56079e1c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7f8affd700 10 client.15714 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7faaffd700 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56079e1be790 0x56079e1c0b80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=964fdddd51a0e041 server_cookie=dfcefc189cd9204a in_seq=0 out_seq=0 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7f8affd700 1 -- 172.21.15.12:0/3419323841 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56079e05f490 con 0x56079e1be790 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7f8affd700 10 client.15714 handle_command_reply: tid=0 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7fc543eb80 1 client.15714 shutdown 2023-12-11T20:16:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3419323841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 msgr2=0x56079e160be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e160be0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c013040 tx=0x7f7f9c0a2570 comp rx=0 tx=0).stop 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3419323841 shutdown_connections 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56079e1be790 0x56079e1c0b80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.687+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079e153c20 0x56079e162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079e1523d0 0x56079e160be0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fc543eb80 1 --2- 172.21.15.12:0/3419323841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079e152d30 0x56079e161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7f8affd700 0 client.15714 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3419323841 >> 172.21.15.12:0/3419323841 conn(0x56079e0817e0 msgr2=0x56079e16ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3419323841 shutdown_connections 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fc543eb80 1 -- 172.21.15.12:0/3419323841 wait complete. 2023-12-11T20:16:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fc543eb80 20 client.15714 trim_cache size 0 max 16384 2023-12-11T20:16:49.693 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:16:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f940a1480 msgr2=0x7f7f940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f940a1480 0x7f7f940a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40062a0 tx=0x7f7fa4006230 comp rx=0 tx=0).stop 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac101fe0 msgr2=0x7f7fac199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.688+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac101fe0 0x7f7fac199610 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00e9a0 tx=0x7f7f9c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.689+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2654879858 shutdown_connections 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.689+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f940a1480 0x7f7f940a3940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.689+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fac107240 0x7f7fac1a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.689+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fac101fe0 0x7f7fac199610 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.689+0000 7f7fb1bff700 1 --2- 172.21.15.12:0/2654879858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fac104910 0x7f7fac199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.689+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2654879858 >> 172.21.15.12:0/2654879858 conn(0x7f7fac0fb930 msgr2=0x7f7fac101750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.689+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2654879858 shutdown_connections 2023-12-11T20:16:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.689+0000 7f7fb1bff700 1 -- 172.21.15.12:0/2654879858 wait complete. 2023-12-11T20:16:49.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:16:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:49 smithi032 ceph-mon[132488]: pgmap v402: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:49 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2374453442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:16:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:49 smithi039 ceph-mon[102205]: pgmap v402: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:49.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:49 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2374453442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:16:49.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 -- 172.21.15.12:0/171424816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc101f80 msgr2=0x7f8fdc104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/171424816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc101f80 0x7f8fdc104370 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009990 tx=0x7f8fd8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 -- 172.21.15.12:0/171424816 shutdown_connections 2023-12-11T20:16:49.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/171424816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fdc1071e0 0x7f8fdc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/171424816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc101f80 0x7f8fdc104370 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/171424816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fdc1048b0 0x7f8fdc106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 -- 172.21.15.12:0/171424816 >> 172.21.15.12:0/171424816 conn(0x7f8fdc0fb930 msgr2=0x7f8fdc0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 -- 172.21.15.12:0/171424816 shutdown_connections 2023-12-11T20:16:49.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.922+0000 7f8fe3bff700 1 -- 172.21.15.12:0/171424816 wait complete. 2023-12-11T20:16:49.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.923+0000 7f8fe3bff700 1 Processor -- start 2023-12-11T20:16:49.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.924+0000 7f8fe3bff700 1 -- start start 2023-12-11T20:16:49.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.924+0000 7f8fe3bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fdc101f80 0x7f8fdc199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.924+0000 7f8fe3bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fdc1048b0 0x7f8fdc199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.924+0000 7f8fe3bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc1071e0 0x7f8fdc1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.924+0000 7f8fe3bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1a10a0 con 0x7f8fdc1071e0 2023-12-11T20:16:49.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.924+0000 7f8fe3bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1a11e0 con 0x7f8fdc101f80 2023-12-11T20:16:49.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.924+0000 7f8fe3bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1a1370 con 0x7f8fdc1048b0 2023-12-11T20:16:49.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc1071e0 0x7f8fdc1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc1071e0 0x7f8fdc1a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55570/0 (socket says 172.21.15.12:55570) 2023-12-11T20:16:49.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 -- 172.21.15.12:0/3848875582 learned_addr learned my addr 172.21.15.12:0/3848875582 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe199b700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fdc101f80 0x7f8fdc199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe119a700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fdc1048b0 0x7f8fdc199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 -- 172.21.15.12:0/3848875582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fdc1048b0 msgr2=0x7f8fdc199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fdc1048b0 0x7f8fdc199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 -- 172.21.15.12:0/3848875582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fdc101f80 msgr2=0x7f8fdc199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fdc101f80 0x7f8fdc199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 -- 172.21.15.12:0/3848875582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80095f0 con 0x7f8fdc1071e0 2023-12-11T20:16:49.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.925+0000 7f8fe219c700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc1071e0 0x7f8fdc1a0ad0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4007ee0 tx=0x7f8fd400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.926+0000 7f8fd2ffd700 1 -- 172.21.15.12:0/3848875582 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400dd20 con 0x7f8fdc1071e0 2023-12-11T20:16:49.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.926+0000 7f8fd2ffd700 1 -- 172.21.15.12:0/3848875582 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fd400f040 con 0x7f8fdc1071e0 2023-12-11T20:16:49.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.926+0000 7f8fe3bff700 1 -- 172.21.15.12:0/3848875582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc1a1650 con 0x7f8fdc1071e0 2023-12-11T20:16:49.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.926+0000 7f8fd2ffd700 1 -- 172.21.15.12:0/3848875582 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4004750 con 0x7f8fdc1071e0 2023-12-11T20:16:49.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.926+0000 7f8fe3bff700 1 -- 172.21.15.12:0/3848875582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc1a1b10 con 0x7f8fdc1071e0 2023-12-11T20:16:49.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.929+0000 7f8fd2ffd700 1 -- 172.21.15.12:0/3848875582 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8fd4003a00 con 0x7f8fdc1071e0 2023-12-11T20:16:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.930+0000 7f8ff75d5b80 1 Processor -- start 2023-12-11T20:16:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.930+0000 7f8ff75d5b80 1 -- start start 2023-12-11T20:16:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8fd2ffd700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fc80a1480 0x7f8fc80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a357f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 0x561ad4a36640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a370a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4990b50 con 0x561ad4a36c20 2023-12-11T20:16:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad498e470 con 0x561ad4a35d30 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4989d60 con 0x561ad4a353d0 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8fd2ffd700 1 -- 172.21.15.12:0/3848875582 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8fd40cc670 con 0x7f8fdc1071e0 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8fe119a700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fc80a1480 0x7f8fc80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8fe199b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8fe199b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a357f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40132/0 (socket says 172.21.15.12:40132) 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8fe199b700 1 -- 172.21.15.12:0/2683296806 learned_addr learned my addr 172.21.15.12:0/2683296806 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8fe219c700 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.931+0000 7f8fe119a700 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 0x561ad4a36640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fe199b700 1 -- 172.21.15.12:0/2683296806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 msgr2=0x561ad4a36640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fe199b700 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 0x561ad4a36640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fe199b700 1 -- 172.21.15.12:0/2683296806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 msgr2=0x561ad4a370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fe199b700 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fe199b700 1 -- 172.21.15.12:0/2683296806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ad4806630 con 0x561ad4a353d0 2023-12-11T20:16:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fe119a700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fc80a1480 0x7f8fc80a3940 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00b6c0 tx=0x7f8fcc00bbd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fe199b700 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a357f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009990 tx=0x7f8fd8009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=228e1a8ab4a93247 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fc7fff700 1 -- 172.21.15.12:0/2683296806 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd801d070 con 0x561ad4a353d0 2023-12-11T20:16:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fc7fff700 1 -- 172.21.15.12:0/2683296806 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fd801e040 con 0x561ad4a353d0 2023-12-11T20:16:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.932+0000 7f8fc7fff700 1 -- 172.21.15.12:0/2683296806 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8004500 con 0x561ad4a353d0 2023-12-11T20:16:49.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2683296806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 msgr2=0x561ad4a357f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a357f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009990 tx=0x7f8fd8009ee0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2683296806 shutdown_connections 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a357f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/2683296806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 0x561ad4a36640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2683296806 >> 172.21.15.12:0/2683296806 conn(0x561ad49647e0 msgr2=0x561ad4a31d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2683296806 shutdown_connections 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.933+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2683296806 wait complete. 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.934+0000 7f8ff75d5b80 1 -- start start 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.934+0000 7f8ff75d5b80 1 Processor -- start 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a3f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 0x561ad4a3f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4943560 con 0x561ad4a36c20 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4943200 con 0x561ad4a35d30 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4808920 con 0x561ad4a353d0 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8ff75d5b80 10 client.0 _ll_register_callbacks cb 0x561ad486ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8fe219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8fe219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55584/0 (socket says 172.21.15.12:55584) 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.935+0000 7f8fe219c700 1 -- 172.21.15.12:0/662399361 learned_addr learned my addr 172.21.15.12:0/662399361 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fe119a700 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 0x561ad4a3f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fe199b700 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a3f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fe219c700 1 -- 172.21.15.12:0/662399361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 msgr2=0x561ad4a3f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fe219c700 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a3f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fe219c700 1 -- 172.21.15.12:0/662399361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 msgr2=0x561ad4a3f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fe219c700 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 0x561ad4a3f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fe219c700 1 -- 172.21.15.12:0/662399361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc10a240 con 0x561ad4a36c20 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fe219c700 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a466c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4096350 tx=0x7f8fd4099300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df132a5c4a3b098c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fc57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8fc57fa700 1 -- 172.21.15.12:0/662399361 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4099d40 con 0x561ad4a36c20 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8fc57fa700 1 -- 172.21.15.12:0/662399361 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8fd400de80 con 0x561ad4a36c20 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.936+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/662399361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ad4a28b40 con 0x561ad4a36c20 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8fc57fa700 1 -- 172.21.15.12:0/662399361 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fd4009410 con 0x561ad4a36c20 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8ff75d5b80 10 client.15726 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/662399361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x561ad47b2de0 con 0x561ad4a36c20 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8fc57fa700 1 -- 172.21.15.12:0/662399361 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fd4063020 con 0x561ad4a36c20 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8fc57fa700 1 -- 172.21.15.12:0/662399361 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8fd4098dd0 con 0x561ad4a36c20 2023-12-11T20:16:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8ff75d5b80 10 client.15726 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8ff75d5b80 10 client.15726 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:16:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8ff75d5b80 20 client.15726 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x561ad4a4b000 0x561ad4a4d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8ff75d5b80 4 client.15726 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.937+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/662399361 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ad4a04f40 con 0x561ad4a4b000 2023-12-11T20:16:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.938+0000 7f8fe199b700 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x561ad4a4b000 0x561ad4a4d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.938+0000 7f8fe199b700 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x561ad4a4b000 0x561ad4a4d420 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a757780621d0217 server_cookie=60f483c9261f9ecc in_seq=0 out_seq=0 2023-12-11T20:16:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.938+0000 7f8fc57fa700 10 client.15726 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:16:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8fc57fa700 1 -- 172.21.15.12:0/662399361 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561ad4a04f40 con 0x561ad4a4b000 2023-12-11T20:16:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8fc57fa700 10 client.15726 handle_command_reply: tid=0 2023-12-11T20:16:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 client.15726 shutdown 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/662399361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 msgr2=0x561ad4a466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a466c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4096350 tx=0x7f8fd4099300 comp rx=0 tx=0).stop 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/662399361 shutdown_connections 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x561ad4a4b000 0x561ad4a4d420 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a466c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a3f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/662399361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a35d30 0x561ad4a3f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/662399361 >> 172.21.15.12:0/662399361 conn(0x561ad49647e0 msgr2=0x561ad4a30a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.939+0000 7f8fc57fa700 0 client.15726 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.940+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/662399361 shutdown_connections 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.940+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/662399361 wait complete. 2023-12-11T20:16:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.940+0000 7f8ff75d5b80 20 client.15726 trim_cache size 0 max 16384 2023-12-11T20:16:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.954+0000 7f8ff75d5b80 1 Processor -- start 2023-12-11T20:16:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.954+0000 7f8ff75d5b80 1 -- start start 2023-12-11T20:16:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.954+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a46d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.954+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a35d30 0x561ad4a46680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.954+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a36c20 0x561ad4a37000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.954+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4a52610 con 0x561ad4a35d30 2023-12-11T20:16:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.954+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4a3cdd0 con 0x561ad4a36c20 2023-12-11T20:16:49.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.954+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4a3a6c0 con 0x561ad4a353d0 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a35d30 0x561ad4a46680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a35d30 0x561ad4a46680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55596/0 (socket says 172.21.15.12:55596) 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 -- 172.21.15.12:0/2220789959 learned_addr learned my addr 172.21.15.12:0/2220789959 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe219c700 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a36c20 0x561ad4a37000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe199b700 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a46d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 -- 172.21.15.12:0/2220789959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 msgr2=0x561ad4a46d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a46d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 -- 172.21.15.12:0/2220789959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a36c20 msgr2=0x561ad4a37000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a36c20 0x561ad4a37000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 -- 172.21.15.12:0/2220789959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ad479bc60 con 0x561ad4a35d30 2023-12-11T20:16:49.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe219c700 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a36c20 0x561ad4a37000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.955+0000 7f8fe119a700 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a35d30 0x561ad4a46680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0041b0 tx=0x7f8fcc00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecedf61dc1be0231 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.956+0000 7f8fd0bff700 1 -- 172.21.15.12:0/2220789959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0044c0 con 0x561ad4a35d30 2023-12-11T20:16:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.956+0000 7f8fd0bff700 1 -- 172.21.15.12:0/2220789959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fcc010c40 con 0x561ad4a35d30 2023-12-11T20:16:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.956+0000 7f8fd0bff700 1 -- 172.21.15.12:0/2220789959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc020590 con 0x561ad4a35d30 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.956+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2220789959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a35d30 msgr2=0x561ad4a46680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.956+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a35d30 0x561ad4a46680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0041b0 tx=0x7f8fcc00b410 comp rx=0 tx=0).stop 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2220789959 shutdown_connections 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a36c20 0x561ad4a37000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a353d0 0x561ad4a46d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/2220789959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a35d30 0x561ad4a46680 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2220789959 >> 172.21.15.12:0/2220789959 conn(0x561ad49647e0 msgr2=0x561ad4a3e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2220789959 shutdown_connections 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/2220789959 wait complete. 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 -- start start 2023-12-11T20:16:49.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.957+0000 7f8ff75d5b80 1 Processor -- start 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a353d0 0x561ad4a42600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a35d30 0x561ad4a42b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8ff75d5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a45b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4a46050 con 0x561ad4a36c20 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4a461c0 con 0x561ad4a353d0 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8ff75d5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad4a46380 con 0x561ad4a35d30 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8ff75d5b80 10 client.0 _ll_register_callbacks cb 0x561ad486ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8fe119a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a35d30 0x561ad4a42b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8fe119a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a35d30 0x561ad4a42b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40158/0 (socket says 172.21.15.12:40158) 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8fe119a700 1 -- 172.21.15.12:0/1973999440 learned_addr learned my addr 172.21.15.12:0/1973999440 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:49.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.958+0000 7f8fe219c700 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a45b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fe199b700 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a353d0 0x561ad4a42600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fe119a700 1 -- 172.21.15.12:0/1973999440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a353d0 msgr2=0x561ad4a42600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fe119a700 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a353d0 0x561ad4a42600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fe119a700 1 -- 172.21.15.12:0/1973999440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 msgr2=0x561ad4a45b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fe119a700 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a45b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fe119a700 1 -- 172.21.15.12:0/1973999440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ad47b2de0 con 0x561ad4a35d30 2023-12-11T20:16:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fe219c700 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a45b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fe119a700 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a35d30 0x561ad4a42b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0059d0 tx=0x7f8fcc005f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a34d74c7d73b454 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.959+0000 7f8fc57fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.960+0000 7f8fc57fa700 1 -- 172.21.15.12:0/1973999440 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc003890 con 0x561ad4a35d30 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.960+0000 7f8fc57fa700 1 -- 172.21.15.12:0/1973999440 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8fcc0039f0 con 0x561ad4a35d30 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.960+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/1973999440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fd801e040 con 0x561ad4a35d30 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.960+0000 7f8fc57fa700 1 -- 172.21.15.12:0/1973999440 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fcc003bb0 con 0x561ad4a35d30 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.960+0000 7f8ff75d5b80 10 client.25531 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.960+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/1973999440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f8fcc013e70 con 0x561ad4a35d30 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.960+0000 7f8fc57fa700 1 -- 172.21.15.12:0/1973999440 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fcc042080 con 0x561ad4a35d30 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.961+0000 7f8fc57fa700 1 -- 172.21.15.12:0/1973999440 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8fcc0049b0 con 0x561ad4a35d30 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.961+0000 7f8ff75d5b80 10 client.25531 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.961+0000 7f8ff75d5b80 10 client.25531 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.961+0000 7f8ff75d5b80 20 client.25531 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.961+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x561ad4aa25a0 0x561ad4aa49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.961+0000 7f8ff75d5b80 4 client.25531 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.961+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/1973999440 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561ad494ffd0 con 0x561ad4aa25a0 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.961+0000 7f8fe199b700 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x561ad4aa25a0 0x561ad4aa49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8fe199b700 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x561ad4aa25a0 0x561ad4aa49c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3bb2416178fc8b37 server_cookie=878b74d58b1b5ccb in_seq=0 out_seq=0 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8fc57fa700 10 client.25531 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8fc57fa700 1 -- 172.21.15.12:0/1973999440 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561ad494ffd0 con 0x561ad4aa25a0 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8fc57fa700 10 client.25531 handle_command_reply: tid=0 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 client.25531 shutdown 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/1973999440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a35d30 msgr2=0x561ad4a42b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a35d30 0x561ad4a42b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0059d0 tx=0x7f8fcc005f70 comp rx=0 tx=0).stop 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/1973999440 shutdown_connections 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x561ad4aa25a0 0x561ad4aa49c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ad4a353d0 0x561ad4a42600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8fc57fa700 0 client.25531 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ad4a36c20 0x561ad4a45b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 --2- 172.21.15.12:0/1973999440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ad4a35d30 0x561ad4a42b40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/1973999440 >> 172.21.15.12:0/1973999440 conn(0x561ad49647e0 msgr2=0x561ad4a39b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/1973999440 shutdown_connections 2023-12-11T20:16:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 1 -- 172.21.15.12:0/1973999440 wait complete. 2023-12-11T20:16:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.962+0000 7f8ff75d5b80 20 client.25531 trim_cache size 0 max 16384 2023-12-11T20:16:49.965 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 -- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fc80a1480 msgr2=0x7f8fc80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fc80a1480 0x7f8fc80a3940 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00b6c0 tx=0x7f8fcc00bbd0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 -- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc1071e0 msgr2=0x7f8fdc1a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc1071e0 0x7f8fdc1a0ad0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4007ee0 tx=0x7f8fd400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 -- 172.21.15.12:0/3848875582 shutdown_connections 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fc80a1480 0x7f8fc80a3940 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fdc101f80 0x7f8fdc199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc1071e0 0x7f8fdc1a0ad0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 --2- 172.21.15.12:0/3848875582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fdc1048b0 0x7f8fdc199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:49.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 -- 172.21.15.12:0/3848875582 >> 172.21.15.12:0/3848875582 conn(0x7f8fdc0fb930 msgr2=0x7f8fdc101760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:49.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 -- 172.21.15.12:0/3848875582 shutdown_connections 2023-12-11T20:16:49.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:49.963+0000 7f8fe3bff700 1 -- 172.21.15.12:0/3848875582 wait complete. 2023-12-11T20:16:49.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:16:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 -- 172.21.15.12:0/970509485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4060103040 msgr2=0x7f40601098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 --2- 172.21.15.12:0/970509485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4060103040 0x7f40601098f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f405800b0d0 tx=0x7f405800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 -- 172.21.15.12:0/970509485 shutdown_connections 2023-12-11T20:16:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 --2- 172.21.15.12:0/970509485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4060103040 0x7f40601098f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 --2- 172.21.15.12:0/970509485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40601014b0 0x7f40601018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 --2- 172.21.15.12:0/970509485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40601026a0 0x7f4060102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 -- 172.21.15.12:0/970509485 >> 172.21.15.12:0/970509485 conn(0x7f40600fca00 msgr2=0x7f40600fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 -- 172.21.15.12:0/970509485 shutdown_connections 2023-12-11T20:16:50.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.198+0000 7f40667ff700 1 -- 172.21.15.12:0/970509485 wait complete. 2023-12-11T20:16:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.199+0000 7f40667ff700 1 Processor -- start 2023-12-11T20:16:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.199+0000 7f40667ff700 1 -- start start 2023-12-11T20:16:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.199+0000 7f40667ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40601014b0 0x7f40601996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.199+0000 7f40667ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601026a0 0x7f4060199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.199+0000 7f40667ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4060103040 0x7f40601a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.199+0000 7f40667ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a1210 con 0x7f40601026a0 2023-12-11T20:16:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.199+0000 7f40667ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a1350 con 0x7f4060103040 2023-12-11T20:16:50.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.199+0000 7f40667ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a14e0 con 0x7f40601014b0 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601026a0 0x7f4060199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601026a0 0x7f4060199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55624/0 (socket says 172.21.15.12:55624) 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 -- 172.21.15.12:0/3951251374 learned_addr learned my addr 172.21.15.12:0/3951251374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405ffff700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40601014b0 0x7f40601996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f4064d9c700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4060103040 0x7f40601a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 -- 172.21.15.12:0/3951251374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40601014b0 msgr2=0x7f40601996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40601014b0 0x7f40601996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 -- 172.21.15.12:0/3951251374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4060103040 msgr2=0x7f40601a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4060103040 0x7f40601a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 -- 172.21.15.12:0/3951251374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058009d00 con 0x7f40601026a0 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f4064d9c700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4060103040 0x7f40601a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.200+0000 7f405f7fe700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601026a0 0x7f4060199c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f405400b530 tx=0x7f405400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.201+0000 7f405d7fa700 1 -- 172.21.15.12:0/3951251374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054011830 con 0x7f40601026a0 2023-12-11T20:16:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.201+0000 7f405d7fa700 1 -- 172.21.15.12:0/3951251374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4054011e20 con 0x7f40601026a0 2023-12-11T20:16:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.201+0000 7f40667ff700 1 -- 172.21.15.12:0/3951251374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40601a17c0 con 0x7f40601026a0 2023-12-11T20:16:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.201+0000 7f405d7fa700 1 -- 172.21.15.12:0/3951251374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400f2e0 con 0x7f40601026a0 2023-12-11T20:16:50.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.201+0000 7f40667ff700 1 -- 172.21.15.12:0/3951251374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40601a1da0 con 0x7f40601026a0 2023-12-11T20:16:50.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.206+0000 7f405d7fa700 1 -- 172.21.15.12:0/3951251374 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4054011990 con 0x7f40601026a0 2023-12-11T20:16:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.206+0000 7f407a10cb80 1 Processor -- start 2023-12-11T20:16:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.206+0000 7f407a10cb80 1 -- start start 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc43d0 0x56426fcc47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc4d30 0x56426fcc5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 0x56426fcc60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f407a10cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fc1fb50 con 0x56426fcc5c20 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f407a10cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fc1d470 con 0x56426fcc43d0 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f407a10cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fc18d60 con 0x56426fcc4d30 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f405d7fa700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40480a1500 0x7f40480a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f4064d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc43d0 0x56426fcc47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f4064d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc43d0 0x56426fcc47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42030/0 (socket says 172.21.15.12:42030) 2023-12-11T20:16:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f4064d9c700 1 -- 172.21.15.12:0/4192229716 learned_addr learned my addr 172.21.15.12:0/4192229716 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.207+0000 7f405f7fe700 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 0x56426fcc60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.208+0000 7f405d7fa700 1 -- 172.21.15.12:0/3951251374 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f40540cc830 con 0x7f40601026a0 2023-12-11T20:16:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.208+0000 7f405ffff700 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc4d30 0x56426fcc5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.208+0000 7f4064d9c700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40480a1500 0x7f40480a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.208+0000 7f4064d9c700 1 -- 172.21.15.12:0/4192229716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc4d30 msgr2=0x56426fcc5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.208+0000 7f4064d9c700 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc4d30 0x56426fcc5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.208+0000 7f4064d9c700 1 -- 172.21.15.12:0/4192229716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 msgr2=0x56426fcc60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.208+0000 7f4064d9c700 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 0x56426fcc60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.208+0000 7f4064d9c700 1 -- 172.21.15.12:0/4192229716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56426fa95630 con 0x56426fcc43d0 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.209+0000 7f4064d9c700 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc43d0 0x56426fcc47f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f405800b0d0 tx=0x7f4058007e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f444e017dc49fc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.209+0000 7f4064d9c700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40480a1500 0x7f40480a39c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4058024000 tx=0x7f4058027000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.209+0000 7f40467fc700 1 -- 172.21.15.12:0/4192229716 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800e070 con 0x56426fcc43d0 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.209+0000 7f40467fc700 1 -- 172.21.15.12:0/4192229716 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4058007b90 con 0x56426fcc43d0 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.209+0000 7f40467fc700 1 -- 172.21.15.12:0/4192229716 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4058020e70 con 0x56426fcc43d0 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 -- 172.21.15.12:0/4192229716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc43d0 msgr2=0x56426fcc47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc43d0 0x56426fcc47f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f405800b0d0 tx=0x7f4058007e70 comp rx=0 tx=0).stop 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 -- 172.21.15.12:0/4192229716 shutdown_connections 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc43d0 0x56426fcc47f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 0x56426fcc60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 --2- 172.21.15.12:0/4192229716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc4d30 0x56426fcc5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 -- 172.21.15.12:0/4192229716 >> 172.21.15.12:0/4192229716 conn(0x56426fbf37e0 msgr2=0x56426fcc0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 -- 172.21.15.12:0/4192229716 shutdown_connections 2023-12-11T20:16:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.210+0000 7f407a10cb80 1 -- 172.21.15.12:0/4192229716 wait complete. 2023-12-11T20:16:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.211+0000 7f407a10cb80 1 -- start start 2023-12-11T20:16:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.211+0000 7f407a10cb80 1 Processor -- start 2023-12-11T20:16:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.212+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.212+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc4d30 0x56426fcce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.212+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc5c20 0x56426fcd56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.212+0000 7f407a10cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fbd2560 con 0x56426fcc4d30 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.212+0000 7f407a10cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fbd2200 con 0x56426fcc5c20 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.212+0000 7f407a10cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fa97920 con 0x56426fcc43d0 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f407a10cb80 10 client.0 _ll_register_callbacks cb 0x56426fafda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc4d30 0x56426fcce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc4d30 0x56426fcce6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55634/0 (socket says 172.21.15.12:55634) 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405f7fe700 1 -- 172.21.15.12:0/1595305159 learned_addr learned my addr 172.21.15.12:0/1595305159 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405ffff700 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f4064d9c700 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc5c20 0x56426fcd56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405f7fe700 1 -- 172.21.15.12:0/1595305159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 msgr2=0x56426fcce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405f7fe700 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405f7fe700 1 -- 172.21.15.12:0/1595305159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc5c20 msgr2=0x56426fcd56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405f7fe700 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc5c20 0x56426fcd56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.213+0000 7f405f7fe700 1 -- 172.21.15.12:0/1595305159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406010a240 con 0x56426fcc4d30 2023-12-11T20:16:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f405f7fe700 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc4d30 0x56426fcce6e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f40540ca2e0 tx=0x7f4054014d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ae8997e2df505c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f403f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f403f7fe700 1 -- 172.21.15.12:0/1595305159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054084040 con 0x56426fcc4d30 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f403f7fe700 1 -- 172.21.15.12:0/1595305159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4054011c40 con 0x56426fcc4d30 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f407a10cb80 1 -- 172.21.15.12:0/1595305159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56426fcb7b40 con 0x56426fcc4d30 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f403f7fe700 1 -- 172.21.15.12:0/1595305159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40540653c0 con 0x56426fcc4d30 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f407a10cb80 10 client.15744 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f407a10cb80 1 -- 172.21.15.12:0/1595305159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56426fa41de0 con 0x56426fcc4d30 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.214+0000 7f403f7fe700 1 -- 172.21.15.12:0/1595305159 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56426fcb7b40 con 0x56426fcc4d30 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.215+0000 7f403f7fe700 1 -- 172.21.15.12:0/1595305159 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f40540b2250 con 0x56426fcc4d30 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.215+0000 7f407a10cb80 10 client.15744 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.215+0000 7f407a10cb80 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.215+0000 7f407a10cb80 20 client.15744 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.215+0000 7f407a10cb80 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56426fcd9ec0 0x56426fcdc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.215+0000 7f407a10cb80 4 client.15744 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.215+0000 7f407a10cb80 1 -- 172.21.15.12:0/1595305159 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56426fc93f40 con 0x56426fcd9ec0 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.215+0000 7f405ffff700 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56426fcd9ec0 0x56426fcdc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.216+0000 7f405ffff700 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56426fcd9ec0 0x56426fcdc2e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1621beea2a7387a4 server_cookie=e1a18cc3e3be7496 in_seq=0 out_seq=0 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.216+0000 7f403f7fe700 10 client.15744 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f403f7fe700 1 -- 172.21.15.12:0/1595305159 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56426fc93f40 con 0x56426fcd9ec0 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f403f7fe700 10 client.15744 handle_command_reply: tid=0 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 client.15744 shutdown 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 -- 172.21.15.12:0/1595305159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc4d30 msgr2=0x56426fcce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc4d30 0x56426fcce6e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f40540ca2e0 tx=0x7f4054014d80 comp rx=0 tx=0).stop 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 -- 172.21.15.12:0/1595305159 shutdown_connections 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56426fcd9ec0 0x56426fcdc2e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc5c20 0x56426fcd56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f403f7fe700 0 client.15744 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 --2- 172.21.15.12:0/1595305159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc4d30 0x56426fcce6e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 -- 172.21.15.12:0/1595305159 >> 172.21.15.12:0/1595305159 conn(0x56426fbf37e0 msgr2=0x56426fcbfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 -- 172.21.15.12:0/1595305159 shutdown_connections 2023-12-11T20:16:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.217+0000 7f407a10cb80 1 -- 172.21.15.12:0/1595305159 wait complete. 2023-12-11T20:16:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.218+0000 7f407a10cb80 20 client.15744 trim_cache size 0 max 16384 2023-12-11T20:16:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f407a10cb80 1 Processor -- start 2023-12-11T20:16:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f407a10cb80 1 -- start start 2023-12-11T20:16:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc43d0 0x56426fcc47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 0x56426fcd5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc5c20 0x56426fce0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f407a10cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fcc1200 con 0x56426fcc43d0 2023-12-11T20:16:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f407a10cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fcc3f70 con 0x56426fcc4d30 2023-12-11T20:16:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f407a10cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fcd7460 con 0x56426fcc5c20 2023-12-11T20:16:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.232+0000 7f405ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc43d0 0x56426fcc47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc43d0 0x56426fcc47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55642/0 (socket says 172.21.15.12:55642) 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405ffff700 1 -- 172.21.15.12:0/2479018773 learned_addr learned my addr 172.21.15.12:0/2479018773 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f4064d9c700 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc5c20 0x56426fce0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405f7fe700 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 0x56426fcd5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405ffff700 1 -- 172.21.15.12:0/2479018773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc5c20 msgr2=0x56426fce0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405ffff700 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc5c20 0x56426fce0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405ffff700 1 -- 172.21.15.12:0/2479018773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 msgr2=0x56426fcd5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405ffff700 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 0x56426fcd5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405ffff700 1 -- 172.21.15.12:0/2479018773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56426fa2ac60 con 0x56426fcc43d0 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.233+0000 7f405ffff700 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc43d0 0x56426fcc47b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x56426fcdcbf0 tx=0x7f4050004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94bd6beded29b78 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.234+0000 7f4046ffd700 1 -- 172.21.15.12:0/2479018773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050016070 con 0x56426fcc43d0 2023-12-11T20:16:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.234+0000 7f4046ffd700 1 -- 172.21.15.12:0/2479018773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4050017040 con 0x56426fcc43d0 2023-12-11T20:16:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.234+0000 7f4046ffd700 1 -- 172.21.15.12:0/2479018773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405001c440 con 0x56426fcc43d0 2023-12-11T20:16:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 -- 172.21.15.12:0/2479018773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc43d0 msgr2=0x56426fcc47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc43d0 0x56426fcc47b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x56426fcdcbf0 tx=0x7f4050004750 comp rx=0 tx=0).stop 2023-12-11T20:16:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 -- 172.21.15.12:0/2479018773 shutdown_connections 2023-12-11T20:16:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc5c20 0x56426fce0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc43d0 0x56426fcc47b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 --2- 172.21.15.12:0/2479018773 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 0x56426fcd5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 -- 172.21.15.12:0/2479018773 >> 172.21.15.12:0/2479018773 conn(0x56426fbf37e0 msgr2=0x56426fccd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 -- 172.21.15.12:0/2479018773 shutdown_connections 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 -- 172.21.15.12:0/2479018773 wait complete. 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.235+0000 7f407a10cb80 1 -- start start 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.236+0000 7f407a10cb80 1 Processor -- start 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.236+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcd35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.236+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 0x56426fcd3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.236+0000 7f407a10cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 0x56426fcd4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.236+0000 7f407a10cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fcd5000 con 0x56426fcc5c20 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.236+0000 7f407a10cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fcd5170 con 0x56426fcc4d30 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.236+0000 7f407a10cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56426fcd5330 con 0x56426fcc43d0 2023-12-11T20:16:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.236+0000 7f407a10cb80 10 client.0 _ll_register_callbacks cb 0x56426fafda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:50.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcd35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcd35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40236/0 (socket says 172.21.15.12:40236) 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 -- 172.21.15.12:0/261405525 learned_addr learned my addr 172.21.15.12:0/261405525 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f4064d9c700 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 0x56426fcd4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405f7fe700 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 0x56426fcd3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 -- 172.21.15.12:0/261405525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 msgr2=0x56426fcd3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 0x56426fcd3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 -- 172.21.15.12:0/261405525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 msgr2=0x56426fcd4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 0x56426fcd4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 -- 172.21.15.12:0/261405525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4050004040 con 0x56426fcc43d0 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f405ffff700 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcd35c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4050021040 tx=0x7f405001d450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d465994f62e8a58 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.237+0000 7f403f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.238+0000 7f403f7fe700 1 -- 172.21.15.12:0/261405525 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050016070 con 0x56426fcc43d0 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.238+0000 7f403f7fe700 1 -- 172.21.15.12:0/261405525 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4050003d00 con 0x56426fcc43d0 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.238+0000 7f407a10cb80 1 -- 172.21.15.12:0/261405525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4058007b90 con 0x56426fcc43d0 2023-12-11T20:16:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.238+0000 7f403f7fe700 1 -- 172.21.15.12:0/261405525 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f405001d8f0 con 0x56426fcc43d0 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.238+0000 7f407a10cb80 10 client.25549 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.238+0000 7f407a10cb80 1 -- 172.21.15.12:0/261405525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x56426fa68250 con 0x56426fcc43d0 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.238+0000 7f403f7fe700 1 -- 172.21.15.12:0/261405525 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4058007b90 con 0x56426fcc43d0 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.239+0000 7f403f7fe700 1 -- 172.21.15.12:0/261405525 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4050004ac0 con 0x56426fcc43d0 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.239+0000 7f407a10cb80 10 client.25549 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.239+0000 7f407a10cb80 10 client.25549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.239+0000 7f407a10cb80 20 client.25549 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.239+0000 7f407a10cb80 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56426fd31390 0x56426fd337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.239+0000 7f407a10cb80 4 client.25549 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.239+0000 7f407a10cb80 1 -- 172.21.15.12:0/261405525 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56426fbdefd0 con 0x56426fd31390 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.239+0000 7f405f7fe700 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56426fd31390 0x56426fd337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f405f7fe700 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56426fd31390 0x56426fd337b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc8055e72912208f server_cookie=bab3519a3a9a72dc in_seq=0 out_seq=0 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f403f7fe700 10 client.25549 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f403f7fe700 1 -- 172.21.15.12:0/261405525 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56426fbdefd0 con 0x56426fd31390 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f403f7fe700 10 client.25549 handle_command_reply: tid=0 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 client.25549 shutdown 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 -- 172.21.15.12:0/261405525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 msgr2=0x56426fcd35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcd35c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4050021040 tx=0x7f405001d450 comp rx=0 tx=0).stop 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 -- 172.21.15.12:0/261405525 shutdown_connections 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56426fd31390 0x56426fd337b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56426fcc5c20 0x56426fcd4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56426fcc43d0 0x56426fcd35c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f403f7fe700 0 client.25549 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 --2- 172.21.15.12:0/261405525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56426fcc4d30 0x56426fcd3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 -- 172.21.15.12:0/261405525 >> 172.21.15.12:0/261405525 conn(0x56426fbf37e0 msgr2=0x56426fce0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 -- 172.21.15.12:0/261405525 shutdown_connections 2023-12-11T20:16:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.240+0000 7f407a10cb80 1 -- 172.21.15.12:0/261405525 wait complete. 2023-12-11T20:16:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f407a10cb80 20 client.25549 trim_cache size 0 max 16384 2023-12-11T20:16:50.243 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:16:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 -- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40480a1500 msgr2=0x7f40480a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40480a1500 0x7f40480a39c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4058024000 tx=0x7f4058027000 comp rx=0 tx=0).stop 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 -- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601026a0 msgr2=0x7f4060199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601026a0 0x7f4060199c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f405400b530 tx=0x7f405400b840 comp rx=0 tx=0).stop 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 -- 172.21.15.12:0/3951251374 shutdown_connections 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40480a1500 0x7f40480a39c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4060103040 0x7f40601a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40601014b0 0x7f40601996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 --2- 172.21.15.12:0/3951251374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601026a0 0x7f4060199c20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.241+0000 7f40667ff700 1 -- 172.21.15.12:0/3951251374 >> 172.21.15.12:0/3951251374 conn(0x7f40600fca00 msgr2=0x7f4060073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.242+0000 7f40667ff700 1 -- 172.21.15.12:0/3951251374 shutdown_connections 2023-12-11T20:16:50.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:50.242+0000 7f40667ff700 1 -- 172.21.15.12:0/3951251374 wait complete. 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 -- 172.21.15.12:0/282144224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c301014f0 msgr2=0x7f5c30101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 --2- 172.21.15.12:0/282144224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c301014f0 0x7f5c30101910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5c280099c0 tx=0x7f5c28009cd0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 -- 172.21.15.12:0/282144224 shutdown_connections 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 --2- 172.21.15.12:0/282144224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c30103080 0x7f5c30109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 --2- 172.21.15.12:0/282144224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c301014f0 0x7f5c30101910 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 --2- 172.21.15.12:0/282144224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c301026e0 0x7f5c30102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 -- 172.21.15.12:0/282144224 >> 172.21.15.12:0/282144224 conn(0x7f5c300fca60 msgr2=0x7f5c300feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 -- 172.21.15.12:0/282144224 shutdown_connections 2023-12-11T20:16:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.278+0000 7f5c361ff700 1 -- 172.21.15.12:0/282144224 wait complete. 2023-12-11T20:16:50.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.279+0000 7f5c361ff700 1 Processor -- start 2023-12-11T20:16:50.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.279+0000 7f5c361ff700 1 -- start start 2023-12-11T20:16:50.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c361ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c301014f0 0x7f5c30199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c361ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c301026e0 0x7f5c30199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c361ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c30103080 0x7f5c301a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c361ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301a1100 con 0x7f5c30103080 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c361ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301a1240 con 0x7f5c301014f0 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c361ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301a13d0 con 0x7f5c301026e0 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c301014f0 0x7f5c30199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c301014f0 0x7f5c30199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42066/0 (socket says 172.21.15.12:42066) 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/3704268438 learned_addr learned my addr 172.21.15.12:0/3704268438 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c30103080 0x7f5c301a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.280+0000 7f5c2effd700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c301026e0 0x7f5c30199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/3704268438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c301026e0 msgr2=0x7f5c30199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c301026e0 0x7f5c30199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c30103080 msgr2=0x7f5c301a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c30103080 0x7f5c301a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/3704268438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c280095f0 con 0x7f5c301014f0 2023-12-11T20:16:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c301014f0 0x7f5c30199620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c28000c00 tx=0x7f5c2800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2cff9700 1 -- 172.21.15.12:0/3704268438 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2801d070 con 0x7f5c301014f0 2023-12-11T20:16:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c361ff700 1 -- 172.21.15.12:0/3704268438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c301a1650 con 0x7f5c301014f0 2023-12-11T20:16:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2cff9700 1 -- 172.21.15.12:0/3704268438 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c28005030 con 0x7f5c301014f0 2023-12-11T20:16:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.281+0000 7f5c2cff9700 1 -- 172.21.15.12:0/3704268438 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28004b30 con 0x7f5c301014f0 2023-12-11T20:16:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.282+0000 7f5c361ff700 1 -- 172.21.15.12:0/3704268438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c301a1a80 con 0x7f5c301014f0 2023-12-11T20:16:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.285+0000 7f5c2cff9700 1 -- 172.21.15.12:0/3704268438 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5c28004c90 con 0x7f5c301014f0 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.286+0000 7f5c49c1fb80 1 Processor -- start 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.286+0000 7f5c2cff9700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5c1c0a1470 0x7f5c1c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.286+0000 7f5c49c1fb80 1 -- start start 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.286+0000 7f5c2cff9700 1 -- 172.21.15.12:0/3704268438 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5c280cd9f0 con 0x7f5c301014f0 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.286+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5c1c0a1470 0x7f5c1c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b376ed0 0x55870b3772f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b377830 0x55870b378140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b378ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b2d2af0 con 0x55870b378720 2023-12-11T20:16:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b2d0410 con 0x55870b376ed0 2023-12-11T20:16:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b2cbd00 con 0x55870b377830 2023-12-11T20:16:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c2ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b378ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c2effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b377830 0x55870b378140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c2ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b378ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55682/0 (socket says 172.21.15.12:55682) 2023-12-11T20:16:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c2ffff700 1 -- 172.21.15.12:0/2600426374 learned_addr learned my addr 172.21.15.12:0/2600426374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b376ed0 0x55870b3772f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5c1c0a1470 0x7f5c1c0a3930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000f930 tx=0x7f5c2000fcf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/2600426374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b377830 msgr2=0x55870b378140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.287+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b377830 0x55870b378140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/2600426374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 msgr2=0x55870b378ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b378ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/2600426374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55870b1485d0 con 0x55870b376ed0 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c2effd700 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b377830 0x55870b378140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b378ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b376ed0 0x55870b3772f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c2809a9f0 tx=0x7f5c2809a950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31221f7caa322af server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c25ffb700 1 -- 172.21.15.12:0/2600426374 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2809b3f0 con 0x55870b376ed0 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c25ffb700 1 -- 172.21.15.12:0/2600426374 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c2809acf0 con 0x55870b376ed0 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.288+0000 7f5c25ffb700 1 -- 172.21.15.12:0/2600426374 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2809b1b0 con 0x55870b376ed0 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2600426374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b376ed0 msgr2=0x55870b3772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b376ed0 0x55870b3772f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c2809a9f0 tx=0x7f5c2809a950 comp rx=0 tx=0).stop 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2600426374 shutdown_connections 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b376ed0 0x55870b3772f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b378ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/2600426374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b377830 0x55870b378140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2600426374 >> 172.21.15.12:0/2600426374 conn(0x55870b2a6780 msgr2=0x55870b373880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2600426374 shutdown_connections 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.289+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2600426374 wait complete. 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 1 -- start start 2023-12-11T20:16:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 1 Processor -- start 2023-12-11T20:16:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b380b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b3810b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 0x55870b387ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b285500 con 0x55870b376ed0 2023-12-11T20:16:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b2851a0 con 0x55870b377830 2023-12-11T20:16:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b14a8c0 con 0x55870b378720 2023-12-11T20:16:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.290+0000 7f5c49c1fb80 10 client.0 _ll_register_callbacks cb 0x55870b1b0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b380b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b380b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55686/0 (socket says 172.21.15.12:55686) 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/1892995500 learned_addr learned my addr 172.21.15.12:0/1892995500 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2effd700 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b3810b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 0x55870b387ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/1892995500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 msgr2=0x55870b387ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 0x55870b387ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/1892995500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 msgr2=0x55870b3810b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b3810b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/1892995500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2000fe70 con 0x55870b376ed0 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b380b70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c280a2ac0 tx=0x7f5c280cb3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4144b41b06fbcf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c0effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.291+0000 7f5c0effd700 1 -- 172.21.15.12:0/1892995500 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2809ee40 con 0x55870b376ed0 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/1892995500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55870b36a730 con 0x55870b376ed0 2023-12-11T20:16:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c0effd700 1 -- 172.21.15.12:0/1892995500 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5c280a2ff0 con 0x55870b376ed0 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c0effd700 1 -- 172.21.15.12:0/1892995500 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c28060be0 con 0x55870b376ed0 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 10 client.15762 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/1892995500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f5c280ba040 con 0x55870b376ed0 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c0effd700 1 -- 172.21.15.12:0/1892995500 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c2807d080 con 0x55870b376ed0 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c0effd700 1 -- 172.21.15.12:0/1892995500 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5c28079d20 con 0x55870b376ed0 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 10 client.15762 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 10 client.15762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 20 client.15762 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55870b38c4d0 0x55870b38e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 4 client.15762 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.292+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/1892995500 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55870b346ee0 con 0x55870b38c4d0 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.293+0000 7f5c2effd700 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55870b38c4d0 0x55870b38e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.293+0000 7f5c0effd700 10 client.15762 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.293+0000 7f5c2effd700 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55870b38c4d0 0x55870b38e8c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c6b491bdd6d375e server_cookie=9236930a31070069 in_seq=0 out_seq=0 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c0effd700 1 -- 172.21.15.12:0/1892995500 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55870b346ee0 con 0x55870b38c4d0 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c0effd700 10 client.15762 handle_command_reply: tid=0 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 client.15762 shutdown 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/1892995500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 msgr2=0x55870b380b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b380b70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c280a2ac0 tx=0x7f5c280cb3e0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/1892995500 shutdown_connections 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55870b38c4d0 0x55870b38e8c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 0x55870b387ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b380b70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/1892995500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b3810b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/1892995500 >> 172.21.15.12:0/1892995500 conn(0x55870b2a6780 msgr2=0x55870b371ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.294+0000 7f5c0effd700 0 client.15762 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.295+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/1892995500 shutdown_connections 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.295+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/1892995500 wait complete. 2023-12-11T20:16:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.295+0000 7f5c49c1fb80 20 client.15762 trim_cache size 0 max 16384 2023-12-11T20:16:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.311+0000 7f5c49c1fb80 1 Processor -- start 2023-12-11T20:16:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.311+0000 7f5c49c1fb80 1 -- start start 2023-12-11T20:16:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.311+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b376ed0 0x55870b378b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.311+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b387ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.311+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b393220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.311+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b3804d0 con 0x55870b378720 2023-12-11T20:16:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.311+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b36a590 con 0x55870b377830 2023-12-11T20:16:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.311+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b37e8e0 con 0x55870b376ed0 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b393220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b376ed0 0x55870b378b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b393220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55692/0 (socket says 172.21.15.12:55692) 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 -- 172.21.15.12:0/2942839161 learned_addr learned my addr 172.21.15.12:0/2942839161 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2effd700 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b387ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 -- 172.21.15.12:0/2942839161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b376ed0 msgr2=0x55870b378b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b376ed0 0x55870b378b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 -- 172.21.15.12:0/2942839161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 msgr2=0x55870b387ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b387ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 -- 172.21.15.12:0/2942839161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55870b0f4d80 con 0x55870b378720 2023-12-11T20:16:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b376ed0 0x55870b378b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.312+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b393220 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5c20018640 tx=0x7f5c2001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9cc507fe277f18 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.313+0000 7f5c267fc700 1 -- 172.21.15.12:0/2942839161 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000e040 con 0x55870b378720 2023-12-11T20:16:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.313+0000 7f5c267fc700 1 -- 172.21.15.12:0/2942839161 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c2000f040 con 0x55870b378720 2023-12-11T20:16:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.313+0000 7f5c267fc700 1 -- 172.21.15.12:0/2942839161 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2001a6a0 con 0x55870b378720 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2942839161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 msgr2=0x55870b393220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b393220 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5c20018640 tx=0x7f5c2001f000 comp rx=0 tx=0).stop 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2942839161 shutdown_connections 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b378720 0x55870b393220 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b376ed0 0x55870b378b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/2942839161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b387ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2942839161 >> 172.21.15.12:0/2942839161 conn(0x55870b2a6780 msgr2=0x55870b37b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2942839161 shutdown_connections 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/2942839161 wait complete. 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.314+0000 7f5c49c1fb80 1 -- start start 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.315+0000 7f5c49c1fb80 1 Processor -- start 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.315+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b385aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.315+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b385fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.315+0000 7f5c49c1fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 0x55870b386fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b3874e0 con 0x55870b376ed0 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b387650 con 0x55870b377830 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c49c1fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55870b387810 con 0x55870b378720 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c49c1fb80 10 client.0 _ll_register_callbacks cb 0x55870b1b0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b385aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b385fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b385aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55696/0 (socket says 172.21.15.12:55696) 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/223140127 learned_addr learned my addr 172.21.15.12:0/223140127 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b385fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42102/0 (socket says 172.21.15.12:42102) 2023-12-11T20:16:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2ffff700 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 0x55870b386fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/223140127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 msgr2=0x55870b386fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 0x55870b386fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/223140127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 msgr2=0x55870b385fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b385fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.316+0000 7f5c2f7fe700 1 -- 172.21.15.12:0/223140127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2000fe70 con 0x55870b376ed0 2023-12-11T20:16:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c2f7fe700 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b385aa0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5c28099040 tx=0x7f5c2809b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9708aa211b3599 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c0effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c0effd700 1 -- 172.21.15.12:0/223140127 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28060de0 con 0x55870b376ed0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c0effd700 1 -- 172.21.15.12:0/223140127 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5c280a2ff0 con 0x55870b376ed0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/223140127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c2809acf0 con 0x55870b376ed0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c0effd700 1 -- 172.21.15.12:0/223140127 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c28099170 con 0x55870b376ed0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c49c1fb80 10 client.15768 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/223140127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f5c20009040 con 0x55870b376ed0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c0effd700 1 -- 172.21.15.12:0/223140127 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c2809acf0 con 0x55870b376ed0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.317+0000 7f5c0effd700 1 -- 172.21.15.12:0/223140127 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5c28079d20 con 0x55870b376ed0 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.318+0000 7f5c49c1fb80 10 client.15768 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.318+0000 7f5c49c1fb80 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.318+0000 7f5c49c1fb80 20 client.15768 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.318+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55870b3e3320 0x55870b3e5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.318+0000 7f5c49c1fb80 4 client.15768 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:16:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.318+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/223140127 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55870b291f70 con 0x55870b3e3320 2023-12-11T20:16:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.318+0000 7f5c2effd700 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55870b3e3320 0x55870b3e5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.319+0000 7f5c0effd700 10 client.15768 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.319+0000 7f5c2effd700 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55870b3e3320 0x55870b3e5740 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=101254b206a3e397 server_cookie=b830f62e4c23bf11 in_seq=0 out_seq=0 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c0effd700 1 -- 172.21.15.12:0/223140127 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55870b291f70 con 0x55870b3e3320 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c0effd700 10 client.15768 handle_command_reply: tid=0 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c49c1fb80 1 client.15768 shutdown 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/223140127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 msgr2=0x55870b385aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b385aa0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5c28099040 tx=0x7f5c2809b4b0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/223140127 shutdown_connections 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55870b3e3320 0x55870b3e5740 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55870b378720 0x55870b386fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55870b376ed0 0x55870b385aa0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c0effd700 0 client.15768 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.323+0000 7f5c49c1fb80 1 --2- 172.21.15.12:0/223140127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55870b377830 0x55870b385fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.324+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/223140127 >> 172.21.15.12:0/223140127 conn(0x55870b2a6780 msgr2=0x55870b37ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.324+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/223140127 shutdown_connections 2023-12-11T20:16:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.324+0000 7f5c49c1fb80 1 -- 172.21.15.12:0/223140127 wait complete. 2023-12-11T20:16:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.324+0000 7f5c49c1fb80 20 client.15768 trim_cache size 0 max 16384 2023-12-11T20:16:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:16:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:16:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:16:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 -- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5c1c0a1470 msgr2=0x7f5c1c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5c1c0a1470 0x7f5c1c0a3930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000f930 tx=0x7f5c2000fcf0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 -- 172.21.15.12:0/3704268438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c301014f0 msgr2=0x7f5c30199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c301014f0 0x7f5c30199620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c28000c00 tx=0x7f5c2800f690 comp rx=0 tx=0).stop 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 -- 172.21.15.12:0/3704268438 shutdown_connections 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5c1c0a1470 0x7f5c1c0a3930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c301014f0 0x7f5c30199620 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c30103080 0x7f5c301a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 --2- 172.21.15.12:0/3704268438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c301026e0 0x7f5c30199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 -- 172.21.15.12:0/3704268438 >> 172.21.15.12:0/3704268438 conn(0x7f5c300fca60 msgr2=0x7f5c30107f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 -- 172.21.15.12:0/3704268438 shutdown_connections 2023-12-11T20:16:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:16:50.325+0000 7f5c361ff700 1 -- 172.21.15.12:0/3704268438 wait complete. 2023-12-11T20:16:51.260 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:16:51.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 -- 172.21.15.12:0/746662161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7950075610 msgr2=0x7f7950073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 --2- 172.21.15.12:0/746662161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7950075610 0x7f7950073a60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f794c009990 tx=0x7f794c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 -- 172.21.15.12:0/746662161 shutdown_connections 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 --2- 172.21.15.12:0/746662161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f795010da80 0x7f795010fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 --2- 172.21.15.12:0/746662161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7950075610 0x7f7950073a60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 --2- 172.21.15.12:0/746662161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950074030 0x7f79500744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 -- 172.21.15.12:0/746662161 >> 172.21.15.12:0/746662161 conn(0x7f79500fca00 msgr2=0x7f79500fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 -- 172.21.15.12:0/746662161 shutdown_connections 2023-12-11T20:16:51.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.472+0000 7f79579ff700 1 -- 172.21.15.12:0/746662161 wait complete. 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f79579ff700 1 Processor -- start 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f79579ff700 1 -- start start 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f79579ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950074030 0x7f795019d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f79579ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950075610 0x7f795019de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f79579ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f795010da80 0x7f79501a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f79579ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79501a5450 con 0x7f795010da80 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f79579ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79501a5590 con 0x7f7950074030 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f79579ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79501a5720 con 0x7f7950075610 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.473+0000 7f7955f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f795010da80 0x7f79501a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7955f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f795010da80 0x7f79501a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55712/0 (socket says 172.21.15.12:55712) 2023-12-11T20:16:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7955f9c700 1 -- 172.21.15.12:0/2099464744 learned_addr learned my addr 172.21.15.12:0/2099464744 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f795579b700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950074030 0x7f795019d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7954f9a700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950075610 0x7f795019de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7955f9c700 1 -- 172.21.15.12:0/2099464744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950075610 msgr2=0x7f795019de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7955f9c700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950075610 0x7f795019de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7955f9c700 1 -- 172.21.15.12:0/2099464744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950074030 msgr2=0x7f795019d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7955f9c700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950074030 0x7f795019d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7955f9c700 1 -- 172.21.15.12:0/2099464744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0095f0 con 0x7f795010da80 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7954f9a700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950075610 0x7f795019de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:51.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.474+0000 7f7955f9c700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f795010da80 0x7f79501a4e80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7948007d70 tx=0x7f794800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.475+0000 7f79467fc700 1 -- 172.21.15.12:0/2099464744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794800ad40 con 0x7f795010da80 2023-12-11T20:16:51.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.475+0000 7f79579ff700 1 -- 172.21.15.12:0/2099464744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79501a5a00 con 0x7f795010da80 2023-12-11T20:16:51.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.475+0000 7f79467fc700 1 -- 172.21.15.12:0/2099464744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79480128b0 con 0x7f795010da80 2023-12-11T20:16:51.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.475+0000 7f79467fc700 1 -- 172.21.15.12:0/2099464744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480115a0 con 0x7f795010da80 2023-12-11T20:16:51.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.475+0000 7f79579ff700 1 -- 172.21.15.12:0/2099464744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79501a5f10 con 0x7f795010da80 2023-12-11T20:16:51.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.479+0000 7f79467fc700 1 -- 172.21.15.12:0/2099464744 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7948012a20 con 0x7f795010da80 2023-12-11T20:16:51.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.480+0000 7f796b320b80 1 Processor -- start 2023-12-11T20:16:51.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.480+0000 7f796b320b80 1 -- start start 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f796b320b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517450 0x561d4d517870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f796b320b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517db0 0x561d4d5186c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f796b320b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d518ca0 0x561d4d519120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f79467fc700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f793c0a1480 0x7f793c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f796b320b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d472bd0 con 0x561d4d517450 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f796b320b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d4704f0 con 0x561d4d518ca0 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f796b320b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d46bde0 con 0x561d4d517db0 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f79467fc700 1 -- 172.21.15.12:0/2099464744 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f79480ccfe0 con 0x7f795010da80 2023-12-11T20:16:51.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f7954f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517450 0x561d4d517870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f7955f9c700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f793c0a1480 0x7f793c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f7954f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517450 0x561d4d517870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55718/0 (socket says 172.21.15.12:55718) 2023-12-11T20:16:51.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.481+0000 7f7954f9a700 1 -- 172.21.15.12:0/736662889 learned_addr learned my addr 172.21.15.12:0/736662889 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f795579b700 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517db0 0x561d4d5186c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f7954f9a700 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d518ca0 0x561d4d519120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f7955f9c700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f793c0a1480 0x7f793c0a3940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f79480967b0 tx=0x7f7948006040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f7954f9a700 1 -- 172.21.15.12:0/736662889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517db0 msgr2=0x561d4d5186c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f7954f9a700 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517db0 0x561d4d5186c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f7954f9a700 1 -- 172.21.15.12:0/736662889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d518ca0 msgr2=0x561d4d519120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f7954f9a700 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d518ca0 0x561d4d519120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f7954f9a700 1 -- 172.21.15.12:0/736662889 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d4d2e86b0 con 0x561d4d517450 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f7954f9a700 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517450 0x561d4d517870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f794000bfd0 tx=0x7f794000b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9e6eb322754e34 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f793b7fe700 1 -- 172.21.15.12:0/736662889 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940004220 con 0x561d4d517450 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.482+0000 7f793b7fe700 1 -- 172.21.15.12:0/736662889 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7940004cc0 con 0x561d4d517450 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f793b7fe700 1 -- 172.21.15.12:0/736662889 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400053e0 con 0x561d4d517450 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 -- 172.21.15.12:0/736662889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517450 msgr2=0x561d4d517870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517450 0x561d4d517870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f794000bfd0 tx=0x7f794000b770 comp rx=0 tx=0).stop 2023-12-11T20:16:51.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 -- 172.21.15.12:0/736662889 shutdown_connections 2023-12-11T20:16:51.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d518ca0 0x561d4d519120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517450 0x561d4d517870 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 --2- 172.21.15.12:0/736662889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517db0 0x561d4d5186c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 -- 172.21.15.12:0/736662889 >> 172.21.15.12:0/736662889 conn(0x561d4d446860 msgr2=0x561d4d513e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 -- 172.21.15.12:0/736662889 shutdown_connections 2023-12-11T20:16:51.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.483+0000 7f796b320b80 1 -- 172.21.15.12:0/736662889 wait complete. 2023-12-11T20:16:51.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.484+0000 7f796b320b80 1 -- start start 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.484+0000 7f796b320b80 1 Processor -- start 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f796b320b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d521160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f796b320b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f796b320b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 0x561d4d5286e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f796b320b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d4255e0 con 0x561d4d517db0 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f796b320b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d425280 con 0x561d4d517450 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f796b320b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d2ea9a0 con 0x561d4d518ca0 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f796b320b80 10 client.0 _ll_register_callbacks cb 0x561d4d350b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f795579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f795579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5216a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55730/0 (socket says 172.21.15.12:55730) 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f795579b700 1 -- 172.21.15.12:0/2272761551 learned_addr learned my addr 172.21.15.12:0/2272761551 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f7954f9a700 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d521160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f7954f9a700 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 0x561d4d5286e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.485+0000 7f795579b700 1 -- 172.21.15.12:0/2272761551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 msgr2=0x561d4d5286e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f795579b700 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 0x561d4d5286e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f795579b700 1 -- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 msgr2=0x561d4d521160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f795579b700 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d521160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f795579b700 1 -- 172.21.15.12:0/2272761551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79400136f0 con 0x561d4d517db0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f7954f9a700 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d521160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f795579b700 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5216a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f794c009990 tx=0x7f794c005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bafa3a561950e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f7938ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f7938ff9700 1 -- 172.21.15.12:0/2272761551 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c01d070 con 0x561d4d517db0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f796b320b80 1 -- 172.21.15.12:0/2272761551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d4d50abc0 con 0x561d4d517db0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f7938ff9700 1 -- 172.21.15.12:0/2272761551 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f794c004500 con 0x561d4d517db0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f7938ff9700 1 -- 172.21.15.12:0/2272761551 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f794c0046c0 con 0x561d4d517db0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.486+0000 7f796b320b80 10 client.15780 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f796b320b80 1 -- 172.21.15.12:0/2272761551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x561d4d294e60 con 0x561d4d517db0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f7938ff9700 1 -- 172.21.15.12:0/2272761551 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561d4d50abc0 con 0x561d4d517db0 2023-12-11T20:16:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f7938ff9700 1 -- 172.21.15.12:0/2272761551 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f794c003a20 con 0x561d4d517db0 2023-12-11T20:16:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f796b320b80 10 client.15780 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f796b320b80 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f796b320b80 20 client.15780 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f796b320b80 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561d4d52cfb0 0x561d4d52f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f796b320b80 4 client.15780 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.487+0000 7f796b320b80 1 -- 172.21.15.12:0/2272761551 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d4d4e6fc0 con 0x561d4d52cfb0 2023-12-11T20:16:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.488+0000 7f7954f9a700 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561d4d52cfb0 0x561d4d52f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.488+0000 7f7954f9a700 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561d4d52cfb0 0x561d4d52f3d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34fcdc6235ded5a0 server_cookie=31262f34bf586f in_seq=0 out_seq=0 2023-12-11T20:16:51.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.488+0000 7f7938ff9700 10 client.15780 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:51.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f7938ff9700 1 -- 172.21.15.12:0/2272761551 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561d4d4e6fc0 con 0x561d4d52cfb0 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f7938ff9700 10 client.15780 handle_command_reply: tid=0 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 client.15780 shutdown 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 -- 172.21.15.12:0/2272761551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 msgr2=0x561d4d5216a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5216a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f794c009990 tx=0x7f794c005320 comp rx=0 tx=0).stop 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 -- 172.21.15.12:0/2272761551 shutdown_connections 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561d4d52cfb0 0x561d4d52f3d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d521160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 0x561d4d5286e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 --2- 172.21.15.12:0/2272761551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5216a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f796b320b80 1 -- 172.21.15.12:0/2272761551 >> 172.21.15.12:0/2272761551 conn(0x561d4d446860 msgr2=0x561d4d512ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.489+0000 7f7938ff9700 0 client.15780 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.490+0000 7f796b320b80 1 -- 172.21.15.12:0/2272761551 shutdown_connections 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.490+0000 7f796b320b80 1 -- 172.21.15.12:0/2272761551 wait complete. 2023-12-11T20:16:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.490+0000 7f796b320b80 20 client.15780 trim_cache size 0 max 16384 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.508+0000 7f796b320b80 1 Processor -- start 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.508+0000 7f796b320b80 1 -- start start 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.508+0000 7f796b320b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d514100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.508+0000 7f796b320b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.508+0000 7f796b320b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 0x561d4d5120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.508+0000 7f796b320b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d529860 con 0x561d4d517db0 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.508+0000 7f796b320b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d520cd0 con 0x561d4d517450 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.508+0000 7f796b320b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d5183c0 con 0x561d4d518ca0 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f795579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f795579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5286a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55736/0 (socket says 172.21.15.12:55736) 2023-12-11T20:16:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f795579b700 1 -- 172.21.15.12:0/3134864891 learned_addr learned my addr 172.21.15.12:0/3134864891 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f7954f9a700 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d514100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f7954f9a700 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 0x561d4d5120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f795579b700 1 -- 172.21.15.12:0/3134864891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 msgr2=0x561d4d5120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f795579b700 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 0x561d4d5120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f795579b700 1 -- 172.21.15.12:0/3134864891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 msgr2=0x561d4d514100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f795579b700 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d514100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f795579b700 1 -- 172.21.15.12:0/3134864891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d4d27dce0 con 0x561d4d517db0 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.509+0000 7f7954f9a700 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d514100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.510+0000 7f795579b700 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5286a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f794c0098e0 tx=0x7f794c005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b152c9989f1a12a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.510+0000 7f793bfff700 1 -- 172.21.15.12:0/3134864891 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c01d070 con 0x561d4d517db0 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.510+0000 7f793bfff700 1 -- 172.21.15.12:0/3134864891 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f794c01e040 con 0x561d4d517db0 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.510+0000 7f793bfff700 1 -- 172.21.15.12:0/3134864891 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c004960 con 0x561d4d517db0 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 -- 172.21.15.12:0/3134864891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 msgr2=0x561d4d5286a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5286a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f794c0098e0 tx=0x7f794c005c70 comp rx=0 tx=0).stop 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 -- 172.21.15.12:0/3134864891 shutdown_connections 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517450 0x561d4d514100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d518ca0 0x561d4d5120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 --2- 172.21.15.12:0/3134864891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d517db0 0x561d4d5286a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 -- 172.21.15.12:0/3134864891 >> 172.21.15.12:0/3134864891 conn(0x561d4d446860 msgr2=0x561d4d5139f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 -- 172.21.15.12:0/3134864891 shutdown_connections 2023-12-11T20:16:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 -- 172.21.15.12:0/3134864891 wait complete. 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 -- start start 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.511+0000 7f796b320b80 1 Processor -- start 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f796b320b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517450 0x561d4d525650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f796b320b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517db0 0x561d4d525b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f796b320b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d518ca0 0x561d4d5834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f796b320b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d5839e0 con 0x561d4d518ca0 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f796b320b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d583b20 con 0x561d4d517db0 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f796b320b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4d583c60 con 0x561d4d517450 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f796b320b80 10 client.0 _ll_register_callbacks cb 0x561d4d350b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f7954f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d518ca0 0x561d4d5834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f7954f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d518ca0 0x561d4d5834a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55738/0 (socket says 172.21.15.12:55738) 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f7954f9a700 1 -- 172.21.15.12:0/3726177816 learned_addr learned my addr 172.21.15.12:0/3726177816 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f7954f9a700 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517450 0x561d4d525650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.512+0000 7f795579b700 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517db0 0x561d4d525b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7954f9a700 1 -- 172.21.15.12:0/3726177816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517450 msgr2=0x561d4d525650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7954f9a700 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517450 0x561d4d525650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7954f9a700 1 -- 172.21.15.12:0/3726177816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517db0 msgr2=0x561d4d525b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7954f9a700 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517db0 0x561d4d525b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7954f9a700 1 -- 172.21.15.12:0/3726177816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d4d2e86b0 con 0x561d4d518ca0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7954f9a700 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d518ca0 0x561d4d5834a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7940013fd0 tx=0x7f7940020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de544e956898ac42 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7938ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7938ff9700 1 -- 172.21.15.12:0/3726177816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940013020 con 0x561d4d518ca0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f796b320b80 1 -- 172.21.15.12:0/3726177816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7940004cc0 con 0x561d4d518ca0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7938ff9700 1 -- 172.21.15.12:0/3726177816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7940013180 con 0x561d4d518ca0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.513+0000 7f7938ff9700 1 -- 172.21.15.12:0/3726177816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f794002c360 con 0x561d4d518ca0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f796b320b80 10 client.15786 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f796b320b80 1 -- 172.21.15.12:0/3726177816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x561d4d294e60 con 0x561d4d518ca0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f7938ff9700 1 -- 172.21.15.12:0/3726177816 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f794003e080 con 0x561d4d518ca0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f7938ff9700 1 -- 172.21.15.12:0/3726177816 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f794001d070 con 0x561d4d518ca0 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f796b320b80 10 client.15786 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f796b320b80 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f796b320b80 20 client.15786 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f796b320b80 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561d4d585590 0x561d4d587980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f796b320b80 4 client.15786 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.514+0000 7f796b320b80 1 -- 172.21.15.12:0/3726177816 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561d4d432050 con 0x561d4d585590 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.515+0000 7f795579b700 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561d4d585590 0x561d4d587980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.515+0000 7f795579b700 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561d4d585590 0x561d4d587980 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6db6255bebc75e6 server_cookie=687307fc0e57f63a in_seq=0 out_seq=0 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.515+0000 7f7938ff9700 10 client.15786 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.516+0000 7f7938ff9700 1 -- 172.21.15.12:0/3726177816 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561d4d432050 con 0x561d4d585590 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.516+0000 7f7938ff9700 10 client.15786 handle_command_reply: tid=0 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.516+0000 7f796b320b80 1 client.15786 shutdown 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 -- 172.21.15.12:0/3726177816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d518ca0 msgr2=0x561d4d5834a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d518ca0 0x561d4d5834a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7940013fd0 tx=0x7f7940020040 comp rx=0 tx=0).stop 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 -- 172.21.15.12:0/3726177816 shutdown_connections 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561d4d585590 0x561d4d587980 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561d4d518ca0 0x561d4d5834a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561d4d517450 0x561d4d525650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 --2- 172.21.15.12:0/3726177816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561d4d517db0 0x561d4d525b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 -- 172.21.15.12:0/3726177816 >> 172.21.15.12:0/3726177816 conn(0x561d4d446860 msgr2=0x561d4d50c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f7938ff9700 0 client.15786 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 -- 172.21.15.12:0/3726177816 shutdown_connections 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 1 -- 172.21.15.12:0/3726177816 wait complete. 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.517+0000 7f796b320b80 20 client.15786 trim_cache size 0 max 16384 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:16:51.521 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "d7771f34-33b7-4453-9c7b-a97a6af37fad", 2023-12-11T20:16:51.522 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:16:51.522 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:16:51.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 -- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f793c0a1480 msgr2=0x7f793c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f793c0a1480 0x7f793c0a3940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f79480967b0 tx=0x7f7948006040 comp rx=0 tx=0).stop 2023-12-11T20:16:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 -- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f795010da80 msgr2=0x7f79501a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f795010da80 0x7f79501a4e80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7948007d70 tx=0x7f794800a340 comp rx=0 tx=0).stop 2023-12-11T20:16:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 -- 172.21.15.12:0/2099464744 shutdown_connections 2023-12-11T20:16:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f793c0a1480 0x7f793c0a3940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7950074030 0x7f795019d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f795010da80 0x7f79501a4e80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 --2- 172.21.15.12:0/2099464744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7950075610 0x7f795019de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 -- 172.21.15.12:0/2099464744 >> 172.21.15.12:0/2099464744 conn(0x7f79500fca00 msgr2=0x7f7950100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 -- 172.21.15.12:0/2099464744 shutdown_connections 2023-12-11T20:16:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.518+0000 7f79579ff700 1 -- 172.21.15.12:0/2099464744 wait complete. 2023-12-11T20:16:51.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:16:51.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 -- 172.21.15.12:0/1983466348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281026a0 msgr2=0x7fea28102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1983466348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281026a0 0x7fea28102b00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fea100099c0 tx=0x7fea10009cd0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 -- 172.21.15.12:0/1983466348 shutdown_connections 2023-12-11T20:16:51.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1983466348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea281014b0 0x7fea281018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1983466348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea28103040 0x7fea281098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1983466348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281026a0 0x7fea28102b00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 -- 172.21.15.12:0/1983466348 >> 172.21.15.12:0/1983466348 conn(0x7fea280fca00 msgr2=0x7fea280fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 -- 172.21.15.12:0/1983466348 shutdown_connections 2023-12-11T20:16:51.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.745+0000 7fea2ddff700 1 -- 172.21.15.12:0/1983466348 wait complete. 2023-12-11T20:16:51.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.746+0000 7fea2ddff700 1 Processor -- start 2023-12-11T20:16:51.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.746+0000 7fea2ddff700 1 -- start start 2023-12-11T20:16:51.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.746+0000 7fea2ddff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281014b0 0x7fea28197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.746+0000 7fea2ddff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea281026a0 0x7fea281978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.746+0000 7fea2ddff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea28103040 0x7fea2819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.746+0000 7fea2ddff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819eea0 con 0x7fea281014b0 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.746+0000 7fea2ddff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819efe0 con 0x7fea281026a0 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.746+0000 7fea2ddff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2819f170 con 0x7fea28103040 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281014b0 0x7fea28197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281014b0 0x7fea28197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55756/0 (socket says 172.21.15.12:55756) 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 -- 172.21.15.12:0/1854405060 learned_addr learned my addr 172.21.15.12:0/1854405060 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea1ffff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea281026a0 0x7fea281978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea27fff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea28103040 0x7fea2819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 -- 172.21.15.12:0/1854405060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea28103040 msgr2=0x7fea2819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea28103040 0x7fea2819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 -- 172.21.15.12:0/1854405060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea281026a0 msgr2=0x7fea281978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea281026a0 0x7fea281978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 -- 172.21.15.12:0/1854405060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100095f0 con 0x7fea281014b0 2023-12-11T20:16:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.747+0000 7fea277fe700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281014b0 0x7fea28197370 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fea1800e970 tx=0x7fea1800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.748+0000 7fea257fa700 1 -- 172.21.15.12:0/1854405060 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18009790 con 0x7fea281014b0 2023-12-11T20:16:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.748+0000 7fea2ddff700 1 -- 172.21.15.12:0/1854405060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2819f450 con 0x7fea281014b0 2023-12-11T20:16:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.748+0000 7fea257fa700 1 -- 172.21.15.12:0/1854405060 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea1800eec0 con 0x7fea281014b0 2023-12-11T20:16:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.748+0000 7fea257fa700 1 -- 172.21.15.12:0/1854405060 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18003c10 con 0x7fea281014b0 2023-12-11T20:16:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.748+0000 7fea2ddff700 1 -- 172.21.15.12:0/1854405060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2819f9b0 con 0x7fea281014b0 2023-12-11T20:16:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.751+0000 7fea257fa700 1 -- 172.21.15.12:0/1854405060 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fea18003db0 con 0x7fea281014b0 2023-12-11T20:16:51.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.752+0000 7fea4164eb80 1 Processor -- start 2023-12-11T20:16:51.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.752+0000 7fea4164eb80 1 -- start start 2023-12-11T20:16:51.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea257fa700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea140a1480 0x7fea140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd535c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 0x555dfd536a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 0x555dfd5374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea4164eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd48cb50 con 0x555dfd5357e0 2023-12-11T20:16:51.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea4164eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd48a470 con 0x555dfd537030 2023-12-11T20:16:51.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea4164eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd485d60 con 0x555dfd536140 2023-12-11T20:16:51.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea257fa700 1 -- 172.21.15.12:0/1854405060 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea18014070 con 0x7fea281014b0 2023-12-11T20:16:51.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea27fff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea140a1480 0x7fea140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea277fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd535c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea277fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd535c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55772/0 (socket says 172.21.15.12:55772) 2023-12-11T20:16:51.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea277fe700 1 -- 172.21.15.12:0/2762559938 learned_addr learned my addr 172.21.15.12:0/2762559938 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.753+0000 7fea1ffff700 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 0x555dfd536a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea277fe700 1 -- 172.21.15.12:0/2762559938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 msgr2=0x555dfd536a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea277fe700 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 0x555dfd536a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea27fff700 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 0x555dfd5374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea277fe700 1 -- 172.21.15.12:0/2762559938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 msgr2=0x555dfd5374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea277fe700 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 0x555dfd5374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea277fe700 1 -- 172.21.15.12:0/2762559938 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dfd302630 con 0x555dfd5357e0 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea27fff700 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 0x555dfd5374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea27fff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea140a1480 0x7fea140a3940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea200060b0 tx=0x7fea200077e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea277fe700 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd535c00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fea180a20e0 tx=0x7fea18099e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dea5d97d3a498bf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea1dffb700 1 -- 172.21.15.12:0/2762559938 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1809a980 con 0x555dfd5357e0 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea1dffb700 1 -- 172.21.15.12:0/2762559938 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea18094e90 con 0x555dfd5357e0 2023-12-11T20:16:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.754+0000 7fea1dffb700 1 -- 172.21.15.12:0/2762559938 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18098490 con 0x555dfd5357e0 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 -- 172.21.15.12:0/2762559938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 msgr2=0x555dfd535c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd535c00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fea180a20e0 tx=0x7fea18099e40 comp rx=0 tx=0).stop 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 -- 172.21.15.12:0/2762559938 shutdown_connections 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 0x555dfd5374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd535c00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 --2- 172.21.15.12:0/2762559938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 0x555dfd536a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 -- 172.21.15.12:0/2762559938 >> 172.21.15.12:0/2762559938 conn(0x555dfd4607e0 msgr2=0x555dfd52dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 -- 172.21.15.12:0/2762559938 shutdown_connections 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.755+0000 7fea4164eb80 1 -- 172.21.15.12:0/2762559938 wait complete. 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.756+0000 7fea4164eb80 1 -- start start 2023-12-11T20:16:51.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.756+0000 7fea4164eb80 1 Processor -- start 2023-12-11T20:16:51.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd53f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 0x555dfd53fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 0x555dfd546bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea4164eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd43f560 con 0x555dfd5357e0 2023-12-11T20:16:51.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea4164eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd43f200 con 0x555dfd537030 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea4164eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd304920 con 0x555dfd536140 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea4164eb80 10 client.0 _ll_register_callbacks cb 0x555dfd36aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea277fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd53f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea277fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd53f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55788/0 (socket says 172.21.15.12:55788) 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea277fe700 1 -- 172.21.15.12:0/1029778098 learned_addr learned my addr 172.21.15.12:0/1029778098 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea1ffff700 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 0x555dfd53fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea277fe700 1 -- 172.21.15.12:0/1029778098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 msgr2=0x555dfd53fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea277fe700 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 0x555dfd53fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea277fe700 1 -- 172.21.15.12:0/1029778098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 msgr2=0x555dfd546bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea277fe700 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 0x555dfd546bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.757+0000 7fea277fe700 1 -- 172.21.15.12:0/1029778098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2819f9b0 con 0x555dfd5357e0 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea277fe700 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd53f640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fea18099f80 tx=0x7fea18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b87fca70bd5e38 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:16:51.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea06ffd700 1 -- 172.21.15.12:0/1029778098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1809e3d0 con 0x555dfd5357e0 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea06ffd700 1 -- 172.21.15.12:0/1029778098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea18098430 con 0x555dfd5357e0 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea4164eb80 1 -- 172.21.15.12:0/1029778098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dfd524b40 con 0x555dfd5357e0 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea06ffd700 1 -- 172.21.15.12:0/1029778098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea1809e170 con 0x555dfd5357e0 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea4164eb80 10 client.15798 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea4164eb80 1 -- 172.21.15.12:0/1029778098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x555dfd2aede0 con 0x555dfd5357e0 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea06ffd700 1 -- 172.21.15.12:0/1029778098 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555dfd524b40 con 0x555dfd5357e0 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.758+0000 7fea06ffd700 1 -- 172.21.15.12:0/1029778098 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fea180b82c0 con 0x555dfd5357e0 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.759+0000 7fea4164eb80 10 client.15798 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.759+0000 7fea4164eb80 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.759+0000 7fea4164eb80 20 client.15798 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.759+0000 7fea4164eb80 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555dfd54af50 0x555dfd54d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.759+0000 7fea4164eb80 4 client.15798 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.759+0000 7fea4164eb80 1 -- 172.21.15.12:0/1029778098 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dfd500f40 con 0x555dfd54af50 2023-12-11T20:16:51.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.759+0000 7fea1ffff700 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555dfd54af50 0x555dfd54d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.760+0000 7fea1ffff700 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555dfd54af50 0x555dfd54d340 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6351b8d9073827d9 server_cookie=8ba6c3a6b458304 in_seq=0 out_seq=0 2023-12-11T20:16:51.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.760+0000 7fea06ffd700 10 client.15798 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:51.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.760+0000 7fea06ffd700 1 -- 172.21.15.12:0/1029778098 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555dfd500f40 con 0x555dfd54af50 2023-12-11T20:16:51.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.760+0000 7fea06ffd700 10 client.15798 handle_command_reply: tid=0 2023-12-11T20:16:51.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 client.15798 shutdown 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 -- 172.21.15.12:0/1029778098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 msgr2=0x555dfd53f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd53f640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fea18099f80 tx=0x7fea18004750 comp rx=0 tx=0).stop 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 -- 172.21.15.12:0/1029778098 shutdown_connections 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555dfd54af50 0x555dfd54d340 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd537030 0x555dfd546bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd5357e0 0x555dfd53f640 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 --2- 172.21.15.12:0/1029778098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd536140 0x555dfd53fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 -- 172.21.15.12:0/1029778098 >> 172.21.15.12:0/1029778098 conn(0x555dfd4607e0 msgr2=0x555dfd52ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea06ffd700 0 client.15798 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 -- 172.21.15.12:0/1029778098 shutdown_connections 2023-12-11T20:16:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 1 -- 172.21.15.12:0/1029778098 wait complete. 2023-12-11T20:16:51.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.761+0000 7fea4164eb80 20 client.15798 trim_cache size 0 max 16384 2023-12-11T20:16:51.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.779+0000 7fea4164eb80 1 Processor -- start 2023-12-11T20:16:51.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.779+0000 7fea4164eb80 1 -- start start 2023-12-11T20:16:51.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd5357e0 0x555dfd52d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd536140 0x555dfd546b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd537030 0x555dfd52deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea4164eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd528790 con 0x555dfd536140 2023-12-11T20:16:51.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea4164eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd53f1b0 con 0x555dfd5357e0 2023-12-11T20:16:51.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea4164eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd547d40 con 0x555dfd537030 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea1ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd536140 0x555dfd546b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea1ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd536140 0x555dfd546b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55792/0 (socket says 172.21.15.12:55792) 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea1ffff700 1 -- 172.21.15.12:0/759100233 learned_addr learned my addr 172.21.15.12:0/759100233 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea277fe700 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd5357e0 0x555dfd52d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea27fff700 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd537030 0x555dfd52deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea1ffff700 1 -- 172.21.15.12:0/759100233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd537030 msgr2=0x555dfd52deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea1ffff700 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd537030 0x555dfd52deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea1ffff700 1 -- 172.21.15.12:0/759100233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd5357e0 msgr2=0x555dfd52d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea1ffff700 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd5357e0 0x555dfd52d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.780+0000 7fea1ffff700 1 -- 172.21.15.12:0/759100233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dfd297c60 con 0x555dfd536140 2023-12-11T20:16:51.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.781+0000 7fea1ffff700 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd536140 0x555dfd546b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fea10009990 tx=0x7fea10005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75b416c52de8a32 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.781+0000 7fea1e7fc700 1 -- 172.21.15.12:0/759100233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100052b0 con 0x555dfd536140 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.781+0000 7fea1e7fc700 1 -- 172.21.15.12:0/759100233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea1002c070 con 0x555dfd536140 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.781+0000 7fea1e7fc700 1 -- 172.21.15.12:0/759100233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10028180 con 0x555dfd536140 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 -- 172.21.15.12:0/759100233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd536140 msgr2=0x555dfd546b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd536140 0x555dfd546b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fea10009990 tx=0x7fea10005040 comp rx=0 tx=0).stop 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 -- 172.21.15.12:0/759100233 shutdown_connections 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd5357e0 0x555dfd52d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd537030 0x555dfd52deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 --2- 172.21.15.12:0/759100233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd536140 0x555dfd546b80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 -- 172.21.15.12:0/759100233 >> 172.21.15.12:0/759100233 conn(0x555dfd4607e0 msgr2=0x555dfd539fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 -- 172.21.15.12:0/759100233 shutdown_connections 2023-12-11T20:16:51.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 -- 172.21.15.12:0/759100233 wait complete. 2023-12-11T20:16:51.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 -- start start 2023-12-11T20:16:51.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.782+0000 7fea4164eb80 1 Processor -- start 2023-12-11T20:16:51.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd5357e0 0x555dfd5465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd536140 0x555dfd546b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea4164eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd537030 0x555dfd544cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea4164eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd545390 con 0x555dfd537030 2023-12-11T20:16:51.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea4164eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd545500 con 0x555dfd536140 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea4164eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dfd5456c0 con 0x555dfd5357e0 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea4164eb80 10 client.0 _ll_register_callbacks cb 0x555dfd36aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea277fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd5357e0 0x555dfd5465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea27fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd537030 0x555dfd544cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea277fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd5357e0 0x555dfd5465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40388/0 (socket says 172.21.15.12:40388) 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea277fe700 1 -- 172.21.15.12:0/3389237233 learned_addr learned my addr 172.21.15.12:0/3389237233 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.783+0000 7fea1ffff700 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd536140 0x555dfd546b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea277fe700 1 -- 172.21.15.12:0/3389237233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd536140 msgr2=0x555dfd546b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea277fe700 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd536140 0x555dfd546b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea277fe700 1 -- 172.21.15.12:0/3389237233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd537030 msgr2=0x555dfd544cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea277fe700 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd537030 0x555dfd544cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea277fe700 1 -- 172.21.15.12:0/3389237233 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2810a240 con 0x555dfd5357e0 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea277fe700 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd5357e0 0x555dfd5465f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea180cadd0 tx=0x7fea180a2470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a87f1583bf1576 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:16:51.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea06ffd700 1 -- 172.21.15.12:0/3389237233 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180965c0 con 0x555dfd5357e0 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea06ffd700 1 -- 172.21.15.12:0/3389237233 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea1807a020 con 0x555dfd5357e0 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.784+0000 7fea4164eb80 1 -- 172.21.15.12:0/3389237233 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea18094e90 con 0x555dfd5357e0 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea06ffd700 1 -- 172.21.15.12:0/3389237233 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea180a2180 con 0x555dfd5357e0 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea4164eb80 10 client.25603 fetch_fsmap learned FSMap version 22 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea4164eb80 1 -- 172.21.15.12:0/3389237233 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x555dfd2d5250 con 0x555dfd5357e0 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea06ffd700 1 -- 172.21.15.12:0/3389237233 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea18094e90 con 0x555dfd5357e0 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea06ffd700 1 -- 172.21.15.12:0/3389237233 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 22) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fea18099410 con 0x555dfd5357e0 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea4164eb80 10 client.25603 fetch_fsmap finished waiting for FSMap version 22 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea4164eb80 10 client.25603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea4164eb80 20 client.25603 populate_metadata read hostname 'smithi012' 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea4164eb80 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555dfd5a2380 0x555dfd5a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea4164eb80 4 client.25603 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.785+0000 7fea4164eb80 1 -- 172.21.15.12:0/3389237233 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555dfd44bfd0 con 0x555dfd5a2380 2023-12-11T20:16:51.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.786+0000 7fea1ffff700 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555dfd5a2380 0x555dfd5a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.786+0000 7fea1ffff700 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555dfd5a2380 0x555dfd5a47a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1132bd736f9d312e server_cookie=ab82b979f8b5c862 in_seq=0 out_seq=0 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.786+0000 7fea06ffd700 10 client.25603 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea06ffd700 1 -- 172.21.15.12:0/3389237233 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555dfd44bfd0 con 0x555dfd5a2380 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea06ffd700 10 client.25603 handle_command_reply: tid=0 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 client.25603 shutdown 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 -- 172.21.15.12:0/3389237233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd5357e0 msgr2=0x555dfd5465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd5357e0 0x555dfd5465f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea180cadd0 tx=0x7fea180a2470 comp rx=0 tx=0).stop 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 -- 172.21.15.12:0/3389237233 shutdown_connections 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555dfd5a2380 0x555dfd5a47a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555dfd537030 0x555dfd544cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555dfd5357e0 0x555dfd5465f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 --2- 172.21.15.12:0/3389237233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555dfd536140 0x555dfd546b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea06ffd700 0 client.25603 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:16:51.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 -- 172.21.15.12:0/3389237233 >> 172.21.15.12:0/3389237233 conn(0x555dfd4607e0 msgr2=0x555dfd52d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 -- 172.21.15.12:0/3389237233 shutdown_connections 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 1 -- 172.21.15.12:0/3389237233 wait complete. 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.787+0000 7fea4164eb80 20 client.25603 trim_cache size 0 max 16384 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stdout: "d7771f34-33b7-4453-9c7b-a97a6af37fad": { 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "d7771f34-33b7-4453-9c7b-a97a6af37fad", 2023-12-11T20:16:51.790 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:16:51.791 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:16:51.791 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:16:51.791 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:16:51.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 -- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea140a1480 msgr2=0x7fea140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea140a1480 0x7fea140a3940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea200060b0 tx=0x7fea200077e0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 -- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281014b0 msgr2=0x7fea28197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:16:51.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281014b0 0x7fea28197370 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fea1800e970 tx=0x7fea1800ec80 comp rx=0 tx=0).stop 2023-12-11T20:16:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 -- 172.21.15.12:0/1854405060 shutdown_connections 2023-12-11T20:16:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea140a1480 0x7fea140a3940 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea28103040 0x7fea2819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea281014b0 0x7fea28197370 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 --2- 172.21.15.12:0/1854405060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea281026a0 0x7fea281978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:16:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 -- 172.21.15.12:0/1854405060 >> 172.21.15.12:0/1854405060 conn(0x7fea280fca00 msgr2=0x7fea28105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:16:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 -- 172.21.15.12:0/1854405060 shutdown_connections 2023-12-11T20:16:51.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:16:51.788+0000 7fea2ddff700 1 -- 172.21.15.12:0/1854405060 wait complete. 2023-12-11T20:16:51.806 INFO:tasks.cephfs.filesystem:scrub status for tag:d7771f34-33b7-4453-9c7b-a97a6af37fad - {'path': '/', 'tag': 'd7771f34-33b7-4453-9c7b-a97a6af37fad', 'options': 'recursive,force'} 2023-12-11T20:16:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:52 smithi032 ceph-mon[132488]: pgmap v403: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:52 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:16:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:52 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:52 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:16:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:52 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:52.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:52 smithi039 ceph-mon[102205]: pgmap v403: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:52.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:52 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:16:52.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:52 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:52.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:52 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:16:52.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:52 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:52 smithi012 ceph-mon[128787]: pgmap v403: 97 pgs: 97 active+clean; 660 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-11T20:16:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:52 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:16:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:52 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:52 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:16:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:52 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:16:53.225 INFO:tasks.workunit.client.0.smithi012.stderr:Updating files: 62% (7557/12157) Updating files: 63% (7659/12157) Updating files: 64% (7781/12157) Updating files: 65% (7903/12157) Updating files: 66% (8024/12157) Updating files: 67% (8146/12157) Updating files: 68% (8267/12157) Updating files: 69% (8389/12157) Updating files: 70% (8510/12157) Updating files: 71% (8632/12157) Updating files: 72% (8754/12157) Updating files: 73% (8875/12157) Updating files: 74% (8997/12157) Updating files: 75% (9118/12157) Updating files: 76% (9240/12157) Updating files: 77% (9361/12157) Updating files: 78% (9483/12157) Updating files: 79% (9605/12157) Updating files: 80% (9726/12157) Updating files: 81% (9848/12157) Updating files: 82% (9969/12157) Updating files: 83% (10091/12157) Updating files: 84% (10212/12157) Updating files: 85% (10334/12157) Updating files: 86% (10456/12157) Updating files: 87% (10577/12157) Updating files: 88% (10699/12157) Updating files: 89% (10820/12157) Updating files: 90% (10942/12157) Updating files: 91% (11063/12157) Updating files: 92% (11185/12157) Updating files: 93% (11307/12157) Updating files: 94% (11428/12157) Updating files: 95% (11550/12157) Updating files: 96% (11671/12157) Updating files: 97% (11793/12157) Updating files: 98% (11914/12157) Updating files: 99% (12036/12157) Updating files: 100% (12157/12157) Updating files: 100% (12157/12157), done. 2023-12-11T20:16:53.478 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to 'a62fda73efba5520d409bb5a21bd8373289dda5d'. 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-12-11T20:16:53.479 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2023-12-11T20:16:53.480 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-12-11T20:16:53.480 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-11T20:16:53.480 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-12-11T20:16:53.480 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at a62fda73efb Merge remote-tracking branch 'milind/mds-enqueue-all-child-frags-for-scrub-for-a-given-fragset' into rishabh-2023dec11 2023-12-11T20:16:53.486 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-11T20:16:53.551 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-11T20:16:53.557 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-11T20:16:53.557 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-11T20:16:54.122 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-11T20:16:54.204 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-11T20:16:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-11T20:16:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-11T20:16:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-11T20:16:54.339 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-11T20:16:54.346 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:16:54.346 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-11T20:16:54.390 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2023-12-11T20:16:54.391 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2023-12-11T20:16:54.391 DEBUG:teuthology.orchestra.run.smithi012:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a62fda73efba5520d409bb5a21bd8373289dda5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2023-12-11T20:16:54.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:54 smithi032 ceph-mon[132488]: pgmap v404: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-12-11T20:16:54.497 INFO:tasks.workunit.client.0.smithi012.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2023-12-11T20:16:54.499 INFO:tasks.workunit.client.0.smithi012.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2023-12-11T20:16:54.499 INFO:tasks.workunit.client.0.smithi012.stderr:+ trap -- retry EXIT 2023-12-11T20:16:54.499 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -rf ffsb 2023-12-11T20:16:54.502 INFO:tasks.workunit.client.0.smithi012.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2023-12-11T20:16:54.512 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into 'ffsb'... 2023-12-11T20:16:54.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:54 smithi039 ceph-mon[102205]: pgmap v404: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-12-11T20:16:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:54 smithi012 ceph-mon[128787]: pgmap v404: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-12-11T20:16:56.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:56 smithi032 ceph-mon[132488]: pgmap v405: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:56 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:16:56.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:56 smithi039 ceph-mon[102205]: pgmap v405: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:56 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:16:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:56 smithi012 ceph-mon[128787]: pgmap v405: 97 pgs: 97 active+clean; 661 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-11T20:16:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:56 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:16:57.150 INFO:tasks.workunit.client.0.smithi012.stderr:+ trap - EXIT 2023-12-11T20:16:57.150 INFO:tasks.workunit.client.0.smithi012.stderr:+ cd ffsb 2023-12-11T20:16:57.152 INFO:tasks.workunit.client.0.smithi012.stderr:+ ./configure 2023-12-11T20:16:57.460 INFO:tasks.workunit.client.0.smithi012.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-12-11T20:16:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:58 smithi032 ceph-mon[132488]: pgmap v406: 97 pgs: 97 active+clean; 2.1 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 129 KiB/s wr, 23 op/s 2023-12-11T20:16:58.479 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether build environment is sane... yes 2023-12-11T20:16:58.516 INFO:tasks.workunit.client.0.smithi012.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2023-12-11T20:16:58.518 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gawk... gawk 2023-12-11T20:16:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:58 smithi039 ceph-mon[102205]: pgmap v406: 97 pgs: 97 active+clean; 2.1 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 129 KiB/s wr, 23 op/s 2023-12-11T20:16:58.564 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether make sets $(MAKE)... yes 2023-12-11T20:16:58.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:58 smithi012 ceph-mon[128787]: pgmap v406: 97 pgs: 97 active+clean; 2.1 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 129 KiB/s wr, 23 op/s 2023-12-11T20:16:58.673 INFO:tasks.workunit.client.0.smithi012.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-12-11T20:16:58.674 INFO:tasks.workunit.client.0.smithi012.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-12-11T20:16:58.707 INFO:tasks.workunit.client.0.smithi012.stdout:checking for style of include used by make... GNU 2023-12-11T20:16:58.715 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc... gcc 2023-12-11T20:16:58.871 INFO:tasks.workunit.client.0.smithi012.stdout:checking for C compiler default output file name... a.out 2023-12-11T20:16:58.878 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether the C compiler works... yes 2023-12-11T20:16:58.884 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether we are cross compiling... no 2023-12-11T20:16:58.975 INFO:tasks.workunit.client.0.smithi012.stdout:checking for suffix of executables... 2023-12-11T20:16:59.059 INFO:tasks.workunit.client.0.smithi012.stdout:checking for suffix of object files... o 2023-12-11T20:16:59.142 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether we are using the GNU C compiler... yes 2023-12-11T20:16:59.226 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether gcc accepts -g... yes 2023-12-11T20:16:59.329 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-11T20:16:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:16:59 smithi012 ceph-mon[128787]: pgmap v407: 97 pgs: 97 active+clean; 2.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-12-11T20:16:59.585 INFO:tasks.workunit.client.0.smithi012.stdout:checking dependency style of gcc... gcc3 2023-12-11T20:16:59.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:16:59 smithi032 ceph-mon[132488]: pgmap v407: 97 pgs: 97 active+clean; 2.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-12-11T20:16:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:checking how to run the C preprocessor... gcc -E 2023-12-11T20:16:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:16:59 smithi039 ceph-mon[102205]: pgmap v407: 97 pgs: 97 active+clean; 2.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-12-11T20:16:59.834 INFO:tasks.workunit.client.0.smithi012.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-12-11T20:16:59.838 INFO:tasks.workunit.client.0.smithi012.stdout:checking for egrep... /usr/bin/grep -E 2023-12-11T20:16:59.864 INFO:tasks.workunit.client.0.smithi012.stdout:checking for AIX... no 2023-12-11T20:16:59.897 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc... (cached) gcc 2023-12-11T20:16:59.927 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-11T20:16:59.929 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-11T20:16:59.930 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-11T20:16:59.931 INFO:tasks.workunit.client.0.smithi012.stdout:checking dependency style of gcc... (cached) gcc3 2023-12-11T20:17:00.075 INFO:tasks.workunit.client.0.smithi012.stdout:checking for main in -lm... yes 2023-12-11T20:17:00.206 INFO:tasks.workunit.client.0.smithi012.stdout:checking for main in -lpthread... yes 2023-12-11T20:17:00.550 INFO:tasks.workunit.client.0.smithi012.stdout:checking for ANSI C header files... yes 2023-12-11T20:17:00.653 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2023-12-11T20:17:00.766 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/types.h... yes 2023-12-11T20:17:00.891 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/stat.h... yes 2023-12-11T20:17:01.008 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdlib.h... yes 2023-12-11T20:17:01.242 INFO:tasks.workunit.client.0.smithi012.stdout:checking for string.h... yes 2023-12-11T20:17:01.361 INFO:tasks.workunit.client.0.smithi012.stdout:checking for memory.h... yes 2023-12-11T20:17:01.485 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strings.h... yes 2023-12-11T20:17:01.614 INFO:tasks.workunit.client.0.smithi012.stdout:checking for inttypes.h... yes 2023-12-11T20:17:01.736 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdint.h... yes 2023-12-11T20:17:01.875 INFO:tasks.workunit.client.0.smithi012.stdout:checking for unistd.h... yes 2023-12-11T20:17:02.033 INFO:tasks.workunit.client.0.smithi012.stdout:checking pthread.h usability... yes 2023-12-11T20:17:02.086 INFO:tasks.workunit.client.0.smithi012.stdout:checking pthread.h presence... yes 2023-12-11T20:17:02.087 INFO:tasks.workunit.client.0.smithi012.stdout:checking for pthread.h... yes 2023-12-11T20:17:02.215 INFO:tasks.workunit.client.0.smithi012.stdout:checking fcntl.h usability... yes 2023-12-11T20:17:02.265 INFO:tasks.workunit.client.0.smithi012.stdout:checking fcntl.h presence... yes 2023-12-11T20:17:02.267 INFO:tasks.workunit.client.0.smithi012.stdout:checking for fcntl.h... yes 2023-12-11T20:17:02.398 INFO:tasks.workunit.client.0.smithi012.stdout:checking limits.h usability... yes 2023-12-11T20:17:02.449 INFO:tasks.workunit.client.0.smithi012.stdout:checking limits.h presence... yes 2023-12-11T20:17:02.451 INFO:tasks.workunit.client.0.smithi012.stdout:checking for limits.h... yes 2023-12-11T20:17:02.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:02 smithi032 ceph-mon[132488]: pgmap v408: 97 pgs: 97 active+clean; 2.6 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 185 KiB/s wr, 37 op/s 2023-12-11T20:17:02.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:02 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:17:02.489 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdint.h... (cached) yes 2023-12-11T20:17:02.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:02 smithi039 ceph-mon[102205]: pgmap v408: 97 pgs: 97 active+clean; 2.6 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 185 KiB/s wr, 37 op/s 2023-12-11T20:17:02.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:02 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:17:02.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:02 smithi012 ceph-mon[128787]: pgmap v408: 97 pgs: 97 active+clean; 2.6 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 185 KiB/s wr, 37 op/s 2023-12-11T20:17:02.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:02 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:17:02.615 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/time.h usability... yes 2023-12-11T20:17:02.666 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/time.h presence... yes 2023-12-11T20:17:02.668 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/time.h... yes 2023-12-11T20:17:02.706 INFO:tasks.workunit.client.0.smithi012.stdout:checking for unistd.h... (cached) yes 2023-12-11T20:17:02.838 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/vfs.h usability... yes 2023-12-11T20:17:02.889 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/vfs.h presence... yes 2023-12-11T20:17:02.890 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/vfs.h... yes 2023-12-11T20:17:03.017 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/limits.h usability... no 2023-12-11T20:17:03.074 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/limits.h presence... no 2023-12-11T20:17:03.076 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/limits.h... no 2023-12-11T20:17:03.163 INFO:tasks.workunit.client.0.smithi012.stdout:checking for an ANSI C-conforming const... yes 2023-12-11T20:17:03.251 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether time.h and sys/time.h may both be included... yes 2023-12-11T20:17:03.256 INFO:tasks.workunit.client.0.smithi012.stdout:checking for function prototypes... yes 2023-12-11T20:17:03.338 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether setvbuf arguments are reversed... no 2023-12-11T20:17:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 -- 172.21.15.12:0/2276071484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33241071a0 msgr2=0x7f3324109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 --2- 172.21.15.12:0/2276071484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33241071a0 0x7f3324109610 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f331c00b0a0 tx=0x7f331c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 -- 172.21.15.12:0/2276071484 shutdown_connections 2023-12-11T20:17:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 --2- 172.21.15.12:0/2276071484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3324101f40 0x7f3324104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 --2- 172.21.15.12:0/2276071484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33241071a0 0x7f3324109610 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 --2- 172.21.15.12:0/2276071484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3324104870 0x7f3324106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 -- 172.21.15.12:0/2276071484 >> 172.21.15.12:0/2276071484 conn(0x7f33240fb930 msgr2=0x7f33240fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 -- 172.21.15.12:0/2276071484 shutdown_connections 2023-12-11T20:17:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.490+0000 7f332b7ff700 1 -- 172.21.15.12:0/2276071484 wait complete. 2023-12-11T20:17:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.491+0000 7f332b7ff700 1 Processor -- start 2023-12-11T20:17:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.491+0000 7f332b7ff700 1 -- start start 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.491+0000 7f332b7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3324101f40 0x7f3324199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.491+0000 7f332b7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3324104870 0x7f3324199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.491+0000 7f332b7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33241071a0 0x7f33241a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.491+0000 7f332b7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33241a1160 con 0x7f3324101f40 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.491+0000 7f332b7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33241a12a0 con 0x7f33241071a0 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.491+0000 7f332b7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33241a1430 con 0x7f3324104870 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3324101f40 0x7f3324199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3324101f40 0x7f3324199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54966/0 (socket says 172.21.15.12:54966) 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 -- 172.21.15.12:0/3736474348 learned_addr learned my addr 172.21.15.12:0/3736474348 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f3329d9c700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33241071a0 0x7f33241a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f3328d9a700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3324104870 0x7f3324199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 -- 172.21.15.12:0/3736474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3324104870 msgr2=0x7f3324199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3324104870 0x7f3324199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 -- 172.21.15.12:0/3736474348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33241071a0 msgr2=0x7f33241a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33241071a0 0x7f33241a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 -- 172.21.15.12:0/3736474348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320009520 con 0x7f3324101f40 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f3328d9a700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3324104870 0x7f3324199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.492+0000 7f332959b700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3324101f40 0x7f3324199630 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f332000eb30 tx=0x7f332000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.493+0000 7f331a7fc700 1 -- 172.21.15.12:0/3736474348 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320009880 con 0x7f3324101f40 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.493+0000 7f331a7fc700 1 -- 172.21.15.12:0/3736474348 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33200044b0 con 0x7f3324101f40 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.493+0000 7f332b7ff700 1 -- 172.21.15.12:0/3736474348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c009d00 con 0x7f3324101f40 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.493+0000 7f331a7fc700 1 -- 172.21.15.12:0/3736474348 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320003e40 con 0x7f3324101f40 2023-12-11T20:17:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.493+0000 7f332b7ff700 1 -- 172.21.15.12:0/3736474348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33241a1ae0 con 0x7f3324101f40 2023-12-11T20:17:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.496+0000 7f331a7fc700 1 -- 172.21.15.12:0/3736474348 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3320003fa0 con 0x7f3324101f40 2023-12-11T20:17:03.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.498+0000 7f333f1f5b80 1 Processor -- start 2023-12-11T20:17:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.498+0000 7f333f1f5b80 1 -- start start 2023-12-11T20:17:03.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b4ed0 0x55895f5b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b6720 0x55895f5b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f510af0 con 0x55895f5b5830 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f50e410 con 0x55895f5b6720 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f509d00 con 0x55895f5b4ed0 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f332959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f331a7fc700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33100a14f0 0x7f33100a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3328d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b6720 0x55895f5b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3328d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b6720 0x55895f5b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38710/0 (socket says 172.21.15.12:38710) 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3328d9a700 1 -- 172.21.15.12:0/1226671123 learned_addr learned my addr 172.21.15.12:0/1226671123 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3329d9c700 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b4ed0 0x55895f5b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f331a7fc700 1 -- 172.21.15.12:0/3736474348 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3320014070 con 0x7f3324101f40 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3329d9c700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33100a14f0 0x7f33100a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3328d9a700 1 -- 172.21.15.12:0/1226671123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b4ed0 msgr2=0x55895f5b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3328d9a700 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b4ed0 0x55895f5b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3328d9a700 1 -- 172.21.15.12:0/1226671123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 msgr2=0x55895f5b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3328d9a700 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f3328d9a700 1 -- 172.21.15.12:0/1226671123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55895f3865d0 con 0x55895f5b6720 2023-12-11T20:17:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.499+0000 7f332959b700 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.500+0000 7f3328d9a700 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b6720 0x55895f5b6ba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3314009cd0 tx=0x7f331400e2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a42d01927cd32171 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:03.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.500+0000 7f330f7fe700 1 -- 172.21.15.12:0/1226671123 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331400ec20 con 0x55895f5b6720 2023-12-11T20:17:03.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.500+0000 7f3329d9c700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33100a14f0 0x7f33100a39b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f331c009fd0 tx=0x7f331c00b700 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:03.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.500+0000 7f330f7fe700 1 -- 172.21.15.12:0/1226671123 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f331400ed80 con 0x55895f5b6720 2023-12-11T20:17:03.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.500+0000 7f330f7fe700 1 -- 172.21.15.12:0/1226671123 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33140056d0 con 0x55895f5b6720 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1226671123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b6720 msgr2=0x55895f5b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b6720 0x55895f5b6ba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3314009cd0 tx=0x7f331400e2f0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1226671123 shutdown_connections 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b6720 0x55895f5b6ba0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b4ed0 0x55895f5b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/1226671123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1226671123 >> 172.21.15.12:0/1226671123 conn(0x55895f4e4780 msgr2=0x55895f5b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1226671123 shutdown_connections 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.501+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1226671123 wait complete. 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 1 -- start start 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 1 Processor -- start 2023-12-11T20:17:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b4ed0 0x55895f5bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b5830 0x55895f5bf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 0x55895f5c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f4c3500 con 0x55895f5b4ed0 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f4c31a0 con 0x55895f5b5830 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f3888c0 con 0x55895f5b6720 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.502+0000 7f333f1f5b80 10 client.0 _ll_register_callbacks cb 0x55895f3eea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b4ed0 0x55895f5bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b4ed0 0x55895f5bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54974/0 (socket says 172.21.15.12:54974) 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 -- 172.21.15.12:0/3314176574 learned_addr learned my addr 172.21.15.12:0/3314176574 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f3328d9a700 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b5830 0x55895f5bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f3329d9c700 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 0x55895f5c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 -- 172.21.15.12:0/3314176574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 msgr2=0x55895f5c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 0x55895f5c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 -- 172.21.15.12:0/3314176574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b5830 msgr2=0x55895f5bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b5830 0x55895f5bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 -- 172.21.15.12:0/3314176574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3314009900 con 0x55895f5b4ed0 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f3329d9c700 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 0x55895f5c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f332959b700 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b4ed0 0x55895f5bee20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f33200cac00 tx=0x7f332009ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d4d0c86e5bfbef server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f330cff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.503+0000 7f330cff9700 1 -- 172.21.15.12:0/3314176574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000cd40 con 0x55895f5b4ed0 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f330cff9700 1 -- 172.21.15.12:0/3314176574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f332009e570 con 0x55895f5b4ed0 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3314176574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55895f5a8730 con 0x55895f5b4ed0 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f330cff9700 1 -- 172.21.15.12:0/3314176574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33200a27b0 con 0x55895f5b4ed0 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 10 client.15816 fetch_fsmap learned FSMap version 23 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3314176574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55895f332d80 con 0x55895f5b4ed0 2023-12-11T20:17:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f330cff9700 1 -- 172.21.15.12:0/3314176574 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3320080020 con 0x55895f5b4ed0 2023-12-11T20:17:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f330cff9700 1 -- 172.21.15.12:0/3314176574 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 23) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f332009a680 con 0x55895f5b4ed0 2023-12-11T20:17:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 10 client.15816 fetch_fsmap finished waiting for FSMap version 23 2023-12-11T20:17:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 20 client.15816 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55895f5cac20 0x55895f5cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 4 client.15816 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.504+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3314176574 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55895f584ee0 con 0x55895f5cac20 2023-12-11T20:17:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.505+0000 7f3328d9a700 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55895f5cac20 0x55895f5cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.505+0000 7f3328d9a700 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55895f5cac20 0x55895f5cd040 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9fd099ebf14f786 server_cookie=911a0b6845602617 in_seq=0 out_seq=0 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.505+0000 7f330cff9700 10 client.15816 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f330cff9700 1 -- 172.21.15.12:0/3314176574 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55895f584ee0 con 0x55895f5cac20 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f330cff9700 10 client.15816 handle_command_reply: tid=0 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 client.15816 shutdown 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3314176574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b4ed0 msgr2=0x55895f5bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b4ed0 0x55895f5bee20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f33200cac00 tx=0x7f332009ab20 comp rx=0 tx=0).stop 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3314176574 shutdown_connections 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55895f5cac20 0x55895f5cd040 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 0x55895f5c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b4ed0 0x55895f5bee20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3314176574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b5830 0x55895f5bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f330cff9700 0 client.15816 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.506+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3314176574 >> 172.21.15.12:0/3314176574 conn(0x55895f4e4780 msgr2=0x55895f5afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.507+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3314176574 shutdown_connections 2023-12-11T20:17:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.507+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3314176574 wait complete. 2023-12-11T20:17:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.507+0000 7f333f1f5b80 20 client.15816 trim_cache size 0 max 16384 2023-12-11T20:17:03.517 INFO:tasks.workunit.client.0.smithi012.stdout:checking for system... yes 2023-12-11T20:17:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.526+0000 7f333f1f5b80 1 Processor -- start 2023-12-11T20:17:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.526+0000 7f333f1f5b80 1 -- start start 2023-12-11T20:17:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b5830 0x55895f5c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b6720 0x55895f5be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f5ba1b0 con 0x55895f5b6720 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f5a84c0 con 0x55895f5b4ed0 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f5af9f0 con 0x55895f5b5830 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f3329d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b6720 0x55895f5be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f332959b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f332959b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38720/0 (socket says 172.21.15.12:38720) 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f332959b700 1 -- 172.21.15.12:0/1973142822 learned_addr learned my addr 172.21.15.12:0/1973142822 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f3328d9a700 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b5830 0x55895f5c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f332959b700 1 -- 172.21.15.12:0/1973142822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b5830 msgr2=0x55895f5c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f332959b700 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b5830 0x55895f5c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f332959b700 1 -- 172.21.15.12:0/1973142822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b6720 msgr2=0x55895f5be120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f332959b700 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b6720 0x55895f5be120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f332959b700 1 -- 172.21.15.12:0/1973142822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55895f31bc00 con 0x55895f5b4ed0 2023-12-11T20:17:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.527+0000 7f3329d9c700 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b6720 0x55895f5be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.528+0000 7f332959b700 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5b52b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3320096e90 tx=0x7f33200cd230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733535f80801401b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.528+0000 7f330ffff700 1 -- 172.21.15.12:0/1973142822 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000cd40 con 0x55895f5b4ed0 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.528+0000 7f330ffff700 1 -- 172.21.15.12:0/1973142822 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3320080070 con 0x55895f5b4ed0 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.528+0000 7f330ffff700 1 -- 172.21.15.12:0/1973142822 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200cac80 con 0x55895f5b4ed0 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1973142822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 msgr2=0x55895f5b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5b52b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3320096e90 tx=0x7f33200cd230 comp rx=0 tx=0).stop 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1973142822 shutdown_connections 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5b52b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b6720 0x55895f5be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/1973142822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b5830 0x55895f5c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1973142822 >> 172.21.15.12:0/1973142822 conn(0x55895f4e4780 msgr2=0x55895f5b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1973142822 shutdown_connections 2023-12-11T20:17:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 -- 172.21.15.12:0/1973142822 wait complete. 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 -- start start 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.529+0000 7f333f1f5b80 1 Processor -- start 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f333f1f5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 0x55895f5c5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f5c5550 con 0x55895f5b5830 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f5c56c0 con 0x55895f5b4ed0 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f333f1f5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55895f5c5880 con 0x55895f5b6720 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f333f1f5b80 10 client.0 _ll_register_callbacks cb 0x55895f3eea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f3328d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f332959b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f3328d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54990/0 (socket says 172.21.15.12:54990) 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.530+0000 7f3328d9a700 1 -- 172.21.15.12:0/3193976336 learned_addr learned my addr 172.21.15.12:0/3193976336 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f3328d9a700 1 -- 172.21.15.12:0/3193976336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 msgr2=0x55895f5c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f3328d9a700 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 0x55895f5c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f3328d9a700 1 -- 172.21.15.12:0/3193976336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 msgr2=0x55895f5c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f3328d9a700 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f3328d9a700 1 -- 172.21.15.12:0/3193976336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332410a200 con 0x55895f5b5830 2023-12-11T20:17:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f332959b700 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f3328d9a700 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5c41b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3314009cd0 tx=0x7f33140095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8ca9006f26dbe1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f330cff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f330cff9700 1 -- 172.21.15.12:0/3193976336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314021070 con 0x55895f5b5830 2023-12-11T20:17:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f330cff9700 1 -- 172.21.15.12:0/3193976336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3314029810 con 0x55895f5b5830 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.531+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3193976336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f331400ed80 con 0x55895f5b5830 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f330cff9700 1 -- 172.21.15.12:0/3193976336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3314004020 con 0x55895f5b5830 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f333f1f5b80 10 client.15822 fetch_fsmap learned FSMap version 23 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3193976336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55895f332d80 con 0x55895f5b5830 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f330cff9700 1 -- 172.21.15.12:0/3193976336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f331400ed80 con 0x55895f5b5830 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f330cff9700 1 -- 172.21.15.12:0/3193976336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 23) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f331400c070 con 0x55895f5b5830 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f333f1f5b80 10 client.15822 fetch_fsmap finished waiting for FSMap version 23 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f333f1f5b80 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f333f1f5b80 20 client.15822 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55895f621d30 0x55895f624150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f333f1f5b80 4 client.15822 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:17:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.532+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3193976336 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55895f4cff70 con 0x55895f621d30 2023-12-11T20:17:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.533+0000 7f332959b700 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55895f621d30 0x55895f624150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.533+0000 7f332959b700 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55895f621d30 0x55895f624150 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4a24be583c3cb70 server_cookie=9697fe464f0ff9e5 in_seq=0 out_seq=0 2023-12-11T20:17:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.533+0000 7f330cff9700 10 client.15822 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f330cff9700 1 -- 172.21.15.12:0/3193976336 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55895f4cff70 con 0x55895f621d30 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f330cff9700 10 client.15822 handle_command_reply: tid=0 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 client.15822 shutdown 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3193976336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 msgr2=0x55895f5c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5c41b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3314009cd0 tx=0x7f33140095c0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3193976336 shutdown_connections 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55895f621d30 0x55895f624150 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55895f5b4ed0 0x55895f5c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55895f5b6720 0x55895f5c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 --2- 172.21.15.12:0/3193976336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55895f5b5830 0x55895f5c41b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3193976336 >> 172.21.15.12:0/3193976336 conn(0x55895f4e4780 msgr2=0x55895f5b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.621+0000 7f330cff9700 0 client.15822 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3193976336 shutdown_connections 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f333f1f5b80 1 -- 172.21.15.12:0/3193976336 wait complete. 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f333f1f5b80 20 client.15822 trim_cache size 0 max 16384 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:17:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:17:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 -- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33100a14f0 msgr2=0x7f33100a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33100a14f0 0x7f33100a39b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f331c009fd0 tx=0x7f331c00b700 comp rx=0 tx=0).stop 2023-12-11T20:17:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 -- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3324101f40 msgr2=0x7f3324199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3324101f40 0x7f3324199630 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f332000eb30 tx=0x7f332000eef0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 -- 172.21.15.12:0/3736474348 shutdown_connections 2023-12-11T20:17:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f33100a14f0 0x7f33100a39b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33241071a0 0x7f33241a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3324101f40 0x7f3324199630 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 --2- 172.21.15.12:0/3736474348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3324104870 0x7f3324199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.622+0000 7f332b7ff700 1 -- 172.21.15.12:0/3736474348 >> 172.21.15.12:0/3736474348 conn(0x7f33240fb930 msgr2=0x7f3324101740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.623+0000 7f332b7ff700 1 -- 172.21.15.12:0/3736474348 shutdown_connections 2023-12-11T20:17:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:03.623+0000 7f332b7ff700 1 -- 172.21.15.12:0/3736474348 wait complete. 2023-12-11T20:17:03.730 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gettimeofday... yes 2023-12-11T20:17:03.888 INFO:tasks.workunit.client.0.smithi012.stdout:checking for mkdir... yes 2023-12-11T20:17:04.046 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strerror... yes 2023-12-11T20:17:04.206 INFO:tasks.workunit.client.0.smithi012.stdout:checking for open64... yes 2023-12-11T20:17:04.372 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stat64... yes 2023-12-11T20:17:04.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:04 smithi032 ceph-mon[132488]: pgmap v409: 97 pgs: 97 active+clean; 4.1 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 325 KiB/s wr, 58 op/s 2023-12-11T20:17:04.532 INFO:tasks.workunit.client.0.smithi012.stdout:checking for fseeko64... yes 2023-12-11T20:17:04.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:04 smithi039 ceph-mon[102205]: pgmap v409: 97 pgs: 97 active+clean; 4.1 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 325 KiB/s wr, 58 op/s 2023-12-11T20:17:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:04 smithi012 ceph-mon[128787]: pgmap v409: 97 pgs: 97 active+clean; 4.1 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 325 KiB/s wr, 58 op/s 2023-12-11T20:17:04.703 INFO:tasks.workunit.client.0.smithi012.stdout:checking for lrand48_r... yes 2023-12-11T20:17:04.860 INFO:tasks.workunit.client.0.smithi012.stdout:checking for srand48_r... yes 2023-12-11T20:17:04.916 INFO:tasks.workunit.client.0.smithi012.stdout:configure: creating ./config.status 2023-12-11T20:17:05.216 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating Makefile 2023-12-11T20:17:05.257 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating config.h 2023-12-11T20:17:05.313 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: executing depfiles commands 2023-12-11T20:17:05.469 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: executing default commands 2023-12-11T20:17:05.572 INFO:tasks.workunit.client.0.smithi012.stderr:+ make 2023-12-11T20:17:05.633 INFO:tasks.workunit.client.0.smithi012.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2023-12-11T20:17:05.649 INFO:tasks.workunit.client.0.smithi012.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2023-12-11T20:17:05.652 INFO:tasks.workunit.client.0.smithi012.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2023-12-11T20:17:05.652 INFO:tasks.workunit.client.0.smithi012.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2023-12-11T20:17:05.652 INFO:tasks.workunit.client.0.smithi012.stderr: to install the `Automake' and `Perl' packages. Grab them from 2023-12-11T20:17:05.652 INFO:tasks.workunit.client.0.smithi012.stderr: any GNU archive site. 2023-12-11T20:17:05.663 INFO:tasks.workunit.client.0.smithi012.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2023-12-11T20:17:05.674 INFO:tasks.workunit.client.0.smithi012.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2023-12-11T20:17:05.677 INFO:tasks.workunit.client.0.smithi012.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2023-12-11T20:17:05.677 INFO:tasks.workunit.client.0.smithi012.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2023-12-11T20:17:05.677 INFO:tasks.workunit.client.0.smithi012.stderr: You might want to install the `Automake' and `Perl' packages. 2023-12-11T20:17:05.677 INFO:tasks.workunit.client.0.smithi012.stderr: Grab them from any GNU archive site. 2023-12-11T20:17:06.062 INFO:tasks.workunit.client.0.smithi012.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2023-12-11T20:17:06.442 INFO:tasks.workunit.client.0.smithi012.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2023-12-11T20:17:06.442 INFO:tasks.workunit.client.0.smithi012.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2023-12-11T20:17:06.442 INFO:tasks.workunit.client.0.smithi012.stderr:If you have problems, you may need to regenerate the build system entirely. 2023-12-11T20:17:06.442 INFO:tasks.workunit.client.0.smithi012.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2023-12-11T20:17:06.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:06 smithi032 ceph-mon[132488]: pgmap v410: 97 pgs: 97 active+clean; 4.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 356 KiB/s wr, 83 op/s 2023-12-11T20:17:06.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:06 smithi039 ceph-mon[102205]: pgmap v410: 97 pgs: 97 active+clean; 4.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 356 KiB/s wr, 83 op/s 2023-12-11T20:17:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:06 smithi012 ceph-mon[128787]: pgmap v410: 97 pgs: 97 active+clean; 4.3 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 356 KiB/s wr, 83 op/s 2023-12-11T20:17:06.667 INFO:tasks.workunit.client.0.smithi012.stdout:/bin/sh ./config.status --recheck 2023-12-11T20:17:06.829 INFO:tasks.workunit.client.0.smithi012.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2023-12-11T20:17:07.148 INFO:tasks.workunit.client.0.smithi012.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-12-11T20:17:07.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:07 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:17:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:17:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:07 smithi032 ceph-mon[132488]: pgmap v411: 97 pgs: 97 active+clean; 5.8 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 530 KiB/s wr, 151 op/s 2023-12-11T20:17:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:07 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:07 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:17:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:17:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:07 smithi039 ceph-mon[102205]: pgmap v411: 97 pgs: 97 active+clean; 5.8 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 530 KiB/s wr, 151 op/s 2023-12-11T20:17:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:07 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:07 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:17:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:17:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:07 smithi012 ceph-mon[128787]: pgmap v411: 97 pgs: 97 active+clean; 5.8 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 530 KiB/s wr, 151 op/s 2023-12-11T20:17:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:07 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:08.165 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether build environment is sane... yes 2023-12-11T20:17:08.187 INFO:tasks.workunit.client.0.smithi012.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2023-12-11T20:17:08.188 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gawk... gawk 2023-12-11T20:17:08.223 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether make sets $(MAKE)... yes 2023-12-11T20:17:08.327 INFO:tasks.workunit.client.0.smithi012.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-12-11T20:17:08.328 INFO:tasks.workunit.client.0.smithi012.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-12-11T20:17:08.358 INFO:tasks.workunit.client.0.smithi012.stdout:checking for style of include used by make... GNU 2023-12-11T20:17:08.366 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc... gcc 2023-12-11T20:17:08.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:17:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:17:08.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:08.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:17:08.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:17:08.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:08.576 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether the C compiler works... yes 2023-12-11T20:17:08.576 INFO:tasks.workunit.client.0.smithi012.stdout:checking for C compiler default output file name... a.out 2023-12-11T20:17:08.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:17:08.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:17:08.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:17:08.673 INFO:tasks.workunit.client.0.smithi012.stdout:checking for suffix of executables... 2023-12-11T20:17:08.770 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether we are cross compiling... no 2023-12-11T20:17:08.853 INFO:tasks.workunit.client.0.smithi012.stdout:checking for suffix of object files... o 2023-12-11T20:17:08.915 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether we are using the GNU C compiler... yes 2023-12-11T20:17:08.976 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether gcc accepts -g... yes 2023-12-11T20:17:09.051 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-11T20:17:09.311 INFO:tasks.workunit.client.0.smithi012.stdout:checking dependency style of gcc... gcc3 2023-12-11T20:17:09.412 INFO:tasks.workunit.client.0.smithi012.stdout:checking how to run the C preprocessor... gcc -E 2023-12-11T20:17:09.516 INFO:tasks.workunit.client.0.smithi012.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-12-11T20:17:09.519 INFO:tasks.workunit.client.0.smithi012.stdout:checking for egrep... /usr/bin/grep -E 2023-12-11T20:17:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:09 smithi012 ceph-mon[128787]: pgmap v412: 97 pgs: 97 active+clean; 6.6 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 497 KiB/s wr, 157 op/s 2023-12-11T20:17:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:09 smithi032 ceph-mon[132488]: pgmap v412: 97 pgs: 97 active+clean; 6.6 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 497 KiB/s wr, 157 op/s 2023-12-11T20:17:09.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:09 smithi039 ceph-mon[102205]: pgmap v412: 97 pgs: 97 active+clean; 6.6 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 497 KiB/s wr, 157 op/s 2023-12-11T20:17:09.803 INFO:tasks.workunit.client.0.smithi012.stdout:checking for ANSI C header files... yes 2023-12-11T20:17:09.891 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/types.h... yes 2023-12-11T20:17:09.988 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/stat.h... yes 2023-12-11T20:17:10.086 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdlib.h... yes 2023-12-11T20:17:10.184 INFO:tasks.workunit.client.0.smithi012.stdout:checking for string.h... yes 2023-12-11T20:17:10.282 INFO:tasks.workunit.client.0.smithi012.stdout:checking for memory.h... yes 2023-12-11T20:17:10.381 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strings.h... yes 2023-12-11T20:17:10.482 INFO:tasks.workunit.client.0.smithi012.stdout:checking for inttypes.h... yes 2023-12-11T20:17:10.579 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdint.h... yes 2023-12-11T20:17:10.680 INFO:tasks.workunit.client.0.smithi012.stdout:checking for unistd.h... yes 2023-12-11T20:17:10.782 INFO:tasks.workunit.client.0.smithi012.stdout:checking minix/config.h usability... no 2023-12-11T20:17:10.847 INFO:tasks.workunit.client.0.smithi012.stdout:checking minix/config.h presence... no 2023-12-11T20:17:10.847 INFO:tasks.workunit.client.0.smithi012.stdout:checking for minix/config.h... no 2023-12-11T20:17:10.924 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2023-12-11T20:17:10.931 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc... (cached) gcc 2023-12-11T20:17:11.021 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-11T20:17:11.022 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-11T20:17:11.022 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-11T20:17:11.023 INFO:tasks.workunit.client.0.smithi012.stdout:checking dependency style of gcc... (cached) gcc3 2023-12-11T20:17:11.134 INFO:tasks.workunit.client.0.smithi012.stdout:checking for main in -lm... yes 2023-12-11T20:17:11.249 INFO:tasks.workunit.client.0.smithi012.stdout:checking for main in -lpthread... yes 2023-12-11T20:17:11.254 INFO:tasks.workunit.client.0.smithi012.stdout:checking for ANSI C header files... (cached) yes 2023-12-11T20:17:11.326 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2023-12-11T20:17:11.426 INFO:tasks.workunit.client.0.smithi012.stdout:checking pthread.h usability... yes 2023-12-11T20:17:11.470 INFO:tasks.workunit.client.0.smithi012.stdout:checking pthread.h presence... yes 2023-12-11T20:17:11.471 INFO:tasks.workunit.client.0.smithi012.stdout:checking for pthread.h... yes 2023-12-11T20:17:11.648 INFO:tasks.workunit.client.0.smithi012.stdout:checking fcntl.h usability... yes 2023-12-11T20:17:11.684 INFO:tasks.workunit.client.0.smithi012.stdout:checking fcntl.h presence... yes 2023-12-11T20:17:11.684 INFO:tasks.workunit.client.0.smithi012.stdout:checking for fcntl.h... yes 2023-12-11T20:17:11.815 INFO:tasks.workunit.client.0.smithi012.stdout:checking limits.h usability... yes 2023-12-11T20:17:11.851 INFO:tasks.workunit.client.0.smithi012.stdout:checking limits.h presence... yes 2023-12-11T20:17:11.851 INFO:tasks.workunit.client.0.smithi012.stdout:checking for limits.h... yes 2023-12-11T20:17:11.886 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdint.h... (cached) yes 2023-12-11T20:17:11.983 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/time.h usability... yes 2023-12-11T20:17:12.022 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/time.h presence... yes 2023-12-11T20:17:12.022 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/time.h... yes 2023-12-11T20:17:12.056 INFO:tasks.workunit.client.0.smithi012.stdout:checking for unistd.h... (cached) yes 2023-12-11T20:17:12.154 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/vfs.h usability... yes 2023-12-11T20:17:12.189 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/vfs.h presence... yes 2023-12-11T20:17:12.190 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/vfs.h... yes 2023-12-11T20:17:12.312 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/limits.h usability... no 2023-12-11T20:17:12.377 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/limits.h presence... no 2023-12-11T20:17:12.378 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/limits.h... no 2023-12-11T20:17:12.441 INFO:tasks.workunit.client.0.smithi012.stdout:checking for an ANSI C-conforming const... yes 2023-12-11T20:17:12.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:12 smithi032 ceph-mon[132488]: pgmap v413: 97 pgs: 97 active+clean; 6.6 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 485 KiB/s wr, 160 op/s 2023-12-11T20:17:12.509 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether time.h and sys/time.h may both be included... yes 2023-12-11T20:17:12.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:12 smithi039 ceph-mon[102205]: pgmap v413: 97 pgs: 97 active+clean; 6.6 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 485 KiB/s wr, 160 op/s 2023-12-11T20:17:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:12 smithi012 ceph-mon[128787]: pgmap v413: 97 pgs: 97 active+clean; 6.6 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 485 KiB/s wr, 160 op/s 2023-12-11T20:17:12.653 INFO:tasks.workunit.client.0.smithi012.stdout:checking for system... yes 2023-12-11T20:17:12.793 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gettimeofday... yes 2023-12-11T20:17:12.933 INFO:tasks.workunit.client.0.smithi012.stdout:checking for mkdir... yes 2023-12-11T20:17:13.074 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strerror... yes 2023-12-11T20:17:13.216 INFO:tasks.workunit.client.0.smithi012.stdout:checking for open64... yes 2023-12-11T20:17:13.361 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stat64... yes 2023-12-11T20:17:13.504 INFO:tasks.workunit.client.0.smithi012.stdout:checking for fseeko64... yes 2023-12-11T20:17:13.651 INFO:tasks.workunit.client.0.smithi012.stdout:checking for lrand48_r... yes 2023-12-11T20:17:13.791 INFO:tasks.workunit.client.0.smithi012.stdout:checking for srand48_r... yes 2023-12-11T20:17:13.842 INFO:tasks.workunit.client.0.smithi012.stdout:configure: creating ./config.status 2023-12-11T20:17:14.041 INFO:tasks.workunit.client.0.smithi012.stdout: /bin/sh ./config.status 2023-12-11T20:17:14.175 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating Makefile 2023-12-11T20:17:14.211 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating config.h 2023-12-11T20:17:14.257 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: executing depfiles commands 2023-12-11T20:17:14.335 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: executing default commands 2023-12-11T20:17:14.416 INFO:tasks.workunit.client.0.smithi012.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2023-12-11T20:17:14.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:14 smithi032 ceph-mon[132488]: pgmap v414: 97 pgs: 97 active+clean; 6.7 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 463 KiB/s wr, 161 op/s 2023-12-11T20:17:14.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:14 smithi039 ceph-mon[102205]: pgmap v414: 97 pgs: 97 active+clean; 6.7 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 463 KiB/s wr, 161 op/s 2023-12-11T20:17:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:14 smithi012 ceph-mon[128787]: pgmap v414: 97 pgs: 97 active+clean; 6.7 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 463 KiB/s wr, 161 op/s 2023-12-11T20:17:14.687 INFO:tasks.workunit.client.0.smithi012.stdout:rm -f stamp-h1 2023-12-11T20:17:14.692 INFO:tasks.workunit.client.0.smithi012.stdout:touch config.h.in 2023-12-11T20:17:14.697 INFO:tasks.workunit.client.0.smithi012.stdout:cd . && /bin/sh ./config.status config.h 2023-12-11T20:17:14.814 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating config.h 2023-12-11T20:17:14.887 INFO:tasks.workunit.client.0.smithi012.stdout:make all-am 2023-12-11T20:17:14.938 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2023-12-11T20:17:14.938 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2023-12-11T20:17:15.181 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2023-12-11T20:17:15.199 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2023-12-11T20:17:15.338 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2023-12-11T20:17:15.356 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2023-12-11T20:17:15.541 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/main.Tpo .deps/main.Po 2023-12-11T20:17:15.559 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2023-12-11T20:17:15.746 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2023-12-11T20:17:15.765 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2023-12-11T20:17:15.956 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2023-12-11T20:17:15.975 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2023-12-11T20:17:16.104 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2023-12-11T20:17:16.124 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2023-12-11T20:17:16.220 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2023-12-11T20:17:16.239 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2023-12-11T20:17:16.349 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2023-12-11T20:17:16.367 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2023-12-11T20:17:16.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:16 smithi032 ceph-mon[132488]: pgmap v415: 97 pgs: 97 active+clean; 8.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 488 KiB/s wr, 160 op/s 2023-12-11T20:17:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:16 smithi039 ceph-mon[102205]: pgmap v415: 97 pgs: 97 active+clean; 8.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 488 KiB/s wr, 160 op/s 2023-12-11T20:17:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:16 smithi012 ceph-mon[128787]: pgmap v415: 97 pgs: 97 active+clean; 8.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 488 KiB/s wr, 160 op/s 2023-12-11T20:17:16.598 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2023-12-11T20:17:16.617 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2023-12-11T20:17:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 -- 172.21.15.12:0/2078536506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 msgr2=0x7fbcfc073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2078536506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 0x7fbcfc073a60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009990 tx=0x7fbcec009ca0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 -- 172.21.15.12:0/2078536506 shutdown_connections 2023-12-11T20:17:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2078536506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcfc10daa0 0x7fbcfc10fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2078536506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 0x7fbcfc073a60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2078536506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcfc074030 0x7fbcfc0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 -- 172.21.15.12:0/2078536506 >> 172.21.15.12:0/2078536506 conn(0x7fbcfc0fca60 msgr2=0x7fbcfc0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 -- 172.21.15.12:0/2078536506 shutdown_connections 2023-12-11T20:17:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.780+0000 7fbd00bff700 1 -- 172.21.15.12:0/2078536506 wait complete. 2023-12-11T20:17:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.781+0000 7fbd00bff700 1 Processor -- start 2023-12-11T20:17:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.781+0000 7fbd00bff700 1 -- start start 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbd00bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcfc074030 0x7fbcfc19d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbd00bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 0x7fbcfc19dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbd00bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcfc10daa0 0x7fbcfc1a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbd00bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1a5480 con 0x7fbcfc075610 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbd00bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1a55c0 con 0x7fbcfc10daa0 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbd00bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1a5750 con 0x7fbcfc074030 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbcf3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 0x7fbcfc19dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbcf3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 0x7fbcfc19dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39448/0 (socket says 172.21.15.12:39448) 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbcf3fff700 1 -- 172.21.15.12:0/2513531111 learned_addr learned my addr 172.21.15.12:0/2513531111 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcfc074030 0x7fbcfc19d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.782+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcfc10daa0 0x7fbcfc1a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf3fff700 1 -- 172.21.15.12:0/2513531111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcfc074030 msgr2=0x7fbcfc19d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcfc074030 0x7fbcfc19d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf3fff700 1 -- 172.21.15.12:0/2513531111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcfc10daa0 msgr2=0x7fbcfc1a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcfc10daa0 0x7fbcfc1a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf3fff700 1 -- 172.21.15.12:0/2513531111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec0095f0 con 0x7fbcfc075610 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcfc074030 0x7fbcfc19d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 0x7fbcfc19dee0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbce400d980 tx=0x7fbce400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf37fe700 1 -- 172.21.15.12:0/2513531111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4004020 con 0x7fbcfc075610 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf37fe700 1 -- 172.21.15.12:0/2513531111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbce400f690 con 0x7fbcfc075610 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbd00bff700 1 -- 172.21.15.12:0/2513531111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc1a5a30 con 0x7fbcfc075610 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbcf37fe700 1 -- 172.21.15.12:0/2513531111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40039e0 con 0x7fbcfc075610 2023-12-11T20:17:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.783+0000 7fbd00bff700 1 -- 172.21.15.12:0/2513531111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc1a5f90 con 0x7fbcfc075610 2023-12-11T20:17:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.788+0000 7fbcf37fe700 1 -- 172.21.15.12:0/2513531111 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fbce400f800 con 0x7fbcfc075610 2023-12-11T20:17:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.789+0000 7fbd14570b80 1 Processor -- start 2023-12-11T20:17:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.789+0000 7fbd14570b80 1 -- start start 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.789+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 0x55a8d69d42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.789+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69d5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.789+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.789+0000 7fbd14570b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d692faf0 con 0x55a8d69d5720 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.789+0000 7fbd14570b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d692d410 con 0x55a8d69d3ed0 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.789+0000 7fbd14570b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d6928d00 con 0x55a8d69d4830 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcf3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcf3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39454/0 (socket says 172.21.15.12:39454) 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcf3fff700 1 -- 172.21.15.12:0/1539499372 learned_addr learned my addr 172.21.15.12:0/1539499372 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 0x55a8d69d42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcfa59c700 1 -- 172.21.15.12:0/1539499372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 msgr2=0x55a8d69d42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 0x55a8d69d42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcfa59c700 1 -- 172.21.15.12:0/1539499372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 msgr2=0x55a8d69d5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcfa59c700 1 -- 172.21.15.12:0/1539499372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8d67a55d0 con 0x55a8d69d4830 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.790+0000 7fbcf37fe700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbce80a14f0 0x7fbce80a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.791+0000 7fbcf37fe700 1 -- 172.21.15.12:0/2513531111 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbce40cc910 con 0x7fbcfc075610 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.791+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69d5140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00b5c0 tx=0x7fbcec009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b0ca386c955b76c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.791+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbce80a14f0 0x7fbce80a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.791+0000 7fbcf0ff9700 1 -- 172.21.15.12:0/1539499372 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec01d070 con 0x55a8d69d4830 2023-12-11T20:17:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.791+0000 7fbcf0ff9700 1 -- 172.21.15.12:0/1539499372 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcec01e040 con 0x55a8d69d4830 2023-12-11T20:17:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.791+0000 7fbcf0ff9700 1 -- 172.21.15.12:0/1539499372 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec004840 con 0x55a8d69d4830 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 -- 172.21.15.12:0/1539499372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 msgr2=0x55a8d69d5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69d5140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00b5c0 tx=0x7fbcec009ee0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbce80a14f0 0x7fbce80a39b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40099d0 tx=0x7fbcf4009100 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 -- 172.21.15.12:0/1539499372 shutdown_connections 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 0x55a8d69d42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 --2- 172.21.15.12:0/1539499372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69d5140 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 -- 172.21.15.12:0/1539499372 >> 172.21.15.12:0/1539499372 conn(0x55a8d6903780 msgr2=0x55a8d69d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 -- 172.21.15.12:0/1539499372 shutdown_connections 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 -- 172.21.15.12:0/1539499372 wait complete. 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.792+0000 7fbd14570b80 1 -- start start 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.793+0000 7fbd14570b80 1 Processor -- start 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.793+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d69dde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.793+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d69de340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.793+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69e5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.793+0000 7fbd14570b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d68e2500 con 0x55a8d69d5720 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.793+0000 7fbd14570b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d68e21a0 con 0x55a8d69d4830 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.793+0000 7fbd14570b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d67a78c0 con 0x55a8d69d3ed0 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.793+0000 7fbd14570b80 10 client.0 _ll_register_callbacks cb 0x55a8d680da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d69dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d69dde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47060/0 (socket says 172.21.15.12:47060) 2023-12-11T20:17:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 -- 172.21.15.12:0/3098943663 learned_addr learned my addr 172.21.15.12:0/3098943663 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d69de340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 -- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 msgr2=0x55a8d69de340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d69de340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 -- 172.21.15.12:0/3098943663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 msgr2=0x55a8d69e5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69e5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 -- 172.21.15.12:0/3098943663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc1a5f90 con 0x55a8d69d3ed0 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d69de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.794+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d69dde00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0098e0 tx=0x7fbcec003ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=923a5b70a1ab618e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.795+0000 7fbce1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.795+0000 7fbce1ffb700 1 -- 172.21.15.12:0/3098943663 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec01d040 con 0x55a8d69d3ed0 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.795+0000 7fbd14570b80 1 -- 172.21.15.12:0/3098943663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8d69c7730 con 0x55a8d69d3ed0 2023-12-11T20:17:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.795+0000 7fbce1ffb700 1 -- 172.21.15.12:0/3098943663 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbcec004190 con 0x55a8d69d3ed0 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.795+0000 7fbce1ffb700 1 -- 172.21.15.12:0/3098943663 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcec005050 con 0x55a8d69d3ed0 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.795+0000 7fbd14570b80 10 client.25624 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.795+0000 7fbd14570b80 1 -- 172.21.15.12:0/3098943663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fbcfc110840 con 0x55a8d69d3ed0 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.795+0000 7fbce1ffb700 1 -- 172.21.15.12:0/3098943663 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a8d69c7730 con 0x55a8d69d3ed0 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.796+0000 7fbce1ffb700 1 -- 172.21.15.12:0/3098943663 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbcec00f460 con 0x55a8d69d3ed0 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.796+0000 7fbd14570b80 10 client.25624 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.796+0000 7fbd14570b80 10 client.25624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.796+0000 7fbd14570b80 20 client.25624 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.796+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a8d69e98d0 0x55a8d69ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.796+0000 7fbd14570b80 4 client.25624 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.796+0000 7fbd14570b80 1 -- 172.21.15.12:0/3098943663 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8d69a3ee0 con 0x55a8d69e98d0 2023-12-11T20:17:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.796+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a8d69e98d0 0x55a8d69ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.797+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a8d69e98d0 0x55a8d69ebcf0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ce170d775eaad22 server_cookie=c45b44baf690e8f5 in_seq=0 out_seq=0 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.797+0000 7fbce1ffb700 10 client.25624 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.797+0000 7fbce1ffb700 1 -- 172.21.15.12:0/3098943663 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a8d69a3ee0 con 0x55a8d69e98d0 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.797+0000 7fbce1ffb700 10 client.25624 handle_command_reply: tid=0 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 client.25624 shutdown 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 -- 172.21.15.12:0/3098943663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 msgr2=0x55a8d69dde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d69dde00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0098e0 tx=0x7fbcec003ab0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 -- 172.21.15.12:0/3098943663 shutdown_connections 2023-12-11T20:17:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a8d69e98d0 0x55a8d69ebcf0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbce1ffb700 0 client.25624 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d69dde00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3098943663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d69de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 -- 172.21.15.12:0/3098943663 >> 172.21.15.12:0/3098943663 conn(0x55a8d6903780 msgr2=0x55a8d69ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 -- 172.21.15.12:0/3098943663 shutdown_connections 2023-12-11T20:17:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 1 -- 172.21.15.12:0/3098943663 wait complete. 2023-12-11T20:17:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.798+0000 7fbd14570b80 20 client.25624 trim_cache size 0 max 16384 2023-12-11T20:17:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.815+0000 7fbd14570b80 1 Processor -- start 2023-12-11T20:17:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.815+0000 7fbd14570b80 1 -- start start 2023-12-11T20:17:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 0x55a8d69d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbd14570b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d69c74c0 con 0x55a8d69d5720 2023-12-11T20:17:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbd14570b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d69f0ee0 con 0x55a8d69d3ed0 2023-12-11T20:17:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbd14570b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d69d4f30 con 0x55a8d69d4830 2023-12-11T20:17:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39472/0 (socket says 172.21.15.12:39472) 2023-12-11T20:17:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfad9d700 1 -- 172.21.15.12:0/3556521157 learned_addr learned my addr 172.21.15.12:0/3556521157 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 0x55a8d69d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfad9d700 1 -- 172.21.15.12:0/3556521157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 msgr2=0x55a8d69e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69e50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfad9d700 1 -- 172.21.15.12:0/3556521157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 msgr2=0x55a8d69d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 0x55a8d69d5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcfad9d700 1 -- 172.21.15.12:0/3556521157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8d6751d80 con 0x55a8d69d5720 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.816+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.817+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d0460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40045d0 tx=0x7fbcf400b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c116e0b6059d6d29 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.817+0000 7fbcf17fa700 1 -- 172.21.15.12:0/3556521157 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4004db0 con 0x55a8d69d5720 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.817+0000 7fbcf17fa700 1 -- 172.21.15.12:0/3556521157 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcf400f040 con 0x55a8d69d5720 2023-12-11T20:17:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.817+0000 7fbcf17fa700 1 -- 172.21.15.12:0/3556521157 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4016b20 con 0x55a8d69d5720 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 -- 172.21.15.12:0/3556521157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 msgr2=0x55a8d69d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d0460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40045d0 tx=0x7fbcf400b050 comp rx=0 tx=0).stop 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 -- 172.21.15.12:0/3556521157 shutdown_connections 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d3ed0 0x55a8d69d5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d69d0460 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 --2- 172.21.15.12:0/3556521157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d4830 0x55a8d69e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 -- 172.21.15.12:0/3556521157 >> 172.21.15.12:0/3556521157 conn(0x55a8d6903780 msgr2=0x55a8d69dd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 -- 172.21.15.12:0/3556521157 shutdown_connections 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 -- 172.21.15.12:0/3556521157 wait complete. 2023-12-11T20:17:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.818+0000 7fbd14570b80 1 -- start start 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.819+0000 7fbd14570b80 1 Processor -- start 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.819+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d6a39d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.819+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d6a3c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.819+0000 7fbd14570b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d6a3e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.819+0000 7fbd14570b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d6a3ee00 con 0x55a8d69d5720 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.819+0000 7fbd14570b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d6a3ef70 con 0x55a8d69d4830 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.819+0000 7fbd14570b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d6a3f130 con 0x55a8d69d3ed0 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbd14570b80 10 client.0 _ll_register_callbacks cb 0x55a8d680da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d6a39d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d6a39d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47076/0 (socket says 172.21.15.12:47076) 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcf3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d6a3c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 -- 172.21.15.12:0/2994359987 learned_addr learned my addr 172.21.15.12:0/2994359987 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d6a3e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 -- 172.21.15.12:0/2994359987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 msgr2=0x55a8d6a3c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d6a3c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 -- 172.21.15.12:0/2994359987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 msgr2=0x55a8d6a3e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d6a3e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 -- 172.21.15.12:0/2994359987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc1a5a30 con 0x55a8d69d3ed0 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfad9d700 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d6a3e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbcfa59c700 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d6a39d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbcec000c00 tx=0x7fbcec00f9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6434d34a7f65e211 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.820+0000 7fbce1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.821+0000 7fbce1ffb700 1 -- 172.21.15.12:0/2994359987 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec01d040 con 0x55a8d69d3ed0 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.821+0000 7fbce1ffb700 1 -- 172.21.15.12:0/2994359987 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbcec005bc0 con 0x55a8d69d3ed0 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.821+0000 7fbd14570b80 1 -- 172.21.15.12:0/2994359987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbcec01e040 con 0x55a8d69d3ed0 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.821+0000 7fbce1ffb700 1 -- 172.21.15.12:0/2994359987 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcec003bd0 con 0x55a8d69d3ed0 2023-12-11T20:17:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.821+0000 7fbd14570b80 10 client.25630 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.821+0000 7fbd14570b80 1 -- 172.21.15.12:0/2994359987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fbcf4004290 con 0x55a8d69d3ed0 2023-12-11T20:17:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.821+0000 7fbce1ffb700 1 -- 172.21.15.12:0/2994359987 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcec01e040 con 0x55a8d69d3ed0 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.822+0000 7fbce1ffb700 1 -- 172.21.15.12:0/2994359987 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbcec004620 con 0x55a8d69d3ed0 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.822+0000 7fbd14570b80 10 client.25630 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.822+0000 7fbd14570b80 10 client.25630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.822+0000 7fbd14570b80 20 client.25630 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.822+0000 7fbd14570b80 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a8d6a40770 0x55a8d6a42b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.822+0000 7fbd14570b80 4 client.25630 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.822+0000 7fbd14570b80 1 -- 172.21.15.12:0/2994359987 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a8d68eef70 con 0x55a8d6a40770 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.822+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a8d6a40770 0x55a8d6a42b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.823+0000 7fbcf3fff700 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a8d6a40770 0x55a8d6a42b90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427b48f74dfac730 server_cookie=bd2c7def7350c4f7 in_seq=0 out_seq=0 2023-12-11T20:17:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.823+0000 7fbce1ffb700 10 client.25630 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:16.826 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2023-12-11T20:17:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.851+0000 7fbce1ffb700 1 -- 172.21.15.12:0/2994359987 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a8d68eef70 con 0x55a8d6a40770 2023-12-11T20:17:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.851+0000 7fbce1ffb700 10 client.25630 handle_command_reply: tid=0 2023-12-11T20:17:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.851+0000 7fbd14570b80 1 client.25630 shutdown 2023-12-11T20:17:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 -- 172.21.15.12:0/2994359987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 msgr2=0x55a8d6a39d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d6a39d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbcec000c00 tx=0x7fbcec00f9e0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 -- 172.21.15.12:0/2994359987 shutdown_connections 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a8d6a40770 0x55a8d6a42b90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8d69d5720 0x55a8d6a3e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8d69d3ed0 0x55a8d6a39d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbce1ffb700 0 client.25630 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 --2- 172.21.15.12:0/2994359987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8d69d4830 0x55a8d6a3c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 -- 172.21.15.12:0/2994359987 >> 172.21.15.12:0/2994359987 conn(0x55a8d6903780 msgr2=0x55a8d69d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 -- 172.21.15.12:0/2994359987 shutdown_connections 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 1 -- 172.21.15.12:0/2994359987 wait complete. 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.852+0000 7fbd14570b80 20 client.25630 trim_cache size 0 max 16384 2023-12-11T20:17:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:17:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:17:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:17:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:17:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 -- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbce80a14f0 msgr2=0x7fbce80a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbce80a14f0 0x7fbce80a39b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40099d0 tx=0x7fbcf4009100 comp rx=0 tx=0).stop 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 -- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 msgr2=0x7fbcfc19dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 0x7fbcfc19dee0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbce400d980 tx=0x7fbce400dc90 comp rx=0 tx=0).stop 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 -- 172.21.15.12:0/2513531111 shutdown_connections 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbce80a14f0 0x7fbce80a39b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbcfc10daa0 0x7fbcfc1a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcfc074030 0x7fbcfc19d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 --2- 172.21.15.12:0/2513531111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcfc075610 0x7fbcfc19dee0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 -- 172.21.15.12:0/2513531111 >> 172.21.15.12:0/2513531111 conn(0x7fbcfc0fca60 msgr2=0x7fbcfc100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 -- 172.21.15.12:0/2513531111 shutdown_connections 2023-12-11T20:17:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:16.853+0000 7fbd00bff700 1 -- 172.21.15.12:0/2513531111 wait complete. 2023-12-11T20:17:16.858 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2023-12-11T20:17:17.090 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2023-12-11T20:17:17.110 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2023-12-11T20:17:17.251 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2023-12-11T20:17:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2023-12-11T20:17:17.420 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2023-12-11T20:17:17.440 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2023-12-11T20:17:17.640 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/util.Tpo .deps/util.Po 2023-12-11T20:17:17.662 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2023-12-11T20:17:17.735 INFO:tasks.workunit.client.0.smithi012.stderr:In file included from parser.h:22, 2023-12-11T20:17:17.736 INFO:tasks.workunit.client.0.smithi012.stderr: from parser.c:25: 2023-12-11T20:17:17.736 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c: In function ‘init_filesys’: 2023-12-11T20:17:17.738 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2023-12-11T20:17:17.738 INFO:tasks.workunit.client.0.smithi012.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2023-12-11T20:17:17.738 INFO:tasks.workunit.client.0.smithi012.stderr: ^ 2023-12-11T20:17:17.738 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: container_of(ptr, type, member) 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2023-12-11T20:17:17.739 INFO:tasks.workunit.client.0.smithi012.stderr: ^ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: container_of(ptr, type, member) 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2023-12-11T20:17:17.740 INFO:tasks.workunit.client.0.smithi012.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: ^ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: container_of(ptr, type, member) 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2023-12-11T20:17:17.741 INFO:tasks.workunit.client.0.smithi012.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: ^ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: container_of(ptr, type, member) 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.742 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c: In function ‘init_tg_stats’: 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: ^ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: container_of(ptr, type, member) 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: list_for_each_entry(tmp_list, 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.743 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: ^ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: container_of(ptr, type, member) 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: list_for_each_entry(tmp_list, 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.744 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: ^ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: container_of(ptr, type, member) 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: list_for_each_entry(tmp_list, 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.745 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: ^ 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~ 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: container_of(ptr, type, member) 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~ 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~ 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: list_for_each_entry(tmp_list, 2023-12-11T20:17:17.746 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.858 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c: In function ‘set_weight’: 2023-12-11T20:17:17.858 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:623:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2023-12-11T20:17:17.859 INFO:tasks.workunit.client.0.smithi012.stderr: strncpy (op, tmp_config->name, len - 7); 2023-12-11T20:17:17.859 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.859 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:620:10: note: length computed here 2023-12-11T20:17:17.859 INFO:tasks.workunit.client.0.smithi012.stderr: len = strlen(tmp_config->name); 2023-12-11T20:17:17.859 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.863 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c: In function ‘get_weight_total’: 2023-12-11T20:17:17.863 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:645:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2023-12-11T20:17:17.863 INFO:tasks.workunit.client.0.smithi012.stderr: strncpy (op, tmp_config->name, len - 7); 2023-12-11T20:17:17.864 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:17.864 INFO:tasks.workunit.client.0.smithi012.stderr:parser.c:642:10: note: length computed here 2023-12-11T20:17:17.864 INFO:tasks.workunit.client.0.smithi012.stderr: len = strlen(tmp_config->name); 2023-12-11T20:17:17.864 INFO:tasks.workunit.client.0.smithi012.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-11T20:17:18.032 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2023-12-11T20:17:18.052 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2023-12-11T20:17:18.186 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2023-12-11T20:17:18.204 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2023-12-11T20:17:18.360 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2023-12-11T20:17:18.380 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2023-12-11T20:17:18.458 INFO:tasks.workunit.client.0.smithi012.stdout:mv -f .deps/list.Tpo .deps/list.Po 2023-12-11T20:17:18.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:18 smithi032 ceph-mon[132488]: pgmap v416: 97 pgs: 97 active+clean; 8.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 492 KiB/s wr, 157 op/s 2023-12-11T20:17:18.478 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2023-12-11T20:17:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:18 smithi039 ceph-mon[102205]: pgmap v416: 97 pgs: 97 active+clean; 8.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 492 KiB/s wr, 157 op/s 2023-12-11T20:17:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:18 smithi012 ceph-mon[128787]: pgmap v416: 97 pgs: 97 active+clean; 8.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 492 KiB/s wr, 157 op/s 2023-12-11T20:17:18.686 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2023-12-11T20:17:18.686 INFO:tasks.workunit.client.0.smithi012.stderr:+ cd .. 2023-12-11T20:17:18.689 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir tmp 2023-12-11T20:17:18.695 INFO:tasks.workunit.client.0.smithi012.stderr:+ cd tmp 2023-12-11T20:17:18.697 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in $mydir/*.ffsb 2023-12-11T20:17:18.697 INFO:tasks.workunit.client.0.smithi012.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2023-12-11T20:17:18.700 INFO:tasks.workunit.client.0.smithi012.stdout:FFSB version 6.0-RC2 started 2023-12-11T20:17:18.700 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:17:18.706 INFO:tasks.workunit.client.0.smithi012.stdout:benchmark time = 300 2023-12-11T20:17:18.706 INFO:tasks.workunit.client.0.smithi012.stdout:ThreadGroup 0 2023-12-11T20:17:18.706 INFO:tasks.workunit.client.0.smithi012.stdout:================ 2023-12-11T20:17:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: num_threads = 32 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: read_random = off 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: read_size = 0 (0B) 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: read_blocksize = 0 (0B) 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: read_skip = off 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: read_skipsize = 0 (0B) 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: write_random = on 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: write_size = 5242880 (5MB) 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: fsync_file = 0 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: write_blocksize = 4096 (4KB) 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: wait time = 0 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: op weights 2023-12-11T20:17:18.707 INFO:tasks.workunit.client.0.smithi012.stdout: read = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: readall = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: write = 1 (100.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: create = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: append = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: delete = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: metaop = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: createdir = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: stat = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: writeall = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: writeall_fsync = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: open_close = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: write_fsync = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: create_fsync = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: append_fsync = 0 (0.00%) 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:17:18.708 INFO:tasks.workunit.client.0.smithi012.stdout:FileSystem . 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout:========== 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: num_dirs = 0 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: starting files = 128 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: min file size = 104857600 (100MB) 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: max file size = 104857600 (100MB) 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: directio = off 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: alignedio = on 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: bufferedio = off 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: aging is off 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: current utilization = 0.00% 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:17:18.709 INFO:tasks.workunit.client.0.smithi012.stdout:checking existing fs: . 2023-12-11T20:17:18.710 INFO:tasks.workunit.client.0.smithi012.stdout:recreating new fileset 2023-12-11T20:17:18.710 INFO:tasks.workunit.client.0.smithi012.stderr:opendir: No such file or directory 2023-12-11T20:17:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:19 smithi012 ceph-mon[128787]: pgmap v417: 97 pgs: 97 active+clean; 9.2 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 403 KiB/s wr, 110 op/s 2023-12-11T20:17:19.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:19 smithi032 ceph-mon[132488]: pgmap v417: 97 pgs: 97 active+clean; 9.2 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 403 KiB/s wr, 110 op/s 2023-12-11T20:17:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:19 smithi039 ceph-mon[102205]: pgmap v417: 97 pgs: 97 active+clean; 9.2 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 403 KiB/s wr, 110 op/s 2023-12-11T20:17:21.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:17:22.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 -- 172.21.15.12:0/4059247649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4088105280 msgr2=0x7f408810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 --2- 172.21.15.12:0/4059247649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4088105280 0x7f408810bb30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4080009fc0 tx=0x7f408000b330 comp rx=0 tx=0).stop 2023-12-11T20:17:22.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 -- 172.21.15.12:0/4059247649 shutdown_connections 2023-12-11T20:17:22.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 --2- 172.21.15.12:0/4059247649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40881036f0 0x7f4088103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 --2- 172.21.15.12:0/4059247649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4088105280 0x7f408810bb30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 --2- 172.21.15.12:0/4059247649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40881048e0 0x7f4088104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 -- 172.21.15.12:0/4059247649 >> 172.21.15.12:0/4059247649 conn(0x7f40880fec80 msgr2=0x7f40881010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 -- 172.21.15.12:0/4059247649 shutdown_connections 2023-12-11T20:17:22.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.041+0000 7f40901ff700 1 -- 172.21.15.12:0/4059247649 wait complete. 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.042+0000 7f40901ff700 1 Processor -- start 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.042+0000 7f40901ff700 1 -- start start 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f40901ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40881036f0 0x7f4088199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f40901ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40881048e0 0x7f4088199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f40901ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4088105280 0x7f40881a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f40901ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40881a1160 con 0x7f40881048e0 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f40901ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40881a12a0 con 0x7f40881036f0 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f40901ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40881a1430 con 0x7f4088105280 2023-12-11T20:17:22.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f408d79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40881048e0 0x7f4088199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f408d79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40881048e0 0x7f4088199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45378/0 (socket says 172.21.15.12:45378) 2023-12-11T20:17:22.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f408d79a700 1 -- 172.21.15.12:0/1389923513 learned_addr learned my addr 172.21.15.12:0/1389923513 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f408d79a700 1 -- 172.21.15.12:0/1389923513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4088105280 msgr2=0x7f40881a0b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-11T20:17:22.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f408d79a700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4088105280 0x7f40881a0b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f408d79a700 1 -- 172.21.15.12:0/1389923513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40881036f0 msgr2=0x7f4088199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f408d79a700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40881036f0 0x7f4088199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.043+0000 7f408d79a700 1 -- 172.21.15.12:0/1389923513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080009c40 con 0x7f40881048e0 2023-12-11T20:17:22.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.044+0000 7f408d79a700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40881048e0 0x7f4088199bc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f407800d950 tx=0x7f407800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.044+0000 7f407effd700 1 -- 172.21.15.12:0/1389923513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078009b40 con 0x7f40881048e0 2023-12-11T20:17:22.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.044+0000 7f407effd700 1 -- 172.21.15.12:0/1389923513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4078009ca0 con 0x7f40881048e0 2023-12-11T20:17:22.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.044+0000 7f40901ff700 1 -- 172.21.15.12:0/1389923513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40881a1710 con 0x7f40881048e0 2023-12-11T20:17:22.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.044+0000 7f407effd700 1 -- 172.21.15.12:0/1389923513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407800f620 con 0x7f40881048e0 2023-12-11T20:17:22.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.044+0000 7f40901ff700 1 -- 172.21.15.12:0/1389923513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40881a1c70 con 0x7f40881048e0 2023-12-11T20:17:22.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.049+0000 7f407effd700 1 -- 172.21.15.12:0/1389923513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4078010460 con 0x7f40881048e0 2023-12-11T20:17:22.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.050+0000 7f40a3b85b80 1 Processor -- start 2023-12-11T20:17:22.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.050+0000 7f40a3b85b80 1 -- start start 2023-12-11T20:17:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a96640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50a970a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b509f0b50 con 0x560b50a953d0 2023-12-11T20:17:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b509ee470 con 0x560b50a96c20 2023-12-11T20:17:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b509e9d60 con 0x560b50a95d30 2023-12-11T20:17:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f407effd700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40740a1500 0x7f40740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f408e79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f408e79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45382/0 (socket says 172.21.15.12:45382) 2023-12-11T20:17:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.051+0000 7f408e79c700 1 -- 172.21.15.12:0/1046622011 learned_addr learned my addr 172.21.15.12:0/1046622011 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.052+0000 7f407effd700 1 -- 172.21.15.12:0/1389923513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f40780cd070 con 0x7f40881048e0 2023-12-11T20:17:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.052+0000 7f408d79a700 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50a970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.052+0000 7f408e79c700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40740a1500 0x7f40740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.053+0000 7f408df9b700 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a96640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.053+0000 7f408e79c700 1 -- 172.21.15.12:0/1046622011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 msgr2=0x560b50a96640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.053+0000 7f408e79c700 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a96640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.053+0000 7f408e79c700 1 -- 172.21.15.12:0/1046622011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 msgr2=0x560b50a970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.053+0000 7f408e79c700 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50a970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.053+0000 7f408e79c700 1 -- 172.21.15.12:0/1046622011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b50866630 con 0x560b50a953d0 2023-12-11T20:17:22.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.053+0000 7f408e79c700 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a957f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4080004c50 tx=0x7f4080004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09fd9eb5abb42f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.054+0000 7f408e79c700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40740a1500 0x7f40740a39c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4080007890 tx=0x7f4080026000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.054+0000 7f4073fff700 1 -- 172.21.15.12:0/1046622011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000e070 con 0x560b50a953d0 2023-12-11T20:17:22.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.054+0000 7f4073fff700 1 -- 172.21.15.12:0/1046622011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4080003e90 con 0x560b50a953d0 2023-12-11T20:17:22.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.054+0000 7f4073fff700 1 -- 172.21.15.12:0/1046622011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080004630 con 0x560b50a953d0 2023-12-11T20:17:22.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 -- 172.21.15.12:0/1046622011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 msgr2=0x560b50a957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a957f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4080004c50 tx=0x7f4080004c80 comp rx=0 tx=0).stop 2023-12-11T20:17:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 -- 172.21.15.12:0/1046622011 shutdown_connections 2023-12-11T20:17:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50a970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a957f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/1046622011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a96640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 -- 172.21.15.12:0/1046622011 >> 172.21.15.12:0/1046622011 conn(0x560b509c47e0 msgr2=0x560b50a91d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 -- 172.21.15.12:0/1046622011 shutdown_connections 2023-12-11T20:17:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.055+0000 7f40a3b85b80 1 -- 172.21.15.12:0/1046622011 wait complete. 2023-12-11T20:17:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.056+0000 7f40a3b85b80 1 -- start start 2023-12-11T20:17:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.056+0000 7f40a3b85b80 1 Processor -- start 2023-12-11T20:17:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a9f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a9f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b509a3560 con 0x560b50a953d0 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b509a3200 con 0x560b50a96c20 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b50868920 con 0x560b50a95d30 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f40a3b85b80 10 client.0 _ll_register_callbacks cb 0x560b508cea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f408e79c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f408e79c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58412/0 (socket says 172.21.15.12:58412) 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.058+0000 7f408e79c700 1 -- 172.21.15.12:0/32640511 learned_addr learned my addr 172.21.15.12:0/32640511 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.059+0000 7f408d79a700 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a9f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.059+0000 7f408d79a700 1 -- 172.21.15.12:0/32640511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 msgr2=0x560b50aa6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.059+0000 7f408d79a700 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.059+0000 7f408d79a700 1 -- 172.21.15.12:0/32640511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 msgr2=0x560b50a9f1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.059+0000 7f408d79a700 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a9f1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.059+0000 7f408d79a700 1 -- 172.21.15.12:0/32640511 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408810c480 con 0x560b50a95d30 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.060+0000 7f408d79a700 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a9f710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f407809a2d0 tx=0x7f4078099f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=439a896b1efec5df server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.060+0000 7f40717fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.060+0000 7f40717fa700 1 -- 172.21.15.12:0/32640511 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407809a340 con 0x560b50a95d30 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.060+0000 7f40717fa700 1 -- 172.21.15.12:0/32640511 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f407809e490 con 0x560b50a95d30 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.060+0000 7f40a3b85b80 1 -- 172.21.15.12:0/32640511 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b50a88b40 con 0x560b50a95d30 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.060+0000 7f40717fa700 1 -- 172.21.15.12:0/32640511 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40780a26d0 con 0x560b50a95d30 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40a3b85b80 10 client.25639 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40a3b85b80 1 -- 172.21.15.12:0/32640511 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560b50812de0 con 0x560b50a95d30 2023-12-11T20:17:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40717fa700 1 -- 172.21.15.12:0/32640511 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560b50a88b40 con 0x560b50a95d30 2023-12-11T20:17:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40717fa700 1 -- 172.21.15.12:0/32640511 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f407809a5a0 con 0x560b50a95d30 2023-12-11T20:17:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40a3b85b80 10 client.25639 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40a3b85b80 10 client.25639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40a3b85b80 20 client.25639 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560b50aaaef0 0x560b50aad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40a3b85b80 4 client.25639 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.061+0000 7f40a3b85b80 1 -- 172.21.15.12:0/32640511 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b50a64f40 con 0x560b50aaaef0 2023-12-11T20:17:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.063+0000 7f408df9b700 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560b50aaaef0 0x560b50aad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.063+0000 7f40717fa700 10 client.25639 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.063+0000 7f408df9b700 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560b50aaaef0 0x560b50aad310 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ea647fc92e8be3b server_cookie=2757b0eebee3dc18 in_seq=0 out_seq=0 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.063+0000 7f40717fa700 1 -- 172.21.15.12:0/32640511 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560b50a64f40 con 0x560b50aaaef0 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.063+0000 7f40717fa700 10 client.25639 handle_command_reply: tid=0 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.063+0000 7f40a3b85b80 1 client.25639 shutdown 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 -- 172.21.15.12:0/32640511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 msgr2=0x560b50a9f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a9f710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f407809a2d0 tx=0x7f4078099f00 comp rx=0 tx=0).stop 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 -- 172.21.15.12:0/32640511 shutdown_connections 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560b50aaaef0 0x560b50aad310 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a953d0 0x560b50a9f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40717fa700 0 client.25639 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/32640511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a95d30 0x560b50a9f710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 -- 172.21.15.12:0/32640511 >> 172.21.15.12:0/32640511 conn(0x560b509c47e0 msgr2=0x560b50a90a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 -- 172.21.15.12:0/32640511 shutdown_connections 2023-12-11T20:17:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 1 -- 172.21.15.12:0/32640511 wait complete. 2023-12-11T20:17:22.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.064+0000 7f40a3b85b80 20 client.25639 trim_cache size 0 max 16384 2023-12-11T20:17:22.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f40a3b85b80 1 Processor -- start 2023-12-11T20:17:22.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f40a3b85b80 1 -- start start 2023-12-11T20:17:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a953d0 0x560b50a91970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a96c20 0x560b50a91eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b50a94f70 con 0x560b50a95d30 2023-12-11T20:17:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b50a8c860 con 0x560b50a953d0 2023-12-11T20:17:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b50ab2540 con 0x560b50a96c20 2023-12-11T20:17:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f408d79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f408d79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45384/0 (socket says 172.21.15.12:45384) 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f408d79a700 1 -- 172.21.15.12:0/2308888967 learned_addr learned my addr 172.21.15.12:0/2308888967 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.088+0000 7f408df9b700 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a953d0 0x560b50a91970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f408d79a700 1 -- 172.21.15.12:0/2308888967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a96c20 msgr2=0x560b50a91eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f408d79a700 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a96c20 0x560b50a91eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f408d79a700 1 -- 172.21.15.12:0/2308888967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a953d0 msgr2=0x560b50a91970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f408d79a700 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a953d0 0x560b50a91970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f408d79a700 1 -- 172.21.15.12:0/2308888967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b507fbc60 con 0x560b50a95d30 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f408df9b700 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a953d0 0x560b50a91970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f408d79a700 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa66c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40780cae90 tx=0x7f40780cd3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1d9bfc1164bfca server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f407cff9700 1 -- 172.21.15.12:0/2308888967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078014030 con 0x560b50a95d30 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f407cff9700 1 -- 172.21.15.12:0/2308888967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4078099ca0 con 0x560b50a95d30 2023-12-11T20:17:22.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.089+0000 7f407cff9700 1 -- 172.21.15.12:0/2308888967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407809e100 con 0x560b50a95d30 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.090+0000 7f40a3b85b80 1 -- 172.21.15.12:0/2308888967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 msgr2=0x560b50aa66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.090+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa66c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40780cae90 tx=0x7f40780cd3c0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.090+0000 7f40a3b85b80 1 -- 172.21.15.12:0/2308888967 shutdown_connections 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.090+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a953d0 0x560b50a91970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.090+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a96c20 0x560b50a91eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.090+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/2308888967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa66c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.090+0000 7f40a3b85b80 1 -- 172.21.15.12:0/2308888967 >> 172.21.15.12:0/2308888967 conn(0x560b509c47e0 msgr2=0x560b50a99130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.091+0000 7f40a3b85b80 1 -- 172.21.15.12:0/2308888967 shutdown_connections 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.091+0000 7f40a3b85b80 1 -- 172.21.15.12:0/2308888967 wait complete. 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.091+0000 7f40a3b85b80 1 -- start start 2023-12-11T20:17:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.091+0000 7f40a3b85b80 1 Processor -- start 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a953d0 0x560b50aa2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f40a3b85b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b50aa6330 con 0x560b50a95d30 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b50aa64a0 con 0x560b50a96c20 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f40a3b85b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b50aa6660 con 0x560b50a953d0 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f40a3b85b80 10 client.0 _ll_register_callbacks cb 0x560b508cea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f408e79c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f408df9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a953d0 0x560b50aa2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f408d79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f408e79c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58432/0 (socket says 172.21.15.12:58432) 2023-12-11T20:17:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f408e79c700 1 -- 172.21.15.12:0/3244705849 learned_addr learned my addr 172.21.15.12:0/3244705849 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.092+0000 7f408e79c700 1 -- 172.21.15.12:0/3244705849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a953d0 msgr2=0x560b50aa2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f408e79c700 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a953d0 0x560b50aa2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f408e79c700 1 -- 172.21.15.12:0/3244705849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 msgr2=0x560b50aa2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f408e79c700 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f408e79c700 1 -- 172.21.15.12:0/3244705849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4084009aa0 con 0x560b50a96c20 2023-12-11T20:17:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f408d79a700 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f408e79c700 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa5df0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4080009430 tx=0x7f4080003cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e84542fc955a94d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f40717fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f40717fa700 1 -- 172.21.15.12:0/3244705849 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000e040 con 0x560b50a96c20 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.093+0000 7f40a3b85b80 1 -- 172.21.15.12:0/3244705849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4080003e90 con 0x560b50a96c20 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40717fa700 1 -- 172.21.15.12:0/3244705849 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4080033430 con 0x560b50a96c20 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40717fa700 1 -- 172.21.15.12:0/3244705849 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4080006000 con 0x560b50a96c20 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40a3b85b80 10 client.25646 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40a3b85b80 1 -- 172.21.15.12:0/3244705849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560b50812de0 con 0x560b50a96c20 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40717fa700 1 -- 172.21.15.12:0/3244705849 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4080003e90 con 0x560b50a96c20 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40717fa700 1 -- 172.21.15.12:0/3244705849 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4080019070 con 0x560b50a96c20 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40a3b85b80 10 client.25646 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40a3b85b80 10 client.25646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40a3b85b80 20 client.25646 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.094+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560b50b02580 0x560b50b049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.095+0000 7f40a3b85b80 4 client.25646 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:17:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.095+0000 7f40a3b85b80 1 -- 172.21.15.12:0/3244705849 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560b509affd0 con 0x560b50b02580 2023-12-11T20:17:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.095+0000 7f408df9b700 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560b50b02580 0x560b50b049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40717fa700 10 client.25646 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f408df9b700 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560b50b02580 0x560b50b049a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d3576e3ed83e4a server_cookie=6d249e33c98bcd95 in_seq=0 out_seq=0 2023-12-11T20:17:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40717fa700 1 -- 172.21.15.12:0/3244705849 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560b509affd0 con 0x560b50b02580 2023-12-11T20:17:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40717fa700 10 client.25646 handle_command_reply: tid=0 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 client.25646 shutdown 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 -- 172.21.15.12:0/3244705849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 msgr2=0x560b50aa5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa5df0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4080009430 tx=0x7f4080003cb0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 -- 172.21.15.12:0/3244705849 shutdown_connections 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560b50b02580 0x560b50b049a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560b50a96c20 0x560b50aa5df0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560b50a953d0 0x560b50aa2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 --2- 172.21.15.12:0/3244705849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560b50a95d30 0x560b50aa2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 -- 172.21.15.12:0/3244705849 >> 172.21.15.12:0/3244705849 conn(0x560b509c47e0 msgr2=0x560b50a9ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40717fa700 0 client.25646 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 -- 172.21.15.12:0/3244705849 shutdown_connections 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.096+0000 7f40a3b85b80 1 -- 172.21.15.12:0/3244705849 wait complete. 2023-12-11T20:17:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40a3b85b80 20 client.25646 trim_cache size 0 max 16384 2023-12-11T20:17:22.099 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:17:22.099 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:17:22.099 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:17:22.099 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 -- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40740a1500 msgr2=0x7f40740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40740a1500 0x7f40740a39c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4080007890 tx=0x7f4080026000 comp rx=0 tx=0).stop 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 -- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40881048e0 msgr2=0x7f4088199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40881048e0 0x7f4088199bc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f407800d950 tx=0x7f407800dd10 comp rx=0 tx=0).stop 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 -- 172.21.15.12:0/1389923513 shutdown_connections 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f40740a1500 0x7f40740a39c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40881036f0 0x7f4088199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4088105280 0x7f40881a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 --2- 172.21.15.12:0/1389923513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40881048e0 0x7f4088199bc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.097+0000 7f40901ff700 1 -- 172.21.15.12:0/1389923513 >> 172.21.15.12:0/1389923513 conn(0x7f40880fec80 msgr2=0x7f4088107c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.098+0000 7f40901ff700 1 -- 172.21.15.12:0/1389923513 shutdown_connections 2023-12-11T20:17:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.098+0000 7f40901ff700 1 -- 172.21.15.12:0/1389923513 wait complete. 2023-12-11T20:17:22.115 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:17:22.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:17:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.341+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2151096574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 msgr2=0x7ffa14106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.341+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2151096574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 0x7ffa14106cb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009990 tx=0x7ffa04009ca0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.342+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2151096574 shutdown_connections 2023-12-11T20:17:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.342+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2151096574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa141071f0 0x7ffa14109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.342+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2151096574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa14101f90 0x7ffa14104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.342+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2151096574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 0x7ffa14106cb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.342+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2151096574 >> 172.21.15.12:0/2151096574 conn(0x7ffa140fb980 msgr2=0x7ffa140fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.342+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2151096574 shutdown_connections 2023-12-11T20:17:22.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.342+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2151096574 wait complete. 2023-12-11T20:17:22.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.343+0000 7ffa1c5ff700 1 Processor -- start 2023-12-11T20:17:22.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.343+0000 7ffa1c5ff700 1 -- start start 2023-12-11T20:17:22.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.344+0000 7ffa1c5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa14101f90 0x7ffa14195110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.344+0000 7ffa1c5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 0x7ffa14195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.344+0000 7ffa1c5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa141071f0 0x7ffa141a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.344+0000 7ffa1c5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14195d60 con 0x7ffa141048c0 2023-12-11T20:17:22.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.344+0000 7ffa1c5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa141a5590 con 0x7ffa141071f0 2023-12-11T20:17:22.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.344+0000 7ffa1c5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa141a5720 con 0x7ffa14101f90 2023-12-11T20:17:22.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa19b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 0x7ffa14195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa1a39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa14101f90 0x7ffa14195110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa19b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 0x7ffa14195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45418/0 (socket says 172.21.15.12:45418) 2023-12-11T20:17:22.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa19b9a700 1 -- 172.21.15.12:0/2821469070 learned_addr learned my addr 172.21.15.12:0/2821469070 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa1ab9c700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa141071f0 0x7ffa141a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa1a39b700 1 -- 172.21.15.12:0/2821469070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa141071f0 msgr2=0x7ffa141a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa1a39b700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa141071f0 0x7ffa141a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa1a39b700 1 -- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 msgr2=0x7ffa14195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa1a39b700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 0x7ffa14195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa1a39b700 1 -- 172.21.15.12:0/2821469070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa040095f0 con 0x7ffa14101f90 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.345+0000 7ffa19b9a700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 0x7ffa14195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.346+0000 7ffa1a39b700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa14101f90 0x7ffa14195110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000e9f0 tx=0x7ffa1000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.346+0000 7ffa0b7fe700 1 -- 172.21.15.12:0/2821469070 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000eee0 con 0x7ffa14101f90 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.346+0000 7ffa0b7fe700 1 -- 172.21.15.12:0/2821469070 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa1000cbd0 con 0x7ffa14101f90 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.346+0000 7ffa0b7fe700 1 -- 172.21.15.12:0/2821469070 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10018680 con 0x7ffa14101f90 2023-12-11T20:17:22.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.346+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa141a5a00 con 0x7ffa14101f90 2023-12-11T20:17:22.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.347+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa141a5ec0 con 0x7ffa14101f90 2023-12-11T20:17:22.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.349+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa14108df0 con 0x7ffa14101f90 2023-12-11T20:17:22.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.352+0000 7ffa0b7fe700 1 -- 172.21.15.12:0/2821469070 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ffa10010430 con 0x7ffa14101f90 2023-12-11T20:17:22.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.353+0000 7ffa0b7fe700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa000a1500 0x7ffa000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.353+0000 7ffa0b7fe700 1 -- 172.21.15.12:0/2821469070 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffa10014070 con 0x7ffa14101f90 2023-12-11T20:17:22.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.353+0000 7ffa19b9a700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa000a1500 0x7ffa000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.354+0000 7ffa19b9a700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa000a1500 0x7ffa000a39c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400b2e0 tx=0x7ffa0400b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.357+0000 7ffa0b7fe700 1 -- 172.21.15.12:0/2821469070 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffa100964a0 con 0x7ffa14101f90 2023-12-11T20:17:22.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:22 smithi032 ceph-mon[132488]: pgmap v418: 97 pgs: 97 active+clean; 18 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.0 MiB/s wr, 97 op/s 2023-12-11T20:17:22.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:22 smithi039 ceph-mon[102205]: pgmap v418: 97 pgs: 97 active+clean; 18 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.0 MiB/s wr, 97 op/s 2023-12-11T20:17:22.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:22 smithi012 ceph-mon[128787]: pgmap v418: 97 pgs: 97 active+clean; 18 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.0 MiB/s wr, 97 op/s 2023-12-11T20:17:22.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.694+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa14068330 con 0x7ffa14101f90 2023-12-11T20:17:22.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.695+0000 7ffa0b7fe700 1 -- 172.21.15.12:0/2821469070 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11306 (secure 0 0 0) 0x7ffa14068330 con 0x7ffa14101f90 2023-12-11T20:17:22.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:17:22.693 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:17:06.102424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa000a1500 msgr2=0x7ffa000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa000a1500 0x7ffa000a39c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400b2e0 tx=0x7ffa0400b610 comp rx=0 tx=0).stop 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa14101f90 msgr2=0x7ffa14195110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa14101f90 0x7ffa14195110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000e9f0 tx=0x7ffa1000ed00 comp rx=0 tx=0).stop 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 shutdown_connections 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa000a1500 0x7ffa000a39c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa141071f0 0x7ffa141a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa14101f90 0x7ffa14195110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 --2- 172.21.15.12:0/2821469070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa141048c0 0x7ffa14195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 >> 172.21.15.12:0/2821469070 conn(0x7ffa140fb980 msgr2=0x7ffa141015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 shutdown_connections 2023-12-11T20:17:22.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.698+0000 7ffa1c5ff700 1 -- 172.21.15.12:0/2821469070 wait complete. 2023-12-11T20:17:22.697 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 24 2023-12-11T20:17:22.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:17:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.948+0000 7fe9e09ff700 1 -- 172.21.15.12:0/1808004114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 msgr2=0x7fe9dc1018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.948+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/1808004114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 0x7fe9dc1018d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0099c0 tx=0x7fe9cc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.948+0000 7fe9e09ff700 1 -- 172.21.15.12:0/1808004114 shutdown_connections 2023-12-11T20:17:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.948+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/1808004114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9dc103040 0x7fe9dc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.948+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/1808004114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 0x7fe9dc1018d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.948+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/1808004114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9dc1026a0 0x7fe9dc102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.948+0000 7fe9e09ff700 1 -- 172.21.15.12:0/1808004114 >> 172.21.15.12:0/1808004114 conn(0x7fe9dc0fca00 msgr2=0x7fe9dc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.948+0000 7fe9e09ff700 1 -- 172.21.15.12:0/1808004114 shutdown_connections 2023-12-11T20:17:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.949+0000 7fe9e09ff700 1 -- 172.21.15.12:0/1808004114 wait complete. 2023-12-11T20:17:22.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.950+0000 7fe9e09ff700 1 Processor -- start 2023-12-11T20:17:22.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.950+0000 7fe9e09ff700 1 -- start start 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9e09ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 0x7fe9dc075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9e09ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9dc1026a0 0x7fe9dc0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9e09ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9dc103040 0x7fe9dc073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9e09ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0746a0 con 0x7fe9dc1014b0 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9e09ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc074810 con 0x7fe9dc103040 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9e09ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1a1420 con 0x7fe9dc1026a0 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9da59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 0x7fe9dc075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9da59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 0x7fe9dc075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45434/0 (socket says 172.21.15.12:45434) 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9da59c700 1 -- 172.21.15.12:0/3912929148 learned_addr learned my addr 172.21.15.12:0/3912929148 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9dc103040 0x7fe9dc073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.951+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9dc1026a0 0x7fe9dc0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9da59c700 1 -- 172.21.15.12:0/3912929148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9dc1026a0 msgr2=0x7fe9dc0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9da59c700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9dc1026a0 0x7fe9dc0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9da59c700 1 -- 172.21.15.12:0/3912929148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9dc103040 msgr2=0x7fe9dc073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9da59c700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9dc103040 0x7fe9dc073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9da59c700 1 -- 172.21.15.12:0/3912929148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0095f0 con 0x7fe9dc1014b0 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9dc1026a0 0x7fe9dc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9dc103040 0x7fe9dc073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9da59c700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 0x7fe9dc075330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc000c00 tx=0x7fe9cc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9cb7fe700 1 -- 172.21.15.12:0/3912929148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc01d070 con 0x7fe9dc1014b0 2023-12-11T20:17:22.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9cb7fe700 1 -- 172.21.15.12:0/3912929148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9cc005030 con 0x7fe9dc1014b0 2023-12-11T20:17:22.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9e09ff700 1 -- 172.21.15.12:0/3912929148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc1a1650 con 0x7fe9dc1014b0 2023-12-11T20:17:22.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9cb7fe700 1 -- 172.21.15.12:0/3912929148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc004b30 con 0x7fe9dc1014b0 2023-12-11T20:17:22.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.952+0000 7fe9e09ff700 1 -- 172.21.15.12:0/3912929148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc1a1a10 con 0x7fe9dc1014b0 2023-12-11T20:17:22.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.956+0000 7fe9cb7fe700 1 -- 172.21.15.12:0/3912929148 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe9cc004c90 con 0x7fe9dc1014b0 2023-12-11T20:17:22.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.957+0000 7fe9cb7fe700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9c40a1480 0x7fe9c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.957+0000 7fe9cb7fe700 1 -- 172.21.15.12:0/3912929148 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe9cc0cda40 con 0x7fe9dc1014b0 2023-12-11T20:17:22.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.957+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9c40a1480 0x7fe9c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.958+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9c40a1480 0x7fe9c40a3940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0011490 tx=0x7fe9d0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.959+0000 7fe9f42b7b80 1 Processor -- start 2023-12-11T20:17:22.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.959+0000 7fe9f42b7b80 1 -- start start 2023-12-11T20:17:22.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.959+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 0x55570c18b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.959+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c18c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.959+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.959+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c0e6b50 con 0x55570c18cc20 2023-12-11T20:17:22.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.959+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c0e4470 con 0x55570c18bd30 2023-12-11T20:17:22.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.959+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c0dfd60 con 0x55570c18b3d0 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9da59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 0x55570c18b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45448/0 (socket says 172.21.15.12:45448) 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 -- 172.21.15.12:0/1976586010 learned_addr learned my addr 172.21.15.12:0/1976586010 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c18c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 -- 172.21.15.12:0/1976586010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 msgr2=0x55570c18b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 0x55570c18b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 -- 172.21.15.12:0/1976586010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 msgr2=0x55570c18c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c18c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 -- 172.21.15.12:0/1976586010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570bf5c630 con 0x55570c18cc20 2023-12-11T20:17:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c18c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:22.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.960+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18d0a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4003eb0 tx=0x7fe9d4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1efca75c4220c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.961+0000 7fe9c8ff9700 1 -- 172.21.15.12:0/1976586010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40092d0 con 0x55570c18cc20 2023-12-11T20:17:22.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.961+0000 7fe9c8ff9700 1 -- 172.21.15.12:0/1976586010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9d400f040 con 0x55570c18cc20 2023-12-11T20:17:22.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.961+0000 7fe9c8ff9700 1 -- 172.21.15.12:0/1976586010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400e750 con 0x55570c18cc20 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1976586010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 msgr2=0x55570c18d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18d0a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4003eb0 tx=0x7fe9d4009920 comp rx=0 tx=0).stop 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1976586010 shutdown_connections 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18d0a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 0x55570c18b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1976586010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c18c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1976586010 >> 172.21.15.12:0/1976586010 conn(0x55570c0ba7e0 msgr2=0x55570c187d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1976586010 shutdown_connections 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1976586010 wait complete. 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.962+0000 7fe9f42b7b80 1 -- start start 2023-12-11T20:17:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.963+0000 7fe9f42b7b80 1 Processor -- start 2023-12-11T20:17:22.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.963+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18b3d0 0x55570c195200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.963+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 0x55570c195740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.963+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.963+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c099560 con 0x55570c18cc20 2023-12-11T20:17:22.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c099200 con 0x55570c18b3d0 2023-12-11T20:17:22.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570bf5e920 con 0x55570c18bd30 2023-12-11T20:17:22.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9f42b7b80 10 client.0 _ll_register_callbacks cb 0x55570bfc4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9da59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18b3d0 0x55570c195200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9da59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18b3d0 0x55570c195200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58500/0 (socket says 172.21.15.12:58500) 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9da59c700 1 -- 172.21.15.12:0/1332699634 learned_addr learned my addr 172.21.15.12:0/1332699634 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 0x55570c195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9da59c700 1 -- 172.21.15.12:0/1332699634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 msgr2=0x55570c195740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9da59c700 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 0x55570c195740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9da59c700 1 -- 172.21.15.12:0/1332699634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 msgr2=0x55570c19c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9da59c700 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c19c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9da59c700 1 -- 172.21.15.12:0/1332699634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d4003b90 con 0x55570c18b3d0 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.964+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.965+0000 7fe9da59c700 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18b3d0 0x55570c195200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0cb860 tx=0x7fe9cc005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=164985ce10b9700f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.965+0000 7fe9c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:17:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.965+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/1332699634 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc09a490 con 0x55570c18b3d0 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.965+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/1332699634 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe9cc09b4a0 con 0x55570c18b3d0 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.965+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1332699634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55570c17eb40 con 0x55570c18b3d0 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.965+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/1332699634 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9cc09ada0 con 0x55570c18b3d0 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.965+0000 7fe9f42b7b80 10 client.25664 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.965+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1332699634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55570bf08de0 con 0x55570c18b3d0 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/1332699634 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9cc064020 con 0x55570c18b3d0 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/1332699634 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe9cc0a2d30 con 0x55570c18b3d0 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9f42b7b80 10 client.25664 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9f42b7b80 10 client.25664 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9f42b7b80 20 client.25664 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55570c1a0c90 0x55570c1a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9f42b7b80 4 client.25664 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1332699634 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55570c15af40 con 0x55570c1a0c90 2023-12-11T20:17:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.966+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55570c1a0c90 0x55570c1a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.967+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55570c1a0c90 0x55570c1a30b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10279bdc70353576 server_cookie=6a6642a895ad3397 in_seq=0 out_seq=0 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.967+0000 7fe9c1ffb700 10 client.25664 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/1332699634 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55570c15af40 con 0x55570c1a0c90 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9c1ffb700 10 client.25664 handle_command_reply: tid=0 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 client.25664 shutdown 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1332699634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18b3d0 msgr2=0x55570c195200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18b3d0 0x55570c195200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0cb860 tx=0x7fe9cc005780 comp rx=0 tx=0).stop 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1332699634 shutdown_connections 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55570c1a0c90 0x55570c1a30b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18b3d0 0x55570c195200 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9c1ffb700 0 client.25664 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:17:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/1332699634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 0x55570c195740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1332699634 >> 172.21.15.12:0/1332699634 conn(0x55570c0ba7e0 msgr2=0x55570c186a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1332699634 shutdown_connections 2023-12-11T20:17:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/1332699634 wait complete. 2023-12-11T20:17:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.968+0000 7fe9f42b7b80 20 client.25664 trim_cache size 0 max 16384 2023-12-11T20:17:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.982+0000 7fe9f42b7b80 1 Processor -- start 2023-12-11T20:17:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9f42b7b80 1 -- start start 2023-12-11T20:17:22.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 0x55570c18b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c19c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c1a08d0 con 0x55570c18cc20 2023-12-11T20:17:22.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c182b50 con 0x55570c18bd30 2023-12-11T20:17:22.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c1963f0 con 0x55570c18b3d0 2023-12-11T20:17:22.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9dad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9dad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45468/0 (socket says 172.21.15.12:45468) 2023-12-11T20:17:22.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.983+0000 7fe9dad9d700 1 -- 172.21.15.12:0/104229420 learned_addr learned my addr 172.21.15.12:0/104229420 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9da59c700 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 0x55570c18b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9dad9d700 1 -- 172.21.15.12:0/104229420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 msgr2=0x55570c18b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 0x55570c18b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9dad9d700 1 -- 172.21.15.12:0/104229420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 msgr2=0x55570c19c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c19c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9dad9d700 1 -- 172.21.15.12:0/104229420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570bef1c60 con 0x55570c18cc20 2023-12-11T20:17:22.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9dad9d700 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18fbd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe9d401a000 tx=0x7fe9d4003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e5ec97148a6c51 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.984+0000 7fe9c97fa700 1 -- 172.21.15.12:0/104229420 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4004c10 con 0x55570c18cc20 2023-12-11T20:17:22.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9c97fa700 1 -- 172.21.15.12:0/104229420 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9d4004d70 con 0x55570c18cc20 2023-12-11T20:17:22.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9c97fa700 1 -- 172.21.15.12:0/104229420 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400e9b0 con 0x55570c18cc20 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/104229420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 msgr2=0x55570c18fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18fbd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe9d401a000 tx=0x7fe9d4003ab0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/104229420 shutdown_connections 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18cc20 0x55570c18fbd0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18b3d0 0x55570c18b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/104229420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18bd30 0x55570c19c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/104229420 >> 172.21.15.12:0/104229420 conn(0x55570c0ba7e0 msgr2=0x55570c1931f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.985+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/104229420 shutdown_connections 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.986+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/104229420 wait complete. 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.986+0000 7fe9f42b7b80 1 -- start start 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.986+0000 7fe9f42b7b80 1 Processor -- start 2023-12-11T20:17:22.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18b3d0 0x55570c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 0x55570c19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9f42b7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18cc20 0x55570c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c19c140 con 0x55570c18b3d0 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c19c2b0 con 0x55570c18cc20 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9f42b7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570c19c470 con 0x55570c18bd30 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9f42b7b80 10 client.0 _ll_register_callbacks cb 0x55570bfc4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9da59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18b3d0 0x55570c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9da59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18b3d0 0x55570c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45478/0 (socket says 172.21.15.12:45478) 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.987+0000 7fe9da59c700 1 -- 172.21.15.12:0/4182588423 learned_addr learned my addr 172.21.15.12:0/4182588423 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 0x55570c19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9da59c700 1 -- 172.21.15.12:0/4182588423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 msgr2=0x55570c19ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9da59c700 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 0x55570c19ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9da59c700 1 -- 172.21.15.12:0/4182588423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18cc20 msgr2=0x55570c19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:22.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9da59c700 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18cc20 0x55570c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9da59c700 1 -- 172.21.15.12:0/4182588423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55570bf5c630 con 0x55570c18b3d0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9da59c700 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18b3d0 0x55570c19a7f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0990f0 tx=0x7fe9cc0a2ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f62c3eb1ce13ed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/4182588423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc09b4a0 con 0x55570c18b3d0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/4182588423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9d400f040 con 0x55570c18b3d0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/4182588423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe9cc065080 con 0x55570c18b3d0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/4182588423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9cc0aed50 con 0x55570c18b3d0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9f42b7b80 10 client.15879 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.988+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/4182588423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55570bf2f250 con 0x55570c18b3d0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.989+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/4182588423 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9d400f040 con 0x55570c18b3d0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.989+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/4182588423 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe9cc096b90 con 0x55570c18b3d0 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.989+0000 7fe9f42b7b80 10 client.15879 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.989+0000 7fe9f42b7b80 10 client.15879 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:17:22.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.989+0000 7fe9f42b7b80 20 client.15879 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.989+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55570c1f7dd0 0x55570c1fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.989+0000 7fe9f42b7b80 4 client.15879 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.989+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/4182588423 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55570c0a5fd0 con 0x55570c1f7dd0 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.990+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55570c1f7dd0 0x55570c1fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.990+0000 7fe9d9d9b700 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55570c1f7dd0 0x55570c1fa1f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70637e34e65955d9 server_cookie=7e1bc6d12ac676a9 in_seq=0 out_seq=0 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.990+0000 7fe9c1ffb700 10 client.15879 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.990+0000 7fe9c1ffb700 1 -- 172.21.15.12:0/4182588423 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55570c0a5fd0 con 0x55570c1f7dd0 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.990+0000 7fe9c1ffb700 10 client.15879 handle_command_reply: tid=0 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.990+0000 7fe9f42b7b80 1 client.15879 shutdown 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/4182588423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18b3d0 msgr2=0x55570c19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18b3d0 0x55570c19a7f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0990f0 tx=0x7fe9cc0a2ef0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/4182588423 shutdown_connections 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55570c1f7dd0 0x55570c1fa1f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55570c18cc20 0x55570c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9c1ffb700 0 client.15879 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:17:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55570c18b3d0 0x55570c19a7f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 --2- 172.21.15.12:0/4182588423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55570c18bd30 0x55570c19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/4182588423 >> 172.21.15.12:0/4182588423 conn(0x55570c0ba7e0 msgr2=0x55570c187970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/4182588423 shutdown_connections 2023-12-11T20:17:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 1 -- 172.21.15.12:0/4182588423 wait complete. 2023-12-11T20:17:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.991+0000 7fe9f42b7b80 20 client.15879 trim_cache size 0 max 16384 2023-12-11T20:17:22.996 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 -- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9c40a1480 msgr2=0x7fe9c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9c40a1480 0x7fe9c40a3940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0011490 tx=0x7fe9d0009260 comp rx=0 tx=0).stop 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 -- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 msgr2=0x7fe9dc075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 0x7fe9dc075330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc000c00 tx=0x7fe9cc00f690 comp rx=0 tx=0).stop 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 -- 172.21.15.12:0/3912929148 shutdown_connections 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe9c40a1480 0x7fe9c40a3940 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9dc103040 0x7fe9dc073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9dc1014b0 0x7fe9dc075330 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 --2- 172.21.15.12:0/3912929148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9dc1026a0 0x7fe9dc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:22.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 -- 172.21.15.12:0/3912929148 >> 172.21.15.12:0/3912929148 conn(0x7fe9dc0fca00 msgr2=0x7fe9dc105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 -- 172.21.15.12:0/3912929148 shutdown_connections 2023-12-11T20:17:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:22.992+0000 7fe9e09ff700 1 -- 172.21.15.12:0/3912929148 wait complete. 2023-12-11T20:17:23.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:17:23.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 -- 172.21.15.12:0/3193491485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee81034f0 msgr2=0x7f9ee8103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 --2- 172.21.15.12:0/3193491485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee81034f0 0x7f9ee8103910 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0099c0 tx=0x7f9edc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 -- 172.21.15.12:0/3193491485 shutdown_connections 2023-12-11T20:17:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 --2- 172.21.15.12:0/3193491485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee8105080 0x7f9ee810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 --2- 172.21.15.12:0/3193491485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee81034f0 0x7f9ee8103910 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 --2- 172.21.15.12:0/3193491485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee81046e0 0x7f9ee8104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 -- 172.21.15.12:0/3193491485 >> 172.21.15.12:0/3193491485 conn(0x7f9ee80fea60 msgr2=0x7f9ee8100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 -- 172.21.15.12:0/3193491485 shutdown_connections 2023-12-11T20:17:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.250+0000 7f9eed99d700 1 -- 172.21.15.12:0/3193491485 wait complete. 2023-12-11T20:17:23.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.251+0000 7f9eed99d700 1 Processor -- start 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eed99d700 1 -- start start 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eed99d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee81034f0 0x7f9ee8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eed99d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee81046e0 0x7f9ee8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eed99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee8105080 0x7f9ee81a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eed99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81a0e40 con 0x7f9ee8105080 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eed99d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81a0f80 con 0x7f9ee81034f0 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eed99d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81a1110 con 0x7f9ee81046e0 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee81034f0 0x7f9ee8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee81046e0 0x7f9ee8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee81034f0 0x7f9ee8199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58532/0 (socket says 172.21.15.12:58532) 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eec99b700 1 -- 172.21.15.12:0/2493835965 learned_addr learned my addr 172.21.15.12:0/2493835965 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.252+0000 7f9eed19c700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee8105080 0x7f9ee81a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee7fff700 1 -- 172.21.15.12:0/2493835965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee81034f0 msgr2=0x7f9ee8199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee81034f0 0x7f9ee8199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee7fff700 1 -- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee8105080 msgr2=0x7f9ee81a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee8105080 0x7f9ee81a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee7fff700 1 -- 172.21.15.12:0/2493835965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0095f0 con 0x7f9ee81046e0 2023-12-11T20:17:23.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9eec99b700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee81034f0 0x7f9ee8199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:23.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee81046e0 0x7f9ee8199850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400d950 tx=0x7f9ed400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee5ffb700 1 -- 172.21.15.12:0/2493835965 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400f890 con 0x7f9ee81046e0 2023-12-11T20:17:23.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee5ffb700 1 -- 172.21.15.12:0/2493835965 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ed400fe80 con 0x7f9ee81046e0 2023-12-11T20:17:23.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9eed99d700 1 -- 172.21.15.12:0/2493835965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee81a13f0 con 0x7f9ee81046e0 2023-12-11T20:17:23.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.253+0000 7f9ee5ffb700 1 -- 172.21.15.12:0/2493835965 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400e3b0 con 0x7f9ee81046e0 2023-12-11T20:17:23.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.254+0000 7f9eed99d700 1 -- 172.21.15.12:0/2493835965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee81a1900 con 0x7f9ee81046e0 2023-12-11T20:17:23.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.258+0000 7f9ee5ffb700 1 -- 172.21.15.12:0/2493835965 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9ed400f9f0 con 0x7f9ee81046e0 2023-12-11T20:17:23.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.258+0000 7f9f02535b80 1 Processor -- start 2023-12-11T20:17:23.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.258+0000 7f9f02535b80 1 -- start start 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.258+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54ea9a60 0x55ea54ea9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.258+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eaa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.258+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54eaade0 0x55ea54eab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9f02535b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54e04b50 con 0x55ea54eaade0 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9f02535b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54e02470 con 0x55ea54eaa3c0 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9f02535b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54dfdd60 con 0x55ea54ea9a60 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54eaade0 0x55ea54eab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eaa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54eaade0 0x55ea54eab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45506/0 (socket says 172.21.15.12:45506) 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9ee7fff700 1 -- 172.21.15.12:0/3106633693 learned_addr learned my addr 172.21.15.12:0/3106633693 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9eed19c700 1 --2- 172.21.15.12:0/3106633693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54ea9a60 0x55ea54ea9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9eec99b700 1 -- 172.21.15.12:0/3106633693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54ea9a60 msgr2=0x55ea54ea9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9eec99b700 1 --2- 172.21.15.12:0/3106633693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54ea9a60 0x55ea54ea9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9eec99b700 1 -- 172.21.15.12:0/3106633693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54eaade0 msgr2=0x55ea54eab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9eec99b700 1 --2- 172.21.15.12:0/3106633693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54eaade0 0x55ea54eab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.259+0000 7f9eec99b700 1 -- 172.21.15.12:0/3106633693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea54c7a630 con 0x55ea54eaa3c0 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.260+0000 7f9eec99b700 1 --2- 172.21.15.12:0/3106633693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eaa8a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9edc000c00 tx=0x7f9edc005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe4089d40595a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.260+0000 7f9ee5ffb700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9ed80a1520 0x7f9ed80a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.260+0000 7f9ee5ffb700 1 -- 172.21.15.12:0/2493835965 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9ed40ccab0 con 0x7f9ee81046e0 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.260+0000 7f9ed2ffd700 1 -- 172.21.15.12:0/3106633693 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc01d050 con 0x55ea54eaa3c0 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.260+0000 7f9ed2ffd700 1 -- 172.21.15.12:0/3106633693 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9edc01e040 con 0x55ea54eaa3c0 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.260+0000 7f9ed2ffd700 1 -- 172.21.15.12:0/3106633693 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0049c0 con 0x55ea54eaa3c0 2023-12-11T20:17:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.260+0000 7f9eed19c700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9ed80a1520 0x7f9ed80a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 -- 172.21.15.12:0/3106633693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 msgr2=0x55ea54eaa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3106633693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eaa8a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9edc000c00 tx=0x7f9edc005bc0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9eed19c700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9ed80a1520 0x7f9ed80a39e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009990 tx=0x7f9ee0009130 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 -- 172.21.15.12:0/3106633693 shutdown_connections 2023-12-11T20:17:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3106633693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54eaade0 0x55ea54eab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3106633693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54ea9a60 0x55ea54ea9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3106633693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eaa8a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 -- 172.21.15.12:0/3106633693 >> 172.21.15.12:0/3106633693 conn(0x55ea54dd87e0 msgr2=0x55ea54ea43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 -- 172.21.15.12:0/3106633693 shutdown_connections 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.261+0000 7f9f02535b80 1 -- 172.21.15.12:0/3106633693 wait complete. 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.262+0000 7f9f02535b80 1 -- start start 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.262+0000 7f9f02535b80 1 Processor -- start 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eb3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 0x55ea54eba850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9f02535b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54db7560 con 0x55ea54ea9a60 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9f02535b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54db7200 con 0x55ea54eaa3c0 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9f02535b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54c7c920 con 0x55ea54eaade0 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9f02535b80 10 client.0 _ll_register_callbacks cb 0x55ea54ce2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45518/0 (socket says 172.21.15.12:45518) 2023-12-11T20:17:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9eec99b700 1 -- 172.21.15.12:0/2211908796 learned_addr learned my addr 172.21.15.12:0/2211908796 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eb3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.263+0000 7f9eed19c700 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 0x55ea54eba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.264+0000 7f9eec99b700 1 -- 172.21.15.12:0/2211908796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 msgr2=0x55ea54eba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.264+0000 7f9eec99b700 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 0x55ea54eba850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.264+0000 7f9eec99b700 1 -- 172.21.15.12:0/2211908796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 msgr2=0x55ea54eb3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.264+0000 7f9eec99b700 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eb3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.264+0000 7f9eec99b700 1 -- 172.21.15.12:0/2211908796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee810c280 con 0x55ea54ea9a60 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.264+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eb3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.264+0000 7f9eec99b700 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb32d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9edc003750 tx=0x7f9edc003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd9b7b395f3b872 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.264+0000 7f9ec7fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:23.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.265+0000 7f9ec7fff700 1 -- 172.21.15.12:0/2211908796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc004080 con 0x55ea54ea9a60 2023-12-11T20:17:23.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.265+0000 7f9ec7fff700 1 -- 172.21.15.12:0/2211908796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9edc005030 con 0x55ea54ea9a60 2023-12-11T20:17:23.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.265+0000 7f9f02535b80 1 -- 172.21.15.12:0/2211908796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea54e9c9e0 con 0x55ea54ea9a60 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.265+0000 7f9ec7fff700 1 -- 172.21.15.12:0/2211908796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9edc0041e0 con 0x55ea54ea9a60 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.265+0000 7f9f02535b80 10 client.15891 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.265+0000 7f9f02535b80 1 -- 172.21.15.12:0/2211908796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ea54c26de0 con 0x55ea54ea9a60 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.265+0000 7f9ec7fff700 1 -- 172.21.15.12:0/2211908796 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ea54e9c9e0 con 0x55ea54ea9a60 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.265+0000 7f9ec7fff700 1 -- 172.21.15.12:0/2211908796 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9edc023460 con 0x55ea54ea9a60 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.266+0000 7f9f02535b80 10 client.15891 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.266+0000 7f9f02535b80 10 client.15891 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.266+0000 7f9f02535b80 20 client.15891 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.266+0000 7f9f02535b80 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ea54ebec60 0x55ea54ec1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.266+0000 7f9f02535b80 4 client.15891 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.266+0000 7f9f02535b80 1 -- 172.21.15.12:0/2211908796 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea54e78f40 con 0x55ea54ebec60 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.266+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ea54ebec60 0x55ea54ec1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.267+0000 7f9ec7fff700 10 client.15891 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:17:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.267+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ea54ebec60 0x55ea54ec1050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d80b8206d6e0991f server_cookie=39508a3848039bec in_seq=0 out_seq=0 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.267+0000 7f9ec7fff700 1 -- 172.21.15.12:0/2211908796 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ea54e78f40 con 0x55ea54ebec60 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.267+0000 7f9ec7fff700 10 client.15891 handle_command_reply: tid=0 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 client.15891 shutdown 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 -- 172.21.15.12:0/2211908796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 msgr2=0x55ea54eb32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb32d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9edc003750 tx=0x7f9edc003a50 comp rx=0 tx=0).stop 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 -- 172.21.15.12:0/2211908796 shutdown_connections 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ea54ebec60 0x55ea54ec1050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 0x55ea54eba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9ec7fff700 0 client.15891 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb32d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 --2- 172.21.15.12:0/2211908796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54eb3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 -- 172.21.15.12:0/2211908796 >> 172.21.15.12:0/2211908796 conn(0x55ea54dd87e0 msgr2=0x55ea54ea8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 -- 172.21.15.12:0/2211908796 shutdown_connections 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 1 -- 172.21.15.12:0/2211908796 wait complete. 2023-12-11T20:17:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.268+0000 7f9f02535b80 20 client.15891 trim_cache size 0 max 16384 2023-12-11T20:17:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.285+0000 7f9f02535b80 1 Processor -- start 2023-12-11T20:17:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9f02535b80 1 -- start start 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaa3c0 0x55ea54eba810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaade0 0x55ea54ea4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9f02535b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54ea0b30 con 0x55ea54ea9a60 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9f02535b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54eb1da0 con 0x55ea54eaade0 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9f02535b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54e9f1e0 con 0x55ea54eaa3c0 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45520/0 (socket says 172.21.15.12:45520) 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9eec99b700 1 -- 172.21.15.12:0/431197664 learned_addr learned my addr 172.21.15.12:0/431197664 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaa3c0 0x55ea54eba810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.286+0000 7f9eed19c700 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaade0 0x55ea54ea4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9eec99b700 1 -- 172.21.15.12:0/431197664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaa3c0 msgr2=0x55ea54eba810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9eec99b700 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaa3c0 0x55ea54eba810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9eec99b700 1 -- 172.21.15.12:0/431197664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaade0 msgr2=0x55ea54ea4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9eec99b700 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaade0 0x55ea54ea4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9eec99b700 1 -- 172.21.15.12:0/431197664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea54c0fc60 con 0x55ea54ea9a60 2023-12-11T20:17:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9eed19c700 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaade0 0x55ea54ea4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9eec99b700 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eab1c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c010 tx=0x7f9edc00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6855405dc8cd8ae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9ed37fe700 1 -- 172.21.15.12:0/431197664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc01d070 con 0x55ea54ea9a60 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9ed37fe700 1 -- 172.21.15.12:0/431197664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9edc023b60 con 0x55ea54ea9a60 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.287+0000 7f9ed37fe700 1 -- 172.21.15.12:0/431197664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc004570 con 0x55ea54ea9a60 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 -- 172.21.15.12:0/431197664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 msgr2=0x55ea54eab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eab1c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c010 tx=0x7f9edc00b540 comp rx=0 tx=0).stop 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 -- 172.21.15.12:0/431197664 shutdown_connections 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaade0 0x55ea54ea4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eab1c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 --2- 172.21.15.12:0/431197664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaa3c0 0x55ea54eba810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 -- 172.21.15.12:0/431197664 >> 172.21.15.12:0/431197664 conn(0x55ea54dd87e0 msgr2=0x55ea54ea4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 -- 172.21.15.12:0/431197664 shutdown_connections 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.288+0000 7f9f02535b80 1 -- 172.21.15.12:0/431197664 wait complete. 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 1 -- start start 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 1 Processor -- start 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54f11120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 0x55ea54f13670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54f13bb0 con 0x55ea54ea9a60 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54f13cf0 con 0x55ea54eaa3c0 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea54f13e30 con 0x55ea54eaade0 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.289+0000 7f9f02535b80 10 client.0 _ll_register_callbacks cb 0x55ea54ce2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54f11120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9eec99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45522/0 (socket says 172.21.15.12:45522) 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9eec99b700 1 -- 172.21.15.12:0/3217983017 learned_addr learned my addr 172.21.15.12:0/3217983017 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9eed19c700 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 0x55ea54f13670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9ee7fff700 1 -- 172.21.15.12:0/3217983017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 msgr2=0x55ea54f13670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 0x55ea54f13670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9ee7fff700 1 -- 172.21.15.12:0/3217983017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 msgr2=0x55ea54eb0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9ee7fff700 1 -- 172.21.15.12:0/3217983017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea54c26de0 con 0x55ea54eaa3c0 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.290+0000 7f9eec99b700 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9ee7fff700 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54f11120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40a1b80 tx=0x7f9ed40ca3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67eee26ec8edb24b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9ec7fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9ec7fff700 1 -- 172.21.15.12:0/3217983017 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40106d0 con 0x55ea54eaa3c0 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9ec7fff700 1 -- 172.21.15.12:0/3217983017 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9ed400fca0 con 0x55ea54eaa3c0 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9f02535b80 1 -- 172.21.15.12:0/3217983017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9edc01e040 con 0x55ea54eaa3c0 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9ec7fff700 1 -- 172.21.15.12:0/3217983017 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ed409a420 con 0x55ea54eaa3c0 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9f02535b80 10 client.25685 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9f02535b80 1 -- 172.21.15.12:0/3217983017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ea54c4d250 con 0x55ea54eaa3c0 2023-12-11T20:17:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.291+0000 7f9ec7fff700 1 -- 172.21.15.12:0/3217983017 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ed40b8030 con 0x55ea54eaa3c0 2023-12-11T20:17:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.292+0000 7f9ec7fff700 1 -- 172.21.15.12:0/3217983017 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9ed4099210 con 0x55ea54eaa3c0 2023-12-11T20:17:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.292+0000 7f9f02535b80 10 client.25685 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.292+0000 7f9f02535b80 10 client.25685 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:17:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.292+0000 7f9f02535b80 20 client.25685 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.292+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ea54f15860 0x55ea54f17c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.292+0000 7f9f02535b80 4 client.25685 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:17:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.292+0000 7f9f02535b80 1 -- 172.21.15.12:0/3217983017 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ea54dc3fd0 con 0x55ea54f15860 2023-12-11T20:17:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.292+0000 7f9eec99b700 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ea54f15860 0x55ea54f17c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9eec99b700 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ea54f15860 0x55ea54f17c50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80768939ca7e666f server_cookie=bc8cf2ee2111130a in_seq=0 out_seq=0 2023-12-11T20:17:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9ec7fff700 10 client.25685 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:17:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9ec7fff700 1 -- 172.21.15.12:0/3217983017 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ea54dc3fd0 con 0x55ea54f15860 2023-12-11T20:17:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9ec7fff700 10 client.25685 handle_command_reply: tid=0 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 client.25685 shutdown 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 -- 172.21.15.12:0/3217983017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 msgr2=0x55ea54f11120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54f11120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40a1b80 tx=0x7f9ed40ca3d0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 -- 172.21.15.12:0/3217983017 shutdown_connections 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ea54f15860 0x55ea54f17c50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea54eaade0 0x55ea54f13670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea54ea9a60 0x55ea54eb0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 --2- 172.21.15.12:0/3217983017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea54eaa3c0 0x55ea54f11120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9ec7fff700 0 client.25685 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 -- 172.21.15.12:0/3217983017 >> 172.21.15.12:0/3217983017 conn(0x55ea54dd87e0 msgr2=0x55ea54ea4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.293+0000 7f9f02535b80 1 -- 172.21.15.12:0/3217983017 shutdown_connections 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9f02535b80 1 -- 172.21.15.12:0/3217983017 wait complete. 2023-12-11T20:17:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9f02535b80 20 client.25685 trim_cache size 0 max 16384 2023-12-11T20:17:23.296 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:17:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 -- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9ed80a1520 msgr2=0x7f9ed80a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9ed80a1520 0x7f9ed80a39e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009990 tx=0x7f9ee0009130 comp rx=0 tx=0).stop 2023-12-11T20:17:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 -- 172.21.15.12:0/2493835965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee81046e0 msgr2=0x7f9ee8199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee81046e0 0x7f9ee8199850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400d950 tx=0x7f9ed400dc60 comp rx=0 tx=0).stop 2023-12-11T20:17:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 -- 172.21.15.12:0/2493835965 shutdown_connections 2023-12-11T20:17:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9ed80a1520 0x7f9ed80a39e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ee81034f0 0x7f9ee8199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee8105080 0x7f9ee81a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 --2- 172.21.15.12:0/2493835965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ee81046e0 0x7f9ee8199850 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.294+0000 7f9eed99d700 1 -- 172.21.15.12:0/2493835965 >> 172.21.15.12:0/2493835965 conn(0x7f9ee80fea60 msgr2=0x7f9ee8107ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.295+0000 7f9eed99d700 1 -- 172.21.15.12:0/2493835965 shutdown_connections 2023-12-11T20:17:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.295+0000 7f9eed99d700 1 -- 172.21.15.12:0/2493835965 wait complete. 2023-12-11T20:17:23.310 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:23 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2821469070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:17:23.313 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:17:23.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:23 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2821469070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:17:23.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:23 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2821469070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:17:23.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.557+0000 7f948f9ff700 1 -- 172.21.15.12:0/188029353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94881048f0 msgr2=0x7f9488106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.557+0000 7f948f9ff700 1 --2- 172.21.15.12:0/188029353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94881048f0 0x7f9488106ce0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9478009990 tx=0x7f9478009ca0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.557+0000 7f948f9ff700 1 -- 172.21.15.12:0/188029353 shutdown_connections 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.557+0000 7f948f9ff700 1 --2- 172.21.15.12:0/188029353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9488107220 0x7f9488109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.557+0000 7f948f9ff700 1 --2- 172.21.15.12:0/188029353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9488101fc0 0x7f94881043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.557+0000 7f948f9ff700 1 --2- 172.21.15.12:0/188029353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94881048f0 0x7f9488106ce0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.557+0000 7f948f9ff700 1 -- 172.21.15.12:0/188029353 >> 172.21.15.12:0/188029353 conn(0x7f94880fb930 msgr2=0x7f94880fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.558+0000 7f948f9ff700 1 -- 172.21.15.12:0/188029353 shutdown_connections 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.558+0000 7f948f9ff700 1 -- 172.21.15.12:0/188029353 wait complete. 2023-12-11T20:17:23.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.559+0000 7f948f9ff700 1 Processor -- start 2023-12-11T20:17:23.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.559+0000 7f948f9ff700 1 -- start start 2023-12-11T20:17:23.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.559+0000 7f948f9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9488101fc0 0x7f94881995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.559+0000 7f948f9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94881048f0 0x7f9488199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.559+0000 7f948f9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9488107220 0x7f94881a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.559+0000 7f948f9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94881a10e0 con 0x7f9488107220 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.559+0000 7f948f9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94881a1220 con 0x7f94881048f0 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.559+0000 7f948f9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94881a13b0 con 0x7f9488101fc0 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948cf9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94881048f0 0x7f9488199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948cf9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94881048f0 0x7f9488199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58598/0 (socket says 172.21.15.12:58598) 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9488107220 0x7f94881a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948cf9a700 1 -- 172.21.15.12:0/2362410940 learned_addr learned my addr 172.21.15.12:0/2362410940 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948d79b700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9488101fc0 0x7f94881995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948cf9a700 1 -- 172.21.15.12:0/2362410940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9488101fc0 msgr2=0x7f94881995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948cf9a700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9488101fc0 0x7f94881995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948cf9a700 1 -- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9488107220 msgr2=0x7f94881a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948cf9a700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9488107220 0x7f94881a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948cf9a700 1 -- 172.21.15.12:0/2362410940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94780095f0 con 0x7f94881048f0 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.560+0000 7f948d79b700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9488101fc0 0x7f94881995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:23.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.561+0000 7f948cf9a700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94881048f0 0x7f9488199af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94780098e0 tx=0x7f9478005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.561+0000 7f947e7fc700 1 -- 172.21.15.12:0/2362410940 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947801d070 con 0x7f94881048f0 2023-12-11T20:17:23.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.561+0000 7f948f9ff700 1 -- 172.21.15.12:0/2362410940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94881a1630 con 0x7f94881048f0 2023-12-11T20:17:23.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.561+0000 7f947e7fc700 1 -- 172.21.15.12:0/2362410940 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9478004000 con 0x7f94881048f0 2023-12-11T20:17:23.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.561+0000 7f947e7fc700 1 -- 172.21.15.12:0/2362410940 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478022ca0 con 0x7f94881048f0 2023-12-11T20:17:23.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.561+0000 7f948f9ff700 1 -- 172.21.15.12:0/2362410940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94881a1ab0 con 0x7f94881048f0 2023-12-11T20:17:23.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.565+0000 7f947e7fc700 1 -- 172.21.15.12:0/2362410940 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9478022470 con 0x7f94881048f0 2023-12-11T20:17:23.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.566+0000 7f94a3269b80 1 Processor -- start 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.566+0000 7f94a3269b80 1 -- start start 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.566+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a1b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1bc20 0x55afd0a1c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f94a3269b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0975b50 con 0x55afd0a1a3d0 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f94a3269b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0973470 con 0x55afd0a1ad30 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f94a3269b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd096ed60 con 0x55afd0a1bc20 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f947e7fc700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94740a1480 0x7f94740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f948cf9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1bc20 0x55afd0a1c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f948d79b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a1b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f948df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f947e7fc700 1 -- 172.21.15.12:0/2362410940 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f94780ce2b0 con 0x7f94881048f0 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f948d79b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a1b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58600/0 (socket says 172.21.15.12:58600) 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f948d79b700 1 -- 172.21.15.12:0/1083762725 learned_addr learned my addr 172.21.15.12:0/1083762725 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.567+0000 7f948df9c700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94740a1480 0x7f94740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f948cf9a700 1 -- 172.21.15.12:0/1083762725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 msgr2=0x55afd0a1b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f948cf9a700 1 --2- 172.21.15.12:0/1083762725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a1b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f948cf9a700 1 -- 172.21.15.12:0/1083762725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1a3d0 msgr2=0x55afd0a1a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f948cf9a700 1 --2- 172.21.15.12:0/1083762725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f948cf9a700 1 -- 172.21.15.12:0/1083762725 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afd07eb630 con 0x55afd0a1bc20 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f948df9c700 1 --2- 172.21.15.12:0/1083762725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f948cf9a700 1 --2- 172.21.15.12:0/1083762725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1bc20 0x55afd0a1c0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94780cbd00 tx=0x7f9478090d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abe62d3779af360f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f948df9c700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94740a1480 0x7f94740a3940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9480009fd0 tx=0x7f9480009130 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f94737fe700 1 -- 172.21.15.12:0/1083762725 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780860d0 con 0x55afd0a1bc20 2023-12-11T20:17:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f94737fe700 1 -- 172.21.15.12:0/1083762725 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f947809af10 con 0x55afd0a1bc20 2023-12-11T20:17:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.568+0000 7f94737fe700 1 -- 172.21.15.12:0/1083762725 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780a38b0 con 0x55afd0a1bc20 2023-12-11T20:17:23.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 -- 172.21.15.12:0/1083762725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1bc20 msgr2=0x55afd0a1c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1083762725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1bc20 0x55afd0a1c0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94780cbd00 tx=0x7f9478090d70 comp rx=0 tx=0).stop 2023-12-11T20:17:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 -- 172.21.15.12:0/1083762725 shutdown_connections 2023-12-11T20:17:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1083762725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1bc20 0x55afd0a1c0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1083762725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1083762725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a1b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 -- 172.21.15.12:0/1083762725 >> 172.21.15.12:0/1083762725 conn(0x55afd09497e0 msgr2=0x55afd0a16d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 -- 172.21.15.12:0/1083762725 shutdown_connections 2023-12-11T20:17:23.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.569+0000 7f94a3269b80 1 -- 172.21.15.12:0/1083762725 wait complete. 2023-12-11T20:17:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.570+0000 7f94a3269b80 1 -- start start 2023-12-11T20:17:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.570+0000 7f94a3269b80 1 Processor -- start 2023-12-11T20:17:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a23e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a24360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f94a3269b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0928560 con 0x55afd0a1bc20 2023-12-11T20:17:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f94a3269b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0928200 con 0x55afd0a1ad30 2023-12-11T20:17:23.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f94a3269b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd07ed920 con 0x55afd0a1a3d0 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f94a3269b80 10 client.0 _ll_register_callbacks cb 0x55afd0853a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948cf9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a24360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45562/0 (socket says 172.21.15.12:45562) 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948df9c700 1 -- 172.21.15.12:0/3115008727 learned_addr learned my addr 172.21.15.12:0/3115008727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948d79b700 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a23e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948df9c700 1 -- 172.21.15.12:0/3115008727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 msgr2=0x55afd0a23e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948df9c700 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a23e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948df9c700 1 -- 172.21.15.12:0/3115008727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 msgr2=0x55afd0a24360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948df9c700 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a24360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948df9c700 1 -- 172.21.15.12:0/3115008727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9480011040 con 0x55afd0a1bc20 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.571+0000 7f948cf9a700 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a24360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.572+0000 7f948df9c700 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b3a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9480019a50 tx=0x7f9480004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b32ce52dc5732f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.572+0000 7f9470ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.572+0000 7f9470ff9700 1 -- 172.21.15.12:0/3115008727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480021070 con 0x55afd0a1bc20 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.572+0000 7f94a3269b80 1 -- 172.21.15.12:0/3115008727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55afd0a0db40 con 0x55afd0a1bc20 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.572+0000 7f9470ff9700 1 -- 172.21.15.12:0/3115008727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9480004bb0 con 0x55afd0a1bc20 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.572+0000 7f9470ff9700 1 -- 172.21.15.12:0/3115008727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9480004d70 con 0x55afd0a1bc20 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f94a3269b80 10 client.15909 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f94a3269b80 1 -- 172.21.15.12:0/3115008727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f94881a1ab0 con 0x55afd0a1bc20 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f9470ff9700 1 -- 172.21.15.12:0/3115008727 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55afd0a0db40 con 0x55afd0a1bc20 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f9470ff9700 1 -- 172.21.15.12:0/3115008727 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f94800045d0 con 0x55afd0a1bc20 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f94a3269b80 10 client.15909 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f94a3269b80 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f94a3269b80 20 client.15909 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:23.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afd0a2fcf0 0x55afd0a32110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f94a3269b80 4 client.15909 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:23.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.573+0000 7f94a3269b80 1 -- 172.21.15.12:0/3115008727 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55afd09e9f40 con 0x55afd0a2fcf0 2023-12-11T20:17:23.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.574+0000 7f948d79b700 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afd0a2fcf0 0x55afd0a32110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.574+0000 7f9470ff9700 10 client.15909 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:23.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.574+0000 7f948d79b700 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afd0a2fcf0 0x55afd0a32110 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86a7b9aec085617 server_cookie=f42cc9ef804bba54 in_seq=0 out_seq=0 2023-12-11T20:17:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f9470ff9700 1 -- 172.21.15.12:0/3115008727 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55afd09e9f40 con 0x55afd0a2fcf0 2023-12-11T20:17:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f9470ff9700 10 client.15909 handle_command_reply: tid=0 2023-12-11T20:17:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 client.15909 shutdown 2023-12-11T20:17:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 -- 172.21.15.12:0/3115008727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 msgr2=0x55afd0a2b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b3a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9480019a50 tx=0x7f9480004ad0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 -- 172.21.15.12:0/3115008727 shutdown_connections 2023-12-11T20:17:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afd0a2fcf0 0x55afd0a32110 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b3a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a23e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f9470ff9700 0 client.15909 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3115008727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a24360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.575+0000 7f94a3269b80 1 -- 172.21.15.12:0/3115008727 >> 172.21.15.12:0/3115008727 conn(0x55afd09497e0 msgr2=0x55afd0a15a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.576+0000 7f94a3269b80 1 -- 172.21.15.12:0/3115008727 shutdown_connections 2023-12-11T20:17:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.576+0000 7f94a3269b80 1 -- 172.21.15.12:0/3115008727 wait complete. 2023-12-11T20:17:23.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.576+0000 7f94a3269b80 20 client.15909 trim_cache size 0 max 16384 2023-12-11T20:17:23.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.591+0000 7f94a3269b80 1 Processor -- start 2023-12-11T20:17:23.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.591+0000 7f94a3269b80 1 -- start start 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1ad30 0x55afd0a23330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f94a3269b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0a2c550 con 0x55afd0a1ad30 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f94a3269b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0a239c0 con 0x55afd0a1bc20 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f94a3269b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0a22e50 con 0x55afd0a1a3d0 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f948cf9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1ad30 0x55afd0a23330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f948cf9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1ad30 0x55afd0a23330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45564/0 (socket says 172.21.15.12:45564) 2023-12-11T20:17:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f948cf9a700 1 -- 172.21.15.12:0/3588264031 learned_addr learned my addr 172.21.15.12:0/3588264031 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f948d79b700 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.592+0000 7f948df9c700 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f948cf9a700 1 -- 172.21.15.12:0/3588264031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 msgr2=0x55afd0a1c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f948cf9a700 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f948cf9a700 1 -- 172.21.15.12:0/3588264031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1bc20 msgr2=0x55afd0a2b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f948cf9a700 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f948cf9a700 1 -- 172.21.15.12:0/3588264031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afd0797de0 con 0x55afd0a1ad30 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f948d79b700 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f948cf9a700 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1ad30 0x55afd0a23330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f94780ce560 tx=0x7f947809b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cb7fe69d4797a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f9473fff700 1 -- 172.21.15.12:0/3588264031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780860d0 con 0x55afd0a1ad30 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f9473fff700 1 -- 172.21.15.12:0/3588264031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9478004170 con 0x55afd0a1ad30 2023-12-11T20:17:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.593+0000 7f9473fff700 1 -- 172.21.15.12:0/3588264031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478099a20 con 0x55afd0a1ad30 2023-12-11T20:17:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 -- 172.21.15.12:0/3588264031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1ad30 msgr2=0x55afd0a23330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1ad30 0x55afd0a23330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f94780ce560 tx=0x7f947809b5b0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 -- 172.21.15.12:0/3588264031 shutdown_connections 2023-12-11T20:17:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1bc20 0x55afd0a2b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a1c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 --2- 172.21.15.12:0/3588264031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1ad30 0x55afd0a23330 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 -- 172.21.15.12:0/3588264031 >> 172.21.15.12:0/3588264031 conn(0x55afd09497e0 msgr2=0x55afd0a22110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 -- 172.21.15.12:0/3588264031 shutdown_connections 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 -- 172.21.15.12:0/3588264031 wait complete. 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.594+0000 7f94a3269b80 1 -- start start 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.595+0000 7f94a3269b80 1 Processor -- start 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.595+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a26a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.595+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a26f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.595+0000 7f94a3269b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a29ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.595+0000 7f94a3269b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0a2a420 con 0x55afd0a1bc20 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.595+0000 7f94a3269b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0a2a590 con 0x55afd0a1ad30 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.595+0000 7f94a3269b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afd0a2a750 con 0x55afd0a1a3d0 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.595+0000 7f94a3269b80 10 client.0 _ll_register_callbacks cb 0x55afd0853a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a29ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a29ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45566/0 (socket says 172.21.15.12:45566) 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 -- 172.21.15.12:0/1521600566 learned_addr learned my addr 172.21.15.12:0/1521600566 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948cf9a700 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a26f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948d79b700 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a26a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 -- 172.21.15.12:0/1521600566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 msgr2=0x55afd0a26a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a26a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 -- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 msgr2=0x55afd0a26f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a26f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 -- 172.21.15.12:0/1521600566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9484004410 con 0x55afd0a1bc20 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948cf9a700 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a26f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f948df9c700 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a29ee0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f948000b010 tx=0x7f9480004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1180170b9b062fc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.596+0000 7f9470ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.597+0000 7f9470ff9700 1 -- 172.21.15.12:0/1521600566 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480021040 con 0x55afd0a1bc20 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.597+0000 7f94a3269b80 1 -- 172.21.15.12:0/1521600566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f947809af10 con 0x55afd0a1bc20 2023-12-11T20:17:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.597+0000 7f9470ff9700 1 -- 172.21.15.12:0/1521600566 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9480007990 con 0x55afd0a1bc20 2023-12-11T20:17:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.597+0000 7f9470ff9700 1 -- 172.21.15.12:0/1521600566 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f948001c250 con 0x55afd0a1bc20 2023-12-11T20:17:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.597+0000 7f94a3269b80 10 client.15915 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.597+0000 7f94a3269b80 1 -- 172.21.15.12:0/1521600566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55afd07eb630 con 0x55afd0a1bc20 2023-12-11T20:17:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.597+0000 7f9470ff9700 1 -- 172.21.15.12:0/1521600566 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f947809af10 con 0x55afd0a1bc20 2023-12-11T20:17:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.597+0000 7f9470ff9700 1 -- 172.21.15.12:0/1521600566 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9480037030 con 0x55afd0a1bc20 2023-12-11T20:17:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.598+0000 7f94a3269b80 10 client.15915 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.598+0000 7f94a3269b80 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.598+0000 7f94a3269b80 20 client.15915 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.598+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afd0a86a10 0x55afd0a88e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.598+0000 7f94a3269b80 4 client.15915 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.598+0000 7f94a3269b80 1 -- 172.21.15.12:0/1521600566 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55afd0934fd0 con 0x55afd0a86a10 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.598+0000 7f948d79b700 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afd0a86a10 0x55afd0a88e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f948d79b700 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afd0a86a10 0x55afd0a88e30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7e1ee7a845b0cd7 server_cookie=84ac5e8a8e378dd in_seq=0 out_seq=0 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f9470ff9700 10 client.15915 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f9470ff9700 1 -- 172.21.15.12:0/1521600566 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55afd0934fd0 con 0x55afd0a86a10 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f9470ff9700 10 client.15915 handle_command_reply: tid=0 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 client.15915 shutdown 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 -- 172.21.15.12:0/1521600566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 msgr2=0x55afd0a29ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a29ee0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f948000b010 tx=0x7f9480004d70 comp rx=0 tx=0).stop 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 -- 172.21.15.12:0/1521600566 shutdown_connections 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afd0a86a10 0x55afd0a88e30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afd0a1bc20 0x55afd0a29ee0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afd0a1a3d0 0x55afd0a26a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f9470ff9700 0 client.15915 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 --2- 172.21.15.12:0/1521600566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afd0a1ad30 0x55afd0a26f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.599+0000 7f94a3269b80 1 -- 172.21.15.12:0/1521600566 >> 172.21.15.12:0/1521600566 conn(0x55afd09497e0 msgr2=0x55afd0a23dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.600+0000 7f94a3269b80 1 -- 172.21.15.12:0/1521600566 shutdown_connections 2023-12-11T20:17:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.600+0000 7f94a3269b80 1 -- 172.21.15.12:0/1521600566 wait complete. 2023-12-11T20:17:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.600+0000 7f94a3269b80 20 client.15915 trim_cache size 0 max 16384 2023-12-11T20:17:23.601 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:17:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.600+0000 7f948f9ff700 1 -- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94740a1480 msgr2=0x7f94740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.600+0000 7f948f9ff700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94740a1480 0x7f94740a3940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9480009fd0 tx=0x7f9480009130 comp rx=0 tx=0).stop 2023-12-11T20:17:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.600+0000 7f948f9ff700 1 -- 172.21.15.12:0/2362410940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94881048f0 msgr2=0x7f9488199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.600+0000 7f948f9ff700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94881048f0 0x7f9488199af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94780098e0 tx=0x7f9478005f10 comp rx=0 tx=0).stop 2023-12-11T20:17:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.601+0000 7f948f9ff700 1 -- 172.21.15.12:0/2362410940 shutdown_connections 2023-12-11T20:17:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.601+0000 7f948f9ff700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f94740a1480 0x7f94740a3940 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.601+0000 7f948f9ff700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9488107220 0x7f94881a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.601+0000 7f948f9ff700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9488101fc0 0x7f94881995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.601+0000 7f948f9ff700 1 --2- 172.21.15.12:0/2362410940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94881048f0 0x7f9488199af0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:23.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.601+0000 7f948f9ff700 1 -- 172.21.15.12:0/2362410940 >> 172.21.15.12:0/2362410940 conn(0x7f94880fb930 msgr2=0x7f94881016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:23.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.601+0000 7f948f9ff700 1 -- 172.21.15.12:0/2362410940 shutdown_connections 2023-12-11T20:17:23.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:23.601+0000 7f948f9ff700 1 -- 172.21.15.12:0/2362410940 wait complete. 2023-12-11T20:17:24.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:24 smithi032 ceph-mon[132488]: pgmap v419: 97 pgs: 97 active+clean; 30 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-11T20:17:24.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:24 smithi039 ceph-mon[102205]: pgmap v419: 97 pgs: 97 active+clean; 30 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-11T20:17:24.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:24 smithi012 ceph-mon[128787]: pgmap v419: 97 pgs: 97 active+clean; 30 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 2.4 MiB/s wr, 96 op/s 2023-12-11T20:17:24.620 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:17:24.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:17:24.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 -- 172.21.15.12:0/1288534176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc1026a0 msgr2=0x7fc2cc102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/1288534176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc1026a0 0x7fc2cc102b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00099c0 tx=0x7fc2c0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 -- 172.21.15.12:0/1288534176 shutdown_connections 2023-12-11T20:17:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/1288534176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2cc103040 0x7fc2cc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/1288534176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2cc1014b0 0x7fc2cc1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/1288534176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc1026a0 0x7fc2cc102b00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 -- 172.21.15.12:0/1288534176 >> 172.21.15.12:0/1288534176 conn(0x7fc2cc0fca00 msgr2=0x7fc2cc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 -- 172.21.15.12:0/1288534176 shutdown_connections 2023-12-11T20:17:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.867+0000 7fc2d25ff700 1 -- 172.21.15.12:0/1288534176 wait complete. 2023-12-11T20:17:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.869+0000 7fc2d25ff700 1 Processor -- start 2023-12-11T20:17:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.869+0000 7fc2d25ff700 1 -- start start 2023-12-11T20:17:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.869+0000 7fc2d25ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2cc1014b0 0x7fc2cc075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.869+0000 7fc2d25ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2cc1026a0 0x7fc2cc0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.869+0000 7fc2d25ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc103040 0x7fc2cc073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.869+0000 7fc2d25ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0746a0 con 0x7fc2cc103040 2023-12-11T20:17:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.869+0000 7fc2d25ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc074810 con 0x7fc2cc1014b0 2023-12-11T20:17:24.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.869+0000 7fc2d25ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc1a13a0 con 0x7fc2cc1026a0 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2cb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2cc1026a0 0x7fc2cc0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2d0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc103040 0x7fc2cc073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2cb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2cc1026a0 0x7fc2cc0739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:45908/0 (socket says 172.21.15.12:45908) 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2cb7fe700 1 -- 172.21.15.12:0/3002710922 learned_addr learned my addr 172.21.15.12:0/3002710922 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2cc1014b0 0x7fc2cc075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2d0b9c700 1 -- 172.21.15.12:0/3002710922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2cc1026a0 msgr2=0x7fc2cc0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2cc1026a0 0x7fc2cc0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2d0b9c700 1 -- 172.21.15.12:0/3002710922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2cc1014b0 msgr2=0x7fc2cc075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2cc1014b0 0x7fc2cc075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2d0b9c700 1 -- 172.21.15.12:0/3002710922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c00095f0 con 0x7fc2cc103040 2023-12-11T20:17:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2cc1026a0 0x7fc2cc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.870+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc103040 0x7fc2cc073f00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4007f10 tx=0x7fc2c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.871+0000 7fc2c97fa700 1 -- 172.21.15.12:0/3002710922 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4004db0 con 0x7fc2cc103040 2023-12-11T20:17:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.871+0000 7fc2c97fa700 1 -- 172.21.15.12:0/3002710922 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2c400f040 con 0x7fc2cc103040 2023-12-11T20:17:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.871+0000 7fc2d25ff700 1 -- 172.21.15.12:0/3002710922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc1a1630 con 0x7fc2cc103040 2023-12-11T20:17:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.871+0000 7fc2c97fa700 1 -- 172.21.15.12:0/3002710922 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4005860 con 0x7fc2cc103040 2023-12-11T20:17:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.871+0000 7fc2d25ff700 1 -- 172.21.15.12:0/3002710922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc1a1af0 con 0x7fc2cc103040 2023-12-11T20:17:24.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.874+0000 7fc2c97fa700 1 -- 172.21.15.12:0/3002710922 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc2c400dac0 con 0x7fc2cc103040 2023-12-11T20:17:24.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.875+0000 7fc2e5ebeb80 1 Processor -- start 2023-12-11T20:17:24.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2e5ebeb80 1 -- start start 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2c97fa700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2b40a1480 0x7fc2b40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431f3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d431f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431f5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d4314ebd0 con 0x564d431f3db0 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d4314c4f0 con 0x564d431f4ca0 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d43147de0 con 0x564d431f3450 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2c97fa700 1 -- 172.21.15.12:0/3002710922 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc2c40cc640 con 0x7fc2cc103040 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.876+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2b40a1480 0x7fc2b40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431f3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:45914/0 (socket says 172.21.15.12:45914) 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cbfff700 1 -- 172.21.15.12:0/2597530924 learned_addr learned my addr 172.21.15.12:0/2597530924 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d431f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cbfff700 1 -- 172.21.15.12:0/2597530924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 msgr2=0x564d431f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cbfff700 1 -- 172.21.15.12:0/2597530924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 msgr2=0x564d431f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d431f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cbfff700 1 -- 172.21.15.12:0/2597530924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d42fc46b0 con 0x564d431f3450 2023-12-11T20:17:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.877+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2b40a1480 0x7fc2b40a3940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c010 tx=0x7fc2c0005c00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.878+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431f3870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00bd40 tx=0x7fc2bc0106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ae029e4da75c7a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.878+0000 7fc2b27fc700 1 -- 172.21.15.12:0/2597530924 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc010e10 con 0x564d431f3450 2023-12-11T20:17:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.878+0000 7fc2b27fc700 1 -- 172.21.15.12:0/2597530924 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2bc015070 con 0x564d431f3450 2023-12-11T20:17:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.878+0000 7fc2b27fc700 1 -- 172.21.15.12:0/2597530924 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc004e10 con 0x564d431f3450 2023-12-11T20:17:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2597530924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 msgr2=0x564d431f3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431f3870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00bd40 tx=0x7fc2bc0106b0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2597530924 shutdown_connections 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431f3870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2597530924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d431f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2597530924 >> 172.21.15.12:0/2597530924 conn(0x564d43122860 msgr2=0x564d431efe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2597530924 shutdown_connections 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2597530924 wait complete. 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.879+0000 7fc2e5ebeb80 1 -- start start 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.880+0000 7fc2e5ebeb80 1 Processor -- start 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.880+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.880+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f3db0 0x564d431fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.880+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f4ca0 0x564d432047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.880+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d431015e0 con 0x564d431f4ca0 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.880+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d43101280 con 0x564d431f3db0 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.880+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d42fc69a0 con 0x564d431f3450 2023-12-11T20:17:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.880+0000 7fc2e5ebeb80 10 client.0 _ll_register_callbacks cb 0x564d4302cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:45924/0 (socket says 172.21.15.12:45924) 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 -- 172.21.15.12:0/872957558 learned_addr learned my addr 172.21.15.12:0/872957558 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f4ca0 0x564d432047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f3db0 0x564d431fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 -- 172.21.15.12:0/872957558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f3db0 msgr2=0x564d431fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f3db0 0x564d431fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 -- 172.21.15.12:0/872957558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f4ca0 msgr2=0x564d432047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f4ca0 0x564d432047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 -- 172.21.15.12:0/872957558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc1a1af0 con 0x564d431f3450 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f4ca0 0x564d432047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00b690 tx=0x7fc2bc010e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21f520f9c0bbdac0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:24.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.881+0000 7fc2ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:17:24.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.882+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/872957558 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc020070 con 0x564d431f3450 2023-12-11T20:17:24.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.882+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/872957558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d431e6bc0 con 0x564d431f3450 2023-12-11T20:17:24.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.882+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/872957558 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc2bc017070 con 0x564d431f3450 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.882+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/872957558 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2bc004250 con 0x564d431f3450 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.882+0000 7fc2e5ebeb80 10 client.25714 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.882+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/872957558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fc2bc00b9a0 con 0x564d431f3450 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.883+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/872957558 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2bc033080 con 0x564d431f3450 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.883+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/872957558 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc2bc011440 con 0x564d431f3450 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.883+0000 7fc2e5ebeb80 10 client.25714 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.883+0000 7fc2e5ebeb80 10 client.25714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.883+0000 7fc2e5ebeb80 20 client.25714 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.883+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564d43208fd0 0x564d4320b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.883+0000 7fc2e5ebeb80 4 client.25714 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.883+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/872957558 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d431c2fc0 con 0x564d43208fd0 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.884+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564d43208fd0 0x564d4320b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.884+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564d43208fd0 0x564d4320b3f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80948647aba7b69a server_cookie=242d49082176dcb8 in_seq=0 out_seq=0 2023-12-11T20:17:24.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.884+0000 7fc2ab7fe700 10 client.25714 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/872957558 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564d431c2fc0 con 0x564d43208fd0 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2ab7fe700 10 client.25714 handle_command_reply: tid=0 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 client.25714 shutdown 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/872957558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 msgr2=0x564d431fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00b690 tx=0x7fc2bc010e40 comp rx=0 tx=0).stop 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/872957558 shutdown_connections 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564d43208fd0 0x564d4320b3f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f4ca0 0x564d432047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd220 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2ab7fe700 0 client.25714 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/872957558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f3db0 0x564d431fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.885+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/872957558 >> 172.21.15.12:0/872957558 conn(0x564d43122860 msgr2=0x564d431eeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.886+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/872957558 shutdown_connections 2023-12-11T20:17:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.886+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/872957558 wait complete. 2023-12-11T20:17:24.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.886+0000 7fc2e5ebeb80 20 client.25714 trim_cache size 0 max 16384 2023-12-11T20:17:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.904+0000 7fc2e5ebeb80 1 Processor -- start 2023-12-11T20:17:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2e5ebeb80 1 -- start start 2023-12-11T20:17:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d432046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431ee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d43204c00 con 0x564d431f3db0 2023-12-11T20:17:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d43210600 con 0x564d431f4ca0 2023-12-11T20:17:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d431eabd0 con 0x564d431f3450 2023-12-11T20:17:24.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d432046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d432046c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45618/0 (socket says 172.21.15.12:45618) 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2cb7fe700 1 -- 172.21.15.12:0/2784652568 learned_addr learned my addr 172.21.15.12:0/2784652568 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.905+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431ee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2cb7fe700 1 -- 172.21.15.12:0/2784652568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 msgr2=0x564d431fd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2cb7fe700 1 -- 172.21.15.12:0/2784652568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 msgr2=0x564d431ee0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431ee0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2cb7fe700 1 -- 172.21.15.12:0/2784652568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d42f70e60 con 0x564d431f3db0 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d432046c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009990 tx=0x7fc2c001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc006800cd5a0572 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2b2ffd700 1 -- 172.21.15.12:0/2784652568 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c002e070 con 0x564d431f3db0 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2b2ffd700 1 -- 172.21.15.12:0/2784652568 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2c002f040 con 0x564d431f3db0 2023-12-11T20:17:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.906+0000 7fc2b2ffd700 1 -- 172.21.15.12:0/2784652568 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00374d0 con 0x564d431f3db0 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2784652568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 msgr2=0x564d432046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d432046c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009990 tx=0x7fc2c001d000 comp rx=0 tx=0).stop 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2784652568 shutdown_connections 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d431ee0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3450 0x564d431fd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2784652568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3db0 0x564d432046c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2784652568 >> 172.21.15.12:0/2784652568 conn(0x564d43122860 msgr2=0x564d431fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2784652568 shutdown_connections 2023-12-11T20:17:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.907+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2784652568 wait complete. 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.908+0000 7fc2e5ebeb80 1 -- start start 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.908+0000 7fc2e5ebeb80 1 Processor -- start 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3450 0x564d432046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3db0 0x564d4325d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2e5ebeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d4325fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d43260230 con 0x564d431f3450 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d432603a0 con 0x564d431f4ca0 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2e5ebeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d43260560 con 0x564d431f3db0 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2e5ebeb80 10 client.0 _ll_register_callbacks cb 0x564d4302cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3450 0x564d432046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3450 0x564d432046c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45626/0 (socket says 172.21.15.12:45626) 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2cbfff700 1 -- 172.21.15.12:0/2030710121 learned_addr learned my addr 172.21.15.12:0/2030710121 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3db0 0x564d4325d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.909+0000 7fc2d0b9c700 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d4325fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2cbfff700 1 -- 172.21.15.12:0/2030710121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3db0 msgr2=0x564d4325d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:24.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3db0 0x564d4325d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2cbfff700 1 -- 172.21.15.12:0/2030710121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 msgr2=0x564d4325fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:24.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d4325fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2cbfff700 1 -- 172.21.15.12:0/2030710121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c0020040 con 0x564d431f3450 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2cbfff700 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3450 0x564d432046c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc001eb0 tx=0x7fc2bc00bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e97d64e0a908c6a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/2030710121 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc020070 con 0x564d431f3450 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/2030710121 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc2bc000e40 con 0x564d431f3450 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.910+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2030710121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2bc015070 con 0x564d431f3450 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/2030710121 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2bc010eb0 con 0x564d431f3450 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2e5ebeb80 10 client.15933 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2030710121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x564d42f59ce0 con 0x564d431f3450 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/2030710121 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2bc040080 con 0x564d431f3450 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/2030710121 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc2bc003910 con 0x564d431f3450 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2e5ebeb80 10 client.15933 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2e5ebeb80 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2e5ebeb80 20 client.15933 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564d43261c90 0x564d432640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2e5ebeb80 4 client.15933 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:17:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.911+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2030710121 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564d4310e050 con 0x564d43261c90 2023-12-11T20:17:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.912+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564d43261c90 0x564d432640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.912+0000 7fc2cb7fe700 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564d43261c90 0x564d432640b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72c75bbcb193b7f7 server_cookie=7033a18eda9a9bac in_seq=0 out_seq=0 2023-12-11T20:17:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.912+0000 7fc2ab7fe700 10 client.15933 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2ab7fe700 1 -- 172.21.15.12:0/2030710121 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564d4310e050 con 0x564d43261c90 2023-12-11T20:17:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2ab7fe700 10 client.15933 handle_command_reply: tid=0 2023-12-11T20:17:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 client.15933 shutdown 2023-12-11T20:17:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2030710121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3450 msgr2=0x564d432046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3450 0x564d432046c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc001eb0 tx=0x7fc2bc00bc70 comp rx=0 tx=0).stop 2023-12-11T20:17:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2030710121 shutdown_connections 2023-12-11T20:17:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564d43261c90 0x564d432640b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564d431f4ca0 0x564d4325fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d431f3450 0x564d432046c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2ab7fe700 0 client.15933 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 --2- 172.21.15.12:0/2030710121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d431f3db0 0x564d4325d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.914+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2030710121 >> 172.21.15.12:0/2030710121 conn(0x564d43122860 msgr2=0x564d431e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.915+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2030710121 shutdown_connections 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.915+0000 7fc2e5ebeb80 1 -- 172.21.15.12:0/2030710121 wait complete. 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.915+0000 7fc2e5ebeb80 20 client.15933 trim_cache size 0 max 16384 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:17:24.914 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "13579572-591c-41db-9ffa-81d2325ff37c", 2023-12-11T20:17:24.915 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:17:24.915 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:17:24.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 -- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2b40a1480 msgr2=0x7fc2b40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2b40a1480 0x7fc2b40a3940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c010 tx=0x7fc2c0005c00 comp rx=0 tx=0).stop 2023-12-11T20:17:24.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 -- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc103040 msgr2=0x7fc2cc073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:24.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc103040 0x7fc2cc073f00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4007f10 tx=0x7fc2c400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 -- 172.21.15.12:0/3002710922 shutdown_connections 2023-12-11T20:17:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc2b40a1480 0x7fc2b40a3940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2cc1014b0 0x7fc2cc075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2cc103040 0x7fc2cc073f00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 --2- 172.21.15.12:0/3002710922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2cc1026a0 0x7fc2cc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 -- 172.21.15.12:0/3002710922 >> 172.21.15.12:0/3002710922 conn(0x7fc2cc0fca00 msgr2=0x7fc2cc105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 -- 172.21.15.12:0/3002710922 shutdown_connections 2023-12-11T20:17:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:24.916+0000 7fc2d25ff700 1 -- 172.21.15.12:0/3002710922 wait complete. 2023-12-11T20:17:24.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:17:25.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 -- 172.21.15.12:0/3431971331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d4101f80 msgr2=0x7f01d4104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 --2- 172.21.15.12:0/3431971331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d4101f80 0x7f01d4104370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f01d00098f0 tx=0x7f01d0009c00 comp rx=0 tx=0).stop 2023-12-11T20:17:25.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 -- 172.21.15.12:0/3431971331 shutdown_connections 2023-12-11T20:17:25.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 --2- 172.21.15.12:0/3431971331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d41071e0 0x7f01d4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 --2- 172.21.15.12:0/3431971331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d4101f80 0x7f01d4104370 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 --2- 172.21.15.12:0/3431971331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01d41048b0 0x7f01d4106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 -- 172.21.15.12:0/3431971331 >> 172.21.15.12:0/3431971331 conn(0x7f01d40fb930 msgr2=0x7f01d40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:25.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 -- 172.21.15.12:0/3431971331 shutdown_connections 2023-12-11T20:17:25.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.164+0000 7f01dbfff700 1 -- 172.21.15.12:0/3431971331 wait complete. 2023-12-11T20:17:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.165+0000 7f01dbfff700 1 Processor -- start 2023-12-11T20:17:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01dbfff700 1 -- start start 2023-12-11T20:17:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01dbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d4101f80 0x7f01d4101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01dbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01d41048b0 0x7f01d40fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01dbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d41071e0 0x7f01d4100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01dbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4100b20 con 0x7f01d41048b0 2023-12-11T20:17:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01dbfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4100c90 con 0x7f01d4101f80 2023-12-11T20:17:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01dbfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41a1470 con 0x7f01d41071e0 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01d959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01d41048b0 0x7f01d40fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01d959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01d41048b0 0x7f01d40fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45634/0 (socket says 172.21.15.12:45634) 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01d959a700 1 -- 172.21.15.12:0/2220918545 learned_addr learned my addr 172.21.15.12:0/2220918545 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01da59c700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d41071e0 0x7f01d4100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.166+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d4101f80 0x7f01d4101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01d959a700 1 -- 172.21.15.12:0/2220918545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d41071e0 msgr2=0x7f01d4100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01d959a700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d41071e0 0x7f01d4100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01d959a700 1 -- 172.21.15.12:0/2220918545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d4101f80 msgr2=0x7f01d4101800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01d959a700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d4101f80 0x7f01d4101800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01d959a700 1 -- 172.21.15.12:0/2220918545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c40095f0 con 0x7f01d41048b0 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01da59c700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d41071e0 0x7f01d4100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01d959a700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01d41048b0 0x7f01d40fff30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f01c400ec10 tx=0x7f01c400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01caffd700 1 -- 172.21.15.12:0/2220918545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400cc90 con 0x7f01d41048b0 2023-12-11T20:17:25.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01caffd700 1 -- 172.21.15.12:0/2220918545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01c400cdf0 con 0x7f01d41048b0 2023-12-11T20:17:25.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01dbfff700 1 -- 172.21.15.12:0/2220918545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d0009520 con 0x7f01d41048b0 2023-12-11T20:17:25.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.167+0000 7f01caffd700 1 -- 172.21.15.12:0/2220918545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4003e80 con 0x7f01d41048b0 2023-12-11T20:17:25.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.168+0000 7f01dbfff700 1 -- 172.21.15.12:0/2220918545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d41a19f0 con 0x7f01d41048b0 2023-12-11T20:17:25.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.171+0000 7f01caffd700 1 -- 172.21.15.12:0/2220918545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f01c4004000 con 0x7f01d41048b0 2023-12-11T20:17:25.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.172+0000 7f01caffd700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01c00a1480 0x7f01c00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.173+0000 7f01caffd700 1 -- 172.21.15.12:0/2220918545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01c4014070 con 0x7f01d41048b0 2023-12-11T20:17:25.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.173+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01c00a1480 0x7f01c00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01c00a1480 0x7f01c00a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01d000f9d0 tx=0x7f01d0019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01ef926b80 1 Processor -- start 2023-12-11T20:17:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01ef926b80 1 -- start start 2023-12-11T20:17:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e5e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e5f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01ef926b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280db9b50 con 0x55d280e5e3d0 2023-12-11T20:17:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01ef926b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280db7470 con 0x55d280e5fc20 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01ef926b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280db2d60 con 0x55d280e5ed30 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.174+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e5e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e5e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45648/0 (socket says 172.21.15.12:45648) 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d9d9b700 1 -- 172.21.15.12:0/2301258407 learned_addr learned my addr 172.21.15.12:0/2301258407 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d959a700 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e5f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01da59c700 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d9d9b700 1 -- 172.21.15.12:0/2301258407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 msgr2=0x55d280e5f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e5f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d9d9b700 1 -- 172.21.15.12:0/2301258407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 msgr2=0x55d280e600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d9d9b700 1 -- 172.21.15.12:0/2301258407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d280c2f630 con 0x55d280e5e3d0 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d959a700 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e5f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.175+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e5e7f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f01d00098f0 tx=0x7f01d001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c9d12cf464492f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.176+0000 7f01bffff700 1 -- 172.21.15.12:0/2301258407 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d000f660 con 0x55d280e5e3d0 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.176+0000 7f01bffff700 1 -- 172.21.15.12:0/2301258407 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01d001d040 con 0x55d280e5e3d0 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.176+0000 7f01bffff700 1 -- 172.21.15.12:0/2301258407 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0005600 con 0x55d280e5e3d0 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.176+0000 7f01ef926b80 1 -- 172.21.15.12:0/2301258407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 msgr2=0x55d280e5e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.176+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e5e7f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f01d00098f0 tx=0x7f01d001e000 comp rx=0 tx=0).stop 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.177+0000 7f01ef926b80 1 -- 172.21.15.12:0/2301258407 shutdown_connections 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.177+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.177+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e5e7f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.177+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2301258407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e5f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.177+0000 7f01ef926b80 1 -- 172.21.15.12:0/2301258407 >> 172.21.15.12:0/2301258407 conn(0x55d280d8d7e0 msgr2=0x55d280e5ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.177+0000 7f01ef926b80 1 -- 172.21.15.12:0/2301258407 shutdown_connections 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.177+0000 7f01ef926b80 1 -- 172.21.15.12:0/2301258407 wait complete. 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.177+0000 7f01ef926b80 1 -- start start 2023-12-11T20:17:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.178+0000 7f01ef926b80 1 Processor -- start 2023-12-11T20:17:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.178+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e68180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.178+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5ed30 0x55d280e686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.178+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5fc20 0x55d280e6f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.178+0000 7f01ef926b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280d6c560 con 0x55d280e5e3d0 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.178+0000 7f01ef926b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280d6c200 con 0x55d280e5ed30 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.178+0000 7f01ef926b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280c31920 con 0x55d280e5fc20 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.178+0000 7f01ef926b80 10 client.0 _ll_register_callbacks cb 0x55d280c97a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e68180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e68180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45664/0 (socket says 172.21.15.12:45664) 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01d9d9b700 1 -- 172.21.15.12:0/1591680681 learned_addr learned my addr 172.21.15.12:0/1591680681 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01da59c700 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5fc20 0x55d280e6f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01d959a700 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5ed30 0x55d280e686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01da59c700 1 -- 172.21.15.12:0/1591680681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5ed30 msgr2=0x55d280e686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01da59c700 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5ed30 0x55d280e686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01da59c700 1 -- 172.21.15.12:0/1591680681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 msgr2=0x55d280e68180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01da59c700 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e68180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01da59c700 1 -- 172.21.15.12:0/1591680681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d41a19f0 con 0x55d280e5fc20 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01da59c700 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5fc20 0x55d280e6f700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f01cc004630 tx=0x7f01cc004940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=866c5a084d6673bd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.179+0000 7f01bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.180+0000 7f01bd7fa700 1 -- 172.21.15.12:0/1591680681 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00ee00 con 0x55d280e5fc20 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.180+0000 7f01bd7fa700 1 -- 172.21.15.12:0/1591680681 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01cc016400 con 0x55d280e5fc20 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.180+0000 7f01ef926b80 1 -- 172.21.15.12:0/1591680681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d280e51b40 con 0x55d280e5fc20 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.180+0000 7f01bd7fa700 1 -- 172.21.15.12:0/1591680681 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01cc0165c0 con 0x55d280e5fc20 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.180+0000 7f01ef926b80 10 client.25732 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.180+0000 7f01ef926b80 1 -- 172.21.15.12:0/1591680681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f01d410a240 con 0x55d280e5fc20 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.180+0000 7f01bd7fa700 1 -- 172.21.15.12:0/1591680681 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d280e51b40 con 0x55d280e5fc20 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.181+0000 7f01bd7fa700 1 -- 172.21.15.12:0/1591680681 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01cc01c070 con 0x55d280e5fc20 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.181+0000 7f01ef926b80 10 client.25732 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.181+0000 7f01ef926b80 10 client.25732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.181+0000 7f01ef926b80 20 client.25732 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.181+0000 7f01ef926b80 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d280e73fd0 0x55d280e763f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.181+0000 7f01ef926b80 4 client.25732 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.181+0000 7f01ef926b80 1 -- 172.21.15.12:0/1591680681 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d280e2df40 con 0x55d280e73fd0 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.181+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d280e73fd0 0x55d280e763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.182+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d280e73fd0 0x55d280e763f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c2896a708d3b1de server_cookie=301bf0d6b4521626 in_seq=0 out_seq=0 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.182+0000 7f01bd7fa700 10 client.25732 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01bd7fa700 1 -- 172.21.15.12:0/1591680681 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d280e2df40 con 0x55d280e73fd0 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01bd7fa700 10 client.25732 handle_command_reply: tid=0 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 client.25732 shutdown 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 -- 172.21.15.12:0/1591680681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5fc20 msgr2=0x55d280e6f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5fc20 0x55d280e6f700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f01cc004630 tx=0x7f01cc004940 comp rx=0 tx=0).stop 2023-12-11T20:17:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 -- 172.21.15.12:0/1591680681 shutdown_connections 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d280e73fd0 0x55d280e763f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5fc20 0x55d280e6f700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01bd7fa700 0 client.25732 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e68180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 --2- 172.21.15.12:0/1591680681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5ed30 0x55d280e686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 -- 172.21.15.12:0/1591680681 >> 172.21.15.12:0/1591680681 conn(0x55d280d8d7e0 msgr2=0x55d280e59a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 -- 172.21.15.12:0/1591680681 shutdown_connections 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.183+0000 7f01ef926b80 1 -- 172.21.15.12:0/1591680681 wait complete. 2023-12-11T20:17:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.184+0000 7f01ef926b80 20 client.25732 trim_cache size 0 max 16384 2023-12-11T20:17:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.203+0000 7f01ef926b80 1 Processor -- start 2023-12-11T20:17:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.203+0000 7f01ef926b80 1 -- start start 2023-12-11T20:17:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.203+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e62c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.203+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e63140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.203+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.203+0000 7f01ef926b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280e55ba0 con 0x55d280e5e3d0 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.203+0000 7f01ef926b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280e70880 con 0x55d280e5fc20 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.203+0000 7f01ef926b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280e67cf0 con 0x55d280e5ed30 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e62c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e62c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45670/0 (socket says 172.21.15.12:45670) 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 -- 172.21.15.12:0/3706391316 learned_addr learned my addr 172.21.15.12:0/3706391316 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01da59c700 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d959a700 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e63140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 -- 172.21.15.12:0/3706391316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 msgr2=0x55d280e63140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e63140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 -- 172.21.15.12:0/3706391316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 msgr2=0x55d280e6f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 -- 172.21.15.12:0/3706391316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d280bdbde0 con 0x55d280e5e3d0 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d959a700 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e63140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01da59c700 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:25.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.204+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e62c00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f01d00094f0 tx=0x7f01d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd3abf264303144 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.205+0000 7f01c8ff9700 1 -- 172.21.15.12:0/3706391316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0034040 con 0x55d280e5e3d0 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.205+0000 7f01c8ff9700 1 -- 172.21.15.12:0/3706391316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01d0005230 con 0x55d280e5e3d0 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.205+0000 7f01c8ff9700 1 -- 172.21.15.12:0/3706391316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d000b850 con 0x55d280e5e3d0 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 -- 172.21.15.12:0/3706391316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 msgr2=0x55d280e62c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e62c00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f01d00094f0 tx=0x7f01d0009c00 comp rx=0 tx=0).stop 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 -- 172.21.15.12:0/3706391316 shutdown_connections 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5e3d0 0x55d280e62c00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 --2- 172.21.15.12:0/3706391316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5ed30 0x55d280e63140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 -- 172.21.15.12:0/3706391316 >> 172.21.15.12:0/3706391316 conn(0x55d280d8d7e0 msgr2=0x55d280e661e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 -- 172.21.15.12:0/3706391316 shutdown_connections 2023-12-11T20:17:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 -- 172.21.15.12:0/3706391316 wait complete. 2023-12-11T20:17:25.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 -- start start 2023-12-11T20:17:25.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.206+0000 7f01ef926b80 1 Processor -- start 2023-12-11T20:17:25.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.207+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5e3d0 0x55d280e6d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.207+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5ed30 0x55d280e6d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.207+0000 7f01ef926b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.207+0000 7f01ef926b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280e6eb00 con 0x55d280e5ed30 2023-12-11T20:17:25.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.207+0000 7f01ef926b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280e6ec70 con 0x55d280e5fc20 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.207+0000 7f01ef926b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d280e6ee30 con 0x55d280e5e3d0 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.207+0000 7f01ef926b80 10 client.0 _ll_register_callbacks cb 0x55d280c97a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.207+0000 7f01d959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5ed30 0x55d280e6d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5e3d0 0x55d280e6d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5e3d0 0x55d280e6d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:45972/0 (socket says 172.21.15.12:45972) 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d9d9b700 1 -- 172.21.15.12:0/2518941160 learned_addr learned my addr 172.21.15.12:0/2518941160 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01da59c700 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d959a700 1 -- 172.21.15.12:0/2518941160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5e3d0 msgr2=0x55d280e6d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d959a700 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5e3d0 0x55d280e6d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d959a700 1 -- 172.21.15.12:0/2518941160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 msgr2=0x55d280e6e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d959a700 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d959a700 1 -- 172.21.15.12:0/2518941160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d280c2f630 con 0x55d280e5ed30 2023-12-11T20:17:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01d959a700 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5ed30 0x55d280e6d5b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f01c40969b0 tx=0x7f01c4099e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79228de0b298ea8a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.208+0000 7f01bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01bd7fa700 1 -- 172.21.15.12:0/2518941160 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c409e600 con 0x55d280e5ed30 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01ef926b80 1 -- 172.21.15.12:0/2518941160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01d001d040 con 0x55d280e5ed30 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01bd7fa700 1 -- 172.21.15.12:0/2518941160 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01c40a2840 con 0x55d280e5ed30 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01bd7fa700 1 -- 172.21.15.12:0/2518941160 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01c4098850 con 0x55d280e5ed30 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01ef926b80 10 client.15951 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01ef926b80 1 -- 172.21.15.12:0/2518941160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d280bc4c60 con 0x55d280e5ed30 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01bd7fa700 1 -- 172.21.15.12:0/2518941160 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01d001d040 con 0x55d280e5ed30 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01bd7fa700 1 -- 172.21.15.12:0/2518941160 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01c40999a0 con 0x55d280e5ed30 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01ef926b80 10 client.15951 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01ef926b80 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01ef926b80 20 client.15951 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.209+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d280ed38e0 0x55d280ed5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.210+0000 7f01ef926b80 4 client.15951 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.210+0000 7f01ef926b80 1 -- 172.21.15.12:0/2518941160 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d280d78fd0 con 0x55d280ed38e0 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.210+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d280ed38e0 0x55d280ed5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01bd7fa700 10 client.15951 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01d9d9b700 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d280ed38e0 0x55d280ed5d00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e51d8b18d8bb7bbb server_cookie=ebe66e2f9b01ec57 in_seq=0 out_seq=0 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01bd7fa700 1 -- 172.21.15.12:0/2518941160 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d280d78fd0 con 0x55d280ed38e0 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01bd7fa700 10 client.15951 handle_command_reply: tid=0 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 client.15951 shutdown 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 -- 172.21.15.12:0/2518941160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5ed30 msgr2=0x55d280e6d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5ed30 0x55d280e6d5b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f01c40969b0 tx=0x7f01c4099e10 comp rx=0 tx=0).stop 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 -- 172.21.15.12:0/2518941160 shutdown_connections 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d280ed38e0 0x55d280ed5d00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d280e5fc20 0x55d280e6e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d280e5e3d0 0x55d280e6d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 --2- 172.21.15.12:0/2518941160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d280e5ed30 0x55d280e6d5b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01ef926b80 1 -- 172.21.15.12:0/2518941160 >> 172.21.15.12:0/2518941160 conn(0x55d280d8d7e0 msgr2=0x55d280e68120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.211+0000 7f01bd7fa700 0 client.15951 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.212+0000 7f01ef926b80 1 -- 172.21.15.12:0/2518941160 shutdown_connections 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.212+0000 7f01ef926b80 1 -- 172.21.15.12:0/2518941160 wait complete. 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.212+0000 7f01ef926b80 20 client.15951 trim_cache size 0 max 16384 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stdout: "13579572-591c-41db-9ffa-81d2325ff37c": { 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "13579572-591c-41db-9ffa-81d2325ff37c", 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:17:25.212 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:17:25.213 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:17:25.213 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:17:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 -- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01c00a1480 msgr2=0x7f01c00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01c00a1480 0x7f01c00a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01d000f9d0 tx=0x7f01d0019040 comp rx=0 tx=0).stop 2023-12-11T20:17:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 -- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01d41048b0 msgr2=0x7f01d40fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01d41048b0 0x7f01d40fff30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f01c400ec10 tx=0x7f01c400ef20 comp rx=0 tx=0).stop 2023-12-11T20:17:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 -- 172.21.15.12:0/2220918545 shutdown_connections 2023-12-11T20:17:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01c00a1480 0x7f01c00a3940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01d4101f80 0x7f01d4101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01d41071e0 0x7f01d4100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 --2- 172.21.15.12:0/2220918545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01d41048b0 0x7f01d40fff30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 -- 172.21.15.12:0/2220918545 >> 172.21.15.12:0/2220918545 conn(0x7f01d40fb930 msgr2=0x7f01d41029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 -- 172.21.15.12:0/2220918545 shutdown_connections 2023-12-11T20:17:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:25.213+0000 7f01dbfff700 1 -- 172.21.15.12:0/2220918545 wait complete. 2023-12-11T20:17:25.235 INFO:tasks.cephfs.filesystem:scrub status for tag:13579572-591c-41db-9ffa-81d2325ff37c - {'path': '/', 'tag': '13579572-591c-41db-9ffa-81d2325ff37c', 'options': 'recursive,force'} 2023-12-11T20:17:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:25 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:17:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:25 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:25 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:25 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:25 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:17:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:25 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:25 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:25 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:25 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:17:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:25 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:25 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:25 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:26.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:26.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:26.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:26 smithi032 ceph-mon[132488]: pgmap v420: 97 pgs: 97 active+clean; 34 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 2.7 MiB/s wr, 88 op/s 2023-12-11T20:17:26.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:26 smithi039 ceph-mon[102205]: pgmap v420: 97 pgs: 97 active+clean; 34 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 2.7 MiB/s wr, 88 op/s 2023-12-11T20:17:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:26.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:26.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:26.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:26.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:26.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:26.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:26 smithi012 ceph-mon[128787]: pgmap v420: 97 pgs: 97 active+clean; 34 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 2.7 MiB/s wr, 88 op/s 2023-12-11T20:17:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:27 smithi032 ceph-mon[132488]: pgmap v421: 97 pgs: 97 active+clean; 86 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.9 MiB/s wr, 83 op/s 2023-12-11T20:17:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:27 smithi039 ceph-mon[102205]: pgmap v421: 97 pgs: 97 active+clean; 86 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.9 MiB/s wr, 83 op/s 2023-12-11T20:17:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:27 smithi012 ceph-mon[128787]: pgmap v421: 97 pgs: 97 active+clean; 86 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.9 MiB/s wr, 83 op/s 2023-12-11T20:17:29.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:29 smithi012 ceph-mon[128787]: pgmap v422: 97 pgs: 97 active+clean; 98 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 7.8 MiB/s wr, 68 op/s 2023-12-11T20:17:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:29 smithi032 ceph-mon[132488]: pgmap v422: 97 pgs: 97 active+clean; 98 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 7.8 MiB/s wr, 68 op/s 2023-12-11T20:17:29.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:29 smithi039 ceph-mon[102205]: pgmap v422: 97 pgs: 97 active+clean; 98 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 7.8 MiB/s wr, 68 op/s 2023-12-11T20:17:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 -- 172.21.15.12:0/3949301377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 msgr2=0x7fe748102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/3949301377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 0x7fe748102b20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0099c0 tx=0x7fe73c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 -- 172.21.15.12:0/3949301377 shutdown_connections 2023-12-11T20:17:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/3949301377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7481014d0 0x7fe7481018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/3949301377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe748103060 0x7fe748109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/3949301377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 0x7fe748102b20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 -- 172.21.15.12:0/3949301377 >> 172.21.15.12:0/3949301377 conn(0x7fe7480fca60 msgr2=0x7fe7480fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 -- 172.21.15.12:0/3949301377 shutdown_connections 2023-12-11T20:17:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.038+0000 7fe74e5ff700 1 -- 172.21.15.12:0/3949301377 wait complete. 2023-12-11T20:17:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.039+0000 7fe74e5ff700 1 Processor -- start 2023-12-11T20:17:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.039+0000 7fe74e5ff700 1 -- start start 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe74e5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7481014d0 0x7fe748199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe74e5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 0x7fe748199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe74e5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe748103060 0x7fe7481a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe74e5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481a10e0 con 0x7fe7481026c0 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe74e5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481a1220 con 0x7fe7481014d0 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe74e5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481a13b0 con 0x7fe748103060 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe747fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7481014d0 0x7fe748199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe7477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 0x7fe748199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe747fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7481014d0 0x7fe748199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:47056/0 (socket says 172.21.15.12:47056) 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe747fff700 1 -- 172.21.15.12:0/2462213320 learned_addr learned my addr 172.21.15.12:0/2462213320 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.040+0000 7fe74cb9c700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe748103060 0x7fe7481a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe747fff700 1 -- 172.21.15.12:0/2462213320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe748103060 msgr2=0x7fe7481a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe747fff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe748103060 0x7fe7481a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe747fff700 1 -- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 msgr2=0x7fe748199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe747fff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 0x7fe748199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe747fff700 1 -- 172.21.15.12:0/2462213320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c0095f0 con 0x7fe7481014d0 2023-12-11T20:17:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe7477fe700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 0x7fe748199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe747fff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7481014d0 0x7fe748199600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe73800e970 tx=0x7fe73800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe7457fa700 1 -- 172.21.15.12:0/2462213320 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738009790 con 0x7fe7481014d0 2023-12-11T20:17:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe74e5ff700 1 -- 172.21.15.12:0/2462213320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7481a1690 con 0x7fe7481014d0 2023-12-11T20:17:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe7457fa700 1 -- 172.21.15.12:0/2462213320 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe73800c7e0 con 0x7fe7481014d0 2023-12-11T20:17:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe7457fa700 1 -- 172.21.15.12:0/2462213320 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738003bd0 con 0x7fe7481014d0 2023-12-11T20:17:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.041+0000 7fe74e5ff700 1 -- 172.21.15.12:0/2462213320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7481a1bf0 con 0x7fe7481014d0 2023-12-11T20:17:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.045+0000 7fe7457fa700 1 -- 172.21.15.12:0/2462213320 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe73800c950 con 0x7fe7481014d0 2023-12-11T20:17:30.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.046+0000 7fe761fbab80 1 Processor -- start 2023-12-11T20:17:30.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.046+0000 7fe761fbab80 1 -- start start 2023-12-11T20:17:30.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae2202f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae220830 0x5571ae221140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae221ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe761fbab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae17baf0 con 0x5571ae21fed0 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe761fbab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae179410 con 0x5571ae220830 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe761fbab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae174d00 con 0x5571ae221720 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe74cb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae2202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe74cb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae2202f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44064/0 (socket says 172.21.15.12:44064) 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe74cb9c700 1 -- 172.21.15.12:0/1708292068 learned_addr learned my addr 172.21.15.12:0/1708292068 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe747fff700 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae220830 0x5571ae221140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae221ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.047+0000 7fe7457fa700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7300a1470 0x7fe7300a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe7477fe700 1 -- 172.21.15.12:0/1708292068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae220830 msgr2=0x5571ae221140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae220830 0x5571ae221140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe7477fe700 1 -- 172.21.15.12:0/1708292068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 msgr2=0x5571ae2202f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae2202f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe7477fe700 1 -- 172.21.15.12:0/1708292068 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571adff15d0 con 0x5571ae221720 2023-12-11T20:17:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe7457fa700 1 -- 172.21.15.12:0/2462213320 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe738014070 con 0x7fe7481014d0 2023-12-11T20:17:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe74cb9c700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7300a1470 0x7fe7300a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae221ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0098e0 tx=0x7fe73c003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25769c8a0664879e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.048+0000 7fe72e7fc700 1 -- 172.21.15.12:0/1708292068 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00bd40 con 0x5571ae221720 2023-12-11T20:17:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe74cb9c700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7300a1470 0x7fe7300a3930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe7400075c0 tx=0x7fe740009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe72e7fc700 1 -- 172.21.15.12:0/1708292068 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe73c01e040 con 0x5571ae221720 2023-12-11T20:17:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe72e7fc700 1 -- 172.21.15.12:0/1708292068 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c003ca0 con 0x5571ae221720 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe761fbab80 1 -- 172.21.15.12:0/1708292068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 msgr2=0x5571ae221ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae221ba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0098e0 tx=0x7fe73c003680 comp rx=0 tx=0).stop 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe761fbab80 1 -- 172.21.15.12:0/1708292068 shutdown_connections 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae221ba0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae2202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1708292068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae220830 0x5571ae221140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe761fbab80 1 -- 172.21.15.12:0/1708292068 >> 172.21.15.12:0/1708292068 conn(0x5571ae14f780 msgr2=0x5571ae21c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.049+0000 7fe761fbab80 1 -- 172.21.15.12:0/1708292068 shutdown_connections 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.050+0000 7fe761fbab80 1 -- 172.21.15.12:0/1708292068 wait complete. 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.050+0000 7fe761fbab80 1 -- start start 2023-12-11T20:17:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.050+0000 7fe761fbab80 1 Processor -- start 2023-12-11T20:17:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae229e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae220830 0x5571ae22a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 0x5571ae2311a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe761fbab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae12e500 con 0x5571ae21fed0 2023-12-11T20:17:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe761fbab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae12e1a0 con 0x5571ae221720 2023-12-11T20:17:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe761fbab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571adff38c0 con 0x5571ae220830 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe761fbab80 10 client.0 _ll_register_callbacks cb 0x5571ae059a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe747fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae229e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe7477fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae220830 0x5571ae22a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe747fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae229e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44078/0 (socket says 172.21.15.12:44078) 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe747fff700 1 -- 172.21.15.12:0/1479088583 learned_addr learned my addr 172.21.15.12:0/1479088583 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.051+0000 7fe74cb9c700 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 0x5571ae2311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7477fe700 1 -- 172.21.15.12:0/1479088583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 msgr2=0x5571ae2311a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 0x5571ae2311a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7477fe700 1 -- 172.21.15.12:0/1479088583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 msgr2=0x5571ae229e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae229e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7477fe700 1 -- 172.21.15.12:0/1479088583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74810a260 con 0x5571ae220830 2023-12-11T20:17:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe747fff700 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae229e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae220830 0x5571ae22a3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009990 tx=0x7fe73c004c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39dc136d578f64cd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7277fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7277fe700 1 -- 172.21.15.12:0/1479088583 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c031070 con 0x5571ae220830 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe761fbab80 1 -- 172.21.15.12:0/1479088583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571ae213730 con 0x5571ae220830 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.052+0000 7fe7277fe700 1 -- 172.21.15.12:0/1479088583 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe73c005240 con 0x5571ae220830 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe7277fe700 1 -- 172.21.15.12:0/1479088583 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe73c005400 con 0x5571ae220830 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe761fbab80 10 client.25747 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe761fbab80 1 -- 172.21.15.12:0/1479088583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5571adf9dd80 con 0x5571ae220830 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe7277fe700 1 -- 172.21.15.12:0/1479088583 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe73c03b020 con 0x5571ae220830 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe7277fe700 1 -- 172.21.15.12:0/1479088583 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe73c034020 con 0x5571ae220830 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe761fbab80 10 client.25747 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe761fbab80 10 client.25747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe761fbab80 20 client.25747 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571ae2357e0 0x5571ae237c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe761fbab80 4 client.25747 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.053+0000 7fe761fbab80 1 -- 172.21.15.12:0/1479088583 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571ae1efee0 con 0x5571ae2357e0 2023-12-11T20:17:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.054+0000 7fe747fff700 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571ae2357e0 0x5571ae237c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.054+0000 7fe747fff700 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571ae2357e0 0x5571ae237c00 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b79b0479661c4125 server_cookie=62815b922b41db7d in_seq=0 out_seq=0 2023-12-11T20:17:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.054+0000 7fe7277fe700 10 client.25747 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.055+0000 7fe7277fe700 1 -- 172.21.15.12:0/1479088583 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571ae1efee0 con 0x5571ae2357e0 2023-12-11T20:17:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.055+0000 7fe7277fe700 10 client.25747 handle_command_reply: tid=0 2023-12-11T20:17:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.055+0000 7fe761fbab80 1 client.25747 shutdown 2023-12-11T20:17:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 -- 172.21.15.12:0/1479088583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae220830 msgr2=0x5571ae22a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae220830 0x5571ae22a3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009990 tx=0x7fe73c004c40 comp rx=0 tx=0).stop 2023-12-11T20:17:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 -- 172.21.15.12:0/1479088583 shutdown_connections 2023-12-11T20:17:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571ae2357e0 0x5571ae237c00 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 0x5571ae2311a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe7277fe700 0 client.25747 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae21fed0 0x5571ae229e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1479088583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae220830 0x5571ae22a3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 -- 172.21.15.12:0/1479088583 >> 172.21.15.12:0/1479088583 conn(0x5571ae14f780 msgr2=0x5571ae21aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 -- 172.21.15.12:0/1479088583 shutdown_connections 2023-12-11T20:17:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 1 -- 172.21.15.12:0/1479088583 wait complete. 2023-12-11T20:17:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.056+0000 7fe761fbab80 20 client.25747 trim_cache size 0 max 16384 2023-12-11T20:17:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe761fbab80 1 Processor -- start 2023-12-11T20:17:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe761fbab80 1 -- start start 2023-12-11T20:17:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae21fed0 0x5571ae231a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae231160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 0x5571ae221b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe761fbab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae21bd70 con 0x5571ae220830 2023-12-11T20:17:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe761fbab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae22ab20 con 0x5571ae221720 2023-12-11T20:17:30.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe761fbab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae228460 con 0x5571ae21fed0 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.073+0000 7fe7477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae231160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe7477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae231160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44092/0 (socket says 172.21.15.12:44092) 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe7477fe700 1 -- 172.21.15.12:0/2258298 learned_addr learned my addr 172.21.15.12:0/2258298 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe747fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae21fed0 0x5571ae231a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe74cb9c700 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 0x5571ae221b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe7477fe700 1 -- 172.21.15.12:0/2258298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae21fed0 msgr2=0x5571ae231a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe7477fe700 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae21fed0 0x5571ae231a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe7477fe700 1 -- 172.21.15.12:0/2258298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 msgr2=0x5571ae221b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe7477fe700 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 0x5571ae221b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe7477fe700 1 -- 172.21.15.12:0/2258298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571adf86c00 con 0x5571ae220830 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe747fff700 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae21fed0 0x5571ae231a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:30.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.074+0000 7fe7477fe700 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae231160 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0098e0 tx=0x7fe73c003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bd84c4efbbf581 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe72effd700 1 -- 172.21.15.12:0/2258298 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c031070 con 0x5571ae220830 2023-12-11T20:17:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe72effd700 1 -- 172.21.15.12:0/2258298 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe73c03b070 con 0x5571ae220830 2023-12-11T20:17:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe72effd700 1 -- 172.21.15.12:0/2258298 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00f880 con 0x5571ae220830 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe761fbab80 1 -- 172.21.15.12:0/2258298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 msgr2=0x5571ae231160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe761fbab80 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae231160 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0098e0 tx=0x7fe73c003680 comp rx=0 tx=0).stop 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe761fbab80 1 -- 172.21.15.12:0/2258298 shutdown_connections 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe761fbab80 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae221720 0x5571ae221b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe761fbab80 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae21fed0 0x5571ae231a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe761fbab80 1 --2- 172.21.15.12:0/2258298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae231160 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.075+0000 7fe761fbab80 1 -- 172.21.15.12:0/2258298 >> 172.21.15.12:0/2258298 conn(0x5571ae14f780 msgr2=0x5571ae227c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.076+0000 7fe761fbab80 1 -- 172.21.15.12:0/2258298 shutdown_connections 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.076+0000 7fe761fbab80 1 -- 172.21.15.12:0/2258298 wait complete. 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.076+0000 7fe761fbab80 1 -- start start 2023-12-11T20:17:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.076+0000 7fe761fbab80 1 Processor -- start 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae21fed0 0x5571ae22e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae22ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe761fbab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae22fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe761fbab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae22ff60 con 0x5571ae220830 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe761fbab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae2300d0 con 0x5571ae21fed0 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe761fbab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571ae230290 con 0x5571ae221720 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe761fbab80 10 client.0 _ll_register_callbacks cb 0x5571ae059a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe7477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae22ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe7477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae22ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44098/0 (socket says 172.21.15.12:44098) 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe747fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae21fed0 0x5571ae22e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.077+0000 7fe7477fe700 1 -- 172.21.15.12:0/1404338763 learned_addr learned my addr 172.21.15.12:0/1404338763 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe74cb9c700 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae22fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7477fe700 1 -- 172.21.15.12:0/1404338763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 msgr2=0x5571ae22fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae22fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7477fe700 1 -- 172.21.15.12:0/1404338763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae21fed0 msgr2=0x5571ae22e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae21fed0 0x5571ae22e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7477fe700 1 -- 172.21.15.12:0/1404338763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7380cae70 con 0x5571ae220830 2023-12-11T20:17:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe747fff700 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae21fed0 0x5571ae22e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7477fe700 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae22ea60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00be70 tx=0x7fe73c00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf33fc277f127ef2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7277fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7277fe700 1 -- 172.21.15.12:0/1404338763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c031070 con 0x5571ae220830 2023-12-11T20:17:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe761fbab80 1 -- 172.21.15.12:0/1404338763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe73c01e040 con 0x5571ae220830 2023-12-11T20:17:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.078+0000 7fe7277fe700 1 -- 172.21.15.12:0/1404338763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe73c000e40 con 0x5571ae220830 2023-12-11T20:17:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe7277fe700 1 -- 172.21.15.12:0/1404338763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe73c037440 con 0x5571ae220830 2023-12-11T20:17:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe761fbab80 10 client.15969 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe761fbab80 1 -- 172.21.15.12:0/1404338763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5571adf9dd80 con 0x5571ae220830 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe7277fe700 1 -- 172.21.15.12:0/1404338763 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe73c01e040 con 0x5571ae220830 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe7277fe700 1 -- 172.21.15.12:0/1404338763 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe73c034070 con 0x5571ae220830 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe761fbab80 10 client.15969 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe761fbab80 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe761fbab80 20 client.15969 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571ae28be00 0x5571ae28e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe761fbab80 4 client.15969 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.079+0000 7fe761fbab80 1 -- 172.21.15.12:0/1404338763 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5571ae13af70 con 0x5571ae28be00 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.080+0000 7fe747fff700 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571ae28be00 0x5571ae28e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.080+0000 7fe7277fe700 10 client.15969 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.080+0000 7fe747fff700 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571ae28be00 0x5571ae28e220 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c3eb271df709ba3 server_cookie=dac4457f2c4fc63f in_seq=0 out_seq=0 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe7277fe700 1 -- 172.21.15.12:0/1404338763 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5571ae13af70 con 0x5571ae28be00 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe7277fe700 10 client.15969 handle_command_reply: tid=0 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 client.15969 shutdown 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 -- 172.21.15.12:0/1404338763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 msgr2=0x5571ae22ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae22ea60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00be70 tx=0x7fe73c00b540 comp rx=0 tx=0).stop 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 -- 172.21.15.12:0/1404338763 shutdown_connections 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571ae28be00 0x5571ae28e220 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571ae21fed0 0x5571ae22e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571ae221720 0x5571ae22fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe7277fe700 0 client.15969 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 --2- 172.21.15.12:0/1404338763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ae220830 0x5571ae22ea60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 -- 172.21.15.12:0/1404338763 >> 172.21.15.12:0/1404338763 conn(0x5571ae14f780 msgr2=0x5571ae224940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 -- 172.21.15.12:0/1404338763 shutdown_connections 2023-12-11T20:17:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.102+0000 7fe761fbab80 1 -- 172.21.15.12:0/1404338763 wait complete. 2023-12-11T20:17:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe761fbab80 20 client.15969 trim_cache size 0 max 16384 2023-12-11T20:17:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:17:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:17:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:17:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 -- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7300a1470 msgr2=0x7fe7300a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7300a1470 0x7fe7300a3930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe7400075c0 tx=0x7fe740009040 comp rx=0 tx=0).stop 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 -- 172.21.15.12:0/2462213320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7481014d0 msgr2=0x7fe748199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7481014d0 0x7fe748199600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe73800e970 tx=0x7fe73800ec80 comp rx=0 tx=0).stop 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 -- 172.21.15.12:0/2462213320 shutdown_connections 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7300a1470 0x7fe7300a3930 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7481014d0 0x7fe748199600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe748103060 0x7fe7481a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 --2- 172.21.15.12:0/2462213320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7481026c0 0x7fe748199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 -- 172.21.15.12:0/2462213320 >> 172.21.15.12:0/2462213320 conn(0x7fe7480fca60 msgr2=0x7fe748073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.103+0000 7fe74e5ff700 1 -- 172.21.15.12:0/2462213320 shutdown_connections 2023-12-11T20:17:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:30.104+0000 7fe74e5ff700 1 -- 172.21.15.12:0/2462213320 wait complete. 2023-12-11T20:17:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:32 smithi032 ceph-mon[132488]: pgmap v423: 97 pgs: 97 active+clean; 142 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 50 op/s 2023-12-11T20:17:32.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:32 smithi039 ceph-mon[102205]: pgmap v423: 97 pgs: 97 active+clean; 142 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 50 op/s 2023-12-11T20:17:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:32 smithi012 ceph-mon[128787]: pgmap v423: 97 pgs: 97 active+clean; 142 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 50 op/s 2023-12-11T20:17:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:34 smithi032 ceph-mon[132488]: pgmap v424: 97 pgs: 97 active+clean; 162 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 43 op/s 2023-12-11T20:17:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:34 smithi039 ceph-mon[102205]: pgmap v424: 97 pgs: 97 active+clean; 162 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 43 op/s 2023-12-11T20:17:34.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:34 smithi012 ceph-mon[128787]: pgmap v424: 97 pgs: 97 active+clean; 162 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 43 op/s 2023-12-11T20:17:36.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:36 smithi032 ceph-mon[132488]: pgmap v425: 97 pgs: 97 active+clean; 186 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 40 op/s 2023-12-11T20:17:36.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:36 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:17:36.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:36 smithi039 ceph-mon[102205]: pgmap v425: 97 pgs: 97 active+clean; 186 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 40 op/s 2023-12-11T20:17:36.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:36 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:17:36.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:36 smithi012 ceph-mon[128787]: pgmap v425: 97 pgs: 97 active+clean; 186 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 40 op/s 2023-12-11T20:17:36.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:36 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:17:37.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:37 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:17:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:37 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:17:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:37 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:17:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:37 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:17:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:37 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:17:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:37 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:17:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:38 smithi032 ceph-mon[132488]: pgmap v426: 97 pgs: 97 active+clean; 242 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 MiB/s wr, 40 op/s 2023-12-11T20:17:38.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:38 smithi039 ceph-mon[102205]: pgmap v426: 97 pgs: 97 active+clean; 242 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 MiB/s wr, 40 op/s 2023-12-11T20:17:38.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:38 smithi012 ceph-mon[128787]: pgmap v426: 97 pgs: 97 active+clean; 242 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 MiB/s wr, 40 op/s 2023-12-11T20:17:39.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:39 smithi012 ceph-mon[128787]: pgmap v427: 97 pgs: 97 active+clean; 262 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:17:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:39 smithi032 ceph-mon[132488]: pgmap v427: 97 pgs: 97 active+clean; 262 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:17:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:39 smithi039 ceph-mon[102205]: pgmap v427: 97 pgs: 97 active+clean; 262 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:17:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:42 smithi032 ceph-mon[132488]: pgmap v428: 97 pgs: 97 active+clean; 286 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 16 MiB/s wr, 18 op/s 2023-12-11T20:17:42.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:42 smithi039 ceph-mon[102205]: pgmap v428: 97 pgs: 97 active+clean; 286 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 16 MiB/s wr, 18 op/s 2023-12-11T20:17:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:42 smithi012 ceph-mon[128787]: pgmap v428: 97 pgs: 97 active+clean; 286 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 16 MiB/s wr, 18 op/s 2023-12-11T20:17:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.276+0000 7f7109bff700 1 -- 172.21.15.12:0/552864445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041026c0 msgr2=0x7f7104102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.276+0000 7f7109bff700 1 --2- 172.21.15.12:0/552864445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041026c0 0x7f7104102b20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f70f80099c0 tx=0x7f70f8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.277+0000 7f7109bff700 1 -- 172.21.15.12:0/552864445 shutdown_connections 2023-12-11T20:17:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.277+0000 7f7109bff700 1 --2- 172.21.15.12:0/552864445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71041014d0 0x7f71041018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.277+0000 7f7109bff700 1 --2- 172.21.15.12:0/552864445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104103060 0x7f7104109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.277+0000 7f7109bff700 1 --2- 172.21.15.12:0/552864445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041026c0 0x7f7104102b20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.277+0000 7f7109bff700 1 -- 172.21.15.12:0/552864445 >> 172.21.15.12:0/552864445 conn(0x7f71040fca60 msgr2=0x7f71040fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.277+0000 7f7109bff700 1 -- 172.21.15.12:0/552864445 shutdown_connections 2023-12-11T20:17:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.277+0000 7f7109bff700 1 -- 172.21.15.12:0/552864445 wait complete. 2023-12-11T20:17:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.278+0000 7f7109bff700 1 Processor -- start 2023-12-11T20:17:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.278+0000 7f7109bff700 1 -- start start 2023-12-11T20:17:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f7109bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041014d0 0x7f7104197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f7109bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71041026c0 0x7f71041978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f7109bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104103060 0x7f710419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f7109bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710419eea0 con 0x7f71041014d0 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f7109bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710419efe0 con 0x7f71041026c0 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f7109bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710419f170 con 0x7f7104103060 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f71037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041014d0 0x7f7104197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f71037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041014d0 0x7f7104197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33700/0 (socket says 172.21.15.12:33700) 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f71037fe700 1 -- 172.21.15.12:0/1252396545 learned_addr learned my addr 172.21.15.12:0/1252396545 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f7102ffd700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71041026c0 0x7f71041978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.279+0000 7f7103fff700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104103060 0x7f710419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f71037fe700 1 -- 172.21.15.12:0/1252396545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104103060 msgr2=0x7f710419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f71037fe700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104103060 0x7f710419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f71037fe700 1 -- 172.21.15.12:0/1252396545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71041026c0 msgr2=0x7f71041978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f71037fe700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71041026c0 0x7f71041978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f71037fe700 1 -- 172.21.15.12:0/1252396545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80095f0 con 0x7f71041014d0 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f71037fe700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041014d0 0x7f7104197370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f70f400d980 tx=0x7f70f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f7100ff9700 1 -- 172.21.15.12:0/1252396545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4004020 con 0x7f71041014d0 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f7100ff9700 1 -- 172.21.15.12:0/1252396545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70f400f690 con 0x7f71041014d0 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f7109bff700 1 -- 172.21.15.12:0/1252396545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710419f450 con 0x7f71041014d0 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.280+0000 7f7100ff9700 1 -- 172.21.15.12:0/1252396545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40039e0 con 0x7f71041014d0 2023-12-11T20:17:43.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.281+0000 7f7109bff700 1 -- 172.21.15.12:0/1252396545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710419f9b0 con 0x7f71041014d0 2023-12-11T20:17:43.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.284+0000 7f7100ff9700 1 -- 172.21.15.12:0/1252396545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f70f400f800 con 0x7f71041014d0 2023-12-11T20:17:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.285+0000 7f7100ff9700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec0a14f0 0x7f70ec0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.285+0000 7f7100ff9700 1 -- 172.21.15.12:0/1252396545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f70f40cc910 con 0x7f71041014d0 2023-12-11T20:17:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.285+0000 7f7102ffd700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec0a14f0 0x7f70ec0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.286+0000 7f711d61bb80 1 Processor -- start 2023-12-11T20:17:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.286+0000 7f7102ffd700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec0a14f0 0x7f70ec0a39b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000c00 tx=0x7f70f8003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:43.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.286+0000 7f711d61bb80 1 -- start start 2023-12-11T20:17:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaac6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 0x55afcaac7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaac7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f711d61bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaa1daf0 con 0x55afcaac62e0 2023-12-11T20:17:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f711d61bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaa1b410 con 0x55afcaac7b30 2023-12-11T20:17:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f711d61bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaa16d00 con 0x55afcaac6c40 2023-12-11T20:17:43.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f71037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaac6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f71037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaac6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33716/0 (socket says 172.21.15.12:33716) 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f71037fe700 1 -- 172.21.15.12:0/830594974 learned_addr learned my addr 172.21.15.12:0/830594974 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f7102ffd700 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 0x55afcaac7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f7103fff700 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaac7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f71037fe700 1 -- 172.21.15.12:0/830594974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 msgr2=0x55afcaac7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f71037fe700 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 0x55afcaac7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f71037fe700 1 -- 172.21.15.12:0/830594974 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 msgr2=0x55afcaac7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f71037fe700 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaac7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.287+0000 7f71037fe700 1 -- 172.21.15.12:0/830594974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afca8935d0 con 0x55afcaac62e0 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.288+0000 7f71037fe700 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaac6700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f70f40965f0 tx=0x7f70f4099a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6d6cfd0c6d8df server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.288+0000 7f70e9ffb700 1 -- 172.21.15.12:0/830594974 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40232f0 con 0x55afcaac62e0 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.288+0000 7f70e9ffb700 1 -- 172.21.15.12:0/830594974 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70f409a280 con 0x55afcaac62e0 2023-12-11T20:17:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.288+0000 7f70e9ffb700 1 -- 172.21.15.12:0/830594974 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4099de0 con 0x55afcaac62e0 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 -- 172.21.15.12:0/830594974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 msgr2=0x55afcaac6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaac6700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f70f40965f0 tx=0x7f70f4099a50 comp rx=0 tx=0).stop 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 -- 172.21.15.12:0/830594974 shutdown_connections 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaac7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaac6700 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 --2- 172.21.15.12:0/830594974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 0x55afcaac7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 -- 172.21.15.12:0/830594974 >> 172.21.15.12:0/830594974 conn(0x55afca9f1780 msgr2=0x55afcaabe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 -- 172.21.15.12:0/830594974 shutdown_connections 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.289+0000 7f711d61bb80 1 -- 172.21.15.12:0/830594974 wait complete. 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.290+0000 7f711d61bb80 1 -- start start 2023-12-11T20:17:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.290+0000 7f711d61bb80 1 Processor -- start 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.290+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 0x55afcaad0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaad7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f711d61bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afca9d0500 con 0x55afcaac62e0 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f711d61bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afca9d01a0 con 0x55afcaac7b30 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f711d61bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afca8958c0 con 0x55afcaac6c40 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f711d61bb80 10 client.0 _ll_register_callbacks cb 0x55afca8fba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f71037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f71037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33722/0 (socket says 172.21.15.12:33722) 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f71037fe700 1 -- 172.21.15.12:0/2815490482 learned_addr learned my addr 172.21.15.12:0/2815490482 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f71037fe700 1 -- 172.21.15.12:0/2815490482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 msgr2=0x55afcaad0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f7102ffd700 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 0x55afcaad0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f71037fe700 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 0x55afcaad0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f7103fff700 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaad7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f71037fe700 1 -- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 msgr2=0x55afcaad7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f71037fe700 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaad7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f71037fe700 1 -- 172.21.15.12:0/2815490482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710419f9b0 con 0x55afcaac62e0 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.291+0000 7f7103fff700 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaad7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f71037fe700 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad03c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f70f409de90 tx=0x7f70f400fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47623ef3e8d0a18 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f70e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f70e2ffd700 1 -- 172.21.15.12:0/2815490482 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40b2470 con 0x55afcaac62e0 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f70e2ffd700 1 -- 172.21.15.12:0/2815490482 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f70f4099b80 con 0x55afcaac62e0 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f711d61bb80 1 -- 172.21.15.12:0/2815490482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55afcaab5730 con 0x55afcaac62e0 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f70e2ffd700 1 -- 172.21.15.12:0/2815490482 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f4099070 con 0x55afcaac62e0 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f711d61bb80 10 client.15981 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f711d61bb80 1 -- 172.21.15.12:0/2815490482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55afca83fd80 con 0x55afcaac62e0 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f70e2ffd700 1 -- 172.21.15.12:0/2815490482 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55afcaab5730 con 0x55afcaac62e0 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.292+0000 7f70e2ffd700 1 -- 172.21.15.12:0/2815490482 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f70f4095970 con 0x55afcaac62e0 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.293+0000 7f711d61bb80 10 client.15981 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.293+0000 7f711d61bb80 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.293+0000 7f711d61bb80 20 client.15981 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.293+0000 7f711d61bb80 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afcaadbb30 0x55afcaaddf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.293+0000 7f711d61bb80 4 client.15981 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.293+0000 7f711d61bb80 1 -- 172.21.15.12:0/2815490482 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55afcaa91ee0 con 0x55afcaadbb30 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.293+0000 7f7102ffd700 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afcaadbb30 0x55afcaaddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.294+0000 7f7102ffd700 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afcaadbb30 0x55afcaaddf50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba941c2039378f78 server_cookie=d61893747692a946 in_seq=0 out_seq=0 2023-12-11T20:17:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.294+0000 7f70e2ffd700 10 client.15981 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:43.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.294+0000 7f70e2ffd700 1 -- 172.21.15.12:0/2815490482 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55afcaa91ee0 con 0x55afcaadbb30 2023-12-11T20:17:43.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.294+0000 7f70e2ffd700 10 client.15981 handle_command_reply: tid=0 2023-12-11T20:17:43.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 client.15981 shutdown 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 -- 172.21.15.12:0/2815490482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 msgr2=0x55afcaad03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad03c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f70f409de90 tx=0x7f70f400fe00 comp rx=0 tx=0).stop 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 -- 172.21.15.12:0/2815490482 shutdown_connections 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afcaadbb30 0x55afcaaddf50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac7b30 0x55afcaad7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad03c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 --2- 172.21.15.12:0/2815490482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac6c40 0x55afcaad0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f70e2ffd700 0 client.15981 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 -- 172.21.15.12:0/2815490482 >> 172.21.15.12:0/2815490482 conn(0x55afca9f1780 msgr2=0x55afcaabcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 -- 172.21.15.12:0/2815490482 shutdown_connections 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 1 -- 172.21.15.12:0/2815490482 wait complete. 2023-12-11T20:17:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.295+0000 7f711d61bb80 20 client.15981 trim_cache size 0 max 16384 2023-12-11T20:17:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.313+0000 7f711d61bb80 1 Processor -- start 2023-12-11T20:17:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.313+0000 7f711d61bb80 1 -- start start 2023-12-11T20:17:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.313+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac62e0 0x55afcaad7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.313+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.313+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac7b30 0x55afcaac7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.313+0000 7f711d61bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaab5700 con 0x55afcaac7b30 2023-12-11T20:17:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.313+0000 7f711d61bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaacfd20 con 0x55afcaac6c40 2023-12-11T20:17:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.313+0000 7f711d61bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaac7340 con 0x55afcaac62e0 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7103fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac7b30 0x55afcaac7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f71037fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac62e0 0x55afcaad7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7103fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac7b30 0x55afcaac7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33734/0 (socket says 172.21.15.12:33734) 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7103fff700 1 -- 172.21.15.12:0/1930503754 learned_addr learned my addr 172.21.15.12:0/1930503754 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7102ffd700 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7103fff700 1 -- 172.21.15.12:0/1930503754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac62e0 msgr2=0x55afcaad7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7103fff700 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac62e0 0x55afcaad7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7103fff700 1 -- 172.21.15.12:0/1930503754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 msgr2=0x55afcaad7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7103fff700 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7103fff700 1 -- 172.21.15.12:0/1930503754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afca828c00 con 0x55afcaac7b30 2023-12-11T20:17:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f71037fe700 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac62e0 0x55afcaad7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.314+0000 7f7102ffd700 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.315+0000 7f7103fff700 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac7b30 0x55afcaac7f10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0094c0 tx=0x7f70fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd33d5add7573146 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.315+0000 7f70ea7fc700 1 -- 172.21.15.12:0/1930503754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00e040 con 0x55afcaac7b30 2023-12-11T20:17:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.315+0000 7f70ea7fc700 1 -- 172.21.15.12:0/1930503754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70fc00f040 con 0x55afcaac7b30 2023-12-11T20:17:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.315+0000 7f70ea7fc700 1 -- 172.21.15.12:0/1930503754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc005280 con 0x55afcaac7b30 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 -- 172.21.15.12:0/1930503754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac7b30 msgr2=0x55afcaac7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac7b30 0x55afcaac7f10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0094c0 tx=0x7f70fc00b040 comp rx=0 tx=0).stop 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 -- 172.21.15.12:0/1930503754 shutdown_connections 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac7b30 0x55afcaac7f10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac62e0 0x55afcaad7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1930503754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 -- 172.21.15.12:0/1930503754 >> 172.21.15.12:0/1930503754 conn(0x55afca9f1780 msgr2=0x55afcaacad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 -- 172.21.15.12:0/1930503754 shutdown_connections 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.316+0000 7f711d61bb80 1 -- 172.21.15.12:0/1930503754 wait complete. 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.317+0000 7f711d61bb80 1 -- start start 2023-12-11T20:17:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.317+0000 7f711d61bb80 1 Processor -- start 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.317+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f711d61bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac7b30 0x55afcaad6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f711d61bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaad6cb0 con 0x55afcaac62e0 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f711d61bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaad6e20 con 0x55afcaac6c40 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f711d61bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afcaad6fe0 con 0x55afcaac7b30 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f711d61bb80 10 client.0 _ll_register_callbacks cb 0x55afca8fba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f71037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f71037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33744/0 (socket says 172.21.15.12:33744) 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f71037fe700 1 -- 172.21.15.12:0/1087183433 learned_addr learned my addr 172.21.15.12:0/1087183433 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f7102ffd700 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f7103fff700 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac7b30 0x55afcaad6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f71037fe700 1 -- 172.21.15.12:0/1087183433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac7b30 msgr2=0x55afcaad6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f71037fe700 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac7b30 0x55afcaad6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f71037fe700 1 -- 172.21.15.12:0/1087183433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 msgr2=0x55afcaad5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f71037fe700 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.318+0000 7f71037fe700 1 -- 172.21.15.12:0/1087183433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f40a3080 con 0x55afcaac62e0 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.319+0000 7f71037fe700 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad5220 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f70f400be80 tx=0x7f70f40a1e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ce2122c08ceea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.319+0000 7f70e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.319+0000 7f70e2ffd700 1 -- 172.21.15.12:0/1087183433 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4099fe0 con 0x55afcaac62e0 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.319+0000 7f70e2ffd700 1 -- 172.21.15.12:0/1087183433 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f70f4099b80 con 0x55afcaac62e0 2023-12-11T20:17:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.319+0000 7f711d61bb80 1 -- 172.21.15.12:0/1087183433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70f409a280 con 0x55afcaac62e0 2023-12-11T20:17:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.319+0000 7f70e2ffd700 1 -- 172.21.15.12:0/1087183433 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f40b2470 con 0x55afcaac62e0 2023-12-11T20:17:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.319+0000 7f711d61bb80 10 client.15987 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.319+0000 7f711d61bb80 1 -- 172.21.15.12:0/1087183433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f710410a260 con 0x55afcaac62e0 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f70e2ffd700 1 -- 172.21.15.12:0/1087183433 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70f40ac080 con 0x55afcaac62e0 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f70e2ffd700 1 -- 172.21.15.12:0/1087183433 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f70f4098bc0 con 0x55afcaac62e0 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f711d61bb80 10 client.15987 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f711d61bb80 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f711d61bb80 20 client.15987 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afcaabf960 0x55afcaac1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f711d61bb80 4 client.15987 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f711d61bb80 1 -- 172.21.15.12:0/1087183433 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55afca9dcf70 con 0x55afcaabf960 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.320+0000 7f7102ffd700 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afcaabf960 0x55afcaac1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.321+0000 7f7102ffd700 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afcaabf960 0x55afcaac1d80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e518e06bf41663f server_cookie=9b8acad3fbeb885f in_seq=0 out_seq=0 2023-12-11T20:17:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.321+0000 7f70e2ffd700 10 client.15987 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f70e2ffd700 1 -- 172.21.15.12:0/1087183433 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55afca9dcf70 con 0x55afcaabf960 2023-12-11T20:17:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f70e2ffd700 10 client.15987 handle_command_reply: tid=0 2023-12-11T20:17:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 client.15987 shutdown 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 -- 172.21.15.12:0/1087183433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 msgr2=0x55afcaad5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad5220 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f70f400be80 tx=0x7f70f40a1e10 comp rx=0 tx=0).stop 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 -- 172.21.15.12:0/1087183433 shutdown_connections 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55afcaabf960 0x55afcaac1d80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55afcaac7b30 0x55afcaad6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afcaac62e0 0x55afcaad5220 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 --2- 172.21.15.12:0/1087183433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55afcaac6c40 0x55afcaad5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 -- 172.21.15.12:0/1087183433 >> 172.21.15.12:0/1087183433 conn(0x55afca9f1780 msgr2=0x55afcaabe460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f70e2ffd700 0 client.15987 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 -- 172.21.15.12:0/1087183433 shutdown_connections 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.336+0000 7f711d61bb80 1 -- 172.21.15.12:0/1087183433 wait complete. 2023-12-11T20:17:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f711d61bb80 20 client.15987 trim_cache size 0 max 16384 2023-12-11T20:17:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:17:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:17:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:17:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:17:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 -- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec0a14f0 msgr2=0x7f70ec0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec0a14f0 0x7f70ec0a39b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000c00 tx=0x7f70f8003680 comp rx=0 tx=0).stop 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 -- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041014d0 msgr2=0x7f7104197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041014d0 0x7f7104197370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f70f400d980 tx=0x7f70f400dc90 comp rx=0 tx=0).stop 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 -- 172.21.15.12:0/1252396545 shutdown_connections 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70ec0a14f0 0x7f70ec0a39b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7104103060 0x7f710419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71041014d0 0x7f7104197370 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 --2- 172.21.15.12:0/1252396545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71041026c0 0x7f71041978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.337+0000 7f7109bff700 1 -- 172.21.15.12:0/1252396545 >> 172.21.15.12:0/1252396545 conn(0x7f71040fca60 msgr2=0x7f7104105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.338+0000 7f7109bff700 1 -- 172.21.15.12:0/1252396545 shutdown_connections 2023-12-11T20:17:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:43.338+0000 7f7109bff700 1 -- 172.21.15.12:0/1252396545 wait complete. 2023-12-11T20:17:44.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:44 smithi032 ceph-mon[132488]: pgmap v429: 97 pgs: 97 active+clean; 314 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:17:44.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:44 smithi039 ceph-mon[102205]: pgmap v429: 97 pgs: 97 active+clean; 314 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:17:44.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:44 smithi012 ceph-mon[128787]: pgmap v429: 97 pgs: 97 active+clean; 314 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:17:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:46 smithi032 ceph-mon[132488]: pgmap v430: 97 pgs: 97 active+clean; 346 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:17:46.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:46 smithi039 ceph-mon[102205]: pgmap v430: 97 pgs: 97 active+clean; 346 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:17:46.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:46 smithi012 ceph-mon[128787]: pgmap v430: 97 pgs: 97 active+clean; 346 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:17:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:47 smithi032 ceph-mon[132488]: pgmap v431: 97 pgs: 97 active+clean; 382 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:17:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:47 smithi039 ceph-mon[102205]: pgmap v431: 97 pgs: 97 active+clean; 382 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:17:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:47 smithi012 ceph-mon[128787]: pgmap v431: 97 pgs: 97 active+clean; 382 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:17:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:49 smithi012 ceph-mon[128787]: pgmap v432: 97 pgs: 97 active+clean; 406 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:17:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:49 smithi032 ceph-mon[132488]: pgmap v432: 97 pgs: 97 active+clean; 406 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:17:49.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:49 smithi039 ceph-mon[102205]: pgmap v432: 97 pgs: 97 active+clean; 406 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:17:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:52 smithi032 ceph-mon[132488]: pgmap v433: 97 pgs: 97 active+clean; 438 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:17:52.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:52 smithi039 ceph-mon[102205]: pgmap v433: 97 pgs: 97 active+clean; 438 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:17:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:52 smithi012 ceph-mon[128787]: pgmap v433: 97 pgs: 97 active+clean; 438 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:17:54.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:54 smithi032 ceph-mon[132488]: pgmap v434: 97 pgs: 97 active+clean; 466 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:17:54.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:54 smithi039 ceph-mon[102205]: pgmap v434: 97 pgs: 97 active+clean; 466 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:17:54.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:54 smithi012 ceph-mon[128787]: pgmap v434: 97 pgs: 97 active+clean; 466 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:17:55.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:17:55.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 -- 172.21.15.12:0/3390892569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041026a0 msgr2=0x7f5004102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 --2- 172.21.15.12:0/3390892569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041026a0 0x7f5004102b00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40099c0 tx=0x7f4ff4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 -- 172.21.15.12:0/3390892569 shutdown_connections 2023-12-11T20:17:55.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 --2- 172.21.15.12:0/3390892569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5004103040 0x7f50041098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 --2- 172.21.15.12:0/3390892569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50041014b0 0x7f50041018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 --2- 172.21.15.12:0/3390892569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041026a0 0x7f5004102b00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 -- 172.21.15.12:0/3390892569 >> 172.21.15.12:0/3390892569 conn(0x7f50040fca00 msgr2=0x7f50040fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:55.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 -- 172.21.15.12:0/3390892569 shutdown_connections 2023-12-11T20:17:55.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.492+0000 7f500c3ff700 1 -- 172.21.15.12:0/3390892569 wait complete. 2023-12-11T20:17:55.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.493+0000 7f500c3ff700 1 Processor -- start 2023-12-11T20:17:55.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.493+0000 7f500c3ff700 1 -- start start 2023-12-11T20:17:55.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500c3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041014b0 0x7f5004197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500c3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50041026a0 0x7f5004197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500c3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5004103040 0x7f500419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500c3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500419ee70 con 0x7f50041014b0 2023-12-11T20:17:55.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500c3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500419efb0 con 0x7f50041026a0 2023-12-11T20:17:55.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500c3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500419f140 con 0x7f5004103040 2023-12-11T20:17:55.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041014b0 0x7f5004197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041014b0 0x7f5004197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36752/0 (socket says 172.21.15.12:36752) 2023-12-11T20:17:55.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500a19b700 1 -- 172.21.15.12:0/2374188463 learned_addr learned my addr 172.21.15.12:0/2374188463 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:55.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500999a700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50041026a0 0x7f5004197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.494+0000 7f500a99c700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5004103040 0x7f500419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f500a19b700 1 -- 172.21.15.12:0/2374188463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5004103040 msgr2=0x7f500419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f500a19b700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5004103040 0x7f500419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f500a19b700 1 -- 172.21.15.12:0/2374188463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50041026a0 msgr2=0x7f5004197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f500a19b700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50041026a0 0x7f5004197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f500a19b700 1 -- 172.21.15.12:0/2374188463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40095f0 con 0x7f50041014b0 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f500a19b700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041014b0 0x7f5004197340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f500000d980 tx=0x7f500000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f4ffb7fe700 1 -- 172.21.15.12:0/2374188463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000f890 con 0x7f50041014b0 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f500c3ff700 1 -- 172.21.15.12:0/2374188463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500419f420 con 0x7f50041014b0 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f4ffb7fe700 1 -- 172.21.15.12:0/2374188463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f500000fe80 con 0x7f50041014b0 2023-12-11T20:17:55.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f4ffb7fe700 1 -- 172.21.15.12:0/2374188463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000019360 con 0x7f50041014b0 2023-12-11T20:17:55.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.495+0000 7f500c3ff700 1 -- 172.21.15.12:0/2374188463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500419f980 con 0x7f50041014b0 2023-12-11T20:17:55.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.499+0000 7f4ffb7fe700 1 -- 172.21.15.12:0/2374188463 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f500000f9f0 con 0x7f50041014b0 2023-12-11T20:17:55.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.500+0000 7f4ffb7fe700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ff00a1480 0x7f4ff00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.501+0000 7f4ffb7fe700 1 -- 172.21.15.12:0/2374188463 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50000cc740 con 0x7f50041014b0 2023-12-11T20:17:55.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.501+0000 7f501fc3db80 1 Processor -- start 2023-12-11T20:17:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.501+0000 7f500999a700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ff00a1480 0x7f4ff00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.501+0000 7f501fc3db80 1 -- start start 2023-12-11T20:17:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e147e0 0x561943e14c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e15140 0x561943e15a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f501fc3db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943d6bb50 con 0x561943e147e0 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f501fc3db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943d69470 con 0x561943e16030 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f501fc3db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943d64d60 con 0x561943e15140 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f500999a700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ff00a1480 0x7f4ff00a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009990 tx=0x7f4ff4000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f500a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e147e0 0x561943e14c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f500a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e147e0 0x561943e14c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36764/0 (socket says 172.21.15.12:36764) 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f500a19b700 1 -- 172.21.15.12:0/3103670249 learned_addr learned my addr 172.21.15.12:0/3103670249 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f500a99c700 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f500999a700 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e15140 0x561943e15a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.502+0000 7f500a19b700 1 -- 172.21.15.12:0/3103670249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e15140 msgr2=0x561943e15a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f500a19b700 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e15140 0x561943e15a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f500a19b700 1 -- 172.21.15.12:0/3103670249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 msgr2=0x561943e164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:55.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f500a19b700 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f500a19b700 1 -- 172.21.15.12:0/3103670249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561943be1630 con 0x561943e147e0 2023-12-11T20:17:55.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f500a99c700 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:55.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f500999a700 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e15140 0x561943e15a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:55.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f500a19b700 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e147e0 0x561943e14c00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f50000a1870 tx=0x7f5000010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b93510fdb120328 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:55.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f4ff8bfe700 1 -- 172.21.15.12:0/3103670249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000fca0 con 0x561943e147e0 2023-12-11T20:17:55.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f4ff8bfe700 1 -- 172.21.15.12:0/3103670249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f500009a110 con 0x561943e147e0 2023-12-11T20:17:55.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.503+0000 7f4ff8bfe700 1 -- 172.21.15.12:0/3103670249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000a1da0 con 0x561943e147e0 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 -- 172.21.15.12:0/3103670249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e147e0 msgr2=0x561943e14c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e147e0 0x561943e14c00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f50000a1870 tx=0x7f5000010000 comp rx=0 tx=0).stop 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 -- 172.21.15.12:0/3103670249 shutdown_connections 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e147e0 0x561943e14c00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 --2- 172.21.15.12:0/3103670249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e15140 0x561943e15a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 -- 172.21.15.12:0/3103670249 >> 172.21.15.12:0/3103670249 conn(0x561943d3f7e0 msgr2=0x561943e0cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 -- 172.21.15.12:0/3103670249 shutdown_connections 2023-12-11T20:17:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.504+0000 7f501fc3db80 1 -- 172.21.15.12:0/3103670249 wait complete. 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 1 -- start start 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 1 Processor -- start 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e1e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e15140 0x561943e1eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e25b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943d1e560 con 0x561943e15140 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943d1e200 con 0x561943e16030 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943be3920 con 0x561943e147e0 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.505+0000 7f501fc3db80 10 client.0 _ll_register_callbacks cb 0x561943c49a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e15140 0x561943e1eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e15140 0x561943e1eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36768/0 (socket says 172.21.15.12:36768) 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 -- 172.21.15.12:0/1941989857 learned_addr learned my addr 172.21.15.12:0/1941989857 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500a19b700 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e1e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500a99c700 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e25b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 -- 172.21.15.12:0/1941989857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 msgr2=0x561943e1e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e1e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 -- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 msgr2=0x561943e25b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e25b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 -- 172.21.15.12:0/1941989857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc003ae0 con 0x561943e15140 2023-12-11T20:17:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500a99c700 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e25b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f500999a700 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e15140 0x561943e1eaf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4015000 tx=0x7f4ff4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27f4ac9bc13c0ad server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.506+0000 7f4fedffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.507+0000 7f4fedffb700 1 -- 172.21.15.12:0/1941989857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400b9b0 con 0x561943e15140 2023-12-11T20:17:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.507+0000 7f501fc3db80 1 -- 172.21.15.12:0/1941989857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561943e03b40 con 0x561943e15140 2023-12-11T20:17:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.507+0000 7f4fedffb700 1 -- 172.21.15.12:0/1941989857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4ff4004d70 con 0x561943e15140 2023-12-11T20:17:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.507+0000 7f4fedffb700 1 -- 172.21.15.12:0/1941989857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ff4003820 con 0x561943e15140 2023-12-11T20:17:55.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.507+0000 7f501fc3db80 10 client.15999 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:55.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.507+0000 7f501fc3db80 1 -- 172.21.15.12:0/1941989857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f500419f980 con 0x561943e15140 2023-12-11T20:17:55.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.507+0000 7f4fedffb700 1 -- 172.21.15.12:0/1941989857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ff403e080 con 0x561943e15140 2023-12-11T20:17:55.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.508+0000 7f4fedffb700 1 -- 172.21.15.12:0/1941989857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4ff400f690 con 0x561943e15140 2023-12-11T20:17:55.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.508+0000 7f501fc3db80 10 client.15999 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:55.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.508+0000 7f501fc3db80 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:55.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.508+0000 7f501fc3db80 20 client.15999 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:55.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.508+0000 7f501fc3db80 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561943e2a450 0x561943e2c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.508+0000 7f501fc3db80 4 client.15999 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:55.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.508+0000 7f501fc3db80 1 -- 172.21.15.12:0/1941989857 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561943ddff40 con 0x561943e2a450 2023-12-11T20:17:55.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.509+0000 7f500a19b700 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561943e2a450 0x561943e2c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.509+0000 7f4fedffb700 10 client.15999 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:55.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.509+0000 7f500a19b700 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561943e2a450 0x561943e2c870 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7099cb363f735d00 server_cookie=1798b3d1762888ea in_seq=0 out_seq=0 2023-12-11T20:17:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f4fedffb700 1 -- 172.21.15.12:0/1941989857 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561943ddff40 con 0x561943e2a450 2023-12-11T20:17:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f4fedffb700 10 client.15999 handle_command_reply: tid=0 2023-12-11T20:17:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 client.15999 shutdown 2023-12-11T20:17:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 -- 172.21.15.12:0/1941989857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e15140 msgr2=0x561943e1eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e15140 0x561943e1eaf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4015000 tx=0x7f4ff4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 -- 172.21.15.12:0/1941989857 shutdown_connections 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561943e2a450 0x561943e2c870 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e16030 0x561943e25b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e1e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 --2- 172.21.15.12:0/1941989857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e15140 0x561943e1eaf0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f4fedffb700 0 client.15999 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 -- 172.21.15.12:0/1941989857 >> 172.21.15.12:0/1941989857 conn(0x561943d3f7e0 msgr2=0x561943e0ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 -- 172.21.15.12:0/1941989857 shutdown_connections 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.510+0000 7f501fc3db80 1 -- 172.21.15.12:0/1941989857 wait complete. 2023-12-11T20:17:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.511+0000 7f501fc3db80 20 client.15999 trim_cache size 0 max 16384 2023-12-11T20:17:55.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.533+0000 7f501fc3db80 1 Processor -- start 2023-12-11T20:17:55.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.533+0000 7f501fc3db80 1 -- start start 2023-12-11T20:17:55.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.533+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e16410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.533+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e25af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e18f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f501fc3db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943e07b50 con 0x561943e16030 2023-12-11T20:17:55.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f501fc3db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943e1f230 con 0x561943e15140 2023-12-11T20:17:55.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f501fc3db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943e143e0 con 0x561943e147e0 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e18f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500999a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e25af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e18f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36782/0 (socket says 172.21.15.12:36782) 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500a99c700 1 -- 172.21.15.12:0/614852398 learned_addr learned my addr 172.21.15.12:0/614852398 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500a19b700 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e16410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500999a700 1 -- 172.21.15.12:0/614852398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 msgr2=0x561943e16410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500999a700 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e16410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500999a700 1 -- 172.21.15.12:0/614852398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 msgr2=0x561943e18f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.534+0000 7f500999a700 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e18f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.535+0000 7f500999a700 1 -- 172.21.15.12:0/614852398 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561943b8dde0 con 0x561943e15140 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.535+0000 7f500a19b700 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e16410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:55.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.535+0000 7f500999a700 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e25af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40099c0 tx=0x7f4ff4009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f445bee65218a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:55.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.535+0000 7f4ff93ff700 1 -- 172.21.15.12:0/614852398 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4004d70 con 0x561943e15140 2023-12-11T20:17:55.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.535+0000 7f4ff93ff700 1 -- 172.21.15.12:0/614852398 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561943e03b40 con 0x561943e15140 2023-12-11T20:17:55.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.535+0000 7f4ff93ff700 1 -- 172.21.15.12:0/614852398 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4004030 con 0x561943e15140 2023-12-11T20:17:55.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 -- 172.21.15.12:0/614852398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 msgr2=0x561943e25af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e25af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40099c0 tx=0x7f4ff4009290 comp rx=0 tx=0).stop 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 -- 172.21.15.12:0/614852398 shutdown_connections 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e18f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e16410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 --2- 172.21.15.12:0/614852398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e25af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 -- 172.21.15.12:0/614852398 >> 172.21.15.12:0/614852398 conn(0x561943d3f7e0 msgr2=0x561943e1c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 -- 172.21.15.12:0/614852398 shutdown_connections 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.536+0000 7f501fc3db80 1 -- 172.21.15.12:0/614852398 wait complete. 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 1 -- start start 2023-12-11T20:17:55.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 1 Processor -- start 2023-12-11T20:17:55.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e219e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e21f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e24f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943e25480 con 0x561943e16030 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943e255f0 con 0x561943e15140 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561943e257b0 con 0x561943e147e0 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.537+0000 7f501fc3db80 10 client.0 _ll_register_callbacks cb 0x561943c49a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e24f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500999a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e21f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e219e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41530/0 (socket says 172.21.15.12:41530) 2023-12-11T20:17:55.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a19b700 1 -- 172.21.15.12:0/2074341056 learned_addr learned my addr 172.21.15.12:0/2074341056 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:55.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a19b700 1 -- 172.21.15.12:0/2074341056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 msgr2=0x561943e21f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:55.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a19b700 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e21f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a19b700 1 -- 172.21.15.12:0/2074341056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 msgr2=0x561943e24f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:55.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a19b700 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e24f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.538+0000 7f500a19b700 1 -- 172.21.15.12:0/2074341056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561943be1630 con 0x561943e147e0 2023-12-11T20:17:55.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.539+0000 7f500a19b700 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e219e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5000095f10 tx=0x7f500009a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e27e8fc83c4ebd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:55.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.539+0000 7f4fedffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:17:55.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.539+0000 7f4fedffb700 1 -- 172.21.15.12:0/2074341056 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000fd20 con 0x561943e147e0 2023-12-11T20:17:55.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.539+0000 7f501fc3db80 1 -- 172.21.15.12:0/2074341056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f500009a110 con 0x561943e147e0 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.539+0000 7f4fedffb700 1 -- 172.21.15.12:0/2074341056 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5000010460 con 0x561943e147e0 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.539+0000 7f4fedffb700 1 -- 172.21.15.12:0/2074341056 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5000095d50 con 0x561943e147e0 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.539+0000 7f501fc3db80 10 client.25786 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.539+0000 7f501fc3db80 1 -- 172.21.15.12:0/2074341056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f500419f980 con 0x561943e147e0 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f4fedffb700 1 -- 172.21.15.12:0/2074341056 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f500007c020 con 0x561943e147e0 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f4fedffb700 1 -- 172.21.15.12:0/2074341056 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f50000b2190 con 0x561943e147e0 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f501fc3db80 10 client.25786 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f501fc3db80 10 client.25786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f501fc3db80 20 client.25786 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f501fc3db80 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561943e815d0 0x561943e839f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f501fc3db80 4 client.25786 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:17:55.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f501fc3db80 1 -- 172.21.15.12:0/2074341056 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561943d2afd0 con 0x561943e815d0 2023-12-11T20:17:55.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.540+0000 7f500999a700 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561943e815d0 0x561943e839f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.541+0000 7f4fedffb700 10 client.25786 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:55.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.541+0000 7f500999a700 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561943e815d0 0x561943e839f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce4b006502e5304a server_cookie=3633e80c3ac03403 in_seq=0 out_seq=0 2023-12-11T20:17:55.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f4fedffb700 1 -- 172.21.15.12:0/2074341056 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561943d2afd0 con 0x561943e815d0 2023-12-11T20:17:55.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f4fedffb700 10 client.25786 handle_command_reply: tid=0 2023-12-11T20:17:55.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 client.25786 shutdown 2023-12-11T20:17:55.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 -- 172.21.15.12:0/2074341056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 msgr2=0x561943e219e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e219e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5000095f10 tx=0x7f500009a280 comp rx=0 tx=0).stop 2023-12-11T20:17:55.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 -- 172.21.15.12:0/2074341056 shutdown_connections 2023-12-11T20:17:55.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561943e815d0 0x561943e839f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561943e16030 0x561943e24f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561943e147e0 0x561943e219e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 --2- 172.21.15.12:0/2074341056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561943e15140 0x561943e21f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f4fedffb700 0 client.25786 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:55.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 -- 172.21.15.12:0/2074341056 >> 172.21.15.12:0/2074341056 conn(0x561943d3f7e0 msgr2=0x561943e1e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:55.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 -- 172.21.15.12:0/2074341056 shutdown_connections 2023-12-11T20:17:55.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 1 -- 172.21.15.12:0/2074341056 wait complete. 2023-12-11T20:17:55.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.542+0000 7f501fc3db80 20 client.25786 trim_cache size 0 max 16384 2023-12-11T20:17:55.544 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:17:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:17:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:17:55.545 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:17:55.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 -- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ff00a1480 msgr2=0x7f4ff00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ff00a1480 0x7f4ff00a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009990 tx=0x7f4ff4000bc0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 -- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041014b0 msgr2=0x7f5004197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041014b0 0x7f5004197340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f500000d980 tx=0x7f500000dc90 comp rx=0 tx=0).stop 2023-12-11T20:17:55.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 -- 172.21.15.12:0/2374188463 shutdown_connections 2023-12-11T20:17:55.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ff00a1480 0x7f4ff00a3940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5004103040 0x7f500419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50041014b0 0x7f5004197340 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 --2- 172.21.15.12:0/2374188463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50041026a0 0x7f5004197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 -- 172.21.15.12:0/2374188463 >> 172.21.15.12:0/2374188463 conn(0x7f50040fca00 msgr2=0x7f5004105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:55.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.543+0000 7f500c3ff700 1 -- 172.21.15.12:0/2374188463 shutdown_connections 2023-12-11T20:17:55.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.544+0000 7f500c3ff700 1 -- 172.21.15.12:0/2374188463 wait complete. 2023-12-11T20:17:55.562 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:17:55.562 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:17:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 -- 172.21.15.12:0/2704681499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa584102690 msgr2=0x7fa584102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/2704681499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa584102690 0x7fa584102af0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa5780099c0 tx=0x7fa578009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 -- 172.21.15.12:0/2704681499 shutdown_connections 2023-12-11T20:17:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/2704681499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa584103030 0x7fa5841098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/2704681499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5841014a0 0x7fa5841018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/2704681499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa584102690 0x7fa584102af0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 -- 172.21.15.12:0/2704681499 >> 172.21.15.12:0/2704681499 conn(0x7fa5840fca10 msgr2=0x7fa5840fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 -- 172.21.15.12:0/2704681499 shutdown_connections 2023-12-11T20:17:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.780+0000 7fa58a9ff700 1 -- 172.21.15.12:0/2704681499 wait complete. 2023-12-11T20:17:55.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.781+0000 7fa58a9ff700 1 Processor -- start 2023-12-11T20:17:55.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa58a9ff700 1 -- start start 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa58a9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5841014a0 0x7fa5841995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa58a9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa584102690 0x7fa584199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa58a9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa584103030 0x7fa5841a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa58a9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841a10b0 con 0x7fa5841014a0 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa58a9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841a11f0 con 0x7fa584102690 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa58a9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841a1380 con 0x7fa584103030 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa583fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5841014a0 0x7fa5841995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa583fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5841014a0 0x7fa5841995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36798/0 (socket says 172.21.15.12:36798) 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa583fff700 1 -- 172.21.15.12:0/997332533 learned_addr learned my addr 172.21.15.12:0/997332533 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa5837fe700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa584102690 0x7fa584199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.782+0000 7fa588f9c700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa584103030 0x7fa5841a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5837fe700 1 -- 172.21.15.12:0/997332533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa584103030 msgr2=0x7fa5841a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5837fe700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa584103030 0x7fa5841a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5837fe700 1 -- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5841014a0 msgr2=0x7fa5841995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5837fe700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5841014a0 0x7fa5841995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5837fe700 1 -- 172.21.15.12:0/997332533 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5780095f0 con 0x7fa584102690 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5837fe700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa584102690 0x7fa584199b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa578009fd0 tx=0x7fa57800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5817fa700 1 -- 172.21.15.12:0/997332533 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57801d070 con 0x7fa584102690 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5841a1600 con 0x7fa584102690 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5817fa700 1 -- 172.21.15.12:0/997332533 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa57800bd10 con 0x7fa584102690 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.783+0000 7fa5817fa700 1 -- 172.21.15.12:0/997332533 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578004a90 con 0x7fa584102690 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.784+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5841a1a80 con 0x7fa584102690 2023-12-11T20:17:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.785+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa584068330 con 0x7fa584102690 2023-12-11T20:17:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.787+0000 7fa5817fa700 1 -- 172.21.15.12:0/997332533 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa578004bf0 con 0x7fa584102690 2023-12-11T20:17:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.789+0000 7fa5817fa700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa56c0a1480 0x7fa56c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.789+0000 7fa5817fa700 1 -- 172.21.15.12:0/997332533 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5780cdc90 con 0x7fa584102690 2023-12-11T20:17:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.789+0000 7fa583fff700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa56c0a1480 0x7fa56c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.789+0000 7fa583fff700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa56c0a1480 0x7fa56c0a3940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa57400bd70 tx=0x7fa57400b4a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:55.791+0000 7fa5817fa700 1 -- 172.21.15.12:0/997332533 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa5780972d0 con 0x7fa584102690 2023-12-11T20:17:56.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.149+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa58410cbc0 con 0x7fa584102690 2023-12-11T20:17:56.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.150+0000 7fa5817fa700 1 -- 172.21.15.12:0/997332533 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11306 (secure 0 0 0) 0x7fa57809a8f0 con 0x7fa584102690 2023-12-11T20:17:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:17:56.149 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:17:06.102424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:17:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa56c0a1480 msgr2=0x7fa56c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa56c0a1480 0x7fa56c0a3940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa57400bd70 tx=0x7fa57400b4a0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa584102690 msgr2=0x7fa584199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa584102690 0x7fa584199b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa578009fd0 tx=0x7fa57800fa00 comp rx=0 tx=0).stop 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 shutdown_connections 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa56c0a1480 0x7fa56c0a3940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa584103030 0x7fa5841a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5841014a0 0x7fa5841995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 --2- 172.21.15.12:0/997332533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa584102690 0x7fa584199b10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 >> 172.21.15.12:0/997332533 conn(0x7fa5840fca10 msgr2=0x7fa584073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 shutdown_connections 2023-12-11T20:17:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.154+0000 7fa58a9ff700 1 -- 172.21.15.12:0/997332533 wait complete. 2023-12-11T20:17:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 24 2023-12-11T20:17:56.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:17:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.406+0000 7f6d1ffff700 1 -- 172.21.15.12:0/3830540519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d20101dd0 msgr2=0x7f6d201041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.406+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/3830540519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d20101dd0 0x7f6d201041c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d100098f0 tx=0x7f6d10009c00 comp rx=0 tx=0).stop 2023-12-11T20:17:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.407+0000 7f6d1ffff700 1 -- 172.21.15.12:0/3830540519 shutdown_connections 2023-12-11T20:17:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.407+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/3830540519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d20101dd0 0x7f6d201041c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.407+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/3830540519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d20107030 0x7f6d20109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.407+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/3830540519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d20104700 0x7f6d20106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.407+0000 7f6d1ffff700 1 -- 172.21.15.12:0/3830540519 >> 172.21.15.12:0/3830540519 conn(0x7f6d200fb740 msgr2=0x7f6d200fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.407+0000 7f6d1ffff700 1 -- 172.21.15.12:0/3830540519 shutdown_connections 2023-12-11T20:17:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.407+0000 7f6d1ffff700 1 -- 172.21.15.12:0/3830540519 wait complete. 2023-12-11T20:17:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.408+0000 7f6d1ffff700 1 Processor -- start 2023-12-11T20:17:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.408+0000 7f6d1ffff700 1 -- start start 2023-12-11T20:17:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.408+0000 7f6d1ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d20101dd0 0x7f6d201970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.408+0000 7f6d1ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d20104700 0x7f6d20197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d20107030 0x7f6d2019e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2019ec10 con 0x7f6d20101dd0 2023-12-11T20:17:56.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1ffff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2019ed50 con 0x7f6d20104700 2023-12-11T20:17:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1ffff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2019eee0 con 0x7f6d20107030 2023-12-11T20:17:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d20101dd0 0x7f6d201970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d20101dd0 0x7f6d201970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36814/0 (socket says 172.21.15.12:36814) 2023-12-11T20:17:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1effd700 1 -- 172.21.15.12:0/2137352301 learned_addr learned my addr 172.21.15.12:0/2137352301 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d20104700 0x7f6d20197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1f7fe700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d20107030 0x7f6d2019e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1effd700 1 -- 172.21.15.12:0/2137352301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d20107030 msgr2=0x7f6d2019e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1effd700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d20107030 0x7f6d2019e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1effd700 1 -- 172.21.15.12:0/2137352301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d20104700 msgr2=0x7f6d20197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1effd700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d20104700 0x7f6d20197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1effd700 1 -- 172.21.15.12:0/2137352301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d10009520 con 0x7f6d20101dd0 2023-12-11T20:17:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.409+0000 7f6d1f7fe700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d20107030 0x7f6d2019e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:56.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.410+0000 7f6d1effd700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d20101dd0 0x7f6d201970e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009810 tx=0x7f6d1000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.410+0000 7f6d07fff700 1 -- 172.21.15.12:0/2137352301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1001c070 con 0x7f6d20101dd0 2023-12-11T20:17:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.410+0000 7f6d07fff700 1 -- 172.21.15.12:0/2137352301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d1000f7b0 con 0x7f6d20101dd0 2023-12-11T20:17:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.410+0000 7f6d1ffff700 1 -- 172.21.15.12:0/2137352301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d200ffbc0 con 0x7f6d20101dd0 2023-12-11T20:17:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.410+0000 7f6d07fff700 1 -- 172.21.15.12:0/2137352301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10003a00 con 0x7f6d20101dd0 2023-12-11T20:17:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.410+0000 7f6d1ffff700 1 -- 172.21.15.12:0/2137352301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d201000c0 con 0x7f6d20101dd0 2023-12-11T20:17:56.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.415+0000 7f6d07fff700 1 -- 172.21.15.12:0/2137352301 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6d10020030 con 0x7f6d20101dd0 2023-12-11T20:17:56.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.416+0000 7f6d39190b80 1 Processor -- start 2023-12-11T20:17:56.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.416+0000 7f6d39190b80 1 -- start start 2023-12-11T20:17:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d39190b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff381db50 con 0x561ff38c2a60 2023-12-11T20:17:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d39190b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff381b470 con 0x561ff38c33c0 2023-12-11T20:17:56.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d39190b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff3816d60 con 0x561ff38c3de0 2023-12-11T20:17:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d1f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d1f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38c2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36818/0 (socket says 172.21.15.12:36818) 2023-12-11T20:17:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d1f7fe700 1 -- 172.21.15.12:0/1854757115 learned_addr learned my addr 172.21.15.12:0/1854757115 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d07fff700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6d080a15a0 0x7f6d080a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.417+0000 7f6d1effd700 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.418+0000 7f6d07fff700 1 -- 172.21.15.12:0/2137352301 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d100cddd0 con 0x7f6d20101dd0 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.418+0000 7f6d1f7fe700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6d080a15a0 0x7f6d080a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.418+0000 7f6d1e7fc700 1 -- 172.21.15.12:0/1854757115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 msgr2=0x561ff38c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.418+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.418+0000 7f6d1e7fc700 1 -- 172.21.15.12:0/1854757115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 msgr2=0x561ff38c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.418+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.418+0000 7f6d1e7fc700 1 -- 172.21.15.12:0/1854757115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ff3693630 con 0x561ff38c3de0 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.419+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38c4240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009c00 tx=0x7f6d14009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1be23dd45509fb2e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.419+0000 7f6d1f7fe700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6d080a15a0 0x7f6d080a3a60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d18007740 tx=0x7f6d18004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.419+0000 7f6d057fa700 1 -- 172.21.15.12:0/1854757115 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14011ab0 con 0x561ff38c3de0 2023-12-11T20:17:56.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.419+0000 7f6d057fa700 1 -- 172.21.15.12:0/1854757115 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d14011c10 con 0x561ff38c3de0 2023-12-11T20:17:56.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.419+0000 7f6d057fa700 1 -- 172.21.15.12:0/1854757115 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d140223f0 con 0x561ff38c3de0 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 -- 172.21.15.12:0/1854757115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 msgr2=0x561ff38c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38c4240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009c00 tx=0x7f6d14009f10 comp rx=0 tx=0).stop 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 -- 172.21.15.12:0/1854757115 shutdown_connections 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38c4240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1854757115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 -- 172.21.15.12:0/1854757115 >> 172.21.15.12:0/1854757115 conn(0x561ff37f17e0 msgr2=0x561ff38bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 -- 172.21.15.12:0/1854757115 shutdown_connections 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.420+0000 7f6d39190b80 1 -- 172.21.15.12:0/1854757115 wait complete. 2023-12-11T20:17:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.421+0000 7f6d39190b80 1 -- start start 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.421+0000 7f6d39190b80 1 Processor -- start 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38d3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d39190b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff37d0560 con 0x561ff38c2a60 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d39190b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff37d0200 con 0x561ff38c33c0 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d39190b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff3695920 con 0x561ff38c3de0 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d39190b80 10 client.0 _ll_register_callbacks cb 0x561ff36fba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d1effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d1effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36824/0 (socket says 172.21.15.12:36824) 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.422+0000 7f6d1effd700 1 -- 172.21.15.12:0/4068688640 learned_addr learned my addr 172.21.15.12:0/4068688640 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1f7fe700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38d3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1effd700 1 -- 172.21.15.12:0/4068688640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 msgr2=0x561ff38d3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1effd700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38d3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1effd700 1 -- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 msgr2=0x561ff38cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1effd700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1effd700 1 -- 172.21.15.12:0/4068688640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d14009830 con 0x561ff38c2a60 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1f7fe700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38d3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d1effd700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38cc360 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009fd0 tx=0x7f6d1009aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e21a17a4b5cba3f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.423+0000 7f6d02ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.424+0000 7f6d02ff5700 1 -- 172.21.15.12:0/4068688640 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a33d0 con 0x561ff38c2a60 2023-12-11T20:17:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.424+0000 7f6d02ff5700 1 -- 172.21.15.12:0/4068688640 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d1009b0d0 con 0x561ff38c2a60 2023-12-11T20:17:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.424+0000 7f6d39190b80 1 -- 172.21.15.12:0/4068688640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ff38b59e0 con 0x561ff38c2a60 2023-12-11T20:17:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.424+0000 7f6d02ff5700 1 -- 172.21.15.12:0/4068688640 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d10021380 con 0x561ff38c2a60 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.424+0000 7f6d39190b80 10 client.16023 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.424+0000 7f6d39190b80 1 -- 172.21.15.12:0/4068688640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x561ff363fde0 con 0x561ff38c2a60 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.424+0000 7f6d02ff5700 1 -- 172.21.15.12:0/4068688640 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d100b7080 con 0x561ff38c2a60 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.424+0000 7f6d02ff5700 1 -- 172.21.15.12:0/4068688640 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6d1009a5c0 con 0x561ff38c2a60 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.425+0000 7f6d39190b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.425+0000 7f6d39190b80 10 client.16023 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.425+0000 7f6d39190b80 20 client.16023 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.425+0000 7f6d39190b80 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x561ff38d7d10 0x561ff38da130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.425+0000 7f6d39190b80 4 client.16023 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.425+0000 7f6d39190b80 1 -- 172.21.15.12:0/4068688640 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ff3891f40 con 0x561ff38d7d10 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.425+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x561ff38d7d10 0x561ff38da130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.426+0000 7f6d02ff5700 10 client.16023 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:17:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.426+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x561ff38d7d10 0x561ff38da130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b680ac2d194f9466 server_cookie=3817516aa56806c4 in_seq=0 out_seq=0 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d02ff5700 1 -- 172.21.15.12:0/4068688640 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561ff3891f40 con 0x561ff38d7d10 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d02ff5700 10 client.16023 handle_command_reply: tid=0 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 client.16023 shutdown 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 -- 172.21.15.12:0/4068688640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 msgr2=0x561ff38cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38cc360 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009fd0 tx=0x7f6d1009aa30 comp rx=0 tx=0).stop 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 -- 172.21.15.12:0/4068688640 shutdown_connections 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x561ff38d7d10 0x561ff38da130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff38d3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c2a60 0x561ff38cc360 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 --2- 172.21.15.12:0/4068688640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c33c0 0x561ff38cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d02ff5700 0 client.16023 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 -- 172.21.15.12:0/4068688640 >> 172.21.15.12:0/4068688640 conn(0x561ff37f17e0 msgr2=0x561ff38c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 -- 172.21.15.12:0/4068688640 shutdown_connections 2023-12-11T20:17:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.427+0000 7f6d39190b80 1 -- 172.21.15.12:0/4068688640 wait complete. 2023-12-11T20:17:56.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.428+0000 7f6d39190b80 20 client.16023 trim_cache size 0 max 16384 2023-12-11T20:17:56.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.444+0000 7f6d39190b80 1 Processor -- start 2023-12-11T20:17:56.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.444+0000 7f6d39190b80 1 -- start start 2023-12-11T20:17:56.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.444+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff38da100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.444+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c33c0 0x561ff38d3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.444+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c3de0 0x561ff38bde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.444+0000 7f6d39190b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff38cbed0 con 0x561ff38c3de0 2023-12-11T20:17:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.444+0000 7f6d39190b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff38df360 con 0x561ff38c2a60 2023-12-11T20:17:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.444+0000 7f6d39190b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff38c3200 con 0x561ff38c33c0 2023-12-11T20:17:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff38da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c33c0 0x561ff38d3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff38da100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:43774/0 (socket says 172.21.15.12:43774) 2023-12-11T20:17:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c3de0 0x561ff38bde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1effd700 1 -- 172.21.15.12:0/1441407548 learned_addr learned my addr 172.21.15.12:0/1441407548 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c33c0 0x561ff38d3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41602/0 (socket says 172.21.15.12:41602) 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1effd700 1 -- 172.21.15.12:0/1441407548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c33c0 msgr2=0x561ff38d3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1effd700 1 --2- 172.21.15.12:0/1441407548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c33c0 0x561ff38d3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1effd700 1 -- 172.21.15.12:0/1441407548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c3de0 msgr2=0x561ff38bde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1effd700 1 --2- 172.21.15.12:0/1441407548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c3de0 0x561ff38bde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1effd700 1 -- 172.21.15.12:0/1441407548 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ff3628c60 con 0x561ff38c2a60 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.445+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/1441407548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c33c0 0x561ff38d3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.446+0000 7f6d1effd700 1 --2- 172.21.15.12:0/1441407548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff38da100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c010 tx=0x7f6d1009f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dde6e41f4ba128e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.446+0000 7f6d05ffb700 1 -- 172.21.15.12:0/1441407548 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1009b0d0 con 0x561ff38c2a60 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.446+0000 7f6d05ffb700 1 -- 172.21.15.12:0/1441407548 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561ff38b59e0 con 0x561ff38c2a60 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.446+0000 7f6d05ffb700 1 -- 172.21.15.12:0/1441407548 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100b9180 con 0x561ff38c2a60 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 -- 172.21.15.12:0/1441407548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 msgr2=0x561ff38da100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1441407548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff38da100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c010 tx=0x7f6d1009f120 comp rx=0 tx=0).stop 2023-12-11T20:17:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 -- 172.21.15.12:0/1441407548 shutdown_connections 2023-12-11T20:17:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1441407548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff38da100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1441407548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c3de0 0x561ff38bde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1441407548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c33c0 0x561ff38d3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 -- 172.21.15.12:0/1441407548 >> 172.21.15.12:0/1441407548 conn(0x561ff37f17e0 msgr2=0x561ff38bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 -- 172.21.15.12:0/1441407548 shutdown_connections 2023-12-11T20:17:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.447+0000 7f6d39190b80 1 -- 172.21.15.12:0/1441407548 wait complete. 2023-12-11T20:17:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.448+0000 7f6d39190b80 1 -- start start 2023-12-11T20:17:56.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.448+0000 7f6d39190b80 1 Processor -- start 2023-12-11T20:17:56.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.448+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff39281f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c33c0 0x561ff392a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d39190b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff392cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d39190b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff38c9830 con 0x561ff38c33c0 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d39190b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff38c9970 con 0x561ff38c2a60 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d39190b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff38c9b30 con 0x561ff38c3de0 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d39190b80 10 client.0 _ll_register_callbacks cb 0x561ff36fba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff39281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c33c0 0x561ff392a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff39281f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:43782/0 (socket says 172.21.15.12:43782) 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1effd700 1 -- 172.21.15.12:0/1014834394 learned_addr learned my addr 172.21.15.12:0/1014834394 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1f7fe700 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff392cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1effd700 1 -- 172.21.15.12:0/1014834394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 msgr2=0x561ff392cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1effd700 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff392cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1effd700 1 -- 172.21.15.12:0/1014834394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c33c0 msgr2=0x561ff392a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1effd700 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c33c0 0x561ff392a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1effd700 1 -- 172.21.15.12:0/1014834394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ff3693630 con 0x561ff38c2a60 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.449+0000 7f6d1f7fe700 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff392cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.450+0000 7f6d1effd700 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff39281f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d100b0040 tx=0x7f6d10097520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51df71ab81c2f8a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.450+0000 7f6d02ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.450+0000 7f6d02ff5700 1 -- 172.21.15.12:0/1014834394 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a12b0 con 0x561ff38c2a60 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.450+0000 7f6d02ff5700 1 -- 172.21.15.12:0/1014834394 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d100a33d0 con 0x561ff38c2a60 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.450+0000 7f6d39190b80 1 -- 172.21.15.12:0/1014834394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d14011c10 con 0x561ff38c2a60 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.450+0000 7f6d02ff5700 1 -- 172.21.15.12:0/1014834394 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d100977e0 con 0x561ff38c2a60 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.450+0000 7f6d39190b80 10 client.25814 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.450+0000 7f6d39190b80 1 -- 172.21.15.12:0/1014834394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x561ff363fde0 con 0x561ff38c2a60 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d02ff5700 1 -- 172.21.15.12:0/1014834394 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d14011c10 con 0x561ff38c2a60 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d02ff5700 1 -- 172.21.15.12:0/1014834394 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6d1009b3c0 con 0x561ff38c2a60 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d39190b80 10 client.25814 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d39190b80 10 client.25814 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d39190b80 20 client.25814 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x561ff392e330 0x561ff3930720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d39190b80 4 client.25814 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:17:56.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d39190b80 1 -- 172.21.15.12:0/1014834394 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561ff37dcfd0 con 0x561ff392e330 2023-12-11T20:17:56.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.451+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x561ff392e330 0x561ff3930720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.452+0000 7f6d1e7fc700 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x561ff392e330 0x561ff3930720 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47c63f2c31a316f0 server_cookie=d50e8eab893a6b1b in_seq=0 out_seq=0 2023-12-11T20:17:56.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.452+0000 7f6d02ff5700 10 client.25814 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:17:56.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.452+0000 7f6d02ff5700 1 -- 172.21.15.12:0/1014834394 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561ff37dcfd0 con 0x561ff392e330 2023-12-11T20:17:56.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.452+0000 7f6d02ff5700 10 client.25814 handle_command_reply: tid=0 2023-12-11T20:17:56.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.452+0000 7f6d39190b80 1 client.25814 shutdown 2023-12-11T20:17:56.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 -- 172.21.15.12:0/1014834394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 msgr2=0x561ff39281f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff39281f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d100b0040 tx=0x7f6d10097520 comp rx=0 tx=0).stop 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 -- 172.21.15.12:0/1014834394 shutdown_connections 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x561ff392e330 0x561ff3930720 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ff38c2a60 0x561ff39281f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d02ff5700 0 client.25814 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ff38c3de0 0x561ff392cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 --2- 172.21.15.12:0/1014834394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ff38c33c0 0x561ff392a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 -- 172.21.15.12:0/1014834394 >> 172.21.15.12:0/1014834394 conn(0x561ff37f17e0 msgr2=0x561ff38bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 -- 172.21.15.12:0/1014834394 shutdown_connections 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 1 -- 172.21.15.12:0/1014834394 wait complete. 2023-12-11T20:17:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.453+0000 7f6d39190b80 20 client.25814 trim_cache size 0 max 16384 2023-12-11T20:17:56.455 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:17:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 -- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6d080a15a0 msgr2=0x7f6d080a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6d080a15a0 0x7f6d080a3a60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6d18007740 tx=0x7f6d18004b40 comp rx=0 tx=0).stop 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 -- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d20101dd0 msgr2=0x7f6d201970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d20101dd0 0x7f6d201970e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009810 tx=0x7f6d1000b840 comp rx=0 tx=0).stop 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 -- 172.21.15.12:0/2137352301 shutdown_connections 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6d080a15a0 0x7f6d080a3a60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d20107030 0x7f6d2019e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d20101dd0 0x7f6d201970e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 --2- 172.21.15.12:0/2137352301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d20104700 0x7f6d20197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 -- 172.21.15.12:0/2137352301 >> 172.21.15.12:0/2137352301 conn(0x7f6d200fb740 msgr2=0x7f6d201028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 -- 172.21.15.12:0/2137352301 shutdown_connections 2023-12-11T20:17:56.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.454+0000 7f6d1ffff700 1 -- 172.21.15.12:0/2137352301 wait complete. 2023-12-11T20:17:56.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:56 smithi032 ceph-mon[132488]: pgmap v435: 97 pgs: 97 active+clean; 490 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:17:56.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:56 smithi012 ceph-mon[128787]: pgmap v435: 97 pgs: 97 active+clean; 490 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:17:56.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:17:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.528+0000 7f62395ff700 1 -- 172.21.15.12:0/3270126945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62341015b0 msgr2=0x7f6234101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.528+0000 7f62395ff700 1 --2- 172.21.15.12:0/3270126945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62341015b0 0x7f6234101a10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6228009920 tx=0x7f6228009c30 comp rx=0 tx=0).stop 2023-12-11T20:17:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.529+0000 7f62395ff700 1 -- 172.21.15.12:0/3270126945 shutdown_connections 2023-12-11T20:17:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.529+0000 7f62395ff700 1 --2- 172.21.15.12:0/3270126945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6234101f50 0x7f6234108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.529+0000 7f62395ff700 1 --2- 172.21.15.12:0/3270126945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62341003c0 0x7f62341007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.529+0000 7f62395ff700 1 --2- 172.21.15.12:0/3270126945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62341015b0 0x7f6234101a10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.529+0000 7f62395ff700 1 -- 172.21.15.12:0/3270126945 >> 172.21.15.12:0/3270126945 conn(0x7f62340fb930 msgr2=0x7f62340fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.529+0000 7f62395ff700 1 -- 172.21.15.12:0/3270126945 shutdown_connections 2023-12-11T20:17:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.529+0000 7f62395ff700 1 -- 172.21.15.12:0/3270126945 wait complete. 2023-12-11T20:17:56.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.530+0000 7f62395ff700 1 Processor -- start 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.530+0000 7f62395ff700 1 -- start start 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f62395ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62341003c0 0x7f6234104300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f62395ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6234101f50 0x7f6234102990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f62395ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6234102ed0 0x7f6234103350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f62395ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62341a1710 con 0x7f6234102ed0 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f62395ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62341a1850 con 0x7f6234101f50 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f62395ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62341a1a10 con 0x7f62341003c0 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f6232ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62341003c0 0x7f6234104300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f62327fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6234101f50 0x7f6234102990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f6232ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62341003c0 0x7f6234104300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41628/0 (socket says 172.21.15.12:41628) 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f6232ffd700 1 -- 172.21.15.12:0/3925859602 learned_addr learned my addr 172.21.15.12:0/3925859602 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.531+0000 7f62337fe700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6234102ed0 0x7f6234103350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f6232ffd700 1 -- 172.21.15.12:0/3925859602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6234101f50 msgr2=0x7f6234102990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f6232ffd700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6234101f50 0x7f6234102990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f6232ffd700 1 -- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6234102ed0 msgr2=0x7f6234103350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f6232ffd700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6234102ed0 0x7f6234103350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f6232ffd700 1 -- 172.21.15.12:0/3925859602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228009520 con 0x7f62341003c0 2023-12-11T20:17:56.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f6232ffd700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62341003c0 0x7f6234104300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f622400e970 tx=0x7f622400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f621bfff700 1 -- 172.21.15.12:0/3925859602 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224009790 con 0x7f62341003c0 2023-12-11T20:17:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f62395ff700 1 -- 172.21.15.12:0/3925859602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62341a1cf0 con 0x7f62341003c0 2023-12-11T20:17:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f621bfff700 1 -- 172.21.15.12:0/3925859602 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f622400eec0 con 0x7f62341003c0 2023-12-11T20:17:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.532+0000 7f621bfff700 1 -- 172.21.15.12:0/3925859602 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224003c10 con 0x7f62341003c0 2023-12-11T20:17:56.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.533+0000 7f62395ff700 1 -- 172.21.15.12:0/3925859602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62341a21b0 con 0x7f62341003c0 2023-12-11T20:17:56.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.538+0000 7f621bfff700 1 -- 172.21.15.12:0/3925859602 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6224003e70 con 0x7f62341003c0 2023-12-11T20:17:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.538+0000 7f624cf46b80 1 Processor -- start 2023-12-11T20:17:56.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.538+0000 7f624cf46b80 1 -- start start 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c1a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c1b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c1bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f624cf46b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436b75af0 con 0x55b436c1a830 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f624cf46b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436b73410 con 0x55b436c1b720 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f624cf46b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436b6ed00 con 0x55b436c19ed0 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f6232ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c1b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f6232ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c1b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36860/0 (socket says 172.21.15.12:36860) 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f6232ffd700 1 -- 172.21.15.12:0/3879408911 learned_addr learned my addr 172.21.15.12:0/3879408911 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.539+0000 7f62337fe700 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c1a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.540+0000 7f62327fc700 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c1bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.540+0000 7f62337fe700 1 -- 172.21.15.12:0/3879408911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 msgr2=0x55b436c1bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.540+0000 7f62337fe700 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c1bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.540+0000 7f62337fe700 1 -- 172.21.15.12:0/3879408911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 msgr2=0x55b436c1b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.540+0000 7f62337fe700 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c1b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.540+0000 7f62337fe700 1 -- 172.21.15.12:0/3879408911 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4369eb5d0 con 0x55b436c19ed0 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.540+0000 7f621bfff700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f621c0a1470 0x7f621c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.540+0000 7f62337fe700 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c1a2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f622c009310 tx=0x7f622c0099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26be737228215ffe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.541+0000 7f6232ffd700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f621c0a1470 0x7f621c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.541+0000 7f621bfff700 1 -- 172.21.15.12:0/3925859602 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6224014070 con 0x7f62341003c0 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.541+0000 7f62197fa700 1 -- 172.21.15.12:0/3879408911 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c00e070 con 0x55b436c19ed0 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.541+0000 7f62197fa700 1 -- 172.21.15.12:0/3879408911 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f622c00f040 con 0x55b436c19ed0 2023-12-11T20:17:56.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.541+0000 7f62197fa700 1 -- 172.21.15.12:0/3879408911 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c004750 con 0x55b436c19ed0 2023-12-11T20:17:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 -- 172.21.15.12:0/3879408911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 msgr2=0x55b436c1a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c1a2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f622c009310 tx=0x7f622c0099e0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f6232ffd700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f621c0a1470 0x7f621c0a3930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f62240a20f0 tx=0x7f62240d08a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 -- 172.21.15.12:0/3879408911 shutdown_connections 2023-12-11T20:17:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c1bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c1a2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3879408911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c1b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 -- 172.21.15.12:0/3879408911 >> 172.21.15.12:0/3879408911 conn(0x55b436b49780 msgr2=0x55b436c16880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 -- 172.21.15.12:0/3879408911 shutdown_connections 2023-12-11T20:17:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.542+0000 7f624cf46b80 1 -- 172.21.15.12:0/3879408911 wait complete. 2023-12-11T20:17:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.543+0000 7f624cf46b80 1 -- start start 2023-12-11T20:17:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.543+0000 7f624cf46b80 1 Processor -- start 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c23e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c243a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c2b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f624cf46b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436b28500 con 0x55b436c1a830 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f624cf46b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436b281a0 con 0x55b436c1b720 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f624cf46b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4369ed8c0 con 0x55b436c19ed0 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f624cf46b80 10 client.0 _ll_register_callbacks cb 0x55b436a53a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f62337fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c23e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f62327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c243a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f62337fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c23e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41636/0 (socket says 172.21.15.12:41636) 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f62337fe700 1 -- 172.21.15.12:0/3888619241 learned_addr learned my addr 172.21.15.12:0/3888619241 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.544+0000 7f62337fe700 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c2b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.545+0000 7f62327fc700 1 -- 172.21.15.12:0/3888619241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 msgr2=0x55b436c23e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.545+0000 7f62327fc700 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c23e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.545+0000 7f62327fc700 1 -- 172.21.15.12:0/3888619241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 msgr2=0x55b436c2b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.545+0000 7f62327fc700 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c2b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.545+0000 7f62327fc700 1 -- 172.21.15.12:0/3888619241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c009050 con 0x55b436c1a830 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.545+0000 7f62327fc700 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c243a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6228008000 tx=0x7f622800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfceeb8d9498324 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.545+0000 7f6216ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.546+0000 7f6216ff5700 1 -- 172.21.15.12:0/3888619241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622800f800 con 0x55b436c1a830 2023-12-11T20:17:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.546+0000 7f624cf46b80 1 -- 172.21.15.12:0/3888619241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b436c0d730 con 0x55b436c1a830 2023-12-11T20:17:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.546+0000 7f6216ff5700 1 -- 172.21.15.12:0/3888619241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f622800b970 con 0x55b436c1a830 2023-12-11T20:17:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.546+0000 7f6216ff5700 1 -- 172.21.15.12:0/3888619241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f622800bb30 con 0x55b436c1a830 2023-12-11T20:17:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.546+0000 7f624cf46b80 10 client.16041 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.546+0000 7f624cf46b80 1 -- 172.21.15.12:0/3888619241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b436997d80 con 0x55b436c1a830 2023-12-11T20:17:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.546+0000 7f6216ff5700 1 -- 172.21.15.12:0/3888619241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6228031020 con 0x55b436c1a830 2023-12-11T20:17:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.547+0000 7f6216ff5700 1 -- 172.21.15.12:0/3888619241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6228015020 con 0x55b436c1a830 2023-12-11T20:17:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.547+0000 7f624cf46b80 10 client.16041 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.547+0000 7f624cf46b80 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.547+0000 7f624cf46b80 20 client.16041 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.547+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b436c2fdd0 0x55b436c321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.547+0000 7f624cf46b80 4 client.16041 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.547+0000 7f624cf46b80 1 -- 172.21.15.12:0/3888619241 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b436be9ee0 con 0x55b436c2fdd0 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.547+0000 7f62337fe700 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b436c2fdd0 0x55b436c321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.548+0000 7f6216ff5700 10 client.16041 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.548+0000 7f62337fe700 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b436c2fdd0 0x55b436c321f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad84e582a9dede66 server_cookie=ac83fadde788dc52 in_seq=0 out_seq=0 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f6216ff5700 1 -- 172.21.15.12:0/3888619241 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b436be9ee0 con 0x55b436c2fdd0 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f6216ff5700 10 client.16041 handle_command_reply: tid=0 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 client.16041 shutdown 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 -- 172.21.15.12:0/3888619241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 msgr2=0x55b436c243a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c243a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6228008000 tx=0x7f622800f690 comp rx=0 tx=0).stop 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 -- 172.21.15.12:0/3888619241 shutdown_connections 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b436c2fdd0 0x55b436c321f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c2b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f6216ff5700 0 client.16041 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c23e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3888619241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1a830 0x55b436c243a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 -- 172.21.15.12:0/3888619241 >> 172.21.15.12:0/3888619241 conn(0x55b436b49780 msgr2=0x55b436c14ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 -- 172.21.15.12:0/3888619241 shutdown_connections 2023-12-11T20:17:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 1 -- 172.21.15.12:0/3888619241 wait complete. 2023-12-11T20:17:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.549+0000 7f624cf46b80 20 client.16041 trim_cache size 0 max 16384 2023-12-11T20:17:56.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:56 smithi039 ceph-mon[102205]: pgmap v435: 97 pgs: 97 active+clean; 490 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:17:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.572+0000 7f624cf46b80 1 Processor -- start 2023-12-11T20:17:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.572+0000 7f624cf46b80 1 -- start start 2023-12-11T20:17:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c2bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1a830 0x55b436c2b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1b720 0x55b436c23e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f624cf46b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436c22c30 con 0x55b436c1b720 2023-12-11T20:17:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f624cf46b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436c19950 con 0x55b436c1a830 2023-12-11T20:17:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f624cf46b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436c373a0 con 0x55b436c19ed0 2023-12-11T20:17:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f62337fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c2bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f62327fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1a830 0x55b436c2b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f62327fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1a830 0x55b436c2b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:43826/0 (socket says 172.21.15.12:43826) 2023-12-11T20:17:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f62327fc700 1 -- 172.21.15.12:0/3253301726 learned_addr learned my addr 172.21.15.12:0/3253301726 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f62337fe700 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c2bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41652/0 (socket says 172.21.15.12:41652) 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.573+0000 7f62337fe700 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1b720 0x55b436c23e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f62327fc700 1 -- 172.21.15.12:0/3253301726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 msgr2=0x55b436c2bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f62327fc700 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c2bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f62327fc700 1 -- 172.21.15.12:0/3253301726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1b720 msgr2=0x55b436c23e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f62327fc700 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1b720 0x55b436c23e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f62327fc700 1 -- 172.21.15.12:0/3253301726 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b436980c00 con 0x55b436c1a830 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f62337fe700 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c2bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f62327fc700 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1a830 0x55b436c2b190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f622800f9d0 tx=0x7f622800b2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6fcac0331124c67 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f6219ffb700 1 -- 172.21.15.12:0/3253301726 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622800f700 con 0x55b436c1a830 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f6219ffb700 1 -- 172.21.15.12:0/3253301726 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6228031070 con 0x55b436c1a830 2023-12-11T20:17:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.574+0000 7f6219ffb700 1 -- 172.21.15.12:0/3253301726 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62280054e0 con 0x55b436c1a830 2023-12-11T20:17:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 -- 172.21.15.12:0/3253301726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1a830 msgr2=0x55b436c2b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1a830 0x55b436c2b190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f622800f9d0 tx=0x7f622800b2c0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 -- 172.21.15.12:0/3253301726 shutdown_connections 2023-12-11T20:17:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c1b720 0x55b436c23e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c19ed0 0x55b436c2bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3253301726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1a830 0x55b436c2b190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 -- 172.21.15.12:0/3253301726 >> 172.21.15.12:0/3253301726 conn(0x55b436b49780 msgr2=0x55b436c16460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 -- 172.21.15.12:0/3253301726 shutdown_connections 2023-12-11T20:17:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.575+0000 7f624cf46b80 1 -- 172.21.15.12:0/3253301726 wait complete. 2023-12-11T20:17:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.576+0000 7f624cf46b80 1 -- start start 2023-12-11T20:17:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.576+0000 7f624cf46b80 1 Processor -- start 2023-12-11T20:17:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c19ed0 0x55b436c80250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c1a830 0x55b436c827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f624cf46b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c84cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f624cf46b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436c212c0 con 0x55b436c19ed0 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f624cf46b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436c21400 con 0x55b436c1b720 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f624cf46b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b436c85260 con 0x55b436c1a830 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f624cf46b80 10 client.0 _ll_register_callbacks cb 0x55b436a53a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f62337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c19ed0 0x55b436c80250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f62337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c19ed0 0x55b436c80250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36874/0 (socket says 172.21.15.12:36874) 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f62337fe700 1 -- 172.21.15.12:0/3398715966 learned_addr learned my addr 172.21.15.12:0/3398715966 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.577+0000 7f62327fc700 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c1a830 0x55b436c827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f62337fe700 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c84cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f62337fe700 1 -- 172.21.15.12:0/3398715966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c1a830 msgr2=0x55b436c827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f62337fe700 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c1a830 0x55b436c827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f62337fe700 1 -- 172.21.15.12:0/3398715966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 msgr2=0x55b436c84cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f62337fe700 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c84cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f62337fe700 1 -- 172.21.15.12:0/3398715966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c028040 con 0x55b436c19ed0 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f62337fe700 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c19ed0 0x55b436c80250 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f622c009310 tx=0x7f622c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f732ac82e2f0b691 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f6216ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f6216ff5700 1 -- 172.21.15.12:0/3398715966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c032070 con 0x55b436c19ed0 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f6216ff5700 1 -- 172.21.15.12:0/3398715966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f622c02d7c0 con 0x55b436c19ed0 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.578+0000 7f624cf46b80 1 -- 172.21.15.12:0/3398715966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f622c00f040 con 0x55b436c19ed0 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f6216ff5700 1 -- 172.21.15.12:0/3398715966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f622c00e040 con 0x55b436c19ed0 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f624cf46b80 10 client.16047 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f624cf46b80 1 -- 172.21.15.12:0/3398715966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b436997d80 con 0x55b436c19ed0 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f6216ff5700 1 -- 172.21.15.12:0/3398715966 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f622c00f040 con 0x55b436c19ed0 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f6216ff5700 1 -- 172.21.15.12:0/3398715966 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f622c02b040 con 0x55b436c19ed0 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f624cf46b80 10 client.16047 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f624cf46b80 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f624cf46b80 20 client.16047 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b436c86c20 0x55b436c89040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f624cf46b80 4 client.16047 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.579+0000 7f624cf46b80 1 -- 172.21.15.12:0/3398715966 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b436b34f70 con 0x55b436c86c20 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.580+0000 7f62327fc700 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b436c86c20 0x55b436c89040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.581+0000 7f62327fc700 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b436c86c20 0x55b436c89040 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6222db173431c68e server_cookie=9c8813e1e184d16f in_seq=0 out_seq=0 2023-12-11T20:17:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.581+0000 7f6216ff5700 10 client.16047 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.592+0000 7f6216ff5700 1 -- 172.21.15.12:0/3398715966 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b436b34f70 con 0x55b436c86c20 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.592+0000 7f6216ff5700 10 client.16047 handle_command_reply: tid=0 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.592+0000 7f624cf46b80 1 client.16047 shutdown 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 -- 172.21.15.12:0/3398715966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c19ed0 msgr2=0x55b436c80250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c19ed0 0x55b436c80250 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f622c009310 tx=0x7f622c021040 comp rx=0 tx=0).stop 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 -- 172.21.15.12:0/3398715966 shutdown_connections 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b436c86c20 0x55b436c89040 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b436c1b720 0x55b436c84cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b436c19ed0 0x55b436c80250 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f6216ff5700 0 client.16047 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 --2- 172.21.15.12:0/3398715966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b436c1a830 0x55b436c827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 -- 172.21.15.12:0/3398715966 >> 172.21.15.12:0/3398715966 conn(0x55b436b49780 msgr2=0x55b436c22e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 -- 172.21.15.12:0/3398715966 shutdown_connections 2023-12-11T20:17:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 1 -- 172.21.15.12:0/3398715966 wait complete. 2023-12-11T20:17:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.593+0000 7f624cf46b80 20 client.16047 trim_cache size 0 max 16384 2023-12-11T20:17:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:17:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:17:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:17:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:17:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 -- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f621c0a1470 msgr2=0x7f621c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f621c0a1470 0x7f621c0a3930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f62240a20f0 tx=0x7f62240d08a0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 -- 172.21.15.12:0/3925859602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62341003c0 msgr2=0x7f6234104300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62341003c0 0x7f6234104300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f622400e970 tx=0x7f622400ec80 comp rx=0 tx=0).stop 2023-12-11T20:17:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 -- 172.21.15.12:0/3925859602 shutdown_connections 2023-12-11T20:17:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f621c0a1470 0x7f621c0a3930 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6234102ed0 0x7f6234103350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62341003c0 0x7f6234104300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 --2- 172.21.15.12:0/3925859602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6234101f50 0x7f6234102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 -- 172.21.15.12:0/3925859602 >> 172.21.15.12:0/3925859602 conn(0x7f62340fb930 msgr2=0x7f6234068a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 -- 172.21.15.12:0/3925859602 shutdown_connections 2023-12-11T20:17:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:17:56.594+0000 7f62395ff700 1 -- 172.21.15.12:0/3925859602 wait complete. 2023-12-11T20:17:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.721+0000 7fa572dff700 1 -- 172.21.15.12:0/2925499524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c104860 msgr2=0x7fa56c106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.721+0000 7fa572dff700 1 --2- 172.21.15.12:0/2925499524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c104860 0x7fa56c106c50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa558009990 tx=0x7fa558009ca0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.722+0000 7fa572dff700 1 -- 172.21.15.12:0/2925499524 shutdown_connections 2023-12-11T20:17:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.722+0000 7fa572dff700 1 --2- 172.21.15.12:0/2925499524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c101f30 0x7fa56c104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.722+0000 7fa572dff700 1 --2- 172.21.15.12:0/2925499524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c107190 0x7fa56c109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.722+0000 7fa572dff700 1 --2- 172.21.15.12:0/2925499524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c104860 0x7fa56c106c50 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.722+0000 7fa572dff700 1 -- 172.21.15.12:0/2925499524 >> 172.21.15.12:0/2925499524 conn(0x7fa56c0fb920 msgr2=0x7fa56c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.722+0000 7fa572dff700 1 -- 172.21.15.12:0/2925499524 shutdown_connections 2023-12-11T20:17:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.722+0000 7fa572dff700 1 -- 172.21.15.12:0/2925499524 wait complete. 2023-12-11T20:17:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.723+0000 7fa572dff700 1 Processor -- start 2023-12-11T20:17:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.723+0000 7fa572dff700 1 -- start start 2023-12-11T20:17:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.723+0000 7fa572dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c101f30 0x7fa56c101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.723+0000 7fa572dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c104860 0x7fa56c0ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.723+0000 7fa572dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c107190 0x7fa56c100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa572dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c100bc0 con 0x7fa56c101f30 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa572dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c100d30 con 0x7fa56c107190 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa572dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1a13a0 con 0x7fa56c104860 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa570b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c101f30 0x7fa56c101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa57139c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c107190 0x7fa56c100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa570b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c101f30 0x7fa56c101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36896/0 (socket says 172.21.15.12:36896) 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa570b9b700 1 -- 172.21.15.12:0/266715508 learned_addr learned my addr 172.21.15.12:0/266715508 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa56bfff700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c104860 0x7fa56c0ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa570b9b700 1 -- 172.21.15.12:0/266715508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c104860 msgr2=0x7fa56c0ffee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa570b9b700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c104860 0x7fa56c0ffee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa570b9b700 1 -- 172.21.15.12:0/266715508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c107190 msgr2=0x7fa56c100420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa570b9b700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c107190 0x7fa56c100420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa570b9b700 1 -- 172.21.15.12:0/266715508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580095f0 con 0x7fa56c101f30 2023-12-11T20:17:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.724+0000 7fa56bfff700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c104860 0x7fa56c0ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.725+0000 7fa570b9b700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c101f30 0x7fa56c101850 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa56000d980 tx=0x7fa56000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.725+0000 7fa569ffb700 1 -- 172.21.15.12:0/266715508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560004220 con 0x7fa56c101f30 2023-12-11T20:17:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.725+0000 7fa569ffb700 1 -- 172.21.15.12:0/266715508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa560007640 con 0x7fa56c101f30 2023-12-11T20:17:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.725+0000 7fa572dff700 1 -- 172.21.15.12:0/266715508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c1a1630 con 0x7fa56c101f30 2023-12-11T20:17:56.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.725+0000 7fa569ffb700 1 -- 172.21.15.12:0/266715508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600055e0 con 0x7fa56c101f30 2023-12-11T20:17:56.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.725+0000 7fa572dff700 1 -- 172.21.15.12:0/266715508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c1a1b40 con 0x7fa56c101f30 2023-12-11T20:17:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.729+0000 7fa569ffb700 1 -- 172.21.15.12:0/266715508 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa560004750 con 0x7fa56c101f30 2023-12-11T20:17:56.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.730+0000 7fa586692b80 1 Processor -- start 2023-12-11T20:17:56.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa586692b80 1 -- start start 2023-12-11T20:17:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa586692b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fde3d0 0x557d44fde7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa569ffb700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa55c0a1480 0x7fa55c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa586692b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fded30 0x557d44fdf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa586692b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 0x557d44fe00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa586692b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44f39b50 con 0x557d44fded30 2023-12-11T20:17:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa586692b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44f37470 con 0x557d44fdfc20 2023-12-11T20:17:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa586692b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44f32d60 con 0x557d44fde3d0 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.731+0000 7fa569ffb700 1 -- 172.21.15.12:0/266715508 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5600ccc10 con 0x7fa56c101f30 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa570b9b700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa55c0a1480 0x7fa55c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fde3d0 0x557d44fde7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fde3d0 0x557d44fde7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41694/0 (socket says 172.21.15.12:41694) 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa56bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fded30 0x557d44fdf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 -- 172.21.15.12:0/2603634630 learned_addr learned my addr 172.21.15.12:0/2603634630 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 --2- 172.21.15.12:0/2603634630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 0x557d44fe00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 -- 172.21.15.12:0/2603634630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 msgr2=0x557d44fe00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 --2- 172.21.15.12:0/2603634630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 0x557d44fe00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 -- 172.21.15.12:0/2603634630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fded30 msgr2=0x557d44fdf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 --2- 172.21.15.12:0/2603634630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fded30 0x557d44fdf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 -- 172.21.15.12:0/2603634630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d44daf630 con 0x557d44fde3d0 2023-12-11T20:17:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa570b9b700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa55c0a1480 0x7fa55c0a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa5600046a0 tx=0x7fa5600045e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.732+0000 7fa57139c700 1 --2- 172.21.15.12:0/2603634630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fde3d0 0x557d44fde7f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa564009fd0 tx=0x7fa564009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=449eb43b0c1b970a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.733+0000 7fa556ffd700 1 -- 172.21.15.12:0/2603634630 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400e070 con 0x557d44fde3d0 2023-12-11T20:17:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.733+0000 7fa556ffd700 1 -- 172.21.15.12:0/2603634630 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa56400f040 con 0x557d44fde3d0 2023-12-11T20:17:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.733+0000 7fa556ffd700 1 -- 172.21.15.12:0/2603634630 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564015ce0 con 0x557d44fde3d0 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 -- 172.21.15.12:0/2603634630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fde3d0 msgr2=0x557d44fde7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 --2- 172.21.15.12:0/2603634630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fde3d0 0x557d44fde7f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa564009fd0 tx=0x7fa564009920 comp rx=0 tx=0).stop 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 -- 172.21.15.12:0/2603634630 shutdown_connections 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 --2- 172.21.15.12:0/2603634630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 0x557d44fe00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 --2- 172.21.15.12:0/2603634630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fde3d0 0x557d44fde7f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 --2- 172.21.15.12:0/2603634630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fded30 0x557d44fdf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 -- 172.21.15.12:0/2603634630 >> 172.21.15.12:0/2603634630 conn(0x557d44f0d7e0 msgr2=0x557d44fdad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 -- 172.21.15.12:0/2603634630 shutdown_connections 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 -- 172.21.15.12:0/2603634630 wait complete. 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.734+0000 7fa586692b80 1 -- start start 2023-12-11T20:17:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa586692b80 1 Processor -- start 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa586692b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fe81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa586692b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fe86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa586692b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 0x557d44fef720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa586692b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44eec560 con 0x557d44fde3d0 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa586692b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44eec200 con 0x557d44fdfc20 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa586692b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44db1920 con 0x557d44fded30 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa586692b80 10 client.0 _ll_register_callbacks cb 0x557d44e17a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.735+0000 7fa57139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fe81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fe81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36918/0 (socket says 172.21.15.12:36918) 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 -- 172.21.15.12:0/4273966833 learned_addr learned my addr 172.21.15.12:0/4273966833 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa56bfff700 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fe86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 0x557d44fef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 -- 172.21.15.12:0/4273966833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 msgr2=0x557d44fe86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fe86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 -- 172.21.15.12:0/4273966833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 msgr2=0x557d44fef720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 0x557d44fef720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 -- 172.21.15.12:0/4273966833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa564008550 con 0x557d44fde3d0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa57139c700 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fe81a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa564009b00 tx=0x7fa564009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ed25c9f0e61231 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.736+0000 7fa54bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.737+0000 7fa54bfff700 1 -- 172.21.15.12:0/4273966833 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400e050 con 0x557d44fde3d0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.737+0000 7fa586692b80 1 -- 172.21.15.12:0/4273966833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d44fd1b40 con 0x557d44fde3d0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.737+0000 7fa54bfff700 1 -- 172.21.15.12:0/4273966833 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa564020040 con 0x557d44fde3d0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.737+0000 7fa54bfff700 1 -- 172.21.15.12:0/4273966833 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa564015e30 con 0x557d44fde3d0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.737+0000 7fa586692b80 10 client.16059 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.737+0000 7fa586692b80 1 -- 172.21.15.12:0/4273966833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557d44d5bde0 con 0x557d44fde3d0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.737+0000 7fa54bfff700 1 -- 172.21.15.12:0/4273966833 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557d44fd1b40 con 0x557d44fde3d0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.738+0000 7fa54bfff700 1 -- 172.21.15.12:0/4273966833 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa564005040 con 0x557d44fde3d0 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.738+0000 7fa586692b80 10 client.16059 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.738+0000 7fa586692b80 10 client.16059 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.738+0000 7fa586692b80 20 client.16059 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.738+0000 7fa586692b80 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x557d44ff3ef0 0x557d44ff6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.738+0000 7fa586692b80 4 client.16059 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.738+0000 7fa586692b80 1 -- 172.21.15.12:0/4273966833 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d44fadf40 con 0x557d44ff3ef0 2023-12-11T20:17:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.738+0000 7fa56bfff700 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x557d44ff3ef0 0x557d44ff6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.739+0000 7fa54bfff700 10 client.16059 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:17:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.739+0000 7fa56bfff700 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x557d44ff3ef0 0x557d44ff6310 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55a7a009895a7db4 server_cookie=2541effd82dec14b in_seq=0 out_seq=0 2023-12-11T20:17:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa54bfff700 1 -- 172.21.15.12:0/4273966833 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557d44fadf40 con 0x557d44ff3ef0 2023-12-11T20:17:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa54bfff700 10 client.16059 handle_command_reply: tid=0 2023-12-11T20:17:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 client.16059 shutdown 2023-12-11T20:17:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 -- 172.21.15.12:0/4273966833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 msgr2=0x557d44fe81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fe81a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa564009b00 tx=0x7fa564009df0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 -- 172.21.15.12:0/4273966833 shutdown_connections 2023-12-11T20:17:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x557d44ff3ef0 0x557d44ff6310 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fdfc20 0x557d44fef720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fe81a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 --2- 172.21.15.12:0/4273966833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fe86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa586692b80 1 -- 172.21.15.12:0/4273966833 >> 172.21.15.12:0/4273966833 conn(0x557d44f0d7e0 msgr2=0x557d44fd9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.740+0000 7fa54bfff700 0 client.16059 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:17:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.741+0000 7fa586692b80 1 -- 172.21.15.12:0/4273966833 shutdown_connections 2023-12-11T20:17:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.741+0000 7fa586692b80 1 -- 172.21.15.12:0/4273966833 wait complete. 2023-12-11T20:17:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.741+0000 7fa586692b80 20 client.16059 trim_cache size 0 max 16384 2023-12-11T20:17:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.758+0000 7fa586692b80 1 Processor -- start 2023-12-11T20:17:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.758+0000 7fa586692b80 1 -- start start 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.758+0000 7fa586692b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fde3d0 0x557d44fefdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.758+0000 7fa586692b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.758+0000 7fa586692b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fdfc20 0x557d44fe2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.758+0000 7fa586692b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44ff3bd0 con 0x557d44fdfc20 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.758+0000 7fa586692b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44fda4d0 con 0x557d44fde3d0 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.758+0000 7fa586692b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d44fdf400 con 0x557d44fded30 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fdfc20 0x557d44fe2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fdfc20 0x557d44fe2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36920/0 (socket says 172.21.15.12:36920) 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 -- 172.21.15.12:0/1214983849 learned_addr learned my addr 172.21.15.12:0/1214983849 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa56bfff700 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fde3d0 0x557d44fefdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 -- 172.21.15.12:0/1214983849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 msgr2=0x557d44fef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 -- 172.21.15.12:0/1214983849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fde3d0 msgr2=0x557d44fefdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fde3d0 0x557d44fefdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa57139c700 1 -- 172.21.15.12:0/1214983849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d44d44c60 con 0x557d44fdfc20 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.759+0000 7fa56bfff700 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.760+0000 7fa57139c700 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fdfc20 0x557d44fe2b50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x557d44fe7e50 tx=0x7fa564009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b9a86af2dabf13 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.760+0000 7fa5577fe700 1 -- 172.21.15.12:0/1214983849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400e020 con 0x557d44fdfc20 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.760+0000 7fa5577fe700 1 -- 172.21.15.12:0/1214983849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa564005a20 con 0x557d44fdfc20 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.760+0000 7fa5577fe700 1 -- 172.21.15.12:0/1214983849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564015e70 con 0x557d44fdfc20 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.760+0000 7fa586692b80 1 -- 172.21.15.12:0/1214983849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fdfc20 msgr2=0x557d44fe2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.760+0000 7fa586692b80 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fdfc20 0x557d44fe2b50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x557d44fe7e50 tx=0x7fa564009920 comp rx=0 tx=0).stop 2023-12-11T20:17:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 -- 172.21.15.12:0/1214983849 shutdown_connections 2023-12-11T20:17:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fde3d0 0x557d44fefdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fdfc20 0x557d44fe2b50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 --2- 172.21.15.12:0/1214983849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fded30 0x557d44fef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 -- 172.21.15.12:0/1214983849 >> 172.21.15.12:0/1214983849 conn(0x557d44f0d7e0 msgr2=0x557d44ffac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 -- 172.21.15.12:0/1214983849 shutdown_connections 2023-12-11T20:17:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 -- 172.21.15.12:0/1214983849 wait complete. 2023-12-11T20:17:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 -- start start 2023-12-11T20:17:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.761+0000 7fa586692b80 1 Processor -- start 2023-12-11T20:17:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa586692b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa586692b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fded30 0x557d45046380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa586692b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fdfc20 0x557d450488d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa586692b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d45048e10 con 0x557d44fde3d0 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa586692b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d45048f50 con 0x557d44fded30 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa586692b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d45049110 con 0x557d44fdfc20 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa586692b80 10 client.0 _ll_register_callbacks cb 0x557d44e17a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa57139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa57139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36936/0 (socket says 172.21.15.12:36936) 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.762+0000 7fa57139c700 1 -- 172.21.15.12:0/3999768642 learned_addr learned my addr 172.21.15.12:0/3999768642 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa57139c700 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fdfc20 0x557d450488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa57139c700 1 -- 172.21.15.12:0/3999768642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fdfc20 msgr2=0x557d450488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa57139c700 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fdfc20 0x557d450488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa57139c700 1 -- 172.21.15.12:0/3999768642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fded30 msgr2=0x557d45046380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa57139c700 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fded30 0x557d45046380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa57139c700 1 -- 172.21.15.12:0/3999768642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c10a1f0 con 0x557d44fde3d0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa57139c700 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fed6d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa564015870 tx=0x7fa564009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa53bfae1757699 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa54bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa54bfff700 1 -- 172.21.15.12:0/3999768642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400e070 con 0x557d44fde3d0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa54bfff700 1 -- 172.21.15.12:0/3999768642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa564032460 con 0x557d44fde3d0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.763+0000 7fa586692b80 1 -- 172.21.15.12:0/3999768642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa56400f040 con 0x557d44fde3d0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa54bfff700 1 -- 172.21.15.12:0/3999768642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa564005270 con 0x557d44fde3d0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa586692b80 10 client.16065 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa586692b80 1 -- 172.21.15.12:0/3999768642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557d44d5bde0 con 0x557d44fde3d0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa54bfff700 1 -- 172.21.15.12:0/3999768642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa564051020 con 0x557d44fde3d0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa54bfff700 1 -- 172.21.15.12:0/3999768642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa564018480 con 0x557d44fde3d0 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa586692b80 10 client.16065 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa586692b80 10 client.16065 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa586692b80 20 client.16065 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa586692b80 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x557d4504a6f0 0x557d4504cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa586692b80 4 client.16065 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:17:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.764+0000 7fa586692b80 1 -- 172.21.15.12:0/3999768642 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557d44ef8fd0 con 0x557d4504a6f0 2023-12-11T20:17:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.765+0000 7fa56bfff700 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x557d4504a6f0 0x557d4504cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.765+0000 7fa56bfff700 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x557d4504a6f0 0x557d4504cae0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe451539d9d8a7b8 server_cookie=7d37d74ac551655e in_seq=0 out_seq=0 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.765+0000 7fa54bfff700 10 client.16065 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.765+0000 7fa54bfff700 1 -- 172.21.15.12:0/3999768642 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557d44ef8fd0 con 0x557d4504a6f0 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.765+0000 7fa54bfff700 10 client.16065 handle_command_reply: tid=0 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.765+0000 7fa586692b80 1 client.16065 shutdown 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 -- 172.21.15.12:0/3999768642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 msgr2=0x557d44fed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fed6d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa564015870 tx=0x7fa564009ad0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 -- 172.21.15.12:0/3999768642 shutdown_connections 2023-12-11T20:17:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x557d4504a6f0 0x557d4504cae0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d44fdfc20 0x557d450488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d44fde3d0 0x557d44fed6d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 --2- 172.21.15.12:0/3999768642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d44fded30 0x557d45046380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 -- 172.21.15.12:0/3999768642 >> 172.21.15.12:0/3999768642 conn(0x557d44f0d7e0 msgr2=0x557d44fe2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa54bfff700 0 client.16065 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 -- 172.21.15.12:0/3999768642 shutdown_connections 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 1 -- 172.21.15.12:0/3999768642 wait complete. 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.766+0000 7fa586692b80 20 client.16065 trim_cache size 0 max 16384 2023-12-11T20:17:56.767 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:17:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 -- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa55c0a1480 msgr2=0x7fa55c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa55c0a1480 0x7fa55c0a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa5600046a0 tx=0x7fa5600045e0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 -- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c101f30 msgr2=0x7fa56c101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c101f30 0x7fa56c101850 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa56000d980 tx=0x7fa56000dc90 comp rx=0 tx=0).stop 2023-12-11T20:17:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 -- 172.21.15.12:0/266715508 shutdown_connections 2023-12-11T20:17:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa55c0a1480 0x7fa55c0a3940 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56c107190 0x7fa56c100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56c101f30 0x7fa56c101850 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 --2- 172.21.15.12:0/266715508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa56c104860 0x7fa56c0ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 -- 172.21.15.12:0/266715508 >> 172.21.15.12:0/266715508 conn(0x7fa56c0fb920 msgr2=0x7fa56c103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 -- 172.21.15.12:0/266715508 shutdown_connections 2023-12-11T20:17:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:56.767+0000 7fa572dff700 1 -- 172.21.15.12:0/266715508 wait complete. 2023-12-11T20:17:56.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:17:57.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2094857770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec4103520 msgr2=0x7f1ec4103940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2094857770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec4103520 0x7f1ec4103940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00099c0 tx=0x7f1ec0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2094857770 shutdown_connections 2023-12-11T20:17:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2094857770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ec41050b0 0x7f1ec410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2094857770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec4103520 0x7f1ec4103940 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2094857770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ec4104710 0x7f1ec4104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2094857770 >> 172.21.15.12:0/2094857770 conn(0x7f1ec40fea70 msgr2=0x7f1ec4100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2094857770 shutdown_connections 2023-12-11T20:17:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.057+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2094857770 wait complete. 2023-12-11T20:17:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.058+0000 7f1ecab9d700 1 Processor -- start 2023-12-11T20:17:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.059+0000 7f1ecab9d700 1 -- start start 2023-12-11T20:17:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.059+0000 7f1ecab9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ec4103520 0x7f1ec41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.059+0000 7f1ecab9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ec4104710 0x7f1ec41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.059+0000 7f1ecab9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec41050b0 0x7f1ec41a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.059+0000 7f1ecab9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec41a0dd0 con 0x7f1ec41050b0 2023-12-11T20:17:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.059+0000 7f1ecab9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec41a0f10 con 0x7f1ec4103520 2023-12-11T20:17:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.059+0000 7f1ecab9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec41a10a0 con 0x7f1ec4104710 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.059+0000 7f1eca39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec41050b0 0x7f1ec41a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1eca39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec41050b0 0x7f1ec41a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36958/0 (socket says 172.21.15.12:36958) 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1eca39c700 1 -- 172.21.15.12:0/2119142987 learned_addr learned my addr 172.21.15.12:0/2119142987 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1ec939a700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ec4104710 0x7f1ec41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ec4103520 0x7f1ec41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1eca39c700 1 -- 172.21.15.12:0/2119142987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ec4104710 msgr2=0x7f1ec41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1eca39c700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ec4104710 0x7f1ec41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1eca39c700 1 -- 172.21.15.12:0/2119142987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ec4103520 msgr2=0x7f1ec41992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1eca39c700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ec4103520 0x7f1ec41992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1eca39c700 1 -- 172.21.15.12:0/2119142987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00095f0 con 0x7f1ec41050b0 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1ec939a700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ec4104710 0x7f1ec41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.060+0000 7f1eca39c700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec41050b0 0x7f1ec41a0800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00ef30 tx=0x7f1ebc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.061+0000 7f1ebaffd700 1 -- 172.21.15.12:0/2119142987 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc018070 con 0x7f1ec41050b0 2023-12-11T20:17:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.061+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2119142987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec41a1320 con 0x7f1ec41050b0 2023-12-11T20:17:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.061+0000 7f1ebaffd700 1 -- 172.21.15.12:0/2119142987 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ebc00f040 con 0x7f1ec41050b0 2023-12-11T20:17:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.061+0000 7f1ebaffd700 1 -- 172.21.15.12:0/2119142987 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00cbc0 con 0x7f1ec41050b0 2023-12-11T20:17:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.061+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2119142987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec41a1830 con 0x7f1ec41050b0 2023-12-11T20:17:57.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.066+0000 7f1ebaffd700 1 -- 172.21.15.12:0/2119142987 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1ebc007500 con 0x7f1ec41050b0 2023-12-11T20:17:57.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1edf665b80 1 Processor -- start 2023-12-11T20:17:57.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1edf665b80 1 -- start start 2023-12-11T20:17:57.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fcee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fcf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1edf665b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7f29b50 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1edf665b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7f27470 con 0x55b0c7fcfde0 2023-12-11T20:17:57.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1edf665b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7f22d60 con 0x55b0c7fcea60 2023-12-11T20:17:57.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.067+0000 7f1ebaffd700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1eb00a1520 0x7f1eb00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ebaffd700 1 -- 172.21.15.12:0/2119142987 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1ebc0cc870 con 0x7f1ec41050b0 2023-12-11T20:17:57.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fcf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:43920/0 (socket says 172.21.15.12:43920) 2023-12-11T20:17:57.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 -- 172.21.15.12:0/3364223600 learned_addr learned my addr 172.21.15.12:0/3364223600 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:57.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fcee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 -- 172.21.15.12:0/3364223600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 msgr2=0x55b0c7fcee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fcee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 -- 172.21.15.12:0/3364223600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 msgr2=0x55b0c7fcf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fcf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.068+0000 7f1ec939a700 1 -- 172.21.15.12:0/3364223600 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0c7d9f630 con 0x55b0c7fcfde0 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.069+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fcf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.069+0000 7f1eca39c700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1eb00a1520 0x7f1eb00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.069+0000 7f1ec939a700 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd0240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1eb401ef70 tx=0x7f1eb4009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3e868b46ed0aff server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.069+0000 7f1eaffff700 1 -- 172.21.15.12:0/3364223600 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb401cad0 con 0x55b0c7fcfde0 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.069+0000 7f1eaffff700 1 -- 172.21.15.12:0/3364223600 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1eb4024020 con 0x55b0c7fcfde0 2023-12-11T20:17:57.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.069+0000 7f1eaffff700 1 -- 172.21.15.12:0/3364223600 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400e620 con 0x55b0c7fcfde0 2023-12-11T20:17:57.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 -- 172.21.15.12:0/3364223600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 msgr2=0x55b0c7fd0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd0240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1eb401ef70 tx=0x7f1eb4009c50 comp rx=0 tx=0).stop 2023-12-11T20:17:57.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1eca39c700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1eb00a1520 0x7f1eb00a39e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc004b80 tx=0x7f1ebc004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:57.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 -- 172.21.15.12:0/3364223600 shutdown_connections 2023-12-11T20:17:57.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd0240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fcee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 --2- 172.21.15.12:0/3364223600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fcf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 -- 172.21.15.12:0/3364223600 >> 172.21.15.12:0/3364223600 conn(0x55b0c7efd7e0 msgr2=0x55b0c7fc93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 -- 172.21.15.12:0/3364223600 shutdown_connections 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.070+0000 7f1edf665b80 1 -- 172.21.15.12:0/3364223600 wait complete. 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.071+0000 7f1edf665b80 1 -- start start 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.071+0000 7f1edf665b80 1 Processor -- start 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.071+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fd8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.071+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fd8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fdf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1edf665b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7edc560 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1edf665b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7edc200 con 0x55b0c7fcfde0 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1edf665b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7da1920 con 0x55b0c7fcea60 2023-12-11T20:17:57.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1edf665b80 10 client.0 _ll_register_callbacks cb 0x55b0c7e07a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fd8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fd8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36974/0 (socket says 172.21.15.12:36974) 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec9b9b700 1 -- 172.21.15.12:0/4085536195 learned_addr learned my addr 172.21.15.12:0/4085536195 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec939a700 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fd8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec939a700 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fdf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec9b9b700 1 -- 172.21.15.12:0/4085536195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 msgr2=0x55b0c7fd8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fd8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec9b9b700 1 -- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 msgr2=0x55b0c7fdf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fdf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec9b9b700 1 -- 172.21.15.12:0/4085536195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec410c2b0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.072+0000 7f1ec939a700 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fdf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.073+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fd8850 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00099c0 tx=0x7f1ec0005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90986f07cd171b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.073+0000 7f1ead7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.073+0000 7f1ead7fa700 1 -- 172.21.15.12:0/4085536195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0003960 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.073+0000 7f1edf665b80 1 -- 172.21.15.12:0/4085536195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0c7fc19e0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.073+0000 7f1ead7fa700 1 -- 172.21.15.12:0/4085536195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1ec00056a0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.073+0000 7f1ead7fa700 1 -- 172.21.15.12:0/4085536195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ec000bcb0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.073+0000 7f1edf665b80 10 client.16077 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:57.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.073+0000 7f1edf665b80 1 -- 172.21.15.12:0/4085536195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f1eb4011440 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.074+0000 7f1ead7fa700 1 -- 172.21.15.12:0/4085536195 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ec0033080 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.074+0000 7f1ead7fa700 1 -- 172.21.15.12:0/4085536195 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1ec000faa0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.074+0000 7f1edf665b80 10 client.16077 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.074+0000 7f1edf665b80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.074+0000 7f1edf665b80 20 client.16077 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.074+0000 7f1edf665b80 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0c7fe4180 0x55b0c7fe65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.074+0000 7f1edf665b80 4 client.16077 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.074+0000 7f1edf665b80 1 -- 172.21.15.12:0/4085536195 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0c7f9df40 con 0x55b0c7fe4180 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.075+0000 7f1ec939a700 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0c7fe4180 0x55b0c7fe65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.075+0000 7f1ec939a700 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0c7fe4180 0x55b0c7fe65a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc87d590818f7bd8 server_cookie=dba5c017cf3940bb in_seq=0 out_seq=0 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.075+0000 7f1ead7fa700 10 client.16077 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1ead7fa700 1 -- 172.21.15.12:0/4085536195 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b0c7f9df40 con 0x55b0c7fe4180 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1ead7fa700 10 client.16077 handle_command_reply: tid=0 2023-12-11T20:17:57.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 client.16077 shutdown 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 -- 172.21.15.12:0/4085536195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 msgr2=0x55b0c7fd8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fd8850 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00099c0 tx=0x7f1ec0005270 comp rx=0 tx=0).stop 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 -- 172.21.15.12:0/4085536195 shutdown_connections 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0c7fe4180 0x55b0c7fe65a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fdf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fd8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 --2- 172.21.15.12:0/4085536195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fd8850 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1ead7fa700 0 client.16077 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.076+0000 7f1edf665b80 1 -- 172.21.15.12:0/4085536195 >> 172.21.15.12:0/4085536195 conn(0x55b0c7efd7e0 msgr2=0x55b0c7fcd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.077+0000 7f1edf665b80 1 -- 172.21.15.12:0/4085536195 shutdown_connections 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.077+0000 7f1edf665b80 1 -- 172.21.15.12:0/4085536195 wait complete. 2023-12-11T20:17:57.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.077+0000 7f1edf665b80 20 client.16077 trim_cache size 0 max 16384 2023-12-11T20:17:57.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1edf665b80 1 Processor -- start 2023-12-11T20:17:57.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1edf665b80 1 -- start start 2023-12-11T20:17:57.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcea60 0x55b0c7fd7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1edf665b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7fca470 con 0x55b0c7fcfde0 2023-12-11T20:17:57.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1edf665b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7fca000 con 0x55b0c7fcea60 2023-12-11T20:17:57.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1edf665b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7fd6da0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1ec939a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1ec9b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1ec939a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36980/0 (socket says 172.21.15.12:36980) 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.095+0000 7f1ec939a700 1 -- 172.21.15.12:0/490066134 learned_addr learned my addr 172.21.15.12:0/490066134 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.096+0000 7f1ec939a700 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcea60 0x55b0c7fd7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.096+0000 7f1ec9b9b700 1 -- 172.21.15.12:0/490066134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcea60 msgr2=0x55b0c7fd7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.096+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcea60 0x55b0c7fd7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.096+0000 7f1ec9b9b700 1 -- 172.21.15.12:0/490066134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcfde0 msgr2=0x55b0c7fd01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.096+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.096+0000 7f1ec9b9b700 1 -- 172.21.15.12:0/490066134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0c7d4bde0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.096+0000 7f1ec939a700 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:57.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.096+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdf850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000ff00 tx=0x7f1ec0005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c24585dbbbc10e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:57.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1eb8bff700 1 -- 172.21.15.12:0/490066134 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec002f9b0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1eb8bff700 1 -- 172.21.15.12:0/490066134 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b0c7fc19e0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1eb8bff700 1 -- 172.21.15.12:0/490066134 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00039c0 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1edf665b80 1 -- 172.21.15.12:0/490066134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcf3c0 msgr2=0x55b0c7fdf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1edf665b80 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdf850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000ff00 tx=0x7f1ec0005ad0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1edf665b80 1 -- 172.21.15.12:0/490066134 shutdown_connections 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1edf665b80 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcea60 0x55b0c7fd7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1edf665b80 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fd01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1edf665b80 1 --2- 172.21.15.12:0/490066134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdf850 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.097+0000 7f1edf665b80 1 -- 172.21.15.12:0/490066134 >> 172.21.15.12:0/490066134 conn(0x55b0c7efd7e0 msgr2=0x55b0c7fc9280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.098+0000 7f1edf665b80 1 -- 172.21.15.12:0/490066134 shutdown_connections 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.098+0000 7f1edf665b80 1 -- 172.21.15.12:0/490066134 wait complete. 2023-12-11T20:17:57.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.098+0000 7f1edf665b80 1 -- start start 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.098+0000 7f1edf665b80 1 Processor -- start 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fdd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1edf665b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fde900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1edf665b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7fdee40 con 0x55b0c7fcf3c0 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1edf665b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7fdefb0 con 0x55b0c7fcfde0 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1edf665b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c7fdf170 con 0x55b0c7fcea60 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1edf665b80 10 client.0 _ll_register_callbacks cb 0x55b0c7e07a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1ec9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1ec9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36996/0 (socket says 172.21.15.12:36996) 2023-12-11T20:17:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1ec939a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fdd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1ec9b9b700 1 -- 172.21.15.12:0/1120752621 learned_addr learned my addr 172.21.15.12:0/1120752621 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.099+0000 7f1ec939a700 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fde900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ec939a700 1 -- 172.21.15.12:0/1120752621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 msgr2=0x55b0c7fde900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ec939a700 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fde900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ec939a700 1 -- 172.21.15.12:0/1120752621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 msgr2=0x55b0c7fdd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ec939a700 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ec939a700 1 -- 172.21.15.12:0/1120752621 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0c7d9f630 con 0x55b0c7fcea60 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ec939a700 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fdd400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4011730 tx=0x7f1eb4030a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ca1c5922ee67d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ead7fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ead7fa700 1 -- 172.21.15.12:0/1120752621 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4030b00 con 0x55b0c7fcea60 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1edf665b80 1 -- 172.21.15.12:0/1120752621 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1eb4024020 con 0x55b0c7fcea60 2023-12-11T20:17:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.100+0000 7f1ead7fa700 1 -- 172.21.15.12:0/1120752621 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1eb4000e40 con 0x55b0c7fcea60 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1ead7fa700 1 -- 172.21.15.12:0/1120752621 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1eb4030c60 con 0x55b0c7fcea60 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1edf665b80 10 client.25855 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1edf665b80 1 -- 172.21.15.12:0/1120752621 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f1eb4011440 con 0x55b0c7fcea60 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1ead7fa700 1 -- 172.21.15.12:0/1120752621 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1eb4024020 con 0x55b0c7fcea60 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1ead7fa700 1 -- 172.21.15.12:0/1120752621 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1eb401e0e0 con 0x55b0c7fcea60 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1edf665b80 10 client.25855 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1edf665b80 10 client.25855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1edf665b80 20 client.25855 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1edf665b80 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0c803b3e0 0x55b0c803d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1edf665b80 4 client.25855 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.101+0000 7f1edf665b80 1 -- 172.21.15.12:0/1120752621 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b0c7ee8fd0 con 0x55b0c803b3e0 2023-12-11T20:17:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.102+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0c803b3e0 0x55b0c803d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:57.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1ec9b9b700 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0c803b3e0 0x55b0c803d800 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce2163112b5bb9d7 server_cookie=a745d43a95cc012e in_seq=0 out_seq=0 2023-12-11T20:17:57.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1ead7fa700 10 client.25855 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1ead7fa700 1 -- 172.21.15.12:0/1120752621 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b0c7ee8fd0 con 0x55b0c803b3e0 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1ead7fa700 10 client.25855 handle_command_reply: tid=0 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 client.25855 shutdown 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 -- 172.21.15.12:0/1120752621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 msgr2=0x55b0c7fdd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fdd400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4011730 tx=0x7f1eb4030a90 comp rx=0 tx=0).stop 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 -- 172.21.15.12:0/1120752621 shutdown_connections 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0c803b3e0 0x55b0c803d800 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0c7fcfde0 0x55b0c7fde900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1ead7fa700 0 client.25855 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0c7fcea60 0x55b0c7fdd400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 --2- 172.21.15.12:0/1120752621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0c7fcf3c0 0x55b0c7fdd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 -- 172.21.15.12:0/1120752621 >> 172.21.15.12:0/1120752621 conn(0x55b0c7efd7e0 msgr2=0x55b0c7feaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 -- 172.21.15.12:0/1120752621 shutdown_connections 2023-12-11T20:17:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.103+0000 7f1edf665b80 1 -- 172.21.15.12:0/1120752621 wait complete. 2023-12-11T20:17:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1edf665b80 20 client.25855 trim_cache size 0 max 16384 2023-12-11T20:17:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1eb00a1520 msgr2=0x7f1eb00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1eb00a1520 0x7f1eb00a39e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc004b80 tx=0x7f1ebc004ad0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec41050b0 msgr2=0x7f1ec41a0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec41050b0 0x7f1ec41a0800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00ef30 tx=0x7f1ebc00c3a0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2119142987 shutdown_connections 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1eb00a1520 0x7f1eb00a39e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ec4103520 0x7f1ec41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec41050b0 0x7f1ec41a0800 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 --2- 172.21.15.12:0/2119142987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ec4104710 0x7f1ec41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.104+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2119142987 >> 172.21.15.12:0/2119142987 conn(0x7f1ec40fea70 msgr2=0x7f1ec4107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.105+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2119142987 shutdown_connections 2023-12-11T20:17:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:57.105+0000 7f1ecab9d700 1 -- 172.21.15.12:0/2119142987 wait complete. 2023-12-11T20:17:57.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:57 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/997332533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:17:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:57 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/997332533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:17:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:57 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/997332533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:17:58.124 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:17:58.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:17:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 -- 172.21.15.12:0/555848641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 msgr2=0x7fb834106d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/555848641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 0x7fb834106d00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb820009990 tx=0x7fb820009ca0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 -- 172.21.15.12:0/555848641 shutdown_connections 2023-12-11T20:17:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/555848641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb834101fe0 0x7fb8341043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/555848641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb834107240 0x7fb834109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/555848641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 0x7fb834106d00 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 -- 172.21.15.12:0/555848641 >> 172.21.15.12:0/555848641 conn(0x7fb8340fb930 msgr2=0x7fb8340fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 -- 172.21.15.12:0/555848641 shutdown_connections 2023-12-11T20:17:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.349+0000 7fb83b1ff700 1 -- 172.21.15.12:0/555848641 wait complete. 2023-12-11T20:17:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.350+0000 7fb83b1ff700 1 Processor -- start 2023-12-11T20:17:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb83b1ff700 1 -- start start 2023-12-11T20:17:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb83b1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb834101fe0 0x7fb834199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb83b1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 0x7fb834199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb83b1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb834107240 0x7fb8341a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb83b1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341a1040 con 0x7fb834104910 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb83b1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341a1180 con 0x7fb834101fe0 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb83b1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341a1310 con 0x7fb834107240 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb833fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 0x7fb834199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb833fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 0x7fb834199a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37004/0 (socket says 172.21.15.12:37004) 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb838f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb834101fe0 0x7fb834199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.351+0000 7fb833fff700 1 -- 172.21.15.12:0/915122880 learned_addr learned my addr 172.21.15.12:0/915122880 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb83979c700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb834107240 0x7fb8341a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb833fff700 1 -- 172.21.15.12:0/915122880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb834107240 msgr2=0x7fb8341a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb833fff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb834107240 0x7fb8341a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb833fff700 1 -- 172.21.15.12:0/915122880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb834101fe0 msgr2=0x7fb834199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb833fff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb834101fe0 0x7fb834199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb833fff700 1 -- 172.21.15.12:0/915122880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200095f0 con 0x7fb834104910 2023-12-11T20:17:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb838f9b700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb834101fe0 0x7fb834199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb833fff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 0x7fb834199a50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb820005740 tx=0x7fb820005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.352+0000 7fb831ffb700 1 -- 172.21.15.12:0/915122880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82001d070 con 0x7fb834104910 2023-12-11T20:17:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.353+0000 7fb831ffb700 1 -- 172.21.15.12:0/915122880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb82000beb0 con 0x7fb834104910 2023-12-11T20:17:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.353+0000 7fb831ffb700 1 -- 172.21.15.12:0/915122880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820021410 con 0x7fb834104910 2023-12-11T20:17:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.353+0000 7fb83b1ff700 1 -- 172.21.15.12:0/915122880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8341a1590 con 0x7fb834104910 2023-12-11T20:17:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.353+0000 7fb83b1ff700 1 -- 172.21.15.12:0/915122880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8341a1960 con 0x7fb834104910 2023-12-11T20:17:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.357+0000 7fb831ffb700 1 -- 172.21.15.12:0/915122880 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb82000f720 con 0x7fb834104910 2023-12-11T20:17:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.359+0000 7fb831ffb700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8240a1500 0x7fb8240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.359+0000 7fb831ffb700 1 -- 172.21.15.12:0/915122880 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb8200ce000 con 0x7fb834104910 2023-12-11T20:17:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.359+0000 7fb838f9b700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8240a1500 0x7fb8240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.359+0000 7fb84eb13b80 1 Processor -- start 2023-12-11T20:17:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.360+0000 7fb84eb13b80 1 -- start start 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.360+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad0c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.360+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0c5c0 0x5654dad0ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.360+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0d4b0 0x5654dad0d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.360+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dac5ebd0 con 0x5654dad0d4b0 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.360+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dac5c4f0 con 0x5654dad0bc60 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.360+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dac57de0 con 0x5654dad0c5c0 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb838f9b700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8240a1500 0x7fb8240a39c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb828011490 tx=0x7fb828009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb83979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0d4b0 0x5654dad0d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb833fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0c5c0 0x5654dad0ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb833fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0c5c0 0x5654dad0ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41800/0 (socket says 172.21.15.12:41800) 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb833fff700 1 -- 172.21.15.12:0/159867251 learned_addr learned my addr 172.21.15.12:0/159867251 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb838f9b700 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad0c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb838f9b700 1 -- 172.21.15.12:0/159867251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0c5c0 msgr2=0x5654dad0ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb838f9b700 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0c5c0 0x5654dad0ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb838f9b700 1 -- 172.21.15.12:0/159867251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0d4b0 msgr2=0x5654dad0d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb838f9b700 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0d4b0 0x5654dad0d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.361+0000 7fb838f9b700 1 -- 172.21.15.12:0/159867251 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654daad46b0 con 0x5654dad0bc60 2023-12-11T20:17:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.362+0000 7fb83979c700 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0d4b0 0x5654dad0d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.362+0000 7fb838f9b700 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad0c080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb8280042b0 tx=0x7fb828014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae84a6fa5404569 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.362+0000 7fb81effd700 1 -- 172.21.15.12:0/159867251 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828003d10 con 0x5654dad0bc60 2023-12-11T20:17:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.362+0000 7fb81effd700 1 -- 172.21.15.12:0/159867251 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb828003e70 con 0x5654dad0bc60 2023-12-11T20:17:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.362+0000 7fb81effd700 1 -- 172.21.15.12:0/159867251 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82801e650 con 0x5654dad0bc60 2023-12-11T20:17:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.363+0000 7fb84eb13b80 1 -- 172.21.15.12:0/159867251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 msgr2=0x5654dad0c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.363+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad0c080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb8280042b0 tx=0x7fb828014000 comp rx=0 tx=0).stop 2023-12-11T20:17:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.364+0000 7fb84eb13b80 1 -- 172.21.15.12:0/159867251 shutdown_connections 2023-12-11T20:17:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.364+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad0c080 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.364+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0d4b0 0x5654dad0d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.364+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/159867251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0c5c0 0x5654dad0ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.364+0000 7fb84eb13b80 1 -- 172.21.15.12:0/159867251 >> 172.21.15.12:0/159867251 conn(0x5654dac32860 msgr2=0x5654dacffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.364+0000 7fb84eb13b80 1 -- 172.21.15.12:0/159867251 shutdown_connections 2023-12-11T20:17:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.364+0000 7fb84eb13b80 1 -- 172.21.15.12:0/159867251 wait complete. 2023-12-11T20:17:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.364+0000 7fb84eb13b80 1 -- start start 2023-12-11T20:17:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.365+0000 7fb84eb13b80 1 Processor -- start 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.365+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad15a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.365+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad15fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.365+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad1d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.365+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dac115e0 con 0x5654dad0c5c0 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.365+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dac11280 con 0x5654dad0bc60 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.365+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654daad69a0 con 0x5654dad0d4b0 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb84eb13b80 10 client.0 _ll_register_callbacks cb 0x5654dab3cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb833fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad15fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb833fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad15fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37028/0 (socket says 172.21.15.12:37028) 2023-12-11T20:17:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb833fff700 1 -- 172.21.15.12:0/786428735 learned_addr learned my addr 172.21.15.12:0/786428735 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb838f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad15a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb83979c700 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad1d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb833fff700 1 -- 172.21.15.12:0/786428735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 msgr2=0x5654dad1d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb833fff700 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad1d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.366+0000 7fb833fff700 1 -- 172.21.15.12:0/786428735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 msgr2=0x5654dad15a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb833fff700 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad15a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb833fff700 1 -- 172.21.15.12:0/786428735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c009940 con 0x5654dad0c5c0 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb833fff700 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad15fc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb820029040 tx=0x7fb82009b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75050599657cf98 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb813fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb813fff700 1 -- 172.21.15.12:0/786428735 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82009ad60 con 0x5654dad0c5c0 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb813fff700 1 -- 172.21.15.12:0/786428735 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb82009bb00 con 0x5654dad0c5c0 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb84eb13b80 1 -- 172.21.15.12:0/786428735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654dacf6bc0 con 0x5654dad0c5c0 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb813fff700 1 -- 172.21.15.12:0/786428735 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb82009b400 con 0x5654dad0c5c0 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb84eb13b80 10 client.16095 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.367+0000 7fb84eb13b80 1 -- 172.21.15.12:0/786428735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fb828017070 con 0x5654dad0c5c0 2023-12-11T20:17:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb813fff700 1 -- 172.21.15.12:0/786428735 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5654dacf6bc0 con 0x5654dad0c5c0 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb813fff700 1 -- 172.21.15.12:0/786428735 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb8200a3270 con 0x5654dad0c5c0 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb84eb13b80 10 client.16095 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb84eb13b80 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb84eb13b80 20 client.16095 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5654dad21570 0x5654dad23990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb84eb13b80 4 client.16095 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb84eb13b80 1 -- 172.21.15.12:0/786428735 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654dacd2fc0 con 0x5654dad21570 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.368+0000 7fb838f9b700 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5654dad21570 0x5654dad23990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.369+0000 7fb838f9b700 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5654dad21570 0x5654dad23990 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8e56be5588e02d server_cookie=42bcc912e577e1e6 in_seq=0 out_seq=0 2023-12-11T20:17:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.369+0000 7fb813fff700 10 client.16095 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb813fff700 1 -- 172.21.15.12:0/786428735 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5654dacd2fc0 con 0x5654dad21570 2023-12-11T20:17:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb813fff700 10 client.16095 handle_command_reply: tid=0 2023-12-11T20:17:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 client.16095 shutdown 2023-12-11T20:17:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 -- 172.21.15.12:0/786428735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 msgr2=0x5654dad15fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad15fc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb820029040 tx=0x7fb82009b940 comp rx=0 tx=0).stop 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 -- 172.21.15.12:0/786428735 shutdown_connections 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5654dad21570 0x5654dad23990 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0bc60 0x5654dad15a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad1d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb813fff700 0 client.16095 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/786428735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad15fc0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 -- 172.21.15.12:0/786428735 >> 172.21.15.12:0/786428735 conn(0x5654dac32860 msgr2=0x5654dacfeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 -- 172.21.15.12:0/786428735 shutdown_connections 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 1 -- 172.21.15.12:0/786428735 wait complete. 2023-12-11T20:17:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.370+0000 7fb84eb13b80 20 client.16095 trim_cache size 0 max 16384 2023-12-11T20:17:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.389+0000 7fb84eb13b80 1 Processor -- start 2023-12-11T20:17:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.389+0000 7fb84eb13b80 1 -- start start 2023-12-11T20:17:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.389+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0bc60 0x5654dad15a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.389+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad1cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.389+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0d4b0 0x5654dad15f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.389+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dad100f0 con 0x5654dad0c5c0 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.389+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dad164f0 con 0x5654dad0d4b0 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.389+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dad1e180 con 0x5654dad0bc60 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad1cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad1cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37038/0 (socket says 172.21.15.12:37038) 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 -- 172.21.15.12:0/1965121045 learned_addr learned my addr 172.21.15.12:0/1965121045 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb838f9b700 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0bc60 0x5654dad15a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb83979c700 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0d4b0 0x5654dad15f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 -- 172.21.15.12:0/1965121045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0bc60 msgr2=0x5654dad15a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0bc60 0x5654dad15a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 -- 172.21.15.12:0/1965121045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0d4b0 msgr2=0x5654dad15f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0d4b0 0x5654dad15f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 -- 172.21.15.12:0/1965121045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654daa80e60 con 0x5654dad0c5c0 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb83979c700 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0d4b0 0x5654dad15f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb838f9b700 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0bc60 0x5654dad15a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.390+0000 7fb833fff700 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad1cfc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb820099750 tx=0x7fb8200a1370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f82cab2898a9fe8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb81f7fe700 1 -- 172.21.15.12:0/1965121045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82009ad60 con 0x5654dad0c5c0 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb81f7fe700 1 -- 172.21.15.12:0/1965121045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8200b8030 con 0x5654dad0c5c0 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb81f7fe700 1 -- 172.21.15.12:0/1965121045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82009f550 con 0x5654dad0c5c0 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1965121045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 msgr2=0x5654dad1cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad1cfc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb820099750 tx=0x7fb8200a1370 comp rx=0 tx=0).stop 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1965121045 shutdown_connections 2023-12-11T20:17:58.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0d4b0 0x5654dad15f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0bc60 0x5654dad15a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1965121045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0c5c0 0x5654dad1cfc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.391+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1965121045 >> 172.21.15.12:0/1965121045 conn(0x5654dac32860 msgr2=0x5654dacff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.392+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1965121045 shutdown_connections 2023-12-11T20:17:58.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.392+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1965121045 wait complete. 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.392+0000 7fb84eb13b80 1 -- start start 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.392+0000 7fb84eb13b80 1 Processor -- start 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0bc60 0x5654dad19d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0c5c0 0x5654dad1a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb84eb13b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad77a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dad1a810 con 0x5654dad0bc60 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dad1a980 con 0x5654dad0c5c0 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb84eb13b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dad77f60 con 0x5654dad0d4b0 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb84eb13b80 10 client.0 _ll_register_callbacks cb 0x5654dab3cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb838f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0bc60 0x5654dad19d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb838f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0bc60 0x5654dad19d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37050/0 (socket says 172.21.15.12:37050) 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb838f9b700 1 -- 172.21.15.12:0/1773463848 learned_addr learned my addr 172.21.15.12:0/1773463848 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb833fff700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0c5c0 0x5654dad1a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb838f9b700 1 -- 172.21.15.12:0/1773463848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 msgr2=0x5654dad77a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb83979c700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad77a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb838f9b700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad77a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb838f9b700 1 -- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0c5c0 msgr2=0x5654dad1a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb838f9b700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0c5c0 0x5654dad1a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb838f9b700 1 -- 172.21.15.12:0/1773463848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654daad46b0 con 0x5654dad0bc60 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb833fff700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0c5c0 0x5654dad1a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.393+0000 7fb83979c700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad77a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.394+0000 7fb838f9b700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0bc60 0x5654dad19d90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb828005950 tx=0x7fb828003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4966259cfcc78845 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.394+0000 7fb813fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.394+0000 7fb813fff700 1 -- 172.21.15.12:0/1773463848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82802a040 con 0x5654dad0bc60 2023-12-11T20:17:58.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.394+0000 7fb813fff700 1 -- 172.21.15.12:0/1773463848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb828005400 con 0x5654dad0bc60 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.394+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1773463848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb828003e70 con 0x5654dad0bc60 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.394+0000 7fb813fff700 1 -- 172.21.15.12:0/1773463848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8280055c0 con 0x5654dad0bc60 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.394+0000 7fb84eb13b80 10 client.16101 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.394+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1773463848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fb828017070 con 0x5654dad0bc60 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb813fff700 1 -- 172.21.15.12:0/1773463848 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb828003e70 con 0x5654dad0bc60 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb813fff700 1 -- 172.21.15.12:0/1773463848 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb828024020 con 0x5654dad0bc60 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb84eb13b80 10 client.16101 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb84eb13b80 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb84eb13b80 20 client.16101 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5654dad79930 0x5654dad7bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb84eb13b80 4 client.16101 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:17:58.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1773463848 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5654dac1e050 con 0x5654dad79930 2023-12-11T20:17:58.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.395+0000 7fb833fff700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5654dad79930 0x5654dad7bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.396+0000 7fb833fff700 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5654dad79930 0x5654dad7bd50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b3d569e430e82e9 server_cookie=9351336522c7ab4 in_seq=0 out_seq=0 2023-12-11T20:17:58.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.396+0000 7fb813fff700 10 client.16101 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:58.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.397+0000 7fb813fff700 1 -- 172.21.15.12:0/1773463848 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5654dac1e050 con 0x5654dad79930 2023-12-11T20:17:58.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.397+0000 7fb813fff700 10 client.16101 handle_command_reply: tid=0 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.397+0000 7fb84eb13b80 1 client.16101 shutdown 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.397+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1773463848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0bc60 msgr2=0x5654dad19d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.397+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0bc60 0x5654dad19d90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb828005950 tx=0x7fb828003b50 comp rx=0 tx=0).stop 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1773463848 shutdown_connections 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5654dad79930 0x5654dad7bd50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5654dad0d4b0 0x5654dad77a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dad0bc60 0x5654dad19d90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 1 --2- 172.21.15.12:0/1773463848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5654dad0c5c0 0x5654dad1a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb813fff700 0 client.16101 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1773463848 >> 172.21.15.12:0/1773463848 conn(0x5654dac32860 msgr2=0x5654dacff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1773463848 shutdown_connections 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 1 -- 172.21.15.12:0/1773463848 wait complete. 2023-12-11T20:17:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.398+0000 7fb84eb13b80 20 client.16101 trim_cache size 0 max 16384 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "b793388d-0556-4697-b376-fbf718a406b0", 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 -- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8240a1500 msgr2=0x7fb8240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8240a1500 0x7fb8240a39c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb828011490 tx=0x7fb828009260 comp rx=0 tx=0).stop 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 -- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 msgr2=0x7fb834199a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 0x7fb834199a50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb820005740 tx=0x7fb820005770 comp rx=0 tx=0).stop 2023-12-11T20:17:58.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 -- 172.21.15.12:0/915122880 shutdown_connections 2023-12-11T20:17:58.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb8240a1500 0x7fb8240a39c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb834101fe0 0x7fb834199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb834107240 0x7fb8341a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 --2- 172.21.15.12:0/915122880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb834104910 0x7fb834199a50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 -- 172.21.15.12:0/915122880 >> 172.21.15.12:0/915122880 conn(0x7fb8340fb930 msgr2=0x7fb834101840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 -- 172.21.15.12:0/915122880 shutdown_connections 2023-12-11T20:17:58.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.399+0000 7fb83b1ff700 1 -- 172.21.15.12:0/915122880 wait complete. 2023-12-11T20:17:58.415 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:58 smithi012 ceph-mon[128787]: pgmap v436: 97 pgs: 97 active+clean; 530 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:17:58.419 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:17:58.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:58 smithi032 ceph-mon[132488]: pgmap v436: 97 pgs: 97 active+clean; 530 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:17:58.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:17:58 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:17:58.407+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v82>,<0x10000000003/client.0 v84>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v101>,<0x10000000001/sv_0 v124>,<0x10000000000/_nogroup v108>,<0x1/volumes v98>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:17:58.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:58 smithi039 ceph-mon[102205]: pgmap v436: 97 pgs: 97 active+clean; 530 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:17:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3916429105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a00102e80 msgr2=0x7f7a00109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3916429105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a00102e80 0x7f7a00109730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009f90 tx=0x7f79f800b330 comp rx=0 tx=0).stop 2023-12-11T20:17:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3916429105 shutdown_connections 2023-12-11T20:17:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3916429105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a001012f0 0x7f7a00101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3916429105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a00102e80 0x7f7a00109730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3916429105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001024e0 0x7f7a00102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3916429105 >> 172.21.15.12:0/3916429105 conn(0x7f7a000fc860 msgr2=0x7f7a000feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3916429105 shutdown_connections 2023-12-11T20:17:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.643+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3916429105 wait complete. 2023-12-11T20:17:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.644+0000 7f7a04f9d700 1 Processor -- start 2023-12-11T20:17:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.644+0000 7f7a04f9d700 1 -- start start 2023-12-11T20:17:58.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f7a04f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001012f0 0x7f7a00075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f7a04f9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a001024e0 0x7f7a000739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f7a04f9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a00102e80 0x7f7a00073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f7a04f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000746a0 con 0x7f7a001012f0 2023-12-11T20:17:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f7a04f9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00074810 con 0x7f7a001024e0 2023-12-11T20:17:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f7a04f9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a001a1240 con 0x7f7a00102e80 2023-12-11T20:17:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001012f0 0x7f7a00075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001012f0 0x7f7a00075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37068/0 (socket says 172.21.15.12:37068) 2023-12-11T20:17:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f79ff7fe700 1 -- 172.21.15.12:0/3538721190 learned_addr learned my addr 172.21.15.12:0/3538721190 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.645+0000 7f79feffd700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a001024e0 0x7f7a000739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79fffff700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a00102e80 0x7f7a00073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79ff7fe700 1 -- 172.21.15.12:0/3538721190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a00102e80 msgr2=0x7f7a00073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a00102e80 0x7f7a00073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79ff7fe700 1 -- 172.21.15.12:0/3538721190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a001024e0 msgr2=0x7f7a000739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a001024e0 0x7f7a000739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79ff7fe700 1 -- 172.21.15.12:0/3538721190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40095f0 con 0x7f7a001012f0 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001012f0 0x7f7a00075330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f79f000e970 tx=0x7f79f000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79fcff9700 1 -- 172.21.15.12:0/3538721190 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0009790 con 0x7f7a001012f0 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.646+0000 7f79fcff9700 1 -- 172.21.15.12:0/3538721190 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79f000eec0 con 0x7f7a001012f0 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.647+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3538721190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f8009c40 con 0x7f7a001012f0 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.647+0000 7f79fcff9700 1 -- 172.21.15.12:0/3538721190 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0003c10 con 0x7f7a001012f0 2023-12-11T20:17:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.647+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3538721190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a001a18a0 con 0x7f7a001012f0 2023-12-11T20:17:58.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.650+0000 7f79fcff9700 1 -- 172.21.15.12:0/3538721190 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f79f000cb70 con 0x7f7a001012f0 2023-12-11T20:17:58.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.651+0000 7f79fcff9700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79e80a15a0 0x7f79e80a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.651+0000 7f79fcff9700 1 -- 172.21.15.12:0/3538721190 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f79f0014070 con 0x7f7a001012f0 2023-12-11T20:17:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.652+0000 7f79feffd700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79e80a15a0 0x7f79e80a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.652+0000 7f7a19ab4b80 1 Processor -- start 2023-12-11T20:17:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.652+0000 7f7a19ab4b80 1 -- start start 2023-12-11T20:17:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.652+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a61a60 0x55fbb4a61e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.652+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a623c0 0x55fbb4a628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.652+0000 7f79feffd700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79e80a15a0 0x7f79e80a3a60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f79f4005fd0 tx=0x7f79f4009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a62de0 0x55fbb4a63240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb49bcb50 con 0x55fbb4a61a60 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb49ba470 con 0x55fbb4a62de0 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb49b5d60 con 0x55fbb4a623c0 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a61a60 0x55fbb4a61e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a61a60 0x55fbb4a61e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37078/0 (socket says 172.21.15.12:37078) 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79ff7fe700 1 -- 172.21.15.12:0/166491914 learned_addr learned my addr 172.21.15.12:0/166491914 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79feffd700 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a623c0 0x55fbb4a628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79ff7fe700 1 -- 172.21.15.12:0/166491914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a623c0 msgr2=0x55fbb4a628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a623c0 0x55fbb4a628a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79ff7fe700 1 -- 172.21.15.12:0/166491914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a62de0 msgr2=0x55fbb4a63240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a62de0 0x55fbb4a63240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79ff7fe700 1 -- 172.21.15.12:0/166491914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbb4832630 con 0x55fbb4a61a60 2023-12-11T20:17:58.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.653+0000 7f79feffd700 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a623c0 0x55fbb4a628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:58.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.654+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a61a60 0x55fbb4a61e80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f79f00966e0 tx=0x7f79f0099b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10433899199a922 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.654+0000 7f79e5ffb700 1 -- 172.21.15.12:0/166491914 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f009e170 con 0x55fbb4a61a60 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.654+0000 7f79e5ffb700 1 -- 172.21.15.12:0/166491914 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79f009a8e0 con 0x55fbb4a61a60 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.654+0000 7f79e5ffb700 1 -- 172.21.15.12:0/166491914 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f009a440 con 0x55fbb4a61a60 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/166491914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a61a60 msgr2=0x55fbb4a61e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a61a60 0x55fbb4a61e80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f79f00966e0 tx=0x7f79f0099b40 comp rx=0 tx=0).stop 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/166491914 shutdown_connections 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a62de0 0x55fbb4a63240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a61a60 0x55fbb4a61e80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/166491914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a623c0 0x55fbb4a628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/166491914 >> 172.21.15.12:0/166491914 conn(0x55fbb49907e0 msgr2=0x55fbb4a5c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/166491914 shutdown_connections 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/166491914 wait complete. 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.655+0000 7f7a19ab4b80 1 -- start start 2023-12-11T20:17:58.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.656+0000 7f7a19ab4b80 1 Processor -- start 2023-12-11T20:17:58.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.656+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a6b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.656+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a6b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.656+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a72920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.656+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb496f560 con 0x55fbb4a62de0 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.656+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb496f200 con 0x55fbb4a623c0 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.656+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb4834920 con 0x55fbb4a61a60 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.656+0000 7f7a19ab4b80 10 client.0 _ll_register_callbacks cb 0x55fbb489aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a6b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a72920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a6b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41864/0 (socket says 172.21.15.12:41864) 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79ff7fe700 1 -- 172.21.15.12:0/1165678078 learned_addr learned my addr 172.21.15.12:0/1165678078 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79feffd700 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a6b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79fffff700 1 -- 172.21.15.12:0/1165678078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 msgr2=0x55fbb4a6b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79fffff700 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a6b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79fffff700 1 -- 172.21.15.12:0/1165678078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 msgr2=0x55fbb4a6b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79fffff700 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a6b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79fffff700 1 -- 172.21.15.12:0/1165678078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a001a18a0 con 0x55fbb4a62de0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79fffff700 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a72920 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f79f80079f0 tx=0x7f79f8009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feebcef75b1651aa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.657+0000 7f79deffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.658+0000 7f79deffd700 1 -- 172.21.15.12:0/1165678078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f800e070 con 0x55fbb4a62de0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.658+0000 7f79deffd700 1 -- 172.21.15.12:0/1165678078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f79f8007da0 con 0x55fbb4a62de0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.658+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1165678078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbb4a549e0 con 0x55fbb4a62de0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.658+0000 7f79deffd700 1 -- 172.21.15.12:0/1165678078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79f8004a50 con 0x55fbb4a62de0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.658+0000 7f7a19ab4b80 10 client.16113 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.658+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1165678078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55fbb47dede0 con 0x55fbb4a62de0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.658+0000 7f79deffd700 1 -- 172.21.15.12:0/1165678078 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fbb4a549e0 con 0x55fbb4a62de0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.659+0000 7f79deffd700 1 -- 172.21.15.12:0/1165678078 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f79f800b050 con 0x55fbb4a62de0 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.659+0000 7f7a19ab4b80 10 client.16113 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.659+0000 7f7a19ab4b80 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.659+0000 7f7a19ab4b80 20 client.16113 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.659+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbb4a77210 0x55fbb4a79630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.659+0000 7f7a19ab4b80 4 client.16113 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:17:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.659+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1165678078 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbb4a30f40 con 0x55fbb4a77210 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.659+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbb4a77210 0x55fbb4a79630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.660+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbb4a77210 0x55fbb4a79630 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=184abd0ec459ade8 server_cookie=e9d06be4bd78df85 in_seq=0 out_seq=0 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.660+0000 7f79deffd700 10 client.16113 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f79deffd700 1 -- 172.21.15.12:0/1165678078 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fbb4a30f40 con 0x55fbb4a77210 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f79deffd700 10 client.16113 handle_command_reply: tid=0 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 client.16113 shutdown 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1165678078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 msgr2=0x55fbb4a72920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a72920 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f79f80079f0 tx=0x7f79f8009510 comp rx=0 tx=0).stop 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1165678078 shutdown_connections 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbb4a77210 0x55fbb4a79630 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a72920 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f79deffd700 0 client.16113 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a6b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1165678078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a6b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1165678078 >> 172.21.15.12:0/1165678078 conn(0x55fbb49907e0 msgr2=0x55fbb4a60820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1165678078 shutdown_connections 2023-12-11T20:17:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.661+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1165678078 wait complete. 2023-12-11T20:17:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.662+0000 7f7a19ab4b80 20 client.16113 trim_cache size 0 max 16384 2023-12-11T20:17:58.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.681+0000 7f7a19ab4b80 1 Processor -- start 2023-12-11T20:17:58.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.681+0000 7f7a19ab4b80 1 -- start start 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.681+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a61a60 0x55fbb4a631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.681+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a623c0 0x55fbb4a728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.681+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a62de0 0x55fbb4a5c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.681+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb4a63700 con 0x55fbb4a623c0 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb4a7e840 con 0x55fbb4a61a60 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb4a58b30 con 0x55fbb4a62de0 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79feffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a623c0 0x55fbb4a728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79feffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a623c0 0x55fbb4a728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37094/0 (socket says 172.21.15.12:37094) 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79feffd700 1 -- 172.21.15.12:0/1986101259 learned_addr learned my addr 172.21.15.12:0/1986101259 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a61a60 0x55fbb4a631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79fffff700 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a62de0 0x55fbb4a5c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79feffd700 1 -- 172.21.15.12:0/1986101259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a62de0 msgr2=0x55fbb4a5c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79feffd700 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a62de0 0x55fbb4a5c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79feffd700 1 -- 172.21.15.12:0/1986101259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a61a60 msgr2=0x55fbb4a631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79feffd700 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a61a60 0x55fbb4a631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.682+0000 7f79feffd700 1 -- 172.21.15.12:0/1986101259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbb47c7c60 con 0x55fbb4a623c0 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.683+0000 7f79feffd700 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a623c0 0x55fbb4a728e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f79f401e600 tx=0x7f79f4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287400240d9b2333 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.683+0000 7f79e67fc700 1 -- 172.21.15.12:0/1986101259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4023070 con 0x55fbb4a623c0 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.683+0000 7f79e67fc700 1 -- 172.21.15.12:0/1986101259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79f401eb80 con 0x55fbb4a623c0 2023-12-11T20:17:58.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.683+0000 7f79e67fc700 1 -- 172.21.15.12:0/1986101259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40273f0 con 0x55fbb4a623c0 2023-12-11T20:17:58.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1986101259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a623c0 msgr2=0x55fbb4a728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a623c0 0x55fbb4a728e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f79f401e600 tx=0x7f79f4014000 comp rx=0 tx=0).stop 2023-12-11T20:17:58.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1986101259 shutdown_connections 2023-12-11T20:17:58.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a61a60 0x55fbb4a631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a62de0 0x55fbb4a5c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/1986101259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a623c0 0x55fbb4a728e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1986101259 >> 172.21.15.12:0/1986101259 conn(0x55fbb49907e0 msgr2=0x55fbb4a69360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1986101259 shutdown_connections 2023-12-11T20:17:58.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/1986101259 wait complete. 2023-12-11T20:17:58.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.684+0000 7f7a19ab4b80 1 -- start start 2023-12-11T20:17:58.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.685+0000 7f7a19ab4b80 1 Processor -- start 2023-12-11T20:17:58.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.685+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a72220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.685+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a72760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.685+0000 7f7a19ab4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a70b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.685+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb4a71250 con 0x55fbb4a62de0 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.685+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb4a713c0 con 0x55fbb4a623c0 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.685+0000 7f7a19ab4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb4a71580 con 0x55fbb4a61a60 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.685+0000 7f7a19ab4b80 10 client.0 _ll_register_callbacks cb 0x55fbb489aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a72760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a70b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a72760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44068/0 (socket says 172.21.15.12:44068) 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 -- 172.21.15.12:0/825871327 learned_addr learned my addr 172.21.15.12:0/825871327 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a72220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 -- 172.21.15.12:0/825871327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 msgr2=0x55fbb4a72220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a72220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 -- 172.21.15.12:0/825871327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 msgr2=0x55fbb4a70b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:17:58.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a70b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 -- 172.21.15.12:0/825871327 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f4017070 con 0x55fbb4a623c0 2023-12-11T20:17:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a72220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:17:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79fffff700 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a70b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:17:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79feffd700 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a72760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009860 tx=0x7f79f401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f879297d534507c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:17:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.686+0000 7f79deffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:17:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.687+0000 7f79deffd700 1 -- 172.21.15.12:0/825871327 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4023040 con 0x55fbb4a623c0 2023-12-11T20:17:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.687+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/825871327 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79f009a8e0 con 0x55fbb4a623c0 2023-12-11T20:17:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.687+0000 7f79deffd700 1 -- 172.21.15.12:0/825871327 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f79f401c800 con 0x55fbb4a623c0 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.687+0000 7f79deffd700 1 -- 172.21.15.12:0/825871327 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79f4005240 con 0x55fbb4a623c0 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.687+0000 7f7a19ab4b80 10 client.25892 fetch_fsmap learned FSMap version 24 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.687+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/825871327 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55fbb4805250 con 0x55fbb4a623c0 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f79deffd700 1 -- 172.21.15.12:0/825871327 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79f009a8e0 con 0x55fbb4a623c0 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f79deffd700 1 -- 172.21.15.12:0/825871327 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f79f402e030 con 0x55fbb4a623c0 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f7a19ab4b80 10 client.25892 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f7a19ab4b80 10 client.25892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f7a19ab4b80 20 client.25892 populate_metadata read hostname 'smithi012' 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbb4acea90 0x55fbb4ad0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f7a19ab4b80 4 client.25892 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:17:58.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/825871327 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fbb497bfd0 con 0x55fbb4acea90 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.688+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbb4acea90 0x55fbb4ad0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.689+0000 7f79ff7fe700 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbb4acea90 0x55fbb4ad0eb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85118d78f27a2404 server_cookie=f1e8600fd659073 in_seq=0 out_seq=0 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.689+0000 7f79deffd700 10 client.25892 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.689+0000 7f79deffd700 1 -- 172.21.15.12:0/825871327 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fbb497bfd0 con 0x55fbb4acea90 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.689+0000 7f79deffd700 10 client.25892 handle_command_reply: tid=0 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.689+0000 7f7a19ab4b80 1 client.25892 shutdown 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/825871327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 msgr2=0x55fbb4a72760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a72760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009860 tx=0x7f79f401c400 comp rx=0 tx=0).stop 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/825871327 shutdown_connections 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbb4acea90 0x55fbb4ad0eb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb4a62de0 0x55fbb4a70b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbb4a61a60 0x55fbb4a72220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f79deffd700 0 client.25892 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 --2- 172.21.15.12:0/825871327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbb4a623c0 0x55fbb4a72760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/825871327 >> 172.21.15.12:0/825871327 conn(0x55fbb49907e0 msgr2=0x55fbb4a6a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/825871327 shutdown_connections 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 1 -- 172.21.15.12:0/825871327 wait complete. 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.690+0000 7f7a19ab4b80 20 client.25892 trim_cache size 0 max 16384 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout: "b793388d-0556-4697-b376-fbf718a406b0": { 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "b793388d-0556-4697-b376-fbf718a406b0", 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:17:58.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:17:58.691 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:17:58.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79e80a15a0 msgr2=0x7f79e80a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79e80a15a0 0x7f79e80a3a60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f79f4005fd0 tx=0x7f79f4009310 comp rx=0 tx=0).stop 2023-12-11T20:17:58.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001012f0 msgr2=0x7f7a00075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:17:58.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001012f0 0x7f7a00075330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f79f000e970 tx=0x7f79f000ec80 comp rx=0 tx=0).stop 2023-12-11T20:17:58.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3538721190 shutdown_connections 2023-12-11T20:17:58.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79e80a15a0 0x7f79e80a3a60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a00102e80 0x7f7a00073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001012f0 0x7f7a00075330 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 --2- 172.21.15.12:0/3538721190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a001024e0 0x7f7a000739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:17:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3538721190 >> 172.21.15.12:0/3538721190 conn(0x7f7a000fc860 msgr2=0x7f7a00105800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:17:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3538721190 shutdown_connections 2023-12-11T20:17:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:17:58.691+0000 7f7a04f9d700 1 -- 172.21.15.12:0/3538721190 wait complete. 2023-12-11T20:17:58.707 INFO:tasks.cephfs.filesystem:scrub status for tag:b793388d-0556-4697-b376-fbf718a406b0 - {'path': '/', 'tag': 'b793388d-0556-4697-b376-fbf718a406b0', 'options': 'recursive,force'} 2023-12-11T20:17:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:17:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:17:59 smithi012 ceph-mon[128787]: pgmap v437: 97 pgs: 97 active+clean; 546 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:17:59 smithi032 ceph-mon[132488]: pgmap v437: 97 pgs: 97 active+clean; 546 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:17:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:17:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:59.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:17:59.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:17:59.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:17:59 smithi039 ceph-mon[102205]: pgmap v437: 97 pgs: 97 active+clean; 546 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:18:02.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:02 smithi032 ceph-mon[132488]: pgmap v438: 97 pgs: 97 active+clean; 582 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 22 op/s 2023-12-11T20:18:02.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:02 smithi039 ceph-mon[102205]: pgmap v438: 97 pgs: 97 active+clean; 582 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 22 op/s 2023-12-11T20:18:02.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:02 smithi012 ceph-mon[128787]: pgmap v438: 97 pgs: 97 active+clean; 582 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 22 op/s 2023-12-11T20:18:04.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:04 smithi032 ceph-mon[132488]: pgmap v439: 97 pgs: 97 active+clean; 606 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:18:04.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:04 smithi039 ceph-mon[102205]: pgmap v439: 97 pgs: 97 active+clean; 606 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:18:04.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:04 smithi012 ceph-mon[128787]: pgmap v439: 97 pgs: 97 active+clean; 606 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:18:06.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:06 smithi032 ceph-mon[132488]: pgmap v440: 97 pgs: 97 active+clean; 626 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:18:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:06 smithi039 ceph-mon[102205]: pgmap v440: 97 pgs: 97 active+clean; 626 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:18:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:06 smithi012 ceph-mon[128787]: pgmap v440: 97 pgs: 97 active+clean; 626 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:18:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:07 smithi032 ceph-mon[132488]: pgmap v441: 97 pgs: 97 active+clean; 682 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:18:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:07 smithi039 ceph-mon[102205]: pgmap v441: 97 pgs: 97 active+clean; 682 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:18:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:07 smithi012 ceph-mon[128787]: pgmap v441: 97 pgs: 97 active+clean; 682 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:18:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:18:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:09 smithi012 ceph-mon[128787]: pgmap v442: 97 pgs: 97 active+clean; 694 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:18:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:18:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:09 smithi032 ceph-mon[132488]: pgmap v442: 97 pgs: 97 active+clean; 694 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.786+0000 7f60509ff700 1 -- 172.21.15.12:0/2384922521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1048e0 msgr2=0x7f604c104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.786+0000 7f60509ff700 1 --2- 172.21.15.12:0/2384922521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1048e0 0x7f604c104d40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f60400099c0 tx=0x7f6040009cd0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.786+0000 7f60509ff700 1 -- 172.21.15.12:0/2384922521 shutdown_connections 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.786+0000 7f60509ff700 1 --2- 172.21.15.12:0/2384922521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c105280 0x7f604c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.786+0000 7f60509ff700 1 --2- 172.21.15.12:0/2384922521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f604c1036f0 0x7f604c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.786+0000 7f60509ff700 1 --2- 172.21.15.12:0/2384922521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1048e0 0x7f604c104d40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.786+0000 7f60509ff700 1 -- 172.21.15.12:0/2384922521 >> 172.21.15.12:0/2384922521 conn(0x7f604c0fec80 msgr2=0x7f604c1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.787+0000 7f60509ff700 1 -- 172.21.15.12:0/2384922521 shutdown_connections 2023-12-11T20:18:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.787+0000 7f60509ff700 1 -- 172.21.15.12:0/2384922521 wait complete. 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.788+0000 7f60509ff700 1 Processor -- start 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.788+0000 7f60509ff700 1 -- start start 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.788+0000 7f60509ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1036f0 0x7f604c199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.788+0000 7f60509ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c1048e0 0x7f604c199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.788+0000 7f60509ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f604c105280 0x7f604c1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.788+0000 7f60509ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c1a10b0 con 0x7f604c1036f0 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.788+0000 7f60509ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c1a11f0 con 0x7f604c1048e0 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.788+0000 7f60509ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c1a1380 con 0x7f604c105280 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1036f0 0x7f604c199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1036f0 0x7f604c199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46886/0 (socket says 172.21.15.12:46886) 2023-12-11T20:18:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604a59c700 1 -- 172.21.15.12:0/3342163315 learned_addr learned my addr 172.21.15.12:0/3342163315 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f6049d9b700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c1048e0 0x7f604c199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604ad9d700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f604c105280 0x7f604c1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604a59c700 1 -- 172.21.15.12:0/3342163315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f604c105280 msgr2=0x7f604c1a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604a59c700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f604c105280 0x7f604c1a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604a59c700 1 -- 172.21.15.12:0/3342163315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c1048e0 msgr2=0x7f604c199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604a59c700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c1048e0 0x7f604c199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.789+0000 7f604a59c700 1 -- 172.21.15.12:0/3342163315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400095f0 con 0x7f604c1036f0 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.790+0000 7f604a59c700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1036f0 0x7f604c199580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e970 tx=0x7f603c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.790+0000 7f603b7fe700 1 -- 172.21.15.12:0/3342163315 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c009790 con 0x7f604c1036f0 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.790+0000 7f60509ff700 1 -- 172.21.15.12:0/3342163315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604c1a1660 con 0x7f604c1036f0 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.790+0000 7f603b7fe700 1 -- 172.21.15.12:0/3342163315 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f603c00c7e0 con 0x7f604c1036f0 2023-12-11T20:18:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.790+0000 7f603b7fe700 1 -- 172.21.15.12:0/3342163315 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c003bd0 con 0x7f604c1036f0 2023-12-11T20:18:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.790+0000 7f60509ff700 1 -- 172.21.15.12:0/3342163315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604c1a1bc0 con 0x7f604c1036f0 2023-12-11T20:18:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.794+0000 7f603b7fe700 1 -- 172.21.15.12:0/3342163315 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f603c00c950 con 0x7f604c1036f0 2023-12-11T20:18:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.795+0000 7f6064246b80 1 Processor -- start 2023-12-11T20:18:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.795+0000 7f6064246b80 1 -- start start 2023-12-11T20:18:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.795+0000 7f6064246b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbd72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f6064246b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbd8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f6064246b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f6064246b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bb32af0 con 0x55ee6bbd8720 2023-12-11T20:18:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f6064246b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bb30410 con 0x55ee6bbd7830 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f6064246b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bb2bd00 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f604ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbd72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f604ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbd72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:38094/0 (socket says 172.21.15.12:38094) 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f604ad9d700 1 -- 172.21.15.12:0/3672872290 learned_addr learned my addr 172.21.15.12:0/3672872290 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f603b7fe700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60340a14f0 0x7f60340a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f604a59c700 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbd8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f603b7fe700 1 -- 172.21.15.12:0/3342163315 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f603c014070 con 0x7f604c1036f0 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.796+0000 7f6049d9b700 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f604ad9d700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60340a14f0 0x7f60340a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f604a59c700 1 -- 172.21.15.12:0/3672872290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd6ed0 msgr2=0x55ee6bbd72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f604a59c700 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbd72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f604a59c700 1 -- 172.21.15.12:0/3672872290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd8720 msgr2=0x55ee6bbd8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f604a59c700 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f604a59c700 1 -- 172.21.15.12:0/3672872290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee6b9a85d0 con 0x55ee6bbd7830 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f604a59c700 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbd8140 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f603c096bf0 tx=0x7f603c005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba128529c381c832 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f6038ff9700 1 -- 172.21.15.12:0/3672872290 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c09e0c0 con 0x55ee6bbd7830 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f6038ff9700 1 -- 172.21.15.12:0/3672872290 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f603c09a880 con 0x55ee6bbd7830 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.797+0000 7f6038ff9700 1 -- 172.21.15.12:0/3672872290 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c0caa70 con 0x55ee6bbd7830 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 -- 172.21.15.12:0/3672872290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 msgr2=0x55ee6bbd8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbd8140 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f603c096bf0 tx=0x7f603c005910 comp rx=0 tx=0).stop 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f604ad9d700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60340a14f0 0x7f60340a39b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6044003fd0 tx=0x7f6044004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 -- 172.21.15.12:0/3672872290 shutdown_connections 2023-12-11T20:18:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbd72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 --2- 172.21.15.12:0/3672872290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbd8140 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 -- 172.21.15.12:0/3672872290 >> 172.21.15.12:0/3672872290 conn(0x55ee6bb06780 msgr2=0x55ee6bbd3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 -- 172.21.15.12:0/3672872290 shutdown_connections 2023-12-11T20:18:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.798+0000 7f6064246b80 1 -- 172.21.15.12:0/3672872290 wait complete. 2023-12-11T20:18:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.799+0000 7f6064246b80 1 -- start start 2023-12-11T20:18:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.799+0000 7f6064246b80 1 Processor -- start 2023-12-11T20:18:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f6064246b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f6064246b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f6064246b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f6064246b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bae5500 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f6064246b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bae51a0 con 0x55ee6bbd7830 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f6064246b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6b9aa8c0 con 0x55ee6bbd8720 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f6064246b80 10 client.0 _ll_register_callbacks cb 0x55ee6ba10a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f604a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f604a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46902/0 (socket says 172.21.15.12:46902) 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f604a59c700 1 -- 172.21.15.12:0/95000874 learned_addr learned my addr 172.21.15.12:0/95000874 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f604ad9d700 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.800+0000 7f6049d9b700 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f604a59c700 1 -- 172.21.15.12:0/95000874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 msgr2=0x55ee6bbe8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f604a59c700 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f604a59c700 1 -- 172.21.15.12:0/95000874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 msgr2=0x55ee6bbe1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f604a59c700 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f604a59c700 1 -- 172.21.15.12:0/95000874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604c1a1bc0 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f604ad9d700 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f604a59c700 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f603c09a110 tx=0x7f603c096520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b33bf7a980baf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f6031ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f6031ffb700 1 -- 172.21.15.12:0/95000874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c099870 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f6031ffb700 1 -- 172.21.15.12:0/95000874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f603c09e2d0 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.801+0000 7f6064246b80 1 -- 172.21.15.12:0/95000874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee6bbca730 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.802+0000 7f6031ffb700 1 -- 172.21.15.12:0/95000874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f603c09e0c0 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.802+0000 7f6064246b80 10 client.16131 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.802+0000 7f6064246b80 1 -- 172.21.15.12:0/95000874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ee6b954d80 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.802+0000 7f6031ffb700 1 -- 172.21.15.12:0/95000874 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee6bbca730 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.802+0000 7f6031ffb700 1 -- 172.21.15.12:0/95000874 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f603c096000 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:18:09.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:09 smithi039 ceph-mon[102205]: pgmap v442: 97 pgs: 97 active+clean; 694 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:18:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.803+0000 7f6064246b80 10 client.16131 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.803+0000 7f6064246b80 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.803+0000 7f6064246b80 20 client.16131 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.803+0000 7f6064246b80 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee6bbec930 0x55ee6bbeed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.803+0000 7f6064246b80 4 client.16131 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.803+0000 7f6064246b80 1 -- 172.21.15.12:0/95000874 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee6bba6ee0 con 0x55ee6bbec930 2023-12-11T20:18:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.804+0000 7f6049d9b700 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee6bbec930 0x55ee6bbeed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.805+0000 7f6049d9b700 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee6bbec930 0x55ee6bbeed70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8d63817eca43fe8 server_cookie=3967afd326f2cbd2 in_seq=0 out_seq=0 2023-12-11T20:18:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.805+0000 7f6031ffb700 10 client.16131 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.806+0000 7f6031ffb700 1 -- 172.21.15.12:0/95000874 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ee6bba6ee0 con 0x55ee6bbec930 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.806+0000 7f6031ffb700 10 client.16131 handle_command_reply: tid=0 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.806+0000 7f6064246b80 1 client.16131 shutdown 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 -- 172.21.15.12:0/95000874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd6ed0 msgr2=0x55ee6bbe0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f603c09a110 tx=0x7f603c096520 comp rx=0 tx=0).stop 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 -- 172.21.15.12:0/95000874 shutdown_connections 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee6bbec930 0x55ee6bbeed70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0f40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6031ffb700 0 client.16131 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 --2- 172.21.15.12:0/95000874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 -- 172.21.15.12:0/95000874 >> 172.21.15.12:0/95000874 conn(0x55ee6bb06780 msgr2=0x55ee6bbd1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 -- 172.21.15.12:0/95000874 shutdown_connections 2023-12-11T20:18:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.807+0000 7f6064246b80 1 -- 172.21.15.12:0/95000874 wait complete. 2023-12-11T20:18:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.808+0000 7f6064246b80 20 client.16131 trim_cache size 0 max 16384 2023-12-11T20:18:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.827+0000 7f6064246b80 1 Processor -- start 2023-12-11T20:18:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6064246b80 1 -- start start 2023-12-11T20:18:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6064246b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6064246b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6064246b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6064246b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bbca700 con 0x55ee6bbd7830 2023-12-11T20:18:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6064246b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bbe08a0 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6064246b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bbef0e0 con 0x55ee6bbd8720 2023-12-11T20:18:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6049d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f604ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6049d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46916/0 (socket says 172.21.15.12:46916) 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.828+0000 7f6049d9b700 1 -- 172.21.15.12:0/492961624 learned_addr learned my addr 172.21.15.12:0/492961624 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.829+0000 7f604a59c700 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.829+0000 7f6049d9b700 1 -- 172.21.15.12:0/492961624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 msgr2=0x55ee6bbd8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.829+0000 7f6049d9b700 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.829+0000 7f6049d9b700 1 -- 172.21.15.12:0/492961624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 msgr2=0x55ee6bbe0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.829+0000 7f6049d9b700 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.829+0000 7f6049d9b700 1 -- 172.21.15.12:0/492961624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee6b93dc00 con 0x55ee6bbd7830 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.829+0000 7f604ad9d700 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.829+0000 7f6049d9b700 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe8220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f60400099c0 tx=0x7f6040005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d14a4f7589902a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.830+0000 7f60397fa700 1 -- 172.21.15.12:0/492961624 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604000bcf0 con 0x55ee6bbd7830 2023-12-11T20:18:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.830+0000 7f60397fa700 1 -- 172.21.15.12:0/492961624 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f604002c070 con 0x55ee6bbd7830 2023-12-11T20:18:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.830+0000 7f60397fa700 1 -- 172.21.15.12:0/492961624 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040003e30 con 0x55ee6bbd7830 2023-12-11T20:18:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 -- 172.21.15.12:0/492961624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 msgr2=0x55ee6bbe8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe8220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f60400099c0 tx=0x7f6040005040 comp rx=0 tx=0).stop 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 -- 172.21.15.12:0/492961624 shutdown_connections 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbd8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 --2- 172.21.15.12:0/492961624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe8220 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 -- 172.21.15.12:0/492961624 >> 172.21.15.12:0/492961624 conn(0x55ee6bb06780 msgr2=0x55ee6bbdecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 -- 172.21.15.12:0/492961624 shutdown_connections 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 -- 172.21.15.12:0/492961624 wait complete. 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.831+0000 7f6064246b80 1 -- start start 2023-12-11T20:18:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.832+0000 7f6064246b80 1 Processor -- start 2023-12-11T20:18:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.832+0000 7f6064246b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.832+0000 7f6064246b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.832+0000 7f6064246b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.832+0000 7f6064246b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bbe7800 con 0x55ee6bbd7830 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.832+0000 7f6064246b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bbe7970 con 0x55ee6bbd6ed0 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.832+0000 7f6064246b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee6bbe7b30 con 0x55ee6bbd8720 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.832+0000 7f6064246b80 10 client.0 _ll_register_callbacks cb 0x55ee6ba10a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f604a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f604a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35882/0 (socket says 172.21.15.12:35882) 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f604a59c700 1 -- 172.21.15.12:0/2097450518 learned_addr learned my addr 172.21.15.12:0/2097450518 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f604ad9d700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f6049d9b700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f6049d9b700 1 -- 172.21.15.12:0/2097450518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 msgr2=0x55ee6bbe72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f6049d9b700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f6049d9b700 1 -- 172.21.15.12:0/2097450518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 msgr2=0x55ee6bbe5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f6049d9b700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f6049d9b700 1 -- 172.21.15.12:0/2097450518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6044022040 con 0x55ee6bbd7830 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f604a59c700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.833+0000 7f604ad9d700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.834+0000 7f6049d9b700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe62b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f60400098e0 tx=0x7f6040009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681fe00668df5f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.834+0000 7f6031ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.834+0000 7f6031ffb700 1 -- 172.21.15.12:0/2097450518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040003bb0 con 0x55ee6bbd7830 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.834+0000 7f6064246b80 1 -- 172.21.15.12:0/2097450518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f603c09a880 con 0x55ee6bbd7830 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.834+0000 7f6031ffb700 1 -- 172.21.15.12:0/2097450518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6040028e40 con 0x55ee6bbd7830 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6031ffb700 1 -- 172.21.15.12:0/2097450518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6040003d10 con 0x55ee6bbd7830 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6064246b80 10 client.16137 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6064246b80 1 -- 172.21.15.12:0/2097450518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f604c10c480 con 0x55ee6bbd7830 2023-12-11T20:18:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6031ffb700 1 -- 172.21.15.12:0/2097450518 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f603c09a880 con 0x55ee6bbd7830 2023-12-11T20:18:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6031ffb700 1 -- 172.21.15.12:0/2097450518 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f60400285d0 con 0x55ee6bbd7830 2023-12-11T20:18:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6064246b80 10 client.16137 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:09.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6064246b80 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6064246b80 20 client.16137 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6064246b80 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee6bc43880 0x55ee6bc45ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6064246b80 4 client.16137 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:18:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.835+0000 7f6064246b80 1 -- 172.21.15.12:0/2097450518 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ee6baf1f70 con 0x55ee6bc43880 2023-12-11T20:18:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.836+0000 7f604a59c700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee6bc43880 0x55ee6bc45ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.836+0000 7f6031ffb700 10 client.16137 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.836+0000 7f604a59c700 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee6bc43880 0x55ee6bc45ca0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4b2696b678cd60 server_cookie=5f4e74bf326d2637 in_seq=0 out_seq=0 2023-12-11T20:18:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6031ffb700 1 -- 172.21.15.12:0/2097450518 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ee6baf1f70 con 0x55ee6bc43880 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6031ffb700 10 client.16137 handle_command_reply: tid=0 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 client.16137 shutdown 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 -- 172.21.15.12:0/2097450518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 msgr2=0x55ee6bbe62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe62b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f60400098e0 tx=0x7f6040009fd0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 -- 172.21.15.12:0/2097450518 shutdown_connections 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee6bc43880 0x55ee6bc45ca0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee6bbd6ed0 0x55ee6bbe5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee6bbd8720 0x55ee6bbe72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6031ffb700 0 client.16137 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 --2- 172.21.15.12:0/2097450518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee6bbd7830 0x55ee6bbe62b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.846+0000 7f6064246b80 1 -- 172.21.15.12:0/2097450518 >> 172.21.15.12:0/2097450518 conn(0x55ee6bb06780 msgr2=0x55ee6bbd3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.847+0000 7f6064246b80 1 -- 172.21.15.12:0/2097450518 shutdown_connections 2023-12-11T20:18:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.847+0000 7f6064246b80 1 -- 172.21.15.12:0/2097450518 wait complete. 2023-12-11T20:18:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.847+0000 7f6064246b80 20 client.16137 trim_cache size 0 max 16384 2023-12-11T20:18:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:18:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:18:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:18:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.847+0000 7f60509ff700 1 -- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60340a14f0 msgr2=0x7f60340a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.847+0000 7f60509ff700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60340a14f0 0x7f60340a39b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6044003fd0 tx=0x7f6044004b40 comp rx=0 tx=0).stop 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 -- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1036f0 msgr2=0x7f604c199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1036f0 0x7f604c199580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e970 tx=0x7f603c00ec80 comp rx=0 tx=0).stop 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 -- 172.21.15.12:0/3342163315 shutdown_connections 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60340a14f0 0x7f60340a39b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f604c105280 0x7f604c1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f604c1036f0 0x7f604c199580 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 --2- 172.21.15.12:0/3342163315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c1048e0 0x7f604c199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 -- 172.21.15.12:0/3342163315 >> 172.21.15.12:0/3342163315 conn(0x7f604c0fec80 msgr2=0x7f604c107d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 -- 172.21.15.12:0/3342163315 shutdown_connections 2023-12-11T20:18:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:09.848+0000 7f60509ff700 1 -- 172.21.15.12:0/3342163315 wait complete. 2023-12-11T20:18:10.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:18:10.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:18:10.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:18:10.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:18:10.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:18:10.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:18:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:18:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:18:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:18:11.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:11 smithi032 ceph-mon[132488]: pgmap v443: 97 pgs: 97 active+clean; 726 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 28 op/s 2023-12-11T20:18:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:11 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:18:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:11 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:18:11.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:11 smithi039 ceph-mon[102205]: pgmap v443: 97 pgs: 97 active+clean; 726 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 28 op/s 2023-12-11T20:18:11.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:11 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:18:11.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:11 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:18:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:11 smithi012 ceph-mon[128787]: pgmap v443: 97 pgs: 97 active+clean; 726 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 28 op/s 2023-12-11T20:18:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:11 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:18:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:11 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:18:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:12 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:18:12.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:12 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:18:12.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:12 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:18:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:13 smithi032 ceph-mon[132488]: pgmap v444: 97 pgs: 97 active+clean; 746 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:18:13.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:13 smithi039 ceph-mon[102205]: pgmap v444: 97 pgs: 97 active+clean; 746 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:18:13.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:13 smithi012 ceph-mon[128787]: pgmap v444: 97 pgs: 97 active+clean; 746 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:18:16.465 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:16 smithi032 ceph-mon[132488]: pgmap v445: 97 pgs: 97 active+clean; 791 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:18:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:16 smithi039 ceph-mon[102205]: pgmap v445: 97 pgs: 97 active+clean; 791 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:18:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:16 smithi012 ceph-mon[128787]: pgmap v445: 97 pgs: 97 active+clean; 791 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:18:18.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:18 smithi032 ceph-mon[132488]: pgmap v446: 97 pgs: 97 active+clean; 819 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:18:18.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:18 smithi039 ceph-mon[102205]: pgmap v446: 97 pgs: 97 active+clean; 819 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:18:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:18 smithi012 ceph-mon[128787]: pgmap v446: 97 pgs: 97 active+clean; 819 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:18:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:19 smithi032 ceph-mon[132488]: pgmap v447: 97 pgs: 97 active+clean; 847 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:18:19.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:19 smithi039 ceph-mon[102205]: pgmap v447: 97 pgs: 97 active+clean; 847 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:18:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:19 smithi012 ceph-mon[128787]: pgmap v447: 97 pgs: 97 active+clean; 847 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:18:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:22 smithi032 ceph-mon[132488]: pgmap v448: 97 pgs: 97 active+clean; 879 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:18:22.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:22 smithi039 ceph-mon[102205]: pgmap v448: 97 pgs: 97 active+clean; 879 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:18:22.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:22 smithi012 ceph-mon[128787]: pgmap v448: 97 pgs: 97 active+clean; 879 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:18:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.011+0000 7f2753fff700 1 -- 172.21.15.12:0/595540955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754101310 msgr2=0x7f2754101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.011+0000 7f2753fff700 1 --2- 172.21.15.12:0/595540955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754101310 0x7f2754101730 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f27440099c0 tx=0x7f2744009cd0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.012+0000 7f2753fff700 1 -- 172.21.15.12:0/595540955 shutdown_connections 2023-12-11T20:18:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.012+0000 7f2753fff700 1 --2- 172.21.15.12:0/595540955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2754102ea0 0x7f2754109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.012+0000 7f2753fff700 1 --2- 172.21.15.12:0/595540955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754101310 0x7f2754101730 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.012+0000 7f2753fff700 1 --2- 172.21.15.12:0/595540955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2754102500 0x7f2754102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.012+0000 7f2753fff700 1 -- 172.21.15.12:0/595540955 >> 172.21.15.12:0/595540955 conn(0x7f27540fc8a0 msgr2=0x7f27540fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.012+0000 7f2753fff700 1 -- 172.21.15.12:0/595540955 shutdown_connections 2023-12-11T20:18:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.012+0000 7f2753fff700 1 -- 172.21.15.12:0/595540955 wait complete. 2023-12-11T20:18:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.013+0000 7f2753fff700 1 Processor -- start 2023-12-11T20:18:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.013+0000 7f2753fff700 1 -- start start 2023-12-11T20:18:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.013+0000 7f2753fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2754101310 0x7f27541993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.013+0000 7f2753fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754102500 0x7f2754199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.013+0000 7f2753fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2754102ea0 0x7f27541a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.013+0000 7f2753fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27541a0ef0 con 0x7f2754102500 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.013+0000 7f2753fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27541a1030 con 0x7f2754101310 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.013+0000 7f2753fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27541a11c0 con 0x7f2754102ea0 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754102500 0x7f2754199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754102500 0x7f2754199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60740/0 (socket says 172.21.15.12:60740) 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 -- 172.21.15.12:0/1967732435 learned_addr learned my addr 172.21.15.12:0/1967732435 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27537fe700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2754102ea0 0x7f27541a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f2752ffd700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2754101310 0x7f27541993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 -- 172.21.15.12:0/1967732435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2754102ea0 msgr2=0x7f27541a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2754102ea0 0x7f27541a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 -- 172.21.15.12:0/1967732435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2754101310 msgr2=0x7f27541993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2754101310 0x7f27541993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 -- 172.21.15.12:0/1967732435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440095f0 con 0x7f2754102500 2023-12-11T20:18:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.014+0000 7f27527fc700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754102500 0x7f2754199900 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f274800d950 tx=0x7f274800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.015+0000 7f273bfff700 1 -- 172.21.15.12:0/1967732435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800f890 con 0x7f2754102500 2023-12-11T20:18:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.015+0000 7f273bfff700 1 -- 172.21.15.12:0/1967732435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f274800fe80 con 0x7f2754102500 2023-12-11T20:18:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.015+0000 7f2753fff700 1 -- 172.21.15.12:0/1967732435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27541a14a0 con 0x7f2754102500 2023-12-11T20:18:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.015+0000 7f273bfff700 1 -- 172.21.15.12:0/1967732435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800e3b0 con 0x7f2754102500 2023-12-11T20:18:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.015+0000 7f2753fff700 1 -- 172.21.15.12:0/1967732435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27541a19b0 con 0x7f2754102500 2023-12-11T20:18:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.019+0000 7f273bfff700 1 -- 172.21.15.12:0/1967732435 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2748010460 con 0x7f2754102500 2023-12-11T20:18:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.020+0000 7f273bfff700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f273c0a1470 0x7f273c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.020+0000 7f276d083b80 1 Processor -- start 2023-12-11T20:18:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.020+0000 7f273bfff700 1 -- 172.21.15.12:0/1967732435 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f27480ccb90 con 0x7f2754102500 2023-12-11T20:18:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.020+0000 7f276d083b80 1 -- start start 2023-12-11T20:18:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f2752ffd700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f273c0a1470 0x7f273c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f276d083b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5087b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f276d083b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f508c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f276d083b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f508ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f276d083b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f4fe2af0 con 0x5584f508cb80 2023-12-11T20:18:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f276d083b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f4fe0410 con 0x5584f5087770 2023-12-11T20:18:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f276d083b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f4fdbd00 con 0x5584f50880d0 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f2752ffd700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f273c0a1470 0x7f273c0a3930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2744009990 tx=0x7f2744003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f27537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f508ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f27527fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f508c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f27527fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f508c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49970/0 (socket says 172.21.15.12:49970) 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.021+0000 7f27527fc700 1 -- 172.21.15.12:0/881376001 learned_addr learned my addr 172.21.15.12:0/881376001 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f2752ffd700 1 --2- 172.21.15.12:0/881376001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5087b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27527fc700 1 -- 172.21.15.12:0/881376001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 msgr2=0x5584f5087b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27527fc700 1 --2- 172.21.15.12:0/881376001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5087b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27527fc700 1 -- 172.21.15.12:0/881376001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 msgr2=0x5584f508ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27527fc700 1 --2- 172.21.15.12:0/881376001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f508ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27527fc700 1 -- 172.21.15.12:0/881376001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584f4e585d0 con 0x5584f50880d0 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27527fc700 1 --2- 172.21.15.12:0/881376001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f508c640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2748099d90 tx=0x7f2748099830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5095ccdc7323667f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27397fa700 1 -- 172.21.15.12:0/881376001 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274809c030 con 0x5584f50880d0 2023-12-11T20:18:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27397fa700 1 -- 172.21.15.12:0/881376001 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2748099e00 con 0x5584f50880d0 2023-12-11T20:18:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.022+0000 7f27397fa700 1 -- 172.21.15.12:0/881376001 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748099550 con 0x5584f50880d0 2023-12-11T20:18:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.023+0000 7f276d083b80 1 -- 172.21.15.12:0/881376001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 msgr2=0x5584f508c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.023+0000 7f276d083b80 1 --2- 172.21.15.12:0/881376001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f508c640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2748099d90 tx=0x7f2748099830 comp rx=0 tx=0).stop 2023-12-11T20:18:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.023+0000 7f276d083b80 1 -- 172.21.15.12:0/881376001 shutdown_connections 2023-12-11T20:18:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.023+0000 7f276d083b80 1 --2- 172.21.15.12:0/881376001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5087b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.023+0000 7f276d083b80 1 --2- 172.21.15.12:0/881376001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f508ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.023+0000 7f276d083b80 1 --2- 172.21.15.12:0/881376001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f508c640 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.024+0000 7f276d083b80 1 -- 172.21.15.12:0/881376001 >> 172.21.15.12:0/881376001 conn(0x5584f4fb6780 msgr2=0x5584f5083b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.024+0000 7f276d083b80 1 -- 172.21.15.12:0/881376001 shutdown_connections 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.024+0000 7f276d083b80 1 -- 172.21.15.12:0/881376001 wait complete. 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.024+0000 7f276d083b80 1 -- start start 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.024+0000 7f276d083b80 1 Processor -- start 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f276d083b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5090e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f276d083b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f5091390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f276d083b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f50983d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f276d083b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f4f95500 con 0x5584f508cb80 2023-12-11T20:18:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f276d083b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f4f951a0 con 0x5584f5087770 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f276d083b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f4e5a8c0 con 0x5584f50880d0 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f276d083b80 10 client.0 _ll_register_callbacks cb 0x5584f4ec0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f27537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f50983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f27537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f50983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60766/0 (socket says 172.21.15.12:60766) 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f27537fe700 1 -- 172.21.15.12:0/928890448 learned_addr learned my addr 172.21.15.12:0/928890448 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.025+0000 7f27527fc700 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f5091390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f2752ffd700 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5090e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f27537fe700 1 -- 172.21.15.12:0/928890448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 msgr2=0x5584f5091390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f27537fe700 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f5091390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f27537fe700 1 -- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 msgr2=0x5584f5090e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f27537fe700 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5090e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f27537fe700 1 -- 172.21.15.12:0/928890448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27541a19b0 con 0x5584f508cb80 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f2752ffd700 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5090e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:18:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f27537fe700 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f50983d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f274c011e80 tx=0x7f274c014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dcf6dde4334e40 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f2736ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f2736ff5700 1 -- 172.21.15.12:0/928890448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c00e040 con 0x5584f508cb80 2023-12-11T20:18:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f276d083b80 1 -- 172.21.15.12:0/928890448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584f507a730 con 0x5584f508cb80 2023-12-11T20:18:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.026+0000 7f2736ff5700 1 -- 172.21.15.12:0/928890448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f274c01a070 con 0x5584f508cb80 2023-12-11T20:18:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f2736ff5700 1 -- 172.21.15.12:0/928890448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274c014e60 con 0x5584f508cb80 2023-12-11T20:18:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f276d083b80 10 client.16149 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f276d083b80 1 -- 172.21.15.12:0/928890448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5584f4e04d80 con 0x5584f508cb80 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f2736ff5700 1 -- 172.21.15.12:0/928890448 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5584f507a730 con 0x5584f508cb80 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f2736ff5700 1 -- 172.21.15.12:0/928890448 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f274c016590 con 0x5584f508cb80 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f276d083b80 10 client.16149 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f276d083b80 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f276d083b80 20 client.16149 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f276d083b80 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584f509cda0 0x5584f509f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f276d083b80 4 client.16149 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.027+0000 7f276d083b80 1 -- 172.21.15.12:0/928890448 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584f5056ee0 con 0x5584f509cda0 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.028+0000 7f2752ffd700 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584f509cda0 0x5584f509f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.028+0000 7f2752ffd700 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584f509cda0 0x5584f509f1c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=499d7f20df95f4a6 server_cookie=ad1dcf704bc746c9 in_seq=0 out_seq=0 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.028+0000 7f2736ff5700 10 client.16149 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f2736ff5700 1 -- 172.21.15.12:0/928890448 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5584f5056ee0 con 0x5584f509cda0 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f2736ff5700 10 client.16149 handle_command_reply: tid=0 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 client.16149 shutdown 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 -- 172.21.15.12:0/928890448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 msgr2=0x5584f50983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f50983d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f274c011e80 tx=0x7f274c014600 comp rx=0 tx=0).stop 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 -- 172.21.15.12:0/928890448 shutdown_connections 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584f509cda0 0x5584f509f1c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f5090e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f50983d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 --2- 172.21.15.12:0/928890448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f5091390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f276d083b80 1 -- 172.21.15.12:0/928890448 >> 172.21.15.12:0/928890448 conn(0x5584f4fb6780 msgr2=0x5584f508ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.029+0000 7f2736ff5700 0 client.16149 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.030+0000 7f276d083b80 1 -- 172.21.15.12:0/928890448 shutdown_connections 2023-12-11T20:18:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.030+0000 7f276d083b80 1 -- 172.21.15.12:0/928890448 wait complete. 2023-12-11T20:18:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.030+0000 7f276d083b80 20 client.16149 trim_cache size 0 max 16384 2023-12-11T20:18:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.045+0000 7f276d083b80 1 Processor -- start 2023-12-11T20:18:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f276d083b80 1 -- start start 2023-12-11T20:18:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f276d083b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f5087770 0x5584f5098a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f276d083b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f50880d0 0x5584f5090360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f276d083b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f508cb80 0x5584f5098390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f276d083b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f5088930 con 0x5584f50880d0 2023-12-11T20:18:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f276d083b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f508f8b0 con 0x5584f508cb80 2023-12-11T20:18:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f276d083b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f508c000 con 0x5584f5087770 2023-12-11T20:18:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f27527fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f50880d0 0x5584f5090360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f27527fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f50880d0 0x5584f5090360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60772/0 (socket says 172.21.15.12:60772) 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f27527fc700 1 -- 172.21.15.12:0/2004182537 learned_addr learned my addr 172.21.15.12:0/2004182537 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f2752ffd700 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f5087770 0x5584f5098a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.046+0000 7f27537fe700 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f508cb80 0x5584f5098390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f27527fc700 1 -- 172.21.15.12:0/2004182537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f5087770 msgr2=0x5584f5098a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f27527fc700 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f5087770 0x5584f5098a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f27527fc700 1 -- 172.21.15.12:0/2004182537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f508cb80 msgr2=0x5584f5098390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f27527fc700 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f508cb80 0x5584f5098390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f27527fc700 1 -- 172.21.15.12:0/2004182537 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584f4dedc00 con 0x5584f50880d0 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f27527fc700 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f50880d0 0x5584f5090360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2748096300 tx=0x7f274800dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1c52595453f7d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f2739ffb700 1 -- 172.21.15.12:0/2004182537 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274809c040 con 0x5584f50880d0 2023-12-11T20:18:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f2739ffb700 1 -- 172.21.15.12:0/2004182537 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27480a2190 con 0x5584f50880d0 2023-12-11T20:18:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.047+0000 7f2739ffb700 1 -- 172.21.15.12:0/2004182537 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748099550 con 0x5584f50880d0 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 -- 172.21.15.12:0/2004182537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f50880d0 msgr2=0x5584f5090360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f50880d0 0x5584f5090360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2748096300 tx=0x7f274800dfd0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 -- 172.21.15.12:0/2004182537 shutdown_connections 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f508cb80 0x5584f5098390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f5087770 0x5584f5098a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 --2- 172.21.15.12:0/2004182537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f50880d0 0x5584f5090360 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 -- 172.21.15.12:0/2004182537 >> 172.21.15.12:0/2004182537 conn(0x5584f4fb6780 msgr2=0x5584f508ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 -- 172.21.15.12:0/2004182537 shutdown_connections 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.048+0000 7f276d083b80 1 -- 172.21.15.12:0/2004182537 wait complete. 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.049+0000 7f276d083b80 1 -- start start 2023-12-11T20:18:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.049+0000 7f276d083b80 1 Processor -- start 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f276d083b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f50959a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f276d083b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f5095ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f276d083b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f5096dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f276d083b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f5097380 con 0x5584f508cb80 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f276d083b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f50974f0 con 0x5584f5087770 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f276d083b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f50976b0 con 0x5584f50880d0 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f276d083b80 10 client.0 _ll_register_callbacks cb 0x5584f4ec0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f5096dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f2752ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f50959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f5096dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60784/0 (socket says 172.21.15.12:60784) 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27537fe700 1 -- 172.21.15.12:0/3254928227 learned_addr learned my addr 172.21.15.12:0/3254928227 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27527fc700 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f5095ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27537fe700 1 -- 172.21.15.12:0/3254928227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 msgr2=0x5584f5095ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27537fe700 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f5095ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27537fe700 1 -- 172.21.15.12:0/3254928227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 msgr2=0x5584f50959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27537fe700 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f50959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.050+0000 7f27537fe700 1 -- 172.21.15.12:0/3254928227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584f4e585d0 con 0x5584f508cb80 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.051+0000 7f27537fe700 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f5096dd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f274c011e50 tx=0x7f274c0166b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c822a18196007f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.051+0000 7f2736ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.051+0000 7f2736ff5700 1 -- 172.21.15.12:0/3254928227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c00e040 con 0x5584f508cb80 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.051+0000 7f276d083b80 1 -- 172.21.15.12:0/3254928227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2748099e00 con 0x5584f508cb80 2023-12-11T20:18:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.051+0000 7f2736ff5700 1 -- 172.21.15.12:0/3254928227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f274c01a050 con 0x5584f508cb80 2023-12-11T20:18:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.051+0000 7f2736ff5700 1 -- 172.21.15.12:0/3254928227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274c011290 con 0x5584f508cb80 2023-12-11T20:18:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.051+0000 7f276d083b80 10 client.16155 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.051+0000 7f276d083b80 1 -- 172.21.15.12:0/3254928227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5584f4e2b1f0 con 0x5584f508cb80 2023-12-11T20:18:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f2736ff5700 1 -- 172.21.15.12:0/3254928227 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f274c03f020 con 0x5584f508cb80 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f2736ff5700 1 -- 172.21.15.12:0/3254928227 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f274c0170b0 con 0x5584f508cb80 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f276d083b80 10 client.16155 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f276d083b80 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f276d083b80 20 client.16155 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f276d083b80 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584f50f3950 0x5584f50f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f276d083b80 4 client.16155 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f276d083b80 1 -- 172.21.15.12:0/3254928227 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5584f4fa1f70 con 0x5584f50f3950 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.052+0000 7f2752ffd700 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584f50f3950 0x5584f50f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.053+0000 7f2736ff5700 10 client.16155 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.053+0000 7f2752ffd700 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584f50f3950 0x5584f50f5d70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=753d8e446399edce server_cookie=4bd65bcc9cf2480 in_seq=0 out_seq=0 2023-12-11T20:18:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f2736ff5700 1 -- 172.21.15.12:0/3254928227 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5584f4fa1f70 con 0x5584f50f3950 2023-12-11T20:18:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f2736ff5700 10 client.16155 handle_command_reply: tid=0 2023-12-11T20:18:23.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 client.16155 shutdown 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 -- 172.21.15.12:0/3254928227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 msgr2=0x5584f5096dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f5096dd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f274c011e50 tx=0x7f274c0166b0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 -- 172.21.15.12:0/3254928227 shutdown_connections 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584f50f3950 0x5584f50f5d70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584f5087770 0x5584f50959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f508cb80 0x5584f5096dd0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 --2- 172.21.15.12:0/3254928227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584f50880d0 0x5584f5095ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f2736ff5700 0 client.16155 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 -- 172.21.15.12:0/3254928227 >> 172.21.15.12:0/3254928227 conn(0x5584f4fb6780 msgr2=0x5584f508c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 -- 172.21.15.12:0/3254928227 shutdown_connections 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.064+0000 7f276d083b80 1 -- 172.21.15.12:0/3254928227 wait complete. 2023-12-11T20:18:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f276d083b80 20 client.16155 trim_cache size 0 max 16384 2023-12-11T20:18:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:18:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:18:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:18:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:18:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 -- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f273c0a1470 msgr2=0x7f273c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f273c0a1470 0x7f273c0a3930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2744009990 tx=0x7f2744003680 comp rx=0 tx=0).stop 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 -- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754102500 msgr2=0x7f2754199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754102500 0x7f2754199900 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f274800d950 tx=0x7f274800dc60 comp rx=0 tx=0).stop 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 -- 172.21.15.12:0/1967732435 shutdown_connections 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f273c0a1470 0x7f273c0a3930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2754101310 0x7f27541993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2754102ea0 0x7f27541a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 --2- 172.21.15.12:0/1967732435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2754102500 0x7f2754199900 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 -- 172.21.15.12:0/1967732435 >> 172.21.15.12:0/1967732435 conn(0x7f27540fc8a0 msgr2=0x7f2754107ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.065+0000 7f2753fff700 1 -- 172.21.15.12:0/1967732435 shutdown_connections 2023-12-11T20:18:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:23.066+0000 7f2753fff700 1 -- 172.21.15.12:0/1967732435 wait complete. 2023-12-11T20:18:24.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:24 smithi032 ceph-mon[132488]: pgmap v449: 97 pgs: 97 active+clean; 907 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:24.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:24 smithi039 ceph-mon[102205]: pgmap v449: 97 pgs: 97 active+clean; 907 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:24.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:24 smithi012 ceph-mon[128787]: pgmap v449: 97 pgs: 97 active+clean; 907 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:25.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:25 smithi032 ceph-mon[132488]: pgmap v450: 97 pgs: 97 active+clean; 919 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:25.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:25 smithi039 ceph-mon[102205]: pgmap v450: 97 pgs: 97 active+clean; 919 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:25 smithi012 ceph-mon[128787]: pgmap v450: 97 pgs: 97 active+clean; 919 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:28.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:28 smithi032 ceph-mon[132488]: pgmap v451: 97 pgs: 97 active+clean; 967 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:28.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:28 smithi039 ceph-mon[102205]: pgmap v451: 97 pgs: 97 active+clean; 967 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:28.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:28 smithi012 ceph-mon[128787]: pgmap v451: 97 pgs: 97 active+clean; 967 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:28.708 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:18:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 -- 172.21.15.12:0/1402408718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4106fd0 msgr2=0x7fa2c4109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/1402408718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4106fd0 0x7fa2c4109440 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00b0a0 tx=0x7fa2bc00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 -- 172.21.15.12:0/1402408718 shutdown_connections 2023-12-11T20:18:28.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/1402408718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c4101d70 0x7fa2c4104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/1402408718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4106fd0 0x7fa2c4109440 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/1402408718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c41046a0 0x7fa2c4106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 -- 172.21.15.12:0/1402408718 >> 172.21.15.12:0/1402408718 conn(0x7fa2c40fb740 msgr2=0x7fa2c40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:28.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 -- 172.21.15.12:0/1402408718 shutdown_connections 2023-12-11T20:18:28.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.930+0000 7fa2cad9d700 1 -- 172.21.15.12:0/1402408718 wait complete. 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.931+0000 7fa2cad9d700 1 Processor -- start 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2cad9d700 1 -- start start 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4101d70 0x7fa2c4199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2cad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c41046a0 0x7fa2c41998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2cad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c4106fd0 0x7fa2c41a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2cad9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c41a0e90 con 0x7fa2c4101d70 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2cad9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c41a0fd0 con 0x7fa2c4106fd0 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2cad9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c41a1160 con 0x7fa2c41046a0 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2c9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4101d70 0x7fa2c4199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2c9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4101d70 0x7fa2c4199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48150/0 (socket says 172.21.15.12:48150) 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2c9d9b700 1 -- 172.21.15.12:0/3511219486 learned_addr learned my addr 172.21.15.12:0/3511219486 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.932+0000 7fa2c959a700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c41046a0 0x7fa2c41998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2c9d9b700 1 -- 172.21.15.12:0/3511219486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c41046a0 msgr2=0x7fa2c41998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c41046a0 0x7fa2c41998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2c9d9b700 1 -- 172.21.15.12:0/3511219486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c4106fd0 msgr2=0x7fa2c41a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c4106fd0 0x7fa2c41a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2c9d9b700 1 -- 172.21.15.12:0/3511219486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc009d00 con 0x7fa2c4101d70 2023-12-11T20:18:28.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4101d70 0x7fa2c4199360 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000e9a0 tx=0x7fa2c000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:28.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2baffd700 1 -- 172.21.15.12:0/3511219486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0009790 con 0x7fa2c4101d70 2023-12-11T20:18:28.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2baffd700 1 -- 172.21.15.12:0/3511219486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2c000cbd0 con 0x7fa2c4101d70 2023-12-11T20:18:28.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2cad9d700 1 -- 172.21.15.12:0/3511219486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c41a1440 con 0x7fa2c4101d70 2023-12-11T20:18:28.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2baffd700 1 -- 172.21.15.12:0/3511219486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0018680 con 0x7fa2c4101d70 2023-12-11T20:18:28.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.933+0000 7fa2cad9d700 1 -- 172.21.15.12:0/3511219486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c41a1950 con 0x7fa2c4101d70 2023-12-11T20:18:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.938+0000 7fa2baffd700 1 -- 172.21.15.12:0/3511219486 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa2c000cd40 con 0x7fa2c4101d70 2023-12-11T20:18:28.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.939+0000 7fa2df9f7b80 1 Processor -- start 2023-12-11T20:18:28.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.939+0000 7fa2df9f7b80 1 -- start start 2023-12-11T20:18:28.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.939+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecc1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecc28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecc3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cec1cb50 con 0x55e2cecc23c0 2023-12-11T20:18:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cec1a470 con 0x55e2cecc1a60 2023-12-11T20:18:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cec15d60 con 0x55e2cecc2de0 2023-12-11T20:18:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2baffd700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1520 0x7fa2b00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2baffd700 1 -- 172.21.15.12:0/3511219486 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2c0014070 con 0x7fa2c4101d70 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecc1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecc1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41400/0 (socket says 172.21.15.12:41400) 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 -- 172.21.15.12:0/2941963077 learned_addr learned my addr 172.21.15.12:0/2941963077 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecc28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2c959a700 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecc3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1520 0x7fa2b00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 -- 172.21.15.12:0/2941963077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 msgr2=0x55e2cecc3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecc3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 -- 172.21.15.12:0/2941963077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 msgr2=0x55e2cecc28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecc28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2ca59c700 1 -- 172.21.15.12:0/2941963077 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2cea92630 con 0x55e2cecc1a60 2023-12-11T20:18:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.940+0000 7fa2c959a700 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecc3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.941+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecc1e80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00b070 tx=0x7fa2bc0075e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12081f88de7c8cc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.941+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1520 0x7fa2b00a39e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc022000 tx=0x7fa2bc024000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.941+0000 7fa2affff700 1 -- 172.21.15.12:0/2941963077 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00e040 con 0x55e2cecc1a60 2023-12-11T20:18:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.941+0000 7fa2affff700 1 -- 172.21.15.12:0/2941963077 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2bc023070 con 0x55e2cecc1a60 2023-12-11T20:18:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.941+0000 7fa2affff700 1 -- 172.21.15.12:0/2941963077 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc01e440 con 0x55e2cecc1a60 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2941963077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 msgr2=0x55e2cecc1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecc1e80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00b070 tx=0x7fa2bc0075e0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2941963077 shutdown_connections 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecc1e80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecc3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2941963077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecc28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2941963077 >> 172.21.15.12:0/2941963077 conn(0x55e2cebf07e0 msgr2=0x55e2cecbc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2941963077 shutdown_connections 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.942+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2941963077 wait complete. 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.943+0000 7fa2df9f7b80 1 -- start start 2023-12-11T20:18:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.943+0000 7fa2df9f7b80 1 Processor -- start 2023-12-11T20:18:28.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2ceccb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2ceccb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cebcf560 con 0x55e2cecc23c0 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cebcf200 con 0x55e2cecc1a60 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cea94920 con 0x55e2cecc2de0 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2df9f7b80 10 client.0 _ll_register_callbacks cb 0x55e2ceafaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2c959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2ceccb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2c959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2ceccb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48174/0 (socket says 172.21.15.12:48174) 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2c959a700 1 -- 172.21.15.12:0/2370825897 learned_addr learned my addr 172.21.15.12:0/2370825897 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.944+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2ceccb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2c959a700 1 -- 172.21.15.12:0/2370825897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 msgr2=0x55e2cecd2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2c959a700 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2c959a700 1 -- 172.21.15.12:0/2370825897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 msgr2=0x55e2ceccb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2c959a700 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2ceccb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2c959a700 1 -- 172.21.15.12:0/2370825897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c410a030 con 0x55e2cecc23c0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2c959a700 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2ceccb8d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4013800 tx=0x7fa2b4013bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21affd3ecb76d56b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/2370825897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4009890 con 0x55e2cecc23c0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2370825897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2cecb49e0 con 0x55e2cecc23c0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.945+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/2370825897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2b4011ac0 con 0x55e2cecc23c0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/2370825897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2b4011c80 con 0x55e2cecc23c0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2df9f7b80 10 client.16167 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2370825897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e2cea3ede0 con 0x55e2cecc23c0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/2370825897 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e2cecb49e0 con 0x55e2cecc23c0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/2370825897 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa2b401d480 con 0x55e2cecc23c0 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2df9f7b80 10 client.16167 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:28.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2df9f7b80 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2df9f7b80 20 client.16167 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e2cecd72f0 0x55e2cecd9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2df9f7b80 4 client.16167 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.946+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2370825897 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2cec90f40 con 0x55e2cecd72f0 2023-12-11T20:18:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.947+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e2cecd72f0 0x55e2cecd9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.947+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e2cecd72f0 0x55e2cecd9710 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d02c8fe1fa85a35a server_cookie=fb9b3a4b29b7508c in_seq=0 out_seq=0 2023-12-11T20:18:28.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.947+0000 7fa2ad7fa700 10 client.16167 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.948+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/2370825897 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e2cec90f40 con 0x55e2cecd72f0 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.948+0000 7fa2ad7fa700 10 client.16167 handle_command_reply: tid=0 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.948+0000 7fa2df9f7b80 1 client.16167 shutdown 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.948+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2370825897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 msgr2=0x55e2ceccb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.948+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2ceccb8d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4013800 tx=0x7fa2b4013bc0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.948+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2370825897 shutdown_connections 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e2cecd72f0 0x55e2cecd9710 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2ceccb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/2370825897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2ceccb8d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2370825897 >> 172.21.15.12:0/2370825897 conn(0x55e2cebf07e0 msgr2=0x55e2cecc0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2ad7fa700 0 client.16167 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2370825897 shutdown_connections 2023-12-11T20:18:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/2370825897 wait complete. 2023-12-11T20:18:28.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.949+0000 7fa2df9f7b80 20 client.16167 trim_cache size 0 max 16384 2023-12-11T20:18:28.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2df9f7b80 1 Processor -- start 2023-12-11T20:18:28.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2df9f7b80 1 -- start start 2023-12-11T20:18:28.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc1a60 0x55e2cecc31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc23c0 0x55e2cecd28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc2de0 0x55e2cecbc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2ceccaf00 con 0x55e2cecc1a60 2023-12-11T20:18:28.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cecd4620 con 0x55e2cecc2de0 2023-12-11T20:18:28.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cecc3700 con 0x55e2cecc23c0 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2c9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc1a60 0x55e2cecc31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2c9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc1a60 0x55e2cecc31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48184/0 (socket says 172.21.15.12:48184) 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2c959a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc23c0 0x55e2cecd28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.976+0000 7fa2c9d9b700 1 -- 172.21.15.12:0/1034606953 learned_addr learned my addr 172.21.15.12:0/1034606953 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.977+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc2de0 0x55e2cecbc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.977+0000 7fa2c959a700 1 -- 172.21.15.12:0/1034606953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc2de0 msgr2=0x55e2cecbc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.977+0000 7fa2c959a700 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc2de0 0x55e2cecbc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.977+0000 7fa2c959a700 1 -- 172.21.15.12:0/1034606953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc1a60 msgr2=0x55e2cecc31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.977+0000 7fa2c959a700 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc1a60 0x55e2cecc31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.977+0000 7fa2c959a700 1 -- 172.21.15.12:0/1034606953 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2cea27c60 con 0x55e2cecc23c0 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.977+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc1a60 0x55e2cecc31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.977+0000 7fa2c959a700 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc23c0 0x55e2cecd28d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4000c00 tx=0x7fa2b40059c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580339d397875283 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:28.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2b8ff9700 1 -- 172.21.15.12:0/1034606953 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b401d3f0 con 0x55e2cecc23c0 2023-12-11T20:18:28.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2b8ff9700 1 -- 172.21.15.12:0/1034606953 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2b40044b0 con 0x55e2cecc23c0 2023-12-11T20:18:28.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2b8ff9700 1 -- 172.21.15.12:0/1034606953 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4011e70 con 0x55e2cecc23c0 2023-12-11T20:18:28.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/1034606953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc23c0 msgr2=0x55e2cecd28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc23c0 0x55e2cecd28d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4000c00 tx=0x7fa2b40059c0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/1034606953 shutdown_connections 2023-12-11T20:18:28.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc2de0 0x55e2cecbc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc1a60 0x55e2cecc31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/1034606953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc23c0 0x55e2cecd28d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/1034606953 >> 172.21.15.12:0/1034606953 conn(0x55e2cebf07e0 msgr2=0x55e2cecc9330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.978+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/1034606953 shutdown_connections 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.979+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/1034606953 wait complete. 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.979+0000 7fa2df9f7b80 1 -- start start 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.979+0000 7fa2df9f7b80 1 Processor -- start 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecd2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecd26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2df9f7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cecd1180 con 0x55e2cecc23c0 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cecd12f0 con 0x55e2cecc1a60 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2df9f7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cecd14b0 con 0x55e2cecc2de0 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2df9f7b80 10 client.0 _ll_register_callbacks cb 0x55e2ceafaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecd26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecd26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48192/0 (socket says 172.21.15.12:48192) 2023-12-11T20:18:28.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c959a700 1 -- 172.21.15.12:0/3865407513 learned_addr learned my addr 172.21.15.12:0/3865407513 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2ca59c700 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecd2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c959a700 1 -- 172.21.15.12:0/3865407513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 msgr2=0x55e2cecd0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c959a700 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c959a700 1 -- 172.21.15.12:0/3865407513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 msgr2=0x55e2cecd2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c959a700 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecd2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.980+0000 7fa2c959a700 1 -- 172.21.15.12:0/3865407513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c41a1950 con 0x55e2cecc23c0 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.981+0000 7fa2c959a700 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecd26a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40096d0 tx=0x7fa2b401d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f70ace71f44270 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.981+0000 7fa2ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.981+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/3865407513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4013220 con 0x55e2cecc23c0 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.981+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/3865407513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2bc023070 con 0x55e2cecc23c0 2023-12-11T20:18:28.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.981+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/3865407513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2b4000e40 con 0x55e2cecc23c0 2023-12-11T20:18:28.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.981+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/3865407513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2b4011ed0 con 0x55e2cecc23c0 2023-12-11T20:18:28.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.981+0000 7fa2df9f7b80 10 client.16173 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:28.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.981+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/3865407513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e2cea3ede0 con 0x55e2cecc23c0 2023-12-11T20:18:28.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/3865407513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2bc023070 con 0x55e2cecc23c0 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/3865407513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa2b402e030 con 0x55e2cecc23c0 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2df9f7b80 10 client.16173 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2df9f7b80 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2df9f7b80 20 client.16173 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e2ced2e820 0x55e2ced30c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2df9f7b80 4 client.16173 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/3865407513 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e2cebdbfd0 con 0x55e2ced2e820 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.982+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e2ced2e820 0x55e2ced30c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2ad7fa700 10 client.16173 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2c9d9b700 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e2ced2e820 0x55e2ced30c40 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e65a07d3a80b3c0e server_cookie=6f10b53ea79519bc in_seq=0 out_seq=0 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2ad7fa700 1 -- 172.21.15.12:0/3865407513 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e2cebdbfd0 con 0x55e2ced2e820 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2ad7fa700 10 client.16173 handle_command_reply: tid=0 2023-12-11T20:18:28.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 client.16173 shutdown 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/3865407513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 msgr2=0x55e2cecd26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecd26a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40096d0 tx=0x7fa2b401d8d0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/3865407513 shutdown_connections 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e2ced2e820 0x55e2ced30c40 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e2cecc1a60 0x55e2cecd2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e2cecc2de0 0x55e2cecd0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2ad7fa700 0 client.16173 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 --2- 172.21.15.12:0/3865407513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2cecc23c0 0x55e2cecd26a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.983+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/3865407513 >> 172.21.15.12:0/3865407513 conn(0x55e2cebf07e0 msgr2=0x55e2cecc8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.984+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/3865407513 shutdown_connections 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.984+0000 7fa2df9f7b80 1 -- 172.21.15.12:0/3865407513 wait complete. 2023-12-11T20:18:28.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.984+0000 7fa2df9f7b80 20 client.16173 trim_cache size 0 max 16384 2023-12-11T20:18:28.987 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:18:28.987 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:18:28.987 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:18:28.987 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:18:28.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.984+0000 7fa2cad9d700 1 -- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1520 msgr2=0x7fa2b00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.984+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1520 0x7fa2b00a39e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc022000 tx=0x7fa2bc024000 comp rx=0 tx=0).stop 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.984+0000 7fa2cad9d700 1 -- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4101d70 msgr2=0x7fa2c4199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.984+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4101d70 0x7fa2c4199360 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000e9a0 tx=0x7fa2c000ed60 comp rx=0 tx=0).stop 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.985+0000 7fa2cad9d700 1 -- 172.21.15.12:0/3511219486 shutdown_connections 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.985+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1520 0x7fa2b00a39e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.985+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c4106fd0 0x7fa2c41a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.985+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c4101d70 0x7fa2c4199360 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.985+0000 7fa2cad9d700 1 --2- 172.21.15.12:0/3511219486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c41046a0 0x7fa2c41998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.985+0000 7fa2cad9d700 1 -- 172.21.15.12:0/3511219486 >> 172.21.15.12:0/3511219486 conn(0x7fa2c40fb740 msgr2=0x7fa2c41014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.985+0000 7fa2cad9d700 1 -- 172.21.15.12:0/3511219486 shutdown_connections 2023-12-11T20:18:28.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:28.985+0000 7fa2cad9d700 1 -- 172.21.15.12:0/3511219486 wait complete. 2023-12-11T20:18:29.006 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:18:29.006 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.227+0000 7f21823ff700 1 -- 172.21.15.12:0/3059235058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c10da70 msgr2=0x7f217c10fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.227+0000 7f21823ff700 1 --2- 172.21.15.12:0/3059235058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c10da70 0x7f217c10fe60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f217400b0a0 tx=0x7f217400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.228+0000 7f21823ff700 1 -- 172.21.15.12:0/3059235058 shutdown_connections 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.228+0000 7f21823ff700 1 --2- 172.21.15.12:0/3059235058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f217c075610 0x7f217c073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.228+0000 7f21823ff700 1 --2- 172.21.15.12:0/3059235058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c10da70 0x7f217c10fe60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.228+0000 7f21823ff700 1 --2- 172.21.15.12:0/3059235058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f217c074030 0x7f217c0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.228+0000 7f21823ff700 1 -- 172.21.15.12:0/3059235058 >> 172.21.15.12:0/3059235058 conn(0x7f217c0fca10 msgr2=0x7f217c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.228+0000 7f21823ff700 1 -- 172.21.15.12:0/3059235058 shutdown_connections 2023-12-11T20:18:29.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.228+0000 7f21823ff700 1 -- 172.21.15.12:0/3059235058 wait complete. 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.229+0000 7f21823ff700 1 Processor -- start 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.229+0000 7f21823ff700 1 -- start start 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.229+0000 7f21823ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c074030 0x7f217c19d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.229+0000 7f21823ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f217c075610 0x7f217c19ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.229+0000 7f21823ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f217c10da70 0x7f217c1a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.229+0000 7f21823ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c1a54c0 con 0x7f217c074030 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.229+0000 7f21823ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c1a5600 con 0x7f217c075610 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.229+0000 7f21823ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c1a5790 con 0x7f217c10da70 2023-12-11T20:18:29.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c074030 0x7f217c19d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f217c075610 0x7f217c19ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c074030 0x7f217c19d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48200/0 (socket says 172.21.15.12:48200) 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217bfff700 1 -- 172.21.15.12:0/1343441261 learned_addr learned my addr 172.21.15.12:0/1343441261 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f218099c700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f217c10da70 0x7f217c1a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217bfff700 1 -- 172.21.15.12:0/1343441261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f217c10da70 msgr2=0x7f217c1a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217bfff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f217c10da70 0x7f217c1a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217bfff700 1 -- 172.21.15.12:0/1343441261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f217c075610 msgr2=0x7f217c19ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217bfff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f217c075610 0x7f217c19ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217bfff700 1 -- 172.21.15.12:0/1343441261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009d00 con 0x7f217c074030 2023-12-11T20:18:29.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.230+0000 7f217b7fe700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f217c075610 0x7f217c19ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.231+0000 7f217bfff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c074030 0x7f217c19d990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c9b0 tx=0x7f216c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.231+0000 7f21797fa700 1 -- 172.21.15.12:0/1343441261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c007b00 con 0x7f217c074030 2023-12-11T20:18:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.231+0000 7f21797fa700 1 -- 172.21.15.12:0/1343441261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f216c007c60 con 0x7f217c074030 2023-12-11T20:18:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.231+0000 7f21797fa700 1 -- 172.21.15.12:0/1343441261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c018660 con 0x7f217c074030 2023-12-11T20:18:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.231+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c1a5a70 con 0x7f217c074030 2023-12-11T20:18:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.231+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c1a5f80 con 0x7f217c074030 2023-12-11T20:18:29.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.232+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c103cd0 con 0x7f217c074030 2023-12-11T20:18:29.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.234+0000 7f21797fa700 1 -- 172.21.15.12:0/1343441261 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f216c00f450 con 0x7f217c074030 2023-12-11T20:18:29.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.236+0000 7f21797fa700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21640a1500 0x7f21640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.236+0000 7f21797fa700 1 -- 172.21.15.12:0/1343441261 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f216c0ccd40 con 0x7f217c074030 2023-12-11T20:18:29.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.236+0000 7f217b7fe700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21640a1500 0x7f21640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.237+0000 7f217b7fe700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21640a1500 0x7f21640a39c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f217c075330 tx=0x7f217000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:29.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.241+0000 7f21797fa700 1 -- 172.21.15.12:0/1343441261 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f216c0962f0 con 0x7f217c074030 2023-12-11T20:18:29.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.542+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f217c068330 con 0x7f217c074030 2023-12-11T20:18:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.543+0000 7f21797fa700 1 -- 172.21.15.12:0/1343441261 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f216c00fe60 con 0x7f217c074030 2023-12-11T20:18:29.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:18:29.542 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:17:06.102424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21640a1500 msgr2=0x7f21640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21640a1500 0x7f21640a39c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f217c075330 tx=0x7f217000b410 comp rx=0 tx=0).stop 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c074030 msgr2=0x7f217c19d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c074030 0x7f217c19d990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c9b0 tx=0x7f216c00ccc0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 shutdown_connections 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21640a1500 0x7f21640a39c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f217c10da70 0x7f217c1a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f217c074030 0x7f217c19d990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 --2- 172.21.15.12:0/1343441261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f217c075610 0x7f217c19ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 >> 172.21.15.12:0/1343441261 conn(0x7f217c0fca10 msgr2=0x7f217c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 shutdown_connections 2023-12-11T20:18:29.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.546+0000 7f21823ff700 1 -- 172.21.15.12:0/1343441261 wait complete. 2023-12-11T20:18:29.546 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 24 2023-12-11T20:18:29.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:18:29.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:29 smithi012 ceph-mon[128787]: pgmap v452: 97 pgs: 97 active+clean; 1007 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:18:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:29 smithi032 ceph-mon[132488]: pgmap v452: 97 pgs: 97 active+clean; 1007 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:18:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 -- 172.21.15.12:0/1282643003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec0ffbc0 msgr2=0x7fddec0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 --2- 172.21.15.12:0/1282643003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec0ffbc0 0x7fddec0fffe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0099c0 tx=0x7fdddc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 -- 172.21.15.12:0/1282643003 shutdown_connections 2023-12-11T20:18:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 --2- 172.21.15.12:0/1282643003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddec100ee0 0x7fddec101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 --2- 172.21.15.12:0/1282643003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec0ffbc0 0x7fddec0fffe0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 --2- 172.21.15.12:0/1282643003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fddec100520 0x7fddec1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 -- 172.21.15.12:0/1282643003 >> 172.21.15.12:0/1282643003 conn(0x7fddec0fb740 msgr2=0x7fddec0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 -- 172.21.15.12:0/1282643003 shutdown_connections 2023-12-11T20:18:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.788+0000 7fddf09fe700 1 -- 172.21.15.12:0/1282643003 wait complete. 2023-12-11T20:18:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.789+0000 7fddf09fe700 1 Processor -- start 2023-12-11T20:18:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.789+0000 7fddf09fe700 1 -- start start 2023-12-11T20:18:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddf09fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddec0ffbc0 0x7fddec1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddf09fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fddec100520 0x7fddec1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddf09fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec100ee0 0x7fddec1a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddf09fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1a0d90 con 0x7fddec100ee0 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddf09fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1a0ed0 con 0x7fddec100520 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddf09fe700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1a1060 con 0x7fddec0ffbc0 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddeb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec100ee0 0x7fddec1a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddeb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec100ee0 0x7fddec1a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48218/0 (socket says 172.21.15.12:48218) 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddeb59e700 1 -- 172.21.15.12:0/931834109 learned_addr learned my addr 172.21.15.12:0/931834109 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddea59c700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fddec100520 0x7fddec1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.790+0000 7fddead9d700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddec0ffbc0 0x7fddec1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddeb59e700 1 -- 172.21.15.12:0/931834109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddec0ffbc0 msgr2=0x7fddec1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddeb59e700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddec0ffbc0 0x7fddec1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddeb59e700 1 -- 172.21.15.12:0/931834109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fddec100520 msgr2=0x7fddec1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddeb59e700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fddec100520 0x7fddec1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddeb59e700 1 -- 172.21.15.12:0/931834109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0095f0 con 0x7fddec100ee0 2023-12-11T20:18:29.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddead9d700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddec0ffbc0 0x7fddec1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:29.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddeb59e700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec100ee0 0x7fddec1a07c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdde4007d70 tx=0x7fdde400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:29.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddd3fff700 1 -- 172.21.15.12:0/931834109 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde400ad40 con 0x7fddec100ee0 2023-12-11T20:18:29.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddd3fff700 1 -- 172.21.15.12:0/931834109 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdde40128b0 con 0x7fddec100ee0 2023-12-11T20:18:29.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddf09fe700 1 -- 172.21.15.12:0/931834109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec1a1340 con 0x7fddec100ee0 2023-12-11T20:18:29.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.791+0000 7fddd3fff700 1 -- 172.21.15.12:0/931834109 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde40115a0 con 0x7fddec100ee0 2023-12-11T20:18:29.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.792+0000 7fddf09fe700 1 -- 172.21.15.12:0/931834109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec1a1800 con 0x7fddec100ee0 2023-12-11T20:18:29.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.795+0000 7fddd3fff700 1 -- 172.21.15.12:0/931834109 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fdde4012a20 con 0x7fddec100ee0 2023-12-11T20:18:29.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.796+0000 7fddd3fff700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd40a1520 0x7fddd40a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fde04a76b80 1 Processor -- start 2023-12-11T20:18:29.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fddd3fff700 1 -- 172.21.15.12:0/931834109 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdde40ccfe0 con 0x7fddec100ee0 2023-12-11T20:18:29.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fde04a76b80 1 -- start start 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fddead9d700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd40a1520 0x7fddd40a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b63c0 0x5595447b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b6de0 0x5595447b7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fde04a76b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559544710b50 con 0x5595447b6de0 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fde04a76b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954470e470 con 0x5595447b63c0 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.797+0000 7fde04a76b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559544709d60 con 0x5595447b5a60 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddeb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b6de0 0x5595447b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b63c0 0x5595447b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b63c0 0x5595447b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41486/0 (socket says 172.21.15.12:41486) 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 -- 172.21.15.12:0/1431257075 learned_addr learned my addr 172.21.15.12:0/1431257075 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddead9d700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd40a1520 0x7fddd40a39e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00c010 tx=0x7fdddc005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:29.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddead9d700 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 -- 172.21.15.12:0/1431257075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 msgr2=0x5595447b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:29.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 -- 172.21.15.12:0/1431257075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b6de0 msgr2=0x5595447b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:29.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b6de0 0x5595447b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 -- 172.21.15.12:0/1431257075 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559544586630 con 0x5595447b63c0 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddeb59e700 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b6de0 0x5595447b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.798+0000 7fddea59c700 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b63c0 0x5595447b68a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdde000bd70 tx=0x7fdde00106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d5e72dbd214275f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.799+0000 7fddd17fa700 1 -- 172.21.15.12:0/1431257075 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0010e10 con 0x5595447b63c0 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.799+0000 7fddd17fa700 1 -- 172.21.15.12:0/1431257075 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdde0015070 con 0x5595447b63c0 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.799+0000 7fddd17fa700 1 -- 172.21.15.12:0/1431257075 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde00116a0 con 0x5595447b63c0 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.799+0000 7fde04a76b80 1 -- 172.21.15.12:0/1431257075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b63c0 msgr2=0x5595447b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.799+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b63c0 0x5595447b68a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdde000bd70 tx=0x7fdde00106b0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.800+0000 7fde04a76b80 1 -- 172.21.15.12:0/1431257075 shutdown_connections 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.800+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b6de0 0x5595447b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.800+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.800+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1431257075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b63c0 0x5595447b68a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.800+0000 7fde04a76b80 1 -- 172.21.15.12:0/1431257075 >> 172.21.15.12:0/1431257075 conn(0x5595446e47e0 msgr2=0x5595447b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.800+0000 7fde04a76b80 1 -- 172.21.15.12:0/1431257075 shutdown_connections 2023-12-11T20:18:29.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.800+0000 7fde04a76b80 1 -- 172.21.15.12:0/1431257075 wait complete. 2023-12-11T20:18:29.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.800+0000 7fde04a76b80 1 -- start start 2023-12-11T20:18:29.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fde04a76b80 1 Processor -- start 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b5a60 0x5595447bf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b6de0 0x5595447c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fde04a76b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595446c3560 con 0x5595447b63c0 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fde04a76b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595446c3200 con 0x5595447b5a60 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fde04a76b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559544588920 con 0x5595447b6de0 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fde04a76b80 10 client.0 _ll_register_callbacks cb 0x5595445eea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.801+0000 7fddea59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddea59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447bf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48248/0 (socket says 172.21.15.12:48248) 2023-12-11T20:18:29.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddea59c700 1 -- 172.21.15.12:0/1071267787 learned_addr learned my addr 172.21.15.12:0/1071267787 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddead9d700 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b5a60 0x5595447bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddea59c700 1 -- 172.21.15.12:0/1071267787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b6de0 msgr2=0x5595447c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddea59c700 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b6de0 0x5595447c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddea59c700 1 -- 172.21.15.12:0/1071267787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b5a60 msgr2=0x5595447bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddea59c700 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b5a60 0x5595447bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddea59c700 1 -- 172.21.15.12:0/1071267787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec1a1800 con 0x5595447b63c0 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddea59c700 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447bf8a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdde0010ec0 tx=0x7fdde0010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3532bd02d763e5bc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.802+0000 7fddceff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.803+0000 7fddceff5700 1 -- 172.21.15.12:0/1071267787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde001c890 con 0x5595447b63c0 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.803+0000 7fde04a76b80 1 -- 172.21.15.12:0/1071267787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595447a89e0 con 0x5595447b63c0 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.803+0000 7fddceff5700 1 -- 172.21.15.12:0/1071267787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdde0017070 con 0x5595447b63c0 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.803+0000 7fddceff5700 1 -- 172.21.15.12:0/1071267787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdde000bec0 con 0x5595447b63c0 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.803+0000 7fde04a76b80 10 client.16191 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:29.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.803+0000 7fde04a76b80 1 -- 172.21.15.12:0/1071267787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fdde000b9a0 con 0x5595447b63c0 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.803+0000 7fddceff5700 1 -- 172.21.15.12:0/1071267787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5595447a89e0 con 0x5595447b63c0 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.803+0000 7fddceff5700 1 -- 172.21.15.12:0/1071267787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdde0003b40 con 0x5595447b63c0 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.804+0000 7fde04a76b80 10 client.16191 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.804+0000 7fde04a76b80 10 client.16191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.804+0000 7fde04a76b80 20 client.16191 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.804+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5595447cafe0 0x5595447cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.804+0000 7fde04a76b80 4 client.16191 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.804+0000 7fde04a76b80 1 -- 172.21.15.12:0/1071267787 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559544784f40 con 0x5595447cafe0 2023-12-11T20:18:29.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.804+0000 7fddead9d700 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5595447cafe0 0x5595447cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.806 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:29 smithi039 ceph-mon[102205]: pgmap v452: 97 pgs: 97 active+clean; 1007 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.805+0000 7fddead9d700 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5595447cafe0 0x5595447cd400 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba346777241adb3c server_cookie=325daf257fb5884d in_seq=0 out_seq=0 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.805+0000 7fddceff5700 10 client.16191 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fddceff5700 1 -- 172.21.15.12:0/1071267787 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559544784f40 con 0x5595447cafe0 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fddceff5700 10 client.16191 handle_command_reply: tid=0 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 client.16191 shutdown 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 -- 172.21.15.12:0/1071267787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 msgr2=0x5595447bf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447bf8a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdde0010ec0 tx=0x7fdde0010ef0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 -- 172.21.15.12:0/1071267787 shutdown_connections 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5595447cafe0 0x5595447cd400 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b5a60 0x5595447bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b6de0 0x5595447c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 --2- 172.21.15.12:0/1071267787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447bf8a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fddceff5700 0 client.16191 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:18:29.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 -- 172.21.15.12:0/1071267787 >> 172.21.15.12:0/1071267787 conn(0x5595446e47e0 msgr2=0x5595447b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:29.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 -- 172.21.15.12:0/1071267787 shutdown_connections 2023-12-11T20:18:29.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 1 -- 172.21.15.12:0/1071267787 wait complete. 2023-12-11T20:18:29.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.806+0000 7fde04a76b80 20 client.16191 trim_cache size 0 max 16384 2023-12-11T20:18:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.822+0000 7fde04a76b80 1 Processor -- start 2023-12-11T20:18:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.822+0000 7fde04a76b80 1 -- start start 2023-12-11T20:18:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.822+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b5a60 0x5595447be870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.822+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b63c0 0x5595447c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.822+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 0x5595447bd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.822+0000 7fde04a76b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595447d2630 con 0x5595447b5a60 2023-12-11T20:18:29.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.822+0000 7fde04a76b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595447acb30 con 0x5595447b6de0 2023-12-11T20:18:29.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.822+0000 7fde04a76b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595447c0550 con 0x5595447b63c0 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b5a60 0x5595447be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b5a60 0x5595447be870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48264/0 (socket says 172.21.15.12:48264) 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 -- 172.21.15.12:0/3431012952 learned_addr learned my addr 172.21.15.12:0/3431012952 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddeb59e700 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 0x5595447bd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddea59c700 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b63c0 0x5595447c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 -- 172.21.15.12:0/3431012952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b63c0 msgr2=0x5595447c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b63c0 0x5595447c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 -- 172.21.15.12:0/3431012952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 msgr2=0x5595447bd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 0x5595447bd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 -- 172.21.15.12:0/3431012952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559544532de0 con 0x5595447b5a60 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddea59c700 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b63c0 0x5595447c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.823+0000 7fddead9d700 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b5a60 0x5595447be870 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0098e0 tx=0x7fdddc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750a5fbea3ffe8dd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fddd1ffb700 1 -- 172.21.15.12:0/3431012952 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc032030 con 0x5595447b5a60 2023-12-11T20:18:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fddd1ffb700 1 -- 172.21.15.12:0/3431012952 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdddc02c040 con 0x5595447b5a60 2023-12-11T20:18:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fddd1ffb700 1 -- 172.21.15.12:0/3431012952 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc004920 con 0x5595447b5a60 2023-12-11T20:18:29.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fde04a76b80 1 -- 172.21.15.12:0/3431012952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b5a60 msgr2=0x5595447be870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fde04a76b80 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b5a60 0x5595447be870 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0098e0 tx=0x7fdddc01f000 comp rx=0 tx=0).stop 2023-12-11T20:18:29.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fde04a76b80 1 -- 172.21.15.12:0/3431012952 shutdown_connections 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fde04a76b80 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 0x5595447bd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fde04a76b80 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b5a60 0x5595447be870 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.824+0000 7fde04a76b80 1 --2- 172.21.15.12:0/3431012952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b63c0 0x5595447c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.825+0000 7fde04a76b80 1 -- 172.21.15.12:0/3431012952 >> 172.21.15.12:0/3431012952 conn(0x5595446e47e0 msgr2=0x5595447b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.825+0000 7fde04a76b80 1 -- 172.21.15.12:0/3431012952 shutdown_connections 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.825+0000 7fde04a76b80 1 -- 172.21.15.12:0/3431012952 wait complete. 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.825+0000 7fde04a76b80 1 -- start start 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.825+0000 7fde04a76b80 1 Processor -- start 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fde04a76b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 0x5595447c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fde04a76b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595447c5fb0 con 0x5595447b63c0 2023-12-11T20:18:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fde04a76b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595447c6120 con 0x5595447b6de0 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fde04a76b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595447c62e0 con 0x5595447b5a60 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fde04a76b80 10 client.0 _ll_register_callbacks cb 0x5595445eea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fddea59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fddead9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fddea59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48270/0 (socket says 172.21.15.12:48270) 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.826+0000 7fddea59c700 1 -- 172.21.15.12:0/500451520 learned_addr learned my addr 172.21.15.12:0/500451520 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddeb59e700 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 0x5595447c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddea59c700 1 -- 172.21.15.12:0/500451520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 msgr2=0x5595447c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddea59c700 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddea59c700 1 -- 172.21.15.12:0/500451520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 msgr2=0x5595447c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddea59c700 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 0x5595447c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddea59c700 1 -- 172.21.15.12:0/500451520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec10c260 con 0x5595447b63c0 2023-12-11T20:18:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddead9d700 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddea59c700 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447c4b00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdde0000c00 tx=0x7fdde000b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5705c1ed1cb019 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddceff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddceff5700 1 -- 172.21.15.12:0/500451520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0031d30 con 0x5595447b63c0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fde04a76b80 1 -- 172.21.15.12:0/500451520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdde0015070 con 0x5595447b63c0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.827+0000 7fddceff5700 1 -- 172.21.15.12:0/500451520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdde0000e40 con 0x5595447b63c0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fddceff5700 1 -- 172.21.15.12:0/500451520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdde0031e90 con 0x5595447b63c0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fde04a76b80 10 client.16197 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fde04a76b80 1 -- 172.21.15.12:0/500451520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55954451bc60 con 0x5595447b63c0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fddceff5700 1 -- 172.21.15.12:0/500451520 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdde0015070 con 0x5595447b63c0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fddceff5700 1 -- 172.21.15.12:0/500451520 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdde00053b0 con 0x5595447b63c0 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fde04a76b80 10 client.16197 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:29.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fde04a76b80 10 client.16197 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fde04a76b80 20 client.16197 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fde04a76b80 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559544822080 0x5595448244a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fde04a76b80 4 client.16197 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.828+0000 7fde04a76b80 1 -- 172.21.15.12:0/500451520 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5595446cffd0 con 0x559544822080 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.829+0000 7fddead9d700 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559544822080 0x5595448244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.829+0000 7fddead9d700 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559544822080 0x5595448244a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9cbb23bf11a0bb5 server_cookie=66fb4c28dc9e6f15 in_seq=0 out_seq=0 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.829+0000 7fddceff5700 10 client.16197 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.829+0000 7fddceff5700 1 -- 172.21.15.12:0/500451520 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5595446cffd0 con 0x559544822080 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.829+0000 7fddceff5700 10 client.16197 handle_command_reply: tid=0 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.829+0000 7fde04a76b80 1 client.16197 shutdown 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 -- 172.21.15.12:0/500451520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 msgr2=0x5595447c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447c4b00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdde0000c00 tx=0x7fdde000b7a0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 -- 172.21.15.12:0/500451520 shutdown_connections 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559544822080 0x5595448244a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595447b6de0 0x5595447c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595447b5a60 0x5595447c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 --2- 172.21.15.12:0/500451520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595447b63c0 0x5595447c4b00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 -- 172.21.15.12:0/500451520 >> 172.21.15.12:0/500451520 conn(0x5595446e47e0 msgr2=0x5595447b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:29.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fddceff5700 0 client.16197 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:18:29.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 -- 172.21.15.12:0/500451520 shutdown_connections 2023-12-11T20:18:29.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 1 -- 172.21.15.12:0/500451520 wait complete. 2023-12-11T20:18:29.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.830+0000 7fde04a76b80 20 client.16197 trim_cache size 0 max 16384 2023-12-11T20:18:29.832 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 -- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd40a1520 msgr2=0x7fddd40a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd40a1520 0x7fddd40a39e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00c010 tx=0x7fdddc005fb0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 -- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec100ee0 msgr2=0x7fddec1a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec100ee0 0x7fddec1a07c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdde4007d70 tx=0x7fdde400a340 comp rx=0 tx=0).stop 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 -- 172.21.15.12:0/931834109 shutdown_connections 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd40a1520 0x7fddd40a39e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddec100ee0 0x7fddec1a07c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fddec0ffbc0 0x7fddec1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 --2- 172.21.15.12:0/931834109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fddec100520 0x7fddec1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:29.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 -- 172.21.15.12:0/931834109 >> 172.21.15.12:0/931834109 conn(0x7fddec0fb740 msgr2=0x7fddec0fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:29.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 -- 172.21.15.12:0/931834109 shutdown_connections 2023-12-11T20:18:29.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:29.831+0000 7fddf09fe700 1 -- 172.21.15.12:0/931834109 wait complete. 2023-12-11T20:18:29.849 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:18:30.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2830343827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc1026a0 msgr2=0x7f1fcc102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2830343827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc1026a0 0x7f1fcc102b00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00099c0 tx=0x7f1fc0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2830343827 shutdown_connections 2023-12-11T20:18:30.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2830343827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fcc103040 0x7f1fcc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2830343827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fcc1014b0 0x7f1fcc1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2830343827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc1026a0 0x7f1fcc102b00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2830343827 >> 172.21.15.12:0/2830343827 conn(0x7f1fcc0fca00 msgr2=0x7f1fcc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2830343827 shutdown_connections 2023-12-11T20:18:30.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.083+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2830343827 wait complete. 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.084+0000 7f1fd13ff700 1 Processor -- start 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.084+0000 7f1fd13ff700 1 -- start start 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.084+0000 7f1fd13ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fcc1014b0 0x7f1fcc1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.084+0000 7f1fd13ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fcc1026a0 0x7f1fcc199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.084+0000 7f1fd13ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc103040 0x7f1fcc1a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fd13ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1a0ff0 con 0x7f1fcc103040 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fd13ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1a1130 con 0x7f1fcc1014b0 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fd13ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1a12c0 con 0x7f1fcc1026a0 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc103040 0x7f1fcc1a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fcc1014b0 0x7f1fcc1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc103040 0x7f1fcc1a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48292/0 (socket says 172.21.15.12:48292) 2023-12-11T20:18:30.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcb7fe700 1 -- 172.21.15.12:0/2268263322 learned_addr learned my addr 172.21.15.12:0/2268263322 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fcc1026a0 0x7f1fcc199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcb7fe700 1 -- 172.21.15.12:0/2268263322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fcc1026a0 msgr2=0x7f1fcc199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcb7fe700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fcc1026a0 0x7f1fcc199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcb7fe700 1 -- 172.21.15.12:0/2268263322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fcc1014b0 msgr2=0x7f1fcc1994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcb7fe700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fcc1014b0 0x7f1fcc1994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fcb7fe700 1 -- 172.21.15.12:0/2268263322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00095f0 con 0x7f1fcc103040 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.085+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fcc1026a0 0x7f1fcc199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.086+0000 7f1fcb7fe700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc103040 0x7f1fcc1a0a20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4007ee0 tx=0x7f1fc400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.086+0000 7f1fb3fff700 1 -- 172.21.15.12:0/2268263322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4017070 con 0x7f1fcc103040 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.086+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2268263322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc1a15a0 con 0x7f1fcc103040 2023-12-11T20:18:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.086+0000 7f1fb3fff700 1 -- 172.21.15.12:0/2268263322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fc400f040 con 0x7f1fcc103040 2023-12-11T20:18:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.086+0000 7f1fb3fff700 1 -- 172.21.15.12:0/2268263322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4005710 con 0x7f1fcc103040 2023-12-11T20:18:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.086+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2268263322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc1a1a60 con 0x7f1fcc103040 2023-12-11T20:18:30.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.090+0000 7f1fb3fff700 1 -- 172.21.15.12:0/2268263322 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1fc4005870 con 0x7f1fcc103040 2023-12-11T20:18:30.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fe4d47b80 1 Processor -- start 2023-12-11T20:18:30.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fe4d47b80 1 -- start start 2023-12-11T20:18:30.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fb3fff700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fb40a1480 0x7f1fb40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe56897f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe568a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe568ac20 0x55cbe568b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe55e4b50 con 0x55cbe5689d30 2023-12-11T20:18:30.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fb3fff700 1 -- 172.21.15.12:0/2268263322 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1fc40cc5c0 con 0x7f1fcc103040 2023-12-11T20:18:30.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe55e2470 con 0x55cbe56893d0 2023-12-11T20:18:30.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.092+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe55ddd60 con 0x55cbe568ac20 2023-12-11T20:18:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fb40a1480 0x7f1fb40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fca7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe568a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe56897f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe56897f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41548/0 (socket says 172.21.15.12:41548) 2023-12-11T20:18:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcaffd700 1 -- 172.21.15.12:0/4086073806 learned_addr learned my addr 172.21.15.12:0/4086073806 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcb7fe700 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe568ac20 0x55cbe568b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcaffd700 1 -- 172.21.15.12:0/4086073806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe568ac20 msgr2=0x55cbe568b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcaffd700 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe568ac20 0x55cbe568b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcaffd700 1 -- 172.21.15.12:0/4086073806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 msgr2=0x55cbe568a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcaffd700 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe568a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fcaffd700 1 -- 172.21.15.12:0/4086073806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbe545a630 con 0x55cbe56893d0 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe568a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.093+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fb40a1480 0x7f1fb40a3940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0003780 tx=0x7f1fc0009f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.094+0000 7f1fcaffd700 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe56897f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00ad00 tx=0x7f1fbc00f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d444b02f020664cf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.094+0000 7f1fb17fa700 1 -- 172.21.15.12:0/4086073806 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00ae50 con 0x55cbe56893d0 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.094+0000 7f1fb17fa700 1 -- 172.21.15.12:0/4086073806 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fbc004cc0 con 0x55cbe56893d0 2023-12-11T20:18:30.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.094+0000 7f1fb17fa700 1 -- 172.21.15.12:0/4086073806 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0186a0 con 0x55cbe56893d0 2023-12-11T20:18:30.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/4086073806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 msgr2=0x55cbe56897f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe56897f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00ad00 tx=0x7f1fbc00f6a0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/4086073806 shutdown_connections 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe56897f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe568ac20 0x55cbe568b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/4086073806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe568a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/4086073806 >> 172.21.15.12:0/4086073806 conn(0x55cbe55b87e0 msgr2=0x55cbe5685d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/4086073806 shutdown_connections 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.095+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/4086073806 wait complete. 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.096+0000 7f1fe4d47b80 1 -- start start 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.096+0000 7f1fe4d47b80 1 Processor -- start 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.096+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe5693140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.096+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe5689d30 0x55cbe5693680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.096+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe569a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.096+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe5597560 con 0x55cbe568ac20 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.096+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe5597200 con 0x55cbe56893d0 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.096+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe545c920 con 0x55cbe5689d30 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fe4d47b80 10 client.0 _ll_register_callbacks cb 0x55cbe54c2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fcaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe5693140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fcaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe5693140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41554/0 (socket says 172.21.15.12:41554) 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fcaffd700 1 -- 172.21.15.12:0/3206921765 learned_addr learned my addr 172.21.15.12:0/3206921765 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe5689d30 0x55cbe5693680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fcb7fe700 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe569a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fca7fc700 1 -- 172.21.15.12:0/3206921765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 msgr2=0x55cbe5693140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe5693140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fca7fc700 1 -- 172.21.15.12:0/3206921765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 msgr2=0x55cbe569a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe569a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fca7fc700 1 -- 172.21.15.12:0/3206921765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc00a9c0 con 0x55cbe5689d30 2023-12-11T20:18:30.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.097+0000 7f1fcb7fe700 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe569a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:30.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.098+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe5689d30 0x55cbe5693680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009990 tx=0x7f1fc0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fc1e635e6da8fd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.098+0000 7f1faeff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:18:30.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.098+0000 7f1faeff5700 1 -- 172.21.15.12:0/3206921765 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000f520 con 0x55cbe5689d30 2023-12-11T20:18:30.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.098+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/3206921765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbe567cb40 con 0x55cbe5689d30 2023-12-11T20:18:30.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.098+0000 7f1faeff5700 1 -- 172.21.15.12:0/3206921765 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1fc000f680 con 0x55cbe5689d30 2023-12-11T20:18:30.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.098+0000 7f1faeff5700 1 -- 172.21.15.12:0/3206921765 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fc000f840 con 0x55cbe5689d30 2023-12-11T20:18:30.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.098+0000 7f1fe4d47b80 10 client.25969 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:30.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.098+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/3206921765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55cbe5406de0 con 0x55cbe5689d30 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.099+0000 7f1faeff5700 1 -- 172.21.15.12:0/3206921765 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cbe567cb40 con 0x55cbe5689d30 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.099+0000 7f1faeff5700 1 -- 172.21.15.12:0/3206921765 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1fc0023050 con 0x55cbe5689d30 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.099+0000 7f1fe4d47b80 10 client.25969 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.099+0000 7f1fe4d47b80 10 client.25969 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.099+0000 7f1fe4d47b80 20 client.25969 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.099+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55cbe569ef10 0x55cbe56a1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.099+0000 7f1fe4d47b80 4 client.25969 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.099+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/3206921765 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbe5658f40 con 0x55cbe569ef10 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.100+0000 7f1fcaffd700 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55cbe569ef10 0x55cbe56a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.100+0000 7f1fcaffd700 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55cbe569ef10 0x55cbe56a1330 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2a2c6912ea9bc70d server_cookie=c001a31356ef31ee in_seq=0 out_seq=0 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.100+0000 7f1faeff5700 10 client.25969 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1faeff5700 1 -- 172.21.15.12:0/3206921765 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cbe5658f40 con 0x55cbe569ef10 2023-12-11T20:18:30.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1faeff5700 10 client.25969 handle_command_reply: tid=0 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 client.25969 shutdown 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe5689d30 msgr2=0x55cbe5693680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe5689d30 0x55cbe5693680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009990 tx=0x7f1fc0009310 comp rx=0 tx=0).stop 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/3206921765 shutdown_connections 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55cbe569ef10 0x55cbe56a1330 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe56893d0 0x55cbe5693140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe569a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1faeff5700 0 client.25969 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/3206921765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe5689d30 0x55cbe5693680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.101+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/3206921765 >> 172.21.15.12:0/3206921765 conn(0x55cbe55b87e0 msgr2=0x55cbe5684a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.102+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/3206921765 shutdown_connections 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.102+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/3206921765 wait complete. 2023-12-11T20:18:30.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.102+0000 7f1fe4d47b80 20 client.25969 trim_cache size 0 max 16384 2023-12-11T20:18:30.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.119+0000 7f1fe4d47b80 1 Processor -- start 2023-12-11T20:18:30.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.119+0000 7f1fe4d47b80 1 -- start start 2023-12-11T20:18:30.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.119+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 0x55cbe56897b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe569a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe568ac20 0x55cbe5685970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe56a6580 con 0x55cbe5689d30 2023-12-11T20:18:30.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe5680b50 con 0x55cbe568ac20 2023-12-11T20:18:30.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe5694330 con 0x55cbe56893d0 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fca7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe569a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fca7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe569a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48312/0 (socket says 172.21.15.12:48312) 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fca7fc700 1 -- 172.21.15.12:0/2641992586 learned_addr learned my addr 172.21.15.12:0/2641992586 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fcaffd700 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 0x55cbe56897b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fcb7fe700 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe568ac20 0x55cbe5685970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fca7fc700 1 -- 172.21.15.12:0/2641992586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 msgr2=0x55cbe56897b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 0x55cbe56897b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fca7fc700 1 -- 172.21.15.12:0/2641992586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe568ac20 msgr2=0x55cbe5685970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe568ac20 0x55cbe5685970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.120+0000 7f1fca7fc700 1 -- 172.21.15.12:0/2641992586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbe53efc60 con 0x55cbe5689d30 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.121+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe569a680 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00098e0 tx=0x7f1fc000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc1614c02b15c60 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.121+0000 7f1fb1ffb700 1 -- 172.21.15.12:0/2641992586 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc003f070 con 0x55cbe5689d30 2023-12-11T20:18:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.121+0000 7f1fb1ffb700 1 -- 172.21.15.12:0/2641992586 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fc002b070 con 0x55cbe5689d30 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.121+0000 7f1fb1ffb700 1 -- 172.21.15.12:0/2641992586 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc003aea0 con 0x55cbe5689d30 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/2641992586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 msgr2=0x55cbe569a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe569a680 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00098e0 tx=0x7f1fc000bfd0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/2641992586 shutdown_connections 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe568ac20 0x55cbe5685970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 0x55cbe56897b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/2641992586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe5689d30 0x55cbe569a680 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/2641992586 >> 172.21.15.12:0/2641992586 conn(0x55cbe55b87e0 msgr2=0x55cbe5691170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/2641992586 shutdown_connections 2023-12-11T20:18:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/2641992586 wait complete. 2023-12-11T20:18:30.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.122+0000 7f1fe4d47b80 1 -- start start 2023-12-11T20:18:30.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fe4d47b80 1 Processor -- start 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 0x55cbe5698050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe5698590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fe4d47b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe5699550 0x55cbe56999d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe5699f10 con 0x55cbe568ac20 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe569a080 con 0x55cbe5699550 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fe4d47b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe569a240 con 0x55cbe56893d0 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fe4d47b80 10 client.0 _ll_register_callbacks cb 0x55cbe54c2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fca7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe5698590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fcaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 0x55cbe5698050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.123+0000 7f1fca7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe5698590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48318/0 (socket says 172.21.15.12:48318) 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fca7fc700 1 -- 172.21.15.12:0/1342962864 learned_addr learned my addr 172.21.15.12:0/1342962864 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fcb7fe700 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe5699550 0x55cbe56999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fca7fc700 1 -- 172.21.15.12:0/1342962864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 msgr2=0x55cbe5698050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 0x55cbe5698050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fca7fc700 1 -- 172.21.15.12:0/1342962864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe5699550 msgr2=0x55cbe56999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe5699550 0x55cbe56999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fca7fc700 1 -- 172.21.15.12:0/1342962864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cbe5406de0 con 0x55cbe568ac20 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fca7fc700 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe5698590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1fc003e000 tx=0x7f1fc0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6334ecf3c28ec6e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1faeff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1faeff5700 1 -- 172.21.15.12:0/1342962864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc003f070 con 0x55cbe568ac20 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/1342962864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fbc004cc0 con 0x55cbe568ac20 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.124+0000 7f1faeff5700 1 -- 172.21.15.12:0/1342962864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1fc003aaf0 con 0x55cbe568ac20 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1faeff5700 1 -- 172.21.15.12:0/1342962864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fc000f520 con 0x55cbe568ac20 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1fe4d47b80 10 client.16215 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/1342962864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55cbe542d250 con 0x55cbe568ac20 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1faeff5700 1 -- 172.21.15.12:0/1342962864 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fc0053080 con 0x55cbe568ac20 2023-12-11T20:18:30.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1faeff5700 1 -- 172.21.15.12:0/1342962864 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1fc0003b70 con 0x55cbe568ac20 2023-12-11T20:18:30.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1fe4d47b80 10 client.16215 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:30.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1fe4d47b80 10 client.16215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:18:30.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1fe4d47b80 20 client.16215 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:30.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55cbe56f5fb0 0x55cbe56f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1fe4d47b80 4 client.16215 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:18:30.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.125+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/1342962864 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cbe55a3fd0 con 0x55cbe56f5fb0 2023-12-11T20:18:30.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.126+0000 7f1fcaffd700 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55cbe56f5fb0 0x55cbe56f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fcaffd700 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55cbe56f5fb0 0x55cbe56f83d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94a6b5fdc753f972 server_cookie=42341f47cf13ebac in_seq=0 out_seq=0 2023-12-11T20:18:30.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1faeff5700 10 client.16215 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:18:30.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1faeff5700 1 -- 172.21.15.12:0/1342962864 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cbe55a3fd0 con 0x55cbe56f5fb0 2023-12-11T20:18:30.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1faeff5700 10 client.16215 handle_command_reply: tid=0 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 client.16215 shutdown 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/1342962864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 msgr2=0x55cbe5698590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe5698590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1fc003e000 tx=0x7f1fc0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/1342962864 shutdown_connections 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55cbe56f5fb0 0x55cbe56f83d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cbe5699550 0x55cbe56999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cbe56893d0 0x55cbe5698050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1faeff5700 0 client.16215 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 --2- 172.21.15.12:0/1342962864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cbe568ac20 0x55cbe5698590 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/1342962864 >> 172.21.15.12:0/1342962864 conn(0x55cbe55b87e0 msgr2=0x55cbe5685970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/1342962864 shutdown_connections 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.127+0000 7f1fe4d47b80 1 -- 172.21.15.12:0/1342962864 wait complete. 2023-12-11T20:18:30.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fe4d47b80 20 client.16215 trim_cache size 0 max 16384 2023-12-11T20:18:30.130 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:18:30.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fb40a1480 msgr2=0x7f1fb40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fb40a1480 0x7f1fb40a3940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0003780 tx=0x7f1fc0009f90 comp rx=0 tx=0).stop 2023-12-11T20:18:30.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc103040 msgr2=0x7f1fcc1a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc103040 0x7f1fcc1a0a20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4007ee0 tx=0x7f1fc400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2268263322 shutdown_connections 2023-12-11T20:18:30.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fb40a1480 0x7f1fb40a3940 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fcc1014b0 0x7f1fcc1994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fcc103040 0x7f1fcc1a0a20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 --2- 172.21.15.12:0/2268263322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fcc1026a0 0x7f1fcc199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.128+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2268263322 >> 172.21.15.12:0/2268263322 conn(0x7f1fcc0fca00 msgr2=0x7f1fcc073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.129+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2268263322 shutdown_connections 2023-12-11T20:18:30.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.129+0000 7f1fd13ff700 1 -- 172.21.15.12:0/2268263322 wait complete. 2023-12-11T20:18:30.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:18:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 -- 172.21.15.12:0/1320284623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 msgr2=0x7f0bc410fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/1320284623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 0x7f0bc410fe70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009f90 tx=0x7f0bbc00b330 comp rx=0 tx=0).stop 2023-12-11T20:18:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 -- 172.21.15.12:0/1320284623 shutdown_connections 2023-12-11T20:18:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/1320284623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 0x7f0bc410fe70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/1320284623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc4075610 0x7f0bc4073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/1320284623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc4074030 0x7f0bc40744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 -- 172.21.15.12:0/1320284623 >> 172.21.15.12:0/1320284623 conn(0x7f0bc40fca00 msgr2=0x7f0bc40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 -- 172.21.15.12:0/1320284623 shutdown_connections 2023-12-11T20:18:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.477+0000 7f0bc91ff700 1 -- 172.21.15.12:0/1320284623 wait complete. 2023-12-11T20:18:30.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.478+0000 7f0bc91ff700 1 Processor -- start 2023-12-11T20:18:30.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.478+0000 7f0bc91ff700 1 -- start start 2023-12-11T20:18:30.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc91ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc4074030 0x7f0bc419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc91ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc4075610 0x7f0bc419dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc91ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 0x7f0bc41a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc91ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc41a55a0 con 0x7f0bc410da80 2023-12-11T20:18:30.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc91ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc41a56e0 con 0x7f0bc4075610 2023-12-11T20:18:30.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc91ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc41a5870 con 0x7f0bc4074030 2023-12-11T20:18:30.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc2d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc4074030 0x7f0bc419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 0x7f0bc41a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc2d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc4074030 0x7f0bc419da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40162/0 (socket says 172.21.15.12:40162) 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc2d9d700 1 -- 172.21.15.12:0/3092059350 learned_addr learned my addr 172.21.15.12:0/3092059350 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.479+0000 7f0bc259c700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc4075610 0x7f0bc419dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc2d9d700 1 -- 172.21.15.12:0/3092059350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc4075610 msgr2=0x7f0bc419dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc4075610 0x7f0bc419dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc2d9d700 1 -- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 msgr2=0x7f0bc41a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 0x7f0bc41a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc2d9d700 1 -- 172.21.15.12:0/3092059350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80095f0 con 0x7f0bc4074030 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc359e700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 0x7f0bc41a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc4074030 0x7f0bc419da70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400e9a0 tx=0x7f0bb400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0babfff700 1 -- 172.21.15.12:0/3092059350 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4009790 con 0x7f0bc4074030 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc91ff700 1 -- 172.21.15.12:0/3092059350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc009c40 con 0x7f0bc4074030 2023-12-11T20:18:30.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0babfff700 1 -- 172.21.15.12:0/3092059350 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bb4010430 con 0x7f0bc4074030 2023-12-11T20:18:30.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0babfff700 1 -- 172.21.15.12:0/3092059350 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400cea0 con 0x7f0bc4074030 2023-12-11T20:18:30.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.480+0000 7f0bc91ff700 1 -- 172.21.15.12:0/3092059350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc41a5ed0 con 0x7f0bc4074030 2023-12-11T20:18:30.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.484+0000 7f0babfff700 1 -- 172.21.15.12:0/3092059350 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0bb40105a0 con 0x7f0bc4074030 2023-12-11T20:18:30.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0bdcaceb80 1 Processor -- start 2023-12-11T20:18:30.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0bdcaceb80 1 -- start start 2023-12-11T20:18:30.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0babfff700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bac0a1480 0x7f0bac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e0467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e047640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 0x56184e0480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184dfa1b50 con 0x56184e0463d0 2023-12-11T20:18:30.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184df9f470 con 0x56184e046d30 2023-12-11T20:18:30.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.486+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184df9ad60 con 0x56184e047c20 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0babfff700 1 -- 172.21.15.12:0/3092059350 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bb4014070 con 0x7f0bc4074030 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc359e700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bac0a1480 0x7f0bac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e047640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e047640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41608/0 (socket says 172.21.15.12:41608) 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc259c700 1 -- 172.21.15.12:0/1807678442 learned_addr learned my addr 172.21.15.12:0/1807678442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e0467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc259c700 1 -- 172.21.15.12:0/1807678442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 msgr2=0x56184e0480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc259c700 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 0x56184e0480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc259c700 1 -- 172.21.15.12:0/1807678442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 msgr2=0x56184e0467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc259c700 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e0467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc259c700 1 -- 172.21.15.12:0/1807678442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56184de17630 con 0x56184e046d30 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.487+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e0467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.488+0000 7f0bc359e700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bac0a1480 0x7f0bac0a3940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009c10 tx=0x7f0bbc009ac0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.488+0000 7f0bc259c700 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e047640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009fa0 tx=0x7f0bb8011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c005d3cb7d136f22 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.488+0000 7f0ba97fa700 1 -- 172.21.15.12:0/1807678442 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8004a30 con 0x56184e046d30 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.488+0000 7f0ba97fa700 1 -- 172.21.15.12:0/1807678442 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bb80054b0 con 0x56184e046d30 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.488+0000 7f0ba97fa700 1 -- 172.21.15.12:0/1807678442 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8019790 con 0x56184e046d30 2023-12-11T20:18:30.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.489+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1807678442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 msgr2=0x56184e047640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.489+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e047640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009fa0 tx=0x7f0bb8011720 comp rx=0 tx=0).stop 2023-12-11T20:18:30.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.489+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1807678442 shutdown_connections 2023-12-11T20:18:30.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.489+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 0x56184e0480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.489+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e0467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.489+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1807678442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e047640 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.489+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1807678442 >> 172.21.15.12:0/1807678442 conn(0x56184df757e0 msgr2=0x56184e042d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.490+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1807678442 shutdown_connections 2023-12-11T20:18:30.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.490+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1807678442 wait complete. 2023-12-11T20:18:30.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.491+0000 7f0bdcaceb80 1 -- start start 2023-12-11T20:18:30.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.492+0000 7f0bdcaceb80 1 Processor -- start 2023-12-11T20:18:30.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.492+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 0x56184e050170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.492+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e0506b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.492+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e0576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.492+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184df54560 con 0x56184e047c20 2023-12-11T20:18:30.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.492+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184df54200 con 0x56184e046d30 2023-12-11T20:18:30.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.492+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184de19920 con 0x56184e0463d0 2023-12-11T20:18:30.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.492+0000 7f0bdcaceb80 10 client.0 _ll_register_callbacks cb 0x56184de7fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e0576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e0506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e0576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48358/0 (socket says 172.21.15.12:48358) 2023-12-11T20:18:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc359e700 1 -- 172.21.15.12:0/699241546 learned_addr learned my addr 172.21.15.12:0/699241546 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 0x56184e050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc359e700 1 -- 172.21.15.12:0/699241546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 msgr2=0x56184e050170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc359e700 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 0x56184e050170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc359e700 1 -- 172.21.15.12:0/699241546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 msgr2=0x56184e0506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc359e700 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e0506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc359e700 1 -- 172.21.15.12:0/699241546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc41a5ed0 con 0x56184e047c20 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.493+0000 7f0bc259c700 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e0506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.494+0000 7f0bc359e700 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e0576f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc015000 tx=0x7f0bbc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4e300bef326602 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.494+0000 7f0ba6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.494+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/699241546 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00e040 con 0x56184e047c20 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.494+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/699241546 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bbc023040 con 0x56184e047c20 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.494+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/699241546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56184e039b40 con 0x56184e047c20 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.494+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/699241546 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bbc028890 con 0x56184e047c20 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.494+0000 7f0bdcaceb80 10 client.16227 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:30.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.494+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/699241546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f0bb8009bd0 con 0x56184e047c20 2023-12-11T20:18:30.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.495+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/699241546 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56184e039b40 con 0x56184e047c20 2023-12-11T20:18:30.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.495+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/699241546 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0bbc01da00 con 0x56184e047c20 2023-12-11T20:18:30.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.495+0000 7f0bdcaceb80 10 client.16227 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:30.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.495+0000 7f0bdcaceb80 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:30.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.495+0000 7f0bdcaceb80 20 client.16227 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:30.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.495+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56184e05bf50 0x56184e05e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.495+0000 7f0bdcaceb80 4 client.16227 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:30.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.495+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/699241546 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56184e015f40 con 0x56184e05bf50 2023-12-11T20:18:30.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.496+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56184e05bf50 0x56184e05e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.497+0000 7f0ba6ff5700 10 client.16227 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:30.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.497+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56184e05bf50 0x56184e05e370 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=464f2a6fd59aa172 server_cookie=48aa85eac3d3066b in_seq=0 out_seq=0 2023-12-11T20:18:30.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.497+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/699241546 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56184e015f40 con 0x56184e05bf50 2023-12-11T20:18:30.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.497+0000 7f0ba6ff5700 10 client.16227 handle_command_reply: tid=0 2023-12-11T20:18:30.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.497+0000 7f0bdcaceb80 1 client.16227 shutdown 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/699241546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 msgr2=0x56184e0576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e0576f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc015000 tx=0x7f0bbc009920 comp rx=0 tx=0).stop 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/699241546 shutdown_connections 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56184e05bf50 0x56184e05e370 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e0576f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 0x56184e050170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/699241546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e0506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/699241546 >> 172.21.15.12:0/699241546 conn(0x56184df757e0 msgr2=0x56184e041a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0ba6ff5700 0 client.16227 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/699241546 shutdown_connections 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/699241546 wait complete. 2023-12-11T20:18:30.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.498+0000 7f0bdcaceb80 20 client.16227 trim_cache size 0 max 16384 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.516+0000 7f0bdcaceb80 1 Processor -- start 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.516+0000 7f0bdcaceb80 1 -- start start 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.516+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e048000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.516+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e057610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.516+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 0x56184e04ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.516+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184e03db50 con 0x56184e0463d0 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.516+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184e051360 con 0x56184e046d30 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.516+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184e045f70 con 0x56184e047c20 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e048000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e048000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48368/0 (socket says 172.21.15.12:48368) 2023-12-11T20:18:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 -- 172.21.15.12:0/2461601470 learned_addr learned my addr 172.21.15.12:0/2461601470 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc359e700 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 0x56184e04ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc259c700 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e057610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 -- 172.21.15.12:0/2461601470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 msgr2=0x56184e04ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 0x56184e04ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 -- 172.21.15.12:0/2461601470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 msgr2=0x56184e057610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e057610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 -- 172.21.15.12:0/2461601470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56184ddc3de0 con 0x56184e0463d0 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc359e700 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 0x56184e04ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.517+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e048000 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0bb409a170 tx=0x7f0bb40cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17673b64173bb090 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.518+0000 7f0ba9ffb700 1 -- 172.21.15.12:0/2461601470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb409a960 con 0x56184e0463d0 2023-12-11T20:18:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.518+0000 7f0ba9ffb700 1 -- 172.21.15.12:0/2461601470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bb409a1e0 con 0x56184e0463d0 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.518+0000 7f0ba9ffb700 1 -- 172.21.15.12:0/2461601470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb409a680 con 0x56184e0463d0 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.518+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/2461601470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 msgr2=0x56184e048000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.518+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e048000 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0bb409a170 tx=0x7f0bb40cc040 comp rx=0 tx=0).stop 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/2461601470 shutdown_connections 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e047c20 0x56184e04ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e0463d0 0x56184e048000 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/2461601470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e057610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/2461601470 >> 172.21.15.12:0/2461601470 conn(0x56184df757e0 msgr2=0x56184e04e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/2461601470 shutdown_connections 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/2461601470 wait complete. 2023-12-11T20:18:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 -- start start 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.519+0000 7f0bdcaceb80 1 Processor -- start 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 0x56184e053120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e053660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bdcaceb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e056680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184e056bc0 con 0x56184e047c20 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184e056d30 con 0x56184e046d30 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bdcaceb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184e056ef0 con 0x56184e0463d0 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bdcaceb80 10 client.0 _ll_register_callbacks cb 0x56184de7fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bc359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e056680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bc359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e056680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48378/0 (socket says 172.21.15.12:48378) 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.520+0000 7f0bc359e700 1 -- 172.21.15.12:0/1118919701 learned_addr learned my addr 172.21.15.12:0/1118919701 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 0x56184e053120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bc259c700 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e053660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bc359e700 1 -- 172.21.15.12:0/1118919701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 msgr2=0x56184e053120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bc359e700 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 0x56184e053120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bc359e700 1 -- 172.21.15.12:0/1118919701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 msgr2=0x56184e053660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bc359e700 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e053660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bc359e700 1 -- 172.21.15.12:0/1118919701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc009c40 con 0x56184e047c20 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bc359e700 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e056680 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009fd0 tx=0x7f0bbc01d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc086394a56f9b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0ba6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/1118919701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00e040 con 0x56184e047c20 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1118919701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bb80054b0 con 0x56184e047c20 2023-12-11T20:18:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.521+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/1118919701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bbc023030 con 0x56184e047c20 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/1118919701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bbc01dbc0 con 0x56184e047c20 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0bdcaceb80 10 client.16233 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1118919701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56184ddacc60 con 0x56184e047c20 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/1118919701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bbc04c080 con 0x56184e047c20 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/1118919701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0bbc028720 con 0x56184e047c20 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0bdcaceb80 10 client.16233 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0bdcaceb80 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0bdcaceb80 20 client.16233 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56184e0b2c10 0x56184e0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0bdcaceb80 4 client.16233 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.522+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1118919701 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56184df60fd0 con 0x56184e0b2c10 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.523+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56184e0b2c10 0x56184e0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.523+0000 7f0bc2d9d700 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56184e0b2c10 0x56184e0b5030 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8ef5fe853482b89 server_cookie=4d7e15d36b9edfb9 in_seq=0 out_seq=0 2023-12-11T20:18:30.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.523+0000 7f0ba6ff5700 10 client.16233 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.523+0000 7f0ba6ff5700 1 -- 172.21.15.12:0/1118919701 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56184df60fd0 con 0x56184e0b2c10 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.523+0000 7f0ba6ff5700 10 client.16233 handle_command_reply: tid=0 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.523+0000 7f0bdcaceb80 1 client.16233 shutdown 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1118919701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 msgr2=0x56184e056680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e056680 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009fd0 tx=0x7f0bbc01d6e0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1118919701 shutdown_connections 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56184e0b2c10 0x56184e0b5030 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56184e047c20 0x56184e056680 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56184e0463d0 0x56184e053120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0ba6ff5700 0 client.16233 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 --2- 172.21.15.12:0/1118919701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56184e046d30 0x56184e053660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1118919701 >> 172.21.15.12:0/1118919701 conn(0x56184df757e0 msgr2=0x56184e042970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1118919701 shutdown_connections 2023-12-11T20:18:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 1 -- 172.21.15.12:0/1118919701 wait complete. 2023-12-11T20:18:30.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.524+0000 7f0bdcaceb80 20 client.16233 trim_cache size 0 max 16384 2023-12-11T20:18:30.527 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:18:30.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 -- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bac0a1480 msgr2=0x7f0bac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bac0a1480 0x7f0bac0a3940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009c10 tx=0x7f0bbc009ac0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 -- 172.21.15.12:0/3092059350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc4074030 msgr2=0x7f0bc419da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc4074030 0x7f0bc419da70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400e9a0 tx=0x7f0bb400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 -- 172.21.15.12:0/3092059350 shutdown_connections 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bac0a1480 0x7f0bac0a3940 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc410da80 0x7f0bc41a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc4074030 0x7f0bc419da70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 --2- 172.21.15.12:0/3092059350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bc4075610 0x7f0bc419dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 -- 172.21.15.12:0/3092059350 >> 172.21.15.12:0/3092059350 conn(0x7f0bc40fca00 msgr2=0x7f0bc4100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 -- 172.21.15.12:0/3092059350 shutdown_connections 2023-12-11T20:18:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:30.525+0000 7f0bc91ff700 1 -- 172.21.15.12:0/3092059350 wait complete. 2023-12-11T20:18:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:30 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1343441261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:18:30.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:30 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1343441261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:18:30.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:30 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1343441261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:18:31.546 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:18:31.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:18:31.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:31 smithi012 ceph-mon[128787]: pgmap v453: 97 pgs: 97 active+clean; 1.0 GiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:18:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:31 smithi032 ceph-mon[132488]: pgmap v453: 97 pgs: 97 active+clean; 1.0 GiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:18:31.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 -- 172.21.15.12:0/2308445374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 msgr2=0x7f7284101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 --2- 172.21.15.12:0/2308445374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 0x7f7284101710 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f72740099c0 tx=0x7f7274009cd0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 -- 172.21.15.12:0/2308445374 shutdown_connections 2023-12-11T20:18:31.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 --2- 172.21.15.12:0/2308445374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7284102e80 0x7f7284109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 --2- 172.21.15.12:0/2308445374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 0x7f7284101710 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 --2- 172.21.15.12:0/2308445374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72841024e0 0x7f7284102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 -- 172.21.15.12:0/2308445374 >> 172.21.15.12:0/2308445374 conn(0x7f72840fc860 msgr2=0x7f72840feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:31.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 -- 172.21.15.12:0/2308445374 shutdown_connections 2023-12-11T20:18:31.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.772+0000 7f728359e700 1 -- 172.21.15.12:0/2308445374 wait complete. 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.773+0000 7f728359e700 1 Processor -- start 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728359e700 1 -- start start 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 0x7f7284075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72841024e0 0x7f72840739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7284102e80 0x7f7284073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72840746a0 con 0x7f72841012f0 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728359e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7284074810 con 0x7f7284102e80 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72841a10f0 con 0x7f72841024e0 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 0x7f7284075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 0x7f7284075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48398/0 (socket says 172.21.15.12:48398) 2023-12-11T20:18:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f728259c700 1 -- 172.21.15.12:0/599675011 learned_addr learned my addr 172.21.15.12:0/599675011 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.774+0000 7f7281d9b700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72841024e0 0x7f72840739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f7282d9d700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7284102e80 0x7f7284073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f728259c700 1 -- 172.21.15.12:0/599675011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72841024e0 msgr2=0x7f72840739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f728259c700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72841024e0 0x7f72840739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f728259c700 1 -- 172.21.15.12:0/599675011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7284102e80 msgr2=0x7f7284073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f728259c700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7284102e80 0x7f7284073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f728259c700 1 -- 172.21.15.12:0/599675011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740095f0 con 0x7f72841012f0 2023-12-11T20:18:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f728259c700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 0x7f7284075330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7274006010 tx=0x7f727400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:31.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f72737fe700 1 -- 172.21.15.12:0/599675011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727401d070 con 0x7f72841012f0 2023-12-11T20:18:31.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f728359e700 1 -- 172.21.15.12:0/599675011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72841a1320 con 0x7f72841012f0 2023-12-11T20:18:31.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f72737fe700 1 -- 172.21.15.12:0/599675011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72740054e0 con 0x7f72841012f0 2023-12-11T20:18:31.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.775+0000 7f72737fe700 1 -- 172.21.15.12:0/599675011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274004bf0 con 0x7f72841012f0 2023-12-11T20:18:31.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.776+0000 7f728359e700 1 -- 172.21.15.12:0/599675011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72841a1740 con 0x7f72841012f0 2023-12-11T20:18:31.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.779+0000 7f72737fe700 1 -- 172.21.15.12:0/599675011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7274004d50 con 0x7f72841012f0 2023-12-11T20:18:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.781+0000 7f72737fe700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f726c0a15a0 0x7f726c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.781+0000 7f729c76cb80 1 Processor -- start 2023-12-11T20:18:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.781+0000 7f72737fe700 1 -- 172.21.15.12:0/599675011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f72740cd9f0 con 0x7f72841012f0 2023-12-11T20:18:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.781+0000 7f729c76cb80 1 -- start start 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.781+0000 7f7281d9b700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f726c0a15a0 0x7f726c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5e9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f729c76cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb543bd0 con 0x55f4fb5e9e60 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f729c76cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb5414f0 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f729c76cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb53cde0 con 0x55f4fb5e9440 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f7282d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f7282d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5ea2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48400/0 (socket says 172.21.15.12:48400) 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f7282d9d700 1 -- 172.21.15.12:0/549279890 learned_addr learned my addr 172.21.15.12:0/549279890 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f7281d9b700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f726c0a15a0 0x7f726c0a3a60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7278009c60 tx=0x7f7278009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f728259c700 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f7281d9b700 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.782+0000 7f7282d9d700 1 -- 172.21.15.12:0/549279890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 msgr2=0x55f4fb5e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:31.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7282d9d700 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7282d9d700 1 -- 172.21.15.12:0/549279890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e8ae0 msgr2=0x55f4fb5e8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:31.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7282d9d700 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5e8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7282d9d700 1 -- 172.21.15.12:0/549279890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4fb3b96b0 con 0x55f4fb5e9e60 2023-12-11T20:18:31.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7281d9b700 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:18:31.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7282d9d700 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5ea2c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f727c009440 tx=0x7f727c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4840371abec3cdde server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:31.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7270ff9700 1 -- 172.21.15.12:0/549279890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c00e070 con 0x55f4fb5e9e60 2023-12-11T20:18:31.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7270ff9700 1 -- 172.21.15.12:0/549279890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f727c00f040 con 0x55f4fb5e9e60 2023-12-11T20:18:31.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.783+0000 7f7270ff9700 1 -- 172.21.15.12:0/549279890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c015a10 con 0x55f4fb5e9e60 2023-12-11T20:18:31.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 -- 172.21.15.12:0/549279890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 msgr2=0x55f4fb5ea2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5ea2c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f727c009440 tx=0x7f727c009920 comp rx=0 tx=0).stop 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 -- 172.21.15.12:0/549279890 shutdown_connections 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5e8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5ea2c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 --2- 172.21.15.12:0/549279890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 -- 172.21.15.12:0/549279890 >> 172.21.15.12:0/549279890 conn(0x55f4fb517860 msgr2=0x55f4fb5e3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 -- 172.21.15.12:0/549279890 shutdown_connections 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.784+0000 7f729c76cb80 1 -- 172.21.15.12:0/549279890 wait complete. 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.785+0000 7f729c76cb80 1 -- start start 2023-12-11T20:18:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.785+0000 7f729c76cb80 1 Processor -- start 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f729c76cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb4f65e0 con 0x55f4fb5e9e60 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f729c76cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb4f6280 con 0x55f4fb5e9440 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f729c76cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb3bb9a0 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f729c76cb80 10 client.0 _ll_register_callbacks cb 0x55f4fb421b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f7282d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f7281d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f7282d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48416/0 (socket says 172.21.15.12:48416) 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f7282d9d700 1 -- 172.21.15.12:0/4215635995 learned_addr learned my addr 172.21.15.12:0/4215635995 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.786+0000 7f728259c700 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7282d9d700 1 -- 172.21.15.12:0/4215635995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e8ae0 msgr2=0x55f4fb5f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7282d9d700 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7282d9d700 1 -- 172.21.15.12:0/4215635995 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 msgr2=0x55f4fb5f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7282d9d700 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7282d9d700 1 -- 172.21.15.12:0/4215635995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0090f0 con 0x55f4fb5e9e60 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7282d9d700 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f98c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f727c014040 tx=0x7f727c016a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42319c528556b1d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7269ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7269ffb700 1 -- 172.21.15.12:0/4215635995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c00e040 con 0x55f4fb5e9e60 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f729c76cb80 1 -- 172.21.15.12:0/4215635995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4fb5dba60 con 0x55f4fb5e9e60 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.787+0000 7f7269ffb700 1 -- 172.21.15.12:0/4215635995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f727c0095e0 con 0x55f4fb5e9e60 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f7269ffb700 1 -- 172.21.15.12:0/4215635995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f727c013750 con 0x55f4fb5e9e60 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f729c76cb80 10 client.16245 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f729c76cb80 1 -- 172.21.15.12:0/4215635995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f4fb365e60 con 0x55f4fb5e9e60 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f7269ffb700 1 -- 172.21.15.12:0/4215635995 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4fb5dba60 con 0x55f4fb5e9e60 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f7269ffb700 1 -- 172.21.15.12:0/4215635995 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f727c01c050 con 0x55f4fb5e9e60 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f729c76cb80 10 client.16245 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f729c76cb80 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f729c76cb80 20 client.16245 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f729c76cb80 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4fb5fe080 0x55f4fb6004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f729c76cb80 4 client.16245 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.788+0000 7f729c76cb80 1 -- 172.21.15.12:0/4215635995 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4fb5b7fc0 con 0x55f4fb5fe080 2023-12-11T20:18:31.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.789+0000 7f728259c700 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4fb5fe080 0x55f4fb6004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.789+0000 7f7269ffb700 10 client.16245 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.789+0000 7f728259c700 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4fb5fe080 0x55f4fb6004a0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48f745599ff829d0 server_cookie=ccb8373b7186cc2e in_seq=0 out_seq=0 2023-12-11T20:18:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.790+0000 7f7269ffb700 1 -- 172.21.15.12:0/4215635995 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f4fb5b7fc0 con 0x55f4fb5fe080 2023-12-11T20:18:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.790+0000 7f7269ffb700 10 client.16245 handle_command_reply: tid=0 2023-12-11T20:18:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.790+0000 7f729c76cb80 1 client.16245 shutdown 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 -- 172.21.15.12:0/4215635995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 msgr2=0x55f4fb5f98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f98c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f727c014040 tx=0x7f727c016a80 comp rx=0 tx=0).stop 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 -- 172.21.15.12:0/4215635995 shutdown_connections 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4fb5fe080 0x55f4fb6004a0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f98c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 --2- 172.21.15.12:0/4215635995 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 -- 172.21.15.12:0/4215635995 >> 172.21.15.12:0/4215635995 conn(0x55f4fb517860 msgr2=0x55f4fb5e78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f7269ffb700 0 client.16245 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 -- 172.21.15.12:0/4215635995 shutdown_connections 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 1 -- 172.21.15.12:0/4215635995 wait complete. 2023-12-11T20:18:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.791+0000 7f729c76cb80 20 client.16245 trim_cache size 0 max 16384 2023-12-11T20:18:31.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:31 smithi039 ceph-mon[102205]: pgmap v453: 97 pgs: 97 active+clean; 1.0 GiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:18:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.812+0000 7f729c76cb80 1 Processor -- start 2023-12-11T20:18:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f729c76cb80 1 -- start start 2023-12-11T20:18:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb604de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f729c76cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb5dba90 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f729c76cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb5df930 con 0x55f4fb5e9440 2023-12-11T20:18:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f729c76cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb5faa40 con 0x55f4fb5e9e60 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f728259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb604de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f728259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb604de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48422/0 (socket says 172.21.15.12:48422) 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f728259c700 1 -- 172.21.15.12:0/2082451898 learned_addr learned my addr 172.21.15.12:0/2082451898 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f7282d9d700 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.813+0000 7f7281d9b700 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f728259c700 1 -- 172.21.15.12:0/2082451898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9e60 msgr2=0x55f4fb5f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f728259c700 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f728259c700 1 -- 172.21.15.12:0/2082451898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 msgr2=0x55f4fb5f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f728259c700 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f728259c700 1 -- 172.21.15.12:0/2082451898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4fb34ece0 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f7282d9d700 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f728259c700 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb604de0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7274097760 tx=0x7f7274005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d19f66732a93c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f72717fa700 1 -- 172.21.15.12:0/2082451898 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727409acf0 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f72717fa700 1 -- 172.21.15.12:0/2082451898 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f727409ee40 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.814+0000 7f72717fa700 1 -- 172.21.15.12:0/2082451898 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727409b1b0 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 -- 172.21.15.12:0/2082451898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 msgr2=0x55f4fb604de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb604de0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7274097760 tx=0x7f7274005960 comp rx=0 tx=0).stop 2023-12-11T20:18:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 -- 172.21.15.12:0/2082451898 shutdown_connections 2023-12-11T20:18:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb604de0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 --2- 172.21.15.12:0/2082451898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 -- 172.21.15.12:0/2082451898 >> 172.21.15.12:0/2082451898 conn(0x55f4fb517860 msgr2=0x55f4fb5f0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 -- 172.21.15.12:0/2082451898 shutdown_connections 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.815+0000 7f729c76cb80 1 -- 172.21.15.12:0/2082451898 wait complete. 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.816+0000 7f729c76cb80 1 -- start start 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.816+0000 7f729c76cb80 1 Processor -- start 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f729c76cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f729c76cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb654590 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f729c76cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb6546d0 con 0x55f4fb5e9e60 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f729c76cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fb654890 con 0x55f4fb5e9440 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f729c76cb80 10 client.0 _ll_register_callbacks cb 0x55f4fb421b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f728259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f728259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48430/0 (socket says 172.21.15.12:48430) 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f728259c700 1 -- 172.21.15.12:0/1691992175 learned_addr learned my addr 172.21.15.12:0/1691992175 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f7281d9b700 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f7282d9d700 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f728259c700 1 -- 172.21.15.12:0/1691992175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 msgr2=0x55f4fb5f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f728259c700 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f728259c700 1 -- 172.21.15.12:0/1691992175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9e60 msgr2=0x55f4fb5f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.817+0000 7f728259c700 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f728259c700 1 -- 172.21.15.12:0/1691992175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72740ba040 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f728259c700 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f8150 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f727409b430 tx=0x7f727409ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c049674f27a3fb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f7269ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f7269ffb700 1 -- 172.21.15.12:0/1691992175 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727409a3e0 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f7269ffb700 1 -- 172.21.15.12:0/1691992175 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f727409acf0 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f729c76cb80 1 -- 172.21.15.12:0/1691992175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f727c00f040 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f7269ffb700 1 -- 172.21.15.12:0/1691992175 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f727409af50 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f729c76cb80 10 client.16251 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.818+0000 7f729c76cb80 1 -- 172.21.15.12:0/1691992175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f4fb38c2d0 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f7269ffb700 1 -- 172.21.15.12:0/1691992175 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f727c00f040 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f7269ffb700 1 -- 172.21.15.12:0/1691992175 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f727409fc80 con 0x55f4fb5e8ae0 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f729c76cb80 10 client.16251 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f729c76cb80 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f729c76cb80 20 client.16251 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f729c76cb80 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4fb655db0 0x55f4fb6581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f729c76cb80 4 client.16251 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f729c76cb80 1 -- 172.21.15.12:0/1691992175 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f4fb503050 con 0x55f4fb655db0 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.819+0000 7f7281d9b700 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4fb655db0 0x55f4fb6581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.820+0000 7f7269ffb700 10 client.16251 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.820+0000 7f7281d9b700 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4fb655db0 0x55f4fb6581d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=112ecebdeb535033 server_cookie=171198eeac58db67 in_seq=0 out_seq=0 2023-12-11T20:18:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.821+0000 7f7269ffb700 1 -- 172.21.15.12:0/1691992175 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f4fb503050 con 0x55f4fb655db0 2023-12-11T20:18:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.821+0000 7f7269ffb700 10 client.16251 handle_command_reply: tid=0 2023-12-11T20:18:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.821+0000 7f729c76cb80 1 client.16251 shutdown 2023-12-11T20:18:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 -- 172.21.15.12:0/1691992175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 msgr2=0x55f4fb5f8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f8150 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f727409b430 tx=0x7f727409ab60 comp rx=0 tx=0).stop 2023-12-11T20:18:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 -- 172.21.15.12:0/1691992175 shutdown_connections 2023-12-11T20:18:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4fb655db0 0x55f4fb6581d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4fb5e9e60 0x55f4fb5f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4fb5e8ae0 0x55f4fb5f8150 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f7269ffb700 0 client.16251 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 --2- 172.21.15.12:0/1691992175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4fb5e9440 0x55f4fb5f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 -- 172.21.15.12:0/1691992175 >> 172.21.15.12:0/1691992175 conn(0x55f4fb517860 msgr2=0x55f4fb604de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 -- 172.21.15.12:0/1691992175 shutdown_connections 2023-12-11T20:18:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 1 -- 172.21.15.12:0/1691992175 wait complete. 2023-12-11T20:18:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.822+0000 7f729c76cb80 20 client.16251 trim_cache size 0 max 16384 2023-12-11T20:18:31.828 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:18:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:18:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "2f411431-7689-4891-87b6-50f1c8aa82aa", 2023-12-11T20:18:31.829 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:18:31.829 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:18:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 -- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f726c0a15a0 msgr2=0x7f726c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f726c0a15a0 0x7f726c0a3a60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7278009c60 tx=0x7f7278009260 comp rx=0 tx=0).stop 2023-12-11T20:18:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 -- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 msgr2=0x7f7284075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 0x7f7284075330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7274006010 tx=0x7f727400f690 comp rx=0 tx=0).stop 2023-12-11T20:18:31.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 -- 172.21.15.12:0/599675011 shutdown_connections 2023-12-11T20:18:31.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f726c0a15a0 0x7f726c0a3a60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7284102e80 0x7f7284073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72841012f0 0x7f7284075330 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 --2- 172.21.15.12:0/599675011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f72841024e0 0x7f72840739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:31.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 -- 172.21.15.12:0/599675011 >> 172.21.15.12:0/599675011 conn(0x7f72840fc860 msgr2=0x7f72841058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 -- 172.21.15.12:0/599675011 shutdown_connections 2023-12-11T20:18:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:31.823+0000 7f728359e700 1 -- 172.21.15.12:0/599675011 wait complete. 2023-12-11T20:18:31.843 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:18:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.066+0000 7ff1819ff700 1 -- 172.21.15.12:0/4057760945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 msgr2=0x7ff17c104380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.066+0000 7ff1819ff700 1 --2- 172.21.15.12:0/4057760945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 0x7ff17c104380 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009990 tx=0x7ff16c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.066+0000 7ff1819ff700 1 -- 172.21.15.12:0/4057760945 shutdown_connections 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.066+0000 7ff1819ff700 1 --2- 172.21.15.12:0/4057760945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff17c1071f0 0x7ff17c109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.066+0000 7ff1819ff700 1 --2- 172.21.15.12:0/4057760945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 0x7ff17c104380 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.066+0000 7ff1819ff700 1 --2- 172.21.15.12:0/4057760945 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff17c1048c0 0x7ff17c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.066+0000 7ff1819ff700 1 -- 172.21.15.12:0/4057760945 >> 172.21.15.12:0/4057760945 conn(0x7ff17c0fb920 msgr2=0x7ff17c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.066+0000 7ff1819ff700 1 -- 172.21.15.12:0/4057760945 shutdown_connections 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.067+0000 7ff1819ff700 1 -- 172.21.15.12:0/4057760945 wait complete. 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.068+0000 7ff1819ff700 1 Processor -- start 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.068+0000 7ff1819ff700 1 -- start start 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.068+0000 7ff1819ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 0x7ff17c1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.068+0000 7ff1819ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff17c1048c0 0x7ff17c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.068+0000 7ff1819ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff17c1071f0 0x7ff17c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.068+0000 7ff1819ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c19ee80 con 0x7ff17c101f90 2023-12-11T20:18:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.068+0000 7ff1819ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c19efc0 con 0x7ff17c1048c0 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.068+0000 7ff1819ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c19f150 con 0x7ff17c1071f0 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 0x7ff17c1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 0x7ff17c1973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48458/0 (socket says 172.21.15.12:48458) 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17affd700 1 -- 172.21.15.12:0/316672981 learned_addr learned my addr 172.21.15.12:0/316672981 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff17c1048c0 0x7ff17c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17b7fe700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff17c1071f0 0x7ff17c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17affd700 1 -- 172.21.15.12:0/316672981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff17c1071f0 msgr2=0x7ff17c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17affd700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff17c1071f0 0x7ff17c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17affd700 1 -- 172.21.15.12:0/316672981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff17c1048c0 msgr2=0x7ff17c1978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17affd700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff17c1048c0 0x7ff17c1978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17affd700 1 -- 172.21.15.12:0/316672981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c0095f0 con 0x7ff17c101f90 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.069+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff17c1048c0 0x7ff17c1978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:32.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.070+0000 7ff17affd700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 0x7ff17c1973a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff16c000c00 tx=0x7ff16c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:32.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.070+0000 7ff1809fd700 1 -- 172.21.15.12:0/316672981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c01d070 con 0x7ff17c101f90 2023-12-11T20:18:32.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.070+0000 7ff1809fd700 1 -- 172.21.15.12:0/316672981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff16c003ec0 con 0x7ff17c101f90 2023-12-11T20:18:32.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.070+0000 7ff1819ff700 1 -- 172.21.15.12:0/316672981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c19f3d0 con 0x7ff17c101f90 2023-12-11T20:18:32.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.070+0000 7ff1809fd700 1 -- 172.21.15.12:0/316672981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c022bc0 con 0x7ff17c101f90 2023-12-11T20:18:32.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.070+0000 7ff1819ff700 1 -- 172.21.15.12:0/316672981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c19f7f0 con 0x7ff17c101f90 2023-12-11T20:18:32.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.073+0000 7ff1809fd700 1 -- 172.21.15.12:0/316672981 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff16c003a30 con 0x7ff17c101f90 2023-12-11T20:18:32.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.075+0000 7ff1809fd700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff1640a1480 0x7ff1640a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.075+0000 7ff1809fd700 1 -- 172.21.15.12:0/316672981 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff16c0ce260 con 0x7ff17c101f90 2023-12-11T20:18:32.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.075+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff1640a1480 0x7ff1640a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.075+0000 7ff195284b80 1 Processor -- start 2023-12-11T20:18:32.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.075+0000 7ff195284b80 1 -- start start 2023-12-11T20:18:32.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff195284b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff195284b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c1140 0x55ee517c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff195284b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c2030 0x55ee517c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff195284b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee51717b50 con 0x55ee517c2030 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff195284b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee51715470 con 0x55ee517c1140 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff195284b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee51710d60 con 0x55ee517c07e0 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff1640a1480 0x7ff1640a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff170010420 tx=0x7ff1700073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff17b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c2030 0x55ee517c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff17b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c2030 0x55ee517c24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48466/0 (socket says 172.21.15.12:48466) 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff17b7fe700 1 -- 172.21.15.12:0/1389023969 learned_addr learned my addr 172.21.15.12:0/1389023969 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff17affd700 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.076+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c1140 0x55ee517c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff17b7fe700 1 -- 172.21.15.12:0/1389023969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 msgr2=0x55ee517c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff17b7fe700 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff17b7fe700 1 -- 172.21.15.12:0/1389023969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c1140 msgr2=0x55ee517c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff17b7fe700 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c1140 0x55ee517c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff17b7fe700 1 -- 172.21.15.12:0/1389023969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee5158d630 con 0x55ee517c2030 2023-12-11T20:18:32.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff17b7fe700 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c2030 0x55ee517c24b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff174003fa0 tx=0x7ff174009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8329b1103faab0b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:32.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff161ffb700 1 -- 172.21.15.12:0/1389023969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174019070 con 0x55ee517c2030 2023-12-11T20:18:32.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff161ffb700 1 -- 172.21.15.12:0/1389023969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff17400f040 con 0x55ee517c2030 2023-12-11T20:18:32.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.077+0000 7ff161ffb700 1 -- 172.21.15.12:0/1389023969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174007a50 con 0x55ee517c2030 2023-12-11T20:18:32.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 -- 172.21.15.12:0/1389023969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c2030 msgr2=0x55ee517c24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c2030 0x55ee517c24b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff174003fa0 tx=0x7ff174009ba0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 -- 172.21.15.12:0/1389023969 shutdown_connections 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c2030 0x55ee517c24b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 --2- 172.21.15.12:0/1389023969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c1140 0x55ee517c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 -- 172.21.15.12:0/1389023969 >> 172.21.15.12:0/1389023969 conn(0x55ee516eb7e0 msgr2=0x55ee517b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 -- 172.21.15.12:0/1389023969 shutdown_connections 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.078+0000 7ff195284b80 1 -- 172.21.15.12:0/1389023969 wait complete. 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.079+0000 7ff195284b80 1 -- start start 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.079+0000 7ff195284b80 1 Processor -- start 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.079+0000 7ff195284b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c07e0 0x55ee517ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.079+0000 7ff195284b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c1140 0x55ee517cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff195284b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff195284b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee516ca560 con 0x55ee517c07e0 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff195284b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee516ca200 con 0x55ee517c2030 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff195284b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee5158f920 con 0x55ee517c1140 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff195284b80 10 client.0 _ll_register_callbacks cb 0x55ee515f5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c07e0 0x55ee517ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c07e0 0x55ee517ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48476/0 (socket says 172.21.15.12:48476) 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17affd700 1 -- 172.21.15.12:0/641644520 learned_addr learned my addr 172.21.15.12:0/641644520 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17b7fe700 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c1140 0x55ee517cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17affd700 1 -- 172.21.15.12:0/641644520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c1140 msgr2=0x55ee517cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17affd700 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c1140 0x55ee517cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17affd700 1 -- 172.21.15.12:0/641644520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 msgr2=0x55ee517d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17affd700 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.080+0000 7ff17affd700 1 -- 172.21.15.12:0/641644520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff174003bd0 con 0x55ee517c07e0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff17affd700 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c07e0 0x55ee517ca610 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff16c097a50 tx=0x7ff16c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9087382cfac6d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff15affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff15affd700 1 -- 172.21.15.12:0/641644520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c09b5a0 con 0x55ee517c07e0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff15affd700 1 -- 172.21.15.12:0/641644520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff16c09f6f0 con 0x55ee517c07e0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff195284b80 1 -- 172.21.15.12:0/641644520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee517afb40 con 0x55ee517c07e0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff15affd700 1 -- 172.21.15.12:0/641644520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff16c0a38a0 con 0x55ee517c07e0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff195284b80 10 client.16263 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff195284b80 1 -- 172.21.15.12:0/641644520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ee51539de0 con 0x55ee517c07e0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff15affd700 1 -- 172.21.15.12:0/641644520 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee517afb40 con 0x55ee517c07e0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.081+0000 7ff15affd700 1 -- 172.21.15.12:0/641644520 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff16c084bd0 con 0x55ee517c07e0 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.082+0000 7ff195284b80 10 client.16263 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.082+0000 7ff195284b80 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.082+0000 7ff195284b80 20 client.16263 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.082+0000 7ff195284b80 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee517d6120 0x55ee517d8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.082+0000 7ff195284b80 4 client.16263 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.082+0000 7ff195284b80 1 -- 172.21.15.12:0/641644520 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee5178bf40 con 0x55ee517d6120 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.082+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee517d6120 0x55ee517d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.083+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee517d6120 0x55ee517d8510 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=253d41991c7b3c server_cookie=154e5a05c0b76f3e in_seq=0 out_seq=0 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.083+0000 7ff15affd700 10 client.16263 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff15affd700 1 -- 172.21.15.12:0/641644520 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ee5178bf40 con 0x55ee517d6120 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff15affd700 10 client.16263 handle_command_reply: tid=0 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 client.16263 shutdown 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 -- 172.21.15.12:0/641644520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c07e0 msgr2=0x55ee517ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c07e0 0x55ee517ca610 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff16c097a50 tx=0x7ff16c0042e0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 -- 172.21.15.12:0/641644520 shutdown_connections 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee517d6120 0x55ee517d8510 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff15affd700 0 client.16263 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c07e0 0x55ee517ca610 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 --2- 172.21.15.12:0/641644520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c1140 0x55ee517cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 -- 172.21.15.12:0/641644520 >> 172.21.15.12:0/641644520 conn(0x55ee516eb7e0 msgr2=0x55ee517b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 -- 172.21.15.12:0/641644520 shutdown_connections 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.084+0000 7ff195284b80 1 -- 172.21.15.12:0/641644520 wait complete. 2023-12-11T20:18:32.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.085+0000 7ff195284b80 20 client.16263 trim_cache size 0 max 16384 2023-12-11T20:18:32.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff195284b80 1 Processor -- start 2023-12-11T20:18:32.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff195284b80 1 -- start start 2023-12-11T20:18:32.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff195284b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff195284b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff195284b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517b8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff195284b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee517b3790 con 0x55ee517c1140 2023-12-11T20:18:32.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff195284b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee517ca180 con 0x55ee517c2030 2023-12-11T20:18:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff195284b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee517d5f30 con 0x55ee517c07e0 2023-12-11T20:18:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff17a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff17a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48490/0 (socket says 172.21.15.12:48490) 2023-12-11T20:18:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff17a7fc700 1 -- 172.21.15.12:0/2696214878 learned_addr learned my addr 172.21.15.12:0/2696214878 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.110+0000 7ff17affd700 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17b7fe700 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17affd700 1 -- 172.21.15.12:0/2696214878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 msgr2=0x55ee517b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17affd700 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517b8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17affd700 1 -- 172.21.15.12:0/2696214878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 msgr2=0x55ee517d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17affd700 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17affd700 1 -- 172.21.15.12:0/2696214878 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee51522c60 con 0x55ee517c07e0 2023-12-11T20:18:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17b7fe700 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517b8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff17affd700 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c2410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff16c09b530 tx=0x7ff16c099b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96821fa217cf70c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff1627fc700 1 -- 172.21.15.12:0/2696214878 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c09f6f0 con 0x55ee517c07e0 2023-12-11T20:18:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff1627fc700 1 -- 172.21.15.12:0/2696214878 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff16c09b5a0 con 0x55ee517c07e0 2023-12-11T20:18:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.111+0000 7ff1627fc700 1 -- 172.21.15.12:0/2696214878 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c084bd0 con 0x55ee517c07e0 2023-12-11T20:18:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 -- 172.21.15.12:0/2696214878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 msgr2=0x55ee517c2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c2410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff16c09b530 tx=0x7ff16c099b50 comp rx=0 tx=0).stop 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 -- 172.21.15.12:0/2696214878 shutdown_connections 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517b8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517c2410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 --2- 172.21.15.12:0/2696214878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 -- 172.21.15.12:0/2696214878 >> 172.21.15.12:0/2696214878 conn(0x55ee516eb7e0 msgr2=0x55ee517c8600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 -- 172.21.15.12:0/2696214878 shutdown_connections 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.112+0000 7ff195284b80 1 -- 172.21.15.12:0/2696214878 wait complete. 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.113+0000 7ff195284b80 1 -- start start 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.113+0000 7ff195284b80 1 Processor -- start 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff195284b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff195284b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff195284b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff195284b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee517d00f0 con 0x55ee517c1140 2023-12-11T20:18:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff195284b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee517d0230 con 0x55ee517c2030 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff195284b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee517d03f0 con 0x55ee517c07e0 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff195284b80 10 client.0 _ll_register_callbacks cb 0x55ee515f5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff17a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff17a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48500/0 (socket says 172.21.15.12:48500) 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff17a7fc700 1 -- 172.21.15.12:0/2238062325 learned_addr learned my addr 172.21.15.12:0/2238062325 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff17affd700 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.114+0000 7ff17b7fe700 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff17affd700 1 -- 172.21.15.12:0/2238062325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 msgr2=0x55ee517cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff17affd700 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff17affd700 1 -- 172.21.15.12:0/2238062325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 msgr2=0x55ee517d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff17affd700 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff17affd700 1 -- 172.21.15.12:0/2238062325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff170004370 con 0x55ee517c07e0 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff17affd700 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517d1470 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff16c097320 tx=0x7ff16c00b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d712e91ed8c8c0e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff15affd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:18:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff15affd700 1 -- 172.21.15.12:0/2238062325 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0a38a0 con 0x55ee517c07e0 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff15affd700 1 -- 172.21.15.12:0/2238062325 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff16c09f6f0 con 0x55ee517c07e0 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.115+0000 7ff195284b80 1 -- 172.21.15.12:0/2238062325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff17400f040 con 0x55ee517c07e0 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff15affd700 1 -- 172.21.15.12:0/2238062325 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff16c084bd0 con 0x55ee517c07e0 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff195284b80 10 client.26023 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff195284b80 1 -- 172.21.15.12:0/2238062325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ee51539de0 con 0x55ee517c07e0 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff15affd700 1 -- 172.21.15.12:0/2238062325 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff16c0a7020 con 0x55ee517c07e0 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff15affd700 1 -- 172.21.15.12:0/2238062325 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff16c0b9a10 con 0x55ee517c07e0 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff195284b80 10 client.26023 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff195284b80 10 client.26023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff195284b80 20 client.26023 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff195284b80 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee5182d3f0 0x55ee5182f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff195284b80 4 client.26023 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:18:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.116+0000 7ff195284b80 1 -- 172.21.15.12:0/2238062325 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee516d6fd0 con 0x55ee5182d3f0 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.117+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee5182d3f0 0x55ee5182f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.117+0000 7ff15affd700 10 client.26023 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.117+0000 7ff17a7fc700 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee5182d3f0 0x55ee5182f7e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1835d7358cb0f073 server_cookie=54bcc328166f3f14 in_seq=0 out_seq=0 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff15affd700 1 -- 172.21.15.12:0/2238062325 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ee516d6fd0 con 0x55ee5182d3f0 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff15affd700 10 client.26023 handle_command_reply: tid=0 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 client.26023 shutdown 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 -- 172.21.15.12:0/2238062325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 msgr2=0x55ee517d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517d1470 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff16c097320 tx=0x7ff16c00b560 comp rx=0 tx=0).stop 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 -- 172.21.15.12:0/2238062325 shutdown_connections 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ee5182d3f0 0x55ee5182f7e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ee517c2030 0x55ee517cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ee517c07e0 0x55ee517d1470 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff15affd700 0 client.26023 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 --2- 172.21.15.12:0/2238062325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee517c1140 0x55ee517d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 -- 172.21.15.12:0/2238062325 >> 172.21.15.12:0/2238062325 conn(0x55ee516eb7e0 msgr2=0x55ee517b8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 -- 172.21.15.12:0/2238062325 shutdown_connections 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 1 -- 172.21.15.12:0/2238062325 wait complete. 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.118+0000 7ff195284b80 20 client.26023 trim_cache size 0 max 16384 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stdout: "2f411431-7689-4891-87b6-50f1c8aa82aa": { 2023-12-11T20:18:32.121 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:18:32.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "2f411431-7689-4891-87b6-50f1c8aa82aa", 2023-12-11T20:18:32.122 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:18:32.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:18:32.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:18:32.122 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:18:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 -- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff1640a1480 msgr2=0x7ff1640a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff1640a1480 0x7ff1640a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff170010420 tx=0x7ff1700073d0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 -- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 msgr2=0x7ff17c1973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 0x7ff17c1973a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff16c000c00 tx=0x7ff16c004730 comp rx=0 tx=0).stop 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 -- 172.21.15.12:0/316672981 shutdown_connections 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff1640a1480 0x7ff1640a3940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff17c1071f0 0x7ff17c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff17c101f90 0x7ff17c1973a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 --2- 172.21.15.12:0/316672981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff17c1048c0 0x7ff17c1978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 -- 172.21.15.12:0/316672981 >> 172.21.15.12:0/316672981 conn(0x7ff17c0fb920 msgr2=0x7ff17c103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 -- 172.21.15.12:0/316672981 shutdown_connections 2023-12-11T20:18:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:18:32.119+0000 7ff1819ff700 1 -- 172.21.15.12:0/316672981 wait complete. 2023-12-11T20:18:32.138 INFO:tasks.cephfs.filesystem:scrub status for tag:2f411431-7689-4891-87b6-50f1c8aa82aa - {'path': '/', 'tag': '2f411431-7689-4891-87b6-50f1c8aa82aa', 'options': 'recursive,force'} 2023-12-11T20:18:32.213 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:18:31 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:18:31.833+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v90>,<0x10000000003/client.0 v92>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v109>,<0x10000000001/sv_0 v133>,<0x10000000000/_nogroup v117>,<0x1/volumes v109>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:18:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:32 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:18:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:18:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:18:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:18:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:18:32.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:32 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:18:32.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:32 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:33 smithi032 ceph-mon[132488]: pgmap v454: 97 pgs: 97 active+clean; 1.0 GiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:33 smithi039 ceph-mon[102205]: pgmap v454: 97 pgs: 97 active+clean; 1.0 GiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:18:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:18:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:18:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:18:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:18:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:18:33.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:33 smithi012 ceph-mon[128787]: pgmap v454: 97 pgs: 97 active+clean; 1.0 GiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:18:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 -- 172.21.15.12:0/1166184400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0101310 msgr2=0x7f4ab0101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1166184400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0101310 0x7f4ab0101730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0099c0 tx=0x7f4aac009cd0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 -- 172.21.15.12:0/1166184400 shutdown_connections 2023-12-11T20:18:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1166184400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab0102ea0 0x7f4ab0109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1166184400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0101310 0x7f4ab0101730 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1166184400 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab0102500 0x7f4ab0102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 -- 172.21.15.12:0/1166184400 >> 172.21.15.12:0/1166184400 conn(0x7f4ab00fc8a0 msgr2=0x7f4ab00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 -- 172.21.15.12:0/1166184400 shutdown_connections 2023-12-11T20:18:36.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.247+0000 7f4ab719d700 1 -- 172.21.15.12:0/1166184400 wait complete. 2023-12-11T20:18:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.248+0000 7f4ab719d700 1 Processor -- start 2023-12-11T20:18:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab719d700 1 -- start start 2023-12-11T20:18:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab719d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab0101310 0x7f4ab0199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab719d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0102500 0x7f4ab0199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab719d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab0102ea0 0x7f4ab01a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab719d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab01a0f50 con 0x7f4ab0102500 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab719d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab01a1090 con 0x7f4ab0101310 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab719d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab01a1220 con 0x7f4ab0102ea0 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab599a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0102500 0x7f4ab0199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab599a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0102500 0x7f4ab0199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48512/0 (socket says 172.21.15.12:48512) 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab619b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab0101310 0x7f4ab0199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.249+0000 7f4ab599a700 1 -- 172.21.15.12:0/1026394798 learned_addr learned my addr 172.21.15.12:0/1026394798 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab0102ea0 0x7f4ab01a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab619b700 1 -- 172.21.15.12:0/1026394798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab0102ea0 msgr2=0x7f4ab01a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab0102ea0 0x7f4ab01a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab619b700 1 -- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0102500 msgr2=0x7f4ab0199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0102500 0x7f4ab0199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab619b700 1 -- 172.21.15.12:0/1026394798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0095f0 con 0x7f4ab0101310 2023-12-11T20:18:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab599a700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0102500 0x7f4ab0199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab0102ea0 0x7f4ab01a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab0101310 0x7f4ab0199420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009990 tx=0x7f4aac005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4aa77fe700 1 -- 172.21.15.12:0/1026394798 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac01d070 con 0x7f4ab0101310 2023-12-11T20:18:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.250+0000 7f4ab719d700 1 -- 172.21.15.12:0/1026394798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab01a14a0 con 0x7f4ab0101310 2023-12-11T20:18:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.251+0000 7f4ab719d700 1 -- 172.21.15.12:0/1026394798 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab01a1920 con 0x7f4ab0101310 2023-12-11T20:18:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.251+0000 7f4aa77fe700 1 -- 172.21.15.12:0/1026394798 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4aac00bda0 con 0x7f4ab0101310 2023-12-11T20:18:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.251+0000 7f4aa77fe700 1 -- 172.21.15.12:0/1026394798 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac022d30 con 0x7f4ab0101310 2023-12-11T20:18:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.254+0000 7f4aa77fe700 1 -- 172.21.15.12:0/1026394798 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4aac00f460 con 0x7f4ab0101310 2023-12-11T20:18:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.255+0000 7f4acbdc4b80 1 Processor -- start 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.255+0000 7f4acbdc4b80 1 -- start start 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.255+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea8603b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.255+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea86040d0 0x55cea8608640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.255+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 0x55cea860af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.255+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea855eaf0 con 0x55cea86040d0 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.255+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea855c410 con 0x55cea8603770 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.255+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea8557d00 con 0x55cea8608b80 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea86040d0 0x55cea8608640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab699c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea8603b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab699c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea8603b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41756/0 (socket says 172.21.15.12:41756) 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab699c700 1 -- 172.21.15.12:0/3377029505 learned_addr learned my addr 172.21.15.12:0/3377029505 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab599a700 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 0x55cea860af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab699c700 1 -- 172.21.15.12:0/3377029505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 msgr2=0x55cea860af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab699c700 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 0x55cea860af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab699c700 1 -- 172.21.15.12:0/3377029505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea86040d0 msgr2=0x55cea8608640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4aa77fe700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a9c0a14f0 0x7f4a9c0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab699c700 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea86040d0 0x55cea8608640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab699c700 1 -- 172.21.15.12:0/3377029505 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cea83d45d0 con 0x55cea8603770 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.256+0000 7f4ab619b700 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea86040d0 0x55cea8608640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.257+0000 7f4aa77fe700 1 -- 172.21.15.12:0/1026394798 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4aac0cdfb0 con 0x7f4ab0101310 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.257+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a9c0a14f0 0x7f4a9c0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.257+0000 7f4ab699c700 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea8603b90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800c450 tx=0x7f4aa800c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=286da60bcbac5a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.257+0000 7f4aa4bfe700 1 -- 172.21.15.12:0/3377029505 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8011070 con 0x55cea8603770 2023-12-11T20:18:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.257+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a9c0a14f0 0x7f4a9c0a39b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800cfd0 tx=0x7f4aa801f000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4aa4bfe700 1 -- 172.21.15.12:0/3377029505 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4aa800c1f0 con 0x55cea8603770 2023-12-11T20:18:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4aa4bfe700 1 -- 172.21.15.12:0/3377029505 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800acd0 con 0x55cea8603770 2023-12-11T20:18:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/3377029505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 msgr2=0x55cea8603b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea8603b90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800c450 tx=0x7f4aa800c480 comp rx=0 tx=0).stop 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/3377029505 shutdown_connections 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea8603b90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 0x55cea860af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/3377029505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea86040d0 0x55cea8608640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/3377029505 >> 172.21.15.12:0/3377029505 conn(0x55cea8532780 msgr2=0x55cea85ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/3377029505 shutdown_connections 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.258+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/3377029505 wait complete. 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.259+0000 7f4acbdc4b80 1 -- start start 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.259+0000 7f4acbdc4b80 1 Processor -- start 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea860cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 0x55cea860d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8608b80 0x55cea8614420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea8511500 con 0x55cea8608b80 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea85111a0 con 0x55cea8603770 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea83d68c0 con 0x55cea86040d0 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4acbdc4b80 10 client.0 _ll_register_callbacks cb 0x55cea843ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4ab619b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea860cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4ab599a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 0x55cea860d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4ab619b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea860cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41772/0 (socket says 172.21.15.12:41772) 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4ab619b700 1 -- 172.21.15.12:0/1666656487 learned_addr learned my addr 172.21.15.12:0/1666656487 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.260+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8608b80 0x55cea8614420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4ab699c700 1 -- 172.21.15.12:0/1666656487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 msgr2=0x55cea860d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 0x55cea860d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4ab699c700 1 -- 172.21.15.12:0/1666656487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 msgr2=0x55cea860cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea860cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4ab699c700 1 -- 172.21.15.12:0/1666656487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab01a1920 con 0x55cea8608b80 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea860cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8608b80 0x55cea8614420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009530 tx=0x7f4aa8019d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24d830c9479b93 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4a99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1666656487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8011040 con 0x55cea8608b80 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.261+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1666656487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cea85f6730 con 0x55cea8608b80 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.262+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1666656487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4aa8006e40 con 0x55cea8608b80 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.262+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1666656487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4aa800ae60 con 0x55cea8608b80 2023-12-11T20:18:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.262+0000 7f4acbdc4b80 10 client.16281 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.262+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1666656487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f4aa8009ca0 con 0x55cea8608b80 2023-12-11T20:18:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.262+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1666656487 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cea85f6730 con 0x55cea8608b80 2023-12-11T20:18:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.262+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1666656487 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4aa8021030 con 0x55cea8608b80 2023-12-11T20:18:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.262+0000 7f4acbdc4b80 10 client.16281 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.262+0000 7f4acbdc4b80 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.263+0000 7f4acbdc4b80 20 client.16281 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.263+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cea8618bb0 0x55cea861afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.263+0000 7f4acbdc4b80 4 client.16281 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.263+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1666656487 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cea85d2ee0 con 0x55cea8618bb0 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.263+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cea8618bb0 0x55cea861afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.264+0000 7f4a99ffb700 10 client.16281 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.264+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cea8618bb0 0x55cea861afd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e42b6bba2cbc982 server_cookie=aa2ed141269f7b8b in_seq=0 out_seq=0 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.264+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1666656487 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cea85d2ee0 con 0x55cea8618bb0 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.264+0000 7f4a99ffb700 10 client.16281 handle_command_reply: tid=0 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.264+0000 7f4acbdc4b80 1 client.16281 shutdown 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1666656487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8608b80 msgr2=0x55cea8614420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8608b80 0x55cea8614420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009530 tx=0x7f4aa8019d50 comp rx=0 tx=0).stop 2023-12-11T20:18:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1666656487 shutdown_connections 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cea8618bb0 0x55cea861afd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8603770 0x55cea860cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8608b80 0x55cea8614420 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1666656487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 0x55cea860d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1666656487 >> 172.21.15.12:0/1666656487 conn(0x55cea8532780 msgr2=0x55cea8600560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4a99ffb700 0 client.16281 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1666656487 shutdown_connections 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1666656487 wait complete. 2023-12-11T20:18:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.265+0000 7f4acbdc4b80 20 client.16281 trim_cache size 0 max 16384 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4acbdc4b80 1 Processor -- start 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4acbdc4b80 1 -- start start 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8614ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea86040d0 0x55cea86143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 0x55cea860c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea86155e0 con 0x55cea8603770 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea860ca40 con 0x55cea86040d0 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea8605730 con 0x55cea8608b80 2023-12-11T20:18:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4ab619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8614ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4ab619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8614ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48556/0 (socket says 172.21.15.12:48556) 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4ab619b700 1 -- 172.21.15.12:0/723415440 learned_addr learned my addr 172.21.15.12:0/723415440 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.281+0000 7f4ab599a700 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea86040d0 0x55cea86143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4ab699c700 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 0x55cea860c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4ab619b700 1 -- 172.21.15.12:0/723415440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 msgr2=0x55cea860c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4ab619b700 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 0x55cea860c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4ab619b700 1 -- 172.21.15.12:0/723415440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea86040d0 msgr2=0x55cea86143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4ab619b700 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea86040d0 0x55cea86143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4ab619b700 1 -- 172.21.15.12:0/723415440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cea8380d80 con 0x55cea8603770 2023-12-11T20:18:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4ab619b700 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8614ad0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4aac097d20 tx=0x7f4aac00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cba327415d2796 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:36.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4aa53ff700 1 -- 172.21.15.12:0/723415440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac09b080 con 0x55cea8603770 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4aa53ff700 1 -- 172.21.15.12:0/723415440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4aac0a1040 con 0x55cea8603770 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.282+0000 7f4aa53ff700 1 -- 172.21.15.12:0/723415440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac09f490 con 0x55cea8603770 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/723415440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 msgr2=0x55cea8614ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8614ad0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4aac097d20 tx=0x7f4aac00b540 comp rx=0 tx=0).stop 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/723415440 shutdown_connections 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea8608b80 0x55cea860c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8614ad0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/723415440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea86040d0 0x55cea86143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/723415440 >> 172.21.15.12:0/723415440 conn(0x55cea8532780 msgr2=0x55cea85f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/723415440 shutdown_connections 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.283+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/723415440 wait complete. 2023-12-11T20:18:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 1 -- start start 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 1 Processor -- start 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8611640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 0x55cea8611b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8608b80 0x55cea8612aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea8612fe0 con 0x55cea8603770 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea8613150 con 0x55cea8608b80 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea8613310 con 0x55cea86040d0 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.284+0000 7f4acbdc4b80 10 client.0 _ll_register_callbacks cb 0x55cea843ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8611640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8611640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48572/0 (socket says 172.21.15.12:48572) 2023-12-11T20:18:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 -- 172.21.15.12:0/1812551618 learned_addr learned my addr 172.21.15.12:0/1812551618 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8608b80 0x55cea8612aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab599a700 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 0x55cea8611b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 -- 172.21.15.12:0/1812551618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 msgr2=0x55cea8611b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 0x55cea8611b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 -- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8608b80 msgr2=0x55cea8612aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8608b80 0x55cea8612aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 -- 172.21.15.12:0/1812551618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab01a14a0 con 0x55cea8603770 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab699c700 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8608b80 0x55cea8612aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4ab619b700 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8611640 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00bfd0 tx=0x7f4aac09b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571c0acb87a2a146 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.285+0000 7f4a99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1812551618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac09b080 con 0x55cea8603770 2023-12-11T20:18:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1812551618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4aa800c1f0 con 0x55cea8603770 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1812551618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4aac09b9b0 con 0x55cea8603770 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1812551618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4aac09ac10 con 0x55cea8603770 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4acbdc4b80 10 client.16287 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1812551618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55cea8369c00 con 0x55cea8603770 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1812551618 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4aac0b2030 con 0x55cea8603770 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1812551618 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4aac09a830 con 0x55cea8603770 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4acbdc4b80 10 client.16287 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4acbdc4b80 10 client.16287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4acbdc4b80 20 client.16287 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.286+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cea866f0a0 0x55cea86714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.287+0000 7f4acbdc4b80 4 client.16287 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:18:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.287+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1812551618 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cea851df70 con 0x55cea866f0a0 2023-12-11T20:18:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.287+0000 7f4ab599a700 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cea866f0a0 0x55cea86714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.288+0000 7f4a99ffb700 10 client.16287 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.288+0000 7f4ab599a700 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cea866f0a0 0x55cea86714c0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbd06e3bf2ab5f2f server_cookie=ef341128c9d8b85a in_seq=0 out_seq=0 2023-12-11T20:18:36.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.297+0000 7f4a99ffb700 1 -- 172.21.15.12:0/1812551618 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cea851df70 con 0x55cea866f0a0 2023-12-11T20:18:36.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.297+0000 7f4a99ffb700 10 client.16287 handle_command_reply: tid=0 2023-12-11T20:18:36.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.297+0000 7f4acbdc4b80 1 client.16287 shutdown 2023-12-11T20:18:36.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1812551618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 msgr2=0x55cea8611640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8611640 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00bfd0 tx=0x7f4aac09b8d0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1812551618 shutdown_connections 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cea866f0a0 0x55cea86714c0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cea8608b80 0x55cea8612aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cea8603770 0x55cea8611640 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 --2- 172.21.15.12:0/1812551618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cea86040d0 0x55cea8611b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4a99ffb700 0 client.16287 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1812551618 >> 172.21.15.12:0/1812551618 conn(0x55cea8532780 msgr2=0x55cea861f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1812551618 shutdown_connections 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 1 -- 172.21.15.12:0/1812551618 wait complete. 2023-12-11T20:18:36.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.298+0000 7f4acbdc4b80 20 client.16287 trim_cache size 0 max 16384 2023-12-11T20:18:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:18:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:18:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:18:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:18:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 -- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a9c0a14f0 msgr2=0x7f4a9c0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a9c0a14f0 0x7f4a9c0a39b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800cfd0 tx=0x7f4aa801f000 comp rx=0 tx=0).stop 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 -- 172.21.15.12:0/1026394798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab0101310 msgr2=0x7f4ab0199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab0101310 0x7f4ab0199420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009990 tx=0x7f4aac005b00 comp rx=0 tx=0).stop 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 -- 172.21.15.12:0/1026394798 shutdown_connections 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a9c0a14f0 0x7f4a9c0a39b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ab0101310 0x7f4ab0199420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab0102ea0 0x7f4ab01a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 --2- 172.21.15.12:0/1026394798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ab0102500 0x7f4ab0199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 -- 172.21.15.12:0/1026394798 >> 172.21.15.12:0/1026394798 conn(0x7f4ab00fc8a0 msgr2=0x7f4ab0107cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 -- 172.21.15.12:0/1026394798 shutdown_connections 2023-12-11T20:18:36.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:36.299+0000 7f4ab719d700 1 -- 172.21.15.12:0/1026394798 wait complete. 2023-12-11T20:18:36.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:36 smithi032 ceph-mon[132488]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 24 op/s 2023-12-11T20:18:36.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:36 smithi039 ceph-mon[102205]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 24 op/s 2023-12-11T20:18:36.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:36 smithi012 ceph-mon[128787]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 24 op/s 2023-12-11T20:18:37.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:37 smithi032 ceph-mon[132488]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 33 op/s 2023-12-11T20:18:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:37 smithi039 ceph-mon[102205]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 33 op/s 2023-12-11T20:18:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:37 smithi012 ceph-mon[128787]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 33 op/s 2023-12-11T20:18:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:39 smithi032 ceph-mon[132488]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:18:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:39 smithi039 ceph-mon[102205]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:18:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:39 smithi012 ceph-mon[128787]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:18:42.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:42 smithi032 ceph-mon[132488]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:18:42.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:42 smithi039 ceph-mon[102205]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:18:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:42 smithi012 ceph-mon[128787]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:18:43.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:43 smithi032 ceph-mon[132488]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:18:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:43 smithi039 ceph-mon[102205]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:18:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:43 smithi012 ceph-mon[128787]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:18:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:46 smithi032 ceph-mon[132488]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:18:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:46 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:18:46.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:46 smithi039 ceph-mon[102205]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:18:46.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:46 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:18:46.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:46 smithi012 ceph-mon[128787]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:18:46.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:46 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:18:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:47 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:18:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:47 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:18:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:47 smithi032 ceph-mon[132488]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:18:47.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:47 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:18:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:47 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:18:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:47 smithi039 ceph-mon[102205]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:18:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:47 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:18:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:47 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:18:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:47 smithi012 ceph-mon[128787]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:18:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1421821756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f81036f0 msgr2=0x7fd7f8103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1421821756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f81036f0 0x7fd7f8103b10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80099c0 tx=0x7fd7e8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1421821756 shutdown_connections 2023-12-11T20:18:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1421821756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7f8105280 0x7fd7f810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1421821756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f81036f0 0x7fd7f8103b10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1421821756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7f81048e0 0x7fd7f8104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1421821756 >> 172.21.15.12:0/1421821756 conn(0x7fd7f80fec80 msgr2=0x7fd7f81010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1421821756 shutdown_connections 2023-12-11T20:18:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.485+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1421821756 wait complete. 2023-12-11T20:18:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.486+0000 7fd7fd3ff700 1 Processor -- start 2023-12-11T20:18:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7fd3ff700 1 -- start start 2023-12-11T20:18:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7fd3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7f81036f0 0x7fd7f81995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7fd3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7f81048e0 0x7fd7f8199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7fd3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8105280 0x7fd7f81a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7fd3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f81a10d0 con 0x7fd7f8105280 2023-12-11T20:18:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7fd3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f81a1210 con 0x7fd7f81048e0 2023-12-11T20:18:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7fd3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f81a13a0 con 0x7fd7f81036f0 2023-12-11T20:18:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8105280 0x7fd7f81a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7f6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7f81036f0 0x7fd7f81995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8105280 0x7fd7f81a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56258/0 (socket says 172.21.15.12:56258) 2023-12-11T20:18:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7f77fe700 1 -- 172.21.15.12:0/1577604581 learned_addr learned my addr 172.21.15.12:0/1577604581 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.487+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7f81048e0 0x7fd7f8199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.488+0000 7fd7f77fe700 1 -- 172.21.15.12:0/1577604581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7f81036f0 msgr2=0x7fd7f81995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.488+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7f81036f0 0x7fd7f81995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.488+0000 7fd7f77fe700 1 -- 172.21.15.12:0/1577604581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7f81048e0 msgr2=0x7fd7f8199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.488+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7f81048e0 0x7fd7f8199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.488+0000 7fd7f77fe700 1 -- 172.21.15.12:0/1577604581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80095f0 con 0x7fd7f8105280 2023-12-11T20:18:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.488+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8105280 0x7fd7f81a0b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000ef30 tx=0x7fd7f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.489+0000 7fd7dffff700 1 -- 172.21.15.12:0/1577604581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0018070 con 0x7fd7f8105280 2023-12-11T20:18:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.489+0000 7fd7dffff700 1 -- 172.21.15.12:0/1577604581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7f000f040 con 0x7fd7f8105280 2023-12-11T20:18:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.489+0000 7fd7dffff700 1 -- 172.21.15.12:0/1577604581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000cc70 con 0x7fd7f8105280 2023-12-11T20:18:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.489+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1577604581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f81a1620 con 0x7fd7f8105280 2023-12-11T20:18:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.489+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1577604581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f81a1ae0 con 0x7fd7f8105280 2023-12-11T20:18:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.494+0000 7fd7dffff700 1 -- 172.21.15.12:0/1577604581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd7f0007500 con 0x7fd7f8105280 2023-12-11T20:18:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.495+0000 7fd7dffff700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7e00a14f0 0x7fd7e00a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd810cd2b80 1 Processor -- start 2023-12-11T20:18:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd7dffff700 1 -- 172.21.15.12:0/1577604581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd7f00cc8b0 con 0x7fd7f8105280 2023-12-11T20:18:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd810cd2b80 1 -- start start 2023-12-11T20:18:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7e00a14f0 0x7fd7e00a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647f9d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647f9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 0x564647f9eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647ef8af0 con 0x564647f9d830 2023-12-11T20:18:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647ef6410 con 0x564647f9ced0 2023-12-11T20:18:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.496+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647ef1d00 con 0x564647f9e720 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647f9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647f9e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56266/0 (socket says 172.21.15.12:56266) 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f67fc700 1 -- 172.21.15.12:0/2350540121 learned_addr learned my addr 172.21.15.12:0/2350540121 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 0x564647f9eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647f9d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7e00a14f0 0x7fd7e00a39b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8000c00 tx=0x7fd7e8003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f67fc700 1 -- 172.21.15.12:0/2350540121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 msgr2=0x564647f9eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 0x564647f9eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f67fc700 1 -- 172.21.15.12:0/2350540121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 msgr2=0x564647f9d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647f9d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f67fc700 1 -- 172.21.15.12:0/2350540121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564647d6e5d0 con 0x564647f9d830 2023-12-11T20:18:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.497+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647f9d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:18:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.498+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647f9e140 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009d20 tx=0x7fd7ec0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fac0d68b2bd67a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.498+0000 7fd7dd7fa700 1 -- 172.21.15.12:0/2350540121 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec0097f0 con 0x564647f9d830 2023-12-11T20:18:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.498+0000 7fd7dd7fa700 1 -- 172.21.15.12:0/2350540121 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7ec009e70 con 0x564647f9d830 2023-12-11T20:18:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.498+0000 7fd7dd7fa700 1 -- 172.21.15.12:0/2350540121 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec00f770 con 0x564647f9d830 2023-12-11T20:18:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2350540121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 msgr2=0x564647f9e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647f9e140 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009d20 tx=0x7fd7ec0116c0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2350540121 shutdown_connections 2023-12-11T20:18:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647f9d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 0x564647f9eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2350540121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647f9e140 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2350540121 >> 172.21.15.12:0/2350540121 conn(0x564647ecc780 msgr2=0x564647f99880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2350540121 shutdown_connections 2023-12-11T20:18:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.499+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2350540121 wait complete. 2023-12-11T20:18:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.500+0000 7fd810cd2b80 1 -- start start 2023-12-11T20:18:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.500+0000 7fd810cd2b80 1 Processor -- start 2023-12-11T20:18:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9ced0 0x564647fa6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9d830 0x564647fa73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9e720 0x564647fae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647eab500 con 0x564647f9ced0 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647eab1a0 con 0x564647f9e720 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647d708c0 con 0x564647f9d830 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd810cd2b80 10 client.0 _ll_register_callbacks cb 0x564647dd6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd7f67fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9d830 0x564647fa73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd7f6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9ced0 0x564647fa6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd7f67fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9d830 0x564647fa73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54202/0 (socket says 172.21.15.12:54202) 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.501+0000 7fd7f67fc700 1 -- 172.21.15.12:0/4089891562 learned_addr learned my addr 172.21.15.12:0/4089891562 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.502+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9e720 0x564647fae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.502+0000 7fd7f67fc700 1 -- 172.21.15.12:0/4089891562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9e720 msgr2=0x564647fae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.502+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9e720 0x564647fae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.502+0000 7fd7f67fc700 1 -- 172.21.15.12:0/4089891562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9ced0 msgr2=0x564647fa6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.502+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9ced0 0x564647fa6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.502+0000 7fd7f67fc700 1 -- 172.21.15.12:0/4089891562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec009950 con 0x564647f9d830 2023-12-11T20:18:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.502+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9d830 0x564647fa73c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009cf0 tx=0x7fd7ec012680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae92553bd7ed179a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.502+0000 7fd7daff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:18:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.503+0000 7fd7daff5700 1 -- 172.21.15.12:0/4089891562 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec004950 con 0x564647f9d830 2023-12-11T20:18:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.503+0000 7fd810cd2b80 1 -- 172.21.15.12:0/4089891562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564647f90730 con 0x564647f9d830 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.503+0000 7fd7daff5700 1 -- 172.21.15.12:0/4089891562 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd7ec004ab0 con 0x564647f9d830 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.503+0000 7fd7daff5700 1 -- 172.21.15.12:0/4089891562 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7ec004c70 con 0x564647f9d830 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.503+0000 7fd810cd2b80 10 client.26047 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.503+0000 7fd810cd2b80 1 -- 172.21.15.12:0/4089891562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x564647d1ad80 con 0x564647f9d830 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd7daff5700 1 -- 172.21.15.12:0/4089891562 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564647f90730 con 0x564647f9d830 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd7daff5700 1 -- 172.21.15.12:0/4089891562 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd7ec00f4b0 con 0x564647f9d830 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd810cd2b80 10 client.26047 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd810cd2b80 10 client.26047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd810cd2b80 20 client.26047 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564647fb2c00 0x564647fb5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd810cd2b80 4 client.26047 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:18:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd810cd2b80 1 -- 172.21.15.12:0/4089891562 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564647f6cee0 con 0x564647fb2c00 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.504+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564647fb2c00 0x564647fb5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.505+0000 7fd7daff5700 10 client.26047 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.505+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564647fb2c00 0x564647fb5020 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=916063e9d900004e server_cookie=aba99abd6938708d in_seq=0 out_seq=0 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd7daff5700 1 -- 172.21.15.12:0/4089891562 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564647f6cee0 con 0x564647fb2c00 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd7daff5700 10 client.26047 handle_command_reply: tid=0 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 client.26047 shutdown 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 -- 172.21.15.12:0/4089891562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9d830 msgr2=0x564647fa73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9d830 0x564647fa73c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009cf0 tx=0x7fd7ec012680 comp rx=0 tx=0).stop 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 -- 172.21.15.12:0/4089891562 shutdown_connections 2023-12-11T20:18:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564647fb2c00 0x564647fb5020 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9e720 0x564647fae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9ced0 0x564647fa6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd7daff5700 0 client.26047 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/4089891562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9d830 0x564647fa73c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 -- 172.21.15.12:0/4089891562 >> 172.21.15.12:0/4089891562 conn(0x564647ecc780 msgr2=0x564647f97ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.506+0000 7fd810cd2b80 1 -- 172.21.15.12:0/4089891562 shutdown_connections 2023-12-11T20:18:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.507+0000 7fd810cd2b80 1 -- 172.21.15.12:0/4089891562 wait complete. 2023-12-11T20:18:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.507+0000 7fd810cd2b80 20 client.26047 trim_cache size 0 max 16384 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd810cd2b80 1 Processor -- start 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd810cd2b80 1 -- start start 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9ced0 0x564647f9d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9d830 0x564647fae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9e720 0x564647fa6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647f905a0 con 0x564647f9e720 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647fb53e0 con 0x564647f9d830 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647fb29f0 con 0x564647f9ced0 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.523+0000 7fd7f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9e720 0x564647fa6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9e720 0x564647fa6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56278/0 (socket says 172.21.15.12:56278) 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f77fe700 1 -- 172.21.15.12:0/2439754399 learned_addr learned my addr 172.21.15.12:0/2439754399 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9d830 0x564647fae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9ced0 0x564647f9d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f77fe700 1 -- 172.21.15.12:0/2439754399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9ced0 msgr2=0x564647f9d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9ced0 0x564647f9d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f77fe700 1 -- 172.21.15.12:0/2439754399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9d830 msgr2=0x564647fae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9d830 0x564647fae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f77fe700 1 -- 172.21.15.12:0/2439754399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564647d03c00 con 0x564647f9e720 2023-12-11T20:18:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9d830 0x564647fae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9e720 0x564647fa6180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00ca300 tx=0x7fd7f0096020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c605d92f3bd73032 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7ddffb700 1 -- 172.21.15.12:0/2439754399 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0099bb0 con 0x564647f9e720 2023-12-11T20:18:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.524+0000 7fd7ddffb700 1 -- 172.21.15.12:0/2439754399 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7f009dd00 con 0x564647f9e720 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd7ddffb700 1 -- 172.21.15.12:0/2439754399 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00ca410 con 0x564647f9e720 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2439754399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9e720 msgr2=0x564647fa6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9e720 0x564647fa6180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00ca300 tx=0x7fd7f0096020 comp rx=0 tx=0).stop 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2439754399 shutdown_connections 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9e720 0x564647fa6180 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9ced0 0x564647f9d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2439754399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9d830 0x564647fae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2439754399 >> 172.21.15.12:0/2439754399 conn(0x564647ecc780 msgr2=0x564647fa4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.525+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2439754399 shutdown_connections 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.526+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2439754399 wait complete. 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.526+0000 7fd810cd2b80 1 -- start start 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.526+0000 7fd810cd2b80 1 Processor -- start 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647fabe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647fac340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd810cd2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 0x564647fad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647fad890 con 0x564647f9d830 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647fada00 con 0x564647f9ced0 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd810cd2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564647fadbc0 con 0x564647f9e720 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd810cd2b80 10 client.0 _ll_register_callbacks cb 0x564647dd6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd7f67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647fac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd7f67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647fac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56292/0 (socket says 172.21.15.12:56292) 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd7f67fc700 1 -- 172.21.15.12:0/2527784604 learned_addr learned my addr 172.21.15.12:0/2527784604 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647fabe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.527+0000 7fd7f77fe700 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 0x564647fad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7f67fc700 1 -- 172.21.15.12:0/2527784604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 msgr2=0x564647fad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 0x564647fad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7f67fc700 1 -- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 msgr2=0x564647fabe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:18:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647fabe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7f67fc700 1 -- 172.21.15.12:0/2527784604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564647d1ad80 con 0x564647f9d830 2023-12-11T20:18:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647fabe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:18:49.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7f67fc700 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647fac340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009d20 tx=0x7fd7ec011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70490b4755e49497 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:18:49.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7daff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:18:49.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7daff5700 1 -- 172.21.15.12:0/2527784604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec03b070 con 0x564647f9d830 2023-12-11T20:18:49.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7daff5700 1 -- 172.21.15.12:0/2527784604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd7ec005c80 con 0x564647f9d830 2023-12-11T20:18:49.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2527784604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7ec009e70 con 0x564647f9d830 2023-12-11T20:18:49.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd7daff5700 1 -- 172.21.15.12:0/2527784604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7ec0092d0 con 0x564647f9d830 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd810cd2b80 10 client.16305 fetch_fsmap learned FSMap version 24 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.528+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2527784604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fd7f81a1ae0 con 0x564647f9d830 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd7daff5700 1 -- 172.21.15.12:0/2527784604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7ec045020 con 0x564647f9d830 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd7daff5700 1 -- 172.21.15.12:0/2527784604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd7ec03e030 con 0x564647f9d830 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd810cd2b80 10 client.16305 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd810cd2b80 10 client.16305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd810cd2b80 20 client.16305 populate_metadata read hostname 'smithi012' 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564648009ca0 0x56464800c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd810cd2b80 4 client.16305 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2527784604 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564647eb7f70 con 0x564648009ca0 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.529+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564648009ca0 0x56464800c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.530+0000 7fd7daff5700 10 client.16305 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.530+0000 7fd7f6ffd700 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564648009ca0 0x56464800c0c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f04ae40dc85cdeaa server_cookie=68c6385eb8265a88 in_seq=0 out_seq=0 2023-12-11T20:18:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd7daff5700 1 -- 172.21.15.12:0/2527784604 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564647eb7f70 con 0x564648009ca0 2023-12-11T20:18:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd7daff5700 10 client.16305 handle_command_reply: tid=0 2023-12-11T20:18:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 client.16305 shutdown 2023-12-11T20:18:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2527784604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 msgr2=0x564647fac340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647fac340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009d20 tx=0x7fd7ec011a10 comp rx=0 tx=0).stop 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2527784604 shutdown_connections 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564648009ca0 0x56464800c0c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564647f9ced0 0x564647fabe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564647f9e720 0x564647fad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd7daff5700 0 client.16305 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 --2- 172.21.15.12:0/2527784604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564647f9d830 0x564647fac340 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2527784604 >> 172.21.15.12:0/2527784604 conn(0x564647ecc780 msgr2=0x564647fa4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2527784604 shutdown_connections 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 1 -- 172.21.15.12:0/2527784604 wait complete. 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.540+0000 7fd810cd2b80 20 client.16305 trim_cache size 0 max 16384 2023-12-11T20:18:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:18:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:18:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:18:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:18:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7e00a14f0 msgr2=0x7fd7e00a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7e00a14f0 0x7fd7e00a39b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8000c00 tx=0x7fd7e8003680 comp rx=0 tx=0).stop 2023-12-11T20:18:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8105280 msgr2=0x7fd7f81a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:18:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8105280 0x7fd7f81a0b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000ef30 tx=0x7fd7f000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1577604581 shutdown_connections 2023-12-11T20:18:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd7e00a14f0 0x7fd7e00a39b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f8105280 0x7fd7f81a0b00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7f81036f0 0x7fd7f81995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 --2- 172.21.15.12:0/1577604581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7f81048e0 0x7fd7f8199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:18:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1577604581 >> 172.21.15.12:0/1577604581 conn(0x7fd7f80fec80 msgr2=0x7fd7f8107d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:18:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1577604581 shutdown_connections 2023-12-11T20:18:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:18:49.541+0000 7fd7fd3ff700 1 -- 172.21.15.12:0/1577604581 wait complete. 2023-12-11T20:18:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:49 smithi032 ceph-mon[132488]: pgmap v462: 97 pgs: 97 active+clean; 1.3 GiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:49 smithi039 ceph-mon[102205]: pgmap v462: 97 pgs: 97 active+clean; 1.3 GiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:49 smithi012 ceph-mon[128787]: pgmap v462: 97 pgs: 97 active+clean; 1.3 GiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:52 smithi032 ceph-mon[132488]: pgmap v463: 97 pgs: 97 active+clean; 1.3 GiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 15 MiB/s wr, 11 op/s 2023-12-11T20:18:52.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:52 smithi039 ceph-mon[102205]: pgmap v463: 97 pgs: 97 active+clean; 1.3 GiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 15 MiB/s wr, 11 op/s 2023-12-11T20:18:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:52 smithi012 ceph-mon[128787]: pgmap v463: 97 pgs: 97 active+clean; 1.3 GiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 15 MiB/s wr, 11 op/s 2023-12-11T20:18:53.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:53 smithi032 ceph-mon[132488]: pgmap v464: 97 pgs: 97 active+clean; 1.3 GiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:18:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:53 smithi039 ceph-mon[102205]: pgmap v464: 97 pgs: 97 active+clean; 1.3 GiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:18:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:53 smithi012 ceph-mon[128787]: pgmap v464: 97 pgs: 97 active+clean; 1.3 GiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:18:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:56 smithi032 ceph-mon[132488]: pgmap v465: 97 pgs: 97 active+clean; 1.3 GiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:56.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:56 smithi039 ceph-mon[102205]: pgmap v465: 97 pgs: 97 active+clean; 1.3 GiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:56 smithi012 ceph-mon[128787]: pgmap v465: 97 pgs: 97 active+clean; 1.3 GiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:18:57.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:57 smithi032 ceph-mon[132488]: pgmap v466: 97 pgs: 97 active+clean; 1.4 GiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:57 smithi039 ceph-mon[102205]: pgmap v466: 97 pgs: 97 active+clean; 1.4 GiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:57 smithi012 ceph-mon[128787]: pgmap v466: 97 pgs: 97 active+clean; 1.4 GiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:18:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:18:59 smithi032 ceph-mon[132488]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:18:59.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:18:59 smithi039 ceph-mon[102205]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:18:59.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:18:59 smithi012 ceph-mon[128787]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:19:01.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:01 smithi032 ceph-mon[132488]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:19:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:01 smithi039 ceph-mon[102205]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:19:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:01 smithi012 ceph-mon[128787]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:19:02.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:19:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 -- 172.21.15.12:0/459498444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 msgr2=0x7f547c106d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 --2- 172.21.15.12:0/459498444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 0x7f547c106d00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5470009990 tx=0x7f5470009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 -- 172.21.15.12:0/459498444 shutdown_connections 2023-12-11T20:19:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 --2- 172.21.15.12:0/459498444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f547c107240 0x7f547c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 --2- 172.21.15.12:0/459498444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f547c101fe0 0x7f547c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 --2- 172.21.15.12:0/459498444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 0x7f547c106d00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 -- 172.21.15.12:0/459498444 >> 172.21.15.12:0/459498444 conn(0x7f547c0fb930 msgr2=0x7f547c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 -- 172.21.15.12:0/459498444 shutdown_connections 2023-12-11T20:19:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.376+0000 7f54829ff700 1 -- 172.21.15.12:0/459498444 wait complete. 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.377+0000 7f54829ff700 1 Processor -- start 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.377+0000 7f54829ff700 1 -- start start 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f54829ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f547c101fe0 0x7f547c199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f54829ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 0x7f547c199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f54829ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f547c107240 0x7f547c1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f54829ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1a1050 con 0x7f547c104910 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f54829ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1a1190 con 0x7f547c107240 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f54829ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1a1320 con 0x7f547c101fe0 2023-12-11T20:19:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f547bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f547c101fe0 0x7f547c199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f547bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f547c101fe0 0x7f547c199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47738/0 (socket says 172.21.15.12:47738) 2023-12-11T20:19:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f547bfff700 1 -- 172.21.15.12:0/2872374346 learned_addr learned my addr 172.21.15.12:0/2872374346 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f547b7fe700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 0x7f547c199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.378+0000 7f5480f9c700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f547c107240 0x7f547c1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f547bfff700 1 -- 172.21.15.12:0/2872374346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f547c107240 msgr2=0x7f547c1a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f547bfff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f547c107240 0x7f547c1a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f547bfff700 1 -- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 msgr2=0x7f547c199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f547bfff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 0x7f547c199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f547bfff700 1 -- 172.21.15.12:0/2872374346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700095f0 con 0x7f547c101fe0 2023-12-11T20:19:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f547b7fe700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 0x7f547c199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f547bfff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f547c101fe0 0x7f547c199520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f546c00d980 tx=0x7f546c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f54797fa700 1 -- 172.21.15.12:0/2872374346 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c004220 con 0x7f547c101fe0 2023-12-11T20:19:02.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f54829ff700 1 -- 172.21.15.12:0/2872374346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c1a1600 con 0x7f547c101fe0 2023-12-11T20:19:02.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f54797fa700 1 -- 172.21.15.12:0/2872374346 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f546c007640 con 0x7f547c101fe0 2023-12-11T20:19:02.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f54797fa700 1 -- 172.21.15.12:0/2872374346 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c005660 con 0x7f547c101fe0 2023-12-11T20:19:02.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.379+0000 7f54829ff700 1 -- 172.21.15.12:0/2872374346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c1a1b60 con 0x7f547c101fe0 2023-12-11T20:19:02.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.384+0000 7f54797fa700 1 -- 172.21.15.12:0/2872374346 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f546c004750 con 0x7f547c101fe0 2023-12-11T20:19:02.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.385+0000 7f549627db80 1 Processor -- start 2023-12-11T20:19:02.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.385+0000 7f549627db80 1 -- start start 2023-12-11T20:19:02.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f549627db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f549627db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a4d30 0x5579328a5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f54797fa700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54640a1480 0x7f54640a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f549627db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a5c20 0x5579328a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f549627db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579327ffb50 con 0x5579328a5c20 2023-12-11T20:19:02.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f549627db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579327fd470 con 0x5579328a4d30 2023-12-11T20:19:02.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f549627db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579327f8d60 con 0x5579328a43d0 2023-12-11T20:19:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f54797fa700 1 -- 172.21.15.12:0/2872374346 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f546c0ccaf0 con 0x7f547c101fe0 2023-12-11T20:19:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f5480f9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f547b7fe700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54640a1480 0x7f54640a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f5480f9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328a47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47740/0 (socket says 172.21.15.12:47740) 2023-12-11T20:19:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f5480f9c700 1 -- 172.21.15.12:0/2096795938 learned_addr learned my addr 172.21.15.12:0/2096795938 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f547bfff700 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a4d30 0x5579328a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.386+0000 7f5480f9c700 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a5c20 0x5579328a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f547bfff700 1 -- 172.21.15.12:0/2096795938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 msgr2=0x5579328a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f547bfff700 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f547bfff700 1 -- 172.21.15.12:0/2096795938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a5c20 msgr2=0x5579328a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f547bfff700 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a5c20 0x5579328a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f547bfff700 1 -- 172.21.15.12:0/2096795938 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557932675630 con 0x5579328a4d30 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f547bfff700 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a4d30 0x5579328a5640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f546c0ca5f0 tx=0x7f546c099720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=786859963403acc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f547b7fe700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54640a1480 0x7f54640a3940 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5470000c00 tx=0x7f5470005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f54627fc700 1 -- 172.21.15.12:0/2096795938 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c004380 con 0x5579328a4d30 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f54627fc700 1 -- 172.21.15.12:0/2096795938 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f546c09a4c0 con 0x5579328a4d30 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.387+0000 7f54627fc700 1 -- 172.21.15.12:0/2096795938 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0992b0 con 0x5579328a4d30 2023-12-11T20:19:02.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 -- 172.21.15.12:0/2096795938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a4d30 msgr2=0x5579328a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a4d30 0x5579328a5640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f546c0ca5f0 tx=0x7f546c099720 comp rx=0 tx=0).stop 2023-12-11T20:19:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 -- 172.21.15.12:0/2096795938 shutdown_connections 2023-12-11T20:19:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a5c20 0x5579328a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 --2- 172.21.15.12:0/2096795938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a4d30 0x5579328a5640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 -- 172.21.15.12:0/2096795938 >> 172.21.15.12:0/2096795938 conn(0x5579327d37e0 msgr2=0x5579328a0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 -- 172.21.15.12:0/2096795938 shutdown_connections 2023-12-11T20:19:02.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.388+0000 7f549627db80 1 -- 172.21.15.12:0/2096795938 wait complete. 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.389+0000 7f549627db80 1 -- start start 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.389+0000 7f549627db80 1 Processor -- start 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f549627db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f549627db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f549627db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f549627db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579327b2560 con 0x5579328a4d30 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f549627db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579327b2200 con 0x5579328a5c20 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f549627db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557932677920 con 0x5579328a43d0 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f549627db80 10 client.0 _ll_register_callbacks cb 0x5579326dda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328ae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55024/0 (socket says 172.21.15.12:55024) 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547b7fe700 1 -- 172.21.15.12:0/673900758 learned_addr learned my addr 172.21.15.12:0/673900758 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f5480f9c700 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547bfff700 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547b7fe700 1 -- 172.21.15.12:0/673900758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 msgr2=0x5579328ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547b7fe700 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547b7fe700 1 -- 172.21.15.12:0/673900758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 msgr2=0x5579328b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547b7fe700 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.390+0000 7f547b7fe700 1 -- 172.21.15.12:0/673900758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c1a1b60 con 0x5579328a4d30 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.391+0000 7f547b7fe700 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328ae7d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5470003bf0 tx=0x7f5470009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d280f40cd650820 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.391+0000 7f545b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.391+0000 7f545b7fe700 1 -- 172.21.15.12:0/673900758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547002b070 con 0x5579328a4d30 2023-12-11T20:19:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.391+0000 7f549627db80 1 -- 172.21.15.12:0/673900758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557932897b40 con 0x5579328a4d30 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.391+0000 7f545b7fe700 1 -- 172.21.15.12:0/673900758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f547000f670 con 0x5579328a4d30 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.391+0000 7f545b7fe700 1 -- 172.21.15.12:0/673900758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f547000f830 con 0x5579328a4d30 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.391+0000 7f549627db80 10 client.16317 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f549627db80 1 -- 172.21.15.12:0/673900758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557932621de0 con 0x5579328a4d30 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f545b7fe700 1 -- 172.21.15.12:0/673900758 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f547003e080 con 0x5579328a4d30 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f545b7fe700 1 -- 172.21.15.12:0/673900758 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f547003a920 con 0x5579328a4d30 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f549627db80 10 client.16317 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f549627db80 10 client.16317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f549627db80 20 client.16317 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f549627db80 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5579328ba0b0 0x5579328bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f549627db80 4 client.16317 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.392+0000 7f549627db80 1 -- 172.21.15.12:0/673900758 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557932873f40 con 0x5579328ba0b0 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.393+0000 7f547bfff700 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5579328ba0b0 0x5579328bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.393+0000 7f547bfff700 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5579328ba0b0 0x5579328bc4d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dc58fd2b3b4ec2f server_cookie=3a68f96119f5b9e6 in_seq=0 out_seq=0 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.393+0000 7f545b7fe700 10 client.16317 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f545b7fe700 1 -- 172.21.15.12:0/673900758 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557932873f40 con 0x5579328ba0b0 2023-12-11T20:19:02.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f545b7fe700 10 client.16317 handle_command_reply: tid=0 2023-12-11T20:19:02.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 client.16317 shutdown 2023-12-11T20:19:02.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 -- 172.21.15.12:0/673900758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 msgr2=0x5579328ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328ae7d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5470003bf0 tx=0x7f5470009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 -- 172.21.15.12:0/673900758 shutdown_connections 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5579328ba0b0 0x5579328bc4d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 --2- 172.21.15.12:0/673900758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328ae7d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f545b7fe700 0 client.16317 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.394+0000 7f549627db80 1 -- 172.21.15.12:0/673900758 >> 172.21.15.12:0/673900758 conn(0x5579327d37e0 msgr2=0x55793289fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.395+0000 7f549627db80 1 -- 172.21.15.12:0/673900758 shutdown_connections 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.395+0000 7f549627db80 1 -- 172.21.15.12:0/673900758 wait complete. 2023-12-11T20:19:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.395+0000 7f549627db80 20 client.16317 trim_cache size 0 max 16384 2023-12-11T20:19:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.419+0000 7f549627db80 1 Processor -- start 2023-12-11T20:19:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.419+0000 7f549627db80 1 -- start start 2023-12-11T20:19:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.419+0000 7f549627db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.419+0000 7f549627db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.419+0000 7f549627db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.419+0000 7f549627db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579328b6990 con 0x5579328a4d30 2023-12-11T20:19:02.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.419+0000 7f549627db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579328b7520 con 0x5579328a5c20 2023-12-11T20:19:02.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.419+0000 7f549627db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793289bb80 con 0x5579328a43d0 2023-12-11T20:19:02.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55034/0 (socket says 172.21.15.12:55034) 2023-12-11T20:19:02.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 -- 172.21.15.12:0/3431765867 learned_addr learned my addr 172.21.15.12:0/3431765867 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f5480f9c700 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547bfff700 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 -- 172.21.15.12:0/3431765867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 msgr2=0x5579328ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 -- 172.21.15.12:0/3431765867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 msgr2=0x5579328ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 -- 172.21.15.12:0/3431765867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55793260ac60 con 0x5579328a4d30 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.420+0000 7f547b7fe700 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328b57d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f54700098e0 tx=0x7f547000b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1628d69d4da2011 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f5462ffd700 1 -- 172.21.15.12:0/3431765867 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547002b050 con 0x5579328a4d30 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f5462ffd700 1 -- 172.21.15.12:0/3431765867 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557932897b40 con 0x5579328a4d30 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f5462ffd700 1 -- 172.21.15.12:0/3431765867 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000fbb0 con 0x5579328a4d30 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f549627db80 1 -- 172.21.15.12:0/3431765867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 msgr2=0x5579328b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f549627db80 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328b57d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f54700098e0 tx=0x7f547000b5c0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f549627db80 1 -- 172.21.15.12:0/3431765867 shutdown_connections 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f549627db80 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f549627db80 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a43d0 0x5579328ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f549627db80 1 --2- 172.21.15.12:0/3431765867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a4d30 0x5579328b57d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.421+0000 7f549627db80 1 -- 172.21.15.12:0/3431765867 >> 172.21.15.12:0/3431765867 conn(0x5579327d37e0 msgr2=0x5579328ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.422+0000 7f549627db80 1 -- 172.21.15.12:0/3431765867 shutdown_connections 2023-12-11T20:19:02.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.422+0000 7f549627db80 1 -- 172.21.15.12:0/3431765867 wait complete. 2023-12-11T20:19:02.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.422+0000 7f549627db80 1 -- start start 2023-12-11T20:19:02.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.422+0000 7f549627db80 1 Processor -- start 2023-12-11T20:19:02.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f549627db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a43d0 0x5579328b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f549627db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a4d30 0x5579328b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f549627db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f549627db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579328b51a0 con 0x5579328a43d0 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f549627db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579328b5310 con 0x5579328a5c20 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f549627db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579328b54d0 con 0x5579328a4d30 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f549627db80 10 client.0 _ll_register_callbacks cb 0x5579326dda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a43d0 0x5579328b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a43d0 0x5579328b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55044/0 (socket says 172.21.15.12:55044) 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547bfff700 1 -- 172.21.15.12:0/3313067754 learned_addr learned my addr 172.21.15.12:0/3313067754 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547b7fe700 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a4d30 0x5579328b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f5480f9c700 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547bfff700 1 -- 172.21.15.12:0/3313067754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a4d30 msgr2=0x5579328b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547bfff700 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a4d30 0x5579328b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547bfff700 1 -- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 msgr2=0x5579328b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547bfff700 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f547bfff700 1 -- 172.21.15.12:0/3313067754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557932621de0 con 0x5579328a43d0 2023-12-11T20:19:02.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.423+0000 7f5480f9c700 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.424+0000 7f547bfff700 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a43d0 0x5579328b3760 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f546c099d50 tx=0x7f546c099b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371845885899aec5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.424+0000 7f545b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.424+0000 7f545b7fe700 1 -- 172.21.15.12:0/3313067754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c099dc0 con 0x5579328a43d0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.424+0000 7f549627db80 1 -- 172.21.15.12:0/3313067754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f546c09a4c0 con 0x5579328a43d0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.424+0000 7f545b7fe700 1 -- 172.21.15.12:0/3313067754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f546c0b2070 con 0x5579328a43d0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.424+0000 7f545b7fe700 1 -- 172.21.15.12:0/3313067754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f546c0a2150 con 0x5579328a43d0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.424+0000 7f549627db80 10 client.16323 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.424+0000 7f549627db80 1 -- 172.21.15.12:0/3313067754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557932648250 con 0x5579328a43d0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f545b7fe700 1 -- 172.21.15.12:0/3313067754 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f546c09a4c0 con 0x5579328a43d0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f545b7fe700 1 -- 172.21.15.12:0/3313067754 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f546c0a1cc0 con 0x5579328a43d0 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f549627db80 10 client.16323 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f549627db80 10 client.16323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f549627db80 20 client.16323 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:02.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f549627db80 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557932911420 0x557932913840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f549627db80 4 client.16323 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f549627db80 1 -- 172.21.15.12:0/3313067754 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5579327befd0 con 0x557932911420 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.425+0000 7f547b7fe700 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557932911420 0x557932913840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.426+0000 7f545b7fe700 10 client.16323 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.426+0000 7f547b7fe700 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557932911420 0x557932913840 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7383ba984c91b851 server_cookie=ec159e764e59f468 in_seq=0 out_seq=0 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.426+0000 7f545b7fe700 1 -- 172.21.15.12:0/3313067754 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5579327befd0 con 0x557932911420 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.426+0000 7f545b7fe700 10 client.16323 handle_command_reply: tid=0 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.426+0000 7f549627db80 1 client.16323 shutdown 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.426+0000 7f549627db80 1 -- 172.21.15.12:0/3313067754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a43d0 msgr2=0x5579328b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.426+0000 7f549627db80 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a43d0 0x5579328b3760 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f546c099d50 tx=0x7f546c099b90 comp rx=0 tx=0).stop 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 1 -- 172.21.15.12:0/3313067754 shutdown_connections 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557932911420 0x557932913840 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5579328a5c20 0x5579328b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579328a43d0 0x5579328b3760 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f545b7fe700 0 client.16323 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 1 --2- 172.21.15.12:0/3313067754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5579328a4d30 0x5579328b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 1 -- 172.21.15.12:0/3313067754 >> 172.21.15.12:0/3313067754 conn(0x5579327d37e0 msgr2=0x5579328ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 1 -- 172.21.15.12:0/3313067754 shutdown_connections 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 1 -- 172.21.15.12:0/3313067754 wait complete. 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f549627db80 20 client.16323 trim_cache size 0 max 16384 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:19:02.430 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f54829ff700 1 -- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54640a1480 msgr2=0x7f54640a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f54829ff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54640a1480 0x7f54640a3940 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5470000c00 tx=0x7f5470005fb0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f54829ff700 1 -- 172.21.15.12:0/2872374346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f547c101fe0 msgr2=0x7f547c199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.427+0000 7f54829ff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f547c101fe0 0x7f547c199520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f546c00d980 tx=0x7f546c00dc90 comp rx=0 tx=0).stop 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.428+0000 7f54829ff700 1 -- 172.21.15.12:0/2872374346 shutdown_connections 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.428+0000 7f54829ff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54640a1480 0x7f54640a3940 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.428+0000 7f54829ff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f547c107240 0x7f547c1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.428+0000 7f54829ff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f547c101fe0 0x7f547c199520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.428+0000 7f54829ff700 1 --2- 172.21.15.12:0/2872374346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547c104910 0x7f547c199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.428+0000 7f54829ff700 1 -- 172.21.15.12:0/2872374346 >> 172.21.15.12:0/2872374346 conn(0x7f547c0fb930 msgr2=0x7f547c0ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.428+0000 7f54829ff700 1 -- 172.21.15.12:0/2872374346 shutdown_connections 2023-12-11T20:19:02.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.428+0000 7f54829ff700 1 -- 172.21.15.12:0/2872374346 wait complete. 2023-12-11T20:19:02.449 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:19:02.450 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:19:02.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.682+0000 7f3c8af9d700 1 -- 172.21.15.12:0/3175443000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c84104700 msgr2=0x7f3c84106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.682+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/3175443000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c84104700 0x7f3c84106af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c740098f0 tx=0x7f3c74009c00 comp rx=0 tx=0).stop 2023-12-11T20:19:02.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.682+0000 7f3c8af9d700 1 -- 172.21.15.12:0/3175443000 shutdown_connections 2023-12-11T20:19:02.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.682+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/3175443000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c84107030 0x7f3c84109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.682+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/3175443000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c84101dd0 0x7f3c841041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.682+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/3175443000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c84104700 0x7f3c84106af0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.682+0000 7f3c8af9d700 1 -- 172.21.15.12:0/3175443000 >> 172.21.15.12:0/3175443000 conn(0x7f3c840fb760 msgr2=0x7f3c840fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.682+0000 7f3c8af9d700 1 -- 172.21.15.12:0/3175443000 shutdown_connections 2023-12-11T20:19:02.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.683+0000 7f3c8af9d700 1 -- 172.21.15.12:0/3175443000 wait complete. 2023-12-11T20:19:02.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.684+0000 7f3c8af9d700 1 Processor -- start 2023-12-11T20:19:02.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.684+0000 7f3c8af9d700 1 -- start start 2023-12-11T20:19:02.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.684+0000 7f3c8af9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c84101dd0 0x7f3c841971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.684+0000 7f3c8af9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c84104700 0x7f3c84197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8af9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c84107030 0x7f3c8419e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8af9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8419ed10 con 0x7f3c84104700 2023-12-11T20:19:02.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8af9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8419ee50 con 0x7f3c84107030 2023-12-11T20:19:02.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8af9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8419efe0 con 0x7f3c84101dd0 2023-12-11T20:19:02.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8979a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c84104700 0x7f3c84197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c89f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c84101dd0 0x7f3c841971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8a79c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c84107030 0x7f3c8419e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8979a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c84104700 0x7f3c84197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55066/0 (socket says 172.21.15.12:55066) 2023-12-11T20:19:02.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8979a700 1 -- 172.21.15.12:0/1322317906 learned_addr learned my addr 172.21.15.12:0/1322317906 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c89f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c84101dd0 0x7f3c841971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47774/0 (socket says 172.21.15.12:47774) 2023-12-11T20:19:02.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8979a700 1 -- 172.21.15.12:0/1322317906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c84101dd0 msgr2=0x7f3c841971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.685+0000 7f3c8979a700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c84101dd0 0x7f3c841971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c8979a700 1 -- 172.21.15.12:0/1322317906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c84107030 msgr2=0x7f3c8419e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c8979a700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c84107030 0x7f3c8419e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c8979a700 1 -- 172.21.15.12:0/1322317906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c009d00 con 0x7f3c84104700 2023-12-11T20:19:02.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c8979a700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c84104700 0x7f3c84197720 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009810 tx=0x7f3c7400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c7affd700 1 -- 172.21.15.12:0/1322317906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7401c070 con 0x7f3c84104700 2023-12-11T20:19:02.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c7affd700 1 -- 172.21.15.12:0/1322317906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c7400f7b0 con 0x7f3c84104700 2023-12-11T20:19:02.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c74009520 con 0x7f3c84104700 2023-12-11T20:19:02.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c7affd700 1 -- 172.21.15.12:0/1322317906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c740038e0 con 0x7f3c84104700 2023-12-11T20:19:02.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.686+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8419f4f0 con 0x7f3c84104700 2023-12-11T20:19:02.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.688+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c840fd2e0 con 0x7f3c84104700 2023-12-11T20:19:02.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.690+0000 7f3c7affd700 1 -- 172.21.15.12:0/1322317906 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3c74020030 con 0x7f3c84104700 2023-12-11T20:19:02.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.692+0000 7f3c7affd700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c700a1480 0x7f3c700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.692+0000 7f3c7affd700 1 -- 172.21.15.12:0/1322317906 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3c740cded0 con 0x7f3c84104700 2023-12-11T20:19:02.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.692+0000 7f3c89f9b700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c700a1480 0x7f3c700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.693+0000 7f3c89f9b700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c700a1480 0x7f3c700a3940 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009c60 tx=0x7f3c80009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:02.700+0000 7f3c7affd700 1 -- 172.21.15.12:0/1322317906 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3c74097510 con 0x7f3c84104700 2023-12-11T20:19:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 -- 172.21.15.12:0/549766449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c104720 msgr2=0x7f3e9c106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 --2- 172.21.15.12:0/549766449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c104720 0x7f3e9c106b10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009990 tx=0x7f3e90009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 -- 172.21.15.12:0/549766449 shutdown_connections 2023-12-11T20:19:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 --2- 172.21.15.12:0/549766449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e9c101df0 0x7f3e9c1041e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 --2- 172.21.15.12:0/549766449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e9c107050 0x7f3e9c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 --2- 172.21.15.12:0/549766449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c104720 0x7f3e9c106b10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 -- 172.21.15.12:0/549766449 >> 172.21.15.12:0/549766449 conn(0x7f3e9c0fb780 msgr2=0x7f3e9c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 -- 172.21.15.12:0/549766449 shutdown_connections 2023-12-11T20:19:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.720+0000 7f3ea119d700 1 -- 172.21.15.12:0/549766449 wait complete. 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.721+0000 7f3ea119d700 1 Processor -- start 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.721+0000 7f3ea119d700 1 -- start start 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea119d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e9c101df0 0x7f3e9c1971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea119d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e9c104720 0x7f3e9c197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea119d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c107050 0x7f3e9c19e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea119d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c19ed00 con 0x7f3e9c107050 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea119d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c19ee40 con 0x7f3e9c104720 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea119d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c19efd0 con 0x7f3e9c101df0 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c107050 0x7f3e9c19e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c107050 0x7f3e9c19e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55088/0 (socket says 172.21.15.12:55088) 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3ea099c700 1 -- 172.21.15.12:0/681726547 learned_addr learned my addr 172.21.15.12:0/681726547 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e9c101df0 0x7f3e9c1971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.722+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e9c104720 0x7f3e9c197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3ea099c700 1 -- 172.21.15.12:0/681726547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e9c101df0 msgr2=0x7f3e9c1971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3ea099c700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e9c101df0 0x7f3e9c1971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3ea099c700 1 -- 172.21.15.12:0/681726547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e9c104720 msgr2=0x7f3e9c197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3ea099c700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e9c104720 0x7f3e9c197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3ea099c700 1 -- 172.21.15.12:0/681726547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900095f0 con 0x7f3e9c107050 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e9c101df0 0x7f3e9c1971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e9c104720 0x7f3e9c197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3ea099c700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c107050 0x7f3e9c19e730 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3e94007ee0 tx=0x7f3e9400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3e997fa700 1 -- 172.21.15.12:0/681726547 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9400ddd0 con 0x7f3e9c107050 2023-12-11T20:19:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3ea119d700 1 -- 172.21.15.12:0/681726547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9c19f2b0 con 0x7f3e9c107050 2023-12-11T20:19:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3e997fa700 1 -- 172.21.15.12:0/681726547 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e9400f040 con 0x7f3e9c107050 2023-12-11T20:19:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.723+0000 7f3e997fa700 1 -- 172.21.15.12:0/681726547 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e940047d0 con 0x7f3e9c107050 2023-12-11T20:19:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.724+0000 7f3ea119d700 1 -- 172.21.15.12:0/681726547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c19f7c0 con 0x7f3e9c107050 2023-12-11T20:19:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.728+0000 7f3e997fa700 1 -- 172.21.15.12:0/681726547 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3e94003a00 con 0x7f3e9c107050 2023-12-11T20:19:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.729+0000 7f3eb5e1db80 1 Processor -- start 2023-12-11T20:19:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.729+0000 7f3eb5e1db80 1 -- start start 2023-12-11T20:19:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.729+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.729+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.729+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.729+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe951caf0 con 0x55fbe95caf90 2023-12-11T20:19:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.729+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe951a410 con 0x55fbe95c64e0 2023-12-11T20:19:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.729+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe9515d00 con 0x55fbe95c5b80 2023-12-11T20:19:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55102/0 (socket says 172.21.15.12:55102) 2023-12-11T20:19:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/2113470081 learned_addr learned my addr 172.21.15.12:0/2113470081 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e997fa700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e840a14f0 0x7f3e840a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/2113470081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 msgr2=0x55fbe95c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/2113470081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 msgr2=0x55fbe95caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e997fa700 1 -- 172.21.15.12:0/681726547 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3e940cc640 con 0x7f3e9c107050 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/2113470081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbe93925d0 con 0x55fbe95caf90 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.730+0000 7f3ea099c700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e840a14f0 0x7f3e840a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.731+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95cd3a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000b2e0 tx=0x7f3e9001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3eaa05e11e64181 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.731+0000 7f3e827fc700 1 -- 172.21.15.12:0/2113470081 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90003b60 con 0x55fbe95caf90 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.731+0000 7f3e827fc700 1 -- 172.21.15.12:0/2113470081 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e9001e070 con 0x55fbe95caf90 2023-12-11T20:19:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.731+0000 7f3e827fc700 1 -- 172.21.15.12:0/2113470081 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000f660 con 0x55fbe95caf90 2023-12-11T20:19:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2113470081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 msgr2=0x55fbe95cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3ea099c700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e840a14f0 0x7f3e840a39b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e940042c0 tx=0x7f3e94004210 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95cd3a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000b2e0 tx=0x7f3e9001a040 comp rx=0 tx=0).stop 2023-12-11T20:19:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2113470081 shutdown_connections 2023-12-11T20:19:02.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95cd3a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2113470081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2113470081 >> 172.21.15.12:0/2113470081 conn(0x55fbe94f0780 msgr2=0x55fbe95bdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2113470081 shutdown_connections 2023-12-11T20:19:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.732+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2113470081 wait complete. 2023-12-11T20:19:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.733+0000 7f3eb5e1db80 1 -- start start 2023-12-11T20:19:02.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.733+0000 7f3eb5e1db80 1 Processor -- start 2023-12-11T20:19:02.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.734+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.734+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.734+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.734+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe94cf500 con 0x55fbe95caf90 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.734+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe94cf1a0 con 0x55fbe95c64e0 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.734+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe93948c0 con 0x55fbe95c5b80 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.734+0000 7f3eb5e1db80 10 client.0 _ll_register_callbacks cb 0x55fbe93faa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55112/0 (socket says 172.21.15.12:55112) 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/2511456657 learned_addr learned my addr 172.21.15.12:0/2511456657 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9bfff700 1 -- 172.21.15.12:0/2511456657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 msgr2=0x55fbe95cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9bfff700 1 -- 172.21.15.12:0/2511456657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 msgr2=0x55fbe95d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9bfff700 1 -- 172.21.15.12:0/2511456657 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c10a030 con 0x55fbe95c64e0 2023-12-11T20:19:02.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.735+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.736+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95cf7d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c012d00 tx=0x7f3e8c00f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2776f93b49ede7d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.736+0000 7f3e7b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.736+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/2511456657 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c017070 con 0x55fbe95c64e0 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.736+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/2511456657 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3e8c00fc30 con 0x55fbe95c64e0 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.736+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2511456657 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbe95b4730 con 0x55fbe95c64e0 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.736+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/2511456657 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e8c00fdf0 con 0x55fbe95c64e0 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.736+0000 7f3eb5e1db80 10 client.26102 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.736+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2511456657 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55fbe933ed80 con 0x55fbe95c64e0 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.737+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/2511456657 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fbe95b4730 con 0x55fbe95c64e0 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.737+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/2511456657 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3e8c003c60 con 0x55fbe95c64e0 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.737+0000 7f3eb5e1db80 10 client.26102 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.737+0000 7f3eb5e1db80 10 client.26102 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.737+0000 7f3eb5e1db80 20 client.26102 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:02.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.737+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbe95db100 0x55fbe95dd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.737+0000 7f3eb5e1db80 4 client.26102 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.737+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2511456657 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbe9590ee0 con 0x55fbe95db100 2023-12-11T20:19:02.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.738+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbe95db100 0x55fbe95dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.738+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbe95db100 0x55fbe95dd520 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50624bfe894e8c1e server_cookie=38aafceee0dc2783 in_seq=0 out_seq=0 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.738+0000 7f3e7b7fe700 10 client.26102 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.739+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/2511456657 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fbe9590ee0 con 0x55fbe95db100 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.739+0000 7f3e7b7fe700 10 client.26102 handle_command_reply: tid=0 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.739+0000 7f3eb5e1db80 1 client.26102 shutdown 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 msgr2=0x55fbe95cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95cf7d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c012d00 tx=0x7f3e8c00f6a0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2511456657 shutdown_connections 2023-12-11T20:19:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbe95db100 0x55fbe95dd520 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c5b80 0x55fbe95cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2511456657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c64e0 0x55fbe95cf7d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2511456657 >> 172.21.15.12:0/2511456657 conn(0x55fbe94f0780 msgr2=0x55fbe95be560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3e7b7fe700 0 client.26102 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2511456657 shutdown_connections 2023-12-11T20:19:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2511456657 wait complete. 2023-12-11T20:19:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.740+0000 7f3eb5e1db80 20 client.26102 trim_cache size 0 max 16384 2023-12-11T20:19:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.759+0000 7f3eb5e1db80 1 Processor -- start 2023-12-11T20:19:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.759+0000 7f3eb5e1db80 1 -- start start 2023-12-11T20:19:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.759+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 0x55fbe95c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.759+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.759+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.759+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe95cee30 con 0x55fbe95caf90 2023-12-11T20:19:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.759+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe95d6c70 con 0x55fbe95c5b80 2023-12-11T20:19:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.759+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe95daef0 con 0x55fbe95c64e0 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47816/0 (socket says 172.21.15.12:47816) 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9bfff700 1 -- 172.21.15.12:0/2104824759 learned_addr learned my addr 172.21.15.12:0/2104824759 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/2104824759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 0x55fbe95c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9bfff700 1 -- 172.21.15.12:0/2104824759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 msgr2=0x55fbe95c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/2104824759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 0x55fbe95c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9bfff700 1 -- 172.21.15.12:0/2104824759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 msgr2=0x55fbe95ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/2104824759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.760+0000 7f3e9bfff700 1 -- 172.21.15.12:0/2104824759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbe9327c00 con 0x55fbe95c64e0 2023-12-11T20:19:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.761+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/2104824759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d6730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c010790 tx=0x7f3e8c010810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c44f2e8543c858a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.761+0000 7f3e82ffd700 1 -- 172.21.15.12:0/2104824759 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c017070 con 0x55fbe95c64e0 2023-12-11T20:19:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.761+0000 7f3e82ffd700 1 -- 172.21.15.12:0/2104824759 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e8c018040 con 0x55fbe95c64e0 2023-12-11T20:19:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.761+0000 7f3e82ffd700 1 -- 172.21.15.12:0/2104824759 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c004b70 con 0x55fbe95c64e0 2023-12-11T20:19:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2104824759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 msgr2=0x55fbe95d6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2104824759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d6730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c010790 tx=0x7f3e8c010810 comp rx=0 tx=0).stop 2023-12-11T20:19:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2104824759 shutdown_connections 2023-12-11T20:19:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2104824759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 0x55fbe95c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2104824759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/2104824759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d6730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2104824759 >> 172.21.15.12:0/2104824759 conn(0x55fbe94f0780 msgr2=0x55fbe95cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2104824759 shutdown_connections 2023-12-11T20:19:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.763+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/2104824759 wait complete. 2023-12-11T20:19:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.764+0000 7f3eb5e1db80 1 -- start start 2023-12-11T20:19:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.765+0000 7f3eb5e1db80 1 Processor -- start 2023-12-11T20:19:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.765+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 0x55fbe95d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.765+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.765+0000 7f3eb5e1db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.765+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe95d5d70 con 0x55fbe95caf90 2023-12-11T20:19:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.765+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe95d5ee0 con 0x55fbe95c5b80 2023-12-11T20:19:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.765+0000 7f3eb5e1db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe95d60a0 con 0x55fbe95c64e0 2023-12-11T20:19:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.765+0000 7f3eb5e1db80 10 client.0 _ll_register_callbacks cb 0x55fbe93faa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55124/0 (socket says 172.21.15.12:55124) 2023-12-11T20:19:02.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/3601475074 learned_addr learned my addr 172.21.15.12:0/3601475074 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:02.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/3601475074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 msgr2=0x55fbe95d4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/3601475074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 msgr2=0x55fbe95d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:02.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 0x55fbe95d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.766+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/3601475074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbe933ed80 con 0x55fbe95caf90 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.767+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d5830 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005950 tx=0x7f3e900057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc23ef9ec6186fc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.767+0000 7f3e7b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.767+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/3601475074 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90005c40 con 0x55fbe95caf90 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.767+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/3601475074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e9001e070 con 0x55fbe95caf90 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.767+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/3601475074 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3e90003960 con 0x55fbe95caf90 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.768+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/3601475074 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e90003b20 con 0x55fbe95caf90 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.768+0000 7f3eb5e1db80 10 client.16347 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.768+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/3601475074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55fbe93651f0 con 0x55fbe95caf90 2023-12-11T20:19:02.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.768+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/3601475074 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e9001e070 con 0x55fbe95caf90 2023-12-11T20:19:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.768+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/3601475074 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3e90039d20 con 0x55fbe95caf90 2023-12-11T20:19:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.768+0000 7f3eb5e1db80 10 client.16347 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.769+0000 7f3eb5e1db80 10 client.16347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.769+0000 7f3eb5e1db80 20 client.16347 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:02.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.769+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbe9631fc0 0x55fbe96343e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.769+0000 7f3eb5e1db80 4 client.16347 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:19:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.769+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/3601475074 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fbe94dbf70 con 0x55fbe9631fc0 2023-12-11T20:19:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.769+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbe9631fc0 0x55fbe96343e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.770+0000 7f3e7b7fe700 10 client.16347 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:02.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.770+0000 7f3e9bfff700 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbe9631fc0 0x55fbe96343e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f7e8faade1c7793 server_cookie=6543361caa1fe9da in_seq=0 out_seq=0 2023-12-11T20:19:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3e7b7fe700 1 -- 172.21.15.12:0/3601475074 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fbe94dbf70 con 0x55fbe9631fc0 2023-12-11T20:19:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3e7b7fe700 10 client.16347 handle_command_reply: tid=0 2023-12-11T20:19:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 client.16347 shutdown 2023-12-11T20:19:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/3601475074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 msgr2=0x55fbe95d5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d5830 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005950 tx=0x7f3e900057e0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/3601475074 shutdown_connections 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fbe9631fc0 0x55fbe96343e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fbe95c5b80 0x55fbe95d42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbe95caf90 0x55fbe95d5830 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 --2- 172.21.15.12:0/3601475074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fbe95c64e0 0x55fbe95d4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3e7b7fe700 0 client.16347 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/3601475074 >> 172.21.15.12:0/3601475074 conn(0x55fbe94f0780 msgr2=0x55fbe95ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/3601475074 shutdown_connections 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.780+0000 7f3eb5e1db80 1 -- 172.21.15.12:0/3601475074 wait complete. 2023-12-11T20:19:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.781+0000 7f3eb5e1db80 20 client.16347 trim_cache size 0 max 16384 2023-12-11T20:19:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:19:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:19:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:19:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:19:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.781+0000 7f3ea119d700 1 -- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e840a14f0 msgr2=0x7f3e840a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.781+0000 7f3ea119d700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e840a14f0 0x7f3e840a39b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e940042c0 tx=0x7f3e94004210 comp rx=0 tx=0).stop 2023-12-11T20:19:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.781+0000 7f3ea119d700 1 -- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c107050 msgr2=0x7f3e9c19e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.781+0000 7f3ea119d700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c107050 0x7f3e9c19e730 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3e94007ee0 tx=0x7f3e9400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.782+0000 7f3ea119d700 1 -- 172.21.15.12:0/681726547 shutdown_connections 2023-12-11T20:19:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.782+0000 7f3ea119d700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3e840a14f0 0x7f3e840a39b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.782+0000 7f3ea119d700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e9c107050 0x7f3e9c19e730 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.782+0000 7f3ea119d700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e9c101df0 0x7f3e9c1971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.782+0000 7f3ea119d700 1 --2- 172.21.15.12:0/681726547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e9c104720 0x7f3e9c197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.782+0000 7f3ea119d700 1 -- 172.21.15.12:0/681726547 >> 172.21.15.12:0/681726547 conn(0x7f3e9c0fb780 msgr2=0x7f3e9c102750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.782+0000 7f3ea119d700 1 -- 172.21.15.12:0/681726547 shutdown_connections 2023-12-11T20:19:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:02.782+0000 7f3ea119d700 1 -- 172.21.15.12:0/681726547 wait complete. 2023-12-11T20:19:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.002+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c8404f300 con 0x7f3c84104700 2023-12-11T20:19:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.003+0000 7f3c7affd700 1 -- 172.21.15.12:0/1322317906 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f3c7409ab30 con 0x7f3c84104700 2023-12-11T20:19:03.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:19:03.002 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:17:06.102424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:19:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c700a1480 msgr2=0x7f3c700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c700a1480 0x7f3c700a3940 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009c60 tx=0x7f3c80009260 comp rx=0 tx=0).stop 2023-12-11T20:19:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c84104700 msgr2=0x7f3c84197720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c84104700 0x7f3c84197720 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009810 tx=0x7f3c7400b790 comp rx=0 tx=0).stop 2023-12-11T20:19:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 shutdown_connections 2023-12-11T20:19:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3c700a1480 0x7f3c700a3940 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c84107030 0x7f3c8419e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c84101dd0 0x7f3c841971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 --2- 172.21.15.12:0/1322317906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c84104700 0x7f3c84197720 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 >> 172.21.15.12:0/1322317906 conn(0x7f3c840fb760 msgr2=0x7f3c84103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 shutdown_connections 2023-12-11T20:19:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.006+0000 7f3c8af9d700 1 -- 172.21.15.12:0/1322317906 wait complete. 2023-12-11T20:19:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 24 2023-12-11T20:19:03.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:19:03.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/245040684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4075610 msgr2=0x7ff2b4073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/245040684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4075610 0x7ff2b4073a60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009990 tx=0x7ff2a4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/245040684 shutdown_connections 2023-12-11T20:19:03.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/245040684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2b410da80 0x7ff2b410fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/245040684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4075610 0x7ff2b4073a60 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/245040684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b4074030 0x7ff2b40744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/245040684 >> 172.21.15.12:0/245040684 conn(0x7ff2b40fca00 msgr2=0x7ff2b40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/245040684 shutdown_connections 2023-12-11T20:19:03.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.304+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/245040684 wait complete. 2023-12-11T20:19:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2ba1ff700 1 Processor -- start 2023-12-11T20:19:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2ba1ff700 1 -- start start 2023-12-11T20:19:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2ba1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4074030 0x7ff2b419d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2ba1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b4075610 0x7ff2b419de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2ba1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2b410da80 0x7ff2b41a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2ba1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41a5450 con 0x7ff2b4074030 2023-12-11T20:19:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2ba1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41a5590 con 0x7ff2b410da80 2023-12-11T20:19:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2ba1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41a5720 con 0x7ff2b4075610 2023-12-11T20:19:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.306+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4074030 0x7ff2b419d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4074030 0x7ff2b419d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55134/0 (socket says 172.21.15.12:55134) 2023-12-11T20:19:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b37fe700 1 -- 172.21.15.12:0/2639485053 learned_addr learned my addr 172.21.15.12:0/2639485053 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b3fff700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2b410da80 0x7ff2b41a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b4075610 0x7ff2b419de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b37fe700 1 -- 172.21.15.12:0/2639485053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b4075610 msgr2=0x7ff2b419de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b4075610 0x7ff2b419de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b37fe700 1 -- 172.21.15.12:0/2639485053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2b410da80 msgr2=0x7ff2b41a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2b410da80 0x7ff2b41a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b37fe700 1 -- 172.21.15.12:0/2639485053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40095f0 con 0x7ff2b4074030 2023-12-11T20:19:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.307+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4074030 0x7ff2b419d920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4006010 tx=0x7ff2a4009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.308+0000 7ff2b0ff9700 1 -- 172.21.15.12:0/2639485053 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a401d070 con 0x7ff2b4074030 2023-12-11T20:19:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.308+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/2639485053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b41a59a0 con 0x7ff2b4074030 2023-12-11T20:19:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.308+0000 7ff2b0ff9700 1 -- 172.21.15.12:0/2639485053 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2a400f460 con 0x7ff2b4074030 2023-12-11T20:19:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.308+0000 7ff2b0ff9700 1 -- 172.21.15.12:0/2639485053 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4021670 con 0x7ff2b4074030 2023-12-11T20:19:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.308+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/2639485053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b41a5dd0 con 0x7ff2b4074030 2023-12-11T20:19:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.311+0000 7ff2b0ff9700 1 -- 172.21.15.12:0/2639485053 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff2a400f5d0 con 0x7ff2b4074030 2023-12-11T20:19:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.313+0000 7ff2b0ff9700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff29c0a1480 0x7ff29c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.313+0000 7ff2b0ff9700 1 -- 172.21.15.12:0/2639485053 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff2a40ce1b0 con 0x7ff2b4074030 2023-12-11T20:19:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.313+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff29c0a1480 0x7ff29c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.313+0000 7ff2cda46b80 1 Processor -- start 2023-12-11T20:19:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.313+0000 7ff2cda46b80 1 -- start start 2023-12-11T20:19:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 0x5562e3c717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 0x5562e3c72640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c72c20 0x5562e3c730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3bccb50 con 0x5562e3c72c20 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3bca470 con 0x5562e3c71d30 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3bc5d60 con 0x5562e3c713d0 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff29c0a1480 0x7ff29c0a3940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4075330 tx=0x7ff2a8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c72c20 0x5562e3c730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c72c20 0x5562e3c730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55150/0 (socket says 172.21.15.12:55150) 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2b3fff700 1 -- 172.21.15.12:0/288882 learned_addr learned my addr 172.21.15.12:0/288882 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 0x5562e3c717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.314+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 0x5562e3c72640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff2b3fff700 1 -- 172.21.15.12:0/288882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 msgr2=0x5562e3c717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff2b3fff700 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 0x5562e3c717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff2b3fff700 1 -- 172.21.15.12:0/288882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 msgr2=0x5562e3c72640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff2b3fff700 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 0x5562e3c72640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff2b3fff700 1 -- 172.21.15.12:0/288882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e3a42630 con 0x5562e3c72c20 2023-12-11T20:19:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff2b3fff700 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c72c20 0x5562e3c730a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009440 tx=0x7ff2ac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633fb37bc943c23f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff299ffb700 1 -- 172.21.15.12:0/288882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00e070 con 0x5562e3c72c20 2023-12-11T20:19:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff299ffb700 1 -- 172.21.15.12:0/288882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2ac00f040 con 0x5562e3c72c20 2023-12-11T20:19:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.315+0000 7ff299ffb700 1 -- 172.21.15.12:0/288882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac015a10 con 0x5562e3c72c20 2023-12-11T20:19:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.316+0000 7ff2cda46b80 1 -- 172.21.15.12:0/288882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c72c20 msgr2=0x5562e3c730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.316+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c72c20 0x5562e3c730a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009440 tx=0x7ff2ac009920 comp rx=0 tx=0).stop 2023-12-11T20:19:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.316+0000 7ff2cda46b80 1 -- 172.21.15.12:0/288882 shutdown_connections 2023-12-11T20:19:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.316+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c72c20 0x5562e3c730a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.316+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 0x5562e3c717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.316+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/288882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 0x5562e3c72640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.316+0000 7ff2cda46b80 1 -- 172.21.15.12:0/288882 >> 172.21.15.12:0/288882 conn(0x5562e3ba07e0 msgr2=0x5562e3c6dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.316+0000 7ff2cda46b80 1 -- 172.21.15.12:0/288882 shutdown_connections 2023-12-11T20:19:03.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.317+0000 7ff2cda46b80 1 -- 172.21.15.12:0/288882 wait complete. 2023-12-11T20:19:03.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.317+0000 7ff2cda46b80 1 -- start start 2023-12-11T20:19:03.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.317+0000 7ff2cda46b80 1 Processor -- start 2023-12-11T20:19:03.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c7b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c71d30 0x5562e3c7b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c82700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3b7f560 con 0x5562e3c713d0 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3b7f200 con 0x5562e3c72c20 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3a44920 con 0x5562e3c71d30 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2cda46b80 10 client.0 _ll_register_callbacks cb 0x5562e3aaaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c7b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c7b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55160/0 (socket says 172.21.15.12:55160) 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b37fe700 1 -- 172.21.15.12:0/425656685 learned_addr learned my addr 172.21.15.12:0/425656685 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b3fff700 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c82700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b37fe700 1 -- 172.21.15.12:0/425656685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c71d30 msgr2=0x5562e3c7b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c71d30 0x5562e3c7b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b37fe700 1 -- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 msgr2=0x5562e3c82700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c82700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.318+0000 7ff2b37fe700 1 -- 172.21.15.12:0/425656685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ac0090f0 con 0x5562e3c713d0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff2b3fff700 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c82700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c7b180 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4028000 tx=0x7ff2a409af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de19161309a61fe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff292ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff292ffd700 1 -- 172.21.15.12:0/425656685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40a3520 con 0x5562e3c713d0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff292ffd700 1 -- 172.21.15.12:0/425656685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff2a409bbb0 con 0x5562e3c713d0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff2cda46b80 1 -- 172.21.15.12:0/425656685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562e3c64b40 con 0x5562e3c713d0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff292ffd700 1 -- 172.21.15.12:0/425656685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2a409b4b0 con 0x5562e3c713d0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff2cda46b80 10 client.16359 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.319+0000 7ff2cda46b80 1 -- 172.21.15.12:0/425656685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5562e39eede0 con 0x5562e3c713d0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.320+0000 7ff292ffd700 1 -- 172.21.15.12:0/425656685 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5562e3c64b40 con 0x5562e3c713d0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.320+0000 7ff292ffd700 1 -- 172.21.15.12:0/425656685 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff2a4084c70 con 0x5562e3c713d0 2023-12-11T20:19:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.320+0000 7ff2cda46b80 10 client.16359 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.320+0000 7ff2cda46b80 10 client.16359 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:19:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.320+0000 7ff2cda46b80 20 client.16359 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.320+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5562e3c86c00 0x5562e3c89020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.320+0000 7ff2cda46b80 4 client.16359 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.320+0000 7ff2cda46b80 1 -- 172.21.15.12:0/425656685 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562e3c40f40 con 0x5562e3c86c00 2023-12-11T20:19:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.321+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5562e3c86c00 0x5562e3c89020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.321+0000 7ff292ffd700 10 client.16359 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:19:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.321+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5562e3c86c00 0x5562e3c89020 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f07758d514f8755d server_cookie=2bdb3eadde745bf in_seq=0 out_seq=0 2023-12-11T20:19:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.322+0000 7ff292ffd700 1 -- 172.21.15.12:0/425656685 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5562e3c40f40 con 0x5562e3c86c00 2023-12-11T20:19:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.322+0000 7ff292ffd700 10 client.16359 handle_command_reply: tid=0 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.322+0000 7ff2cda46b80 1 client.16359 shutdown 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.322+0000 7ff2cda46b80 1 -- 172.21.15.12:0/425656685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 msgr2=0x5562e3c7b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.322+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c7b180 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4028000 tx=0x7ff2a409af40 comp rx=0 tx=0).stop 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 1 -- 172.21.15.12:0/425656685 shutdown_connections 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5562e3c86c00 0x5562e3c89020 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c82700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c7b180 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/425656685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c71d30 0x5562e3c7b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff292ffd700 0 client.16359 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 1 -- 172.21.15.12:0/425656685 >> 172.21.15.12:0/425656685 conn(0x5562e3ba07e0 msgr2=0x5562e3c6ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 1 -- 172.21.15.12:0/425656685 shutdown_connections 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 1 -- 172.21.15.12:0/425656685 wait complete. 2023-12-11T20:19:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.323+0000 7ff2cda46b80 20 client.16359 trim_cache size 0 max 16384 2023-12-11T20:19:03.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:03 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1322317906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:19:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2cda46b80 1 Processor -- start 2023-12-11T20:19:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2cda46b80 1 -- start start 2023-12-11T20:19:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c73020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 0x5562e3c826c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c72c20 0x5562e3c6d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3c72110 con 0x5562e3c713d0 2023-12-11T20:19:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3c8e1f0 con 0x5562e3c71d30 2023-12-11T20:19:03.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3c766a0 con 0x5562e3c72c20 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c73020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c73020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55166/0 (socket says 172.21.15.12:55166) 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.342+0000 7ff2b37fe700 1 -- 172.21.15.12:0/649047360 learned_addr learned my addr 172.21.15.12:0/649047360 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff2b3fff700 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c72c20 0x5562e3c6d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 0x5562e3c826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff2b37fe700 1 -- 172.21.15.12:0/649047360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c72c20 msgr2=0x5562e3c6d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c72c20 0x5562e3c6d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff2b37fe700 1 -- 172.21.15.12:0/649047360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 msgr2=0x5562e3c826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 0x5562e3c826c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff2b37fe700 1 -- 172.21.15.12:0/649047360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e39d7c60 con 0x5562e3c713d0 2023-12-11T20:19:03.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c73020 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff2a409b440 tx=0x7ff2a4097880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106c8aebca773eb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff29a7fc700 1 -- 172.21.15.12:0/649047360 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40a3520 con 0x5562e3c713d0 2023-12-11T20:19:03.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff29a7fc700 1 -- 172.21.15.12:0/649047360 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2a40b8030 con 0x5562e3c713d0 2023-12-11T20:19:03.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.343+0000 7ff29a7fc700 1 -- 172.21.15.12:0/649047360 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4084d90 con 0x5562e3c713d0 2023-12-11T20:19:03.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 -- 172.21.15.12:0/649047360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 msgr2=0x5562e3c73020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c73020 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff2a409b440 tx=0x7ff2a4097880 comp rx=0 tx=0).stop 2023-12-11T20:19:03.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 -- 172.21.15.12:0/649047360 shutdown_connections 2023-12-11T20:19:03.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c72c20 0x5562e3c6d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c713d0 0x5562e3c73020 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/649047360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c71d30 0x5562e3c826c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 -- 172.21.15.12:0/649047360 >> 172.21.15.12:0/649047360 conn(0x5562e3ba07e0 msgr2=0x5562e3c75b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 -- 172.21.15.12:0/649047360 shutdown_connections 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.344+0000 7ff2cda46b80 1 -- 172.21.15.12:0/649047360 wait complete. 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.345+0000 7ff2cda46b80 1 -- start start 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.345+0000 7ff2cda46b80 1 Processor -- start 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.345+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 0x5562e3c7e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.345+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c71d30 0x5562e3c7eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.345+0000 7ff2cda46b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c81a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.345+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3c81f50 con 0x5562e3c71d30 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.345+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3c820c0 con 0x5562e3c72c20 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.345+0000 7ff2cda46b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3c82280 con 0x5562e3c713d0 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2cda46b80 10 client.0 _ll_register_callbacks cb 0x5562e3aaaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c71d30 0x5562e3c7eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c71d30 0x5562e3c7eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55174/0 (socket says 172.21.15.12:55174) 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b2ffd700 1 -- 172.21.15.12:0/2786576481 learned_addr learned my addr 172.21.15.12:0/2786576481 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b3fff700 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c81a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 0x5562e3c7e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b2ffd700 1 -- 172.21.15.12:0/2786576481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 msgr2=0x5562e3c7e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 0x5562e3c7e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b2ffd700 1 -- 172.21.15.12:0/2786576481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 msgr2=0x5562e3c81a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c81a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.346+0000 7ff2b2ffd700 1 -- 172.21.15.12:0/2786576481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562e39eede0 con 0x5562e3c71d30 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.347+0000 7ff2b2ffd700 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c71d30 0x5562e3c7eae0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80097d0 tx=0x7ff2a8014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0dd98ecc552e23e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.347+0000 7ff292ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.347+0000 7ff292ffd700 1 -- 172.21.15.12:0/2786576481 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8028ea0 con 0x5562e3c71d30 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.347+0000 7ff2cda46b80 1 -- 172.21.15.12:0/2786576481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2ac00f040 con 0x5562e3c71d30 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.347+0000 7ff292ffd700 1 -- 172.21.15.12:0/2786576481 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff2a8025070 con 0x5562e3c71d30 2023-12-11T20:19:03.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.347+0000 7ff292ffd700 1 -- 172.21.15.12:0/2786576481 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2a80285f0 con 0x5562e3c71d30 2023-12-11T20:19:03.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.347+0000 7ff2cda46b80 10 client.16365 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:03.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.347+0000 7ff2cda46b80 1 -- 172.21.15.12:0/2786576481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5562e3a15250 con 0x5562e3c71d30 2023-12-11T20:19:03.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff292ffd700 1 -- 172.21.15.12:0/2786576481 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2ac00f040 con 0x5562e3c71d30 2023-12-11T20:19:03.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff292ffd700 1 -- 172.21.15.12:0/2786576481 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff2a8012450 con 0x5562e3c71d30 2023-12-11T20:19:03.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff2cda46b80 10 client.16365 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:03.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff2cda46b80 10 client.16365 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff2cda46b80 20 client.16365 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5562e3cde140 0x5562e3ce0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff2cda46b80 4 client.16365 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff2cda46b80 1 -- 172.21.15.12:0/2786576481 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5562e3b8bfd0 con 0x5562e3cde140 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.348+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5562e3cde140 0x5562e3ce0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2b37fe700 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5562e3cde140 0x5562e3ce0560 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a072267acab280ad server_cookie=86be9c097cf44d01 in_seq=0 out_seq=0 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff292ffd700 10 client.16365 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff292ffd700 1 -- 172.21.15.12:0/2786576481 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5562e3b8bfd0 con 0x5562e3cde140 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff292ffd700 10 client.16365 handle_command_reply: tid=0 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 client.16365 shutdown 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 -- 172.21.15.12:0/2786576481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c71d30 msgr2=0x5562e3c7eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c71d30 0x5562e3c7eae0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80097d0 tx=0x7ff2a8014070 comp rx=0 tx=0).stop 2023-12-11T20:19:03.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 -- 172.21.15.12:0/2786576481 shutdown_connections 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5562e3cde140 0x5562e3ce0560 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5562e3c72c20 0x5562e3c81a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5562e3c713d0 0x5562e3c7e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 --2- 172.21.15.12:0/2786576481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562e3c71d30 0x5562e3c7eae0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff292ffd700 0 client.16365 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.349+0000 7ff2cda46b80 1 -- 172.21.15.12:0/2786576481 >> 172.21.15.12:0/2786576481 conn(0x5562e3ba07e0 msgr2=0x5562e3c6d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2cda46b80 1 -- 172.21.15.12:0/2786576481 shutdown_connections 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2cda46b80 1 -- 172.21.15.12:0/2786576481 wait complete. 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2cda46b80 20 client.16365 trim_cache size 0 max 16384 2023-12-11T20:19:03.352 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:19:03.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff29c0a1480 msgr2=0x7ff29c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff29c0a1480 0x7ff29c0a3940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4075330 tx=0x7ff2a8009260 comp rx=0 tx=0).stop 2023-12-11T20:19:03.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4074030 msgr2=0x7ff2b419d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4074030 0x7ff2b419d920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4006010 tx=0x7ff2a4009510 comp rx=0 tx=0).stop 2023-12-11T20:19:03.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/2639485053 shutdown_connections 2023-12-11T20:19:03.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff29c0a1480 0x7ff29c0a3940 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2b410da80 0x7ff2b41a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2b4074030 0x7ff2b419d920 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 --2- 172.21.15.12:0/2639485053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2b4075610 0x7ff2b419de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.350+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/2639485053 >> 172.21.15.12:0/2639485053 conn(0x7ff2b40fca00 msgr2=0x7ff2b4100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.351+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/2639485053 shutdown_connections 2023-12-11T20:19:03.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.351+0000 7ff2ba1ff700 1 -- 172.21.15.12:0/2639485053 wait complete. 2023-12-11T20:19:03.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:19:03.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:03 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1322317906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:19:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:03 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1322317906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:19:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 -- 172.21.15.12:0/950387581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 msgr2=0x7fe648100820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/950387581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 0x7fe648100820 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe6380099c0 tx=0x7fe638009cd0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 -- 172.21.15.12:0/950387581 shutdown_connections 2023-12-11T20:19:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/950387581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe648101f90 0x7fe648108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/950387581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 0x7fe648100820 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/950387581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6481015f0 0x7fe648101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 -- 172.21.15.12:0/950387581 >> 172.21.15.12:0/950387581 conn(0x7fe6480fb930 msgr2=0x7fe6480fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 -- 172.21.15.12:0/950387581 shutdown_connections 2023-12-11T20:19:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.598+0000 7fe64e3ff700 1 -- 172.21.15.12:0/950387581 wait complete. 2023-12-11T20:19:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.599+0000 7fe64e3ff700 1 Processor -- start 2023-12-11T20:19:03.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.599+0000 7fe64e3ff700 1 -- start start 2023-12-11T20:19:03.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe64e3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 0x7fe648199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe64e3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6481015f0 0x7fe648199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe64e3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe648101f90 0x7fe6481a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe64e3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6481a1080 con 0x7fe648100400 2023-12-11T20:19:03.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe64e3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6481a11c0 con 0x7fe648101f90 2023-12-11T20:19:03.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe64e3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6481a1350 con 0x7fe6481015f0 2023-12-11T20:19:03.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe647fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 0x7fe648199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe647fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 0x7fe648199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55194/0 (socket says 172.21.15.12:55194) 2023-12-11T20:19:03.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.600+0000 7fe647fff700 1 -- 172.21.15.12:0/1725719547 learned_addr learned my addr 172.21.15.12:0/1725719547 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe64c99c700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe648101f90 0x7fe6481a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe6477fe700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6481015f0 0x7fe648199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe647fff700 1 -- 172.21.15.12:0/1725719547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6481015f0 msgr2=0x7fe648199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe647fff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6481015f0 0x7fe648199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe647fff700 1 -- 172.21.15.12:0/1725719547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe648101f90 msgr2=0x7fe6481a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe647fff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe648101f90 0x7fe6481a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe647fff700 1 -- 172.21.15.12:0/1725719547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380095f0 con 0x7fe648100400 2023-12-11T20:19:03.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe64c99c700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe648101f90 0x7fe6481a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:03.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe647fff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 0x7fe648199550 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe638009f50 tx=0x7fe638005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe6457fa700 1 -- 172.21.15.12:0/1725719547 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63801d070 con 0x7fe648100400 2023-12-11T20:19:03.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe6457fa700 1 -- 172.21.15.12:0/1725719547 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe63800bda0 con 0x7fe648100400 2023-12-11T20:19:03.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe64e3ff700 1 -- 172.21.15.12:0/1725719547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6481a15d0 con 0x7fe648100400 2023-12-11T20:19:03.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.601+0000 7fe6457fa700 1 -- 172.21.15.12:0/1725719547 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638022d20 con 0x7fe648100400 2023-12-11T20:19:03.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.602+0000 7fe64e3ff700 1 -- 172.21.15.12:0/1725719547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6481a1a30 con 0x7fe648100400 2023-12-11T20:19:03.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.605+0000 7fe6457fa700 1 -- 172.21.15.12:0/1725719547 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe638003f80 con 0x7fe648100400 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.606+0000 7fe661ddab80 1 Processor -- start 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.607+0000 7fe661ddab80 1 -- start start 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.607+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.607+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fdd30 0x55e5f83fe640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.607+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fec20 0x55e5f83ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.607+0000 7fe661ddab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f8358b50 con 0x55e5f83fd3d0 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.607+0000 7fe661ddab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f8356470 con 0x55e5f83fdd30 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.607+0000 7fe661ddab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f8351d60 con 0x55e5f83fec20 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.607+0000 7fe64c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe64c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83fd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55200/0 (socket says 172.21.15.12:55200) 2023-12-11T20:19:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe64c99c700 1 -- 172.21.15.12:0/3172906930 learned_addr learned my addr 172.21.15.12:0/3172906930 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe6477fe700 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fec20 0x55e5f83ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe647fff700 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fdd30 0x55e5f83fe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe6457fa700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe6300a1480 0x7fe6300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe6457fa700 1 -- 172.21.15.12:0/1725719547 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe6380ce0e0 con 0x7fe648100400 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe6477fe700 1 -- 172.21.15.12:0/3172906930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fdd30 msgr2=0x55e5f83fe640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe6477fe700 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fdd30 0x55e5f83fe640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe6477fe700 1 -- 172.21.15.12:0/3172906930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 msgr2=0x55e5f83fd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe6477fe700 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83fd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe6477fe700 1 -- 172.21.15.12:0/3172906930 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5f81ce630 con 0x55e5f83fec20 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.608+0000 7fe64c99c700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe6300a1480 0x7fe6300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.609+0000 7fe6477fe700 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fec20 0x55e5f83ff0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00dc30 tx=0x7fe63c00df40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49b657a99d9265b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.609+0000 7fe62e7fc700 1 -- 172.21.15.12:0/3172906930 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c004230 con 0x55e5f83fec20 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.609+0000 7fe62e7fc700 1 -- 172.21.15.12:0/3172906930 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe63c00fe00 con 0x55e5f83fec20 2023-12-11T20:19:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.609+0000 7fe62e7fc700 1 -- 172.21.15.12:0/3172906930 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c005020 con 0x55e5f83fec20 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.609+0000 7fe64c99c700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe6300a1480 0x7fe6300a3940 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe640009f30 tx=0x7fe640004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 -- 172.21.15.12:0/3172906930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fec20 msgr2=0x55e5f83ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fec20 0x55e5f83ff0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00dc30 tx=0x7fe63c00df40 comp rx=0 tx=0).stop 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 -- 172.21.15.12:0/3172906930 shutdown_connections 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fec20 0x55e5f83ff0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83fd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 --2- 172.21.15.12:0/3172906930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fdd30 0x55e5f83fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 -- 172.21.15.12:0/3172906930 >> 172.21.15.12:0/3172906930 conn(0x55e5f832c7e0 msgr2=0x55e5f83f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 -- 172.21.15.12:0/3172906930 shutdown_connections 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.610+0000 7fe661ddab80 1 -- 172.21.15.12:0/3172906930 wait complete. 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 1 -- start start 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 1 Processor -- start 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fd3d0 0x55e5f8407160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 0x55e5f84076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fec20 0x55e5f840e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f830b560 con 0x55e5f83fec20 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f830b200 con 0x55e5f83fd3d0 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f81d0920 con 0x55e5f83fdd30 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.611+0000 7fe661ddab80 10 client.0 _ll_register_callbacks cb 0x55e5f8236a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fec20 0x55e5f840e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fec20 0x55e5f840e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55206/0 (socket says 172.21.15.12:55206) 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe647fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fd3d0 0x55e5f8407160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 -- 172.21.15.12:0/2346471985 learned_addr learned my addr 172.21.15.12:0/2346471985 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe6477fe700 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 0x55e5f84076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 -- 172.21.15.12:0/2346471985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 msgr2=0x55e5f84076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 0x55e5f84076a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 -- 172.21.15.12:0/2346471985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fd3d0 msgr2=0x55e5f8407160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fd3d0 0x55e5f8407160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 -- 172.21.15.12:0/2346471985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c00d860 con 0x55e5f83fec20 2023-12-11T20:19:03.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe647fff700 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fd3d0 0x55e5f8407160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe64c99c700 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fec20 0x55e5f840e6e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe640017c70 tx=0x7fe640009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c677d8c1b2930880 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.612+0000 7fe6277fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.613+0000 7fe6277fe700 1 -- 172.21.15.12:0/2346471985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640026070 con 0x55e5f83fec20 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.613+0000 7fe661ddab80 1 -- 172.21.15.12:0/2346471985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5f83f0b40 con 0x55e5f83fec20 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.613+0000 7fe6277fe700 1 -- 172.21.15.12:0/2346471985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe640004bb0 con 0x55e5f83fec20 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.613+0000 7fe6277fe700 1 -- 172.21.15.12:0/2346471985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe640004d70 con 0x55e5f83fec20 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.613+0000 7fe661ddab80 10 client.16377 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.613+0000 7fe661ddab80 1 -- 172.21.15.12:0/2346471985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e5f817ade0 con 0x55e5f83fec20 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe6277fe700 1 -- 172.21.15.12:0/2346471985 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe640030020 con 0x55e5f83fec20 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe6277fe700 1 -- 172.21.15.12:0/2346471985 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe640029030 con 0x55e5f83fec20 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe661ddab80 10 client.16377 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:03.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe661ddab80 10 client.16377 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:19:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe661ddab80 20 client.16377 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e5f8413000 0x55e5f8415420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe661ddab80 4 client.16377 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe661ddab80 1 -- 172.21.15.12:0/2346471985 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5f83ccf40 con 0x55e5f8413000 2023-12-11T20:19:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.614+0000 7fe647fff700 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e5f8413000 0x55e5f8415420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.615+0000 7fe647fff700 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e5f8413000 0x55e5f8415420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1732bc552b0a8aaa server_cookie=c2c47ea9d9a0b1c4 in_seq=0 out_seq=0 2023-12-11T20:19:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.615+0000 7fe6277fe700 10 client.16377 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:19:03.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe6277fe700 1 -- 172.21.15.12:0/2346471985 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e5f83ccf40 con 0x55e5f8413000 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe6277fe700 10 client.16377 handle_command_reply: tid=0 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 client.16377 shutdown 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 -- 172.21.15.12:0/2346471985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fec20 msgr2=0x55e5f840e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fec20 0x55e5f840e6e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe640017c70 tx=0x7fe640009040 comp rx=0 tx=0).stop 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 -- 172.21.15.12:0/2346471985 shutdown_connections 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e5f8413000 0x55e5f8415420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fd3d0 0x55e5f8407160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fec20 0x55e5f840e6e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2346471985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 0x55e5f84076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 -- 172.21.15.12:0/2346471985 >> 172.21.15.12:0/2346471985 conn(0x55e5f832c7e0 msgr2=0x55e5f83f8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe6277fe700 0 client.16377 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:19:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 -- 172.21.15.12:0/2346471985 shutdown_connections 2023-12-11T20:19:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 1 -- 172.21.15.12:0/2346471985 wait complete. 2023-12-11T20:19:03.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.616+0000 7fe661ddab80 20 client.16377 trim_cache size 0 max 16384 2023-12-11T20:19:03.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.636+0000 7fe661ddab80 1 Processor -- start 2023-12-11T20:19:03.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.636+0000 7fe661ddab80 1 -- start start 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83ff000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 0x55e5f840e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f8419da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe661ddab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f8406cd0 con 0x55e5f83fd3d0 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe661ddab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f83fa200 con 0x55e5f83fec20 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe661ddab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f83fe430 con 0x55e5f83fdd30 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe647fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe647fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83ff000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55218/0 (socket says 172.21.15.12:55218) 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe647fff700 1 -- 172.21.15.12:0/4157282735 learned_addr learned my addr 172.21.15.12:0/4157282735 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.637+0000 7fe6477fe700 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 0x55e5f840e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe64c99c700 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f8419da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe647fff700 1 -- 172.21.15.12:0/4157282735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 msgr2=0x55e5f840e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe647fff700 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 0x55e5f840e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe647fff700 1 -- 172.21.15.12:0/4157282735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 msgr2=0x55e5f8419da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe647fff700 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f8419da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe647fff700 1 -- 172.21.15.12:0/4157282735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5f8163c60 con 0x55e5f83fd3d0 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe64c99c700 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f8419da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe647fff700 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83ff000 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe638000c00 tx=0x7fe638009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a37c6ad1f08a22 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe62effd700 1 -- 172.21.15.12:0/4157282735 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63809b500 con 0x55e5f83fd3d0 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe62effd700 1 -- 172.21.15.12:0/4157282735 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe63809bc00 con 0x55e5f83fd3d0 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.638+0000 7fe62effd700 1 -- 172.21.15.12:0/4157282735 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380cbc40 con 0x55e5f83fd3d0 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 -- 172.21.15.12:0/4157282735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 msgr2=0x55e5f83ff000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83ff000 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe638000c00 tx=0x7fe638009310 comp rx=0 tx=0).stop 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 -- 172.21.15.12:0/4157282735 shutdown_connections 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f8419da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fd3d0 0x55e5f83ff000 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 --2- 172.21.15.12:0/4157282735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fdd30 0x55e5f840e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 -- 172.21.15.12:0/4157282735 >> 172.21.15.12:0/4157282735 conn(0x55e5f832c7e0 msgr2=0x55e5f8405e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 -- 172.21.15.12:0/4157282735 shutdown_connections 2023-12-11T20:19:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.639+0000 7fe661ddab80 1 -- 172.21.15.12:0/4157282735 wait complete. 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.640+0000 7fe661ddab80 1 -- start start 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.640+0000 7fe661ddab80 1 Processor -- start 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fd3d0 0x55e5f840bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fdd30 0x55e5f840c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe661ddab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f840d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe661ddab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f840d6c0 con 0x55e5f83fdd30 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe661ddab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f840d830 con 0x55e5f83fec20 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe661ddab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f840d9a0 con 0x55e5f83fd3d0 2023-12-11T20:19:03.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe661ddab80 10 client.0 _ll_register_callbacks cb 0x55e5f8236a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe6477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fdd30 0x55e5f840c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe6477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fdd30 0x55e5f840c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55220/0 (socket says 172.21.15.12:55220) 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe6477fe700 1 -- 172.21.15.12:0/2509781267 learned_addr learned my addr 172.21.15.12:0/2509781267 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe647fff700 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fd3d0 0x55e5f840bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe64c99c700 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f840d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe6477fe700 1 -- 172.21.15.12:0/2509781267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fd3d0 msgr2=0x55e5f840bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe6477fe700 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fd3d0 0x55e5f840bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe6477fe700 1 -- 172.21.15.12:0/2509781267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 msgr2=0x55e5f840d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe6477fe700 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f840d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe6477fe700 1 -- 172.21.15.12:0/2509781267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6481a1a30 con 0x55e5f83fdd30 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.641+0000 7fe64c99c700 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f840d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.642+0000 7fe6477fe700 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fdd30 0x55e5f840c300 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55e5f83fe400 tx=0x7fe63c00fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d3b2949196f2b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.642+0000 7fe6277fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.642+0000 7fe6277fe700 1 -- 172.21.15.12:0/2509781267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c004440 con 0x55e5f83fdd30 2023-12-11T20:19:03.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.642+0000 7fe6277fe700 1 -- 172.21.15.12:0/2509781267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe63c022070 con 0x55e5f83fdd30 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.642+0000 7fe661ddab80 1 -- 172.21.15.12:0/2509781267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe63c00fe00 con 0x55e5f83fdd30 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.642+0000 7fe6277fe700 1 -- 172.21.15.12:0/2509781267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe63c005b00 con 0x55e5f83fdd30 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.642+0000 7fe661ddab80 10 client.16383 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.642+0000 7fe661ddab80 1 -- 172.21.15.12:0/2509781267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e5f81a1250 con 0x55e5f83fdd30 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.643+0000 7fe6277fe700 1 -- 172.21.15.12:0/2509781267 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe63c035080 con 0x55e5f83fdd30 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.643+0000 7fe6277fe700 1 -- 172.21.15.12:0/2509781267 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe63c004ae0 con 0x55e5f83fdd30 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.643+0000 7fe661ddab80 10 client.16383 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.643+0000 7fe661ddab80 10 client.16383 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.643+0000 7fe661ddab80 20 client.16383 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.643+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e5f8469c00 0x55e5f846c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.643+0000 7fe661ddab80 4 client.16383 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.643+0000 7fe661ddab80 1 -- 172.21.15.12:0/2509781267 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e5f8317fd0 con 0x55e5f8469c00 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.644+0000 7fe647fff700 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e5f8469c00 0x55e5f846c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.644+0000 7fe647fff700 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e5f8469c00 0x55e5f846c020 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4b075ae073ddb6c server_cookie=2f94fadc7d700d58 in_seq=0 out_seq=0 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.644+0000 7fe6277fe700 10 client.16383 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.644+0000 7fe6277fe700 1 -- 172.21.15.12:0/2509781267 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e5f8317fd0 con 0x55e5f8469c00 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.644+0000 7fe6277fe700 10 client.16383 handle_command_reply: tid=0 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.644+0000 7fe661ddab80 1 client.16383 shutdown 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 -- 172.21.15.12:0/2509781267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fdd30 msgr2=0x55e5f840c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fdd30 0x55e5f840c300 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55e5f83fe400 tx=0x7fe63c00fb80 comp rx=0 tx=0).stop 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 -- 172.21.15.12:0/2509781267 shutdown_connections 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e5f8469c00 0x55e5f846c020 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e5f83fec20 0x55e5f840d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe6277fe700 0 client.16383 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:19:03.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5f83fd3d0 0x55e5f840bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 --2- 172.21.15.12:0/2509781267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f83fdd30 0x55e5f840c300 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 -- 172.21.15.12:0/2509781267 >> 172.21.15.12:0/2509781267 conn(0x55e5f832c7e0 msgr2=0x55e5f8419da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 -- 172.21.15.12:0/2509781267 shutdown_connections 2023-12-11T20:19:03.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 1 -- 172.21.15.12:0/2509781267 wait complete. 2023-12-11T20:19:03.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.645+0000 7fe661ddab80 20 client.16383 trim_cache size 0 max 16384 2023-12-11T20:19:03.648 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 -- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe6300a1480 msgr2=0x7fe6300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe6300a1480 0x7fe6300a3940 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe640009f30 tx=0x7fe640004ad0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 -- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 msgr2=0x7fe648199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 0x7fe648199550 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe638009f50 tx=0x7fe638005b00 comp rx=0 tx=0).stop 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 -- 172.21.15.12:0/1725719547 shutdown_connections 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe6300a1480 0x7fe6300a3940 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe648101f90 0x7fe6481a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe648100400 0x7fe648199550 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 --2- 172.21.15.12:0/1725719547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe6481015f0 0x7fe648199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 -- 172.21.15.12:0/1725719547 >> 172.21.15.12:0/1725719547 conn(0x7fe6480fb930 msgr2=0x7fe6480687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 -- 172.21.15.12:0/1725719547 shutdown_connections 2023-12-11T20:19:03.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.646+0000 7fe64e3ff700 1 -- 172.21.15.12:0/1725719547 wait complete. 2023-12-11T20:19:03.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:19:03.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.917+0000 7f1e5dfff700 1 -- 172.21.15.12:0/3845855356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 msgr2=0x7f1e5810b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.917+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/3845855356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 0x7f1e5810b7e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000b0a0 tx=0x7f1e5000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.917+0000 7f1e5dfff700 1 -- 172.21.15.12:0/3845855356 shutdown_connections 2023-12-11T20:19:03.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.917+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/3845855356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 0x7f1e5810b7e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.917+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/3845855356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e580755b0 0x7f1e58073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.917+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/3845855356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58073fd0 0x7f1e58074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.917+0000 7f1e5dfff700 1 -- 172.21.15.12:0/3845855356 >> 172.21.15.12:0/3845855356 conn(0x7f1e580fca30 msgr2=0x7f1e580fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.918+0000 7f1e5dfff700 1 -- 172.21.15.12:0/3845855356 shutdown_connections 2023-12-11T20:19:03.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.918+0000 7f1e5dfff700 1 -- 172.21.15.12:0/3845855356 wait complete. 2023-12-11T20:19:03.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.919+0000 7f1e5dfff700 1 Processor -- start 2023-12-11T20:19:03.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.919+0000 7f1e5dfff700 1 -- start start 2023-12-11T20:19:03.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e5dfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58073fd0 0x7f1e581995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e5dfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e580755b0 0x7f1e58199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e5dfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 0x7f1e581a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e5dfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581a10e0 con 0x7f1e58109370 2023-12-11T20:19:03.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e5dfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581a1220 con 0x7f1e58073fd0 2023-12-11T20:19:03.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e5dfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581a13b0 con 0x7f1e580755b0 2023-12-11T20:19:03.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 0x7f1e581a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58073fd0 0x7f1e581995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 0x7f1e581a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55230/0 (socket says 172.21.15.12:55230) 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58073fd0 0x7f1e581995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41078/0 (socket says 172.21.15.12:41078) 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e57fff700 1 -- 172.21.15.12:0/2831694160 learned_addr learned my addr 172.21.15.12:0/2831694160 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.920+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e580755b0 0x7f1e58199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e57fff700 1 -- 172.21.15.12:0/2831694160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e580755b0 msgr2=0x7f1e58199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e57fff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e580755b0 0x7f1e58199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e57fff700 1 -- 172.21.15.12:0/2831694160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58073fd0 msgr2=0x7f1e581995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e57fff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58073fd0 0x7f1e581995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e57fff700 1 -- 172.21.15.12:0/2831694160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50009d00 con 0x7f1e58109370 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e57fff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 0x7f1e581a0b10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000b780 tx=0x7f1e5000bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e54ff9700 1 -- 172.21.15.12:0/2831694160 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5000e040 con 0x7f1e58109370 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e5dfff700 1 -- 172.21.15.12:0/2831694160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e581a1630 con 0x7f1e58109370 2023-12-11T20:19:03.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e54ff9700 1 -- 172.21.15.12:0/2831694160 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e50009480 con 0x7f1e58109370 2023-12-11T20:19:03.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e54ff9700 1 -- 172.21.15.12:0/2831694160 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500052c0 con 0x7f1e58109370 2023-12-11T20:19:03.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.921+0000 7f1e5dfff700 1 -- 172.21.15.12:0/2831694160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e581a1ab0 con 0x7f1e58109370 2023-12-11T20:19:03.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.925+0000 7f1e54ff9700 1 -- 172.21.15.12:0/2831694160 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1e50005420 con 0x7f1e58109370 2023-12-11T20:19:03.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.926+0000 7f1e71897b80 1 Processor -- start 2023-12-11T20:19:03.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e71897b80 1 -- start start 2023-12-11T20:19:03.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c9583d0 0x55ec8c9587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c959640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c95a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e71897b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c8b3b50 con 0x55ec8c959c20 2023-12-11T20:19:03.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e71897b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c8b1470 con 0x55ec8c9583d0 2023-12-11T20:19:03.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e71897b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c8acd60 con 0x55ec8c958d30 2023-12-11T20:19:03.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e54ff9700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1e400a1480 0x7f1e400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c95a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c959640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.927+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c959640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47974/0 (socket says 172.21.15.12:47974) 2023-12-11T20:19:03.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e577fe700 1 -- 172.21.15.12:0/3416875434 learned_addr learned my addr 172.21.15.12:0/3416875434 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e54ff9700 1 -- 172.21.15.12:0/2831694160 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1e500cdec0 con 0x7f1e58109370 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/3416875434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c9583d0 0x55ec8c9587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e57fff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1e400a1480 0x7f1e400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e56ffd700 1 -- 172.21.15.12:0/3416875434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 msgr2=0x55ec8c959640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/3416875434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c959640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e56ffd700 1 -- 172.21.15.12:0/3416875434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c9583d0 msgr2=0x55ec8c9587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/3416875434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c9583d0 0x55ec8c9587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e56ffd700 1 -- 172.21.15.12:0/3416875434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec8c729630 con 0x55ec8c959c20 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.928+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/3416875434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c95a0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c012750 tx=0x7f1e4c0096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4a65bebd95ac27 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.929+0000 7f1e57fff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1e400a1480 0x7f1e400a3940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1e5009aec0 tx=0x7f1e50009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.929+0000 7f1e3dffb700 1 -- 172.21.15.12:0/3416875434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c012d70 con 0x55ec8c959c20 2023-12-11T20:19:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.929+0000 7f1e3dffb700 1 -- 172.21.15.12:0/3416875434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e4c00f8e0 con 0x55ec8c959c20 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.929+0000 7f1e3dffb700 1 -- 172.21.15.12:0/3416875434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c01e6c0 con 0x55ec8c959c20 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.929+0000 7f1e71897b80 1 -- 172.21.15.12:0/3416875434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 msgr2=0x55ec8c95a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.929+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3416875434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c95a0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c012750 tx=0x7f1e4c0096d0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.930+0000 7f1e71897b80 1 -- 172.21.15.12:0/3416875434 shutdown_connections 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.930+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3416875434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c9583d0 0x55ec8c9587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.930+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3416875434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c95a0a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.930+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3416875434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c959640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.930+0000 7f1e71897b80 1 -- 172.21.15.12:0/3416875434 >> 172.21.15.12:0/3416875434 conn(0x55ec8c8877e0 msgr2=0x55ec8c954d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.930+0000 7f1e71897b80 1 -- 172.21.15.12:0/3416875434 shutdown_connections 2023-12-11T20:19:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.930+0000 7f1e71897b80 1 -- 172.21.15.12:0/3416875434 wait complete. 2023-12-11T20:19:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.930+0000 7f1e71897b80 1 -- start start 2023-12-11T20:19:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.931+0000 7f1e71897b80 1 Processor -- start 2023-12-11T20:19:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.931+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 0x55ec8c9621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.931+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c958d30 0x55ec8c962720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.931+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c969760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.931+0000 7f1e71897b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c866560 con 0x55ec8c959c20 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.931+0000 7f1e71897b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c866200 con 0x55ec8c958d30 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.931+0000 7f1e71897b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c72b920 con 0x55ec8c9583d0 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.931+0000 7f1e71897b80 10 client.0 _ll_register_callbacks cb 0x55ec8c791a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c958d30 0x55ec8c962720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c958d30 0x55ec8c962720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41108/0 (socket says 172.21.15.12:41108) 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e577fe700 1 -- 172.21.15.12:0/4168368905 learned_addr learned my addr 172.21.15.12:0/4168368905 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 0x55ec8c9621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c969760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e577fe700 1 -- 172.21.15.12:0/4168368905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 msgr2=0x55ec8c9621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e577fe700 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 0x55ec8c9621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e577fe700 1 -- 172.21.15.12:0/4168368905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 msgr2=0x55ec8c969760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e577fe700 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c969760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.932+0000 7f1e577fe700 1 -- 172.21.15.12:0/4168368905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c01a040 con 0x55ec8c958d30 2023-12-11T20:19:03.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.933+0000 7f1e577fe700 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c958d30 0x55ec8c962720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800bb70 tx=0x7f1e4800be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbdd8d514d5eae04 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.933+0000 7f1e36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:19:03.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.933+0000 7f1e36ffd700 1 -- 172.21.15.12:0/4168368905 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48016070 con 0x55ec8c958d30 2023-12-11T20:19:03.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.933+0000 7f1e71897b80 1 -- 172.21.15.12:0/4168368905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec8c94bb40 con 0x55ec8c958d30 2023-12-11T20:19:03.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.933+0000 7f1e36ffd700 1 -- 172.21.15.12:0/4168368905 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1e48003d00 con 0x55ec8c958d30 2023-12-11T20:19:03.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.933+0000 7f1e36ffd700 1 -- 172.21.15.12:0/4168368905 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e48011440 con 0x55ec8c958d30 2023-12-11T20:19:03.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.933+0000 7f1e71897b80 10 client.26150 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:03.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.933+0000 7f1e71897b80 1 -- 172.21.15.12:0/4168368905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ec8c6d5de0 con 0x55ec8c958d30 2023-12-11T20:19:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e36ffd700 1 -- 172.21.15.12:0/4168368905 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ec8c94bb40 con 0x55ec8c958d30 2023-12-11T20:19:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e36ffd700 1 -- 172.21.15.12:0/4168368905 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1e48025450 con 0x55ec8c958d30 2023-12-11T20:19:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e71897b80 10 client.26150 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e71897b80 10 client.26150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e71897b80 20 client.26150 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e71897b80 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ec8c96e0e0 0x55ec8c970500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e71897b80 4 client.26150 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e71897b80 1 -- 172.21.15.12:0/4168368905 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec8c927f40 con 0x55ec8c96e0e0 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.934+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ec8c96e0e0 0x55ec8c970500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.935+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ec8c96e0e0 0x55ec8c970500 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f358560e8ba994c server_cookie=1b026bb38bd059be in_seq=0 out_seq=0 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.935+0000 7f1e36ffd700 10 client.26150 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e36ffd700 1 -- 172.21.15.12:0/4168368905 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ec8c927f40 con 0x55ec8c96e0e0 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e36ffd700 10 client.26150 handle_command_reply: tid=0 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 client.26150 shutdown 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 -- 172.21.15.12:0/4168368905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c958d30 msgr2=0x55ec8c962720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c958d30 0x55ec8c962720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800bb70 tx=0x7f1e4800be80 comp rx=0 tx=0).stop 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 -- 172.21.15.12:0/4168368905 shutdown_connections 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ec8c96e0e0 0x55ec8c970500 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c959c20 0x55ec8c969760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 0x55ec8c9621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 --2- 172.21.15.12:0/4168368905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c958d30 0x55ec8c962720 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e36ffd700 0 client.26150 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 -- 172.21.15.12:0/4168368905 >> 172.21.15.12:0/4168368905 conn(0x55ec8c8877e0 msgr2=0x55ec8c953a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 -- 172.21.15.12:0/4168368905 shutdown_connections 2023-12-11T20:19:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.936+0000 7f1e71897b80 1 -- 172.21.15.12:0/4168368905 wait complete. 2023-12-11T20:19:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.937+0000 7f1e71897b80 20 client.26150 trim_cache size 0 max 16384 2023-12-11T20:19:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.954+0000 7f1e71897b80 1 Processor -- start 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.954+0000 7f1e71897b80 1 -- start start 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.954+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 0x55ec8c95a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.954+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c958d30 0x55ec8c969680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.954+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 0x55ec8c95cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.954+0000 7f1e71897b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c96a920 con 0x55ec8c958d30 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.954+0000 7f1e71897b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c963450 con 0x55ec8c959c20 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.954+0000 7f1e71897b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c9756d0 con 0x55ec8c9583d0 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c958d30 0x55ec8c969680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e56ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 0x55ec8c95cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c958d30 0x55ec8c969680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55276/0 (socket says 172.21.15.12:55276) 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e577fe700 1 -- 172.21.15.12:0/335443430 learned_addr learned my addr 172.21.15.12:0/335443430 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/335443430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 0x55ec8c95a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e56ffd700 1 -- 172.21.15.12:0/335443430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 msgr2=0x55ec8c95a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/335443430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 0x55ec8c95a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e56ffd700 1 -- 172.21.15.12:0/335443430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c958d30 msgr2=0x55ec8c969680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/335443430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c958d30 0x55ec8c969680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e56ffd700 1 -- 172.21.15.12:0/335443430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec8c6bec60 con 0x55ec8c959c20 2023-12-11T20:19:03.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.955+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/335443430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 0x55ec8c95cbc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009cd0 tx=0x7f1e4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21e4c8f1df2a5f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e3e7fc700 1 -- 172.21.15.12:0/335443430 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c024070 con 0x55ec8c959c20 2023-12-11T20:19:03.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e3e7fc700 1 -- 172.21.15.12:0/335443430 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e4c010bf0 con 0x55ec8c959c20 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e3e7fc700 1 -- 172.21.15.12:0/335443430 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c005470 con 0x55ec8c959c20 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e71897b80 1 -- 172.21.15.12:0/335443430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 msgr2=0x55ec8c95cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e71897b80 1 --2- 172.21.15.12:0/335443430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 0x55ec8c95cbc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009cd0 tx=0x7f1e4c009b50 comp rx=0 tx=0).stop 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e71897b80 1 -- 172.21.15.12:0/335443430 shutdown_connections 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e71897b80 1 --2- 172.21.15.12:0/335443430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 0x55ec8c95cbc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e71897b80 1 --2- 172.21.15.12:0/335443430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c9583d0 0x55ec8c95a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e71897b80 1 --2- 172.21.15.12:0/335443430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c958d30 0x55ec8c969680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.956+0000 7f1e71897b80 1 -- 172.21.15.12:0/335443430 >> 172.21.15.12:0/335443430 conn(0x55ec8c8877e0 msgr2=0x55ec8c9601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.957+0000 7f1e71897b80 1 -- 172.21.15.12:0/335443430 shutdown_connections 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.957+0000 7f1e71897b80 1 -- 172.21.15.12:0/335443430 wait complete. 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.957+0000 7f1e71897b80 1 -- start start 2023-12-11T20:19:03.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.957+0000 7f1e71897b80 1 Processor -- start 2023-12-11T20:19:03.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c9583d0 0x55ec8c967730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c967c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e71897b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 0x55ec8c968b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e71897b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c9690d0 con 0x55ec8c9583d0 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e71897b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c969240 con 0x55ec8c959c20 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e71897b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c969400 con 0x55ec8c958d30 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e71897b80 10 client.0 _ll_register_callbacks cb 0x55ec8c791a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c9583d0 0x55ec8c967730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c9583d0 0x55ec8c967730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55278/0 (socket says 172.21.15.12:55278) 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e56ffd700 1 -- 172.21.15.12:0/3156210722 learned_addr learned my addr 172.21.15.12:0/3156210722 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e577fe700 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c967c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e56ffd700 1 -- 172.21.15.12:0/3156210722 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 msgr2=0x55ec8c967c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c967c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e56ffd700 1 -- 172.21.15.12:0/3156210722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 msgr2=0x55ec8c968b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 0x55ec8c968b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.958+0000 7f1e56ffd700 1 -- 172.21.15.12:0/3156210722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c027040 con 0x55ec8c9583d0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.959+0000 7f1e56ffd700 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c9583d0 0x55ec8c967730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009ca0 tx=0x7f1e4c005110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ece3a578f93029 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.959+0000 7f1e36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.959+0000 7f1e36ffd700 1 -- 172.21.15.12:0/3156210722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c024070 con 0x55ec8c9583d0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.959+0000 7f1e71897b80 1 -- 172.21.15.12:0/3156210722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e4c00f8e0 con 0x55ec8c9583d0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.959+0000 7f1e36ffd700 1 -- 172.21.15.12:0/3156210722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1e4c012e40 con 0x55ec8c9583d0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.959+0000 7f1e36ffd700 1 -- 172.21.15.12:0/3156210722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e4c009640 con 0x55ec8c9583d0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.959+0000 7f1e71897b80 10 client.16401 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.959+0000 7f1e71897b80 1 -- 172.21.15.12:0/3156210722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ec8c6fc250 con 0x55ec8c9583d0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e36ffd700 1 -- 172.21.15.12:0/3156210722 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e4c00f8e0 con 0x55ec8c9583d0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e36ffd700 1 -- 172.21.15.12:0/3156210722 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1e4c003820 con 0x55ec8c9583d0 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e71897b80 10 client.16401 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e71897b80 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e71897b80 20 client.16401 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:03.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ec8c9c5510 0x55ec8c9c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:03.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e71897b80 4 client.16401 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:19:03.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e71897b80 1 -- 172.21.15.12:0/3156210722 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ec8c872fd0 con 0x55ec8c9c5510 2023-12-11T20:19:03.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.960+0000 7f1e577fe700 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ec8c9c5510 0x55ec8c9c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.961+0000 7f1e577fe700 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ec8c9c5510 0x55ec8c9c7930 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eebf0c8fc6ab18a8 server_cookie=177ece492e379780 in_seq=0 out_seq=0 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.961+0000 7f1e36ffd700 10 client.16401 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e36ffd700 1 -- 172.21.15.12:0/3156210722 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ec8c872fd0 con 0x55ec8c9c5510 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e36ffd700 10 client.16401 handle_command_reply: tid=0 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 client.16401 shutdown 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 -- 172.21.15.12:0/3156210722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c9583d0 msgr2=0x55ec8c967730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c9583d0 0x55ec8c967730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009ca0 tx=0x7f1e4c005110 comp rx=0 tx=0).stop 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 -- 172.21.15.12:0/3156210722 shutdown_connections 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ec8c9c5510 0x55ec8c9c7930 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ec8c959c20 0x55ec8c968b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec8c9583d0 0x55ec8c967730 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 --2- 172.21.15.12:0/3156210722 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ec8c958d30 0x55ec8c967c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 -- 172.21.15.12:0/3156210722 >> 172.21.15.12:0/3156210722 conn(0x55ec8c8877e0 msgr2=0x55ec8c962180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e36ffd700 0 client.16401 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:03.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 -- 172.21.15.12:0/3156210722 shutdown_connections 2023-12-11T20:19:03.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 1 -- 172.21.15.12:0/3156210722 wait complete. 2023-12-11T20:19:03.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.962+0000 7f1e71897b80 20 client.16401 trim_cache size 0 max 16384 2023-12-11T20:19:03.964 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:19:03.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 -- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1e400a1480 msgr2=0x7f1e400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1e400a1480 0x7f1e400a3940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1e5009aec0 tx=0x7f1e50009040 comp rx=0 tx=0).stop 2023-12-11T20:19:03.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 -- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 msgr2=0x7f1e581a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:03.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 0x7f1e581a0b10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000b780 tx=0x7f1e5000bcc0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 -- 172.21.15.12:0/2831694160 shutdown_connections 2023-12-11T20:19:03.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1e400a1480 0x7f1e400a3940 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e58073fd0 0x7f1e581995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58109370 0x7f1e581a0b10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 --2- 172.21.15.12:0/2831694160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e580755b0 0x7f1e58199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:03.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 -- 172.21.15.12:0/2831694160 >> 172.21.15.12:0/2831694160 conn(0x7f1e580fca30 msgr2=0x7f1e581052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:03.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 -- 172.21.15.12:0/2831694160 shutdown_connections 2023-12-11T20:19:03.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:03.963+0000 7f1e5dfff700 1 -- 172.21.15.12:0/2831694160 wait complete. 2023-12-11T20:19:04.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:04 smithi012 ceph-mon[128787]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:19:04.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:04 smithi032 ceph-mon[132488]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:19:04.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:04 smithi039 ceph-mon[102205]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:19:04.982 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:19:04.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:19:05.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 -- 172.21.15.12:0/3947709868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe101048b0 msgr2=0x7efe10106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 --2- 172.21.15.12:0/3947709868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe101048b0 0x7efe10106ca0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efe04009990 tx=0x7efe04009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 -- 172.21.15.12:0/3947709868 shutdown_connections 2023-12-11T20:19:05.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 --2- 172.21.15.12:0/3947709868 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe101071e0 0x7efe10109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 --2- 172.21.15.12:0/3947709868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe10101f80 0x7efe10104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 --2- 172.21.15.12:0/3947709868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe101048b0 0x7efe10106ca0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 -- 172.21.15.12:0/3947709868 >> 172.21.15.12:0/3947709868 conn(0x7efe100fb930 msgr2=0x7efe100fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 -- 172.21.15.12:0/3947709868 shutdown_connections 2023-12-11T20:19:05.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.220+0000 7efe149ff700 1 -- 172.21.15.12:0/3947709868 wait complete. 2023-12-11T20:19:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.221+0000 7efe149ff700 1 Processor -- start 2023-12-11T20:19:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.221+0000 7efe149ff700 1 -- start start 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe149ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe10101f80 0x7efe10199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe149ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe101048b0 0x7efe10199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe149ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe101071e0 0x7efe101a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe149ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101a10a0 con 0x7efe10101f80 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe149ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101a11e0 con 0x7efe101071e0 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe149ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101a1370 con 0x7efe101048b0 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe10101f80 0x7efe10199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe10101f80 0x7efe10199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55294/0 (socket says 172.21.15.12:55294) 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe0e59c700 1 -- 172.21.15.12:0/1450385183 learned_addr learned my addr 172.21.15.12:0/1450385183 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.222+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe101048b0 0x7efe10199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe0ed9d700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe101071e0 0x7efe101a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe0dd9b700 1 -- 172.21.15.12:0/1450385183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe101071e0 msgr2=0x7efe101a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe101071e0 0x7efe101a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe0dd9b700 1 -- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe10101f80 msgr2=0x7efe10199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe10101f80 0x7efe10199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe0dd9b700 1 -- 172.21.15.12:0/1450385183 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040095f0 con 0x7efe101048b0 2023-12-11T20:19:05.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe0ed9d700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe101071e0 0x7efe101a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:05.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe101048b0 0x7efe10199ab0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe04003f60 tx=0x7efe04005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efdff7fe700 1 -- 172.21.15.12:0/1450385183 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0401d070 con 0x7efe101048b0 2023-12-11T20:19:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efe149ff700 1 -- 172.21.15.12:0/1450385183 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe101a15f0 con 0x7efe101048b0 2023-12-11T20:19:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efdff7fe700 1 -- 172.21.15.12:0/1450385183 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe0400be30 con 0x7efe101048b0 2023-12-11T20:19:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.223+0000 7efdff7fe700 1 -- 172.21.15.12:0/1450385183 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04022da0 con 0x7efe101048b0 2023-12-11T20:19:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.224+0000 7efe149ff700 1 -- 172.21.15.12:0/1450385183 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101a1a70 con 0x7efe101048b0 2023-12-11T20:19:05.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.227+0000 7efdff7fe700 1 -- 172.21.15.12:0/1450385183 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7efe04022570 con 0x7efe101048b0 2023-12-11T20:19:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.229+0000 7efdff7fe700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efdf80a1480 0x7efdf80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.229+0000 7efdff7fe700 1 -- 172.21.15.12:0/1450385183 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe040ce1d0 con 0x7efe101048b0 2023-12-11T20:19:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.229+0000 7efe0e59c700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efdf80a1480 0x7efdf80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.229+0000 7efe282a4b80 1 Processor -- start 2023-12-11T20:19:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe0e59c700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efdf80a1480 0x7efdf80a3940 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efe00005950 tx=0x7efe0000b500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe282a4b80 1 -- start start 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3d6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3d76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3d8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe282a4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f331bd0 con 0x55ed6f3d6450 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe282a4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f32f4f0 con 0x55ed6f3d7ca0 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe282a4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f32ade0 con 0x55ed6f3d6db0 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.230+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3d6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3d6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55296/0 (socket says 172.21.15.12:55296) 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0e59c700 1 -- 172.21.15.12:0/3137370775 learned_addr learned my addr 172.21.15.12:0/3137370775 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0ed9d700 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3d8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3d76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0e59c700 1 -- 172.21.15.12:0/3137370775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 msgr2=0x55ed6f3d76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0e59c700 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3d76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0e59c700 1 -- 172.21.15.12:0/3137370775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 msgr2=0x55ed6f3d8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0e59c700 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3d8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0e59c700 1 -- 172.21.15.12:0/3137370775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed6f1a76b0 con 0x55ed6f3d6450 2023-12-11T20:19:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3d76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:05.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.231+0000 7efe0e59c700 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3d6870 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7efe00010f70 tx=0x7efe00013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ed65a845a6b188 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.232+0000 7efdfcff9700 1 -- 172.21.15.12:0/3137370775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00011db0 con 0x55ed6f3d6450 2023-12-11T20:19:05.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.232+0000 7efdfcff9700 1 -- 172.21.15.12:0/3137370775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe00015070 con 0x55ed6f3d6450 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.232+0000 7efdfcff9700 1 -- 172.21.15.12:0/3137370775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0001c610 con 0x55ed6f3d6450 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.232+0000 7efe282a4b80 1 -- 172.21.15.12:0/3137370775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 msgr2=0x55ed6f3d6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.232+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3d6870 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7efe00010f70 tx=0x7efe00013000 comp rx=0 tx=0).stop 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 -- 172.21.15.12:0/3137370775 shutdown_connections 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3d8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3d6870 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3137370775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3d76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 -- 172.21.15.12:0/3137370775 >> 172.21.15.12:0/3137370775 conn(0x55ed6f305860 msgr2=0x55ed6f3d2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 -- 172.21.15.12:0/3137370775 shutdown_connections 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 -- 172.21.15.12:0/3137370775 wait complete. 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 -- start start 2023-12-11T20:19:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.233+0000 7efe282a4b80 1 Processor -- start 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe282a4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f2e45e0 con 0x55ed6f3d6450 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe282a4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f2e4280 con 0x55ed6f3d7ca0 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe282a4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f1a99a0 con 0x55ed6f3d6db0 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe282a4b80 10 client.0 _ll_register_callbacks cb 0x55ed6f20fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55312/0 (socket says 172.21.15.12:55312) 2023-12-11T20:19:05.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.234+0000 7efe0e59c700 1 -- 172.21.15.12:0/4246643664 learned_addr learned my addr 172.21.15.12:0/4246643664 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe0ed9d700 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe0e59c700 1 -- 172.21.15.12:0/4246643664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 msgr2=0x55ed6f3e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe0e59c700 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe0e59c700 1 -- 172.21.15.12:0/4246643664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 msgr2=0x55ed6f3e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe0e59c700 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe0e59c700 1 -- 172.21.15.12:0/4246643664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe00010c50 con 0x55ed6f3d6450 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe0e59c700 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e0220 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efe00011e10 tx=0x7efe00011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd3aeae5d942823 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efdf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efdf5ffb700 1 -- 172.21.15.12:0/4246643664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0002c070 con 0x55ed6f3d6450 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efe282a4b80 1 -- 172.21.15.12:0/4246643664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed6f3c9bc0 con 0x55ed6f3d6450 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.235+0000 7efdf5ffb700 1 -- 172.21.15.12:0/4246643664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe00017070 con 0x55ed6f3d6450 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efdf5ffb700 1 -- 172.21.15.12:0/4246643664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe0001e6b0 con 0x55ed6f3d6450 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efe282a4b80 10 client.16413 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efe282a4b80 1 -- 172.21.15.12:0/4246643664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ed6f153e60 con 0x55ed6f3d6450 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efdf5ffb700 1 -- 172.21.15.12:0/4246643664 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe00040080 con 0x55ed6f3d6450 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efdf5ffb700 1 -- 172.21.15.12:0/4246643664 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efe000263f0 con 0x55ed6f3d6450 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efe282a4b80 10 client.16413 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efe282a4b80 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efe282a4b80 20 client.16413 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efe282a4b80 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ed6f3ebf60 0x55ed6f3ee380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.236+0000 7efe282a4b80 4 client.16413 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.237+0000 7efe282a4b80 1 -- 172.21.15.12:0/4246643664 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed6f3a5fc0 con 0x55ed6f3ebf60 2023-12-11T20:19:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.237+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ed6f3ebf60 0x55ed6f3ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.237+0000 7efdf5ffb700 10 client.16413 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.237+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ed6f3ebf60 0x55ed6f3ee380 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c91d6d3a31756b6 server_cookie=e5bd666fd42e6885 in_seq=0 out_seq=0 2023-12-11T20:19:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.238+0000 7efdf5ffb700 1 -- 172.21.15.12:0/4246643664 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ed6f3a5fc0 con 0x55ed6f3ebf60 2023-12-11T20:19:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.238+0000 7efdf5ffb700 10 client.16413 handle_command_reply: tid=0 2023-12-11T20:19:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.238+0000 7efe282a4b80 1 client.16413 shutdown 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.238+0000 7efe282a4b80 1 -- 172.21.15.12:0/4246643664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 msgr2=0x55ed6f3e0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.238+0000 7efe282a4b80 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e0220 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efe00011e10 tx=0x7efe00011e40 comp rx=0 tx=0).stop 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 1 -- 172.21.15.12:0/4246643664 shutdown_connections 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ed6f3ebf60 0x55ed6f3ee380 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e0220 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 1 --2- 172.21.15.12:0/4246643664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 1 -- 172.21.15.12:0/4246643664 >> 172.21.15.12:0/4246643664 conn(0x55ed6f305860 msgr2=0x55ed6f3d1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efdf5ffb700 0 client.16413 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 1 -- 172.21.15.12:0/4246643664 shutdown_connections 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 1 -- 172.21.15.12:0/4246643664 wait complete. 2023-12-11T20:19:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.239+0000 7efe282a4b80 20 client.16413 trim_cache size 0 max 16384 2023-12-11T20:19:05.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.261+0000 7efe282a4b80 1 Processor -- start 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.261+0000 7efe282a4b80 1 -- start start 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.261+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.261+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.261+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.261+0000 7efe282a4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f3cdc00 con 0x55ed6f3d6db0 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.261+0000 7efe282a4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f3d5ff0 con 0x55ed6f3d6450 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.261+0000 7efe282a4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f3d74b0 con 0x55ed6f3d7ca0 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55318/0 (socket says 172.21.15.12:55318) 2023-12-11T20:19:05.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 -- 172.21.15.12:0/3639940056 learned_addr learned my addr 172.21.15.12:0/3639940056 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0ed9d700 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0e59c700 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 -- 172.21.15.12:0/3639940056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d7ca0 msgr2=0x55ed6f3e0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 -- 172.21.15.12:0/3639940056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 msgr2=0x55ed6f3dffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3dffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 -- 172.21.15.12:0/3639940056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed6f13cce0 con 0x55ed6f3d6db0 2023-12-11T20:19:05.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.262+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e7760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efe0409b4c0 tx=0x7efe040cbb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4a24aed434853b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.263+0000 7efdfd7fa700 1 -- 172.21.15.12:0/3639940056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040b7070 con 0x55ed6f3d6db0 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.263+0000 7efdfd7fa700 1 -- 172.21.15.12:0/3639940056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe040cd040 con 0x55ed6f3d6db0 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.263+0000 7efdfd7fa700 1 -- 172.21.15.12:0/3639940056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0409aa20 con 0x55ed6f3d6db0 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 -- 172.21.15.12:0/3639940056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6db0 msgr2=0x55ed6f3e7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e7760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efe0409b4c0 tx=0x7efe040cbb50 comp rx=0 tx=0).stop 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 -- 172.21.15.12:0/3639940056 shutdown_connections 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3dffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3639940056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e7760 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 -- 172.21.15.12:0/3639940056 >> 172.21.15.12:0/3639940056 conn(0x55ed6f305860 msgr2=0x55ed6f3d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 -- 172.21.15.12:0/3639940056 shutdown_connections 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 -- 172.21.15.12:0/3639940056 wait complete. 2023-12-11T20:19:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.264+0000 7efe282a4b80 1 -- start start 2023-12-11T20:19:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe282a4b80 1 Processor -- start 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe282a4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe282a4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f442450 con 0x55ed6f3d7ca0 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe282a4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f442590 con 0x55ed6f3d6450 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe282a4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6f4426d0 con 0x55ed6f3d6db0 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe282a4b80 10 client.0 _ll_register_callbacks cb 0x55ed6f20fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe0dd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.265+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0dd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48048/0 (socket says 172.21.15.12:48048) 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0dd9b700 1 -- 172.21.15.12:0/3972732175 learned_addr learned my addr 172.21.15.12:0/3972732175 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0ed9d700 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0e59c700 1 -- 172.21.15.12:0/3972732175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 msgr2=0x55ed6f3e41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0e59c700 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0e59c700 1 -- 172.21.15.12:0/3972732175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d7ca0 msgr2=0x55ed6f3e4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0e59c700 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0e59c700 1 -- 172.21.15.12:0/3972732175 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101a1a70 con 0x55ed6f3d6450 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0ed9d700 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efe0e59c700 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e76c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe000267d0 tx=0x7efe00005980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d27cf047c715b536 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.266+0000 7efdf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efdf5ffb700 1 -- 172.21.15.12:0/3972732175 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0002c020 con 0x55ed6f3d6450 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efdf5ffb700 1 -- 172.21.15.12:0/3972732175 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe00017040 con 0x55ed6f3d6450 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efe282a4b80 1 -- 172.21.15.12:0/3972732175 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe00015070 con 0x55ed6f3d6450 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efdf5ffb700 1 -- 172.21.15.12:0/3972732175 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe0001e6b0 con 0x55ed6f3d6450 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efe282a4b80 10 client.26168 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efe282a4b80 1 -- 172.21.15.12:0/3972732175 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ed6f17a2d0 con 0x55ed6f3d6450 2023-12-11T20:19:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efdf5ffb700 1 -- 172.21.15.12:0/3972732175 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe00015070 con 0x55ed6f3d6450 2023-12-11T20:19:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efdf5ffb700 1 -- 172.21.15.12:0/3972732175 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efe00026d20 con 0x55ed6f3d6450 2023-12-11T20:19:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efe282a4b80 10 client.26168 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efe282a4b80 10 client.26168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.267+0000 7efe282a4b80 20 client.26168 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.268+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ed6f443ce0 0x55ed6f446100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.268+0000 7efe282a4b80 4 client.26168 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:19:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.268+0000 7efe282a4b80 1 -- 172.21.15.12:0/3972732175 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ed6f2f1050 con 0x55ed6f443ce0 2023-12-11T20:19:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.268+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ed6f443ce0 0x55ed6f446100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.269+0000 7efe0dd9b700 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ed6f443ce0 0x55ed6f446100 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4940ca3ed439c34d server_cookie=99d2d0a357b6e67 in_seq=0 out_seq=0 2023-12-11T20:19:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.269+0000 7efdf5ffb700 10 client.26168 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efdf5ffb700 1 -- 172.21.15.12:0/3972732175 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ed6f2f1050 con 0x55ed6f443ce0 2023-12-11T20:19:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efdf5ffb700 10 client.26168 handle_command_reply: tid=0 2023-12-11T20:19:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 client.26168 shutdown 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 -- 172.21.15.12:0/3972732175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 msgr2=0x55ed6f3e76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e76c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe000267d0 tx=0x7efe00005980 comp rx=0 tx=0).stop 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 -- 172.21.15.12:0/3972732175 shutdown_connections 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ed6f443ce0 0x55ed6f446100 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed6f3d6450 0x55ed6f3e76c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed6f3d7ca0 0x55ed6f3e4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efdf5ffb700 0 client.26168 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 --2- 172.21.15.12:0/3972732175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed6f3d6db0 0x55ed6f3e41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.271+0000 7efe282a4b80 1 -- 172.21.15.12:0/3972732175 >> 172.21.15.12:0/3972732175 conn(0x55ed6f305860 msgr2=0x55ed6f3dffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.272+0000 7efe282a4b80 1 -- 172.21.15.12:0/3972732175 shutdown_connections 2023-12-11T20:19:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.272+0000 7efe282a4b80 1 -- 172.21.15.12:0/3972732175 wait complete. 2023-12-11T20:19:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.272+0000 7efe282a4b80 20 client.26168 trim_cache size 0 max 16384 2023-12-11T20:19:05.272 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:19:05.272 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:19:05.272 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "19ecee4c-f37d-4cc1-85f5-6ea5c06625c4", 2023-12-11T20:19:05.272 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:19:05.272 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 -- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efdf80a1480 msgr2=0x7efdf80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efdf80a1480 0x7efdf80a3940 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efe00005950 tx=0x7efe0000b500 comp rx=0 tx=0).stop 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 -- 172.21.15.12:0/1450385183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe101048b0 msgr2=0x7efe10199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe101048b0 0x7efe10199ab0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe04003f60 tx=0x7efe04005740 comp rx=0 tx=0).stop 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 -- 172.21.15.12:0/1450385183 shutdown_connections 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efdf80a1480 0x7efdf80a3940 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe101071e0 0x7efe101a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe10101f80 0x7efe10199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 --2- 172.21.15.12:0/1450385183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe101048b0 0x7efe10199ab0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.273+0000 7efe149ff700 1 -- 172.21.15.12:0/1450385183 >> 172.21.15.12:0/1450385183 conn(0x7efe100fb930 msgr2=0x7efe10101670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.274+0000 7efe149ff700 1 -- 172.21.15.12:0/1450385183 shutdown_connections 2023-12-11T20:19:05.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.274+0000 7efe149ff700 1 -- 172.21.15.12:0/1450385183 wait complete. 2023-12-11T20:19:05.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:19:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:05 smithi012 ceph-mon[128787]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.536+0000 7f01b759e700 1 -- 172.21.15.12:0/1556058342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b81046a0 msgr2=0x7f01b8106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.536+0000 7f01b759e700 1 --2- 172.21.15.12:0/1556058342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b81046a0 0x7f01b8106a90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009990 tx=0x7f01ac009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.537+0000 7f01b759e700 1 -- 172.21.15.12:0/1556058342 shutdown_connections 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.537+0000 7f01b759e700 1 --2- 172.21.15.12:0/1556058342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01b8101d70 0x7f01b8104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.537+0000 7f01b759e700 1 --2- 172.21.15.12:0/1556058342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b8106fd0 0x7f01b8109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.537+0000 7f01b759e700 1 --2- 172.21.15.12:0/1556058342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b81046a0 0x7f01b8106a90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.537+0000 7f01b759e700 1 -- 172.21.15.12:0/1556058342 >> 172.21.15.12:0/1556058342 conn(0x7f01b80fb740 msgr2=0x7f01b80fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.537+0000 7f01b759e700 1 -- 172.21.15.12:0/1556058342 shutdown_connections 2023-12-11T20:19:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.537+0000 7f01b759e700 1 -- 172.21.15.12:0/1556058342 wait complete. 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b759e700 1 Processor -- start 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b759e700 1 -- start start 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b8101d70 0x7f01b8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81046a0 0x7f01b81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01b8106fd0 0x7f01b81a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b81a0dc0 con 0x7f01b8101d70 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b81a0f00 con 0x7f01b8106fd0 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b81a1090 con 0x7f01b81046a0 2023-12-11T20:19:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.538+0000 7f01b659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b8101d70 0x7f01b8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b8101d70 0x7f01b8199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55352/0 (socket says 172.21.15.12:55352) 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b659c700 1 -- 172.21.15.12:0/1981906191 learned_addr learned my addr 172.21.15.12:0/1981906191 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81046a0 0x7f01b81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b6d9d700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01b8106fd0 0x7f01b81a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b659c700 1 -- 172.21.15.12:0/1981906191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81046a0 msgr2=0x7f01b81997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b659c700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81046a0 0x7f01b81997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b659c700 1 -- 172.21.15.12:0/1981906191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01b8106fd0 msgr2=0x7f01b81a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b659c700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01b8106fd0 0x7f01b81a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b659c700 1 -- 172.21.15.12:0/1981906191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0095f0 con 0x7f01b8101d70 2023-12-11T20:19:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.539+0000 7f01b659c700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b8101d70 0x7f01b8199290 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f01a800d980 tx=0x7f01a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.540+0000 7f01a77fe700 1 -- 172.21.15.12:0/1981906191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8004220 con 0x7f01b8101d70 2023-12-11T20:19:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.540+0000 7f01a77fe700 1 -- 172.21.15.12:0/1981906191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01a8007640 con 0x7f01b8101d70 2023-12-11T20:19:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.540+0000 7f01b759e700 1 -- 172.21.15.12:0/1981906191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b81a1370 con 0x7f01b8101d70 2023-12-11T20:19:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.540+0000 7f01a77fe700 1 -- 172.21.15.12:0/1981906191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8005660 con 0x7f01b8101d70 2023-12-11T20:19:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.540+0000 7f01b759e700 1 -- 172.21.15.12:0/1981906191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b81a18d0 con 0x7f01b8101d70 2023-12-11T20:19:05.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.543+0000 7f01a77fe700 1 -- 172.21.15.12:0/1981906191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f01a8004750 con 0x7f01b8101d70 2023-12-11T20:19:05.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.545+0000 7f01a77fe700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01a00a15a0 0x7f01a00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.545+0000 7f01a77fe700 1 -- 172.21.15.12:0/1981906191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01a80ccab0 con 0x7f01b8101d70 2023-12-11T20:19:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.545+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01a00a15a0 0x7f01a00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.545+0000 7f01d0468b80 1 Processor -- start 2023-12-11T20:19:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01d0468b80 1 -- start start 2023-12-11T20:19:05.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d690a60 0x55614d690e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d6913c0 0x55614d6918a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 0x55614d692240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01d0468b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d5ebb50 con 0x55614d6913c0 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01d0468b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d5e9470 con 0x55614d691de0 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01d0468b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d5e4d60 con 0x55614d690a60 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01a00a15a0 0x7f01a00a3a60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005910 tx=0x7f01ac00b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01b659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d690a60 0x55614d690e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01b659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d690a60 0x55614d690e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48086/0 (socket says 172.21.15.12:48086) 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01b659c700 1 -- 172.21.15.12:0/4008677209 learned_addr learned my addr 172.21.15.12:0/4008677209 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.546+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d6913c0 0x55614d6918a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01b6d9d700 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 0x55614d692240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01b659c700 1 -- 172.21.15.12:0/4008677209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 msgr2=0x55614d692240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01b659c700 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 0x55614d692240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01b659c700 1 -- 172.21.15.12:0/4008677209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d6913c0 msgr2=0x55614d6918a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01b659c700 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d6913c0 0x55614d6918a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01b659c700 1 -- 172.21.15.12:0/4008677209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55614d461630 con 0x55614d690a60 2023-12-11T20:19:05.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01b6d9d700 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 0x55614d692240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:05.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01b659c700 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d690a60 0x55614d690e80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f01a8096790 tx=0x7f01a8099780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=745741c9c7e521f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01a4ff9700 1 -- 172.21.15.12:0/4008677209 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a809a420 con 0x55614d690a60 2023-12-11T20:19:05.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01a4ff9700 1 -- 172.21.15.12:0/4008677209 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01a8099d20 con 0x55614d690a60 2023-12-11T20:19:05.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.547+0000 7f01a4ff9700 1 -- 172.21.15.12:0/4008677209 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8099470 con 0x55614d690a60 2023-12-11T20:19:05.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 -- 172.21.15.12:0/4008677209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d690a60 msgr2=0x55614d690e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d690a60 0x55614d690e80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f01a8096790 tx=0x7f01a8099780 comp rx=0 tx=0).stop 2023-12-11T20:19:05.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 -- 172.21.15.12:0/4008677209 shutdown_connections 2023-12-11T20:19:05.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 0x55614d692240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d690a60 0x55614d690e80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 --2- 172.21.15.12:0/4008677209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d6913c0 0x55614d6918a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 -- 172.21.15.12:0/4008677209 >> 172.21.15.12:0/4008677209 conn(0x55614d5bf7e0 msgr2=0x55614d68b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 -- 172.21.15.12:0/4008677209 shutdown_connections 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.548+0000 7f01d0468b80 1 -- 172.21.15.12:0/4008677209 wait complete. 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.549+0000 7f01d0468b80 1 -- start start 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.549+0000 7f01d0468b80 1 Processor -- start 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d69a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 0x55614d69a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 0x55614d6a1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01d0468b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d59e560 con 0x55614d690a60 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01d0468b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d59e200 con 0x55614d691de0 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01d0468b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d463920 con 0x55614d6913c0 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01d0468b80 10 client.0 _ll_register_callbacks cb 0x55614d4c9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d69a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d69a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55382/0 (socket says 172.21.15.12:55382) 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b659c700 1 -- 172.21.15.12:0/128656317 learned_addr learned my addr 172.21.15.12:0/128656317 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 0x55614d69a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b659c700 1 -- 172.21.15.12:0/128656317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 msgr2=0x55614d69a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b659c700 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 0x55614d69a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b659c700 1 -- 172.21.15.12:0/128656317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 msgr2=0x55614d6a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b659c700 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 0x55614d6a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.550+0000 7f01b659c700 1 -- 172.21.15.12:0/128656317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b81a18d0 con 0x55614d690a60 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.551+0000 7f01b659c700 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d69a400 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f01a8096220 tx=0x7f01a8005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b477de15014db760 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.551+0000 7f019dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.551+0000 7f019dffb700 1 -- 172.21.15.12:0/128656317 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a809a420 con 0x55614d690a60 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.551+0000 7f01d0468b80 1 -- 172.21.15.12:0/128656317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55614d6839e0 con 0x55614d690a60 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.551+0000 7f019dffb700 1 -- 172.21.15.12:0/128656317 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01a80a1c20 con 0x55614d690a60 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.551+0000 7f019dffb700 1 -- 172.21.15.12:0/128656317 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a80a1de0 con 0x55614d690a60 2023-12-11T20:19:05.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.551+0000 7f01d0468b80 10 client.16431 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:05.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.551+0000 7f01d0468b80 1 -- 172.21.15.12:0/128656317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55614d40dde0 con 0x55614d690a60 2023-12-11T20:19:05.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:05 smithi039 ceph-mon[102205]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.552+0000 7f019dffb700 1 -- 172.21.15.12:0/128656317 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55614d6839e0 con 0x55614d690a60 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.552+0000 7f019dffb700 1 -- 172.21.15.12:0/128656317 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01a8098c80 con 0x55614d690a60 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.552+0000 7f01d0468b80 10 client.16431 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.552+0000 7f01d0468b80 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.552+0000 7f01d0468b80 20 client.16431 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.552+0000 7f01d0468b80 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55614d6a5d10 0x55614d6a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.552+0000 7f01d0468b80 4 client.16431 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.552+0000 7f01d0468b80 1 -- 172.21.15.12:0/128656317 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55614d65ff40 con 0x55614d6a5d10 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.553+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55614d6a5d10 0x55614d6a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.553+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55614d6a5d10 0x55614d6a8100 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee4135b63d596f22 server_cookie=eb251caef66b9aec in_seq=0 out_seq=0 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.553+0000 7f019dffb700 10 client.16431 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f019dffb700 1 -- 172.21.15.12:0/128656317 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55614d65ff40 con 0x55614d6a5d10 2023-12-11T20:19:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f019dffb700 10 client.16431 handle_command_reply: tid=0 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 client.16431 shutdown 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 -- 172.21.15.12:0/128656317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 msgr2=0x55614d69a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d69a400 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f01a8096220 tx=0x7f01a8005870 comp rx=0 tx=0).stop 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 -- 172.21.15.12:0/128656317 shutdown_connections 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55614d6a5d10 0x55614d6a8100 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d691de0 0x55614d6a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d69a400 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 --2- 172.21.15.12:0/128656317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 0x55614d69a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 -- 172.21.15.12:0/128656317 >> 172.21.15.12:0/128656317 conn(0x55614d5bf7e0 msgr2=0x55614d68f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f019dffb700 0 client.16431 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.554+0000 7f01d0468b80 1 -- 172.21.15.12:0/128656317 shutdown_connections 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.555+0000 7f01d0468b80 1 -- 172.21.15.12:0/128656317 wait complete. 2023-12-11T20:19:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.555+0000 7f01d0468b80 20 client.16431 trim_cache size 0 max 16384 2023-12-11T20:19:05.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.575+0000 7f01d0468b80 1 Processor -- start 2023-12-11T20:19:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.575+0000 7f01d0468b80 1 -- start start 2023-12-11T20:19:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d690a60 0x55614d699910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 0x55614d6a1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d691de0 0x55614d698360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01d0468b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d6839e0 con 0x55614d691de0 2023-12-11T20:19:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01d0468b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d68c630 con 0x55614d690a60 2023-12-11T20:19:05.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01d0468b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d699fc0 con 0x55614d6913c0 2023-12-11T20:19:05.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01b6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d691de0 0x55614d698360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01b6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d691de0 0x55614d698360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55396/0 (socket says 172.21.15.12:55396) 2023-12-11T20:19:05.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01b6d9d700 1 -- 172.21.15.12:0/2273677156 learned_addr learned my addr 172.21.15.12:0/2273677156 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 0x55614d6a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01b659c700 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d690a60 0x55614d699910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.576+0000 7f01b6d9d700 1 -- 172.21.15.12:0/2273677156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 msgr2=0x55614d6a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.577+0000 7f01b6d9d700 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 0x55614d6a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.577+0000 7f01b6d9d700 1 -- 172.21.15.12:0/2273677156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d690a60 msgr2=0x55614d699910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.577+0000 7f01b6d9d700 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d690a60 0x55614d699910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.577+0000 7f01b6d9d700 1 -- 172.21.15.12:0/2273677156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55614d3f6c60 con 0x55614d691de0 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.577+0000 7f01b6d9d700 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d691de0 0x55614d698360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f01b0007700 tx=0x7f01b0007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472c7065505d7bcc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.577+0000 7f01a57fa700 1 -- 172.21.15.12:0/2273677156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b000e040 con 0x55614d691de0 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.577+0000 7f01a57fa700 1 -- 172.21.15.12:0/2273677156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01b000f040 con 0x55614d691de0 2023-12-11T20:19:05.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01a57fa700 1 -- 172.21.15.12:0/2273677156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0008740 con 0x55614d691de0 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 -- 172.21.15.12:0/2273677156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d691de0 msgr2=0x55614d698360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d691de0 0x55614d698360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f01b0007700 tx=0x7f01b0007a10 comp rx=0 tx=0).stop 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 -- 172.21.15.12:0/2273677156 shutdown_connections 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d690a60 0x55614d699910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d691de0 0x55614d698360 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 --2- 172.21.15.12:0/2273677156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d6913c0 0x55614d6a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 -- 172.21.15.12:0/2273677156 >> 172.21.15.12:0/2273677156 conn(0x55614d5bf7e0 msgr2=0x55614d68b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 -- 172.21.15.12:0/2273677156 shutdown_connections 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.578+0000 7f01d0468b80 1 -- 172.21.15.12:0/2273677156 wait complete. 2023-12-11T20:19:05.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.579+0000 7f01d0468b80 1 -- start start 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.579+0000 7f01d0468b80 1 Processor -- start 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d6f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d6913c0 0x55614d6f8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01d0468b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d691de0 0x55614d6fac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01d0468b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d6a1d30 con 0x55614d690a60 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01d0468b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d6fb1a0 con 0x55614d6913c0 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01d0468b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614d6fb2e0 con 0x55614d691de0 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01d0468b80 10 client.0 _ll_register_callbacks cb 0x55614d4c9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d6f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d6f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55402/0 (socket says 172.21.15.12:55402) 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b659c700 1 -- 172.21.15.12:0/222786910 learned_addr learned my addr 172.21.15.12:0/222786910 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b6d9d700 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d691de0 0x55614d6fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d6913c0 0x55614d6f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b659c700 1 -- 172.21.15.12:0/222786910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d691de0 msgr2=0x55614d6fac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b659c700 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d691de0 0x55614d6fac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b659c700 1 -- 172.21.15.12:0/222786910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d6913c0 msgr2=0x55614d6f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b659c700 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d6913c0 0x55614d6f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.580+0000 7f01b659c700 1 -- 172.21.15.12:0/222786910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b00073e0 con 0x55614d690a60 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f01b659c700 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d6f61c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f01a80b2210 tx=0x7f01a8099730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f781ef3b0914778 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f019dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f019dffb700 1 -- 172.21.15.12:0/222786910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a809a420 con 0x55614d690a60 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f019dffb700 1 -- 172.21.15.12:0/222786910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01a80a20b0 con 0x55614d690a60 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f01d0468b80 1 -- 172.21.15.12:0/222786910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01a8099d20 con 0x55614d690a60 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f019dffb700 1 -- 172.21.15.12:0/222786910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a80980c0 con 0x55614d690a60 2023-12-11T20:19:05.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f01d0468b80 10 client.16437 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f01d0468b80 1 -- 172.21.15.12:0/222786910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55614d434250 con 0x55614d690a60 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.581+0000 7f019dffb700 1 -- 172.21.15.12:0/222786910 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01a8099d20 con 0x55614d690a60 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.582+0000 7f019dffb700 1 -- 172.21.15.12:0/222786910 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01a80adb00 con 0x55614d690a60 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.582+0000 7f01d0468b80 10 client.16437 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.582+0000 7f01d0468b80 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.582+0000 7f01d0468b80 20 client.16437 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.582+0000 7f01d0468b80 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55614d6fc700 0x55614d6feb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.582+0000 7f01d0468b80 4 client.16437 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.582+0000 7f01d0468b80 1 -- 172.21.15.12:0/222786910 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55614d5aafd0 con 0x55614d6fc700 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.582+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55614d6fc700 0x55614d6feb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01b5d9b700 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55614d6fc700 0x55614d6feb20 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3c1746cf4823415 server_cookie=e8735d19ba00b671 in_seq=0 out_seq=0 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f019dffb700 10 client.16437 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f019dffb700 1 -- 172.21.15.12:0/222786910 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55614d5aafd0 con 0x55614d6fc700 2023-12-11T20:19:05.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f019dffb700 10 client.16437 handle_command_reply: tid=0 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 client.16437 shutdown 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 -- 172.21.15.12:0/222786910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 msgr2=0x55614d6f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d6f61c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f01a80b2210 tx=0x7f01a8099730 comp rx=0 tx=0).stop 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 -- 172.21.15.12:0/222786910 shutdown_connections 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55614d6fc700 0x55614d6feb20 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55614d691de0 0x55614d6fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55614d690a60 0x55614d6f61c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 --2- 172.21.15.12:0/222786910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55614d6913c0 0x55614d6f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f019dffb700 0 client.16437 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 -- 172.21.15.12:0/222786910 >> 172.21.15.12:0/222786910 conn(0x55614d5bf7e0 msgr2=0x55614d698360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 -- 172.21.15.12:0/222786910 shutdown_connections 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.583+0000 7f01d0468b80 1 -- 172.21.15.12:0/222786910 wait complete. 2023-12-11T20:19:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01d0468b80 20 client.16437 trim_cache size 0 max 16384 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout: "19ecee4c-f37d-4cc1-85f5-6ea5c06625c4": { 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "19ecee4c-f37d-4cc1-85f5-6ea5c06625c4", 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:19:05.586 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:19:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 -- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01a00a15a0 msgr2=0x7f01a00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01a00a15a0 0x7f01a00a3a60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005910 tx=0x7f01ac00b610 comp rx=0 tx=0).stop 2023-12-11T20:19:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 -- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b8101d70 msgr2=0x7f01b8199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b8101d70 0x7f01b8199290 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f01a800d980 tx=0x7f01a800dc90 comp rx=0 tx=0).stop 2023-12-11T20:19:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 -- 172.21.15.12:0/1981906191 shutdown_connections 2023-12-11T20:19:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f01a00a15a0 0x7f01a00a3a60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01b8106fd0 0x7f01b81a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01b8101d70 0x7f01b8199290 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 --2- 172.21.15.12:0/1981906191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81046a0 0x7f01b81997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 -- 172.21.15.12:0/1981906191 >> 172.21.15.12:0/1981906191 conn(0x7f01b80fb740 msgr2=0x7f01b8101500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 -- 172.21.15.12:0/1981906191 shutdown_connections 2023-12-11T20:19:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:05.584+0000 7f01b759e700 1 -- 172.21.15.12:0/1981906191 wait complete. 2023-12-11T20:19:05.603 INFO:tasks.cephfs.filesystem:scrub status for tag:19ecee4c-f37d-4cc1-85f5-6ea5c06625c4 - {'path': '/', 'tag': '19ecee4c-f37d-4cc1-85f5-6ea5c06625c4', 'options': 'recursive,force'} 2023-12-11T20:19:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:05 smithi032 ceph-mon[132488]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:05.713 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:19:05 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:19:05.284+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v98>,<0x10000000003/client.0 v100>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v117>,<0x10000000001/sv_0 v141>,<0x10000000000/_nogroup v125>,<0x1/volumes v117>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:19:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:06.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:06.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:06.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:19:06.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:06.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:06.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:07 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:07 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:07 smithi039 ceph-mon[102205]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:19:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:07 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:07 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:07 smithi012 ceph-mon[128787]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:19:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:07 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:07 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:07 smithi032 ceph-mon[132488]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:19:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:09 smithi032 ceph-mon[132488]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:19:09.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:09 smithi039 ceph-mon[102205]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:19:09.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:09 smithi012 ceph-mon[128787]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:19:10.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:19:10.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:19:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:19:11.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:11 smithi032 ceph-mon[132488]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:19:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:19:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:19:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:11 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:19:11.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:11 smithi039 ceph-mon[102205]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:19:11.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:19:11.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:19:11.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:11 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:19:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:11 smithi012 ceph-mon[128787]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:19:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:19:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:19:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:11 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:19:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:13 smithi032 ceph-mon[132488]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:19:13.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:13 smithi039 ceph-mon[102205]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:19:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:13 smithi012 ceph-mon[128787]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:19:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:15 smithi032 ceph-mon[132488]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:19:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:15 smithi039 ceph-mon[102205]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:19:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:15 smithi012 ceph-mon[128787]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:19:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/403579326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e581048d0 msgr2=0x7f0e58106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/403579326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e581048d0 0x7f0e58106cc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009990 tx=0x7f0e4c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/403579326 shutdown_connections 2023-12-11T20:19:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/403579326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e58107200 0x7f0e58109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/403579326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e58101fa0 0x7f0e58104390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/403579326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e581048d0 0x7f0e58106cc0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/403579326 >> 172.21.15.12:0/403579326 conn(0x7f0e580fb930 msgr2=0x7f0e580fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/403579326 shutdown_connections 2023-12-11T20:19:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.960+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/403579326 wait complete. 2023-12-11T20:19:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.961+0000 7f0e5e3ff700 1 Processor -- start 2023-12-11T20:19:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e5e3ff700 1 -- start start 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e5e3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e58101fa0 0x7f0e58197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e5e3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e581048d0 0x7f0e581978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e5e3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e58107200 0x7f0e5819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e5e3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5819eec0 con 0x7f0e58101fa0 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e5e3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5819f000 con 0x7f0e58107200 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e5e3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5819f190 con 0x7f0e581048d0 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e58101fa0 0x7f0e58197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e58101fa0 0x7f0e58197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53556/0 (socket says 172.21.15.12:53556) 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.962+0000 7f0e57fff700 1 -- 172.21.15.12:0/2308566066 learned_addr learned my addr 172.21.15.12:0/2308566066 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e577fe700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e581048d0 0x7f0e581978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e58107200 0x7f0e5819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e57fff700 1 -- 172.21.15.12:0/2308566066 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e581048d0 msgr2=0x7f0e581978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e57fff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e581048d0 0x7f0e581978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e57fff700 1 -- 172.21.15.12:0/2308566066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e58107200 msgr2=0x7f0e5819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e57fff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e58107200 0x7f0e5819e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e57fff700 1 -- 172.21.15.12:0/2308566066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0095f0 con 0x7f0e58101fa0 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e577fe700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e581048d0 0x7f0e581978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e57fff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e58101fa0 0x7f0e58197390 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e9a0 tx=0x7f0e4800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e557fa700 1 -- 172.21.15.12:0/2308566066 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48009790 con 0x7f0e58101fa0 2023-12-11T20:19:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e557fa700 1 -- 172.21.15.12:0/2308566066 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e4800cbd0 con 0x7f0e58101fa0 2023-12-11T20:19:15.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.963+0000 7f0e557fa700 1 -- 172.21.15.12:0/2308566066 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48018680 con 0x7f0e58101fa0 2023-12-11T20:19:15.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.964+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/2308566066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5819f470 con 0x7f0e58101fa0 2023-12-11T20:19:15.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.964+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/2308566066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5819f930 con 0x7f0e58101fa0 2023-12-11T20:19:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.968+0000 7f0e557fa700 1 -- 172.21.15.12:0/2308566066 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0e4800cd40 con 0x7f0e58101fa0 2023-12-11T20:19:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.968+0000 7f0e71db2b80 1 Processor -- start 2023-12-11T20:19:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e71db2b80 1 -- start start 2023-12-11T20:19:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727f4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727f5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577274baf0 con 0x5557727f42e0 2023-12-11T20:19:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555772749410 con 0x5557727f5b30 2023-12-11T20:19:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555772744d00 con 0x5557727f4c40 2023-12-11T20:19:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e5c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e5c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53572/0 (socket says 172.21.15.12:53572) 2023-12-11T20:19:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.969+0000 7f0e5c99c700 1 -- 172.21.15.12:0/3260034946 learned_addr learned my addr 172.21.15.12:0/3260034946 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e57fff700 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e577fe700 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e5c99c700 1 -- 172.21.15.12:0/3260034946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 msgr2=0x5557727f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e557fa700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0e400a14f0 0x7f0e400a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e5c99c700 1 -- 172.21.15.12:0/3260034946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 msgr2=0x5557727f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e5c99c700 1 -- 172.21.15.12:0/3260034946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557725c15d0 con 0x5557727f42e0 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e57fff700 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e577fe700 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e557fa700 1 -- 172.21.15.12:0/2308566066 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0e48014070 con 0x7f0e58101fa0 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0e400a14f0 0x7f0e400a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.970+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727f4700 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009dd0 tx=0x7f0e500077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f666f3a7eaadbd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.971+0000 7f0e3e7fc700 1 -- 172.21.15.12:0/3260034946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500147f0 con 0x5557727f42e0 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.971+0000 7f0e3e7fc700 1 -- 172.21.15.12:0/3260034946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e5000f050 con 0x5557727f42e0 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.971+0000 7f0e3e7fc700 1 -- 172.21.15.12:0/3260034946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50020ea0 con 0x5557727f42e0 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 -- 172.21.15.12:0/3260034946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 msgr2=0x5557727f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727f4700 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009dd0 tx=0x7f0e500077e0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0e400a14f0 0x7f0e400a39b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e5001b000 tx=0x7f0e5001e870 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:15.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 -- 172.21.15.12:0/3260034946 shutdown_connections 2023-12-11T20:19:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727f4700 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/3260034946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 -- 172.21.15.12:0/3260034946 >> 172.21.15.12:0/3260034946 conn(0x55577271f780 msgr2=0x5557727ec880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 -- 172.21.15.12:0/3260034946 shutdown_connections 2023-12-11T20:19:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 -- 172.21.15.12:0/3260034946 wait complete. 2023-12-11T20:19:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.972+0000 7f0e71db2b80 1 -- start start 2023-12-11T20:19:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e71db2b80 1 Processor -- start 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727fe230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727fe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557728055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557726fe500 con 0x5557727f42e0 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557726fe1a0 con 0x5557727f5b30 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557725c38c0 con 0x5557727f4c40 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e71db2b80 10 client.0 _ll_register_callbacks cb 0x555772629a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727fe230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53578/0 (socket says 172.21.15.12:53578) 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.973+0000 7f0e57fff700 1 -- 172.21.15.12:0/1443396535 learned_addr learned my addr 172.21.15.12:0/1443396535 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e577fe700 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557728055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e57fff700 1 -- 172.21.15.12:0/1443396535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 msgr2=0x5557727fe770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e57fff700 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727fe770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e57fff700 1 -- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 msgr2=0x5557728055a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e57fff700 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557728055a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e57fff700 1 -- 172.21.15.12:0/1443396535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e50009a00 con 0x5557727f42e0 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557728055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e57fff700 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727fe230 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0e480967c0 tx=0x7f0e4809a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5004bd710e50ee57 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e377fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.974+0000 7f0e377fe700 1 -- 172.21.15.12:0/1443396535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4809a9c0 con 0x5557727f42e0 2023-12-11T20:19:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e377fe700 1 -- 172.21.15.12:0/1443396535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0e4809a2c0 con 0x5557727f42e0 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1443396535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557727e3730 con 0x5557727f42e0 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e377fe700 1 -- 172.21.15.12:0/1443396535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e480b1030 con 0x5557727f42e0 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e71db2b80 10 client.16449 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1443396535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55577256dd80 con 0x5557727f42e0 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e377fe700 1 -- 172.21.15.12:0/1443396535 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e480b6020 con 0x5557727f42e0 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e377fe700 1 -- 172.21.15.12:0/1443396535 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0e48099220 con 0x5557727f42e0 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e71db2b80 10 client.16449 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e71db2b80 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e71db2b80 20 client.16449 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.975+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55577280a070 0x55577280c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.976+0000 7f0e71db2b80 4 client.16449 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.976+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1443396535 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557727bfee0 con 0x55577280a070 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.976+0000 7f0e577fe700 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55577280a070 0x55577280c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.977+0000 7f0e577fe700 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55577280a070 0x55577280c490 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=183aa305825f4a98 server_cookie=ad27d7ee7106353f in_seq=0 out_seq=0 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.977+0000 7f0e377fe700 10 client.16449 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.977+0000 7f0e377fe700 1 -- 172.21.15.12:0/1443396535 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5557727bfee0 con 0x55577280a070 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.977+0000 7f0e377fe700 10 client.16449 handle_command_reply: tid=0 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 client.16449 shutdown 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1443396535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 msgr2=0x5557727fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727fe230 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0e480967c0 tx=0x7f0e4809a800 comp rx=0 tx=0).stop 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1443396535 shutdown_connections 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55577280a070 0x55577280c490 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557728055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f42e0 0x5557727fe230 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1443396535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f4c40 0x5557727fe770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e377fe700 0 client.16449 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1443396535 >> 172.21.15.12:0/1443396535 conn(0x55577271f780 msgr2=0x5557727eaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1443396535 shutdown_connections 2023-12-11T20:19:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1443396535 wait complete. 2023-12-11T20:19:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:15.978+0000 7f0e71db2b80 20 client.16449 trim_cache size 0 max 16384 2023-12-11T20:19:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.001+0000 7f0e71db2b80 1 Processor -- start 2023-12-11T20:19:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.001+0000 7f0e71db2b80 1 -- start start 2023-12-11T20:19:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f42e0 0x555772805e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x555772805560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557727f3e60 con 0x5557727f4c40 2023-12-11T20:19:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557728116c0 con 0x5557727f5b30 2023-12-11T20:19:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557727fbd20 con 0x5557727f42e0 2023-12-11T20:19:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f42e0 0x555772805e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e5c99c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x555772805560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e5c99c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46136/0 (socket says 172.21.15.12:46136) 2023-12-11T20:19:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e57fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f42e0 0x555772805e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:39566/0 (socket says 172.21.15.12:39566) 2023-12-11T20:19:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.002+0000 7f0e5c99c700 1 -- 172.21.15.12:0/967954330 learned_addr learned my addr 172.21.15.12:0/967954330 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.003+0000 7f0e5c99c700 1 -- 172.21.15.12:0/967954330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f42e0 msgr2=0x555772805e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.003+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/967954330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f42e0 0x555772805e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.003+0000 7f0e5c99c700 1 -- 172.21.15.12:0/967954330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 msgr2=0x555772805560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.003+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/967954330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x555772805560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.003+0000 7f0e5c99c700 1 -- 172.21.15.12:0/967954330 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555772556c00 con 0x5557727f5b30 2023-12-11T20:19:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.003+0000 7f0e577fe700 1 --2- 172.21.15.12:0/967954330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x555772805560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.003+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/967954330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5f10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009dd0 tx=0x7f0e50016050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c945f233792bbc55 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.004+0000 7f0e3effd700 1 -- 172.21.15.12:0/967954330 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5001e3a0 con 0x5557727f5b30 2023-12-11T20:19:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.004+0000 7f0e3effd700 1 -- 172.21.15.12:0/967954330 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e5001eda0 con 0x5557727f5b30 2023-12-11T20:19:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.004+0000 7f0e3effd700 1 -- 172.21.15.12:0/967954330 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50004cd0 con 0x5557727f5b30 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.004+0000 7f0e71db2b80 1 -- 172.21.15.12:0/967954330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 msgr2=0x5557727f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.004+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/967954330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5f10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009dd0 tx=0x7f0e50016050 comp rx=0 tx=0).stop 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.005+0000 7f0e71db2b80 1 -- 172.21.15.12:0/967954330 shutdown_connections 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.005+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/967954330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f5b30 0x5557727f5f10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.005+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/967954330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f42e0 0x555772805e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.005+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/967954330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x555772805560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.005+0000 7f0e71db2b80 1 -- 172.21.15.12:0/967954330 >> 172.21.15.12:0/967954330 conn(0x55577271f780 msgr2=0x5557727f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.005+0000 7f0e71db2b80 1 -- 172.21.15.12:0/967954330 shutdown_connections 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.005+0000 7f0e71db2b80 1 -- 172.21.15.12:0/967954330 wait complete. 2023-12-11T20:19:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.005+0000 7f0e71db2b80 1 -- start start 2023-12-11T20:19:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e71db2b80 1 Processor -- start 2023-12-11T20:19:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f42e0 0x555772804e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x5557728053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e71db2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f5b30 0x555772803480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555772803b60 con 0x5557727f4c40 2023-12-11T20:19:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555772803cd0 con 0x5557727f42e0 2023-12-11T20:19:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e71db2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555772803e90 con 0x5557727f5b30 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e71db2b80 10 client.0 _ll_register_callbacks cb 0x555772629a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.006+0000 7f0e577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x5557728053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x5557728053b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53610/0 (socket says 172.21.15.12:53610) 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e577fe700 1 -- 172.21.15.12:0/1886600627 learned_addr learned my addr 172.21.15.12:0/1886600627 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e5c99c700 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f5b30 0x555772803480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e57fff700 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f42e0 0x555772804e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e577fe700 1 -- 172.21.15.12:0/1886600627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f5b30 msgr2=0x555772803480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e577fe700 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f5b30 0x555772803480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e577fe700 1 -- 172.21.15.12:0/1886600627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f42e0 msgr2=0x555772804e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e577fe700 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f42e0 0x555772804e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e577fe700 1 -- 172.21.15.12:0/1886600627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5810a200 con 0x5557727f4c40 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e577fe700 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x5557728053b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c003f60 tx=0x7f0e4c005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6e325c4fa0972a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.007+0000 7f0e377fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.008+0000 7f0e377fe700 1 -- 172.21.15.12:0/1886600627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003830 con 0x5557727f4c40 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.008+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1886600627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e5000f050 con 0x5557727f4c40 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.008+0000 7f0e377fe700 1 -- 172.21.15.12:0/1886600627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0e4c003990 con 0x5557727f4c40 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.008+0000 7f0e377fe700 1 -- 172.21.15.12:0/1886600627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e4c003b90 con 0x5557727f4c40 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.008+0000 7f0e71db2b80 10 client.16455 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.008+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1886600627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f0e50026070 con 0x5557727f4c40 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.008+0000 7f0e377fe700 1 -- 172.21.15.12:0/1886600627 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e5000f050 con 0x5557727f4c40 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.008+0000 7f0e377fe700 1 -- 172.21.15.12:0/1886600627 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0e4c028040 con 0x5557727f4c40 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.009+0000 7f0e71db2b80 10 client.16455 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.009+0000 7f0e71db2b80 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.009+0000 7f0e71db2b80 20 client.16455 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.009+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555772861960 0x555772863d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.009+0000 7f0e71db2b80 4 client.16455 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:19:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.009+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1886600627 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55577270af70 con 0x555772861960 2023-12-11T20:19:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.009+0000 7f0e57fff700 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555772861960 0x555772863d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.010+0000 7f0e377fe700 10 client.16455 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.010+0000 7f0e57fff700 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555772861960 0x555772863d80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f8e611afada4b6b server_cookie=5d0cd54c76dd33a8 in_seq=0 out_seq=0 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.019+0000 7f0e377fe700 1 -- 172.21.15.12:0/1886600627 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55577270af70 con 0x555772861960 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.019+0000 7f0e377fe700 10 client.16455 handle_command_reply: tid=0 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.019+0000 7f0e71db2b80 1 client.16455 shutdown 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1886600627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 msgr2=0x5557728053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x5557728053b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c003f60 tx=0x7f0e4c005ec0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1886600627 shutdown_connections 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555772861960 0x555772863d80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5557727f42e0 0x555772804e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5557727f5b30 0x555772803480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 --2- 172.21.15.12:0/1886600627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5557727f4c40 0x5557728053b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e377fe700 0 client.16455 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1886600627 >> 172.21.15.12:0/1886600627 conn(0x55577271f780 msgr2=0x5557727ec460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1886600627 shutdown_connections 2023-12-11T20:19:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 1 -- 172.21.15.12:0/1886600627 wait complete. 2023-12-11T20:19:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.020+0000 7f0e71db2b80 20 client.16455 trim_cache size 0 max 16384 2023-12-11T20:19:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:19:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:19:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:19:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:19:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0e400a14f0 msgr2=0x7f0e400a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0e400a14f0 0x7f0e400a39b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e5001b000 tx=0x7f0e5001e870 comp rx=0 tx=0).stop 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e58101fa0 msgr2=0x7f0e58197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e58101fa0 0x7f0e58197390 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e9a0 tx=0x7f0e4800ed60 comp rx=0 tx=0).stop 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/2308566066 shutdown_connections 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0e400a14f0 0x7f0e400a39b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e58107200 0x7f0e5819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e58101fa0 0x7f0e58197390 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 --2- 172.21.15.12:0/2308566066 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e581048d0 0x7f0e581978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/2308566066 >> 172.21.15.12:0/2308566066 conn(0x7f0e580fb930 msgr2=0x7f0e581029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/2308566066 shutdown_connections 2023-12-11T20:19:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:16.021+0000 7f0e5e3ff700 1 -- 172.21.15.12:0/2308566066 wait complete. 2023-12-11T20:19:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:16 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:19:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:16 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:19:16.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:16 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:19:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:17 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:19:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:17 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:19:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:17 smithi039 ceph-mon[102205]: pgmap v476: 97 pgs: 97 active+clean; 1.7 GiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 33 op/s 2023-12-11T20:19:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:17 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:19:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:17 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:19:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:17 smithi012 ceph-mon[128787]: pgmap v476: 97 pgs: 97 active+clean; 1.7 GiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 33 op/s 2023-12-11T20:19:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:17 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:19:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:17 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:19:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:17 smithi032 ceph-mon[132488]: pgmap v476: 97 pgs: 97 active+clean; 1.7 GiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 33 op/s 2023-12-11T20:19:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:19 smithi032 ceph-mon[132488]: pgmap v477: 97 pgs: 97 active+clean; 1.7 GiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 23 op/s 2023-12-11T20:19:19.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:19 smithi039 ceph-mon[102205]: pgmap v477: 97 pgs: 97 active+clean; 1.7 GiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 23 op/s 2023-12-11T20:19:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:19 smithi012 ceph-mon[128787]: pgmap v477: 97 pgs: 97 active+clean; 1.7 GiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 23 op/s 2023-12-11T20:19:21.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:21 smithi039 ceph-mon[102205]: pgmap v478: 97 pgs: 97 active+clean; 1.7 GiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:19:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:21 smithi012 ceph-mon[128787]: pgmap v478: 97 pgs: 97 active+clean; 1.7 GiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:19:21.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:21 smithi032 ceph-mon[132488]: pgmap v478: 97 pgs: 97 active+clean; 1.7 GiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:19:23.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:23 smithi039 ceph-mon[102205]: pgmap v479: 97 pgs: 97 active+clean; 1.7 GiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:19:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:23 smithi012 ceph-mon[128787]: pgmap v479: 97 pgs: 97 active+clean; 1.7 GiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:19:23.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:23 smithi032 ceph-mon[132488]: pgmap v479: 97 pgs: 97 active+clean; 1.7 GiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:19:25.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:25 smithi039 ceph-mon[102205]: pgmap v480: 97 pgs: 97 active+clean; 1.8 GiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:19:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:25 smithi012 ceph-mon[128787]: pgmap v480: 97 pgs: 97 active+clean; 1.8 GiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:19:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:25 smithi032 ceph-mon[132488]: pgmap v480: 97 pgs: 97 active+clean; 1.8 GiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:19:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:27 smithi039 ceph-mon[102205]: pgmap v481: 97 pgs: 97 active+clean; 1.8 GiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:27 smithi012 ceph-mon[128787]: pgmap v481: 97 pgs: 97 active+clean; 1.8 GiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:27 smithi032 ceph-mon[132488]: pgmap v481: 97 pgs: 97 active+clean; 1.8 GiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:29.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 -- 172.21.15.12:0/1208993859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 msgr2=0x7f080c10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 --2- 172.21.15.12:0/1208993859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 0x7f080c10b960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f080400b0d0 tx=0x7f080400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 -- 172.21.15.12:0/1208993859 shutdown_connections 2023-12-11T20:19:29.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 --2- 172.21.15.12:0/1208993859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 0x7f080c10b960 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 --2- 172.21.15.12:0/1208993859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f080c103520 0x7f080c103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 --2- 172.21.15.12:0/1208993859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f080c104710 0x7f080c104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 -- 172.21.15.12:0/1208993859 >> 172.21.15.12:0/1208993859 conn(0x7f080c0fead0 msgr2=0x7f080c100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:29.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 -- 172.21.15.12:0/1208993859 shutdown_connections 2023-12-11T20:19:29.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.192+0000 7f0812f9d700 1 -- 172.21.15.12:0/1208993859 wait complete. 2023-12-11T20:19:29.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.193+0000 7f0812f9d700 1 Processor -- start 2023-12-11T20:19:29.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.193+0000 7f0812f9d700 1 -- start start 2023-12-11T20:19:29.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.193+0000 7f0812f9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f080c103520 0x7f080c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.193+0000 7f0812f9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f080c104710 0x7f080c199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.193+0000 7f0812f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 0x7f080c1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.193+0000 7f0812f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c1a0f20 con 0x7f080c1050b0 2023-12-11T20:19:29.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.193+0000 7f0812f9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c1a1060 con 0x7f080c104710 2023-12-11T20:19:29.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.193+0000 7f0812f9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c1a11f0 con 0x7f080c103520 2023-12-11T20:19:29.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f081279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 0x7f080c1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f0811f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f080c103520 0x7f080c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f0811f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f080c103520 0x7f080c199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34560/0 (socket says 172.21.15.12:34560) 2023-12-11T20:19:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f0811f9b700 1 -- 172.21.15.12:0/2350840913 learned_addr learned my addr 172.21.15.12:0/2350840913 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f081179a700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f080c104710 0x7f080c199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f081279c700 1 -- 172.21.15.12:0/2350840913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f080c103520 msgr2=0x7f080c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f081279c700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f080c103520 0x7f080c199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f081279c700 1 -- 172.21.15.12:0/2350840913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f080c104710 msgr2=0x7f080c199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f081279c700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f080c104710 0x7f080c199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f081279c700 1 -- 172.21.15.12:0/2350840913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804009d00 con 0x7f080c1050b0 2023-12-11T20:19:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.194+0000 7f081179a700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f080c104710 0x7f080c199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.195+0000 7f081279c700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 0x7f080c1a0950 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0804007b60 tx=0x7f08040094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.195+0000 7f0802ffd700 1 -- 172.21.15.12:0/2350840913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400e040 con 0x7f080c1050b0 2023-12-11T20:19:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.195+0000 7f0802ffd700 1 -- 172.21.15.12:0/2350840913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0804003e10 con 0x7f080c1050b0 2023-12-11T20:19:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.195+0000 7f0802ffd700 1 -- 172.21.15.12:0/2350840913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804012a60 con 0x7f080c1050b0 2023-12-11T20:19:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.195+0000 7f0812f9d700 1 -- 172.21.15.12:0/2350840913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c1a1470 con 0x7f080c1050b0 2023-12-11T20:19:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.195+0000 7f0812f9d700 1 -- 172.21.15.12:0/2350840913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c1a1840 con 0x7f080c1050b0 2023-12-11T20:19:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.198+0000 7f0802ffd700 1 -- 172.21.15.12:0/2350840913 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0804005720 con 0x7f080c1050b0 2023-12-11T20:19:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.200+0000 7f0827acbb80 1 Processor -- start 2023-12-11T20:19:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.200+0000 7f0802ffd700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07f80a1470 0x7f07f80a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.200+0000 7f0827acbb80 1 -- start start 2023-12-11T20:19:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.200+0000 7f0802ffd700 1 -- 172.21.15.12:0/2350840913 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f08040ce1f0 con 0x7f080c1050b0 2023-12-11T20:19:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f081179a700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07f80a1470 0x7f07f80a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda863bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863c0d0 0x55dda8640640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda8642f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0827acbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda8596af0 con 0x55dda8640b80 2023-12-11T20:19:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0827acbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda8594410 con 0x55dda863b770 2023-12-11T20:19:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0827acbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda858fd00 con 0x55dda863c0d0 2023-12-11T20:19:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0811f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda863bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f081279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda8642f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0811f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda863bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60482/0 (socket says 172.21.15.12:60482) 2023-12-11T20:19:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.201+0000 7f0811f9b700 1 -- 172.21.15.12:0/826408345 learned_addr learned my addr 172.21.15.12:0/826408345 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f081179a700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07f80a1470 0x7f07f80a3930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00bc10 tx=0x7f07fc00b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f081179a700 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863c0d0 0x55dda8640640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f0811f9b700 1 -- 172.21.15.12:0/826408345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863c0d0 msgr2=0x55dda8640640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f0811f9b700 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863c0d0 0x55dda8640640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f0811f9b700 1 -- 172.21.15.12:0/826408345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 msgr2=0x55dda8642f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f0811f9b700 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda8642f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f0811f9b700 1 -- 172.21.15.12:0/826408345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda840c5d0 con 0x55dda863b770 2023-12-11T20:19:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f081279c700 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda8642f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f081179a700 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863c0d0 0x55dda8640640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.202+0000 7f0811f9b700 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda863bb90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f080800bea0 tx=0x7f08080106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91f7321b301aae12 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f07f7fff700 1 -- 172.21.15.12:0/826408345 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080800b970 con 0x55dda863b770 2023-12-11T20:19:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f07f7fff700 1 -- 172.21.15.12:0/826408345 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0808015070 con 0x55dda863b770 2023-12-11T20:19:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f07f7fff700 1 -- 172.21.15.12:0/826408345 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808003e30 con 0x55dda863b770 2023-12-11T20:19:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f0827acbb80 1 -- 172.21.15.12:0/826408345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 msgr2=0x55dda863bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f0827acbb80 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda863bb90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f080800bea0 tx=0x7f08080106b0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f0827acbb80 1 -- 172.21.15.12:0/826408345 shutdown_connections 2023-12-11T20:19:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f0827acbb80 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda863bb90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f0827acbb80 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda8642f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f0827acbb80 1 --2- 172.21.15.12:0/826408345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863c0d0 0x55dda8640640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.203+0000 7f0827acbb80 1 -- 172.21.15.12:0/826408345 >> 172.21.15.12:0/826408345 conn(0x55dda856a780 msgr2=0x55dda8637b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.204+0000 7f0827acbb80 1 -- 172.21.15.12:0/826408345 shutdown_connections 2023-12-11T20:19:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.204+0000 7f0827acbb80 1 -- 172.21.15.12:0/826408345 wait complete. 2023-12-11T20:19:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.204+0000 7f0827acbb80 1 -- start start 2023-12-11T20:19:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0827acbb80 1 Processor -- start 2023-12-11T20:19:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863b770 0x55dda8644f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 0x55dda8645470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda864c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0827acbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda8549500 con 0x55dda863b770 2023-12-11T20:19:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0827acbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda85491a0 con 0x55dda863c0d0 2023-12-11T20:19:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0827acbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda840e8c0 con 0x55dda8640b80 2023-12-11T20:19:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0827acbb80 10 client.0 _ll_register_callbacks cb 0x55dda8474a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0811f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863b770 0x55dda8644f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0811f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863b770 0x55dda8644f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46828/0 (socket says 172.21.15.12:46828) 2023-12-11T20:19:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.205+0000 7f0811f9b700 1 -- 172.21.15.12:0/70402804 learned_addr learned my addr 172.21.15.12:0/70402804 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f081179a700 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 0x55dda8645470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f081279c700 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda864c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f0811f9b700 1 -- 172.21.15.12:0/70402804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 msgr2=0x55dda864c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f0811f9b700 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda864c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f0811f9b700 1 -- 172.21.15.12:0/70402804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 msgr2=0x55dda8645470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f0811f9b700 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 0x55dda8645470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f0811f9b700 1 -- 172.21.15.12:0/70402804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c1a1840 con 0x55dda863b770 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f081279c700 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda864c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f0811f9b700 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863b770 0x55dda8644f30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f080800b970 tx=0x7f080800b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7a04db4bc32fd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.206+0000 7f07f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.207+0000 7f07f57fa700 1 -- 172.21.15.12:0/70402804 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808003db0 con 0x55dda863b770 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.207+0000 7f0827acbb80 1 -- 172.21.15.12:0/70402804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dda862e730 con 0x55dda863b770 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.207+0000 7f07f57fa700 1 -- 172.21.15.12:0/70402804 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0808003f10 con 0x55dda863b770 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.207+0000 7f07f57fa700 1 -- 172.21.15.12:0/70402804 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08080040d0 con 0x55dda863b770 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.207+0000 7f0827acbb80 10 client.16467 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.207+0000 7f0827acbb80 1 -- 172.21.15.12:0/70402804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f080800bad0 con 0x55dda863b770 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.207+0000 7f07f57fa700 1 -- 172.21.15.12:0/70402804 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dda862e730 con 0x55dda863b770 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.207+0000 7f07f57fa700 1 -- 172.21.15.12:0/70402804 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f080801ac00 con 0x55dda863b770 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.208+0000 7f0827acbb80 10 client.16467 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.208+0000 7f0827acbb80 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.208+0000 7f0827acbb80 20 client.16467 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.208+0000 7f0827acbb80 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dda8650c00 0x55dda8653020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.208+0000 7f0827acbb80 4 client.16467 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.208+0000 7f0827acbb80 1 -- 172.21.15.12:0/70402804 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dda860aee0 con 0x55dda8650c00 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.208+0000 7f081179a700 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dda8650c00 0x55dda8653020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.209+0000 7f07f57fa700 10 client.16467 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.209+0000 7f081179a700 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dda8650c00 0x55dda8653020 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4862c65e781103aa server_cookie=309e3384821866f8 in_seq=0 out_seq=0 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f07f57fa700 1 -- 172.21.15.12:0/70402804 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dda860aee0 con 0x55dda8650c00 2023-12-11T20:19:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f07f57fa700 10 client.16467 handle_command_reply: tid=0 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 client.16467 shutdown 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 -- 172.21.15.12:0/70402804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863b770 msgr2=0x55dda8644f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863b770 0x55dda8644f30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f080800b970 tx=0x7f080800b9a0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 -- 172.21.15.12:0/70402804 shutdown_connections 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dda8650c00 0x55dda8653020 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda864c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863b770 0x55dda8644f30 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 --2- 172.21.15.12:0/70402804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 0x55dda8645470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f07f57fa700 0 client.16467 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 -- 172.21.15.12:0/70402804 >> 172.21.15.12:0/70402804 conn(0x55dda856a780 msgr2=0x55dda8638560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 -- 172.21.15.12:0/70402804 shutdown_connections 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 1 -- 172.21.15.12:0/70402804 wait complete. 2023-12-11T20:19:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.210+0000 7f0827acbb80 20 client.16467 trim_cache size 0 max 16384 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.230+0000 7f0827acbb80 1 Processor -- start 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.230+0000 7f0827acbb80 1 -- start start 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.230+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda864cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.230+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863c0d0 0x55dda864c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.230+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda8644440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.230+0000 7f0827acbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda8637210 con 0x55dda863c0d0 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.230+0000 7f0827acbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda862e4c0 con 0x55dda863b770 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.230+0000 7f0827acbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda8645bb0 con 0x55dda8640b80 2023-12-11T20:19:29.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863c0d0 0x55dda864c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863c0d0 0x55dda864c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46836/0 (socket says 172.21.15.12:46836) 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 -- 172.21.15.12:0/1239064977 learned_addr learned my addr 172.21.15.12:0/1239064977 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f0811f9b700 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda864cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081279c700 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda8644440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 -- 172.21.15.12:0/1239064977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 msgr2=0x55dda8644440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda8644440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 -- 172.21.15.12:0/1239064977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 msgr2=0x55dda864cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda864cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 -- 172.21.15.12:0/1239064977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda83b8d80 con 0x55dda863c0d0 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.231+0000 7f081179a700 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863c0d0 0x55dda864c420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f07fc014040 tx=0x7f07fc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae35a41e4e7fcc34 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.232+0000 7f0800ff9700 1 -- 172.21.15.12:0/1239064977 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc024040 con 0x55dda863c0d0 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.232+0000 7f0800ff9700 1 -- 172.21.15.12:0/1239064977 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07fc026380 con 0x55dda863c0d0 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.232+0000 7f0800ff9700 1 -- 172.21.15.12:0/1239064977 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc003aa0 con 0x55dda863c0d0 2023-12-11T20:19:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 -- 172.21.15.12:0/1239064977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863c0d0 msgr2=0x55dda864c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863c0d0 0x55dda864c420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f07fc014040 tx=0x7f07fc015000 comp rx=0 tx=0).stop 2023-12-11T20:19:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 -- 172.21.15.12:0/1239064977 shutdown_connections 2023-12-11T20:19:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863b770 0x55dda864cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda8640b80 0x55dda8644440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1239064977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda863c0d0 0x55dda864c420 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 -- 172.21.15.12:0/1239064977 >> 172.21.15.12:0/1239064977 conn(0x55dda856a780 msgr2=0x55dda86403f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 -- 172.21.15.12:0/1239064977 shutdown_connections 2023-12-11T20:19:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 -- 172.21.15.12:0/1239064977 wait complete. 2023-12-11T20:19:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.233+0000 7f0827acbb80 1 -- start start 2023-12-11T20:19:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.234+0000 7f0827acbb80 1 Processor -- start 2023-12-11T20:19:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.234+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863b770 0x55dda864a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.234+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 0x55dda864a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.234+0000 7f0827acbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda864b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.234+0000 7f0827acbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda864bb00 con 0x55dda8640b80 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.234+0000 7f0827acbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda864bc70 con 0x55dda863c0d0 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.234+0000 7f0827acbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda864be30 con 0x55dda863b770 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.234+0000 7f0827acbb80 10 client.0 _ll_register_callbacks cb 0x55dda8474a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda864b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f0811f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863b770 0x55dda864a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f0811f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863b770 0x55dda864a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34600/0 (socket says 172.21.15.12:34600) 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda864b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46846/0 (socket says 172.21.15.12:46846) 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f0811f9b700 1 -- 172.21.15.12:0/1787966115 learned_addr learned my addr 172.21.15.12:0/1787966115 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081179a700 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 0x55dda864a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081279c700 1 -- 172.21.15.12:0/1787966115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863b770 msgr2=0x55dda864a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081279c700 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863b770 0x55dda864a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081279c700 1 -- 172.21.15.12:0/1787966115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 msgr2=0x55dda864a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081279c700 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 0x55dda864a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081279c700 1 -- 172.21.15.12:0/1787966115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc00fa60 con 0x55dda8640b80 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f0811f9b700 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863b770 0x55dda864a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f081279c700 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda864b5c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f080409b280 tx=0x7f080409b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7f1bdefc03eba4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.235+0000 7f07f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f07f57fa700 1 -- 172.21.15.12:0/1787966115 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080409bc80 con 0x55dda8640b80 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f07f57fa700 1 -- 172.21.15.12:0/1787966115 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f080409b580 con 0x55dda8640b80 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 1 -- 172.21.15.12:0/1787966115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0808015070 con 0x55dda8640b80 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f07f57fa700 1 -- 172.21.15.12:0/1787966115 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f080409f6d0 con 0x55dda8640b80 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 10 client.16473 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 1 -- 172.21.15.12:0/1787966115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55dda83a1c00 con 0x55dda8640b80 2023-12-11T20:19:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f07f57fa700 1 -- 172.21.15.12:0/1787966115 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0808015070 con 0x55dda8640b80 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f07f57fa700 1 -- 172.21.15.12:0/1787966115 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f080409aa70 con 0x55dda8640b80 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 10 client.16473 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 10 client.16473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 20 client.16473 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dda86a7cd0 0x55dda86aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 4 client.16473 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.236+0000 7f0827acbb80 1 -- 172.21.15.12:0/1787966115 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dda8555f70 con 0x55dda86a7cd0 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.237+0000 7f0811f9b700 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dda86a7cd0 0x55dda86aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.237+0000 7f0811f9b700 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dda86a7cd0 0x55dda86aa0f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=157943aac2ae681c server_cookie=9e248a22694309e in_seq=0 out_seq=0 2023-12-11T20:19:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.237+0000 7f07f57fa700 10 client.16473 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f07f57fa700 1 -- 172.21.15.12:0/1787966115 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dda8555f70 con 0x55dda86a7cd0 2023-12-11T20:19:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f07f57fa700 10 client.16473 handle_command_reply: tid=0 2023-12-11T20:19:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 client.16473 shutdown 2023-12-11T20:19:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 -- 172.21.15.12:0/1787966115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 msgr2=0x55dda864b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda864b5c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f080409b280 tx=0x7f080409b420 comp rx=0 tx=0).stop 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 -- 172.21.15.12:0/1787966115 shutdown_connections 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dda86a7cd0 0x55dda86aa0f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dda8640b80 0x55dda864b5c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dda863b770 0x55dda864a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 --2- 172.21.15.12:0/1787966115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dda863c0d0 0x55dda864a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f07f57fa700 0 client.16473 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 -- 172.21.15.12:0/1787966115 >> 172.21.15.12:0/1787966115 conn(0x55dda856a780 msgr2=0x55dda863ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 -- 172.21.15.12:0/1787966115 shutdown_connections 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 1 -- 172.21.15.12:0/1787966115 wait complete. 2023-12-11T20:19:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.247+0000 7f0827acbb80 20 client.16473 trim_cache size 0 max 16384 2023-12-11T20:19:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:19:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:19:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:19:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 -- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07f80a1470 msgr2=0x7f07f80a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07f80a1470 0x7f07f80a3930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00bc10 tx=0x7f07fc00b5f0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 -- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 msgr2=0x7f080c1a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 0x7f080c1a0950 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0804007b60 tx=0x7f08040094c0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 -- 172.21.15.12:0/2350840913 shutdown_connections 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07f80a1470 0x7f07f80a3930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f080c1050b0 0x7f080c1a0950 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f080c103520 0x7f080c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 --2- 172.21.15.12:0/2350840913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f080c104710 0x7f080c199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 -- 172.21.15.12:0/2350840913 >> 172.21.15.12:0/2350840913 conn(0x7f080c0fead0 msgr2=0x7f080c107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 -- 172.21.15.12:0/2350840913 shutdown_connections 2023-12-11T20:19:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:29.248+0000 7f0812f9d700 1 -- 172.21.15.12:0/2350840913 wait complete. 2023-12-11T20:19:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:29 smithi032 ceph-mon[132488]: pgmap v482: 97 pgs: 97 active+clean; 1.8 GiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:29.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:29 smithi039 ceph-mon[102205]: pgmap v482: 97 pgs: 97 active+clean; 1.8 GiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:29 smithi012 ceph-mon[128787]: pgmap v482: 97 pgs: 97 active+clean; 1.8 GiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:31.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:31 smithi039 ceph-mon[102205]: pgmap v483: 97 pgs: 97 active+clean; 1.9 GiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 15 MiB/s wr, 11 op/s 2023-12-11T20:19:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:31 smithi012 ceph-mon[128787]: pgmap v483: 97 pgs: 97 active+clean; 1.9 GiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 15 MiB/s wr, 11 op/s 2023-12-11T20:19:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:31 smithi032 ceph-mon[132488]: pgmap v483: 97 pgs: 97 active+clean; 1.9 GiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 15 MiB/s wr, 11 op/s 2023-12-11T20:19:33.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:33 smithi039 ceph-mon[102205]: pgmap v484: 97 pgs: 97 active+clean; 1.9 GiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:19:33.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:33 smithi012 ceph-mon[128787]: pgmap v484: 97 pgs: 97 active+clean; 1.9 GiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:19:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:33 smithi032 ceph-mon[132488]: pgmap v484: 97 pgs: 97 active+clean; 1.9 GiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:19:35.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:35 smithi039 ceph-mon[102205]: pgmap v485: 97 pgs: 97 active+clean; 1.9 GiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:35 smithi012 ceph-mon[128787]: pgmap v485: 97 pgs: 97 active+clean; 1.9 GiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:35.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:19:35.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:35 smithi032 ceph-mon[132488]: pgmap v485: 97 pgs: 97 active+clean; 1.9 GiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.867+0000 7f39c5dff700 1 -- 172.21.15.12:0/1703555243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c0103040 msgr2=0x7f39c01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.867+0000 7f39c5dff700 1 --2- 172.21.15.12:0/1703555243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c0103040 0x7f39c01098f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f39b800b0d0 tx=0x7f39b800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.867+0000 7f39c5dff700 1 -- 172.21.15.12:0/1703555243 shutdown_connections 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.867+0000 7f39c5dff700 1 --2- 172.21.15.12:0/1703555243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c0103040 0x7f39c01098f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.868+0000 7f39c5dff700 1 --2- 172.21.15.12:0/1703555243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c01014b0 0x7f39c01018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.868+0000 7f39c5dff700 1 --2- 172.21.15.12:0/1703555243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39c01026a0 0x7f39c0102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.868+0000 7f39c5dff700 1 -- 172.21.15.12:0/1703555243 >> 172.21.15.12:0/1703555243 conn(0x7f39c00fca00 msgr2=0x7f39c00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.868+0000 7f39c5dff700 1 -- 172.21.15.12:0/1703555243 shutdown_connections 2023-12-11T20:19:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.868+0000 7f39c5dff700 1 -- 172.21.15.12:0/1703555243 wait complete. 2023-12-11T20:19:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39c5dff700 1 Processor -- start 2023-12-11T20:19:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39c5dff700 1 -- start start 2023-12-11T20:19:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39c5dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39c01014b0 0x7f39c0199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39c5dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c01026a0 0x7f39c0199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39c5dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c0103040 0x7f39c01a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39c5dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a1160 con 0x7f39c01026a0 2023-12-11T20:19:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39c5dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a12a0 con 0x7f39c01014b0 2023-12-11T20:19:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39c5dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a1430 con 0x7f39c0103040 2023-12-11T20:19:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.869+0000 7f39beffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c01026a0 0x7f39c0199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39beffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c01026a0 0x7f39c0199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46872/0 (socket says 172.21.15.12:46872) 2023-12-11T20:19:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39beffd700 1 -- 172.21.15.12:0/3278331696 learned_addr learned my addr 172.21.15.12:0/3278331696 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39bffff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c0103040 0x7f39c01a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39c01014b0 0x7f39c0199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39beffd700 1 -- 172.21.15.12:0/3278331696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c0103040 msgr2=0x7f39c01a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39beffd700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c0103040 0x7f39c01a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39beffd700 1 -- 172.21.15.12:0/3278331696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39c01014b0 msgr2=0x7f39c0199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39beffd700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39c01014b0 0x7f39c0199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39beffd700 1 -- 172.21.15.12:0/3278331696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8009d00 con 0x7f39c01026a0 2023-12-11T20:19:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.870+0000 7f39beffd700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c01026a0 0x7f39c0199b70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f39b400e9a0 tx=0x7f39b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.871+0000 7f39bcff9700 1 -- 172.21.15.12:0/3278331696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4009790 con 0x7f39c01026a0 2023-12-11T20:19:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.871+0000 7f39bcff9700 1 -- 172.21.15.12:0/3278331696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b4010430 con 0x7f39c01026a0 2023-12-11T20:19:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.871+0000 7f39bcff9700 1 -- 172.21.15.12:0/3278331696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b400cea0 con 0x7f39c01026a0 2023-12-11T20:19:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.871+0000 7f39c5dff700 1 -- 172.21.15.12:0/3278331696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c01a1710 con 0x7f39c01026a0 2023-12-11T20:19:35.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.871+0000 7f39c5dff700 1 -- 172.21.15.12:0/3278331696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c01a1c20 con 0x7f39c01026a0 2023-12-11T20:19:35.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.876+0000 7f39bcff9700 1 -- 172.21.15.12:0/3278331696 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f39b40105a0 con 0x7f39c01026a0 2023-12-11T20:19:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39d974cb80 1 Processor -- start 2023-12-11T20:19:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39d974cb80 1 -- start start 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 0x55b30518a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518ad30 0x55b30518b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39d974cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3050e5b50 con 0x55b30518bc20 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39d974cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3050e3470 con 0x55b30518ad30 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39d974cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3050ded60 con 0x55b30518a3d0 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.877+0000 7f39bcff9700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39a80a1500 0x7f39a80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518ad30 0x55b30518b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39beffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518ad30 0x55b30518b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60536/0 (socket says 172.21.15.12:60536) 2023-12-11T20:19:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bf7fe700 1 -- 172.21.15.12:0/3982199742 learned_addr learned my addr 172.21.15.12:0/3982199742 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bcff9700 1 -- 172.21.15.12:0/3278331696 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39b4014070 con 0x7f39c01026a0 2023-12-11T20:19:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bf7fe700 1 -- 172.21.15.12:0/3982199742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 msgr2=0x55b30518a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/3982199742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 0x55b30518a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bf7fe700 1 -- 172.21.15.12:0/3982199742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 msgr2=0x55b30518c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/3982199742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bffff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39a80a1500 0x7f39a80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.878+0000 7f39bf7fe700 1 -- 172.21.15.12:0/3982199742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b304f5b630 con 0x55b30518ad30 2023-12-11T20:19:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.879+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/3982199742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518ad30 0x55b30518b640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d30 tx=0x7f39b0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc5579496defd73 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.879+0000 7f39a5ffb700 1 -- 172.21.15.12:0/3982199742 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0004220 con 0x55b30518ad30 2023-12-11T20:19:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.879+0000 7f39bffff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39a80a1500 0x7f39a80a39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007af0 tx=0x7f39b8009380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.879+0000 7f39a5ffb700 1 -- 172.21.15.12:0/3982199742 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b0004380 con 0x55b30518ad30 2023-12-11T20:19:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.879+0000 7f39a5ffb700 1 -- 172.21.15.12:0/3982199742 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00197a0 con 0x55b30518ad30 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 -- 172.21.15.12:0/3982199742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518ad30 msgr2=0x55b30518b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 --2- 172.21.15.12:0/3982199742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518ad30 0x55b30518b640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d30 tx=0x7f39b0011720 comp rx=0 tx=0).stop 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 -- 172.21.15.12:0/3982199742 shutdown_connections 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 --2- 172.21.15.12:0/3982199742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 --2- 172.21.15.12:0/3982199742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 0x55b30518a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 --2- 172.21.15.12:0/3982199742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518ad30 0x55b30518b640 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 -- 172.21.15.12:0/3982199742 >> 172.21.15.12:0/3982199742 conn(0x55b3050b97e0 msgr2=0x55b305186d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 -- 172.21.15.12:0/3982199742 shutdown_connections 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.880+0000 7f39d974cb80 1 -- 172.21.15.12:0/3982199742 wait complete. 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.881+0000 7f39d974cb80 1 -- start start 2023-12-11T20:19:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.881+0000 7f39d974cb80 1 Processor -- start 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518a3d0 0x55b3051941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 0x55b3051946e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39d974cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b305098560 con 0x55b30518a3d0 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39d974cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b305098200 con 0x55b30518bc20 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39d974cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b304f5d920 con 0x55b30518ad30 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39d974cb80 10 client.0 _ll_register_callbacks cb 0x55b304fc3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518a3d0 0x55b3051941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518a3d0 0x55b3051941a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46886/0 (socket says 172.21.15.12:46886) 2023-12-11T20:19:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bf7fe700 1 -- 172.21.15.12:0/116062076 learned_addr learned my addr 172.21.15.12:0/116062076 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bffff700 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39beffd700 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 0x55b3051946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bf7fe700 1 -- 172.21.15.12:0/116062076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 msgr2=0x55b3051946e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 0x55b3051946e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bf7fe700 1 -- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 msgr2=0x55b30519b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bf7fe700 1 -- 172.21.15.12:0/116062076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b0009960 con 0x55b30518a3d0 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.882+0000 7f39bffff700 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.883+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518a3d0 0x55b3051941a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097c0 tx=0x7f39b0003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce2ea3717728a3d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.883+0000 7f399effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.883+0000 7f399effd700 1 -- 172.21.15.12:0/116062076 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0005240 con 0x55b30518a3d0 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.883+0000 7f399effd700 1 -- 172.21.15.12:0/116062076 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39b00053a0 con 0x55b30518a3d0 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.883+0000 7f39d974cb80 1 -- 172.21.15.12:0/116062076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b30517db40 con 0x55b30518a3d0 2023-12-11T20:19:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.883+0000 7f399effd700 1 -- 172.21.15.12:0/116062076 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b0005580 con 0x55b30518a3d0 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.883+0000 7f39d974cb80 10 client.16485 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.883+0000 7f39d974cb80 1 -- 172.21.15.12:0/116062076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b304f07de0 con 0x55b30518a3d0 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f399effd700 1 -- 172.21.15.12:0/116062076 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b30517db40 con 0x55b30518a3d0 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f399effd700 1 -- 172.21.15.12:0/116062076 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f39b0021040 con 0x55b30518a3d0 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f39d974cb80 10 client.16485 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f39d974cb80 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f39d974cb80 20 client.16485 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f39d974cb80 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b30519ff10 0x55b3051a2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f39d974cb80 4 client.16485 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f39d974cb80 1 -- 172.21.15.12:0/116062076 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b305159f40 con 0x55b30519ff10 2023-12-11T20:19:35.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.884+0000 7f39beffd700 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b30519ff10 0x55b3051a2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.885+0000 7f39beffd700 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b30519ff10 0x55b3051a2330 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f9b90f6fe2710f1 server_cookie=dd33995fd869e923 in_seq=0 out_seq=0 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.885+0000 7f399effd700 10 client.16485 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f399effd700 1 -- 172.21.15.12:0/116062076 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b305159f40 con 0x55b30519ff10 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f399effd700 10 client.16485 handle_command_reply: tid=0 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 client.16485 shutdown 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 -- 172.21.15.12:0/116062076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518a3d0 msgr2=0x55b3051941a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518a3d0 0x55b3051941a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097c0 tx=0x7f39b0003680 comp rx=0 tx=0).stop 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 -- 172.21.15.12:0/116062076 shutdown_connections 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b30519ff10 0x55b3051a2330 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518a3d0 0x55b3051941a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 --2- 172.21.15.12:0/116062076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 0x55b3051946e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f39d974cb80 1 -- 172.21.15.12:0/116062076 >> 172.21.15.12:0/116062076 conn(0x55b3050b97e0 msgr2=0x55b305185a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.886+0000 7f399effd700 0 client.16485 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:35.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.887+0000 7f39d974cb80 1 -- 172.21.15.12:0/116062076 shutdown_connections 2023-12-11T20:19:35.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.887+0000 7f39d974cb80 1 -- 172.21.15.12:0/116062076 wait complete. 2023-12-11T20:19:35.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.887+0000 7f39d974cb80 20 client.16485 trim_cache size 0 max 16384 2023-12-11T20:19:35.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.913+0000 7f39d974cb80 1 Processor -- start 2023-12-11T20:19:35.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.913+0000 7f39d974cb80 1 -- start start 2023-12-11T20:19:35.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.913+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518a3d0 0x55b305192e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.913+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 0x55b30519b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.913+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.913+0000 7f39d974cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b305181b50 con 0x55b30518bc20 2023-12-11T20:19:35.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.913+0000 7f39d974cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b30518b360 con 0x55b30518a3d0 2023-12-11T20:19:35.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.913+0000 7f39d974cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3051a7540 con 0x55b30518ad30 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518a3d0 0x55b305192e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46898/0 (socket says 172.21.15.12:46898) 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bffff700 1 -- 172.21.15.12:0/3334135491 learned_addr learned my addr 172.21.15.12:0/3334135491 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39beffd700 1 --2- 172.21.15.12:0/3334135491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 0x55b30519b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bf7fe700 1 -- 172.21.15.12:0/3334135491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 msgr2=0x55b30519b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/3334135491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 0x55b30519b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bf7fe700 1 -- 172.21.15.12:0/3334135491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 msgr2=0x55b30518ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/3334135491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bf7fe700 1 -- 172.21.15.12:0/3334135491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b304ef0c60 con 0x55b30518a3d0 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.914+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/3334135491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518a3d0 0x55b305192e80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39b0019770 tx=0x7f39b0005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f122607c4e1936 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.915+0000 7f39a67fc700 1 -- 172.21.15.12:0/3334135491 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00037a0 con 0x55b30518a3d0 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.915+0000 7f39a67fc700 1 -- 172.21.15.12:0/3334135491 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b0009c30 con 0x55b30518a3d0 2023-12-11T20:19:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.915+0000 7f39a67fc700 1 -- 172.21.15.12:0/3334135491 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0004970 con 0x55b30518a3d0 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 -- 172.21.15.12:0/3334135491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518a3d0 msgr2=0x55b305192e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 --2- 172.21.15.12:0/3334135491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518a3d0 0x55b305192e80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39b0019770 tx=0x7f39b0005a00 comp rx=0 tx=0).stop 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 -- 172.21.15.12:0/3334135491 shutdown_connections 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 --2- 172.21.15.12:0/3334135491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518a3d0 0x55b305192e80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 --2- 172.21.15.12:0/3334135491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518bc20 0x55b30518ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 --2- 172.21.15.12:0/3334135491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518ad30 0x55b30519b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 -- 172.21.15.12:0/3334135491 >> 172.21.15.12:0/3334135491 conn(0x55b3050b97e0 msgr2=0x55b3051936b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 -- 172.21.15.12:0/3334135491 shutdown_connections 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 -- 172.21.15.12:0/3334135491 wait complete. 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.916+0000 7f39d974cb80 1 -- start start 2023-12-11T20:19:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39d974cb80 1 Processor -- start 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 0x55b305198df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518ad30 0x55b305199330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39d974cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39d974cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b30519a880 con 0x55b30518ad30 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39d974cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b30519a9f0 con 0x55b30518bc20 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39d974cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b30519abb0 con 0x55b30518a3d0 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39d974cb80 10 client.0 _ll_register_callbacks cb 0x55b304fc3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39beffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518ad30 0x55b305199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39beffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518ad30 0x55b305199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46910/0 (socket says 172.21.15.12:46910) 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.917+0000 7f39beffd700 1 -- 172.21.15.12:0/4227462729 learned_addr learned my addr 172.21.15.12:0/4227462729 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 0x55b305198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39beffd700 1 -- 172.21.15.12:0/4227462729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 msgr2=0x55b305198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39beffd700 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 0x55b305198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39beffd700 1 -- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 msgr2=0x55b30519a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:35.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39bffff700 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39beffd700 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39beffd700 1 -- 172.21.15.12:0/4227462729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b304f07de0 con 0x55b30518ad30 2023-12-11T20:19:35.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39bffff700 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:35.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39beffd700 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518ad30 0x55b305199330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c2d0 tx=0x7f39b4010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8261b491afdfe5d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:35.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f399effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:35.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f399effd700 1 -- 172.21.15.12:0/4227462729 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4010880 con 0x55b30518ad30 2023-12-11T20:19:35.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f399effd700 1 -- 172.21.15.12:0/4227462729 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39b409a840 con 0x55b30518ad30 2023-12-11T20:19:35.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.918+0000 7f39d974cb80 1 -- 172.21.15.12:0/4227462729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39b0004380 con 0x55b30518ad30 2023-12-11T20:19:35.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f399effd700 1 -- 172.21.15.12:0/4227462729 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b409a140 con 0x55b30518ad30 2023-12-11T20:19:35.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f39d974cb80 10 client.16491 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:35.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f39d974cb80 1 -- 172.21.15.12:0/4227462729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b304f2e250 con 0x55b30518ad30 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f399effd700 1 -- 172.21.15.12:0/4227462729 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b0004380 con 0x55b30518ad30 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f399effd700 1 -- 172.21.15.12:0/4227462729 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f39b40b8250 con 0x55b30518ad30 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f39d974cb80 10 client.16491 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f39d974cb80 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f39d974cb80 20 client.16491 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f39d974cb80 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b3051f6e50 0x55b3051f9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f39d974cb80 4 client.16491 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.919+0000 7f39d974cb80 1 -- 172.21.15.12:0/4227462729 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b3050a4fd0 con 0x55b3051f6e50 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.920+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b3051f6e50 0x55b3051f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.920+0000 7f399effd700 10 client.16491 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.920+0000 7f39bf7fe700 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b3051f6e50 0x55b3051f9270 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd31b6bf20e7f00 server_cookie=5a240020fa7a4f99 in_seq=0 out_seq=0 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f399effd700 1 -- 172.21.15.12:0/4227462729 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b3050a4fd0 con 0x55b3051f6e50 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f399effd700 10 client.16491 handle_command_reply: tid=0 2023-12-11T20:19:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 client.16491 shutdown 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 -- 172.21.15.12:0/4227462729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518ad30 msgr2=0x55b305199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518ad30 0x55b305199330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c2d0 tx=0x7f39b4010b80 comp rx=0 tx=0).stop 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 -- 172.21.15.12:0/4227462729 shutdown_connections 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b3051f6e50 0x55b3051f9270 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b30518bc20 0x55b30519a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b30518a3d0 0x55b305198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 --2- 172.21.15.12:0/4227462729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b30518ad30 0x55b305199330 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 -- 172.21.15.12:0/4227462729 >> 172.21.15.12:0/4227462729 conn(0x55b3050b97e0 msgr2=0x55b305186970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f399effd700 0 client.16491 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 -- 172.21.15.12:0/4227462729 shutdown_connections 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 1 -- 172.21.15.12:0/4227462729 wait complete. 2023-12-11T20:19:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.921+0000 7f39d974cb80 20 client.16491 trim_cache size 0 max 16384 2023-12-11T20:19:35.923 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:19:35.923 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:19:35.923 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:19:35.923 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:19:35.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 -- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39a80a1500 msgr2=0x7f39a80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39a80a1500 0x7f39a80a39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007af0 tx=0x7f39b8009380 comp rx=0 tx=0).stop 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 -- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c01026a0 msgr2=0x7f39c0199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c01026a0 0x7f39c0199b70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f39b400e9a0 tx=0x7f39b400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 -- 172.21.15.12:0/3278331696 shutdown_connections 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39a80a1500 0x7f39a80a39c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39c01014b0 0x7f39c0199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39c0103040 0x7f39c01a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 --2- 172.21.15.12:0/3278331696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c01026a0 0x7f39c0199b70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 -- 172.21.15.12:0/3278331696 >> 172.21.15.12:0/3278331696 conn(0x7f39c00fca00 msgr2=0x7f39c0073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:35.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 -- 172.21.15.12:0/3278331696 shutdown_connections 2023-12-11T20:19:35.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:35.922+0000 7f39c5dff700 1 -- 172.21.15.12:0/3278331696 wait complete. 2023-12-11T20:19:35.939 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:19:35.940 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:19:36.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.157+0000 7ff691fff700 1 -- 172.21.15.12:0/712346829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c103030 msgr2=0x7ff68c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.157+0000 7ff691fff700 1 --2- 172.21.15.12:0/712346829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c103030 0x7ff68c1098e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff68400b0d0 tx=0x7ff68400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.158+0000 7ff691fff700 1 -- 172.21.15.12:0/712346829 shutdown_connections 2023-12-11T20:19:36.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.158+0000 7ff691fff700 1 --2- 172.21.15.12:0/712346829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c1014a0 0x7ff68c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.158+0000 7ff691fff700 1 --2- 172.21.15.12:0/712346829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c103030 0x7ff68c1098e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.158+0000 7ff691fff700 1 --2- 172.21.15.12:0/712346829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff68c102690 0x7ff68c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.158+0000 7ff691fff700 1 -- 172.21.15.12:0/712346829 >> 172.21.15.12:0/712346829 conn(0x7ff68c0fca10 msgr2=0x7ff68c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.158+0000 7ff691fff700 1 -- 172.21.15.12:0/712346829 shutdown_connections 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.158+0000 7ff691fff700 1 -- 172.21.15.12:0/712346829 wait complete. 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.159+0000 7ff691fff700 1 Processor -- start 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.159+0000 7ff691fff700 1 -- start start 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff691fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff68c1014a0 0x7ff68c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff691fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c102690 0x7ff68c199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff691fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c103030 0x7ff68c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff691fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c1a1160 con 0x7ff68c102690 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff691fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c1a12a0 con 0x7ff68c103030 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff691fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c1a1430 con 0x7ff68c1014a0 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff68affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c102690 0x7ff68c199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff68affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c102690 0x7ff68c199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46920/0 (socket says 172.21.15.12:46920) 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff68affd700 1 -- 172.21.15.12:0/3715027734 learned_addr learned my addr 172.21.15.12:0/3715027734 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:36.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff68b7fe700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff68c1014a0 0x7ff68c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.160+0000 7ff68bfff700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c103030 0x7ff68c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff68affd700 1 -- 172.21.15.12:0/3715027734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff68c1014a0 msgr2=0x7ff68c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff68affd700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff68c1014a0 0x7ff68c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff68affd700 1 -- 172.21.15.12:0/3715027734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c103030 msgr2=0x7ff68c1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff68affd700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c103030 0x7ff68c1a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff68affd700 1 -- 172.21.15.12:0/3715027734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff684009d00 con 0x7ff68c102690 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff68bfff700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c103030 0x7ff68c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff68affd700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c102690 0x7ff68c199b70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff68000e9a0 tx=0x7ff68000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff688ff9700 1 -- 172.21.15.12:0/3715027734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680009790 con 0x7ff68c102690 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c1a1710 con 0x7ff68c102690 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff688ff9700 1 -- 172.21.15.12:0/3715027734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff68000cbd0 con 0x7ff68c102690 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff688ff9700 1 -- 172.21.15.12:0/3715027734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680018680 con 0x7ff68c102690 2023-12-11T20:19:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.161+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68c1a1c70 con 0x7ff68c102690 2023-12-11T20:19:36.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.162+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68c068330 con 0x7ff68c102690 2023-12-11T20:19:36.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.165+0000 7ff688ff9700 1 -- 172.21.15.12:0/3715027734 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff68000cd40 con 0x7ff68c102690 2023-12-11T20:19:36.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.167+0000 7ff688ff9700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6740a1500 0x7ff6740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.167+0000 7ff688ff9700 1 -- 172.21.15.12:0/3715027734 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff680014070 con 0x7ff68c102690 2023-12-11T20:19:36.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.167+0000 7ff68b7fe700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6740a1500 0x7ff6740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.168+0000 7ff68b7fe700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6740a1500 0x7ff6740a39c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff68c1024f0 tx=0x7ff67c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:36.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.173+0000 7ff688ff9700 1 -- 172.21.15.12:0/3715027734 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff6800522f0 con 0x7ff68c102690 2023-12-11T20:19:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.506+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff68c10cb60 con 0x7ff68c102690 2023-12-11T20:19:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.507+0000 7ff688ff9700 1 -- 172.21.15.12:0/3715027734 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11306 (secure 0 0 0) 0x7ff680096570 con 0x7ff68c102690 2023-12-11T20:19:36.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:19:36.505 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:17:06.102424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:19:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6740a1500 msgr2=0x7ff6740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6740a1500 0x7ff6740a39c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff68c1024f0 tx=0x7ff67c009260 comp rx=0 tx=0).stop 2023-12-11T20:19:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c102690 msgr2=0x7ff68c199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c102690 0x7ff68c199b70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff68000e9a0 tx=0x7ff68000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 shutdown_connections 2023-12-11T20:19:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6740a1500 0x7ff6740a39c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c103030 0x7ff68c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff68c1014a0 0x7ff68c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 --2- 172.21.15.12:0/3715027734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68c102690 0x7ff68c199b70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 >> 172.21.15.12:0/3715027734 conn(0x7ff68c0fca10 msgr2=0x7ff68c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 shutdown_connections 2023-12-11T20:19:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.510+0000 7ff691fff700 1 -- 172.21.15.12:0/3715027734 wait complete. 2023-12-11T20:19:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 24 2023-12-11T20:19:36.532 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:19:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 -- 172.21.15.12:0/398642641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 msgr2=0x7fba88104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 --2- 172.21.15.12:0/398642641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 0x7fba88104160 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fba78009990 tx=0x7fba78009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 -- 172.21.15.12:0/398642641 shutdown_connections 2023-12-11T20:19:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 --2- 172.21.15.12:0/398642641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba88106fd0 0x7fba88109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 --2- 172.21.15.12:0/398642641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 0x7fba88104160 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 --2- 172.21.15.12:0/398642641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba881046a0 0x7fba88106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 -- 172.21.15.12:0/398642641 >> 172.21.15.12:0/398642641 conn(0x7fba880fb740 msgr2=0x7fba880fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 -- 172.21.15.12:0/398642641 shutdown_connections 2023-12-11T20:19:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.774+0000 7fba87fff700 1 -- 172.21.15.12:0/398642641 wait complete. 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.775+0000 7fba87fff700 1 Processor -- start 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.775+0000 7fba87fff700 1 -- start start 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 0x7fba88197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba87fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba881046a0 0x7fba881975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba87fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba88106fd0 0x7fba8819e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba87fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8819ebc0 con 0x7fba88101d70 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba87fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8819ed00 con 0x7fba881046a0 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba87fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8819ee90 con 0x7fba88106fd0 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba86ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 0x7fba88197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba86ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 0x7fba88197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46940/0 (socket says 172.21.15.12:46940) 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba86ffd700 1 -- 172.21.15.12:0/892187871 learned_addr learned my addr 172.21.15.12:0/892187871 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba877fe700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba88106fd0 0x7fba8819e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.776+0000 7fba867fc700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba881046a0 0x7fba881975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba86ffd700 1 -- 172.21.15.12:0/892187871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba88106fd0 msgr2=0x7fba8819e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba86ffd700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba88106fd0 0x7fba8819e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba86ffd700 1 -- 172.21.15.12:0/892187871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba881046a0 msgr2=0x7fba881975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba86ffd700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba881046a0 0x7fba881975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba86ffd700 1 -- 172.21.15.12:0/892187871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780095f0 con 0x7fba88101d70 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba877fe700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba88106fd0 0x7fba8819e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba86ffd700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 0x7fba88197090 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fba78005740 tx=0x7fba78005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba6ffff700 1 -- 172.21.15.12:0/892187871 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7801d070 con 0x7fba88101d70 2023-12-11T20:19:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba6ffff700 1 -- 172.21.15.12:0/892187871 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba7800beb0 con 0x7fba88101d70 2023-12-11T20:19:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba87fff700 1 -- 172.21.15.12:0/892187871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8819f110 con 0x7fba88101d70 2023-12-11T20:19:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba6ffff700 1 -- 172.21.15.12:0/892187871 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78021410 con 0x7fba88101d70 2023-12-11T20:19:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.777+0000 7fba87fff700 1 -- 172.21.15.12:0/892187871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8819f590 con 0x7fba88101d70 2023-12-11T20:19:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.781+0000 7fba6ffff700 1 -- 172.21.15.12:0/892187871 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fba7800f720 con 0x7fba88101d70 2023-12-11T20:19:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.782+0000 7fba6ffff700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba700a15a0 0x7fba700a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.782+0000 7fba6ffff700 1 -- 172.21.15.12:0/892187871 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fba780ce0a0 con 0x7fba88101d70 2023-12-11T20:19:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.782+0000 7fba867fc700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba700a15a0 0x7fba700a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.783+0000 7fba867fc700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba700a15a0 0x7fba700a3a60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009bf0 tx=0x7fba7c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.783+0000 7fbaa116bb80 1 Processor -- start 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.783+0000 7fbaa116bb80 1 -- start start 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.783+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aada60 0x555584aade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 0x555584aae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584aaf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584a08b50 con 0x555584aaede0 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584a06470 con 0x555584aae3c0 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584a01d60 con 0x555584aada60 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584aaf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba867fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 0x555584aae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584aaf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46948/0 (socket says 172.21.15.12:46948) 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba877fe700 1 -- 172.21.15.12:0/4276106365 learned_addr learned my addr 172.21.15.12:0/4276106365 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba86ffd700 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aada60 0x555584aade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba877fe700 1 -- 172.21.15.12:0/4276106365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aada60 msgr2=0x555584aade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba877fe700 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aada60 0x555584aade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba877fe700 1 -- 172.21.15.12:0/4276106365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 msgr2=0x555584aae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba877fe700 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 0x555584aae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba877fe700 1 -- 172.21.15.12:0/4276106365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55558487e630 con 0x555584aaede0 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.784+0000 7fba86ffd700 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aada60 0x555584aade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.785+0000 7fba877fe700 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584aaf240 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fba800078d0 tx=0x7fba80007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400a70e6dacbde6a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.785+0000 7fba6d7fa700 1 -- 172.21.15.12:0/4276106365 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80004bb0 con 0x555584aaede0 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.785+0000 7fba6d7fa700 1 -- 172.21.15.12:0/4276106365 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba8000f040 con 0x555584aaede0 2023-12-11T20:19:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.785+0000 7fba6d7fa700 1 -- 172.21.15.12:0/4276106365 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80005280 con 0x555584aaede0 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4276106365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 msgr2=0x555584aaf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584aaf240 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fba800078d0 tx=0x7fba80007be0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4276106365 shutdown_connections 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584aaf240 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aada60 0x555584aade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/4276106365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 0x555584aae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4276106365 >> 172.21.15.12:0/4276106365 conn(0x5555849dc7e0 msgr2=0x555584aa83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4276106365 shutdown_connections 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.786+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4276106365 wait complete. 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.787+0000 7fbaa116bb80 1 -- start start 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.787+0000 7fbaa116bb80 1 Processor -- start 2023-12-11T20:19:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.787+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584ab72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.787+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aae3c0 0x555584ab7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.787+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584abe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.787+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555849bb560 con 0x555584aaede0 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.787+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555849bb200 con 0x555584aada60 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.787+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584880920 con 0x555584aae3c0 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fbaa116bb80 10 client.0 _ll_register_callbacks cb 0x5555848e6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584abe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba86ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584ab72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba86ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584ab72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60598/0 (socket says 172.21.15.12:60598) 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba86ffd700 1 -- 172.21.15.12:0/939238769 learned_addr learned my addr 172.21.15.12:0/939238769 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba867fc700 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aae3c0 0x555584ab7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba877fe700 1 -- 172.21.15.12:0/939238769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aae3c0 msgr2=0x555584ab7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba877fe700 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aae3c0 0x555584ab7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba877fe700 1 -- 172.21.15.12:0/939238769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 msgr2=0x555584ab72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba877fe700 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584ab72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba877fe700 1 -- 172.21.15.12:0/939238769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba80007500 con 0x555584aaede0 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.788+0000 7fba86ffd700 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584ab72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.789+0000 7fba877fe700 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584abe7f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fba800078a0 tx=0x7fba80003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91355c69c7b95522 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.789+0000 7fba6aff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.789+0000 7fba6aff5700 1 -- 172.21.15.12:0/939238769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80003e60 con 0x555584aaede0 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.789+0000 7fba6aff5700 1 -- 172.21.15.12:0/939238769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fba80004ce0 con 0x555584aaede0 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.789+0000 7fbaa116bb80 1 -- 172.21.15.12:0/939238769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555584aa09e0 con 0x555584aaede0 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.789+0000 7fba6aff5700 1 -- 172.21.15.12:0/939238769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba80004ea0 con 0x555584aaede0 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fbaa116bb80 10 client.16509 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fbaa116bb80 1 -- 172.21.15.12:0/939238769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55558482ade0 con 0x555584aaede0 2023-12-11T20:19:36.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fba6aff5700 1 -- 172.21.15.12:0/939238769 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555584aa09e0 con 0x555584aaede0 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fba6aff5700 1 -- 172.21.15.12:0/939238769 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fba8001e500 con 0x555584aaede0 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fbaa116bb80 10 client.16509 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fbaa116bb80 10 client.16509 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fbaa116bb80 20 client.16509 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x555584ac2f50 0x555584ac5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fbaa116bb80 4 client.16509 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.790+0000 7fbaa116bb80 1 -- 172.21.15.12:0/939238769 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555584a7cf40 con 0x555584ac2f50 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.791+0000 7fba86ffd700 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x555584ac2f50 0x555584ac5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.792+0000 7fba86ffd700 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x555584ac2f50 0x555584ac5370 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e89e09e01ccfe1 server_cookie=9b865282310f0c4c in_seq=0 out_seq=0 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.792+0000 7fba6aff5700 10 client.16509 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.793+0000 7fba6aff5700 1 -- 172.21.15.12:0/939238769 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555584a7cf40 con 0x555584ac2f50 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.793+0000 7fba6aff5700 10 client.16509 handle_command_reply: tid=0 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.793+0000 7fbaa116bb80 1 client.16509 shutdown 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.793+0000 7fbaa116bb80 1 -- 172.21.15.12:0/939238769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 msgr2=0x555584abe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.793+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584abe7f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fba800078a0 tx=0x7fba80003c30 comp rx=0 tx=0).stop 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.793+0000 7fbaa116bb80 1 -- 172.21.15.12:0/939238769 shutdown_connections 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.793+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x555584ac2f50 0x555584ac5370 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.793+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584ab72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.794+0000 7fba6aff5700 0 client.16509 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.794+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aaede0 0x555584abe7f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.794+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/939238769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aae3c0 0x555584ab7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.794+0000 7fbaa116bb80 1 -- 172.21.15.12:0/939238769 >> 172.21.15.12:0/939238769 conn(0x5555849dc7e0 msgr2=0x555584aac820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.794+0000 7fbaa116bb80 1 -- 172.21.15.12:0/939238769 shutdown_connections 2023-12-11T20:19:36.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.794+0000 7fbaa116bb80 1 -- 172.21.15.12:0/939238769 wait complete. 2023-12-11T20:19:36.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.794+0000 7fbaa116bb80 20 client.16509 trim_cache size 0 max 16384 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.809+0000 7fbaa116bb80 1 Processor -- start 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fbaa116bb80 1 -- start start 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aada60 0x555584abeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 0x555584abe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 0x555584aaf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584ab62f0 con 0x555584aada60 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584ab6e30 con 0x555584aae3c0 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584aa9090 con 0x555584aaede0 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fba86ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aada60 0x555584abeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fba86ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aada60 0x555584abeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46966/0 (socket says 172.21.15.12:46966) 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.810+0000 7fba86ffd700 1 -- 172.21.15.12:0/4107505002 learned_addr learned my addr 172.21.15.12:0/4107505002 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba877fe700 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 0x555584aaf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba867fc700 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 0x555584abe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba86ffd700 1 -- 172.21.15.12:0/4107505002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 msgr2=0x555584aaf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:36.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba86ffd700 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 0x555584aaf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba86ffd700 1 -- 172.21.15.12:0/4107505002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 msgr2=0x555584abe7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:36.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba86ffd700 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 0x555584abe7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba86ffd700 1 -- 172.21.15.12:0/4107505002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555584813c60 con 0x555584aada60 2023-12-11T20:19:36.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba86ffd700 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aada60 0x555584abeea0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba78097e20 tx=0x7fba7809b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92f063af7cbbf61 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:36.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba6dffb700 1 -- 172.21.15.12:0/4107505002 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7809bb00 con 0x555584aada60 2023-12-11T20:19:36.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba6dffb700 1 -- 172.21.15.12:0/4107505002 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba7809b400 con 0x555584aada60 2023-12-11T20:19:36.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.811+0000 7fba6dffb700 1 -- 172.21.15.12:0/4107505002 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78099830 con 0x555584aada60 2023-12-11T20:19:36.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4107505002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aada60 msgr2=0x555584abeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aada60 0x555584abeea0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba78097e20 tx=0x7fba7809b940 comp rx=0 tx=0).stop 2023-12-11T20:19:36.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4107505002 shutdown_connections 2023-12-11T20:19:36.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 0x555584aaf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aada60 0x555584abeea0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/4107505002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aae3c0 0x555584abe7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4107505002 >> 172.21.15.12:0/4107505002 conn(0x5555849dc7e0 msgr2=0x555584aa8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:36.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4107505002 shutdown_connections 2023-12-11T20:19:36.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.812+0000 7fbaa116bb80 1 -- 172.21.15.12:0/4107505002 wait complete. 2023-12-11T20:19:36.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.813+0000 7fbaa116bb80 1 -- start start 2023-12-11T20:19:36.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.813+0000 7fbaa116bb80 1 Processor -- start 2023-12-11T20:19:36.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584abc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aae3c0 0x555584abc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fbaa116bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 0x555584abd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584abdc60 con 0x555584aae3c0 2023-12-11T20:19:36.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584abddd0 con 0x555584aada60 2023-12-11T20:19:36.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fbaa116bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555584abdf90 con 0x555584aaede0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fbaa116bb80 10 client.0 _ll_register_callbacks cb 0x5555848e6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fba867fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aae3c0 0x555584abc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fba867fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aae3c0 0x555584abc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46978/0 (socket says 172.21.15.12:46978) 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fba867fc700 1 -- 172.21.15.12:0/665867494 learned_addr learned my addr 172.21.15.12:0/665867494 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fba877fe700 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 0x555584abd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.814+0000 7fba86ffd700 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584abc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba867fc700 1 -- 172.21.15.12:0/665867494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 msgr2=0x555584abd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba867fc700 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 0x555584abd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba867fc700 1 -- 172.21.15.12:0/665867494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 msgr2=0x555584abc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba867fc700 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584abc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba867fc700 1 -- 172.21.15.12:0/665867494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8819f590 con 0x555584aae3c0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba867fc700 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aae3c0 0x555584abc7b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0128a0 tx=0x7fba7c014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7427bcd7e95c1aa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba6aff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba6aff5700 1 -- 172.21.15.12:0/665867494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c024040 con 0x555584aae3c0 2023-12-11T20:19:36.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fbaa116bb80 1 -- 172.21.15.12:0/665867494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba8000f040 con 0x555584aae3c0 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.815+0000 7fba6aff5700 1 -- 172.21.15.12:0/665867494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fba7c018070 con 0x555584aae3c0 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fba6aff5700 1 -- 172.21.15.12:0/665867494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba7c004220 con 0x555584aae3c0 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fbaa116bb80 10 client.16515 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fbaa116bb80 1 -- 172.21.15.12:0/665867494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x555584851250 con 0x555584aae3c0 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fba6aff5700 1 -- 172.21.15.12:0/665867494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba8000f040 con 0x555584aae3c0 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fba6aff5700 1 -- 172.21.15.12:0/665867494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fba7c003680 con 0x555584aae3c0 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fbaa116bb80 10 client.16515 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fbaa116bb80 10 client.16515 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fbaa116bb80 20 client.16515 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x555584b1a180 0x555584b1c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fbaa116bb80 4 client.16515 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:19:36.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.816+0000 7fbaa116bb80 1 -- 172.21.15.12:0/665867494 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5555849c7fd0 con 0x555584b1a180 2023-12-11T20:19:36.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.817+0000 7fba86ffd700 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x555584b1a180 0x555584b1c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:36.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.817+0000 7fba86ffd700 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x555584b1a180 0x555584b1c5a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ea195840a396d78 server_cookie=79be588f985be0f in_seq=0 out_seq=0 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.817+0000 7fba6aff5700 10 client.16515 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fba6aff5700 1 -- 172.21.15.12:0/665867494 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5555849c7fd0 con 0x555584b1a180 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fba6aff5700 10 client.16515 handle_command_reply: tid=0 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 client.16515 shutdown 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 -- 172.21.15.12:0/665867494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aae3c0 msgr2=0x555584abc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aae3c0 0x555584abc7b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0128a0 tx=0x7fba7c014070 comp rx=0 tx=0).stop 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 -- 172.21.15.12:0/665867494 shutdown_connections 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x555584b1a180 0x555584b1c5a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555584aada60 0x555584abc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555584aaede0 0x555584abd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 --2- 172.21.15.12:0/665867494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555584aae3c0 0x555584abc7b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fba6aff5700 0 client.16515 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:19:36.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 -- 172.21.15.12:0/665867494 >> 172.21.15.12:0/665867494 conn(0x5555849dc7e0 msgr2=0x555584ac9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:36.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 -- 172.21.15.12:0/665867494 shutdown_connections 2023-12-11T20:19:36.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.818+0000 7fbaa116bb80 1 -- 172.21.15.12:0/665867494 wait complete. 2023-12-11T20:19:36.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fbaa116bb80 20 client.16515 trim_cache size 0 max 16384 2023-12-11T20:19:36.819 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 -- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba700a15a0 msgr2=0x7fba700a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba700a15a0 0x7fba700a3a60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009bf0 tx=0x7fba7c009260 comp rx=0 tx=0).stop 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 -- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 msgr2=0x7fba88197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 0x7fba88197090 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fba78005740 tx=0x7fba78005770 comp rx=0 tx=0).stop 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 -- 172.21.15.12:0/892187871 shutdown_connections 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fba700a15a0 0x7fba700a3a60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba88106fd0 0x7fba8819e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba88101d70 0x7fba88197090 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 --2- 172.21.15.12:0/892187871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba881046a0 0x7fba881975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.819+0000 7fba87fff700 1 -- 172.21.15.12:0/892187871 >> 172.21.15.12:0/892187871 conn(0x7fba880fb740 msgr2=0x7fba88102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.820+0000 7fba87fff700 1 -- 172.21.15.12:0/892187871 shutdown_connections 2023-12-11T20:19:36.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:36.820+0000 7fba87fff700 1 -- 172.21.15.12:0/892187871 wait complete. 2023-12-11T20:19:36.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:36 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3715027734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:19:36.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:19:36.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:36 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3715027734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:19:37.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:36 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3715027734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:19:37.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 -- 172.21.15.12:0/1577765724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc075610 msgr2=0x7ff6fc073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 --2- 172.21.15.12:0/1577765724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc075610 0x7ff6fc073a60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009990 tx=0x7ff6f8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 -- 172.21.15.12:0/1577765724 shutdown_connections 2023-12-11T20:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 --2- 172.21.15.12:0/1577765724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc075610 0x7ff6fc073a60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 --2- 172.21.15.12:0/1577765724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6fc10d8c0 0x7ff6fc10fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 --2- 172.21.15.12:0/1577765724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6fc074030 0x7ff6fc0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 -- 172.21.15.12:0/1577765724 >> 172.21.15.12:0/1577765724 conn(0x7ff6fc0fc860 msgr2=0x7ff6fc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 -- 172.21.15.12:0/1577765724 shutdown_connections 2023-12-11T20:19:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.074+0000 7ff702d9d700 1 -- 172.21.15.12:0/1577765724 wait complete. 2023-12-11T20:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff702d9d700 1 Processor -- start 2023-12-11T20:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff702d9d700 1 -- start start 2023-12-11T20:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff702d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6fc074030 0x7ff6fc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff702d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc075610 0x7ff6fc19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff702d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6fc10d8c0 0x7ff6fc1a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff702d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1a5190 con 0x7ff6fc074030 2023-12-11T20:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff702d9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1a52d0 con 0x7ff6fc075610 2023-12-11T20:19:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff702d9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1a5460 con 0x7ff6fc10d8c0 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff701d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6fc074030 0x7ff6fc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff701d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6fc074030 0x7ff6fc19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47006/0 (socket says 172.21.15.12:47006) 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.076+0000 7ff701d9b700 1 -- 172.21.15.12:0/708069165 learned_addr learned my addr 172.21.15.12:0/708069165 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff70259c700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6fc10d8c0 0x7ff6fc1a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff70159a700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc075610 0x7ff6fc19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff701d9b700 1 -- 172.21.15.12:0/708069165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6fc10d8c0 msgr2=0x7ff6fc1a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff701d9b700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6fc10d8c0 0x7ff6fc1a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff701d9b700 1 -- 172.21.15.12:0/708069165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc075610 msgr2=0x7ff6fc19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff701d9b700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc075610 0x7ff6fc19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff701d9b700 1 -- 172.21.15.12:0/708069165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009c40 con 0x7ff6fc074030 2023-12-11T20:19:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff701d9b700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6fc074030 0x7ff6fc19d660 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800b2e0 tx=0x7ff6f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.077+0000 7ff6f2ffd700 1 -- 172.21.15.12:0/708069165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f801d070 con 0x7ff6fc074030 2023-12-11T20:19:37.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.078+0000 7ff6f2ffd700 1 -- 172.21.15.12:0/708069165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6f8005a00 con 0x7ff6fc074030 2023-12-11T20:19:37.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.078+0000 7ff702d9d700 1 -- 172.21.15.12:0/708069165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f80095f0 con 0x7ff6fc074030 2023-12-11T20:19:37.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.078+0000 7ff6f2ffd700 1 -- 172.21.15.12:0/708069165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800fe00 con 0x7ff6fc074030 2023-12-11T20:19:37.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.078+0000 7ff702d9d700 1 -- 172.21.15.12:0/708069165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc1a5970 con 0x7ff6fc074030 2023-12-11T20:19:37.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.081+0000 7ff6f2ffd700 1 -- 172.21.15.12:0/708069165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff6f800f560 con 0x7ff6fc074030 2023-12-11T20:19:37.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff717929b80 1 Processor -- start 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff717929b80 1 -- start start 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff6f2ffd700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6e80a1520 0x7ff6e80a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff717929b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3ca60 0x558e06b3ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff717929b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b3d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff717929b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3dde0 0x558e06b3e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff717929b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06a97b50 con 0x558e06b3dde0 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff717929b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06a95470 con 0x558e06b3d3c0 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff717929b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06a90d60 con 0x558e06b3ca60 2023-12-11T20:19:37.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff6f2ffd700 1 -- 172.21.15.12:0/708069165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff6f80ce0d0 con 0x7ff6fc074030 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.083+0000 7ff70259c700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6e80a1520 0x7ff6e80a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3ca60 0x558e06b3ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3ca60 0x558e06b3ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34714/0 (socket says 172.21.15.12:34714) 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 -- 172.21.15.12:0/2179435159 learned_addr learned my addr 172.21.15.12:0/2179435159 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff70159a700 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b3d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff70259c700 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3dde0 0x558e06b3e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 -- 172.21.15.12:0/2179435159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 msgr2=0x558e06b3d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b3d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 -- 172.21.15.12:0/2179435159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3dde0 msgr2=0x558e06b3e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3dde0 0x558e06b3e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 -- 172.21.15.12:0/2179435159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e0690d630 con 0x558e06b3ca60 2023-12-11T20:19:37.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff701d9b700 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3ca60 0x558e06b3ce80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a3200 tx=0x7ff6f8004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccca6280c2eb9d32 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.084+0000 7ff70259c700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6e80a1520 0x7ff6e80a39e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009fd0 tx=0x7ff6f4009490 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.085+0000 7ff6e7fff700 1 -- 172.21.15.12:0/2179435159 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f809ad90 con 0x558e06b3ca60 2023-12-11T20:19:37.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.085+0000 7ff6e7fff700 1 -- 172.21.15.12:0/2179435159 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6f809bb30 con 0x558e06b3ca60 2023-12-11T20:19:37.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.085+0000 7ff6e7fff700 1 -- 172.21.15.12:0/2179435159 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f809b690 con 0x558e06b3ca60 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.085+0000 7ff717929b80 1 -- 172.21.15.12:0/2179435159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3ca60 msgr2=0x558e06b3ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.085+0000 7ff717929b80 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3ca60 0x558e06b3ce80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a3200 tx=0x7ff6f8004320 comp rx=0 tx=0).stop 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.086+0000 7ff717929b80 1 -- 172.21.15.12:0/2179435159 shutdown_connections 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.086+0000 7ff717929b80 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3dde0 0x558e06b3e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.086+0000 7ff717929b80 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3ca60 0x558e06b3ce80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.086+0000 7ff717929b80 1 --2- 172.21.15.12:0/2179435159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b3d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.086+0000 7ff717929b80 1 -- 172.21.15.12:0/2179435159 >> 172.21.15.12:0/2179435159 conn(0x558e06a6b7e0 msgr2=0x558e06b373d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.086+0000 7ff717929b80 1 -- 172.21.15.12:0/2179435159 shutdown_connections 2023-12-11T20:19:37.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.086+0000 7ff717929b80 1 -- 172.21.15.12:0/2179435159 wait complete. 2023-12-11T20:19:37.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.087+0000 7ff717929b80 1 -- start start 2023-12-11T20:19:37.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.087+0000 7ff717929b80 1 Processor -- start 2023-12-11T20:19:37.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.087+0000 7ff717929b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b46000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff717929b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b46540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff717929b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff717929b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06a4a560 con 0x558e06b3d3c0 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff717929b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06a4a200 con 0x558e06b3ca60 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff717929b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e0690f920 con 0x558e06b3dde0 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff717929b80 10 client.0 _ll_register_callbacks cb 0x558e06975a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70159a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b46540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70159a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b46540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47020/0 (socket says 172.21.15.12:47020) 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff701d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b46000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70159a700 1 -- 172.21.15.12:0/397925796 learned_addr learned my addr 172.21.15.12:0/397925796 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70259c700 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70159a700 1 -- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 msgr2=0x558e06b4d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70159a700 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70159a700 1 -- 172.21.15.12:0/397925796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 msgr2=0x558e06b46000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70159a700 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b46000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70159a700 1 -- 172.21.15.12:0/397925796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc1a5970 con 0x558e06b3d3c0 2023-12-11T20:19:37.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.088+0000 7ff70259c700 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.089+0000 7ff70159a700 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b46540 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00bf20 tx=0x7ff6ec011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b18f9d2bd3e49e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.089+0000 7ff6e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.089+0000 7ff6e57fa700 1 -- 172.21.15.12:0/397925796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec016070 con 0x558e06b3d3c0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.089+0000 7ff6e57fa700 1 -- 172.21.15.12:0/397925796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff6ec004020 con 0x558e06b3d3c0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.089+0000 7ff717929b80 1 -- 172.21.15.12:0/397925796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e06b2f9e0 con 0x558e06b3d3c0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff6e57fa700 1 -- 172.21.15.12:0/397925796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6ec0041e0 con 0x558e06b3d3c0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff717929b80 10 client.16527 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff717929b80 1 -- 172.21.15.12:0/397925796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558e068b9de0 con 0x558e06b3d3c0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff6e57fa700 1 -- 172.21.15.12:0/397925796 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558e06b2f9e0 con 0x558e06b3d3c0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff6e57fa700 1 -- 172.21.15.12:0/397925796 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff6ec011d20 con 0x558e06b3d3c0 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff717929b80 10 client.16527 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff717929b80 10 client.16527 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff717929b80 20 client.16527 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:37.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff717929b80 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558e06b51e60 0x558e06b54280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff717929b80 4 client.16527 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:37.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.090+0000 7ff717929b80 1 -- 172.21.15.12:0/397925796 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e06b0bf40 con 0x558e06b51e60 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.091+0000 7ff701d9b700 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558e06b51e60 0x558e06b54280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.092+0000 7ff701d9b700 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558e06b51e60 0x558e06b54280 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93b65e3404ee3a17 server_cookie=b61ffb2202c3c5d5 in_seq=0 out_seq=0 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.092+0000 7ff6e57fa700 10 client.16527 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff6e57fa700 1 -- 172.21.15.12:0/397925796 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558e06b0bf40 con 0x558e06b51e60 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff6e57fa700 10 client.16527 handle_command_reply: tid=0 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 client.16527 shutdown 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 -- 172.21.15.12:0/397925796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 msgr2=0x558e06b46540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b46540 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00bf20 tx=0x7ff6ec011720 comp rx=0 tx=0).stop 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 -- 172.21.15.12:0/397925796 shutdown_connections 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558e06b51e60 0x558e06b54280 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b46000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 --2- 172.21.15.12:0/397925796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b46540 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff6e57fa700 0 client.16527 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:19:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 -- 172.21.15.12:0/397925796 >> 172.21.15.12:0/397925796 conn(0x558e06a6b7e0 msgr2=0x558e06b3b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 -- 172.21.15.12:0/397925796 shutdown_connections 2023-12-11T20:19:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 1 -- 172.21.15.12:0/397925796 wait complete. 2023-12-11T20:19:37.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.093+0000 7ff717929b80 20 client.16527 trim_cache size 0 max 16384 2023-12-11T20:19:37.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.113+0000 7ff717929b80 1 Processor -- start 2023-12-11T20:19:37.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.113+0000 7ff717929b80 1 -- start start 2023-12-11T20:19:37.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.113+0000 7ff717929b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b4dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.113+0000 7ff717929b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b4d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.113+0000 7ff717929b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b3e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.113+0000 7ff717929b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06b44ff0 con 0x558e06b3d3c0 2023-12-11T20:19:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.113+0000 7ff717929b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06b33b30 con 0x558e06b3ca60 2023-12-11T20:19:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.113+0000 7ff717929b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06b321e0 con 0x558e06b3dde0 2023-12-11T20:19:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70159a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b4d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70159a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b4d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47034/0 (socket says 172.21.15.12:47034) 2023-12-11T20:19:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70159a700 1 -- 172.21.15.12:0/3833439607 learned_addr learned my addr 172.21.15.12:0/3833439607 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70259c700 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b3e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff701d9b700 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b4dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70159a700 1 -- 172.21.15.12:0/3833439607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 msgr2=0x558e06b3e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70159a700 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b3e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70159a700 1 -- 172.21.15.12:0/3833439607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 msgr2=0x558e06b4dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70159a700 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b4dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff70159a700 1 -- 172.21.15.12:0/3833439607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e068a2c60 con 0x558e06b3d3c0 2023-12-11T20:19:37.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.114+0000 7ff701d9b700 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b4dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:37.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.115+0000 7ff70159a700 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b4d540 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0036e0 tx=0x7ff6ec003950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab6e42b0fa0b4f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.115+0000 7ff6f0ff9700 1 -- 172.21.15.12:0/3833439607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec016040 con 0x558e06b3d3c0 2023-12-11T20:19:37.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.115+0000 7ff6f0ff9700 1 -- 172.21.15.12:0/3833439607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6ec00b500 con 0x558e06b3d3c0 2023-12-11T20:19:37.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.115+0000 7ff6f0ff9700 1 -- 172.21.15.12:0/3833439607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0043c0 con 0x558e06b3d3c0 2023-12-11T20:19:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 -- 172.21.15.12:0/3833439607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 msgr2=0x558e06b4d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b4d540 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0036e0 tx=0x7ff6ec003950 comp rx=0 tx=0).stop 2023-12-11T20:19:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 -- 172.21.15.12:0/3833439607 shutdown_connections 2023-12-11T20:19:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3ca60 0x558e06b4dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b3e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 --2- 172.21.15.12:0/3833439607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3d3c0 0x558e06b4d540 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 -- 172.21.15.12:0/3833439607 >> 172.21.15.12:0/3833439607 conn(0x558e06a6b7e0 msgr2=0x558e06b37320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 -- 172.21.15.12:0/3833439607 shutdown_connections 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 -- 172.21.15.12:0/3833439607 wait complete. 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.116+0000 7ff717929b80 1 -- start start 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff717929b80 1 Processor -- start 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff717929b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3ca60 0x558e06b4b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff717929b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b4b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff717929b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff717929b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06b4ced0 con 0x558e06b3ca60 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff717929b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06b4d040 con 0x558e06b3d3c0 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff717929b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e06b4d200 con 0x558e06b3dde0 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff717929b80 10 client.0 _ll_register_callbacks cb 0x558e06975a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:37.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.117+0000 7ff701d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3ca60 0x558e06b4b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff701d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3ca60 0x558e06b4b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47040/0 (socket says 172.21.15.12:47040) 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff701d9b700 1 -- 172.21.15.12:0/157194298 learned_addr learned my addr 172.21.15.12:0/157194298 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff70159a700 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b4b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff70259c700 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff701d9b700 1 -- 172.21.15.12:0/157194298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 msgr2=0x558e06b4c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff701d9b700 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff701d9b700 1 -- 172.21.15.12:0/157194298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 msgr2=0x558e06b4b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff701d9b700 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b4b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff701d9b700 1 -- 172.21.15.12:0/157194298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e068b9de0 con 0x558e06b3ca60 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff70159a700 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b4b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff701d9b700 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3ca60 0x558e06b4b440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8097ea0 tx=0x7ff6f80ce060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97206e3f47f7551 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff6e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.118+0000 7ff6e57fa700 1 -- 172.21.15.12:0/157194298 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f805a060 con 0x558e06b3ca60 2023-12-11T20:19:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 1 -- 172.21.15.12:0/157194298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6f809bb30 con 0x558e06b3ca60 2023-12-11T20:19:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff6e57fa700 1 -- 172.21.15.12:0/157194298 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff6f809b430 con 0x558e06b3ca60 2023-12-11T20:19:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff6e57fa700 1 -- 172.21.15.12:0/157194298 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6f80a3730 con 0x558e06b3ca60 2023-12-11T20:19:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 10 client.16533 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 1 -- 172.21.15.12:0/157194298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558e068e0250 con 0x558e06b3ca60 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff6e57fa700 1 -- 172.21.15.12:0/157194298 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6f809bb30 con 0x558e06b3ca60 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff6e57fa700 1 -- 172.21.15.12:0/157194298 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff6f80b3020 con 0x558e06b3ca60 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 10 client.16533 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 10 client.16533 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 20 client.16533 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558e06ba9070 0x558e06bab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 4 client.16533 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.119+0000 7ff717929b80 1 -- 172.21.15.12:0/157194298 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558e06a56fd0 con 0x558e06ba9070 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.120+0000 7ff70159a700 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558e06ba9070 0x558e06bab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.120+0000 7ff6e57fa700 10 client.16533 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.120+0000 7ff70159a700 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558e06ba9070 0x558e06bab490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89af49bb7f689b79 server_cookie=afa0bf3706532c3d in_seq=0 out_seq=0 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff6e57fa700 1 -- 172.21.15.12:0/157194298 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558e06a56fd0 con 0x558e06ba9070 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff6e57fa700 10 client.16533 handle_command_reply: tid=0 2023-12-11T20:19:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 client.16533 shutdown 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 -- 172.21.15.12:0/157194298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3ca60 msgr2=0x558e06b4b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3ca60 0x558e06b4b440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8097ea0 tx=0x7ff6f80ce060 comp rx=0 tx=0).stop 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 -- 172.21.15.12:0/157194298 shutdown_connections 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558e06ba9070 0x558e06bab490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e06b3dde0 0x558e06b4c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e06b3ca60 0x558e06b4b440 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff6e57fa700 0 client.16533 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 --2- 172.21.15.12:0/157194298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e06b3d3c0 0x558e06b4b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 -- 172.21.15.12:0/157194298 >> 172.21.15.12:0/157194298 conn(0x558e06a6b7e0 msgr2=0x558e06b45510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 -- 172.21.15.12:0/157194298 shutdown_connections 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 1 -- 172.21.15.12:0/157194298 wait complete. 2023-12-11T20:19:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.121+0000 7ff717929b80 20 client.16533 trim_cache size 0 max 16384 2023-12-11T20:19:37.123 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:19:37.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 -- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6e80a1520 msgr2=0x7ff6e80a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6e80a1520 0x7ff6e80a39e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009fd0 tx=0x7ff6f4009490 comp rx=0 tx=0).stop 2023-12-11T20:19:37.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 -- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6fc074030 msgr2=0x7ff6fc19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6fc074030 0x7ff6fc19d660 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800b2e0 tx=0x7ff6f8004730 comp rx=0 tx=0).stop 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 -- 172.21.15.12:0/708069165 shutdown_connections 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff6e80a1520 0x7ff6e80a39e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6fc10d8c0 0x7ff6fc1a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6fc074030 0x7ff6fc19d660 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 --2- 172.21.15.12:0/708069165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6fc075610 0x7ff6fc19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 -- 172.21.15.12:0/708069165 >> 172.21.15.12:0/708069165 conn(0x7ff6fc0fc860 msgr2=0x7ff6fc100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 -- 172.21.15.12:0/708069165 shutdown_connections 2023-12-11T20:19:37.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.122+0000 7ff702d9d700 1 -- 172.21.15.12:0/708069165 wait complete. 2023-12-11T20:19:37.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:19:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 -- 172.21.15.12:0/437157231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 msgr2=0x7fbef0100820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 --2- 172.21.15.12:0/437157231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 0x7fbef0100820 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbee40099c0 tx=0x7fbee4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 -- 172.21.15.12:0/437157231 shutdown_connections 2023-12-11T20:19:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 --2- 172.21.15.12:0/437157231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbef0101f90 0x7fbef0108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 --2- 172.21.15.12:0/437157231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 0x7fbef0100820 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 --2- 172.21.15.12:0/437157231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef01015f0 0x7fbef0101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 -- 172.21.15.12:0/437157231 >> 172.21.15.12:0/437157231 conn(0x7fbef00fb930 msgr2=0x7fbef00fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 -- 172.21.15.12:0/437157231 shutdown_connections 2023-12-11T20:19:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.373+0000 7fbef6fff700 1 -- 172.21.15.12:0/437157231 wait complete. 2023-12-11T20:19:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.375+0000 7fbef6fff700 1 Processor -- start 2023-12-11T20:19:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.375+0000 7fbef6fff700 1 -- start start 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.375+0000 7fbef6fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 0x7fbef01995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.375+0000 7fbef6fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef01015f0 0x7fbef0199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.375+0000 7fbef6fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbef0101f90 0x7fbef01a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.375+0000 7fbef6fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01a10f0 con 0x7fbef0100400 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.375+0000 7fbef6fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01a1230 con 0x7fbef0101f90 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.375+0000 7fbef6fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01a13c0 con 0x7fbef01015f0 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef4d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 0x7fbef01995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef4d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 0x7fbef01995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47062/0 (socket says 172.21.15.12:47062) 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef4d9b700 1 -- 172.21.15.12:0/1195663881 learned_addr learned my addr 172.21.15.12:0/1195663881 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef559c700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbef0101f90 0x7fbef01a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef4d9b700 1 -- 172.21.15.12:0/1195663881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef01015f0 msgr2=0x7fbef0199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef01015f0 0x7fbef0199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef4d9b700 1 -- 172.21.15.12:0/1195663881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbef0101f90 msgr2=0x7fbef01a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbef0101f90 0x7fbef01a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.376+0000 7fbef4d9b700 1 -- 172.21.15.12:0/1195663881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40095f0 con 0x7fbef0100400 2023-12-11T20:19:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.377+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 0x7fbef01995c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbee40098e0 tx=0x7fbee4003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.377+0000 7fbeedffb700 1 -- 172.21.15.12:0/1195663881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee401d070 con 0x7fbef0100400 2023-12-11T20:19:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.377+0000 7fbeedffb700 1 -- 172.21.15.12:0/1195663881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbee400bd50 con 0x7fbef0100400 2023-12-11T20:19:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.377+0000 7fbeedffb700 1 -- 172.21.15.12:0/1195663881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4022cf0 con 0x7fbef0100400 2023-12-11T20:19:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.377+0000 7fbef6fff700 1 -- 172.21.15.12:0/1195663881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef01a1640 con 0x7fbef0100400 2023-12-11T20:19:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.377+0000 7fbef6fff700 1 -- 172.21.15.12:0/1195663881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef01a1aa0 con 0x7fbef0100400 2023-12-11T20:19:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.381+0000 7fbeedffb700 1 -- 172.21.15.12:0/1195663881 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fbee4022470 con 0x7fbef0100400 2023-12-11T20:19:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.382+0000 7fbf0a9b8b80 1 Processor -- start 2023-12-11T20:19:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.382+0000 7fbf0a9b8b80 1 -- start start 2023-12-11T20:19:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b33d0 0x55e6536b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b4c20 0x55e6536b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e65360eb50 con 0x55e6536b3d30 2023-12-11T20:19:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e65360c470 con 0x55e6536b4c20 2023-12-11T20:19:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e653607d60 con 0x55e6536b33d0 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbeedffb700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbee00a1480 0x7fbee00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b4c20 0x55e6536b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbef4d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbeedffb700 1 -- 172.21.15.12:0/1195663881 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbee40ce260 con 0x7fbef0100400 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.383+0000 7fbef559c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b33d0 0x55e6536b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef559c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b33d0 0x55e6536b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34756/0 (socket says 172.21.15.12:34756) 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b4c20 0x55e6536b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60702/0 (socket says 172.21.15.12:60702) 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef559c700 1 -- 172.21.15.12:0/2303577463 learned_addr learned my addr 172.21.15.12:0/2303577463 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef4d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47066/0 (socket says 172.21.15.12:47066) 2023-12-11T20:19:37.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef559c700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbee00a1480 0x7fbee00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef4d9b700 1 -- 172.21.15.12:0/2303577463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b33d0 msgr2=0x55e6536b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/2303577463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b33d0 0x55e6536b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef4d9b700 1 -- 172.21.15.12:0/2303577463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b4c20 msgr2=0x55e6536b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/2303577463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b4c20 0x55e6536b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef4d9b700 1 -- 172.21.15.12:0/2303577463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e653484630 con 0x55e6536b3d30 2023-12-11T20:19:37.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/2303577463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536b4640 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009990 tx=0x7fbee4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13302cae32ca49a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.384+0000 7fbef559c700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbee00a1480 0x7fbee00a3940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009fd0 tx=0x7fbee80093d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.385+0000 7fbedaffd700 1 -- 172.21.15.12:0/2303577463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee409b040 con 0x55e6536b3d30 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.385+0000 7fbedaffd700 1 -- 172.21.15.12:0/2303577463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbee4022720 con 0x55e6536b3d30 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.385+0000 7fbedaffd700 1 -- 172.21.15.12:0/2303577463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee40a39e0 con 0x55e6536b3d30 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.385+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/2303577463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 msgr2=0x55e6536b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.385+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/2303577463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536b4640 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009990 tx=0x7fbee4009310 comp rx=0 tx=0).stop 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.386+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/2303577463 shutdown_connections 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.386+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/2303577463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b4c20 0x55e6536b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.386+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/2303577463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b33d0 0x55e6536b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.386+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/2303577463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536b4640 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.386+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/2303577463 >> 172.21.15.12:0/2303577463 conn(0x55e6535e27e0 msgr2=0x55e6536afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.386+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/2303577463 shutdown_connections 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.386+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/2303577463 wait complete. 2023-12-11T20:19:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.386+0000 7fbf0a9b8b80 1 -- start start 2023-12-11T20:19:37.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.387+0000 7fbf0a9b8b80 1 Processor -- start 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.387+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.387+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b3d30 0x55e6536bd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.387+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b4c20 0x55e6536c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.387+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6535c1560 con 0x55e6536b4c20 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.387+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6535c1200 con 0x55e6536b33d0 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.387+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e653486920 con 0x55e6536b3d30 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.387+0000 7fbf0a9b8b80 10 client.0 _ll_register_callbacks cb 0x55e6534eca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b4c20 0x55e6536c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b4c20 0x55e6536c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47068/0 (socket says 172.21.15.12:47068) 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef559c700 1 -- 172.21.15.12:0/1136323253 learned_addr learned my addr 172.21.15.12:0/1136323253 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbeeffff700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b3d30 0x55e6536bd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef559c700 1 -- 172.21.15.12:0/1136323253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b3d30 msgr2=0x55e6536bd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef559c700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b3d30 0x55e6536bd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef559c700 1 -- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 msgr2=0x55e6536bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef559c700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef559c700 1 -- 172.21.15.12:0/1136323253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef01a1aa0 con 0x55e6536b4c20 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbeeffff700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b3d30 0x55e6536bd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.388+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbef559c700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b4c20 0x55e6536c4400 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009540 tx=0x7fbee8004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6779efa4cee2256f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbecffff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbecffff700 1 -- 172.21.15.12:0/1136323253 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8020070 con 0x55e6536b4c20 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/1136323253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6536a6b40 con 0x55e6536b4c20 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbecffff700 1 -- 172.21.15.12:0/1136323253 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbee8006e40 con 0x55e6536b4c20 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbecffff700 1 -- 172.21.15.12:0/1136323253 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbee802f430 con 0x55e6536b4c20 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbf0a9b8b80 10 client.16545 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/1136323253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e653430de0 con 0x55e6536b4c20 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.389+0000 7fbecffff700 1 -- 172.21.15.12:0/1136323253 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbee8033080 con 0x55e6536b4c20 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.390+0000 7fbecffff700 1 -- 172.21.15.12:0/1136323253 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbee80245d0 con 0x55e6536b4c20 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.390+0000 7fbf0a9b8b80 10 client.16545 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.390+0000 7fbf0a9b8b80 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.390+0000 7fbf0a9b8b80 20 client.16545 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.390+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e6536c8cf0 0x55e6536cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.390+0000 7fbf0a9b8b80 4 client.16545 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.390+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/1136323253 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e653682f40 con 0x55e6536c8cf0 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.390+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e6536c8cf0 0x55e6536cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.391+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e6536c8cf0 0x55e6536cb110 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f7dab52e9016e22 server_cookie=95bcfaf27d0d06bc in_seq=0 out_seq=0 2023-12-11T20:19:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.391+0000 7fbecffff700 10 client.16545 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.391+0000 7fbecffff700 1 -- 172.21.15.12:0/1136323253 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e653682f40 con 0x55e6536c8cf0 2023-12-11T20:19:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.391+0000 7fbecffff700 10 client.16545 handle_command_reply: tid=0 2023-12-11T20:19:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 client.16545 shutdown 2023-12-11T20:19:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/1136323253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b4c20 msgr2=0x55e6536c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b4c20 0x55e6536c4400 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009540 tx=0x7fbee8004be0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/1136323253 shutdown_connections 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e6536c8cf0 0x55e6536cb110 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b4c20 0x55e6536c4400 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/1136323253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b3d30 0x55e6536bd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/1136323253 >> 172.21.15.12:0/1136323253 conn(0x55e6535e27e0 msgr2=0x55e6536aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbecffff700 0 client.16545 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/1136323253 shutdown_connections 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/1136323253 wait complete. 2023-12-11T20:19:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.392+0000 7fbf0a9b8b80 20 client.16545 trim_cache size 0 max 16384 2023-12-11T20:19:37.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.410+0000 7fbf0a9b8b80 1 Processor -- start 2023-12-11T20:19:37.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.410+0000 7fbf0a9b8b80 1 -- start start 2023-12-11T20:19:37.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.410+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b33d0 0x55e6536b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.410+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b3d30 0x55e6536c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.410+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.410+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e653682f40 con 0x55e6536b33d0 2023-12-11T20:19:37.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.410+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6536b2f70 con 0x55e6536b3d30 2023-12-11T20:19:37.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.410+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6536c5580 con 0x55e6536b4c20 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b33d0 0x55e6536b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b33d0 0x55e6536b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47084/0 (socket says 172.21.15.12:47084) 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 -- 172.21.15.12:0/358933274 learned_addr learned my addr 172.21.15.12:0/358933274 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbeeffff700 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b3d30 0x55e6536c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef559c700 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 -- 172.21.15.12:0/358933274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 msgr2=0x55e6536b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 -- 172.21.15.12:0/358933274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b3d30 msgr2=0x55e6536c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b3d30 0x55e6536c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 -- 172.21.15.12:0/358933274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e653419c60 con 0x55e6536b33d0 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef559c700 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:37.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.411+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b33d0 0x55e6536b5000 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbee40cc080 tx=0x7fbee4009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb088c86f06587a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbedb7fe700 1 -- 172.21.15.12:0/358933274 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee40ce520 con 0x55e6536b33d0 2023-12-11T20:19:37.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbedb7fe700 1 -- 172.21.15.12:0/358933274 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbee40b8070 con 0x55e6536b33d0 2023-12-11T20:19:37.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbedb7fe700 1 -- 172.21.15.12:0/358933274 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee409f830 con 0x55e6536b33d0 2023-12-11T20:19:37.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/358933274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b33d0 msgr2=0x55e6536b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b33d0 0x55e6536b5000 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbee40cc080 tx=0x7fbee4009530 comp rx=0 tx=0).stop 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/358933274 shutdown_connections 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b33d0 0x55e6536b5000 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/358933274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b3d30 0x55e6536c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.412+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/358933274 >> 172.21.15.12:0/358933274 conn(0x55e6535e27e0 msgr2=0x55e6536bce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.413+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/358933274 shutdown_connections 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.413+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/358933274 wait complete. 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.413+0000 7fbf0a9b8b80 1 -- start start 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.413+0000 7fbf0a9b8b80 1 Processor -- start 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbf0a9b8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6536c31f0 con 0x55e6536b3d30 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6536c3360 con 0x55e6536b33d0 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbf0a9b8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6536c3520 con 0x55e6536b4c20 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbf0a9b8b80 10 client.0 _ll_register_callbacks cb 0x55e6534eca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536bfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47100/0 (socket says 172.21.15.12:47100) 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.414+0000 7fbeeffff700 1 -- 172.21.15.12:0/742049794 learned_addr learned my addr 172.21.15.12:0/742049794 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbef559c700 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbeeffff700 1 -- 172.21.15.12:0/742049794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 msgr2=0x55e6536c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbeeffff700 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbeeffff700 1 -- 172.21.15.12:0/742049794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 msgr2=0x55e6536bf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbeeffff700 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbeeffff700 1 -- 172.21.15.12:0/742049794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee40b3040 con 0x55e6536b3d30 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbeeffff700 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536bfc90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbedc003a70 tx=0x7fbedc003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcc0e81a8692835 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbecffff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbecffff700 1 -- 172.21.15.12:0/742049794 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc017070 con 0x55e6536b3d30 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbecffff700 1 -- 172.21.15.12:0/742049794 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbedc00bca0 con 0x55e6536b3d30 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.415+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/742049794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbee4022720 con 0x55e6536b3d30 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbecffff700 1 -- 172.21.15.12:0/742049794 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbedc00be60 con 0x55e6536b3d30 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbf0a9b8b80 10 client.16551 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/742049794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e653457250 con 0x55e6536b3d30 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbecffff700 1 -- 172.21.15.12:0/742049794 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbee4022720 con 0x55e6536b3d30 2023-12-11T20:19:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbecffff700 1 -- 172.21.15.12:0/742049794 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbedc011480 con 0x55e6536b3d30 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbf0a9b8b80 10 client.16551 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbf0a9b8b80 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbf0a9b8b80 20 client.16551 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e65371f950 0x55e653721d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbf0a9b8b80 4 client.16551 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.416+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/742049794 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e6535cdfd0 con 0x55e65371f950 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e65371f950 0x55e653721d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbef4d9b700 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e65371f950 0x55e653721d70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eecbabb23fbf7e88 server_cookie=3ccc9d20478dce8f in_seq=0 out_seq=0 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbecffff700 10 client.16551 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbecffff700 1 -- 172.21.15.12:0/742049794 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e6535cdfd0 con 0x55e65371f950 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbecffff700 10 client.16551 handle_command_reply: tid=0 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbf0a9b8b80 1 client.16551 shutdown 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/742049794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 msgr2=0x55e6536bfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536bfc90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbedc003a70 tx=0x7fbedc003e30 comp rx=0 tx=0).stop 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/742049794 shutdown_connections 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.417+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e65371f950 0x55e653721d70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e6536b33d0 0x55e6536bf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e6536b4c20 0x55e6536c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbecffff700 0 client.16551 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbf0a9b8b80 1 --2- 172.21.15.12:0/742049794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e6536b3d30 0x55e6536bfc90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/742049794 >> 172.21.15.12:0/742049794 conn(0x55e6535e27e0 msgr2=0x55e6536bce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/742049794 shutdown_connections 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbf0a9b8b80 1 -- 172.21.15.12:0/742049794 wait complete. 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbf0a9b8b80 20 client.16551 trim_cache size 0 max 16384 2023-12-11T20:19:37.419 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:19:37.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbef6fff700 1 -- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbee00a1480 msgr2=0x7fbee00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbef6fff700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbee00a1480 0x7fbee00a3940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009fd0 tx=0x7fbee80093d0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbef6fff700 1 -- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 msgr2=0x7fbef01995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:37.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.418+0000 7fbef6fff700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 0x7fbef01995c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbee40098e0 tx=0x7fbee4003b80 comp rx=0 tx=0).stop 2023-12-11T20:19:37.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.419+0000 7fbef6fff700 1 -- 172.21.15.12:0/1195663881 shutdown_connections 2023-12-11T20:19:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.419+0000 7fbef6fff700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbee00a1480 0x7fbee00a3940 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.419+0000 7fbef6fff700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbef0101f90 0x7fbef01a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.419+0000 7fbef6fff700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbef0100400 0x7fbef01995c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.419+0000 7fbef6fff700 1 --2- 172.21.15.12:0/1195663881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef01015f0 0x7fbef0199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.419+0000 7fbef6fff700 1 -- 172.21.15.12:0/1195663881 >> 172.21.15.12:0/1195663881 conn(0x7fbef00fb930 msgr2=0x7fbef00687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.419+0000 7fbef6fff700 1 -- 172.21.15.12:0/1195663881 shutdown_connections 2023-12-11T20:19:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:37.419+0000 7fbef6fff700 1 -- 172.21.15.12:0/1195663881 wait complete. 2023-12-11T20:19:37.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:37 smithi012 ceph-mon[128787]: pgmap v486: 97 pgs: 97 active+clean; 1.9 GiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:37.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:37 smithi032 ceph-mon[132488]: pgmap v486: 97 pgs: 97 active+clean; 1.9 GiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:38.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:37 smithi039 ceph-mon[102205]: pgmap v486: 97 pgs: 97 active+clean; 1.9 GiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:38.439 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:19:38.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:19:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.670+0000 7fe2befff700 1 -- 172.21.15.12:0/1286841815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b81048c0 msgr2=0x7fe2b8104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.670+0000 7fe2befff700 1 --2- 172.21.15.12:0/1286841815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b81048c0 0x7fe2b8104d20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40099c0 tx=0x7fe2a4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.671+0000 7fe2befff700 1 -- 172.21.15.12:0/1286841815 shutdown_connections 2023-12-11T20:19:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.671+0000 7fe2befff700 1 --2- 172.21.15.12:0/1286841815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b81036d0 0x7fe2b8103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.671+0000 7fe2befff700 1 --2- 172.21.15.12:0/1286841815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b8105260 0x7fe2b810bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.671+0000 7fe2befff700 1 --2- 172.21.15.12:0/1286841815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b81048c0 0x7fe2b8104d20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.671+0000 7fe2befff700 1 -- 172.21.15.12:0/1286841815 >> 172.21.15.12:0/1286841815 conn(0x7fe2b80fec80 msgr2=0x7fe2b81010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.671+0000 7fe2befff700 1 -- 172.21.15.12:0/1286841815 shutdown_connections 2023-12-11T20:19:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.671+0000 7fe2befff700 1 -- 172.21.15.12:0/1286841815 wait complete. 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.672+0000 7fe2befff700 1 Processor -- start 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.672+0000 7fe2befff700 1 -- start start 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.672+0000 7fe2befff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b81036d0 0x7fe2b8199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.672+0000 7fe2befff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b81048c0 0x7fe2b8199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.672+0000 7fe2befff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b8105260 0x7fe2b81a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.672+0000 7fe2befff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b81a1070 con 0x7fe2b8105260 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.672+0000 7fe2befff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b81a11b0 con 0x7fe2b81036d0 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.672+0000 7fe2befff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b81a1340 con 0x7fe2b81048c0 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bcd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b81036d0 0x7fe2b8199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b8105260 0x7fe2b81a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bcd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b81036d0 0x7fe2b8199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60732/0 (socket says 172.21.15.12:60732) 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/1414422572 learned_addr learned my addr 172.21.15.12:0/1414422572 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b81048c0 0x7fe2b8199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bd59c700 1 -- 172.21.15.12:0/1414422572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b81048c0 msgr2=0x7fe2b8199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bd59c700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b81048c0 0x7fe2b8199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bd59c700 1 -- 172.21.15.12:0/1414422572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b81036d0 msgr2=0x7fe2b8199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bd59c700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b81036d0 0x7fe2b8199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bd59c700 1 -- 172.21.15.12:0/1414422572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a40095f0 con 0x7fe2b8105260 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.673+0000 7fe2bd59c700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b8105260 0x7fe2b81a0aa0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000efc0 tx=0x7fe2b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.674+0000 7fe2b5ffb700 1 -- 172.21.15.12:0/1414422572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0018070 con 0x7fe2b8105260 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.674+0000 7fe2b5ffb700 1 -- 172.21.15.12:0/1414422572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2b000f040 con 0x7fe2b8105260 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.674+0000 7fe2befff700 1 -- 172.21.15.12:0/1414422572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b81a15c0 con 0x7fe2b8105260 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.674+0000 7fe2b5ffb700 1 -- 172.21.15.12:0/1414422572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000cc50 con 0x7fe2b8105260 2023-12-11T20:19:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.674+0000 7fe2befff700 1 -- 172.21.15.12:0/1414422572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b81a1a80 con 0x7fe2b8105260 2023-12-11T20:19:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.678+0000 7fe2d29b8b80 1 Processor -- start 2023-12-11T20:19:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.678+0000 7fe2b5ffb700 1 -- 172.21.15.12:0/1414422572 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe2b0003a00 con 0x7fe2b8105260 2023-12-11T20:19:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.679+0000 7fe2d29b8b80 1 -- start start 2023-12-11T20:19:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.679+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5450 0x55d5166e5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.679+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.679+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.679+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d516640bd0 con 0x55d5166e5450 2023-12-11T20:19:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.679+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d51663e4f0 con 0x55d5166e5db0 2023-12-11T20:19:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.679+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d516639de0 con 0x55d5166e6ca0 2023-12-11T20:19:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.679+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5450 0x55d5166e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5450 0x55d5166e5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47120/0 (socket says 172.21.15.12:47120) 2023-12-11T20:19:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2b7fff700 1 -- 172.21.15.12:0/17038167 learned_addr learned my addr 172.21.15.12:0/17038167 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/17038167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 msgr2=0x55d5166e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/17038167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5450 msgr2=0x55d5166e5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5450 0x55d5166e5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/17038167 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5164b66b0 con 0x55d5166e5db0 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.680+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166e66c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac005950 tx=0x7fe2ac011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31ee2cf0cfd9072e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.681+0000 7fe2b5ffb700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2a80a1480 0x7fe2a80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.681+0000 7fe2a2ffd700 1 -- 172.21.15.12:0/17038167 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac011d80 con 0x55d5166e5db0 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.681+0000 7fe2a2ffd700 1 -- 172.21.15.12:0/17038167 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2ac0044b0 con 0x55d5166e5db0 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.681+0000 7fe2a2ffd700 1 -- 172.21.15.12:0/17038167 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac005280 con 0x55d5166e5db0 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.681+0000 7fe2b5ffb700 1 -- 172.21.15.12:0/1414422572 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe2b00cc950 con 0x7fe2b8105260 2023-12-11T20:19:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.681+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2a80a1480 0x7fe2a80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/17038167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 msgr2=0x55d5166e66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166e66c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac005950 tx=0x7fe2ac011440 comp rx=0 tx=0).stop 2023-12-11T20:19:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2a80a1480 0x7fe2a80a3940 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006010 tx=0x7fe2a4005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/17038167 shutdown_connections 2023-12-11T20:19:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5450 0x55d5166e5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/17038167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166e66c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/17038167 >> 172.21.15.12:0/17038167 conn(0x55d516614860 msgr2=0x55d5166e1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/17038167 shutdown_connections 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/17038167 wait complete. 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.682+0000 7fe2d29b8b80 1 -- start start 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2d29b8b80 1 Processor -- start 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166ef250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166ef790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5165f35e0 con 0x55d5166e5db0 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5165f3280 con 0x55d5166e5450 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5164b89a0 con 0x55d5166e6ca0 2023-12-11T20:19:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2d29b8b80 10 client.0 _ll_register_callbacks cb 0x55d51651eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.683+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166ef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2bcd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166ef790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47126/0 (socket says 172.21.15.12:47126) 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2b7fff700 1 -- 172.21.15.12:0/1858002606 learned_addr learned my addr 172.21.15.12:0/1858002606 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2bd59c700 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/1858002606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 msgr2=0x55d5166f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/1858002606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 msgr2=0x55d5166ef790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166ef790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/1858002606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac009970 con 0x55d5166e5450 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166ef250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac004ad0 tx=0x7fe2ac004980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4f3f761861f1d13 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.684+0000 7fe297fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.685+0000 7fe297fff700 1 -- 172.21.15.12:0/1858002606 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac005ce0 con 0x55d5166e5450 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.685+0000 7fe297fff700 1 -- 172.21.15.12:0/1858002606 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe2ac01f040 con 0x55d5166e5450 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.685+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1858002606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5166d8bc0 con 0x55d5166e5450 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.685+0000 7fe297fff700 1 -- 172.21.15.12:0/1858002606 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2ac005460 con 0x55d5166e5450 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.685+0000 7fe2d29b8b80 10 client.26297 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.685+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1858002606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d516462e60 con 0x55d5166e5450 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe297fff700 1 -- 172.21.15.12:0/1858002606 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d5166d8bc0 con 0x55d5166e5450 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe297fff700 1 -- 172.21.15.12:0/1858002606 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe2ac019430 con 0x55d5166e5450 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe2d29b8b80 10 client.26297 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe2d29b8b80 10 client.26297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe2d29b8b80 20 client.26297 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d5166faf00 0x55d5166fd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe2d29b8b80 4 client.26297 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1858002606 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5166b4fc0 con 0x55d5166faf00 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.686+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d5166faf00 0x55d5166fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.687+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d5166faf00 0x55d5166fd320 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=721b151957a1e329 server_cookie=53e6e7dee967801f in_seq=0 out_seq=0 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.687+0000 7fe297fff700 10 client.26297 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe297fff700 1 -- 172.21.15.12:0/1858002606 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d5166b4fc0 con 0x55d5166faf00 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe297fff700 10 client.26297 handle_command_reply: tid=0 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 client.26297 shutdown 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1858002606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 msgr2=0x55d5166ef250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166ef250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac004ad0 tx=0x7fe2ac004980 comp rx=0 tx=0).stop 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1858002606 shutdown_connections 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d5166faf00 0x55d5166fd320 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166ef250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe297fff700 0 client.26297 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1858002606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1858002606 >> 172.21.15.12:0/1858002606 conn(0x55d516614860 msgr2=0x55d5166e0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1858002606 shutdown_connections 2023-12-11T20:19:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1858002606 wait complete. 2023-12-11T20:19:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.688+0000 7fe2d29b8b80 20 client.26297 trim_cache size 0 max 16384 2023-12-11T20:19:38.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.706+0000 7fe2d29b8b80 1 Processor -- start 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2d29b8b80 1 -- start start 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e5450 0x55d5166e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166f6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e6ca0 0x55d5166ea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5166eede0 con 0x55d5166e6ca0 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5166e6190 con 0x55d5166e5db0 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5166f7950 con 0x55d5166e5450 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2bd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e6ca0 0x55d5166ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166f6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60764/0 (socket says 172.21.15.12:60764) 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2b7fff700 1 -- 172.21.15.12:0/455716314 learned_addr learned my addr 172.21.15.12:0/455716314 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.707+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/455716314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e5450 0x55d5166e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2b7fff700 1 -- 172.21.15.12:0/455716314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e5450 msgr2=0x55d5166e9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/455716314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e5450 0x55d5166e9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2b7fff700 1 -- 172.21.15.12:0/455716314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e6ca0 msgr2=0x55d5166ea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/455716314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e6ca0 0x55d5166ea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2b7fff700 1 -- 172.21.15.12:0/455716314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d51644bce0 con 0x55d5166e5db0 2023-12-11T20:19:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/455716314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166f6790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400bf10 tx=0x7fe2a4022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cc65ecad3d9a6d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2a37fe700 1 -- 172.21.15.12:0/455716314 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a401d040 con 0x55d5166e5db0 2023-12-11T20:19:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2a37fe700 1 -- 172.21.15.12:0/455716314 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2a4036150 con 0x55d5166e5db0 2023-12-11T20:19:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.708+0000 7fe2a37fe700 1 -- 172.21.15.12:0/455716314 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4032710 con 0x55d5166e5db0 2023-12-11T20:19:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/455716314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 msgr2=0x55d5166f6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/455716314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166f6790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400bf10 tx=0x7fe2a4022000 comp rx=0 tx=0).stop 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/455716314 shutdown_connections 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/455716314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e6ca0 0x55d5166ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/455716314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e5450 0x55d5166e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/455716314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5db0 0x55d5166f6790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/455716314 >> 172.21.15.12:0/455716314 conn(0x55d516614860 msgr2=0x55d5166ed200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/455716314 shutdown_connections 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.709+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/455716314 wait complete. 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 1 -- start start 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 1 Processor -- start 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166f5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166f5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d516751540 con 0x55d5166e5db0 2023-12-11T20:19:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5167516b0 con 0x55d5166e5450 2023-12-11T20:19:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d516751870 con 0x55d5166e6ca0 2023-12-11T20:19:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.710+0000 7fe2d29b8b80 10 client.0 _ll_register_callbacks cb 0x55d51651eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bcd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bcd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166f5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60770/0 (socket says 172.21.15.12:60770) 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/1055437363 learned_addr learned my addr 172.21.15.12:0/1055437363 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bd59c700 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/1055437363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 msgr2=0x55d5166f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/1055437363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 msgr2=0x55d5166f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bcd9b700 1 -- 172.21.15.12:0/1055437363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a4036e70 con 0x55d5166e5450 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2bd59c700 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.711+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe2bcd9b700 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166f5310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009c60 tx=0x7fe2ac000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ab3056933999f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe297fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe297fff700 1 -- 172.21.15.12:0/1055437363 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac005c80 con 0x55d5166e5450 2023-12-11T20:19:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1055437363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2ac0044b0 con 0x55d5166e5450 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe297fff700 1 -- 172.21.15.12:0/1055437363 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe2ac019b30 con 0x55d5166e5450 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe297fff700 1 -- 172.21.15.12:0/1055437363 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2ac019430 con 0x55d5166e5450 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe2d29b8b80 10 client.26303 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1055437363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d5164892d0 con 0x55d5166e5450 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.712+0000 7fe297fff700 1 -- 172.21.15.12:0/1055437363 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2ac03e080 con 0x55d5166e5450 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.713+0000 7fe297fff700 1 -- 172.21.15.12:0/1055437363 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe2ac038900 con 0x55d5166e5450 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.713+0000 7fe2d29b8b80 10 client.26303 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.713+0000 7fe2d29b8b80 10 client.26303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.713+0000 7fe2d29b8b80 20 client.26303 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.713+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d516753090 0x55d5167554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.713+0000 7fe2d29b8b80 4 client.26303 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.713+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1055437363 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d516600050 con 0x55d516753090 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.713+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d516753090 0x55d5167554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.714+0000 7fe297fff700 10 client.26303 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.714+0000 7fe2b7fff700 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d516753090 0x55d5167554b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8c5492cbd7cad43 server_cookie=fdc7d9181fe02109 in_seq=0 out_seq=0 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe297fff700 1 -- 172.21.15.12:0/1055437363 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d516600050 con 0x55d516753090 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe297fff700 10 client.26303 handle_command_reply: tid=0 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 client.26303 shutdown 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1055437363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 msgr2=0x55d5166f5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166f5310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009c60 tx=0x7fe2ac000bc0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1055437363 shutdown_connections 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d516753090 0x55d5167554b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d5166e5450 0x55d5166f5310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d5166e6ca0 0x55d5166f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe297fff700 0 client.26303 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 --2- 172.21.15.12:0/1055437363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d5166e5db0 0x55d5166f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1055437363 >> 172.21.15.12:0/1055437363 conn(0x55d516614860 msgr2=0x55d5166e9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.715+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1055437363 shutdown_connections 2023-12-11T20:19:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.716+0000 7fe2d29b8b80 1 -- 172.21.15.12:0/1055437363 wait complete. 2023-12-11T20:19:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.716+0000 7fe2d29b8b80 20 client.26303 trim_cache size 0 max 16384 2023-12-11T20:19:38.716 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:19:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:19:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "259d427e-1e15-4813-870a-bf334b441b42", 2023-12-11T20:19:38.716 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:19:38.716 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.716+0000 7fe2befff700 1 -- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2a80a1480 msgr2=0x7fe2a80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.716+0000 7fe2befff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2a80a1480 0x7fe2a80a3940 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006010 tx=0x7fe2a4005960 comp rx=0 tx=0).stop 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.716+0000 7fe2befff700 1 -- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b8105260 msgr2=0x7fe2b81a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.716+0000 7fe2befff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b8105260 0x7fe2b81a0aa0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000efc0 tx=0x7fe2b000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.717+0000 7fe2befff700 1 -- 172.21.15.12:0/1414422572 shutdown_connections 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.717+0000 7fe2befff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe2a80a1480 0x7fe2a80a3940 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.717+0000 7fe2befff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b81036d0 0x7fe2b8199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.717+0000 7fe2befff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2b8105260 0x7fe2b81a0aa0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.717+0000 7fe2befff700 1 --2- 172.21.15.12:0/1414422572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2b81048c0 0x7fe2b8199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.717+0000 7fe2befff700 1 -- 172.21.15.12:0/1414422572 >> 172.21.15.12:0/1414422572 conn(0x7fe2b80fec80 msgr2=0x7fe2b8107c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.717+0000 7fe2befff700 1 -- 172.21.15.12:0/1414422572 shutdown_connections 2023-12-11T20:19:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.717+0000 7fe2befff700 1 -- 172.21.15.12:0/1414422572 wait complete. 2023-12-11T20:19:38.739 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:19:38.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 -- 172.21.15.12:0/3012587533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77681024e0 msgr2=0x7f7768102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 --2- 172.21.15.12:0/3012587533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77681024e0 0x7f7768102940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f775c0099c0 tx=0x7f775c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 -- 172.21.15.12:0/3012587533 shutdown_connections 2023-12-11T20:19:38.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 --2- 172.21.15.12:0/3012587533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77681012f0 0x7f7768101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 --2- 172.21.15.12:0/3012587533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7768102e80 0x7f7768109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 --2- 172.21.15.12:0/3012587533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77681024e0 0x7f7768102940 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 -- 172.21.15.12:0/3012587533 >> 172.21.15.12:0/3012587533 conn(0x7f77680fc860 msgr2=0x7f77680feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 -- 172.21.15.12:0/3012587533 shutdown_connections 2023-12-11T20:19:38.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.975+0000 7f776759e700 1 -- 172.21.15.12:0/3012587533 wait complete. 2023-12-11T20:19:38.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.976+0000 7f776759e700 1 Processor -- start 2023-12-11T20:19:38.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.976+0000 7f776759e700 1 -- start start 2023-12-11T20:19:38.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f776759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77681012f0 0x7f77681992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f776759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77681024e0 0x7f7768199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f776759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7768102e80 0x7f77681a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f776759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77681a0df0 con 0x7f7768102e80 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f776759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77681a0f30 con 0x7f77681024e0 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f776759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77681a10c0 con 0x7f77681012f0 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7768102e80 0x7f77681a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f776659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77681012f0 0x7f77681992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7768102e80 0x7f77681a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58862/0 (socket says 172.21.15.12:58862) 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7766d9d700 1 -- 172.21.15.12:0/1761903957 learned_addr learned my addr 172.21.15.12:0/1761903957 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7765d9b700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77681024e0 0x7f7768199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7766d9d700 1 -- 172.21.15.12:0/1761903957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77681012f0 msgr2=0x7f77681992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77681012f0 0x7f77681992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7766d9d700 1 -- 172.21.15.12:0/1761903957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77681024e0 msgr2=0x7f7768199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77681024e0 0x7f7768199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f7766d9d700 1 -- 172.21.15.12:0/1761903957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0095f0 con 0x7f7768102e80 2023-12-11T20:19:38.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.977+0000 7f776659c700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77681012f0 0x7f77681992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:38.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.978+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7768102e80 0x7f77681a0820 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f776000ef30 tx=0x7f776000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.978+0000 7f77577fe700 1 -- 172.21.15.12:0/1761903957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760018070 con 0x7f7768102e80 2023-12-11T20:19:38.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.978+0000 7f77577fe700 1 -- 172.21.15.12:0/1761903957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f776000f040 con 0x7f7768102e80 2023-12-11T20:19:38.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.978+0000 7f77577fe700 1 -- 172.21.15.12:0/1761903957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776000cc70 con 0x7f7768102e80 2023-12-11T20:19:38.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.978+0000 7f776759e700 1 -- 172.21.15.12:0/1761903957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77681a1340 con 0x7f7768102e80 2023-12-11T20:19:38.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.978+0000 7f776759e700 1 -- 172.21.15.12:0/1761903957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77681a1800 con 0x7f7768102e80 2023-12-11T20:19:38.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.982+0000 7f77577fe700 1 -- 172.21.15.12:0/1761903957 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7760007500 con 0x7f7768102e80 2023-12-11T20:19:38.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.983+0000 7f77802a7b80 1 Processor -- start 2023-12-11T20:19:38.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.983+0000 7f77577fe700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77500a1520 0x7f77500a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.983+0000 7f77802a7b80 1 -- start start 2023-12-11T20:19:38.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.983+0000 7f77577fe700 1 -- 172.21.15.12:0/1761903957 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f77600cc920 con 0x7f7768102e80 2023-12-11T20:19:38.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.983+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a9193e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.983+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a91943c0 0x5621a91948a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a9195240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f77802a7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a90eeb50 con 0x5621a9194de0 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f77802a7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a90ec470 con 0x5621a9193a60 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f77802a7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a90e7d60 con 0x5621a91943c0 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7765d9b700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77500a1520 0x7f77500a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a9195240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a9195240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58868/0 (socket says 172.21.15.12:58868) 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7766d9d700 1 -- 172.21.15.12:0/1141631 learned_addr learned my addr 172.21.15.12:0/1141631 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7765d9b700 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a91943c0 0x5621a91948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f776659c700 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a9193e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7766d9d700 1 -- 172.21.15.12:0/1141631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a91943c0 msgr2=0x5621a91948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a91943c0 0x5621a91948a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7766d9d700 1 -- 172.21.15.12:0/1141631 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 msgr2=0x5621a9193e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a9193e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.984+0000 7f7766d9d700 1 -- 172.21.15.12:0/1141631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621a8f64630 con 0x5621a9194de0 2023-12-11T20:19:38.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.985+0000 7f7765d9b700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77500a1520 0x7f77500a39e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f775c00b580 tx=0x7f775c00ba70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.985+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a9195240 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7760096690 tx=0x7f7760099830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20367e383257c887 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.985+0000 7f7754ff9700 1 -- 172.21.15.12:0/1141631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760012340 con 0x5621a9194de0 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.985+0000 7f7754ff9700 1 -- 172.21.15.12:0/1141631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f776009a320 con 0x5621a9194de0 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.985+0000 7f7754ff9700 1 -- 172.21.15.12:0/1141631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776000cea0 con 0x5621a9194de0 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 -- 172.21.15.12:0/1141631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 msgr2=0x5621a9195240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a9195240 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7760096690 tx=0x7f7760099830 comp rx=0 tx=0).stop 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 -- 172.21.15.12:0/1141631 shutdown_connections 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a9193e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a9195240 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1141631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a91943c0 0x5621a91948a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 -- 172.21.15.12:0/1141631 >> 172.21.15.12:0/1141631 conn(0x5621a90c27e0 msgr2=0x5621a918e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 -- 172.21.15.12:0/1141631 shutdown_connections 2023-12-11T20:19:38.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.986+0000 7f77802a7b80 1 -- 172.21.15.12:0/1141631 wait complete. 2023-12-11T20:19:38.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.987+0000 7f77802a7b80 1 -- start start 2023-12-11T20:19:38.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.987+0000 7f77802a7b80 1 Processor -- start 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.987+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 0x5621a919d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.987+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a919d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.987+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.987+0000 7f77802a7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a90a1560 con 0x5621a9194de0 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.987+0000 7f77802a7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a90a1200 con 0x5621a91943c0 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.987+0000 7f77802a7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a8f66920 con 0x5621a9193a60 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f77802a7b80 10 client.0 _ll_register_callbacks cb 0x5621a8fcca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58882/0 (socket says 172.21.15.12:58882) 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7766d9d700 1 -- 172.21.15.12:0/1988464429 learned_addr learned my addr 172.21.15.12:0/1988464429 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f776659c700 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 0x5621a919d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7765d9b700 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a919d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7766d9d700 1 -- 172.21.15.12:0/1988464429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 msgr2=0x5621a919d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 0x5621a919d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7766d9d700 1 -- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 msgr2=0x5621a919d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a919d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7766d9d700 1 -- 172.21.15.12:0/1988464429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77681a1800 con 0x5621a9194de0 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.988+0000 7f7765d9b700 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a919d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f7766d9d700 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a48b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7760099920 tx=0x7f77600994a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca72cbbb4372f534 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f774dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f774dffb700 1 -- 172.21.15.12:0/1988464429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776000cea0 con 0x5621a9194de0 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f774dffb700 1 -- 172.21.15.12:0/1988464429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7760099c20 con 0x5621a9194de0 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f77802a7b80 1 -- 172.21.15.12:0/1988464429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621a91869e0 con 0x5621a9194de0 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f774dffb700 1 -- 172.21.15.12:0/1988464429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77600b2260 con 0x5621a9194de0 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f77802a7b80 10 client.16581 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:38.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f77802a7b80 1 -- 172.21.15.12:0/1988464429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5621a8f10de0 con 0x5621a9194de0 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.989+0000 7f774dffb700 1 -- 172.21.15.12:0/1988464429 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5621a91869e0 con 0x5621a9194de0 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.990+0000 7f774dffb700 1 -- 172.21.15.12:0/1988464429 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7760095a10 con 0x5621a9194de0 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.990+0000 7f77802a7b80 10 client.16581 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.990+0000 7f77802a7b80 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.990+0000 7f77802a7b80 20 client.16581 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.990+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5621a91a8cf0 0x5621a91ab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.990+0000 7f77802a7b80 4 client.16581 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.990+0000 7f77802a7b80 1 -- 172.21.15.12:0/1988464429 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621a9162f40 con 0x5621a91a8cf0 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.990+0000 7f776659c700 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5621a91a8cf0 0x5621a91ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.991+0000 7f776659c700 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5621a91a8cf0 0x5621a91ab110 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4a934b3aee3cc7a server_cookie=d87b3faa25381555 in_seq=0 out_seq=0 2023-12-11T20:19:38.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.991+0000 7f774dffb700 10 client.16581 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:38.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f774dffb700 1 -- 172.21.15.12:0/1988464429 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5621a9162f40 con 0x5621a91a8cf0 2023-12-11T20:19:38.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f774dffb700 10 client.16581 handle_command_reply: tid=0 2023-12-11T20:19:38.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 client.16581 shutdown 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 -- 172.21.15.12:0/1988464429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 msgr2=0x5621a91a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a48b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7760099920 tx=0x7f77600994a0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 -- 172.21.15.12:0/1988464429 shutdown_connections 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5621a91a8cf0 0x5621a91ab110 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a48b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 0x5621a919d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 --2- 172.21.15.12:0/1988464429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a919d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f774dffb700 0 client.16581 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 -- 172.21.15.12:0/1988464429 >> 172.21.15.12:0/1988464429 conn(0x5621a90c27e0 msgr2=0x5621a9192820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 -- 172.21.15.12:0/1988464429 shutdown_connections 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 1 -- 172.21.15.12:0/1988464429 wait complete. 2023-12-11T20:19:38.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:38.992+0000 7f77802a7b80 20 client.16581 trim_cache size 0 max 16384 2023-12-11T20:19:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f77802a7b80 1 Processor -- start 2023-12-11T20:19:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f77802a7b80 1 -- start start 2023-12-11T20:19:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a918edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a91943c0 0x5621a91a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9194de0 0x5621a91951c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f77802a7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a91869c0 con 0x5621a91943c0 2023-12-11T20:19:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f77802a7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a919cea0 con 0x5621a9193a60 2023-12-11T20:19:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f77802a7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a9194c30 con 0x5621a9194de0 2023-12-11T20:19:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f7765d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a91943c0 0x5621a91a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f7765d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a91943c0 0x5621a91a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58886/0 (socket says 172.21.15.12:58886) 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f7765d9b700 1 -- 172.21.15.12:0/4149786237 learned_addr learned my addr 172.21.15.12:0/4149786237 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f7766d9d700 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9194de0 0x5621a91951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.013+0000 7f776659c700 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a918edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.014+0000 7f7766d9d700 1 -- 172.21.15.12:0/4149786237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 msgr2=0x5621a918edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.014+0000 7f7766d9d700 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a918edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.014+0000 7f7766d9d700 1 -- 172.21.15.12:0/4149786237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a91943c0 msgr2=0x5621a91a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.014+0000 7f7766d9d700 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a91943c0 0x5621a91a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.014+0000 7f7766d9d700 1 -- 172.21.15.12:0/4149786237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621a8ef9c60 con 0x5621a9194de0 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.014+0000 7f776659c700 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a918edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.014+0000 7f7766d9d700 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9194de0 0x5621a91951c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7760096690 tx=0x7f77600981d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e04a1fa8c3aa400 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77557fa700 1 -- 172.21.15.12:0/4149786237 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760099c20 con 0x5621a9194de0 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77557fa700 1 -- 172.21.15.12:0/4149786237 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7760064070 con 0x5621a9194de0 2023-12-11T20:19:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77557fa700 1 -- 172.21.15.12:0/4149786237 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77600b2260 con 0x5621a9194de0 2023-12-11T20:19:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77802a7b80 1 -- 172.21.15.12:0/4149786237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9194de0 msgr2=0x5621a91951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77802a7b80 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9194de0 0x5621a91951c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7760096690 tx=0x7f77600981d0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77802a7b80 1 -- 172.21.15.12:0/4149786237 shutdown_connections 2023-12-11T20:19:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77802a7b80 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a9193a60 0x5621a918edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77802a7b80 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9194de0 0x5621a91951c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77802a7b80 1 --2- 172.21.15.12:0/4149786237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a91943c0 0x5621a91a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.015+0000 7f77802a7b80 1 -- 172.21.15.12:0/4149786237 >> 172.21.15.12:0/4149786237 conn(0x5621a90c27e0 msgr2=0x5621a918e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.016+0000 7f77802a7b80 1 -- 172.21.15.12:0/4149786237 shutdown_connections 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.016+0000 7f77802a7b80 1 -- 172.21.15.12:0/4149786237 wait complete. 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.016+0000 7f77802a7b80 1 -- start start 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.016+0000 7f77802a7b80 1 Processor -- start 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 0x5621a91a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a91a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f77802a7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f77802a7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a91a4270 con 0x5621a9194de0 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f77802a7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a91a43e0 con 0x5621a91943c0 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f77802a7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a91a45a0 con 0x5621a9193a60 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f77802a7b80 10 client.0 _ll_register_callbacks cb 0x5621a8fcca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58902/0 (socket says 172.21.15.12:58902) 2023-12-11T20:19:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f7766d9d700 1 -- 172.21.15.12:0/3348387354 learned_addr learned my addr 172.21.15.12:0/3348387354 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f776659c700 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 0x5621a91a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.017+0000 7f7765d9b700 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a91a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f7766d9d700 1 -- 172.21.15.12:0/3348387354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 msgr2=0x5621a91a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f7766d9d700 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 0x5621a91a27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f7766d9d700 1 -- 172.21.15.12:0/3348387354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 msgr2=0x5621a91a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f7766d9d700 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a91a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f7766d9d700 1 -- 172.21.15.12:0/3348387354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7758012170 con 0x5621a9194de0 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f7766d9d700 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a3d30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7760095d70 tx=0x7f776009a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ea40a2fccdda31 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f774dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f774dffb700 1 -- 172.21.15.12:0/3348387354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760099c20 con 0x5621a9194de0 2023-12-11T20:19:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f77802a7b80 1 -- 172.21.15.12:0/3348387354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f776009a320 con 0x5621a9194de0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f774dffb700 1 -- 172.21.15.12:0/3348387354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f776009dd70 con 0x5621a9194de0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f774dffb700 1 -- 172.21.15.12:0/3348387354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77600b2260 con 0x5621a9194de0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f77802a7b80 10 client.16587 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.018+0000 7f77802a7b80 1 -- 172.21.15.12:0/3348387354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5621a8f10de0 con 0x5621a9194de0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f774dffb700 1 -- 172.21.15.12:0/3348387354 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f776009a320 con 0x5621a9194de0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f774dffb700 1 -- 172.21.15.12:0/3348387354 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7760098b80 con 0x5621a9194de0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f77802a7b80 10 client.16587 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f77802a7b80 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f77802a7b80 20 client.16587 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f77802a7b80 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5621a91ffda0 0x5621a9202190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f77802a7b80 4 client.16587 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f77802a7b80 1 -- 172.21.15.12:0/3348387354 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5621a90adfd0 con 0x5621a91ffda0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.019+0000 7f776659c700 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5621a91ffda0 0x5621a9202190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f776659c700 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5621a91ffda0 0x5621a9202190 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=622f1880fb28c53f server_cookie=94a7a11cbfe88bd in_seq=0 out_seq=0 2023-12-11T20:19:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f774dffb700 10 client.16587 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f774dffb700 1 -- 172.21.15.12:0/3348387354 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5621a90adfd0 con 0x5621a91ffda0 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f774dffb700 10 client.16587 handle_command_reply: tid=0 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f77802a7b80 1 client.16587 shutdown 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f77802a7b80 1 -- 172.21.15.12:0/3348387354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 msgr2=0x5621a91a3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f77802a7b80 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a3d30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7760095d70 tx=0x7f776009a490 comp rx=0 tx=0).stop 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f77802a7b80 1 -- 172.21.15.12:0/3348387354 shutdown_connections 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.020+0000 7f77802a7b80 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5621a91ffda0 0x5621a9202190 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f77802a7b80 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621a9194de0 0x5621a91a3d30 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f774dffb700 0 client.16587 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f77802a7b80 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5621a9193a60 0x5621a91a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f77802a7b80 1 --2- 172.21.15.12:0/3348387354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621a91943c0 0x5621a91a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f77802a7b80 1 -- 172.21.15.12:0/3348387354 >> 172.21.15.12:0/3348387354 conn(0x5621a90c27e0 msgr2=0x5621a91afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f77802a7b80 1 -- 172.21.15.12:0/3348387354 shutdown_connections 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f77802a7b80 1 -- 172.21.15.12:0/3348387354 wait complete. 2023-12-11T20:19:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f77802a7b80 20 client.16587 trim_cache size 0 max 16384 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout: "259d427e-1e15-4813-870a-bf334b441b42": { 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "259d427e-1e15-4813-870a-bf334b441b42", 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:19:39.022 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:19:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f776759e700 1 -- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77500a1520 msgr2=0x7f77500a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f776759e700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77500a1520 0x7f77500a39e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f775c00b580 tx=0x7f775c00ba70 comp rx=0 tx=0).stop 2023-12-11T20:19:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f776759e700 1 -- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7768102e80 msgr2=0x7f77681a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.021+0000 7f776759e700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7768102e80 0x7f77681a0820 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f776000ef30 tx=0x7f776000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.022+0000 7f776759e700 1 -- 172.21.15.12:0/1761903957 shutdown_connections 2023-12-11T20:19:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.022+0000 7f776759e700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77500a1520 0x7f77500a39e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.022+0000 7f776759e700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7768102e80 0x7f77681a0820 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.022+0000 7f776759e700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77681012f0 0x7f77681992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.022+0000 7f776759e700 1 --2- 172.21.15.12:0/1761903957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77681024e0 0x7f7768199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.022+0000 7f776759e700 1 -- 172.21.15.12:0/1761903957 >> 172.21.15.12:0/1761903957 conn(0x7f77680fc860 msgr2=0x7f7768073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.022+0000 7f776759e700 1 -- 172.21.15.12:0/1761903957 shutdown_connections 2023-12-11T20:19:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:19:39.022+0000 7f776759e700 1 -- 172.21.15.12:0/1761903957 wait complete. 2023-12-11T20:19:39.040 INFO:tasks.cephfs.filesystem:scrub status for tag:259d427e-1e15-4813-870a-bf334b441b42 - {'path': '/', 'tag': '259d427e-1e15-4813-870a-bf334b441b42', 'options': 'recursive,force'} 2023-12-11T20:19:39.213 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:19:38 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:19:38.727+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v106>,<0x10000000003/client.0 v108>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v125>,<0x10000000001/sv_0 v149>,<0x10000000000/_nogroup v133>,<0x1/volumes v125>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:19:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:19:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:19:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:39.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:39 smithi032 ceph-mon[132488]: pgmap v487: 97 pgs: 97 active+clean; 2.0 GiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:19:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:39 smithi039 ceph-mon[102205]: pgmap v487: 97 pgs: 97 active+clean; 2.0 GiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:19:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:19:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:19:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:39.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:39.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:39 smithi012 ceph-mon[128787]: pgmap v487: 97 pgs: 97 active+clean; 2.0 GiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:19:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:40 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:40 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:40 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:40 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:19:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:40 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:40.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:40 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:40.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:40 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:40.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:40 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:19:40.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:40 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:40 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:40 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:40 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:19:40.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:19:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:41 smithi032 ceph-mon[132488]: pgmap v488: 97 pgs: 97 active+clean; 2.0 GiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:19:41.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:41 smithi039 ceph-mon[102205]: pgmap v488: 97 pgs: 97 active+clean; 2.0 GiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:19:41.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:41 smithi012 ceph-mon[128787]: pgmap v488: 97 pgs: 97 active+clean; 2.0 GiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:19:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 -- 172.21.15.12:0/760772197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e80074030 msgr2=0x7f6e800744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 --2- 172.21.15.12:0/760772197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e80074030 0x7f6e800744b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009990 tx=0x7f6e74009ca0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 -- 172.21.15.12:0/760772197 shutdown_connections 2023-12-11T20:19:42.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 --2- 172.21.15.12:0/760772197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e8010daa0 0x7f6e8010fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 --2- 172.21.15.12:0/760772197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e80075610 0x7f6e80073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 --2- 172.21.15.12:0/760772197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e80074030 0x7f6e800744b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 -- 172.21.15.12:0/760772197 >> 172.21.15.12:0/760772197 conn(0x7f6e800fca60 msgr2=0x7f6e800fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 -- 172.21.15.12:0/760772197 shutdown_connections 2023-12-11T20:19:42.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.428+0000 7f6e857ff700 1 -- 172.21.15.12:0/760772197 wait complete. 2023-12-11T20:19:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.429+0000 7f6e857ff700 1 Processor -- start 2023-12-11T20:19:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.429+0000 7f6e857ff700 1 -- start start 2023-12-11T20:19:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.429+0000 7f6e857ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e80074030 0x7f6e8019da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.429+0000 7f6e857ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e80075610 0x7f6e8019df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.429+0000 7f6e857ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e8010daa0 0x7f6e801a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.429+0000 7f6e857ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e801a54e0 con 0x7f6e8010daa0 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.429+0000 7f6e857ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e801a5620 con 0x7f6e80074030 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.429+0000 7f6e857ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e801a57b0 con 0x7f6e80075610 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e8010daa0 0x7f6e801a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e8010daa0 0x7f6e801a4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58908/0 (socket says 172.21.15.12:58908) 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7f7fe700 1 -- 172.21.15.12:0/1593370672 learned_addr learned my addr 172.21.15.12:0/1593370672 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e80075610 0x7f6e8019df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7effd700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e80074030 0x7f6e8019da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7f7fe700 1 -- 172.21.15.12:0/1593370672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e80075610 msgr2=0x7f6e8019df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7f7fe700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e80075610 0x7f6e8019df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7f7fe700 1 -- 172.21.15.12:0/1593370672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e80074030 msgr2=0x7f6e8019da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7f7fe700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e80074030 0x7f6e8019da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7f7fe700 1 -- 172.21.15.12:0/1593370672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740095f0 con 0x7f6e8010daa0 2023-12-11T20:19:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.430+0000 7f6e7effd700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e80074030 0x7f6e8019da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.431+0000 7f6e7f7fe700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e8010daa0 0x7f6e801a4f10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6e78007ee0 tx=0x7f6e7800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.431+0000 7f6e67fff700 1 -- 172.21.15.12:0/1593370672 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800dd20 con 0x7f6e8010daa0 2023-12-11T20:19:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.431+0000 7f6e857ff700 1 -- 172.21.15.12:0/1593370672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e801a5a90 con 0x7f6e8010daa0 2023-12-11T20:19:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.431+0000 7f6e67fff700 1 -- 172.21.15.12:0/1593370672 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e7800f040 con 0x7f6e8010daa0 2023-12-11T20:19:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.431+0000 7f6e67fff700 1 -- 172.21.15.12:0/1593370672 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78004750 con 0x7f6e8010daa0 2023-12-11T20:19:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.431+0000 7f6e857ff700 1 -- 172.21.15.12:0/1593370672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e801a5fa0 con 0x7f6e8010daa0 2023-12-11T20:19:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.435+0000 7f6e67fff700 1 -- 172.21.15.12:0/1593370672 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6e78003a00 con 0x7f6e8010daa0 2023-12-11T20:19:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.436+0000 7f6e991a8b80 1 Processor -- start 2023-12-11T20:19:42.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.436+0000 7f6e991a8b80 1 -- start start 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.436+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f59ed0 0x55e083f5a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.436+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f5b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.436+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5b720 0x55e083f5bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.436+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083eb5af0 con 0x55e083f59ed0 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.436+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083eb3410 con 0x55e083f5a830 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.436+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083eaed00 con 0x55e083f5b720 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f59ed0 0x55e083f5a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f59ed0 0x55e083f5a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58922/0 (socket says 172.21.15.12:58922) 2023-12-11T20:19:42.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7e7fc700 1 -- 172.21.15.12:0/2196824471 learned_addr learned my addr 172.21.15.12:0/2196824471 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7effd700 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f5b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5b720 0x55e083f5bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e67fff700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e680a14f0 0x7f6e680a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7effd700 1 -- 172.21.15.12:0/2196824471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5b720 msgr2=0x55e083f5bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7effd700 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5b720 0x55e083f5bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7effd700 1 -- 172.21.15.12:0/2196824471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f59ed0 msgr2=0x55e083f5a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7effd700 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f59ed0 0x55e083f5a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7effd700 1 -- 172.21.15.12:0/2196824471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e083d2b5d0 con 0x55e083f5a830 2023-12-11T20:19:42.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5b720 0x55e083f5bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:42.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.437+0000 7f6e67fff700 1 -- 172.21.15.12:0/1593370672 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e780cc5f0 con 0x7f6e8010daa0 2023-12-11T20:19:42.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.438+0000 7f6e7f7fe700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e680a14f0 0x7f6e680a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.438+0000 7f6e7effd700 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f5b140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e700114f0 tx=0x7f6e70011800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58df40eaeec266b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.438+0000 7f6e657fa700 1 -- 172.21.15.12:0/2196824471 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70004230 con 0x55e083f5a830 2023-12-11T20:19:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.438+0000 7f6e657fa700 1 -- 172.21.15.12:0/2196824471 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e70004cc0 con 0x55e083f5a830 2023-12-11T20:19:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.438+0000 7f6e657fa700 1 -- 172.21.15.12:0/2196824471 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70005520 con 0x55e083f5a830 2023-12-11T20:19:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.438+0000 7f6e7f7fe700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e680a14f0 0x7f6e680a39b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6e780997f0 tx=0x7f6e78004130 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2196824471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 msgr2=0x55e083f5b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f5b140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e700114f0 tx=0x7f6e70011800 comp rx=0 tx=0).stop 2023-12-11T20:19:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2196824471 shutdown_connections 2023-12-11T20:19:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5b720 0x55e083f5bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f59ed0 0x55e083f5a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/2196824471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f5b140 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2196824471 >> 172.21.15.12:0/2196824471 conn(0x55e083e89780 msgr2=0x55e083f56880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2196824471 shutdown_connections 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.439+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2196824471 wait complete. 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.440+0000 7f6e991a8b80 1 -- start start 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.440+0000 7f6e991a8b80 1 Processor -- start 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f63e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f64390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083e68500 con 0x55e083f5b720 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083e681a0 con 0x55e083f5a830 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083d2d8c0 con 0x55e083f59ed0 2023-12-11T20:19:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e991a8b80 10 client.0 _ll_register_callbacks cb 0x55e083d93a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e7e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f63e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e7e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e7e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58936/0 (socket says 172.21.15.12:58936) 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e7e7fc700 1 -- 172.21.15.12:0/4089302544 learned_addr learned my addr 172.21.15.12:0/4089302544 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.441+0000 7f6e7effd700 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f64390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e7e7fc700 1 -- 172.21.15.12:0/4089302544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 msgr2=0x55e083f63e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f63e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e7e7fc700 1 -- 172.21.15.12:0/4089302544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 msgr2=0x55e083f64390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f64390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e7e7fc700 1 -- 172.21.15.12:0/4089302544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e70009c90 con 0x55e083f5b720 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6b1c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6e740098e0 tx=0x7f6e7400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5cbf045e90efb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e62ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e62ff5700 1 -- 172.21.15.12:0/4089302544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7401d030 con 0x55e083f5b720 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e991a8b80 1 -- 172.21.15.12:0/4089302544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e083f4d730 con 0x55e083f5b720 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e62ff5700 1 -- 172.21.15.12:0/4089302544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e74005320 con 0x55e083f5b720 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e62ff5700 1 -- 172.21.15.12:0/4089302544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e7400b9f0 con 0x55e083f5b720 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e991a8b80 10 client.16599 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.442+0000 7f6e991a8b80 1 -- 172.21.15.12:0/4089302544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e083cd7d80 con 0x55e083f5b720 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e62ff5700 1 -- 172.21.15.12:0/4089302544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e083f4d730 con 0x55e083f5b720 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e62ff5700 1 -- 172.21.15.12:0/4089302544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6e74033080 con 0x55e083f5b720 2023-12-11T20:19:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e991a8b80 10 client.16599 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e991a8b80 10 client.16599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e991a8b80 20 client.16599 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e083f6fc40 0x55e083f72060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e991a8b80 4 client.16599 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e991a8b80 1 -- 172.21.15.12:0/4089302544 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e083f29ee0 con 0x55e083f6fc40 2023-12-11T20:19:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.443+0000 7f6e7effd700 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e083f6fc40 0x55e083f72060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.444+0000 7f6e62ff5700 10 client.16599 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.444+0000 7f6e7effd700 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e083f6fc40 0x55e083f72060 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10b823b98f8292ec server_cookie=3408c1d485b87d99 in_seq=0 out_seq=0 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e62ff5700 1 -- 172.21.15.12:0/4089302544 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e083f29ee0 con 0x55e083f6fc40 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e62ff5700 10 client.16599 handle_command_reply: tid=0 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 client.16599 shutdown 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 -- 172.21.15.12:0/4089302544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 msgr2=0x55e083f6b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6b1c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6e740098e0 tx=0x7f6e7400b610 comp rx=0 tx=0).stop 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 -- 172.21.15.12:0/4089302544 shutdown_connections 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e083f6fc40 0x55e083f72060 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6b1c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f63e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/4089302544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5a830 0x55e083f64390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e991a8b80 1 -- 172.21.15.12:0/4089302544 >> 172.21.15.12:0/4089302544 conn(0x55e083e89780 msgr2=0x55e083f54ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.445+0000 7f6e62ff5700 0 client.16599 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.446+0000 7f6e991a8b80 1 -- 172.21.15.12:0/4089302544 shutdown_connections 2023-12-11T20:19:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.446+0000 7f6e991a8b80 1 -- 172.21.15.12:0/4089302544 wait complete. 2023-12-11T20:19:42.450 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.446+0000 7f6e991a8b80 20 client.16599 trim_cache size 0 max 16384 2023-12-11T20:19:42.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.462+0000 7f6e991a8b80 1 Processor -- start 2023-12-11T20:19:42.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e991a8b80 1 -- start start 2023-12-11T20:19:42.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f6baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5a830 0x55e083f6b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5b720 0x55e083f63e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083f77270 con 0x55e083f5a830 2023-12-11T20:19:42.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083f62c00 con 0x55e083f5b720 2023-12-11T20:19:42.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083f64e30 con 0x55e083f59ed0 2023-12-11T20:19:42.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e7effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5a830 0x55e083f6b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e7effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5a830 0x55e083f6b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58942/0 (socket says 172.21.15.12:58942) 2023-12-11T20:19:42.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e7effd700 1 -- 172.21.15.12:0/2249054628 learned_addr learned my addr 172.21.15.12:0/2249054628 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:42.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.463+0000 7f6e7e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f6baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5b720 0x55e083f63e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e7effd700 1 -- 172.21.15.12:0/2249054628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 msgr2=0x55e083f6baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e7effd700 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f6baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e7effd700 1 -- 172.21.15.12:0/2249054628 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5b720 msgr2=0x55e083f63e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e7effd700 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5b720 0x55e083f63e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e7effd700 1 -- 172.21.15.12:0/2249054628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e083cc0c00 con 0x55e083f5a830 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f6baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e7effd700 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5a830 0x55e083f6b180 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6e70005950 tx=0x7f6e70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb09f488c9179b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e65ffb700 1 -- 172.21.15.12:0/2249054628 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70011050 con 0x55e083f5a830 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e65ffb700 1 -- 172.21.15.12:0/2249054628 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e7002ae90 con 0x55e083f5a830 2023-12-11T20:19:42.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.464+0000 7f6e65ffb700 1 -- 172.21.15.12:0/2249054628 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70005140 con 0x55e083f5a830 2023-12-11T20:19:42.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.465+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2249054628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5a830 msgr2=0x55e083f6b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.465+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5a830 0x55e083f6b180 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6e70005950 tx=0x7f6e70004740 comp rx=0 tx=0).stop 2023-12-11T20:19:42.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.465+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2249054628 shutdown_connections 2023-12-11T20:19:42.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.465+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f5b720 0x55e083f63e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.465+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f59ed0 0x55e083f6baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.465+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/2249054628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5a830 0x55e083f6b180 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.465+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2249054628 >> 172.21.15.12:0/2249054628 conn(0x55e083e89780 msgr2=0x55e083f63150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:42.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.465+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2249054628 shutdown_connections 2023-12-11T20:19:42.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.466+0000 7f6e991a8b80 1 -- 172.21.15.12:0/2249054628 wait complete. 2023-12-11T20:19:42.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.466+0000 7f6e991a8b80 1 -- start start 2023-12-11T20:19:42.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.466+0000 7f6e991a8b80 1 Processor -- start 2023-12-11T20:19:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.466+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f59ed0 0x55e083f69020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5a830 0x55e083f69560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e991a8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083f6aa10 con 0x55e083f5b720 2023-12-11T20:19:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083f6ab80 con 0x55e083f59ed0 2023-12-11T20:19:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e991a8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e083f6ad40 con 0x55e083f5a830 2023-12-11T20:19:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e991a8b80 10 client.0 _ll_register_callbacks cb 0x55e083d93a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f59ed0 0x55e083f69020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f59ed0 0x55e083f69020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:47348/0 (socket says 172.21.15.12:47348) 2023-12-11T20:19:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7e7fc700 1 -- 172.21.15.12:0/623927038 learned_addr learned my addr 172.21.15.12:0/623927038 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5a830 0x55e083f69560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7effd700 1 -- 172.21.15.12:0/623927038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f59ed0 msgr2=0x55e083f69020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7effd700 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f59ed0 0x55e083f69020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7effd700 1 -- 172.21.15.12:0/623927038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 msgr2=0x55e083f6a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7effd700 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7effd700 1 -- 172.21.15.12:0/623927038 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7001d040 con 0x55e083f5a830 2023-12-11T20:19:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.467+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f59ed0 0x55e083f69020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.468+0000 7f6e7effd700 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5a830 0x55e083f69560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e70011b50 tx=0x7f6e70011800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=842ba16408352606 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.468+0000 7f6e62ff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:19:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.468+0000 7f6e62ff5700 1 -- 172.21.15.12:0/623927038 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7002a3f0 con 0x55e083f5a830 2023-12-11T20:19:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.468+0000 7f6e991a8b80 1 -- 172.21.15.12:0/623927038 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e70004cc0 con 0x55e083f5a830 2023-12-11T20:19:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.468+0000 7f6e62ff5700 1 -- 172.21.15.12:0/623927038 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e700112e0 con 0x55e083f5a830 2023-12-11T20:19:42.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.469+0000 7f6e62ff5700 1 -- 172.21.15.12:0/623927038 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e7002a550 con 0x55e083f5a830 2023-12-11T20:19:42.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.469+0000 7f6e991a8b80 10 client.26335 fetch_fsmap learned FSMap version 24 2023-12-11T20:19:42.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.469+0000 7f6e991a8b80 1 -- 172.21.15.12:0/623927038 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e083cfe1f0 con 0x55e083f5a830 2023-12-11T20:19:42.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.469+0000 7f6e62ff5700 1 -- 172.21.15.12:0/623927038 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e70045080 con 0x55e083f5a830 2023-12-11T20:19:42.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e62ff5700 1 -- 172.21.15.12:0/623927038 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6e70026440 con 0x55e083f5a830 2023-12-11T20:19:42.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e991a8b80 10 client.26335 fetch_fsmap finished waiting for FSMap version 24 2023-12-11T20:19:42.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e991a8b80 10 client.26335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:42.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e991a8b80 20 client.26335 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:42.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e083fc6eb0 0x55e083fc92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:42.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e991a8b80 4 client.26335 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:19:42.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e991a8b80 1 -- 172.21.15.12:0/623927038 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e083e74f70 con 0x55e083fc6eb0 2023-12-11T20:19:42.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e083fc6eb0 0x55e083fc92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:42.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e7e7fc700 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e083fc6eb0 0x55e083fc92d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb6365f327ea325b server_cookie=84977c1ed84fcfdd in_seq=0 out_seq=0 2023-12-11T20:19:42.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.470+0000 7f6e62ff5700 10 client.26335 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.479+0000 7f6e62ff5700 1 -- 172.21.15.12:0/623927038 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e083e74f70 con 0x55e083fc6eb0 2023-12-11T20:19:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.479+0000 7f6e62ff5700 10 client.26335 handle_command_reply: tid=0 2023-12-11T20:19:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.479+0000 7f6e991a8b80 1 client.26335 shutdown 2023-12-11T20:19:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.479+0000 7f6e991a8b80 1 -- 172.21.15.12:0/623927038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5a830 msgr2=0x55e083f69560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.479+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5a830 0x55e083f69560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e70011b50 tx=0x7f6e70011800 comp rx=0 tx=0).stop 2023-12-11T20:19:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 1 -- 172.21.15.12:0/623927038 shutdown_connections 2023-12-11T20:19:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e083fc6eb0 0x55e083fc92d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e083f59ed0 0x55e083f69020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e083f5b720 0x55e083f6a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e62ff5700 0 client.26335 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 1 --2- 172.21.15.12:0/623927038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e083f5a830 0x55e083f69560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 1 -- 172.21.15.12:0/623927038 >> 172.21.15.12:0/623927038 conn(0x55e083e89780 msgr2=0x55e083f63df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 1 -- 172.21.15.12:0/623927038 shutdown_connections 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 1 -- 172.21.15.12:0/623927038 wait complete. 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.480+0000 7f6e991a8b80 20 client.26335 trim_cache size 0 max 16384 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:19:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:19:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 -- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e680a14f0 msgr2=0x7f6e680a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e680a14f0 0x7f6e680a39b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6e780997f0 tx=0x7f6e78004130 comp rx=0 tx=0).stop 2023-12-11T20:19:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 -- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e8010daa0 msgr2=0x7f6e801a4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e8010daa0 0x7f6e801a4f10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6e78007ee0 tx=0x7f6e7800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 -- 172.21.15.12:0/1593370672 shutdown_connections 2023-12-11T20:19:42.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6e680a14f0 0x7f6e680a39b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e80074030 0x7f6e8019da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e8010daa0 0x7f6e801a4f10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 --2- 172.21.15.12:0/1593370672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e80075610 0x7f6e8019df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:42.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 -- 172.21.15.12:0/1593370672 >> 172.21.15.12:0/1593370672 conn(0x7f6e800fca60 msgr2=0x7f6e80100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:42.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 -- 172.21.15.12:0/1593370672 shutdown_connections 2023-12-11T20:19:42.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:42.481+0000 7f6e857ff700 1 -- 172.21.15.12:0/1593370672 wait complete. 2023-12-11T20:19:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:43 smithi039 ceph-mon[102205]: pgmap v489: 97 pgs: 97 active+clean; 2.0 GiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:19:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:43 smithi012 ceph-mon[128787]: pgmap v489: 97 pgs: 97 active+clean; 2.0 GiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:19:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:43 smithi032 ceph-mon[132488]: pgmap v489: 97 pgs: 97 active+clean; 2.0 GiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:19:45.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:45 smithi039 ceph-mon[102205]: pgmap v490: 97 pgs: 97 active+clean; 2.0 GiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:19:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:45 smithi012 ceph-mon[128787]: pgmap v490: 97 pgs: 97 active+clean; 2.0 GiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:19:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:45 smithi032 ceph-mon[132488]: pgmap v490: 97 pgs: 97 active+clean; 2.0 GiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:19:47.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:47 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:19:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:47 smithi039 ceph-mon[102205]: pgmap v491: 97 pgs: 97 active+clean; 2.1 GiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:19:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:47 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:19:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:47 smithi012 ceph-mon[128787]: pgmap v491: 97 pgs: 97 active+clean; 2.1 GiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:19:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:47 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:19:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:47 smithi032 ceph-mon[132488]: pgmap v491: 97 pgs: 97 active+clean; 2.1 GiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:19:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:49 smithi032 ceph-mon[132488]: pgmap v492: 97 pgs: 97 active+clean; 2.1 GiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:19:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:49 smithi039 ceph-mon[102205]: pgmap v492: 97 pgs: 97 active+clean; 2.1 GiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:19:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:49 smithi012 ceph-mon[128787]: pgmap v492: 97 pgs: 97 active+clean; 2.1 GiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:19:51.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:51 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:19:51.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:51 smithi032 ceph-mon[132488]: pgmap v493: 97 pgs: 97 active+clean; 2.1 GiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:19:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:51 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:19:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:51 smithi039 ceph-mon[102205]: pgmap v493: 97 pgs: 97 active+clean; 2.1 GiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:19:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:51 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:19:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:51 smithi012 ceph-mon[128787]: pgmap v493: 97 pgs: 97 active+clean; 2.1 GiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:19:52.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:52 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:19:52.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:52 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:19:52.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:52 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:19:52.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:52 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:19:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:52 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:19:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:52 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:19:53.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:53 smithi032 ceph-mon[132488]: pgmap v494: 97 pgs: 97 active+clean; 2.2 GiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:19:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:53 smithi039 ceph-mon[102205]: pgmap v494: 97 pgs: 97 active+clean; 2.2 GiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:19:53.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:53 smithi012 ceph-mon[128787]: pgmap v494: 97 pgs: 97 active+clean; 2.2 GiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:19:55.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:55 smithi039 ceph-mon[102205]: pgmap v495: 97 pgs: 97 active+clean; 2.2 GiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:19:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:55 smithi012 ceph-mon[128787]: pgmap v495: 97 pgs: 97 active+clean; 2.2 GiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 -- 172.21.15.12:0/2625597366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 msgr2=0x7f265c109750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 --2- 172.21.15.12:0/2625597366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 0x7f265c109750 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f265400b0d0 tx=0x7f265400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 -- 172.21.15.12:0/2625597366 shutdown_connections 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 --2- 172.21.15.12:0/2625597366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 0x7f265c109750 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 --2- 172.21.15.12:0/2625597366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f265c101310 0x7f265c101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 --2- 172.21.15.12:0/2625597366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f265c102500 0x7f265c102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 -- 172.21.15.12:0/2625597366 >> 172.21.15.12:0/2625597366 conn(0x7f265c0fc8a0 msgr2=0x7f265c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 -- 172.21.15.12:0/2625597366 shutdown_connections 2023-12-11T20:19:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.645+0000 7f266159d700 1 -- 172.21.15.12:0/2625597366 wait complete. 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f266159d700 1 Processor -- start 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f266159d700 1 -- start start 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f266159d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f265c101310 0x7f265c1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f266159d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f265c102500 0x7f265c199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f266159d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 0x7f265c1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f266159d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1a0fa0 con 0x7f265c102ea0 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f266159d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1a10e0 con 0x7f265c101310 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f266159d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1a1270 con 0x7f265c102500 2023-12-11T20:19:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.647+0000 7f2660d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 0x7f265c1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f2660d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 0x7f265c1a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50770/0 (socket says 172.21.15.12:50770) 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f2660d9c700 1 -- 172.21.15.12:0/3486647395 learned_addr learned my addr 172.21.15.12:0/3486647395 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f265bfff700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f265c101310 0x7f265c1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f265b7fe700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f265c102500 0x7f265c199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f2660d9c700 1 -- 172.21.15.12:0/3486647395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f265c102500 msgr2=0x7f265c199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f2660d9c700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f265c102500 0x7f265c199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f2660d9c700 1 -- 172.21.15.12:0/3486647395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f265c101310 msgr2=0x7f265c1994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f2660d9c700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f265c101310 0x7f265c1994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f2660d9c700 1 -- 172.21.15.12:0/3486647395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2654009d00 con 0x7f265c102ea0 2023-12-11T20:19:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.648+0000 7f2660d9c700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 0x7f265c1a09d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f26540079c0 tx=0x7f265400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.649+0000 7f26597fa700 1 -- 172.21.15.12:0/3486647395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400e040 con 0x7f265c102ea0 2023-12-11T20:19:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.649+0000 7f26597fa700 1 -- 172.21.15.12:0/3486647395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f265400ceb0 con 0x7f265c102ea0 2023-12-11T20:19:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.649+0000 7f266159d700 1 -- 172.21.15.12:0/3486647395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c1a14f0 con 0x7f265c102ea0 2023-12-11T20:19:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.649+0000 7f26597fa700 1 -- 172.21.15.12:0/3486647395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265401b6b0 con 0x7f265c102ea0 2023-12-11T20:19:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.649+0000 7f266159d700 1 -- 172.21.15.12:0/3486647395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c1a19c0 con 0x7f265c102ea0 2023-12-11T20:19:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.652+0000 7f26597fa700 1 -- 172.21.15.12:0/3486647395 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f265401d480 con 0x7f265c102ea0 2023-12-11T20:19:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.653+0000 7f26761dfb80 1 Processor -- start 2023-12-11T20:19:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.653+0000 7f26761dfb80 1 -- start start 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a6834b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a6839640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a683bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f26761dfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a678faf0 con 0x55e1a68350d0 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f26761dfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a678d410 con 0x55e1a6834770 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f26761dfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a6788d00 con 0x55e1a6839b80 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f265bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a6839640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a6834b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f265bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a6839640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50776/0 (socket says 172.21.15.12:50776) 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f265bfff700 1 -- 172.21.15.12:0/3813598652 learned_addr learned my addr 172.21.15.12:0/3813598652 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f26597fa700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f26440a14f0 0x7f26440a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.654+0000 7f265b7fe700 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a683bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f265bfff700 1 -- 172.21.15.12:0/3813598652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 msgr2=0x55e1a683bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f265bfff700 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a683bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f26597fa700 1 -- 172.21.15.12:0/3486647395 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f26540ce5e0 con 0x7f265c102ea0 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f265bfff700 1 -- 172.21.15.12:0/3813598652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 msgr2=0x55e1a6834b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f265bfff700 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a6834b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f265bfff700 1 -- 172.21.15.12:0/3813598652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1a66055d0 con 0x55e1a68350d0 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f2660d9c700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f26440a14f0 0x7f26440a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f265b7fe700 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a683bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:19:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f265bfff700 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a6839640 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f264c009d30 tx=0x7f264c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cb4574054e223e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f26427fc700 1 -- 172.21.15.12:0/3813598652 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c004220 con 0x55e1a68350d0 2023-12-11T20:19:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f26427fc700 1 -- 172.21.15.12:0/3813598652 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f264c004380 con 0x55e1a68350d0 2023-12-11T20:19:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.655+0000 7f26427fc700 1 -- 172.21.15.12:0/3813598652 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c0197a0 con 0x55e1a68350d0 2023-12-11T20:19:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 -- 172.21.15.12:0/3813598652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 msgr2=0x55e1a6839640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f2660d9c700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f26440a14f0 0x7f26440a39b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2654097de0 tx=0x7f2654009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a6839640 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f264c009d30 tx=0x7f264c011720 comp rx=0 tx=0).stop 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 -- 172.21.15.12:0/3813598652 shutdown_connections 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a6834b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a683bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3813598652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a6839640 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 -- 172.21.15.12:0/3813598652 >> 172.21.15.12:0/3813598652 conn(0x55e1a6763780 msgr2=0x55e1a6830b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 -- 172.21.15.12:0/3813598652 shutdown_connections 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.656+0000 7f26761dfb80 1 -- 172.21.15.12:0/3813598652 wait complete. 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.657+0000 7f26761dfb80 1 -- start start 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.657+0000 7f26761dfb80 1 Processor -- start 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a683dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a683e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a68453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f26761dfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a6742500 con 0x55e1a68350d0 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f26761dfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a67421a0 con 0x55e1a6834770 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f26761dfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a66078c0 con 0x55e1a6839b80 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f26761dfb80 10 client.0 _ll_register_callbacks cb 0x55e1a666da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a683dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f265bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a683e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a683dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:43064/0 (socket says 172.21.15.12:43064) 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f265b7fe700 1 -- 172.21.15.12:0/2313525456 learned_addr learned my addr 172.21.15.12:0/2313525456 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.658+0000 7f265b7fe700 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a68453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f265bfff700 1 -- 172.21.15.12:0/2313525456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 msgr2=0x55e1a68453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f265bfff700 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a68453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f265bfff700 1 -- 172.21.15.12:0/2313525456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 msgr2=0x55e1a683dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f265bfff700 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a683dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f265bfff700 1 -- 172.21.15.12:0/2313525456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c009960 con 0x55e1a68350d0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f265bfff700 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a683e3e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f264c000c00 tx=0x7f264c005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7633b500a0f131 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f263b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f263b7fe700 1 -- 172.21.15.12:0/2313525456 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c005040 con 0x55e1a68350d0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f26761dfb80 1 -- 172.21.15.12:0/2313525456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1a6827730 con 0x55e1a68350d0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.659+0000 7f263b7fe700 1 -- 172.21.15.12:0/2313525456 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f264c0051a0 con 0x55e1a68350d0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f263b7fe700 1 -- 172.21.15.12:0/2313525456 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f264c005360 con 0x55e1a68350d0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f26761dfb80 10 client.16617 fetch_fsmap learned FSMap version 25 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f26761dfb80 1 -- 172.21.15.12:0/2313525456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55e1a65b1d80 con 0x55e1a68350d0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f263b7fe700 1 -- 172.21.15.12:0/2313525456 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e1a6827730 con 0x55e1a68350d0 2023-12-11T20:19:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f263b7fe700 1 -- 172.21.15.12:0/2313525456 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f264c021040 con 0x55e1a68350d0 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f26761dfb80 10 client.16617 fetch_fsmap finished waiting for FSMap version 25 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f26761dfb80 10 client.16617 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f26761dfb80 20 client.16617 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a6849b90 0x55e1a684bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f26761dfb80 4 client.16617 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.660+0000 7f26761dfb80 1 -- 172.21.15.12:0/2313525456 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1a6803ee0 con 0x55e1a6849b90 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.661+0000 7f265b7fe700 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a6849b90 0x55e1a684bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.661+0000 7f265b7fe700 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a6849b90 0x55e1a684bfb0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b76d81098eb1f296 server_cookie=8c4cf1876dd88320 in_seq=0 out_seq=0 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.661+0000 7f263b7fe700 10 client.16617 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.662+0000 7f263b7fe700 1 -- 172.21.15.12:0/2313525456 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e1a6803ee0 con 0x55e1a6849b90 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.662+0000 7f263b7fe700 10 client.16617 handle_command_reply: tid=0 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.662+0000 7f26761dfb80 1 client.16617 shutdown 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.662+0000 7f26761dfb80 1 -- 172.21.15.12:0/2313525456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 msgr2=0x55e1a683e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.662+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a683e3e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f264c000c00 tx=0x7f264c005df0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.662+0000 7f26761dfb80 1 -- 172.21.15.12:0/2313525456 shutdown_connections 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a6849b90 0x55e1a684bfb0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a6834770 0x55e1a683dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a68453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2313525456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a68350d0 0x55e1a683e3e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f26761dfb80 1 -- 172.21.15.12:0/2313525456 >> 172.21.15.12:0/2313525456 conn(0x55e1a6763780 msgr2=0x55e1a6831560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f263b7fe700 0 client.16617 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f26761dfb80 1 -- 172.21.15.12:0/2313525456 shutdown_connections 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f26761dfb80 1 -- 172.21.15.12:0/2313525456 wait complete. 2023-12-11T20:19:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.663+0000 7f26761dfb80 20 client.16617 trim_cache size 0 max 16384 2023-12-11T20:19:55.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f26761dfb80 1 Processor -- start 2023-12-11T20:19:55.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f26761dfb80 1 -- start start 2023-12-11T20:19:55.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6834770 0x55e1a682e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a6845390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a6829240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f26761dfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a6851180 con 0x55e1a6834770 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f26761dfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a682f590 con 0x55e1a68350d0 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f26761dfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a6829f30 con 0x55e1a6839b80 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.680+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6834770 0x55e1a682e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6834770 0x55e1a682e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50784/0 (socket says 172.21.15.12:50784) 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 -- 172.21.15.12:0/2835698913 learned_addr learned my addr 172.21.15.12:0/2835698913 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265bfff700 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a6845390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a6829240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 -- 172.21.15.12:0/2835698913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 msgr2=0x55e1a6829240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a6829240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 -- 172.21.15.12:0/2835698913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 msgr2=0x55e1a6845390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a6845390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 -- 172.21.15.12:0/2835698913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1a659ac00 con 0x55e1a6834770 2023-12-11T20:19:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265bfff700 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a6845390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:19:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.681+0000 7f265b7fe700 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6834770 0x55e1a682e9f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f26500097c0 tx=0x7f2650009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ed186aea099123 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f2642ffd700 1 -- 172.21.15.12:0/2835698913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650012110 con 0x55e1a6834770 2023-12-11T20:19:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f2642ffd700 1 -- 172.21.15.12:0/2835698913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2650017070 con 0x55e1a6834770 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f2642ffd700 1 -- 172.21.15.12:0/2835698913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650005280 con 0x55e1a6834770 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f26761dfb80 1 -- 172.21.15.12:0/2835698913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6834770 msgr2=0x55e1a682e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6834770 0x55e1a682e9f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f26500097c0 tx=0x7f2650009750 comp rx=0 tx=0).stop 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f26761dfb80 1 -- 172.21.15.12:0/2835698913 shutdown_connections 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6839b80 0x55e1a6829240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6834770 0x55e1a682e9f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f26761dfb80 1 --2- 172.21.15.12:0/2835698913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a6845390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.682+0000 7f26761dfb80 1 -- 172.21.15.12:0/2835698913 >> 172.21.15.12:0/2835698913 conn(0x55e1a6763780 msgr2=0x55e1a683bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.683+0000 7f26761dfb80 1 -- 172.21.15.12:0/2835698913 shutdown_connections 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.683+0000 7f26761dfb80 1 -- 172.21.15.12:0/2835698913 wait complete. 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.683+0000 7f26761dfb80 1 -- start start 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.683+0000 7f26761dfb80 1 Processor -- start 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6834770 0x55e1a6842e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a68433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f26761dfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6839b80 0x55e1a68443b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f26761dfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a68448f0 con 0x55e1a6839b80 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f26761dfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a6844a60 con 0x55e1a68350d0 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f26761dfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a6844c20 con 0x55e1a6834770 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f26761dfb80 10 client.0 _ll_register_callbacks cb 0x55e1a666da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6834770 0x55e1a6842e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6839b80 0x55e1a68443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6839b80 0x55e1a68443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50794/0 (socket says 172.21.15.12:50794) 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.684+0000 7f265b7fe700 1 -- 172.21.15.12:0/3732770324 learned_addr learned my addr 172.21.15.12:0/3732770324 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f265bfff700 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a68433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f265b7fe700 1 -- 172.21.15.12:0/3732770324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6834770 msgr2=0x55e1a6842e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f265b7fe700 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6834770 0x55e1a6842e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f265b7fe700 1 -- 172.21.15.12:0/3732770324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 msgr2=0x55e1a68433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f265b7fe700 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a68433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f265b7fe700 1 -- 172.21.15.12:0/3732770324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1a65b1d80 con 0x55e1a6839b80 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f265b7fe700 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6839b80 0x55e1a68443b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2650004830 tx=0x7f2650009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d95573898cdd1e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f263b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f263b7fe700 1 -- 172.21.15.12:0/3732770324 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650004220 con 0x55e1a6839b80 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f26761dfb80 1 -- 172.21.15.12:0/3732770324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f264c004380 con 0x55e1a6839b80 2023-12-11T20:19:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.685+0000 7f263b7fe700 1 -- 172.21.15.12:0/3732770324 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2650004380 con 0x55e1a6839b80 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f263b7fe700 1 -- 172.21.15.12:0/3732770324 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2650004540 con 0x55e1a6839b80 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f26761dfb80 10 client.16623 fetch_fsmap learned FSMap version 25 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f26761dfb80 1 -- 172.21.15.12:0/3732770324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f2650012c90 con 0x55e1a6839b80 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f263b7fe700 1 -- 172.21.15.12:0/3732770324 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f264c004380 con 0x55e1a6839b80 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f263b7fe700 1 -- 172.21.15.12:0/3732770324 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2650005530 con 0x55e1a6839b80 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f26761dfb80 10 client.16623 fetch_fsmap finished waiting for FSMap version 25 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f26761dfb80 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f26761dfb80 20 client.16623 populate_metadata read hostname 'smithi012' 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a68a0d10 0x55e1a68a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f26761dfb80 4 client.16623 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.686+0000 7f26761dfb80 1 -- 172.21.15.12:0/3732770324 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e1a674ef70 con 0x55e1a68a0d10 2023-12-11T20:19:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.687+0000 7f265bfff700 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a68a0d10 0x55e1a68a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:19:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.687+0000 7f265bfff700 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a68a0d10 0x55e1a68a3130 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbb9befef071142c server_cookie=d3e22b6bfb9c3b0c in_seq=0 out_seq=0 2023-12-11T20:19:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.687+0000 7f263b7fe700 10 client.16623 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.697+0000 7f263b7fe700 1 -- 172.21.15.12:0/3732770324 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e1a674ef70 con 0x55e1a68a0d10 2023-12-11T20:19:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.697+0000 7f263b7fe700 10 client.16623 handle_command_reply: tid=0 2023-12-11T20:19:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.697+0000 7f26761dfb80 1 client.16623 shutdown 2023-12-11T20:19:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 -- 172.21.15.12:0/3732770324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6839b80 msgr2=0x55e1a68443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6839b80 0x55e1a68443b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2650004830 tx=0x7f2650009fd0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 -- 172.21.15.12:0/3732770324 shutdown_connections 2023-12-11T20:19:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a68a0d10 0x55e1a68a3130 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a6839b80 0x55e1a68443b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a6834770 0x55e1a6842e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f263b7fe700 0 client.16623 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 --2- 172.21.15.12:0/3732770324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a68350d0 0x55e1a68433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 -- 172.21.15.12:0/3732770324 >> 172.21.15.12:0/3732770324 conn(0x55e1a6763780 msgr2=0x55e1a683d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 -- 172.21.15.12:0/3732770324 shutdown_connections 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 1 -- 172.21.15.12:0/3732770324 wait complete. 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.698+0000 7f26761dfb80 20 client.16623 trim_cache size 0 max 16384 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:19:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:19:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:19:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:19:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 -- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f26440a14f0 msgr2=0x7f26440a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f26440a14f0 0x7f26440a39b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2654097de0 tx=0x7f2654009040 comp rx=0 tx=0).stop 2023-12-11T20:19:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 -- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 msgr2=0x7f265c1a09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 0x7f265c1a09d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f26540079c0 tx=0x7f265400cab0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 -- 172.21.15.12:0/3486647395 shutdown_connections 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f26440a14f0 0x7f26440a39b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f265c101310 0x7f265c1994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f265c102ea0 0x7f265c1a09d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 --2- 172.21.15.12:0/3486647395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f265c102500 0x7f265c199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 -- 172.21.15.12:0/3486647395 >> 172.21.15.12:0/3486647395 conn(0x7f265c0fc8a0 msgr2=0x7f265c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 -- 172.21.15.12:0/3486647395 shutdown_connections 2023-12-11T20:19:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:19:55.699+0000 7f266159d700 1 -- 172.21.15.12:0/3486647395 wait complete. 2023-12-11T20:19:55.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:55 smithi032 ceph-mon[132488]: pgmap v495: 97 pgs: 97 active+clean; 2.2 GiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:19:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:57 smithi039 ceph-mon[102205]: pgmap v496: 97 pgs: 97 active+clean; 2.2 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:57 smithi012 ceph-mon[128787]: pgmap v496: 97 pgs: 97 active+clean; 2.2 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:57.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:57 smithi032 ceph-mon[132488]: pgmap v496: 97 pgs: 97 active+clean; 2.2 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:19:59.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:19:59 smithi032 ceph-mon[132488]: pgmap v497: 97 pgs: 97 active+clean; 2.2 GiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:19:59.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:19:59 smithi039 ceph-mon[102205]: pgmap v497: 97 pgs: 97 active+clean; 2.2 GiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:19:59.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:19:59 smithi012 ceph-mon[128787]: pgmap v497: 97 pgs: 97 active+clean; 2.2 GiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:20:00.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:00 smithi032 ceph-mon[132488]: overall HEALTH_OK 2023-12-11T20:20:00.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:00 smithi039 ceph-mon[102205]: overall HEALTH_OK 2023-12-11T20:20:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:00 smithi012 ceph-mon[128787]: overall HEALTH_OK 2023-12-11T20:20:01.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:01 smithi032 ceph-mon[132488]: pgmap v498: 97 pgs: 97 active+clean; 2.3 GiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:20:01.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:01 smithi039 ceph-mon[102205]: pgmap v498: 97 pgs: 97 active+clean; 2.3 GiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:20:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:01 smithi012 ceph-mon[128787]: pgmap v498: 97 pgs: 97 active+clean; 2.3 GiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:20:02.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:02 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:20:02.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:02 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:20:02.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:02 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:20:03.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:03 smithi032 ceph-mon[132488]: pgmap v499: 97 pgs: 97 active+clean; 2.3 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:20:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:03 smithi039 ceph-mon[102205]: pgmap v499: 97 pgs: 97 active+clean; 2.3 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:20:03.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:03 smithi012 ceph-mon[128787]: pgmap v499: 97 pgs: 97 active+clean; 2.3 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:20:05.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:05 smithi039 ceph-mon[102205]: pgmap v500: 97 pgs: 97 active+clean; 2.4 GiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:20:05.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:05 smithi012 ceph-mon[128787]: pgmap v500: 97 pgs: 97 active+clean; 2.4 GiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:20:05.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:05 smithi032 ceph-mon[132488]: pgmap v500: 97 pgs: 97 active+clean; 2.4 GiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:20:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:07 smithi039 ceph-mon[102205]: pgmap v501: 97 pgs: 97 active+clean; 2.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:20:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:07 smithi012 ceph-mon[128787]: pgmap v501: 97 pgs: 97 active+clean; 2.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:20:07.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:07 smithi032 ceph-mon[132488]: pgmap v501: 97 pgs: 97 active+clean; 2.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:20:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/3091800192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb041048e0 msgr2=0x7fcb04104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/3091800192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb041048e0 0x7fcb04104d40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00099c0 tx=0x7fcaf0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/3091800192 shutdown_connections 2023-12-11T20:20:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/3091800192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb041036f0 0x7fcb04103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/3091800192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb04105280 0x7fcb0410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/3091800192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb041048e0 0x7fcb04104d40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/3091800192 >> 172.21.15.12:0/3091800192 conn(0x7fcb040fec80 msgr2=0x7fcb041010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:08.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/3091800192 shutdown_connections 2023-12-11T20:20:08.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.867+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/3091800192 wait complete. 2023-12-11T20:20:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.868+0000 7fcb0b1ff700 1 Processor -- start 2023-12-11T20:20:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.868+0000 7fcb0b1ff700 1 -- start start 2023-12-11T20:20:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0b1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb041036f0 0x7fcb041995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0b1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb041048e0 0x7fcb04199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0b1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb04105280 0x7fcb041a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0b1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041a1090 con 0x7fcb04105280 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0b1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041a11d0 con 0x7fcb041036f0 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0b1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041a1360 con 0x7fcb041048e0 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb04105280 0x7fcb041a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb04105280 0x7fcb041a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34182/0 (socket says 172.21.15.12:34182) 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb0979c700 1 -- 172.21.15.12:0/464724711 learned_addr learned my addr 172.21.15.12:0/464724711 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb041036f0 0x7fcb041995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.869+0000 7fcb03fff700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb041048e0 0x7fcb04199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb0979c700 1 -- 172.21.15.12:0/464724711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb041048e0 msgr2=0x7fcb04199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb0979c700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb041048e0 0x7fcb04199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb0979c700 1 -- 172.21.15.12:0/464724711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb041036f0 msgr2=0x7fcb041995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb0979c700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb041036f0 0x7fcb041995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb0979c700 1 -- 172.21.15.12:0/464724711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf00095f0 con 0x7fcb04105280 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb041036f0 0x7fcb041995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb0979c700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb04105280 0x7fcb041a0ac0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00ef30 tx=0x7fcafc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb01ffb700 1 -- 172.21.15.12:0/464724711 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc018070 con 0x7fcb04105280 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb01ffb700 1 -- 172.21.15.12:0/464724711 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcafc00f040 con 0x7fcb04105280 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/464724711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb041a15e0 con 0x7fcb04105280 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb01ffb700 1 -- 172.21.15.12:0/464724711 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00cbc0 con 0x7fcb04105280 2023-12-11T20:20:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.870+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/464724711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb041a1aa0 con 0x7fcb04105280 2023-12-11T20:20:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.874+0000 7fcb01ffb700 1 -- 172.21.15.12:0/464724711 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcafc007500 con 0x7fcb04105280 2023-12-11T20:20:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.875+0000 7fcb1eb2cb80 1 Processor -- start 2023-12-11T20:20:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.875+0000 7fcb1eb2cb80 1 -- start start 2023-12-11T20:20:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.875+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.875+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.875+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6af720 0x55759b6afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.875+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b609af0 con 0x55759b6aded0 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.875+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b607410 con 0x55759b6ae830 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.875+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b602d00 con 0x55759b6af720 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb08f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb08f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40326/0 (socket says 172.21.15.12:40326) 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb08f9b700 1 -- 172.21.15.12:0/948905639 learned_addr learned my addr 172.21.15.12:0/948905639 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb01ffb700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcaf40a1470 0x7fcaf40a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb03fff700 1 --2- 172.21.15.12:0/948905639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6af720 0x55759b6afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb01ffb700 1 -- 172.21.15.12:0/464724711 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcafc0cc870 con 0x7fcb04105280 2023-12-11T20:20:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb08f9b700 1 -- 172.21.15.12:0/948905639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6af720 msgr2=0x55759b6afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/948905639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6af720 0x55759b6afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb08f9b700 1 -- 172.21.15.12:0/948905639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 msgr2=0x55759b6ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/948905639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb08f9b700 1 -- 172.21.15.12:0/948905639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55759b47f5d0 con 0x55759b6ae830 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.876+0000 7fcb0979c700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcaf40a1470 0x7fcaf40a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.877+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/948905639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6af140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80115c0 tx=0x7fcaf80118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214f76994aa938b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.877+0000 7fcaeeffd700 1 -- 172.21.15.12:0/948905639 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8004220 con 0x55759b6ae830 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.877+0000 7fcb0979c700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcaf40a1470 0x7fcaf40a3930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0090a0 tx=0x7fcafc004bf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.877+0000 7fcaeeffd700 1 -- 172.21.15.12:0/948905639 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcaf8004cc0 con 0x55759b6ae830 2023-12-11T20:20:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.877+0000 7fcaeeffd700 1 -- 172.21.15.12:0/948905639 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8005540 con 0x55759b6ae830 2023-12-11T20:20:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/948905639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 msgr2=0x55759b6af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/948905639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6af140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80115c0 tx=0x7fcaf80118d0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/948905639 shutdown_connections 2023-12-11T20:20:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/948905639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6af720 0x55759b6afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/948905639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/948905639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6af140 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/948905639 >> 172.21.15.12:0/948905639 conn(0x55759b5dd780 msgr2=0x55759b6aa880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/948905639 shutdown_connections 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.878+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/948905639 wait complete. 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.879+0000 7fcb1eb2cb80 1 -- start start 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.879+0000 7fcb1eb2cb80 1 Processor -- start 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 0x55759b6b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6af720 0x55759b6bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b5bc500 con 0x55759b6af720 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b5bc1a0 con 0x55759b6ae830 2023-12-11T20:20:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b4818c0 con 0x55759b6aded0 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb1eb2cb80 10 client.0 _ll_register_callbacks cb 0x55759b4e7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6af720 0x55759b6bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6af720 0x55759b6bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34210/0 (socket says 172.21.15.12:34210) 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb03fff700 1 -- 172.21.15.12:0/716558525 learned_addr learned my addr 172.21.15.12:0/716558525 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.880+0000 7fcb03fff700 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 0x55759b6b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcb03fff700 1 -- 172.21.15.12:0/716558525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 msgr2=0x55759b6b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcb03fff700 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 0x55759b6b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcb03fff700 1 -- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 msgr2=0x55759b6b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcb03fff700 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcb03fff700 1 -- 172.21.15.12:0/716558525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf8009d50 con 0x55759b6af720 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcb03fff700 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6af720 0x55759b6bf230 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005cd0 tx=0x7fcaf001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6789edc08289ed98 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcae3fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.881+0000 7fcae3fff700 1 -- 172.21.15.12:0/716558525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf001d020 con 0x55759b6af720 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.882+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/716558525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55759b6a1730 con 0x55759b6af720 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.882+0000 7fcae3fff700 1 -- 172.21.15.12:0/716558525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcaf000fbb0 con 0x55759b6af720 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.882+0000 7fcae3fff700 1 -- 172.21.15.12:0/716558525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaf000fd70 con 0x55759b6af720 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.882+0000 7fcb1eb2cb80 10 client.16635 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.882+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/716558525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55759b42bd80 con 0x55759b6af720 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.882+0000 7fcae3fff700 1 -- 172.21.15.12:0/716558525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55759b6a1730 con 0x55759b6af720 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.882+0000 7fcae3fff700 1 -- 172.21.15.12:0/716558525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcaf0003b00 con 0x55759b6af720 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.883+0000 7fcb1eb2cb80 10 client.16635 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.883+0000 7fcb1eb2cb80 10 client.16635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.883+0000 7fcb1eb2cb80 20 client.16635 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.883+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55759b6c3c10 0x55759b6c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.883+0000 7fcb1eb2cb80 4 client.16635 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.883+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/716558525 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55759b67dee0 con 0x55759b6c3c10 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.883+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55759b6c3c10 0x55759b6c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.884+0000 7fcae3fff700 10 client.16635 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.884+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55759b6c3c10 0x55759b6c6030 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814c6610785200cb server_cookie=ddc76ad12751890a in_seq=0 out_seq=0 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcae3fff700 1 -- 172.21.15.12:0/716558525 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55759b67dee0 con 0x55759b6c3c10 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcae3fff700 10 client.16635 handle_command_reply: tid=0 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 client.16635 shutdown 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/716558525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6af720 msgr2=0x55759b6bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6af720 0x55759b6bf230 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005cd0 tx=0x7fcaf001a040 comp rx=0 tx=0).stop 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/716558525 shutdown_connections 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55759b6c3c10 0x55759b6c6030 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6af720 0x55759b6bf230 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 0x55759b6b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/716558525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/716558525 >> 172.21.15.12:0/716558525 conn(0x55759b5dd780 msgr2=0x55759b6a8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.885+0000 7fcae3fff700 0 client.16635 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.886+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/716558525 shutdown_connections 2023-12-11T20:20:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.886+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/716558525 wait complete. 2023-12-11T20:20:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.886+0000 7fcb1eb2cb80 20 client.16635 trim_cache size 0 max 16384 2023-12-11T20:20:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.903+0000 7fcb1eb2cb80 1 Processor -- start 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb1eb2cb80 1 -- start start 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 0x55759b6bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6b2940 0x55759b6aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b6b8f00 con 0x55759b6b2940 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b6c05e0 con 0x55759b6ae830 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b6a1700 con 0x55759b6aded0 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6b2940 0x55759b6aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6b2940 0x55759b6aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34220/0 (socket says 172.21.15.12:34220) 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.904+0000 7fcb03fff700 1 -- 172.21.15.12:0/856024468 learned_addr learned my addr 172.21.15.12:0/856024468 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb03fff700 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 0x55759b6bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb03fff700 1 -- 172.21.15.12:0/856024468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 msgr2=0x55759b6bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb03fff700 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 0x55759b6bfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb03fff700 1 -- 172.21.15.12:0/856024468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 msgr2=0x55759b6bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb03fff700 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb03fff700 1 -- 172.21.15.12:0/856024468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55759b414c00 con 0x55759b6b2940 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.905+0000 7fcb03fff700 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6b2940 0x55759b6aa460 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0001eb0 tx=0x7fcaf0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888807ec136265cf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcaef7fe700 1 -- 172.21.15.12:0/856024468 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000b790 con 0x55759b6b2940 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcaef7fe700 1 -- 172.21.15.12:0/856024468 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcaf002f020 con 0x55759b6b2940 2023-12-11T20:20:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcaef7fe700 1 -- 172.21.15.12:0/856024468 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000e3e0 con 0x55759b6b2940 2023-12-11T20:20:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/856024468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6b2940 msgr2=0x55759b6aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6b2940 0x55759b6aa460 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0001eb0 tx=0x7fcaf0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/856024468 shutdown_connections 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6b2940 0x55759b6aa460 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6aded0 0x55759b6bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/856024468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/856024468 >> 172.21.15.12:0/856024468 conn(0x55759b5dd780 msgr2=0x55759b6b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.906+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/856024468 shutdown_connections 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.907+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/856024468 wait complete. 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.907+0000 7fcb1eb2cb80 1 -- start start 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.907+0000 7fcb1eb2cb80 1 Processor -- start 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6bcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb1eb2cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6b2940 0x55759b6be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b6be5d0 con 0x55759b6aded0 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b6be740 con 0x55759b6ae830 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb1eb2cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55759b6be900 con 0x55759b6b2940 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb1eb2cb80 10 client.0 _ll_register_callbacks cb 0x55759b4e7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6bcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6bcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34222/0 (socket says 172.21.15.12:34222) 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb03fff700 1 -- 172.21.15.12:0/797784601 learned_addr learned my addr 172.21.15.12:0/797784601 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb03fff700 1 -- 172.21.15.12:0/797784601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6b2940 msgr2=0x55759b6be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb03fff700 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6b2940 0x55759b6be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb03fff700 1 -- 172.21.15.12:0/797784601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 msgr2=0x55759b6bd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.908+0000 7fcb03fff700 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcb03fff700 1 -- 172.21.15.12:0/797784601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55759b47f5d0 con 0x55759b6aded0 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcb03fff700 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6bcb90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000b580 tx=0x7fcaf000b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2c7e75f596b273 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcae3fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcae3fff700 1 -- 172.21.15.12:0/797784601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0034520 con 0x55759b6aded0 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/797784601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaf8004cc0 con 0x55759b6aded0 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcae3fff700 1 -- 172.21.15.12:0/797784601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcaf0039030 con 0x55759b6aded0 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcae3fff700 1 -- 172.21.15.12:0/797784601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaf000e5f0 con 0x55759b6aded0 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcb1eb2cb80 10 client.16641 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.909+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/797784601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55759b42bd80 con 0x55759b6aded0 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcae3fff700 1 -- 172.21.15.12:0/797784601 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcaf0049020 con 0x55759b6aded0 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcae3fff700 1 -- 172.21.15.12:0/797784601 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcaf000ecc0 con 0x55759b6aded0 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcb1eb2cb80 10 client.16641 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcb1eb2cb80 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcb1eb2cb80 20 client.16641 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55759b71a8d0 0x55759b71ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcb1eb2cb80 4 client.16641 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:20:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/797784601 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55759b5c8f70 con 0x55759b71a8d0 2023-12-11T20:20:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.910+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55759b71a8d0 0x55759b71ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.911+0000 7fcae3fff700 10 client.16641 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.911+0000 7fcb08f9b700 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55759b71a8d0 0x55759b71ccf0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e713c6f06a88522f server_cookie=30bafc89c548532d in_seq=0 out_seq=0 2023-12-11T20:20:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcae3fff700 1 -- 172.21.15.12:0/797784601 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55759b5c8f70 con 0x55759b71a8d0 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcae3fff700 10 client.16641 handle_command_reply: tid=0 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 client.16641 shutdown 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/797784601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 msgr2=0x55759b6bcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6bcb90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000b580 tx=0x7fcaf000b800 comp rx=0 tx=0).stop 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/797784601 shutdown_connections 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55759b71a8d0 0x55759b71ccf0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55759b6b2940 0x55759b6be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55759b6aded0 0x55759b6bcb90 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 --2- 172.21.15.12:0/797784601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55759b6ae830 0x55759b6bd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/797784601 >> 172.21.15.12:0/797784601 conn(0x55759b5dd780 msgr2=0x55759b6b70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcae3fff700 0 client.16641 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/797784601 shutdown_connections 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.922+0000 7fcb1eb2cb80 1 -- 172.21.15.12:0/797784601 wait complete. 2023-12-11T20:20:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb1eb2cb80 20 client.16641 trim_cache size 0 max 16384 2023-12-11T20:20:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:20:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:20:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:20:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:20:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcaf40a1470 msgr2=0x7fcaf40a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcaf40a1470 0x7fcaf40a3930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0090a0 tx=0x7fcafc004bf0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb04105280 msgr2=0x7fcb041a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb04105280 0x7fcb041a0ac0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00ef30 tx=0x7fcafc00c3a0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/464724711 shutdown_connections 2023-12-11T20:20:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcaf40a1470 0x7fcaf40a3930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb041036f0 0x7fcb041995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb04105280 0x7fcb041a0ac0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 --2- 172.21.15.12:0/464724711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb041048e0 0x7fcb04199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.923+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/464724711 >> 172.21.15.12:0/464724711 conn(0x7fcb040fec80 msgr2=0x7fcb04107d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.924+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/464724711 shutdown_connections 2023-12-11T20:20:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:08.924+0000 7fcb0b1ff700 1 -- 172.21.15.12:0/464724711 wait complete. 2023-12-11T20:20:09.041 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:20:09.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 -- 172.21.15.12:0/2191693322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 msgr2=0x7ff92c104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 --2- 172.21.15.12:0/2191693322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 0x7ff92c104370 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009990 tx=0x7ff91c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 -- 172.21.15.12:0/2191693322 shutdown_connections 2023-12-11T20:20:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 --2- 172.21.15.12:0/2191693322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff92c1071e0 0x7ff92c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 --2- 172.21.15.12:0/2191693322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 0x7ff92c104370 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 --2- 172.21.15.12:0/2191693322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff92c1048b0 0x7ff92c106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 -- 172.21.15.12:0/2191693322 >> 172.21.15.12:0/2191693322 conn(0x7ff92c0fb930 msgr2=0x7ff92c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 -- 172.21.15.12:0/2191693322 shutdown_connections 2023-12-11T20:20:09.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.277+0000 7ff9313ff700 1 -- 172.21.15.12:0/2191693322 wait complete. 2023-12-11T20:20:09.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff9313ff700 1 Processor -- start 2023-12-11T20:20:09.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff9313ff700 1 -- start start 2023-12-11T20:20:09.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff9313ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 0x7ff92c1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff9313ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff92c1048b0 0x7ff92c199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff9313ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff92c1071e0 0x7ff92c1a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff9313ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c1a0ff0 con 0x7ff92c101f80 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff9313ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c1a1130 con 0x7ff92c1071e0 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff9313ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c1a12c0 con 0x7ff92c1048b0 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff92affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 0x7ff92c1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff92affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 0x7ff92c1994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34242/0 (socket says 172.21.15.12:34242) 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff92affd700 1 -- 172.21.15.12:0/882302607 learned_addr learned my addr 172.21.15.12:0/882302607 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.279+0000 7ff92a7fc700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff92c1048b0 0x7ff92c199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.280+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff92c1071e0 0x7ff92c1a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.280+0000 7ff92affd700 1 -- 172.21.15.12:0/882302607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff92c1048b0 msgr2=0x7ff92c199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.280+0000 7ff92affd700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff92c1048b0 0x7ff92c199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.280+0000 7ff92affd700 1 -- 172.21.15.12:0/882302607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff92c1071e0 msgr2=0x7ff92c1a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.280+0000 7ff92affd700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff92c1071e0 0x7ff92c1a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.280+0000 7ff92affd700 1 -- 172.21.15.12:0/882302607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0095f0 con 0x7ff92c101f80 2023-12-11T20:20:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.280+0000 7ff92affd700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 0x7ff92c1994c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff91c000c00 tx=0x7ff91c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.280+0000 7ff913fff700 1 -- 172.21.15.12:0/882302607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c01d070 con 0x7ff92c101f80 2023-12-11T20:20:09.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.281+0000 7ff913fff700 1 -- 172.21.15.12:0/882302607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff91c00bd70 con 0x7ff92c101f80 2023-12-11T20:20:09.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.281+0000 7ff9313ff700 1 -- 172.21.15.12:0/882302607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c1a1540 con 0x7ff92c101f80 2023-12-11T20:20:09.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.281+0000 7ff913fff700 1 -- 172.21.15.12:0/882302607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c022c60 con 0x7ff92c101f80 2023-12-11T20:20:09.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.281+0000 7ff9313ff700 1 -- 172.21.15.12:0/882302607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c1a19c0 con 0x7ff92c101f80 2023-12-11T20:20:09.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.285+0000 7ff913fff700 1 -- 172.21.15.12:0/882302607 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff91c022470 con 0x7ff92c101f80 2023-12-11T20:20:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.286+0000 7ff944d9fb80 1 Processor -- start 2023-12-11T20:20:09.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.286+0000 7ff944d9fb80 1 -- start start 2023-12-11T20:20:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a23d0 0x5609da6a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a2d30 0x5609da6a3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da5fdb50 con 0x5609da6a23d0 2023-12-11T20:20:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da5fb470 con 0x5609da6a2d30 2023-12-11T20:20:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da5f6d60 con 0x5609da6a3c20 2023-12-11T20:20:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a23d0 0x5609da6a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff913fff700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9140a1500 0x7ff9140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a23d0 0x5609da6a27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34256/0 (socket says 172.21.15.12:34256) 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff92b7fe700 1 -- 172.21.15.12:0/2811629104 learned_addr learned my addr 172.21.15.12:0/2811629104 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff913fff700 1 -- 172.21.15.12:0/882302607 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff91c0ce310 con 0x7ff92c101f80 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff92affd700 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a2d30 0x5609da6a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.287+0000 7ff92a7fc700 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.288+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9140a1500 0x7ff9140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.288+0000 7ff92b7fe700 1 -- 172.21.15.12:0/2811629104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 msgr2=0x5609da6a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.288+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6a40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.288+0000 7ff92b7fe700 1 -- 172.21.15.12:0/2811629104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a2d30 msgr2=0x5609da6a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.288+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a2d30 0x5609da6a3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.288+0000 7ff92b7fe700 1 -- 172.21.15.12:0/2811629104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609da473630 con 0x5609da6a23d0 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.288+0000 7ff92affd700 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a2d30 0x5609da6a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:09.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.288+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a23d0 0x5609da6a27f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff924012ae0 tx=0x7ff924012df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7087b6de79d0737d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:09.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.289+0000 7ff9117fa700 1 -- 172.21.15.12:0/2811629104 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240123d0 con 0x5609da6a23d0 2023-12-11T20:20:09.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.289+0000 7ff9117fa700 1 -- 172.21.15.12:0/2811629104 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff924004bb0 con 0x5609da6a23d0 2023-12-11T20:20:09.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.289+0000 7ff9117fa700 1 -- 172.21.15.12:0/2811629104 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924021e50 con 0x5609da6a23d0 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.289+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9140a1500 0x7ff9140a39c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff92401f000 tx=0x7ff92401d000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.289+0000 7ff944d9fb80 1 -- 172.21.15.12:0/2811629104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a23d0 msgr2=0x5609da6a27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.289+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a23d0 0x5609da6a27f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff924012ae0 tx=0x7ff924012df0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 -- 172.21.15.12:0/2811629104 shutdown_connections 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a23d0 0x5609da6a27f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/2811629104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a2d30 0x5609da6a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 -- 172.21.15.12:0/2811629104 >> 172.21.15.12:0/2811629104 conn(0x5609da5d17e0 msgr2=0x5609da69ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 -- 172.21.15.12:0/2811629104 shutdown_connections 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 -- 172.21.15.12:0/2811629104 wait complete. 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 -- start start 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.290+0000 7ff944d9fb80 1 Processor -- start 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6ac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da5b0560 con 0x5609da6a2d30 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da5b0200 con 0x5609da6a23d0 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da475920 con 0x5609da6a3c20 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff944d9fb80 10 client.0 _ll_register_callbacks cb 0x5609da4dba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff92a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff92a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34270/0 (socket says 172.21.15.12:34270) 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff92a7fc700 1 -- 172.21.15.12:0/1571131961 learned_addr learned my addr 172.21.15.12:0/1571131961 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.291+0000 7ff92affd700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92a7fc700 1 -- 172.21.15.12:0/1571131961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 msgr2=0x5609da6b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92a7fc700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92a7fc700 1 -- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 msgr2=0x5609da6ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92a7fc700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92a7fc700 1 -- 172.21.15.12:0/1571131961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c1a19c0 con 0x5609da6a2d30 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92affd700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff92a7fc700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6ac740 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff92000bb70 tx=0x7ff92000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9d3d136fb55540 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff90eff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff90eff5700 1 -- 172.21.15.12:0/1571131961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920016070 con 0x5609da6a2d30 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff90eff5700 1 -- 172.21.15.12:0/1571131961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff920003ca0 con 0x5609da6a2d30 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.292+0000 7ff944d9fb80 1 -- 172.21.15.12:0/1571131961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609da695b40 con 0x5609da6a2d30 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff90eff5700 1 -- 172.21.15.12:0/1571131961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff920003e60 con 0x5609da6a2d30 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff944d9fb80 10 client.16653 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff944d9fb80 1 -- 172.21.15.12:0/1571131961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ff924012690 con 0x5609da6a2d30 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff90eff5700 1 -- 172.21.15.12:0/1571131961 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5609da695b40 con 0x5609da6a2d30 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff90eff5700 1 -- 172.21.15.12:0/1571131961 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff920011540 con 0x5609da6a2d30 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff944d9fb80 10 client.16653 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff944d9fb80 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff944d9fb80 20 client.16653 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5609da6b8030 0x5609da6ba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff944d9fb80 4 client.16653 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:09.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.293+0000 7ff944d9fb80 1 -- 172.21.15.12:0/1571131961 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609da671f40 con 0x5609da6b8030 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.294+0000 7ff92affd700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5609da6b8030 0x5609da6ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.294+0000 7ff90eff5700 10 client.16653 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.294+0000 7ff92affd700 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5609da6b8030 0x5609da6ba450 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec4f5f986ce0701d server_cookie=7c5ca05ad8d6b31d in_seq=0 out_seq=0 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff90eff5700 1 -- 172.21.15.12:0/1571131961 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5609da671f40 con 0x5609da6b8030 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff90eff5700 10 client.16653 handle_command_reply: tid=0 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 client.16653 shutdown 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 -- 172.21.15.12:0/1571131961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 msgr2=0x5609da6ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6ac740 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff92000bb70 tx=0x7ff92000be80 comp rx=0 tx=0).stop 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 -- 172.21.15.12:0/1571131961 shutdown_connections 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5609da6b8030 0x5609da6ba450 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff90eff5700 0 client.16653 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/1571131961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6ac740 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.295+0000 7ff944d9fb80 1 -- 172.21.15.12:0/1571131961 >> 172.21.15.12:0/1571131961 conn(0x5609da5d17e0 msgr2=0x5609da69da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.296+0000 7ff944d9fb80 1 -- 172.21.15.12:0/1571131961 shutdown_connections 2023-12-11T20:20:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.296+0000 7ff944d9fb80 1 -- 172.21.15.12:0/1571131961 wait complete. 2023-12-11T20:20:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.296+0000 7ff944d9fb80 20 client.16653 trim_cache size 0 max 16384 2023-12-11T20:20:09.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.316+0000 7ff944d9fb80 1 Processor -- start 2023-12-11T20:20:09.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.316+0000 7ff944d9fb80 1 -- start start 2023-12-11T20:20:09.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.316+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6a4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.316+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a2d30 0x5609da6b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.316+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a3c20 0x5609da6ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.316+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da6abd70 con 0x5609da6a3c20 2023-12-11T20:20:09.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.316+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da699b70 con 0x5609da6a23d0 2023-12-11T20:20:09.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.316+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da6bf680 con 0x5609da6a2d30 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a3c20 0x5609da6ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a3c20 0x5609da6ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34284/0 (socket says 172.21.15.12:34284) 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 -- 172.21.15.12:0/4023594695 learned_addr learned my addr 172.21.15.12:0/4023594695 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92affd700 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92a7fc700 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a2d30 0x5609da6b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 -- 172.21.15.12:0/4023594695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a2d30 msgr2=0x5609da6b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a2d30 0x5609da6b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 -- 172.21.15.12:0/4023594695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 msgr2=0x5609da6a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 -- 172.21.15.12:0/4023594695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609da41fde0 con 0x5609da6a3c20 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92affd700 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:09.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.317+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a3c20 0x5609da6ac1c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff924015fc0 tx=0x7ff924015660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ac30754895f4b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:09.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff911ffb700 1 -- 172.21.15.12:0/4023594695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924004d20 con 0x5609da6a3c20 2023-12-11T20:20:09.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff911ffb700 1 -- 172.21.15.12:0/4023594695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff924004e80 con 0x5609da6a3c20 2023-12-11T20:20:09.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff911ffb700 1 -- 172.21.15.12:0/4023594695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924018860 con 0x5609da6a3c20 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff944d9fb80 1 -- 172.21.15.12:0/4023594695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a3c20 msgr2=0x5609da6ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a3c20 0x5609da6ac1c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff924015fc0 tx=0x7ff924015660 comp rx=0 tx=0).stop 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff944d9fb80 1 -- 172.21.15.12:0/4023594695 shutdown_connections 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a3c20 0x5609da6ac1c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/4023594695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a2d30 0x5609da6b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.318+0000 7ff944d9fb80 1 -- 172.21.15.12:0/4023594695 >> 172.21.15.12:0/4023594695 conn(0x5609da5d17e0 msgr2=0x5609da6aa170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.319+0000 7ff944d9fb80 1 -- 172.21.15.12:0/4023594695 shutdown_connections 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.319+0000 7ff944d9fb80 1 -- 172.21.15.12:0/4023594695 wait complete. 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.319+0000 7ff944d9fb80 1 -- start start 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.319+0000 7ff944d9fb80 1 Processor -- start 2023-12-11T20:20:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6af620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff944d9fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da6b30c0 con 0x5609da6a2d30 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da6b3230 con 0x5609da6a23d0 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff944d9fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609da6b33f0 con 0x5609da6a3c20 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff944d9fb80 10 client.0 _ll_register_callbacks cb 0x5609da4dba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff92a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:39382/0 (socket says 172.21.15.12:39382) 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff92a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34294/0 (socket says 172.21.15.12:34294) 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff92b7fe700 1 -- 172.21.15.12:0/3930834789 learned_addr learned my addr 172.21.15.12:0/3930834789 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.320+0000 7ff92affd700 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff92b7fe700 1 -- 172.21.15.12:0/3930834789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 msgr2=0x5609da6af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff92b7fe700 1 -- 172.21.15.12:0/3930834789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 msgr2=0x5609da6afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:09.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff92b7fe700 1 -- 172.21.15.12:0/3930834789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609da473630 con 0x5609da6a3c20 2023-12-11T20:20:09.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff92a7fc700 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:09.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff92b7fe700 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b2b80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff924021dd0 tx=0x7ff924021e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d5ba781233778c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:09.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff90eff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:20:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.321+0000 7ff90eff5700 1 -- 172.21.15.12:0/3930834789 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924004d20 con 0x5609da6a3c20 2023-12-11T20:20:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 1 -- 172.21.15.12:0/3930834789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609da5bcfd0 con 0x5609da6a3c20 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff90eff5700 1 -- 172.21.15.12:0/3930834789 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff924018640 con 0x5609da6a3c20 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff90eff5700 1 -- 172.21.15.12:0/3930834789 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff924004e80 con 0x5609da6a3c20 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 10 client.26380 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 1 -- 172.21.15.12:0/3930834789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5609da408c60 con 0x5609da6a3c20 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff90eff5700 1 -- 172.21.15.12:0/3930834789 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff924043080 con 0x5609da6a3c20 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff90eff5700 1 -- 172.21.15.12:0/3930834789 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff92402d480 con 0x5609da6a3c20 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 10 client.26380 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 10 client.26380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 20 client.26380 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5609da70f2c0 0x5609da7116e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 4 client.26380 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:20:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.322+0000 7ff944d9fb80 1 -- 172.21.15.12:0/3930834789 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5609da5af490 con 0x5609da70f2c0 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.323+0000 7ff92affd700 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5609da70f2c0 0x5609da7116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff92affd700 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5609da70f2c0 0x5609da7116e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee143fa52e7894c server_cookie=37112de335736a0c in_seq=0 out_seq=0 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff90eff5700 10 client.26380 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff90eff5700 1 -- 172.21.15.12:0/3930834789 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5609da5af490 con 0x5609da70f2c0 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff90eff5700 10 client.26380 handle_command_reply: tid=0 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 client.26380 shutdown 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 -- 172.21.15.12:0/3930834789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 msgr2=0x5609da6b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b2b80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff924021dd0 tx=0x7ff924021e00 comp rx=0 tx=0).stop 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 -- 172.21.15.12:0/3930834789 shutdown_connections 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5609da70f2c0 0x5609da7116e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5609da6a23d0 0x5609da6af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5609da6a3c20 0x5609da6b2b80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff90eff5700 0 client.26380 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:09.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 --2- 172.21.15.12:0/3930834789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5609da6a2d30 0x5609da6afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 -- 172.21.15.12:0/3930834789 >> 172.21.15.12:0/3930834789 conn(0x5609da5d17e0 msgr2=0x5609da6ac1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:09.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 -- 172.21.15.12:0/3930834789 shutdown_connections 2023-12-11T20:20:09.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.324+0000 7ff944d9fb80 1 -- 172.21.15.12:0/3930834789 wait complete. 2023-12-11T20:20:09.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.325+0000 7ff944d9fb80 20 client.26380 trim_cache size 0 max 16384 2023-12-11T20:20:09.327 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:20:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:20:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:20:09.327 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.325+0000 7ff9313ff700 1 -- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9140a1500 msgr2=0x7ff9140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.325+0000 7ff9313ff700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9140a1500 0x7ff9140a39c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff92401f000 tx=0x7ff92401d000 comp rx=0 tx=0).stop 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.325+0000 7ff9313ff700 1 -- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 msgr2=0x7ff92c1994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.325+0000 7ff9313ff700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 0x7ff92c1994c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff91c000c00 tx=0x7ff91c003a50 comp rx=0 tx=0).stop 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.326+0000 7ff9313ff700 1 -- 172.21.15.12:0/882302607 shutdown_connections 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.326+0000 7ff9313ff700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9140a1500 0x7ff9140a39c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.326+0000 7ff9313ff700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff92c1071e0 0x7ff92c1a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.326+0000 7ff9313ff700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff92c101f80 0x7ff92c1994c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.326+0000 7ff9313ff700 1 --2- 172.21.15.12:0/882302607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff92c1048b0 0x7ff92c199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.326+0000 7ff9313ff700 1 -- 172.21.15.12:0/882302607 >> 172.21.15.12:0/882302607 conn(0x7ff92c0fb930 msgr2=0x7ff92c1016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.326+0000 7ff9313ff700 1 -- 172.21.15.12:0/882302607 shutdown_connections 2023-12-11T20:20:09.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.326+0000 7ff9313ff700 1 -- 172.21.15.12:0/882302607 wait complete. 2023-12-11T20:20:09.350 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:20:09.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:20:09.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:09 smithi012 ceph-mon[128787]: pgmap v502: 97 pgs: 97 active+clean; 2.4 GiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:20:09.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 -- 172.21.15.12:0/2886524538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581013a0 msgr2=0x7fe058101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2886524538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581013a0 0x7fe058101800 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0099c0 tx=0x7fe04c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 -- 172.21.15.12:0/2886524538 shutdown_connections 2023-12-11T20:20:09.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2886524538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0581001b0 0x7fe0581005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2886524538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe058101d40 0x7fe0581085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2886524538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581013a0 0x7fe058101800 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 -- 172.21.15.12:0/2886524538 >> 172.21.15.12:0/2886524538 conn(0x7fe0580fb760 msgr2=0x7fe0580fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:09.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 -- 172.21.15.12:0/2886524538 shutdown_connections 2023-12-11T20:20:09.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.580+0000 7fe05d59d700 1 -- 172.21.15.12:0/2886524538 wait complete. 2023-12-11T20:20:09.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.581+0000 7fe05d59d700 1 Processor -- start 2023-12-11T20:20:09.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe05d59d700 1 -- start start 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe05d59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581001b0 0x7fe0581971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe05d59d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0581013a0 0x7fe0581976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe05d59d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe058101d40 0x7fe05819e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe05d59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05819ece0 con 0x7fe0581001b0 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe05d59d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05819ee20 con 0x7fe058101d40 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe05d59d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05819efb0 con 0x7fe0581013a0 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe057fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581001b0 0x7fe0581971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe057fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581001b0 0x7fe0581971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34320/0 (socket says 172.21.15.12:34320) 2023-12-11T20:20:09.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.582+0000 7fe057fff700 1 -- 172.21.15.12:0/2369377591 learned_addr learned my addr 172.21.15.12:0/2369377591 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:09.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe0577fe700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0581013a0 0x7fe0581976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe05cd9c700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe058101d40 0x7fe05819e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe057fff700 1 -- 172.21.15.12:0/2369377591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0581013a0 msgr2=0x7fe0581976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe057fff700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0581013a0 0x7fe0581976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe057fff700 1 -- 172.21.15.12:0/2369377591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe058101d40 msgr2=0x7fe05819e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe057fff700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe058101d40 0x7fe05819e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe057fff700 1 -- 172.21.15.12:0/2369377591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0095f0 con 0x7fe0581001b0 2023-12-11T20:20:09.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe057fff700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581001b0 0x7fe0581971b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe04800be80 tx=0x7fe04800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:09.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe0557fa700 1 -- 172.21.15.12:0/2369377591 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048012b70 con 0x7fe0581001b0 2023-12-11T20:20:09.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.583+0000 7fe0557fa700 1 -- 172.21.15.12:0/2369377591 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe04800de40 con 0x7fe0581001b0 2023-12-11T20:20:09.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.584+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe058102620 con 0x7fe0581001b0 2023-12-11T20:20:09.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.584+0000 7fe0557fa700 1 -- 172.21.15.12:0/2369377591 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048009e00 con 0x7fe0581001b0 2023-12-11T20:20:09.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.584+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe058102b80 con 0x7fe0581001b0 2023-12-11T20:20:09.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.585+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05804f300 con 0x7fe0581001b0 2023-12-11T20:20:09.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.587+0000 7fe0557fa700 1 -- 172.21.15.12:0/2369377591 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe04801c410 con 0x7fe0581001b0 2023-12-11T20:20:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.588+0000 7fe0557fa700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe0400a1500 0x7fe0400a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.588+0000 7fe0557fa700 1 -- 172.21.15.12:0/2369377591 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe0480d0ad0 con 0x7fe0581001b0 2023-12-11T20:20:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.589+0000 7fe0577fe700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe0400a1500 0x7fe0400a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:09.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.589+0000 7fe0577fe700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe0400a1500 0x7fe0400a39c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00b580 tx=0x7fe04c01a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.592+0000 7fe0557fa700 1 -- 172.21.15.12:0/2369377591 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe04809a0e0 con 0x7fe0581001b0 2023-12-11T20:20:09.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:09 smithi032 ceph-mon[132488]: pgmap v502: 97 pgs: 97 active+clean; 2.4 GiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:20:09.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:09 smithi039 ceph-mon[102205]: pgmap v502: 97 pgs: 97 active+clean; 2.4 GiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:20:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.893+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe05810bb80 con 0x7fe0581001b0 2023-12-11T20:20:09.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.894+0000 7fe0557fa700 1 -- 172.21.15.12:0/2369377591 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7fe048018090 con 0x7fe0581001b0 2023-12-11T20:20:09.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:20:09.893 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:20:09.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe0400a1500 msgr2=0x7fe0400a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe0400a1500 0x7fe0400a39c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00b580 tx=0x7fe04c01a040 comp rx=0 tx=0).stop 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581001b0 msgr2=0x7fe0581971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581001b0 0x7fe0581971b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe04800be80 tx=0x7fe04800dc60 comp rx=0 tx=0).stop 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 shutdown_connections 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe0400a1500 0x7fe0400a39c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe058101d40 0x7fe05819e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0581001b0 0x7fe0581971b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 --2- 172.21.15.12:0/2369377591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0581013a0 0x7fe0581976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 >> 172.21.15.12:0/2369377591 conn(0x7fe0580fb760 msgr2=0x7fe058068830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.897+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 shutdown_connections 2023-12-11T20:20:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:09.898+0000 7fe05d59d700 1 -- 172.21.15.12:0/2369377591 wait complete. 2023-12-11T20:20:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:20:09.917 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:20:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 -- 172.21.15.12:0/4022955302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010da80 msgr2=0x7f914010fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 --2- 172.21.15.12:0/4022955302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010da80 0x7f914010fe70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f913800b0a0 tx=0x7f913800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 -- 172.21.15.12:0/4022955302 shutdown_connections 2023-12-11T20:20:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 --2- 172.21.15.12:0/4022955302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9140075610 0x7f9140073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 --2- 172.21.15.12:0/4022955302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010da80 0x7f914010fe70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 --2- 172.21.15.12:0/4022955302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9140074030 0x7f91400744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 -- 172.21.15.12:0/4022955302 >> 172.21.15.12:0/4022955302 conn(0x7f91400fca20 msgr2=0x7f91400fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 -- 172.21.15.12:0/4022955302 shutdown_connections 2023-12-11T20:20:10.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.162+0000 7f9145fff700 1 -- 172.21.15.12:0/4022955302 wait complete. 2023-12-11T20:20:10.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.164+0000 7f9145fff700 1 Processor -- start 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.164+0000 7f9145fff700 1 -- start start 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.164+0000 7f9145fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9140074030 0x7f914019da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.164+0000 7f9145fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9140075610 0x7f914019df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.164+0000 7f9145fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914010da80 0x7f91401a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.164+0000 7f9145fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401a5520 con 0x7f9140074030 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.164+0000 7f9145fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401a5660 con 0x7f914010da80 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.164+0000 7f9145fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401a57f0 con 0x7f9140075610 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9140074030 0x7f914019da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9140074030 0x7f914019da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34344/0 (socket says 172.21.15.12:34344) 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913f7fe700 1 -- 172.21.15.12:0/1787283329 learned_addr learned my addr 172.21.15.12:0/1787283329 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913effd700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9140075610 0x7f914019df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913ffff700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914010da80 0x7f91401a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913f7fe700 1 -- 172.21.15.12:0/1787283329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9140075610 msgr2=0x7f914019df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913f7fe700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9140075610 0x7f914019df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913f7fe700 1 -- 172.21.15.12:0/1787283329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914010da80 msgr2=0x7f91401a4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913f7fe700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914010da80 0x7f91401a4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.165+0000 7f913f7fe700 1 -- 172.21.15.12:0/1787283329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138009d00 con 0x7f9140074030 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.166+0000 7f913f7fe700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9140074030 0x7f914019da40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f913000e9a0 tx=0x7f913000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.166+0000 7f913cff9700 1 -- 172.21.15.12:0/1787283329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130009790 con 0x7f9140074030 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.166+0000 7f9145fff700 1 -- 172.21.15.12:0/1787283329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91401a5ad0 con 0x7f9140074030 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.166+0000 7f913cff9700 1 -- 172.21.15.12:0/1787283329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9130010430 con 0x7f9140074030 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.166+0000 7f913cff9700 1 -- 172.21.15.12:0/1787283329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000cea0 con 0x7f9140074030 2023-12-11T20:20:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.166+0000 7f9145fff700 1 -- 172.21.15.12:0/1787283329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91401a5fe0 con 0x7f9140074030 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.169+0000 7f913cff9700 1 -- 172.21.15.12:0/1787283329 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f91300105a0 con 0x7f9140074030 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.171+0000 7f913cff9700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91280a1480 0x7f91280a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.171+0000 7f9159874b80 1 Processor -- start 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.171+0000 7f913cff9700 1 -- 172.21.15.12:0/1787283329 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9130014070 con 0x7f9140074030 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.171+0000 7f9159874b80 1 -- start start 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.171+0000 7f913effd700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91280a1480 0x7f91280a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f9159874b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c30773d0 0x5642c30777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f9159874b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c3077d30 0x5642c3078640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f9159874b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c30790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f9159874b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2fd2b50 con 0x5642c30773d0 2023-12-11T20:20:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f9159874b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2fd0470 con 0x5642c3077d30 2023-12-11T20:20:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f9159874b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2fcbd60 con 0x5642c3078c20 2023-12-11T20:20:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f913f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c30773d0 0x5642c30777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f913effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c3077d30 0x5642c3078640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f913f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c30773d0 0x5642c30777f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34360/0 (socket says 172.21.15.12:34360) 2023-12-11T20:20:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f913f7fe700 1 -- 172.21.15.12:0/1489624047 learned_addr learned my addr 172.21.15.12:0/1489624047 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f913ffff700 1 --2- 172.21.15.12:0/1489624047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c30790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.172+0000 7f913effd700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91280a1480 0x7f91280a3940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9140075330 tx=0x7f9134011720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f913effd700 1 -- 172.21.15.12:0/1489624047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 msgr2=0x5642c30790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f913effd700 1 --2- 172.21.15.12:0/1489624047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c30790a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f913effd700 1 -- 172.21.15.12:0/1489624047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c30773d0 msgr2=0x5642c30777f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f913effd700 1 --2- 172.21.15.12:0/1489624047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c30773d0 0x5642c30777f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f913effd700 1 -- 172.21.15.12:0/1489624047 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642c2e48630 con 0x5642c3077d30 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f913effd700 1 --2- 172.21.15.12:0/1489624047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c3077d30 0x5642c3078640 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9134011b20 tx=0x7f913401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e055379677c25f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f9125ffb700 1 -- 172.21.15.12:0/1489624047 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913401ddb0 con 0x5642c3077d30 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f9125ffb700 1 -- 172.21.15.12:0/1489624047 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91340044b0 con 0x5642c3077d30 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.173+0000 7f9125ffb700 1 -- 172.21.15.12:0/1489624047 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400f3c0 con 0x5642c3077d30 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 -- 172.21.15.12:0/1489624047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c3077d30 msgr2=0x5642c3078640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 --2- 172.21.15.12:0/1489624047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c3077d30 0x5642c3078640 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9134011b20 tx=0x7f913401c000 comp rx=0 tx=0).stop 2023-12-11T20:20:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 -- 172.21.15.12:0/1489624047 shutdown_connections 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 --2- 172.21.15.12:0/1489624047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c30790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 --2- 172.21.15.12:0/1489624047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c30773d0 0x5642c30777f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 --2- 172.21.15.12:0/1489624047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c3077d30 0x5642c3078640 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 -- 172.21.15.12:0/1489624047 >> 172.21.15.12:0/1489624047 conn(0x5642c2fa67e0 msgr2=0x5642c3073d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 -- 172.21.15.12:0/1489624047 shutdown_connections 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.174+0000 7f9159874b80 1 -- 172.21.15.12:0/1489624047 wait complete. 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.175+0000 7f9159874b80 1 -- start start 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.175+0000 7f9159874b80 1 Processor -- start 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f9159874b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3081210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f9159874b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c3081750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f9159874b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3088790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f9159874b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2f85560 con 0x5642c3078c20 2023-12-11T20:20:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f9159874b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2f85200 con 0x5642c30773d0 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f9159874b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2e4a920 con 0x5642c3077d30 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f9159874b80 10 client.0 _ll_register_callbacks cb 0x5642c2eb0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f913ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3088790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f913ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3088790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34376/0 (socket says 172.21.15.12:34376) 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f913ffff700 1 -- 172.21.15.12:0/1441489336 learned_addr learned my addr 172.21.15.12:0/1441489336 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f913f7fe700 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3081210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.176+0000 7f913effd700 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c3081750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f913ffff700 1 -- 172.21.15.12:0/1441489336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 msgr2=0x5642c3081750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f913ffff700 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c3081750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f913ffff700 1 -- 172.21.15.12:0/1441489336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 msgr2=0x5642c3081210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f913ffff700 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3081210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f913ffff700 1 -- 172.21.15.12:0/1441489336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9134011cd0 con 0x5642c3078c20 2023-12-11T20:20:10.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f913ffff700 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3088790 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f913800b0a0 tx=0x7f9138007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa91802542a4b5d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f911effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f911effd700 1 -- 172.21.15.12:0/1441489336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913800e040 con 0x5642c3078c20 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f9159874b80 1 -- 172.21.15.12:0/1441489336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642c306ab40 con 0x5642c3078c20 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.177+0000 7f911effd700 1 -- 172.21.15.12:0/1441489336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9138003a00 con 0x5642c3078c20 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f911effd700 1 -- 172.21.15.12:0/1441489336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9138003c00 con 0x5642c3078c20 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f9159874b80 10 client.16677 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f9159874b80 1 -- 172.21.15.12:0/1441489336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5642c2df4de0 con 0x5642c3078c20 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f911effd700 1 -- 172.21.15.12:0/1441489336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5642c306ab40 con 0x5642c3078c20 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f911effd700 1 -- 172.21.15.12:0/1441489336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9138025030 con 0x5642c3078c20 2023-12-11T20:20:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f9159874b80 10 client.16677 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f9159874b80 10 client.16677 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f9159874b80 20 client.16677 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f9159874b80 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5642c308d010 0x5642c308f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f9159874b80 4 client.16677 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.178+0000 7f9159874b80 1 -- 172.21.15.12:0/1441489336 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642c3046f40 con 0x5642c308d010 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.179+0000 7f913f7fe700 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5642c308d010 0x5642c308f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.179+0000 7f913f7fe700 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5642c308d010 0x5642c308f430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=42c08ef0d4cfae16 server_cookie=79f20da21cf567c in_seq=0 out_seq=0 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.179+0000 7f911effd700 10 client.16677 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.180+0000 7f911effd700 1 -- 172.21.15.12:0/1441489336 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5642c3046f40 con 0x5642c308d010 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.180+0000 7f911effd700 10 client.16677 handle_command_reply: tid=0 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.180+0000 7f9159874b80 1 client.16677 shutdown 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.180+0000 7f9159874b80 1 -- 172.21.15.12:0/1441489336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 msgr2=0x5642c3088790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.180+0000 7f9159874b80 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3088790 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f913800b0a0 tx=0x7f9138007dc0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 1 -- 172.21.15.12:0/1441489336 shutdown_connections 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5642c308d010 0x5642c308f430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3081210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3088790 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 1 --2- 172.21.15.12:0/1441489336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c3081750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f911effd700 0 client.16677 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 1 -- 172.21.15.12:0/1441489336 >> 172.21.15.12:0/1441489336 conn(0x5642c2fa67e0 msgr2=0x5642c3072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 1 -- 172.21.15.12:0/1441489336 shutdown_connections 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 1 -- 172.21.15.12:0/1441489336 wait complete. 2023-12-11T20:20:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.181+0000 7f9159874b80 20 client.16677 trim_cache size 0 max 16384 2023-12-11T20:20:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.203+0000 7f9159874b80 1 Processor -- start 2023-12-11T20:20:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.203+0000 7f9159874b80 1 -- start start 2023-12-11T20:20:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.203+0000 7f9159874b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3088e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.203+0000 7f9159874b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c30886b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.203+0000 7f9159874b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3079000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.203+0000 7f9159874b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c306ebd0 con 0x5642c3078c20 2023-12-11T20:20:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.203+0000 7f9159874b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c3094650 con 0x5642c30773d0 2023-12-11T20:20:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.203+0000 7f9159874b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c3078140 con 0x5642c3077d30 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c30886b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3079000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3088e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c30886b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:39446/0 (socket says 172.21.15.12:39446) 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913effd700 1 -- 172.21.15.12:0/3091050512 learned_addr learned my addr 172.21.15.12:0/3091050512 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913f7fe700 1 -- 172.21.15.12:0/3091050512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 msgr2=0x5642c30886b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913f7fe700 1 --2- 172.21.15.12:0/3091050512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c30886b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913f7fe700 1 -- 172.21.15.12:0/3091050512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 msgr2=0x5642c3079000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913f7fe700 1 --2- 172.21.15.12:0/3091050512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3079000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913f7fe700 1 -- 172.21.15.12:0/3091050512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642c2dddc60 con 0x5642c30773d0 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913ffff700 1 --2- 172.21.15.12:0/3091050512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3079000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.204+0000 7f913f7fe700 1 --2- 172.21.15.12:0/3091050512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3088e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f913009a170 tx=0x7f91300ca890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8351acd7c1108f09 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f91267fc700 1 -- 172.21.15.12:0/3091050512 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913009e120 con 0x5642c30773d0 2023-12-11T20:20:10.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f91267fc700 1 -- 172.21.15.12:0/3091050512 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f913009a1e0 con 0x5642c30773d0 2023-12-11T20:20:10.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f91267fc700 1 -- 172.21.15.12:0/3091050512 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130099930 con 0x5642c30773d0 2023-12-11T20:20:10.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f9159874b80 1 -- 172.21.15.12:0/3091050512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 msgr2=0x5642c3088e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f9159874b80 1 --2- 172.21.15.12:0/3091050512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3088e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f913009a170 tx=0x7f91300ca890 comp rx=0 tx=0).stop 2023-12-11T20:20:10.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f9159874b80 1 -- 172.21.15.12:0/3091050512 shutdown_connections 2023-12-11T20:20:10.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f9159874b80 1 --2- 172.21.15.12:0/3091050512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3088e40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f9159874b80 1 --2- 172.21.15.12:0/3091050512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3078c20 0x5642c3079000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f9159874b80 1 --2- 172.21.15.12:0/3091050512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3077d30 0x5642c30886b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.205+0000 7f9159874b80 1 -- 172.21.15.12:0/3091050512 >> 172.21.15.12:0/3091050512 conn(0x5642c2fa67e0 msgr2=0x5642c307f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.206+0000 7f9159874b80 1 -- 172.21.15.12:0/3091050512 shutdown_connections 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.206+0000 7f9159874b80 1 -- 172.21.15.12:0/3091050512 wait complete. 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.206+0000 7f9159874b80 1 -- start start 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.206+0000 7f9159874b80 1 Processor -- start 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f9159874b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3086570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f9159874b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3077d30 0x5642c3086ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f9159874b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c3087a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f9159874b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c3087fb0 con 0x5642c3077d30 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f9159874b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c3088120 con 0x5642c30773d0 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f9159874b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c30882e0 con 0x5642c3078c20 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f9159874b80 10 client.0 _ll_register_callbacks cb 0x5642c2eb0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f913effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3077d30 0x5642c3086ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f913f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3086570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f913effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3077d30 0x5642c3086ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34384/0 (socket says 172.21.15.12:34384) 2023-12-11T20:20:10.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.207+0000 7f913effd700 1 -- 172.21.15.12:0/3188646425 learned_addr learned my addr 172.21.15.12:0/3188646425 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f913ffff700 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c3087a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f913f7fe700 1 -- 172.21.15.12:0/3188646425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 msgr2=0x5642c3087a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f913f7fe700 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c3087a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f913f7fe700 1 -- 172.21.15.12:0/3188646425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3077d30 msgr2=0x5642c3086ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f913f7fe700 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3077d30 0x5642c3086ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f913f7fe700 1 -- 172.21.15.12:0/3188646425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642c2df4de0 con 0x5642c30773d0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f913ffff700 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c3087a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f913f7fe700 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3086570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f913000e970 tx=0x7f9130098780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e46f2c3aedf886 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f911effd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f911effd700 1 -- 172.21.15.12:0/3188646425 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91300998d0 con 0x5642c30773d0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f911effd700 1 -- 172.21.15.12:0/3188646425 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f91300a20e0 con 0x5642c30773d0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.208+0000 7f9159874b80 1 -- 172.21.15.12:0/3188646425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91340044b0 con 0x5642c30773d0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f911effd700 1 -- 172.21.15.12:0/3188646425 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f913009e120 con 0x5642c30773d0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f9159874b80 10 client.26411 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f9159874b80 1 -- 172.21.15.12:0/3188646425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f91401a5fe0 con 0x5642c30773d0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f911effd700 1 -- 172.21.15.12:0/3188646425 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91340044b0 con 0x5642c30773d0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f911effd700 1 -- 172.21.15.12:0/3188646425 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f91300960f0 con 0x5642c30773d0 2023-12-11T20:20:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f9159874b80 10 client.26411 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f9159874b80 10 client.26411 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f9159874b80 20 client.26411 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f9159874b80 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5642c30e4250 0x5642c30e6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f9159874b80 4 client.26411 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.209+0000 7f9159874b80 1 -- 172.21.15.12:0/3188646425 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5642c2f91fd0 con 0x5642c30e4250 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.210+0000 7f913effd700 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5642c30e4250 0x5642c30e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.210+0000 7f911effd700 10 client.26411 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.210+0000 7f913effd700 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5642c30e4250 0x5642c30e6670 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5cbbb4e1dbd3550c server_cookie=91e96fa1a19c4a65 in_seq=0 out_seq=0 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f911effd700 1 -- 172.21.15.12:0/3188646425 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5642c2f91fd0 con 0x5642c30e4250 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f911effd700 10 client.26411 handle_command_reply: tid=0 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 client.26411 shutdown 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 -- 172.21.15.12:0/3188646425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 msgr2=0x5642c3086570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3086570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f913000e970 tx=0x7f9130098780 comp rx=0 tx=0).stop 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 -- 172.21.15.12:0/3188646425 shutdown_connections 2023-12-11T20:20:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5642c30e4250 0x5642c30e6670 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5642c30773d0 0x5642c3086570 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5642c3078c20 0x5642c3087a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f911effd700 0 client.26411 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 --2- 172.21.15.12:0/3188646425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642c3077d30 0x5642c3086ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 -- 172.21.15.12:0/3188646425 >> 172.21.15.12:0/3188646425 conn(0x5642c2fa67e0 msgr2=0x5642c307bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 -- 172.21.15.12:0/3188646425 shutdown_connections 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.211+0000 7f9159874b80 1 -- 172.21.15.12:0/3188646425 wait complete. 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9159874b80 20 client.26411 trim_cache size 0 max 16384 2023-12-11T20:20:10.213 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 -- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91280a1480 msgr2=0x7f91280a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91280a1480 0x7f91280a3940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9140075330 tx=0x7f9134011720 comp rx=0 tx=0).stop 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 -- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9140074030 msgr2=0x7f914019da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9140074030 0x7f914019da40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f913000e9a0 tx=0x7f913000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 -- 172.21.15.12:0/1787283329 shutdown_connections 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f91280a1480 0x7f91280a3940 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f914010da80 0x7f91401a4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9140074030 0x7f914019da40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 --2- 172.21.15.12:0/1787283329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9140075610 0x7f914019df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 -- 172.21.15.12:0/1787283329 >> 172.21.15.12:0/1787283329 conn(0x7f91400fca20 msgr2=0x7f9140100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 -- 172.21.15.12:0/1787283329 shutdown_connections 2023-12-11T20:20:10.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.212+0000 7f9145fff700 1 -- 172.21.15.12:0/1787283329 wait complete. 2023-12-11T20:20:10.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:20:10.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/2873794876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 msgr2=0x7fdb18109750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/2873794876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 0x7fdb18109750 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000b0d0 tx=0x7fdb1000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/2873794876 shutdown_connections 2023-12-11T20:20:10.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/2873794876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb18101310 0x7fdb18101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/2873794876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 0x7fdb18109750 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/2873794876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb18102500 0x7fdb18102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/2873794876 >> 172.21.15.12:0/2873794876 conn(0x7fdb180fc860 msgr2=0x7fdb180fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/2873794876 shutdown_connections 2023-12-11T20:20:10.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.476+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/2873794876 wait complete. 2023-12-11T20:20:10.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.477+0000 7fdb1eb9d700 1 Processor -- start 2023-12-11T20:20:10.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.477+0000 7fdb1eb9d700 1 -- start start 2023-12-11T20:20:10.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.477+0000 7fdb1eb9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb18101310 0x7fdb18075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.477+0000 7fdb1eb9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb18102500 0x7fdb180739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.477+0000 7fdb1eb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 0x7fdb18073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.477+0000 7fdb1eb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180746a0 con 0x7fdb18102ea0 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.477+0000 7fdb1eb9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb18074810 con 0x7fdb18101310 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.477+0000 7fdb1eb9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb181a11a0 con 0x7fdb18102500 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1db9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb18101310 0x7fdb18075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1d39a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb18102500 0x7fdb180739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1db9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb18101310 0x7fdb18075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40474/0 (socket says 172.21.15.12:40474) 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1db9b700 1 -- 172.21.15.12:0/1888589250 learned_addr learned my addr 172.21.15.12:0/1888589250 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 0x7fdb18073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1d39a700 1 -- 172.21.15.12:0/1888589250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb18101310 msgr2=0x7fdb18075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb18101310 0x7fdb18075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1d39a700 1 -- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 msgr2=0x7fdb18073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 0x7fdb18073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1d39a700 1 -- 172.21.15.12:0/1888589250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10009d00 con 0x7fdb18102500 2023-12-11T20:20:10.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.478+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 0x7fdb18073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:10.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.479+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb18102500 0x7fdb180739c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e9f0 tx=0x7fdb0800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.479+0000 7fdb0effd700 1 -- 172.21.15.12:0/1888589250 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800c9c0 con 0x7fdb18102500 2023-12-11T20:20:10.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.479+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/1888589250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb181a13d0 con 0x7fdb18102500 2023-12-11T20:20:10.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.479+0000 7fdb0effd700 1 -- 172.21.15.12:0/1888589250 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb08010430 con 0x7fdb18102500 2023-12-11T20:20:10.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.479+0000 7fdb0effd700 1 -- 172.21.15.12:0/1888589250 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08018680 con 0x7fdb18102500 2023-12-11T20:20:10.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.479+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/1888589250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb181a18d0 con 0x7fdb18102500 2023-12-11T20:20:10.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.483+0000 7fdb0effd700 1 -- 172.21.15.12:0/1888589250 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fdb080105a0 con 0x7fdb18102500 2023-12-11T20:20:10.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.484+0000 7fdb33816b80 1 Processor -- start 2023-12-11T20:20:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.484+0000 7fdb33816b80 1 -- start start 2023-12-11T20:20:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585ea60 0x5566b585ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b585f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585fde0 0x5566b5860240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb33816b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b57b9b50 con 0x5566b585fde0 2023-12-11T20:20:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb33816b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b57b7470 con 0x5566b585ea60 2023-12-11T20:20:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb33816b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b57b2d60 con 0x5566b585f3c0 2023-12-11T20:20:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb0effd700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdb040a1520 0x7fdb040a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb1d39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585fde0 0x5566b5860240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb1d39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585fde0 0x5566b5860240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34412/0 (socket says 172.21.15.12:34412) 2023-12-11T20:20:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb1e39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585ea60 0x5566b585ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb1d39a700 1 -- 172.21.15.12:0/2593497274 learned_addr learned my addr 172.21.15.12:0/2593497274 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b585f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.485+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdb040a1520 0x7fdb040a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb0effd700 1 -- 172.21.15.12:0/1888589250 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb08014070 con 0x7fdb18102500 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb1d39a700 1 -- 172.21.15.12:0/2593497274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 msgr2=0x5566b585f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b585f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb1d39a700 1 -- 172.21.15.12:0/2593497274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585ea60 msgr2=0x5566b585ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585ea60 0x5566b585ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb1d39a700 1 -- 172.21.15.12:0/2593497274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566b562f630 con 0x5566b585fde0 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585ea60 0x5566b585ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585fde0 0x5566b5860240 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fdb0809a110 tx=0x7fdb0809a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff90a552e4a3372 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdb040a1520 0x7fdb040a39e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009040 tx=0x7fdb1000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.486+0000 7fdb03fff700 1 -- 172.21.15.12:0/2593497274 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080989d0 con 0x5566b585fde0 2023-12-11T20:20:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb03fff700 1 -- 172.21.15.12:0/2593497274 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb080d1040 con 0x5566b585fde0 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb03fff700 1 -- 172.21.15.12:0/2593497274 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080a2510 con 0x5566b585fde0 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb33816b80 1 -- 172.21.15.12:0/2593497274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585fde0 msgr2=0x5566b5860240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb33816b80 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585fde0 0x5566b5860240 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fdb0809a110 tx=0x7fdb0809a080 comp rx=0 tx=0).stop 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb33816b80 1 -- 172.21.15.12:0/2593497274 shutdown_connections 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb33816b80 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585ea60 0x5566b585ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb33816b80 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585fde0 0x5566b5860240 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb33816b80 1 --2- 172.21.15.12:0/2593497274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b585f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.487+0000 7fdb33816b80 1 -- 172.21.15.12:0/2593497274 >> 172.21.15.12:0/2593497274 conn(0x5566b578d7e0 msgr2=0x5566b58593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.488+0000 7fdb33816b80 1 -- 172.21.15.12:0/2593497274 shutdown_connections 2023-12-11T20:20:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.488+0000 7fdb33816b80 1 -- 172.21.15.12:0/2593497274 wait complete. 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.488+0000 7fdb33816b80 1 -- start start 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.488+0000 7fdb33816b80 1 Processor -- start 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b5868310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b5868850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb33816b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b576c560 con 0x5566b585ea60 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb33816b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b576c200 con 0x5566b585fde0 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb33816b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b5631920 con 0x5566b585f3c0 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb33816b80 10 client.0 _ll_register_callbacks cb 0x5566b5697a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb1db9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b5868310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb1db9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b5868310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34428/0 (socket says 172.21.15.12:34428) 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb1db9b700 1 -- 172.21.15.12:0/3815342186 learned_addr learned my addr 172.21.15.12:0/3815342186 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.489+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b5868850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb1db9b700 1 -- 172.21.15.12:0/3815342186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 msgr2=0x5566b5868850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b5868850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb1db9b700 1 -- 172.21.15.12:0/3815342186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 msgr2=0x5566b586f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb1db9b700 1 -- 172.21.15.12:0/3815342186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1810a0a0 con 0x5566b585ea60 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b5868310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdb14011440 tx=0x7fdb14011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270349adf5a8019d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb017fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb017fa700 1 -- 172.21.15.12:0/3815342186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14016070 con 0x5566b585ea60 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb017fa700 1 -- 172.21.15.12:0/3815342186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb14010640 con 0x5566b585ea60 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.490+0000 7fdb33816b80 1 -- 172.21.15.12:0/3815342186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566b58519e0 con 0x5566b585ea60 2023-12-11T20:20:10.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb017fa700 1 -- 172.21.15.12:0/3815342186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb14007900 con 0x5566b585ea60 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb33816b80 10 client.16695 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb33816b80 1 -- 172.21.15.12:0/3815342186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fdb181a18d0 con 0x5566b585ea60 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb017fa700 1 -- 172.21.15.12:0/3815342186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5566b58519e0 con 0x5566b585ea60 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb017fa700 1 -- 172.21.15.12:0/3815342186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb14025a40 con 0x5566b585ea60 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb33816b80 10 client.16695 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb33816b80 10 client.16695 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb33816b80 20 client.16695 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5566b5874170 0x5566b5876590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb33816b80 4 client.16695 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.491+0000 7fdb33816b80 1 -- 172.21.15.12:0/3815342186 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566b582df40 con 0x5566b5874170 2023-12-11T20:20:10.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.492+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5566b5874170 0x5566b5876590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.492+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5566b5874170 0x5566b5876590 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c6e40d6fb0cf4d3b server_cookie=b79f51661ab78306 in_seq=0 out_seq=0 2023-12-11T20:20:10.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.492+0000 7fdb017fa700 10 client.16695 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.493+0000 7fdb017fa700 1 -- 172.21.15.12:0/3815342186 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5566b582df40 con 0x5566b5874170 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.493+0000 7fdb017fa700 10 client.16695 handle_command_reply: tid=0 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.493+0000 7fdb33816b80 1 client.16695 shutdown 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 -- 172.21.15.12:0/3815342186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 msgr2=0x5566b5868310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b5868310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdb14011440 tx=0x7fdb14011750 comp rx=0 tx=0).stop 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 -- 172.21.15.12:0/3815342186 shutdown_connections 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5566b5874170 0x5566b5876590 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b5868310 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3815342186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b5868850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 -- 172.21.15.12:0/3815342186 >> 172.21.15.12:0/3815342186 conn(0x5566b578d7e0 msgr2=0x5566b585d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb017fa700 0 client.16695 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:20:10.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 -- 172.21.15.12:0/3815342186 shutdown_connections 2023-12-11T20:20:10.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 1 -- 172.21.15.12:0/3815342186 wait complete. 2023-12-11T20:20:10.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.494+0000 7fdb33816b80 20 client.16695 trim_cache size 0 max 16384 2023-12-11T20:20:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.511+0000 7fdb33816b80 1 Processor -- start 2023-12-11T20:20:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb33816b80 1 -- start start 2023-12-11T20:20:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b586ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b586f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b58601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb33816b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b58672c0 con 0x5566b585ea60 2023-12-11T20:20:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb33816b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b5855880 con 0x5566b585fde0 2023-12-11T20:20:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb33816b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b58541e0 con 0x5566b585f3c0 2023-12-11T20:20:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb1db9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b586ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb1db9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b586ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34434/0 (socket says 172.21.15.12:34434) 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb1db9b700 1 -- 172.21.15.12:0/1769783904 learned_addr learned my addr 172.21.15.12:0/1769783904 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b586f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.512+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b58601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb1db9b700 1 -- 172.21.15.12:0/1769783904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 msgr2=0x5566b586f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b586f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb1db9b700 1 -- 172.21.15.12:0/1769783904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 msgr2=0x5566b58601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b58601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb1db9b700 1 -- 172.21.15.12:0/1769783904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566b55dbde0 con 0x5566b585ea60 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b58601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b586ff40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005b30 tx=0x7fdb14007640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df565a8dbf696e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb0cbff700 1 -- 172.21.15.12:0/1769783904 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14016070 con 0x5566b585ea60 2023-12-11T20:20:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb0cbff700 1 -- 172.21.15.12:0/1769783904 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb14017040 con 0x5566b585ea60 2023-12-11T20:20:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.513+0000 7fdb0cbff700 1 -- 172.21.15.12:0/1769783904 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb140052a0 con 0x5566b585ea60 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 -- 172.21.15.12:0/1769783904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 msgr2=0x5566b586ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b586ff40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005b30 tx=0x7fdb14007640 comp rx=0 tx=0).stop 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 -- 172.21.15.12:0/1769783904 shutdown_connections 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b58601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585ea60 0x5566b586ff40 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 --2- 172.21.15.12:0/1769783904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585f3c0 0x5566b586f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 -- 172.21.15.12:0/1769783904 >> 172.21.15.12:0/1769783904 conn(0x5566b578d7e0 msgr2=0x5566b5859280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 -- 172.21.15.12:0/1769783904 shutdown_connections 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.514+0000 7fdb33816b80 1 -- 172.21.15.12:0/1769783904 wait complete. 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.515+0000 7fdb33816b80 1 -- start start 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.515+0000 7fdb33816b80 1 Processor -- start 2023-12-11T20:20:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585ea60 0x5566b586d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585f3c0 0x5566b586d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb33816b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb33816b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b586ec70 con 0x5566b585f3c0 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb33816b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b586ede0 con 0x5566b585fde0 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb33816b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b586efa0 con 0x5566b585ea60 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb33816b80 10 client.0 _ll_register_callbacks cb 0x5566b5697a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb1db9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585ea60 0x5566b586d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb1d39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585f3c0 0x5566b586d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb1db9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585ea60 0x5566b586d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:39534/0 (socket says 172.21.15.12:39534) 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb1db9b700 1 -- 172.21.15.12:0/3668474375 learned_addr learned my addr 172.21.15.12:0/3668474375 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.516+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb1db9b700 1 -- 172.21.15.12:0/3668474375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 msgr2=0x5566b586e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb1db9b700 1 -- 172.21.15.12:0/3668474375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585f3c0 msgr2=0x5566b586d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585f3c0 0x5566b586d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb1db9b700 1 -- 172.21.15.12:0/3668474375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb181a18d0 con 0x5566b585ea60 2023-12-11T20:20:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb1e39c700 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb1db9b700 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585ea60 0x5566b586d230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb14025e20 tx=0x7fdb1401b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c640aab666136d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb017fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:20:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb017fa700 1 -- 172.21.15.12:0/3668474375 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14016070 con 0x5566b585ea60 2023-12-11T20:20:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb33816b80 1 -- 172.21.15.12:0/3668474375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb080d1040 con 0x5566b585ea60 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.517+0000 7fdb017fa700 1 -- 172.21.15.12:0/3668474375 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb1402a070 con 0x5566b585ea60 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb017fa700 1 -- 172.21.15.12:0/3668474375 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb1401ba30 con 0x5566b585ea60 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb33816b80 10 client.26419 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb33816b80 1 -- 172.21.15.12:0/3668474375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5566b55c4c60 con 0x5566b585ea60 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb017fa700 1 -- 172.21.15.12:0/3668474375 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb14044080 con 0x5566b585ea60 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb017fa700 1 -- 172.21.15.12:0/3668474375 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb14004ab0 con 0x5566b585ea60 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb33816b80 10 client.26419 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb33816b80 10 client.26419 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb33816b80 20 client.26419 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5566b58cae50 0x5566b58cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb33816b80 4 client.26419 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.518+0000 7fdb33816b80 1 -- 172.21.15.12:0/3668474375 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5566b5778fd0 con 0x5566b58cae50 2023-12-11T20:20:10.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.519+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5566b58cae50 0x5566b58cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.519+0000 7fdb1d39a700 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5566b58cae50 0x5566b58cd270 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=802e929c627e841e server_cookie=13813520c18ce9b in_seq=0 out_seq=0 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.519+0000 7fdb017fa700 10 client.26419 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb017fa700 1 -- 172.21.15.12:0/3668474375 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5566b5778fd0 con 0x5566b58cae50 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb017fa700 10 client.26419 handle_command_reply: tid=0 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 client.26419 shutdown 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 -- 172.21.15.12:0/3668474375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585ea60 msgr2=0x5566b586d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585ea60 0x5566b586d230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb14025e20 tx=0x7fdb1401b420 comp rx=0 tx=0).stop 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 -- 172.21.15.12:0/3668474375 shutdown_connections 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5566b58cae50 0x5566b58cd270 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566b585fde0 0x5566b586e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566b585ea60 0x5566b586d230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb017fa700 0 client.26419 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:20:10.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 --2- 172.21.15.12:0/3668474375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566b585f3c0 0x5566b586d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 -- 172.21.15.12:0/3668474375 >> 172.21.15.12:0/3668474375 conn(0x5566b578d7e0 msgr2=0x5566b587af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 -- 172.21.15.12:0/3668474375 shutdown_connections 2023-12-11T20:20:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 1 -- 172.21.15.12:0/3668474375 wait complete. 2023-12-11T20:20:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.520+0000 7fdb33816b80 20 client.26419 trim_cache size 0 max 16384 2023-12-11T20:20:10.523 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdb040a1520 msgr2=0x7fdb040a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdb040a1520 0x7fdb040a39e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009040 tx=0x7fdb1000b040 comp rx=0 tx=0).stop 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/1888589250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb18102500 msgr2=0x7fdb180739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb18102500 0x7fdb180739c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e9f0 tx=0x7fdb0800ed00 comp rx=0 tx=0).stop 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/1888589250 shutdown_connections 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdb040a1520 0x7fdb040a39e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb18101310 0x7fdb18075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb18102ea0 0x7fdb18073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 --2- 172.21.15.12:0/1888589250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdb18102500 0x7fdb180739c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/1888589250 >> 172.21.15.12:0/1888589250 conn(0x7fdb180fc860 msgr2=0x7fdb18105800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/1888589250 shutdown_connections 2023-12-11T20:20:10.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.521+0000 7fdb1eb9d700 1 -- 172.21.15.12:0/1888589250 wait complete. 2023-12-11T20:20:10.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:10 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2369377591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:20:10.540 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:20:10.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:10 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2369377591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.764+0000 7f09119ff700 1 -- 172.21.15.12:0/2258503997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1014b0 msgr2=0x7f090c1018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.764+0000 7f09119ff700 1 --2- 172.21.15.12:0/2258503997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1014b0 0x7f090c1018d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0099c0 tx=0x7f08fc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.764+0000 7f09119ff700 1 -- 172.21.15.12:0/2258503997 shutdown_connections 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.764+0000 7f09119ff700 1 --2- 172.21.15.12:0/2258503997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f090c103040 0x7f090c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.764+0000 7f09119ff700 1 --2- 172.21.15.12:0/2258503997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1014b0 0x7f090c1018d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.764+0000 7f09119ff700 1 --2- 172.21.15.12:0/2258503997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f090c1026a0 0x7f090c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.764+0000 7f09119ff700 1 -- 172.21.15.12:0/2258503997 >> 172.21.15.12:0/2258503997 conn(0x7f090c0fca00 msgr2=0x7f090c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.765+0000 7f09119ff700 1 -- 172.21.15.12:0/2258503997 shutdown_connections 2023-12-11T20:20:10.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.765+0000 7f09119ff700 1 -- 172.21.15.12:0/2258503997 wait complete. 2023-12-11T20:20:10.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.765+0000 7f09119ff700 1 Processor -- start 2023-12-11T20:20:10.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f09119ff700 1 -- start start 2023-12-11T20:20:10.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f09119ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f090c1014b0 0x7f090c1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f09119ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1026a0 0x7f090c199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f09119ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f090c103040 0x7f090c1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f09119ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c1a10d0 con 0x7f090c1026a0 2023-12-11T20:20:10.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f09119ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c1a1210 con 0x7f090c1014b0 2023-12-11T20:20:10.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f09119ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c1a13a0 con 0x7f090c103040 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f090a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1026a0 0x7f090c199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f090a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1026a0 0x7f090c199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34462/0 (socket says 172.21.15.12:34462) 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f090a7fc700 1 -- 172.21.15.12:0/3861870156 learned_addr learned my addr 172.21.15.12:0/3861870156 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.766+0000 7f090b7fe700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f090c103040 0x7f090c1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f090affd700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f090c1014b0 0x7f090c1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f090a7fc700 1 -- 172.21.15.12:0/3861870156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f090c103040 msgr2=0x7f090c1a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f090a7fc700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f090c103040 0x7f090c1a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f090a7fc700 1 -- 172.21.15.12:0/3861870156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f090c1014b0 msgr2=0x7f090c1995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f090a7fc700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f090c1014b0 0x7f090c1995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f090a7fc700 1 -- 172.21.15.12:0/3861870156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0095f0 con 0x7f090c1026a0 2023-12-11T20:20:10.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f090a7fc700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1026a0 0x7f090c199ae0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f090000d950 tx=0x7f090000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f09109fd700 1 -- 172.21.15.12:0/3861870156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000f890 con 0x7f090c1026a0 2023-12-11T20:20:10.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f09109fd700 1 -- 172.21.15.12:0/3861870156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f090000fe80 con 0x7f090c1026a0 2023-12-11T20:20:10.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.767+0000 7f09109fd700 1 -- 172.21.15.12:0/3861870156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000e3b0 con 0x7f090c1026a0 2023-12-11T20:20:10.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.768+0000 7f09119ff700 1 -- 172.21.15.12:0/3861870156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c1a1680 con 0x7f090c1026a0 2023-12-11T20:20:10.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.768+0000 7f09119ff700 1 -- 172.21.15.12:0/3861870156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c1a1b90 con 0x7f090c1026a0 2023-12-11T20:20:10.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.771+0000 7f09109fd700 1 -- 172.21.15.12:0/3861870156 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0900010460 con 0x7f090c1026a0 2023-12-11T20:20:10.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.772+0000 7f092532ab80 1 Processor -- start 2023-12-11T20:20:10.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.772+0000 7f092532ab80 1 -- start start 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f09109fd700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f08f40a1500 0x7f08f40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f092532ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c60a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f092532ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60ad30 0x56284c60b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f092532ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c60c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f092532ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c565b50 con 0x56284c60a3d0 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f092532ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c563470 con 0x56284c60ad30 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f092532ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c55ed60 con 0x56284c60bc20 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f09109fd700 1 -- 172.21.15.12:0/3861870156 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f09000cca90 con 0x7f090c1026a0 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f090affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c60a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f090b7fe700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f08f40a1500 0x7f08f40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f090affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c60a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34468/0 (socket says 172.21.15.12:34468) 2023-12-11T20:20:10.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.773+0000 7f090affd700 1 -- 172.21.15.12:0/367973043 learned_addr learned my addr 172.21.15.12:0/367973043 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090a7fc700 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60ad30 0x56284c60b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090b7fe700 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c60c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090affd700 1 -- 172.21.15.12:0/367973043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 msgr2=0x56284c60c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090affd700 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c60c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090affd700 1 -- 172.21.15.12:0/367973043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60ad30 msgr2=0x56284c60b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090affd700 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60ad30 0x56284c60b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090affd700 1 -- 172.21.15.12:0/367973043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56284c3db630 con 0x56284c60a3d0 2023-12-11T20:20:10.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090b7fe700 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c60c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:10.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090affd700 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c60a7f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0099c0 tx=0x7f08fc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73927b7f5dc1071 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f090b7fe700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f08f40a1500 0x7f08f40a39c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x56284c60b400 tx=0x7f090400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.774+0000 7f08f1ffb700 1 -- 172.21.15.12:0/367973043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc026070 con 0x56284c60a3d0 2023-12-11T20:20:10.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f08f1ffb700 1 -- 172.21.15.12:0/367973043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08fc01e040 con 0x56284c60a3d0 2023-12-11T20:20:10.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f08f1ffb700 1 -- 172.21.15.12:0/367973043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01d070 con 0x56284c60a3d0 2023-12-11T20:20:10.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f092532ab80 1 -- 172.21.15.12:0/367973043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 msgr2=0x56284c60a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f092532ab80 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c60a7f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0099c0 tx=0x7f08fc005e80 comp rx=0 tx=0).stop 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f092532ab80 1 -- 172.21.15.12:0/367973043 shutdown_connections 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f092532ab80 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c60c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f092532ab80 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c60a7f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f092532ab80 1 --2- 172.21.15.12:0/367973043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60ad30 0x56284c60b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f092532ab80 1 -- 172.21.15.12:0/367973043 >> 172.21.15.12:0/367973043 conn(0x56284c5397e0 msgr2=0x56284c606d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.775+0000 7f092532ab80 1 -- 172.21.15.12:0/367973043 shutdown_connections 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.776+0000 7f092532ab80 1 -- 172.21.15.12:0/367973043 wait complete. 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.776+0000 7f092532ab80 1 -- start start 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.776+0000 7f092532ab80 1 Processor -- start 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f092532ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60a3d0 0x56284c614170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f092532ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6146b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f092532ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c61b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f092532ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c518560 con 0x56284c60ad30 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f092532ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c518200 con 0x56284c60bc20 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f092532ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c3dd920 con 0x56284c60a3d0 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f092532ab80 10 client.0 _ll_register_callbacks cb 0x56284c443a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f090a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6146b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f090a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6146b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34472/0 (socket says 172.21.15.12:34472) 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f090a7fc700 1 -- 172.21.15.12:0/4207986692 learned_addr learned my addr 172.21.15.12:0/4207986692 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f090affd700 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60a3d0 0x56284c614170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.777+0000 7f090b7fe700 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c61b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f090a7fc700 1 -- 172.21.15.12:0/4207986692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60a3d0 msgr2=0x56284c614170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f090a7fc700 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60a3d0 0x56284c614170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f090a7fc700 1 -- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 msgr2=0x56284c61b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f090a7fc700 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c61b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f090a7fc700 1 -- 172.21.15.12:0/4207986692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c10a240 con 0x56284c60ad30 2023-12-11T20:20:10.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f090b7fe700 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c61b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:10.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f090a7fc700 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6146b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0900096260 tx=0x7f090009a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce1bfd95e6e20a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f08eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:10.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f08eaffd700 1 -- 172.21.15.12:0/4207986692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090009d070 con 0x56284c60ad30 2023-12-11T20:20:10.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f08eaffd700 1 -- 172.21.15.12:0/4207986692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f090009deb0 con 0x56284c60ad30 2023-12-11T20:20:10.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.778+0000 7f092532ab80 1 -- 172.21.15.12:0/4207986692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56284c5fdb40 con 0x56284c60ad30 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f08eaffd700 1 -- 172.21.15.12:0/4207986692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09000a20f0 con 0x56284c60ad30 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f092532ab80 10 client.16713 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f092532ab80 1 -- 172.21.15.12:0/4207986692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56284c387de0 con 0x56284c60ad30 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f08eaffd700 1 -- 172.21.15.12:0/4207986692 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56284c5fdb40 con 0x56284c60ad30 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f08eaffd700 1 -- 172.21.15.12:0/4207986692 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09000adb40 con 0x56284c60ad30 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f092532ab80 10 client.16713 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f092532ab80 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f092532ab80 20 client.16713 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:10.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f092532ab80 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56284c61ff50 0x56284c622370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f092532ab80 4 client.16713 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.779+0000 7f092532ab80 1 -- 172.21.15.12:0/4207986692 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56284c5d9f40 con 0x56284c61ff50 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.780+0000 7f090affd700 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56284c61ff50 0x56284c622370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.780+0000 7f08eaffd700 10 client.16713 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.780+0000 7f090affd700 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56284c61ff50 0x56284c622370 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=294796471098732a server_cookie=e058d4014e2d838c in_seq=0 out_seq=0 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f08eaffd700 1 -- 172.21.15.12:0/4207986692 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56284c5d9f40 con 0x56284c61ff50 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f08eaffd700 10 client.16713 handle_command_reply: tid=0 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f092532ab80 1 client.16713 shutdown 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f092532ab80 1 -- 172.21.15.12:0/4207986692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 msgr2=0x56284c6146b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f092532ab80 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6146b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0900096260 tx=0x7f090009a460 comp rx=0 tx=0).stop 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f092532ab80 1 -- 172.21.15.12:0/4207986692 shutdown_connections 2023-12-11T20:20:10.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f092532ab80 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56284c61ff50 0x56284c622370 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f092532ab80 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c61b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.781+0000 7f092532ab80 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60a3d0 0x56284c614170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.782+0000 7f092532ab80 1 --2- 172.21.15.12:0/4207986692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6146b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.782+0000 7f092532ab80 1 -- 172.21.15.12:0/4207986692 >> 172.21.15.12:0/4207986692 conn(0x56284c5397e0 msgr2=0x56284c605a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.782+0000 7f08eaffd700 0 client.16713 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:10.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.782+0000 7f092532ab80 1 -- 172.21.15.12:0/4207986692 shutdown_connections 2023-12-11T20:20:10.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.782+0000 7f092532ab80 1 -- 172.21.15.12:0/4207986692 wait complete. 2023-12-11T20:20:10.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.782+0000 7f092532ab80 20 client.16713 trim_cache size 0 max 16384 2023-12-11T20:20:10.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f092532ab80 1 Processor -- start 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f092532ab80 1 -- start start 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f092532ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c61bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f092532ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60ad30 0x56284c61b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f092532ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c613680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f092532ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c61c870 con 0x56284c60a3d0 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f092532ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c61d480 con 0x56284c60bc20 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f092532ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c612bb0 con 0x56284c60ad30 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.799+0000 7f090affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c61bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c61bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34482/0 (socket says 172.21.15.12:34482) 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090affd700 1 -- 172.21.15.12:0/4009335259 learned_addr learned my addr 172.21.15.12:0/4009335259 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090a7fc700 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60ad30 0x56284c61b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090b7fe700 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c613680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090affd700 1 -- 172.21.15.12:0/4009335259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60ad30 msgr2=0x56284c61b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090affd700 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60ad30 0x56284c61b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090affd700 1 -- 172.21.15.12:0/4009335259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 msgr2=0x56284c613680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090affd700 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c613680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090affd700 1 -- 172.21.15.12:0/4009335259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56284c370c60 con 0x56284c60a3d0 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090b7fe700 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c613680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f090affd700 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c61bda0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f08fc005850 tx=0x7f08fc005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bd99acfa75bf29 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.800+0000 7f08f27fc700 1 -- 172.21.15.12:0/4009335259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc026070 con 0x56284c60a3d0 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f08f27fc700 1 -- 172.21.15.12:0/4009335259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08fc027040 con 0x56284c60a3d0 2023-12-11T20:20:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f08f27fc700 1 -- 172.21.15.12:0/4009335259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01d040 con 0x56284c60a3d0 2023-12-11T20:20:10.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:10 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2369377591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:20:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f092532ab80 1 -- 172.21.15.12:0/4009335259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 msgr2=0x56284c61bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f092532ab80 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c61bda0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f08fc005850 tx=0x7f08fc005c70 comp rx=0 tx=0).stop 2023-12-11T20:20:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f092532ab80 1 -- 172.21.15.12:0/4009335259 shutdown_connections 2023-12-11T20:20:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f092532ab80 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60bc20 0x56284c613680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f092532ab80 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60a3d0 0x56284c61bda0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f092532ab80 1 --2- 172.21.15.12:0/4009335259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60ad30 0x56284c61b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f092532ab80 1 -- 172.21.15.12:0/4009335259 >> 172.21.15.12:0/4009335259 conn(0x56284c5397e0 msgr2=0x56284c612150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.801+0000 7f092532ab80 1 -- 172.21.15.12:0/4009335259 shutdown_connections 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.802+0000 7f092532ab80 1 -- 172.21.15.12:0/4009335259 wait complete. 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.802+0000 7f092532ab80 1 -- start start 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.802+0000 7f092532ab80 1 Processor -- start 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f092532ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60a3d0 0x56284c617290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f092532ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6177d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f092532ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c61a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f092532ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c61ad30 con 0x56284c60ad30 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f092532ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c61aea0 con 0x56284c60a3d0 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f092532ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56284c61b060 con 0x56284c60bc20 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f092532ab80 10 client.0 _ll_register_callbacks cb 0x56284c443a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f090a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f090a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6177d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34494/0 (socket says 172.21.15.12:34494) 2023-12-11T20:20:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f090a7fc700 1 -- 172.21.15.12:0/1879831465 learned_addr learned my addr 172.21.15.12:0/1879831465 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f090b7fe700 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c61a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f090affd700 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60a3d0 0x56284c617290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f090a7fc700 1 -- 172.21.15.12:0/1879831465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 msgr2=0x56284c61a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.803+0000 7f090a7fc700 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c61a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f090a7fc700 1 -- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60a3d0 msgr2=0x56284c617290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f090a7fc700 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60a3d0 0x56284c617290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f090a7fc700 1 -- 172.21.15.12:0/1879831465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56284c3db630 con 0x56284c60ad30 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f090affd700 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60a3d0 0x56284c617290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f090a7fc700 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6177d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0900099a60 tx=0x7f09000a1e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8cff1ea551bfb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f08eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f08eaffd700 1 -- 172.21.15.12:0/1879831465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090007f070 con 0x56284c60ad30 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f08eaffd700 1 -- 172.21.15.12:0/1879831465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f090009deb0 con 0x56284c60ad30 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f092532ab80 1 -- 172.21.15.12:0/1879831465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08fc01e040 con 0x56284c60ad30 2023-12-11T20:20:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f08eaffd700 1 -- 172.21.15.12:0/1879831465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f090009d050 con 0x56284c60ad30 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f092532ab80 10 client.16719 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.804+0000 7f092532ab80 1 -- 172.21.15.12:0/1879831465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56284c3ae250 con 0x56284c60ad30 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f08eaffd700 1 -- 172.21.15.12:0/1879831465 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08fc01e040 con 0x56284c60ad30 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f08eaffd700 1 -- 172.21.15.12:0/1879831465 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0900082030 con 0x56284c60ad30 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f092532ab80 10 client.16719 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f092532ab80 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f092532ab80 20 client.16719 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f092532ab80 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56284c676c90 0x56284c6790b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f092532ab80 4 client.16719 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f092532ab80 1 -- 172.21.15.12:0/1879831465 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56284c524fd0 con 0x56284c676c90 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.805+0000 7f090affd700 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56284c676c90 0x56284c6790b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f090affd700 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56284c676c90 0x56284c6790b0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5c0abc5419ad147 server_cookie=43ea2478f259c23d in_seq=0 out_seq=0 2023-12-11T20:20:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f08eaffd700 10 client.16719 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:10.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f08eaffd700 1 -- 172.21.15.12:0/1879831465 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56284c524fd0 con 0x56284c676c90 2023-12-11T20:20:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f08eaffd700 10 client.16719 handle_command_reply: tid=0 2023-12-11T20:20:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f092532ab80 1 client.16719 shutdown 2023-12-11T20:20:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f092532ab80 1 -- 172.21.15.12:0/1879831465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 msgr2=0x56284c6177d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f092532ab80 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6177d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0900099a60 tx=0x7f09000a1e90 comp rx=0 tx=0).stop 2023-12-11T20:20:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f092532ab80 1 -- 172.21.15.12:0/1879831465 shutdown_connections 2023-12-11T20:20:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.806+0000 7f092532ab80 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56284c676c90 0x56284c6790b0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.807+0000 7f092532ab80 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56284c60a3d0 0x56284c617290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.807+0000 7f092532ab80 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56284c60bc20 0x56284c61a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.807+0000 7f092532ab80 1 --2- 172.21.15.12:0/1879831465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56284c60ad30 0x56284c6177d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.807+0000 7f092532ab80 1 -- 172.21.15.12:0/1879831465 >> 172.21.15.12:0/1879831465 conn(0x56284c5397e0 msgr2=0x56284c613680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.807+0000 7f08eaffd700 0 client.16719 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.807+0000 7f092532ab80 1 -- 172.21.15.12:0/1879831465 shutdown_connections 2023-12-11T20:20:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.807+0000 7f092532ab80 1 -- 172.21.15.12:0/1879831465 wait complete. 2023-12-11T20:20:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.807+0000 7f092532ab80 20 client.16719 trim_cache size 0 max 16384 2023-12-11T20:20:10.811 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 -- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f08f40a1500 msgr2=0x7f08f40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f08f40a1500 0x7f08f40a39c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x56284c60b400 tx=0x7f090400b040 comp rx=0 tx=0).stop 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 -- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1026a0 msgr2=0x7f090c199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1026a0 0x7f090c199ae0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f090000d950 tx=0x7f090000dc60 comp rx=0 tx=0).stop 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 -- 172.21.15.12:0/3861870156 shutdown_connections 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f08f40a1500 0x7f08f40a39c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f090c1014b0 0x7f090c1995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f090c103040 0x7f090c1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 --2- 172.21.15.12:0/3861870156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f090c1026a0 0x7f090c199ae0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:10.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 -- 172.21.15.12:0/3861870156 >> 172.21.15.12:0/3861870156 conn(0x7f090c0fca00 msgr2=0x7f090c107f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:10.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 -- 172.21.15.12:0/3861870156 shutdown_connections 2023-12-11T20:20:10.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:10.808+0000 7f09119ff700 1 -- 172.21.15.12:0/3861870156 wait complete. 2023-12-11T20:20:11.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:11 smithi032 ceph-mon[132488]: pgmap v503: 97 pgs: 97 active+clean; 2.4 GiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:20:11.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:11 smithi039 ceph-mon[102205]: pgmap v503: 97 pgs: 97 active+clean; 2.4 GiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:20:11.828 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:20:11.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:20:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:11 smithi012 ceph-mon[128787]: pgmap v503: 97 pgs: 97 active+clean; 2.4 GiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 -- 172.21.15.12:0/4047456162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 msgr2=0x7f74c4106d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 --2- 172.21.15.12:0/4047456162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 0x7f74c4106d00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009990 tx=0x7f74b4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 -- 172.21.15.12:0/4047456162 shutdown_connections 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 --2- 172.21.15.12:0/4047456162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74c4107240 0x7f74c4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 --2- 172.21.15.12:0/4047456162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74c4101fe0 0x7f74c41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 --2- 172.21.15.12:0/4047456162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 0x7f74c4106d00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 -- 172.21.15.12:0/4047456162 >> 172.21.15.12:0/4047456162 conn(0x7f74c40fb930 msgr2=0x7f74c40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 -- 172.21.15.12:0/4047456162 shutdown_connections 2023-12-11T20:20:12.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.068+0000 7f74cbfff700 1 -- 172.21.15.12:0/4047456162 wait complete. 2023-12-11T20:20:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74cbfff700 1 Processor -- start 2023-12-11T20:20:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74cbfff700 1 -- start start 2023-12-11T20:20:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74c4101fe0 0x7f74c4101900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 0x7f74c40fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74c4107240 0x7f74c41004d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74cbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4100c70 con 0x7f74c4104910 2023-12-11T20:20:12.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74cbfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4100de0 con 0x7f74c4101fe0 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74cbfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c41a13a0 con 0x7f74c4107240 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74c959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 0x7f74c40fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74c959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 0x7f74c40fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34512/0 (socket says 172.21.15.12:34512) 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74c959a700 1 -- 172.21.15.12:0/2724292277 learned_addr learned my addr 172.21.15.12:0/2724292277 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.070+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74c4101fe0 0x7f74c4101900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74ca59c700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74c4107240 0x7f74c41004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74c959a700 1 -- 172.21.15.12:0/2724292277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74c4107240 msgr2=0x7f74c41004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74c959a700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74c4107240 0x7f74c41004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74c959a700 1 -- 172.21.15.12:0/2724292277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74c4101fe0 msgr2=0x7f74c4101900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74c959a700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74c4101fe0 0x7f74c4101900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74c959a700 1 -- 172.21.15.12:0/2724292277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b40095f0 con 0x7f74c4104910 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74c4101fe0 0x7f74c4101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:12.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74c959a700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 0x7f74c40fff90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f74b4005740 tx=0x7f74b4005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.071+0000 7f74baffd700 1 -- 172.21.15.12:0/2724292277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b401d070 con 0x7f74c4104910 2023-12-11T20:20:12.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.072+0000 7f74baffd700 1 -- 172.21.15.12:0/2724292277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74b400beb0 con 0x7f74c4104910 2023-12-11T20:20:12.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.072+0000 7f74cbfff700 1 -- 172.21.15.12:0/2724292277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c41a15d0 con 0x7f74c4104910 2023-12-11T20:20:12.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.072+0000 7f74baffd700 1 -- 172.21.15.12:0/2724292277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4021410 con 0x7f74c4104910 2023-12-11T20:20:12.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.072+0000 7f74cbfff700 1 -- 172.21.15.12:0/2724292277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c41a19f0 con 0x7f74c4104910 2023-12-11T20:20:12.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.075+0000 7f74baffd700 1 -- 172.21.15.12:0/2724292277 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f74b400f720 con 0x7f74c4104910 2023-12-11T20:20:12.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.076+0000 7f74df871b80 1 Processor -- start 2023-12-11T20:20:12.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.076+0000 7f74df871b80 1 -- start start 2023-12-11T20:20:12.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74df871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9519870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74df871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c951a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74df871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c951b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74df871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c9474bd0 con 0x5598c9519450 2023-12-11T20:20:12.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74df871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c94724f0 con 0x5598c9519db0 2023-12-11T20:20:12.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74df871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c946dde0 con 0x5598c951aca0 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74ca59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9519870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74baffd700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74b00a1500 0x7f74b00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74ca59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9519870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34526/0 (socket says 172.21.15.12:34526) 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.077+0000 7f74ca59c700 1 -- 172.21.15.12:0/590712692 learned_addr learned my addr 172.21.15.12:0/590712692 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74baffd700 1 -- 172.21.15.12:0/2724292277 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f74b40ce0c0 con 0x7f74c4104910 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c959a700 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c951b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74ca59c700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74b00a1500 0x7f74b00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c951a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c959a700 1 -- 172.21.15.12:0/590712692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 msgr2=0x5598c951a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c959a700 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c951a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c959a700 1 -- 172.21.15.12:0/590712692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 msgr2=0x5598c9519870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c959a700 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9519870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c959a700 1 -- 172.21.15.12:0/590712692 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598c92ea6b0 con 0x5598c951aca0 2023-12-11T20:20:12.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74ca59c700 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9519870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:12.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c951a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:12.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.078+0000 7f74c959a700 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c951b120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f74b40cbb70 tx=0x7f74b409b1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b68672c98f9d1329 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74affff700 1 -- 172.21.15.12:0/590712692 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b409bb20 con 0x5598c951aca0 2023-12-11T20:20:12.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74affff700 1 -- 172.21.15.12:0/590712692 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74b409b420 con 0x5598c951aca0 2023-12-11T20:20:12.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74affff700 1 -- 172.21.15.12:0/590712692 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b409f160 con 0x5598c951aca0 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74df871b80 1 -- 172.21.15.12:0/590712692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 msgr2=0x5598c951b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74df871b80 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c951b120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f74b40cbb70 tx=0x7f74b409b1f0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74ca59c700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74b00a1500 0x7f74b00a39c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009fd0 tx=0x7f74bc004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74df871b80 1 -- 172.21.15.12:0/590712692 shutdown_connections 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74df871b80 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c951b120 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74df871b80 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9519870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74df871b80 1 --2- 172.21.15.12:0/590712692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c951a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.079+0000 7f74df871b80 1 -- 172.21.15.12:0/590712692 >> 172.21.15.12:0/590712692 conn(0x5598c9448860 msgr2=0x5598c9515e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.080+0000 7f74df871b80 1 -- 172.21.15.12:0/590712692 shutdown_connections 2023-12-11T20:20:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.080+0000 7f74df871b80 1 -- 172.21.15.12:0/590712692 wait complete. 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.080+0000 7f74df871b80 1 -- start start 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.080+0000 7f74df871b80 1 Processor -- start 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74df871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9522f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74df871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9523470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74df871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c952a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74df871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c94275e0 con 0x5598c9519450 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74df871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c9427280 con 0x5598c9519db0 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74df871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c92ec9a0 con 0x5598c951aca0 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74df871b80 10 client.0 _ll_register_callbacks cb 0x5598c9352b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74c9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9522f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74c9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9522f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34540/0 (socket says 172.21.15.12:34540) 2023-12-11T20:20:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74c9d9b700 1 -- 172.21.15.12:0/970973541 learned_addr learned my addr 172.21.15.12:0/970973541 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.081+0000 7f74c959a700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9523470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74ca59c700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c952a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74c9d9b700 1 -- 172.21.15.12:0/970973541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 msgr2=0x5598c952a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c952a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74c9d9b700 1 -- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 msgr2=0x5598c9523470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9523470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74c9d9b700 1 -- 172.21.15.12:0/970973541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc007600 con 0x5598c9519450 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74ca59c700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c952a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74c959a700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9523470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9522f30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f74c0013d30 tx=0x7f74c00116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f87e654a83ed23 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74ad7fa700 1 -- 172.21.15.12:0/970973541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0009e70 con 0x5598c9519450 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74ad7fa700 1 -- 172.21.15.12:0/970973541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f74c001b430 con 0x5598c9519450 2023-12-11T20:20:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.082+0000 7f74df871b80 1 -- 172.21.15.12:0/970973541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598c950cbc0 con 0x5598c9519450 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74ad7fa700 1 -- 172.21.15.12:0/970973541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74c001b5f0 con 0x5598c9519450 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74df871b80 10 client.16731 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74df871b80 1 -- 172.21.15.12:0/970973541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f74c41a19f0 con 0x5598c9519450 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74ad7fa700 1 -- 172.21.15.12:0/970973541 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74c002a080 con 0x5598c9519450 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74ad7fa700 1 -- 172.21.15.12:0/970973541 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f74c0025470 con 0x5598c9519450 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74df871b80 10 client.16731 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74df871b80 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74df871b80 20 client.16731 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74df871b80 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5598c952ec70 0x5598c9531090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74df871b80 4 client.16731 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.083+0000 7f74df871b80 1 -- 172.21.15.12:0/970973541 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598c94e8fc0 con 0x5598c952ec70 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.084+0000 7f74c959a700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5598c952ec70 0x5598c9531090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.084+0000 7f74c959a700 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5598c952ec70 0x5598c9531090 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca2b914abbf47ee6 server_cookie=a8b437d1fcab52f1 in_seq=0 out_seq=0 2023-12-11T20:20:12.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.084+0000 7f74ad7fa700 10 client.16731 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:12.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74ad7fa700 1 -- 172.21.15.12:0/970973541 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5598c94e8fc0 con 0x5598c952ec70 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74ad7fa700 10 client.16731 handle_command_reply: tid=0 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 client.16731 shutdown 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 -- 172.21.15.12:0/970973541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 msgr2=0x5598c9522f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9522f30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f74c0013d30 tx=0x7f74c00116c0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 -- 172.21.15.12:0/970973541 shutdown_connections 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5598c952ec70 0x5598c9531090 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c952a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9522f30 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74ad7fa700 0 client.16731 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 --2- 172.21.15.12:0/970973541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9523470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 -- 172.21.15.12:0/970973541 >> 172.21.15.12:0/970973541 conn(0x5598c9448860 msgr2=0x5598c9514ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 -- 172.21.15.12:0/970973541 shutdown_connections 2023-12-11T20:20:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.085+0000 7f74df871b80 1 -- 172.21.15.12:0/970973541 wait complete. 2023-12-11T20:20:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.086+0000 7f74df871b80 20 client.16731 trim_cache size 0 max 16384 2023-12-11T20:20:12.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74df871b80 1 Processor -- start 2023-12-11T20:20:12.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74df871b80 1 -- start start 2023-12-11T20:20:12.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74df871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c9519450 0x5598c9522ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74df871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c952a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74df871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c951aca0 0x5598c9523220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74df871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c9510bd0 con 0x5598c951aca0 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74df871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c951a190 con 0x5598c9519db0 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74df871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c95362a0 con 0x5598c9519450 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74c9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c9519450 0x5598c9522ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74ca59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c951aca0 0x5598c9523220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74c959a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c952a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74c9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c9519450 0x5598c9522ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:39628/0 (socket says 172.21.15.12:39628) 2023-12-11T20:20:12.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.104+0000 7f74c9d9b700 1 -- 172.21.15.12:0/4200644399 learned_addr learned my addr 172.21.15.12:0/4200644399 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74c9d9b700 1 -- 172.21.15.12:0/4200644399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 msgr2=0x5598c952a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/4200644399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c952a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74c9d9b700 1 -- 172.21.15.12:0/4200644399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c951aca0 msgr2=0x5598c9523220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/4200644399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c951aca0 0x5598c9523220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74c9d9b700 1 -- 172.21.15.12:0/4200644399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598c9296e60 con 0x5598c9519450 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/4200644399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c9519450 0x5598c9522ce0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f74c0025820 tx=0x7f74c0005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8567ec453df3ef54 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74b8ff9700 1 -- 172.21.15.12:0/4200644399 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c002d070 con 0x5598c9519450 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74b8ff9700 1 -- 172.21.15.12:0/4200644399 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598c950cbc0 con 0x5598c9519450 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.105+0000 7f74b8ff9700 1 -- 172.21.15.12:0/4200644399 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c00050c0 con 0x5598c9519450 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.106+0000 7f74df871b80 1 -- 172.21.15.12:0/4200644399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c9519450 msgr2=0x5598c9522ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.106+0000 7f74df871b80 1 --2- 172.21.15.12:0/4200644399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c9519450 0x5598c9522ce0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f74c0025820 tx=0x7f74c0005ce0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.106+0000 7f74df871b80 1 -- 172.21.15.12:0/4200644399 shutdown_connections 2023-12-11T20:20:12.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.106+0000 7f74df871b80 1 --2- 172.21.15.12:0/4200644399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c951aca0 0x5598c9523220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.106+0000 7f74df871b80 1 --2- 172.21.15.12:0/4200644399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c9519450 0x5598c9522ce0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.106+0000 7f74df871b80 1 --2- 172.21.15.12:0/4200644399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c952a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.106+0000 7f74df871b80 1 -- 172.21.15.12:0/4200644399 >> 172.21.15.12:0/4200644399 conn(0x5598c9448860 msgr2=0x5598c951dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.107+0000 7f74df871b80 1 -- 172.21.15.12:0/4200644399 shutdown_connections 2023-12-11T20:20:12.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.107+0000 7f74df871b80 1 -- 172.21.15.12:0/4200644399 wait complete. 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.107+0000 7f74df871b80 1 -- start start 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.107+0000 7f74df871b80 1 Processor -- start 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74df871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9529620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74df871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9529b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74df871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c9585210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74df871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c9585750 con 0x5598c9519450 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74df871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c9585890 con 0x5598c9519db0 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74df871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c9585a50 con 0x5598c951aca0 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74df871b80 10 client.0 _ll_register_callbacks cb 0x5598c9352b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74c9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9529620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74c959a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9529b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74ca59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c9585210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74c959a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9529b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40650/0 (socket says 172.21.15.12:40650) 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.108+0000 7f74c959a700 1 -- 172.21.15.12:0/2574998002 learned_addr learned my addr 172.21.15.12:0/2574998002 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74ca59c700 1 -- 172.21.15.12:0/2574998002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 msgr2=0x5598c9529b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74ca59c700 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9529b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74ca59c700 1 -- 172.21.15.12:0/2574998002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 msgr2=0x5598c9529620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74ca59c700 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9529620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74ca59c700 1 -- 172.21.15.12:0/2574998002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c41a19f0 con 0x5598c951aca0 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9529620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74ca59c700 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c9585210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009690 tx=0x7f74bc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77dc2ba44ffb8e3e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74ad7fa700 1 -- 172.21.15.12:0/2574998002 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc019af0 con 0x5598c951aca0 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.109+0000 7f74df871b80 1 -- 172.21.15.12:0/2574998002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74b409b420 con 0x5598c951aca0 2023-12-11T20:20:12.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74ad7fa700 1 -- 172.21.15.12:0/2574998002 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f74bc019c50 con 0x5598c951aca0 2023-12-11T20:20:12.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74ad7fa700 1 -- 172.21.15.12:0/2574998002 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74bc019e10 con 0x5598c951aca0 2023-12-11T20:20:12.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74df871b80 10 client.26452 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:12.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74df871b80 1 -- 172.21.15.12:0/2574998002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5598c927fce0 con 0x5598c951aca0 2023-12-11T20:20:12.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74ad7fa700 1 -- 172.21.15.12:0/2574998002 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74b409b420 con 0x5598c951aca0 2023-12-11T20:20:12.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74ad7fa700 1 -- 172.21.15.12:0/2574998002 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f74bc024070 con 0x5598c951aca0 2023-12-11T20:20:12.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74df871b80 10 client.26452 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:12.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74df871b80 10 client.26452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:12.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74df871b80 20 client.26452 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74df871b80 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5598c9587570 0x5598c9589990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74df871b80 4 client.26452 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.110+0000 7f74df871b80 1 -- 172.21.15.12:0/2574998002 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5598c9434050 con 0x5598c9587570 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.111+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5598c9587570 0x5598c9589990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.111+0000 7f74c9d9b700 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5598c9587570 0x5598c9589990 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4f3637e1a4a37e server_cookie=3fba5bbdc8d18397 in_seq=0 out_seq=0 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.111+0000 7f74ad7fa700 10 client.26452 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.112+0000 7f74ad7fa700 1 -- 172.21.15.12:0/2574998002 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5598c9434050 con 0x5598c9587570 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.112+0000 7f74ad7fa700 10 client.26452 handle_command_reply: tid=0 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.112+0000 7f74df871b80 1 client.26452 shutdown 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 -- 172.21.15.12:0/2574998002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 msgr2=0x5598c9585210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c9585210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009690 tx=0x7f74bc004ad0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 -- 172.21.15.12:0/2574998002 shutdown_connections 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5598c9587570 0x5598c9589990 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5598c951aca0 0x5598c9585210 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c9519450 0x5598c9529620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 --2- 172.21.15.12:0/2574998002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5598c9519db0 0x5598c9529b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74ad7fa700 0 client.26452 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 -- 172.21.15.12:0/2574998002 >> 172.21.15.12:0/2574998002 conn(0x5598c9448860 msgr2=0x5598c9522ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 -- 172.21.15.12:0/2574998002 shutdown_connections 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 1 -- 172.21.15.12:0/2574998002 wait complete. 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.113+0000 7f74df871b80 20 client.26452 trim_cache size 0 max 16384 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:20:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "c1c551d8-d29c-4fca-a09f-c52583a906cd", 2023-12-11T20:20:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:20:12.115 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:20:12.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 -- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74b00a1500 msgr2=0x7f74b00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74b00a1500 0x7f74b00a39c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009fd0 tx=0x7f74bc004b40 comp rx=0 tx=0).stop 2023-12-11T20:20:12.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 -- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 msgr2=0x7f74c40fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 0x7f74c40fff90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f74b4005740 tx=0x7f74b4005770 comp rx=0 tx=0).stop 2023-12-11T20:20:12.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 -- 172.21.15.12:0/2724292277 shutdown_connections 2023-12-11T20:20:12.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74b00a1500 0x7f74b00a39c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74c4101fe0 0x7f74c4101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74c4107240 0x7f74c41004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 --2- 172.21.15.12:0/2724292277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4104910 0x7f74c40fff90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 -- 172.21.15.12:0/2724292277 >> 172.21.15.12:0/2724292277 conn(0x7f74c40fb930 msgr2=0x7f74c4103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 -- 172.21.15.12:0/2724292277 shutdown_connections 2023-12-11T20:20:12.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.114+0000 7f74cbfff700 1 -- 172.21.15.12:0/2724292277 wait complete. 2023-12-11T20:20:12.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:20:12.213 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:20:12.124+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v114>,<0x10000000003/client.0 v116>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v133>,<0x10000000001/sv_0 v157>,<0x10000000000/_nogroup v141>,<0x1/volumes v133>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.386+0000 7f15353ff700 1 -- 172.21.15.12:0/3019826229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15301093e0 msgr2=0x7f153010b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.386+0000 7f15353ff700 1 --2- 172.21.15.12:0/3019826229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15301093e0 0x7f153010b870 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f152800b0a0 tx=0x7f152800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.386+0000 7f15353ff700 1 -- 172.21.15.12:0/3019826229 shutdown_connections 2023-12-11T20:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.386+0000 7f15353ff700 1 --2- 172.21.15.12:0/3019826229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15301093e0 0x7f153010b870 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.386+0000 7f15353ff700 1 --2- 172.21.15.12:0/3019826229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1530075590 0x7f15300739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.386+0000 7f15353ff700 1 --2- 172.21.15.12:0/3019826229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1530073fb0 0x7f1530074430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.386+0000 7f15353ff700 1 -- 172.21.15.12:0/3019826229 >> 172.21.15.12:0/3019826229 conn(0x7f15300fca60 msgr2=0x7f15300feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.387+0000 7f15353ff700 1 -- 172.21.15.12:0/3019826229 shutdown_connections 2023-12-11T20:20:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.387+0000 7f15353ff700 1 -- 172.21.15.12:0/3019826229 wait complete. 2023-12-11T20:20:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.388+0000 7f15353ff700 1 Processor -- start 2023-12-11T20:20:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.388+0000 7f15353ff700 1 -- start start 2023-12-11T20:20:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.388+0000 7f15353ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1530073fb0 0x7f15301995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.388+0000 7f15353ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1530075590 0x7f1530199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.388+0000 7f15353ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15301093e0 0x7f15301a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.388+0000 7f15353ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301a1100 con 0x7f1530073fb0 2023-12-11T20:20:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.388+0000 7f15353ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301a1240 con 0x7f1530075590 2023-12-11T20:20:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.388+0000 7f15353ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301a13d0 con 0x7f15301093e0 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1530073fb0 0x7f15301995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1530075590 0x7f1530199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1530073fb0 0x7f15301995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34584/0 (socket says 172.21.15.12:34584) 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 -- 172.21.15.12:0/1913057869 learned_addr learned my addr 172.21.15.12:0/1913057869 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152f7fe700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15301093e0 0x7f15301a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 -- 172.21.15.12:0/1913057869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15301093e0 msgr2=0x7f15301a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15301093e0 0x7f15301a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 -- 172.21.15.12:0/1913057869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1530075590 msgr2=0x7f1530199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1530075590 0x7f1530199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 -- 172.21.15.12:0/1913057869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528009d00 con 0x7f1530073fb0 2023-12-11T20:20:12.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.389+0000 7f152effd700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1530073fb0 0x7f15301995d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f152000e9a0 tx=0x7f152000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.390+0000 7f1517fff700 1 -- 172.21.15.12:0/1913057869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520009790 con 0x7f1530073fb0 2023-12-11T20:20:12.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.390+0000 7f1517fff700 1 -- 172.21.15.12:0/1913057869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1520010430 con 0x7f1530073fb0 2023-12-11T20:20:12.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.390+0000 7f15353ff700 1 -- 172.21.15.12:0/1913057869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15301a16b0 con 0x7f1530073fb0 2023-12-11T20:20:12.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.390+0000 7f1517fff700 1 -- 172.21.15.12:0/1913057869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152000cea0 con 0x7f1530073fb0 2023-12-11T20:20:12.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.390+0000 7f15353ff700 1 -- 172.21.15.12:0/1913057869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15301a1bc0 con 0x7f1530073fb0 2023-12-11T20:20:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.394+0000 7f1517fff700 1 -- 172.21.15.12:0/1913057869 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f15200105a0 con 0x7f1530073fb0 2023-12-11T20:20:12.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.395+0000 7f1517fff700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15180a1480 0x7f15180a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.395+0000 7f1517fff700 1 -- 172.21.15.12:0/1913057869 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1520014070 con 0x7f1530073fb0 2023-12-11T20:20:12.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.395+0000 7f152e7fc700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15180a1480 0x7f15180a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.395+0000 7f1548c6fb80 1 Processor -- start 2023-12-11T20:20:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.396+0000 7f1548c6fb80 1 -- start start 2023-12-11T20:20:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.396+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a53d0 0x558ac83a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.396+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83a6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.396+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a6c20 0x558ac83a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.396+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac8300b50 con 0x558ac83a5d30 2023-12-11T20:20:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.396+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac82fe470 con 0x558ac83a6c20 2023-12-11T20:20:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.396+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac82f9d60 con 0x558ac83a53d0 2023-12-11T20:20:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.396+0000 7f152e7fc700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15180a1480 0x7f15180a3940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1524009c60 tx=0x7f1524009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a53d0 0x558ac83a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a53d0 0x558ac83a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:39670/0 (socket says 172.21.15.12:39670) 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 -- 172.21.15.12:0/4053477424 learned_addr learned my addr 172.21.15.12:0/4053477424 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152f7fe700 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a6c20 0x558ac83a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152e7fc700 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 -- 172.21.15.12:0/4053477424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a6c20 msgr2=0x558ac83a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a6c20 0x558ac83a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 -- 172.21.15.12:0/4053477424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 msgr2=0x558ac83a6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83a6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 -- 172.21.15.12:0/4053477424 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ac8176630 con 0x558ac83a53d0 2023-12-11T20:20:12.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152e7fc700 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:12.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.397+0000 7f152effd700 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a53d0 0x558ac83a57f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f152009a170 tx=0x7f1520099c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e46fb617327defb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.398+0000 7f15157fa700 1 -- 172.21.15.12:0/4053477424 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152009e120 con 0x558ac83a53d0 2023-12-11T20:20:12.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.398+0000 7f15157fa700 1 -- 172.21.15.12:0/4053477424 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f152009a1e0 con 0x558ac83a53d0 2023-12-11T20:20:12.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.398+0000 7f15157fa700 1 -- 172.21.15.12:0/4053477424 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200996d0 con 0x558ac83a53d0 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.398+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4053477424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a53d0 msgr2=0x558ac83a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.398+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a53d0 0x558ac83a57f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f152009a170 tx=0x7f1520099c10 comp rx=0 tx=0).stop 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.399+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4053477424 shutdown_connections 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.399+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a6c20 0x558ac83a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.399+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a53d0 0x558ac83a57f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.399+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4053477424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.399+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4053477424 >> 172.21.15.12:0/4053477424 conn(0x558ac82d47e0 msgr2=0x558ac83a1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.399+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4053477424 shutdown_connections 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.399+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4053477424 wait complete. 2023-12-11T20:20:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.399+0000 7f1548c6fb80 1 -- start start 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.400+0000 7f1548c6fb80 1 Processor -- start 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.400+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.400+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.400+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.400+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac82b3560 con 0x558ac83a5d30 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.400+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac82b3200 con 0x558ac83a53d0 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.400+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac8178920 con 0x558ac83a6c20 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.400+0000 7f1548c6fb80 10 client.0 _ll_register_callbacks cb 0x558ac81dea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40684/0 (socket says 172.21.15.12:40684) 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 -- 172.21.15.12:0/4186287498 learned_addr learned my addr 172.21.15.12:0/4186287498 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152f7fe700 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152e7fc700 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 -- 172.21.15.12:0/4186287498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 msgr2=0x558ac83b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 -- 172.21.15.12:0/4186287498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 msgr2=0x558ac83af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 -- 172.21.15.12:0/4186287498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15301a1bc0 con 0x558ac83a53d0 2023-12-11T20:20:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152e7fc700 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f152effd700 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83af230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1520099ee0 tx=0x7f152009a9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f22340de0c4548 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.401+0000 7f1512ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:20:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1512ff5700 1 -- 172.21.15.12:0/4186287498 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200a22e0 con 0x558ac83a53d0 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1512ff5700 1 -- 172.21.15.12:0/4186287498 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f152009e330 con 0x558ac83a53d0 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4186287498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ac8398b40 con 0x558ac83a53d0 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1512ff5700 1 -- 172.21.15.12:0/4186287498 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15200b8250 con 0x558ac83a53d0 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 10 client.26471 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4186287498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558ac8122de0 con 0x558ac83a53d0 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1512ff5700 1 -- 172.21.15.12:0/4186287498 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558ac8398b40 con 0x558ac83a53d0 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1512ff5700 1 -- 172.21.15.12:0/4186287498 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1520099140 con 0x558ac83a53d0 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 10 client.26471 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 10 client.26471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 20 client.26471 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558ac83bacc0 0x558ac83bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 4 client.26471 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.402+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4186287498 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ac8374f40 con 0x558ac83bacc0 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.403+0000 7f152e7fc700 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558ac83bacc0 0x558ac83bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.404+0000 7f152e7fc700 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558ac83bacc0 0x558ac83bd0e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e52bb4a59ca7cb server_cookie=a04c502f6319ec33 in_seq=0 out_seq=0 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.404+0000 7f1512ff5700 10 client.26471 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.404+0000 7f1512ff5700 1 -- 172.21.15.12:0/4186287498 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558ac8374f40 con 0x558ac83bacc0 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.404+0000 7f1512ff5700 10 client.26471 handle_command_reply: tid=0 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.404+0000 7f1548c6fb80 1 client.26471 shutdown 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4186287498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 msgr2=0x558ac83af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83af230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1520099ee0 tx=0x7f152009a9a0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4186287498 shutdown_connections 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558ac83bacc0 0x558ac83bd0e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83af230 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/4186287498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a5d30 0x558ac83af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1512ff5700 0 client.26471 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4186287498 >> 172.21.15.12:0/4186287498 conn(0x558ac82d47e0 msgr2=0x558ac83a0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4186287498 shutdown_connections 2023-12-11T20:20:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 1 -- 172.21.15.12:0/4186287498 wait complete. 2023-12-11T20:20:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.405+0000 7f1548c6fb80 20 client.26471 trim_cache size 0 max 16384 2023-12-11T20:20:12.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.429+0000 7f1548c6fb80 1 Processor -- start 2023-12-11T20:20:12.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f1548c6fb80 1 -- start start 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a53d0 0x558ac83ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a5d30 0x558ac83b6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83a7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac83988d0 con 0x558ac83a53d0 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac83c22f0 con 0x558ac83a5d30 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac839cb50 con 0x558ac83a6c20 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f152f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f152effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a53d0 0x558ac83ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.430+0000 7f152f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83a7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:39698/0 (socket says 172.21.15.12:39698) 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152f7fe700 1 -- 172.21.15.12:0/3613113198 learned_addr learned my addr 172.21.15.12:0/3613113198 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152e7fc700 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a5d30 0x558ac83b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152f7fe700 1 -- 172.21.15.12:0/3613113198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a5d30 msgr2=0x558ac83b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152f7fe700 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a5d30 0x558ac83b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152f7fe700 1 -- 172.21.15.12:0/3613113198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a53d0 msgr2=0x558ac83ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152f7fe700 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a53d0 0x558ac83ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152f7fe700 1 -- 172.21.15.12:0/3613113198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ac810bc60 con 0x558ac83a6c20 2023-12-11T20:20:12.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152e7fc700 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a5d30 0x558ac83b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:12.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152effd700 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a53d0 0x558ac83ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:12.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.431+0000 7f152f7fe700 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83a7000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f152800b0a0 tx=0x7f15280095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6df007451b1c21f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.432+0000 7f1515ffb700 1 -- 172.21.15.12:0/3613113198 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152800e040 con 0x558ac83a6c20 2023-12-11T20:20:12.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.432+0000 7f1515ffb700 1 -- 172.21.15.12:0/3613113198 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1528022070 con 0x558ac83a6c20 2023-12-11T20:20:12.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.432+0000 7f1515ffb700 1 -- 172.21.15.12:0/3613113198 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528003d70 con 0x558ac83a6c20 2023-12-11T20:20:12.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3613113198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 msgr2=0x558ac83a7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83a7000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f152800b0a0 tx=0x7f15280095a0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3613113198 shutdown_connections 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a6c20 0x558ac83a7000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a53d0 0x558ac83ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3613113198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a5d30 0x558ac83b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3613113198 >> 172.21.15.12:0/3613113198 conn(0x558ac82d47e0 msgr2=0x558ac83ad250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3613113198 shutdown_connections 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3613113198 wait complete. 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.433+0000 7f1548c6fb80 1 -- start start 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.434+0000 7f1548c6fb80 1 Processor -- start 2023-12-11T20:20:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.434+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.434+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a5d30 0x558ac83b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f1548c6fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a6c20 0x558ac83b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac83b5f50 con 0x558ac83a6c20 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac83b60c0 con 0x558ac83a53d0 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f1548c6fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ac83b6280 con 0x558ac83a5d30 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f1548c6fb80 10 client.0 _ll_register_callbacks cb 0x558ac81dea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a6c20 0x558ac83b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40704/0 (socket says 172.21.15.12:40704) 2023-12-11T20:20:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152effd700 1 -- 172.21.15.12:0/3319716940 learned_addr learned my addr 172.21.15.12:0/3319716940 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152e7fc700 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a5d30 0x558ac83b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152effd700 1 -- 172.21.15.12:0/3319716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a5d30 msgr2=0x558ac83b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152effd700 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a5d30 0x558ac83b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152effd700 1 -- 172.21.15.12:0/3319716940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a6c20 msgr2=0x558ac83b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152effd700 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a6c20 0x558ac83b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152effd700 1 -- 172.21.15.12:0/3319716940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ac8122de0 con 0x558ac83a53d0 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.435+0000 7f152f7fe700 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a6c20 0x558ac83b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.436+0000 7f152effd700 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83b24b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f15200966e0 tx=0x7f15200b8480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6048be6f12568d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.436+0000 7f1512ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.436+0000 7f1512ff5700 1 -- 172.21.15.12:0/3319716940 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520099b40 con 0x558ac83a53d0 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.436+0000 7f1512ff5700 1 -- 172.21.15.12:0/3319716940 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15200a2570 con 0x558ac83a53d0 2023-12-11T20:20:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.436+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3319716940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f152009a1e0 con 0x558ac83a53d0 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.436+0000 7f1512ff5700 1 -- 172.21.15.12:0/3319716940 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f152009e120 con 0x558ac83a53d0 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.436+0000 7f1548c6fb80 10 client.26477 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.436+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3319716940 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f1524017070 con 0x558ac83a53d0 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f1512ff5700 1 -- 172.21.15.12:0/3319716940 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f152009a1e0 con 0x558ac83a53d0 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f1512ff5700 1 -- 172.21.15.12:0/3319716940 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f15200830d0 con 0x558ac83a53d0 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f1548c6fb80 10 client.26477 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f1548c6fb80 10 client.26477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f1548c6fb80 20 client.26477 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558ac841a4b0 0x558ac841c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f1548c6fb80 4 client.26477 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:20:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3319716940 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558ac82bffd0 con 0x558ac841a4b0 2023-12-11T20:20:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.437+0000 7f152e7fc700 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558ac841a4b0 0x558ac841c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.438+0000 7f152e7fc700 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558ac841a4b0 0x558ac841c8d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee2c8a89a3efac9 server_cookie=142680f2871db3eb in_seq=0 out_seq=0 2023-12-11T20:20:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.438+0000 7f1512ff5700 10 client.26477 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.438+0000 7f1512ff5700 1 -- 172.21.15.12:0/3319716940 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558ac82bffd0 con 0x558ac841a4b0 2023-12-11T20:20:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.438+0000 7f1512ff5700 10 client.26477 handle_command_reply: tid=0 2023-12-11T20:20:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.438+0000 7f1548c6fb80 1 client.26477 shutdown 2023-12-11T20:20:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.438+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3319716940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 msgr2=0x558ac83b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.438+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83b24b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f15200966e0 tx=0x7f15200b8480 comp rx=0 tx=0).stop 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3319716940 shutdown_connections 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558ac841a4b0 0x558ac841c8d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558ac83a53d0 0x558ac83b24b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558ac83a6c20 0x558ac83b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1512ff5700 0 client.26477 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 1 --2- 172.21.15.12:0/3319716940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558ac83a5d30 0x558ac83b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3319716940 >> 172.21.15.12:0/3319716940 conn(0x558ac82d47e0 msgr2=0x558ac83a1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3319716940 shutdown_connections 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 1 -- 172.21.15.12:0/3319716940 wait complete. 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.439+0000 7f1548c6fb80 20 client.26477 trim_cache size 0 max 16384 2023-12-11T20:20:12.441 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "c1c551d8-d29c-4fca-a09f-c52583a906cd": { 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "c1c551d8-d29c-4fca-a09f-c52583a906cd", 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:20:12.442 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:20:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 -- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15180a1480 msgr2=0x7f15180a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15180a1480 0x7f15180a3940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1524009c60 tx=0x7f1524009260 comp rx=0 tx=0).stop 2023-12-11T20:20:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 -- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1530073fb0 msgr2=0x7f15301995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1530073fb0 0x7f15301995d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f152000e9a0 tx=0x7f152000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 -- 172.21.15.12:0/1913057869 shutdown_connections 2023-12-11T20:20:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f15180a1480 0x7f15180a3940 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15301093e0 0x7f15301a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1530073fb0 0x7f15301995d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 --2- 172.21.15.12:0/1913057869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1530075590 0x7f1530199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 -- 172.21.15.12:0/1913057869 >> 172.21.15.12:0/1913057869 conn(0x7f15300fca60 msgr2=0x7f1530105330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 -- 172.21.15.12:0/1913057869 shutdown_connections 2023-12-11T20:20:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:12.440+0000 7f15353ff700 1 -- 172.21.15.12:0/1913057869 wait complete. 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:12.461 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:12 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.463 INFO:tasks.cephfs.filesystem:scrub status for tag:c1c551d8-d29c-4fca-a09f-c52583a906cd - {'path': '/', 'tag': 'c1c551d8-d29c-4fca-a09f-c52583a906cd', 'options': 'recursive,force'} 2023-12-11T20:20:12.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:12 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:20:12.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:20:12.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:12.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:20:12.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:12.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:12.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:12.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:12 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:20:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:20:13.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:20:13.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:13 smithi032 ceph-mon[132488]: pgmap v504: 97 pgs: 97 active+clean; 2.5 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:20:13.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:13.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:13.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:13.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:13.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:20:13.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:20:13.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:20:13.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:13 smithi039 ceph-mon[102205]: pgmap v504: 97 pgs: 97 active+clean; 2.5 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:20:13.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:13.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:13.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:13.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:13.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:13.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:20:13.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:20:13.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:20:13.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:13 smithi012 ceph-mon[128787]: pgmap v504: 97 pgs: 97 active+clean; 2.5 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:20:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:15 smithi039 ceph-mon[102205]: pgmap v505: 97 pgs: 97 active+clean; 2.5 GiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 23 op/s 2023-12-11T20:20:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:15 smithi012 ceph-mon[128787]: pgmap v505: 97 pgs: 97 active+clean; 2.5 GiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 23 op/s 2023-12-11T20:20:15.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:15 smithi032 ceph-mon[132488]: pgmap v505: 97 pgs: 97 active+clean; 2.5 GiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 23 op/s 2023-12-11T20:20:17.554 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:17 smithi039 ceph-mon[102205]: pgmap v506: 97 pgs: 97 active+clean; 2.5 GiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:20:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:17 smithi012 ceph-mon[128787]: pgmap v506: 97 pgs: 97 active+clean; 2.5 GiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:20:17.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:17 smithi032 ceph-mon[132488]: pgmap v506: 97 pgs: 97 active+clean; 2.5 GiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:20:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:19 smithi032 ceph-mon[132488]: pgmap v507: 97 pgs: 97 active+clean; 2.5 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:20:19.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:19 smithi039 ceph-mon[102205]: pgmap v507: 97 pgs: 97 active+clean; 2.5 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:20:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:19 smithi012 ceph-mon[128787]: pgmap v507: 97 pgs: 97 active+clean; 2.5 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:20:21.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:21 smithi039 ceph-mon[102205]: pgmap v508: 97 pgs: 97 active+clean; 2.6 GiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:20:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:21 smithi012 ceph-mon[128787]: pgmap v508: 97 pgs: 97 active+clean; 2.6 GiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:20:21.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:21 smithi032 ceph-mon[132488]: pgmap v508: 97 pgs: 97 active+clean; 2.6 GiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:20:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 -- 172.21.15.12:0/4224679025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5bc101dd0 msgr2=0x7ff5bc1041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 --2- 172.21.15.12:0/4224679025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5bc101dd0 0x7ff5bc1041c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80098f0 tx=0x7ff5b8009c00 comp rx=0 tx=0).stop 2023-12-11T20:20:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 -- 172.21.15.12:0/4224679025 shutdown_connections 2023-12-11T20:20:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 --2- 172.21.15.12:0/4224679025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5bc101dd0 0x7ff5bc1041c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 --2- 172.21.15.12:0/4224679025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5bc107030 0x7ff5bc109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 --2- 172.21.15.12:0/4224679025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5bc104700 0x7ff5bc106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 -- 172.21.15.12:0/4224679025 >> 172.21.15.12:0/4224679025 conn(0x7ff5bc0fb780 msgr2=0x7ff5bc0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 -- 172.21.15.12:0/4224679025 shutdown_connections 2023-12-11T20:20:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.090+0000 7ff5c219d700 1 -- 172.21.15.12:0/4224679025 wait complete. 2023-12-11T20:20:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.091+0000 7ff5c219d700 1 Processor -- start 2023-12-11T20:20:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.091+0000 7ff5c219d700 1 -- start start 2023-12-11T20:20:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c219d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5bc101dd0 0x7ff5bc1016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c219d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5bc104700 0x7ff5bc0ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c219d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5bc107030 0x7ff5bc1002c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c219d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc19b050 con 0x7ff5bc107030 2023-12-11T20:20:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c219d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc100800 con 0x7ff5bc104700 2023-12-11T20:20:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c219d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc1009c0 con 0x7ff5bc101dd0 2023-12-11T20:20:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5bc101dd0 0x7ff5bc1016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c199c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5bc107030 0x7ff5bc1002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5bc101dd0 0x7ff5bc1016f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46108/0 (socket says 172.21.15.12:46108) 2023-12-11T20:20:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.092+0000 7ff5c119b700 1 -- 172.21.15.12:0/3267705616 learned_addr learned my addr 172.21.15.12:0/3267705616 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.093+0000 7ff5c099a700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5bc104700 0x7ff5bc0ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.093+0000 7ff5c119b700 1 -- 172.21.15.12:0/3267705616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5bc104700 msgr2=0x7ff5bc0ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.093+0000 7ff5c119b700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5bc104700 0x7ff5bc0ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.093+0000 7ff5c119b700 1 -- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5bc107030 msgr2=0x7ff5bc1002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.093+0000 7ff5c119b700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5bc107030 0x7ff5bc1002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.093+0000 7ff5c119b700 1 -- 172.21.15.12:0/3267705616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4009d00 con 0x7ff5bc101dd0 2023-12-11T20:20:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.093+0000 7ff5c119b700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5bc101dd0 0x7ff5bc1016f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009810 tx=0x7ff5b800b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.094+0000 7ff5b27fc700 1 -- 172.21.15.12:0/3267705616 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b801c070 con 0x7ff5bc101dd0 2023-12-11T20:20:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.094+0000 7ff5c219d700 1 -- 172.21.15.12:0/3267705616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b8009520 con 0x7ff5bc101dd0 2023-12-11T20:20:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.094+0000 7ff5b27fc700 1 -- 172.21.15.12:0/3267705616 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b800f7b0 con 0x7ff5bc101dd0 2023-12-11T20:20:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.094+0000 7ff5b27fc700 1 -- 172.21.15.12:0/3267705616 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80038e0 con 0x7ff5bc101dd0 2023-12-11T20:20:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.094+0000 7ff5c219d700 1 -- 172.21.15.12:0/3267705616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc1a5be0 con 0x7ff5bc101dd0 2023-12-11T20:20:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.097+0000 7ff5b27fc700 1 -- 172.21.15.12:0/3267705616 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff5b8020030 con 0x7ff5bc101dd0 2023-12-11T20:20:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.100+0000 7ff5d6caab80 1 Processor -- start 2023-12-11T20:20:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.100+0000 7ff5b27fc700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5a80a1470 0x7ff5a80a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.100+0000 7ff5b27fc700 1 -- 172.21.15.12:0/3267705616 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5b80cde70 con 0x7ff5bc101dd0 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5d6caab80 1 -- start start 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5c199c700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5a80a1470 0x7ff5a80a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd116b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd11b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd11df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd071af0 con 0x5638bd116770 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd06f410 con 0x5638bd1170d0 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd06ad00 con 0x5638bd11bb80 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd116b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd116b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44722/0 (socket says 172.21.15.12:44722) 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.101+0000 7ff5c119b700 1 -- 172.21.15.12:0/757151509 learned_addr learned my addr 172.21.15.12:0/757151509 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c099a700 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd11b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c199c700 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd11df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c119b700 1 -- 172.21.15.12:0/757151509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 msgr2=0x5638bd11df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c119b700 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd11df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c119b700 1 -- 172.21.15.12:0/757151509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 msgr2=0x5638bd11b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c119b700 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd11b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c119b700 1 -- 172.21.15.12:0/757151509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638bcee75d0 con 0x5638bd116770 2023-12-11T20:20:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c199c700 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd11df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c199c700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5a80a1470 0x7ff5a80a3930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009fd0 tx=0x7ff5b400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.102+0000 7ff5c119b700 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd116b90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80a2fa0 tx=0x7ff5b809ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bce0c3cd9ea647 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.103+0000 7ff5a77fe700 1 -- 172.21.15.12:0/757151509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b809f120 con 0x5638bd116770 2023-12-11T20:20:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.103+0000 7ff5a77fe700 1 -- 172.21.15.12:0/757151509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b809b1d0 con 0x5638bd116770 2023-12-11T20:20:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.103+0000 7ff5a77fe700 1 -- 172.21.15.12:0/757151509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8099690 con 0x5638bd116770 2023-12-11T20:20:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 -- 172.21.15.12:0/757151509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 msgr2=0x5638bd116b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd116b90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80a2fa0 tx=0x7ff5b809ad90 comp rx=0 tx=0).stop 2023-12-11T20:20:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 -- 172.21.15.12:0/757151509 shutdown_connections 2023-12-11T20:20:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd11df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd116b90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/757151509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd11b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 -- 172.21.15.12:0/757151509 >> 172.21.15.12:0/757151509 conn(0x5638bd045780 msgr2=0x5638bd112b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 -- 172.21.15.12:0/757151509 shutdown_connections 2023-12-11T20:20:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.104+0000 7ff5d6caab80 1 -- 172.21.15.12:0/757151509 wait complete. 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.105+0000 7ff5d6caab80 1 -- start start 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.105+0000 7ff5d6caab80 1 Processor -- start 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd130b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd1170d0 0x5638bd1310a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd11bb80 0x5638bd1380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd024500 con 0x5638bd1170d0 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd0241a0 con 0x5638bd11bb80 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bcee98c0 con 0x5638bd116770 2023-12-11T20:20:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5d6caab80 10 client.0 _ll_register_callbacks cb 0x5638bcf4fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd130b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46132/0 (socket says 172.21.15.12:46132) 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.106+0000 7ff5c119b700 1 -- 172.21.15.12:0/2379310309 learned_addr learned my addr 172.21.15.12:0/2379310309 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.107+0000 7ff5c099a700 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd1170d0 0x5638bd1310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.107+0000 7ff5c199c700 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd11bb80 0x5638bd1380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.107+0000 7ff5c119b700 1 -- 172.21.15.12:0/2379310309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd11bb80 msgr2=0x5638bd1380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.107+0000 7ff5c119b700 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd11bb80 0x5638bd1380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.107+0000 7ff5c119b700 1 -- 172.21.15.12:0/2379310309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd1170d0 msgr2=0x5638bd1310a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.107+0000 7ff5c119b700 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd1170d0 0x5638bd1310a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.108+0000 7ff5c119b700 1 -- 172.21.15.12:0/2379310309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc1a5be0 con 0x5638bd116770 2023-12-11T20:20:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.108+0000 7ff5c099a700 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd1170d0 0x5638bd1310a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.108+0000 7ff5c119b700 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd130b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800f9d0 tx=0x7ff5b8009470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab0a485d34033e84 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.108+0000 7ff5a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.108+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/2379310309 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8021590 con 0x5638bd116770 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.108+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/2379310309 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5b809f320 con 0x5638bd116770 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.108+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2379310309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638bd109730 con 0x5638bd116770 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/2379310309 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5b807c050 con 0x5638bd116770 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5d6caab80 10 client.26479 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2379310309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5638bce93d80 con 0x5638bd116770 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/2379310309 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5638bd109730 con 0x5638bd116770 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/2379310309 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff5b809a6c0 con 0x5638bd116770 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5d6caab80 10 client.26479 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5d6caab80 10 client.26479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5d6caab80 20 client.26479 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5638bd13c260 0x5638bd13e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5d6caab80 4 client.26479 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.109+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2379310309 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638bd0e5ee0 con 0x5638bd13c260 2023-12-11T20:20:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.110+0000 7ff5c099a700 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5638bd13c260 0x5638bd13e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.110+0000 7ff5c099a700 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5638bd13c260 0x5638bd13e650 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12111977f8fa18df server_cookie=d0355cecfdfd8991 in_seq=0 out_seq=0 2023-12-11T20:20:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.110+0000 7ff5a4ff9700 10 client.26479 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/2379310309 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5638bd0e5ee0 con 0x5638bd13c260 2023-12-11T20:20:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5a4ff9700 10 client.26479 handle_command_reply: tid=0 2023-12-11T20:20:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5d6caab80 1 client.26479 shutdown 2023-12-11T20:20:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2379310309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 msgr2=0x5638bd130b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd130b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800f9d0 tx=0x7ff5b8009470 comp rx=0 tx=0).stop 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2379310309 shutdown_connections 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5638bd13c260 0x5638bd13e650 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd11bb80 0x5638bd1380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd130b60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.111+0000 7ff5a4ff9700 0 client.26479 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.112+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2379310309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd1170d0 0x5638bd1310a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.112+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2379310309 >> 172.21.15.12:0/2379310309 conn(0x5638bd045780 msgr2=0x5638bd113560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.112+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2379310309 shutdown_connections 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.112+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2379310309 wait complete. 2023-12-11T20:20:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.112+0000 7ff5d6caab80 20 client.26479 trim_cache size 0 max 16384 2023-12-11T20:20:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5d6caab80 1 Processor -- start 2023-12-11T20:20:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5d6caab80 1 -- start start 2023-12-11T20:20:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd138790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd1380a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd1174b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd109740 con 0x5638bd116770 2023-12-11T20:20:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd117a20 con 0x5638bd1170d0 2023-12-11T20:20:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd139260 con 0x5638bd11bb80 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.134+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd138790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44734/0 (socket says 172.21.15.12:44734) 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c119b700 1 -- 172.21.15.12:0/2935810082 learned_addr learned my addr 172.21.15.12:0/2935810082 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c199c700 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd1174b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c099a700 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd1380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c119b700 1 -- 172.21.15.12:0/2935810082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 msgr2=0x5638bd1174b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c119b700 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd1174b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c119b700 1 -- 172.21.15.12:0/2935810082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 msgr2=0x5638bd1380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c119b700 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd1380a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c119b700 1 -- 172.21.15.12:0/2935810082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638bce7cc00 con 0x5638bd116770 2023-12-11T20:20:22.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.135+0000 7ff5c119b700 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd138790 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80098c0 tx=0x7ff5b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5648e6b23f5574e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.136+0000 7ff5a7fff700 1 -- 172.21.15.12:0/2935810082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b807c030 con 0x5638bd116770 2023-12-11T20:20:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.136+0000 7ff5a7fff700 1 -- 172.21.15.12:0/2935810082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b8021590 con 0x5638bd116770 2023-12-11T20:20:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.136+0000 7ff5a7fff700 1 -- 172.21.15.12:0/2935810082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b809a6c0 con 0x5638bd116770 2023-12-11T20:20:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.136+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2935810082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 msgr2=0x5638bd138790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.136+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd138790 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80098c0 tx=0x7ff5b8009c00 comp rx=0 tx=0).stop 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2935810082 shutdown_connections 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd11bb80 0x5638bd1174b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd116770 0x5638bd138790 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/2935810082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd1380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2935810082 >> 172.21.15.12:0/2935810082 conn(0x5638bd045780 msgr2=0x5638bd11b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2935810082 shutdown_connections 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 -- 172.21.15.12:0/2935810082 wait complete. 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 -- start start 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.137+0000 7ff5d6caab80 1 Processor -- start 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd135ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd136000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5d6caab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd11bb80 0x5638bd136f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd1374b0 con 0x5638bd11bb80 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd137620 con 0x5638bd1170d0 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5d6caab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bd1377e0 con 0x5638bd116770 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5d6caab80 10 client.0 _ll_register_callbacks cb 0x5638bcf4fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd135ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5c199c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd11bb80 0x5638bd136f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5c119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd135ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46154/0 (socket says 172.21.15.12:46154) 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5c119b700 1 -- 172.21.15.12:0/3487083227 learned_addr learned my addr 172.21.15.12:0/3487083227 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.138+0000 7ff5c099a700 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd136000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5c119b700 1 -- 172.21.15.12:0/3487083227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 msgr2=0x5638bd136000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5c119b700 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd136000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5c119b700 1 -- 172.21.15.12:0/3487083227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd11bb80 msgr2=0x5638bd136f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5c119b700 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd11bb80 0x5638bd136f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5c119b700 1 -- 172.21.15.12:0/3487083227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc1a5be0 con 0x5638bd116770 2023-12-11T20:20:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5c199c700 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd11bb80 0x5638bd136f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5c119b700 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd135ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800f9d0 tx=0x7ff5b8009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dd4a962f226ffde server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/3487083227 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b807c030 con 0x5638bd116770 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/3487083227 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5b809f320 con 0x5638bd116770 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5d6caab80 1 -- 172.21.15.12:0/3487083227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5b809b1d0 con 0x5638bd116770 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/3487083227 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5b809ad10 con 0x5638bd116770 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5d6caab80 10 client.26485 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.139+0000 7ff5d6caab80 1 -- 172.21.15.12:0/3487083227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5638bceba1f0 con 0x5638bd116770 2023-12-11T20:20:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/3487083227 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b809b1d0 con 0x5638bd116770 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/3487083227 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff5b807f020 con 0x5638bd116770 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5d6caab80 10 client.26485 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5d6caab80 10 client.26485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5d6caab80 20 client.26485 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5638bd192bb0 0x5638bd194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5d6caab80 4 client.26485 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5d6caab80 1 -- 172.21.15.12:0/3487083227 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5638bd030f70 con 0x5638bd192bb0 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.140+0000 7ff5c099a700 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5638bd192bb0 0x5638bd194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.141+0000 7ff5c099a700 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5638bd192bb0 0x5638bd194fa0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690f67c3408e7b60 server_cookie=25ff2c4b0f6dd8f4 in_seq=0 out_seq=0 2023-12-11T20:20:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.141+0000 7ff5a4ff9700 10 client.26485 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5a4ff9700 1 -- 172.21.15.12:0/3487083227 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5638bd030f70 con 0x5638bd192bb0 2023-12-11T20:20:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5a4ff9700 10 client.26485 handle_command_reply: tid=0 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 client.26485 shutdown 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 -- 172.21.15.12:0/3487083227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 msgr2=0x5638bd135ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd135ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800f9d0 tx=0x7ff5b8009400 comp rx=0 tx=0).stop 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 -- 172.21.15.12:0/3487083227 shutdown_connections 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5638bd192bb0 0x5638bd194fa0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638bd11bb80 0x5638bd136f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5638bd116770 0x5638bd135ac0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 --2- 172.21.15.12:0/3487083227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5638bd1170d0 0x5638bd136000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5a4ff9700 0 client.26485 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 -- 172.21.15.12:0/3487083227 >> 172.21.15.12:0/3487083227 conn(0x5638bd045780 msgr2=0x5638bd11b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 -- 172.21.15.12:0/3487083227 shutdown_connections 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.151+0000 7ff5d6caab80 1 -- 172.21.15.12:0/3487083227 wait complete. 2023-12-11T20:20:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5d6caab80 20 client.26485 trim_cache size 0 max 16384 2023-12-11T20:20:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:20:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:20:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:20:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 -- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5a80a1470 msgr2=0x7ff5a80a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5a80a1470 0x7ff5a80a3930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009fd0 tx=0x7ff5b400b040 comp rx=0 tx=0).stop 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 -- 172.21.15.12:0/3267705616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5bc101dd0 msgr2=0x7ff5bc1016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5bc101dd0 0x7ff5bc1016f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009810 tx=0x7ff5b800b790 comp rx=0 tx=0).stop 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 -- 172.21.15.12:0/3267705616 shutdown_connections 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5a80a1470 0x7ff5a80a3930 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5bc107030 0x7ff5bc1002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5bc101dd0 0x7ff5bc1016f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 --2- 172.21.15.12:0/3267705616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5bc104700 0x7ff5bc0ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.152+0000 7ff5c219d700 1 -- 172.21.15.12:0/3267705616 >> 172.21.15.12:0/3267705616 conn(0x7ff5bc0fb780 msgr2=0x7ff5bc102730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.153+0000 7ff5c219d700 1 -- 172.21.15.12:0/3267705616 shutdown_connections 2023-12-11T20:20:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:22.153+0000 7ff5c219d700 1 -- 172.21.15.12:0/3267705616 wait complete. 2023-12-11T20:20:23.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:23 smithi039 ceph-mon[102205]: pgmap v509: 97 pgs: 97 active+clean; 2.6 GiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:20:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:23 smithi012 ceph-mon[128787]: pgmap v509: 97 pgs: 97 active+clean; 2.6 GiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:20:23.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:23 smithi032 ceph-mon[132488]: pgmap v509: 97 pgs: 97 active+clean; 2.6 GiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:20:25.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:25 smithi039 ceph-mon[102205]: pgmap v510: 97 pgs: 97 active+clean; 2.6 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:20:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:25 smithi012 ceph-mon[128787]: pgmap v510: 97 pgs: 97 active+clean; 2.6 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:20:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:25 smithi032 ceph-mon[132488]: pgmap v510: 97 pgs: 97 active+clean; 2.6 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:20:26.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:26 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:20:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:26 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:20:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:26 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:20:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:27 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:20:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:27 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:20:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:27 smithi039 ceph-mon[102205]: pgmap v511: 97 pgs: 97 active+clean; 2.7 GiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:20:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:27 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:20:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:27 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:20:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:27 smithi012 ceph-mon[128787]: pgmap v511: 97 pgs: 97 active+clean; 2.7 GiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:20:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:27 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:20:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:27 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:20:27.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:27 smithi032 ceph-mon[132488]: pgmap v511: 97 pgs: 97 active+clean; 2.7 GiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:20:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:29 smithi032 ceph-mon[132488]: pgmap v512: 97 pgs: 97 active+clean; 2.7 GiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:20:29.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:29 smithi039 ceph-mon[102205]: pgmap v512: 97 pgs: 97 active+clean; 2.7 GiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:20:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:29 smithi012 ceph-mon[128787]: pgmap v512: 97 pgs: 97 active+clean; 2.7 GiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:20:31.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:31 smithi039 ceph-mon[102205]: pgmap v513: 97 pgs: 97 active+clean; 2.7 GiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:20:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:31 smithi012 ceph-mon[128787]: pgmap v513: 97 pgs: 97 active+clean; 2.7 GiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:20:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:31 smithi032 ceph-mon[132488]: pgmap v513: 97 pgs: 97 active+clean; 2.7 GiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:20:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:33 smithi039 ceph-mon[102205]: pgmap v514: 97 pgs: 97 active+clean; 2.7 GiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:20:33.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:33 smithi012 ceph-mon[128787]: pgmap v514: 97 pgs: 97 active+clean; 2.7 GiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:20:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:33 smithi032 ceph-mon[132488]: pgmap v514: 97 pgs: 97 active+clean; 2.7 GiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:20:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 -- 172.21.15.12:0/809702896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0c8102000 msgr2=0x7ff0c81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/809702896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0c8102000 0x7ff0c81043f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009990 tx=0x7ff0c4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 -- 172.21.15.12:0/809702896 shutdown_connections 2023-12-11T20:20:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/809702896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0c8107260 0x7ff0c8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/809702896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0c8102000 0x7ff0c81043f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/809702896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0c8104930 0x7ff0c8106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 -- 172.21.15.12:0/809702896 >> 172.21.15.12:0/809702896 conn(0x7ff0c80fb930 msgr2=0x7ff0c80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 -- 172.21.15.12:0/809702896 shutdown_connections 2023-12-11T20:20:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.318+0000 7ff0d03ff700 1 -- 172.21.15.12:0/809702896 wait complete. 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.319+0000 7ff0d03ff700 1 Processor -- start 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0d03ff700 1 -- start start 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0d03ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0c8102000 0x7ff0c8199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0d03ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0c8104930 0x7ff0c8199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0d03ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0c8107260 0x7ff0c81a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0d03ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81a1030 con 0x7ff0c8102000 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0d03ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81a1170 con 0x7ff0c8107260 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0d03ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81a1300 con 0x7ff0c8104930 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0ce19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0c8102000 0x7ff0c8199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0ce19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0c8102000 0x7ff0c8199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50796/0 (socket says 172.21.15.12:50796) 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.320+0000 7ff0ce19b700 1 -- 172.21.15.12:0/1219366214 learned_addr learned my addr 172.21.15.12:0/1219366214 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0c8107260 0x7ff0c81a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0c8104930 0x7ff0c8199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0ce19b700 1 -- 172.21.15.12:0/1219366214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0c8104930 msgr2=0x7ff0c8199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0c8104930 0x7ff0c8199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0ce19b700 1 -- 172.21.15.12:0/1219366214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0c8107260 msgr2=0x7ff0c81a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0c8107260 0x7ff0c81a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0ce19b700 1 -- 172.21.15.12:0/1219366214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40095f0 con 0x7ff0c8102000 2023-12-11T20:20:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0c8107260 0x7ff0c81a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0c8102000 0x7ff0c8199500 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4003ec0 tx=0x7ff0c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0bf7fe700 1 -- 172.21.15.12:0/1219366214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c401d070 con 0x7ff0c8102000 2023-12-11T20:20:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0bf7fe700 1 -- 172.21.15.12:0/1219366214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0c400be30 con 0x7ff0c8102000 2023-12-11T20:20:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.321+0000 7ff0d03ff700 1 -- 172.21.15.12:0/1219366214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c81a1580 con 0x7ff0c8102000 2023-12-11T20:20:35.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.322+0000 7ff0bf7fe700 1 -- 172.21.15.12:0/1219366214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400fe90 con 0x7ff0c8102000 2023-12-11T20:20:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.322+0000 7ff0d03ff700 1 -- 172.21.15.12:0/1219366214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c81a1a00 con 0x7ff0c8102000 2023-12-11T20:20:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.326+0000 7ff0e3c23b80 1 Processor -- start 2023-12-11T20:20:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.326+0000 7ff0bf7fe700 1 -- 172.21.15.12:0/1219366214 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff0c400f660 con 0x7ff0c8102000 2023-12-11T20:20:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.326+0000 7ff0e3c23b80 1 -- start start 2023-12-11T20:20:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 0x561ab23b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23b8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab2312af0 con 0x561ab23b7830 2023-12-11T20:20:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab2310410 con 0x561ab23b8720 2023-12-11T20:20:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab230bd00 con 0x561ab23b6ed0 2023-12-11T20:20:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0ce19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0cd99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0cd99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:59704/0 (socket says 172.21.15.12:59704) 2023-12-11T20:20:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0cd99a700 1 -- 172.21.15.12:0/1141992864 learned_addr learned my addr 172.21.15.12:0/1141992864 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.327+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/1141992864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 0x561ab23b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.328+0000 7ff0cd99a700 1 -- 172.21.15.12:0/1141992864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 msgr2=0x561ab23b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.328+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/1141992864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 0x561ab23b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.328+0000 7ff0cd99a700 1 -- 172.21.15.12:0/1141992864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 msgr2=0x561ab23b8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.328+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/1141992864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23b8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.328+0000 7ff0cd99a700 1 -- 172.21.15.12:0/1141992864 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ab21885d0 con 0x561ab23b8720 2023-12-11T20:20:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.328+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/1141992864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8ba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009810 tx=0x7ff0b8009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3774bc2c4409e68c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.329+0000 7ff0bf7fe700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff0b40a14f0 0x7ff0b40a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.329+0000 7ff0bcbfe700 1 -- 172.21.15.12:0/1141992864 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b801c070 con 0x561ab23b8720 2023-12-11T20:20:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.329+0000 7ff0bcbfe700 1 -- 172.21.15.12:0/1141992864 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0b80170d0 con 0x561ab23b8720 2023-12-11T20:20:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.329+0000 7ff0bcbfe700 1 -- 172.21.15.12:0/1141992864 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b800c6b0 con 0x561ab23b8720 2023-12-11T20:20:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.329+0000 7ff0bf7fe700 1 -- 172.21.15.12:0/1219366214 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff0c40ce0a0 con 0x7ff0c8102000 2023-12-11T20:20:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.329+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff0b40a14f0 0x7ff0b40a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff0b40a14f0 0x7ff0b40a39b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009fd0 tx=0x7ff0c0009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1141992864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 msgr2=0x561ab23b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1141992864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8ba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009810 tx=0x7ff0b8009b20 comp rx=0 tx=0).stop 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1141992864 shutdown_connections 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1141992864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8ba0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1141992864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 0x561ab23b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1141992864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23b8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1141992864 >> 172.21.15.12:0/1141992864 conn(0x561ab22e6780 msgr2=0x561ab23b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1141992864 shutdown_connections 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1141992864 wait complete. 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.330+0000 7ff0e3c23b80 1 -- start start 2023-12-11T20:20:35.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.331+0000 7ff0e3c23b80 1 Processor -- start 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.331+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.331+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b7830 0x561ab23c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.331+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b8720 0x561ab23c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.331+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab22c5500 con 0x561ab23b8720 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.331+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab22c51a0 con 0x561ab23b6ed0 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.331+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab218a8c0 con 0x561ab23b7830 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.331+0000 7ff0e3c23b80 10 client.0 _ll_register_callbacks cb 0x561ab21f0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b8720 0x561ab23c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b8720 0x561ab23c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50810/0 (socket says 172.21.15.12:50810) 2023-12-11T20:20:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce99c700 1 -- 172.21.15.12:0/888020642 learned_addr learned my addr 172.21.15.12:0/888020642 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b7830 0x561ab23c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce99c700 1 -- 172.21.15.12:0/888020642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b7830 msgr2=0x561ab23c13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b7830 0x561ab23c13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce99c700 1 -- 172.21.15.12:0/888020642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 msgr2=0x561ab23c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.332+0000 7ff0ce99c700 1 -- 172.21.15.12:0/888020642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ab2134d80 con 0x561ab23b8720 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.333+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b8720 0x561ab23c8220 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0018040 tx=0x7ff0c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d296f968216a158 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.333+0000 7ff0b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.333+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/888020642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000e050 con 0x561ab23b8720 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.333+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/888020642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ab23aa730 con 0x561ab23b8720 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.333+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/888020642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff0c001d050 con 0x561ab23b8720 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.333+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/888020642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0c0015a30 con 0x561ab23b8720 2023-12-11T20:20:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.333+0000 7ff0e3c23b80 10 client.16785 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.333+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/888020642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561ab211dc00 con 0x561ab23b8720 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.334+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/888020642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561ab23aa730 con 0x561ab23b8720 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.334+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/888020642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff0c0004160 con 0x561ab23b8720 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.334+0000 7ff0e3c23b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.334+0000 7ff0e3c23b80 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.334+0000 7ff0e3c23b80 20 client.16785 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.334+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561ab23ccd90 0x561ab23cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.334+0000 7ff0e3c23b80 4 client.16785 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.334+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/888020642 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ab2386ee0 con 0x561ab23ccd90 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.335+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561ab23ccd90 0x561ab23cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.335+0000 7ff0b1ffb700 10 client.16785 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.335+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561ab23ccd90 0x561ab23cf1b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2582ba3a3d162c8a server_cookie=ae1983c061ce56eb in_seq=0 out_seq=0 2023-12-11T20:20:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/888020642 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561ab2386ee0 con 0x561ab23ccd90 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0b1ffb700 10 client.16785 handle_command_reply: tid=0 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 client.16785 shutdown 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/888020642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b8720 msgr2=0x561ab23c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b8720 0x561ab23c8220 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0018040 tx=0x7ff0c000b040 comp rx=0 tx=0).stop 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/888020642 shutdown_connections 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561ab23ccd90 0x561ab23cf1b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b8720 0x561ab23c8220 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0b1ffb700 0 client.16785 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/888020642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b7830 0x561ab23c13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.336+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/888020642 >> 172.21.15.12:0/888020642 conn(0x561ab22e6780 msgr2=0x561ab23b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.337+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/888020642 shutdown_connections 2023-12-11T20:20:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.337+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/888020642 wait complete. 2023-12-11T20:20:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.337+0000 7ff0e3c23b80 20 client.16785 trim_cache size 0 max 16384 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.353+0000 7ff0e3c23b80 1 Processor -- start 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.353+0000 7ff0e3c23b80 1 -- start start 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.353+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 0x561ab23c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.353+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.353+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.353+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab23ccb80 con 0x561ab23b7830 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.353+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab23d4400 con 0x561ab23b8720 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.353+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab23ae8d0 con 0x561ab23b6ed0 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50826/0 (socket says 172.21.15.12:50826) 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 -- 172.21.15.12:0/4252383612 learned_addr learned my addr 172.21.15.12:0/4252383612 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 0x561ab23c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 -- 172.21.15.12:0/4252383612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 msgr2=0x561ab23c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 0x561ab23c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 -- 172.21.15.12:0/4252383612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 msgr2=0x561ab23b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 -- 172.21.15.12:0/4252383612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ab215b1f0 con 0x561ab23b7830 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.354+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c8140 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80097b0 tx=0x7ff0b8005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa743f4ec21b977 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0bd3ff700 1 -- 172.21.15.12:0/4252383612 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b801c040 con 0x561ab23b7830 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0bd3ff700 1 -- 172.21.15.12:0/4252383612 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0b80176d0 con 0x561ab23b7830 2023-12-11T20:20:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0bd3ff700 1 -- 172.21.15.12:0/4252383612 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8003680 con 0x561ab23b7830 2023-12-11T20:20:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/4252383612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 msgr2=0x561ab23c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c8140 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80097b0 tx=0x7ff0b8005d40 comp rx=0 tx=0).stop 2023-12-11T20:20:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/4252383612 shutdown_connections 2023-12-11T20:20:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b8720 0x561ab23b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b6ed0 0x561ab23c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/4252383612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c8140 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.355+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/4252383612 >> 172.21.15.12:0/4252383612 conn(0x561ab22e6780 msgr2=0x561ab23bf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.356+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/4252383612 shutdown_connections 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.356+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/4252383612 wait complete. 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.356+0000 7ff0e3c23b80 1 -- start start 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.356+0000 7ff0e3c23b80 1 Processor -- start 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0e3c23b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b8720 0x561ab23c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab23c7510 con 0x561ab23b7830 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab23c7680 con 0x561ab23b6ed0 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0e3c23b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab23c7840 con 0x561ab23b8720 2023-12-11T20:20:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0e3c23b80 10 client.0 _ll_register_callbacks cb 0x561ab21f0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0cd99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0cd99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50836/0 (socket says 172.21.15.12:50836) 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0cd99a700 1 -- 172.21.15.12:0/1120088982 learned_addr learned my addr 172.21.15.12:0/1120088982 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0ce19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.357+0000 7ff0ce99c700 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b8720 0x561ab23c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0ce19b700 1 -- 172.21.15.12:0/1120088982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b8720 msgr2=0x561ab23c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b8720 0x561ab23c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0ce19b700 1 -- 172.21.15.12:0/1120088982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 msgr2=0x561ab23c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0ce19b700 1 -- 172.21.15.12:0/1120088982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ab21885d0 con 0x561ab23b6ed0 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0ce19b700 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c5cb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40cbba0 tx=0x7ff0c4005860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e3ab95d69e64ec server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:20:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/1120088982 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c409ad60 con 0x561ab23b6ed0 2023-12-11T20:20:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1120088982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0b80170d0 con 0x561ab23b6ed0 2023-12-11T20:20:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/1120088982 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff0c400f460 con 0x561ab23b6ed0 2023-12-11T20:20:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/1120088982 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0c409bb00 con 0x561ab23b6ed0 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0e3c23b80 10 client.26513 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.358+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1120088982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561ab2133250 con 0x561ab23b6ed0 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/1120088982 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0b80170d0 con 0x561ab23b6ed0 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/1120088982 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff0c409b660 con 0x561ab23b6ed0 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0e3c23b80 10 client.26513 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0e3c23b80 10 client.26513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0e3c23b80 20 client.26513 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561ab2423a50 0x561ab2425e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0e3c23b80 4 client.26513 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1120088982 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561ab22d1f70 con 0x561ab2423a50 2023-12-11T20:20:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.359+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561ab2423a50 0x561ab2425e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.360+0000 7ff0cd99a700 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561ab2423a50 0x561ab2425e70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed25dc476cae088f server_cookie=dd2d2df18d959151 in_seq=0 out_seq=0 2023-12-11T20:20:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.360+0000 7ff0b1ffb700 10 client.26513 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.369+0000 7ff0b1ffb700 1 -- 172.21.15.12:0/1120088982 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561ab22d1f70 con 0x561ab2423a50 2023-12-11T20:20:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.369+0000 7ff0b1ffb700 10 client.26513 handle_command_reply: tid=0 2023-12-11T20:20:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.369+0000 7ff0e3c23b80 1 client.26513 shutdown 2023-12-11T20:20:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.369+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1120088982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 msgr2=0x561ab23c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.369+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c5cb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40cbba0 tx=0x7ff0c4005860 comp rx=0 tx=0).stop 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1120088982 shutdown_connections 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561ab2423a50 0x561ab2425e70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561ab23b6ed0 0x561ab23c5cb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ab23b8720 0x561ab23c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0b1ffb700 0 client.26513 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 1 --2- 172.21.15.12:0/1120088982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ab23b7830 0x561ab23c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1120088982 >> 172.21.15.12:0/1120088982 conn(0x561ab22e6780 msgr2=0x561ab23b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1120088982 shutdown_connections 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 1 -- 172.21.15.12:0/1120088982 wait complete. 2023-12-11T20:20:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.370+0000 7ff0e3c23b80 20 client.26513 trim_cache size 0 max 16384 2023-12-11T20:20:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:20:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:20:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:20:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 -- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff0b40a14f0 msgr2=0x7ff0b40a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff0b40a14f0 0x7ff0b40a39b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009fd0 tx=0x7ff0c0009040 comp rx=0 tx=0).stop 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 -- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0c8102000 msgr2=0x7ff0c8199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0c8102000 0x7ff0c8199500 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4003ec0 tx=0x7ff0c40057f0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 -- 172.21.15.12:0/1219366214 shutdown_connections 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff0b40a14f0 0x7ff0b40a39b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0c8107260 0x7ff0c81a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0c8102000 0x7ff0c8199500 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 --2- 172.21.15.12:0/1219366214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0c8104930 0x7ff0c8199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 -- 172.21.15.12:0/1219366214 >> 172.21.15.12:0/1219366214 conn(0x7ff0c80fb930 msgr2=0x7ff0c8105e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 -- 172.21.15.12:0/1219366214 shutdown_connections 2023-12-11T20:20:35.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:35.371+0000 7ff0d03ff700 1 -- 172.21.15.12:0/1219366214 wait complete. 2023-12-11T20:20:35.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:35 smithi039 ceph-mon[102205]: pgmap v515: 97 pgs: 97 active+clean; 2.8 GiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:20:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:35 smithi012 ceph-mon[128787]: pgmap v515: 97 pgs: 97 active+clean; 2.8 GiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:20:35.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:35 smithi032 ceph-mon[132488]: pgmap v515: 97 pgs: 97 active+clean; 2.8 GiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:20:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:37 smithi039 ceph-mon[102205]: pgmap v516: 97 pgs: 97 active+clean; 2.8 GiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:20:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:37 smithi012 ceph-mon[128787]: pgmap v516: 97 pgs: 97 active+clean; 2.8 GiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:20:37.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:37 smithi032 ceph-mon[132488]: pgmap v516: 97 pgs: 97 active+clean; 2.8 GiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:20:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:39 smithi032 ceph-mon[132488]: pgmap v517: 97 pgs: 97 active+clean; 2.8 GiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:20:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:39 smithi039 ceph-mon[102205]: pgmap v517: 97 pgs: 97 active+clean; 2.8 GiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:20:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:39 smithi012 ceph-mon[128787]: pgmap v517: 97 pgs: 97 active+clean; 2.8 GiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:20:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:41 smithi039 ceph-mon[102205]: pgmap v518: 97 pgs: 97 active+clean; 2.9 GiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:20:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:41 smithi012 ceph-mon[128787]: pgmap v518: 97 pgs: 97 active+clean; 2.9 GiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:20:41.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:41 smithi032 ceph-mon[132488]: pgmap v518: 97 pgs: 97 active+clean; 2.9 GiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:20:42.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:20:42.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2109676165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc107280 msgr2=0x7f7abc109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2109676165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc107280 0x7f7abc109670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400b0a0 tx=0x7f7ab400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2109676165 shutdown_connections 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2109676165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc107280 0x7f7abc109670 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2109676165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7abc102020 0x7f7abc104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2109676165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7abc104950 0x7f7abc106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2109676165 >> 172.21.15.12:0/2109676165 conn(0x7f7abc0fb930 msgr2=0x7f7abc0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2109676165 shutdown_connections 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.704+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2109676165 wait complete. 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.705+0000 7f7ac09ff700 1 Processor -- start 2023-12-11T20:20:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7ac09ff700 1 -- start start 2023-12-11T20:20:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7ac09ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc102020 0x7f7abc199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7ac09ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7abc104950 0x7f7abc199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7ac09ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7abc107280 0x7f7abc1a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7ac09ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1a1150 con 0x7f7abc102020 2023-12-11T20:20:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7ac09ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1a1290 con 0x7f7abc107280 2023-12-11T20:20:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7ac09ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1a1420 con 0x7f7abc104950 2023-12-11T20:20:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7aba59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc102020 0x7f7abc199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7aba59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc102020 0x7f7abc199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55010/0 (socket says 172.21.15.12:55010) 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.706+0000 7f7aba59c700 1 -- 172.21.15.12:0/2346705337 learned_addr learned my addr 172.21.15.12:0/2346705337 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7abad9d700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7abc107280 0x7f7abc1a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7abc104950 0x7f7abc199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7aba59c700 1 -- 172.21.15.12:0/2346705337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7abc104950 msgr2=0x7f7abc199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7aba59c700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7abc104950 0x7f7abc199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7aba59c700 1 -- 172.21.15.12:0/2346705337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7abc107280 msgr2=0x7f7abc1a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7aba59c700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7abc107280 0x7f7abc1a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7aba59c700 1 -- 172.21.15.12:0/2346705337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4009d00 con 0x7f7abc102020 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7abc104950 0x7f7abc199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.707+0000 7f7aba59c700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc102020 0x7f7abc199620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00e9a0 tx=0x7f7aac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.708+0000 7f7aab7fe700 1 -- 172.21.15.12:0/2346705337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac009790 con 0x7f7abc102020 2023-12-11T20:20:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.708+0000 7f7aab7fe700 1 -- 172.21.15.12:0/2346705337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7aac00cbd0 con 0x7f7abc102020 2023-12-11T20:20:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.708+0000 7f7aab7fe700 1 -- 172.21.15.12:0/2346705337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac018680 con 0x7f7abc102020 2023-12-11T20:20:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.708+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2346705337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc1a1700 con 0x7f7abc102020 2023-12-11T20:20:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.708+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2346705337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc1a1bc0 con 0x7f7abc102020 2023-12-11T20:20:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.712+0000 7f7aab7fe700 1 -- 172.21.15.12:0/2346705337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7aac00cd40 con 0x7f7abc102020 2023-12-11T20:20:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.714+0000 7f7aab7fe700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7aa40a1500 0x7f7aa40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.714+0000 7f7aab7fe700 1 -- 172.21.15.12:0/2346705337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7aac014070 con 0x7f7abc102020 2023-12-11T20:20:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.714+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7aa40a1500 0x7f7aa40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ad439eb80 1 Processor -- start 2023-12-11T20:20:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7aa40a1500 0x7f7aa40a39c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0005fd0 tx=0x7f7ab0005ee0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ad439eb80 1 -- start start 2023-12-11T20:20:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a2187f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a218d30 0x55644a219640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a219c20 0x55644a21a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a173b50 con 0x55644a218d30 2023-12-11T20:20:42.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a171470 con 0x55644a2183d0 2023-12-11T20:20:42.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.715+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a16cd60 con 0x55644a219c20 2023-12-11T20:20:42.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7ab9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a218d30 0x55644a219640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a2187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a2187f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40820/0 (socket says 172.21.15.12:40820) 2023-12-11T20:20:42.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7ab9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a218d30 0x55644a219640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55024/0 (socket says 172.21.15.12:55024) 2023-12-11T20:20:42.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 -- 172.21.15.12:0/1684774405 learned_addr learned my addr 172.21.15.12:0/1684774405 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:42.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7abad9d700 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a219c20 0x55644a21a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 -- 172.21.15.12:0/1684774405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a219c20 msgr2=0x55644a21a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a219c20 0x55644a21a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 -- 172.21.15.12:0/1684774405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a218d30 msgr2=0x55644a219640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a218d30 0x55644a219640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 -- 172.21.15.12:0/1684774405 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556449fe9630 con 0x55644a2183d0 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7abad9d700 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a219c20 0x55644a21a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a218d30 0x55644a219640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.716+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a2187f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0967c0 tx=0x7f7aac09a9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f3f40796672c99 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.717+0000 7f7aa8ff9700 1 -- 172.21.15.12:0/1684774405 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac09e410 con 0x55644a2183d0 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.717+0000 7f7aa8ff9700 1 -- 172.21.15.12:0/1684774405 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7aac0a2650 con 0x55644a2183d0 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.717+0000 7f7aa8ff9700 1 -- 172.21.15.12:0/1684774405 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0a21c0 con 0x55644a2183d0 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.717+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1684774405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 msgr2=0x55644a2187f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.717+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a2187f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0967c0 tx=0x7f7aac09a9c0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.717+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1684774405 shutdown_connections 2023-12-11T20:20:42.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.718+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a2187f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.718+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a219c20 0x55644a21a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.718+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1684774405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a218d30 0x55644a219640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.718+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1684774405 >> 172.21.15.12:0/1684774405 conn(0x55644a1477e0 msgr2=0x55644a214d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:42.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.718+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1684774405 shutdown_connections 2023-12-11T20:20:42.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.718+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1684774405 wait complete. 2023-12-11T20:20:42.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.718+0000 7f7ad439eb80 1 -- start start 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.719+0000 7f7ad439eb80 1 Processor -- start 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.719+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a2221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.719+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a222700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.719+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.719+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a126560 con 0x55644a219c20 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.719+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a126200 con 0x55644a218d30 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.719+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556449feb920 con 0x55644a2183d0 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ad439eb80 10 client.0 _ll_register_callbacks cb 0x55644a051a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ab9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a222700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ab9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a222700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40830/0 (socket says 172.21.15.12:40830) 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ab9d9b700 1 -- 172.21.15.12:0/1823545273 learned_addr learned my addr 172.21.15.12:0/1823545273 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a2221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ab9d9b700 1 -- 172.21.15.12:0/1823545273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 msgr2=0x55644a2221c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a2221c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ab9d9b700 1 -- 172.21.15.12:0/1823545273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 msgr2=0x55644a229740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.720+0000 7f7ab9d9b700 1 -- 172.21.15.12:0/1823545273 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab000ea20 con 0x55644a218d30 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.721+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a222700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0011940 tx=0x7f7ab00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e9930123c1c35c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.721+0000 7f7aa1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.721+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1823545273 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00106d0 con 0x55644a218d30 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.721+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1823545273 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55644a20bb40 con 0x55644a218d30 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.721+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1823545273 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ab0010830 con 0x55644a218d30 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.721+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1823545273 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab00109f0 con 0x55644a218d30 2023-12-11T20:20:42.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.721+0000 7f7ad439eb80 10 client.26525 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.721+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1823545273 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f7abc1a1bc0 con 0x55644a218d30 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1823545273 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55644a20bb40 con 0x55644a218d30 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1823545273 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7ab0025020 con 0x55644a218d30 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7ad439eb80 10 client.26525 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7ad439eb80 10 client.26525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7ad439eb80 20 client.26525 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55644a22e000 0x55644a230420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7ad439eb80 4 client.26525 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1823545273 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55644a1e7f40 con 0x55644a22e000 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.722+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55644a22e000 0x55644a230420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.723+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55644a22e000 0x55644a230420 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d26afd6f92a9b2c server_cookie=f8de2e1521d22421 in_seq=0 out_seq=0 2023-12-11T20:20:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.723+0000 7f7aa1ffb700 10 client.26525 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1823545273 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55644a1e7f40 con 0x55644a22e000 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7aa1ffb700 10 client.26525 handle_command_reply: tid=0 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 client.26525 shutdown 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1823545273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 msgr2=0x55644a222700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a222700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0011940 tx=0x7f7ab00047c0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1823545273 shutdown_connections 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55644a22e000 0x55644a230420 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7aa1ffb700 0 client.26525 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:42.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a2221c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1823545273 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a222700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1823545273 >> 172.21.15.12:0/1823545273 conn(0x55644a1477e0 msgr2=0x55644a213a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:42.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1823545273 shutdown_connections 2023-12-11T20:20:42.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1823545273 wait complete. 2023-12-11T20:20:42.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.724+0000 7f7ad439eb80 20 client.26525 trim_cache size 0 max 16384 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.748+0000 7f7ad439eb80 1 Processor -- start 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.748+0000 7f7ad439eb80 1 -- start start 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.748+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a21cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.748+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a21d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.748+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.748+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a235630 con 0x55644a219c20 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.748+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a20fb50 con 0x55644a218d30 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.748+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a21fed0 con 0x55644a2183d0 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55038/0 (socket says 172.21.15.12:55038) 2023-12-11T20:20:42.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7abad9d700 1 -- 172.21.15.12:0/2594836689 learned_addr learned my addr 172.21.15.12:0/2594836689 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:42.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7aba59c700 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a21cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a21d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7aba59c700 1 -- 172.21.15.12:0/2594836689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 msgr2=0x55644a21d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7aba59c700 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a21d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7aba59c700 1 -- 172.21.15.12:0/2594836689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 msgr2=0x55644a229660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7aba59c700 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7aba59c700 1 -- 172.21.15.12:0/2594836689 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556449f95de0 con 0x55644a2183d0 2023-12-11T20:20:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.749+0000 7f7abad9d700 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.750+0000 7f7aba59c700 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a21cca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0967c0 tx=0x7f7aac010b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=846b0d888ee11654 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.750+0000 7f7aa97fa700 1 -- 172.21.15.12:0/2594836689 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac098400 con 0x55644a2183d0 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.750+0000 7f7aa97fa700 1 -- 172.21.15.12:0/2594836689 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7aac098660 con 0x55644a2183d0 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.750+0000 7f7aa97fa700 1 -- 172.21.15.12:0/2594836689 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0a21c0 con 0x55644a2183d0 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 -- 172.21.15.12:0/2594836689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 msgr2=0x55644a21cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a21cca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0967c0 tx=0x7f7aac010b20 comp rx=0 tx=0).stop 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 -- 172.21.15.12:0/2594836689 shutdown_connections 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a229660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a2183d0 0x55644a21cca0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/2594836689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a218d30 0x55644a21d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 -- 172.21.15.12:0/2594836689 >> 172.21.15.12:0/2594836689 conn(0x55644a1477e0 msgr2=0x55644a21c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 -- 172.21.15.12:0/2594836689 shutdown_connections 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 -- 172.21.15.12:0/2594836689 wait complete. 2023-12-11T20:20:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.751+0000 7f7ad439eb80 1 -- start start 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.752+0000 7f7ad439eb80 1 Processor -- start 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.752+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a225900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.752+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a218d30 0x55644a225e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.752+0000 7f7ad439eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a228e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.752+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a229350 con 0x55644a219c20 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.752+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a2294c0 con 0x55644a2183d0 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.752+0000 7f7ad439eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55644a229680 con 0x55644a218d30 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.752+0000 7f7ad439eb80 10 client.0 _ll_register_callbacks cb 0x55644a051a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a228e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a228e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55044/0 (socket says 172.21.15.12:55044) 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 -- 172.21.15.12:0/1984548887 learned_addr learned my addr 172.21.15.12:0/1984548887 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:42.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a225900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a218d30 0x55644a225e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 -- 172.21.15.12:0/1984548887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a218d30 msgr2=0x55644a225e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a218d30 0x55644a225e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 -- 172.21.15.12:0/1984548887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 msgr2=0x55644a225900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a225900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 -- 172.21.15.12:0/1984548887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc10a240 con 0x55644a219c20 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7ab9d9b700 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a218d30 0x55644a225e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7abad9d700 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a228e10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400afe0 tx=0x7f7ab4007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9130cbbbf05e78d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.753+0000 7f7aa1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.754+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1984548887 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400e040 con 0x55644a219c20 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.754+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1984548887 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ab4020040 con 0x55644a219c20 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.754+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1984548887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7aac0a2650 con 0x55644a219c20 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.754+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1984548887 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab4007e70 con 0x55644a219c20 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.754+0000 7f7ad439eb80 10 client.16809 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:42.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.754+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1984548887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556449fe9630 con 0x55644a219c20 2023-12-11T20:20:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.754+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1984548887 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7aac0a2650 con 0x55644a219c20 2023-12-11T20:20:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.755+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1984548887 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7ab400b0d0 con 0x55644a219c20 2023-12-11T20:20:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.755+0000 7f7ad439eb80 10 client.16809 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.755+0000 7f7ad439eb80 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.755+0000 7f7ad439eb80 20 client.16809 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.755+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55644a2859d0 0x55644a287df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.755+0000 7f7ad439eb80 4 client.16809 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:20:42.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.755+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1984548887 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55644a132fd0 con 0x55644a2859d0 2023-12-11T20:20:42.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.755+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55644a2859d0 0x55644a287df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:42.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7aba59c700 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55644a2859d0 0x55644a287df0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b724fadedd276b2 server_cookie=f78a6905e1c43dc9 in_seq=0 out_seq=0 2023-12-11T20:20:42.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7aa1ffb700 10 client.16809 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:42.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7aa1ffb700 1 -- 172.21.15.12:0/1984548887 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55644a132fd0 con 0x55644a2859d0 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7aa1ffb700 10 client.16809 handle_command_reply: tid=0 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 client.16809 shutdown 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1984548887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 msgr2=0x55644a228e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a228e10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400afe0 tx=0x7f7ab4007b90 comp rx=0 tx=0).stop 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1984548887 shutdown_connections 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55644a2859d0 0x55644a287df0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55644a2183d0 0x55644a225900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55644a219c20 0x55644a228e10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 --2- 172.21.15.12:0/1984548887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55644a218d30 0x55644a225e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7aa1ffb700 0 client.16809 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1984548887 >> 172.21.15.12:0/1984548887 conn(0x55644a1477e0 msgr2=0x55644a222160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1984548887 shutdown_connections 2023-12-11T20:20:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.756+0000 7f7ad439eb80 1 -- 172.21.15.12:0/1984548887 wait complete. 2023-12-11T20:20:42.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ad439eb80 20 client.16809 trim_cache size 0 max 16384 2023-12-11T20:20:42.759 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:20:42.759 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:20:42.759 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:20:42.759 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7aa40a1500 msgr2=0x7f7aa40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7aa40a1500 0x7f7aa40a39c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0005fd0 tx=0x7f7ab0005ee0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc102020 msgr2=0x7f7abc199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc102020 0x7f7abc199620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00e9a0 tx=0x7f7aac00ed60 comp rx=0 tx=0).stop 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2346705337 shutdown_connections 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7aa40a1500 0x7f7aa40a39c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7abc107280 0x7f7abc1a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7abc102020 0x7f7abc199620 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 --2- 172.21.15.12:0/2346705337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7abc104950 0x7f7abc199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.757+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2346705337 >> 172.21.15.12:0/2346705337 conn(0x7f7abc0fb930 msgr2=0x7f7abc101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.758+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2346705337 shutdown_connections 2023-12-11T20:20:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:42.758+0000 7f7ac09ff700 1 -- 172.21.15.12:0/2346705337 wait complete. 2023-12-11T20:20:42.777 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:20:42.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 -- 172.21.15.12:0/533461689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b58105060 msgr2=0x7f8b5810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/533461689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b58105060 0x7f8b5810b910 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b0d0 tx=0x7f8b5000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 -- 172.21.15.12:0/533461689 shutdown_connections 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/533461689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b581034d0 0x7f8b581038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/533461689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b58105060 0x7f8b5810b910 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/533461689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b581046c0 0x7f8b58104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 -- 172.21.15.12:0/533461689 >> 172.21.15.12:0/533461689 conn(0x7f8b580fea60 msgr2=0x7f8b58100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 -- 172.21.15.12:0/533461689 shutdown_connections 2023-12-11T20:20:43.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.025+0000 7f8b5e99d700 1 -- 172.21.15.12:0/533461689 wait complete. 2023-12-11T20:20:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.026+0000 7f8b5e99d700 1 Processor -- start 2023-12-11T20:20:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5e99d700 1 -- start start 2023-12-11T20:20:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5e99d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b581034d0 0x7f8b58199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5e99d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b581046c0 0x7f8b581999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5e99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b58105060 0x7f8b581a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5e99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b581a0fc0 con 0x7f8b58105060 2023-12-11T20:20:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5e99d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b581a1100 con 0x7f8b581034d0 2023-12-11T20:20:43.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5e99d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b581a1290 con 0x7f8b581046c0 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5e19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b58105060 0x7f8b581a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5d19a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b581046c0 0x7f8b581999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5d19a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b581046c0 0x7f8b581999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48968/0 (socket says 172.21.15.12:48968) 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5d19a700 1 -- 172.21.15.12:0/3950292721 learned_addr learned my addr 172.21.15.12:0/3950292721 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.027+0000 7f8b5d99b700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b581034d0 0x7f8b58199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b5d19a700 1 -- 172.21.15.12:0/3950292721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b581034d0 msgr2=0x7f8b58199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b5d19a700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b581034d0 0x7f8b58199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b5d19a700 1 -- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b58105060 msgr2=0x7f8b581a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b5d19a700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b58105060 0x7f8b581a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b5d19a700 1 -- 172.21.15.12:0/3950292721 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50009d00 con 0x7f8b581046c0 2023-12-11T20:20:43.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b5d19a700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b581046c0 0x7f8b581999d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800e9a0 tx=0x7f8b4800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b4effd700 1 -- 172.21.15.12:0/3950292721 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48009790 con 0x7f8b581046c0 2023-12-11T20:20:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b4effd700 1 -- 172.21.15.12:0/3950292721 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b48010430 con 0x7f8b581046c0 2023-12-11T20:20:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b581a1570 con 0x7f8b581046c0 2023-12-11T20:20:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.028+0000 7f8b4effd700 1 -- 172.21.15.12:0/3950292721 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800cea0 con 0x7f8b581046c0 2023-12-11T20:20:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.029+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b581a1ad0 con 0x7f8b581046c0 2023-12-11T20:20:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.030+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5810a9a0 con 0x7f8b581046c0 2023-12-11T20:20:43.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.032+0000 7f8b4effd700 1 -- 172.21.15.12:0/3950292721 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8b480105a0 con 0x7f8b581046c0 2023-12-11T20:20:43.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.033+0000 7f8b4effd700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8b440a1500 0x7f8b440a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.033+0000 7f8b4effd700 1 -- 172.21.15.12:0/3950292721 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8b48014070 con 0x7f8b581046c0 2023-12-11T20:20:43.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.034+0000 7f8b5d99b700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8b440a1500 0x7f8b440a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.034+0000 7f8b5d99b700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8b440a1500 0x7f8b440a39c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8b58104520 tx=0x7f8b54009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.036+0000 7f8b4effd700 1 -- 172.21.15.12:0/3950292721 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8b48096650 con 0x7f8b581046c0 2023-12-11T20:20:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.363+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b5804f300 con 0x7f8b581046c0 2023-12-11T20:20:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.364+0000 7f8b4effd700 1 -- 172.21.15.12:0/3950292721 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f8b48099c70 con 0x7f8b581046c0 2023-12-11T20:20:43.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:20:43.366 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.366+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8b440a1500 msgr2=0x7f8b440a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.366+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8b440a1500 0x7f8b440a39c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8b58104520 tx=0x7f8b54009260 comp rx=0 tx=0).stop 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.366+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b581046c0 msgr2=0x7f8b581999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.366+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b581046c0 0x7f8b581999d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800e9a0 tx=0x7f8b4800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.367+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 shutdown_connections 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.367+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8b440a1500 0x7f8b440a39c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.367+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b581034d0 0x7f8b58199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.367+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b58105060 0x7f8b581a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.367+0000 7f8b5e99d700 1 --2- 172.21.15.12:0/3950292721 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b581046c0 0x7f8b581999d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.367+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 >> 172.21.15.12:0/3950292721 conn(0x7f8b580fea60 msgr2=0x7f8b58107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.367+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 shutdown_connections 2023-12-11T20:20:43.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.367+0000 7f8b5e99d700 1 -- 172.21.15.12:0/3950292721 wait complete. 2023-12-11T20:20:43.369 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:20:43.385 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:20:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:43 smithi039 ceph-mon[102205]: pgmap v519: 97 pgs: 97 active+clean; 2.9 GiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:20:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:43 smithi012 ceph-mon[128787]: pgmap v519: 97 pgs: 97 active+clean; 2.9 GiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:20:43.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 -- 172.21.15.12:0/521392002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 msgr2=0x7f6914109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 --2- 172.21.15.12:0/521392002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 0x7f6914109440 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f690c00b0a0 tx=0x7f690c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 -- 172.21.15.12:0/521392002 shutdown_connections 2023-12-11T20:20:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 --2- 172.21.15.12:0/521392002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6914101dd0 0x7f69141041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 --2- 172.21.15.12:0/521392002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 0x7f6914109440 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 --2- 172.21.15.12:0/521392002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6914104700 0x7f6914106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 -- 172.21.15.12:0/521392002 >> 172.21.15.12:0/521392002 conn(0x7f69140fb740 msgr2=0x7f69140fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 -- 172.21.15.12:0/521392002 shutdown_connections 2023-12-11T20:20:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.634+0000 7f6913fff700 1 -- 172.21.15.12:0/521392002 wait complete. 2023-12-11T20:20:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.635+0000 7f6913fff700 1 Processor -- start 2023-12-11T20:20:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.635+0000 7f6913fff700 1 -- start start 2023-12-11T20:20:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.635+0000 7f6913fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6914101dd0 0x7f6914199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.635+0000 7f6913fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6914104700 0x7f6914199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f6913fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 0x7f69141a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f6913fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69141a0e70 con 0x7f6914107030 2023-12-11T20:20:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f6913fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69141a0fb0 con 0x7f6914104700 2023-12-11T20:20:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f6913fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69141a1140 con 0x7f6914101dd0 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 0x7f69141a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 0x7f69141a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55072/0 (socket says 172.21.15.12:55072) 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69137fe700 1 -- 172.21.15.12:0/3995770239 learned_addr learned my addr 172.21.15.12:0/3995770239 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69127fc700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6914104700 0x7f6914199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f6912ffd700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6914101dd0 0x7f6914199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69137fe700 1 -- 172.21.15.12:0/3995770239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6914101dd0 msgr2=0x7f6914199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69137fe700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6914101dd0 0x7f6914199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69137fe700 1 -- 172.21.15.12:0/3995770239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6914104700 msgr2=0x7f6914199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69137fe700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6914104700 0x7f6914199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.636+0000 7f69137fe700 1 -- 172.21.15.12:0/3995770239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c009d00 con 0x7f6914107030 2023-12-11T20:20:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.637+0000 7f69137fe700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 0x7f69141a08a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f690c00b780 tx=0x7f690c00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.637+0000 7f68fbfff700 1 -- 172.21.15.12:0/3995770239 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00e040 con 0x7f6914107030 2023-12-11T20:20:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.637+0000 7f6913fff700 1 -- 172.21.15.12:0/3995770239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69141a13c0 con 0x7f6914107030 2023-12-11T20:20:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.637+0000 7f68fbfff700 1 -- 172.21.15.12:0/3995770239 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f690c003c00 con 0x7f6914107030 2023-12-11T20:20:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.637+0000 7f68fbfff700 1 -- 172.21.15.12:0/3995770239 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c0052a0 con 0x7f6914107030 2023-12-11T20:20:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.637+0000 7f6913fff700 1 -- 172.21.15.12:0/3995770239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69141a17e0 con 0x7f6914107030 2023-12-11T20:20:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.641+0000 7f68fbfff700 1 -- 172.21.15.12:0/3995770239 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f690c01d480 con 0x7f6914107030 2023-12-11T20:20:43.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.642+0000 7f68fbfff700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f68fc0a1520 0x7f68fc0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.642+0000 7f68fbfff700 1 -- 172.21.15.12:0/3995770239 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f690c0cdda0 con 0x7f6914107030 2023-12-11T20:20:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.642+0000 7f692d1bbb80 1 Processor -- start 2023-12-11T20:20:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.642+0000 7f6912ffd700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f68fc0a1520 0x7f68fc0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f692d1bbb80 1 -- start start 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b62285e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b622868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b62287240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b621e0b50 con 0x557b62285a60 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b621de470 con 0x557b62286de0 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b621d9d60 con 0x557b622863c0 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f6912ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b62285e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f6912ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b62285e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55082/0 (socket says 172.21.15.12:55082) 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f6912ffd700 1 -- 172.21.15.12:0/2703570394 learned_addr learned my addr 172.21.15.12:0/2703570394 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.643+0000 7f69137fe700 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b62287240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.644+0000 7f6912ffd700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f68fc0a1520 0x7f68fc0a39e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6904009c60 tx=0x7f6904009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.644+0000 7f69127fc700 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b622868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.644+0000 7f6912ffd700 1 -- 172.21.15.12:0/2703570394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 msgr2=0x557b622868a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.644+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b622868a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.644+0000 7f6912ffd700 1 -- 172.21.15.12:0/2703570394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 msgr2=0x557b62287240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.644+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b62287240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.644+0000 7f6912ffd700 1 -- 172.21.15.12:0/2703570394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b62056630 con 0x557b62285a60 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.644+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b62285e80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f690400e430 tx=0x7f6904014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9de512b5dcf7482 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.645+0000 7f68f97fa700 1 -- 172.21.15.12:0/2703570394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400edd0 con 0x557b62285a60 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.645+0000 7f68f97fa700 1 -- 172.21.15.12:0/2703570394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6904021070 con 0x557b62285a60 2023-12-11T20:20:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.645+0000 7f68f97fa700 1 -- 172.21.15.12:0/2703570394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904005690 con 0x557b62285a60 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.645+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2703570394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 msgr2=0x557b62285e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.645+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b62285e80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f690400e430 tx=0x7f6904014000 comp rx=0 tx=0).stop 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.646+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2703570394 shutdown_connections 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.646+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b62287240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.646+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b62285e80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.646+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2703570394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b622868a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.646+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2703570394 >> 172.21.15.12:0/2703570394 conn(0x557b621b47e0 msgr2=0x557b622803d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.646+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2703570394 shutdown_connections 2023-12-11T20:20:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.646+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2703570394 wait complete. 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.646+0000 7f692d1bbb80 1 -- start start 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f692d1bbb80 1 Processor -- start 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b6228f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b6228f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b62296950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b62193560 con 0x557b62285a60 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b62193200 con 0x557b62286de0 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b62058920 con 0x557b622863c0 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f692d1bbb80 10 client.0 _ll_register_callbacks cb 0x557b620bea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.647+0000 7f6912ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b6228f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f6912ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b6228f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55094/0 (socket says 172.21.15.12:55094) 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f6912ffd700 1 -- 172.21.15.12:0/2414012750 learned_addr learned my addr 172.21.15.12:0/2414012750 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f69137fe700 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b62296950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f69127fc700 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b6228f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f6912ffd700 1 -- 172.21.15.12:0/2414012750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 msgr2=0x557b6228f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b6228f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f6912ffd700 1 -- 172.21.15.12:0/2414012750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 msgr2=0x557b62296950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b62296950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f6912ffd700 1 -- 172.21.15.12:0/2414012750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6904017070 con 0x557b62285a60 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b6228f420 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6904009e90 tx=0x7f690400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33e0c28f02af1d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.648+0000 7f68f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.649+0000 7f68f6ff5700 1 -- 172.21.15.12:0/2414012750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690402a040 con 0x557b62285a60 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.649+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2414012750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b622789e0 con 0x557b62285a60 2023-12-11T20:20:43.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.649+0000 7f68f6ff5700 1 -- 172.21.15.12:0/2414012750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6904004230 con 0x557b62285a60 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.649+0000 7f68f6ff5700 1 -- 172.21.15.12:0/2414012750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69040056e0 con 0x557b62285a60 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.649+0000 7f692d1bbb80 10 client.16827 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.649+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2414012750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557b62002de0 con 0x557b62285a60 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.649+0000 7f68f6ff5700 1 -- 172.21.15.12:0/2414012750 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557b622789e0 con 0x557b62285a60 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.650+0000 7f68f6ff5700 1 -- 172.21.15.12:0/2414012750 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f69040038b0 con 0x557b62285a60 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.650+0000 7f692d1bbb80 10 client.16827 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.650+0000 7f692d1bbb80 10 client.16827 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.650+0000 7f692d1bbb80 20 client.16827 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.650+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557b6229b0f0 0x557b6229d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.650+0000 7f692d1bbb80 4 client.16827 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.650+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2414012750 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b62254f40 con 0x557b6229b0f0 2023-12-11T20:20:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.650+0000 7f69127fc700 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557b6229b0f0 0x557b6229d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.651+0000 7f68f6ff5700 10 client.16827 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:20:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.651+0000 7f69127fc700 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557b6229b0f0 0x557b6229d510 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9771fe1a1bfd2867 server_cookie=6bfa00642478ffe8 in_seq=0 out_seq=0 2023-12-11T20:20:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f68f6ff5700 1 -- 172.21.15.12:0/2414012750 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557b62254f40 con 0x557b6229b0f0 2023-12-11T20:20:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f68f6ff5700 10 client.16827 handle_command_reply: tid=0 2023-12-11T20:20:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 client.16827 shutdown 2023-12-11T20:20:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2414012750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 msgr2=0x557b6228f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b6228f420 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6904009e90 tx=0x7f690400edc0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2414012750 shutdown_connections 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557b6229b0f0 0x557b6229d510 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b62296950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62285a60 0x557b6228f420 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2414012750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b6228f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2414012750 >> 172.21.15.12:0/2414012750 conn(0x557b621b47e0 msgr2=0x557b62284820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f68f6ff5700 0 client.16827 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2414012750 shutdown_connections 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.652+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2414012750 wait complete. 2023-12-11T20:20:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.653+0000 7f692d1bbb80 20 client.16827 trim_cache size 0 max 16384 2023-12-11T20:20:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f692d1bbb80 1 Processor -- start 2023-12-11T20:20:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f692d1bbb80 1 -- start start 2023-12-11T20:20:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62285a60 0x557b6228e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b62296910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62286de0 0x557b622871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b62287700 con 0x557b62286de0 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b6228ef90 con 0x557b62285a60 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b622a26e0 con 0x557b622863c0 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.672+0000 7f69137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62286de0 0x557b622871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f69137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62286de0 0x557b622871c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55096/0 (socket says 172.21.15.12:55096) 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f69137fe700 1 -- 172.21.15.12:0/2604975551 learned_addr learned my addr 172.21.15.12:0/2604975551 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62285a60 0x557b6228e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f69127fc700 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b62296910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f6912ffd700 1 -- 172.21.15.12:0/2604975551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 msgr2=0x557b62296910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b62296910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f6912ffd700 1 -- 172.21.15.12:0/2604975551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62286de0 msgr2=0x557b622871c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62286de0 0x557b622871c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f6912ffd700 1 -- 172.21.15.12:0/2604975551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b61febc60 con 0x557b62285a60 2023-12-11T20:20:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.673+0000 7f69137fe700 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62286de0 0x557b622871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.674+0000 7f6912ffd700 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62285a60 0x557b6228e930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6904011ab0 tx=0x7f690400ea60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=667137ad8c3991fa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.674+0000 7f68f9ffb700 1 -- 172.21.15.12:0/2604975551 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690402a040 con 0x557b62285a60 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.674+0000 7f68f9ffb700 1 -- 172.21.15.12:0/2604975551 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69040092d0 con 0x557b62285a60 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.674+0000 7f68f9ffb700 1 -- 172.21.15.12:0/2604975551 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904026bf0 con 0x557b62285a60 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2604975551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62285a60 msgr2=0x557b6228e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62285a60 0x557b6228e930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6904011ab0 tx=0x7f690400ea60 comp rx=0 tx=0).stop 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2604975551 shutdown_connections 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62285a60 0x557b6228e930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b62286de0 0x557b622871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/2604975551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b622863c0 0x557b62296910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2604975551 >> 172.21.15.12:0/2604975551 conn(0x557b621b47e0 msgr2=0x557b622803a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2604975551 shutdown_connections 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 -- 172.21.15.12:0/2604975551 wait complete. 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 -- start start 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.675+0000 7f692d1bbb80 1 Processor -- start 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b62285a60 0x557b622eb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b622863c0 0x557b622edac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f692d1bbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b622f0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b622f0550 con 0x557b622863c0 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b622f0690 con 0x557b62286de0 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f692d1bbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b622f07d0 con 0x557b62285a60 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f692d1bbb80 10 client.0 _ll_register_callbacks cb 0x557b620bea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f69127fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b622863c0 0x557b622edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f69127fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b622863c0 0x557b622edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55104/0 (socket says 172.21.15.12:55104) 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.676+0000 7f69127fc700 1 -- 172.21.15.12:0/3280117540 learned_addr learned my addr 172.21.15.12:0/3280117540 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f6912ffd700 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b62285a60 0x557b622eb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f69137fe700 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b622f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f69127fc700 1 -- 172.21.15.12:0/3280117540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b62285a60 msgr2=0x557b622eb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f69127fc700 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b62285a60 0x557b622eb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f69127fc700 1 -- 172.21.15.12:0/3280117540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 msgr2=0x557b622f0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f69127fc700 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b622f0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f69127fc700 1 -- 172.21.15.12:0/3280117540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69141a17e0 con 0x557b622863c0 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f69127fc700 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b622863c0 0x557b622edac0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x557b6229ddb0 tx=0x7f690801f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90adc4e9be010997 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.677+0000 7f68f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f68f6ff5700 1 -- 172.21.15.12:0/3280117540 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908004460 con 0x557b622863c0 2023-12-11T20:20:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f692d1bbb80 1 -- 172.21.15.12:0/3280117540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6904021070 con 0x557b622863c0 2023-12-11T20:20:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f68f6ff5700 1 -- 172.21.15.12:0/3280117540 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6908010870 con 0x557b622863c0 2023-12-11T20:20:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f68f6ff5700 1 -- 172.21.15.12:0/3280117540 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6908010a30 con 0x557b622863c0 2023-12-11T20:20:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f692d1bbb80 10 client.16833 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f692d1bbb80 1 -- 172.21.15.12:0/3280117540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557b62002de0 con 0x557b622863c0 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f68f6ff5700 1 -- 172.21.15.12:0/3280117540 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6904021070 con 0x557b622863c0 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f68f6ff5700 1 -- 172.21.15.12:0/3280117540 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f69080273c0 con 0x557b622863c0 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f692d1bbb80 10 client.16833 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f692d1bbb80 10 client.16833 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f692d1bbb80 20 client.16833 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.678+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557b622f21a0 0x557b622f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.679+0000 7f692d1bbb80 4 client.16833 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.679+0000 7f692d1bbb80 1 -- 172.21.15.12:0/3280117540 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557b6219ffd0 con 0x557b622f21a0 2023-12-11T20:20:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.679+0000 7f6912ffd700 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557b622f21a0 0x557b622f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.679+0000 7f6912ffd700 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557b622f21a0 0x557b622f45c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=566da21395a23363 server_cookie=4a0b26691be227e6 in_seq=0 out_seq=0 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.679+0000 7f68f6ff5700 10 client.16833 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f68f6ff5700 1 -- 172.21.15.12:0/3280117540 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557b6219ffd0 con 0x557b622f21a0 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f68f6ff5700 10 client.16833 handle_command_reply: tid=0 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 client.16833 shutdown 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 -- 172.21.15.12:0/3280117540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b622863c0 msgr2=0x557b622edac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b622863c0 0x557b622edac0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x557b6229ddb0 tx=0x7f690801f770 comp rx=0 tx=0).stop 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 -- 172.21.15.12:0/3280117540 shutdown_connections 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557b622f21a0 0x557b622f45c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557b62286de0 0x557b622f0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557b62285a60 0x557b622eb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 --2- 172.21.15.12:0/3280117540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b622863c0 0x557b622edac0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 -- 172.21.15.12:0/3280117540 >> 172.21.15.12:0/3280117540 conn(0x557b621b47e0 msgr2=0x557b6228cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f68f6ff5700 0 client.16833 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:20:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 -- 172.21.15.12:0/3280117540 shutdown_connections 2023-12-11T20:20:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 1 -- 172.21.15.12:0/3280117540 wait complete. 2023-12-11T20:20:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.680+0000 7f692d1bbb80 20 client.16833 trim_cache size 0 max 16384 2023-12-11T20:20:43.685 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:20:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 -- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f68fc0a1520 msgr2=0x7f68fc0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f68fc0a1520 0x7f68fc0a39e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6904009c60 tx=0x7f6904009260 comp rx=0 tx=0).stop 2023-12-11T20:20:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 -- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 msgr2=0x7f69141a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 0x7f69141a08a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f690c00b780 tx=0x7f690c00bab0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 -- 172.21.15.12:0/3995770239 shutdown_connections 2023-12-11T20:20:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f68fc0a1520 0x7f68fc0a39e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6914107030 0x7f69141a08a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6914101dd0 0x7f6914199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 --2- 172.21.15.12:0/3995770239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6914104700 0x7f6914199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 -- 172.21.15.12:0/3995770239 >> 172.21.15.12:0/3995770239 conn(0x7f69140fb740 msgr2=0x7f6914101440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 -- 172.21.15.12:0/3995770239 shutdown_connections 2023-12-11T20:20:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.681+0000 7f6913fff700 1 -- 172.21.15.12:0/3995770239 wait complete. 2023-12-11T20:20:43.698 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:20:43.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:43 smithi032 ceph-mon[132488]: pgmap v519: 97 pgs: 97 active+clean; 2.9 GiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:20:43.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 -- 172.21.15.12:0/2412638153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bd4101dd0 msgr2=0x7f0bd41041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 --2- 172.21.15.12:0/2412638153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bd4101dd0 0x7f0bd41041c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009990 tx=0x7f0bd0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 -- 172.21.15.12:0/2412638153 shutdown_connections 2023-12-11T20:20:43.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 --2- 172.21.15.12:0/2412638153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bd4101dd0 0x7f0bd41041c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 --2- 172.21.15.12:0/2412638153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bd4107030 0x7f0bd4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 --2- 172.21.15.12:0/2412638153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bd4104700 0x7f0bd4106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 -- 172.21.15.12:0/2412638153 >> 172.21.15.12:0/2412638153 conn(0x7f0bd40fb740 msgr2=0x7f0bd40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 -- 172.21.15.12:0/2412638153 shutdown_connections 2023-12-11T20:20:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.920+0000 7f0bda79d700 1 -- 172.21.15.12:0/2412638153 wait complete. 2023-12-11T20:20:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.921+0000 7f0bda79d700 1 Processor -- start 2023-12-11T20:20:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.921+0000 7f0bda79d700 1 -- start start 2023-12-11T20:20:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bda79d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bd4101dd0 0x7f0bd41016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bda79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bd4104700 0x7f0bd40ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bda79d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bd4107030 0x7f0bd41002c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bda79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4100a60 con 0x7f0bd4104700 2023-12-11T20:20:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bda79d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4100bd0 con 0x7f0bd4107030 2023-12-11T20:20:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bda79d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd41a10e0 con 0x7f0bd4101dd0 2023-12-11T20:20:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bd8f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bd4104700 0x7f0bd40ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bd8f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bd4104700 0x7f0bd40ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55130/0 (socket says 172.21.15.12:55130) 2023-12-11T20:20:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bd979b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bd4101dd0 0x7f0bd41016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bd8f9a700 1 -- 172.21.15.12:0/1296038690 learned_addr learned my addr 172.21.15.12:0/1296038690 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.922+0000 7f0bd9f9c700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bd4107030 0x7f0bd41002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bd8f9a700 1 -- 172.21.15.12:0/1296038690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bd4101dd0 msgr2=0x7f0bd41016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bd4101dd0 0x7f0bd41016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bd8f9a700 1 -- 172.21.15.12:0/1296038690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bd4107030 msgr2=0x7f0bd41002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bd4107030 0x7f0bd41002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bd8f9a700 1 -- 172.21.15.12:0/1296038690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00095f0 con 0x7f0bd4104700 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bd4104700 0x7f0bd40ffd80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400e9a0 tx=0x7f0bc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bca7fc700 1 -- 172.21.15.12:0/1296038690 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4009790 con 0x7f0bd4104700 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bca7fc700 1 -- 172.21.15.12:0/1296038690 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bc400ce40 con 0x7f0bd4104700 2023-12-11T20:20:43.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bca7fc700 1 -- 172.21.15.12:0/1296038690 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4018420 con 0x7f0bd4104700 2023-12-11T20:20:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.923+0000 7f0bda79d700 1 -- 172.21.15.12:0/1296038690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd41a1370 con 0x7f0bd4104700 2023-12-11T20:20:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.924+0000 7f0bda79d700 1 -- 172.21.15.12:0/1296038690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd41a1830 con 0x7f0bd4104700 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.927+0000 7f0bca7fc700 1 -- 172.21.15.12:0/1296038690 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0bc4010430 con 0x7f0bd4104700 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.928+0000 7f0bca7fc700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bc00a1520 0x7f0bc00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.929+0000 7f0bca7fc700 1 -- 172.21.15.12:0/1296038690 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bc4014070 con 0x7f0bd4104700 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.929+0000 7f0bd979b700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bc00a1520 0x7f0bc00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.929+0000 7f0bef38ab80 1 Processor -- start 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.929+0000 7f0bef38ab80 1 -- start start 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb146ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb146d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb146e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb13c7b50 con 0x559cb146ca60 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb13c5470 con 0x559cb146dde0 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb13c0d60 con 0x559cb146d3c0 2023-12-11T20:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd979b700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bc00a1520 0x7f0bc00a39e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0006010 tx=0x7f0bd000b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd979b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb146ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd979b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb146ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55132/0 (socket says 172.21.15.12:55132) 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd979b700 1 -- 172.21.15.12:0/3437713949 learned_addr learned my addr 172.21.15.12:0/3437713949 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd8f9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb146d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd9f9c700 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb146e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd979b700 1 -- 172.21.15.12:0/3437713949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 msgr2=0x559cb146d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd979b700 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb146d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd979b700 1 -- 172.21.15.12:0/3437713949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 msgr2=0x559cb146e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.930+0000 7f0bd979b700 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb146e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.931+0000 7f0bd979b700 1 -- 172.21.15.12:0/3437713949 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cb123d630 con 0x559cb146ca60 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.931+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb146d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.931+0000 7f0bd979b700 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb146ce80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0015000 tx=0x7f0bd0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3658a55312736f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.931+0000 7f0bbf7fe700 1 -- 172.21.15.12:0/3437713949 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0003d10 con 0x559cb146ca60 2023-12-11T20:20:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.931+0000 7f0bbf7fe700 1 -- 172.21.15.12:0/3437713949 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bd001e040 con 0x559cb146ca60 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.931+0000 7f0bbf7fe700 1 -- 172.21.15.12:0/3437713949 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0004740 con 0x559cb146ca60 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 -- 172.21.15.12:0/3437713949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 msgr2=0x559cb146ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb146ce80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0015000 tx=0x7f0bd0020000 comp rx=0 tx=0).stop 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 -- 172.21.15.12:0/3437713949 shutdown_connections 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb146e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb146ce80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/3437713949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb146d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 -- 172.21.15.12:0/3437713949 >> 172.21.15.12:0/3437713949 conn(0x559cb139b7e0 msgr2=0x559cb14673d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 -- 172.21.15.12:0/3437713949 shutdown_connections 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.932+0000 7f0bef38ab80 1 -- 172.21.15.12:0/3437713949 wait complete. 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.933+0000 7f0bef38ab80 1 -- start start 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.933+0000 7f0bef38ab80 1 Processor -- start 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1476370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146d3c0 0x559cb14768b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146dde0 0x559cb147d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb137a560 con 0x559cb146dde0 2023-12-11T20:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb137a200 con 0x559cb146d3c0 2023-12-11T20:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb123f920 con 0x559cb146ca60 2023-12-11T20:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bef38ab80 10 client.0 _ll_register_callbacks cb 0x559cb12a5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd979b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1476370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd979b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1476370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49058/0 (socket says 172.21.15.12:49058) 2023-12-11T20:20:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd979b700 1 -- 172.21.15.12:0/1582365778 learned_addr learned my addr 172.21.15.12:0/1582365778 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd9f9c700 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146dde0 0x559cb147d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146d3c0 0x559cb14768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd979b700 1 -- 172.21.15.12:0/1582365778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146d3c0 msgr2=0x559cb14768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd979b700 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146d3c0 0x559cb14768b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd979b700 1 -- 172.21.15.12:0/1582365778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146dde0 msgr2=0x559cb147d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd979b700 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146dde0 0x559cb147d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.934+0000 7f0bd979b700 1 -- 172.21.15.12:0/1582365778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd41a1830 con 0x559cb146ca60 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.935+0000 7f0bd979b700 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1476370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00098e0 tx=0x7f0bd00047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=750e8b634789f594 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.935+0000 7f0bbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.935+0000 7f0bbcff9700 1 -- 172.21.15.12:0/1582365778 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0004e10 con 0x559cb146ca60 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.935+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1582365778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559cb145f9e0 con 0x559cb146ca60 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.935+0000 7f0bbcff9700 1 -- 172.21.15.12:0/1582365778 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bd000b710 con 0x559cb146ca60 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bbcff9700 1 -- 172.21.15.12:0/1582365778 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bd000b8d0 con 0x559cb146ca60 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bef38ab80 10 client.26551 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1582365778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f0bd410a030 con 0x559cb146ca60 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bbcff9700 1 -- 172.21.15.12:0/1582365778 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559cb145f9e0 con 0x559cb146ca60 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bbcff9700 1 -- 172.21.15.12:0/1582365778 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0bd000fbb0 con 0x559cb146ca60 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bef38ab80 10 client.26551 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bef38ab80 10 client.26551 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bef38ab80 20 client.26551 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559cb1481c90 0x559cb1484080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bef38ab80 4 client.26551 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.936+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1582365778 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559cb143bf40 con 0x559cb1481c90 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.937+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559cb1481c90 0x559cb1484080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.937+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559cb1481c90 0x559cb1484080 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=68027bb356060dac server_cookie=f6691d360458e280 in_seq=0 out_seq=0 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.937+0000 7f0bbcff9700 10 client.26551 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bbcff9700 1 -- 172.21.15.12:0/1582365778 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559cb143bf40 con 0x559cb1481c90 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bbcff9700 10 client.26551 handle_command_reply: tid=0 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 client.26551 shutdown 2023-12-11T20:20:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1582365778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 msgr2=0x559cb1476370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1476370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00098e0 tx=0x7f0bd00047b0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1582365778 shutdown_connections 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559cb1481c90 0x559cb1484080 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146dde0 0x559cb147d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1476370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bbcff9700 0 client.26551 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1582365778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146d3c0 0x559cb14768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1582365778 >> 172.21.15.12:0/1582365778 conn(0x559cb139b7e0 msgr2=0x559cb146b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.938+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1582365778 shutdown_connections 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.939+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1582365778 wait complete. 2023-12-11T20:20:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.939+0000 7f0bef38ab80 20 client.26551 trim_cache size 0 max 16384 2023-12-11T20:20:43.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.956+0000 7f0bef38ab80 1 Processor -- start 2023-12-11T20:20:43.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.956+0000 7f0bef38ab80 1 -- start start 2023-12-11T20:20:43.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.956+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1484080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.956+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146d3c0 0x559cb147d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.956+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb146ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.956+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb14681e0 con 0x559cb146d3c0 2023-12-11T20:20:43.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.956+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb1474da0 con 0x559cb146dde0 2023-12-11T20:20:43.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.956+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb1473fa0 con 0x559cb146ca60 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146d3c0 0x559cb147d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146d3c0 0x559cb147d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55138/0 (socket says 172.21.15.12:55138) 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 -- 172.21.15.12:0/1488668377 learned_addr learned my addr 172.21.15.12:0/1488668377 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd9f9c700 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb146ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd979b700 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1484080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 -- 172.21.15.12:0/1488668377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 msgr2=0x559cb1484080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1484080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 -- 172.21.15.12:0/1488668377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 msgr2=0x559cb146ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb146ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 -- 172.21.15.12:0/1488668377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cb11e9de0 con 0x559cb146d3c0 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.957+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146d3c0 0x559cb147d8b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ca970 tx=0x7f0bc40ca840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65051b8cd0d1945 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.958+0000 7f0bbffff700 1 -- 172.21.15.12:0/1488668377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc409e120 con 0x559cb146d3c0 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.958+0000 7f0bbffff700 1 -- 172.21.15.12:0/1488668377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bc409a190 con 0x559cb146d3c0 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.958+0000 7f0bbffff700 1 -- 172.21.15.12:0/1488668377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40998e0 con 0x559cb146d3c0 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.958+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1488668377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146d3c0 msgr2=0x559cb147d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.958+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146d3c0 0x559cb147d8b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40ca970 tx=0x7f0bc40ca840 comp rx=0 tx=0).stop 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.958+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1488668377 shutdown_connections 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.959+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb146ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.959+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146ca60 0x559cb1484080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.959+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/1488668377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146d3c0 0x559cb147d8b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.959+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1488668377 >> 172.21.15.12:0/1488668377 conn(0x559cb139b7e0 msgr2=0x559cb1467320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.959+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1488668377 shutdown_connections 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.959+0000 7f0bef38ab80 1 -- 172.21.15.12:0/1488668377 wait complete. 2023-12-11T20:20:43.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.959+0000 7f0bef38ab80 1 -- start start 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.959+0000 7f0bef38ab80 1 Processor -- start 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb14d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb14d4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bef38ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb14d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb14d72b0 con 0x559cb146ca60 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb14d7420 con 0x559cb146dde0 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bef38ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb14d75e0 con 0x559cb146d3c0 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bef38ab80 10 client.0 _ll_register_callbacks cb 0x559cb12a5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bd979b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb14d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bd979b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb14d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55146/0 (socket says 172.21.15.12:55146) 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bd979b700 1 -- 172.21.15.12:0/2958859290 learned_addr learned my addr 172.21.15.12:0/2958859290 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.960+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb14d4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bd979b700 1 -- 172.21.15.12:0/2958859290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 msgr2=0x559cb14d4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bd979b700 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb14d4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bd979b700 1 -- 172.21.15.12:0/2958859290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 msgr2=0x559cb14d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bd979b700 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb14d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bd979b700 1 -- 172.21.15.12:0/2958859290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd41a1370 con 0x559cb146ca60 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bd979b700 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb14d2120 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009ce0 tx=0x7f0bd0004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b54dffc353e97d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bbcff9700 1 -- 172.21.15.12:0/2958859290 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0030d30 con 0x559cb146ca60 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bef38ab80 1 -- 172.21.15.12:0/2958859290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559cb1462260 con 0x559cb146ca60 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.961+0000 7f0bbcff9700 1 -- 172.21.15.12:0/2958859290 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bd0004820 con 0x559cb146ca60 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bbcff9700 1 -- 172.21.15.12:0/2958859290 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bd0030e90 con 0x559cb146ca60 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bef38ab80 10 client.16851 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bef38ab80 1 -- 172.21.15.12:0/2958859290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559cb11d2c60 con 0x559cb146ca60 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bbcff9700 1 -- 172.21.15.12:0/2958859290 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559cb1462260 con 0x559cb146ca60 2023-12-11T20:20:43.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bbcff9700 1 -- 172.21.15.12:0/2958859290 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0bd000f4f0 con 0x559cb146ca60 2023-12-11T20:20:43.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bef38ab80 10 client.16851 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:43.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bef38ab80 10 client.16851 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:20:43.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bef38ab80 20 client.16851 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:43.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559cb14d8ba0 0x559cb14dafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:43.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bef38ab80 4 client.16851 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:20:43.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.962+0000 7f0bef38ab80 1 -- 172.21.15.12:0/2958859290 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f0bd001e040 con 0x559cb14d8ba0 2023-12-11T20:20:43.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.963+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559cb14d8ba0 0x559cb14dafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:43.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.963+0000 7f0bd8f9a700 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559cb14d8ba0 0x559cb14dafc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac1d87b4dcfd13d server_cookie=6e76ae61298bc497 in_seq=0 out_seq=0 2023-12-11T20:20:43.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.963+0000 7f0bbcff9700 10 client.16851 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:20:43.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.963+0000 7f0bbcff9700 1 -- 172.21.15.12:0/2958859290 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f0bd001e040 con 0x559cb14d8ba0 2023-12-11T20:20:43.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.963+0000 7f0bbcff9700 10 client.16851 handle_command_reply: tid=0 2023-12-11T20:20:43.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.963+0000 7f0bef38ab80 1 client.16851 shutdown 2023-12-11T20:20:43.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 -- 172.21.15.12:0/2958859290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 msgr2=0x559cb14d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb14d2120 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009ce0 tx=0x7f0bd0004f40 comp rx=0 tx=0).stop 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 -- 172.21.15.12:0/2958859290 shutdown_connections 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559cb14d8ba0 0x559cb14dafc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559cb146dde0 0x559cb14d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cb146ca60 0x559cb14d2120 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 --2- 172.21.15.12:0/2958859290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559cb146d3c0 0x559cb14d4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 -- 172.21.15.12:0/2958859290 >> 172.21.15.12:0/2958859290 conn(0x559cb139b7e0 msgr2=0x559cb1467320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bbcff9700 0 client.16851 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 -- 172.21.15.12:0/2958859290 shutdown_connections 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 1 -- 172.21.15.12:0/2958859290 wait complete. 2023-12-11T20:20:43.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.964+0000 7f0bef38ab80 20 client.16851 trim_cache size 0 max 16384 2023-12-11T20:20:43.967 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:20:43.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 -- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bc00a1520 msgr2=0x7f0bc00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bc00a1520 0x7f0bc00a39e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0006010 tx=0x7f0bd000b610 comp rx=0 tx=0).stop 2023-12-11T20:20:43.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 -- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bd4104700 msgr2=0x7f0bd40ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:43.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bd4104700 0x7f0bd40ffd80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400e9a0 tx=0x7f0bc400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 -- 172.21.15.12:0/1296038690 shutdown_connections 2023-12-11T20:20:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0bc00a1520 0x7f0bc00a39e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bd4107030 0x7f0bd41002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bd4101dd0 0x7f0bd41016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 --2- 172.21.15.12:0/1296038690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bd4104700 0x7f0bd40ffd80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 -- 172.21.15.12:0/1296038690 >> 172.21.15.12:0/1296038690 conn(0x7f0bd40fb740 msgr2=0x7f0bd4102830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 -- 172.21.15.12:0/1296038690 shutdown_connections 2023-12-11T20:20:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:43.965+0000 7f0bda79d700 1 -- 172.21.15.12:0/1296038690 wait complete. 2023-12-11T20:20:43.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:20:44.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 -- 172.21.15.12:0/2179464947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc104840 msgr2=0x7f0dbc106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/2179464947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc104840 0x7f0dbc106c30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009990 tx=0x7f0db0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 -- 172.21.15.12:0/2179464947 shutdown_connections 2023-12-11T20:20:44.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/2179464947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dbc107170 0x7f0dbc1095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/2179464947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dbc101f10 0x7f0dbc104300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/2179464947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc104840 0x7f0dbc106c30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 -- 172.21.15.12:0/2179464947 >> 172.21.15.12:0/2179464947 conn(0x7f0dbc0fb940 msgr2=0x7f0dbc0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:44.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 -- 172.21.15.12:0/2179464947 shutdown_connections 2023-12-11T20:20:44.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.212+0000 7f0dc1dff700 1 -- 172.21.15.12:0/2179464947 wait complete. 2023-12-11T20:20:44.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.213+0000 7f0dc1dff700 1 Processor -- start 2023-12-11T20:20:44.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dc1dff700 1 -- start start 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dc1dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc101f10 0x7f0dbc1951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dc1dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dbc104840 0x7f0dbc1956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dc1dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dbc107170 0x7f0dbc1a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dc1dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc1a5580 con 0x7f0dbc101f10 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dc1dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc1a56c0 con 0x7f0dbc104840 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dc1dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc1a5800 con 0x7f0dbc107170 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc101f10 0x7f0dbc1951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc101f10 0x7f0dbc1951a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55166/0 (socket says 172.21.15.12:55166) 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/336373651 learned_addr learned my addr 172.21.15.12:0/336373651 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.214+0000 7f0dbbfff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dbc107170 0x7f0dbc1a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dbc104840 0x7f0dbc1956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/336373651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dbc107170 msgr2=0x7f0dbc1a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dbc107170 0x7f0dbc1a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/336373651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dbc104840 msgr2=0x7f0dbc1956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dbc104840 0x7f0dbc1956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/336373651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00095f0 con 0x7f0dbc101f10 2023-12-11T20:20:44.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dbc104840 0x7f0dbc1956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:44.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc101f10 0x7f0dbc1951a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00e9d0 tx=0x7f0dac00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:44.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0db8ff9700 1 -- 172.21.15.12:0/336373651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac009790 con 0x7f0dbc101f10 2023-12-11T20:20:44.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0db8ff9700 1 -- 172.21.15.12:0/336373651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dac00cbd0 con 0x7f0dbc101f10 2023-12-11T20:20:44.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0dc1dff700 1 -- 172.21.15.12:0/336373651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc1a5ab0 con 0x7f0dbc101f10 2023-12-11T20:20:44.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.215+0000 7f0db8ff9700 1 -- 172.21.15.12:0/336373651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac018680 con 0x7f0dbc101f10 2023-12-11T20:20:44.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.216+0000 7f0dc1dff700 1 -- 172.21.15.12:0/336373651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc1a5fc0 con 0x7f0dbc101f10 2023-12-11T20:20:44.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.219+0000 7f0db8ff9700 1 -- 172.21.15.12:0/336373651 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0dac010430 con 0x7f0dbc101f10 2023-12-11T20:20:44.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.220+0000 7f0dd581db80 1 Processor -- start 2023-12-11T20:20:44.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dd581db80 1 -- start start 2023-12-11T20:20:44.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0db8ff9700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0da40a1480 0x7f0da40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac0a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac0b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac0c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dd581db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ab65b50 con 0x55793ac0bc20 2023-12-11T20:20:44.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dd581db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ab63470 con 0x55793ac0a3d0 2023-12-11T20:20:44.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dd581db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ab5ed60 con 0x55793ac0ad30 2023-12-11T20:20:44.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0db8ff9700 1 -- 172.21.15.12:0/336373651 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0dac014070 con 0x7f0dbc101f10 2023-12-11T20:20:44.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dbbfff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0da40a1480 0x7f0da40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.221+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac0a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac0c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac0b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac0a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40998/0 (socket says 172.21.15.12:40998) 2023-12-11T20:20:44.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/3261961370 learned_addr learned my addr 172.21.15.12:0/3261961370 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac0b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49108/0 (socket says 172.21.15.12:49108) 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/3261961370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 msgr2=0x55793ac0b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/3261961370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac0b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/3261961370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 msgr2=0x55793ac0c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/3261961370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac0c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/3261961370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55793a9db630 con 0x55793ac0a3d0 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbbfff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0da40a1480 0x7f0da40a3940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0db40060b0 tx=0x7f0db4009c30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.222+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/3261961370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac0a7f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0a2190 tx=0x7f0dac09a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c653dcaa40549 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.223+0000 7f0da1ffb700 1 -- 172.21.15.12:0/3261961370 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0209b0 con 0x55793ac0a3d0 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.223+0000 7f0da1ffb700 1 -- 172.21.15.12:0/3261961370 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dac017970 con 0x55793ac0a3d0 2023-12-11T20:20:44.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.223+0000 7f0da1ffb700 1 -- 172.21.15.12:0/3261961370 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac01cc60 con 0x55793ac0a3d0 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.223+0000 7f0dd581db80 1 -- 172.21.15.12:0/3261961370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 msgr2=0x55793ac0a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.223+0000 7f0dd581db80 1 --2- 172.21.15.12:0/3261961370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac0a7f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0a2190 tx=0x7f0dac09a200 comp rx=0 tx=0).stop 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.224+0000 7f0dd581db80 1 -- 172.21.15.12:0/3261961370 shutdown_connections 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.224+0000 7f0dd581db80 1 --2- 172.21.15.12:0/3261961370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac0a7f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.224+0000 7f0dd581db80 1 --2- 172.21.15.12:0/3261961370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac0c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.224+0000 7f0dd581db80 1 --2- 172.21.15.12:0/3261961370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac0b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.224+0000 7f0dd581db80 1 -- 172.21.15.12:0/3261961370 >> 172.21.15.12:0/3261961370 conn(0x55793ab397e0 msgr2=0x55793ac06d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.224+0000 7f0dd581db80 1 -- 172.21.15.12:0/3261961370 shutdown_connections 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.224+0000 7f0dd581db80 1 -- 172.21.15.12:0/3261961370 wait complete. 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.224+0000 7f0dd581db80 1 -- start start 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.225+0000 7f0dd581db80 1 Processor -- start 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.225+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac141b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.225+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac146f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.225+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac1b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.225+0000 7f0dd581db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ab18560 con 0x55793ac0bc20 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.225+0000 7f0dd581db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ab18200 con 0x55793ac0a3d0 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.225+0000 7f0dd581db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793a9dd920 con 0x55793ac0ad30 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.225+0000 7f0dd581db80 10 client.0 _ll_register_callbacks cb 0x55793aa43a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac1b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac1b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55178/0 (socket says 172.21.15.12:55178) 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 -- 172.21.15.12:0/2980981074 learned_addr learned my addr 172.21.15.12:0/2980981074 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac146f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 -- 172.21.15.12:0/2980981074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 msgr2=0x55793ac146f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac146f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 -- 172.21.15.12:0/2980981074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 msgr2=0x55793ac141b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:44.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac141b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 -- 172.21.15.12:0/2980981074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc1a5fc0 con 0x55793ac0bc20 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac146f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac141b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0dbbfff700 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac1b730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0db4018d60 tx=0x7f0db4009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd955e1e3c836cb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.226+0000 7f0d9affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.227+0000 7f0d9affd700 1 -- 172.21.15.12:0/2980981074 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40092d0 con 0x55793ac0bc20 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.227+0000 7f0dd581db80 1 -- 172.21.15.12:0/2980981074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55793abfdb40 con 0x55793ac0bc20 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.227+0000 7f0d9affd700 1 -- 172.21.15.12:0/2980981074 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0db401ac60 con 0x55793ac0bc20 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.227+0000 7f0d9affd700 1 -- 172.21.15.12:0/2980981074 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0db40099a0 con 0x55793ac0bc20 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.227+0000 7f0dd581db80 10 client.16863 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.227+0000 7f0dd581db80 1 -- 172.21.15.12:0/2980981074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55793a987de0 con 0x55793ac0bc20 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.227+0000 7f0d9affd700 1 -- 172.21.15.12:0/2980981074 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0db4034080 con 0x55793ac0bc20 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.228+0000 7f0d9affd700 1 -- 172.21.15.12:0/2980981074 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0db4025420 con 0x55793ac0bc20 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.228+0000 7f0dd581db80 10 client.16863 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:44.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.228+0000 7f0dd581db80 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:44.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.228+0000 7f0dd581db80 20 client.16863 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:44.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.228+0000 7f0dd581db80 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55793ac1ff80 0x55793ac223a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.228+0000 7f0dd581db80 4 client.16863 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:44.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.228+0000 7f0dd581db80 1 -- 172.21.15.12:0/2980981074 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55793abd9f40 con 0x55793ac1ff80 2023-12-11T20:20:44.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.228+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55793ac1ff80 0x55793ac223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.229+0000 7f0d9affd700 10 client.16863 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:44.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.229+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55793ac1ff80 0x55793ac223a0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f04b81981b7e4d server_cookie=752a49ae01ef16b9 in_seq=0 out_seq=0 2023-12-11T20:20:44.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0d9affd700 1 -- 172.21.15.12:0/2980981074 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55793abd9f40 con 0x55793ac1ff80 2023-12-11T20:20:44.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0d9affd700 10 client.16863 handle_command_reply: tid=0 2023-12-11T20:20:44.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 client.16863 shutdown 2023-12-11T20:20:44.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 -- 172.21.15.12:0/2980981074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 msgr2=0x55793ac1b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac1b730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0db4018d60 tx=0x7f0db4009050 comp rx=0 tx=0).stop 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 -- 172.21.15.12:0/2980981074 shutdown_connections 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55793ac1ff80 0x55793ac223a0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac141b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0bc20 0x55793ac1b730 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 --2- 172.21.15.12:0/2980981074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac146f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0d9affd700 0 client.16863 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 -- 172.21.15.12:0/2980981074 >> 172.21.15.12:0/2980981074 conn(0x55793ab397e0 msgr2=0x55793ac05a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 -- 172.21.15.12:0/2980981074 shutdown_connections 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.230+0000 7f0dd581db80 1 -- 172.21.15.12:0/2980981074 wait complete. 2023-12-11T20:20:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.231+0000 7f0dd581db80 20 client.16863 trim_cache size 0 max 16384 2023-12-11T20:20:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.247+0000 7f0dd581db80 1 Processor -- start 2023-12-11T20:20:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dd581db80 1 -- start start 2023-12-11T20:20:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac1bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0ad30 0x55793ac1b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0bc20 0x55793ac0c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dd581db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ac01b70 con 0x55793ac0ad30 2023-12-11T20:20:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dd581db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ac01790 con 0x55793ac0a3d0 2023-12-11T20:20:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dd581db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ac275d0 con 0x55793ac0bc20 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dbaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0ad30 0x55793ac1b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dbaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0ad30 0x55793ac1b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55180/0 (socket says 172.21.15.12:55180) 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dbaffd700 1 -- 172.21.15.12:0/737519446 learned_addr learned my addr 172.21.15.12:0/737519446 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.248+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac1bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0dbbfff700 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0bc20 0x55793ac0c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/737519446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0bc20 msgr2=0x55793ac0c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0bc20 0x55793ac0c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/737519446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0ad30 msgr2=0x55793ac1b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0ad30 0x55793ac1b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/737519446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55793a970c60 con 0x55793ac0a3d0 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0ad30 0x55793ac1b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac1bde0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00cf60 tx=0x7f0dac011f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e34e7ac0dd90079 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0da27fc700 1 -- 172.21.15.12:0/737519446 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac09aa30 con 0x55793ac0a3d0 2023-12-11T20:20:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0da27fc700 1 -- 172.21.15.12:0/737519446 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dac09e480 con 0x55793ac0a3d0 2023-12-11T20:20:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.249+0000 7f0da27fc700 1 -- 172.21.15.12:0/737519446 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0cac20 con 0x55793ac0a3d0 2023-12-11T20:20:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 -- 172.21.15.12:0/737519446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 msgr2=0x55793ac1bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac1bde0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00cf60 tx=0x7f0dac011f90 comp rx=0 tx=0).stop 2023-12-11T20:20:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 -- 172.21.15.12:0/737519446 shutdown_connections 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0a3d0 0x55793ac1bde0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0bc20 0x55793ac0c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 --2- 172.21.15.12:0/737519446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0ad30 0x55793ac1b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 -- 172.21.15.12:0/737519446 >> 172.21.15.12:0/737519446 conn(0x55793ab397e0 msgr2=0x55793ac121b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 -- 172.21.15.12:0/737519446 shutdown_connections 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.250+0000 7f0dd581db80 1 -- 172.21.15.12:0/737519446 wait complete. 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.251+0000 7f0dd581db80 1 -- start start 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.251+0000 7f0dd581db80 1 Processor -- start 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.251+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0a3d0 0x55793ac19030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.251+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac19570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.251+0000 7f0dd581db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0bc20 0x55793ac1a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.251+0000 7f0dd581db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ac1aa70 con 0x55793ac0a3d0 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.251+0000 7f0dd581db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ac1abe0 con 0x55793ac0bc20 2023-12-11T20:20:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.251+0000 7f0dd581db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55793ac1ada0 con 0x55793ac0ad30 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dd581db80 10 client.0 _ll_register_callbacks cb 0x55793aa43a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0a3d0 0x55793ac19030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0a3d0 0x55793ac19030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55184/0 (socket says 172.21.15.12:55184) 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/1541118110 learned_addr learned my addr 172.21.15.12:0/1541118110 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbbfff700 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0bc20 0x55793ac1a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac19570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/1541118110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 msgr2=0x55793ac19570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac19570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/1541118110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0bc20 msgr2=0x55793ac1a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0bc20 0x55793ac1a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 -- 172.21.15.12:0/1541118110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc10a1d0 con 0x55793ac0a3d0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac19570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0dbb7fe700 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0a3d0 0x55793ac19030 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0dac09a2c0 tx=0x7f0dac010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61152c91e6224c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.252+0000 7f0d9affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.253+0000 7f0d9affd700 1 -- 172.21.15.12:0/1541118110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0cac20 con 0x55793ac0a3d0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.253+0000 7f0d9affd700 1 -- 172.21.15.12:0/1541118110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0dac017ae0 con 0x55793ac0a3d0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.253+0000 7f0dd581db80 1 -- 172.21.15.12:0/1541118110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0dac017970 con 0x55793ac0a3d0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.253+0000 7f0d9affd700 1 -- 172.21.15.12:0/1541118110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dac017ca0 con 0x55793ac0a3d0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.253+0000 7f0dd581db80 10 client.16869 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.253+0000 7f0dd581db80 1 -- 172.21.15.12:0/1541118110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55793a9db630 con 0x55793ac0a3d0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.253+0000 7f0d9affd700 1 -- 172.21.15.12:0/1541118110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dac017970 con 0x55793ac0a3d0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.253+0000 7f0d9affd700 1 -- 172.21.15.12:0/1541118110 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0dac09a590 con 0x55793ac0a3d0 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.254+0000 7f0dd581db80 10 client.16869 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.254+0000 7f0dd581db80 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.254+0000 7f0dd581db80 20 client.16869 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.254+0000 7f0dd581db80 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55793ac76b30 0x55793ac78f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.254+0000 7f0dd581db80 4 client.16869 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:20:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.254+0000 7f0dd581db80 1 -- 172.21.15.12:0/1541118110 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55793ab24fd0 con 0x55793ac76b30 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.254+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55793ac76b30 0x55793ac78f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dbaffd700 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55793ac76b30 0x55793ac78f20 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab361b5e2daad3d server_cookie=700e648ac19dec5e in_seq=0 out_seq=0 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0d9affd700 10 client.16869 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0d9affd700 1 -- 172.21.15.12:0/1541118110 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55793ab24fd0 con 0x55793ac76b30 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0d9affd700 10 client.16869 handle_command_reply: tid=0 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 client.16869 shutdown 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 -- 172.21.15.12:0/1541118110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0a3d0 msgr2=0x55793ac19030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0a3d0 0x55793ac19030 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0dac09a2c0 tx=0x7f0dac010b70 comp rx=0 tx=0).stop 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 -- 172.21.15.12:0/1541118110 shutdown_connections 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55793ac76b30 0x55793ac78f20 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55793ac0bc20 0x55793ac1a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55793ac0a3d0 0x55793ac19030 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0d9affd700 0 client.16869 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 --2- 172.21.15.12:0/1541118110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55793ac0ad30 0x55793ac19570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 -- 172.21.15.12:0/1541118110 >> 172.21.15.12:0/1541118110 conn(0x55793ab397e0 msgr2=0x55793ac14150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 -- 172.21.15.12:0/1541118110 shutdown_connections 2023-12-11T20:20:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.255+0000 7f0dd581db80 1 -- 172.21.15.12:0/1541118110 wait complete. 2023-12-11T20:20:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dd581db80 20 client.16869 trim_cache size 0 max 16384 2023-12-11T20:20:44.258 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 -- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0da40a1480 msgr2=0x7f0da40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0da40a1480 0x7f0da40a3940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0db40060b0 tx=0x7f0db4009c30 comp rx=0 tx=0).stop 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 -- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc101f10 msgr2=0x7f0dbc1951a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc101f10 0x7f0dbc1951a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00e9d0 tx=0x7f0dac00ed90 comp rx=0 tx=0).stop 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 -- 172.21.15.12:0/336373651 shutdown_connections 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0da40a1480 0x7f0da40a3940 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0dbc107170 0x7f0dbc1a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dbc101f10 0x7f0dbc1951a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 --2- 172.21.15.12:0/336373651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0dbc104840 0x7f0dbc1956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:44.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 -- 172.21.15.12:0/336373651 >> 172.21.15.12:0/336373651 conn(0x7f0dbc0fb940 msgr2=0x7f0dbc1016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:44.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.256+0000 7f0dc1dff700 1 -- 172.21.15.12:0/336373651 shutdown_connections 2023-12-11T20:20:44.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:44.257+0000 7f0dc1dff700 1 -- 172.21.15.12:0/336373651 wait complete. 2023-12-11T20:20:44.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:44 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3950292721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:20:44.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:44 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3950292721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:20:44.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:44 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3950292721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:20:45.276 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:20:45.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:20:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.528+0000 7f5dce7ff700 1 -- 172.21.15.12:0/355411019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8075610 msgr2=0x7f5dc8073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.528+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/355411019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8075610 0x7f5dc8073a60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009990 tx=0x7f5db8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.529+0000 7f5dce7ff700 1 -- 172.21.15.12:0/355411019 shutdown_connections 2023-12-11T20:20:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.529+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/355411019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dc810da80 0x7f5dc810fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.529+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/355411019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8075610 0x7f5dc8073a60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.529+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/355411019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dc8074030 0x7f5dc80744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.529+0000 7f5dce7ff700 1 -- 172.21.15.12:0/355411019 >> 172.21.15.12:0/355411019 conn(0x7f5dc80fca00 msgr2=0x7f5dc80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.529+0000 7f5dce7ff700 1 -- 172.21.15.12:0/355411019 shutdown_connections 2023-12-11T20:20:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.529+0000 7f5dce7ff700 1 -- 172.21.15.12:0/355411019 wait complete. 2023-12-11T20:20:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.530+0000 7f5dce7ff700 1 Processor -- start 2023-12-11T20:20:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.530+0000 7f5dce7ff700 1 -- start start 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.530+0000 7f5dce7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8074030 0x7f5dc819d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.530+0000 7f5dce7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dc8075610 0x7f5dc819de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.530+0000 7f5dce7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dc810da80 0x7f5dc81a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.530+0000 7f5dce7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81a5450 con 0x7f5dc8074030 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.530+0000 7f5dce7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81a5590 con 0x7f5dc810da80 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.530+0000 7f5dce7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81a5720 con 0x7f5dc8075610 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8074030 0x7f5dc819d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8074030 0x7f5dc819d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55202/0 (socket says 172.21.15.12:55202) 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 -- 172.21.15.12:0/1503863239 learned_addr learned my addr 172.21.15.12:0/1503863239 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dc810da80 0x7f5dc81a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc77fe700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dc8075610 0x7f5dc819de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 -- 172.21.15.12:0/1503863239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dc8075610 msgr2=0x7f5dc819de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dc8075610 0x7f5dc819de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 -- 172.21.15.12:0/1503863239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dc810da80 msgr2=0x7f5dc81a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dc810da80 0x7f5dc81a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 -- 172.21.15.12:0/1503863239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80095f0 con 0x7f5dc8074030 2023-12-11T20:20:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.531+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8074030 0x7f5dc819d920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5db8000c00 tx=0x7f5db8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.532+0000 7f5dc57fa700 1 -- 172.21.15.12:0/1503863239 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db801d070 con 0x7f5dc8074030 2023-12-11T20:20:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.532+0000 7f5dc57fa700 1 -- 172.21.15.12:0/1503863239 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db8003f40 con 0x7f5dc8074030 2023-12-11T20:20:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.532+0000 7f5dce7ff700 1 -- 172.21.15.12:0/1503863239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc81a59a0 con 0x7f5dc8074030 2023-12-11T20:20:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.532+0000 7f5dc57fa700 1 -- 172.21.15.12:0/1503863239 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8022b70 con 0x7f5dc8074030 2023-12-11T20:20:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.532+0000 7f5dce7ff700 1 -- 172.21.15.12:0/1503863239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc81a5dc0 con 0x7f5dc8074030 2023-12-11T20:20:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.535+0000 7f5dc57fa700 1 -- 172.21.15.12:0/1503863239 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5db8003ab0 con 0x7f5dc8074030 2023-12-11T20:20:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.537+0000 7f5de213db80 1 Processor -- start 2023-12-11T20:20:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.537+0000 7f5de213db80 1 -- start start 2023-12-11T20:20:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.537+0000 7f5dc57fa700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5db00a1480 0x7f5db00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.537+0000 7f5dc57fa700 1 -- 172.21.15.12:0/1503863239 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5db80ce500 con 0x7f5dc8074030 2023-12-11T20:20:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5de213db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca841870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5de213db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 0x55f4ca8426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5de213db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca843120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5de213db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca79cbd0 con 0x55f4ca841450 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5de213db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca79a4f0 con 0x55f4ca841db0 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5de213db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca795de0 con 0x55f4ca842ca0 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5db00a1480 0x7f5db00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5dc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca841870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5dc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca841870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55206/0 (socket says 172.21.15.12:55206) 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5dc7fff700 1 -- 172.21.15.12:0/3360542615 learned_addr learned my addr 172.21.15.12:0/3360542615 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5db00a1480 0x7f5db00a3940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0003f30 tx=0x7f5dc0009c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca843120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.538+0000 7f5dc77fe700 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 0x55f4ca8426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dc7fff700 1 -- 172.21.15.12:0/3360542615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 msgr2=0x55f4ca843120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca843120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dc7fff700 1 -- 172.21.15.12:0/3360542615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 msgr2=0x55f4ca8426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 0x55f4ca8426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dc7fff700 1 -- 172.21.15.12:0/3360542615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4ca6126b0 con 0x55f4ca841450 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca841870 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5db8098390 tx=0x7f5db8005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6945bcb71df17eb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dae7fc700 1 -- 172.21.15.12:0/3360542615 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db809fa70 con 0x55f4ca841450 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dae7fc700 1 -- 172.21.15.12:0/3360542615 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db80a3c20 con 0x55f4ca841450 2023-12-11T20:20:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.539+0000 7f5dae7fc700 1 -- 172.21.15.12:0/3360542615 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80ce0f0 con 0x55f4ca841450 2023-12-11T20:20:45.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 -- 172.21.15.12:0/3360542615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 msgr2=0x55f4ca841870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca841870 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5db8098390 tx=0x7f5db8005ac0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 -- 172.21.15.12:0/3360542615 shutdown_connections 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca843120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca841870 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 --2- 172.21.15.12:0/3360542615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 0x55f4ca8426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 -- 172.21.15.12:0/3360542615 >> 172.21.15.12:0/3360542615 conn(0x55f4ca770860 msgr2=0x55f4ca83de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 -- 172.21.15.12:0/3360542615 shutdown_connections 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.540+0000 7f5de213db80 1 -- 172.21.15.12:0/3360542615 wait complete. 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.541+0000 7f5de213db80 1 -- start start 2023-12-11T20:20:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.541+0000 7f5de213db80 1 Processor -- start 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.541+0000 7f5de213db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 0x55f4ca84aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5de213db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca84b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5de213db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca852450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5de213db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca74f5e0 con 0x55f4ca841db0 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5de213db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca74f280 con 0x55f4ca842ca0 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5de213db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca6149a0 con 0x55f4ca841450 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5de213db80 10 client.0 _ll_register_callbacks cb 0x55f4ca67ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca84b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca84b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55212/0 (socket says 172.21.15.12:55212) 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca852450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dc77fe700 1 -- 172.21.15.12:0/2012791512 learned_addr learned my addr 172.21.15.12:0/2012791512 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 0x55f4ca84aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dccd9c700 1 -- 172.21.15.12:0/2012791512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 msgr2=0x55f4ca84aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 0x55f4ca84aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dccd9c700 1 -- 172.21.15.12:0/2012791512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 msgr2=0x55f4ca84b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca84b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dccd9c700 1 -- 172.21.15.12:0/2012791512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc81a5dc0 con 0x55f4ca842ca0 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.542+0000 7f5dc77fe700 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca84b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.543+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca852450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009fd0 tx=0x7f5dc0004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=358177f0b7cdb8d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.543+0000 7f5da77fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.543+0000 7f5da77fe700 1 -- 172.21.15.12:0/2012791512 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0004bb0 con 0x55f4ca842ca0 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.543+0000 7f5de213db80 1 -- 172.21.15.12:0/2012791512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4ca834bc0 con 0x55f4ca842ca0 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.543+0000 7f5da77fe700 1 -- 172.21.15.12:0/2012791512 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5dc0004d10 con 0x55f4ca842ca0 2023-12-11T20:20:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.543+0000 7f5da77fe700 1 -- 172.21.15.12:0/2012791512 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dc0017670 con 0x55f4ca842ca0 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.543+0000 7f5de213db80 10 client.26594 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.543+0000 7f5de213db80 1 -- 172.21.15.12:0/2012791512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f4ca5bee60 con 0x55f4ca842ca0 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.544+0000 7f5da77fe700 1 -- 172.21.15.12:0/2012791512 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4ca834bc0 con 0x55f4ca842ca0 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.544+0000 7f5da77fe700 1 -- 172.21.15.12:0/2012791512 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5dc002b6e0 con 0x55f4ca842ca0 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.544+0000 7f5de213db80 10 client.26594 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.544+0000 7f5de213db80 10 client.26594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.544+0000 7f5de213db80 20 client.26594 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.544+0000 7f5de213db80 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4ca856d30 0x55f4ca859150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.544+0000 7f5de213db80 4 client.26594 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.544+0000 7f5de213db80 1 -- 172.21.15.12:0/2012791512 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4ca810fc0 con 0x55f4ca856d30 2023-12-11T20:20:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.545+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4ca856d30 0x55f4ca859150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.545+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4ca856d30 0x55f4ca859150 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddf639ab28b2e23e server_cookie=c1f8e1e96d8edfce in_seq=0 out_seq=0 2023-12-11T20:20:45.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.545+0000 7f5da77fe700 10 client.26594 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:45.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5da77fe700 1 -- 172.21.15.12:0/2012791512 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f4ca810fc0 con 0x55f4ca856d30 2023-12-11T20:20:45.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5da77fe700 10 client.26594 handle_command_reply: tid=0 2023-12-11T20:20:45.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 client.26594 shutdown 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 -- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 msgr2=0x55f4ca852450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca852450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009fd0 tx=0x7f5dc0004b40 comp rx=0 tx=0).stop 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 -- 172.21.15.12:0/2012791512 shutdown_connections 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4ca856d30 0x55f4ca859150 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca852450 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 0x55f4ca84aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 --2- 172.21.15.12:0/2012791512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca84b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5de213db80 1 -- 172.21.15.12:0/2012791512 >> 172.21.15.12:0/2012791512 conn(0x55f4ca770860 msgr2=0x55f4ca83cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.546+0000 7f5da77fe700 0 client.26594 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:45.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.547+0000 7f5de213db80 1 -- 172.21.15.12:0/2012791512 shutdown_connections 2023-12-11T20:20:45.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.547+0000 7f5de213db80 1 -- 172.21.15.12:0/2012791512 wait complete. 2023-12-11T20:20:45.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.547+0000 7f5de213db80 20 client.26594 trim_cache size 0 max 16384 2023-12-11T20:20:45.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.570+0000 7f5de213db80 1 Processor -- start 2023-12-11T20:20:45.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.570+0000 7f5de213db80 1 -- start start 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5de213db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca845c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5de213db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 0x55f4ca846180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5de213db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca852410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5de213db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca8535d0 con 0x55f4ca841450 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5de213db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca84aa40 con 0x55f4ca841db0 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5de213db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca84c0c0 con 0x55f4ca842ca0 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5dc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca845c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5dc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca845c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55218/0 (socket says 172.21.15.12:55218) 2023-12-11T20:20:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5dc7fff700 1 -- 172.21.15.12:0/912632125 learned_addr learned my addr 172.21.15.12:0/912632125 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca852410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.571+0000 7f5dc77fe700 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 0x55f4ca846180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5dccd9c700 1 -- 172.21.15.12:0/912632125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 msgr2=0x55f4ca846180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 0x55f4ca846180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5dccd9c700 1 -- 172.21.15.12:0/912632125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 msgr2=0x55f4ca845c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca845c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5dccd9c700 1 -- 172.21.15.12:0/912632125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4ca5a7ce0 con 0x55f4ca842ca0 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca845c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca852410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0004320 tx=0x7f5dc0009100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60acf8cff553c5e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5daeffd700 1 -- 172.21.15.12:0/912632125 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0008d50 con 0x55f4ca842ca0 2023-12-11T20:20:45.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5daeffd700 1 -- 172.21.15.12:0/912632125 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc000f040 con 0x55f4ca842ca0 2023-12-11T20:20:45.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.572+0000 7f5daeffd700 1 -- 172.21.15.12:0/912632125 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0017670 con 0x55f4ca842ca0 2023-12-11T20:20:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 -- 172.21.15.12:0/912632125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 msgr2=0x55f4ca852410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca852410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0004320 tx=0x7f5dc0009100 comp rx=0 tx=0).stop 2023-12-11T20:20:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 -- 172.21.15.12:0/912632125 shutdown_connections 2023-12-11T20:20:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca842ca0 0x55f4ca852410 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841450 0x55f4ca845c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 --2- 172.21.15.12:0/912632125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca841db0 0x55f4ca846180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 -- 172.21.15.12:0/912632125 >> 172.21.15.12:0/912632125 conn(0x55f4ca770860 msgr2=0x55f4ca84aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 -- 172.21.15.12:0/912632125 shutdown_connections 2023-12-11T20:20:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 -- 172.21.15.12:0/912632125 wait complete. 2023-12-11T20:20:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.573+0000 7f5de213db80 1 -- start start 2023-12-11T20:20:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5de213db80 1 Processor -- start 2023-12-11T20:20:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5de213db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 0x55f4ca852490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5de213db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca850b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5de213db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca851120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5de213db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca851880 con 0x55f4ca841db0 2023-12-11T20:20:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5de213db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca8519f0 con 0x55f4ca842ca0 2023-12-11T20:20:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5de213db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4ca8ad2a0 con 0x55f4ca841450 2023-12-11T20:20:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5de213db80 10 client.0 _ll_register_callbacks cb 0x55f4ca67ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca850b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dccd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca851120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.574+0000 7f5dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca850b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55230/0 (socket says 172.21.15.12:55230) 2023-12-11T20:20:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dc77fe700 1 -- 172.21.15.12:0/596331145 learned_addr learned my addr 172.21.15.12:0/596331145 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 0x55f4ca852490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dccd9c700 1 -- 172.21.15.12:0/596331145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 msgr2=0x55f4ca852490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 0x55f4ca852490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dccd9c700 1 -- 172.21.15.12:0/596331145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 msgr2=0x55f4ca850b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca850b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dccd9c700 1 -- 172.21.15.12:0/596331145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4ca6126b0 con 0x55f4ca842ca0 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dc77fe700 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca850b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5dccd9c700 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca851120 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0004320 tx=0x7f5dc00178a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751c3bd3ccc887a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.575+0000 7f5da77fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5da77fe700 1 -- 172.21.15.12:0/596331145 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0008d50 con 0x55f4ca842ca0 2023-12-11T20:20:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5da77fe700 1 -- 172.21.15.12:0/596331145 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5dc0004dd0 con 0x55f4ca842ca0 2023-12-11T20:20:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 1 -- 172.21.15.12:0/596331145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5db80a3c20 con 0x55f4ca842ca0 2023-12-11T20:20:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5da77fe700 1 -- 172.21.15.12:0/596331145 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dc002b8d0 con 0x55f4ca842ca0 2023-12-11T20:20:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 10 client.26600 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 1 -- 172.21.15.12:0/596331145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f4ca5bee60 con 0x55f4ca842ca0 2023-12-11T20:20:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5da77fe700 1 -- 172.21.15.12:0/596331145 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db80a3c20 con 0x55f4ca842ca0 2023-12-11T20:20:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5da77fe700 1 -- 172.21.15.12:0/596331145 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5dc0044070 con 0x55f4ca842ca0 2023-12-11T20:20:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 10 client.26600 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 10 client.26600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 20 client.26600 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4ca8ae950 0x55f4ca8b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 4 client.26600 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:20:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.576+0000 7f5de213db80 1 -- 172.21.15.12:0/596331145 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f4ca75c050 con 0x55f4ca8ae950 2023-12-11T20:20:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.577+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4ca8ae950 0x55f4ca8b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.577+0000 7f5da77fe700 10 client.26600 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.577+0000 7f5dc7fff700 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4ca8ae950 0x55f4ca8b0d70 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b05922d6169a55f0 server_cookie=77766bf0a17907cd in_seq=0 out_seq=0 2023-12-11T20:20:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5da77fe700 1 -- 172.21.15.12:0/596331145 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f4ca75c050 con 0x55f4ca8ae950 2023-12-11T20:20:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5da77fe700 10 client.26600 handle_command_reply: tid=0 2023-12-11T20:20:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 client.26600 shutdown 2023-12-11T20:20:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 -- 172.21.15.12:0/596331145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 msgr2=0x55f4ca851120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca851120 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0004320 tx=0x7f5dc00178a0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 -- 172.21.15.12:0/596331145 shutdown_connections 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4ca8ae950 0x55f4ca8b0d70 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4ca842ca0 0x55f4ca851120 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4ca841450 0x55f4ca852490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 --2- 172.21.15.12:0/596331145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4ca841db0 0x55f4ca850b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5da77fe700 0 client.26600 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 -- 172.21.15.12:0/596331145 >> 172.21.15.12:0/596331145 conn(0x55f4ca770860 msgr2=0x55f4ca84ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 -- 172.21.15.12:0/596331145 shutdown_connections 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.579+0000 7f5de213db80 1 -- 172.21.15.12:0/596331145 wait complete. 2023-12-11T20:20:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5de213db80 20 client.26600 trim_cache size 0 max 16384 2023-12-11T20:20:45.588 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:20:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:20:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "10203f79-66aa-46fc-98d1-a1073253068c", 2023-12-11T20:20:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:20:45.588 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:20:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 -- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5db00a1480 msgr2=0x7f5db00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5db00a1480 0x7f5db00a3940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0003f30 tx=0x7f5dc0009c50 comp rx=0 tx=0).stop 2023-12-11T20:20:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 -- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8074030 msgr2=0x7f5dc819d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8074030 0x7f5dc819d920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5db8000c00 tx=0x7f5db8004730 comp rx=0 tx=0).stop 2023-12-11T20:20:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 -- 172.21.15.12:0/1503863239 shutdown_connections 2023-12-11T20:20:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5db00a1480 0x7f5db00a3940 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5dc810da80 0x7f5dc81a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dc8074030 0x7f5dc819d920 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 --2- 172.21.15.12:0/1503863239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dc8075610 0x7f5dc819de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.580+0000 7f5dce7ff700 1 -- 172.21.15.12:0/1503863239 >> 172.21.15.12:0/1503863239 conn(0x7f5dc80fca00 msgr2=0x7f5dc8100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.581+0000 7f5dce7ff700 1 -- 172.21.15.12:0/1503863239 shutdown_connections 2023-12-11T20:20:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.581+0000 7f5dce7ff700 1 -- 172.21.15.12:0/1503863239 wait complete. 2023-12-11T20:20:45.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:45 smithi012 ceph-mon[128787]: pgmap v520: 97 pgs: 97 active+clean; 2.9 GiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:20:45.602 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:20:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:45 smithi032 ceph-mon[132488]: pgmap v520: 97 pgs: 97 active+clean; 2.9 GiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:20:45.713 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:20:45 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:20:45.589+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v122>,<0x10000000003/client.0 v124>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v141>,<0x10000000001/sv_0 v165>,<0x10000000000/_nogroup v149>,<0x1/volumes v141>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:20:45.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:45 smithi039 ceph-mon[102205]: pgmap v520: 97 pgs: 97 active+clean; 2.9 GiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:20:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.832+0000 7f6161bff700 1 -- 172.21.15.12:0/2176404715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 msgr2=0x7f615c102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.832+0000 7f6161bff700 1 --2- 172.21.15.12:0/2176404715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 0x7f615c102b00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f61500099c0 tx=0x7f6150009cd0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.833+0000 7f6161bff700 1 -- 172.21.15.12:0/2176404715 shutdown_connections 2023-12-11T20:20:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.833+0000 7f6161bff700 1 --2- 172.21.15.12:0/2176404715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f615c103040 0x7f615c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.833+0000 7f6161bff700 1 --2- 172.21.15.12:0/2176404715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f615c1014b0 0x7f615c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.833+0000 7f6161bff700 1 --2- 172.21.15.12:0/2176404715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 0x7f615c102b00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.833+0000 7f6161bff700 1 -- 172.21.15.12:0/2176404715 >> 172.21.15.12:0/2176404715 conn(0x7f615c0fca00 msgr2=0x7f615c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.833+0000 7f6161bff700 1 -- 172.21.15.12:0/2176404715 shutdown_connections 2023-12-11T20:20:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.833+0000 7f6161bff700 1 -- 172.21.15.12:0/2176404715 wait complete. 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.834+0000 7f6161bff700 1 Processor -- start 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.834+0000 7f6161bff700 1 -- start start 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.834+0000 7f6161bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f615c1014b0 0x7f615c075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.834+0000 7f6161bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 0x7f615c0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.834+0000 7f6161bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f615c103040 0x7f615c073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.834+0000 7f6161bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0746a0 con 0x7f615c1026a0 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.834+0000 7f6161bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c074810 con 0x7f615c1014b0 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.834+0000 7f6161bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1a13d0 con 0x7f615c103040 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 0x7f615c0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f615c1014b0 0x7f615c075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 0x7f615c0739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55256/0 (socket says 172.21.15.12:55256) 2023-12-11T20:20:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 -- 172.21.15.12:0/3372160580 learned_addr learned my addr 172.21.15.12:0/3372160580 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615bfff700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f615c103040 0x7f615c073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 -- 172.21.15.12:0/3372160580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f615c103040 msgr2=0x7f615c073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f615c103040 0x7f615c073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 -- 172.21.15.12:0/3372160580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f615c1014b0 msgr2=0x7f615c075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f615c1014b0 0x7f615c075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 -- 172.21.15.12:0/3372160580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500095f0 con 0x7f615c1026a0 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615bfff700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f615c103040 0x7f615c073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.835+0000 7f615affd700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 0x7f615c0739c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6150009fd0 tx=0x7f615000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.836+0000 7f6158ff9700 1 -- 172.21.15.12:0/3372160580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615001d070 con 0x7f615c1026a0 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.836+0000 7f6158ff9700 1 -- 172.21.15.12:0/3372160580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f615000bd10 con 0x7f615c1026a0 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.836+0000 7f6161bff700 1 -- 172.21.15.12:0/3372160580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c1a1600 con 0x7f615c1026a0 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.836+0000 7f6158ff9700 1 -- 172.21.15.12:0/3372160580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150004bb0 con 0x7f615c1026a0 2023-12-11T20:20:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.836+0000 7f6161bff700 1 -- 172.21.15.12:0/3372160580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c1a19c0 con 0x7f615c1026a0 2023-12-11T20:20:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.840+0000 7f6158ff9700 1 -- 172.21.15.12:0/3372160580 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6150004d10 con 0x7f615c1026a0 2023-12-11T20:20:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.841+0000 7f6158ff9700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61440a1480 0x7f61440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.841+0000 7f6158ff9700 1 -- 172.21.15.12:0/3372160580 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f61500cdc60 con 0x7f615c1026a0 2023-12-11T20:20:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.841+0000 7f615b7fe700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61440a1480 0x7f61440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f6175443b80 1 Processor -- start 2023-12-11T20:20:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f6175443b80 1 -- start start 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f615b7fe700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61440a1480 0x7f61440a3940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f615c102500 tx=0x7f614c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f6175443b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f6175443b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b3c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f6175443b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b3d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f6175443b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1a96b50 con 0x5628b1b3bd30 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f6175443b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1a94470 con 0x5628b1b3b3d0 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.842+0000 7f6175443b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1a8fd60 con 0x5628b1b3cc20 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b3c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:41134/0 (socket says 172.21.15.12:41134) 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615b7fe700 1 -- 172.21.15.12:0/3214293719 learned_addr learned my addr 172.21.15.12:0/3214293719 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615affd700 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b3c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55262/0 (socket says 172.21.15.12:55262) 2023-12-11T20:20:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615bfff700 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b3d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615affd700 1 -- 172.21.15.12:0/3214293719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 msgr2=0x5628b1b3d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615affd700 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b3d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615affd700 1 -- 172.21.15.12:0/3214293719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 msgr2=0x5628b1b3b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615affd700 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615affd700 1 -- 172.21.15.12:0/3214293719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628b190c630 con 0x5628b1b3bd30 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615b7fe700 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.843+0000 7f615affd700 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b3c640 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6150000c00 tx=0x7f615009ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64e03d11e84dc32 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.844+0000 7f6141ffb700 1 -- 172.21.15.12:0/3214293719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615009af60 con 0x5628b1b3bd30 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.844+0000 7f6141ffb700 1 -- 172.21.15.12:0/3214293719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f615009f0b0 con 0x5628b1b3bd30 2023-12-11T20:20:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.844+0000 7f6141ffb700 1 -- 172.21.15.12:0/3214293719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615009a450 con 0x5628b1b3bd30 2023-12-11T20:20:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.844+0000 7f6175443b80 1 -- 172.21.15.12:0/3214293719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 msgr2=0x5628b1b3c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.844+0000 7f6175443b80 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b3c640 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6150000c00 tx=0x7f615009ab20 comp rx=0 tx=0).stop 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.845+0000 7f6175443b80 1 -- 172.21.15.12:0/3214293719 shutdown_connections 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.845+0000 7f6175443b80 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.845+0000 7f6175443b80 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b3d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.845+0000 7f6175443b80 1 --2- 172.21.15.12:0/3214293719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b3c640 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.845+0000 7f6175443b80 1 -- 172.21.15.12:0/3214293719 >> 172.21.15.12:0/3214293719 conn(0x5628b1a6a7e0 msgr2=0x5628b1b37d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.845+0000 7f6175443b80 1 -- 172.21.15.12:0/3214293719 shutdown_connections 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.845+0000 7f6175443b80 1 -- 172.21.15.12:0/3214293719 wait complete. 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.845+0000 7f6175443b80 1 -- start start 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f6175443b80 1 Processor -- start 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f6175443b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b44e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f6175443b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3bd30 0x5628b1b453c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f6175443b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f6175443b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1a49560 con 0x5628b1b3b3d0 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f6175443b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1a49200 con 0x5628b1b3bd30 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f6175443b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b190e920 con 0x5628b1b3cc20 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f6175443b80 10 client.0 _ll_register_callbacks cb 0x5628b1974a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.846+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b44e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b44e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55264/0 (socket says 172.21.15.12:55264) 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615b7fe700 1 -- 172.21.15.12:0/2329550406 learned_addr learned my addr 172.21.15.12:0/2329550406 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615affd700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3bd30 0x5628b1b453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615bfff700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615b7fe700 1 -- 172.21.15.12:0/2329550406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 msgr2=0x5628b1b4c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615b7fe700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615b7fe700 1 -- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3bd30 msgr2=0x5628b1b453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615b7fe700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3bd30 0x5628b1b453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615b7fe700 1 -- 172.21.15.12:0/2329550406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c017070 con 0x5628b1b3b3d0 2023-12-11T20:20:45.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615affd700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3bd30 0x5628b1b453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615bfff700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f615b7fe700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b44e80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f614c01d8c0 tx=0x7f614c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74f68657f63dd3e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.847+0000 7f613affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f613affd700 1 -- 172.21.15.12:0/2329550406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c022070 con 0x5628b1b3b3d0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f613affd700 1 -- 172.21.15.12:0/2329550406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f614c004020 con 0x5628b1b3b3d0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 1 -- 172.21.15.12:0/2329550406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628b1b2eb40 con 0x5628b1b3b3d0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f613affd700 1 -- 172.21.15.12:0/2329550406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f614c0041e0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 10 client.16899 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 1 -- 172.21.15.12:0/2329550406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f615c1a19c0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f613affd700 1 -- 172.21.15.12:0/2329550406 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5628b1b2eb40 con 0x5628b1b3b3d0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f613affd700 1 -- 172.21.15.12:0/2329550406 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f614c003680 con 0x5628b1b3b3d0 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 10 client.16899 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 20 client.16899 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5628b1b50d20 0x5628b1b53140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 4 client.16899 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.848+0000 7f6175443b80 1 -- 172.21.15.12:0/2329550406 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628b1b0af40 con 0x5628b1b50d20 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.849+0000 7f615affd700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5628b1b50d20 0x5628b1b53140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.849+0000 7f615affd700 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5628b1b50d20 0x5628b1b53140 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f2cea0e7ec27bea server_cookie=38e2029098a56cea in_seq=0 out_seq=0 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.849+0000 7f613affd700 10 client.16899 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f613affd700 1 -- 172.21.15.12:0/2329550406 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628b1b0af40 con 0x5628b1b50d20 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f613affd700 10 client.16899 handle_command_reply: tid=0 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f6175443b80 1 client.16899 shutdown 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f6175443b80 1 -- 172.21.15.12:0/2329550406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 msgr2=0x5628b1b44e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f6175443b80 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b44e80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f614c01d8c0 tx=0x7f614c0047c0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f6175443b80 1 -- 172.21.15.12:0/2329550406 shutdown_connections 2023-12-11T20:20:45.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f6175443b80 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5628b1b50d20 0x5628b1b53140 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f6175443b80 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f6175443b80 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b44e80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f6175443b80 1 --2- 172.21.15.12:0/2329550406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3bd30 0x5628b1b453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.850+0000 7f613affd700 0 client.16899 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.851+0000 7f6175443b80 1 -- 172.21.15.12:0/2329550406 >> 172.21.15.12:0/2329550406 conn(0x5628b1a6a7e0 msgr2=0x5628b1b36a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.851+0000 7f6175443b80 1 -- 172.21.15.12:0/2329550406 shutdown_connections 2023-12-11T20:20:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.851+0000 7f6175443b80 1 -- 172.21.15.12:0/2329550406 wait complete. 2023-12-11T20:20:45.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.851+0000 7f6175443b80 20 client.16899 trim_cache size 0 max 16384 2023-12-11T20:20:45.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f6175443b80 1 Processor -- start 2023-12-11T20:20:45.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f6175443b80 1 -- start start 2023-12-11T20:20:45.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f6175443b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f6175443b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3bd30 0x5628b1b40090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f6175443b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f6175443b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1b32ba0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f6175443b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1b58360 con 0x5628b1b3cc20 2023-12-11T20:20:45.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f6175443b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1b3c460 con 0x5628b1b3bd30 2023-12-11T20:20:45.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.873+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55270/0 (socket says 172.21.15.12:55270) 2023-12-11T20:20:45.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615b7fe700 1 -- 172.21.15.12:0/1778942167 learned_addr learned my addr 172.21.15.12:0/1778942167 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615affd700 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3bd30 0x5628b1b40090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615bfff700 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615b7fe700 1 -- 172.21.15.12:0/1778942167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3bd30 msgr2=0x5628b1b40090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615b7fe700 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3bd30 0x5628b1b40090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615b7fe700 1 -- 172.21.15.12:0/1778942167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3cc20 msgr2=0x5628b1b4c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615b7fe700 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615b7fe700 1 -- 172.21.15.12:0/1778942167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628b18b8de0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.874+0000 7f615b7fe700 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3fb50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f614c0093f0 tx=0x7f614c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1c737fe356a2c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f61427fc700 1 -- 172.21.15.12:0/1778942167 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c022070 con 0x5628b1b3b3d0 2023-12-11T20:20:45.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f61427fc700 1 -- 172.21.15.12:0/1778942167 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f614c003680 con 0x5628b1b3b3d0 2023-12-11T20:20:45.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f61427fc700 1 -- 172.21.15.12:0/1778942167 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c003fb0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f6175443b80 1 -- 172.21.15.12:0/1778942167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 msgr2=0x5628b1b3fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f6175443b80 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3fb50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f614c0093f0 tx=0x7f614c011af0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f6175443b80 1 -- 172.21.15.12:0/1778942167 shutdown_connections 2023-12-11T20:20:45.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f6175443b80 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3cc20 0x5628b1b4c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f6175443b80 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3b3d0 0x5628b1b3fb50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f6175443b80 1 --2- 172.21.15.12:0/1778942167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3bd30 0x5628b1b40090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.875+0000 7f6175443b80 1 -- 172.21.15.12:0/1778942167 >> 172.21.15.12:0/1778942167 conn(0x5628b1a6a7e0 msgr2=0x5628b1b43150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.876+0000 7f6175443b80 1 -- 172.21.15.12:0/1778942167 shutdown_connections 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.876+0000 7f6175443b80 1 -- 172.21.15.12:0/1778942167 wait complete. 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.876+0000 7f6175443b80 1 -- start start 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.876+0000 7f6175443b80 1 Processor -- start 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f6175443b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b48290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f6175443b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f6175443b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f6175443b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1b4bd30 con 0x5628b1b3bd30 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f6175443b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1b4bea0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f6175443b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b1b4c060 con 0x5628b1b3cc20 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f6175443b80 10 client.0 _ll_register_callbacks cb 0x5628b1974a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:45.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55276/0 (socket says 172.21.15.12:55276) 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615affd700 1 -- 172.21.15.12:0/3760576654 learned_addr learned my addr 172.21.15.12:0/3760576654 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615bfff700 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615b7fe700 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b48290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615b7fe700 1 -- 172.21.15.12:0/3760576654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 msgr2=0x5628b1b4b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615b7fe700 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615b7fe700 1 -- 172.21.15.12:0/3760576654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 msgr2=0x5628b1b487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615b7fe700 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.877+0000 7f615b7fe700 1 -- 172.21.15.12:0/3760576654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c1a19c0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.878+0000 7f615b7fe700 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b48290 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f614c01f040 tx=0x7f614c0056b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0335274725b1e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.878+0000 7f613affd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:20:45.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.878+0000 7f613affd700 1 -- 172.21.15.12:0/3760576654 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c022040 con 0x5628b1b3b3d0 2023-12-11T20:20:45.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.878+0000 7f613affd700 1 -- 172.21.15.12:0/3760576654 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f614c0037f0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.878+0000 7f6175443b80 1 -- 172.21.15.12:0/3760576654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f615009f0b0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.879+0000 7f613affd700 1 -- 172.21.15.12:0/3760576654 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f614c01cb20 con 0x5628b1b3b3d0 2023-12-11T20:20:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.879+0000 7f6175443b80 10 client.26618 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.879+0000 7f6175443b80 1 -- 172.21.15.12:0/3760576654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5628b18a1c60 con 0x5628b1b3b3d0 2023-12-11T20:20:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.879+0000 7f613affd700 1 -- 172.21.15.12:0/3760576654 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f615009f0b0 con 0x5628b1b3b3d0 2023-12-11T20:20:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.879+0000 7f613affd700 1 -- 172.21.15.12:0/3760576654 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f614c037030 con 0x5628b1b3b3d0 2023-12-11T20:20:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.880+0000 7f6175443b80 10 client.26618 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.880+0000 7f6175443b80 10 client.26618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.880+0000 7f6175443b80 20 client.26618 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.880+0000 7f6175443b80 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5628b1ba7ef0 0x5628b1baa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.880+0000 7f6175443b80 4 client.26618 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.880+0000 7f6175443b80 1 -- 172.21.15.12:0/3760576654 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5628b1a55fd0 con 0x5628b1ba7ef0 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.880+0000 7f615affd700 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5628b1ba7ef0 0x5628b1baa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f615affd700 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5628b1ba7ef0 0x5628b1baa2e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10ac976923998ba server_cookie=224b91319524f349 in_seq=0 out_seq=0 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f613affd700 10 client.26618 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f613affd700 1 -- 172.21.15.12:0/3760576654 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5628b1a55fd0 con 0x5628b1ba7ef0 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f613affd700 10 client.26618 handle_command_reply: tid=0 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 client.26618 shutdown 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 -- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 msgr2=0x5628b1b48290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b48290 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f614c01f040 tx=0x7f614c0056b0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 -- 172.21.15.12:0/3760576654 shutdown_connections 2023-12-11T20:20:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5628b1ba7ef0 0x5628b1baa2e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5628b1b3b3d0 0x5628b1b48290 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5628b1b3cc20 0x5628b1b4b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f613affd700 0 client.26618 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 --2- 172.21.15.12:0/3760576654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628b1b3bd30 0x5628b1b487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 -- 172.21.15.12:0/3760576654 >> 172.21.15.12:0/3760576654 conn(0x5628b1a6a7e0 msgr2=0x5628b1b3fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 -- 172.21.15.12:0/3760576654 shutdown_connections 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.881+0000 7f6175443b80 1 -- 172.21.15.12:0/3760576654 wait complete. 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6175443b80 20 client.26618 trim_cache size 0 max 16384 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:20:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:20:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "10203f79-66aa-46fc-98d1-a1073253068c": { 2023-12-11T20:20:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:20:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "10203f79-66aa-46fc-98d1-a1073253068c", 2023-12-11T20:20:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:20:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:20:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:20:45.885 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 -- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61440a1480 msgr2=0x7f61440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61440a1480 0x7f61440a3940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f615c102500 tx=0x7f614c009260 comp rx=0 tx=0).stop 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 -- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 msgr2=0x7f615c0739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 0x7f615c0739c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6150009fd0 tx=0x7f615000fa00 comp rx=0 tx=0).stop 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 -- 172.21.15.12:0/3372160580 shutdown_connections 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61440a1480 0x7f61440a3940 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f615c1014b0 0x7f615c075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f615c103040 0x7f615c073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 --2- 172.21.15.12:0/3372160580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f615c1026a0 0x7f615c0739c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 -- 172.21.15.12:0/3372160580 >> 172.21.15.12:0/3372160580 conn(0x7f615c0fca00 msgr2=0x7f615c105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 -- 172.21.15.12:0/3372160580 shutdown_connections 2023-12-11T20:20:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:20:45.882+0000 7f6161bff700 1 -- 172.21.15.12:0/3372160580 wait complete. 2023-12-11T20:20:45.900 INFO:tasks.cephfs.filesystem:scrub status for tag:10203f79-66aa-46fc-98d1-a1073253068c - {'path': '/', 'tag': '10203f79-66aa-46fc-98d1-a1073253068c', 'options': 'recursive,force'} 2023-12-11T20:20:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:20:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:20:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:46.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:46.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:20:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:20:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:47 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:20:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:47 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:47 smithi032 ceph-mon[132488]: pgmap v521: 97 pgs: 97 active+clean; 3.0 GiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:20:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:47 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:20:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:47 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:47 smithi039 ceph-mon[102205]: pgmap v521: 97 pgs: 97 active+clean; 3.0 GiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:20:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:47 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:20:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:47 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:20:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:47 smithi012 ceph-mon[128787]: pgmap v521: 97 pgs: 97 active+clean; 3.0 GiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:20:48.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 -- 172.21.15.12:0/828894533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a0104870 msgr2=0x7fc3a0106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/828894533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a0104870 0x7fc3a0106c60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc390009990 tx=0x7fc390009ca0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 -- 172.21.15.12:0/828894533 shutdown_connections 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/828894533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3a0101f40 0x7fc3a0104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/828894533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3a01071a0 0x7fc3a0109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/828894533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a0104870 0x7fc3a0106c60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 -- 172.21.15.12:0/828894533 >> 172.21.15.12:0/828894533 conn(0x7fc3a00fb930 msgr2=0x7fc3a00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 -- 172.21.15.12:0/828894533 shutdown_connections 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.555+0000 7fc3a73ff700 1 -- 172.21.15.12:0/828894533 wait complete. 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.556+0000 7fc3a73ff700 1 Processor -- start 2023-12-11T20:20:48.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a73ff700 1 -- start start 2023-12-11T20:20:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a73ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3a0101f40 0x7fc3a0101860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a73ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3a0104870 0x7fc3a00ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a73ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a01071a0 0x7fc3a0100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a73ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0100bd0 con 0x7fc3a01071a0 2023-12-11T20:20:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a73ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0100d40 con 0x7fc3a0104870 2023-12-11T20:20:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a73ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a01a13a0 con 0x7fc3a0101f40 2023-12-11T20:20:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a599c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a01071a0 0x7fc3a0100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a599c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a01071a0 0x7fc3a0100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55286/0 (socket says 172.21.15.12:55286) 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a599c700 1 -- 172.21.15.12:0/4069782143 learned_addr learned my addr 172.21.15.12:0/4069782143 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.557+0000 7fc3a519b700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3a0101f40 0x7fc3a0101860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3a499a700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3a0104870 0x7fc3a00ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3a599c700 1 -- 172.21.15.12:0/4069782143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3a0101f40 msgr2=0x7fc3a0101860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3a599c700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3a0101f40 0x7fc3a0101860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3a599c700 1 -- 172.21.15.12:0/4069782143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3a0104870 msgr2=0x7fc3a00ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3a599c700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3a0104870 0x7fc3a00ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3a599c700 1 -- 172.21.15.12:0/4069782143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3900095f0 con 0x7fc3a01071a0 2023-12-11T20:20:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3a599c700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a01071a0 0x7fc3a0100430 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc39800ef30 tx=0x7fc39800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3967fc700 1 -- 172.21.15.12:0/4069782143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398018070 con 0x7fc3a01071a0 2023-12-11T20:20:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.558+0000 7fc3967fc700 1 -- 172.21.15.12:0/4069782143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc39800f040 con 0x7fc3a01071a0 2023-12-11T20:20:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.559+0000 7fc3a73ff700 1 -- 172.21.15.12:0/4069782143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a01a15d0 con 0x7fc3a01071a0 2023-12-11T20:20:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.559+0000 7fc3967fc700 1 -- 172.21.15.12:0/4069782143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39800cb60 con 0x7fc3a01071a0 2023-12-11T20:20:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.559+0000 7fc3a73ff700 1 -- 172.21.15.12:0/4069782143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a01a1ae0 con 0x7fc3a01071a0 2023-12-11T20:20:48.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.562+0000 7fc3967fc700 1 -- 172.21.15.12:0/4069782143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc39800cd40 con 0x7fc3a01071a0 2023-12-11T20:20:48.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.563+0000 7fc3967fc700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc38c0a14f0 0x7fc38c0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.563+0000 7fc3967fc700 1 -- 172.21.15.12:0/4069782143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc3980cc7b0 con 0x7fc3a01071a0 2023-12-11T20:20:48.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.564+0000 7fc3a519b700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc38c0a14f0 0x7fc38c0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.563 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.564+0000 7fc3a519b700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc38c0a14f0 0x7fc38c0a39b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009c60 tx=0x7fc39c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:48.563 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.564+0000 7fc3bac29b80 1 Processor -- start 2023-12-11T20:20:48.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3bac29b80 1 -- start start 2023-12-11T20:20:48.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0abed0 0x5577ab0ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0ad720 0x5577ab0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab007af0 con 0x5577ab0abed0 2023-12-11T20:20:48.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab005410 con 0x5577ab0ad720 2023-12-11T20:20:48.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab000d00 con 0x5577ab0ac830 2023-12-11T20:20:48.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3a519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0abed0 0x5577ab0ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3a519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0abed0 0x5577ab0ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55298/0 (socket says 172.21.15.12:55298) 2023-12-11T20:20:48.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.565+0000 7fc3a519b700 1 -- 172.21.15.12:0/3800304661 learned_addr learned my addr 172.21.15.12:0/3800304661 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc3a599c700 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0ad720 0x5577ab0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc3a499a700 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc3a519b700 1 -- 172.21.15.12:0/3800304661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 msgr2=0x5577ab0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc3a519b700 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc3a519b700 1 -- 172.21.15.12:0/3800304661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0ad720 msgr2=0x5577ab0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc3a519b700 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0ad720 0x5577ab0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc3a519b700 1 -- 172.21.15.12:0/3800304661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577aae7d5d0 con 0x5577ab0abed0 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc3a519b700 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0abed0 0x5577ab0ac2f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00e4e0 tx=0x7fc39c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8dee446bf7c385 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc38b7fe700 1 -- 172.21.15.12:0/3800304661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c026430 con 0x5577ab0abed0 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.566+0000 7fc38b7fe700 1 -- 172.21.15.12:0/3800304661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc39c021070 con 0x5577ab0abed0 2023-12-11T20:20:48.566 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.567+0000 7fc38b7fe700 1 -- 172.21.15.12:0/3800304661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c01d630 con 0x5577ab0abed0 2023-12-11T20:20:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.567+0000 7fc3bac29b80 1 -- 172.21.15.12:0/3800304661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0abed0 msgr2=0x5577ab0ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.567+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0abed0 0x5577ab0ac2f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00e4e0 tx=0x7fc39c014000 comp rx=0 tx=0).stop 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.567+0000 7fc3bac29b80 1 -- 172.21.15.12:0/3800304661 shutdown_connections 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.567+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0ad720 0x5577ab0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.567+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0abed0 0x5577ab0ac2f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.567+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/3800304661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.567+0000 7fc3bac29b80 1 -- 172.21.15.12:0/3800304661 >> 172.21.15.12:0/3800304661 conn(0x5577aafdb780 msgr2=0x5577ab0a8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.568+0000 7fc3bac29b80 1 -- 172.21.15.12:0/3800304661 shutdown_connections 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.568+0000 7fc3bac29b80 1 -- 172.21.15.12:0/3800304661 wait complete. 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.568+0000 7fc3bac29b80 1 -- start start 2023-12-11T20:20:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.568+0000 7fc3bac29b80 1 Processor -- start 2023-12-11T20:20:48.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ad720 0x5577ab0bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577aafba500 con 0x5577ab0ad720 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577aafba1a0 con 0x5577ab0abed0 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577aae7f8c0 con 0x5577ab0ac830 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3bac29b80 10 client.0 _ll_register_callbacks cb 0x5577aaee5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3a499a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3a499a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49302/0 (socket says 172.21.15.12:49302) 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3a499a700 1 -- 172.21.15.12:0/1652164292 learned_addr learned my addr 172.21.15.12:0/1652164292 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.569+0000 7fc3a599c700 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ad720 0x5577ab0bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.570+0000 7fc3a519b700 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.570+0000 7fc3a499a700 1 -- 172.21.15.12:0/1652164292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 msgr2=0x5577ab0b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.570+0000 7fc3a499a700 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.570+0000 7fc3a499a700 1 -- 172.21.15.12:0/1652164292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ad720 msgr2=0x5577ab0bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.570+0000 7fc3a499a700 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ad720 0x5577ab0bd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.570+0000 7fc3a499a700 1 -- 172.21.15.12:0/1652164292 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c017070 con 0x5577ab0ac830 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.570+0000 7fc3a499a700 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0b63f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc390009990 tx=0x7fc390005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69eb440701d2f3ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.570+0000 7fc388ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.571+0000 7fc388ff9700 1 -- 172.21.15.12:0/1652164292 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39001d030 con 0x5577ab0ac830 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.571+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1652164292 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5577ab09f730 con 0x5577ab0ac830 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.571+0000 7fc388ff9700 1 -- 172.21.15.12:0/1652164292 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc390003a90 con 0x5577ab0ac830 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.571+0000 7fc388ff9700 1 -- 172.21.15.12:0/1652164292 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc390003c50 con 0x5577ab0ac830 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.571+0000 7fc3bac29b80 10 client.26620 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.571+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1652164292 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5577aae29d80 con 0x5577ab0ac830 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.571+0000 7fc388ff9700 1 -- 172.21.15.12:0/1652164292 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc390033080 con 0x5577ab0ac830 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.572+0000 7fc388ff9700 1 -- 172.21.15.12:0/1652164292 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc3900046c0 con 0x5577ab0ac830 2023-12-11T20:20:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.572+0000 7fc3bac29b80 10 client.26620 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.572+0000 7fc3bac29b80 10 client.26620 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.572+0000 7fc3bac29b80 20 client.26620 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.572+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5577ab0c1d30 0x5577ab0c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.572+0000 7fc3bac29b80 4 client.26620 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:20:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.572+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1652164292 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5577ab07bee0 con 0x5577ab0c1d30 2023-12-11T20:20:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.573+0000 7fc3a519b700 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5577ab0c1d30 0x5577ab0c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.573+0000 7fc3a519b700 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5577ab0c1d30 0x5577ab0c4150 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=190dcdf8ce645054 server_cookie=761acc5cda546b46 in_seq=0 out_seq=0 2023-12-11T20:20:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.573+0000 7fc388ff9700 10 client.26620 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc388ff9700 1 -- 172.21.15.12:0/1652164292 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5577ab07bee0 con 0x5577ab0c1d30 2023-12-11T20:20:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc388ff9700 10 client.26620 handle_command_reply: tid=0 2023-12-11T20:20:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 client.26620 shutdown 2023-12-11T20:20:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1652164292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 msgr2=0x5577ab0b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0b63f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc390009990 tx=0x7fc390005270 comp rx=0 tx=0).stop 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1652164292 shutdown_connections 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5577ab0c1d30 0x5577ab0c4150 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ad720 0x5577ab0bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc388ff9700 0 client.26620 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1652164292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ac830 0x5577ab0b63f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.574+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1652164292 >> 172.21.15.12:0/1652164292 conn(0x5577aafdb780 msgr2=0x5577ab0a6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.575+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1652164292 shutdown_connections 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.575+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1652164292 wait complete. 2023-12-11T20:20:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.575+0000 7fc3bac29b80 20 client.26620 trim_cache size 0 max 16384 2023-12-11T20:20:48.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.594+0000 7fc3bac29b80 1 Processor -- start 2023-12-11T20:20:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.594+0000 7fc3bac29b80 1 -- start start 2023-12-11T20:20:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 0x5577ab0c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab0a3920 con 0x5577ab0ac830 2023-12-11T20:20:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab0b3950 con 0x5577ab0abed0 2023-12-11T20:20:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab0b1230 con 0x5577ab0ad720 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0bd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55312/0 (socket says 172.21.15.12:55312) 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a499a700 1 -- 172.21.15.12:0/1330872365 learned_addr learned my addr 172.21.15.12:0/1330872365 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a599c700 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 0x5577ab0c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a519b700 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a499a700 1 -- 172.21.15.12:0/1330872365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 msgr2=0x5577ab0c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a499a700 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 0x5577ab0c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a499a700 1 -- 172.21.15.12:0/1330872365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 msgr2=0x5577ab0bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a499a700 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.595+0000 7fc3a499a700 1 -- 172.21.15.12:0/1330872365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577aae12c00 con 0x5577ab0ac830 2023-12-11T20:20:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.596+0000 7fc3a499a700 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0bd1e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc3900098e0 tx=0x7fc390004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f238efc9272cf5b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.596+0000 7fc38bfff700 1 -- 172.21.15.12:0/1330872365 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39001d040 con 0x5577ab0ac830 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.596+0000 7fc38bfff700 1 -- 172.21.15.12:0/1330872365 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5577ab09f730 con 0x5577ab0ac830 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.596+0000 7fc38bfff700 1 -- 172.21.15.12:0/1330872365 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39000b710 con 0x5577ab0ac830 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1330872365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 msgr2=0x5577ab0bd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0bd1e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc3900098e0 tx=0x7fc390004c40 comp rx=0 tx=0).stop 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1330872365 shutdown_connections 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 0x5577ab0c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/1330872365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0bd1e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1330872365 >> 172.21.15.12:0/1330872365 conn(0x5577aafdb780 msgr2=0x5577ab0b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1330872365 shutdown_connections 2023-12-11T20:20:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 -- 172.21.15.12:0/1330872365 wait complete. 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.597+0000 7fc3bac29b80 1 -- start start 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3bac29b80 1 Processor -- start 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0baa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0baf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3bac29b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 0x5577ab0bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab0bc490 con 0x5577ab0ac830 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab0bc600 con 0x5577ab0abed0 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3bac29b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577ab0bc7c0 con 0x5577ab0ad720 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3bac29b80 10 client.0 _ll_register_callbacks cb 0x5577aaee5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:20:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.598+0000 7fc3a499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a599c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 0x5577ab0bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0baf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55326/0 (socket says 172.21.15.12:55326) 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a499a700 1 -- 172.21.15.12:0/4009467100 learned_addr learned my addr 172.21.15.12:0/4009467100 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a519b700 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a499a700 1 -- 172.21.15.12:0/4009467100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 msgr2=0x5577ab0bbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a499a700 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 0x5577ab0bbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a499a700 1 -- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 msgr2=0x5577ab0baa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a499a700 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0baa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a499a700 1 -- 172.21.15.12:0/4009467100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5577aae29d80 con 0x5577ab0ac830 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a519b700 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0baa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc3a499a700 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0baf40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc390004ad0 tx=0x7fc390004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c145f480aa5c144 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.599+0000 7fc388ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:20:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.600+0000 7fc388ff9700 1 -- 172.21.15.12:0/4009467100 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39001d040 con 0x5577ab0ac830 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.600+0000 7fc3bac29b80 1 -- 172.21.15.12:0/4009467100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc39c021070 con 0x5577ab0ac830 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.600+0000 7fc388ff9700 1 -- 172.21.15.12:0/4009467100 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc390036020 con 0x5577ab0ac830 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.600+0000 7fc388ff9700 1 -- 172.21.15.12:0/4009467100 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc390003aa0 con 0x5577ab0ac830 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.600+0000 7fc3bac29b80 10 client.16923 fetch_fsmap learned FSMap version 26 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.600+0000 7fc3bac29b80 1 -- 172.21.15.12:0/4009467100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5577aae501f0 con 0x5577ab0ac830 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.600+0000 7fc388ff9700 1 -- 172.21.15.12:0/4009467100 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc39c021070 con 0x5577ab0ac830 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.600+0000 7fc388ff9700 1 -- 172.21.15.12:0/4009467100 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc39000bd60 con 0x5577ab0ac830 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.601+0000 7fc3bac29b80 10 client.16923 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.601+0000 7fc3bac29b80 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.601+0000 7fc3bac29b80 20 client.16923 populate_metadata read hostname 'smithi012' 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.601+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5577ab1188c0 0x5577ab11ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:20:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.601+0000 7fc3bac29b80 4 client.16923 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:20:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.601+0000 7fc3bac29b80 1 -- 172.21.15.12:0/4009467100 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5577aafc6f70 con 0x5577ab1188c0 2023-12-11T20:20:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.601+0000 7fc3a519b700 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5577ab1188c0 0x5577ab11ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:20:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.602+0000 7fc3a519b700 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5577ab1188c0 0x5577ab11ace0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=110b253aa146058b server_cookie=9f897a03772f7eb3 in_seq=0 out_seq=0 2023-12-11T20:20:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.602+0000 7fc388ff9700 10 client.16923 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.612+0000 7fc388ff9700 1 -- 172.21.15.12:0/4009467100 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5577aafc6f70 con 0x5577ab1188c0 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.612+0000 7fc388ff9700 10 client.16923 handle_command_reply: tid=0 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.612+0000 7fc3bac29b80 1 client.16923 shutdown 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.612+0000 7fc3bac29b80 1 -- 172.21.15.12:0/4009467100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 msgr2=0x5577ab0baf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0baf40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc390004ad0 tx=0x7fc390004dc0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 -- 172.21.15.12:0/4009467100 shutdown_connections 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5577ab1188c0 0x5577ab11ace0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5577ab0abed0 0x5577ab0baa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5577ab0ad720 0x5577ab0bbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 --2- 172.21.15.12:0/4009467100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577ab0ac830 0x5577ab0baf40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc388ff9700 0 client.16923 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 -- 172.21.15.12:0/4009467100 >> 172.21.15.12:0/4009467100 conn(0x5577aafdb780 msgr2=0x5577ab0c8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 -- 172.21.15.12:0/4009467100 shutdown_connections 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 1 -- 172.21.15.12:0/4009467100 wait complete. 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.613+0000 7fc3bac29b80 20 client.16923 trim_cache size 0 max 16384 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:20:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:20:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 -- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc38c0a14f0 msgr2=0x7fc38c0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc38c0a14f0 0x7fc38c0a39b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009c60 tx=0x7fc39c009260 comp rx=0 tx=0).stop 2023-12-11T20:20:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 -- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a01071a0 msgr2=0x7fc3a0100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:20:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a01071a0 0x7fc3a0100430 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc39800ef30 tx=0x7fc39800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 -- 172.21.15.12:0/4069782143 shutdown_connections 2023-12-11T20:20:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc38c0a14f0 0x7fc38c0a39b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3a01071a0 0x7fc3a0100430 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3a0101f40 0x7fc3a0101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 --2- 172.21.15.12:0/4069782143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3a0104870 0x7fc3a00ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:20:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 -- 172.21.15.12:0/4069782143 >> 172.21.15.12:0/4069782143 conn(0x7fc3a00fb930 msgr2=0x7fc3a0103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:20:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 -- 172.21.15.12:0/4069782143 shutdown_connections 2023-12-11T20:20:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:20:48.614+0000 7fc3a73ff700 1 -- 172.21.15.12:0/4069782143 wait complete. 2023-12-11T20:20:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:49 smithi032 ceph-mon[132488]: pgmap v522: 97 pgs: 97 active+clean; 3.0 GiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:20:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:49 smithi039 ceph-mon[102205]: pgmap v522: 97 pgs: 97 active+clean; 3.0 GiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:20:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:49 smithi012 ceph-mon[128787]: pgmap v522: 97 pgs: 97 active+clean; 3.0 GiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:20:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:51 smithi039 ceph-mon[102205]: pgmap v523: 97 pgs: 97 active+clean; 3.0 GiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:20:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:51 smithi012 ceph-mon[128787]: pgmap v523: 97 pgs: 97 active+clean; 3.0 GiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:20:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:51 smithi032 ceph-mon[132488]: pgmap v523: 97 pgs: 97 active+clean; 3.0 GiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:20:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:53 smithi039 ceph-mon[102205]: pgmap v524: 97 pgs: 97 active+clean; 3.0 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:20:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:53 smithi012 ceph-mon[128787]: pgmap v524: 97 pgs: 97 active+clean; 3.0 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:20:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:53 smithi032 ceph-mon[132488]: pgmap v524: 97 pgs: 97 active+clean; 3.0 GiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:20:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:55 smithi039 ceph-mon[102205]: pgmap v525: 97 pgs: 97 active+clean; 3.1 GiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:20:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:55 smithi012 ceph-mon[128787]: pgmap v525: 97 pgs: 97 active+clean; 3.1 GiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:20:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:55 smithi032 ceph-mon[132488]: pgmap v525: 97 pgs: 97 active+clean; 3.1 GiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:20:56.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:56 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:20:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:56 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:20:56.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:56 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:20:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:57 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:20:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:57 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:20:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:57 smithi039 ceph-mon[102205]: pgmap v526: 97 pgs: 97 active+clean; 3.1 GiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:20:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:57 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:20:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:57 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:20:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:57 smithi012 ceph-mon[128787]: pgmap v526: 97 pgs: 97 active+clean; 3.1 GiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:20:57.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:57 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:20:57.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:57 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:20:57.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:57 smithi032 ceph-mon[132488]: pgmap v526: 97 pgs: 97 active+clean; 3.1 GiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:20:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:20:59 smithi032 ceph-mon[132488]: pgmap v527: 97 pgs: 97 active+clean; 3.1 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 27 op/s 2023-12-11T20:20:59.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:20:59 smithi039 ceph-mon[102205]: pgmap v527: 97 pgs: 97 active+clean; 3.1 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 27 op/s 2023-12-11T20:20:59.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:20:59 smithi012 ceph-mon[128787]: pgmap v527: 97 pgs: 97 active+clean; 3.1 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 27 op/s 2023-12-11T20:21:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:01 smithi039 ceph-mon[102205]: pgmap v528: 97 pgs: 97 active+clean; 3.1 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:21:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:01 smithi012 ceph-mon[128787]: pgmap v528: 97 pgs: 97 active+clean; 3.1 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:21:01.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:01 smithi032 ceph-mon[132488]: pgmap v528: 97 pgs: 97 active+clean; 3.1 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:21:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/2802296830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34101f40 msgr2=0x7f5d34104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/2802296830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34101f40 0x7f5d34104330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009990 tx=0x7f5d28009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/2802296830 shutdown_connections 2023-12-11T20:21:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/2802296830 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d341071a0 0x7f5d34109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/2802296830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34101f40 0x7f5d34104330 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/2802296830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d34104870 0x7f5d34106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/2802296830 >> 172.21.15.12:0/2802296830 conn(0x7f5d340fb930 msgr2=0x7f5d340fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:01.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/2802296830 shutdown_connections 2023-12-11T20:21:01.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.777+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/2802296830 wait complete. 2023-12-11T20:21:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.778+0000 7f5d3b1ff700 1 Processor -- start 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.778+0000 7f5d3b1ff700 1 -- start start 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.778+0000 7f5d3b1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d34101f40 0x7f5d341994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d3b1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34104870 0x7f5d34199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d3b1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d341071a0 0x7f5d341a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d3b1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341a1020 con 0x7f5d34104870 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d3b1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341a1160 con 0x7f5d341071a0 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d3b1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341a12f0 con 0x7f5d34101f40 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d33fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34104870 0x7f5d34199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d38f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d34101f40 0x7f5d341994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d33fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34104870 0x7f5d34199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42840/0 (socket says 172.21.15.12:42840) 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d33fff700 1 -- 172.21.15.12:0/3402984889 learned_addr learned my addr 172.21.15.12:0/3402984889 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d3979c700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d341071a0 0x7f5d341a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d38f9b700 1 -- 172.21.15.12:0/3402984889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d341071a0 msgr2=0x7f5d341a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d341071a0 0x7f5d341a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d38f9b700 1 -- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34104870 msgr2=0x7f5d34199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34104870 0x7f5d34199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d38f9b700 1 -- 172.21.15.12:0/3402984889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280095f0 con 0x7f5d34101f40 2023-12-11T20:21:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.779+0000 7f5d33fff700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34104870 0x7f5d34199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.780+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d34101f40 0x7f5d341994f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d280098e0 tx=0x7f5d28005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.780+0000 7f5d31ffb700 1 -- 172.21.15.12:0/3402984889 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2801d070 con 0x7f5d34101f40 2023-12-11T20:21:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.780+0000 7f5d31ffb700 1 -- 172.21.15.12:0/3402984889 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d2800be70 con 0x7f5d34101f40 2023-12-11T20:21:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.780+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/3402984889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d341a1570 con 0x7f5d34101f40 2023-12-11T20:21:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.780+0000 7f5d31ffb700 1 -- 172.21.15.12:0/3402984889 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800fe90 con 0x7f5d34101f40 2023-12-11T20:21:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.780+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/3402984889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d341a19f0 con 0x7f5d34101f40 2023-12-11T20:21:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.784+0000 7f5d31ffb700 1 -- 172.21.15.12:0/3402984889 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5d2800f5f0 con 0x7f5d34101f40 2023-12-11T20:21:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.785+0000 7f5d4eb41b80 1 Processor -- start 2023-12-11T20:21:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d4eb41b80 1 -- start start 2023-12-11T20:21:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247bffed0 0x55a247c002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247c00830 0x55a247c01140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247b5baf0 con 0x55a247bffed0 2023-12-11T20:21:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247b59410 con 0x55a247c01720 2023-12-11T20:21:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247b54d00 con 0x55a247c00830 2023-12-11T20:21:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d3979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247bffed0 0x55a247c002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d3979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247bffed0 0x55a247c002f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42852/0 (socket says 172.21.15.12:42852) 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d38f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247c00830 0x55a247c01140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d33fff700 1 --2- 172.21.15.12:0/3255803805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.786+0000 7f5d3979c700 1 -- 172.21.15.12:0/3255803805 learned_addr learned my addr 172.21.15.12:0/3255803805 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d31ffb700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d240a14f0 0x7f5d240a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d33fff700 1 -- 172.21.15.12:0/3255803805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247c00830 msgr2=0x55a247c01140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d33fff700 1 --2- 172.21.15.12:0/3255803805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247c00830 0x55a247c01140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d33fff700 1 -- 172.21.15.12:0/3255803805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247bffed0 msgr2=0x55a247c002f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d33fff700 1 --2- 172.21.15.12:0/3255803805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247bffed0 0x55a247c002f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d33fff700 1 -- 172.21.15.12:0/3255803805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2479d15d0 con 0x55a247c01720 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d31ffb700 1 -- 172.21.15.12:0/3402984889 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5d280cdf90 con 0x7f5d34101f40 2023-12-11T20:21:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d3979c700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d240a14f0 0x7f5d240a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.787+0000 7f5d33fff700 1 --2- 172.21.15.12:0/3255803805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01ba0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d20011570 tx=0x7f5d20011880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cde3249cbf82fb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d1effd700 1 -- 172.21.15.12:0/3255803805 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20004230 con 0x55a247c01720 2023-12-11T20:21:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d1effd700 1 -- 172.21.15.12:0/3255803805 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d20004390 con 0x55a247c01720 2023-12-11T20:21:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d1effd700 1 -- 172.21.15.12:0/3255803805 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20019860 con 0x55a247c01720 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3255803805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 msgr2=0x55a247c01ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3255803805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01ba0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d20011570 tx=0x7f5d20011880 comp rx=0 tx=0).stop 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d3979c700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d240a14f0 0x7f5d240a39b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009fd0 tx=0x7f5d2c009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3255803805 shutdown_connections 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3255803805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01ba0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3255803805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247bffed0 0x55a247c002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3255803805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247c00830 0x55a247c01140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.788+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3255803805 >> 172.21.15.12:0/3255803805 conn(0x55a247b2f780 msgr2=0x55a247bfc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.789+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3255803805 shutdown_connections 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.789+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3255803805 wait complete. 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.789+0000 7f5d4eb41b80 1 -- start start 2023-12-11T20:21:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.790+0000 7f5d4eb41b80 1 Processor -- start 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.790+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.790+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 0x55a247c0a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.790+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 0x55a247c111f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.790+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247b0e500 con 0x55a247c01720 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.790+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247b0e1a0 con 0x55a247c00830 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.790+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2479d38c0 con 0x55a247bffed0 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.790+0000 7f5d4eb41b80 10 client.0 _ll_register_callbacks cb 0x55a247a39a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d33fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 0x55a247c0a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50958/0 (socket says 172.21.15.12:50958) 2023-12-11T20:21:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 -- 172.21.15.12:0/3799288547 learned_addr learned my addr 172.21.15.12:0/3799288547 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d3979c700 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 0x55a247c111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 -- 172.21.15.12:0/3799288547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 msgr2=0x55a247c0a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 0x55a247c0a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 -- 172.21.15.12:0/3799288547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 msgr2=0x55a247c111f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 0x55a247c111f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 -- 172.21.15.12:0/3799288547 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d20009d60 con 0x55a247bffed0 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800b2e0 tx=0x7f5d28004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded3dc68d30ae668 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.791+0000 7f5d13fff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.792+0000 7f5d13fff700 1 -- 172.21.15.12:0/3799288547 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280cbea0 con 0x55a247bffed0 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.792+0000 7f5d13fff700 1 -- 172.21.15.12:0/3799288547 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5d2809b990 con 0x55a247bffed0 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.792+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3799288547 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a247bf3730 con 0x55a247bffed0 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.792+0000 7f5d13fff700 1 -- 172.21.15.12:0/3799288547 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d28095ea0 con 0x55a247bffed0 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.792+0000 7f5d4eb41b80 10 client.26638 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.792+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3799288547 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a24797dd80 con 0x55a247bffed0 2023-12-11T20:21:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.792+0000 7f5d13fff700 1 -- 172.21.15.12:0/3799288547 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a247bf3730 con 0x55a247bffed0 2023-12-11T20:21:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.792+0000 7f5d13fff700 1 -- 172.21.15.12:0/3799288547 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5d280a1190 con 0x55a247bffed0 2023-12-11T20:21:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.793+0000 7f5d4eb41b80 10 client.26638 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.793+0000 7f5d4eb41b80 10 client.26638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.793+0000 7f5d4eb41b80 20 client.26638 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.793+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a247c15920 0x55a247c17d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.793+0000 7f5d4eb41b80 4 client.26638 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.793+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3799288547 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a247bcfee0 con 0x55a247c15920 2023-12-11T20:21:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.793+0000 7f5d33fff700 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a247c15920 0x55a247c17d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.794+0000 7f5d13fff700 10 client.26638 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.794+0000 7f5d33fff700 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a247c15920 0x55a247c17d40 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa6dd17115ef30ad server_cookie=ad122d6b5481e24b in_seq=0 out_seq=0 2023-12-11T20:21:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.794+0000 7f5d13fff700 1 -- 172.21.15.12:0/3799288547 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a247bcfee0 con 0x55a247c15920 2023-12-11T20:21:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.794+0000 7f5d13fff700 10 client.26638 handle_command_reply: tid=0 2023-12-11T20:21:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 client.26638 shutdown 2023-12-11T20:21:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3799288547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 msgr2=0x55a247c09e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800b2e0 tx=0x7f5d28004320 comp rx=0 tx=0).stop 2023-12-11T20:21:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3799288547 shutdown_connections 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a247c15920 0x55a247c17d40 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 0x55a247c111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09e80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/3799288547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 0x55a247c0a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3799288547 >> 172.21.15.12:0/3799288547 conn(0x55a247b2f780 msgr2=0x55a247bfaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d13fff700 0 client.26638 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3799288547 shutdown_connections 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/3799288547 wait complete. 2023-12-11T20:21:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.795+0000 7f5d4eb41b80 20 client.26638 trim_cache size 0 max 16384 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.816+0000 7f5d4eb41b80 1 Processor -- start 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.816+0000 7f5d4eb41b80 1 -- start start 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.816+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.816+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c00830 0x55a247c111b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.816+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.816+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247c15690 con 0x55a247c00830 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.816+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247c00c10 con 0x55a247c01720 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.816+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247c1cef0 con 0x55a247bffed0 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c00830 0x55a247c111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d38f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c00830 0x55a247c111b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42870/0 (socket says 172.21.15.12:42870) 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 -- 172.21.15.12:0/1241566566 learned_addr learned my addr 172.21.15.12:0/1241566566 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d3979c700 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 -- 172.21.15.12:0/1241566566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 msgr2=0x55a247c09180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 -- 172.21.15.12:0/1241566566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 msgr2=0x55a247c01b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 -- 172.21.15.12:0/1241566566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a247966c00 con 0x55a247c00830 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.817+0000 7f5d33fff700 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c00830 0x55a247c111b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009880 tx=0x7f5d20011880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc6fc94c2c606ca server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.818+0000 7f5d1f7fe700 1 -- 172.21.15.12:0/1241566566 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20029040 con 0x55a247c00830 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.818+0000 7f5d1f7fe700 1 -- 172.21.15.12:0/1241566566 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d200040d0 con 0x55a247c00830 2023-12-11T20:21:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.818+0000 7f5d1f7fe700 1 -- 172.21.15.12:0/1241566566 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2002a530 con 0x55a247c00830 2023-12-11T20:21:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/1241566566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c00830 msgr2=0x55a247c111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c00830 0x55a247c111b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009880 tx=0x7f5d20011880 comp rx=0 tx=0).stop 2023-12-11T20:21:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/1241566566 shutdown_connections 2023-12-11T20:21:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c01720 0x55a247c01b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c09180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/1241566566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c00830 0x55a247c111b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/1241566566 >> 172.21.15.12:0/1241566566 conn(0x55a247b2f780 msgr2=0x55a247bfc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/1241566566 shutdown_connections 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/1241566566 wait complete. 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.819+0000 7f5d4eb41b80 1 -- start start 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.820+0000 7f5d4eb41b80 1 Processor -- start 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.820+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c6e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.820+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 0x55a247c70b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.820+0000 7f5d4eb41b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 0x55a247c73050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.820+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247c73590 con 0x55a247c01720 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.820+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247c736d0 con 0x55a247c00830 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.820+0000 7f5d4eb41b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a247c73840 con 0x55a247bffed0 2023-12-11T20:21:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d4eb41b80 10 client.0 _ll_register_callbacks cb 0x55a247a39a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d38f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c6e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d38f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c6e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50978/0 (socket says 172.21.15.12:50978) 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d3979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 0x55a247c73050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d38f9b700 1 -- 172.21.15.12:0/2949366215 learned_addr learned my addr 172.21.15.12:0/2949366215 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d33fff700 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 0x55a247c70b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d38f9b700 1 -- 172.21.15.12:0/2949366215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 msgr2=0x55a247c70b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 0x55a247c70b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d38f9b700 1 -- 172.21.15.12:0/2949366215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 msgr2=0x55a247c73050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 0x55a247c73050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.821+0000 7f5d38f9b700 1 -- 172.21.15.12:0/2949366215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a24797dd80 con 0x55a247bffed0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.822+0000 7f5d38f9b700 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c6e5b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5d280a3060 tx=0x7f5d280cba60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f9e15ba6904d62 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.822+0000 7f5d13fff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.822+0000 7f5d13fff700 1 -- 172.21.15.12:0/2949366215 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280cbea0 con 0x55a247bffed0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.822+0000 7f5d13fff700 1 -- 172.21.15.12:0/2949366215 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5d2809b990 con 0x55a247bffed0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.822+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/2949366215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d20004390 con 0x55a247bffed0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.822+0000 7f5d13fff700 1 -- 172.21.15.12:0/2949366215 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d28095ea0 con 0x55a247bffed0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.822+0000 7f5d4eb41b80 10 client.26644 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.822+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/2949366215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a2479d15d0 con 0x55a247bffed0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.823+0000 7f5d13fff700 1 -- 172.21.15.12:0/2949366215 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d20004390 con 0x55a247bffed0 2023-12-11T20:21:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.823+0000 7f5d13fff700 1 -- 172.21.15.12:0/2949366215 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5d28097280 con 0x55a247bffed0 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.823+0000 7f5d4eb41b80 10 client.26644 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.823+0000 7f5d4eb41b80 10 client.26644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.823+0000 7f5d4eb41b80 20 client.26644 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.823+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a247c74ed0 0x55a247c772f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.823+0000 7f5d4eb41b80 4 client.26644 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.823+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/2949366215 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a247b1af70 con 0x55a247c74ed0 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.824+0000 7f5d33fff700 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a247c74ed0 0x55a247c772f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.824+0000 7f5d33fff700 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a247c74ed0 0x55a247c772f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0cba52d70671c41 server_cookie=7869e94780fec8ed in_seq=0 out_seq=0 2023-12-11T20:21:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.824+0000 7f5d13fff700 10 client.26644 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.834+0000 7f5d13fff700 1 -- 172.21.15.12:0/2949366215 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a247b1af70 con 0x55a247c74ed0 2023-12-11T20:21:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.834+0000 7f5d13fff700 10 client.26644 handle_command_reply: tid=0 2023-12-11T20:21:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.834+0000 7f5d4eb41b80 1 client.26644 shutdown 2023-12-11T20:21:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/2949366215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 msgr2=0x55a247c6e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c6e5b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5d280a3060 tx=0x7f5d280cba60 comp rx=0 tx=0).stop 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/2949366215 shutdown_connections 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a247c74ed0 0x55a247c772f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a247c01720 0x55a247c73050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a247bffed0 0x55a247c6e5b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 --2- 172.21.15.12:0/2949366215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a247c00830 0x55a247c70b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d13fff700 0 client.26644 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/2949366215 >> 172.21.15.12:0/2949366215 conn(0x55a247b2f780 msgr2=0x55a247bfac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/2949366215 shutdown_connections 2023-12-11T20:21:01.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 1 -- 172.21.15.12:0/2949366215 wait complete. 2023-12-11T20:21:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.835+0000 7f5d4eb41b80 20 client.26644 trim_cache size 0 max 16384 2023-12-11T20:21:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:21:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:21:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:21:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:21:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d240a14f0 msgr2=0x7f5d240a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d240a14f0 0x7f5d240a39b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009fd0 tx=0x7f5d2c009040 comp rx=0 tx=0).stop 2023-12-11T20:21:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/3402984889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d34101f40 msgr2=0x7f5d341994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d34101f40 0x7f5d341994f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d280098e0 tx=0x7f5d28005740 comp rx=0 tx=0).stop 2023-12-11T20:21:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/3402984889 shutdown_connections 2023-12-11T20:21:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d240a14f0 0x7f5d240a39b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d341071a0 0x7f5d341a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d34101f40 0x7f5d341994f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 --2- 172.21.15.12:0/3402984889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d34104870 0x7f5d34199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/3402984889 >> 172.21.15.12:0/3402984889 conn(0x7f5d340fb930 msgr2=0x7f5d34101830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/3402984889 shutdown_connections 2023-12-11T20:21:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:01.836+0000 7f5d3b1ff700 1 -- 172.21.15.12:0/3402984889 wait complete. 2023-12-11T20:21:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:03 smithi039 ceph-mon[102205]: pgmap v529: 97 pgs: 97 active+clean; 3.2 GiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:03 smithi012 ceph-mon[128787]: pgmap v529: 97 pgs: 97 active+clean; 3.2 GiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:03 smithi032 ceph-mon[132488]: pgmap v529: 97 pgs: 97 active+clean; 3.2 GiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:05 smithi039 ceph-mon[102205]: pgmap v530: 97 pgs: 97 active+clean; 3.2 GiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:05.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:05 smithi012 ceph-mon[128787]: pgmap v530: 97 pgs: 97 active+clean; 3.2 GiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:05.717 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:05 smithi032 ceph-mon[132488]: pgmap v530: 97 pgs: 97 active+clean; 3.2 GiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:07 smithi039 ceph-mon[102205]: pgmap v531: 97 pgs: 97 active+clean; 3.2 GiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:21:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:07 smithi012 ceph-mon[128787]: pgmap v531: 97 pgs: 97 active+clean; 3.2 GiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:21:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:07 smithi032 ceph-mon[132488]: pgmap v531: 97 pgs: 97 active+clean; 3.2 GiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:21:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:09 smithi032 ceph-mon[132488]: pgmap v532: 97 pgs: 97 active+clean; 3.3 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:21:09.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:09 smithi039 ceph-mon[102205]: pgmap v532: 97 pgs: 97 active+clean; 3.3 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:21:09.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:09 smithi012 ceph-mon[128787]: pgmap v532: 97 pgs: 97 active+clean; 3.3 GiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:21:11.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:11 smithi039 ceph-mon[102205]: pgmap v533: 97 pgs: 97 active+clean; 3.3 GiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:21:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:11 smithi012 ceph-mon[128787]: pgmap v533: 97 pgs: 97 active+clean; 3.3 GiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:21:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:11 smithi032 ceph-mon[132488]: pgmap v533: 97 pgs: 97 active+clean; 3.3 GiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:21:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:13 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:21:13.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:13 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:21:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:13 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:21:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:14 smithi012 ceph-mon[128787]: pgmap v534: 97 pgs: 97 active+clean; 3.3 GiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:21:14.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:14 smithi032 ceph-mon[132488]: pgmap v534: 97 pgs: 97 active+clean; 3.3 GiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:21:14.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:14 smithi039 ceph-mon[102205]: pgmap v534: 97 pgs: 97 active+clean; 3.3 GiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:21:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 -- 172.21.15.12:0/1926965548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3640755d0 msgr2=0x7ff364073a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/1926965548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3640755d0 0x7ff364073a20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff354009990 tx=0x7ff354009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 -- 172.21.15.12:0/1926965548 shutdown_connections 2023-12-11T20:21:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/1926965548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3641093a0 0x7ff36410b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/1926965548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3640755d0 0x7ff364073a20 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/1926965548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff364073ff0 0x7ff364074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 -- 172.21.15.12:0/1926965548 >> 172.21.15.12:0/1926965548 conn(0x7ff3640fca60 msgr2=0x7ff3640feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 -- 172.21.15.12:0/1926965548 shutdown_connections 2023-12-11T20:21:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.005+0000 7ff36a3ff700 1 -- 172.21.15.12:0/1926965548 wait complete. 2023-12-11T20:21:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.006+0000 7ff36a3ff700 1 Processor -- start 2023-12-11T20:21:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.006+0000 7ff36a3ff700 1 -- start start 2023-12-11T20:21:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff36a3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff364073ff0 0x7ff364199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff36a3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3640755d0 0x7ff364199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff36a3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3641093a0 0x7ff3641a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff363fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff364073ff0 0x7ff364199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff36a3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3641a10a0 con 0x7ff364073ff0 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff36a3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3641a11e0 con 0x7ff3641093a0 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff36a3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3641a1370 con 0x7ff3640755d0 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff363fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff364073ff0 0x7ff364199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36254/0 (socket says 172.21.15.12:36254) 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff363fff700 1 -- 172.21.15.12:0/3287480269 learned_addr learned my addr 172.21.15.12:0/3287480269 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.007+0000 7ff3637fe700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3640755d0 0x7ff364199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.008+0000 7ff36899c700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3641093a0 0x7ff3641a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.008+0000 7ff363fff700 1 -- 172.21.15.12:0/3287480269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3640755d0 msgr2=0x7ff364199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.008+0000 7ff363fff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3640755d0 0x7ff364199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.008+0000 7ff363fff700 1 -- 172.21.15.12:0/3287480269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3641093a0 msgr2=0x7ff3641a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.008+0000 7ff363fff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3641093a0 0x7ff3641a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.008+0000 7ff363fff700 1 -- 172.21.15.12:0/3287480269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3540095f0 con 0x7ff364073ff0 2023-12-11T20:21:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.008+0000 7ff36899c700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3641093a0 0x7ff3641a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.008+0000 7ff363fff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff364073ff0 0x7ff364199570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff3540098e0 tx=0x7ff354005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.009+0000 7ff3617fa700 1 -- 172.21.15.12:0/3287480269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35401d070 con 0x7ff364073ff0 2023-12-11T20:21:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.009+0000 7ff3617fa700 1 -- 172.21.15.12:0/3287480269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff354004000 con 0x7ff364073ff0 2023-12-11T20:21:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.009+0000 7ff3617fa700 1 -- 172.21.15.12:0/3287480269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354022ca0 con 0x7ff364073ff0 2023-12-11T20:21:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.009+0000 7ff36a3ff700 1 -- 172.21.15.12:0/3287480269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3641a15f0 con 0x7ff364073ff0 2023-12-11T20:21:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.009+0000 7ff36a3ff700 1 -- 172.21.15.12:0/3287480269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3641a19c0 con 0x7ff364073ff0 2023-12-11T20:21:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff37dd04b80 1 Processor -- start 2023-12-11T20:21:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff37dd04b80 1 -- start start 2023-12-11T20:21:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff3617fa700 1 -- 172.21.15.12:0/3287480269 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff354022470 con 0x7ff364073ff0 2023-12-11T20:21:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bcff92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff9830 0x5567bcffa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bcffaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bcf54af0 con 0x5567bcff8ed0 2023-12-11T20:21:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bcf52410 con 0x5567bcffa720 2023-12-11T20:21:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.014+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bcf4dd00 con 0x5567bcff9830 2023-12-11T20:21:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.015+0000 7ff363fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff9830 0x5567bcffa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.015+0000 7ff36899c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bcff92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.015+0000 7ff363fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff9830 0x5567bcffa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60654/0 (socket says 172.21.15.12:60654) 2023-12-11T20:21:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.015+0000 7ff363fff700 1 -- 172.21.15.12:0/3335412603 learned_addr learned my addr 172.21.15.12:0/3335412603 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.015+0000 7ff3637fe700 1 --2- 172.21.15.12:0/3335412603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bcffaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff363fff700 1 -- 172.21.15.12:0/3335412603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 msgr2=0x5567bcffaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff363fff700 1 --2- 172.21.15.12:0/3335412603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bcffaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff363fff700 1 -- 172.21.15.12:0/3335412603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 msgr2=0x5567bcff92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff363fff700 1 --2- 172.21.15.12:0/3335412603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bcff92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff363fff700 1 -- 172.21.15.12:0/3335412603 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567bcdca5d0 con 0x5567bcff9830 2023-12-11T20:21:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff363fff700 1 --2- 172.21.15.12:0/3335412603 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff9830 0x5567bcffa140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3540d6260 tx=0x7ff3540d6570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2fe310530926ed3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff34a7fc700 1 -- 172.21.15.12:0/3335412603 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540d6e20 con 0x5567bcff9830 2023-12-11T20:21:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff3617fa700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff34c0a1470 0x7ff34c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff34a7fc700 1 -- 172.21.15.12:0/3335412603 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3540ce620 con 0x5567bcff9830 2023-12-11T20:21:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.016+0000 7ff34a7fc700 1 -- 172.21.15.12:0/3335412603 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540dc660 con 0x5567bcff9830 2023-12-11T20:21:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.017+0000 7ff3617fa700 1 -- 172.21.15.12:0/3287480269 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff3540ce1b0 con 0x7ff364073ff0 2023-12-11T20:21:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.017+0000 7ff36899c700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff34c0a1470 0x7ff34c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.017+0000 7ff37dd04b80 1 -- 172.21.15.12:0/3335412603 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff9830 msgr2=0x5567bcffa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.017+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/3335412603 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff9830 0x5567bcffa140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3540d6260 tx=0x7ff3540d6570 comp rx=0 tx=0).stop 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.018+0000 7ff36899c700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff34c0a1470 0x7ff34c0a3930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0094f0 tx=0x7ff35c009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.018+0000 7ff37dd04b80 1 -- 172.21.15.12:0/3335412603 shutdown_connections 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.018+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/3335412603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bcffaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.018+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/3335412603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bcff92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.018+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/3335412603 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff9830 0x5567bcffa140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.018+0000 7ff37dd04b80 1 -- 172.21.15.12:0/3335412603 >> 172.21.15.12:0/3335412603 conn(0x5567bcf28780 msgr2=0x5567bcff5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.018+0000 7ff37dd04b80 1 -- 172.21.15.12:0/3335412603 shutdown_connections 2023-12-11T20:21:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.018+0000 7ff37dd04b80 1 -- 172.21.15.12:0/3335412603 wait complete. 2023-12-11T20:21:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.019+0000 7ff37dd04b80 1 -- start start 2023-12-11T20:21:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.019+0000 7ff37dd04b80 1 Processor -- start 2023-12-11T20:21:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.020+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bd002b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.020+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcff9830 0x5567bd003060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.020+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcffa720 0x5567bd009e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.020+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bcf07500 con 0x5567bcff8ed0 2023-12-11T20:21:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.020+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bcf071a0 con 0x5567bcff9830 2023-12-11T20:21:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.020+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bcdcc8c0 con 0x5567bcffa720 2023-12-11T20:21:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.020+0000 7ff37dd04b80 10 client.0 _ll_register_callbacks cb 0x5567bce32a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.021+0000 7ff363fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bd002b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.021+0000 7ff363fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bd002b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36274/0 (socket says 172.21.15.12:36274) 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.021+0000 7ff363fff700 1 -- 172.21.15.12:0/2644692492 learned_addr learned my addr 172.21.15.12:0/2644692492 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.021+0000 7ff36899c700 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcffa720 0x5567bd009e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.021+0000 7ff3637fe700 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcff9830 0x5567bd003060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.021+0000 7ff363fff700 1 -- 172.21.15.12:0/2644692492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcffa720 msgr2=0x5567bd009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.021+0000 7ff363fff700 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcffa720 0x5567bd009e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.022+0000 7ff363fff700 1 -- 172.21.15.12:0/2644692492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcff9830 msgr2=0x5567bd003060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.022+0000 7ff363fff700 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcff9830 0x5567bd003060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.022+0000 7ff363fff700 1 -- 172.21.15.12:0/2644692492 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3641a19c0 con 0x5567bcff8ed0 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.022+0000 7ff363fff700 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bd002b20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff354009350 tx=0x7ff354005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523e4e41a80f7e64 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.022+0000 7ff3437fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.022+0000 7ff3437fe700 1 -- 172.21.15.12:0/2644692492 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540d6e20 con 0x5567bcff8ed0 2023-12-11T20:21:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.022+0000 7ff3437fe700 1 -- 172.21.15.12:0/2644692492 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff354004170 con 0x5567bcff8ed0 2023-12-11T20:21:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.022+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2644692492 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567bcfec730 con 0x5567bcff8ed0 2023-12-11T20:21:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff3437fe700 1 -- 172.21.15.12:0/2644692492 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3540d1d80 con 0x5567bcff8ed0 2023-12-11T20:21:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff37dd04b80 10 client.16953 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2644692492 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5567bcd76d80 con 0x5567bcff8ed0 2023-12-11T20:21:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff3437fe700 1 -- 172.21.15.12:0/2644692492 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5567bcfec730 con 0x5567bcff8ed0 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff3437fe700 1 -- 172.21.15.12:0/2644692492 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff35409b770 con 0x5567bcff8ed0 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff37dd04b80 10 client.16953 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff37dd04b80 10 client.16953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff37dd04b80 20 client.16953 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567bd016d80 0x5567bd0191a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff37dd04b80 4 client.16953 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.023+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2644692492 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567bcfc8ee0 con 0x5567bd016d80 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.024+0000 7ff3637fe700 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567bd016d80 0x5567bd0191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.025+0000 7ff3637fe700 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567bd016d80 0x5567bd0191a0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a2b34382c365e54 server_cookie=5966b0b5641d5744 in_seq=0 out_seq=0 2023-12-11T20:21:15.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.025+0000 7ff3437fe700 10 client.16953 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:15.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.026+0000 7ff3437fe700 1 -- 172.21.15.12:0/2644692492 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5567bcfc8ee0 con 0x5567bd016d80 2023-12-11T20:21:15.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.026+0000 7ff3437fe700 10 client.16953 handle_command_reply: tid=0 2023-12-11T20:21:15.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.026+0000 7ff37dd04b80 1 client.16953 shutdown 2023-12-11T20:21:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2644692492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 msgr2=0x5567bd002b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bd002b20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff354009350 tx=0x7ff354005850 comp rx=0 tx=0).stop 2023-12-11T20:21:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2644692492 shutdown_connections 2023-12-11T20:21:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567bd016d80 0x5567bd0191a0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcffa720 0x5567bd009e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff8ed0 0x5567bd002b20 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2644692492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcff9830 0x5567bd003060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2644692492 >> 172.21.15.12:0/2644692492 conn(0x5567bcf28780 msgr2=0x5567bcff3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff3437fe700 0 client.16953 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2644692492 shutdown_connections 2023-12-11T20:21:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.027+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2644692492 wait complete. 2023-12-11T20:21:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.028+0000 7ff37dd04b80 20 client.16953 trim_cache size 0 max 16384 2023-12-11T20:21:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.043+0000 7ff37dd04b80 1 Processor -- start 2023-12-11T20:21:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff37dd04b80 1 -- start start 2023-12-11T20:21:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd001e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd009e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bcff5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bcff5050 con 0x5567bcff9830 2023-12-11T20:21:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bcfec700 con 0x5567bcffa720 2023-12-11T20:21:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bd002480 con 0x5567bcff8ed0 2023-12-11T20:21:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd009e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd009e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36288/0 (socket says 172.21.15.12:36288) 2023-12-11T20:21:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff3637fe700 1 -- 172.21.15.12:0/1947994951 learned_addr learned my addr 172.21.15.12:0/1947994951 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff363fff700 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd001e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.044+0000 7ff36899c700 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bcff5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff363fff700 1 -- 172.21.15.12:0/1947994951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 msgr2=0x5567bcff5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff363fff700 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bcff5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff363fff700 1 -- 172.21.15.12:0/1947994951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 msgr2=0x5567bd009e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff363fff700 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd009e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff363fff700 1 -- 172.21.15.12:0/1947994951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567bcd5fc00 con 0x5567bcff8ed0 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff3637fe700 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd009e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff363fff700 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd001e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff35409ae90 tx=0x7ff3540d6570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c88cef0418c70b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff34affd700 1 -- 172.21.15.12:0/1947994951 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540ce470 con 0x5567bcff8ed0 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff34affd700 1 -- 172.21.15.12:0/1947994951 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff354004170 con 0x5567bcff8ed0 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.045+0000 7ff34affd700 1 -- 172.21.15.12:0/1947994951 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35409f660 con 0x5567bcff8ed0 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 -- 172.21.15.12:0/1947994951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 msgr2=0x5567bd001e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd001e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff35409ae90 tx=0x7ff3540d6570 comp rx=0 tx=0).stop 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 -- 172.21.15.12:0/1947994951 shutdown_connections 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bcff5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd001e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/1947994951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd009e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 -- 172.21.15.12:0/1947994951 >> 172.21.15.12:0/1947994951 conn(0x5567bcf28780 msgr2=0x5567bd0016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 -- 172.21.15.12:0/1947994951 shutdown_connections 2023-12-11T20:21:15.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.046+0000 7ff37dd04b80 1 -- 172.21.15.12:0/1947994951 wait complete. 2023-12-11T20:21:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.047+0000 7ff37dd04b80 1 -- start start 2023-12-11T20:21:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.047+0000 7ff37dd04b80 1 Processor -- start 2023-12-11T20:21:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd067240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff37dd04b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bd06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bd00a190 con 0x5567bcff9830 2023-12-11T20:21:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bd06c220 con 0x5567bcffa720 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff37dd04b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567bd06c360 con 0x5567bcff8ed0 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff37dd04b80 10 client.0 _ll_register_callbacks cb 0x5567bce32a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd069790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36298/0 (socket says 172.21.15.12:36298) 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff3637fe700 1 -- 172.21.15.12:0/2830033408 learned_addr learned my addr 172.21.15.12:0/2830033408 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff36899c700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bd06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff363fff700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff3637fe700 1 -- 172.21.15.12:0/2830033408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 msgr2=0x5567bd067240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff3637fe700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd067240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff3637fe700 1 -- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 msgr2=0x5567bd06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff3637fe700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bd06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff3637fe700 1 -- 172.21.15.12:0/2830033408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff358004280 con 0x5567bcff9830 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff36899c700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bd06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.048+0000 7ff363fff700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd067240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff3637fe700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd069790 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff358005950 tx=0x7ff35800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c6e0a96877152a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff3437fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff3437fe700 1 -- 172.21.15.12:0/2830033408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358003a90 con 0x5567bcff9830 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2830033408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3540ce620 con 0x5567bcff9830 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff3437fe700 1 -- 172.21.15.12:0/2830033408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff358003bf0 con 0x5567bcff9830 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff3437fe700 1 -- 172.21.15.12:0/2830033408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff358003db0 con 0x5567bcff9830 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff37dd04b80 10 client.16959 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2830033408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5567bcd76d80 con 0x5567bcff9830 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.049+0000 7ff3437fe700 1 -- 172.21.15.12:0/2830033408 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3540ce620 con 0x5567bcff9830 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.050+0000 7ff3437fe700 1 -- 172.21.15.12:0/2830033408 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff358011440 con 0x5567bcff9830 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.050+0000 7ff37dd04b80 10 client.16959 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.050+0000 7ff37dd04b80 10 client.16959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.050+0000 7ff37dd04b80 20 client.16959 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.050+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567bd06dd20 0x5567bd070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.050+0000 7ff37dd04b80 4 client.16959 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:21:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.050+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2830033408 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5567bcf13f70 con 0x5567bd06dd20 2023-12-11T20:21:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.050+0000 7ff363fff700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567bd06dd20 0x5567bd070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.051+0000 7ff363fff700 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567bd06dd20 0x5567bd070140 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=184deaca65abd89e server_cookie=ed80e3989bbc9956 in_seq=0 out_seq=0 2023-12-11T20:21:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.051+0000 7ff3437fe700 10 client.16959 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff3437fe700 1 -- 172.21.15.12:0/2830033408 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5567bcf13f70 con 0x5567bd06dd20 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff3437fe700 10 client.16959 handle_command_reply: tid=0 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 client.16959 shutdown 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2830033408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 msgr2=0x5567bd069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd069790 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff358005950 tx=0x7ff35800b8c0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2830033408 shutdown_connections 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567bd06dd20 0x5567bd070140 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5567bcffa720 0x5567bd06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5567bcff8ed0 0x5567bd067240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff3437fe700 0 client.16959 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 --2- 172.21.15.12:0/2830033408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5567bcff9830 0x5567bd069790 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.060+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2830033408 >> 172.21.15.12:0/2830033408 conn(0x5567bcf28780 msgr2=0x5567bcffd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.061+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2830033408 shutdown_connections 2023-12-11T20:21:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.061+0000 7ff37dd04b80 1 -- 172.21.15.12:0/2830033408 wait complete. 2023-12-11T20:21:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.061+0000 7ff37dd04b80 20 client.16959 trim_cache size 0 max 16384 2023-12-11T20:21:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:21:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:21:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:21:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:21:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.061+0000 7ff36a3ff700 1 -- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff34c0a1470 msgr2=0x7ff34c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.061+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff34c0a1470 0x7ff34c0a3930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0094f0 tx=0x7ff35c009040 comp rx=0 tx=0).stop 2023-12-11T20:21:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.061+0000 7ff36a3ff700 1 -- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff364073ff0 msgr2=0x7ff364199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.061+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff364073ff0 0x7ff364199570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff3540098e0 tx=0x7ff354005f10 comp rx=0 tx=0).stop 2023-12-11T20:21:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.062+0000 7ff36a3ff700 1 -- 172.21.15.12:0/3287480269 shutdown_connections 2023-12-11T20:21:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.062+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff34c0a1470 0x7ff34c0a3930 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.062+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3641093a0 0x7ff3641a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.062+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff364073ff0 0x7ff364199570 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.062+0000 7ff36a3ff700 1 --2- 172.21.15.12:0/3287480269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3640755d0 0x7ff364199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.062+0000 7ff36a3ff700 1 -- 172.21.15.12:0/3287480269 >> 172.21.15.12:0/3287480269 conn(0x7ff3640fca60 msgr2=0x7ff3641052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.062+0000 7ff36a3ff700 1 -- 172.21.15.12:0/3287480269 shutdown_connections 2023-12-11T20:21:15.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:15.062+0000 7ff36a3ff700 1 -- 172.21.15.12:0/3287480269 wait complete. 2023-12-11T20:21:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:21:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:21:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:15 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:21:15.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:21:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:21:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:15 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:21:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:21:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:21:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:15 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:21:15.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:21:16.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 -- 172.21.15.12:0/4218302116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 msgr2=0x7f43a0102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 --2- 172.21.15.12:0/4218302116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 0x7f43a0102940 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f43900099c0 tx=0x7f4390009cd0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 -- 172.21.15.12:0/4218302116 shutdown_connections 2023-12-11T20:21:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 --2- 172.21.15.12:0/4218302116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43a01012f0 0x7f43a0101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 --2- 172.21.15.12:0/4218302116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43a0102e80 0x7f43a0109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 --2- 172.21.15.12:0/4218302116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 0x7f43a0102940 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 -- 172.21.15.12:0/4218302116 >> 172.21.15.12:0/4218302116 conn(0x7f43a00fc860 msgr2=0x7f43a00feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 -- 172.21.15.12:0/4218302116 shutdown_connections 2023-12-11T20:21:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.140+0000 7f43a739d700 1 -- 172.21.15.12:0/4218302116 wait complete. 2023-12-11T20:21:16.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.141+0000 7f43a739d700 1 Processor -- start 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.141+0000 7f43a739d700 1 -- start start 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.141+0000 7f43a739d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43a01012f0 0x7f43a01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.141+0000 7f43a739d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 0x7f43a0199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a739d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43a0102e80 0x7f43a01a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a739d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01a0df0 con 0x7f43a01024e0 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a739d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01a0f30 con 0x7f43a0102e80 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a739d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01a10c0 con 0x7f43a01012f0 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a639b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43a01012f0 0x7f43a01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a6b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43a0102e80 0x7f43a01a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a639b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43a01012f0 0x7f43a01992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60694/0 (socket says 172.21.15.12:60694) 2023-12-11T20:21:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a639b700 1 -- 172.21.15.12:0/2819487280 learned_addr learned my addr 172.21.15.12:0/2819487280 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 0x7f43a0199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a639b700 1 -- 172.21.15.12:0/2819487280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43a0102e80 msgr2=0x7f43a01a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a639b700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43a0102e80 0x7f43a01a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a639b700 1 -- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 msgr2=0x7f43a0199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.142+0000 7f43a639b700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 0x7f43a0199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43a639b700 1 -- 172.21.15.12:0/2819487280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900095f0 con 0x7f43a01012f0 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43a6b9c700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43a0102e80 0x7f43a01a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 0x7f43a0199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43a639b700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43a01012f0 0x7f43a01992c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f439c00e970 tx=0x7f439c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43977fe700 1 -- 172.21.15.12:0/2819487280 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c009790 con 0x7f43a01012f0 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43977fe700 1 -- 172.21.15.12:0/2819487280 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f439c00eec0 con 0x7f43a01012f0 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43a739d700 1 -- 172.21.15.12:0/2819487280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a01a13a0 con 0x7f43a01012f0 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43977fe700 1 -- 172.21.15.12:0/2819487280 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c003c10 con 0x7f43a01012f0 2023-12-11T20:21:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.143+0000 7f43a739d700 1 -- 172.21.15.12:0/2819487280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a01a1900 con 0x7f43a01012f0 2023-12-11T20:21:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.148+0000 7f43977fe700 1 -- 172.21.15.12:0/2819487280 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f439c018430 con 0x7f43a01012f0 2023-12-11T20:21:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.148+0000 7f43bbf44b80 1 Processor -- start 2023-12-11T20:21:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43bbf44b80 1 -- start start 2023-12-11T20:21:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f2829fde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f2829fe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f2829ff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f282958b50 con 0x55f2829fe3c0 2023-12-11T20:21:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f282956470 con 0x55f2829fda60 2023-12-11T20:21:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f282951d60 con 0x55f2829fede0 2023-12-11T20:21:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43a639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f2829fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43a639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f2829fe8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36312/0 (socket says 172.21.15.12:36312) 2023-12-11T20:21:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.149+0000 7f43a639b700 1 -- 172.21.15.12:0/1796982975 learned_addr learned my addr 172.21.15.12:0/1796982975 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.150+0000 7f43a6b9c700 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f2829fde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.150+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f2829ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.150+0000 7f43a639b700 1 -- 172.21.15.12:0/1796982975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 msgr2=0x55f2829ff240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.150+0000 7f43a639b700 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f2829ff240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.150+0000 7f43a639b700 1 -- 172.21.15.12:0/1796982975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 msgr2=0x55f2829fde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.150+0000 7f43a639b700 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f2829fde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.150+0000 7f43a639b700 1 -- 172.21.15.12:0/1796982975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2827ce630 con 0x55f2829fe3c0 2023-12-11T20:21:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.150+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f2829ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.151+0000 7f43a639b700 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f2829fe8a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f439c0d0d10 tx=0x7f439c0d0d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b175b8f289bf7f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.151+0000 7f43977fe700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f438c0a15a0 0x7f438c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.151+0000 7f43a6b9c700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f438c0a15a0 0x7f438c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.151+0000 7f4394bfe700 1 -- 172.21.15.12:0/1796982975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0d8070 con 0x55f2829fe3c0 2023-12-11T20:21:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.151+0000 7f4394bfe700 1 -- 172.21.15.12:0/1796982975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f439c096590 con 0x55f2829fe3c0 2023-12-11T20:21:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.151+0000 7f4394bfe700 1 -- 172.21.15.12:0/1796982975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c099d90 con 0x55f2829fe3c0 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43977fe700 1 -- 172.21.15.12:0/2819487280 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f439c014070 con 0x7f43a01012f0 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1796982975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 msgr2=0x55f2829fe8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43a6b9c700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f438c0a15a0 0x7f438c0a3a60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4398003d50 tx=0x7f4398009100 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f2829fe8a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f439c0d0d10 tx=0x7f439c0d0d40 comp rx=0 tx=0).stop 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1796982975 shutdown_connections 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f2829fde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f2829ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1796982975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f2829fe8a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.152+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1796982975 >> 172.21.15.12:0/1796982975 conn(0x55f28292c7e0 msgr2=0x55f2829f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.153+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1796982975 shutdown_connections 2023-12-11T20:21:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.153+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1796982975 wait complete. 2023-12-11T20:21:16.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.153+0000 7f43bbf44b80 1 -- start start 2023-12-11T20:21:16.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43bbf44b80 1 Processor -- start 2023-12-11T20:21:16.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a07370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f282a0e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28290b560 con 0x55f2829fe3c0 2023-12-11T20:21:16.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28290b200 con 0x55f2829fda60 2023-12-11T20:21:16.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2827d0920 con 0x55f2829fede0 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43bbf44b80 10 client.0 _ll_register_callbacks cb 0x55f282836a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.154+0000 7f43a5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36326/0 (socket says 172.21.15.12:36326) 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a5b9a700 1 -- 172.21.15.12:0/1153302607 learned_addr learned my addr 172.21.15.12:0/1153302607 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a639b700 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a07370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a6b9c700 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f282a0e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a5b9a700 1 -- 172.21.15.12:0/1153302607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 msgr2=0x55f282a0e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f282a0e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a5b9a700 1 -- 172.21.15.12:0/1153302607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 msgr2=0x55f282a07370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a07370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.155+0000 7f43a5b9a700 1 -- 172.21.15.12:0/1153302607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a01a1900 con 0x55f2829fe3c0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.156+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a078b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f439000bf10 tx=0x7f4390005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a36831e98db30ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.156+0000 7f4389ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.156+0000 7f4389ffb700 1 -- 172.21.15.12:0/1153302607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390005560 con 0x55f2829fe3c0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.156+0000 7f4389ffb700 1 -- 172.21.15.12:0/1153302607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43900056c0 con 0x55f2829fe3c0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.156+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1153302607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2829f09e0 con 0x55f2829fe3c0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f4389ffb700 1 -- 172.21.15.12:0/1153302607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4390003760 con 0x55f2829fe3c0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f43bbf44b80 10 client.16971 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1153302607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f28277ade0 con 0x55f2829fe3c0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f4389ffb700 1 -- 172.21.15.12:0/1153302607 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4390031020 con 0x55f2829fe3c0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f4389ffb700 1 -- 172.21.15.12:0/1153302607 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4390021070 con 0x55f2829fe3c0 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f43bbf44b80 10 client.16971 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f43bbf44b80 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:16.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f43bbf44b80 20 client.16971 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:16.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f282a13100 0x55f282a15520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f43bbf44b80 4 client.16971 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:16.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.157+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1153302607 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2829ccf40 con 0x55f282a13100 2023-12-11T20:21:16.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.158+0000 7f43a639b700 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f282a13100 0x55f282a15520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.159+0000 7f43a639b700 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f282a13100 0x55f282a15520 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=201024c0077983b0 server_cookie=549692a0808fe142 in_seq=0 out_seq=0 2023-12-11T20:21:16.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.159+0000 7f4389ffb700 10 client.16971 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:16.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.159+0000 7f4389ffb700 1 -- 172.21.15.12:0/1153302607 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f2829ccf40 con 0x55f282a13100 2023-12-11T20:21:16.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.159+0000 7f4389ffb700 10 client.16971 handle_command_reply: tid=0 2023-12-11T20:21:16.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 client.16971 shutdown 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1153302607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 msgr2=0x55f282a078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a078b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f439000bf10 tx=0x7f4390005e80 comp rx=0 tx=0).stop 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1153302607 shutdown_connections 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f282a13100 0x55f282a15520 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a07370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f282a0e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1153302607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a078b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1153302607 >> 172.21.15.12:0/1153302607 conn(0x55f28292c7e0 msgr2=0x55f2829fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f4389ffb700 0 client.16971 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1153302607 shutdown_connections 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.160+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1153302607 wait complete. 2023-12-11T20:21:16.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.161+0000 7f43bbf44b80 20 client.16971 trim_cache size 0 max 16384 2023-12-11T20:21:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.181+0000 7f43bbf44b80 1 Processor -- start 2023-12-11T20:21:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.181+0000 7f43bbf44b80 1 -- start start 2023-12-11T20:21:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.181+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a15110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.181+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.181+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f282a19e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.181+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2829f4880 con 0x55f2829fe3c0 2023-12-11T20:21:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.181+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2829f31e0 con 0x55f2829fda60 2023-12-11T20:21:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.181+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f282a07ff0 con 0x55f2829fede0 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36334/0 (socket says 172.21.15.12:36334) 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a5b9a700 1 -- 172.21.15.12:0/1082268026 learned_addr learned my addr 172.21.15.12:0/1082268026 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a639b700 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a15110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a6b9c700 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f282a19e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a5b9a700 1 -- 172.21.15.12:0/1082268026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 msgr2=0x55f282a19e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f282a19e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a5b9a700 1 -- 172.21.15.12:0/1082268026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 msgr2=0x55f282a15110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a15110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a5b9a700 1 -- 172.21.15.12:0/1082268026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f282763c60 con 0x55f2829fe3c0 2023-12-11T20:21:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.182+0000 7f43a639b700 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a15110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.183+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0e8b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f43900036c0 tx=0x7f4390009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c987dda647b56331 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.183+0000 7f43953ff700 1 -- 172.21.15.12:0/1082268026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390005560 con 0x55f2829fe3c0 2023-12-11T20:21:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.183+0000 7f43953ff700 1 -- 172.21.15.12:0/1082268026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4390031040 con 0x55f2829fe3c0 2023-12-11T20:21:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.183+0000 7f43953ff700 1 -- 172.21.15.12:0/1082268026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439002b4d0 con 0x55f2829fe3c0 2023-12-11T20:21:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1082268026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 msgr2=0x55f282a0e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0e8b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f43900036c0 tx=0x7f4390009cd0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1082268026 shutdown_connections 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fda60 0x55f282a15110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fede0 0x55f282a19e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/1082268026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0e8b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1082268026 >> 172.21.15.12:0/1082268026 conn(0x55f28292c7e0 msgr2=0x55f282a06880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1082268026 shutdown_connections 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 -- 172.21.15.12:0/1082268026 wait complete. 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.184+0000 7f43bbf44b80 1 -- start start 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43bbf44b80 1 Processor -- start 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fda60 0x55f282a0c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43bbf44b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fede0 0x55f282a0ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f282a0e300 con 0x55f2829fe3c0 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f282a0e470 con 0x55f2829fede0 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43bbf44b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f282a0e5e0 con 0x55f2829fda60 2023-12-11T20:21:16.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43bbf44b80 10 client.0 _ll_register_callbacks cb 0x55f282836a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:16.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43a5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.185+0000 7f43a639b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fda60 0x55f282a0c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36338/0 (socket says 172.21.15.12:36338) 2023-12-11T20:21:16.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a5b9a700 1 -- 172.21.15.12:0/4243217141 learned_addr learned my addr 172.21.15.12:0/4243217141 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:16.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a6b9c700 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fede0 0x55f282a0ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a5b9a700 1 -- 172.21.15.12:0/4243217141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fda60 msgr2=0x55f282a0c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fda60 0x55f282a0c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a5b9a700 1 -- 172.21.15.12:0/4243217141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fede0 msgr2=0x55f282a0ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fede0 0x55f282a0ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a5b9a700 1 -- 172.21.15.12:0/4243217141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c07ea90 con 0x55f2829fe3c0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f43a5b9a700 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0ce00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4390038040 tx=0x7f4390003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd867a771c674 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.186+0000 7f4389ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f4389ffb700 1 -- 172.21.15.12:0/4243217141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439000f660 con 0x55f2829fe3c0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f43bbf44b80 1 -- 172.21.15.12:0/4243217141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f439c096590 con 0x55f2829fe3c0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f4389ffb700 1 -- 172.21.15.12:0/4243217141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4390000e40 con 0x55f2829fe3c0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f4389ffb700 1 -- 172.21.15.12:0/4243217141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43900056b0 con 0x55f2829fe3c0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f43bbf44b80 10 client.16977 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f43bbf44b80 1 -- 172.21.15.12:0/4243217141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f28277ade0 con 0x55f2829fe3c0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f4389ffb700 1 -- 172.21.15.12:0/4243217141 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f439004f080 con 0x55f2829fe3c0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f4389ffb700 1 -- 172.21.15.12:0/4243217141 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f439000b260 con 0x55f2829fe3c0 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f43bbf44b80 10 client.16977 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f43bbf44b80 10 client.16977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f43bbf44b80 20 client.16977 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f282a6a350 0x55f282a6c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.187+0000 7f43bbf44b80 4 client.16977 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.188+0000 7f43bbf44b80 1 -- 172.21.15.12:0/4243217141 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f282917fd0 con 0x55f282a6a350 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.188+0000 7f43a639b700 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f282a6a350 0x55f282a6c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43a639b700 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f282a6a350 0x55f282a6c740 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9f3d0a9e4451141 server_cookie=203b4937279af342 in_seq=0 out_seq=0 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f4389ffb700 10 client.16977 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f4389ffb700 1 -- 172.21.15.12:0/4243217141 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f282917fd0 con 0x55f282a6a350 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f4389ffb700 10 client.16977 handle_command_reply: tid=0 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 client.16977 shutdown 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 -- 172.21.15.12:0/4243217141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 msgr2=0x55f282a0ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0ce00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4390038040 tx=0x7f4390003970 comp rx=0 tx=0).stop 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 -- 172.21.15.12:0/4243217141 shutdown_connections 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f282a6a350 0x55f282a6c740 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2829fede0 0x55f282a0ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2829fda60 0x55f282a0c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 --2- 172.21.15.12:0/4243217141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2829fe3c0 0x55f282a0ce00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 -- 172.21.15.12:0/4243217141 >> 172.21.15.12:0/4243217141 conn(0x55f28292c7e0 msgr2=0x55f282a15110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f4389ffb700 0 client.16977 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:16.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 -- 172.21.15.12:0/4243217141 shutdown_connections 2023-12-11T20:21:16.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.189+0000 7f43bbf44b80 1 -- 172.21.15.12:0/4243217141 wait complete. 2023-12-11T20:21:16.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43bbf44b80 20 client.16977 trim_cache size 0 max 16384 2023-12-11T20:21:16.191 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:21:16.192 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:21:16.192 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:21:16.192 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:21:16.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 -- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f438c0a15a0 msgr2=0x7f438c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f438c0a15a0 0x7f438c0a3a60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4398003d50 tx=0x7f4398009100 comp rx=0 tx=0).stop 2023-12-11T20:21:16.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 -- 172.21.15.12:0/2819487280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43a01012f0 msgr2=0x7f43a01992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43a01012f0 0x7f43a01992c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f439c00e970 tx=0x7f439c00ec80 comp rx=0 tx=0).stop 2023-12-11T20:21:16.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 -- 172.21.15.12:0/2819487280 shutdown_connections 2023-12-11T20:21:16.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f438c0a15a0 0x7f438c0a3a60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43a0102e80 0x7f43a01a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43a01012f0 0x7f43a01992c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 --2- 172.21.15.12:0/2819487280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a01024e0 0x7f43a0199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.190+0000 7f43a739d700 1 -- 172.21.15.12:0/2819487280 >> 172.21.15.12:0/2819487280 conn(0x7f43a00fc860 msgr2=0x7f43a0073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.191+0000 7f43a739d700 1 -- 172.21.15.12:0/2819487280 shutdown_connections 2023-12-11T20:21:16.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.191+0000 7f43a739d700 1 -- 172.21.15.12:0/2819487280 wait complete. 2023-12-11T20:21:16.209 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:21:16.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:21:16.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:16 smithi012 ceph-mon[128787]: pgmap v535: 97 pgs: 97 active+clean; 3.4 GiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:21:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 -- 172.21.15.12:0/1780408900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d01048c0 msgr2=0x7f81d0106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 --2- 172.21.15.12:0/1780408900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d01048c0 0x7f81d0106cb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009990 tx=0x7f81c4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 -- 172.21.15.12:0/1780408900 shutdown_connections 2023-12-11T20:21:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 --2- 172.21.15.12:0/1780408900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81d0101f90 0x7f81d0104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 --2- 172.21.15.12:0/1780408900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81d01071f0 0x7f81d0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 --2- 172.21.15.12:0/1780408900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d01048c0 0x7f81d0106cb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 -- 172.21.15.12:0/1780408900 >> 172.21.15.12:0/1780408900 conn(0x7f81d00fb980 msgr2=0x7f81d00fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 -- 172.21.15.12:0/1780408900 shutdown_connections 2023-12-11T20:21:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.436+0000 7f81d53ff700 1 -- 172.21.15.12:0/1780408900 wait complete. 2023-12-11T20:21:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.438+0000 7f81d53ff700 1 Processor -- start 2023-12-11T20:21:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.438+0000 7f81d53ff700 1 -- start start 2023-12-11T20:21:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.438+0000 7f81d53ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0101f90 0x7f81d01994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.438+0000 7f81d53ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81d01048c0 0x7f81d0199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.438+0000 7f81d53ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81d01071f0 0x7f81d01a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.438+0000 7f81d53ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01a1020 con 0x7f81d0101f90 2023-12-11T20:21:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.438+0000 7f81d53ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01a1160 con 0x7f81d01048c0 2023-12-11T20:21:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.438+0000 7f81d53ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01a12f0 con 0x7f81d01071f0 2023-12-11T20:21:16.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ceffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0101f90 0x7f81d01994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ceffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0101f90 0x7f81d01994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36362/0 (socket says 172.21.15.12:36362) 2023-12-11T20:21:16.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ceffd700 1 -- 172.21.15.12:0/2029222129 learned_addr learned my addr 172.21.15.12:0/2029222129 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ce7fc700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81d01048c0 0x7f81d0199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81cf7fe700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81d01071f0 0x7f81d01a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ceffd700 1 -- 172.21.15.12:0/2029222129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81d01071f0 msgr2=0x7f81d01a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ceffd700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81d01071f0 0x7f81d01a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ceffd700 1 -- 172.21.15.12:0/2029222129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81d01048c0 msgr2=0x7f81d0199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ceffd700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81d01048c0 0x7f81d0199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ceffd700 1 -- 172.21.15.12:0/2029222129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40095f0 con 0x7f81d0101f90 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.439+0000 7f81ce7fc700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81d01048c0 0x7f81d0199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.440+0000 7f81ceffd700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0101f90 0x7f81d01994f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f81c000e9a0 tx=0x7f81c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.440+0000 7f81b7fff700 1 -- 172.21.15.12:0/2029222129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0009790 con 0x7f81d0101f90 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.440+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d01a15d0 con 0x7f81d0101f90 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.440+0000 7f81b7fff700 1 -- 172.21.15.12:0/2029222129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81c0010430 con 0x7f81d0101f90 2023-12-11T20:21:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.440+0000 7f81b7fff700 1 -- 172.21.15.12:0/2029222129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000cea0 con 0x7f81d0101f90 2023-12-11T20:21:16.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.440+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d01a1b30 con 0x7f81d0101f90 2023-12-11T20:21:16.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.442+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d0068330 con 0x7f81d0101f90 2023-12-11T20:21:16.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.444+0000 7f81b7fff700 1 -- 172.21.15.12:0/2029222129 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f81c00105a0 con 0x7f81d0101f90 2023-12-11T20:21:16.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.445+0000 7f81b7fff700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81b80a1480 0x7f81b80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.446+0000 7f81b7fff700 1 -- 172.21.15.12:0/2029222129 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f81c0014070 con 0x7f81d0101f90 2023-12-11T20:21:16.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.446+0000 7f81ce7fc700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81b80a1480 0x7f81b80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.447+0000 7f81ce7fc700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81b80a1480 0x7f81b80a3940 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f81c4005910 tx=0x7f81c400b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.452+0000 7f81b7fff700 1 -- 172.21.15.12:0/2029222129 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f81c00522f0 con 0x7f81d0101f90 2023-12-11T20:21:16.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:16 smithi032 ceph-mon[132488]: pgmap v535: 97 pgs: 97 active+clean; 3.4 GiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:21:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:16 smithi039 ceph-mon[102205]: pgmap v535: 97 pgs: 97 active+clean; 3.4 GiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:21:16.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.729+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81d010cb70 con 0x7f81d0101f90 2023-12-11T20:21:16.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.730+0000 7f81b7fff700 1 -- 172.21.15.12:0/2029222129 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f81c00d1070 con 0x7f81d0101f90 2023-12-11T20:21:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:21:16.729 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.732+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81b80a1480 msgr2=0x7f81b80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.732+0000 7f81d53ff700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81b80a1480 0x7f81b80a3940 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f81c4005910 tx=0x7f81c400b610 comp rx=0 tx=0).stop 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.732+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0101f90 msgr2=0x7f81d01994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.732+0000 7f81d53ff700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0101f90 0x7f81d01994f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f81c000e9a0 tx=0x7f81c000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.733+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 shutdown_connections 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.733+0000 7f81d53ff700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81b80a1480 0x7f81b80a3940 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.733+0000 7f81d53ff700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81d01071f0 0x7f81d01a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.733+0000 7f81d53ff700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81d0101f90 0x7f81d01994f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.733+0000 7f81d53ff700 1 --2- 172.21.15.12:0/2029222129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81d01048c0 0x7f81d0199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.733+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 >> 172.21.15.12:0/2029222129 conn(0x7f81d00fb980 msgr2=0x7f81d00fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.733+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 shutdown_connections 2023-12-11T20:21:16.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.733+0000 7f81d53ff700 1 -- 172.21.15.12:0/2029222129 wait complete. 2023-12-11T20:21:16.733 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:21:16.751 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:21:16.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 -- 172.21.15.12:0/381063920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1014b0 msgr2=0x7fea4c1018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 --2- 172.21.15.12:0/381063920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1014b0 0x7fea4c1018d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0099c0 tx=0x7fea3c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 -- 172.21.15.12:0/381063920 shutdown_connections 2023-12-11T20:21:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 --2- 172.21.15.12:0/381063920 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea4c103040 0x7fea4c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 --2- 172.21.15.12:0/381063920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1014b0 0x7fea4c1018d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 --2- 172.21.15.12:0/381063920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4c1026a0 0x7fea4c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 -- 172.21.15.12:0/381063920 >> 172.21.15.12:0/381063920 conn(0x7fea4c0fca20 msgr2=0x7fea4c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 -- 172.21.15.12:0/381063920 shutdown_connections 2023-12-11T20:21:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.993+0000 7fea515ff700 1 -- 172.21.15.12:0/381063920 wait complete. 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.994+0000 7fea515ff700 1 Processor -- start 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.994+0000 7fea515ff700 1 -- start start 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea515ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea4c1014b0 0x7fea4c199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea515ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1026a0 0x7fea4c199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea515ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4c103040 0x7fea4c1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea515ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1a1060 con 0x7fea4c1026a0 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea515ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1a11a0 con 0x7fea4c1014b0 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea515ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1a1330 con 0x7fea4c103040 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1026a0 0x7fea4c199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1026a0 0x7fea4c199a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36374/0 (socket says 172.21.15.12:36374) 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4a7fc700 1 -- 172.21.15.12:0/3156860796 learned_addr learned my addr 172.21.15.12:0/3156860796 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4b7fe700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4c103040 0x7fea4c1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4affd700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea4c1014b0 0x7fea4c199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4a7fc700 1 -- 172.21.15.12:0/3156860796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4c103040 msgr2=0x7fea4c1a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4c103040 0x7fea4c1a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4a7fc700 1 -- 172.21.15.12:0/3156860796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea4c1014b0 msgr2=0x7fea4c199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.995+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea4c1014b0 0x7fea4c199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.996+0000 7fea4a7fc700 1 -- 172.21.15.12:0/3156860796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c0095f0 con 0x7fea4c1026a0 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.996+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1026a0 0x7fea4c199a70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fea4000d950 tx=0x7fea4000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.996+0000 7fea33fff700 1 -- 172.21.15.12:0/3156860796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40009b40 con 0x7fea4c1026a0 2023-12-11T20:21:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.996+0000 7fea515ff700 1 -- 172.21.15.12:0/3156860796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c1a1610 con 0x7fea4c1026a0 2023-12-11T20:21:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.996+0000 7fea33fff700 1 -- 172.21.15.12:0/3156860796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea40009ca0 con 0x7fea4c1026a0 2023-12-11T20:21:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.996+0000 7fea33fff700 1 -- 172.21.15.12:0/3156860796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000f620 con 0x7fea4c1026a0 2023-12-11T20:21:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.996+0000 7fea515ff700 1 -- 172.21.15.12:0/3156860796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c1a1b70 con 0x7fea4c1026a0 2023-12-11T20:21:16.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:16.999+0000 7fea33fff700 1 -- 172.21.15.12:0/3156860796 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fea40010460 con 0x7fea4c1026a0 2023-12-11T20:21:17.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.001+0000 7fea33fff700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea340a1500 0x7fea340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.001+0000 7fea33fff700 1 -- 172.21.15.12:0/3156860796 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea400cd0d0 con 0x7fea4c1026a0 2023-12-11T20:21:17.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.001+0000 7fea4affd700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea340a1500 0x7fea340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea64fcdb80 1 Processor -- start 2023-12-11T20:21:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea64fcdb80 1 -- start start 2023-12-11T20:21:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea4affd700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea340a1500 0x7fea340a39c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fea3c003780 tx=0x7fea3c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d2d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d2e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d2f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18c88b50 con 0x557c18d2d3d0 2023-12-11T20:21:17.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18c86470 con 0x557c18d2dd30 2023-12-11T20:21:17.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.002+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18c81d60 con 0x557c18d2ec20 2023-12-11T20:21:17.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d2d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d2e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d2e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44826/0 (socket says 172.21.15.12:44826) 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 -- 172.21.15.12:0/2936074338 learned_addr learned my addr 172.21.15.12:0/2936074338 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d2d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36382/0 (socket says 172.21.15.12:36382) 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4b7fe700 1 --2- 172.21.15.12:0/2936074338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d2f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 -- 172.21.15.12:0/2936074338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 msgr2=0x557c18d2f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/2936074338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d2f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 -- 172.21.15.12:0/2936074338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 msgr2=0x557c18d2d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/2936074338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d2d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 -- 172.21.15.12:0/2936074338 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c18afe630 con 0x557c18d2dd30 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.003+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/2936074338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d2e640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea40096db0 tx=0x7fea4009a190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55239fe1571df99d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.004+0000 7fea317fa700 1 -- 172.21.15.12:0/2936074338 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4009aa40 con 0x557c18d2dd30 2023-12-11T20:21:17.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.004+0000 7fea317fa700 1 -- 172.21.15.12:0/2936074338 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea4009a340 con 0x557c18d2dd30 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.004+0000 7fea317fa700 1 -- 172.21.15.12:0/2936074338 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4009e120 con 0x557c18d2dd30 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.004+0000 7fea64fcdb80 1 -- 172.21.15.12:0/2936074338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 msgr2=0x557c18d2e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.004+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/2936074338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d2e640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea40096db0 tx=0x7fea4009a190 comp rx=0 tx=0).stop 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.005+0000 7fea64fcdb80 1 -- 172.21.15.12:0/2936074338 shutdown_connections 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.005+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/2936074338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d2f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.005+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/2936074338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d2d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.005+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/2936074338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d2e640 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.005+0000 7fea64fcdb80 1 -- 172.21.15.12:0/2936074338 >> 172.21.15.12:0/2936074338 conn(0x557c18c5c7e0 msgr2=0x557c18d29d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.005+0000 7fea64fcdb80 1 -- 172.21.15.12:0/2936074338 shutdown_connections 2023-12-11T20:21:17.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.005+0000 7fea64fcdb80 1 -- 172.21.15.12:0/2936074338 wait complete. 2023-12-11T20:21:17.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.005+0000 7fea64fcdb80 1 -- start start 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea64fcdb80 1 Processor -- start 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d37120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d37660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2ec20 0x557c18d3e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18c3b560 con 0x557c18d2ec20 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18c3b200 con 0x557c18d2dd30 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18b00920 con 0x557c18d2d3d0 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea64fcdb80 10 client.0 _ll_register_callbacks cb 0x557c18b66a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.006+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d37660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d37660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44830/0 (socket says 172.21.15.12:44830) 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4a7fc700 1 -- 172.21.15.12:0/4002526495 learned_addr learned my addr 172.21.15.12:0/4002526495 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4affd700 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d37120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4b7fe700 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2ec20 0x557c18d3e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4a7fc700 1 -- 172.21.15.12:0/4002526495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 msgr2=0x557c18d37120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d37120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4a7fc700 1 -- 172.21.15.12:0/4002526495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2ec20 msgr2=0x557c18d3e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2ec20 0x557c18d3e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4a7fc700 1 -- 172.21.15.12:0/4002526495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c1a1b70 con 0x557c18d2dd30 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d37660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea400a21a0 tx=0x7fea40099da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf5fee06a8bf226 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.007+0000 7fea2eff5700 1 -- 172.21.15.12:0/4002526495 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4009aa40 con 0x557c18d2dd30 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea2eff5700 1 -- 172.21.15.12:0/4002526495 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea4009e490 con 0x557c18d2dd30 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 1 -- 172.21.15.12:0/4002526495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c18d20b40 con 0x557c18d2dd30 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea2eff5700 1 -- 172.21.15.12:0/4002526495 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea4009e120 con 0x557c18d2dd30 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 10 client.26699 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:17.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 1 -- 172.21.15.12:0/4002526495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557c18aaade0 con 0x557c18d2dd30 2023-12-11T20:21:17.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea2eff5700 1 -- 172.21.15.12:0/4002526495 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea400a6080 con 0x557c18d2dd30 2023-12-11T20:21:17.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea2eff5700 1 -- 172.21.15.12:0/4002526495 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fea40099930 con 0x557c18d2dd30 2023-12-11T20:21:17.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 10 client.26699 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:17.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 10 client.26699 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:21:17.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 20 client.26699 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:17.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557c18d42b40 0x557c18d44f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 4 client.26699 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:17.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.008+0000 7fea64fcdb80 1 -- 172.21.15.12:0/4002526495 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c18cfcf40 con 0x557c18d42b40 2023-12-11T20:21:17.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.009+0000 7fea4affd700 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557c18d42b40 0x557c18d44f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.010+0000 7fea4affd700 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557c18d42b40 0x557c18d44f60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a681993272fa4f1 server_cookie=4fb3116eabafedca in_seq=0 out_seq=0 2023-12-11T20:21:17.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.010+0000 7fea2eff5700 10 client.26699 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea2eff5700 1 -- 172.21.15.12:0/4002526495 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557c18cfcf40 con 0x557c18d42b40 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea2eff5700 10 client.26699 handle_command_reply: tid=0 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 client.26699 shutdown 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 -- 172.21.15.12:0/4002526495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 msgr2=0x557c18d37660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d37660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea400a21a0 tx=0x7fea40099da0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 -- 172.21.15.12:0/4002526495 shutdown_connections 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557c18d42b40 0x557c18d44f60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2ec20 0x557c18d3e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d37120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/4002526495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d37660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea2eff5700 0 client.26699 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 -- 172.21.15.12:0/4002526495 >> 172.21.15.12:0/4002526495 conn(0x557c18c5c7e0 msgr2=0x557c18d28a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 -- 172.21.15.12:0/4002526495 shutdown_connections 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 1 -- 172.21.15.12:0/4002526495 wait complete. 2023-12-11T20:21:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.011+0000 7fea64fcdb80 20 client.26699 trim_cache size 0 max 16384 2023-12-11T20:21:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.030+0000 7fea64fcdb80 1 Processor -- start 2023-12-11T20:21:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.030+0000 7fea64fcdb80 1 -- start start 2023-12-11T20:21:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d36630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2dd30 0x557c18d3e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2ec20 0x557c18d2f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18d37da0 con 0x557c18d2dd30 2023-12-11T20:21:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18d2e430 con 0x557c18d2ec20 2023-12-11T20:21:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18d34e60 con 0x557c18d2d3d0 2023-12-11T20:21:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2dd30 0x557c18d3e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2dd30 0x557c18d3e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36392/0 (socket says 172.21.15.12:36392) 2023-12-11T20:21:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea4a7fc700 1 -- 172.21.15.12:0/1104992476 learned_addr learned my addr 172.21.15.12:0/1104992476 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea4affd700 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d36630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.031+0000 7fea4b7fe700 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2ec20 0x557c18d2f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.032+0000 7fea4affd700 1 -- 172.21.15.12:0/1104992476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2ec20 msgr2=0x557c18d2f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.032+0000 7fea4affd700 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2ec20 0x557c18d2f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.032+0000 7fea4affd700 1 -- 172.21.15.12:0/1104992476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2dd30 msgr2=0x557c18d3e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.032+0000 7fea4affd700 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2dd30 0x557c18d3e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.032+0000 7fea4affd700 1 -- 172.21.15.12:0/1104992476 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c18a93c60 con 0x557c18d2d3d0 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.032+0000 7fea4affd700 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d36630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00b580 tx=0x7fea3c021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=636f0cdf91b1c558 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.032+0000 7fea31ffb700 1 -- 172.21.15.12:0/1104992476 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c02c040 con 0x557c18d2d3d0 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.033+0000 7fea31ffb700 1 -- 172.21.15.12:0/1104992476 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea3c005700 con 0x557c18d2d3d0 2023-12-11T20:21:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.033+0000 7fea31ffb700 1 -- 172.21.15.12:0/1104992476 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c01e070 con 0x557c18d2d3d0 2023-12-11T20:21:17.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.033+0000 7fea64fcdb80 1 -- 172.21.15.12:0/1104992476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 msgr2=0x557c18d36630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.033+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d36630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00b580 tx=0x7fea3c021000 comp rx=0 tx=0).stop 2023-12-11T20:21:17.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.034+0000 7fea64fcdb80 1 -- 172.21.15.12:0/1104992476 shutdown_connections 2023-12-11T20:21:17.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.034+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2ec20 0x557c18d2f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.034+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2d3d0 0x557c18d36630 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.034+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/1104992476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2dd30 0x557c18d3e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.034+0000 7fea64fcdb80 1 -- 172.21.15.12:0/1104992476 >> 172.21.15.12:0/1104992476 conn(0x557c18c5c7e0 msgr2=0x557c18d37120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.034+0000 7fea64fcdb80 1 -- 172.21.15.12:0/1104992476 shutdown_connections 2023-12-11T20:21:17.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.034+0000 7fea64fcdb80 1 -- 172.21.15.12:0/1104992476 wait complete. 2023-12-11T20:21:17.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.034+0000 7fea64fcdb80 1 -- start start 2023-12-11T20:21:17.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.035+0000 7fea64fcdb80 1 Processor -- start 2023-12-11T20:21:17.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.035+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d3c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.035+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d3ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.035+0000 7fea64fcdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d3dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.035+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18d3e210 con 0x557c18d2d3d0 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.035+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18d3e380 con 0x557c18d2dd30 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.035+0000 7fea64fcdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c18d3e540 con 0x557c18d2ec20 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.035+0000 7fea64fcdb80 10 client.0 _ll_register_callbacks cb 0x557c18b66a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d3c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d3ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d3c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36408/0 (socket says 172.21.15.12:36408) 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 -- 172.21.15.12:0/681687747 learned_addr learned my addr 172.21.15.12:0/681687747 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4b7fe700 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d3dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 -- 172.21.15.12:0/681687747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 msgr2=0x557c18d3dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d3dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 -- 172.21.15.12:0/681687747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 msgr2=0x557c18d3ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d3ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 -- 172.21.15.12:0/681687747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c10a240 con 0x557c18d2d3d0 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d3ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4b7fe700 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d3dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea4affd700 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d3c900 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fea3c005a60 tx=0x7fea3c00b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454d435211c9b963 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.036+0000 7fea2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:17.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.037+0000 7fea2eff5700 1 -- 172.21.15.12:0/681687747 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c01e070 con 0x557c18d2d3d0 2023-12-11T20:21:17.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.037+0000 7fea2eff5700 1 -- 172.21.15.12:0/681687747 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea3c0324e0 con 0x557c18d2d3d0 2023-12-11T20:21:17.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.037+0000 7fea64fcdb80 1 -- 172.21.15.12:0/681687747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c18c47fd0 con 0x557c18d2d3d0 2023-12-11T20:21:17.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.037+0000 7fea2eff5700 1 -- 172.21.15.12:0/681687747 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea3c02c070 con 0x557c18d2d3d0 2023-12-11T20:21:17.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.037+0000 7fea64fcdb80 10 client.17001 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.037+0000 7fea64fcdb80 1 -- 172.21.15.12:0/681687747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557c18ad1250 con 0x557c18d2d3d0 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea2eff5700 1 -- 172.21.15.12:0/681687747 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c18c47fd0 con 0x557c18d2d3d0 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea2eff5700 1 -- 172.21.15.12:0/681687747 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fea3c003a80 con 0x557c18d2d3d0 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea64fcdb80 10 client.17001 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea64fcdb80 10 client.17001 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea64fcdb80 20 client.17001 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557c18d99ed0 0x557c18d9c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea64fcdb80 4 client.17001 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea64fcdb80 1 -- 172.21.15.12:0/681687747 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557c18c3a490 con 0x557c18d99ed0 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.038+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557c18d99ed0 0x557c18d9c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.039+0000 7fea4a7fc700 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557c18d99ed0 0x557c18d9c2c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9eeecda624808c1 server_cookie=2258913d3feddfd in_seq=0 out_seq=0 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.039+0000 7fea2eff5700 10 client.17001 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.039+0000 7fea2eff5700 1 -- 172.21.15.12:0/681687747 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557c18c3a490 con 0x557c18d99ed0 2023-12-11T20:21:17.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.039+0000 7fea2eff5700 10 client.17001 handle_command_reply: tid=0 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 client.17001 shutdown 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 -- 172.21.15.12:0/681687747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 msgr2=0x557c18d3c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d3c900 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fea3c005a60 tx=0x7fea3c00b9c0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 -- 172.21.15.12:0/681687747 shutdown_connections 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x557c18d99ed0 0x557c18d9c2c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557c18d2ec20 0x557c18d3dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557c18d2d3d0 0x557c18d3c900 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea2eff5700 0 client.17001 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 --2- 172.21.15.12:0/681687747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557c18d2dd30 0x557c18d3ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 -- 172.21.15.12:0/681687747 >> 172.21.15.12:0/681687747 conn(0x557c18c5c7e0 msgr2=0x557c18d370c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 -- 172.21.15.12:0/681687747 shutdown_connections 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 1 -- 172.21.15.12:0/681687747 wait complete. 2023-12-11T20:21:17.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.040+0000 7fea64fcdb80 20 client.17001 trim_cache size 0 max 16384 2023-12-11T20:21:17.042 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:21:17.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 -- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea340a1500 msgr2=0x7fea340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea340a1500 0x7fea340a39c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fea3c003780 tx=0x7fea3c000bc0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 -- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1026a0 msgr2=0x7fea4c199a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1026a0 0x7fea4c199a70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fea4000d950 tx=0x7fea4000dd10 comp rx=0 tx=0).stop 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 -- 172.21.15.12:0/3156860796 shutdown_connections 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea340a1500 0x7fea340a39c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea4c1014b0 0x7fea4c199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea4c103040 0x7fea4c1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 --2- 172.21.15.12:0/3156860796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea4c1026a0 0x7fea4c199a70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 -- 172.21.15.12:0/3156860796 >> 172.21.15.12:0/3156860796 conn(0x7fea4c0fca20 msgr2=0x7fea4c107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 -- 172.21.15.12:0/3156860796 shutdown_connections 2023-12-11T20:21:17.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.041+0000 7fea515ff700 1 -- 172.21.15.12:0/3156860796 wait complete. 2023-12-11T20:21:17.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:21:17.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2584762421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 msgr2=0x7f9b68106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2584762421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 0x7f9b68106ce0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009990 tx=0x7f9b58009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2584762421 shutdown_connections 2023-12-11T20:21:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2584762421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b68107220 0x7f9b68109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2584762421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b68101fc0 0x7f9b681043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2584762421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 0x7f9b68106ce0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2584762421 >> 172.21.15.12:0/2584762421 conn(0x7f9b680fb930 msgr2=0x7f9b680fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2584762421 shutdown_connections 2023-12-11T20:21:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.285+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2584762421 wait complete. 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.286+0000 7f9b6f3ff700 1 Processor -- start 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6f3ff700 1 -- start start 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6f3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b68101fc0 0x7f9b681995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6f3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 0x7f9b68199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6f3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b68107220 0x7f9b681a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6f3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b681a10e0 con 0x7f9b681048f0 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6f3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b681a1220 con 0x7f9b68107220 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6f3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b681a13b0 con 0x7f9b68101fc0 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 0x7f9b68199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 0x7f9b68199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36416/0 (socket says 172.21.15.12:36416) 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6c99a700 1 -- 172.21.15.12:0/2590631654 learned_addr learned my addr 172.21.15.12:0/2590631654 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.287+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b68101fc0 0x7f9b681995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b68107220 0x7f9b681a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b6c99a700 1 -- 172.21.15.12:0/2590631654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b68101fc0 msgr2=0x7f9b681995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b68101fc0 0x7f9b681995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b6c99a700 1 -- 172.21.15.12:0/2590631654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b68107220 msgr2=0x7f9b681a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b68107220 0x7f9b681a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b6c99a700 1 -- 172.21.15.12:0/2590631654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b580095f0 con 0x7f9b681048f0 2023-12-11T20:21:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 0x7f9b68199af0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800b2e0 tx=0x7f9b58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b5e7fc700 1 -- 172.21.15.12:0/2590631654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5801d070 con 0x7f9b681048f0 2023-12-11T20:21:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2590631654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b681a1630 con 0x7f9b681048f0 2023-12-11T20:21:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b5e7fc700 1 -- 172.21.15.12:0/2590631654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b5800beb0 con 0x7f9b681048f0 2023-12-11T20:21:17.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.288+0000 7f9b5e7fc700 1 -- 172.21.15.12:0/2590631654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58021410 con 0x7f9b681048f0 2023-12-11T20:21:17.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.289+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2590631654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b681a1a50 con 0x7f9b681048f0 2023-12-11T20:21:17.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.292+0000 7f9b5e7fc700 1 -- 172.21.15.12:0/2590631654 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9b5800f640 con 0x7f9b681048f0 2023-12-11T20:21:17.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.293+0000 7f9b82e12b80 1 Processor -- start 2023-12-11T20:21:17.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.293+0000 7f9b82e12b80 1 -- start start 2023-12-11T20:21:17.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.293+0000 7f9b5e7fc700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9b540a1480 0x7f9b540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608354743d0 0x5608354747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x560835475640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560835475c20 0x5608354760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608353cfb50 con 0x5608354743d0 2023-12-11T20:21:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608353cd470 con 0x560835474d30 2023-12-11T20:21:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608353c8d60 con 0x560835475c20 2023-12-11T20:21:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9b540a1480 0x7f9b540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b5e7fc700 1 -- 172.21.15.12:0/2590631654 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9b580ce170 con 0x7f9b681048f0 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b6d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608354743d0 0x5608354747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b6d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608354743d0 0x5608354747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36432/0 (socket says 172.21.15.12:36432) 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.294+0000 7f9b6d19b700 1 -- 172.21.15.12:0/660766069 learned_addr learned my addr 172.21.15.12:0/660766069 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x560835475640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560835475c20 0x5608354760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d19b700 1 -- 172.21.15.12:0/660766069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560835475c20 msgr2=0x5608354760a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560835475c20 0x5608354760a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d19b700 1 -- 172.21.15.12:0/660766069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 msgr2=0x560835475640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x560835475640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d19b700 1 -- 172.21.15.12:0/660766069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560835245630 con 0x5608354743d0 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560835475c20 0x5608354760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9b540a1480 0x7f9b540a3940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009550 tx=0x7f9b600077e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608354743d0 0x5608354747f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009d80 tx=0x7f9b64011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc842d1ca188ecc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b537fe700 1 -- 172.21.15.12:0/660766069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64004230 con 0x5608354743d0 2023-12-11T20:21:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b537fe700 1 -- 172.21.15.12:0/660766069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b64004390 con 0x5608354743d0 2023-12-11T20:21:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.295+0000 7f9b537fe700 1 -- 172.21.15.12:0/660766069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64019800 con 0x5608354743d0 2023-12-11T20:21:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.296+0000 7f9b82e12b80 1 -- 172.21.15.12:0/660766069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608354743d0 msgr2=0x5608354747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.296+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608354743d0 0x5608354747f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009d80 tx=0x7f9b64011720 comp rx=0 tx=0).stop 2023-12-11T20:21:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.296+0000 7f9b82e12b80 1 -- 172.21.15.12:0/660766069 shutdown_connections 2023-12-11T20:21:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.296+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560835475c20 0x5608354760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.296+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608354743d0 0x5608354747f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.296+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/660766069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x560835475640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.296+0000 7f9b82e12b80 1 -- 172.21.15.12:0/660766069 >> 172.21.15.12:0/660766069 conn(0x5608353a37e0 msgr2=0x560835470d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.296+0000 7f9b82e12b80 1 -- 172.21.15.12:0/660766069 shutdown_connections 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.297+0000 7f9b82e12b80 1 -- 172.21.15.12:0/660766069 wait complete. 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.297+0000 7f9b82e12b80 1 -- start start 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.297+0000 7f9b82e12b80 1 Processor -- start 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.298+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x56083547e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.298+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x56083547e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.298+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835485740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.298+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560835382560 con 0x560835475c20 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.298+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560835382200 con 0x560835474d30 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.298+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560835247920 con 0x5608354743d0 2023-12-11T20:21:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.298+0000 7f9b82e12b80 10 client.0 _ll_register_callbacks cb 0x5608352ada80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x56083547e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6d19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x56083547e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x56083547e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44890/0 (socket says 172.21.15.12:44890) 2023-12-11T20:21:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6c99a700 1 -- 172.21.15.12:0/275330447 learned_addr learned my addr 172.21.15.12:0/275330447 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835485740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6c99a700 1 -- 172.21.15.12:0/275330447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 msgr2=0x56083547e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x56083547e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6c99a700 1 -- 172.21.15.12:0/275330447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 msgr2=0x560835485740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835485740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6c99a700 1 -- 172.21.15.12:0/275330447 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b640099e0 con 0x560835474d30 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.299+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835485740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.300+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x56083547e700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b580095c0 tx=0x7f9b5809b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74dc96b5a8e43114 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.300+0000 7f9b50ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.300+0000 7f9b50ff9700 1 -- 172.21.15.12:0/275330447 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580b3ea0 con 0x560835474d30 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.300+0000 7f9b82e12b80 1 -- 172.21.15.12:0/275330447 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560835467b40 con 0x560835474d30 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.300+0000 7f9b50ff9700 1 -- 172.21.15.12:0/275330447 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9b5800f460 con 0x560835474d30 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.300+0000 7f9b50ff9700 1 -- 172.21.15.12:0/275330447 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b5809bb70 con 0x560835474d30 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.300+0000 7f9b82e12b80 10 client.26717 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.300+0000 7f9b82e12b80 1 -- 172.21.15.12:0/275330447 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5608351f1de0 con 0x560835474d30 2023-12-11T20:21:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b50ff9700 1 -- 172.21.15.12:0/275330447 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560835467b40 con 0x560835474d30 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b50ff9700 1 -- 172.21.15.12:0/275330447 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9b580a1370 con 0x560835474d30 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b82e12b80 10 client.26717 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b82e12b80 10 client.26717 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b82e12b80 20 client.26717 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x560835489c00 0x56083548bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b82e12b80 4 client.26717 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b82e12b80 1 -- 172.21.15.12:0/275330447 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560835443f40 con 0x560835489c00 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.301+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x560835489c00 0x56083548bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.302+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x560835489c00 0x56083548bff0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ae438e70f180b9a server_cookie=ec5cb1f3c1decf78 in_seq=0 out_seq=0 2023-12-11T20:21:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.302+0000 7f9b50ff9700 10 client.26717 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:21:17.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.303+0000 7f9b50ff9700 1 -- 172.21.15.12:0/275330447 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560835443f40 con 0x560835489c00 2023-12-11T20:21:17.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.303+0000 7f9b50ff9700 10 client.26717 handle_command_reply: tid=0 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.303+0000 7f9b82e12b80 1 client.26717 shutdown 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.303+0000 7f9b82e12b80 1 -- 172.21.15.12:0/275330447 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 msgr2=0x56083547e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.303+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x56083547e700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b580095c0 tx=0x7f9b5809b9b0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 1 -- 172.21.15.12:0/275330447 shutdown_connections 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x560835489c00 0x56083548bff0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835485740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x56083547e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/275330447 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x56083547e700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b50ff9700 0 client.26717 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 1 -- 172.21.15.12:0/275330447 >> 172.21.15.12:0/275330447 conn(0x5608353a37e0 msgr2=0x56083546fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 1 -- 172.21.15.12:0/275330447 shutdown_connections 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 1 -- 172.21.15.12:0/275330447 wait complete. 2023-12-11T20:21:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.304+0000 7f9b82e12b80 20 client.26717 trim_cache size 0 max 16384 2023-12-11T20:21:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.326+0000 7f9b82e12b80 1 Processor -- start 2023-12-11T20:21:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.326+0000 7f9b82e12b80 1 -- start start 2023-12-11T20:21:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.326+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835485df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.326+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835474d30 0x560835485700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.326+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835475c20 0x560835476000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.326+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560835486930 con 0x560835474d30 2023-12-11T20:21:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.326+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560835471250 con 0x560835475c20 2023-12-11T20:21:17.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.326+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56083546bbd0 con 0x5608354743d0 2023-12-11T20:21:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835474d30 0x560835485700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835474d30 0x560835485700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36442/0 (socket says 172.21.15.12:36442) 2023-12-11T20:21:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6c99a700 1 -- 172.21.15.12:0/354133699 learned_addr learned my addr 172.21.15.12:0/354133699 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835485df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835475c20 0x560835476000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6c99a700 1 -- 172.21.15.12:0/354133699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 msgr2=0x560835485df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835485df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6c99a700 1 -- 172.21.15.12:0/354133699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835475c20 msgr2=0x560835476000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835475c20 0x560835476000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6c99a700 1 -- 172.21.15.12:0/354133699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608351dac60 con 0x560835474d30 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.327+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835475c20 0x560835476000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.328+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835474d30 0x560835485700 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9b58097970 tx=0x7f9b58099a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcf08057af38044 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.328+0000 7f9b53fff700 1 -- 172.21.15.12:0/354133699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580b3ea0 con 0x560835474d30 2023-12-11T20:21:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.328+0000 7f9b53fff700 1 -- 172.21.15.12:0/354133699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b580b8030 con 0x560835474d30 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.328+0000 7f9b53fff700 1 -- 172.21.15.12:0/354133699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5809bb70 con 0x560835474d30 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 -- 172.21.15.12:0/354133699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835474d30 msgr2=0x560835485700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835474d30 0x560835485700 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9b58097970 tx=0x7f9b58099a20 comp rx=0 tx=0).stop 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 -- 172.21.15.12:0/354133699 shutdown_connections 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835475c20 0x560835476000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835485df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/354133699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835474d30 0x560835485700 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 -- 172.21.15.12:0/354133699 >> 172.21.15.12:0/354133699 conn(0x5608353a37e0 msgr2=0x56083547c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 -- 172.21.15.12:0/354133699 shutdown_connections 2023-12-11T20:21:17.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 -- 172.21.15.12:0/354133699 wait complete. 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.329+0000 7f9b82e12b80 1 -- start start 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b82e12b80 1 Processor -- start 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835483550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x560835483a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b82e12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835484960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560835484ea0 con 0x560835475c20 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560835485010 con 0x560835474d30 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b82e12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608354851d0 con 0x5608354743d0 2023-12-11T20:21:17.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b82e12b80 10 client.0 _ll_register_callbacks cb 0x5608352ada80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:17.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b6d99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835484960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b6d19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835483550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.330+0000 7f9b6d19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835483550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60828/0 (socket says 172.21.15.12:60828) 2023-12-11T20:21:17.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b6d19b700 1 -- 172.21.15.12:0/3497733401 learned_addr learned my addr 172.21.15.12:0/3497733401 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b6c99a700 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x560835483a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.334 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:17 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2029222129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b6d99c700 1 -- 172.21.15.12:0/3497733401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 msgr2=0x560835483550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835483550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b6d99c700 1 -- 172.21.15.12:0/3497733401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 msgr2=0x560835483a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x560835483a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b6d99c700 1 -- 172.21.15.12:0/3497733401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608351f1de0 con 0x560835475c20 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b6d99c700 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835484960 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009200 tx=0x7f9b60004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6c9d0d21c6d061 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.331+0000 7f9b50ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.332+0000 7f9b50ff9700 1 -- 172.21.15.12:0/3497733401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b600169d0 con 0x560835475c20 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.332+0000 7f9b82e12b80 1 -- 172.21.15.12:0/3497733401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b64004390 con 0x560835475c20 2023-12-11T20:21:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.332+0000 7f9b50ff9700 1 -- 172.21.15.12:0/3497733401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9b60016b30 con 0x560835475c20 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.332+0000 7f9b50ff9700 1 -- 172.21.15.12:0/3497733401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b60016cf0 con 0x560835475c20 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.332+0000 7f9b82e12b80 10 client.17019 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.332+0000 7f9b82e12b80 1 -- 172.21.15.12:0/3497733401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560835218250 con 0x560835475c20 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.332+0000 7f9b50ff9700 1 -- 172.21.15.12:0/3497733401 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b60033080 con 0x560835475c20 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.333+0000 7f9b50ff9700 1 -- 172.21.15.12:0/3497733401 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9b600243f0 con 0x560835475c20 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.333+0000 7f9b82e12b80 10 client.17019 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.333+0000 7f9b82e12b80 10 client.17019 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.333+0000 7f9b82e12b80 20 client.17019 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.333+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5608354e0ff0 0x5608354e3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.333+0000 7f9b82e12b80 4 client.17019 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.333+0000 7f9b82e12b80 1 -- 172.21.15.12:0/3497733401 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56083538efd0 con 0x5608354e0ff0 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.333+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5608354e0ff0 0x5608354e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b6d19b700 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5608354e0ff0 0x5608354e3410 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a091a1cc6fe6dadc server_cookie=3ce16c56739a5640 in_seq=0 out_seq=0 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b50ff9700 10 client.17019 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:21:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b50ff9700 1 -- 172.21.15.12:0/3497733401 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56083538efd0 con 0x5608354e0ff0 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b50ff9700 10 client.17019 handle_command_reply: tid=0 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 client.17019 shutdown 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 -- 172.21.15.12:0/3497733401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 msgr2=0x560835484960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835484960 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009200 tx=0x7f9b60004b40 comp rx=0 tx=0).stop 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 -- 172.21.15.12:0/3497733401 shutdown_connections 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5608354e0ff0 0x5608354e3410 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560835475c20 0x560835484960 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608354743d0 0x560835483550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 --2- 172.21.15.12:0/3497733401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560835474d30 0x560835483a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b50ff9700 0 client.17019 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 -- 172.21.15.12:0/3497733401 >> 172.21.15.12:0/3497733401 conn(0x5608353a37e0 msgr2=0x56083547bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 -- 172.21.15.12:0/3497733401 shutdown_connections 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.334+0000 7f9b82e12b80 1 -- 172.21.15.12:0/3497733401 wait complete. 2023-12-11T20:21:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b82e12b80 20 client.17019 trim_cache size 0 max 16384 2023-12-11T20:21:17.339 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:21:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9b540a1480 msgr2=0x7f9b540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9b540a1480 0x7f9b540a3940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009550 tx=0x7f9b600077e0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 msgr2=0x7f9b68199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 0x7f9b68199af0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800b2e0 tx=0x7f9b58004730 comp rx=0 tx=0).stop 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2590631654 shutdown_connections 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f9b540a1480 0x7f9b540a3940 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b68107220 0x7f9b681a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b68101fc0 0x7f9b681995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 --2- 172.21.15.12:0/2590631654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b681048f0 0x7f9b68199af0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.335+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2590631654 >> 172.21.15.12:0/2590631654 conn(0x7f9b680fb930 msgr2=0x7f9b681016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.336+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2590631654 shutdown_connections 2023-12-11T20:21:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.336+0000 7f9b6f3ff700 1 -- 172.21.15.12:0/2590631654 wait complete. 2023-12-11T20:21:17.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:21:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:17 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2029222129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:21:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:17 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2029222129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:21:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.591+0000 7fad4759e700 1 -- 172.21.15.12:0/2697868079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad4810d8c0 msgr2=0x7fad4810fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.591+0000 7fad4759e700 1 --2- 172.21.15.12:0/2697868079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad4810d8c0 0x7fad4810fcb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fad4000b0a0 tx=0x7fad4000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.592+0000 7fad4759e700 1 -- 172.21.15.12:0/2697868079 shutdown_connections 2023-12-11T20:21:17.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.592+0000 7fad4759e700 1 --2- 172.21.15.12:0/2697868079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad4810d8c0 0x7fad4810fcb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.592+0000 7fad4759e700 1 --2- 172.21.15.12:0/2697868079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48075610 0x7fad48073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.592+0000 7fad4759e700 1 --2- 172.21.15.12:0/2697868079 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad48074030 0x7fad480744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.592+0000 7fad4759e700 1 -- 172.21.15.12:0/2697868079 >> 172.21.15.12:0/2697868079 conn(0x7fad480fc860 msgr2=0x7fad480feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.592+0000 7fad4759e700 1 -- 172.21.15.12:0/2697868079 shutdown_connections 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.592+0000 7fad4759e700 1 -- 172.21.15.12:0/2697868079 wait complete. 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4759e700 1 Processor -- start 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4759e700 1 -- start start 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48074030 0x7fad4819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48075610 0x7fad4819dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad4810d8c0 0x7fad481a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481a5230 con 0x7fad48074030 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481a5370 con 0x7fad4810d8c0 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481a5500 con 0x7fad48075610 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.593+0000 7fad4659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48074030 0x7fad4819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad4659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48074030 0x7fad4819d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36484/0 (socket says 172.21.15.12:36484) 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad4659c700 1 -- 172.21.15.12:0/3256523950 learned_addr learned my addr 172.21.15.12:0/3256523950 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad46d9d700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad4810d8c0 0x7fad481a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad45d9b700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48075610 0x7fad4819dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad46d9d700 1 -- 172.21.15.12:0/3256523950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48075610 msgr2=0x7fad4819dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad46d9d700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48075610 0x7fad4819dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad46d9d700 1 -- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48074030 msgr2=0x7fad4819d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad46d9d700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48074030 0x7fad4819d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad46d9d700 1 -- 172.21.15.12:0/3256523950 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40009d00 con 0x7fad4810d8c0 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.594+0000 7fad46d9d700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad4810d8c0 0x7fad481a4c60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad4000b070 tx=0x7fad40007840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.595+0000 7fad377fe700 1 -- 172.21.15.12:0/3256523950 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000e040 con 0x7fad4810d8c0 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.595+0000 7fad377fe700 1 -- 172.21.15.12:0/3256523950 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad4000be40 con 0x7fad4810d8c0 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.595+0000 7fad4759e700 1 -- 172.21.15.12:0/3256523950 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad481a5780 con 0x7fad4810d8c0 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.595+0000 7fad377fe700 1 -- 172.21.15.12:0/3256523950 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40005040 con 0x7fad4810d8c0 2023-12-11T20:21:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.595+0000 7fad4759e700 1 -- 172.21.15.12:0/3256523950 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad481a5ba0 con 0x7fad4810d8c0 2023-12-11T20:21:17.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.600+0000 7fad377fe700 1 -- 172.21.15.12:0/3256523950 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fad4001d480 con 0x7fad4810d8c0 2023-12-11T20:21:17.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.600+0000 7fad60467b80 1 Processor -- start 2023-12-11T20:21:17.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.601+0000 7fad60467b80 1 -- start start 2023-12-11T20:21:17.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.601+0000 7fad60467b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 0x5581d92c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.601+0000 7fad60467b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c63c0 0x5581d92c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.601+0000 7fad60467b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c6de0 0x5581d92c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.601+0000 7fad60467b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d9220b50 con 0x5581d92c63c0 2023-12-11T20:21:17.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.601+0000 7fad60467b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d921e470 con 0x5581d92c6de0 2023-12-11T20:21:17.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.601+0000 7fad60467b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d9219d60 con 0x5581d92c5a60 2023-12-11T20:21:17.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad377fe700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad300a1520 0x7fad300a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad4659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c63c0 0x5581d92c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad4659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c63c0 0x5581d92c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36486/0 (socket says 172.21.15.12:36486) 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad4659c700 1 -- 172.21.15.12:0/2100707013 learned_addr learned my addr 172.21.15.12:0/2100707013 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad377fe700 1 -- 172.21.15.12:0/3256523950 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fad400cdbf0 con 0x7fad4810d8c0 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad45d9b700 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 0x5581d92c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad45d9b700 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c6de0 0x5581d92c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad46d9d700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad300a1520 0x7fad300a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad4659c700 1 -- 172.21.15.12:0/2100707013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 msgr2=0x5581d92c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad4659c700 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 0x5581d92c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad4659c700 1 -- 172.21.15.12:0/2100707013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c6de0 msgr2=0x5581d92c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad4659c700 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c6de0 0x5581d92c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.602+0000 7fad4659c700 1 -- 172.21.15.12:0/2100707013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581d9096630 con 0x5581d92c63c0 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.603+0000 7fad4659c700 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c63c0 0x5581d92c68a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fad38009e50 tx=0x7fad38011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7f725ca8602b03 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.603+0000 7fad46d9d700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad300a1520 0x7fad300a39e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fad40097450 tx=0x7fad4000b3b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.603+0000 7fad34ff9700 1 -- 172.21.15.12:0/2100707013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38004a30 con 0x5581d92c63c0 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.603+0000 7fad34ff9700 1 -- 172.21.15.12:0/2100707013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad380054b0 con 0x5581d92c63c0 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.603+0000 7fad34ff9700 1 -- 172.21.15.12:0/2100707013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380197f0 con 0x5581d92c63c0 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 -- 172.21.15.12:0/2100707013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c63c0 msgr2=0x5581d92c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c63c0 0x5581d92c68a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fad38009e50 tx=0x7fad38011720 comp rx=0 tx=0).stop 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 -- 172.21.15.12:0/2100707013 shutdown_connections 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c6de0 0x5581d92c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 0x5581d92c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 --2- 172.21.15.12:0/2100707013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c63c0 0x5581d92c68a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 -- 172.21.15.12:0/2100707013 >> 172.21.15.12:0/2100707013 conn(0x5581d91f47e0 msgr2=0x5581d92c03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 -- 172.21.15.12:0/2100707013 shutdown_connections 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 -- 172.21.15.12:0/2100707013 wait complete. 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.604+0000 7fad60467b80 1 -- start start 2023-12-11T20:21:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.605+0000 7fad60467b80 1 Processor -- start 2023-12-11T20:21:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.605+0000 7fad60467b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.605+0000 7fad60467b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.605+0000 7fad60467b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.605+0000 7fad60467b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d91d3560 con 0x5581d92c6de0 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.605+0000 7fad60467b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d91d3200 con 0x5581d92c5a60 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.605+0000 7fad60467b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d9098920 con 0x5581d92c63c0 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.605+0000 7fad60467b80 10 client.0 _ll_register_callbacks cb 0x5581d90fea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44934/0 (socket says 172.21.15.12:44934) 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 -- 172.21.15.12:0/131320827 learned_addr learned my addr 172.21.15.12:0/131320827 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad4659c700 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 -- 172.21.15.12:0/131320827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 msgr2=0x5581d92cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 -- 172.21.15.12:0/131320827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 msgr2=0x5581d92cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 -- 172.21.15.12:0/131320827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad38009a80 con 0x5581d92c6de0 2023-12-11T20:21:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad4659c700 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad45d9b700 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d68c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fad3c011da0 tx=0x7fad3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60df964e6abe031 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.606+0000 7fad2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.607+0000 7fad2dffb700 1 -- 172.21.15.12:0/131320827 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c016070 con 0x5581d92c6de0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.607+0000 7fad60467b80 1 -- 172.21.15.12:0/131320827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581d92b89e0 con 0x5581d92c6de0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.607+0000 7fad2dffb700 1 -- 172.21.15.12:0/131320827 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fad3c00fbc0 con 0x5581d92c6de0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.607+0000 7fad2dffb700 1 -- 172.21.15.12:0/131320827 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad3c011e90 con 0x5581d92c6de0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.607+0000 7fad60467b80 10 client.17031 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.607+0000 7fad60467b80 1 -- 172.21.15.12:0/131320827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5581d9042de0 con 0x5581d92c6de0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.607+0000 7fad2dffb700 1 -- 172.21.15.12:0/131320827 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad3c031080 con 0x5581d92c6de0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.608+0000 7fad2dffb700 1 -- 172.21.15.12:0/131320827 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fad3c003710 con 0x5581d92c6de0 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.608+0000 7fad60467b80 10 client.17031 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.608+0000 7fad60467b80 10 client.17031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.608+0000 7fad60467b80 20 client.17031 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.608+0000 7fad60467b80 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5581d92db150 0x5581d92dd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.608+0000 7fad60467b80 4 client.17031 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:17.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.608+0000 7fad60467b80 1 -- 172.21.15.12:0/131320827 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581d9294f40 con 0x5581d92db150 2023-12-11T20:21:17.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.608+0000 7fad4659c700 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5581d92db150 0x5581d92dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.609+0000 7fad4659c700 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5581d92db150 0x5581d92dd570 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b57d772f2a448996 server_cookie=74563a39c0ba4258 in_seq=0 out_seq=0 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.609+0000 7fad2dffb700 10 client.17031 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad2dffb700 1 -- 172.21.15.12:0/131320827 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5581d9294f40 con 0x5581d92db150 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad2dffb700 10 client.17031 handle_command_reply: tid=0 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 client.17031 shutdown 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 -- 172.21.15.12:0/131320827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 msgr2=0x5581d92d68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d68c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fad3c011da0 tx=0x7fad3c004750 comp rx=0 tx=0).stop 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 -- 172.21.15.12:0/131320827 shutdown_connections 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5581d92db150 0x5581d92dd570 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d68c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 --2- 172.21.15.12:0/131320827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad2dffb700 0 client.17031 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:17.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 -- 172.21.15.12:0/131320827 >> 172.21.15.12:0/131320827 conn(0x5581d91f47e0 msgr2=0x5581d92c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 -- 172.21.15.12:0/131320827 shutdown_connections 2023-12-11T20:21:17.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 1 -- 172.21.15.12:0/131320827 wait complete. 2023-12-11T20:21:17.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.610+0000 7fad60467b80 20 client.17031 trim_cache size 0 max 16384 2023-12-11T20:21:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.628+0000 7fad60467b80 1 Processor -- start 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad60467b80 1 -- start start 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad60467b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 0x5581d92d6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad60467b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c63c0 0x5581d92d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad60467b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92c03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad60467b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d92c0200 con 0x5581d92c6de0 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad60467b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d92d7a40 con 0x5581d92c63c0 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad60467b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d92d6d20 con 0x5581d92c5a60 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad45d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92c03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.629+0000 7fad45d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92c03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36502/0 (socket says 172.21.15.12:36502) 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad45d9b700 1 -- 172.21.15.12:0/4285959300 learned_addr learned my addr 172.21.15.12:0/4285959300 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad4659c700 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c63c0 0x5581d92d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad45d9b700 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 0x5581d92d6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad45d9b700 1 -- 172.21.15.12:0/4285959300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 msgr2=0x5581d92d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad45d9b700 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 0x5581d92d6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad45d9b700 1 -- 172.21.15.12:0/4285959300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c63c0 msgr2=0x5581d92d67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad45d9b700 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c63c0 0x5581d92d67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad45d9b700 1 -- 172.21.15.12:0/4285959300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581d902bc60 con 0x5581d92c6de0 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad45d9b700 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92c03a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5581d92db000 tx=0x7fad3c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa14e610fbc90692 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.630+0000 7fad357fa700 1 -- 172.21.15.12:0/4285959300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c016040 con 0x5581d92c6de0 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad357fa700 1 -- 172.21.15.12:0/4285959300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5581d92b89e0 con 0x5581d92c6de0 2023-12-11T20:21:17.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad357fa700 1 -- 172.21.15.12:0/4285959300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0038e0 con 0x5581d92c6de0 2023-12-11T20:21:17.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad60467b80 1 -- 172.21.15.12:0/4285959300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 msgr2=0x5581d92c03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad60467b80 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92c03a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5581d92db000 tx=0x7fad3c009260 comp rx=0 tx=0).stop 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad60467b80 1 -- 172.21.15.12:0/4285959300 shutdown_connections 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad60467b80 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92c03a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad60467b80 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c5a60 0x5581d92d6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad60467b80 1 --2- 172.21.15.12:0/4285959300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c63c0 0x5581d92d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad60467b80 1 -- 172.21.15.12:0/4285959300 >> 172.21.15.12:0/4285959300 conn(0x5581d91f47e0 msgr2=0x5581d92cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.631+0000 7fad60467b80 1 -- 172.21.15.12:0/4285959300 shutdown_connections 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.632+0000 7fad60467b80 1 -- 172.21.15.12:0/4285959300 wait complete. 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.632+0000 7fad60467b80 1 -- start start 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.632+0000 7fad60467b80 1 Processor -- start 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad60467b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad60467b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92d45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad60467b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad60467b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d92d5960 con 0x5581d92c6de0 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad60467b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d92d5ad0 con 0x5581d92c5a60 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad60467b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581d92d5c90 con 0x5581d92c63c0 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad60467b80 10 client.0 _ll_register_callbacks cb 0x5581d90fea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad4659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92d45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad4659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92d45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60868/0 (socket says 172.21.15.12:60868) 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92d4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44944/0 (socket says 172.21.15.12:44944) 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad4659c700 1 -- 172.21.15.12:0/981870853 learned_addr learned my addr 172.21.15.12:0/981870853 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.633+0000 7fad45d9b700 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.634+0000 7fad4659c700 1 -- 172.21.15.12:0/981870853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 msgr2=0x5581d92d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.634+0000 7fad4659c700 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92d4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.634+0000 7fad4659c700 1 -- 172.21.15.12:0/981870853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 msgr2=0x5581d92d5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.634+0000 7fad4659c700 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.634+0000 7fad4659c700 1 -- 172.21.15.12:0/981870853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581d9042de0 con 0x5581d92c63c0 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.634+0000 7fad4659c700 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92d45c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad38011a70 tx=0x7fad380095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20cc6c22166d4cc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.634+0000 7fad2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.635+0000 7fad2dffb700 1 -- 172.21.15.12:0/981870853 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3802b040 con 0x5581d92c63c0 2023-12-11T20:21:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.635+0000 7fad60467b80 1 -- 172.21.15.12:0/981870853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad380054b0 con 0x5581d92c63c0 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.635+0000 7fad2dffb700 1 -- 172.21.15.12:0/981870853 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fad38003880 con 0x5581d92c63c0 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.635+0000 7fad2dffb700 1 -- 172.21.15.12:0/981870853 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad38003a60 con 0x5581d92c63c0 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.635+0000 7fad60467b80 10 client.26728 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.635+0000 7fad60467b80 1 -- 172.21.15.12:0/981870853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5581d9069250 con 0x5581d92c63c0 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.635+0000 7fad2dffb700 1 -- 172.21.15.12:0/981870853 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad3803e080 con 0x5581d92c63c0 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.635+0000 7fad2dffb700 1 -- 172.21.15.12:0/981870853 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fad38011440 con 0x5581d92c63c0 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.636+0000 7fad60467b80 10 client.26728 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.636+0000 7fad60467b80 10 client.26728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.636+0000 7fad60467b80 20 client.26728 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.636+0000 7fad60467b80 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5581d9331f50 0x5581d9334370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.636+0000 7fad60467b80 4 client.26728 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:21:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.636+0000 7fad60467b80 1 -- 172.21.15.12:0/981870853 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5581d91dffd0 con 0x5581d9331f50 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.636+0000 7fad45d9b700 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5581d9331f50 0x5581d9334370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad2dffb700 10 client.26728 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad45d9b700 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5581d9331f50 0x5581d9334370 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=595d1f27fbdddbd3 server_cookie=755f1f539a888946 in_seq=0 out_seq=0 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad2dffb700 1 -- 172.21.15.12:0/981870853 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5581d91dffd0 con 0x5581d9331f50 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad2dffb700 10 client.26728 handle_command_reply: tid=0 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 client.26728 shutdown 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 -- 172.21.15.12:0/981870853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 msgr2=0x5581d92d45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92d45c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad38011a70 tx=0x7fad380095c0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 -- 172.21.15.12:0/981870853 shutdown_connections 2023-12-11T20:21:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5581d9331f50 0x5581d9334370 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5581d92c5a60 0x5581d92d4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d92c6de0 0x5581d92d5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad2dffb700 0 client.26728 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:17.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 --2- 172.21.15.12:0/981870853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5581d92c63c0 0x5581d92d45c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 -- 172.21.15.12:0/981870853 >> 172.21.15.12:0/981870853 conn(0x5581d91f47e0 msgr2=0x5581d92ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 -- 172.21.15.12:0/981870853 shutdown_connections 2023-12-11T20:21:17.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.637+0000 7fad60467b80 1 -- 172.21.15.12:0/981870853 wait complete. 2023-12-11T20:21:17.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad60467b80 20 client.26728 trim_cache size 0 max 16384 2023-12-11T20:21:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:21:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 -- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad300a1520 msgr2=0x7fad300a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad300a1520 0x7fad300a39e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fad40097450 tx=0x7fad4000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 -- 172.21.15.12:0/3256523950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad4810d8c0 msgr2=0x7fad481a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad4810d8c0 0x7fad481a4c60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad4000b070 tx=0x7fad40007840 comp rx=0 tx=0).stop 2023-12-11T20:21:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 -- 172.21.15.12:0/3256523950 shutdown_connections 2023-12-11T20:21:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad300a1520 0x7fad300a39e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad4810d8c0 0x7fad481a4c60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48074030 0x7fad4819d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 --2- 172.21.15.12:0/3256523950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48075610 0x7fad4819dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 -- 172.21.15.12:0/3256523950 >> 172.21.15.12:0/3256523950 conn(0x7fad480fc860 msgr2=0x7fad48100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 -- 172.21.15.12:0/3256523950 shutdown_connections 2023-12-11T20:21:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:17.638+0000 7fad4759e700 1 -- 172.21.15.12:0/3256523950 wait complete. 2023-12-11T20:21:18.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:18 smithi032 ceph-mon[132488]: pgmap v536: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:18.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:18 smithi039 ceph-mon[102205]: pgmap v536: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:18 smithi012 ceph-mon[128787]: pgmap v536: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:21:18.656 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:21:18.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:21:18.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.879+0000 7f4f381ff700 1 -- 172.21.15.12:0/3926186544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30100750 msgr2=0x7f4f30100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.879+0000 7f4f381ff700 1 --2- 172.21.15.12:0/3926186544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30100750 0x7f4f30100bd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009990 tx=0x7f4f20009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.880+0000 7f4f381ff700 1 -- 172.21.15.12:0/3926186544 shutdown_connections 2023-12-11T20:21:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.880+0000 7f4f381ff700 1 --2- 172.21.15.12:0/3926186544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f300ffdf0 0x7f4f30100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.880+0000 7f4f381ff700 1 --2- 172.21.15.12:0/3926186544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f30101110 0x7f4f30101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.880+0000 7f4f381ff700 1 --2- 172.21.15.12:0/3926186544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30100750 0x7f4f30100bd0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.880+0000 7f4f381ff700 1 -- 172.21.15.12:0/3926186544 >> 172.21.15.12:0/3926186544 conn(0x7f4f300fb930 msgr2=0x7f4f300fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.880+0000 7f4f381ff700 1 -- 172.21.15.12:0/3926186544 shutdown_connections 2023-12-11T20:21:18.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.880+0000 7f4f381ff700 1 -- 172.21.15.12:0/3926186544 wait complete. 2023-12-11T20:21:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.881+0000 7f4f381ff700 1 Processor -- start 2023-12-11T20:21:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.881+0000 7f4f381ff700 1 -- start start 2023-12-11T20:21:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.881+0000 7f4f381ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f300ffdf0 0x7f4f30199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.881+0000 7f4f381ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f30100750 0x7f4f30199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.881+0000 7f4f381ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30101110 0x7f4f301a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.881+0000 7f4f381ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f301a1090 con 0x7f4f30101110 2023-12-11T20:21:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.881+0000 7f4f381ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f301a11d0 con 0x7f4f30100750 2023-12-11T20:21:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.881+0000 7f4f381ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f301a1360 con 0x7f4f300ffdf0 2023-12-11T20:21:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f3679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30101110 0x7f4f301a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f35f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f300ffdf0 0x7f4f30199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f35f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f300ffdf0 0x7f4f30199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40272/0 (socket says 172.21.15.12:40272) 2023-12-11T20:21:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f35f9b700 1 -- 172.21.15.12:0/1046337465 learned_addr learned my addr 172.21.15.12:0/1046337465 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f3579a700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f30100750 0x7f4f30199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f3679c700 1 -- 172.21.15.12:0/1046337465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f300ffdf0 msgr2=0x7f4f30199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f3679c700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f300ffdf0 0x7f4f30199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f3679c700 1 -- 172.21.15.12:0/1046337465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f30100750 msgr2=0x7f4f30199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f3679c700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f30100750 0x7f4f30199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.882+0000 7f4f3679c700 1 -- 172.21.15.12:0/1046337465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200095f0 con 0x7f4f30101110 2023-12-11T20:21:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.883+0000 7f4f3679c700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30101110 0x7f4f301a0ac0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4f28007f10 tx=0x7f4f2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.883+0000 7f4f26ffd700 1 -- 172.21.15.12:0/1046337465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28004db0 con 0x7f4f30101110 2023-12-11T20:21:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.883+0000 7f4f26ffd700 1 -- 172.21.15.12:0/1046337465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f2800f040 con 0x7f4f30101110 2023-12-11T20:21:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.883+0000 7f4f381ff700 1 -- 172.21.15.12:0/1046337465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f301a1640 con 0x7f4f30101110 2023-12-11T20:21:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.883+0000 7f4f26ffd700 1 -- 172.21.15.12:0/1046337465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28005960 con 0x7f4f30101110 2023-12-11T20:21:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.883+0000 7f4f381ff700 1 -- 172.21.15.12:0/1046337465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f301a1b50 con 0x7f4f30101110 2023-12-11T20:21:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.886+0000 7f4f26ffd700 1 -- 172.21.15.12:0/1046337465 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4f2800db20 con 0x7f4f30101110 2023-12-11T20:21:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.888+0000 7f4f26ffd700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f1c0a1500 0x7f4f1c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.888+0000 7f4f26ffd700 1 -- 172.21.15.12:0/1046337465 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f280cc610 con 0x7f4f30101110 2023-12-11T20:21:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.888+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f1c0a1500 0x7f4f1c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.888+0000 7f4f4ba64b80 1 Processor -- start 2023-12-11T20:21:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f4ba64b80 1 -- start start 2023-12-11T20:21:18.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56465791bbd0 con 0x5646579c0db0 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646579194f0 con 0x5646579c1ca0 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564657914de0 con 0x5646579c0450 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f1c0a1500 0x7f4f1c0a39c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009d20 tx=0x7f4f2c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f3579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.889+0000 7f4f35f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f35f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40278/0 (socket says 172.21.15.12:40278) 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579c16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58752/0 (socket says 172.21.15.12:58752) 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f35f9b700 1 -- 172.21.15.12:0/1655090354 learned_addr learned my addr 172.21.15.12:0/1655090354 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3679c700 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3579a700 1 -- 172.21.15.12:0/1655090354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 msgr2=0x5646579c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:18.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3579a700 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3579a700 1 -- 172.21.15.12:0/1655090354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 msgr2=0x5646579c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3579a700 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3579a700 1 -- 172.21.15.12:0/1655090354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646577916b0 con 0x5646579c0db0 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3679c700 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.890+0000 7f4f3579a700 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579c16c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4f20003f60 tx=0x7f4f20005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6adb0598f7d300 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.891+0000 7f4f1bfff700 1 -- 172.21.15.12:0/1655090354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001d070 con 0x5646579c0db0 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.891+0000 7f4f1bfff700 1 -- 172.21.15.12:0/1655090354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f2001e040 con 0x5646579c0db0 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.891+0000 7f4f1bfff700 1 -- 172.21.15.12:0/1655090354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000b6b0 con 0x5646579c0db0 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.891+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1655090354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 msgr2=0x5646579c16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.891+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579c16c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4f20003f60 tx=0x7f4f20005bc0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.892+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1655090354 shutdown_connections 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.892+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.892+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.892+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1655090354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579c16c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.892+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1655090354 >> 172.21.15.12:0/1655090354 conn(0x5646578ef860 msgr2=0x5646579bce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.892+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1655090354 shutdown_connections 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.892+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1655090354 wait complete. 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.892+0000 7f4f4ba64b80 1 -- start start 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.893+0000 7f4f4ba64b80 1 Processor -- start 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.893+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0450 0x5646579ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.893+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0db0 0x5646579ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.893+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.893+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646578ce5e0 con 0x5646579c0450 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.893+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646578ce280 con 0x5646579c1ca0 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.893+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646577939a0 con 0x5646579c0db0 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.893+0000 7f4f4ba64b80 10 client.0 _ll_register_callbacks cb 0x5646577f9b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f35f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0450 0x5646579ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f3579a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0db0 0x5646579ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f35f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0450 0x5646579ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58764/0 (socket says 172.21.15.12:58764) 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f35f9b700 1 -- 172.21.15.12:0/1995539818 learned_addr learned my addr 172.21.15.12:0/1995539818 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f3679c700 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f3579a700 1 -- 172.21.15.12:0/1995539818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 msgr2=0x5646579d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f3579a700 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f3579a700 1 -- 172.21.15.12:0/1995539818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0450 msgr2=0x5646579ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f3579a700 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0450 0x5646579ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f3579a700 1 -- 172.21.15.12:0/1995539818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f301a1b50 con 0x5646579c0db0 2023-12-11T20:21:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.894+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0450 0x5646579ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:18.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.895+0000 7f4f3579a700 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0db0 0x5646579ca740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4f20005910 tx=0x7f4f20003e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b0be4e2c7926b24 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.895+0000 7f4f197fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.895+0000 7f4f197fa700 1 -- 172.21.15.12:0/1995539818 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001d070 con 0x5646579c0db0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.895+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1995539818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646579b3bc0 con 0x5646579c0db0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.895+0000 7f4f197fa700 1 -- 172.21.15.12:0/1995539818 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f20005650 con 0x5646579c0db0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.895+0000 7f4f197fa700 1 -- 172.21.15.12:0/1995539818 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f2000b6b0 con 0x5646579c0db0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.895+0000 7f4f4ba64b80 10 client.26740 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.895+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1995539818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f4f3010c470 con 0x5646579c0db0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f197fa700 1 -- 172.21.15.12:0/1995539818 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5646579b3bc0 con 0x5646579c0db0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f197fa700 1 -- 172.21.15.12:0/1995539818 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f20004950 con 0x5646579c0db0 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f4ba64b80 10 client.26740 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f4ba64b80 10 client.26740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f4ba64b80 20 client.26740 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:18.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5646579d5ba0 0x5646579d7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f4ba64b80 4 client.26740 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1995539818 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56465798ffc0 con 0x5646579d5ba0 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.896+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5646579d5ba0 0x5646579d7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.897+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5646579d5ba0 0x5646579d7fc0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7f779395095479c server_cookie=e5d91bdd8a08246e in_seq=0 out_seq=0 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.897+0000 7f4f197fa700 10 client.26740 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f197fa700 1 -- 172.21.15.12:0/1995539818 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56465798ffc0 con 0x5646579d5ba0 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f197fa700 10 client.26740 handle_command_reply: tid=0 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 client.26740 shutdown 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1995539818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0db0 msgr2=0x5646579ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0db0 0x5646579ca740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4f20005910 tx=0x7f4f20003e30 comp rx=0 tx=0).stop 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1995539818 shutdown_connections 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5646579d5ba0 0x5646579d7fc0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0450 0x5646579ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f197fa700 0 client.26740 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:18.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/1995539818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0db0 0x5646579ca740 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.898+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1995539818 >> 172.21.15.12:0/1995539818 conn(0x5646578ef860 msgr2=0x5646579bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:18.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.899+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1995539818 shutdown_connections 2023-12-11T20:21:18.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.899+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/1995539818 wait complete. 2023-12-11T20:21:18.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.899+0000 7f4f4ba64b80 20 client.26740 trim_cache size 0 max 16384 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.923+0000 7f4f4ba64b80 1 Processor -- start 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f4ba64b80 1 -- start start 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646579c1520 con 0x5646579c0db0 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646579dd190 con 0x5646579c1ca0 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646579c8c30 con 0x5646579c0450 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f3579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f3579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58774/0 (socket says 172.21.15.12:58774) 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f3579a700 1 -- 172.21.15.12:0/3338120442 learned_addr learned my addr 172.21.15.12:0/3338120442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.924+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f3679c700 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f3579a700 1 -- 172.21.15.12:0/3338120442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 msgr2=0x5646579bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f3579a700 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f3579a700 1 -- 172.21.15.12:0/3338120442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 msgr2=0x5646579bcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f3579a700 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579bcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f3579a700 1 -- 172.21.15.12:0/3338120442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56465773de60 con 0x5646579c0db0 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:18.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f3579a700 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579d1740 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4f20003ec0 tx=0x7f4f20009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660cbbf783dfacf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:18.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f24ff9700 1 -- 172.21.15.12:0/3338120442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001d040 con 0x5646579c0db0 2023-12-11T20:21:18.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f24ff9700 1 -- 172.21.15.12:0/3338120442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f200050c0 con 0x5646579c0db0 2023-12-11T20:21:18.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.925+0000 7f4f24ff9700 1 -- 172.21.15.12:0/3338120442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000f900 con 0x5646579c0db0 2023-12-11T20:21:18.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3338120442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 msgr2=0x5646579d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579d1740 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4f20003ec0 tx=0x7f4f20009310 comp rx=0 tx=0).stop 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3338120442 shutdown_connections 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c1ca0 0x5646579bcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3338120442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c0db0 0x5646579d1740 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3338120442 >> 172.21.15.12:0/3338120442 conn(0x5646578ef860 msgr2=0x5646579c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3338120442 shutdown_connections 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.926+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3338120442 wait complete. 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 1 -- start start 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 1 Processor -- start 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c0db0 0x5646579cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c1ca0 0x5646579cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646579d0570 con 0x5646579c1ca0 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646579d06e0 con 0x5646579c0db0 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646579d08a0 con 0x5646579c0450 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.927+0000 7f4f4ba64b80 10 client.0 _ll_register_callbacks cb 0x5646577f9b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c1ca0 0x5646579cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c1ca0 0x5646579cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58778/0 (socket says 172.21.15.12:58778) 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 -- 172.21.15.12:0/3799235509 learned_addr learned my addr 172.21.15.12:0/3799235509 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3579a700 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c0db0 0x5646579cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 -- 172.21.15.12:0/3799235509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 msgr2=0x5646579d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579d14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 -- 172.21.15.12:0/3799235509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c0db0 msgr2=0x5646579cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c0db0 0x5646579cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 -- 172.21.15.12:0/3799235509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c017070 con 0x5646579c1ca0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f3679c700 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c1ca0 0x5646579cfff0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4f280962f0 tx=0x7f4f280b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7e70c7fc45ade3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.928+0000 7f4f197fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f197fa700 1 -- 172.21.15.12:0/3799235509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280b2170 con 0x5646579c1ca0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f197fa700 1 -- 172.21.15.12:0/3799235509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f28005000 con 0x5646579c1ca0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3799235509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646578db050 con 0x5646579c1ca0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f197fa700 1 -- 172.21.15.12:0/3799235509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f28099880 con 0x5646579c1ca0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 10 client.17055 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3799235509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f4f3010c470 con 0x5646579c1ca0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f197fa700 1 -- 172.21.15.12:0/3799235509 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f2807c080 con 0x5646579c1ca0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f197fa700 1 -- 172.21.15.12:0/3799235509 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f28098d70 con 0x5646579c1ca0 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 10 client.17055 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 20 client.17055 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:18.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564657a36190 0x564657a385b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:18.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 4 client.17055 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:21:18.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.929+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3799235509 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5646578cd510 con 0x564657a36190 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.930+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564657a36190 0x564657a385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.930+0000 7f4f35f9b700 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564657a36190 0x564657a385b0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e45ad51a7d5d2e1 server_cookie=f0b6cf16a0d4290d in_seq=0 out_seq=0 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.930+0000 7f4f197fa700 10 client.17055 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f197fa700 1 -- 172.21.15.12:0/3799235509 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5646578cd510 con 0x564657a36190 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f197fa700 10 client.17055 handle_command_reply: tid=0 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 client.17055 shutdown 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3799235509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c1ca0 msgr2=0x5646579cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c1ca0 0x5646579cfff0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4f280962f0 tx=0x7f4f280b9040 comp rx=0 tx=0).stop 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3799235509 shutdown_connections 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564657a36190 0x564657a385b0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646579c1ca0 0x5646579cfff0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5646579c0450 0x5646579d14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f197fa700 0 client.17055 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 --2- 172.21.15.12:0/3799235509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5646579c0db0 0x5646579cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3799235509 >> 172.21.15.12:0/3799235509 conn(0x5646578ef860 msgr2=0x5646579bc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3799235509 shutdown_connections 2023-12-11T20:21:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 1 -- 172.21.15.12:0/3799235509 wait complete. 2023-12-11T20:21:18.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.932+0000 7f4f4ba64b80 20 client.17055 trim_cache size 0 max 16384 2023-12-11T20:21:18.934 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:21:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:21:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "e52624ba-4727-41c6-bdfc-2b5f68251879", 2023-12-11T20:21:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:21:18.935 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 -- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f1c0a1500 msgr2=0x7f4f1c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f1c0a1500 0x7f4f1c0a39c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009d20 tx=0x7f4f2c009260 comp rx=0 tx=0).stop 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 -- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30101110 msgr2=0x7f4f301a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30101110 0x7f4f301a0ac0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4f28007f10 tx=0x7f4f2800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 -- 172.21.15.12:0/1046337465 shutdown_connections 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f1c0a1500 0x7f4f1c0a39c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f30101110 0x7f4f301a0ac0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f300ffdf0 0x7f4f30199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 --2- 172.21.15.12:0/1046337465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f30100750 0x7f4f30199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 -- 172.21.15.12:0/1046337465 >> 172.21.15.12:0/1046337465 conn(0x7f4f300fb930 msgr2=0x7f4f300fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 -- 172.21.15.12:0/1046337465 shutdown_connections 2023-12-11T20:21:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:18.933+0000 7f4f381ff700 1 -- 172.21.15.12:0/1046337465 wait complete. 2023-12-11T20:21:18.953 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:21:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 -- 172.21.15.12:0/970917052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4075610 msgr2=0x7f66f4073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/970917052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4075610 0x7f66f4073a60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009990 tx=0x7f66f0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 -- 172.21.15.12:0/970917052 shutdown_connections 2023-12-11T20:21:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/970917052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66f410da80 0x7f66f410fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/970917052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4075610 0x7f66f4073a60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/970917052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f4074030 0x7f66f40744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 -- 172.21.15.12:0/970917052 >> 172.21.15.12:0/970917052 conn(0x7f66f40fca00 msgr2=0x7f66f40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:19.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 -- 172.21.15.12:0/970917052 shutdown_connections 2023-12-11T20:21:19.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.193+0000 7f66fb7ff700 1 -- 172.21.15.12:0/970917052 wait complete. 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.194+0000 7f66fb7ff700 1 Processor -- start 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.194+0000 7f66fb7ff700 1 -- start start 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.194+0000 7f66fb7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4074030 0x7f66f419d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66fb7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66f4075610 0x7f66f419df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66fb7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f410da80 0x7f66f41a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66fb7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a54a0 con 0x7f66f4074030 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66fb7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a55e0 con 0x7f66f4075610 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66fb7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a5770 con 0x7f66f410da80 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4074030 0x7f66f419d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4074030 0x7f66f419d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58806/0 (socket says 172.21.15.12:58806) 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f959b700 1 -- 172.21.15.12:0/741007724 learned_addr learned my addr 172.21.15.12:0/741007724 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66f4075610 0x7f66f419df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f9d9c700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f410da80 0x7f66f41a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f959b700 1 -- 172.21.15.12:0/741007724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f410da80 msgr2=0x7f66f41a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f959b700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f410da80 0x7f66f41a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f959b700 1 -- 172.21.15.12:0/741007724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66f4075610 msgr2=0x7f66f419df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f959b700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66f4075610 0x7f66f419df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f959b700 1 -- 172.21.15.12:0/741007724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00095f0 con 0x7f66f4074030 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.195+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66f4075610 0x7f66f419df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.196+0000 7f66f959b700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4074030 0x7f66f419d9c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f66f000b2e0 tx=0x7f66f0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.196+0000 7f66ea7fc700 1 -- 172.21.15.12:0/741007724 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f001d070 con 0x7f66f4074030 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.196+0000 7f66fb7ff700 1 -- 172.21.15.12:0/741007724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41a59f0 con 0x7f66f4074030 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.196+0000 7f66ea7fc700 1 -- 172.21.15.12:0/741007724 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66f000beb0 con 0x7f66f4074030 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.196+0000 7f66ea7fc700 1 -- 172.21.15.12:0/741007724 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0021410 con 0x7f66f4074030 2023-12-11T20:21:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.196+0000 7f66fb7ff700 1 -- 172.21.15.12:0/741007724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41a5e70 con 0x7f66f4074030 2023-12-11T20:21:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.199+0000 7f66ea7fc700 1 -- 172.21.15.12:0/741007724 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f66f000f6b0 con 0x7f66f4074030 2023-12-11T20:21:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.201+0000 7f670f038b80 1 Processor -- start 2023-12-11T20:21:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.201+0000 7f66ea7fc700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f66e00a1480 0x7f66e00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.201+0000 7f66ea7fc700 1 -- 172.21.15.12:0/741007724 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f66f00ce240 con 0x7f66f4074030 2023-12-11T20:21:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.201+0000 7f670f038b80 1 -- start start 2023-12-11T20:21:19.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f66f9d9c700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f66e00a1480 0x7f66e00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f670f038b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed1923d0 0x5595ed1927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f670f038b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed193640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f670f038b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed193c20 0x5595ed1940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f670f038b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed0edb50 con 0x5595ed1923d0 2023-12-11T20:21:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f670f038b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed0eb470 con 0x5595ed192d30 2023-12-11T20:21:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f670f038b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed0e6d60 con 0x5595ed193c20 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f66f959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed1923d0 0x5595ed1927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f66f959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed1923d0 0x5595ed1927f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58820/0 (socket says 172.21.15.12:58820) 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f66f959b700 1 -- 172.21.15.12:0/1700420522 learned_addr learned my addr 172.21.15.12:0/1700420522 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed193640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.202+0000 7f66f9d9c700 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed193c20 0x5595ed1940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66f959b700 1 -- 172.21.15.12:0/1700420522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed193c20 msgr2=0x5595ed1940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66f959b700 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed193c20 0x5595ed1940a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66f9d9c700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f66e00a1480 0x7f66e00a3940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0093d0 tx=0x7f66ec00b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66f959b700 1 -- 172.21.15.12:0/1700420522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 msgr2=0x5595ed193640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66f959b700 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed193640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66f959b700 1 -- 172.21.15.12:0/1700420522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595ecf63630 con 0x5595ed1923d0 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed193640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66f959b700 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed1923d0 0x5595ed1927f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f66f00a3310 tx=0x7f66f009b100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97f474ac049cebd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66df7fe700 1 -- 172.21.15.12:0/1700420522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f009b540 con 0x5595ed1923d0 2023-12-11T20:21:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66df7fe700 1 -- 172.21.15.12:0/1700420522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66f009f690 con 0x5595ed1923d0 2023-12-11T20:21:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.203+0000 7f66df7fe700 1 -- 172.21.15.12:0/1700420522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f009ac70 con 0x5595ed1923d0 2023-12-11T20:21:19.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 -- 172.21.15.12:0/1700420522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed1923d0 msgr2=0x5595ed1927f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed1923d0 0x5595ed1927f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f66f00a3310 tx=0x7f66f009b100 comp rx=0 tx=0).stop 2023-12-11T20:21:19.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 -- 172.21.15.12:0/1700420522 shutdown_connections 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed193c20 0x5595ed1940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed1923d0 0x5595ed1927f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 --2- 172.21.15.12:0/1700420522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed193640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 -- 172.21.15.12:0/1700420522 >> 172.21.15.12:0/1700420522 conn(0x5595ed0c17e0 msgr2=0x5595ed18ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 -- 172.21.15.12:0/1700420522 shutdown_connections 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.204+0000 7f670f038b80 1 -- 172.21.15.12:0/1700420522 wait complete. 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.205+0000 7f670f038b80 1 -- start start 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.205+0000 7f670f038b80 1 Processor -- start 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.205+0000 7f670f038b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.205+0000 7f670f038b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed19c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.205+0000 7f670f038b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 0x5595ed1a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.205+0000 7f670f038b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed0a0560 con 0x5595ed192d30 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.205+0000 7f670f038b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed0a0200 con 0x5595ed193c20 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.205+0000 7f670f038b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ecf65920 con 0x5595ed1923d0 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f670f038b80 10 client.0 _ll_register_callbacks cb 0x5595ecfcba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f959b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f959b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40340/0 (socket says 172.21.15.12:40340) 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f959b700 1 -- 172.21.15.12:0/2370004480 learned_addr learned my addr 172.21.15.12:0/2370004480 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:19.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f9d9c700 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 0x5595ed1a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f959b700 1 -- 172.21.15.12:0/2370004480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 msgr2=0x5595ed1a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f959b700 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 0x5595ed1a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f959b700 1 -- 172.21.15.12:0/2370004480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 msgr2=0x5595ed19c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f959b700 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed19c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.206+0000 7f66f959b700 1 -- 172.21.15.12:0/2370004480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41a5e70 con 0x5595ed1923d0 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.207+0000 7f66f959b700 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19be20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66f00972c0 tx=0x7f66f00a35e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c52d0b738be4c4a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.207+0000 7f66dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.207+0000 7f66dcff9700 1 -- 172.21.15.12:0/2370004480 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0099680 con 0x5595ed1923d0 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.207+0000 7f670f038b80 1 -- 172.21.15.12:0/2370004480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595ed185b40 con 0x5595ed1923d0 2023-12-11T20:21:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.207+0000 7f66dcff9700 1 -- 172.21.15.12:0/2370004480 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f66f00a3840 con 0x5595ed1923d0 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.207+0000 7f66dcff9700 1 -- 172.21.15.12:0/2370004480 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66f009b540 con 0x5595ed1923d0 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.207+0000 7f670f038b80 10 client.26758 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.207+0000 7f670f038b80 1 -- 172.21.15.12:0/2370004480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5595ecf0fde0 con 0x5595ed1923d0 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f66dcff9700 1 -- 172.21.15.12:0/2370004480 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5595ed185b40 con 0x5595ed1923d0 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f66dcff9700 1 -- 172.21.15.12:0/2370004480 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f66f009f120 con 0x5595ed1923d0 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f670f038b80 10 client.26758 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f670f038b80 10 client.26758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f670f038b80 20 client.26758 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:19.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f670f038b80 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5595ed1a7610 0x5595ed1a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f670f038b80 4 client.26758 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:19.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f670f038b80 1 -- 172.21.15.12:0/2370004480 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595ed161f40 con 0x5595ed1a7610 2023-12-11T20:21:19.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.208+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5595ed1a7610 0x5595ed1a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.209+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5595ed1a7610 0x5595ed1a9a30 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2a49b013efaf8c server_cookie=2102e47b05c1a1b7 in_seq=0 out_seq=0 2023-12-11T20:21:19.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.209+0000 7f66dcff9700 10 client.26758 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:19.214 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:21:18 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:21:18.944+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v130>,<0x10000000003/client.0 v132>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v149>,<0x10000000001/sv_0 v173>,<0x10000000000/_nogroup v157>,<0x1/volumes v149>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:21:19.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f66dcff9700 1 -- 172.21.15.12:0/2370004480 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5595ed161f40 con 0x5595ed1a7610 2023-12-11T20:21:19.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f66dcff9700 10 client.26758 handle_command_reply: tid=0 2023-12-11T20:21:19.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 client.26758 shutdown 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 -- 172.21.15.12:0/2370004480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 msgr2=0x5595ed19be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19be20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66f00972c0 tx=0x7f66f00a35e0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 -- 172.21.15.12:0/2370004480 shutdown_connections 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5595ed1a7610 0x5595ed1a9a30 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 0x5595ed1a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19be20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f66dcff9700 0 client.26758 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 --2- 172.21.15.12:0/2370004480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed19c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 -- 172.21.15.12:0/2370004480 >> 172.21.15.12:0/2370004480 conn(0x5595ed0c17e0 msgr2=0x5595ed18da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 -- 172.21.15.12:0/2370004480 shutdown_connections 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.210+0000 7f670f038b80 1 -- 172.21.15.12:0/2370004480 wait complete. 2023-12-11T20:21:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.211+0000 7f670f038b80 20 client.26758 trim_cache size 0 max 16384 2023-12-11T20:21:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.232+0000 7f670f038b80 1 Processor -- start 2023-12-11T20:21:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.232+0000 7f670f038b80 1 -- start start 2023-12-11T20:21:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.232+0000 7f670f038b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed18e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.232+0000 7f670f038b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed1a3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.232+0000 7f670f038b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 0x5595ed18eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.232+0000 7f670f038b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed19a960 con 0x5595ed192d30 2023-12-11T20:21:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.232+0000 7f670f038b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed19b9c0 con 0x5595ed193c20 2023-12-11T20:21:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.232+0000 7f670f038b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed19ae50 con 0x5595ed1923d0 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed1a3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed1a3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58846/0 (socket says 172.21.15.12:58846) 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 -- 172.21.15.12:0/816027362 learned_addr learned my addr 172.21.15.12:0/816027362 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f959b700 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed18e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f9d9c700 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 0x5595ed18eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 -- 172.21.15.12:0/816027362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 msgr2=0x5595ed18e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed18e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 -- 172.21.15.12:0/816027362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 msgr2=0x5595ed18eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 0x5595ed18eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 -- 172.21.15.12:0/816027362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595ecef8c60 con 0x5595ed192d30 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f959b700 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed18e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.233+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed1a3360 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5595ed1aa340 tx=0x7f66e400e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6345fe6f83abc74 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.234+0000 7f66dffff700 1 -- 172.21.15.12:0/816027362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4016040 con 0x5595ed192d30 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.234+0000 7f66dffff700 1 -- 172.21.15.12:0/816027362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66e4021070 con 0x5595ed192d30 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.234+0000 7f66dffff700 1 -- 172.21.15.12:0/816027362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40038e0 con 0x5595ed192d30 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 -- 172.21.15.12:0/816027362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 msgr2=0x5595ed1a3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed1a3360 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5595ed1aa340 tx=0x7f66e400e4f0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 -- 172.21.15.12:0/816027362 shutdown_connections 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed193c20 0x5595ed18eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed18e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 --2- 172.21.15.12:0/816027362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed192d30 0x5595ed1a3360 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 -- 172.21.15.12:0/816027362 >> 172.21.15.12:0/816027362 conn(0x5595ed0c17e0 msgr2=0x5595ed19a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 -- 172.21.15.12:0/816027362 shutdown_connections 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 -- 172.21.15.12:0/816027362 wait complete. 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.235+0000 7f670f038b80 1 -- start start 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f670f038b80 1 Processor -- start 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f670f038b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f670f038b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed19f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f670f038b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed193c20 0x5595ed1a2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f670f038b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed1a2e80 con 0x5595ed193c20 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f670f038b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed1a2ff0 con 0x5595ed192d30 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f670f038b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ed1a31b0 con 0x5595ed1923d0 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f670f038b80 10 client.0 _ll_register_callbacks cb 0x5595ecfcba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f66f9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed193c20 0x5595ed1a2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f66f9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed193c20 0x5595ed1a2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58848/0 (socket says 172.21.15.12:58848) 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f66f9d9c700 1 -- 172.21.15.12:0/2685087030 learned_addr learned my addr 172.21.15.12:0/2685087030 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f66f959b700 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.236+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f66f959b700 1 -- 172.21.15.12:0/2685087030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 msgr2=0x5595ed19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f66f959b700 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f66f959b700 1 -- 172.21.15.12:0/2685087030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed193c20 msgr2=0x5595ed1a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f66f959b700 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed193c20 0x5595ed1a2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f66f959b700 1 -- 172.21.15.12:0/2685087030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e400edc0 con 0x5595ed1923d0 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f66f959b700 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19f3e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66f00095c0 tx=0x7f66f00cbd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f4fcc1cc2b6ef3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f66dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f66dcff9700 1 -- 172.21.15.12:0/2685087030 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f00092b0 con 0x5595ed1923d0 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.237+0000 7f670f038b80 1 -- 172.21.15.12:0/2685087030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66f009f690 con 0x5595ed1923d0 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f66dcff9700 1 -- 172.21.15.12:0/2685087030 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f66f00a3840 con 0x5595ed1923d0 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f66dcff9700 1 -- 172.21.15.12:0/2685087030 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66f009b540 con 0x5595ed1923d0 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f670f038b80 10 client.26764 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f670f038b80 1 -- 172.21.15.12:0/2685087030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5595ecf36250 con 0x5595ed1923d0 2023-12-11T20:21:19.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f66dcff9700 1 -- 172.21.15.12:0/2685087030 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66f009f690 con 0x5595ed1923d0 2023-12-11T20:21:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f66dcff9700 1 -- 172.21.15.12:0/2685087030 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f66f00a1610 con 0x5595ed1923d0 2023-12-11T20:21:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f670f038b80 10 client.26764 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f670f038b80 10 client.26764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f670f038b80 20 client.26764 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f670f038b80 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5595ed1fe860 0x5595ed200c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f670f038b80 4 client.26764 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:21:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.238+0000 7f670f038b80 1 -- 172.21.15.12:0/2685087030 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5595ed0acfd0 con 0x5595ed1fe860 2023-12-11T20:21:19.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.239+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5595ed1fe860 0x5595ed200c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.239+0000 7f66f8d9a700 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5595ed1fe860 0x5595ed200c80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54f3fbef68af7f9 server_cookie=d527224323db9b7f in_seq=0 out_seq=0 2023-12-11T20:21:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.239+0000 7f66dcff9700 10 client.26764 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f66dcff9700 1 -- 172.21.15.12:0/2685087030 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5595ed0acfd0 con 0x5595ed1fe860 2023-12-11T20:21:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f66dcff9700 10 client.26764 handle_command_reply: tid=0 2023-12-11T20:21:19.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 client.26764 shutdown 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 -- 172.21.15.12:0/2685087030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 msgr2=0x5595ed19f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19f3e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66f00095c0 tx=0x7f66f00cbd10 comp rx=0 tx=0).stop 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 -- 172.21.15.12:0/2685087030 shutdown_connections 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5595ed1fe860 0x5595ed200c80 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595ed193c20 0x5595ed1a2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5595ed1923d0 0x5595ed19f3e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 --2- 172.21.15.12:0/2685087030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5595ed192d30 0x5595ed19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 -- 172.21.15.12:0/2685087030 >> 172.21.15.12:0/2685087030 conn(0x5595ed0c17e0 msgr2=0x5595ed18e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f66dcff9700 0 client.26764 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 -- 172.21.15.12:0/2685087030 shutdown_connections 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 1 -- 172.21.15.12:0/2685087030 wait complete. 2023-12-11T20:21:19.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.240+0000 7f670f038b80 20 client.26764 trim_cache size 0 max 16384 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: "e52624ba-4727-41c6-bdfc-2b5f68251879": { 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "e52624ba-4727-41c6-bdfc-2b5f68251879", 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:21:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:21:19.247 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:21:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 -- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f66e00a1480 msgr2=0x7f66e00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f66e00a1480 0x7f66e00a3940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0093d0 tx=0x7f66ec00b040 comp rx=0 tx=0).stop 2023-12-11T20:21:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 -- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4074030 msgr2=0x7f66f419d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4074030 0x7f66f419d9c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f66f000b2e0 tx=0x7f66f0005e80 comp rx=0 tx=0).stop 2023-12-11T20:21:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 -- 172.21.15.12:0/741007724 shutdown_connections 2023-12-11T20:21:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f66e00a1480 0x7f66e00a3940 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f410da80 0x7f66f41a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66f4074030 0x7f66f419d9c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 --2- 172.21.15.12:0/741007724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66f4075610 0x7f66f419df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 -- 172.21.15.12:0/741007724 >> 172.21.15.12:0/741007724 conn(0x7f66f40fca00 msgr2=0x7f66f4100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 -- 172.21.15.12:0/741007724 shutdown_connections 2023-12-11T20:21:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:19.241+0000 7f66fb7ff700 1 -- 172.21.15.12:0/741007724 wait complete. 2023-12-11T20:21:19.258 INFO:tasks.cephfs.filesystem:scrub status for tag:e52624ba-4727-41c6-bdfc-2b5f68251879 - {'path': '/', 'tag': 'e52624ba-4727-41c6-bdfc-2b5f68251879', 'options': 'recursive,force'} 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:19 smithi032 ceph-mon[132488]: pgmap v537: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:19 smithi039 ceph-mon[102205]: pgmap v537: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:21:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:21:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:21:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:19.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:19.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:19 smithi012 ceph-mon[128787]: pgmap v537: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:21:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:21.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:21 smithi032 ceph-mon[132488]: pgmap v538: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:21:21.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:21 smithi039 ceph-mon[102205]: pgmap v538: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:21:21.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:21 smithi012 ceph-mon[128787]: pgmap v538: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:21:23.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:23 smithi039 ceph-mon[102205]: pgmap v539: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 32 op/s 2023-12-11T20:21:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:23 smithi012 ceph-mon[128787]: pgmap v539: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 32 op/s 2023-12-11T20:21:23.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:23 smithi032 ceph-mon[132488]: pgmap v539: 97 pgs: 97 active+clean; 3.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 32 op/s 2023-12-11T20:21:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:25 smithi039 ceph-mon[102205]: pgmap v540: 97 pgs: 97 active+clean; 3.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:21:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:25 smithi012 ceph-mon[128787]: pgmap v540: 97 pgs: 97 active+clean; 3.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:21:25.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:25 smithi032 ceph-mon[132488]: pgmap v540: 97 pgs: 97 active+clean; 3.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:21:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:27 smithi039 ceph-mon[102205]: pgmap v541: 97 pgs: 97 active+clean; 3.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:21:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:27 smithi012 ceph-mon[128787]: pgmap v541: 97 pgs: 97 active+clean; 3.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:21:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:27 smithi032 ceph-mon[132488]: pgmap v541: 97 pgs: 97 active+clean; 3.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:21:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1097289430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 msgr2=0x7f0df4102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1097289430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 0x7f0df4102b40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0de40099c0 tx=0x7f0de4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1097289430 shutdown_connections 2023-12-11T20:21:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1097289430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0df4103080 0x7f0df4109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1097289430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0df41014f0 0x7f0df4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1097289430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 0x7f0df4102b40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1097289430 >> 172.21.15.12:0/1097289430 conn(0x7f0df40fca60 msgr2=0x7f0df40feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1097289430 shutdown_connections 2023-12-11T20:21:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.231+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1097289430 wait complete. 2023-12-11T20:21:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.232+0000 7f0dfb3ff700 1 Processor -- start 2023-12-11T20:21:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.232+0000 7f0dfb3ff700 1 -- start start 2023-12-11T20:21:28.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.232+0000 7f0dfb3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0df41014f0 0x7f0df4199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.232+0000 7f0dfb3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 0x7f0df4199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0dfb3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0df4103080 0x7f0df41a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0dfb3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41a10d0 con 0x7f0df41026e0 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0dfb3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41a1210 con 0x7f0df4103080 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0dfb3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41a13a0 con 0x7f0df41014f0 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 0x7f0df4199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 0x7f0df4199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58858/0 (socket says 172.21.15.12:58858) 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df899a700 1 -- 172.21.15.12:0/1016801673 learned_addr learned my addr 172.21.15.12:0/1016801673 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df919b700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0df41014f0 0x7f0df4199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df999c700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0df4103080 0x7f0df41a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df899a700 1 -- 172.21.15.12:0/1016801673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0df41014f0 msgr2=0x7f0df4199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df899a700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0df41014f0 0x7f0df4199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df899a700 1 -- 172.21.15.12:0/1016801673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0df4103080 msgr2=0x7f0df41a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df899a700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0df4103080 0x7f0df41a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.233+0000 7f0df899a700 1 -- 172.21.15.12:0/1016801673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de40095f0 con 0x7f0df41026e0 2023-12-11T20:21:28.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.234+0000 7f0df899a700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 0x7f0df4199b80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0de4000c00 tx=0x7f0de4003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:28.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.234+0000 7f0dea7fc700 1 -- 172.21.15.12:0/1016801673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de401d070 con 0x7f0df41026e0 2023-12-11T20:21:28.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.234+0000 7f0dea7fc700 1 -- 172.21.15.12:0/1016801673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0de400bd30 con 0x7f0df41026e0 2023-12-11T20:21:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.234+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1016801673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df41a1620 con 0x7f0df41026e0 2023-12-11T20:21:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.234+0000 7f0dea7fc700 1 -- 172.21.15.12:0/1016801673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4022bd0 con 0x7f0df41026e0 2023-12-11T20:21:28.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.234+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1016801673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df41a1aa0 con 0x7f0df41026e0 2023-12-11T20:21:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.237+0000 7f0dea7fc700 1 -- 172.21.15.12:0/1016801673 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0de4022d50 con 0x7f0df41026e0 2023-12-11T20:21:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.239+0000 7f0e0ec58b80 1 Processor -- start 2023-12-11T20:21:28.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.239+0000 7f0e0ec58b80 1 -- start start 2023-12-11T20:21:28.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd12e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd12f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd12fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd089af0 con 0x5574fd12ded0 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd087410 con 0x5574fd12e830 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd082d00 con 0x5574fd12f720 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0dea7fc700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0de00a14f0 0x7f0de00a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0dea7fc700 1 -- 172.21.15.12:0/1016801673 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0de40cdfe0 con 0x7f0df41026e0 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0df999c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd12e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0df999c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd12e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58862/0 (socket says 172.21.15.12:58862) 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0df999c700 1 -- 172.21.15.12:0/882296092 learned_addr learned my addr 172.21.15.12:0/882296092 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.240+0000 7f0df919b700 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd12f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df899a700 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd12fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df999c700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0de00a14f0 0x7f0de00a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df919b700 1 -- 172.21.15.12:0/882296092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 msgr2=0x5574fd12fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df919b700 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd12fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df919b700 1 -- 172.21.15.12:0/882296092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 msgr2=0x5574fd12e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df919b700 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd12e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df919b700 1 -- 172.21.15.12:0/882296092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574fceff5d0 con 0x5574fd12e830 2023-12-11T20:21:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df999c700 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd12e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df919b700 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd12f140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0df0007c30 tx=0x7f0df0007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78bca5b06f52fa9c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:28.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.241+0000 7f0df999c700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0de00a14f0 0x7f0de00a39b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009fd0 tx=0x7f0dec009100 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.242+0000 7f0ddf7fe700 1 -- 172.21.15.12:0/882296092 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0010ca0 con 0x5574fd12e830 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.242+0000 7f0ddf7fe700 1 -- 172.21.15.12:0/882296092 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0df00044e0 con 0x5574fd12e830 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.242+0000 7f0ddf7fe700 1 -- 172.21.15.12:0/882296092 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0005020 con 0x5574fd12e830 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.242+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/882296092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 msgr2=0x5574fd12f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.242+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd12f140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0df0007c30 tx=0x7f0df0007f40 comp rx=0 tx=0).stop 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.243+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/882296092 shutdown_connections 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.243+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd12fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.243+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd12e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.243+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/882296092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd12f140 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.243+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/882296092 >> 172.21.15.12:0/882296092 conn(0x5574fd05d780 msgr2=0x5574fd12a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.243+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/882296092 shutdown_connections 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.243+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/882296092 wait complete. 2023-12-11T20:21:28.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.243+0000 7f0e0ec58b80 1 -- start start 2023-12-11T20:21:28.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0e0ec58b80 1 Processor -- start 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 0x5574fd137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12e830 0x5574fd138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12f720 0x5574fd13f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd03c500 con 0x5574fd12f720 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd03c1a0 con 0x5574fd12ded0 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fcf018c0 con 0x5574fd12e830 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0e0ec58b80 10 client.0 _ll_register_callbacks cb 0x5574fcf67a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0df999c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12f720 0x5574fd13f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0df999c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12f720 0x5574fd13f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58874/0 (socket says 172.21.15.12:58874) 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0df999c700 1 -- 172.21.15.12:0/1685822843 learned_addr learned my addr 172.21.15.12:0/1685822843 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.244+0000 7f0df899a700 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12e830 0x5574fd138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0df919b700 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 0x5574fd137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0df999c700 1 -- 172.21.15.12:0/1685822843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12e830 msgr2=0x5574fd138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:28.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0df999c700 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12e830 0x5574fd138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0df999c700 1 -- 172.21.15.12:0/1685822843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 msgr2=0x5574fd137e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0df999c700 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 0x5574fd137e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0df999c700 1 -- 172.21.15.12:0/1685822843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec011040 con 0x5574fd12f720 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0df899a700 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12e830 0x5574fd138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0df999c700 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12f720 0x5574fd13f1a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0dec003d80 tx=0x7f0dec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1006cfc21e7dbb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0ddcff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.245+0000 7f0ddcff9700 1 -- 172.21.15.12:0/1685822843 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec022070 con 0x5574fd12f720 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/1685822843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574fd121730 con 0x5574fd12f720 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0ddcff9700 1 -- 172.21.15.12:0/1685822843 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0dec004bb0 con 0x5574fd12f720 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0ddcff9700 1 -- 172.21.15.12:0/1685822843 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dec019ee0 con 0x5574fd12f720 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 10 client.17085 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/1685822843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f0df0007890 con 0x5574fd12f720 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0ddcff9700 1 -- 172.21.15.12:0/1685822843 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5574fd121730 con 0x5574fd12f720 2023-12-11T20:21:28.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0ddcff9700 1 -- 172.21.15.12:0/1685822843 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0dec01b480 con 0x5574fd12f720 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 10 client.17085 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 10 client.17085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 20 client.17085 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574fd143d40 0x5574fd146160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 4 client.17085 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.246+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/1685822843 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574fd0fdee0 con 0x5574fd143d40 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.247+0000 7f0df919b700 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574fd143d40 0x5574fd146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.247+0000 7f0df919b700 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574fd143d40 0x5574fd146160 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91d9d46ca0de8a9 server_cookie=1bbba6878a75d7c4 in_seq=0 out_seq=0 2023-12-11T20:21:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.247+0000 7f0ddcff9700 10 client.17085 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:28.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.248+0000 7f0ddcff9700 1 -- 172.21.15.12:0/1685822843 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5574fd0fdee0 con 0x5574fd143d40 2023-12-11T20:21:28.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.248+0000 7f0ddcff9700 10 client.17085 handle_command_reply: tid=0 2023-12-11T20:21:28.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.248+0000 7f0e0ec58b80 1 client.17085 shutdown 2023-12-11T20:21:28.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/1685822843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12f720 msgr2=0x5574fd13f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12f720 0x5574fd13f1a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0dec003d80 tx=0x7f0dec004ad0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/1685822843 shutdown_connections 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574fd143d40 0x5574fd146160 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 0x5574fd137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12f720 0x5574fd13f1a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/1685822843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12e830 0x5574fd138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0ddcff9700 0 client.17085 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/1685822843 >> 172.21.15.12:0/1685822843 conn(0x5574fd05d780 msgr2=0x5574fd128ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/1685822843 shutdown_connections 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/1685822843 wait complete. 2023-12-11T20:21:28.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.249+0000 7f0e0ec58b80 20 client.17085 trim_cache size 0 max 16384 2023-12-11T20:21:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.265+0000 7f0e0ec58b80 1 Processor -- start 2023-12-11T20:21:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.265+0000 7f0e0ec58b80 1 -- start start 2023-12-11T20:21:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.265+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 0x5574fd13fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.265+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12e830 0x5574fd13f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.265+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd12fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.265+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd136c80 con 0x5574fd12e830 2023-12-11T20:21:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.265+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd12e670 con 0x5574fd12ded0 2023-12-11T20:21:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.265+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd14b310 con 0x5574fd12f720 2023-12-11T20:21:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12e830 0x5574fd13f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12e830 0x5574fd13f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58878/0 (socket says 172.21.15.12:58878) 2023-12-11T20:21:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 -- 172.21.15.12:0/4160859674 learned_addr learned my addr 172.21.15.12:0/4160859674 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df919b700 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 0x5574fd13fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df999c700 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd12fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 -- 172.21.15.12:0/4160859674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 msgr2=0x5574fd12fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd12fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 -- 172.21.15.12:0/4160859674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 msgr2=0x5574fd13fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 0x5574fd13fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 -- 172.21.15.12:0/4160859674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574fceabd80 con 0x5574fd12e830 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.266+0000 7f0df899a700 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12e830 0x5574fd13f0c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0de4097d20 tx=0x7f0de401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d536546a6eefb42 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0ddffff700 1 -- 172.21.15.12:0/4160859674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de409ae40 con 0x5574fd12e830 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0ddffff700 1 -- 172.21.15.12:0/4160859674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0de409ac60 con 0x5574fd12e830 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0ddffff700 1 -- 172.21.15.12:0/4160859674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de40a3600 con 0x5574fd12e830 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/4160859674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12e830 msgr2=0x5574fd13f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12e830 0x5574fd13f0c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0de4097d20 tx=0x7f0de401a040 comp rx=0 tx=0).stop 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/4160859674 shutdown_connections 2023-12-11T20:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12ded0 0x5574fd13fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd12fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/4160859674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12e830 0x5574fd13f0c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/4160859674 >> 172.21.15.12:0/4160859674 conn(0x5574fd05d780 msgr2=0x5574fd12a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.267+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/4160859674 shutdown_connections 2023-12-11T20:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.268+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/4160859674 wait complete. 2023-12-11T20:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.268+0000 7f0e0ec58b80 1 -- start start 2023-12-11T20:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.268+0000 7f0e0ec58b80 1 Processor -- start 2023-12-11T20:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd1941c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd196710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0e0ec58b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd198c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd135310 con 0x5574fd12ded0 2023-12-11T20:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd135450 con 0x5574fd12e830 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0e0ec58b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fd199220 con 0x5574fd12f720 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0e0ec58b80 10 client.0 _ll_register_callbacks cb 0x5574fcf67a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df919b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd1941c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df919b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd1941c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58888/0 (socket says 172.21.15.12:58888) 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df919b700 1 -- 172.21.15.12:0/3347217542 learned_addr learned my addr 172.21.15.12:0/3347217542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df899a700 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df999c700 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df919b700 1 -- 172.21.15.12:0/3347217542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 msgr2=0x5574fd198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df919b700 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df919b700 1 -- 172.21.15.12:0/3347217542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 msgr2=0x5574fd196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df919b700 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd196710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df919b700 1 -- 172.21.15.12:0/3347217542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df41a1aa0 con 0x5574fd12ded0 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.269+0000 7f0df999c700 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.270+0000 7f0df919b700 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd1941c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0df0000c00 tx=0x7f0df0005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e985667ec75fa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.270+0000 7f0ddcff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.270+0000 7f0ddcff9700 1 -- 172.21.15.12:0/3347217542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df001d040 con 0x5574fd12ded0 2023-12-11T20:21:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.270+0000 7f0ddcff9700 1 -- 172.21.15.12:0/3347217542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0df0028e40 con 0x5574fd12ded0 2023-12-11T20:21:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.270+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/3347217542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0df00044e0 con 0x5574fd12ded0 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.270+0000 7f0ddcff9700 1 -- 172.21.15.12:0/3347217542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0df0010ca0 con 0x5574fd12ded0 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.270+0000 7f0e0ec58b80 10 client.17091 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.270+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/3347217542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5574fce94c00 con 0x5574fd12ded0 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.271+0000 7f0ddcff9700 1 -- 172.21.15.12:0/3347217542 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0df00044e0 con 0x5574fd12ded0 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.271+0000 7f0ddcff9700 1 -- 172.21.15.12:0/3347217542 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0df00037e0 con 0x5574fd12ded0 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.271+0000 7f0e0ec58b80 10 client.17091 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.271+0000 7f0e0ec58b80 10 client.17091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.271+0000 7f0e0ec58b80 20 client.17091 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.271+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574fd19ac40 0x5574fd19d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.271+0000 7f0e0ec58b80 4 client.17091 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:21:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.271+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/3347217542 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5574fd048f70 con 0x5574fd19ac40 2023-12-11T20:21:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.272+0000 7f0df899a700 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574fd19ac40 0x5574fd19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.272+0000 7f0ddcff9700 10 client.17091 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.272+0000 7f0df899a700 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574fd19ac40 0x5574fd19d060 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e57ed3053ca84bfc server_cookie=762011e60e6f9fe5 in_seq=0 out_seq=0 2023-12-11T20:21:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.283+0000 7f0ddcff9700 1 -- 172.21.15.12:0/3347217542 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5574fd048f70 con 0x5574fd19ac40 2023-12-11T20:21:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.283+0000 7f0ddcff9700 10 client.17091 handle_command_reply: tid=0 2023-12-11T20:21:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.283+0000 7f0e0ec58b80 1 client.17091 shutdown 2023-12-11T20:21:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.283+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/3347217542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 msgr2=0x5574fd1941c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.283+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd1941c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0df0000c00 tx=0x7f0df0005cf0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/3347217542 shutdown_connections 2023-12-11T20:21:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574fd19ac40 0x5574fd19d060 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574fd12f720 0x5574fd198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574fd12ded0 0x5574fd1941c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 1 --2- 172.21.15.12:0/3347217542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574fd12e830 0x5574fd196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0ddcff9700 0 client.17091 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/3347217542 >> 172.21.15.12:0/3347217542 conn(0x5574fd05d780 msgr2=0x5574fd12a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/3347217542 shutdown_connections 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 1 -- 172.21.15.12:0/3347217542 wait complete. 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.284+0000 7f0e0ec58b80 20 client.17091 trim_cache size 0 max 16384 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:21:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:21:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:21:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0de00a14f0 msgr2=0x7f0de00a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0de00a14f0 0x7f0de00a39b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009fd0 tx=0x7f0dec009100 comp rx=0 tx=0).stop 2023-12-11T20:21:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 msgr2=0x7f0df4199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 0x7f0df4199b80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0de4000c00 tx=0x7f0de4003a50 comp rx=0 tx=0).stop 2023-12-11T20:21:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1016801673 shutdown_connections 2023-12-11T20:21:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0de00a14f0 0x7f0de00a39b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0df4103080 0x7f0df41a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0df41014f0 0x7f0df4199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 --2- 172.21.15.12:0/1016801673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df41026e0 0x7f0df4199b80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1016801673 >> 172.21.15.12:0/1016801673 conn(0x7f0df40fca60 msgr2=0x7f0df4107f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1016801673 shutdown_connections 2023-12-11T20:21:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:28.285+0000 7f0dfb3ff700 1 -- 172.21.15.12:0/1016801673 wait complete. 2023-12-11T20:21:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:29 smithi032 ceph-mon[132488]: pgmap v542: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:21:29.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:29 smithi039 ceph-mon[102205]: pgmap v542: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:21:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:29 smithi012 ceph-mon[128787]: pgmap v542: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:21:31.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:31 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:21:31.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:31 smithi039 ceph-mon[102205]: pgmap v543: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:21:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:31 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:21:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:31 smithi012 ceph-mon[128787]: pgmap v543: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:21:31.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:31 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:21:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:31 smithi032 ceph-mon[132488]: pgmap v543: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:21:32.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:32 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:21:32.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:32 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:21:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:32 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:21:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:32 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:21:32.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:32 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:21:32.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:32 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:21:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:33 smithi039 ceph-mon[102205]: pgmap v544: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:21:33.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:33 smithi012 ceph-mon[128787]: pgmap v544: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:21:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:33 smithi032 ceph-mon[132488]: pgmap v544: 97 pgs: 97 active+clean; 3.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:21:35.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:35 smithi039 ceph-mon[102205]: pgmap v545: 97 pgs: 97 active+clean; 3.6 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:21:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:35 smithi012 ceph-mon[128787]: pgmap v545: 97 pgs: 97 active+clean; 3.6 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:21:35.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:35 smithi032 ceph-mon[132488]: pgmap v545: 97 pgs: 97 active+clean; 3.6 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:21:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:37 smithi039 ceph-mon[102205]: pgmap v546: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 15 op/s 2023-12-11T20:21:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:37 smithi012 ceph-mon[128787]: pgmap v546: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 15 op/s 2023-12-11T20:21:37.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:37 smithi032 ceph-mon[132488]: pgmap v546: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 15 op/s 2023-12-11T20:21:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:39 smithi032 ceph-mon[132488]: pgmap v547: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:21:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:39 smithi039 ceph-mon[102205]: pgmap v547: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:21:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:39 smithi012 ceph-mon[128787]: pgmap v547: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:21:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.465+0000 7f46d25ff700 1 -- 172.21.15.12:0/2846519472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc1026c0 msgr2=0x7f46cc102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.465+0000 7f46d25ff700 1 --2- 172.21.15.12:0/2846519472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc1026c0 0x7f46cc102b20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f46c00099c0 tx=0x7f46c0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.465+0000 7f46d25ff700 1 -- 172.21.15.12:0/2846519472 shutdown_connections 2023-12-11T20:21:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.466+0000 7f46d25ff700 1 --2- 172.21.15.12:0/2846519472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46cc103060 0x7f46cc109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.466+0000 7f46d25ff700 1 --2- 172.21.15.12:0/2846519472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46cc1014d0 0x7f46cc1018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.466+0000 7f46d25ff700 1 --2- 172.21.15.12:0/2846519472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc1026c0 0x7f46cc102b20 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.466+0000 7f46d25ff700 1 -- 172.21.15.12:0/2846519472 >> 172.21.15.12:0/2846519472 conn(0x7f46cc0fca60 msgr2=0x7f46cc0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.466+0000 7f46d25ff700 1 -- 172.21.15.12:0/2846519472 shutdown_connections 2023-12-11T20:21:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.466+0000 7f46d25ff700 1 -- 172.21.15.12:0/2846519472 wait complete. 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d25ff700 1 Processor -- start 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d25ff700 1 -- start start 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d25ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46cc1014d0 0x7f46cc0752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d25ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46cc1026c0 0x7f46cc0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d25ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc103060 0x7f46cc073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d25ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc19b1c0 con 0x7f46cc103060 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d25ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc074440 con 0x7f46cc1026c0 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d25ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc074600 con 0x7f46cc1014d0 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46cc1014d0 0x7f46cc0752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.467+0000 7f46d0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc103060 0x7f46cc073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46cc1014d0 0x7f46cc0752e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54944/0 (socket says 172.21.15.12:54944) 2023-12-11T20:21:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 -- 172.21.15.12:0/627746125 learned_addr learned my addr 172.21.15.12:0/627746125 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46cc1026c0 0x7f46cc0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 -- 172.21.15.12:0/627746125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46cc1026c0 msgr2=0x7f46cc0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46cc1026c0 0x7f46cc0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 -- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc103060 msgr2=0x7f46cc073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc103060 0x7f46cc073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 -- 172.21.15.12:0/627746125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00095f0 con 0x7f46cc1014d0 2023-12-11T20:21:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc103060 0x7f46cc073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.468+0000 7f46cbfff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46cc1014d0 0x7f46cc0752e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00e970 tx=0x7f46bc00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.469+0000 7f46c97fa700 1 -- 172.21.15.12:0/627746125 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc009790 con 0x7f46cc1014d0 2023-12-11T20:21:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.469+0000 7f46d25ff700 1 -- 172.21.15.12:0/627746125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc1a5c10 con 0x7f46cc1014d0 2023-12-11T20:21:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.469+0000 7f46c97fa700 1 -- 172.21.15.12:0/627746125 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46bc00c7e0 con 0x7f46cc1014d0 2023-12-11T20:21:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.469+0000 7f46c97fa700 1 -- 172.21.15.12:0/627746125 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc003bd0 con 0x7f46cc1014d0 2023-12-11T20:21:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.469+0000 7f46d25ff700 1 -- 172.21.15.12:0/627746125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc1a5fd0 con 0x7f46cc1014d0 2023-12-11T20:21:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.473+0000 7f46c97fa700 1 -- 172.21.15.12:0/627746125 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f46bc00c950 con 0x7f46cc1014d0 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.474+0000 7f46e5ebab80 1 Processor -- start 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.474+0000 7f46e5ebab80 1 -- start start 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46c97fa700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b40a14f0 0x7f46b40a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a5ed0 0x56515d5a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46c97fa700 1 -- 172.21.15.12:0/627746125 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46bc014070 con 0x7f46cc1014d0 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a7720 0x56515d5a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d501af0 con 0x56515d5a5ed0 2023-12-11T20:21:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d4ff410 con 0x56515d5a7720 2023-12-11T20:21:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d4fad00 con 0x56515d5a6830 2023-12-11T20:21:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b40a14f0 0x7f46b40a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46cb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46d0b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a7720 0x56515d5a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46cb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54946/0 (socket says 172.21.15.12:54946) 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46cb7fe700 1 -- 172.21.15.12:0/2429089458 learned_addr learned my addr 172.21.15.12:0/2429089458 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.475+0000 7f46cbfff700 1 --2- 172.21.15.12:0/2429089458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a5ed0 0x56515d5a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46cb7fe700 1 -- 172.21.15.12:0/2429089458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a7720 msgr2=0x56515d5a7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/2429089458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a7720 0x56515d5a7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46cb7fe700 1 -- 172.21.15.12:0/2429089458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a5ed0 msgr2=0x56515d5a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/2429089458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a5ed0 0x56515d5a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46cb7fe700 1 -- 172.21.15.12:0/2429089458 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56515d3775d0 con 0x56515d5a6830 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b40a14f0 0x7f46b40a39b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f46c4019370 tx=0x7f46c4007690 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/2429089458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5a7140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46c000b580 tx=0x7f46c0005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97219ce06300a0f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46b27fc700 1 -- 172.21.15.12:0/2429089458 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c000ba10 con 0x56515d5a6830 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46b27fc700 1 -- 172.21.15.12:0/2429089458 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46c001e040 con 0x56515d5a6830 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.476+0000 7f46b27fc700 1 -- 172.21.15.12:0/2429089458 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0003ac0 con 0x56515d5a6830 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.477+0000 7f46e5ebab80 1 -- 172.21.15.12:0/2429089458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 msgr2=0x56515d5a7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.477+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/2429089458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5a7140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46c000b580 tx=0x7f46c0005bc0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.477+0000 7f46e5ebab80 1 -- 172.21.15.12:0/2429089458 shutdown_connections 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.477+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/2429089458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a7720 0x56515d5a7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.477+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/2429089458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a5ed0 0x56515d5a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.477+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/2429089458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5a7140 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.477+0000 7f46e5ebab80 1 -- 172.21.15.12:0/2429089458 >> 172.21.15.12:0/2429089458 conn(0x56515d4d5780 msgr2=0x56515d5a2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.478+0000 7f46e5ebab80 1 -- 172.21.15.12:0/2429089458 shutdown_connections 2023-12-11T20:21:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.478+0000 7f46e5ebab80 1 -- 172.21.15.12:0/2429089458 wait complete. 2023-12-11T20:21:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.478+0000 7f46e5ebab80 1 -- start start 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46e5ebab80 1 Processor -- start 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a5ed0 0x56515d5afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a6830 0x56515d5b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d4b4500 con 0x56515d5a7720 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d4b41a0 con 0x56515d5a6830 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d3798c0 con 0x56515d5a5ed0 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46e5ebab80 10 client.0 _ll_register_callbacks cb 0x56515d3dfa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46d0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46cb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a6830 0x56515d5b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46d0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57234/0 (socket says 172.21.15.12:57234) 2023-12-11T20:21:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.479+0000 7f46d0b9c700 1 -- 172.21.15.12:0/507477872 learned_addr learned my addr 172.21.15.12:0/507477872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46cbfff700 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a5ed0 0x56515d5afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46d0b9c700 1 -- 172.21.15.12:0/507477872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a5ed0 msgr2=0x56515d5afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a5ed0 0x56515d5afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46d0b9c700 1 -- 172.21.15.12:0/507477872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a6830 msgr2=0x56515d5b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a6830 0x56515d5b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46d0b9c700 1 -- 172.21.15.12:0/507477872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc10a260 con 0x56515d5a7720 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a6830 0x56515d5b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b71d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f46c4003cb0 tx=0x7f46c4009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d034d171369bbe5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.480+0000 7f46ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46ab7fe700 1 -- 172.21.15.12:0/507477872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4004710 con 0x56515d5a7720 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46e5ebab80 1 -- 172.21.15.12:0/507477872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56515d599730 con 0x56515d5a7720 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46ab7fe700 1 -- 172.21.15.12:0/507477872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46c4004870 con 0x56515d5a7720 2023-12-11T20:21:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46ab7fe700 1 -- 172.21.15.12:0/507477872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46c401b450 con 0x56515d5a7720 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46e5ebab80 10 client.17103 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46e5ebab80 1 -- 172.21.15.12:0/507477872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56515d323d80 con 0x56515d5a7720 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46ab7fe700 1 -- 172.21.15.12:0/507477872 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46c4033020 con 0x56515d5a7720 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46ab7fe700 1 -- 172.21.15.12:0/507477872 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f46c4024530 con 0x56515d5a7720 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46e5ebab80 10 client.17103 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46e5ebab80 10 client.17103 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.481+0000 7f46e5ebab80 20 client.17103 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.482+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56515d5bbd70 0x56515d5be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.482+0000 7f46e5ebab80 4 client.17103 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.482+0000 7f46e5ebab80 1 -- 172.21.15.12:0/507477872 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56515d575ee0 con 0x56515d5bbd70 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.482+0000 7f46cbfff700 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56515d5bbd70 0x56515d5be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.483+0000 7f46cbfff700 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56515d5bbd70 0x56515d5be190 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61dc493583253697 server_cookie=3ac72e04ea21a2b in_seq=0 out_seq=0 2023-12-11T20:21:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.483+0000 7f46ab7fe700 10 client.17103 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.483+0000 7f46ab7fe700 1 -- 172.21.15.12:0/507477872 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56515d575ee0 con 0x56515d5bbd70 2023-12-11T20:21:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.483+0000 7f46ab7fe700 10 client.17103 handle_command_reply: tid=0 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.483+0000 7f46e5ebab80 1 client.17103 shutdown 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 -- 172.21.15.12:0/507477872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 msgr2=0x56515d5b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b71d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f46c4003cb0 tx=0x7f46c4009100 comp rx=0 tx=0).stop 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 -- 172.21.15.12:0/507477872 shutdown_connections 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56515d5bbd70 0x56515d5be190 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b71d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a5ed0 0x56515d5afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/507477872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a6830 0x56515d5b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46ab7fe700 0 client.17103 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 -- 172.21.15.12:0/507477872 >> 172.21.15.12:0/507477872 conn(0x56515d4d5780 msgr2=0x56515d5a0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 -- 172.21.15.12:0/507477872 shutdown_connections 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 1 -- 172.21.15.12:0/507477872 wait complete. 2023-12-11T20:21:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.484+0000 7f46e5ebab80 20 client.17103 trim_cache size 0 max 16384 2023-12-11T20:21:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.508+0000 7f46e5ebab80 1 Processor -- start 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.508+0000 7f46e5ebab80 1 -- start start 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.508+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.508+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a6830 0x56515d5b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.508+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a7720 0x56515d5af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.508+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d5c3360 con 0x56515d5a6830 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.508+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d5a6c10 con 0x56515d5a5ed0 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.508+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d5ae6b0 con 0x56515d5a7720 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a6830 0x56515d5b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a6830 0x56515d5b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57242/0 (socket says 172.21.15.12:57242) 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 -- 172.21.15.12:0/3008485698 learned_addr learned my addr 172.21.15.12:0/3008485698 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cbfff700 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a7720 0x56515d5af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 -- 172.21.15.12:0/3008485698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a7720 msgr2=0x56515d5af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a7720 0x56515d5af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 -- 172.21.15.12:0/3008485698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 msgr2=0x56515d5a7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5a7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 -- 172.21.15.12:0/3008485698 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56515d30cc00 con 0x56515d5a6830 2023-12-11T20:21:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a7720 0x56515d5af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cbfff700 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5a7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.509+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a6830 0x56515d5b70f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f46c0025040 tx=0x7f46c0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa13619d14cb46 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.510+0000 7f46b2ffd700 1 -- 172.21.15.12:0/3008485698 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c000bd20 con 0x56515d5a6830 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.510+0000 7f46b2ffd700 1 -- 172.21.15.12:0/3008485698 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46c00058e0 con 0x56515d5a6830 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.510+0000 7f46b2ffd700 1 -- 172.21.15.12:0/3008485698 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c000f460 con 0x56515d5a6830 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.510+0000 7f46e5ebab80 1 -- 172.21.15.12:0/3008485698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a6830 msgr2=0x56515d5b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.510+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a6830 0x56515d5b70f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f46c0025040 tx=0x7f46c0005fd0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 -- 172.21.15.12:0/3008485698 shutdown_connections 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5a7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a7720 0x56515d5af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/3008485698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a6830 0x56515d5b70f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 -- 172.21.15.12:0/3008485698 >> 172.21.15.12:0/3008485698 conn(0x56515d4d5780 msgr2=0x56515d5adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 -- 172.21.15.12:0/3008485698 shutdown_connections 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 -- 172.21.15.12:0/3008485698 wait complete. 2023-12-11T20:21:41.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 -- start start 2023-12-11T20:21:41.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.511+0000 7f46e5ebab80 1 Processor -- start 2023-12-11T20:21:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46e5ebab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d5b6710 con 0x56515d5a7720 2023-12-11T20:21:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d5b6880 con 0x56515d5a5ed0 2023-12-11T20:21:41.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46e5ebab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56515d5b6a40 con 0x56515d5a6830 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46e5ebab80 10 client.0 _ll_register_callbacks cb 0x56515d3dfa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46d0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46d0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57248/0 (socket says 172.21.15.12:57248) 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46d0b9c700 1 -- 172.21.15.12:0/1862302505 learned_addr learned my addr 172.21.15.12:0/1862302505 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46cbfff700 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.512+0000 7f46cb7fe700 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46d0b9c700 1 -- 172.21.15.12:0/1862302505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 msgr2=0x56515d5b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46d0b9c700 1 -- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 msgr2=0x56515d5b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46d0b9c700 1 -- 172.21.15.12:0/1862302505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc1a5fd0 con 0x56515d5a7720 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46cbfff700 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:41.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46d0b9c700 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b61d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x56515d5b0d00 tx=0x7f46c40049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f405c77f7ee9195 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46ab7fe700 1 -- 172.21.15.12:0/1862302505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4024410 con 0x56515d5a7720 2023-12-11T20:21:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46ab7fe700 1 -- 172.21.15.12:0/1862302505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46c4034080 con 0x56515d5a7720 2023-12-11T20:21:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.513+0000 7f46e5ebab80 1 -- 172.21.15.12:0/1862302505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46c001e040 con 0x56515d5a7720 2023-12-11T20:21:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46ab7fe700 1 -- 172.21.15.12:0/1862302505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46c4024570 con 0x56515d5a7720 2023-12-11T20:21:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46e5ebab80 10 client.17109 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:41.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46e5ebab80 1 -- 172.21.15.12:0/1862302505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56515d3775d0 con 0x56515d5a7720 2023-12-11T20:21:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46ab7fe700 1 -- 172.21.15.12:0/1862302505 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46c4047080 con 0x56515d5a7720 2023-12-11T20:21:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46ab7fe700 1 -- 172.21.15.12:0/1862302505 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f46c401b450 con 0x56515d5a7720 2023-12-11T20:21:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46e5ebab80 10 client.17109 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46e5ebab80 10 client.17109 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46e5ebab80 20 client.17109 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56515d612f40 0x56515d615360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:41.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46e5ebab80 4 client.17109 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:21:41.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.514+0000 7f46e5ebab80 1 -- 172.21.15.12:0/1862302505 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56515d4c0f70 con 0x56515d612f40 2023-12-11T20:21:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.515+0000 7f46cbfff700 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56515d612f40 0x56515d615360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:41.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.516+0000 7f46cbfff700 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56515d612f40 0x56515d615360 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3730515a2d998f92 server_cookie=4b9e51f45fb52257 in_seq=0 out_seq=0 2023-12-11T20:21:41.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.516+0000 7f46ab7fe700 10 client.17109 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46ab7fe700 1 -- 172.21.15.12:0/1862302505 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56515d4c0f70 con 0x56515d612f40 2023-12-11T20:21:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46ab7fe700 10 client.17109 handle_command_reply: tid=0 2023-12-11T20:21:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 client.17109 shutdown 2023-12-11T20:21:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 -- 172.21.15.12:0/1862302505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 msgr2=0x56515d5b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b61d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x56515d5b0d00 tx=0x7f46c40049c0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 -- 172.21.15.12:0/1862302505 shutdown_connections 2023-12-11T20:21:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56515d612f40 0x56515d615360 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56515d5a5ed0 0x56515d5b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56515d5a7720 0x56515d5b61d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 --2- 172.21.15.12:0/1862302505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56515d5a6830 0x56515d5b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46ab7fe700 0 client.17109 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 -- 172.21.15.12:0/1862302505 >> 172.21.15.12:0/1862302505 conn(0x56515d4d5780 msgr2=0x56515d5a2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 -- 172.21.15.12:0/1862302505 shutdown_connections 2023-12-11T20:21:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.526+0000 7f46e5ebab80 1 -- 172.21.15.12:0/1862302505 wait complete. 2023-12-11T20:21:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46e5ebab80 20 client.17109 trim_cache size 0 max 16384 2023-12-11T20:21:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:21:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:21:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:21:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:21:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 -- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b40a14f0 msgr2=0x7f46b40a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b40a14f0 0x7f46b40a39b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f46c4019370 tx=0x7f46c4007690 comp rx=0 tx=0).stop 2023-12-11T20:21:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 -- 172.21.15.12:0/627746125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46cc1014d0 msgr2=0x7f46cc0752e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46cc1014d0 0x7f46cc0752e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00e970 tx=0x7f46bc00ec80 comp rx=0 tx=0).stop 2023-12-11T20:21:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 -- 172.21.15.12:0/627746125 shutdown_connections 2023-12-11T20:21:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b40a14f0 0x7f46b40a39b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46cc103060 0x7f46cc073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46cc1014d0 0x7f46cc0752e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 --2- 172.21.15.12:0/627746125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46cc1026c0 0x7f46cc0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.527+0000 7f46d25ff700 1 -- 172.21.15.12:0/627746125 >> 172.21.15.12:0/627746125 conn(0x7f46cc0fca60 msgr2=0x7f46cc105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.528+0000 7f46d25ff700 1 -- 172.21.15.12:0/627746125 shutdown_connections 2023-12-11T20:21:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:41.528+0000 7f46d25ff700 1 -- 172.21.15.12:0/627746125 wait complete. 2023-12-11T20:21:41.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:41 smithi039 ceph-mon[102205]: pgmap v548: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:21:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:41 smithi012 ceph-mon[128787]: pgmap v548: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:21:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:41 smithi032 ceph-mon[132488]: pgmap v548: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:21:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:43 smithi039 ceph-mon[102205]: pgmap v549: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:21:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:43 smithi012 ceph-mon[128787]: pgmap v549: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:21:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:43 smithi032 ceph-mon[132488]: pgmap v549: 97 pgs: 97 active+clean; 3.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:21:45.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:45 smithi039 ceph-mon[102205]: pgmap v550: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:21:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:45 smithi012 ceph-mon[128787]: pgmap v550: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:21:45.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:45 smithi032 ceph-mon[132488]: pgmap v550: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:21:47.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:47 smithi039 ceph-mon[102205]: pgmap v551: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:21:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:47 smithi012 ceph-mon[128787]: pgmap v551: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:21:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:47 smithi032 ceph-mon[132488]: pgmap v551: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:21:49.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:21:49.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.525+0000 7f16941ff700 1 -- 172.21.15.12:0/338161063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 msgr2=0x7f168c100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.525+0000 7f16941ff700 1 --2- 172.21.15.12:0/338161063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 0x7f168c100210 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1688009990 tx=0x7f1688009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.526+0000 7f16941ff700 1 -- 172.21.15.12:0/338161063 shutdown_connections 2023-12-11T20:21:49.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.526+0000 7f16941ff700 1 --2- 172.21.15.12:0/338161063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c101110 0x7f168c101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.526+0000 7f16941ff700 1 --2- 172.21.15.12:0/338161063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 0x7f168c100210 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.526+0000 7f16941ff700 1 --2- 172.21.15.12:0/338161063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f168c100750 0x7f168c100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.526+0000 7f16941ff700 1 -- 172.21.15.12:0/338161063 >> 172.21.15.12:0/338161063 conn(0x7f168c0fb930 msgr2=0x7f168c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:49.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.526+0000 7f16941ff700 1 -- 172.21.15.12:0/338161063 shutdown_connections 2023-12-11T20:21:49.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.526+0000 7f16941ff700 1 -- 172.21.15.12:0/338161063 wait complete. 2023-12-11T20:21:49.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.527+0000 7f16941ff700 1 Processor -- start 2023-12-11T20:21:49.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.527+0000 7f16941ff700 1 -- start start 2023-12-11T20:21:49.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.527+0000 7f16941ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 0x7f168c1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.527+0000 7f16941ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f168c100750 0x7f168c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.527+0000 7f16941ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c101110 0x7f168c1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.527+0000 7f16941ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1a10b0 con 0x7f168c0ffdf0 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.527+0000 7f16941ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1a11f0 con 0x7f168c101110 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.527+0000 7f16941ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1a1380 con 0x7f168c100750 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 0x7f168c1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 0x7f168c1995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45038/0 (socket says 172.21.15.12:45038) 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 -- 172.21.15.12:0/2444414259 learned_addr learned my addr 172.21.15.12:0/2444414259 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f169179a700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f168c100750 0x7f168c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f169279c700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c101110 0x7f168c1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 -- 172.21.15.12:0/2444414259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f168c100750 msgr2=0x7f168c199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f168c100750 0x7f168c199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 -- 172.21.15.12:0/2444414259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c101110 msgr2=0x7f168c1a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c101110 0x7f168c1a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 -- 172.21.15.12:0/2444414259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880095f0 con 0x7f168c0ffdf0 2023-12-11T20:21:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f169279c700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c101110 0x7f168c1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.528+0000 7f1691f9b700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 0x7f168c1995d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f168800b2e0 tx=0x7f1688004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:49.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.529+0000 7f1682ffd700 1 -- 172.21.15.12:0/2444414259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168801d070 con 0x7f168c0ffdf0 2023-12-11T20:21:49.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.529+0000 7f1682ffd700 1 -- 172.21.15.12:0/2444414259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f168800be50 con 0x7f168c0ffdf0 2023-12-11T20:21:49.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.529+0000 7f16941ff700 1 -- 172.21.15.12:0/2444414259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c1a1600 con 0x7f168c0ffdf0 2023-12-11T20:21:49.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.529+0000 7f1682ffd700 1 -- 172.21.15.12:0/2444414259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168800fe60 con 0x7f168c0ffdf0 2023-12-11T20:21:49.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.529+0000 7f16941ff700 1 -- 172.21.15.12:0/2444414259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c1a1a80 con 0x7f168c0ffdf0 2023-12-11T20:21:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.533+0000 7f1682ffd700 1 -- 172.21.15.12:0/2444414259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f168800f5f0 con 0x7f168c0ffdf0 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.534+0000 7f1682ffd700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16780a1500 0x7f16780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.534+0000 7f16a7c21b80 1 Processor -- start 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.534+0000 7f1682ffd700 1 -- 172.21.15.12:0/2444414259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f16880ce110 con 0x7f168c0ffdf0 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f16a7c21b80 1 -- start start 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f169179a700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16780a1500 0x7f16780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b3427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b342d30 0x561b7b343640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b343c20 0x561b7b3440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b29db50 con 0x561b7b342d30 2023-12-11T20:21:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b29b470 con 0x561b7b343c20 2023-12-11T20:21:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b296d60 con 0x561b7b3423d0 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f169179a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b342d30 0x561b7b343640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.535+0000 7f169179a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b342d30 0x561b7b343640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45050/0 (socket says 172.21.15.12:45050) 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169279c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b343c20 0x561b7b3440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169179a700 1 -- 172.21.15.12:0/1656637538 learned_addr learned my addr 172.21.15.12:0/1656637538 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f1691f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b3427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169179a700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16780a1500 0x7f16780a39c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f167c009cb0 tx=0x7f167c011720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169179a700 1 -- 172.21.15.12:0/1656637538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 msgr2=0x561b7b3427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169179a700 1 --2- 172.21.15.12:0/1656637538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b3427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169179a700 1 -- 172.21.15.12:0/1656637538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b343c20 msgr2=0x561b7b3440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169179a700 1 --2- 172.21.15.12:0/1656637538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b343c20 0x561b7b3440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169179a700 1 -- 172.21.15.12:0/1656637538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b7b113630 con 0x561b7b342d30 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f169179a700 1 --2- 172.21.15.12:0/1656637538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b342d30 0x561b7b343640 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f167c005c50 tx=0x7f167c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b951252497793554 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f1677fff700 1 -- 172.21.15.12:0/1656637538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c01ddb0 con 0x561b7b342d30 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.536+0000 7f1677fff700 1 -- 172.21.15.12:0/1656637538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f167c004cc0 con 0x561b7b342d30 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.537+0000 7f1677fff700 1 -- 172.21.15.12:0/1656637538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c00f3c0 con 0x561b7b342d30 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.537+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1656637538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b342d30 msgr2=0x561b7b343640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.537+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1656637538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b342d30 0x561b7b343640 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f167c005c50 tx=0x7f167c01c000 comp rx=0 tx=0).stop 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.537+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1656637538 shutdown_connections 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.537+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1656637538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b343c20 0x561b7b3440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.537+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1656637538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b3427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.537+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1656637538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b342d30 0x561b7b343640 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.537+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1656637538 >> 172.21.15.12:0/1656637538 conn(0x561b7b2717e0 msgr2=0x561b7b33ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.538+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1656637538 shutdown_connections 2023-12-11T20:21:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.538+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1656637538 wait complete. 2023-12-11T20:21:49.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.538+0000 7f16a7c21b80 1 -- start start 2023-12-11T20:21:49.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.539+0000 7f16a7c21b80 1 Processor -- start 2023-12-11T20:21:49.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.539+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 0x561b7b34c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.539+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 0x561b7b34c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.539+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.539+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b250560 con 0x561b7b343c20 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.539+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b250200 con 0x561b7b3423d0 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.539+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b115920 con 0x561b7b342d30 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f16a7c21b80 10 client.0 _ll_register_callbacks cb 0x561b7b17ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45054/0 (socket says 172.21.15.12:45054) 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169279c700 1 -- 172.21.15.12:0/225106495 learned_addr learned my addr 172.21.15.12:0/225106495 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f1691f9b700 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 0x561b7b34c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169179a700 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 0x561b7b34c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169279c700 1 -- 172.21.15.12:0/225106495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 msgr2=0x561b7b34c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169279c700 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 0x561b7b34c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169279c700 1 -- 172.21.15.12:0/225106495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 msgr2=0x561b7b34c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169279c700 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 0x561b7b34c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.540+0000 7f169279c700 1 -- 172.21.15.12:0/225106495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c011cd0 con 0x561b7b343c20 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f169279c700 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353720 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1684007b20 tx=0x7f1684007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19c1dbeba5d202e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f16757fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f16757fa700 1 -- 172.21.15.12:0/225106495 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16840118d0 con 0x561b7b343c20 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f16757fa700 1 -- 172.21.15.12:0/225106495 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1684011a30 con 0x561b7b343c20 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f16a7c21b80 1 -- 172.21.15.12:0/225106495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b7b335b40 con 0x561b7b343c20 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f16757fa700 1 -- 172.21.15.12:0/225106495 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1684011bf0 con 0x561b7b343c20 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f16a7c21b80 10 client.17121 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f16a7c21b80 1 -- 172.21.15.12:0/225106495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561b7b0bfde0 con 0x561b7b343c20 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.541+0000 7f16757fa700 1 -- 172.21.15.12:0/225106495 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561b7b335b40 con 0x561b7b343c20 2023-12-11T20:21:49.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.542+0000 7f16757fa700 1 -- 172.21.15.12:0/225106495 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1684014070 con 0x561b7b343c20 2023-12-11T20:21:49.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.542+0000 7f16a7c21b80 10 client.17121 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:49.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.542+0000 7f16a7c21b80 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:49.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.542+0000 7f16a7c21b80 20 client.17121 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:49.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.542+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561b7b358040 0x561b7b35a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.542+0000 7f16a7c21b80 4 client.17121 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:49.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.542+0000 7f16a7c21b80 1 -- 172.21.15.12:0/225106495 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b7b311f40 con 0x561b7b358040 2023-12-11T20:21:49.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.542+0000 7f1691f9b700 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561b7b358040 0x561b7b35a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.543+0000 7f1691f9b700 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561b7b358040 0x561b7b35a460 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=859e4ad5200ef52c server_cookie=389dd7e0231905c5 in_seq=0 out_seq=0 2023-12-11T20:21:49.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.543+0000 7f16757fa700 10 client.17121 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:49.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16757fa700 1 -- 172.21.15.12:0/225106495 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561b7b311f40 con 0x561b7b358040 2023-12-11T20:21:49.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16757fa700 10 client.17121 handle_command_reply: tid=0 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 client.17121 shutdown 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 -- 172.21.15.12:0/225106495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 msgr2=0x561b7b353720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353720 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1684007b20 tx=0x7f1684007e30 comp rx=0 tx=0).stop 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 -- 172.21.15.12:0/225106495 shutdown_connections 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561b7b358040 0x561b7b35a460 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 0x561b7b34c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353720 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16757fa700 0 client.17121 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/225106495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 0x561b7b34c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 -- 172.21.15.12:0/225106495 >> 172.21.15.12:0/225106495 conn(0x561b7b2717e0 msgr2=0x561b7b33da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 -- 172.21.15.12:0/225106495 shutdown_connections 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.544+0000 7f16a7c21b80 1 -- 172.21.15.12:0/225106495 wait complete. 2023-12-11T20:21:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.545+0000 7f16a7c21b80 20 client.17121 trim_cache size 0 max 16384 2023-12-11T20:21:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f16a7c21b80 1 Processor -- start 2023-12-11T20:21:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f16a7c21b80 1 -- start start 2023-12-11T20:21:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b34c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b342d30 0x561b7b34c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b34bd10 con 0x561b7b343c20 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b353b80 con 0x561b7b342d30 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b35f690 con 0x561b7b3423d0 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.565+0000 7f1691f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b34c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f169279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f1691f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b34c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:36028/0 (socket says 172.21.15.12:36028) 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f1691f9b700 1 -- 172.21.15.12:0/3372781797 learned_addr learned my addr 172.21.15.12:0/3372781797 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f169179a700 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b342d30 0x561b7b34c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f1691f9b700 1 -- 172.21.15.12:0/3372781797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b342d30 msgr2=0x561b7b34c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f1691f9b700 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b342d30 0x561b7b34c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f1691f9b700 1 -- 172.21.15.12:0/3372781797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 msgr2=0x561b7b353640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f1691f9b700 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f1691f9b700 1 -- 172.21.15.12:0/3372781797 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b7b0a8c60 con 0x561b7b3423d0 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f169279c700 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.566+0000 7f1691f9b700 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b34c160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1688097ee0 tx=0x7f1688086040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbbb9e4bc63f73ba server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f1680ff9700 1 -- 172.21.15.12:0/3372781797 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880b3ea0 con 0x561b7b3423d0 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f1680ff9700 1 -- 172.21.15.12:0/3372781797 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f168809bb70 con 0x561b7b3423d0 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f1680ff9700 1 -- 172.21.15.12:0/3372781797 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688099810 con 0x561b7b3423d0 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f16a7c21b80 1 -- 172.21.15.12:0/3372781797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 msgr2=0x561b7b34c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b34c160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1688097ee0 tx=0x7f1688086040 comp rx=0 tx=0).stop 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f16a7c21b80 1 -- 172.21.15.12:0/3372781797 shutdown_connections 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b353640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b3423d0 0x561b7b34c160 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/3372781797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b342d30 0x561b7b34c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f16a7c21b80 1 -- 172.21.15.12:0/3372781797 >> 172.21.15.12:0/3372781797 conn(0x561b7b2717e0 msgr2=0x561b7b34ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.567+0000 7f16a7c21b80 1 -- 172.21.15.12:0/3372781797 shutdown_connections 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.568+0000 7f16a7c21b80 1 -- 172.21.15.12:0/3372781797 wait complete. 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.568+0000 7f16a7c21b80 1 -- start start 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.568+0000 7f16a7c21b80 1 Processor -- start 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 0x561b7b3532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 0x561b7b351920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f16a7c21b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b351e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b3523a0 con 0x561b7b343c20 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b352510 con 0x561b7b3423d0 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f16a7c21b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b7b3526d0 con 0x561b7b342d30 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f16a7c21b80 10 client.0 _ll_register_callbacks cb 0x561b7b17ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f169279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b351e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f169279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b351e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45066/0 (socket says 172.21.15.12:45066) 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.569+0000 7f169279c700 1 -- 172.21.15.12:0/1797988505 learned_addr learned my addr 172.21.15.12:0/1797988505 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f169179a700 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 0x561b7b351920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f1691f9b700 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 0x561b7b3532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f169279c700 1 -- 172.21.15.12:0/1797988505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 msgr2=0x561b7b351920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f169279c700 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 0x561b7b351920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f169279c700 1 -- 172.21.15.12:0/1797988505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 msgr2=0x561b7b3532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f169279c700 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 0x561b7b3532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f169279c700 1 -- 172.21.15.12:0/1797988505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b7b0bfde0 con 0x561b7b343c20 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f169279c700 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b351e60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1684018000 tx=0x7f16840157c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee69c2e80952d5c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f16757fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f16757fa700 1 -- 172.21.15.12:0/1797988505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684004e40 con 0x561b7b343c20 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1797988505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f167c004cc0 con 0x561b7b343c20 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.570+0000 7f16757fa700 1 -- 172.21.15.12:0/1797988505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f16840118d0 con 0x561b7b343c20 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16757fa700 1 -- 172.21.15.12:0/1797988505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1684011a90 con 0x561b7b343c20 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16a7c21b80 10 client.17127 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1797988505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f168c1a1a80 con 0x561b7b343c20 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16757fa700 1 -- 172.21.15.12:0/1797988505 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f167c004cc0 con 0x561b7b343c20 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16757fa700 1 -- 172.21.15.12:0/1797988505 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1684014050 con 0x561b7b343c20 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16a7c21b80 10 client.17127 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16a7c21b80 10 client.17127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16a7c21b80 20 client.17127 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561b7b3afc80 0x561b7b3b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16a7c21b80 4 client.17127 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.571+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1797988505 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561b7b25cfd0 con 0x561b7b3afc80 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.572+0000 7f1691f9b700 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561b7b3afc80 0x561b7b3b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.572+0000 7f1691f9b700 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561b7b3afc80 0x561b7b3b20a0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e5ee6c9b78a3053 server_cookie=97d1a028a78fae20 in_seq=0 out_seq=0 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.572+0000 7f16757fa700 10 client.17127 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16757fa700 1 -- 172.21.15.12:0/1797988505 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561b7b25cfd0 con 0x561b7b3afc80 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16757fa700 10 client.17127 handle_command_reply: tid=0 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 client.17127 shutdown 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1797988505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 msgr2=0x561b7b351e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b351e60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1684018000 tx=0x7f16840157c0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1797988505 shutdown_connections 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561b7b3afc80 0x561b7b3b20a0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561b7b3423d0 0x561b7b3532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7b343c20 0x561b7b351e60 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 --2- 172.21.15.12:0/1797988505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561b7b342d30 0x561b7b351920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1797988505 >> 172.21.15.12:0/1797988505 conn(0x561b7b2717e0 msgr2=0x561b7b346b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16757fa700 0 client.17127 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1797988505 shutdown_connections 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 1 -- 172.21.15.12:0/1797988505 wait complete. 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.573+0000 7f16a7c21b80 20 client.17127 trim_cache size 0 max 16384 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:21:49.579 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 -- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16780a1500 msgr2=0x7f16780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16780a1500 0x7f16780a39c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f167c009cb0 tx=0x7f167c011720 comp rx=0 tx=0).stop 2023-12-11T20:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 -- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 msgr2=0x7f168c1995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 0x7f168c1995d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f168800b2e0 tx=0x7f1688004730 comp rx=0 tx=0).stop 2023-12-11T20:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 -- 172.21.15.12:0/2444414259 shutdown_connections 2023-12-11T20:21:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16780a1500 0x7f16780a39c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f168c101110 0x7f168c1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f168c0ffdf0 0x7f168c1995d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 --2- 172.21.15.12:0/2444414259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f168c100750 0x7f168c199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 -- 172.21.15.12:0/2444414259 >> 172.21.15.12:0/2444414259 conn(0x7f168c0fb930 msgr2=0x7f168c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 -- 172.21.15.12:0/2444414259 shutdown_connections 2023-12-11T20:21:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.574+0000 7f16941ff700 1 -- 172.21.15.12:0/2444414259 wait complete. 2023-12-11T20:21:49.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:49 smithi012 ceph-mon[128787]: pgmap v552: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:21:49.592 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:21:49.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:49 smithi032 ceph-mon[132488]: pgmap v552: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:21:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:49 smithi039 ceph-mon[102205]: pgmap v552: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:21:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 -- 172.21.15.12:0/2799322750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 msgr2=0x7f902c109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 --2- 172.21.15.12:0/2799322750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 0x7f902c109660 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f902400b0a0 tx=0x7f902400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 -- 172.21.15.12:0/2799322750 shutdown_connections 2023-12-11T20:21:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 --2- 172.21.15.12:0/2799322750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c101f90 0x7f902c104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 --2- 172.21.15.12:0/2799322750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 0x7f902c109660 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 --2- 172.21.15.12:0/2799322750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f902c1048c0 0x7f902c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 -- 172.21.15.12:0/2799322750 >> 172.21.15.12:0/2799322750 conn(0x7f902c0fb980 msgr2=0x7f902c0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 -- 172.21.15.12:0/2799322750 shutdown_connections 2023-12-11T20:21:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.812+0000 7f90327ff700 1 -- 172.21.15.12:0/2799322750 wait complete. 2023-12-11T20:21:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.813+0000 7f90327ff700 1 Processor -- start 2023-12-11T20:21:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.814+0000 7f90327ff700 1 -- start start 2023-12-11T20:21:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.814+0000 7f90327ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c101f90 0x7f902c195220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.814+0000 7f90327ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f902c1048c0 0x7f902c195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.814+0000 7f90327ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 0x7f902c1a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.814+0000 7f90327ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c1a5540 con 0x7f902c1071f0 2023-12-11T20:21:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.814+0000 7f90327ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c1a5680 con 0x7f902c101f90 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.814+0000 7f90327ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c1a5840 con 0x7f902c1048c0 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.814+0000 7f9030d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 0x7f902c1a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f9030d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 0x7f902c1a5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45090/0 (socket says 172.21.15.12:45090) 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f9030d9c700 1 -- 172.21.15.12:0/2426609089 learned_addr learned my addr 172.21.15.12:0/2426609089 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f902bfff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c101f90 0x7f902c195220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f902b7fe700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f902c1048c0 0x7f902c195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f9030d9c700 1 -- 172.21.15.12:0/2426609089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f902c1048c0 msgr2=0x7f902c195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f9030d9c700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f902c1048c0 0x7f902c195760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f9030d9c700 1 -- 172.21.15.12:0/2426609089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c101f90 msgr2=0x7f902c195220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f9030d9c700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c101f90 0x7f902c195220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f9030d9c700 1 -- 172.21.15.12:0/2426609089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024009d00 con 0x7f902c1071f0 2023-12-11T20:21:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.815+0000 7f9030d9c700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 0x7f902c1a5000 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f902400b780 tx=0x7f902400bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.816+0000 7f90297fa700 1 -- 172.21.15.12:0/2426609089 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400e040 con 0x7f902c1071f0 2023-12-11T20:21:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.816+0000 7f90297fa700 1 -- 172.21.15.12:0/2426609089 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9024009480 con 0x7f902c1071f0 2023-12-11T20:21:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.816+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c1a5ac0 con 0x7f902c1071f0 2023-12-11T20:21:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.816+0000 7f90297fa700 1 -- 172.21.15.12:0/2426609089 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90240052c0 con 0x7f902c1071f0 2023-12-11T20:21:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.816+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c1a5f40 con 0x7f902c1071f0 2023-12-11T20:21:49.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.817+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c108d70 con 0x7f902c1071f0 2023-12-11T20:21:49.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.819+0000 7f90297fa700 1 -- 172.21.15.12:0/2426609089 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f902401d9a0 con 0x7f902c1071f0 2023-12-11T20:21:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.821+0000 7f90297fa700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90140a1500 0x7f90140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.821+0000 7f90297fa700 1 -- 172.21.15.12:0/2426609089 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f90240cde20 con 0x7f902c1071f0 2023-12-11T20:21:49.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.821+0000 7f902bfff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90140a1500 0x7f90140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.822+0000 7f902bfff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90140a1500 0x7f90140a39c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f901c005950 tx=0x7f901c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:49.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:49.826+0000 7f90297fa700 1 -- 172.21.15.12:0/2426609089 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9024097460 con 0x7f902c1071f0 2023-12-11T20:21:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.150+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f902c068330 con 0x7f902c1071f0 2023-12-11T20:21:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.150+0000 7f90297fa700 1 -- 172.21.15.12:0/2426609089 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f902409aa80 con 0x7f902c1071f0 2023-12-11T20:21:50.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:21:50.149 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90140a1500 msgr2=0x7f90140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90140a1500 0x7f90140a39c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f901c005950 tx=0x7f901c00b410 comp rx=0 tx=0).stop 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 msgr2=0x7f902c1a5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 0x7f902c1a5000 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f902400b780 tx=0x7f902400bcc0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 shutdown_connections 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f90140a1500 0x7f90140a39c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f902c101f90 0x7f902c195220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f902c1071f0 0x7f902c1a5000 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 --2- 172.21.15.12:0/2426609089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f902c1048c0 0x7f902c195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.153+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 >> 172.21.15.12:0/2426609089 conn(0x7f902c0fb980 msgr2=0x7f902c101720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.154+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 shutdown_connections 2023-12-11T20:21:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.154+0000 7f90327ff700 1 -- 172.21.15.12:0/2426609089 wait complete. 2023-12-11T20:21:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:21:50.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:21:50.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 -- 172.21.15.12:0/1227171139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21481026e0 msgr2=0x7f2148104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 --2- 172.21.15.12:0/1227171139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21481026e0 0x7f2148104b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2138009990 tx=0x7f2138009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 -- 172.21.15.12:0/1227171139 shutdown_connections 2023-12-11T20:21:50.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 --2- 172.21.15.12:0/1227171139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21481050b0 0x7f2148105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 --2- 172.21.15.12:0/1227171139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21480ffd70 0x7f21481021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 --2- 172.21.15.12:0/1227171139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21481026e0 0x7f2148104b70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 -- 172.21.15.12:0/1227171139 >> 172.21.15.12:0/1227171139 conn(0x7f21480fb930 msgr2=0x7f21480fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 -- 172.21.15.12:0/1227171139 shutdown_connections 2023-12-11T20:21:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.397+0000 7f21505ff700 1 -- 172.21.15.12:0/1227171139 wait complete. 2023-12-11T20:21:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.398+0000 7f21505ff700 1 Processor -- start 2023-12-11T20:21:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.398+0000 7f21505ff700 1 -- start start 2023-12-11T20:21:50.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f21505ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21480ffd70 0x7f214819d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f21505ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21481026e0 0x7f214819dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f21505ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21481050b0 0x7f21481a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f21505ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21481a5490 con 0x7f21480ffd70 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f21505ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21481a55d0 con 0x7f21481050b0 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f21505ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21481a5760 con 0x7f21481026e0 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f214e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21480ffd70 0x7f214819d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f214e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21480ffd70 0x7f214819d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45116/0 (socket says 172.21.15.12:45116) 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f214db9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21481026e0 0x7f214819dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.399+0000 7f214e39b700 1 -- 172.21.15.12:0/775950833 learned_addr learned my addr 172.21.15.12:0/775950833 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f214eb9c700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21481050b0 0x7f21481a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f214e39b700 1 -- 172.21.15.12:0/775950833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21481026e0 msgr2=0x7f214819dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f214e39b700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21481026e0 0x7f214819dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f214e39b700 1 -- 172.21.15.12:0/775950833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21481050b0 msgr2=0x7f21481a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f214e39b700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21481050b0 0x7f21481a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f214e39b700 1 -- 172.21.15.12:0/775950833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144009520 con 0x7f21480ffd70 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f214e39b700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21480ffd70 0x7f214819d960 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f214400eb30 tx=0x7f214400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f213f7fe700 1 -- 172.21.15.12:0/775950833 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144009880 con 0x7f21480ffd70 2023-12-11T20:21:50.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f213f7fe700 1 -- 172.21.15.12:0/775950833 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21440044b0 con 0x7f21480ffd70 2023-12-11T20:21:50.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f21505ff700 1 -- 172.21.15.12:0/775950833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21380095f0 con 0x7f21480ffd70 2023-12-11T20:21:50.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.400+0000 7f213f7fe700 1 -- 172.21.15.12:0/775950833 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144003df0 con 0x7f21480ffd70 2023-12-11T20:21:50.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.401+0000 7f21505ff700 1 -- 172.21.15.12:0/775950833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21481a5e10 con 0x7f21480ffd70 2023-12-11T20:21:50.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.404+0000 7f213f7fe700 1 -- 172.21.15.12:0/775950833 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2144003f50 con 0x7f21480ffd70 2023-12-11T20:21:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f2163f8bb80 1 Processor -- start 2023-12-11T20:21:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f2163f8bb80 1 -- start start 2023-12-11T20:21:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac71157f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7116640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac7070b50 con 0x559ac7116c20 2023-12-11T20:21:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac706e470 con 0x559ac7115d30 2023-12-11T20:21:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac7069d60 con 0x559ac71153d0 2023-12-11T20:21:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.406+0000 7f213f7fe700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21340a1500 0x7f21340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f213f7fe700 1 -- 172.21.15.12:0/775950833 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2144014070 con 0x7f21480ffd70 2023-12-11T20:21:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214eb9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac71157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71170a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45120/0 (socket says 172.21.15.12:45120) 2023-12-11T20:21:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214db9a700 1 -- 172.21.15.12:0/3743217065 learned_addr learned my addr 172.21.15.12:0/3743217065 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214e39b700 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7116640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214eb9c700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21340a1500 0x7f21340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214db9a700 1 -- 172.21.15.12:0/3743217065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 msgr2=0x559ac71157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214db9a700 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac71157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214db9a700 1 -- 172.21.15.12:0/3743217065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 msgr2=0x559ac7116640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214db9a700 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7116640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214db9a700 1 -- 172.21.15.12:0/3743217065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ac6ee6630 con 0x559ac7116c20 2023-12-11T20:21:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.407+0000 7f214e39b700 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7116640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.408+0000 7f214eb9c700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21340a1500 0x7f21340a39c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2140012df0 tx=0x7f214000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.408+0000 7f214db9a700 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71170a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2138003f60 tx=0x7f2138005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869b69696fdfca9d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.408+0000 7f213cbfe700 1 -- 172.21.15.12:0/3743217065 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213801d070 con 0x559ac7116c20 2023-12-11T20:21:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.408+0000 7f213cbfe700 1 -- 172.21.15.12:0/3743217065 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f213801e040 con 0x559ac7116c20 2023-12-11T20:21:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.408+0000 7f213cbfe700 1 -- 172.21.15.12:0/3743217065 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800b710 con 0x559ac7116c20 2023-12-11T20:21:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 -- 172.21.15.12:0/3743217065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 msgr2=0x559ac71170a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71170a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2138003f60 tx=0x7f2138005ec0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 -- 172.21.15.12:0/3743217065 shutdown_connections 2023-12-11T20:21:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71170a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac71157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/3743217065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7116640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 -- 172.21.15.12:0/3743217065 >> 172.21.15.12:0/3743217065 conn(0x559ac70447e0 msgr2=0x559ac7111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 -- 172.21.15.12:0/3743217065 shutdown_connections 2023-12-11T20:21:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.409+0000 7f2163f8bb80 1 -- 172.21.15.12:0/3743217065 wait complete. 2023-12-11T20:21:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.410+0000 7f2163f8bb80 1 -- start start 2023-12-11T20:21:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.410+0000 7f2163f8bb80 1 Processor -- start 2023-12-11T20:21:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac71153d0 0x559ac711f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac711f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71266a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac7023560 con 0x559ac7116c20 2023-12-11T20:21:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac7023200 con 0x559ac71153d0 2023-12-11T20:21:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac6ee8920 con 0x559ac7115d30 2023-12-11T20:21:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f2163f8bb80 10 client.0 _ll_register_callbacks cb 0x559ac6f4ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214db9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac711f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214eb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214db9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac711f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:36094/0 (socket says 172.21.15.12:36094) 2023-12-11T20:21:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214db9a700 1 -- 172.21.15.12:0/335081282 learned_addr learned my addr 172.21.15.12:0/335081282 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214e39b700 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac71153d0 0x559ac711f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214db9a700 1 -- 172.21.15.12:0/335081282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac71153d0 msgr2=0x559ac711f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214db9a700 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac71153d0 0x559ac711f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214db9a700 1 -- 172.21.15.12:0/335081282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 msgr2=0x559ac71266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214db9a700 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.411+0000 7f214db9a700 1 -- 172.21.15.12:0/335081282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21481a5e10 con 0x559ac7115d30 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.412+0000 7f214db9a700 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac711f660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2138009350 tx=0x7f21380038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8338638fc941881f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.412+0000 7f2131ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.412+0000 7f2131ffb700 1 -- 172.21.15.12:0/335081282 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213801d040 con 0x559ac7115d30 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.412+0000 7f2131ffb700 1 -- 172.21.15.12:0/335081282 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f213800bb20 con 0x559ac7115d30 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.412+0000 7f2163f8bb80 1 -- 172.21.15.12:0/335081282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ac7108b40 con 0x559ac7115d30 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.412+0000 7f2131ffb700 1 -- 172.21.15.12:0/335081282 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f213800bce0 con 0x559ac7115d30 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.412+0000 7f2163f8bb80 10 client.26836 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.412+0000 7f2163f8bb80 1 -- 172.21.15.12:0/335081282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f2148106060 con 0x559ac7115d30 2023-12-11T20:21:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.413+0000 7f2131ffb700 1 -- 172.21.15.12:0/335081282 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559ac7108b40 con 0x559ac7115d30 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.413+0000 7f2131ffb700 1 -- 172.21.15.12:0/335081282 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2138031020 con 0x559ac7115d30 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.413+0000 7f2163f8bb80 10 client.26836 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.413+0000 7f2163f8bb80 10 client.26836 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.413+0000 7f2163f8bb80 20 client.26836 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.413+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559ac712aa50 0x559ac712ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.413+0000 7f2163f8bb80 4 client.26836 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.413+0000 7f2163f8bb80 1 -- 172.21.15.12:0/335081282 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ac70e4f40 con 0x559ac712aa50 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.414+0000 7f214e39b700 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559ac712aa50 0x559ac712ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.414+0000 7f214e39b700 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559ac712aa50 0x559ac712ce40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70ae5ccecbe67caa server_cookie=88d5dd4e7e137c18 in_seq=0 out_seq=0 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.414+0000 7f2131ffb700 10 client.26836 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2131ffb700 1 -- 172.21.15.12:0/335081282 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559ac70e4f40 con 0x559ac712aa50 2023-12-11T20:21:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2131ffb700 10 client.26836 handle_command_reply: tid=0 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 client.26836 shutdown 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 -- 172.21.15.12:0/335081282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 msgr2=0x559ac711f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac711f660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2138009350 tx=0x7f21380038b0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 -- 172.21.15.12:0/335081282 shutdown_connections 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559ac712aa50 0x559ac712ce40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac71153d0 0x559ac711f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2131ffb700 0 client.26836 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac71266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/335081282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac711f660 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.415+0000 7f2163f8bb80 1 -- 172.21.15.12:0/335081282 >> 172.21.15.12:0/335081282 conn(0x559ac70447e0 msgr2=0x559ac7110a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.416+0000 7f2163f8bb80 1 -- 172.21.15.12:0/335081282 shutdown_connections 2023-12-11T20:21:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.416+0000 7f2163f8bb80 1 -- 172.21.15.12:0/335081282 wait complete. 2023-12-11T20:21:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.416+0000 7f2163f8bb80 20 client.26836 trim_cache size 0 max 16384 2023-12-11T20:21:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.431+0000 7f2163f8bb80 1 Processor -- start 2023-12-11T20:21:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.431+0000 7f2163f8bb80 1 -- start start 2023-12-11T20:21:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.431+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac7126d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.431+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7126660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.431+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac7117000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.431+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac71164d0 con 0x559ac7116c20 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.431+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac710cb50 con 0x559ac7115d30 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.431+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac7116140 con 0x559ac71153d0 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214eb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac7117000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214e39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac7126d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214eb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac7117000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45144/0 (socket says 172.21.15.12:45144) 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214eb9c700 1 -- 172.21.15.12:0/577905410 learned_addr learned my addr 172.21.15.12:0/577905410 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214db9a700 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7126660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214e39b700 1 -- 172.21.15.12:0/577905410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 msgr2=0x559ac7126660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214e39b700 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7126660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214e39b700 1 -- 172.21.15.12:0/577905410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 msgr2=0x559ac7117000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214e39b700 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac7117000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214e39b700 1 -- 172.21.15.12:0/577905410 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ac6e92de0 con 0x559ac71153d0 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.432+0000 7f214eb9c700 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac7117000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.433+0000 7f214e39b700 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac7126d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f214400eb00 tx=0x7f2144003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32d817bdc69dce60 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.433+0000 7f213d3ff700 1 -- 172.21.15.12:0/577905410 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214409aab0 con 0x559ac71153d0 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.433+0000 7f213d3ff700 1 -- 172.21.15.12:0/577905410 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f214400cc90 con 0x559ac71153d0 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.433+0000 7f213d3ff700 1 -- 172.21.15.12:0/577905410 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144098750 con 0x559ac71153d0 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.433+0000 7f2163f8bb80 1 -- 172.21.15.12:0/577905410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 msgr2=0x559ac7126d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.433+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac7126d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f214400eb00 tx=0x7f2144003680 comp rx=0 tx=0).stop 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 -- 172.21.15.12:0/577905410 shutdown_connections 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac7116c20 0x559ac7117000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac71153d0 0x559ac7126d50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/577905410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7115d30 0x559ac7126660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 -- 172.21.15.12:0/577905410 >> 172.21.15.12:0/577905410 conn(0x559ac70447e0 msgr2=0x559ac7119b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 -- 172.21.15.12:0/577905410 shutdown_connections 2023-12-11T20:21:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 -- 172.21.15.12:0/577905410 wait complete. 2023-12-11T20:21:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 -- start start 2023-12-11T20:21:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.434+0000 7f2163f8bb80 1 Processor -- start 2023-12-11T20:21:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac71153d0 0x559ac7122480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac71229c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f2163f8bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7116c20 0x559ac7125940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac7125e80 con 0x559ac71153d0 2023-12-11T20:21:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac7125ff0 con 0x559ac7116c20 2023-12-11T20:21:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f2163f8bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac71261b0 con 0x559ac7115d30 2023-12-11T20:21:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f2163f8bb80 10 client.0 _ll_register_callbacks cb 0x559ac6f4ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f214e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac71153d0 0x559ac7122480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f214e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac71153d0 0x559ac7122480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45150/0 (socket says 172.21.15.12:45150) 2023-12-11T20:21:50.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f214e39b700 1 -- 172.21.15.12:0/1644322765 learned_addr learned my addr 172.21.15.12:0/1644322765 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.435+0000 7f214db9a700 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac71229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f214eb9c700 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7116c20 0x559ac7125940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f214e39b700 1 -- 172.21.15.12:0/1644322765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 msgr2=0x559ac71229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f214e39b700 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac71229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f214e39b700 1 -- 172.21.15.12:0/1644322765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7116c20 msgr2=0x559ac7125940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f214e39b700 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7116c20 0x559ac7125940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f214e39b700 1 -- 172.21.15.12:0/1644322765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21400090f0 con 0x559ac71153d0 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f214e39b700 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac71153d0 0x559ac7122480 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f21440caf00 tx=0x7f21440a27d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa7316b02a1dd2c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f2131ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:50.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f2131ffb700 1 -- 172.21.15.12:0/1644322765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214409e500 con 0x559ac71153d0 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f2163f8bb80 1 -- 172.21.15.12:0/1644322765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f213801e040 con 0x559ac71153d0 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.436+0000 7f2131ffb700 1 -- 172.21.15.12:0/1644322765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21440af070 con 0x559ac71153d0 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2131ffb700 1 -- 172.21.15.12:0/1644322765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f214409a3b0 con 0x559ac71153d0 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2163f8bb80 10 client.17151 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2163f8bb80 1 -- 172.21.15.12:0/1644322765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f21380095f0 con 0x559ac71153d0 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2131ffb700 1 -- 172.21.15.12:0/1644322765 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f213801e040 con 0x559ac71153d0 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2131ffb700 1 -- 172.21.15.12:0/1644322765 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2144060ce0 con 0x559ac71153d0 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2163f8bb80 10 client.17151 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:50.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2163f8bb80 10 client.17151 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:21:50.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2163f8bb80 20 client.17151 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:50.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559ac7181a00 0x559ac7183e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2163f8bb80 4 client.17151 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:21:50.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.437+0000 7f2163f8bb80 1 -- 172.21.15.12:0/1644322765 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559ac702ffd0 con 0x559ac7181a00 2023-12-11T20:21:50.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.438+0000 7f214db9a700 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559ac7181a00 0x559ac7183e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.438+0000 7f214db9a700 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559ac7181a00 0x559ac7183e20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f147e6cf09e86e77 server_cookie=b68c542e93a9bb9 in_seq=0 out_seq=0 2023-12-11T20:21:50.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.438+0000 7f2131ffb700 10 client.17151 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:21:50.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.438+0000 7f2131ffb700 1 -- 172.21.15.12:0/1644322765 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559ac702ffd0 con 0x559ac7181a00 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.438+0000 7f2131ffb700 10 client.17151 handle_command_reply: tid=0 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.438+0000 7f2163f8bb80 1 client.17151 shutdown 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 -- 172.21.15.12:0/1644322765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac71153d0 msgr2=0x559ac7122480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac71153d0 0x559ac7122480 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f21440caf00 tx=0x7f21440a27d0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 -- 172.21.15.12:0/1644322765 shutdown_connections 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559ac7181a00 0x559ac7183e20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559ac7116c20 0x559ac7125940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ac71153d0 0x559ac7122480 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2131ffb700 0 client.17151 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 --2- 172.21.15.12:0/1644322765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559ac7115d30 0x559ac71229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 -- 172.21.15.12:0/1644322765 >> 172.21.15.12:0/1644322765 conn(0x559ac70447e0 msgr2=0x559ac7119b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 -- 172.21.15.12:0/1644322765 shutdown_connections 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 1 -- 172.21.15.12:0/1644322765 wait complete. 2023-12-11T20:21:50.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.439+0000 7f2163f8bb80 20 client.17151 trim_cache size 0 max 16384 2023-12-11T20:21:50.447 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:21:50.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 -- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21340a1500 msgr2=0x7f21340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21340a1500 0x7f21340a39c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2140012df0 tx=0x7f214000b040 comp rx=0 tx=0).stop 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 -- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21480ffd70 msgr2=0x7f214819d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21480ffd70 0x7f214819d960 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f214400eb30 tx=0x7f214400ee40 comp rx=0 tx=0).stop 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 -- 172.21.15.12:0/775950833 shutdown_connections 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21340a1500 0x7f21340a39c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21481050b0 0x7f21481a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21480ffd70 0x7f214819d960 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 --2- 172.21.15.12:0/775950833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21481026e0 0x7f214819dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 -- 172.21.15.12:0/775950833 >> 172.21.15.12:0/775950833 conn(0x7f21480fb930 msgr2=0x7f2148101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 -- 172.21.15.12:0/775950833 shutdown_connections 2023-12-11T20:21:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.440+0000 7f21505ff700 1 -- 172.21.15.12:0/775950833 wait complete. 2023-12-11T20:21:50.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:50 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2426609089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:21:50.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.684+0000 7fb1dcbff700 1 -- 172.21.15.12:0/4200049031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81014b0 msgr2=0x7fb1d81018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.684+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/4200049031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81014b0 0x7fb1d81018d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80099c0 tx=0x7fb1c8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.684+0000 7fb1dcbff700 1 -- 172.21.15.12:0/4200049031 shutdown_connections 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.684+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/4200049031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d8103040 0x7fb1d81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.684+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/4200049031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81014b0 0x7fb1d81018d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.684+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/4200049031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1d81026a0 0x7fb1d8102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.684+0000 7fb1dcbff700 1 -- 172.21.15.12:0/4200049031 >> 172.21.15.12:0/4200049031 conn(0x7fb1d80fca00 msgr2=0x7fb1d80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.684+0000 7fb1dcbff700 1 -- 172.21.15.12:0/4200049031 shutdown_connections 2023-12-11T20:21:50.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.685+0000 7fb1dcbff700 1 -- 172.21.15.12:0/4200049031 wait complete. 2023-12-11T20:21:50.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.686+0000 7fb1dcbff700 1 Processor -- start 2023-12-11T20:21:50.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.686+0000 7fb1dcbff700 1 -- start start 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.686+0000 7fb1dcbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81014b0 0x7fb1d8197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.686+0000 7fb1dcbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81026a0 0x7fb1d8197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.686+0000 7fb1dcbff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1d8103040 0x7fb1d819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.686+0000 7fb1dcbff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d819ee40 con 0x7fb1d81026a0 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.686+0000 7fb1dcbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d819ef80 con 0x7fb1d81014b0 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.686+0000 7fb1dcbff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d819f110 con 0x7fb1d8103040 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81026a0 0x7fb1d8197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81026a0 0x7fb1d8197850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45170/0 (socket says 172.21.15.12:45170) 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/2655209424 learned_addr learned my addr 172.21.15.12:0/2655209424 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d659c700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81014b0 0x7fb1d8197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1d8103040 0x7fb1d819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/2655209424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1d8103040 msgr2=0x7fb1d819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1d8103040 0x7fb1d819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/2655209424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81014b0 msgr2=0x7fb1d8197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81014b0 0x7fb1d8197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/2655209424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80095f0 con 0x7fb1d81026a0 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.687+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81026a0 0x7fb1d8197850 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e9a0 tx=0x7fb1cc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.688+0000 7fb1c77fe700 1 -- 172.21.15.12:0/2655209424 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc009790 con 0x7fb1d81026a0 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.688+0000 7fb1c77fe700 1 -- 172.21.15.12:0/2655209424 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1cc00cbd0 con 0x7fb1d81026a0 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.688+0000 7fb1dcbff700 1 -- 172.21.15.12:0/2655209424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d819f3f0 con 0x7fb1d81026a0 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.688+0000 7fb1c77fe700 1 -- 172.21.15.12:0/2655209424 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc018680 con 0x7fb1d81026a0 2023-12-11T20:21:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.688+0000 7fb1dcbff700 1 -- 172.21.15.12:0/2655209424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d819f900 con 0x7fb1d81026a0 2023-12-11T20:21:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.691+0000 7fb1c77fe700 1 -- 172.21.15.12:0/2655209424 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb1cc00cd40 con 0x7fb1d81026a0 2023-12-11T20:21:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.693+0000 7fb1c77fe700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb1c00a1480 0x7fb1c00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.693+0000 7fb1c77fe700 1 -- 172.21.15.12:0/2655209424 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb1cc014070 con 0x7fb1d81026a0 2023-12-11T20:21:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.693+0000 7fb1d659c700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb1c00a1480 0x7fb1c00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.693+0000 7fb1f044fb80 1 Processor -- start 2023-12-11T20:21:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.694+0000 7fb1f044fb80 1 -- start start 2023-12-11T20:21:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.694+0000 7fb1d659c700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb1c00a1480 0x7fb1c00a3940 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8006010 tx=0x7fb1c8003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.694+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631761893d0 0x5631761897f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.694+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563176189d30 0x56317618a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.694+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x56317618b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.694+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631760e4b50 con 0x56317618ac20 2023-12-11T20:21:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.694+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631760e2470 con 0x563176189d30 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.694+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631760ddd60 con 0x5631761893d0 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x56317618b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x56317618b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45176/0 (socket says 172.21.15.12:45176) 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d6d9d700 1 -- 172.21.15.12:0/603160429 learned_addr learned my addr 172.21.15.12:0/603160429 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563176189d30 0x56317618a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d659c700 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631761893d0 0x5631761897f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d6d9d700 1 -- 172.21.15.12:0/603160429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631761893d0 msgr2=0x5631761897f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631761893d0 0x5631761897f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d6d9d700 1 -- 172.21.15.12:0/603160429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563176189d30 msgr2=0x56317618a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563176189d30 0x56317618a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d6d9d700 1 -- 172.21.15.12:0/603160429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563175f5a630 con 0x56317618ac20 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.695+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563176189d30 0x56317618a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.696+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x56317618b0a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009dc0 tx=0x7fb1d00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84548fe28614d241 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.696+0000 7fb1c4ff9700 1 -- 172.21.15.12:0/603160429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0014610 con 0x56317618ac20 2023-12-11T20:21:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.696+0000 7fb1c4ff9700 1 -- 172.21.15.12:0/603160429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1d000f050 con 0x56317618ac20 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.696+0000 7fb1c4ff9700 1 -- 172.21.15.12:0/603160429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0013770 con 0x56317618ac20 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.696+0000 7fb1f044fb80 1 -- 172.21.15.12:0/603160429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 msgr2=0x56317618b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x56317618b0a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009dc0 tx=0x7fb1d00077e0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 -- 172.21.15.12:0/603160429 shutdown_connections 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x56317618b0a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5631761893d0 0x5631761897f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/603160429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563176189d30 0x56317618a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 -- 172.21.15.12:0/603160429 >> 172.21.15.12:0/603160429 conn(0x5631760b87e0 msgr2=0x563176185d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 -- 172.21.15.12:0/603160429 shutdown_connections 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 -- 172.21.15.12:0/603160429 wait complete. 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.697+0000 7fb1f044fb80 1 -- start start 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1f044fb80 1 Processor -- start 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631761893d0 0x563176193180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x5631761936c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56317618ac20 0x56317619a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563176097560 con 0x5631761893d0 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563176097200 con 0x56317618ac20 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563175f5c920 con 0x563176189d30 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1f044fb80 10 client.0 _ll_register_callbacks cb 0x563175fc2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1d659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631761893d0 0x563176193180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1d659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631761893d0 0x563176193180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45190/0 (socket says 172.21.15.12:45190) 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1d659c700 1 -- 172.21.15.12:0/3198444042 learned_addr learned my addr 172.21.15.12:0/3198444042 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.698+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x5631761936c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56317618ac20 0x56317619a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/3198444042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56317618ac20 msgr2=0x56317619a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56317618ac20 0x56317619a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/3198444042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631761893d0 msgr2=0x563176193180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631761893d0 0x563176193180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/3198444042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d819f900 con 0x563176189d30 2023-12-11T20:21:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1d659c700 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631761893d0 0x563176193180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x5631761936c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc09a1b0 tx=0x7fb1cc09a9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb48bcf23bba792 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.699+0000 7fb1bdffb700 1 -- 172.21.15.12:0/3198444042 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc09e370 con 0x563176189d30 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3198444042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56317617cb40 con 0x563176189d30 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1bdffb700 1 -- 172.21.15.12:0/3198444042 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb1cc09a4b0 con 0x563176189d30 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1bdffb700 1 -- 172.21.15.12:0/3198444042 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1cc09e600 con 0x563176189d30 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1f044fb80 10 client.26854 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3198444042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fb1d0009a20 con 0x563176189d30 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1bdffb700 1 -- 172.21.15.12:0/3198444042 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1cc07e080 con 0x563176189d30 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1bdffb700 1 -- 172.21.15.12:0/3198444042 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb1cc083ae0 con 0x563176189d30 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1f044fb80 10 client.26854 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.700+0000 7fb1f044fb80 10 client.26854 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.701+0000 7fb1f044fb80 20 client.26854 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.701+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56317619efb0 0x5631761a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.701+0000 7fb1f044fb80 4 client.26854 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.701+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3198444042 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563176158f40 con 0x56317619efb0 2023-12-11T20:21:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.701+0000 7fb1d659c700 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56317619efb0 0x5631761a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.702+0000 7fb1d659c700 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56317619efb0 0x5631761a13d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8e248fd04c2ba11e server_cookie=6a1a780e37179320 in_seq=0 out_seq=0 2023-12-11T20:21:50.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.702+0000 7fb1bdffb700 10 client.26854 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:21:50.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.702+0000 7fb1bdffb700 1 -- 172.21.15.12:0/3198444042 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563176158f40 con 0x56317619efb0 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.702+0000 7fb1bdffb700 10 client.26854 handle_command_reply: tid=0 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 client.26854 shutdown 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 msgr2=0x5631761936c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x5631761936c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc09a1b0 tx=0x7fb1cc09a9f0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3198444042 shutdown_connections 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56317619efb0 0x5631761a13d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56317618ac20 0x56317619a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631761893d0 0x563176193180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3198444042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x5631761936c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1bdffb700 0 client.26854 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3198444042 >> 172.21.15.12:0/3198444042 conn(0x5631760b87e0 msgr2=0x563176184a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3198444042 shutdown_connections 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3198444042 wait complete. 2023-12-11T20:21:50.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.703+0000 7fb1f044fb80 20 client.26854 trim_cache size 0 max 16384 2023-12-11T20:21:50.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:50 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2426609089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:21:50.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.720+0000 7fb1f044fb80 1 Processor -- start 2023-12-11T20:21:50.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1f044fb80 1 -- start start 2023-12-11T20:21:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x563176192690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x563176185970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x563176185eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56317618a110 con 0x56317618ac20 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563176194370 con 0x5631761893d0 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631761a65c0 con 0x563176189d30 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1d6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x563176185eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1d6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x563176185eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45196/0 (socket says 172.21.15.12:45196) 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1d6d9d700 1 -- 172.21.15.12:0/3840794336 learned_addr learned my addr 172.21.15.12:0/3840794336 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.721+0000 7fb1d659c700 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x563176192690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x563176185970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1d6d9d700 1 -- 172.21.15.12:0/3840794336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 msgr2=0x563176185970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x563176185970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1d6d9d700 1 -- 172.21.15.12:0/3840794336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 msgr2=0x563176192690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x563176192690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1d6d9d700 1 -- 172.21.15.12:0/3840794336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563175f06de0 con 0x56317618ac20 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1d659c700 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x563176192690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x563176185eb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009dc0 tx=0x7fb1d0009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11d9073337e2d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1c57fa700 1 -- 172.21.15.12:0/3840794336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0023070 con 0x56317618ac20 2023-12-11T20:21:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1c57fa700 1 -- 172.21.15.12:0/3840794336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1d0006000 con 0x56317618ac20 2023-12-11T20:21:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.722+0000 7fb1c57fa700 1 -- 172.21.15.12:0/3840794336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0005840 con 0x56317618ac20 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3840794336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 msgr2=0x563176185eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x563176185eb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009dc0 tx=0x7fb1d0009640 comp rx=0 tx=0).stop 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3840794336 shutdown_connections 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x563176192690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56317618ac20 0x563176185eb0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/3840794336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563176189d30 0x563176185970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3840794336 >> 172.21.15.12:0/3840794336 conn(0x5631760b87e0 msgr2=0x56317618db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3840794336 shutdown_connections 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.723+0000 7fb1f044fb80 1 -- 172.21.15.12:0/3840794336 wait complete. 2023-12-11T20:21:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.724+0000 7fb1f044fb80 1 -- start start 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.724+0000 7fb1f044fb80 1 Processor -- start 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.724+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x5631761f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.724+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563176189d30 0x5631761f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1f044fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56317618ac20 0x5631761f8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631761f8d70 con 0x563176189d30 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631761f8eb0 con 0x5631761893d0 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1f044fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631761f9070 con 0x56317618ac20 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1f044fb80 10 client.0 _ll_register_callbacks cb 0x563175fc2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563176189d30 0x5631761f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563176189d30 0x5631761f1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45206/0 (socket says 172.21.15.12:45206) 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x5631761f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/964008538 learned_addr learned my addr 172.21.15.12:0/964008538 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d6d9d700 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56317618ac20 0x5631761f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/964008538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56317618ac20 msgr2=0x5631761f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56317618ac20 0x5631761f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/964008538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 msgr2=0x5631761f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x5631761f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d5d9b700 1 -- 172.21.15.12:0/964008538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d810a240 con 0x563176189d30 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.725+0000 7fb1d659c700 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x5631761f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1d5d9b700 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563176189d30 0x5631761f1c10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e970 tx=0x7fb1cc005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8313542ec7e7f16 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1bdffb700 1 -- 172.21.15.12:0/964008538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc09e600 con 0x563176189d30 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1bdffb700 1 -- 172.21.15.12:0/964008538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb1cc0a2840 con 0x563176189d30 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1f044fb80 1 -- 172.21.15.12:0/964008538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1d000f050 con 0x563176189d30 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1bdffb700 1 -- 172.21.15.12:0/964008538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1cc09e170 con 0x563176189d30 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1f044fb80 10 client.17169 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1f044fb80 1 -- 172.21.15.12:0/964008538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563175f5a630 con 0x563176189d30 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.726+0000 7fb1bdffb700 1 -- 172.21.15.12:0/964008538 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1cc0a6020 con 0x563176189d30 2023-12-11T20:21:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.727+0000 7fb1bdffb700 1 -- 172.21.15.12:0/964008538 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb1cc099410 con 0x563176189d30 2023-12-11T20:21:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.727+0000 7fb1f044fb80 10 client.17169 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.727+0000 7fb1f044fb80 10 client.17169 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:21:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.727+0000 7fb1f044fb80 20 client.17169 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.727+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5631761fa790 0x5631761fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.727+0000 7fb1f044fb80 4 client.17169 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:21:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.727+0000 7fb1f044fb80 1 -- 172.21.15.12:0/964008538 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5631760a3fd0 con 0x5631761fa790 2023-12-11T20:21:50.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.727+0000 7fb1d659c700 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5631761fa790 0x5631761fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1bdffb700 10 client.17169 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:21:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1d659c700 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5631761fa790 0x5631761fcbb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d65cac39631141 server_cookie=4d1277263a5038a3 in_seq=0 out_seq=0 2023-12-11T20:21:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1bdffb700 1 -- 172.21.15.12:0/964008538 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5631760a3fd0 con 0x5631761fa790 2023-12-11T20:21:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1bdffb700 10 client.17169 handle_command_reply: tid=0 2023-12-11T20:21:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 client.17169 shutdown 2023-12-11T20:21:50.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 -- 172.21.15.12:0/964008538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563176189d30 msgr2=0x5631761f1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563176189d30 0x5631761f1c10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e970 tx=0x7fb1cc005b40 comp rx=0 tx=0).stop 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 -- 172.21.15.12:0/964008538 shutdown_connections 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5631761fa790 0x5631761fcbb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5631761893d0 0x5631761f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56317618ac20 0x5631761f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 --2- 172.21.15.12:0/964008538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563176189d30 0x5631761f1c10 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1f044fb80 1 -- 172.21.15.12:0/964008538 >> 172.21.15.12:0/964008538 conn(0x5631760b87e0 msgr2=0x56317618db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.728+0000 7fb1bdffb700 0 client.17169 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1f044fb80 1 -- 172.21.15.12:0/964008538 shutdown_connections 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1f044fb80 1 -- 172.21.15.12:0/964008538 wait complete. 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1f044fb80 20 client.17169 trim_cache size 0 max 16384 2023-12-11T20:21:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:21:50.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 -- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb1c00a1480 msgr2=0x7fb1c00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb1c00a1480 0x7fb1c00a3940 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8006010 tx=0x7fb1c8003680 comp rx=0 tx=0).stop 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 -- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81026a0 msgr2=0x7fb1d8197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81026a0 0x7fb1d8197850 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e9a0 tx=0x7fb1cc00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 -- 172.21.15.12:0/2655209424 shutdown_connections 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb1c00a1480 0x7fb1c00a3940 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d81014b0 0x7fb1d8197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1d8103040 0x7fb1d819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 --2- 172.21.15.12:0/2655209424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1d81026a0 0x7fb1d8197850 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.729+0000 7fb1dcbff700 1 -- 172.21.15.12:0/2655209424 >> 172.21.15.12:0/2655209424 conn(0x7fb1d80fca00 msgr2=0x7fb1d8105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.730+0000 7fb1dcbff700 1 -- 172.21.15.12:0/2655209424 shutdown_connections 2023-12-11T20:21:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.730+0000 7fb1dcbff700 1 -- 172.21.15.12:0/2655209424 wait complete. 2023-12-11T20:21:50.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:21:50.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:50 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2426609089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.989+0000 7f00fc7ff700 1 -- 172.21.15.12:0/2980248724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 msgr2=0x7f00f41018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.989+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/2980248724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 0x7f00f41018d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f00f00099c0 tx=0x7f00f0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.989+0000 7f00fc7ff700 1 -- 172.21.15.12:0/2980248724 shutdown_connections 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.990+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/2980248724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00f4103040 0x7f00f41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.990+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/2980248724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 0x7f00f41018d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.990+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/2980248724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00f41026a0 0x7f00f4102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.990+0000 7f00fc7ff700 1 -- 172.21.15.12:0/2980248724 >> 172.21.15.12:0/2980248724 conn(0x7f00f40fca00 msgr2=0x7f00f40fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.990+0000 7f00fc7ff700 1 -- 172.21.15.12:0/2980248724 shutdown_connections 2023-12-11T20:21:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.990+0000 7f00fc7ff700 1 -- 172.21.15.12:0/2980248724 wait complete. 2023-12-11T20:21:50.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fc7ff700 1 Processor -- start 2023-12-11T20:21:50.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fc7ff700 1 -- start start 2023-12-11T20:21:50.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fc7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 0x7f00f41995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fc7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00f41026a0 0x7f00f4199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fc7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00f4103040 0x7f00f41a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fc7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41a10e0 con 0x7f00f41014b0 2023-12-11T20:21:50.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fc7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41a1220 con 0x7f00f41026a0 2023-12-11T20:21:50.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fc7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41a13b0 con 0x7f00f4103040 2023-12-11T20:21:50.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.991+0000 7f00fa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 0x7f00f41995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00f41026a0 0x7f00f4199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00f41026a0 0x7f00f4199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38776/0 (socket says 172.21.15.12:38776) 2023-12-11T20:21:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 -- 172.21.15.12:0/16531571 learned_addr learned my addr 172.21.15.12:0/16531571 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00fa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 0x7f00f41995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45226/0 (socket says 172.21.15.12:45226) 2023-12-11T20:21:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00fad9c700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00f4103040 0x7f00f41a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 -- 172.21.15.12:0/16531571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00f4103040 msgr2=0x7f00f41a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00f4103040 0x7f00f41a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 -- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 msgr2=0x7f00f41995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:50.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 0x7f00f41995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:50.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 -- 172.21.15.12:0/16531571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00095f0 con 0x7f00f41026a0 2023-12-11T20:21:50.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.992+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00f41026a0 0x7f00f4199af0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00e400e9a0 tx=0x7f00e400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.993+0000 7f00eb7fe700 1 -- 172.21.15.12:0/16531571 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4009790 con 0x7f00f41026a0 2023-12-11T20:21:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.993+0000 7f00fc7ff700 1 -- 172.21.15.12:0/16531571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f41a1690 con 0x7f00f41026a0 2023-12-11T20:21:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.993+0000 7f00eb7fe700 1 -- 172.21.15.12:0/16531571 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00e4010430 con 0x7f00f41026a0 2023-12-11T20:21:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.993+0000 7f00eb7fe700 1 -- 172.21.15.12:0/16531571 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e400cea0 con 0x7f00f41026a0 2023-12-11T20:21:50.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.993+0000 7f00fc7ff700 1 -- 172.21.15.12:0/16531571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f41a1ba0 con 0x7f00f41026a0 2023-12-11T20:21:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.997+0000 7f00eb7fe700 1 -- 172.21.15.12:0/16531571 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f00e40105a0 con 0x7f00f41026a0 2023-12-11T20:21:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.998+0000 7f0110044b80 1 Processor -- start 2023-12-11T20:21:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.998+0000 7f0110044b80 1 -- start start 2023-12-11T20:21:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.998+0000 7f0110044b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18db57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.998+0000 7f0110044b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db5d30 0x562e18db6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.998+0000 7f0110044b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18db70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.998+0000 7f0110044b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18d10b50 con 0x562e18db5d30 2023-12-11T20:21:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.998+0000 7f0110044b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18d0e470 con 0x562e18db53d0 2023-12-11T20:21:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.998+0000 7f0110044b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18d09d60 con 0x562e18db6c20 2023-12-11T20:21:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db5d30 0x562e18db6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db5d30 0x562e18db6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45240/0 (socket says 172.21.15.12:45240) 2023-12-11T20:21:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fad9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18db57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fa59b700 1 -- 172.21.15.12:0/1465290468 learned_addr learned my addr 172.21.15.12:0/1465290468 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18db70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00eb7fe700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00e00a1480 0x7f00e00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fa59b700 1 -- 172.21.15.12:0/1465290468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 msgr2=0x562e18db70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18db70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fa59b700 1 -- 172.21.15.12:0/1465290468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 msgr2=0x562e18db57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:51.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18db57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fa59b700 1 -- 172.21.15.12:0/1465290468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e18b86630 con 0x562e18db5d30 2023-12-11T20:21:51.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18db70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:51.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00eb7fe700 1 -- 172.21.15.12:0/16531571 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f00e4014070 con 0x7f00f41026a0 2023-12-11T20:21:51.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:50.999+0000 7f00fad9c700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00e00a1480 0x7f00e00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.000+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db5d30 0x562e18db6640 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f00f000b580 tx=0x7f00f0005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb52695891e777f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.000+0000 7f00e8ff9700 1 -- 172.21.15.12:0/1465290468 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000ba90 con 0x562e18db5d30 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.000+0000 7f00e8ff9700 1 -- 172.21.15.12:0/1465290468 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00f001e040 con 0x562e18db5d30 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.000+0000 7f00e8ff9700 1 -- 172.21.15.12:0/1465290468 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0003b90 con 0x562e18db5d30 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 -- 172.21.15.12:0/1465290468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db5d30 msgr2=0x562e18db6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f00fad9c700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00e00a1480 0x7f00e00a3940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009980 tx=0x7f00ec004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db5d30 0x562e18db6640 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f00f000b580 tx=0x7f00f0005bc0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 -- 172.21.15.12:0/1465290468 shutdown_connections 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18db57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18db70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 --2- 172.21.15.12:0/1465290468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db5d30 0x562e18db6640 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 -- 172.21.15.12:0/1465290468 >> 172.21.15.12:0/1465290468 conn(0x562e18ce47e0 msgr2=0x562e18db1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 -- 172.21.15.12:0/1465290468 shutdown_connections 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 -- 172.21.15.12:0/1465290468 wait complete. 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.001+0000 7f0110044b80 1 -- start start 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.002+0000 7f0110044b80 1 Processor -- start 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.002+0000 7f0110044b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18dbf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.002+0000 7f0110044b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dbf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.002+0000 7f0110044b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db6c20 0x562e18dc66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.002+0000 7f0110044b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18cc3560 con 0x562e18db6c20 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.002+0000 7f0110044b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18cc3200 con 0x562e18db53d0 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.002+0000 7f0110044b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18b88920 con 0x562e18db5d30 2023-12-11T20:21:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.002+0000 7f0110044b80 10 client.0 _ll_register_callbacks cb 0x562e18beea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:51.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db6c20 0x562e18dc66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db6c20 0x562e18dc66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45254/0 (socket says 172.21.15.12:45254) 2023-12-11T20:21:51.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fad9c700 1 -- 172.21.15.12:0/1297029694 learned_addr learned my addr 172.21.15.12:0/1297029694 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:51.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18dbf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dbf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fad9c700 1 -- 172.21.15.12:0/1297029694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 msgr2=0x562e18dbf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:51.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fad9c700 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dbf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fad9c700 1 -- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 msgr2=0x562e18dbf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fad9c700 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18dbf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fad9c700 1 -- 172.21.15.12:0/1297029694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f410a240 con 0x562e18db6c20 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.003+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18dbf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f00fad9c700 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db6c20 0x562e18dc66c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f00ec017950 tx=0x7f00ec009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2acc681af88fe1c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f00ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f00ddffb700 1 -- 172.21.15.12:0/1297029694 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec028070 con 0x562e18db6c20 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f0110044b80 1 -- 172.21.15.12:0/1297029694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e18da8b40 con 0x562e18db6c20 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f00ddffb700 1 -- 172.21.15.12:0/1297029694 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f00ec01c070 con 0x562e18db6c20 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f00ddffb700 1 -- 172.21.15.12:0/1297029694 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00ec016790 con 0x562e18db6c20 2023-12-11T20:21:51.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f0110044b80 10 client.17181 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f0110044b80 1 -- 172.21.15.12:0/1297029694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562e18b32de0 con 0x562e18db6c20 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.004+0000 7f00ddffb700 1 -- 172.21.15.12:0/1297029694 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00ec032020 con 0x562e18db6c20 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.005+0000 7f00ddffb700 1 -- 172.21.15.12:0/1297029694 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f00ec02b030 con 0x562e18db6c20 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.005+0000 7f0110044b80 10 client.17181 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.005+0000 7f0110044b80 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.005+0000 7f0110044b80 20 client.17181 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.005+0000 7f0110044b80 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562e18dcafb0 0x562e18dcd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.005+0000 7f0110044b80 4 client.17181 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.005+0000 7f0110044b80 1 -- 172.21.15.12:0/1297029694 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e18d84f40 con 0x562e18dcafb0 2023-12-11T20:21:51.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.006+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562e18dcafb0 0x562e18dcd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.006+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562e18dcafb0 0x562e18dcd3f0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b8f70381de520d2 server_cookie=ead53e8980a83343 in_seq=0 out_seq=0 2023-12-11T20:21:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.006+0000 7f00ddffb700 10 client.17181 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f00ddffb700 1 -- 172.21.15.12:0/1297029694 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562e18d84f40 con 0x562e18dcafb0 2023-12-11T20:21:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f00ddffb700 10 client.17181 handle_command_reply: tid=0 2023-12-11T20:21:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 client.17181 shutdown 2023-12-11T20:21:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 -- 172.21.15.12:0/1297029694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db6c20 msgr2=0x562e18dc66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db6c20 0x562e18dc66c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f00ec017950 tx=0x7f00ec009100 comp rx=0 tx=0).stop 2023-12-11T20:21:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 -- 172.21.15.12:0/1297029694 shutdown_connections 2023-12-11T20:21:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562e18dcafb0 0x562e18dcd3f0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db53d0 0x562e18dbf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db6c20 0x562e18dc66c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 --2- 172.21.15.12:0/1297029694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dbf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.007+0000 7f0110044b80 1 -- 172.21.15.12:0/1297029694 >> 172.21.15.12:0/1297029694 conn(0x562e18ce47e0 msgr2=0x562e18db0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.008+0000 7f00ddffb700 0 client.17181 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.008+0000 7f0110044b80 1 -- 172.21.15.12:0/1297029694 shutdown_connections 2023-12-11T20:21:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.008+0000 7f0110044b80 1 -- 172.21.15.12:0/1297029694 wait complete. 2023-12-11T20:21:51.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.008+0000 7f0110044b80 20 client.17181 trim_cache size 0 max 16384 2023-12-11T20:21:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.025+0000 7f0110044b80 1 Processor -- start 2023-12-11T20:21:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f0110044b80 1 -- start start 2023-12-11T20:21:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f0110044b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dbe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f0110044b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dc65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f0110044b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db6c20 0x562e18dbde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f0110044b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18dbdc30 con 0x562e18db53d0 2023-12-11T20:21:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f0110044b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18dd2650 con 0x562e18db6c20 2023-12-11T20:21:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f0110044b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18dbfdf0 con 0x562e18db5d30 2023-12-11T20:21:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f00fa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dbe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f00fa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dbe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45260/0 (socket says 172.21.15.12:45260) 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f00f9d9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dc65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f00fa59b700 1 -- 172.21.15.12:0/3311759310 learned_addr learned my addr 172.21.15.12:0/3311759310 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.026+0000 7f00fad9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db6c20 0x562e18dbde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00f9d9a700 1 -- 172.21.15.12:0/3311759310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db6c20 msgr2=0x562e18dbde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/3311759310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db6c20 0x562e18dbde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00f9d9a700 1 -- 172.21.15.12:0/3311759310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 msgr2=0x562e18dbe650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/3311759310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dbe650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00f9d9a700 1 -- 172.21.15.12:0/3311759310 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e18b1bc60 con 0x562e18db5d30 2023-12-11T20:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00fa59b700 1 --2- 172.21.15.12:0/3311759310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dbe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/3311759310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dc65e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00e40966e0 tx=0x7f00e4096650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a394bb0c65fc0f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00e97fa700 1 -- 172.21.15.12:0/3311759310 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e409e160 con 0x562e18db5d30 2023-12-11T20:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00e97fa700 1 -- 172.21.15.12:0/3311759310 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00e4010880 con 0x562e18db5d30 2023-12-11T20:21:51.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.027+0000 7f00e97fa700 1 -- 172.21.15.12:0/3311759310 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4098660 con 0x562e18db5d30 2023-12-11T20:21:51.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 -- 172.21.15.12:0/3311759310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 msgr2=0x562e18dc65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:51.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 --2- 172.21.15.12:0/3311759310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dc65e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00e40966e0 tx=0x7f00e4096650 comp rx=0 tx=0).stop 2023-12-11T20:21:51.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 -- 172.21.15.12:0/3311759310 shutdown_connections 2023-12-11T20:21:51.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 --2- 172.21.15.12:0/3311759310 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db6c20 0x562e18dbde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 --2- 172.21.15.12:0/3311759310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dbe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 --2- 172.21.15.12:0/3311759310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db5d30 0x562e18dc65e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 -- 172.21.15.12:0/3311759310 >> 172.21.15.12:0/3311759310 conn(0x562e18ce47e0 msgr2=0x562e18dbd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 -- 172.21.15.12:0/3311759310 shutdown_connections 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.028+0000 7f0110044b80 1 -- 172.21.15.12:0/3311759310 wait complete. 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.029+0000 7f0110044b80 1 -- start start 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.029+0000 7f0110044b80 1 Processor -- start 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.029+0000 7f0110044b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dc4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.029+0000 7f0110044b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db5d30 0x562e18dc4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f0110044b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18dc5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f0110044b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18dc5f90 con 0x562e18db53d0 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f0110044b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18dc6100 con 0x562e18db5d30 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f0110044b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e18dc62c0 con 0x562e18db6c20 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f0110044b80 10 client.0 _ll_register_callbacks cb 0x562e18beea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:51.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dc4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dc4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45262/0 (socket says 172.21.15.12:45262) 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fa59b700 1 -- 172.21.15.12:0/1951842963 learned_addr learned my addr 172.21.15.12:0/1951842963 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db5d30 0x562e18dc4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fad9c700 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18dc5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fa59b700 1 -- 172.21.15.12:0/1951842963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 msgr2=0x562e18dc5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18dc5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fa59b700 1 -- 172.21.15.12:0/1951842963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db5d30 msgr2=0x562e18dc4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db5d30 0x562e18dc4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.030+0000 7f00fa59b700 1 -- 172.21.15.12:0/1951842963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e18b86630 con 0x562e18db53d0 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.031+0000 7f00fa59b700 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dc4500 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f00f0005f50 tx=0x7f00f0005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1553c0f40968fa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.031+0000 7f00ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.031+0000 7f00ddffb700 1 -- 172.21.15.12:0/1951842963 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0003d10 con 0x562e18db53d0 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.031+0000 7f0110044b80 1 -- 172.21.15.12:0/1951842963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00f001e040 con 0x562e18db53d0 2023-12-11T20:21:51.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.031+0000 7f00ddffb700 1 -- 172.21.15.12:0/1951842963 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f00f00050d0 con 0x562e18db53d0 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.031+0000 7f00ddffb700 1 -- 172.21.15.12:0/1951842963 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00f0009290 con 0x562e18db53d0 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.031+0000 7f0110044b80 10 client.17187 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.031+0000 7f0110044b80 1 -- 172.21.15.12:0/1951842963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f00e40ce040 con 0x562e18db53d0 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f00ddffb700 1 -- 172.21.15.12:0/1951842963 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00f003f080 con 0x562e18db53d0 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f00ddffb700 1 -- 172.21.15.12:0/1951842963 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f00f00304b0 con 0x562e18db53d0 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f0110044b80 10 client.17187 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f0110044b80 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f0110044b80 20 client.17187 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f0110044b80 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562e18e22120 0x562e18e24540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f0110044b80 4 client.17187 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f0110044b80 1 -- 172.21.15.12:0/1951842963 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562e18ccffd0 con 0x562e18e22120 2023-12-11T20:21:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.032+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562e18e22120 0x562e18e24540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f00ddffb700 10 client.17187 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f00f9d9a700 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562e18e22120 0x562e18e24540 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3ea9b296f398a2d server_cookie=627d7d252f51c8f7 in_seq=0 out_seq=0 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f00ddffb700 1 -- 172.21.15.12:0/1951842963 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562e18ccffd0 con 0x562e18e22120 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f00ddffb700 10 client.17187 handle_command_reply: tid=0 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 client.17187 shutdown 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 -- 172.21.15.12:0/1951842963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 msgr2=0x562e18dc4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dc4500 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f00f0005f50 tx=0x7f00f0005cb0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 -- 172.21.15.12:0/1951842963 shutdown_connections 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562e18e22120 0x562e18e24540 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e18db6c20 0x562e18dc5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e18db53d0 0x562e18dc4500 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 --2- 172.21.15.12:0/1951842963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562e18db5d30 0x562e18dc4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.033+0000 7f0110044b80 1 -- 172.21.15.12:0/1951842963 >> 172.21.15.12:0/1951842963 conn(0x562e18ce47e0 msgr2=0x562e18dbde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.034+0000 7f00ddffb700 0 client.17187 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:51.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.034+0000 7f0110044b80 1 -- 172.21.15.12:0/1951842963 shutdown_connections 2023-12-11T20:21:51.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.034+0000 7f0110044b80 1 -- 172.21.15.12:0/1951842963 wait complete. 2023-12-11T20:21:51.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.034+0000 7f0110044b80 20 client.17187 trim_cache size 0 max 16384 2023-12-11T20:21:51.036 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.034+0000 7f00fc7ff700 1 -- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00e00a1480 msgr2=0x7f00e00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.034+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00e00a1480 0x7f00e00a3940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009980 tx=0x7f00ec004ad0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.034+0000 7f00fc7ff700 1 -- 172.21.15.12:0/16531571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00f41026a0 msgr2=0x7f00f4199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.034+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00f41026a0 0x7f00f4199af0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00e400e9a0 tx=0x7f00e400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.035+0000 7f00fc7ff700 1 -- 172.21.15.12:0/16531571 shutdown_connections 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.035+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f00e00a1480 0x7f00e00a3940 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.035+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00f4103040 0x7f00f41a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.035+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00f41014b0 0x7f00f41995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.035+0000 7f00fc7ff700 1 --2- 172.21.15.12:0/16531571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00f41026a0 0x7f00f4199af0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.035+0000 7f00fc7ff700 1 -- 172.21.15.12:0/16531571 >> 172.21.15.12:0/16531571 conn(0x7f00f40fca00 msgr2=0x7f00f4107fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.035+0000 7f00fc7ff700 1 -- 172.21.15.12:0/16531571 shutdown_connections 2023-12-11T20:21:51.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:51.035+0000 7f00fc7ff700 1 -- 172.21.15.12:0/16531571 wait complete. 2023-12-11T20:21:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:51 smithi032 ceph-mon[132488]: pgmap v553: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:21:51.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:51 smithi039 ceph-mon[102205]: pgmap v553: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:21:51.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:51 smithi012 ceph-mon[128787]: pgmap v553: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:21:52.054 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:21:52.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.287+0000 7fd9fd79d700 1 -- 172.21.15.12:0/1451314897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8102e80 msgr2=0x7fd9f8109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.287+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/1451314897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8102e80 0x7fd9f8109730 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000b0d0 tx=0x7fd9f000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.287+0000 7fd9fd79d700 1 -- 172.21.15.12:0/1451314897 shutdown_connections 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.287+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/1451314897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f81012f0 0x7fd9f8101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.287+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/1451314897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8102e80 0x7fd9f8109730 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.287+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/1451314897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f81024e0 0x7fd9f8102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.287+0000 7fd9fd79d700 1 -- 172.21.15.12:0/1451314897 >> 172.21.15.12:0/1451314897 conn(0x7fd9f80fc860 msgr2=0x7fd9f80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.288+0000 7fd9fd79d700 1 -- 172.21.15.12:0/1451314897 shutdown_connections 2023-12-11T20:21:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.288+0000 7fd9fd79d700 1 -- 172.21.15.12:0/1451314897 wait complete. 2023-12-11T20:21:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9fd79d700 1 Processor -- start 2023-12-11T20:21:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9fd79d700 1 -- start start 2023-12-11T20:21:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9fd79d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f81012f0 0x7fd9f81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9fd79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f81024e0 0x7fd9f81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9fd79d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f8102e80 0x7fd9f81a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9fd79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f81a0ee0 con 0x7fd9f81024e0 2023-12-11T20:21:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9fd79d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f81a1020 con 0x7fd9f81012f0 2023-12-11T20:21:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9fd79d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f81a11b0 con 0x7fd9f8102e80 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f81024e0 0x7fd9f81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.289+0000 7fd9f7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f81012f0 0x7fd9f81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f81024e0 0x7fd9f81998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45284/0 (socket says 172.21.15.12:45284) 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9f7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f81012f0 0x7fd9f81993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38838/0 (socket says 172.21.15.12:38838) 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9f77fe700 1 -- 172.21.15.12:0/3813205007 learned_addr learned my addr 172.21.15.12:0/3813205007 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9fcf9c700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f8102e80 0x7fd9f81a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9fcf9c700 1 -- 172.21.15.12:0/3813205007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f81012f0 msgr2=0x7fd9f81993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9fcf9c700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f81012f0 0x7fd9f81993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9fcf9c700 1 -- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f81024e0 msgr2=0x7fd9f81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9fcf9c700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f81024e0 0x7fd9f81998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9fcf9c700 1 -- 172.21.15.12:0/3813205007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0009d00 con 0x7fd9f8102e80 2023-12-11T20:21:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.290+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f81024e0 0x7fd9f81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.291+0000 7fd9fcf9c700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f8102e80 0x7fd9f81a0910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0007b60 tx=0x7fd9f0009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.291+0000 7fd9f57fa700 1 -- 172.21.15.12:0/3813205007 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000e040 con 0x7fd9f8102e80 2023-12-11T20:21:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.291+0000 7fd9f57fa700 1 -- 172.21.15.12:0/3813205007 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9f0003e10 con 0x7fd9f8102e80 2023-12-11T20:21:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.291+0000 7fd9f57fa700 1 -- 172.21.15.12:0/3813205007 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f001c8c0 con 0x7fd9f8102e80 2023-12-11T20:21:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.291+0000 7fd9fd79d700 1 -- 172.21.15.12:0/3813205007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f81a1430 con 0x7fd9f8102e80 2023-12-11T20:21:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.291+0000 7fd9fd79d700 1 -- 172.21.15.12:0/3813205007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f81a1800 con 0x7fd9f8102e80 2023-12-11T20:21:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.295+0000 7fd9f57fa700 1 -- 172.21.15.12:0/3813205007 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd9f0005690 con 0x7fd9f8102e80 2023-12-11T20:21:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.296+0000 7fda123cfb80 1 Processor -- start 2023-12-11T20:21:52.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.296+0000 7fda123cfb80 1 -- start start 2023-12-11T20:21:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.296+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a148804f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.296+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a148805920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.296+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 0x55a1488062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.296+0000 7fda123cfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14875fbd0 con 0x55a148804ae0 2023-12-11T20:21:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.296+0000 7fda123cfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14875d4f0 con 0x55a148805e60 2023-12-11T20:21:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.296+0000 7fda123cfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a148758de0 con 0x55a148805440 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a148804f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a148804f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45300/0 (socket says 172.21.15.12:45300) 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 -- 172.21.15.12:0/1207590129 learned_addr learned my addr 172.21.15.12:0/1207590129 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a148805920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 0x55a1488062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 -- 172.21.15.12:0/1207590129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 msgr2=0x55a148805920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a148805920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 -- 172.21.15.12:0/1207590129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 msgr2=0x55a1488062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 0x55a1488062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 -- 172.21.15.12:0/1207590129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1485d56b0 con 0x55a148804ae0 2023-12-11T20:21:52.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.297+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a148804f00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec012b30 tx=0x7fd9ec00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3d2448333f5e24 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.298+0000 7fd9f57fa700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15a0 0x7fd9e00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.298+0000 7fd9de7fc700 1 -- 172.21.15.12:0/1207590129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec004030 con 0x55a148804ae0 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.298+0000 7fd9de7fc700 1 -- 172.21.15.12:0/1207590129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9ec004830 con 0x55a148804ae0 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.298+0000 7fd9de7fc700 1 -- 172.21.15.12:0/1207590129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec005290 con 0x55a148804ae0 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.298+0000 7fd9f57fa700 1 -- 172.21.15.12:0/3813205007 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd9f00cdbe0 con 0x7fd9f8102e80 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.298+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15a0 0x7fd9e00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.298+0000 7fda123cfb80 1 -- 172.21.15.12:0/1207590129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 msgr2=0x55a148804f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.298+0000 7fda123cfb80 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a148804f00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec012b30 tx=0x7fd9ec00bda0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15a0 0x7fd9e00a3a60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8102340 tx=0x7fd9e8007400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fda123cfb80 1 -- 172.21.15.12:0/1207590129 shutdown_connections 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fda123cfb80 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 0x55a1488062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fda123cfb80 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a148804f00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fda123cfb80 1 --2- 172.21.15.12:0/1207590129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a148805920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fda123cfb80 1 -- 172.21.15.12:0/1207590129 >> 172.21.15.12:0/1207590129 conn(0x55a148733860 msgr2=0x55a1487ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fda123cfb80 1 -- 172.21.15.12:0/1207590129 shutdown_connections 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fda123cfb80 1 -- 172.21.15.12:0/1207590129 wait complete. 2023-12-11T20:21:52.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.299+0000 7fda123cfb80 1 -- start start 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fda123cfb80 1 Processor -- start 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a14880e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a14880e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 0x55a1488158e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fda123cfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1487125e0 con 0x55a148804ae0 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fda123cfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a148712280 con 0x55a148805e60 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fda123cfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1485d79a0 con 0x55a148805440 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fda123cfb80 10 client.0 _ll_register_callbacks cb 0x55a14863db00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fd9f7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a14880e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fd9f7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a14880e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45314/0 (socket says 172.21.15.12:45314) 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fd9f7fff700 1 -- 172.21.15.12:0/2128963959 learned_addr learned my addr 172.21.15.12:0/2128963959 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.300+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a14880e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9fcf9c700 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 0x55a1488158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9f77fe700 1 -- 172.21.15.12:0/2128963959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 msgr2=0x55a1488158e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 0x55a1488158e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9f77fe700 1 -- 172.21.15.12:0/2128963959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 msgr2=0x55a14880e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a14880e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9f77fe700 1 -- 172.21.15.12:0/2128963959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec0126c0 con 0x55a148805440 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a14880e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a14880e8a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0046e0 tx=0x7fd9ec005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a23fba4f85f914 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.301+0000 7fd9d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.302+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2128963959 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec0054a0 con 0x55a148805440 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.302+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2128963959 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd9ec012e40 con 0x55a148805440 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.302+0000 7fda123cfb80 1 -- 172.21.15.12:0/2128963959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1487f7a60 con 0x55a148805440 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.302+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2128963959 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9ec005600 con 0x55a148805440 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.302+0000 7fda123cfb80 10 client.26890 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.302+0000 7fda123cfb80 1 -- 172.21.15.12:0/2128963959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a148581e60 con 0x55a148805440 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.302+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2128963959 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a1487f7a60 con 0x55a148805440 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.303+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2128963959 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd9ec028060 con 0x55a148805440 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.303+0000 7fda123cfb80 10 client.26890 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.303+0000 7fda123cfb80 10 client.26890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:52.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.303+0000 7fda123cfb80 20 client.26890 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.303+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a14881a120 0x55a14881c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.303+0000 7fda123cfb80 4 client.26890 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.303+0000 7fda123cfb80 1 -- 172.21.15.12:0/2128963959 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1487d3fc0 con 0x55a14881a120 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.303+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a14881a120 0x55a14881c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.304+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a14881a120 0x55a14881c540 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5158f26007f2da2 server_cookie=1e1d92c156a5d0fa in_seq=0 out_seq=0 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.304+0000 7fd9d77fe700 10 client.26890 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2128963959 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a1487d3fc0 con 0x55a14881a120 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fd9d77fe700 10 client.26890 handle_command_reply: tid=0 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 client.26890 shutdown 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 -- 172.21.15.12:0/2128963959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 msgr2=0x55a14880e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a14880e8a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0046e0 tx=0x7fd9ec005a00 comp rx=0 tx=0).stop 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 -- 172.21.15.12:0/2128963959 shutdown_connections 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a14881a120 0x55a14881c540 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148805e60 0x55a1488158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148804ae0 0x55a14880e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fd9d77fe700 0 client.26890 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2128963959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a14880e8a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 -- 172.21.15.12:0/2128963959 >> 172.21.15.12:0/2128963959 conn(0x55a148733860 msgr2=0x55a1488038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 -- 172.21.15.12:0/2128963959 shutdown_connections 2023-12-11T20:21:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 1 -- 172.21.15.12:0/2128963959 wait complete. 2023-12-11T20:21:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.305+0000 7fda123cfb80 20 client.26890 trim_cache size 0 max 16384 2023-12-11T20:21:52.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.325+0000 7fda123cfb80 1 Processor -- start 2023-12-11T20:21:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.325+0000 7fda123cfb80 1 -- start start 2023-12-11T20:21:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a14880e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805440 0x55a14880e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805e60 0x55a1488158a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fda123cfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14880d340 con 0x55a148805440 2023-12-11T20:21:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fda123cfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a148800770 con 0x55a148804ae0 2023-12-11T20:21:52.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fda123cfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1487fb900 con 0x55a148805e60 2023-12-11T20:21:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805440 0x55a14880e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805440 0x55a14880e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45316/0 (socket says 172.21.15.12:45316) 2023-12-11T20:21:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f77fe700 1 -- 172.21.15.12:0/3491282909 learned_addr learned my addr 172.21.15.12:0/3491282909 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9fcf9c700 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805e60 0x55a1488158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a14880e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f77fe700 1 -- 172.21.15.12:0/3491282909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805e60 msgr2=0x55a1488158a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805e60 0x55a1488158a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f77fe700 1 -- 172.21.15.12:0/3491282909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 msgr2=0x55a14880e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a14880e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f77fe700 1 -- 172.21.15.12:0/3491282909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a14856ace0 con 0x55a148805440 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.326+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a14880e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.327+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805440 0x55a14880e880 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00e630 tx=0x7fd9ec00bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf5c55519089935 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.327+0000 7fd9deffd700 1 -- 172.21.15.12:0/3491282909 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec0052a0 con 0x55a148805440 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.327+0000 7fd9deffd700 1 -- 172.21.15.12:0/3491282909 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9ec00e6e0 con 0x55a148805440 2023-12-11T20:21:52.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.327+0000 7fd9deffd700 1 -- 172.21.15.12:0/3491282909 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec010880 con 0x55a148805440 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 -- 172.21.15.12:0/3491282909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805440 msgr2=0x55a14880e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805440 0x55a14880e880 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00e630 tx=0x7fd9ec00bc10 comp rx=0 tx=0).stop 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 -- 172.21.15.12:0/3491282909 shutdown_connections 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a14880e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805e60 0x55a1488158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 --2- 172.21.15.12:0/3491282909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805440 0x55a14880e880 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 -- 172.21.15.12:0/3491282909 >> 172.21.15.12:0/3491282909 conn(0x55a148733860 msgr2=0x55a148820ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 -- 172.21.15.12:0/3491282909 shutdown_connections 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 -- 172.21.15.12:0/3491282909 wait complete. 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.328+0000 7fda123cfb80 1 -- start start 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.329+0000 7fda123cfb80 1 Processor -- start 2023-12-11T20:21:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.329+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a148815400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.329+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a148813a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.329+0000 7fda123cfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805e60 0x55a148813fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.329+0000 7fda123cfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a148815c20 con 0x55a148805e60 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.329+0000 7fda123cfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1488144e0 con 0x55a148804ae0 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.329+0000 7fda123cfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a148814650 con 0x55a148805440 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fda123cfb80 10 client.0 _ll_register_callbacks cb 0x55a14863db00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a148815400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a148815400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38860/0 (socket says 172.21.15.12:38860) 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f7fff700 1 -- 172.21.15.12:0/2136484320 learned_addr learned my addr 172.21.15.12:0/2136484320 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a148813a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9fcf9c700 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805e60 0x55a148813fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f7fff700 1 -- 172.21.15.12:0/2136484320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 msgr2=0x55a148813a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a148813a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f7fff700 1 -- 172.21.15.12:0/2136484320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805e60 msgr2=0x55a148813fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805e60 0x55a148813fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.330+0000 7fd9f7fff700 1 -- 172.21.15.12:0/2136484320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a148581e60 con 0x55a148804ae0 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fd9f7fff700 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a148815400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8011ab0 tx=0x7fd9e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56aeb3cdf483c30f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fd9d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2136484320 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8024040 con 0x55a148804ae0 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2136484320 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd9e801ed80 con 0x55a148804ae0 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fda123cfb80 1 -- 172.21.15.12:0/2136484320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9ec004830 con 0x55a148804ae0 2023-12-11T20:21:52.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2136484320 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9e8016070 con 0x55a148804ae0 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fda123cfb80 10 client.26903 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fda123cfb80 1 -- 172.21.15.12:0/2136484320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a1485a82d0 con 0x55a148804ae0 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.331+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2136484320 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9ec004830 con 0x55a148804ae0 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.332+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2136484320 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd9e8003680 con 0x55a148804ae0 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.332+0000 7fda123cfb80 10 client.26903 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.332+0000 7fda123cfb80 10 client.26903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.332+0000 7fda123cfb80 20 client.26903 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.332+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a148871ca0 0x55a1488740c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.332+0000 7fda123cfb80 4 client.26903 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.332+0000 7fda123cfb80 1 -- 172.21.15.12:0/2136484320 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a14871f050 con 0x55a148871ca0 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.332+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a148871ca0 0x55a1488740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.333+0000 7fd9f77fe700 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a148871ca0 0x55a1488740c0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=755138ddf995cac1 server_cookie=a51b23711cfdc836 in_seq=0 out_seq=0 2023-12-11T20:21:52.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.333+0000 7fd9d77fe700 10 client.26903 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:52.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fd9d77fe700 1 -- 172.21.15.12:0/2136484320 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a14871f050 con 0x55a148871ca0 2023-12-11T20:21:52.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fd9d77fe700 10 client.26903 handle_command_reply: tid=0 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 client.26903 shutdown 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 -- 172.21.15.12:0/2136484320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 msgr2=0x55a148815400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a148815400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8011ab0 tx=0x7fd9e8004750 comp rx=0 tx=0).stop 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 -- 172.21.15.12:0/2136484320 shutdown_connections 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a148871ca0 0x55a1488740c0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a148804ae0 0x55a148815400 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a148805e60 0x55a148813fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 --2- 172.21.15.12:0/2136484320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a148805440 0x55a148813a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fd9d77fe700 0 client.26903 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.334+0000 7fda123cfb80 1 -- 172.21.15.12:0/2136484320 >> 172.21.15.12:0/2136484320 conn(0x55a148733860 msgr2=0x55a14880e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fda123cfb80 1 -- 172.21.15.12:0/2136484320 shutdown_connections 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fda123cfb80 1 -- 172.21.15.12:0/2136484320 wait complete. 2023-12-11T20:21:52.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fda123cfb80 20 client.26903 trim_cache size 0 max 16384 2023-12-11T20:21:52.335 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:21:52.335 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:21:52.335 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "cb8a5c4f-02bf-4dd7-8e83-b5c528870f98", 2023-12-11T20:21:52.335 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:21:52.335 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fd9fd79d700 1 -- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15a0 msgr2=0x7fd9e00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15a0 0x7fd9e00a3a60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8102340 tx=0x7fd9e8007400 comp rx=0 tx=0).stop 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fd9fd79d700 1 -- 172.21.15.12:0/3813205007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f8102e80 msgr2=0x7fd9f81a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f8102e80 0x7fd9f81a0910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0007b60 tx=0x7fd9f0009440 comp rx=0 tx=0).stop 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fd9fd79d700 1 -- 172.21.15.12:0/3813205007 shutdown_connections 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.335+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd9e00a15a0 0x7fd9e00a3a60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.336+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9f81012f0 0x7fd9f81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.336+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9f8102e80 0x7fd9f81a0910 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.336+0000 7fd9fd79d700 1 --2- 172.21.15.12:0/3813205007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f81024e0 0x7fd9f81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.336+0000 7fd9fd79d700 1 -- 172.21.15.12:0/3813205007 >> 172.21.15.12:0/3813205007 conn(0x7fd9f80fc860 msgr2=0x7fd9f8073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.336+0000 7fd9fd79d700 1 -- 172.21.15.12:0/3813205007 shutdown_connections 2023-12-11T20:21:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.336+0000 7fd9fd79d700 1 -- 172.21.15.12:0/3813205007 wait complete. 2023-12-11T20:21:52.356 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:21:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 -- 172.21.15.12:0/1450575672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c00105280 msgr2=0x7f4c0010bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1450575672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c00105280 0x7f4c0010bb30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800b0d0 tx=0x7f4bf800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 -- 172.21.15.12:0/1450575672 shutdown_connections 2023-12-11T20:21:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1450575672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c001036f0 0x7f4c00103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1450575672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c00105280 0x7f4c0010bb30 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1450575672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c001048e0 0x7f4c00104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 -- 172.21.15.12:0/1450575672 >> 172.21.15.12:0/1450575672 conn(0x7f4c000fec80 msgr2=0x7f4c001010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 -- 172.21.15.12:0/1450575672 shutdown_connections 2023-12-11T20:21:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.596+0000 7f4c049ff700 1 -- 172.21.15.12:0/1450575672 wait complete. 2023-12-11T20:21:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.597+0000 7f4c049ff700 1 Processor -- start 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4c049ff700 1 -- start start 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4c049ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c001036f0 0x7f4c00199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4c049ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c001048e0 0x7f4c00199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4c049ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c00105280 0x7f4c001a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4c049ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001a1140 con 0x7f4c001048e0 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4c049ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001a1280 con 0x7f4c00105280 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4c049ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001a1410 con 0x7f4c001036f0 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c001048e0 0x7f4c00199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4bfe59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c001036f0 0x7f4c00199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c001048e0 0x7f4c00199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45344/0 (socket says 172.21.15.12:45344) 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4bf7fff700 1 -- 172.21.15.12:0/1595625181 learned_addr learned my addr 172.21.15.12:0/1595625181 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.598+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c00105280 0x7f4c001a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf7fff700 1 -- 172.21.15.12:0/1595625181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c001036f0 msgr2=0x7f4c00199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c001036f0 0x7f4c00199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf7fff700 1 -- 172.21.15.12:0/1595625181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c00105280 msgr2=0x7f4c001a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c00105280 0x7f4c001a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf7fff700 1 -- 172.21.15.12:0/1595625181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8009d00 con 0x7f4c001048e0 2023-12-11T20:21:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c001048e0 0x7f4c00199b50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4be800e9a0 tx=0x7f4be800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf77fe700 1 -- 172.21.15.12:0/1595625181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8009790 con 0x7f4c001048e0 2023-12-11T20:21:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4c049ff700 1 -- 172.21.15.12:0/1595625181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c001a16f0 con 0x7f4c001048e0 2023-12-11T20:21:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf77fe700 1 -- 172.21.15.12:0/1595625181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4be8010430 con 0x7f4c001048e0 2023-12-11T20:21:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4bf77fe700 1 -- 172.21.15.12:0/1595625181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be800cea0 con 0x7f4c001048e0 2023-12-11T20:21:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.599+0000 7f4c049ff700 1 -- 172.21.15.12:0/1595625181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c001a1c00 con 0x7f4c001048e0 2023-12-11T20:21:52.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.604+0000 7f4bf77fe700 1 -- 172.21.15.12:0/1595625181 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4be80105a0 con 0x7f4c001048e0 2023-12-11T20:21:52.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.605+0000 7f4c182a9b80 1 Processor -- start 2023-12-11T20:21:52.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.605+0000 7f4c182a9b80 1 -- start start 2023-12-11T20:21:52.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b45640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132a9fb50 con 0x559132b44d30 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132a9d470 con 0x559132b45c20 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132a98d60 con 0x559132b443d0 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4bfed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4bfe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b45640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4bf77fe700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4bec0a1480 0x7f4bec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4bfed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:36284/0 (socket says 172.21.15.12:36284) 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4bfed9d700 1 -- 172.21.15.12:0/2398738363 learned_addr learned my addr 172.21.15.12:0/2398738363 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4bf77fe700 1 -- 172.21.15.12:0/1595625181 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4be8014070 con 0x7f4c001048e0 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.606+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bfe59c700 1 -- 172.21.15.12:0/2398738363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 msgr2=0x559132b447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bfe59c700 1 -- 172.21.15.12:0/2398738363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 msgr2=0x559132b460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bfe59c700 1 -- 172.21.15.12:0/2398738363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559132915630 con 0x559132b44d30 2023-12-11T20:21:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4bec0a1480 0x7f4bec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b45640 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009c80 tx=0x7f4bf0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66096c425120c1fc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bf4ff9700 1 -- 172.21.15.12:0/2398738363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0011cb0 con 0x559132b44d30 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bf4ff9700 1 -- 172.21.15.12:0/2398738363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bf0011e10 con 0x559132b44d30 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.607+0000 7f4bf4ff9700 1 -- 172.21.15.12:0/2398738363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0005020 con 0x559132b44d30 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2398738363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 msgr2=0x559132b45640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4bec0a1480 0x7f4bec0a3940 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009cd0 tx=0x7f4bf800b3e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b45640 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009c80 tx=0x7f4bf0009f90 comp rx=0 tx=0).stop 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2398738363 shutdown_connections 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2398738363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b45640 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2398738363 >> 172.21.15.12:0/2398738363 conn(0x559132a737e0 msgr2=0x559132b40d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2398738363 shutdown_connections 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.608+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2398738363 wait complete. 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.609+0000 7f4c182a9b80 1 -- start start 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.609+0000 7f4c182a9b80 1 Processor -- start 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b4e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b4e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b55690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132a52560 con 0x559132b44d30 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132a52200 con 0x559132b45c20 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132917920 con 0x559132b443d0 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4c182a9b80 10 client.0 _ll_register_callbacks cb 0x55913297da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b4e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b4e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45362/0 (socket says 172.21.15.12:45362) 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bf7fff700 1 -- 172.21.15.12:0/2271451566 learned_addr learned my addr 172.21.15.12:0/2271451566 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b4e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bf7fff700 1 -- 172.21.15.12:0/2271451566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 msgr2=0x559132b4e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b4e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bf7fff700 1 -- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 msgr2=0x559132b55690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b55690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b55690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bf7fff700 1 -- 172.21.15.12:0/2271451566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf00098e0 con 0x559132b44d30 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.610+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b55690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.611+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b4e650 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4be80ca9c0 tx=0x7f4be809a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5677f8a6647d44 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.611+0000 7f4be5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.611+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2271451566 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80a22e0 con 0x559132b44d30 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.611+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2271451566 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4be809a1e0 con 0x559132b44d30 2023-12-11T20:21:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.611+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2271451566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559132b37b40 con 0x559132b44d30 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.611+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2271451566 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4be809e120 con 0x559132b44d30 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.611+0000 7f4c182a9b80 10 client.17217 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.611+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2271451566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5591328c1de0 con 0x559132b44d30 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2271451566 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559132b37b40 con 0x559132b44d30 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2271451566 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4be80961d0 con 0x559132b44d30 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4c182a9b80 10 client.17217 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4c182a9b80 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4c182a9b80 20 client.17217 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559132b59eb0 0x559132b5c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4c182a9b80 4 client.17217 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2271451566 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559132b13f40 con 0x559132b59eb0 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.612+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559132b59eb0 0x559132b5c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.613+0000 7f4be5ffb700 10 client.17217 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.613+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559132b59eb0 0x559132b5c2d0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db817104b043ac18 server_cookie=a537f081e2408098 in_seq=0 out_seq=0 2023-12-11T20:21:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2271451566 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559132b13f40 con 0x559132b59eb0 2023-12-11T20:21:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4be5ffb700 10 client.17217 handle_command_reply: tid=0 2023-12-11T20:21:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 client.17217 shutdown 2023-12-11T20:21:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2271451566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 msgr2=0x559132b4e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b4e650 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4be80ca9c0 tx=0x7f4be809a720 comp rx=0 tx=0).stop 2023-12-11T20:21:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2271451566 shutdown_connections 2023-12-11T20:21:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559132b59eb0 0x559132b5c2d0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b45c20 0x559132b55690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b443d0 0x559132b4e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2271451566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b4e650 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4be5ffb700 0 client.17217 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2271451566 >> 172.21.15.12:0/2271451566 conn(0x559132a737e0 msgr2=0x559132b3fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2271451566 shutdown_connections 2023-12-11T20:21:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.614+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2271451566 wait complete. 2023-12-11T20:21:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.615+0000 7f4c182a9b80 20 client.17217 trim_cache size 0 max 16384 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.638+0000 7f4c182a9b80 1 Processor -- start 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.638+0000 7f4c182a9b80 1 -- start start 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 0x559132b48af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b44d30 0x559132b49030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b45c20 0x559132b55650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132b56810 con 0x559132b45c20 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132b4d0d0 con 0x559132b443d0 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132b45850 con 0x559132b44d30 2023-12-11T20:21:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4bfed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b45c20 0x559132b55650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4bfed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b45c20 0x559132b55650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45376/0 (socket says 172.21.15.12:45376) 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4bfed9d700 1 -- 172.21.15.12:0/2437531069 learned_addr learned my addr 172.21.15.12:0/2437531069 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 0x559132b48af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.639+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b44d30 0x559132b49030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bfed9d700 1 -- 172.21.15.12:0/2437531069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b44d30 msgr2=0x559132b49030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b44d30 0x559132b49030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bfed9d700 1 -- 172.21.15.12:0/2437531069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 msgr2=0x559132b48af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 0x559132b48af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bfed9d700 1 -- 172.21.15.12:0/2437531069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591328aac60 con 0x559132b45c20 2023-12-11T20:21:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b45c20 0x559132b55650 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8007f10 tx=0x7f4bf8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c861d40ffbe6f5a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bf57fa700 1 -- 172.21.15.12:0/2437531069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8027070 con 0x559132b45c20 2023-12-11T20:21:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bf57fa700 1 -- 172.21.15.12:0/2437531069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bf8003e90 con 0x559132b45c20 2023-12-11T20:21:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.640+0000 7f4bf57fa700 1 -- 172.21.15.12:0/2437531069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800e040 con 0x559132b45c20 2023-12-11T20:21:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2437531069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b45c20 msgr2=0x559132b55650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b45c20 0x559132b55650 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8007f10 tx=0x7f4bf8009b80 comp rx=0 tx=0).stop 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2437531069 shutdown_connections 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 0x559132b48af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b45c20 0x559132b55650 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2437531069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b44d30 0x559132b49030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2437531069 >> 172.21.15.12:0/2437531069 conn(0x559132a737e0 msgr2=0x559132b4d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2437531069 shutdown_connections 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.641+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2437531069 wait complete. 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 1 -- start start 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 1 Processor -- start 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 0x559132b54f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b45c20 0x559132b51a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132b520b0 con 0x559132b44d30 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132b52220 con 0x559132b443d0 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559132b523e0 con 0x559132b45c20 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.642+0000 7f4c182a9b80 10 client.0 _ll_register_callbacks cb 0x55913297da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bfe59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 0x559132b54f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45384/0 (socket says 172.21.15.12:45384) 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 -- 172.21.15.12:0/2568595641 learned_addr learned my addr 172.21.15.12:0/2568595641 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 -- 172.21.15.12:0/2568595641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b45c20 msgr2=0x559132b51a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bfed9d700 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b45c20 0x559132b51a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b45c20 0x559132b51a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 -- 172.21.15.12:0/2568595641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 msgr2=0x559132b54f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 0x559132b54f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 -- 172.21.15.12:0/2568595641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0010c480 con 0x559132b44d30 2023-12-11T20:21:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4bf7fff700 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b554c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4be8096c00 tx=0x7f4be800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159b4881b4fdd365 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.643+0000 7f4be5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2568595641 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be809e120 con 0x559132b44d30 2023-12-11T20:21:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2568595641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bf0011e10 con 0x559132b44d30 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2568595641 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4be809a1e0 con 0x559132b44d30 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2568595641 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4be809e330 con 0x559132b44d30 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 10 client.17223 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2568595641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5591328e8250 con 0x559132b44d30 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2568595641 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bf0011e10 con 0x559132b44d30 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2568595641 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4be807e080 con 0x559132b44d30 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 10 client.17223 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 10 client.17223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:52.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 20 client.17223 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:52.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559132bb1790 0x559132bb3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:52.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 4 client.17223 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:21:52.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.644+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2568595641 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559132a5efd0 con 0x559132bb1790 2023-12-11T20:21:52.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.645+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559132bb1790 0x559132bb3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:52.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.645+0000 7f4bfe59c700 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559132bb1790 0x559132bb3bb0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44083727dec4c45 server_cookie=7aeaf656c3fb807a in_seq=0 out_seq=0 2023-12-11T20:21:52.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.645+0000 7f4be5ffb700 10 client.17223 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:52.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4be5ffb700 1 -- 172.21.15.12:0/2568595641 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559132a5efd0 con 0x559132bb1790 2023-12-11T20:21:52.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4be5ffb700 10 client.17223 handle_command_reply: tid=0 2023-12-11T20:21:52.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 client.17223 shutdown 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2568595641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 msgr2=0x559132b554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b554c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4be8096c00 tx=0x7f4be800cd20 comp rx=0 tx=0).stop 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2568595641 shutdown_connections 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559132bb1790 0x559132bb3bb0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559132b443d0 0x559132b54f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559132b45c20 0x559132b51a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4be5ffb700 0 client.17223 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 --2- 172.21.15.12:0/2568595641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559132b44d30 0x559132b554c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2568595641 >> 172.21.15.12:0/2568595641 conn(0x559132a737e0 msgr2=0x559132b48af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2568595641 shutdown_connections 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 1 -- 172.21.15.12:0/2568595641 wait complete. 2023-12-11T20:21:52.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.646+0000 7f4c182a9b80 20 client.17223 trim_cache size 0 max 16384 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: "cb8a5c4f-02bf-4dd7-8e83-b5c528870f98": { 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "cb8a5c4f-02bf-4dd7-8e83-b5c528870f98", 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:21:52.651 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 -- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4bec0a1480 msgr2=0x7f4bec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4bec0a1480 0x7f4bec0a3940 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009cd0 tx=0x7f4bf800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 -- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c001048e0 msgr2=0x7f4c00199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c001048e0 0x7f4c00199b50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4be800e9a0 tx=0x7f4be800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 -- 172.21.15.12:0/1595625181 shutdown_connections 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4bec0a1480 0x7f4bec0a3940 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c00105280 0x7f4c001a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c001036f0 0x7f4c00199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 --2- 172.21.15.12:0/1595625181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c001048e0 0x7f4c00199b50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:52.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 -- 172.21.15.12:0/1595625181 >> 172.21.15.12:0/1595625181 conn(0x7f4c000fec80 msgr2=0x7f4c00107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 -- 172.21.15.12:0/1595625181 shutdown_connections 2023-12-11T20:21:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:21:52.647+0000 7f4c049ff700 1 -- 172.21.15.12:0/1595625181 wait complete. 2023-12-11T20:21:52.658 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:21:52 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:21:52.343+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v138>,<0x10000000003/client.0 v140>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v157>,<0x10000000001/sv_0 v181>,<0x10000000000/_nogroup v165>,<0x1/volumes v157>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:21:52.667 INFO:tasks.cephfs.filesystem:scrub status for tag:cb8a5c4f-02bf-4dd7-8e83-b5c528870f98 - {'path': '/', 'tag': 'cb8a5c4f-02bf-4dd7-8e83-b5c528870f98', 'options': 'recursive,force'} 2023-12-11T20:21:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:52 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:52 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:52 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:52 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:52 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:52.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:52 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:52.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:52 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:52.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:52 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:52.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:52 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:52.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:52 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:52.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:52 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:52.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:52 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:53.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:52 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:53.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:52 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:53.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:52 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:53.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:52 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:53.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:52 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:53.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:52 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:53.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:53 smithi032 ceph-mon[132488]: pgmap v554: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 13 MiB/s wr, 16 op/s 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:54.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:53 smithi039 ceph-mon[102205]: pgmap v554: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 13 MiB/s wr, 16 op/s 2023-12-11T20:21:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:21:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:21:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:21:54.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:21:54.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:53 smithi012 ceph-mon[128787]: pgmap v554: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 13 MiB/s wr, 16 op/s 2023-12-11T20:21:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/3610305784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 msgr2=0x7fa2d40744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/3610305784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 0x7fa2d40744b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009990 tx=0x7fa2c4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/3610305784 shutdown_connections 2023-12-11T20:21:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/3610305784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2d4109390 0x7fa2d410b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/3610305784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2d4075610 0x7fa2d4073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/3610305784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 0x7fa2d40744b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/3610305784 >> 172.21.15.12:0/3610305784 conn(0x7fa2d40fca60 msgr2=0x7fa2d40fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/3610305784 shutdown_connections 2023-12-11T20:21:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.701+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/3610305784 wait complete. 2023-12-11T20:21:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.702+0000 7fa2dc7ff700 1 Processor -- start 2023-12-11T20:21:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.702+0000 7fa2dc7ff700 1 -- start start 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2dc7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 0x7fa2d41995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2dc7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2d4075610 0x7fa2d4199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2dc7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2d4109390 0x7fa2d41a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2dc7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41a10c0 con 0x7fa2d4074030 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2dc7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41a1200 con 0x7fa2d4075610 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2dc7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41a1390 con 0x7fa2d4109390 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2da59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 0x7fa2d41995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2da59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 0x7fa2d41995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45408/0 (socket says 172.21.15.12:45408) 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2da59b700 1 -- 172.21.15.12:0/1782955804 learned_addr learned my addr 172.21.15.12:0/1782955804 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2d9d9a700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2d4075610 0x7fa2d4199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2d4109390 0x7fa2d41a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2da59b700 1 -- 172.21.15.12:0/1782955804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2d4109390 msgr2=0x7fa2d41a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2da59b700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2d4109390 0x7fa2d41a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2da59b700 1 -- 172.21.15.12:0/1782955804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2d4075610 msgr2=0x7fa2d4199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2da59b700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2d4075610 0x7fa2d4199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2da59b700 1 -- 172.21.15.12:0/1782955804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c40095f0 con 0x7fa2d4074030 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2d9d9a700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2d4075610 0x7fa2d4199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.703+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2d4109390 0x7fa2d41a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.704+0000 7fa2da59b700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 0x7fa2d41995e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000e9a0 tx=0x7fa2d000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.704+0000 7fa2cb7fe700 1 -- 172.21.15.12:0/1782955804 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0009790 con 0x7fa2d4074030 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.704+0000 7fa2cb7fe700 1 -- 172.21.15.12:0/1782955804 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2d000cbd0 con 0x7fa2d4074030 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.704+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/1782955804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d41a1670 con 0x7fa2d4074030 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.704+0000 7fa2cb7fe700 1 -- 172.21.15.12:0/1782955804 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0018680 con 0x7fa2d4074030 2023-12-11T20:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.704+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/1782955804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d41a1bd0 con 0x7fa2d4074030 2023-12-11T20:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.708+0000 7fa2cb7fe700 1 -- 172.21.15.12:0/1782955804 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa2d000cd40 con 0x7fa2d4074030 2023-12-11T20:21:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.709+0000 7fa2f0060b80 1 Processor -- start 2023-12-11T20:21:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.709+0000 7fa2f0060b80 1 -- start start 2023-12-11T20:21:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.709+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b8802f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b881140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b881ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b7dbaf0 con 0x557a5b880830 2023-12-11T20:21:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b7d9410 con 0x557a5b87fed0 2023-12-11T20:21:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b7d4d00 con 0x557a5b881720 2023-12-11T20:21:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2cb7fe700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2c00a14f0 0x7fa2c00a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2da59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b881140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2dad9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b8802f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2da59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b881140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45418/0 (socket says 172.21.15.12:45418) 2023-12-11T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2dad9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b8802f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38928/0 (socket says 172.21.15.12:38928) 2023-12-11T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2da59b700 1 -- 172.21.15.12:0/2563856039 learned_addr learned my addr 172.21.15.12:0/2563856039 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2d9d9a700 1 --2- 172.21.15.12:0/2563856039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b881ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2cb7fe700 1 -- 172.21.15.12:0/1782955804 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2d0014070 con 0x7fa2d4074030 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.710+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2c00a14f0 0x7fa2c00a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2da59b700 1 -- 172.21.15.12:0/2563856039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 msgr2=0x557a5b881ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2da59b700 1 --2- 172.21.15.12:0/2563856039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b881ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2da59b700 1 -- 172.21.15.12:0/2563856039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 msgr2=0x557a5b8802f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2da59b700 1 --2- 172.21.15.12:0/2563856039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b8802f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2da59b700 1 -- 172.21.15.12:0/2563856039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a5b6515d0 con 0x557a5b880830 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2da59b700 1 --2- 172.21.15.12:0/2563856039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b881140 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa2d009a250 tx=0x7fa2d006d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86418f70db5c5d46 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2c00a14f0 0x7fa2c00a39b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0060b0 tx=0x7fa2cc00b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2c8ff9700 1 -- 172.21.15.12:0/2563856039 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0065b80 con 0x557a5b880830 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2c8ff9700 1 -- 172.21.15.12:0/2563856039 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2d009a9c0 con 0x557a5b880830 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.711+0000 7fa2c8ff9700 1 -- 172.21.15.12:0/2563856039 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d009a780 con 0x557a5b880830 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 -- 172.21.15.12:0/2563856039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 msgr2=0x557a5b881140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/2563856039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b881140 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa2d009a250 tx=0x7fa2d006d280 comp rx=0 tx=0).stop 2023-12-11T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 -- 172.21.15.12:0/2563856039 shutdown_connections 2023-12-11T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/2563856039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b8802f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/2563856039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b881ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/2563856039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b881140 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 -- 172.21.15.12:0/2563856039 >> 172.21.15.12:0/2563856039 conn(0x557a5b7af780 msgr2=0x557a5b87c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 -- 172.21.15.12:0/2563856039 shutdown_connections 2023-12-11T20:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.712+0000 7fa2f0060b80 1 -- 172.21.15.12:0/2563856039 wait complete. 2023-12-11T20:21:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.713+0000 7fa2f0060b80 1 -- start start 2023-12-11T20:21:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.713+0000 7fa2f0060b80 1 Processor -- start 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b889e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b880830 0x557a5b88a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b8911c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b78e500 con 0x557a5b881720 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b78e1a0 con 0x557a5b87fed0 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b6538c0 con 0x557a5b880830 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2f0060b80 10 client.0 _ll_register_callbacks cb 0x557a5b6b9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2dad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b8911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2dad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b8911c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45426/0 (socket says 172.21.15.12:45426) 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2dad9c700 1 -- 172.21.15.12:0/3981914559 learned_addr learned my addr 172.21.15.12:0/3981914559 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2d9d9a700 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b880830 0x557a5b88a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.714+0000 7fa2da59b700 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b889e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2dad9c700 1 -- 172.21.15.12:0/3981914559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b880830 msgr2=0x557a5b88a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b880830 0x557a5b88a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2dad9c700 1 -- 172.21.15.12:0/3981914559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 msgr2=0x557a5b889e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b889e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2dad9c700 1 -- 172.21.15.12:0/3981914559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d41a1bd0 con 0x557a5b881720 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2d9d9a700 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b880830 0x557a5b88a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b8911c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009490 tx=0x7fa2cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acea5587e5978d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3981914559 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc020070 con 0x557a5b881720 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3981914559 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2cc007910 con 0x557a5b881720 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.715+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3981914559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a5b873730 con 0x557a5b881720 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.716+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3981914559 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2cc00e070 con 0x557a5b881720 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.716+0000 7fa2f0060b80 10 client.17235 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.716+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3981914559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a5b5fdd80 con 0x557a5b881720 2023-12-11T20:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.716+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3981914559 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2cc034080 con 0x557a5b881720 2023-12-11T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.716+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3981914559 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa2cc025b30 con 0x557a5b881720 2023-12-11T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.716+0000 7fa2f0060b80 10 client.17235 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.716+0000 7fa2f0060b80 10 client.17235 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.717+0000 7fa2f0060b80 20 client.17235 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.717+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557a5b895ce0 0x557a5b898100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.717+0000 7fa2f0060b80 4 client.17235 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.717+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3981914559 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a5b84fee0 con 0x557a5b895ce0 2023-12-11T20:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.717+0000 7fa2da59b700 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557a5b895ce0 0x557a5b898100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.718+0000 7fa2da59b700 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557a5b895ce0 0x557a5b898100 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1791beb064b5ca59 server_cookie=158a0e88df58a659 in_seq=0 out_seq=0 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.718+0000 7fa2bdffb700 10 client.17235 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.718+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3981914559 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557a5b84fee0 con 0x557a5b895ce0 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.718+0000 7fa2bdffb700 10 client.17235 handle_command_reply: tid=0 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.718+0000 7fa2f0060b80 1 client.17235 shutdown 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3981914559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 msgr2=0x557a5b8911c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b8911c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009490 tx=0x7fa2cc004ad0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3981914559 shutdown_connections 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557a5b895ce0 0x557a5b898100 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b889e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b8911c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2bdffb700 0 client.17235 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3981914559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b880830 0x557a5b88a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3981914559 >> 172.21.15.12:0/3981914559 conn(0x557a5b7af780 msgr2=0x557a5b87aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.719+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3981914559 shutdown_connections 2023-12-11T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.720+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3981914559 wait complete. 2023-12-11T20:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.720+0000 7fa2f0060b80 20 client.17235 trim_cache size 0 max 16384 2023-12-11T20:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.740+0000 7fa2f0060b80 1 Processor -- start 2023-12-11T20:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.740+0000 7fa2f0060b80 1 -- start start 2023-12-11T20:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.740+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b87fed0 0x557a5b881b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.740+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b880830 0x557a5b891180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.740+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b887c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.740+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b880f30 con 0x557a5b881720 2023-12-11T20:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.740+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b895a80 con 0x557a5b880830 2023-12-11T20:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.740+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b891e60 con 0x557a5b87fed0 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2dad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b887c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2dad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b887c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45436/0 (socket says 172.21.15.12:45436) 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2dad9c700 1 -- 172.21.15.12:0/4235286187 learned_addr learned my addr 172.21.15.12:0/4235286187 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2da59b700 1 --2- 172.21.15.12:0/4235286187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b87fed0 0x557a5b881b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2dad9c700 1 -- 172.21.15.12:0/4235286187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b87fed0 msgr2=0x557a5b881b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/4235286187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b87fed0 0x557a5b881b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2dad9c700 1 -- 172.21.15.12:0/4235286187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b880830 msgr2=0x557a5b891180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/4235286187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b880830 0x557a5b891180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.741+0000 7fa2dad9c700 1 -- 172.21.15.12:0/4235286187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a5b5e6c00 con 0x557a5b881720 2023-12-11T20:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.742+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/4235286187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b887c90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc025f10 tx=0x7fa2cc011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7212296e47398c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.742+0000 7fa2c97fa700 1 -- 172.21.15.12:0/4235286187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc020070 con 0x557a5b881720 2023-12-11T20:21:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.742+0000 7fa2c97fa700 1 -- 172.21.15.12:0/4235286187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a5b873730 con 0x557a5b881720 2023-12-11T20:21:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.742+0000 7fa2c97fa700 1 -- 172.21.15.12:0/4235286187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00e040 con 0x557a5b881720 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.743+0000 7fa2f0060b80 1 -- 172.21.15.12:0/4235286187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 msgr2=0x557a5b887c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.743+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/4235286187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b887c90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc025f10 tx=0x7fa2cc011040 comp rx=0 tx=0).stop 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.743+0000 7fa2f0060b80 1 -- 172.21.15.12:0/4235286187 shutdown_connections 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.743+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/4235286187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b881720 0x557a5b887c90 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.743+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/4235286187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b87fed0 0x557a5b881b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.743+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/4235286187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b880830 0x557a5b891180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.743+0000 7fa2f0060b80 1 -- 172.21.15.12:0/4235286187 >> 172.21.15.12:0/4235286187 conn(0x557a5b7af780 msgr2=0x557a5b8891c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.744+0000 7fa2f0060b80 1 -- 172.21.15.12:0/4235286187 shutdown_connections 2023-12-11T20:21:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.744+0000 7fa2f0060b80 1 -- 172.21.15.12:0/4235286187 wait complete. 2023-12-11T20:21:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.744+0000 7fa2f0060b80 1 -- start start 2023-12-11T20:21:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.745+0000 7fa2f0060b80 1 Processor -- start 2023-12-11T20:21:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.745+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b88edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.745+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b88f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.745+0000 7fa2f0060b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b890320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.745+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b890860 con 0x557a5b880830 2023-12-11T20:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.745+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b8909d0 con 0x557a5b87fed0 2023-12-11T20:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.745+0000 7fa2f0060b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5b890b90 con 0x557a5b881720 2023-12-11T20:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.745+0000 7fa2f0060b80 10 client.0 _ll_register_callbacks cb 0x557a5b6b9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2dad9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b890320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2dad9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b890320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:36368/0 (socket says 172.21.15.12:36368) 2023-12-11T20:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2dad9c700 1 -- 172.21.15.12:0/3397810729 learned_addr learned my addr 172.21.15.12:0/3397810729 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2d9d9a700 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b88f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2da59b700 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b88edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2dad9c700 1 -- 172.21.15.12:0/3397810729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 msgr2=0x557a5b88edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b88edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2dad9c700 1 -- 172.21.15.12:0/3397810729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 msgr2=0x557a5b88f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b88f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.746+0000 7fa2dad9c700 1 -- 172.21.15.12:0/3397810729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a5b5fdd80 con 0x557a5b881720 2023-12-11T20:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.747+0000 7fa2dad9c700 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b890320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc000f80 tx=0x7fa2cc01ab40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213414e83fc1686b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.747+0000 7fa2bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.747+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3397810729 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00e040 con 0x557a5b881720 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.747+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3397810729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2d009a9c0 con 0x557a5b881720 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.747+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3397810729 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2cc01a560 con 0x557a5b881720 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.747+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3397810729 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2cc020040 con 0x557a5b881720 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.747+0000 7fa2f0060b80 10 client.26926 fetch_fsmap learned FSMap version 26 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.747+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3397810729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a5b6241f0 con 0x557a5b881720 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.748+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3397810729 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2cc049080 con 0x557a5b881720 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.748+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3397810729 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa2cc039070 con 0x557a5b881720 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.748+0000 7fa2f0060b80 10 client.26926 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.748+0000 7fa2f0060b80 10 client.26926 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.748+0000 7fa2f0060b80 20 client.26926 populate_metadata read hostname 'smithi012' 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.748+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557a5b8ecd00 0x557a5b8ef120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.748+0000 7fa2f0060b80 4 client.26926 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.748+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3397810729 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a5b79af70 con 0x557a5b8ecd00 2023-12-11T20:21:54.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.749+0000 7fa2da59b700 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557a5b8ecd00 0x557a5b8ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:21:54.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.749+0000 7fa2bdffb700 10 client.26926 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:54.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.749+0000 7fa2da59b700 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557a5b8ecd00 0x557a5b8ef120 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95024538bc1691de server_cookie=485ba7e9516c152b in_seq=0 out_seq=0 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2bdffb700 1 -- 172.21.15.12:0/3397810729 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a5b79af70 con 0x557a5b8ecd00 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2bdffb700 10 client.26926 handle_command_reply: tid=0 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 client.26926 shutdown 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3397810729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 msgr2=0x557a5b890320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b890320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc000f80 tx=0x7fa2cc01ab40 comp rx=0 tx=0).stop 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3397810729 shutdown_connections 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557a5b8ecd00 0x557a5b8ef120 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557a5b87fed0 0x557a5b88edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557a5b881720 0x557a5b890320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2bdffb700 0 client.26926 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:21:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 --2- 172.21.15.12:0/3397810729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a5b880830 0x557a5b88f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.759+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3397810729 >> 172.21.15.12:0/3397810729 conn(0x557a5b7af780 msgr2=0x557a5b884940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.760+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3397810729 shutdown_connections 2023-12-11T20:21:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.760+0000 7fa2f0060b80 1 -- 172.21.15.12:0/3397810729 wait complete. 2023-12-11T20:21:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.760+0000 7fa2f0060b80 20 client.26926 trim_cache size 0 max 16384 2023-12-11T20:21:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:21:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:21:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:21:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.760+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2c00a14f0 msgr2=0x7fa2c00a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2c00a14f0 0x7fa2c00a39b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0060b0 tx=0x7fa2cc00b040 comp rx=0 tx=0).stop 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 msgr2=0x7fa2d41995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 0x7fa2d41995e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000e9a0 tx=0x7fa2d000ed60 comp rx=0 tx=0).stop 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/1782955804 shutdown_connections 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2c00a14f0 0x7fa2c00a39b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2d4109390 0x7fa2d41a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d4074030 0x7fa2d41995e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 --2- 172.21.15.12:0/1782955804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2d4075610 0x7fa2d4199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:21:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/1782955804 >> 172.21.15.12:0/1782955804 conn(0x7fa2d40fca60 msgr2=0x7fa2d4105290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:21:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/1782955804 shutdown_connections 2023-12-11T20:21:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:21:54.761+0000 7fa2dc7ff700 1 -- 172.21.15.12:0/1782955804 wait complete. 2023-12-11T20:21:55.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:55 smithi039 ceph-mon[102205]: pgmap v555: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 23 op/s 2023-12-11T20:21:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:55 smithi012 ceph-mon[128787]: pgmap v555: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 23 op/s 2023-12-11T20:21:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:55 smithi032 ceph-mon[132488]: pgmap v555: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 23 op/s 2023-12-11T20:21:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:57 smithi039 ceph-mon[102205]: pgmap v556: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:21:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:57 smithi012 ceph-mon[128787]: pgmap v556: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:21:57.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:57 smithi032 ceph-mon[132488]: pgmap v556: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:21:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:21:59 smithi032 ceph-mon[132488]: pgmap v557: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:21:59.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:21:59 smithi039 ceph-mon[102205]: pgmap v557: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:21:59.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:21:59 smithi012 ceph-mon[128787]: pgmap v557: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:22:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:01 smithi039 ceph-mon[102205]: pgmap v558: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:22:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:01 smithi012 ceph-mon[128787]: pgmap v558: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:22:01.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:01 smithi032 ceph-mon[132488]: pgmap v558: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:22:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:03 smithi039 ceph-mon[102205]: pgmap v559: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:22:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:03 smithi012 ceph-mon[128787]: pgmap v559: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:22:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:03 smithi032 ceph-mon[132488]: pgmap v559: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:22:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:05 smithi039 ceph-mon[102205]: pgmap v560: 97 pgs: 97 active+clean; 4.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:05.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:05 smithi012 ceph-mon[128787]: pgmap v560: 97 pgs: 97 active+clean; 4.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:05 smithi032 ceph-mon[132488]: pgmap v560: 97 pgs: 97 active+clean; 4.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:06.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:06 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:22:06.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:06 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:22:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:06 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:22:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:07 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:22:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:07 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:22:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:07 smithi039 ceph-mon[102205]: pgmap v561: 97 pgs: 97 active+clean; 4.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:22:07.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:07 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:22:07.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:07 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:22:07.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:07 smithi012 ceph-mon[128787]: pgmap v561: 97 pgs: 97 active+clean; 4.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:22:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:07 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:22:08.289 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:07 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:22:08.289 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:07 smithi032 ceph-mon[132488]: pgmap v561: 97 pgs: 97 active+clean; 4.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.935+0000 7f54a53ff700 1 -- 172.21.15.12:0/661026053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 msgr2=0x7f54a01018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.935+0000 7f54a53ff700 1 --2- 172.21.15.12:0/661026053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 0x7f54a01018f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f54900099c0 tx=0x7f5490009cd0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.936+0000 7f54a53ff700 1 -- 172.21.15.12:0/661026053 shutdown_connections 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.936+0000 7f54a53ff700 1 --2- 172.21.15.12:0/661026053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54a0103060 0x7f54a0109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.936+0000 7f54a53ff700 1 --2- 172.21.15.12:0/661026053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 0x7f54a01018f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.936+0000 7f54a53ff700 1 --2- 172.21.15.12:0/661026053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54a01026c0 0x7f54a0102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.936+0000 7f54a53ff700 1 -- 172.21.15.12:0/661026053 >> 172.21.15.12:0/661026053 conn(0x7f54a00fca60 msgr2=0x7f54a00fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.936+0000 7f54a53ff700 1 -- 172.21.15.12:0/661026053 shutdown_connections 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.936+0000 7f54a53ff700 1 -- 172.21.15.12:0/661026053 wait complete. 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.937+0000 7f54a53ff700 1 Processor -- start 2023-12-11T20:22:08.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.937+0000 7f54a53ff700 1 -- start start 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.937+0000 7f54a53ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 0x7f54a0199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.937+0000 7f54a53ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54a01026c0 0x7f54a0199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.937+0000 7f54a53ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54a0103060 0x7f54a01a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.937+0000 7f54a53ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01a10c0 con 0x7f54a01014d0 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.937+0000 7f54a53ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01a1200 con 0x7f54a01026c0 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.937+0000 7f54a53ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01a1390 con 0x7f54a0103060 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 0x7f54a0199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54a01026c0 0x7f54a0199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 0x7f54a0199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42092/0 (socket says 172.21.15.12:42092) 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 -- 172.21.15.12:0/2625823139 learned_addr learned my addr 172.21.15.12:0/2625823139 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549f7fe700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54a0103060 0x7f54a01a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 -- 172.21.15.12:0/2625823139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54a0103060 msgr2=0x7f54a01a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54a0103060 0x7f54a01a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 -- 172.21.15.12:0/2625823139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54a01026c0 msgr2=0x7f54a0199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54a01026c0 0x7f54a0199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 -- 172.21.15.12:0/2625823139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900095f0 con 0x7f54a01014d0 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.938+0000 7f549effd700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 0x7f54a0199590 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5490009990 tx=0x7f549000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.939+0000 7f5487fff700 1 -- 172.21.15.12:0/2625823139 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549001d070 con 0x7f54a01014d0 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.939+0000 7f5487fff700 1 -- 172.21.15.12:0/2625823139 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f549000bd10 con 0x7f54a01014d0 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.939+0000 7f5487fff700 1 -- 172.21.15.12:0/2625823139 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490017650 con 0x7f54a01014d0 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.939+0000 7f54a53ff700 1 -- 172.21.15.12:0/2625823139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a01a1610 con 0x7f54a01014d0 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.939+0000 7f54a53ff700 1 -- 172.21.15.12:0/2625823139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a01a1a30 con 0x7f54a01014d0 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.942+0000 7f5487fff700 1 -- 172.21.15.12:0/2625823139 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5490022470 con 0x7f54a01014d0 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f54b8dc1b80 1 Processor -- start 2023-12-11T20:22:08.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f5487fff700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54880a14f0 0x7f54880a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f54b8dc1b80 1 -- start start 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f5487fff700 1 -- 172.21.15.12:0/2625823139 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f54900cdfd0 con 0x7f54a01014d0 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f549f7fe700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54880a14f0 0x7f54880a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12ef830 0x5640e12f0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e12f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e124aaf0 con 0x5640e12f0720 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e1248410 con 0x5640e12eeed0 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.944+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e1243d00 con 0x5640e12ef830 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e12f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46292/0 (socket says 172.21.15.12:46292) 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549effd700 1 -- 172.21.15.12:0/1641672831 learned_addr learned my addr 172.21.15.12:0/1641672831 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549e7fc700 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12ef830 0x5640e12f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549f7fe700 1 -- 172.21.15.12:0/1641672831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12ef830 msgr2=0x5640e12f0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549f7fe700 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12ef830 0x5640e12f0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549f7fe700 1 -- 172.21.15.12:0/1641672831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 msgr2=0x5640e12ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549f7fe700 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549f7fe700 1 -- 172.21.15.12:0/1641672831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640e10c05d0 con 0x5640e12f0720 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.945+0000 7f549effd700 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.946+0000 7f549f7fe700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54880a14f0 0x7f54880a39b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5498004230 tx=0x7f5498009c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.946+0000 7f549f7fe700 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e12f0ba0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f54980076f0 tx=0x7f549801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb76d3e1fed501f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.946+0000 7f54857fa700 1 -- 172.21.15.12:0/1641672831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498007d10 con 0x5640e12f0720 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.946+0000 7f54857fa700 1 -- 172.21.15.12:0/1641672831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f549800f040 con 0x5640e12f0720 2023-12-11T20:22:08.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.946+0000 7f54857fa700 1 -- 172.21.15.12:0/1641672831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549801bca0 con 0x5640e12f0720 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1641672831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 msgr2=0x5640e12f0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e12f0ba0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f54980076f0 tx=0x7f549801c000 comp rx=0 tx=0).stop 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1641672831 shutdown_connections 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e12f0ba0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1641672831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12ef830 0x5640e12f0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1641672831 >> 172.21.15.12:0/1641672831 conn(0x5640e121e780 msgr2=0x5640e12eb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1641672831 shutdown_connections 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1641672831 wait complete. 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.947+0000 7f54b8dc1b80 1 -- start start 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.948+0000 7f54b8dc1b80 1 Processor -- start 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.948+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12eeed0 0x5640e12f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.948+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.948+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e13001f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.948+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e11fd500 con 0x5640e12f0720 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.948+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e11fd1a0 con 0x5640e12ef830 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.948+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e10c28c0 con 0x5640e12eeed0 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.948+0000 7f54b8dc1b80 10 client.0 _ll_register_callbacks cb 0x5640e1128a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12eeed0 0x5640e12f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12eeed0 0x5640e12f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50952/0 (socket says 172.21.15.12:50952) 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e13001f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549effd700 1 -- 172.21.15.12:0/1826508104 learned_addr learned my addr 172.21.15.12:0/1826508104 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549e7fc700 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549e7fc700 1 -- 172.21.15.12:0/1826508104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12eeed0 msgr2=0x5640e12f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549e7fc700 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12eeed0 0x5640e12f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549e7fc700 1 -- 172.21.15.12:0/1826508104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 msgr2=0x5640e13001f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549e7fc700 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e13001f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549e7fc700 1 -- 172.21.15.12:0/1826508104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54900a1040 con 0x5640e12ef830 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.949+0000 7f549effd700 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12eeed0 0x5640e12f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.950+0000 7f549e7fc700 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12f93c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5494012770 tx=0x7f5494012a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=248f960b8b49eaa0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.950+0000 7f5482ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.950+0000 7f5482ff5700 1 -- 172.21.15.12:0/1826508104 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5494017070 con 0x5640e12ef830 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.950+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1826508104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640e12e2730 con 0x5640e12ef830 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.950+0000 7f5482ff5700 1 -- 172.21.15.12:0/1826508104 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f549400f480 con 0x5640e12ef830 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.950+0000 7f5482ff5700 1 -- 172.21.15.12:0/1826508104 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f549400f640 con 0x5640e12ef830 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.950+0000 7f54b8dc1b80 10 client.26939 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.950+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1826508104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f5498007560 con 0x5640e12ef830 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.951+0000 7f5482ff5700 1 -- 172.21.15.12:0/1826508104 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5640e12e2730 con 0x5640e12ef830 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.951+0000 7f5482ff5700 1 -- 172.21.15.12:0/1826508104 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f54940266e0 con 0x5640e12ef830 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.951+0000 7f54b8dc1b80 10 client.26939 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.951+0000 7f54b8dc1b80 10 client.26939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.951+0000 7f54b8dc1b80 20 client.26939 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.951+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5640e1304d40 0x5640e1307160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.951+0000 7f54b8dc1b80 4 client.26939 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.951+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1826508104 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640e12beee0 con 0x5640e1304d40 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.952+0000 7f549effd700 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5640e1304d40 0x5640e1307160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.952+0000 7f5482ff5700 10 client.26939 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.952+0000 7f549effd700 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5640e1304d40 0x5640e1307160 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8654bd02b1393f8e server_cookie=3a1c0e5c27763b25 in_seq=0 out_seq=0 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f5482ff5700 1 -- 172.21.15.12:0/1826508104 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5640e12beee0 con 0x5640e1304d40 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f5482ff5700 10 client.26939 handle_command_reply: tid=0 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 client.26939 shutdown 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 msgr2=0x5640e12f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12f93c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5494012770 tx=0x7f5494012a80 comp rx=0 tx=0).stop 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1826508104 shutdown_connections 2023-12-11T20:22:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5640e1304d40 0x5640e1307160 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12f0720 0x5640e13001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12eeed0 0x5640e12f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f5482ff5700 0 client.26939 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/1826508104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12f93c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1826508104 >> 172.21.15.12:0/1826508104 conn(0x5640e121e780 msgr2=0x5640e12e9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1826508104 shutdown_connections 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.953+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/1826508104 wait complete. 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.954+0000 7f54b8dc1b80 20 client.26939 trim_cache size 0 max 16384 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f54b8dc1b80 1 Processor -- start 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f54b8dc1b80 1 -- start start 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12ef830 0x5640e1300ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 0x5640e12f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e12f76b0 con 0x5640e12ef830 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e12f69d0 con 0x5640e12eeed0 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e12f42c0 con 0x5640e12f0720 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.971+0000 7f549e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12ef830 0x5640e1300ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12ef830 0x5640e1300ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42128/0 (socket says 172.21.15.12:42128) 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549e7fc700 1 -- 172.21.15.12:0/221407107 learned_addr learned my addr 172.21.15.12:0/221407107 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549effd700 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549f7fe700 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 0x5640e12f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549effd700 1 -- 172.21.15.12:0/221407107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 msgr2=0x5640e12f0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549effd700 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 0x5640e12f0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549effd700 1 -- 172.21.15.12:0/221407107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12ef830 msgr2=0x5640e1300ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549effd700 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12ef830 0x5640e1300ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549effd700 1 -- 172.21.15.12:0/221407107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640e106cd80 con 0x5640e12eeed0 2023-12-11T20:22:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549e7fc700 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12ef830 0x5640e1300ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549f7fe700 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 0x5640e12f0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f549effd700 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5490009350 tx=0x7f54900cb8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb8839a2caf2fdc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.972+0000 7f5485ffb700 1 -- 172.21.15.12:0/221407107 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549009b0a0 con 0x5640e12eeed0 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f5485ffb700 1 -- 172.21.15.12:0/221407107 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f549009b9d0 con 0x5640e12eeed0 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f5485ffb700 1 -- 172.21.15.12:0/221407107 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549009f1f0 con 0x5640e12eeed0 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/221407107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 msgr2=0x5640e12ef2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5490009350 tx=0x7f54900cb8f0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/221407107 shutdown_connections 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12eeed0 0x5640e12ef2b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 0x5640e12f0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/221407107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12ef830 0x5640e1300ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/221407107 >> 172.21.15.12:0/221407107 conn(0x5640e121e780 msgr2=0x5640e12f6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/221407107 shutdown_connections 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.973+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/221407107 wait complete. 2023-12-11T20:22:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 1 -- start start 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 1 Processor -- start 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12eeed0 0x5640e12fd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12fdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 0x5640e12fec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e12ff170 con 0x5640e12eeed0 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e12ff2e0 con 0x5640e12ef830 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640e12ff4a0 con 0x5640e12f0720 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.974+0000 7f54b8dc1b80 10 client.0 _ll_register_callbacks cb 0x5640e1128a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12eeed0 0x5640e12fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12eeed0 0x5640e12fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42132/0 (socket says 172.21.15.12:42132) 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 -- 172.21.15.12:0/4004953872 learned_addr learned my addr 172.21.15.12:0/4004953872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549e7fc700 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12fdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 -- 172.21.15.12:0/4004953872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 msgr2=0x5640e12fec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 0x5640e12fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 -- 172.21.15.12:0/4004953872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 msgr2=0x5640e12fdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12fdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 -- 172.21.15.12:0/4004953872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498007560 con 0x5640e12eeed0 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f549effd700 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12eeed0 0x5640e12fd780 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f54900977d0 tx=0x7f5490097720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fafe5744b43a564 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.975+0000 7f5482ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f5482ff5700 1 -- 172.21.15.12:0/4004953872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549009f420 con 0x5640e12eeed0 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f5482ff5700 1 -- 172.21.15.12:0/4004953872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f549009f1d0 con 0x5640e12eeed0 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/4004953872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f549800f040 con 0x5640e12eeed0 2023-12-11T20:22:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f5482ff5700 1 -- 172.21.15.12:0/4004953872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54900a3140 con 0x5640e12eeed0 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 10 client.17259 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/4004953872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f54a01a1a30 con 0x5640e12eeed0 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f5482ff5700 1 -- 172.21.15.12:0/4004953872 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54900b9020 con 0x5640e12eeed0 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f5482ff5700 1 -- 172.21.15.12:0/4004953872 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f54900970c0 con 0x5640e12eeed0 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 10 client.17259 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 10 client.17259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 20 client.17259 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5640e135b4a0 0x5640e135d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 4 client.17259 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.976+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/4004953872 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5640e1209f70 con 0x5640e135b4a0 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.977+0000 7f549e7fc700 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5640e135b4a0 0x5640e135d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.977+0000 7f549e7fc700 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5640e135b4a0 0x5640e135d8c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40403ccd71afc2c2 server_cookie=dc2dec95a55a97b3 in_seq=0 out_seq=0 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.977+0000 7f5482ff5700 10 client.17259 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:08.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f5482ff5700 1 -- 172.21.15.12:0/4004953872 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5640e1209f70 con 0x5640e135b4a0 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f5482ff5700 10 client.17259 handle_command_reply: tid=0 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 client.17259 shutdown 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/4004953872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12eeed0 msgr2=0x5640e12fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12eeed0 0x5640e12fd780 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f54900977d0 tx=0x7f5490097720 comp rx=0 tx=0).stop 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/4004953872 shutdown_connections 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5640e135b4a0 0x5640e135d8c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5640e12f0720 0x5640e12fec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640e12eeed0 0x5640e12fd780 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 --2- 172.21.15.12:0/4004953872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5640e12ef830 0x5640e12fdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f5482ff5700 0 client.17259 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.988+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/4004953872 >> 172.21.15.12:0/4004953872 conn(0x5640e121e780 msgr2=0x5640e1300ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.989+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/4004953872 shutdown_connections 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.989+0000 7f54b8dc1b80 1 -- 172.21.15.12:0/4004953872 wait complete. 2023-12-11T20:22:08.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.989+0000 7f54b8dc1b80 20 client.17259 trim_cache size 0 max 16384 2023-12-11T20:22:08.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:22:08.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:22:08.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:22:08.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.989+0000 7f54a53ff700 1 -- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54880a14f0 msgr2=0x7f54880a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.989+0000 7f54a53ff700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54880a14f0 0x7f54880a39b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5498004230 tx=0x7f5498009c50 comp rx=0 tx=0).stop 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.989+0000 7f54a53ff700 1 -- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 msgr2=0x7f54a0199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.989+0000 7f54a53ff700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 0x7f54a0199590 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5490009990 tx=0x7f549000fa00 comp rx=0 tx=0).stop 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.990+0000 7f54a53ff700 1 -- 172.21.15.12:0/2625823139 shutdown_connections 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.990+0000 7f54a53ff700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f54880a14f0 0x7f54880a39b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.990+0000 7f54a53ff700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54a0103060 0x7f54a01a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.990+0000 7f54a53ff700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54a01014d0 0x7f54a0199590 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.990+0000 7f54a53ff700 1 --2- 172.21.15.12:0/2625823139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54a01026c0 0x7f54a0199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.990+0000 7f54a53ff700 1 -- 172.21.15.12:0/2625823139 >> 172.21.15.12:0/2625823139 conn(0x7f54a00fca60 msgr2=0x7f54a0107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.990+0000 7f54a53ff700 1 -- 172.21.15.12:0/2625823139 shutdown_connections 2023-12-11T20:22:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:07.990+0000 7f54a53ff700 1 -- 172.21.15.12:0/2625823139 wait complete. 2023-12-11T20:22:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:09 smithi032 ceph-mon[132488]: pgmap v562: 97 pgs: 97 active+clean; 4.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:09.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:09 smithi039 ceph-mon[102205]: pgmap v562: 97 pgs: 97 active+clean; 4.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:09.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:09 smithi012 ceph-mon[128787]: pgmap v562: 97 pgs: 97 active+clean; 4.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:11.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:11 smithi039 ceph-mon[102205]: pgmap v563: 97 pgs: 97 active+clean; 4.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:22:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:11 smithi012 ceph-mon[128787]: pgmap v563: 97 pgs: 97 active+clean; 4.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:22:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:11 smithi032 ceph-mon[132488]: pgmap v563: 97 pgs: 97 active+clean; 4.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:22:13.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:13 smithi039 ceph-mon[102205]: pgmap v564: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:22:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:13 smithi012 ceph-mon[128787]: pgmap v564: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:22:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:13 smithi032 ceph-mon[132488]: pgmap v564: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:22:14.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:14 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:22:14.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:14 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:22:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:14 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:22:15.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:15 smithi039 ceph-mon[102205]: pgmap v565: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:15.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:15 smithi012 ceph-mon[128787]: pgmap v565: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:15.966 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:15 smithi032 ceph-mon[132488]: pgmap v565: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi012 to 223.0M 2023-12-11T20:22:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: Unable to set osd_memory_target on smithi012 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:22:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:22:16.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:22:16.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:22:16.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi012 to 223.0M 2023-12-11T20:22:16.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: Unable to set osd_memory_target on smithi012 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:22:16.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:22:16.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:22:16.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi012 to 223.0M 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: Unable to set osd_memory_target on smithi012 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:22:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:22:17.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:17 smithi039 ceph-mon[102205]: pgmap v566: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:22:17.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:17 smithi012 ceph-mon[128787]: pgmap v566: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:22:17.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:17 smithi032 ceph-mon[132488]: pgmap v566: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:22:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:19 smithi032 ceph-mon[132488]: pgmap v567: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:19.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:19 smithi039 ceph-mon[102205]: pgmap v567: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:19 smithi012 ceph-mon[128787]: pgmap v567: 97 pgs: 97 active+clean; 4.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:21.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 -- 172.21.15.12:0/3991082048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 msgr2=0x7f4d70106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3991082048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 0x7f4d70106c60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009990 tx=0x7f4d64009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 -- 172.21.15.12:0/3991082048 shutdown_connections 2023-12-11T20:22:21.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3991082048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d701071a0 0x7f4d70109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3991082048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d70101f40 0x7f4d70104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3991082048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 0x7f4d70106c60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 -- 172.21.15.12:0/3991082048 >> 172.21.15.12:0/3991082048 conn(0x7f4d700fb930 msgr2=0x7f4d700fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:21.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 -- 172.21.15.12:0/3991082048 shutdown_connections 2023-12-11T20:22:21.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.158+0000 7f4d763ff700 1 -- 172.21.15.12:0/3991082048 wait complete. 2023-12-11T20:22:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.159+0000 7f4d763ff700 1 Processor -- start 2023-12-11T20:22:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d763ff700 1 -- start start 2023-12-11T20:22:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d763ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d70101f40 0x7f4d701994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d763ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 0x7f4d70199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d763ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d701071a0 0x7f4d701a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d763ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701a1020 con 0x7f4d70104870 2023-12-11T20:22:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d763ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701a1160 con 0x7f4d70101f40 2023-12-11T20:22:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d763ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701a12f0 con 0x7f4d701071a0 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 0x7f4d70199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.160+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 0x7f4d70199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53720/0 (socket says 172.21.15.12:53720) 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/3213957993 learned_addr learned my addr 172.21.15.12:0/3213957993 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d6ffff700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d70101f40 0x7f4d701994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d7499c700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d701071a0 0x7f4d701a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/3213957993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d701071a0 msgr2=0x7f4d701a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d701071a0 0x7f4d701a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/3213957993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d70101f40 msgr2=0x7f4d701994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d70101f40 0x7f4d701994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/3213957993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640095f0 con 0x7f4d70104870 2023-12-11T20:22:21.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.161+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 0x7f4d70199a30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4d64004710 tx=0x7f4d64009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:21.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.162+0000 7f4d6d7fa700 1 -- 172.21.15.12:0/3213957993 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6401d070 con 0x7f4d70104870 2023-12-11T20:22:21.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.162+0000 7f4d763ff700 1 -- 172.21.15.12:0/3213957993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d701a1570 con 0x7f4d70104870 2023-12-11T20:22:21.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.162+0000 7f4d6d7fa700 1 -- 172.21.15.12:0/3213957993 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d6400be70 con 0x7f4d70104870 2023-12-11T20:22:21.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.162+0000 7f4d763ff700 1 -- 172.21.15.12:0/3213957993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d701a19a0 con 0x7f4d70104870 2023-12-11T20:22:21.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.162+0000 7f4d6d7fa700 1 -- 172.21.15.12:0/3213957993 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64021410 con 0x7f4d70104870 2023-12-11T20:22:21.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.165+0000 7f4d6d7fa700 1 -- 172.21.15.12:0/3213957993 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4d6400f6f0 con 0x7f4d70104870 2023-12-11T20:22:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d89de1b80 1 Processor -- start 2023-12-11T20:22:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d89de1b80 1 -- start start 2023-12-11T20:22:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d6d7fa700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d580a1470 0x7f4d580a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68da2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d6d7fa700 1 -- 172.21.15.12:0/3213957993 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d640ce0a0 con 0x7f4d70104870 2023-12-11T20:22:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68db720 0x5591a68dbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a6835af0 con 0x5591a68d9ed0 2023-12-11T20:22:21.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a6833410 con 0x5591a68db720 2023-12-11T20:22:21.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.167+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a682ed00 con 0x5591a68da830 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68da2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68da2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53728/0 (socket says 172.21.15.12:53728) 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6ffff700 1 -- 172.21.15.12:0/691118388 learned_addr learned my addr 172.21.15.12:0/691118388 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d7499c700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d580a1470 0x7f4d580a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d7499c700 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68db720 0x5591a68dbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/691118388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68db720 msgr2=0x5591a68dbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68db720 0x5591a68dbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/691118388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 msgr2=0x5591a68da2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68da2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.168+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/691118388 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591a66ab5d0 con 0x5591a68da830 2023-12-11T20:22:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.169+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68db140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d6409b0a0 tx=0x7f4d64009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12e47a9760c74b53 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.169+0000 7f4d7499c700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d580a1470 0x7f4d580a3930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x5591a68daf00 tx=0x7f4d68009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.169+0000 7f4d567fc700 1 -- 172.21.15.12:0/691118388 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6409baa0 con 0x5591a68da830 2023-12-11T20:22:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.169+0000 7f4d567fc700 1 -- 172.21.15.12:0/691118388 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d6409b3a0 con 0x5591a68da830 2023-12-11T20:22:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.169+0000 7f4d567fc700 1 -- 172.21.15.12:0/691118388 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6409f120 con 0x5591a68da830 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 -- 172.21.15.12:0/691118388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 msgr2=0x5591a68db140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68db140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d6409b0a0 tx=0x7f4d64009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 -- 172.21.15.12:0/691118388 shutdown_connections 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68db720 0x5591a68dbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68da2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/691118388 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68db140 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 -- 172.21.15.12:0/691118388 >> 172.21.15.12:0/691118388 conn(0x5591a6809780 msgr2=0x5591a68d6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 -- 172.21.15.12:0/691118388 shutdown_connections 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.170+0000 7f4d89de1b80 1 -- 172.21.15.12:0/691118388 wait complete. 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 1 -- start start 2023-12-11T20:22:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 1 Processor -- start 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 0x5591a68e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68da830 0x5591a68e4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 0x5591a68eae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a67e8500 con 0x5591a68da830 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a67e81a0 con 0x5591a68d9ed0 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a66ad8c0 con 0x5591a68db720 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.171+0000 7f4d89de1b80 10 client.0 _ll_register_callbacks cb 0x5591a6713a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68da830 0x5591a68e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68da830 0x5591a68e4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53738/0 (socket says 172.21.15.12:53738) 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/3042517904 learned_addr learned my addr 172.21.15.12:0/3042517904 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d7499c700 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 0x5591a68eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6ffff700 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 0x5591a68e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/3042517904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 msgr2=0x5591a68eae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 0x5591a68eae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/3042517904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 msgr2=0x5591a68e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 0x5591a68e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.172+0000 7f4d6f7fe700 1 -- 172.21.15.12:0/3042517904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d701a19a0 con 0x5591a68da830 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68da830 0x5591a68e4050 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4d6409ba00 tx=0x7f4d64097750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5698348eeae5bdc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/3042517904 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640a36a0 con 0x5591a68da830 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/3042517904 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d640b1020 con 0x5591a68da830 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d89de1b80 1 -- 172.21.15.12:0/3042517904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591a68cd730 con 0x5591a68da830 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/3042517904 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d6409a890 con 0x5591a68da830 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d89de1b80 10 client.17271 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d89de1b80 1 -- 172.21.15.12:0/3042517904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5591a6657d80 con 0x5591a68da830 2023-12-11T20:22:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/3042517904 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591a68cd730 con 0x5591a68da830 2023-12-11T20:22:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.173+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/3042517904 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4d6407b070 con 0x5591a68da830 2023-12-11T20:22:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.174+0000 7f4d89de1b80 10 client.17271 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.174+0000 7f4d89de1b80 10 client.17271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.174+0000 7f4d89de1b80 20 client.17271 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.174+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591a68ef410 0x5591a68f1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.174+0000 7f4d89de1b80 4 client.17271 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.174+0000 7f4d89de1b80 1 -- 172.21.15.12:0/3042517904 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591a68a9ee0 con 0x5591a68ef410 2023-12-11T20:22:21.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.174+0000 7f4d6ffff700 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591a68ef410 0x5591a68f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.175+0000 7f4d6ffff700 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591a68ef410 0x5591a68f1830 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=607e2a28f40c946d server_cookie=271117d28a2245b8 in_seq=0 out_seq=0 2023-12-11T20:22:21.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.175+0000 7f4d4f7fe700 10 client.17271 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:21.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/3042517904 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5591a68a9ee0 con 0x5591a68ef410 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d4f7fe700 10 client.17271 handle_command_reply: tid=0 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 client.17271 shutdown 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 -- 172.21.15.12:0/3042517904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68da830 msgr2=0x5591a68e4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68da830 0x5591a68e4050 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4d6409ba00 tx=0x7f4d64097750 comp rx=0 tx=0).stop 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 -- 172.21.15.12:0/3042517904 shutdown_connections 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591a68ef410 0x5591a68f1830 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 0x5591a68e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 0x5591a68eae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/3042517904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68da830 0x5591a68e4050 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d4f7fe700 0 client.17271 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 -- 172.21.15.12:0/3042517904 >> 172.21.15.12:0/3042517904 conn(0x5591a6809780 msgr2=0x5591a68d4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 -- 172.21.15.12:0/3042517904 shutdown_connections 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 1 -- 172.21.15.12:0/3042517904 wait complete. 2023-12-11T20:22:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.176+0000 7f4d89de1b80 20 client.17271 trim_cache size 0 max 16384 2023-12-11T20:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.200+0000 7f4d89de1b80 1 Processor -- start 2023-12-11T20:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.200+0000 7f4d89de1b80 1 -- start start 2023-12-11T20:22:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.200+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 0x5591a68eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.200+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68eae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.200+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68db720 0x5591a68dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.200+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a68cd700 con 0x5591a68db720 2023-12-11T20:22:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.200+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a68e3470 con 0x5591a68d9ed0 2023-12-11T20:22:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.200+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a68e2900 con 0x5591a68da830 2023-12-11T20:22:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d7499c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68db720 0x5591a68dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d7499c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68db720 0x5591a68dbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53744/0 (socket says 172.21.15.12:53744) 2023-12-11T20:22:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d7499c700 1 -- 172.21.15.12:0/2247109754 learned_addr learned my addr 172.21.15.12:0/2247109754 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68eae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d6ffff700 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 0x5591a68eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d7499c700 1 -- 172.21.15.12:0/2247109754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 msgr2=0x5591a68eae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d7499c700 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68eae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d7499c700 1 -- 172.21.15.12:0/2247109754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 msgr2=0x5591a68eb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d7499c700 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 0x5591a68eb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.201+0000 7f4d7499c700 1 -- 172.21.15.12:0/2247109754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591a6640c00 con 0x5591a68db720 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.202+0000 7f4d7499c700 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68db720 0x5591a68dbb00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009300 tx=0x7f4d6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6138452865a92187 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.202+0000 7f4d56ffd700 1 -- 172.21.15.12:0/2247109754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800e040 con 0x5591a68db720 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.202+0000 7f4d56ffd700 1 -- 172.21.15.12:0/2247109754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d68007990 con 0x5591a68db720 2023-12-11T20:22:21.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.202+0000 7f4d56ffd700 1 -- 172.21.15.12:0/2247109754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680258d0 con 0x5591a68db720 2023-12-11T20:22:21.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 -- 172.21.15.12:0/2247109754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68db720 msgr2=0x5591a68dbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68db720 0x5591a68dbb00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009300 tx=0x7f4d6800b040 comp rx=0 tx=0).stop 2023-12-11T20:22:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 -- 172.21.15.12:0/2247109754 shutdown_connections 2023-12-11T20:22:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68d9ed0 0x5591a68eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68db720 0x5591a68dbb00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/2247109754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68da830 0x5591a68eae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 -- 172.21.15.12:0/2247109754 >> 172.21.15.12:0/2247109754 conn(0x5591a6809780 msgr2=0x5591a68e3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:21.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 -- 172.21.15.12:0/2247109754 shutdown_connections 2023-12-11T20:22:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 -- 172.21.15.12:0/2247109754 wait complete. 2023-12-11T20:22:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.203+0000 7f4d89de1b80 1 -- start start 2023-12-11T20:22:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d89de1b80 1 Processor -- start 2023-12-11T20:22:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68da830 0x5591a68e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d89de1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 0x5591a68ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a68ea5f0 con 0x5591a68d9ed0 2023-12-11T20:22:21.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a68ea760 con 0x5591a68da830 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d89de1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a68ea920 con 0x5591a68db720 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d89de1b80 10 client.0 _ll_register_callbacks cb 0x5591a6713a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68e8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53760/0 (socket says 172.21.15.12:53760) 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.204+0000 7f4d6ffff700 1 -- 172.21.15.12:0/1296899201 learned_addr learned my addr 172.21.15.12:0/1296899201 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.205+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68da830 0x5591a68e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.205+0000 7f4d6ffff700 1 -- 172.21.15.12:0/1296899201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 msgr2=0x5591a68ea0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.205+0000 7f4d6ffff700 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 0x5591a68ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.205+0000 7f4d6ffff700 1 -- 172.21.15.12:0/1296899201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68da830 msgr2=0x5591a68e90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.205+0000 7f4d6ffff700 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68da830 0x5591a68e90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.205+0000 7f4d6ffff700 1 -- 172.21.15.12:0/1296899201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d68009070 con 0x5591a68d9ed0 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.205+0000 7f4d6ffff700 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68e8bb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x5591a68f2120 tx=0x7f4d6000bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652005b81e307f29 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.205+0000 7f4d4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:21.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.206+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/1296899201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60016070 con 0x5591a68d9ed0 2023-12-11T20:22:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.206+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/1296899201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d60003e70 con 0x5591a68d9ed0 2023-12-11T20:22:21.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.206+0000 7f4d89de1b80 1 -- 172.21.15.12:0/1296899201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d6409b3a0 con 0x5591a68d9ed0 2023-12-11T20:22:21.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.206+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/1296899201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d6001f040 con 0x5591a68d9ed0 2023-12-11T20:22:21.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.206+0000 7f4d89de1b80 10 client.17277 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.206+0000 7f4d89de1b80 1 -- 172.21.15.12:0/1296899201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5591a667e1f0 con 0x5591a68d9ed0 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.206+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/1296899201 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d6409b3a0 con 0x5591a68d9ed0 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.207+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/1296899201 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4d600117a0 con 0x5591a68d9ed0 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.207+0000 7f4d89de1b80 10 client.17277 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.207+0000 7f4d89de1b80 10 client.17277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.207+0000 7f4d89de1b80 20 client.17277 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.207+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591a6946970 0x5591a6948d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.207+0000 7f4d89de1b80 4 client.17277 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.207+0000 7f4d89de1b80 1 -- 172.21.15.12:0/1296899201 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5591a67f4f70 con 0x5591a6946970 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.207+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591a6946970 0x5591a6948d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.208+0000 7f4d6f7fe700 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591a6946970 0x5591a6948d90 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7040db992320809d server_cookie=4f34ad54d9edf16a in_seq=0 out_seq=0 2023-12-11T20:22:21.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.208+0000 7f4d4f7fe700 10 client.17277 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d4f7fe700 1 -- 172.21.15.12:0/1296899201 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5591a67f4f70 con 0x5591a6946970 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d4f7fe700 10 client.17277 handle_command_reply: tid=0 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 client.17277 shutdown 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 -- 172.21.15.12:0/1296899201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 msgr2=0x5591a68e8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68e8bb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x5591a68f2120 tx=0x7f4d6000bd00 comp rx=0 tx=0).stop 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 -- 172.21.15.12:0/1296899201 shutdown_connections 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591a6946970 0x5591a6948d90 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a68db720 0x5591a68ea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591a68d9ed0 0x5591a68e8bb0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 --2- 172.21.15.12:0/1296899201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591a68da830 0x5591a68e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d4f7fe700 0 client.17277 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 -- 172.21.15.12:0/1296899201 >> 172.21.15.12:0/1296899201 conn(0x5591a6809780 msgr2=0x5591a68e3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 -- 172.21.15.12:0/1296899201 shutdown_connections 2023-12-11T20:22:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 1 -- 172.21.15.12:0/1296899201 wait complete. 2023-12-11T20:22:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.218+0000 7f4d89de1b80 20 client.17277 trim_cache size 0 max 16384 2023-12-11T20:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 -- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d580a1470 msgr2=0x7f4d580a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d580a1470 0x7f4d580a3930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x5591a68daf00 tx=0x7f4d68009920 comp rx=0 tx=0).stop 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 -- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 msgr2=0x7f4d70199a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 0x7f4d70199a30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4d64004710 tx=0x7f4d64009580 comp rx=0 tx=0).stop 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 -- 172.21.15.12:0/3213957993 shutdown_connections 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4d580a1470 0x7f4d580a3930 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d70101f40 0x7f4d701994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d701071a0 0x7f4d701a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 --2- 172.21.15.12:0/3213957993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70104870 0x7f4d70199a30 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 -- 172.21.15.12:0/3213957993 >> 172.21.15.12:0/3213957993 conn(0x7f4d700fb930 msgr2=0x7f4d70101820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 -- 172.21.15.12:0/3213957993 shutdown_connections 2023-12-11T20:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:21.219+0000 7f4d763ff700 1 -- 172.21.15.12:0/3213957993 wait complete. 2023-12-11T20:22:21.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:21 smithi039 ceph-mon[102205]: pgmap v568: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:22:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:21 smithi012 ceph-mon[128787]: pgmap v568: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:22:21.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:21 smithi032 ceph-mon[132488]: pgmap v568: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:22:22.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:22:22.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 -- 172.21.15.12:0/3370176167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c1072a0 msgr2=0x7f938c109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 --2- 172.21.15.12:0/3370176167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c1072a0 0x7f938c109690 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f938400b0a0 tx=0x7f938400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 -- 172.21.15.12:0/3370176167 shutdown_connections 2023-12-11T20:22:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 --2- 172.21.15.12:0/3370176167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c1072a0 0x7f938c109690 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 --2- 172.21.15.12:0/3370176167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f938c102040 0x7f938c104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 --2- 172.21.15.12:0/3370176167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f938c104970 0x7f938c106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 -- 172.21.15.12:0/3370176167 >> 172.21.15.12:0/3370176167 conn(0x7f938c0fb930 msgr2=0x7f938c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 -- 172.21.15.12:0/3370176167 shutdown_connections 2023-12-11T20:22:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.930+0000 7f9393dff700 1 -- 172.21.15.12:0/3370176167 wait complete. 2023-12-11T20:22:22.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.931+0000 7f9393dff700 1 Processor -- start 2023-12-11T20:22:22.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.931+0000 7f9393dff700 1 -- start start 2023-12-11T20:22:22.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f9393dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f938c102040 0x7f938c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f9393dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c104970 0x7f938c199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f9393dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f938c1072a0 0x7f938c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f9393dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c1a1160 con 0x7f938c104970 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f9393dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c1a12a0 con 0x7f938c102040 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f9393dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c1a1430 con 0x7f938c1072a0 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f939139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c104970 0x7f938c199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f939139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c104970 0x7f938c199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53776/0 (socket says 172.21.15.12:53776) 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f939139a700 1 -- 172.21.15.12:0/2166481290 learned_addr learned my addr 172.21.15.12:0/2166481290 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f939239c700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f938c1072a0 0x7f938c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.932+0000 7f9391b9b700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f938c102040 0x7f938c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f939139a700 1 -- 172.21.15.12:0/2166481290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f938c1072a0 msgr2=0x7f938c1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f939139a700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f938c1072a0 0x7f938c1a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f939139a700 1 -- 172.21.15.12:0/2166481290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f938c102040 msgr2=0x7f938c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f939139a700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f938c102040 0x7f938c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f939139a700 1 -- 172.21.15.12:0/2166481290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9384009d00 con 0x7f938c104970 2023-12-11T20:22:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f939139a700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c104970 0x7f938c199b70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f937c00d980 tx=0x7f937c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:22.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f9382ffd700 1 -- 172.21.15.12:0/2166481290 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c004220 con 0x7f938c104970 2023-12-11T20:22:22.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f9382ffd700 1 -- 172.21.15.12:0/2166481290 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f937c007640 con 0x7f938c104970 2023-12-11T20:22:22.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f9382ffd700 1 -- 172.21.15.12:0/2166481290 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c005660 con 0x7f938c104970 2023-12-11T20:22:22.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f9393dff700 1 -- 172.21.15.12:0/2166481290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c1a1710 con 0x7f938c104970 2023-12-11T20:22:22.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.933+0000 7f9393dff700 1 -- 172.21.15.12:0/2166481290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c1a1bd0 con 0x7f938c104970 2023-12-11T20:22:22.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.937+0000 7f9382ffd700 1 -- 172.21.15.12:0/2166481290 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f937c004750 con 0x7f938c104970 2023-12-11T20:22:22.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.938+0000 7f93a7753b80 1 Processor -- start 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.938+0000 7f93a7753b80 1 -- start start 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.938+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c3637f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.938+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c363d30 0x55f53c364640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.938+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c3650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.938+0000 7f93a7753b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c2beb50 con 0x55f53c3633d0 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.938+0000 7f93a7753b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c2bc470 con 0x55f53c363d30 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.938+0000 7f93a7753b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c2b7d60 con 0x55f53c364c20 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c3637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c3637f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53778/0 (socket says 172.21.15.12:53778) 2023-12-11T20:22:22.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939239c700 1 -- 172.21.15.12:0/4202582014 learned_addr learned my addr 172.21.15.12:0/4202582014 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:22.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939139a700 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c3650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f9391b9b700 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c363d30 0x55f53c364640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939139a700 1 -- 172.21.15.12:0/4202582014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c363d30 msgr2=0x55f53c364640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:22.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939139a700 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c363d30 0x55f53c364640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939139a700 1 -- 172.21.15.12:0/4202582014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 msgr2=0x55f53c3637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:22.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939139a700 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c3637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939139a700 1 -- 172.21.15.12:0/4202582014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f53c134630 con 0x55f53c364c20 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.939+0000 7f939239c700 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c3637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.940+0000 7f939139a700 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c3650a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f937c0ca420 tx=0x7f937c0d2d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4657619f0c62756 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.940+0000 7f9382ffd700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93780a1500 0x7f93780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.940+0000 7f939239c700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93780a1500 0x7f93780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.940+0000 7f9377fff700 1 -- 172.21.15.12:0/4202582014 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c095fe0 con 0x55f53c364c20 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.940+0000 7f9382ffd700 1 -- 172.21.15.12:0/2166481290 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f937c0cca30 con 0x7f938c104970 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.940+0000 7f9377fff700 1 -- 172.21.15.12:0/4202582014 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f937c0d26d0 con 0x55f53c364c20 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.940+0000 7f9377fff700 1 -- 172.21.15.12:0/4202582014 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c099a70 con 0x55f53c364c20 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f939239c700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93780a1500 0x7f93780a39c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f938400d010 tx=0x7f938400b720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 -- 172.21.15.12:0/4202582014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 msgr2=0x55f53c3650a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c3650a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f937c0ca420 tx=0x7f937c0d2d40 comp rx=0 tx=0).stop 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 -- 172.21.15.12:0/4202582014 shutdown_connections 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c3650a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c3637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 --2- 172.21.15.12:0/4202582014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c363d30 0x55f53c364640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 -- 172.21.15.12:0/4202582014 >> 172.21.15.12:0/4202582014 conn(0x55f53c2927e0 msgr2=0x55f53c35fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:22.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 -- 172.21.15.12:0/4202582014 shutdown_connections 2023-12-11T20:22:22.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.941+0000 7f93a7753b80 1 -- 172.21.15.12:0/4202582014 wait complete. 2023-12-11T20:22:22.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.942+0000 7f93a7753b80 1 -- start start 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.942+0000 7f93a7753b80 1 Processor -- start 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c3633d0 0x55f53c36d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c36d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c374610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f93a7753b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c271560 con 0x55f53c363d30 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f93a7753b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c271200 con 0x55f53c3633d0 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f93a7753b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c136920 con 0x55f53c364c20 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f93a7753b80 10 client.0 _ll_register_callbacks cb 0x55f53c19ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f939139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c36d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f9391b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c3633d0 0x55f53c36d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f9391b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c3633d0 0x55f53c36d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46578/0 (socket says 172.21.15.12:46578) 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f9391b9b700 1 -- 172.21.15.12:0/331453082 learned_addr learned my addr 172.21.15.12:0/331453082 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:22.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.943+0000 7f939239c700 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c374610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f939139a700 1 -- 172.21.15.12:0/331453082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 msgr2=0x55f53c374610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f939139a700 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c374610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f939139a700 1 -- 172.21.15.12:0/331453082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c3633d0 msgr2=0x55f53c36d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f939139a700 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c3633d0 0x55f53c36d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f939139a700 1 -- 172.21.15.12:0/331453082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c10a260 con 0x55f53c363d30 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f9391b9b700 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c3633d0 0x55f53c36d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f939139a700 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c36d5d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f937c099c30 tx=0x7f937c0d2f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68cd2ff74b11882 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f93757fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f93757fa700 1 -- 172.21.15.12:0/331453082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c099600 con 0x55f53c363d30 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f93757fa700 1 -- 172.21.15.12:0/331453082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f937c0cee40 con 0x55f53c363d30 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f93a7753b80 1 -- 172.21.15.12:0/331453082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f53c332f40 con 0x55f53c363d30 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f93757fa700 1 -- 172.21.15.12:0/331453082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f937c095fe0 con 0x55f53c363d30 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f93a7753b80 10 client.17289 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.944+0000 7f93a7753b80 1 -- 172.21.15.12:0/331453082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f938c1a1bd0 con 0x55f53c363d30 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f93757fa700 1 -- 172.21.15.12:0/331453082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f53c332f40 con 0x55f53c363d30 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f93757fa700 1 -- 172.21.15.12:0/331453082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f937c0963b0 con 0x55f53c363d30 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f93a7753b80 10 client.17289 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f93a7753b80 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f93a7753b80 20 client.17289 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f93a7753b80 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f53c3788e0 0x55f53c37ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f93a7753b80 4 client.17289 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f93a7753b80 1 -- 172.21.15.12:0/331453082 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f53c27dfd0 con 0x55f53c3788e0 2023-12-11T20:22:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.945+0000 7f9391b9b700 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f53c3788e0 0x55f53c37ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.946+0000 7f9391b9b700 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f53c3788e0 0x55f53c37ad00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d0363f6df38d87 server_cookie=8d278d010a98a19f in_seq=0 out_seq=0 2023-12-11T20:22:22.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.946+0000 7f93757fa700 10 client.17289 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:22.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93757fa700 1 -- 172.21.15.12:0/331453082 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f53c27dfd0 con 0x55f53c3788e0 2023-12-11T20:22:22.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93757fa700 10 client.17289 handle_command_reply: tid=0 2023-12-11T20:22:22.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 client.17289 shutdown 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 -- 172.21.15.12:0/331453082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 msgr2=0x55f53c36d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c36d5d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f937c099c30 tx=0x7f937c0d2f40 comp rx=0 tx=0).stop 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 -- 172.21.15.12:0/331453082 shutdown_connections 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f53c3788e0 0x55f53c37ad00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c3633d0 0x55f53c36d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c364c20 0x55f53c374610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 --2- 172.21.15.12:0/331453082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c36d5d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93757fa700 0 client.17289 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 -- 172.21.15.12:0/331453082 >> 172.21.15.12:0/331453082 conn(0x55f53c2927e0 msgr2=0x55f53c35ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 -- 172.21.15.12:0/331453082 shutdown_connections 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.947+0000 7f93a7753b80 1 -- 172.21.15.12:0/331453082 wait complete. 2023-12-11T20:22:22.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.948+0000 7f93a7753b80 20 client.17289 trim_cache size 0 max 16384 2023-12-11T20:22:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.967+0000 7f93a7753b80 1 Processor -- start 2023-12-11T20:22:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.967+0000 7f93a7753b80 1 -- start start 2023-12-11T20:22:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c37f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c363d30 0x55f53c3745d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c36d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f93a7753b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c36cc60 con 0x55f53c3633d0 2023-12-11T20:22:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f93a7753b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c360390 con 0x55f53c364c20 2023-12-11T20:22:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f93a7753b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c3757c0 con 0x55f53c363d30 2023-12-11T20:22:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f9391b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c37f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f9391b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c37f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53804/0 (socket says 172.21.15.12:53804) 2023-12-11T20:22:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f9391b9b700 1 -- 172.21.15.12:0/2660028420 learned_addr learned my addr 172.21.15.12:0/2660028420 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.968+0000 7f939139a700 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c363d30 0x55f53c3745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f939239c700 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c36d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9391b9b700 1 -- 172.21.15.12:0/2660028420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c363d30 msgr2=0x55f53c3745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9391b9b700 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c363d30 0x55f53c3745d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9391b9b700 1 -- 172.21.15.12:0/2660028420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 msgr2=0x55f53c36d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9391b9b700 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c36d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9391b9b700 1 -- 172.21.15.12:0/2660028420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f53c0e0de0 con 0x55f53c3633d0 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f939239c700 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c36d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9391b9b700 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c37f640 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f93880097a0 tx=0x7f9388009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba169dfb5d8b658 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9380bff700 1 -- 172.21.15.12:0/2660028420 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388015050 con 0x55f53c3633d0 2023-12-11T20:22:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9380bff700 1 -- 172.21.15.12:0/2660028420 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9388020030 con 0x55f53c3633d0 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.969+0000 7f9380bff700 1 -- 172.21.15.12:0/2660028420 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388004b40 con 0x55f53c3633d0 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 -- 172.21.15.12:0/2660028420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 msgr2=0x55f53c37f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c37f640 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f93880097a0 tx=0x7f9388009260 comp rx=0 tx=0).stop 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 -- 172.21.15.12:0/2660028420 shutdown_connections 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c36d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c3633d0 0x55f53c37f640 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 --2- 172.21.15.12:0/2660028420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c363d30 0x55f53c3745d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 -- 172.21.15.12:0/2660028420 >> 172.21.15.12:0/2660028420 conn(0x55f53c2927e0 msgr2=0x55f53c36bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 -- 172.21.15.12:0/2660028420 shutdown_connections 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.970+0000 7f93a7753b80 1 -- 172.21.15.12:0/2660028420 wait complete. 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.971+0000 7f93a7753b80 1 -- start start 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.971+0000 7f93a7753b80 1 Processor -- start 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.971+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c3633d0 0x55f53c372600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.971+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c372b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.971+0000 7f93a7753b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c373ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.971+0000 7f93a7753b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c373ff0 con 0x55f53c363d30 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.971+0000 7f93a7753b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c374160 con 0x55f53c364c20 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.971+0000 7f93a7753b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f53c374320 con 0x55f53c3633d0 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f93a7753b80 10 client.0 _ll_register_callbacks cb 0x55f53c19ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f939139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c372b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f9391b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c3633d0 0x55f53c372600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f939139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c372b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53816/0 (socket says 172.21.15.12:53816) 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f939139a700 1 -- 172.21.15.12:0/349944635 learned_addr learned my addr 172.21.15.12:0/349944635 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f9391b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c3633d0 0x55f53c372600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:41866/0 (socket says 172.21.15.12:41866) 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f939239c700 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c373ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f9391b9b700 1 -- 172.21.15.12:0/349944635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 msgr2=0x55f53c373ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f9391b9b700 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c373ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f9391b9b700 1 -- 172.21.15.12:0/349944635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 msgr2=0x55f53c372b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f9391b9b700 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c372b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f9391b9b700 1 -- 172.21.15.12:0/349944635 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9388004040 con 0x55f53c3633d0 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.972+0000 7f939139a700 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c372b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.973+0000 7f9391b9b700 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c3633d0 0x55f53c372600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f938801f040 tx=0x7f9388005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10e51e8ba0dc89ce server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.973+0000 7f93757fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.973+0000 7f93757fa700 1 -- 172.21.15.12:0/349944635 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938801c880 con 0x55f53c3633d0 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.973+0000 7f93a7753b80 1 -- 172.21.15.12:0/349944635 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f53c356b40 con 0x55f53c3633d0 2023-12-11T20:22:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.973+0000 7f93757fa700 1 -- 172.21.15.12:0/349944635 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f93880048c0 con 0x55f53c3633d0 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.973+0000 7f93757fa700 1 -- 172.21.15.12:0/349944635 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9388015020 con 0x55f53c3633d0 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.973+0000 7f93a7753b80 10 client.26971 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.973+0000 7f93a7753b80 1 -- 172.21.15.12:0/349944635 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f53c0c9c60 con 0x55f53c3633d0 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f93757fa700 1 -- 172.21.15.12:0/349944635 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f53c356b40 con 0x55f53c3633d0 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f93757fa700 1 -- 172.21.15.12:0/349944635 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9388005500 con 0x55f53c3633d0 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f93a7753b80 10 client.26971 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f93a7753b80 10 client.26971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f93a7753b80 20 client.26971 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f93a7753b80 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f53c3cfda0 0x55f53c3d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f93a7753b80 4 client.26971 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f93a7753b80 1 -- 172.21.15.12:0/349944635 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f53c270490 con 0x55f53c3cfda0 2023-12-11T20:22:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.974+0000 7f939139a700 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f53c3cfda0 0x55f53c3d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f939139a700 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f53c3cfda0 0x55f53c3d21c0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbefec55394d313f server_cookie=622545b9f175c109 in_seq=0 out_seq=0 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93757fa700 10 client.26971 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93757fa700 1 -- 172.21.15.12:0/349944635 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f53c270490 con 0x55f53c3cfda0 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93757fa700 10 client.26971 handle_command_reply: tid=0 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 client.26971 shutdown 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 -- 172.21.15.12:0/349944635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c3633d0 msgr2=0x55f53c372600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c3633d0 0x55f53c372600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f938801f040 tx=0x7f9388005bb0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 -- 172.21.15.12:0/349944635 shutdown_connections 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f53c3cfda0 0x55f53c3d21c0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f53c364c20 0x55f53c373ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93757fa700 0 client.26971 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f53c3633d0 0x55f53c372600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 --2- 172.21.15.12:0/349944635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f53c363d30 0x55f53c372b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.975+0000 7f93a7753b80 1 -- 172.21.15.12:0/349944635 >> 172.21.15.12:0/349944635 conn(0x55f53c2927e0 msgr2=0x55f53c37f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:22.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f93a7753b80 1 -- 172.21.15.12:0/349944635 shutdown_connections 2023-12-11T20:22:22.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f93a7753b80 1 -- 172.21.15.12:0/349944635 wait complete. 2023-12-11T20:22:22.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f93a7753b80 20 client.26971 trim_cache size 0 max 16384 2023-12-11T20:22:22.979 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:22:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:22:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:22:22.979 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 -- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93780a1500 msgr2=0x7f93780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93780a1500 0x7f93780a39c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f938400d010 tx=0x7f938400b720 comp rx=0 tx=0).stop 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 -- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c104970 msgr2=0x7f938c199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c104970 0x7f938c199b70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f937c00d980 tx=0x7f937c00dc90 comp rx=0 tx=0).stop 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 -- 172.21.15.12:0/2166481290 shutdown_connections 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93780a1500 0x7f93780a39c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f938c102040 0x7f938c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f938c1072a0 0x7f938c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 --2- 172.21.15.12:0/2166481290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938c104970 0x7f938c199b70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:22.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.976+0000 7f9393dff700 1 -- 172.21.15.12:0/2166481290 >> 172.21.15.12:0/2166481290 conn(0x7f938c0fb930 msgr2=0x7f938c0fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:22.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.977+0000 7f9393dff700 1 -- 172.21.15.12:0/2166481290 shutdown_connections 2023-12-11T20:22:22.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:22.977+0000 7f9393dff700 1 -- 172.21.15.12:0/2166481290 wait complete. 2023-12-11T20:22:22.993 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:22:22.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:22:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.228+0000 7f52a2dff700 1 -- 172.21.15.12:0/4105739613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1036a0 msgr2=0x7f529c103ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.228+0000 7f52a2dff700 1 --2- 172.21.15.12:0/4105739613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1036a0 0x7f529c103ac0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f52900099c0 tx=0x7f5290009cd0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.228+0000 7f52a2dff700 1 -- 172.21.15.12:0/4105739613 shutdown_connections 2023-12-11T20:22:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.228+0000 7f52a2dff700 1 --2- 172.21.15.12:0/4105739613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529c105230 0x7f529c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.228+0000 7f52a2dff700 1 --2- 172.21.15.12:0/4105739613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1036a0 0x7f529c103ac0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.228+0000 7f52a2dff700 1 --2- 172.21.15.12:0/4105739613 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529c104890 0x7f529c104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.228+0000 7f52a2dff700 1 -- 172.21.15.12:0/4105739613 >> 172.21.15.12:0/4105739613 conn(0x7f529c0fec10 msgr2=0x7f529c101050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:23.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.229+0000 7f52a2dff700 1 -- 172.21.15.12:0/4105739613 shutdown_connections 2023-12-11T20:22:23.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.229+0000 7f52a2dff700 1 -- 172.21.15.12:0/4105739613 wait complete. 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.229+0000 7f52a2dff700 1 Processor -- start 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f52a2dff700 1 -- start start 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f52a2dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529c1036a0 0x7f529c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f52a2dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c104890 0x7f529c199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f52a2dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529c105230 0x7f529c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f52a2dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1a10a0 con 0x7f529c104890 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f52a2dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1a11e0 con 0x7f529c105230 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f52a2dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1a1370 con 0x7f529c1036a0 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f529bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c104890 0x7f529c199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f529bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c104890 0x7f529c199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53826/0 (socket says 172.21.15.12:53826) 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.230+0000 7f529bfff700 1 -- 172.21.15.12:0/1805043294 learned_addr learned my addr 172.21.15.12:0/1805043294 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f52a0b9b700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529c1036a0 0x7f529c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f52a139c700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529c105230 0x7f529c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f529bfff700 1 -- 172.21.15.12:0/1805043294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529c1036a0 msgr2=0x7f529c199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f529bfff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529c1036a0 0x7f529c199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f529bfff700 1 -- 172.21.15.12:0/1805043294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529c105230 msgr2=0x7f529c1a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f529bfff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529c105230 0x7f529c1a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f529bfff700 1 -- 172.21.15.12:0/1805043294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52900095f0 con 0x7f529c104890 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f529bfff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c104890 0x7f529c199ab0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f528800d980 tx=0x7f528800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.231+0000 7f5299ffb700 1 -- 172.21.15.12:0/1805043294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288004220 con 0x7f529c104890 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.232+0000 7f5299ffb700 1 -- 172.21.15.12:0/1805043294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5288007640 con 0x7f529c104890 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.232+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c1a1650 con 0x7f529c104890 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.232+0000 7f5299ffb700 1 -- 172.21.15.12:0/1805043294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288005660 con 0x7f529c104890 2023-12-11T20:22:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.232+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c1a1bb0 con 0x7f529c104890 2023-12-11T20:22:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.233+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c10ab90 con 0x7f529c104890 2023-12-11T20:22:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.235+0000 7f5299ffb700 1 -- 172.21.15.12:0/1805043294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5288004750 con 0x7f529c104890 2023-12-11T20:22:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.238+0000 7f5299ffb700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f528c0a1500 0x7f528c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.238+0000 7f5299ffb700 1 -- 172.21.15.12:0/1805043294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f52880ccab0 con 0x7f529c104890 2023-12-11T20:22:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.238+0000 7f52a0b9b700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f528c0a1500 0x7f528c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.239+0000 7f52a0b9b700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f528c0a1500 0x7f528c0a39c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5290006010 tx=0x7f5290003740 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.244+0000 7f5299ffb700 1 -- 172.21.15.12:0/1805043294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5288096060 con 0x7f529c104890 2023-12-11T20:22:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:23 smithi012 ceph-mon[128787]: pgmap v569: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:22:23.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:23 smithi039 ceph-mon[102205]: pgmap v569: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:22:23.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.563+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f529c067aa0 con 0x7f529c104890 2023-12-11T20:22:23.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.564+0000 7f5299ffb700 1 -- 172.21.15.12:0/1805043294 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f5288016020 con 0x7f529c104890 2023-12-11T20:22:23.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:22:23.564 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:22:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.566+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f528c0a1500 msgr2=0x7f528c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.566+0000 7f52a2dff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f528c0a1500 0x7f528c0a39c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5290006010 tx=0x7f5290003740 comp rx=0 tx=0).stop 2023-12-11T20:22:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.566+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c104890 msgr2=0x7f529c199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.566+0000 7f52a2dff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c104890 0x7f529c199ab0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f528800d980 tx=0x7f528800dc90 comp rx=0 tx=0).stop 2023-12-11T20:22:23.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.567+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 shutdown_connections 2023-12-11T20:22:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.567+0000 7f52a2dff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f528c0a1500 0x7f528c0a39c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.567+0000 7f52a2dff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529c105230 0x7f529c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.567+0000 7f52a2dff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529c1036a0 0x7f529c199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.567+0000 7f52a2dff700 1 --2- 172.21.15.12:0/1805043294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c104890 0x7f529c199ab0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.567+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 >> 172.21.15.12:0/1805043294 conn(0x7f529c0fec10 msgr2=0x7f529c107cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:23.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.567+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 shutdown_connections 2023-12-11T20:22:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.567+0000 7f52a2dff700 1 -- 172.21.15.12:0/1805043294 wait complete. 2023-12-11T20:22:23.568 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:22:23.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:22:23.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:23 smithi032 ceph-mon[132488]: pgmap v569: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:22:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/2681278266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f64101f90 msgr2=0x7f8f64108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/2681278266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f64101f90 0x7f8f64108840 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00b0d0 tx=0x7f8f5c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/2681278266 shutdown_connections 2023-12-11T20:22:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/2681278266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8f64100400 0x7f8f64100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/2681278266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f64101f90 0x7f8f64108840 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/2681278266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f641015f0 0x7f8f64101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/2681278266 >> 172.21.15.12:0/2681278266 conn(0x7f8f640fb930 msgr2=0x7f8f640fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/2681278266 shutdown_connections 2023-12-11T20:22:23.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.814+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/2681278266 wait complete. 2023-12-11T20:22:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.815+0000 7f8f6b5ff700 1 Processor -- start 2023-12-11T20:22:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.815+0000 7f8f6b5ff700 1 -- start start 2023-12-11T20:22:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f6b5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8f64100400 0x7f8f64199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f6b5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f641015f0 0x7f8f64199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f6b5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f64101f90 0x7f8f641a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f6b5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641a11c0 con 0x7f8f641015f0 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f6b5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641a1300 con 0x7f8f64100400 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f6b5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641a1490 con 0x7f8f64101f90 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f68b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f641015f0 0x7f8f64199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f68b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f641015f0 0x7f8f64199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53848/0 (socket says 172.21.15.12:53848) 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f68b9a700 1 -- 172.21.15.12:0/3787756280 learned_addr learned my addr 172.21.15.12:0/3787756280 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f6939b700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8f64100400 0x7f8f64199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f64101f90 0x7f8f641a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f68b9a700 1 -- 172.21.15.12:0/3787756280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f64101f90 msgr2=0x7f8f641a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.816+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f64101f90 0x7f8f641a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f68b9a700 1 -- 172.21.15.12:0/3787756280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8f64100400 msgr2=0x7f8f64199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8f64100400 0x7f8f64199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f68b9a700 1 -- 172.21.15.12:0/3787756280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c009d00 con 0x7f8f641015f0 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f6939b700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8f64100400 0x7f8f64199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f641015f0 0x7f8f64199bd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400d950 tx=0x7f8f5400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f5a7fc700 1 -- 172.21.15.12:0/3787756280 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54009b40 con 0x7f8f641015f0 2023-12-11T20:22:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f5a7fc700 1 -- 172.21.15.12:0/3787756280 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f54009ca0 con 0x7f8f641015f0 2023-12-11T20:22:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/3787756280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f641a1770 con 0x7f8f641015f0 2023-12-11T20:22:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f5a7fc700 1 -- 172.21.15.12:0/3787756280 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5400f620 con 0x7f8f641015f0 2023-12-11T20:22:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.817+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/3787756280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f641a1cd0 con 0x7f8f641015f0 2023-12-11T20:22:23.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.821+0000 7f8f5a7fc700 1 -- 172.21.15.12:0/3787756280 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8f54010460 con 0x7f8f641015f0 2023-12-11T20:22:23.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.822+0000 7f8f7ee40b80 1 Processor -- start 2023-12-11T20:22:23.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f7ee40b80 1 -- start start 2023-12-11T20:22:23.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f5a7fc700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8f500a1500 0x7f8f500a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f5a7fc700 1 -- 172.21.15.12:0/3787756280 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f540ccfe0 con 0x7f8f641015f0 2023-12-11T20:22:23.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 0x559b1e9777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e978640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 0x559b1e9790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e8d2b50 con 0x559b1e977d30 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e8d0470 con 0x559b1e978c20 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e8cbd60 con 0x559b1e9773d0 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8f500a1500 0x7f8f500a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.823+0000 7f8f68b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e978640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f68b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e978640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53862/0 (socket says 172.21.15.12:53862) 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f68b9a700 1 -- 172.21.15.12:0/4176496122 learned_addr learned my addr 172.21.15.12:0/4176496122 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 0x559b1e9790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f6939b700 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 0x559b1e9777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f68b9a700 1 -- 172.21.15.12:0/4176496122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 msgr2=0x559b1e9777f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 0x559b1e9777f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f68b9a700 1 -- 172.21.15.12:0/4176496122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 msgr2=0x559b1e9790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 0x559b1e9790a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f68b9a700 1 -- 172.21.15.12:0/4176496122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b1e748630 con 0x559b1e977d30 2023-12-11T20:22:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8f500a1500 0x7f8f500a39c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009cd0 tx=0x7f8f5c0076e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:23.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e978640 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8f54096cc0 tx=0x7f8f5409a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed945745158d4ec7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:23.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.824+0000 7f8f4f7fe700 1 -- 172.21.15.12:0/4176496122 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5409a250 con 0x559b1e977d30 2023-12-11T20:22:23.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.825+0000 7f8f4f7fe700 1 -- 172.21.15.12:0/4176496122 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f5409e3a0 con 0x559b1e977d30 2023-12-11T20:22:23.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.825+0000 7f8f4f7fe700 1 -- 172.21.15.12:0/4176496122 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54010710 con 0x559b1e977d30 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.825+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/4176496122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 msgr2=0x559b1e978640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.825+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e978640 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8f54096cc0 tx=0x7f8f5409a0a0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.826+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/4176496122 shutdown_connections 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.826+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 0x559b1e9790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.826+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 0x559b1e9777f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.826+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/4176496122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e978640 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.826+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/4176496122 >> 172.21.15.12:0/4176496122 conn(0x559b1e8a67e0 msgr2=0x559b1e973d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.826+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/4176496122 shutdown_connections 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.826+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/4176496122 wait complete. 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.826+0000 7f8f7ee40b80 1 -- start start 2023-12-11T20:22:23.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.827+0000 7f8f7ee40b80 1 Processor -- start 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.827+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e9810e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.827+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e981620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.827+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e988660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.827+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e885560 con 0x559b1e978c20 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.827+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e885200 con 0x559b1e9773d0 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.827+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e74a920 con 0x559b1e977d30 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f7ee40b80 10 client.0 _ll_register_callbacks cb 0x559b1e7b0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f69b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e988660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f69b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e988660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53874/0 (socket says 172.21.15.12:53874) 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f69b9c700 1 -- 172.21.15.12:0/2907829407 learned_addr learned my addr 172.21.15.12:0/2907829407 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f6939b700 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e9810e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e981620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f69b9c700 1 -- 172.21.15.12:0/2907829407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 msgr2=0x559b1e981620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e981620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f69b9c700 1 -- 172.21.15.12:0/2907829407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 msgr2=0x559b1e9810e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e9810e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.828+0000 7f8f69b9c700 1 -- 172.21.15.12:0/2907829407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f641a1cd0 con 0x559b1e978c20 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.829+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e988660 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c007a30 tx=0x7f8f5c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a8ce1f7a4a76f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.829+0000 7f8f4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.829+0000 7f8f4cff9700 1 -- 172.21.15.12:0/2907829407 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00e070 con 0x559b1e978c20 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.829+0000 7f8f4cff9700 1 -- 172.21.15.12:0/2907829407 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f5c01ecd0 con 0x559b1e978c20 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.829+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2907829407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b1e96ab40 con 0x559b1e978c20 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.829+0000 7f8f4cff9700 1 -- 172.21.15.12:0/2907829407 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f5c01ee90 con 0x559b1e978c20 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.829+0000 7f8f7ee40b80 10 client.17313 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.829+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2907829407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b1e6f4de0 con 0x559b1e978c20 2023-12-11T20:22:23.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.830+0000 7f8f4cff9700 1 -- 172.21.15.12:0/2907829407 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559b1e96ab40 con 0x559b1e978c20 2023-12-11T20:22:23.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.830+0000 7f8f4cff9700 1 -- 172.21.15.12:0/2907829407 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f5c020450 con 0x559b1e978c20 2023-12-11T20:22:23.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.830+0000 7f8f7ee40b80 10 client.17313 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:23.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.830+0000 7f8f7ee40b80 10 client.17313 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:22:23.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.830+0000 7f8f7ee40b80 20 client.17313 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:23.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.830+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559b1e98cf40 0x559b1e98f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.830+0000 7f8f7ee40b80 4 client.17313 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:23.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.830+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2907829407 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b1e946f40 con 0x559b1e98cf40 2023-12-11T20:22:23.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.831+0000 7f8f6939b700 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559b1e98cf40 0x559b1e98f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.831+0000 7f8f6939b700 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559b1e98cf40 0x559b1e98f360 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9e970aa12255136 server_cookie=ac380356f1e939fe in_seq=0 out_seq=0 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.831+0000 7f8f4cff9700 10 client.17313 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.832+0000 7f8f4cff9700 1 -- 172.21.15.12:0/2907829407 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559b1e946f40 con 0x559b1e98cf40 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.832+0000 7f8f4cff9700 10 client.17313 handle_command_reply: tid=0 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.832+0000 7f8f7ee40b80 1 client.17313 shutdown 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.832+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2907829407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 msgr2=0x559b1e988660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.832+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e988660 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c007a30 tx=0x7f8f5c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2907829407 shutdown_connections 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559b1e98cf40 0x559b1e98f360 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e9810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e988660 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2907829407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e981620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2907829407 >> 172.21.15.12:0/2907829407 conn(0x559b1e8a67e0 msgr2=0x559b1e972a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f4cff9700 0 client.17313 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2907829407 shutdown_connections 2023-12-11T20:22:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2907829407 wait complete. 2023-12-11T20:22:23.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.833+0000 7f8f7ee40b80 20 client.17313 trim_cache size 0 max 16384 2023-12-11T20:22:23.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.849+0000 7f8f7ee40b80 1 Processor -- start 2023-12-11T20:22:23.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f7ee40b80 1 -- start start 2023-12-11T20:22:23.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 0x559b1e97bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e97c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 0x559b1e988620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e980c70 con 0x559b1e977d30 2023-12-11T20:22:23.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e976f70 con 0x559b1e978c20 2023-12-11T20:22:23.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e9897e0 con 0x559b1e9773d0 2023-12-11T20:22:23.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f68b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e97c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f68b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e97c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53888/0 (socket says 172.21.15.12:53888) 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f68b9a700 1 -- 172.21.15.12:0/2976311184 learned_addr learned my addr 172.21.15.12:0/2976311184 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f6939b700 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 0x559b1e97bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.850+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 0x559b1e988620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f68b9a700 1 -- 172.21.15.12:0/2976311184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 msgr2=0x559b1e97bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 0x559b1e97bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f68b9a700 1 -- 172.21.15.12:0/2976311184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 msgr2=0x559b1e988620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 0x559b1e988620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f68b9a700 1 -- 172.21.15.12:0/2976311184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b1e6ddc60 con 0x559b1e977d30 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e97c0d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8f54099f50 tx=0x7f8f54010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fdcf4e2876407c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f4ffff700 1 -- 172.21.15.12:0/2976311184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54098470 con 0x559b1e977d30 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f4ffff700 1 -- 172.21.15.12:0/2976311184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f540b1070 con 0x559b1e977d30 2023-12-11T20:22:23.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.851+0000 7f8f4ffff700 1 -- 172.21.15.12:0/2976311184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5409a4b0 con 0x559b1e977d30 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2976311184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 msgr2=0x559b1e97c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e97c0d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8f54099f50 tx=0x7f8f54010a40 comp rx=0 tx=0).stop 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2976311184 shutdown_connections 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e978c20 0x559b1e988620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e9773d0 0x559b1e97bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/2976311184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e977d30 0x559b1e97c0d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2976311184 >> 172.21.15.12:0/2976311184 conn(0x559b1e8a67e0 msgr2=0x559b1e97fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2976311184 shutdown_connections 2023-12-11T20:22:23.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.852+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/2976311184 wait complete. 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.853+0000 7f8f7ee40b80 1 -- start start 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.853+0000 7f8f7ee40b80 1 Processor -- start 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.853+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e986120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e986660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f7ee40b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e9875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e987b10 con 0x559b1e978c20 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e987c80 con 0x559b1e9773d0 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f7ee40b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1e987e40 con 0x559b1e977d30 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f7ee40b80 10 client.0 _ll_register_callbacks cb 0x559b1e7b0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f6939b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e986120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f6939b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e986120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46670/0 (socket says 172.21.15.12:46670) 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f6939b700 1 -- 172.21.15.12:0/1873002732 learned_addr learned my addr 172.21.15.12:0/1873002732 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:23.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f69b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e9875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e986660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f6939b700 1 -- 172.21.15.12:0/1873002732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 msgr2=0x559b1e986660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:23.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f6939b700 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e986660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f6939b700 1 -- 172.21.15.12:0/1873002732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 msgr2=0x559b1e9875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:23.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f6939b700 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e9875d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f6939b700 1 -- 172.21.15.12:0/1873002732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b1e748630 con 0x559b1e9773d0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e986660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.854+0000 7f8f69b9c700 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e9875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.855+0000 7f8f6939b700 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e986120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x559b1e98fc70 tx=0x7f8f6001d760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4475a8c802f255 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.855+0000 7f8f4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.855+0000 7f8f4cff9700 1 -- 172.21.15.12:0/1873002732 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60017040 con 0x559b1e9773d0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.855+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/1873002732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f5409e3a0 con 0x559b1e9773d0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.855+0000 7f8f4cff9700 1 -- 172.21.15.12:0/1873002732 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f60004220 con 0x559b1e9773d0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.855+0000 7f8f4cff9700 1 -- 172.21.15.12:0/1873002732 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f600142e0 con 0x559b1e9773d0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.855+0000 7f8f7ee40b80 10 client.27002 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.855+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/1873002732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b1e71b250 con 0x559b1e9773d0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f4cff9700 1 -- 172.21.15.12:0/1873002732 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f5409e3a0 con 0x559b1e9773d0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f4cff9700 1 -- 172.21.15.12:0/1873002732 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f600039f0 con 0x559b1e9773d0 2023-12-11T20:22:23.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f7ee40b80 10 client.27002 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f7ee40b80 10 client.27002 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f7ee40b80 20 client.27002 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559b1e9e40b0 0x559b1e9e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f7ee40b80 4 client.27002 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/1873002732 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559b1e891fd0 con 0x559b1e9e40b0 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.856+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559b1e9e40b0 0x559b1e9e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f68b9a700 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559b1e9e40b0 0x559b1e9e64d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=edf40ff62cbb4553 server_cookie=a5ea1f4743b116e6 in_seq=0 out_seq=0 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f4cff9700 10 client.27002 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f4cff9700 1 -- 172.21.15.12:0/1873002732 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559b1e891fd0 con 0x559b1e9e40b0 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f4cff9700 10 client.27002 handle_command_reply: tid=0 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 client.27002 shutdown 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/1873002732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 msgr2=0x559b1e986120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e986120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x559b1e98fc70 tx=0x7f8f6001d760 comp rx=0 tx=0).stop 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/1873002732 shutdown_connections 2023-12-11T20:22:23.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x559b1e9e40b0 0x559b1e9e64d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b1e9773d0 0x559b1e986120 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b1e978c20 0x559b1e9875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f4cff9700 0 client.27002 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 --2- 172.21.15.12:0/1873002732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b1e977d30 0x559b1e986660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.857+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/1873002732 >> 172.21.15.12:0/1873002732 conn(0x559b1e8a67e0 msgr2=0x559b1e97fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.858+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/1873002732 shutdown_connections 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.858+0000 7f8f7ee40b80 1 -- 172.21.15.12:0/1873002732 wait complete. 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.858+0000 7f8f7ee40b80 20 client.27002 trim_cache size 0 max 16384 2023-12-11T20:22:23.860 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:22:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.858+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8f500a1500 msgr2=0x7f8f500a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.858+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8f500a1500 0x7f8f500a39c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009cd0 tx=0x7f8f5c0076e0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.858+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f641015f0 msgr2=0x7f8f64199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.858+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f641015f0 0x7f8f64199bd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400d950 tx=0x7f8f5400dd10 comp rx=0 tx=0).stop 2023-12-11T20:22:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.859+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/3787756280 shutdown_connections 2023-12-11T20:22:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.859+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8f500a1500 0x7f8f500a39c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.859+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8f64100400 0x7f8f64199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.859+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f64101f90 0x7f8f641a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.859+0000 7f8f6b5ff700 1 --2- 172.21.15.12:0/3787756280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f641015f0 0x7f8f64199bd0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:23.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.859+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/3787756280 >> 172.21.15.12:0/3787756280 conn(0x7f8f640fb930 msgr2=0x7f8f64068830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:23.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.859+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/3787756280 shutdown_connections 2023-12-11T20:22:23.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:23.859+0000 7f8f6b5ff700 1 -- 172.21.15.12:0/3787756280 wait complete. 2023-12-11T20:22:23.877 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:22:24.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 -- 172.21.15.12:0/644627764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 msgr2=0x7f3320109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 --2- 172.21.15.12:0/644627764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 0x7f3320109650 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f331800b0a0 tx=0x7f331800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 -- 172.21.15.12:0/644627764 shutdown_connections 2023-12-11T20:22:24.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 --2- 172.21.15.12:0/644627764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 0x7f3320109650 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 --2- 172.21.15.12:0/644627764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3320101f80 0x7f3320104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 --2- 172.21.15.12:0/644627764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33201048b0 0x7f3320106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 -- 172.21.15.12:0/644627764 >> 172.21.15.12:0/644627764 conn(0x7f33200fb930 msgr2=0x7f33200fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 -- 172.21.15.12:0/644627764 shutdown_connections 2023-12-11T20:22:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.096+0000 7f33283ff700 1 -- 172.21.15.12:0/644627764 wait complete. 2023-12-11T20:22:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.097+0000 7f33283ff700 1 Processor -- start 2023-12-11T20:22:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.097+0000 7f33283ff700 1 -- start start 2023-12-11T20:22:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.097+0000 7f33283ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3320101f80 0x7f3320195200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.097+0000 7f33283ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33201048b0 0x7f3320195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.097+0000 7f33283ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 0x7f332019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.097+0000 7f33283ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332019cd30 con 0x7f33201071e0 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.097+0000 7f33283ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332019ce70 con 0x7f33201048b0 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.097+0000 7f33283ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332019d000 con 0x7f3320101f80 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 0x7f332019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 0x7f332019c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53912/0 (socket says 172.21.15.12:53912) 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332619b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3320101f80 0x7f3320195200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332699c700 1 -- 172.21.15.12:0/3773194529 learned_addr learned my addr 172.21.15.12:0/3773194529 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332599a700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33201048b0 0x7f3320195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332699c700 1 -- 172.21.15.12:0/3773194529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3320101f80 msgr2=0x7f3320195200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332699c700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3320101f80 0x7f3320195200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332699c700 1 -- 172.21.15.12:0/3773194529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33201048b0 msgr2=0x7f3320195740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332699c700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33201048b0 0x7f3320195740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.098+0000 7f332699c700 1 -- 172.21.15.12:0/3773194529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318009d00 con 0x7f33201071e0 2023-12-11T20:22:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.099+0000 7f332699c700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 0x7f332019c760 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f331800b780 tx=0x7f331800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.099+0000 7f33177fe700 1 -- 172.21.15.12:0/3773194529 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800e040 con 0x7f33201071e0 2023-12-11T20:22:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.099+0000 7f33177fe700 1 -- 172.21.15.12:0/3773194529 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3318003c00 con 0x7f33201071e0 2023-12-11T20:22:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.099+0000 7f33177fe700 1 -- 172.21.15.12:0/3773194529 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33180052a0 con 0x7f33201071e0 2023-12-11T20:22:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.099+0000 7f33283ff700 1 -- 172.21.15.12:0/3773194529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332019d280 con 0x7f33201071e0 2023-12-11T20:22:24.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.099+0000 7f33283ff700 1 -- 172.21.15.12:0/3773194529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332019d650 con 0x7f33201071e0 2023-12-11T20:22:24.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.104+0000 7f33177fe700 1 -- 172.21.15.12:0/3773194529 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f331801d480 con 0x7f33201071e0 2023-12-11T20:22:24.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.105+0000 7f333bc39b80 1 Processor -- start 2023-12-11T20:22:24.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.105+0000 7f333bc39b80 1 -- start start 2023-12-11T20:22:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.105+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e017f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.105+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e02640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.105+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.105+0000 7f333bc39b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7d5cb50 con 0x559be7e01d30 2023-12-11T20:22:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.105+0000 7f333bc39b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7d5a470 con 0x559be7e013d0 2023-12-11T20:22:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.105+0000 7f333bc39b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7d55d60 con 0x559be7e02c20 2023-12-11T20:22:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f33177fe700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f330c0a5910 0x7f330c0a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e02640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e02640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53920/0 (socket says 172.21.15.12:53920) 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332619b700 1 -- 172.21.15.12:0/3481470931 learned_addr learned my addr 172.21.15.12:0/3481470931 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332599a700 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f33177fe700 1 -- 172.21.15.12:0/3773194529 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f33180cdd20 con 0x7f33201071e0 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332699c700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f330c0a5910 0x7f330c0a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332599a700 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332619b700 1 -- 172.21.15.12:0/3481470931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 msgr2=0x559be7e030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332619b700 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332619b700 1 -- 172.21.15.12:0/3481470931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 msgr2=0x559be7e017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332619b700 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.106+0000 7f332619b700 1 -- 172.21.15.12:0/3481470931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559be7bd2630 con 0x559be7e01d30 2023-12-11T20:22:24.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.107+0000 7f332619b700 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e02640 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f331c009d80 tx=0x7f331c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f213c12215946d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.107+0000 7f332699c700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f330c0a5910 0x7f330c0a7dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f331809afb0 tx=0x7f3318009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.107+0000 7f3314bfe700 1 -- 172.21.15.12:0/3481470931 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c004230 con 0x559be7e01d30 2023-12-11T20:22:24.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.107+0000 7f3314bfe700 1 -- 172.21.15.12:0/3481470931 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f331c004390 con 0x559be7e01d30 2023-12-11T20:22:24.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.107+0000 7f3314bfe700 1 -- 172.21.15.12:0/3481470931 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c019800 con 0x559be7e01d30 2023-12-11T20:22:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 -- 172.21.15.12:0/3481470931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 msgr2=0x559be7e02640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e02640 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f331c009d80 tx=0x7f331c011720 comp rx=0 tx=0).stop 2023-12-11T20:22:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 -- 172.21.15.12:0/3481470931 shutdown_connections 2023-12-11T20:22:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3481470931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e02640 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 -- 172.21.15.12:0/3481470931 >> 172.21.15.12:0/3481470931 conn(0x559be7d307e0 msgr2=0x559be7dfdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 -- 172.21.15.12:0/3481470931 shutdown_connections 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.108+0000 7f333bc39b80 1 -- 172.21.15.12:0/3481470931 wait complete. 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.109+0000 7f333bc39b80 1 -- start start 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.109+0000 7f333bc39b80 1 Processor -- start 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.109+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e0b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.109+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e0b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.109+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e12720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.109+0000 7f333bc39b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7d0f560 con 0x559be7e01d30 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.109+0000 7f333bc39b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7d0f200 con 0x559be7e013d0 2023-12-11T20:22:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.109+0000 7f333bc39b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7bd4920 con 0x559be7e02c20 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f333bc39b80 10 client.0 _ll_register_callbacks cb 0x559be7c3aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e0b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e0b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53928/0 (socket says 172.21.15.12:53928) 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332619b700 1 -- 172.21.15.12:0/3239427559 learned_addr learned my addr 172.21.15.12:0/3239427559 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332599a700 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e0b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332599a700 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e12720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332619b700 1 -- 172.21.15.12:0/3239427559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 msgr2=0x559be7e12720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332619b700 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e12720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332619b700 1 -- 172.21.15.12:0/3239427559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 msgr2=0x559be7e0b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332619b700 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e0b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.110+0000 7f332619b700 1 -- 172.21.15.12:0/3239427559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c0099e0 con 0x559be7e01d30 2023-12-11T20:22:24.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.111+0000 7f332619b700 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e0b6e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f331c009770 tx=0x7f331c0038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e2e816105c091d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.111+0000 7f3309ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.111+0000 7f3309ffb700 1 -- 172.21.15.12:0/3239427559 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c005240 con 0x559be7e01d30 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.111+0000 7f3309ffb700 1 -- 172.21.15.12:0/3239427559 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f331c005ce0 con 0x559be7e01d30 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.111+0000 7f333bc39b80 1 -- 172.21.15.12:0/3239427559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559be7df4b40 con 0x559be7e01d30 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.111+0000 7f3309ffb700 1 -- 172.21.15.12:0/3239427559 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f331c0053a0 con 0x559be7e01d30 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.111+0000 7f333bc39b80 10 client.17331 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.111+0000 7f333bc39b80 1 -- 172.21.15.12:0/3239427559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559be7b7ede0 con 0x559be7e01d30 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.112+0000 7f3309ffb700 1 -- 172.21.15.12:0/3239427559 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559be7df4b40 con 0x559be7e01d30 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.112+0000 7f3309ffb700 1 -- 172.21.15.12:0/3239427559 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f331c021040 con 0x559be7e01d30 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.112+0000 7f333bc39b80 10 client.17331 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.112+0000 7f333bc39b80 10 client.17331 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.112+0000 7f333bc39b80 20 client.17331 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.112+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559be7e16e70 0x559be7e19290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.112+0000 7f333bc39b80 4 client.17331 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.112+0000 7f333bc39b80 1 -- 172.21.15.12:0/3239427559 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559be7dd0f40 con 0x559be7e16e70 2023-12-11T20:22:24.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.113+0000 7f332599a700 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559be7e16e70 0x559be7e19290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.113+0000 7f332599a700 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559be7e16e70 0x559be7e19290 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30e0db66b1459490 server_cookie=a48a52bb58545105 in_seq=0 out_seq=0 2023-12-11T20:22:24.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.113+0000 7f3309ffb700 10 client.17331 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f3309ffb700 1 -- 172.21.15.12:0/3239427559 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559be7dd0f40 con 0x559be7e16e70 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f3309ffb700 10 client.17331 handle_command_reply: tid=0 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 client.17331 shutdown 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 -- 172.21.15.12:0/3239427559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 msgr2=0x559be7e0b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e0b6e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f331c009770 tx=0x7f331c0038b0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 -- 172.21.15.12:0/3239427559 shutdown_connections 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559be7e16e70 0x559be7e19290 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e0b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e12720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3239427559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e0b6e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f333bc39b80 1 -- 172.21.15.12:0/3239427559 >> 172.21.15.12:0/3239427559 conn(0x559be7d307e0 msgr2=0x559be7dfca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.114+0000 7f3309ffb700 0 client.17331 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:22:24.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.115+0000 7f333bc39b80 1 -- 172.21.15.12:0/3239427559 shutdown_connections 2023-12-11T20:22:24.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.115+0000 7f333bc39b80 1 -- 172.21.15.12:0/3239427559 wait complete. 2023-12-11T20:22:24.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.115+0000 7f333bc39b80 20 client.17331 trim_cache size 0 max 16384 2023-12-11T20:22:24.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f333bc39b80 1 Processor -- start 2023-12-11T20:22:24.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f333bc39b80 1 -- start start 2023-12-11T20:22:24.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e013d0 0x559be7e03000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e02c20 0x559be7e1dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f333bc39b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7e00f70 con 0x559be7e01d30 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f333bc39b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7e0ad10 con 0x559be7e02c20 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f333bc39b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7df8b50 con 0x559be7e013d0 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.129+0000 7f332619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e126e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53942/0 (socket says 172.21.15.12:53942) 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332619b700 1 -- 172.21.15.12:0/860759627 learned_addr learned my addr 172.21.15.12:0/860759627 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332599a700 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e02c20 0x559be7e1dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332599a700 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e013d0 0x559be7e03000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332619b700 1 -- 172.21.15.12:0/860759627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e013d0 msgr2=0x559be7e03000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332619b700 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e013d0 0x559be7e03000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332619b700 1 -- 172.21.15.12:0/860759627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e02c20 msgr2=0x559be7e1dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332619b700 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e02c20 0x559be7e1dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332619b700 1 -- 172.21.15.12:0/860759627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559be7b67c60 con 0x559be7e01d30 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332599a700 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e013d0 0x559be7e03000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.130+0000 7f332619b700 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e126e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f331c000c00 tx=0x7f331c0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cc47afc9bcd779 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f33153ff700 1 -- 172.21.15.12:0/860759627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c009cb0 con 0x559be7e01d30 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f33153ff700 1 -- 172.21.15.12:0/860759627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f331c019e30 con 0x559be7e01d30 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f33153ff700 1 -- 172.21.15.12:0/860759627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c004bf0 con 0x559be7e01d30 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f333bc39b80 1 -- 172.21.15.12:0/860759627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 msgr2=0x559be7e126e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f333bc39b80 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e126e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f331c000c00 tx=0x7f331c0058e0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f333bc39b80 1 -- 172.21.15.12:0/860759627 shutdown_connections 2023-12-11T20:22:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f333bc39b80 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e02c20 0x559be7e1dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f333bc39b80 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e013d0 0x559be7e03000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f333bc39b80 1 --2- 172.21.15.12:0/860759627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e126e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.131+0000 7f333bc39b80 1 -- 172.21.15.12:0/860759627 >> 172.21.15.12:0/860759627 conn(0x559be7d307e0 msgr2=0x559be7e09e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.132+0000 7f333bc39b80 1 -- 172.21.15.12:0/860759627 shutdown_connections 2023-12-11T20:22:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.132+0000 7f333bc39b80 1 -- 172.21.15.12:0/860759627 wait complete. 2023-12-11T20:22:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.132+0000 7f333bc39b80 1 -- start start 2023-12-11T20:22:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.132+0000 7f333bc39b80 1 Processor -- start 2023-12-11T20:22:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.133+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e0fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.133+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.133+0000 7f333bc39b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e11190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.133+0000 7f333bc39b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7e116d0 con 0x559be7e01d30 2023-12-11T20:22:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.133+0000 7f333bc39b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7e11840 con 0x559be7e013d0 2023-12-11T20:22:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.133+0000 7f333bc39b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559be7e11a00 con 0x559be7e02c20 2023-12-11T20:22:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.133+0000 7f333bc39b80 10 client.0 _ll_register_callbacks cb 0x559be7c3aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.133+0000 7f332619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53948/0 (socket says 172.21.15.12:53948) 2023-12-11T20:22:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332619b700 1 -- 172.21.15.12:0/3727512789 learned_addr learned my addr 172.21.15.12:0/3727512789 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332599a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e0fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332599a700 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e11190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332619b700 1 -- 172.21.15.12:0/3727512789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 msgr2=0x559be7e11190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332619b700 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e11190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332619b700 1 -- 172.21.15.12:0/3727512789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 msgr2=0x559be7e0fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332619b700 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e0fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332619b700 1 -- 172.21.15.12:0/3727512789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559be7b7ede0 con 0x559be7e01d30 2023-12-11T20:22:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f332619b700 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e101d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f331c0092a0 tx=0x7f331c0093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3486b1a51bd781df server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.134+0000 7f3309ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.135+0000 7f3309ffb700 1 -- 172.21.15.12:0/3727512789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c009cb0 con 0x559be7e01d30 2023-12-11T20:22:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.135+0000 7f3309ffb700 1 -- 172.21.15.12:0/3727512789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f331c019bb0 con 0x559be7e01d30 2023-12-11T20:22:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.135+0000 7f333bc39b80 1 -- 172.21.15.12:0/3727512789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f331c004390 con 0x559be7e01d30 2023-12-11T20:22:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.135+0000 7f3309ffb700 1 -- 172.21.15.12:0/3727512789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f331c009ed0 con 0x559be7e01d30 2023-12-11T20:22:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.135+0000 7f333bc39b80 10 client.17337 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.135+0000 7f333bc39b80 1 -- 172.21.15.12:0/3727512789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559be7ba5250 con 0x559be7e01d30 2023-12-11T20:22:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.135+0000 7f3309ffb700 1 -- 172.21.15.12:0/3727512789 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f331c04e080 con 0x559be7e01d30 2023-12-11T20:22:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.135+0000 7f3309ffb700 1 -- 172.21.15.12:0/3727512789 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f331c011790 con 0x559be7e01d30 2023-12-11T20:22:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f333bc39b80 10 client.17337 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f333bc39b80 10 client.17337 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:22:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f333bc39b80 20 client.17337 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559be7e6d6b0 0x559be7e6faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f333bc39b80 4 client.17337 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:22:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f333bc39b80 1 -- 172.21.15.12:0/3727512789 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559be7d1bfd0 con 0x559be7e6d6b0 2023-12-11T20:22:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f332599a700 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559be7e6d6b0 0x559be7e6faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f332599a700 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559be7e6d6b0 0x559be7e6faa0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c93dce92ccb2007 server_cookie=ebb551e2eb549888 in_seq=0 out_seq=0 2023-12-11T20:22:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.136+0000 7f3309ffb700 10 client.17337 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:22:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f3309ffb700 1 -- 172.21.15.12:0/3727512789 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559be7d1bfd0 con 0x559be7e6d6b0 2023-12-11T20:22:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f3309ffb700 10 client.17337 handle_command_reply: tid=0 2023-12-11T20:22:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 client.17337 shutdown 2023-12-11T20:22:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 -- 172.21.15.12:0/3727512789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 msgr2=0x559be7e101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e101d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f331c0092a0 tx=0x7f331c0093c0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 -- 172.21.15.12:0/3727512789 shutdown_connections 2023-12-11T20:22:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559be7e6d6b0 0x559be7e6faa0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559be7e013d0 0x559be7e0fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559be7e02c20 0x559be7e11190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 --2- 172.21.15.12:0/3727512789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559be7e01d30 0x559be7e101d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 -- 172.21.15.12:0/3727512789 >> 172.21.15.12:0/3727512789 conn(0x559be7d307e0 msgr2=0x559be7e1dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f3309ffb700 0 client.17337 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:22:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 -- 172.21.15.12:0/3727512789 shutdown_connections 2023-12-11T20:22:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 1 -- 172.21.15.12:0/3727512789 wait complete. 2023-12-11T20:22:24.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.137+0000 7f333bc39b80 20 client.17337 trim_cache size 0 max 16384 2023-12-11T20:22:24.145 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 -- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f330c0a5910 msgr2=0x7f330c0a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f330c0a5910 0x7f330c0a7dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f331809afb0 tx=0x7f3318009040 comp rx=0 tx=0).stop 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 -- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 msgr2=0x7f332019c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 0x7f332019c760 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f331800b780 tx=0x7f331800bab0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 -- 172.21.15.12:0/3773194529 shutdown_connections 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f330c0a5910 0x7f330c0a7dd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33201071e0 0x7f332019c760 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3320101f80 0x7f3320195200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 --2- 172.21.15.12:0/3773194529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33201048b0 0x7f3320195740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 -- 172.21.15.12:0/3773194529 >> 172.21.15.12:0/3773194529 conn(0x7f33200fb930 msgr2=0x7f3320103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 -- 172.21.15.12:0/3773194529 shutdown_connections 2023-12-11T20:22:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.138+0000 7f33283ff700 1 -- 172.21.15.12:0/3773194529 wait complete. 2023-12-11T20:22:24.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:22:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.383+0000 7f96a3fff700 1 -- 172.21.15.12:0/577135804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4107030 msgr2=0x7f96a4109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.383+0000 7f96a3fff700 1 --2- 172.21.15.12:0/577135804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4107030 0x7f96a4109440 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f969c00b0a0 tx=0x7f969c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.384+0000 7f96a3fff700 1 -- 172.21.15.12:0/577135804 shutdown_connections 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.384+0000 7f96a3fff700 1 --2- 172.21.15.12:0/577135804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a4101dd0 0x7f96a41041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.384+0000 7f96a3fff700 1 --2- 172.21.15.12:0/577135804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4107030 0x7f96a4109440 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.384+0000 7f96a3fff700 1 --2- 172.21.15.12:0/577135804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96a4104700 0x7f96a4106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.384+0000 7f96a3fff700 1 -- 172.21.15.12:0/577135804 >> 172.21.15.12:0/577135804 conn(0x7f96a40fb740 msgr2=0x7f96a40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.384+0000 7f96a3fff700 1 -- 172.21.15.12:0/577135804 shutdown_connections 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.384+0000 7f96a3fff700 1 -- 172.21.15.12:0/577135804 wait complete. 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.385+0000 7f96a3fff700 1 Processor -- start 2023-12-11T20:22:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a3fff700 1 -- start start 2023-12-11T20:22:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a4101dd0 0x7f96a41016a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4104700 0x7f96a40ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96a4107030 0x7f96a41002c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a41009c0 con 0x7f96a4104700 2023-12-11T20:22:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a3fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4100b30 con 0x7f96a4101dd0 2023-12-11T20:22:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a3fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a41a11c0 con 0x7f96a4107030 2023-12-11T20:22:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4104700 0x7f96a40ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4104700 0x7f96a40ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53960/0 (socket says 172.21.15.12:53960) 2023-12-11T20:22:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a4101dd0 0x7f96a41016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.386+0000 7f96a27fc700 1 -- 172.21.15.12:0/3113829478 learned_addr learned my addr 172.21.15.12:0/3113829478 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.387+0000 7f96a37fe700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96a4107030 0x7f96a41002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.387+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3113829478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96a4107030 msgr2=0x7f96a41002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.387+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96a4107030 0x7f96a41002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.387+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4104700 msgr2=0x7f96a40ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.387+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4104700 0x7f96a40ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.387+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3113829478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c009d00 con 0x7f96a4101dd0 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.387+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a4101dd0 0x7f96a41016a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f969400e9f0 tx=0x7f969400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.388+0000 7f968bfff700 1 -- 172.21.15.12:0/3113829478 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400c9c0 con 0x7f96a4101dd0 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.388+0000 7f968bfff700 1 -- 172.21.15.12:0/3113829478 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9694010430 con 0x7f96a4101dd0 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.388+0000 7f968bfff700 1 -- 172.21.15.12:0/3113829478 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694018680 con 0x7f96a4101dd0 2023-12-11T20:22:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.388+0000 7f96a3fff700 1 -- 172.21.15.12:0/3113829478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a41a1420 con 0x7f96a4101dd0 2023-12-11T20:22:24.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.388+0000 7f96a3fff700 1 -- 172.21.15.12:0/3113829478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a41a1930 con 0x7f96a4101dd0 2023-12-11T20:22:24.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.393+0000 7f968bfff700 1 -- 172.21.15.12:0/3113829478 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f96940105a0 con 0x7f96a4101dd0 2023-12-11T20:22:24.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.394+0000 7f96bd045b80 1 Processor -- start 2023-12-11T20:22:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.394+0000 7f96bd045b80 1 -- start start 2023-12-11T20:22:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.394+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d1fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.394+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.394+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 0x5574a6d21240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.394+0000 7f96bd045b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6c7ab50 con 0x5574a6d1fa60 2023-12-11T20:22:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.394+0000 7f96bd045b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6c78470 con 0x5574a6d203c0 2023-12-11T20:22:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.394+0000 7f96bd045b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6c73d60 con 0x5574a6d20de0 2023-12-11T20:22:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d1fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d1fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53974/0 (socket says 172.21.15.12:53974) 2023-12-11T20:22:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 -- 172.21.15.12:0/3641723765 learned_addr learned my addr 172.21.15.12:0/3641723765 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f968bfff700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f968c0a15a0 0x7f968c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a27fc700 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 0x5574a6d21240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f968bfff700 1 -- 172.21.15.12:0/3113829478 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9694014070 con 0x7f96a4101dd0 2023-12-11T20:22:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f968c0a15a0 0x7f968c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 -- 172.21.15.12:0/3641723765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 msgr2=0x5574a6d21240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 0x5574a6d21240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 -- 172.21.15.12:0/3641723765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 msgr2=0x5574a6d208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d208a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.395+0000 7f96a37fe700 1 -- 172.21.15.12:0/3641723765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574a6af0630 con 0x5574a6d1fa60 2023-12-11T20:22:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.396+0000 7f96a37fe700 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d1fe80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f969c0060b0 tx=0x7f969c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9493e4b2a0efcc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.396+0000 7f96897fa700 1 -- 172.21.15.12:0/3641723765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c00e040 con 0x5574a6d1fa60 2023-12-11T20:22:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.396+0000 7f96897fa700 1 -- 172.21.15.12:0/3641723765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f969c007d50 con 0x5574a6d1fa60 2023-12-11T20:22:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.396+0000 7f96897fa700 1 -- 172.21.15.12:0/3641723765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c02acd0 con 0x5574a6d1fa60 2023-12-11T20:22:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 -- 172.21.15.12:0/3641723765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 msgr2=0x5574a6d1fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96a37fe700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f968c0a15a0 0x7f968c0a3a60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f969c02c000 tx=0x7f969c028000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d1fe80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f969c0060b0 tx=0x7f969c007720 comp rx=0 tx=0).stop 2023-12-11T20:22:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 -- 172.21.15.12:0/3641723765 shutdown_connections 2023-12-11T20:22:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 0x5574a6d21240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d1fe80 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3641723765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 -- 172.21.15.12:0/3641723765 >> 172.21.15.12:0/3641723765 conn(0x5574a6c4e7e0 msgr2=0x5574a6d1a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 -- 172.21.15.12:0/3641723765 shutdown_connections 2023-12-11T20:22:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.397+0000 7f96bd045b80 1 -- 172.21.15.12:0/3641723765 wait complete. 2023-12-11T20:22:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.398+0000 7f96bd045b80 1 -- start start 2023-12-11T20:22:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.398+0000 7f96bd045b80 1 Processor -- start 2023-12-11T20:22:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d293d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d29910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 0x5574a6d30900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96bd045b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6c2d560 con 0x5574a6d1fa60 2023-12-11T20:22:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96bd045b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6c2d200 con 0x5574a6d20de0 2023-12-11T20:22:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96bd045b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6af2920 con 0x5574a6d203c0 2023-12-11T20:22:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96bd045b80 10 client.0 _ll_register_callbacks cb 0x5574a6b58a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d293d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d293d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53984/0 (socket says 172.21.15.12:53984) 2023-12-11T20:22:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3668866964 learned_addr learned my addr 172.21.15.12:0/3668866964 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96a27fc700 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d29910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.399+0000 7f96a37fe700 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 0x5574a6d30900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3668866964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 msgr2=0x5574a6d29910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d29910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3668866964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 msgr2=0x5574a6d30900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 0x5574a6d30900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3668866964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a410a030 con 0x5574a6d1fa60 2023-12-11T20:22:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d293d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f96940965f0 tx=0x7f969409a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1b36b436df4ee8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f9686ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f9686ff5700 1 -- 172.21.15.12:0/3668866964 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940a21f0 con 0x5574a6d1fa60 2023-12-11T20:22:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96bd045b80 1 -- 172.21.15.12:0/3668866964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574a6d129e0 con 0x5574a6d1fa60 2023-12-11T20:22:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f9686ff5700 1 -- 172.21.15.12:0/3668866964 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9694010880 con 0x5574a6d1fa60 2023-12-11T20:22:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f9686ff5700 1 -- 172.21.15.12:0/3668866964 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f969409a7f0 con 0x5574a6d1fa60 2023-12-11T20:22:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96bd045b80 10 client.17349 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.400+0000 7f96bd045b80 1 -- 172.21.15.12:0/3668866964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5574a6a9cde0 con 0x5574a6d1fa60 2023-12-11T20:22:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.401+0000 7f9686ff5700 1 -- 172.21.15.12:0/3668866964 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5574a6d129e0 con 0x5574a6d1fa60 2023-12-11T20:22:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.401+0000 7f9686ff5700 1 -- 172.21.15.12:0/3668866964 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9694095ee0 con 0x5574a6d1fa60 2023-12-11T20:22:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.401+0000 7f96bd045b80 10 client.17349 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.401+0000 7f96bd045b80 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.401+0000 7f96bd045b80 20 client.17349 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.401+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574a6d34ff0 0x5574a6d37410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.401+0000 7f96bd045b80 4 client.17349 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.401+0000 7f96bd045b80 1 -- 172.21.15.12:0/3668866964 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574a6ceef40 con 0x5574a6d34ff0 2023-12-11T20:22:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.402+0000 7f96a27fc700 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574a6d34ff0 0x5574a6d37410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.402+0000 7f96a27fc700 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574a6d34ff0 0x5574a6d37410 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cfeeb1d9401128a server_cookie=dfff3674d8a71313 in_seq=0 out_seq=0 2023-12-11T20:22:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.402+0000 7f9686ff5700 10 client.17349 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.403+0000 7f9686ff5700 1 -- 172.21.15.12:0/3668866964 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5574a6ceef40 con 0x5574a6d34ff0 2023-12-11T20:22:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.403+0000 7f9686ff5700 10 client.17349 handle_command_reply: tid=0 2023-12-11T20:22:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.403+0000 7f96bd045b80 1 client.17349 shutdown 2023-12-11T20:22:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 -- 172.21.15.12:0/3668866964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 msgr2=0x5574a6d293d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d293d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f96940965f0 tx=0x7f969409a630 comp rx=0 tx=0).stop 2023-12-11T20:22:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 -- 172.21.15.12:0/3668866964 shutdown_connections 2023-12-11T20:22:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574a6d34ff0 0x5574a6d37410 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 0x5574a6d30900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d293d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3668866964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d29910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f9686ff5700 0 client.17349 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 -- 172.21.15.12:0/3668866964 >> 172.21.15.12:0/3668866964 conn(0x5574a6c4e7e0 msgr2=0x5574a6d1e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 -- 172.21.15.12:0/3668866964 shutdown_connections 2023-12-11T20:22:24.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 1 -- 172.21.15.12:0/3668866964 wait complete. 2023-12-11T20:22:24.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.404+0000 7f96bd045b80 20 client.17349 trim_cache size 0 max 16384 2023-12-11T20:22:24.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96bd045b80 1 Processor -- start 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96bd045b80 1 -- start start 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d288e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d308c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 0x5574a6d211c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96bd045b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6d28f40 con 0x5574a6d1fa60 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96bd045b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6d1b470 con 0x5574a6d20de0 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96bd045b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6d21700 con 0x5574a6d203c0 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.426+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d288e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d288e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53990/0 (socket says 172.21.15.12:53990) 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a2ffd700 1 -- 172.21.15.12:0/4107540795 learned_addr learned my addr 172.21.15.12:0/4107540795 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a37fe700 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 0x5574a6d211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a27fc700 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d308c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a2ffd700 1 -- 172.21.15.12:0/4107540795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 msgr2=0x5574a6d308c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d308c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a2ffd700 1 -- 172.21.15.12:0/4107540795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 msgr2=0x5574a6d211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 0x5574a6d211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a2ffd700 1 -- 172.21.15.12:0/4107540795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574a6a85c60 con 0x5574a6d1fa60 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a27fc700 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d288e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f969400cfd0 tx=0x7f9694009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1b3a5344bb07e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.427+0000 7f9689ffb700 1 -- 172.21.15.12:0/4107540795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694010880 con 0x5574a6d1fa60 2023-12-11T20:22:24.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f9689ffb700 1 -- 172.21.15.12:0/4107540795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96940d0030 con 0x5574a6d1fa60 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f9689ffb700 1 -- 172.21.15.12:0/4107540795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940a1ff0 con 0x5574a6d1fa60 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 -- 172.21.15.12:0/4107540795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 msgr2=0x5574a6d288e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d288e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f969400cfd0 tx=0x7f9694009790 comp rx=0 tx=0).stop 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 -- 172.21.15.12:0/4107540795 shutdown_connections 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d20de0 0x5574a6d211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d288e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 --2- 172.21.15.12:0/4107540795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d203c0 0x5574a6d308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 -- 172.21.15.12:0/4107540795 >> 172.21.15.12:0/4107540795 conn(0x5574a6c4e7e0 msgr2=0x5574a6d1a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 -- 172.21.15.12:0/4107540795 shutdown_connections 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.428+0000 7f96bd045b80 1 -- 172.21.15.12:0/4107540795 wait complete. 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.429+0000 7f96bd045b80 1 -- start start 2023-12-11T20:22:24.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.429+0000 7f96bd045b80 1 Processor -- start 2023-12-11T20:22:24.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.429+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d854d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.429+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d87a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96bd045b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 0x5574a6d89ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96bd045b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6d8a730 con 0x5574a6d1fa60 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96bd045b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6d8a8a0 con 0x5574a6d203c0 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96bd045b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574a6d8aa60 con 0x5574a6d20de0 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96bd045b80 10 client.0 _ll_register_callbacks cb 0x5574a6b58a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d854d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d854d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54006/0 (socket says 172.21.15.12:54006) 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3748503099 learned_addr learned my addr 172.21.15.12:0/3748503099 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a37fe700 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 0x5574a6d89ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3748503099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 msgr2=0x5574a6d89ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a27fc700 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d87a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 0x5574a6d89ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 msgr2=0x5574a6d87a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d87a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 -- 172.21.15.12:0/3748503099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574a6a9cde0 con 0x5574a6d1fa60 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a27fc700 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d87a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f96a2ffd700 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d854d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f969400e9c0 tx=0x7f9694099ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9901a2aa90b8ad46 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.430+0000 7f9686ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f9686ff5700 1 -- 172.21.15.12:0/3748503099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400cd20 con 0x5574a6d1fa60 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f9686ff5700 1 -- 172.21.15.12:0/3748503099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f969409a0f0 con 0x5574a6d1fa60 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 1 -- 172.21.15.12:0/3748503099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f969c007d50 con 0x5574a6d1fa60 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f9686ff5700 1 -- 172.21.15.12:0/3748503099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9694010880 con 0x5574a6d1fa60 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 10 client.17355 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 1 -- 172.21.15.12:0/3748503099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5574a6ac3250 con 0x5574a6d1fa60 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f9686ff5700 1 -- 172.21.15.12:0/3748503099 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f969c007d50 con 0x5574a6d1fa60 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f9686ff5700 1 -- 172.21.15.12:0/3748503099 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f96940187e0 con 0x5574a6d1fa60 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 10 client.17355 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:24.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 10 client.17355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 20 client.17355 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574a6d8bfa0 0x5574a6d8e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 4 client.17355 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:22:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.431+0000 7f96bd045b80 1 -- 172.21.15.12:0/3748503099 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5574a6c39fd0 con 0x5574a6d8bfa0 2023-12-11T20:22:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.432+0000 7f96a27fc700 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574a6d8bfa0 0x5574a6d8e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96a27fc700 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574a6d8bfa0 0x5574a6d8e390 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db4dd869ba423e15 server_cookie=3c3b75b9566eb534 in_seq=0 out_seq=0 2023-12-11T20:22:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f9686ff5700 10 client.17355 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f9686ff5700 1 -- 172.21.15.12:0/3748503099 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5574a6c39fd0 con 0x5574a6d8bfa0 2023-12-11T20:22:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f9686ff5700 10 client.17355 handle_command_reply: tid=0 2023-12-11T20:22:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 client.17355 shutdown 2023-12-11T20:22:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 -- 172.21.15.12:0/3748503099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 msgr2=0x5574a6d854d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d854d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f969400e9c0 tx=0x7f9694099ce0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 -- 172.21.15.12:0/3748503099 shutdown_connections 2023-12-11T20:22:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5574a6d8bfa0 0x5574a6d8e390 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574a6d20de0 0x5574a6d89ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574a6d1fa60 0x5574a6d854d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 --2- 172.21.15.12:0/3748503099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574a6d203c0 0x5574a6d87a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f9686ff5700 0 client.17355 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 -- 172.21.15.12:0/3748503099 >> 172.21.15.12:0/3748503099 conn(0x5574a6c4e7e0 msgr2=0x5574a6d26f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.433+0000 7f96bd045b80 1 -- 172.21.15.12:0/3748503099 shutdown_connections 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96bd045b80 1 -- 172.21.15.12:0/3748503099 wait complete. 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96bd045b80 20 client.17355 trim_cache size 0 max 16384 2023-12-11T20:22:24.436 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:22:24.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 -- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f968c0a15a0 msgr2=0x7f968c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f968c0a15a0 0x7f968c0a3a60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f969c02c000 tx=0x7f969c028000 comp rx=0 tx=0).stop 2023-12-11T20:22:24.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 -- 172.21.15.12:0/3113829478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a4101dd0 msgr2=0x7f96a41016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:24.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a4101dd0 0x7f96a41016a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f969400e9f0 tx=0x7f969400ed00 comp rx=0 tx=0).stop 2023-12-11T20:22:24.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 -- 172.21.15.12:0/3113829478 shutdown_connections 2023-12-11T20:22:24.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f968c0a15a0 0x7f968c0a3a60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a4101dd0 0x7f96a41016a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96a4107030 0x7f96a41002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 --2- 172.21.15.12:0/3113829478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a4104700 0x7f96a40ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:24.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.434+0000 7f96a3fff700 1 -- 172.21.15.12:0/3113829478 >> 172.21.15.12:0/3113829478 conn(0x7f96a40fb740 msgr2=0x7f96a4102710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:24.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.435+0000 7f96a3fff700 1 -- 172.21.15.12:0/3113829478 shutdown_connections 2023-12-11T20:22:24.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:24.435+0000 7f96a3fff700 1 -- 172.21.15.12:0/3113829478 wait complete. 2023-12-11T20:22:24.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:24 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1805043294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:22:24.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:24 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1805043294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:22:24.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:24 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1805043294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:22:25.454 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:22:25.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:22:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 -- 172.21.15.12:0/923559670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8420103040 msgr2=0x7f84201098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 --2- 172.21.15.12:0/923559670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8420103040 0x7f84201098f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f84180099c0 tx=0x7f8418009cd0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 -- 172.21.15.12:0/923559670 shutdown_connections 2023-12-11T20:22:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 --2- 172.21.15.12:0/923559670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84201014b0 0x7f84201018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 --2- 172.21.15.12:0/923559670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8420103040 0x7f84201098f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 --2- 172.21.15.12:0/923559670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84201026a0 0x7f8420102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 -- 172.21.15.12:0/923559670 >> 172.21.15.12:0/923559670 conn(0x7f84200fca00 msgr2=0x7f84200fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 -- 172.21.15.12:0/923559670 shutdown_connections 2023-12-11T20:22:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.702+0000 7f8427dff700 1 -- 172.21.15.12:0/923559670 wait complete. 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.703+0000 7f8427dff700 1 Processor -- start 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f8427dff700 1 -- start start 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f8427dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84201014b0 0x7f8420199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f8427dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84201026a0 0x7f8420199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f8427dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8420103040 0x7f84201a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f8427dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84201a1070 con 0x7f84201026a0 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f8427dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84201a11b0 con 0x7f8420103040 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f8427dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84201a1340 con 0x7f84201014b0 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f842539a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84201026a0 0x7f8420199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f842539a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84201026a0 0x7f8420199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54020/0 (socket says 172.21.15.12:54020) 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f842539a700 1 -- 172.21.15.12:0/1944890442 learned_addr learned my addr 172.21.15.12:0/1944890442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:25.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f8425b9b700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84201014b0 0x7f8420199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.704+0000 7f842639c700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8420103040 0x7f84201a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f842539a700 1 -- 172.21.15.12:0/1944890442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84201014b0 msgr2=0x7f8420199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f842539a700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84201014b0 0x7f8420199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f842539a700 1 -- 172.21.15.12:0/1944890442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8420103040 msgr2=0x7f84201a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f842539a700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8420103040 0x7f84201a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f842539a700 1 -- 172.21.15.12:0/1944890442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180095f0 con 0x7f84201026a0 2023-12-11T20:22:25.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f842539a700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84201026a0 0x7f8420199a80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f841000e9a0 tx=0x7f841000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f8416ffd700 1 -- 172.21.15.12:0/1944890442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410009790 con 0x7f84201026a0 2023-12-11T20:22:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f8416ffd700 1 -- 172.21.15.12:0/1944890442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f841000cbd0 con 0x7f84201026a0 2023-12-11T20:22:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f8427dff700 1 -- 172.21.15.12:0/1944890442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84201a1620 con 0x7f84201026a0 2023-12-11T20:22:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f8416ffd700 1 -- 172.21.15.12:0/1944890442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410018680 con 0x7f84201026a0 2023-12-11T20:22:25.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.705+0000 7f8427dff700 1 -- 172.21.15.12:0/1944890442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84201a1b80 con 0x7f84201026a0 2023-12-11T20:22:25.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.709+0000 7f8416ffd700 1 -- 172.21.15.12:0/1944890442 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f841000cd40 con 0x7f84201026a0 2023-12-11T20:22:25.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.710+0000 7f843b744b80 1 Processor -- start 2023-12-11T20:22:25.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.710+0000 7f843b744b80 1 -- start start 2023-12-11T20:22:25.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.710+0000 7f843b744b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x556403783870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.710+0000 7f843b744b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783db0 0x5564037846c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.710+0000 7f843b744b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403785120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.710+0000 7f843b744b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564036debd0 con 0x556403783db0 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.710+0000 7f843b744b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564036dc4f0 con 0x556403784ca0 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.710+0000 7f843b744b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564036d7de0 con 0x556403783450 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8425b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783db0 0x5564037846c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8425b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783db0 0x5564037846c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54028/0 (socket says 172.21.15.12:54028) 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8425b9b700 1 -- 172.21.15.12:0/3507022959 learned_addr learned my addr 172.21.15.12:0/3507022959 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f842639c700 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x556403783870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8416ffd700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f840c0a1500 0x7f840c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f842539a700 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403785120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8416ffd700 1 -- 172.21.15.12:0/1944890442 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8410014070 con 0x7f84201026a0 2023-12-11T20:22:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8425b9b700 1 -- 172.21.15.12:0/3507022959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 msgr2=0x556403783870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8425b9b700 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x556403783870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8425b9b700 1 -- 172.21.15.12:0/3507022959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 msgr2=0x556403785120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8425b9b700 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403785120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f8425b9b700 1 -- 172.21.15.12:0/3507022959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564035546b0 con 0x556403783db0 2023-12-11T20:22:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.711+0000 7f842639c700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f840c0a1500 0x7f840c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.712+0000 7f842539a700 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403785120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:25.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.712+0000 7f8425b9b700 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783db0 0x5564037846c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f841c009df0 tx=0x7f841c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a3953056a3047f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.712+0000 7f840bfff700 1 -- 172.21.15.12:0/3507022959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c018070 con 0x556403783db0 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.712+0000 7f840bfff700 1 -- 172.21.15.12:0/3507022959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f841c00f050 con 0x556403783db0 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.712+0000 7f840bfff700 1 -- 172.21.15.12:0/3507022959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c0047f0 con 0x556403783db0 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 -- 172.21.15.12:0/3507022959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783db0 msgr2=0x5564037846c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f842639c700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f840c0a1500 0x7f840c0a39c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f841800b580 tx=0x7f8418009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783db0 0x5564037846c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f841c009df0 tx=0x7f841c0077e0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 -- 172.21.15.12:0/3507022959 shutdown_connections 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403785120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x556403783870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 --2- 172.21.15.12:0/3507022959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783db0 0x5564037846c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 -- 172.21.15.12:0/3507022959 >> 172.21.15.12:0/3507022959 conn(0x5564036b2860 msgr2=0x55640377fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 -- 172.21.15.12:0/3507022959 shutdown_connections 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.713+0000 7f843b744b80 1 -- 172.21.15.12:0/3507022959 wait complete. 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.714+0000 7f843b744b80 1 -- start start 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.714+0000 7f843b744b80 1 Processor -- start 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f843b744b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783450 0x55640378d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f843b744b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f843b744b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f843b744b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564036915e0 con 0x556403784ca0 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f843b744b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556403691280 con 0x556403783450 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f843b744b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564035569a0 con 0x556403783db0 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f843b744b80 10 client.0 _ll_register_callbacks cb 0x5564035bcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842539a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f8425b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783450 0x55640378d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54034/0 (socket says 172.21.15.12:54034) 2023-12-11T20:22:25.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842639c700 1 -- 172.21.15.12:0/1842868502 learned_addr learned my addr 172.21.15.12:0/1842868502 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:25.716 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:25 smithi032 ceph-mon[132488]: pgmap v570: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842539a700 1 -- 172.21.15.12:0/1842868502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783450 msgr2=0x55640378d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842539a700 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783450 0x55640378d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842539a700 1 -- 172.21.15.12:0/1842868502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 msgr2=0x5564037947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842539a700 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037947b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.715+0000 7f842539a700 1 -- 172.21.15.12:0/1842868502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c009a20 con 0x556403783db0 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.716+0000 7f842539a700 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x556403784480 tx=0x7f841009a800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8922061b8cf82ea8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.716+0000 7f84097fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.716+0000 7f84097fa700 1 -- 172.21.15.12:0/1842868502 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841009a9c0 con 0x556403783db0 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.716+0000 7f843b744b80 1 -- 172.21.15.12:0/1842868502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556403776bc0 con 0x556403783db0 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.716+0000 7f84097fa700 1 -- 172.21.15.12:0/1842868502 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f841009a2c0 con 0x556403783db0 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.716+0000 7f84097fa700 1 -- 172.21.15.12:0/1842868502 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f841009e410 con 0x556403783db0 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.716+0000 7f843b744b80 10 client.27043 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:25.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.716+0000 7f843b744b80 1 -- 172.21.15.12:0/1842868502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556403500e60 con 0x556403783db0 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f84097fa700 1 -- 172.21.15.12:0/1842868502 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556403776bc0 con 0x556403783db0 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f84097fa700 1 -- 172.21.15.12:0/1842868502 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8410099220 con 0x556403783db0 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f843b744b80 10 client.27043 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f843b744b80 10 client.27043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f843b744b80 20 client.27043 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f843b744b80 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556403799020 0x55640379b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f843b744b80 4 client.27043 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f843b744b80 1 -- 172.21.15.12:0/1842868502 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556403752fc0 con 0x556403799020 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.717+0000 7f8425b9b700 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556403799020 0x55640379b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.718+0000 7f84097fa700 10 client.27043 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.718+0000 7f8425b9b700 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556403799020 0x55640379b440 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73525bf27add6a22 server_cookie=7549fba6c32e495 in_seq=0 out_seq=0 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f84097fa700 1 -- 172.21.15.12:0/1842868502 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556403752fc0 con 0x556403799020 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f84097fa700 10 client.27043 handle_command_reply: tid=0 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 client.27043 shutdown 2023-12-11T20:22:25.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 -- 172.21.15.12:0/1842868502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 msgr2=0x55640378d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x556403784480 tx=0x7f841009a800 comp rx=0 tx=0).stop 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 -- 172.21.15.12:0/1842868502 shutdown_connections 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556403799020 0x55640379b440 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783450 0x55640378d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037947b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 --2- 172.21.15.12:0/1842868502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 -- 172.21.15.12:0/1842868502 >> 172.21.15.12:0/1842868502 conn(0x5564036b2860 msgr2=0x55640377eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f84097fa700 0 client.27043 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 -- 172.21.15.12:0/1842868502 shutdown_connections 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.719+0000 7f843b744b80 1 -- 172.21.15.12:0/1842868502 wait complete. 2023-12-11T20:22:25.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.720+0000 7f843b744b80 20 client.27043 trim_cache size 0 max 16384 2023-12-11T20:22:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.739+0000 7f843b744b80 1 Processor -- start 2023-12-11T20:22:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.739+0000 7f843b744b80 1 -- start start 2023-12-11T20:22:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f843b744b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783450 0x55640378d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f843b744b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f843b744b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403794770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f843b744b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640378ceb0 con 0x556403783450 2023-12-11T20:22:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f843b744b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556403784520 con 0x556403784ca0 2023-12-11T20:22:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f843b744b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556403795960 con 0x556403783db0 2023-12-11T20:22:25.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f8425b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783450 0x55640378d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f8425b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783450 0x55640378d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54044/0 (socket says 172.21.15.12:54044) 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f8425b9b700 1 -- 172.21.15.12:0/4165922427 learned_addr learned my addr 172.21.15.12:0/4165922427 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f842639c700 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403794770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.740+0000 7f842539a700 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8425b9b700 1 -- 172.21.15.12:0/4165922427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 msgr2=0x55640378d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8425b9b700 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8425b9b700 1 -- 172.21.15.12:0/4165922427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 msgr2=0x556403794770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8425b9b700 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403794770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8425b9b700 1 -- 172.21.15.12:0/4165922427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564034e9ce0 con 0x556403783450 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f842639c700 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403794770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8425b9b700 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783450 0x55640378d320 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f841c009df0 tx=0x7f841c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f658a372914ccd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8414bff700 1 -- 172.21.15.12:0/4165922427 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c018030 con 0x556403783450 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8414bff700 1 -- 172.21.15.12:0/4165922427 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f841c019040 con 0x556403783450 2023-12-11T20:22:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.741+0000 7f8414bff700 1 -- 172.21.15.12:0/4165922427 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c024070 con 0x556403783450 2023-12-11T20:22:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 -- 172.21.15.12:0/4165922427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783450 msgr2=0x55640378d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783450 0x55640378d320 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f841c009df0 tx=0x7f841c009040 comp rx=0 tx=0).stop 2023-12-11T20:22:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 -- 172.21.15.12:0/4165922427 shutdown_connections 2023-12-11T20:22:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403784ca0 0x556403794770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403783450 0x55640378d320 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 --2- 172.21.15.12:0/4165922427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783db0 0x55640378d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 -- 172.21.15.12:0/4165922427 >> 172.21.15.12:0/4165922427 conn(0x5564036b2860 msgr2=0x5564037871b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 -- 172.21.15.12:0/4165922427 shutdown_connections 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 -- 172.21.15.12:0/4165922427 wait complete. 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.742+0000 7f843b744b80 1 -- start start 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.743+0000 7f843b744b80 1 Processor -- start 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.743+0000 7f843b744b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x5564037915c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.743+0000 7f843b744b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783db0 0x556403791b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.743+0000 7f843b744b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037ef510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.743+0000 7f843b744b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556403792040 con 0x556403784ca0 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.743+0000 7f843b744b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564037921b0 con 0x556403783db0 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.743+0000 7f843b744b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564037efa50 con 0x556403783450 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.743+0000 7f843b744b80 10 client.0 _ll_register_callbacks cb 0x5564035bcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842539a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783db0 0x556403791b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037ef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f8425b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x5564037915c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842539a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783db0 0x556403791b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46848/0 (socket says 172.21.15.12:46848) 2023-12-11T20:22:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842539a700 1 -- 172.21.15.12:0/3490919196 learned_addr learned my addr 172.21.15.12:0/3490919196 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842539a700 1 -- 172.21.15.12:0/3490919196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 msgr2=0x5564037915c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842539a700 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x5564037915c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842539a700 1 -- 172.21.15.12:0/3490919196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 msgr2=0x5564037ef510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842539a700 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037ef510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f842539a700 1 -- 172.21.15.12:0/3490919196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564035546b0 con 0x556403783db0 2023-12-11T20:22:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.744+0000 7f8425b9b700 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x5564037915c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:25.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f842539a700 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783db0 0x556403791b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8410010bd0 tx=0x7f8410099f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28bf7855c21f37d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:25.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f84097fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:25.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f84097fa700 1 -- 172.21.15.12:0/3490919196 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841009a9c0 con 0x556403783db0 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f843b744b80 1 -- 172.21.15.12:0/3490919196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f841c00f050 con 0x556403783db0 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f84097fa700 1 -- 172.21.15.12:0/3490919196 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f841009a2c0 con 0x556403783db0 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f84097fa700 1 -- 172.21.15.12:0/3490919196 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f841009e410 con 0x556403783db0 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f843b744b80 10 client.27053 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f843b744b80 1 -- 172.21.15.12:0/3490919196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5564035272d0 con 0x556403783db0 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f84097fa700 1 -- 172.21.15.12:0/3490919196 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f841c00f050 con 0x556403783db0 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.745+0000 7f84097fa700 1 -- 172.21.15.12:0/3490919196 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f84100960b0 con 0x556403783db0 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.746+0000 7f843b744b80 10 client.27053 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.746+0000 7f843b744b80 10 client.27053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.746+0000 7f843b744b80 20 client.27053 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.746+0000 7f843b744b80 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5564037f1130 0x5564037f3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.746+0000 7f843b744b80 4 client.27053 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:22:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.746+0000 7f843b744b80 1 -- 172.21.15.12:0/3490919196 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55640369e050 con 0x5564037f1130 2023-12-11T20:22:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.746+0000 7f8425b9b700 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5564037f1130 0x5564037f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.747+0000 7f84097fa700 10 client.27053 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.747+0000 7f8425b9b700 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5564037f1130 0x5564037f3550 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66b86bbe9073522d server_cookie=26440630ded54611 in_seq=0 out_seq=0 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f84097fa700 1 -- 172.21.15.12:0/3490919196 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55640369e050 con 0x5564037f1130 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f84097fa700 10 client.27053 handle_command_reply: tid=0 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 client.27053 shutdown 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 -- 172.21.15.12:0/3490919196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783db0 msgr2=0x556403791b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783db0 0x556403791b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8410010bd0 tx=0x7f8410099f30 comp rx=0 tx=0).stop 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 -- 172.21.15.12:0/3490919196 shutdown_connections 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5564037f1130 0x5564037f3550 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556403784ca0 0x5564037ef510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556403783450 0x5564037915c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f84097fa700 0 client.27053 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 --2- 172.21.15.12:0/3490919196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556403783db0 0x556403791b00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 -- 172.21.15.12:0/3490919196 >> 172.21.15.12:0/3490919196 conn(0x5564036b2860 msgr2=0x55640377f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 -- 172.21.15.12:0/3490919196 shutdown_connections 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.748+0000 7f843b744b80 1 -- 172.21.15.12:0/3490919196 wait complete. 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f843b744b80 20 client.27053 trim_cache size 0 max 16384 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "0b3930c8-064e-446e-8721-f7919653b508", 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:22:25.750 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:22:25.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 -- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f840c0a1500 msgr2=0x7f840c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f840c0a1500 0x7f840c0a39c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f841800b580 tx=0x7f8418009310 comp rx=0 tx=0).stop 2023-12-11T20:22:25.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 -- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84201026a0 msgr2=0x7f8420199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:25.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84201026a0 0x7f8420199a80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f841000e9a0 tx=0x7f841000ed60 comp rx=0 tx=0).stop 2023-12-11T20:22:25.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 -- 172.21.15.12:0/1944890442 shutdown_connections 2023-12-11T20:22:25.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f840c0a1500 0x7f840c0a39c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8420103040 0x7f84201a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84201014b0 0x7f8420199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 --2- 172.21.15.12:0/1944890442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84201026a0 0x7f8420199a80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:25.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 -- 172.21.15.12:0/1944890442 >> 172.21.15.12:0/1944890442 conn(0x7f84200fca00 msgr2=0x7f8420073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:25.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.749+0000 7f8427dff700 1 -- 172.21.15.12:0/1944890442 shutdown_connections 2023-12-11T20:22:25.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:25.750+0000 7f8427dff700 1 -- 172.21.15.12:0/1944890442 wait complete. 2023-12-11T20:22:25.767 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:25 smithi012 ceph-mon[128787]: pgmap v570: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:25.771 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:22:25.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:25 smithi039 ceph-mon[102205]: pgmap v570: 97 pgs: 97 active+clean; 4.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:26.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 -- 172.21.15.12:0/943776815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418101fe0 msgr2=0x7f34181043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 --2- 172.21.15.12:0/943776815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418101fe0 0x7f34181043d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3414009990 tx=0x7f3414009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 -- 172.21.15.12:0/943776815 shutdown_connections 2023-12-11T20:22:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 --2- 172.21.15.12:0/943776815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3418107240 0x7f3418109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 --2- 172.21.15.12:0/943776815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418101fe0 0x7f34181043d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 --2- 172.21.15.12:0/943776815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3418104910 0x7f3418106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 -- 172.21.15.12:0/943776815 >> 172.21.15.12:0/943776815 conn(0x7f34180fb930 msgr2=0x7f34180fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 -- 172.21.15.12:0/943776815 shutdown_connections 2023-12-11T20:22:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.006+0000 7f341fbff700 1 -- 172.21.15.12:0/943776815 wait complete. 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.007+0000 7f341fbff700 1 Processor -- start 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.007+0000 7f341fbff700 1 -- start start 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341fbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3418101fe0 0x7f3418199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341fbff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3418104910 0x7f3418199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341fbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418107240 0x7f34181a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341fbff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34181a1070 con 0x7f3418107240 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341fbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34181a11b0 con 0x7f3418101fe0 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341fbff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34181a1340 con 0x7f3418104910 2023-12-11T20:22:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341e19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418107240 0x7f34181a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341d19a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3418104910 0x7f3418199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341d19a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3418104910 0x7f3418199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:42134/0 (socket says 172.21.15.12:42134) 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341e19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418107240 0x7f34181a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54076/0 (socket says 172.21.15.12:54076) 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341d19a700 1 -- 172.21.15.12:0/1240879129 learned_addr learned my addr 172.21.15.12:0/1240879129 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341d99b700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3418101fe0 0x7f3418199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341e19c700 1 -- 172.21.15.12:0/1240879129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3418104910 msgr2=0x7f3418199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.008+0000 7f341e19c700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3418104910 0x7f3418199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f341e19c700 1 -- 172.21.15.12:0/1240879129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3418101fe0 msgr2=0x7f3418199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f341e19c700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3418101fe0 0x7f3418199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f341e19c700 1 -- 172.21.15.12:0/1240879129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140095f0 con 0x7f3418107240 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f341d19a700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3418104910 0x7f3418199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f341e19c700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418107240 0x7f34181a0aa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3410007f10 tx=0x7f341000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f340effd700 1 -- 172.21.15.12:0/1240879129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410004db0 con 0x7f3418107240 2023-12-11T20:22:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f341fbff700 1 -- 172.21.15.12:0/1240879129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34181a1620 con 0x7f3418107240 2023-12-11T20:22:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f340effd700 1 -- 172.21.15.12:0/1240879129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f341000f040 con 0x7f3418107240 2023-12-11T20:22:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f340effd700 1 -- 172.21.15.12:0/1240879129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410005960 con 0x7f3418107240 2023-12-11T20:22:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.009+0000 7f341fbff700 1 -- 172.21.15.12:0/1240879129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34181a1b30 con 0x7f3418107240 2023-12-11T20:22:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.014+0000 7f340effd700 1 -- 172.21.15.12:0/1240879129 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f341000db20 con 0x7f3418107240 2023-12-11T20:22:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.015+0000 7f343345cb80 1 Processor -- start 2023-12-11T20:22:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.015+0000 7f343345cb80 1 -- start start 2023-12-11T20:22:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.015+0000 7f343345cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613719153d0 0x5613719157f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f343345cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x561371916640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f343345cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561371916c20 0x5613719170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f343345cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561371870b50 con 0x561371916c20 2023-12-11T20:22:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f343345cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56137186e470 con 0x561371915d30 2023-12-11T20:22:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f343345cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561371869d60 con 0x5613719153d0 2023-12-11T20:22:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f340effd700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34040a1500 0x7f34040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f341d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561371916c20 0x5613719170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f340effd700 1 -- 172.21.15.12:0/1240879129 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f34100cc5b0 con 0x7f3418107240 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f341d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561371916c20 0x5613719170a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54088/0 (socket says 172.21.15.12:54088) 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f341d99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x561371916640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f341d19a700 1 -- 172.21.15.12:0/2008972805 learned_addr learned my addr 172.21.15.12:0/2008972805 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f341d19a700 1 --2- 172.21.15.12:0/2008972805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613719153d0 0x5613719157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f341e19c700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34040a1500 0x7f34040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f341d99b700 1 -- 172.21.15.12:0/2008972805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613719153d0 msgr2=0x5613719157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.016+0000 7f341d99b700 1 --2- 172.21.15.12:0/2008972805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613719153d0 0x5613719157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.017+0000 7f341d99b700 1 -- 172.21.15.12:0/2008972805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561371916c20 msgr2=0x5613719170a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.017+0000 7f341d99b700 1 --2- 172.21.15.12:0/2008972805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561371916c20 0x5613719170a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.017+0000 7f341d99b700 1 -- 172.21.15.12:0/2008972805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613716e6630 con 0x561371915d30 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.017+0000 7f341d99b700 1 --2- 172.21.15.12:0/2008972805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x561371916640 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f34140098e0 tx=0x7f3414005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a42951249879d7a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.017+0000 7f341e19c700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34040a1500 0x7f34040a39c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3410095d80 tx=0x7f3410009580 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.017+0000 7f3403fff700 1 -- 172.21.15.12:0/2008972805 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341401d070 con 0x561371915d30 2023-12-11T20:22:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f3403fff700 1 -- 172.21.15.12:0/2008972805 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f341401e040 con 0x561371915d30 2023-12-11T20:22:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f3403fff700 1 -- 172.21.15.12:0/2008972805 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400b710 con 0x561371915d30 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f343345cb80 1 -- 172.21.15.12:0/2008972805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 msgr2=0x561371916640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f343345cb80 1 --2- 172.21.15.12:0/2008972805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x561371916640 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f34140098e0 tx=0x7f3414005bc0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f343345cb80 1 -- 172.21.15.12:0/2008972805 shutdown_connections 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f343345cb80 1 --2- 172.21.15.12:0/2008972805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561371916c20 0x5613719170a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f343345cb80 1 --2- 172.21.15.12:0/2008972805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613719153d0 0x5613719157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f343345cb80 1 --2- 172.21.15.12:0/2008972805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x561371916640 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f343345cb80 1 -- 172.21.15.12:0/2008972805 >> 172.21.15.12:0/2008972805 conn(0x5613718447e0 msgr2=0x561371911d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.018+0000 7f343345cb80 1 -- 172.21.15.12:0/2008972805 shutdown_connections 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.019+0000 7f343345cb80 1 -- 172.21.15.12:0/2008972805 wait complete. 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.019+0000 7f343345cb80 1 -- start start 2023-12-11T20:22:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.020+0000 7f343345cb80 1 Processor -- start 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.020+0000 7f343345cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x56137191f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.020+0000 7f343345cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x56137191f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.020+0000 7f343345cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371926660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.020+0000 7f343345cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561371823560 con 0x5613719153d0 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.020+0000 7f343345cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561371823200 con 0x561371915d30 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.020+0000 7f343345cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613716e8920 con 0x561371916c20 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.020+0000 7f343345cb80 10 client.0 _ll_register_callbacks cb 0x56137174ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x56137191f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x56137191f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54100/0 (socket says 172.21.15.12:54100) 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x56137191f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 -- 172.21.15.12:0/52849894 learned_addr learned my addr 172.21.15.12:0/52849894 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371926660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 -- 172.21.15.12:0/52849894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 msgr2=0x561371926660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371926660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 -- 172.21.15.12:0/52849894 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 msgr2=0x56137191f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x56137191f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 -- 172.21.15.12:0/52849894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341810a240 con 0x5613719153d0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f341d19a700 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x56137191f0e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f34080046a0 tx=0x7f34080047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1770f4c7941341 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.021+0000 7f34017fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.022+0000 7f34017fa700 1 -- 172.21.15.12:0/52849894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408011020 con 0x5613719153d0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.022+0000 7f34017fa700 1 -- 172.21.15.12:0/52849894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3408011180 con 0x5613719153d0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.022+0000 7f343345cb80 1 -- 172.21.15.12:0/52849894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561371908b40 con 0x5613719153d0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.022+0000 7f34017fa700 1 -- 172.21.15.12:0/52849894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3408004830 con 0x5613719153d0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.022+0000 7f343345cb80 10 client.17385 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.022+0000 7f343345cb80 1 -- 172.21.15.12:0/52849894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561371692de0 con 0x5613719153d0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.022+0000 7f34017fa700 1 -- 172.21.15.12:0/52849894 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561371908b40 con 0x5613719153d0 2023-12-11T20:22:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.022+0000 7f34017fa700 1 -- 172.21.15.12:0/52849894 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f34080053e0 con 0x5613719153d0 2023-12-11T20:22:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.023+0000 7f343345cb80 10 client.17385 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.023+0000 7f343345cb80 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.023+0000 7f343345cb80 20 client.17385 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.023+0000 7f343345cb80 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56137192af90 0x56137192d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.023+0000 7f343345cb80 4 client.17385 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.023+0000 7f343345cb80 1 -- 172.21.15.12:0/52849894 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613718e4f40 con 0x56137192af90 2023-12-11T20:22:26.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.023+0000 7f341d99b700 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56137192af90 0x56137192d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.024+0000 7f34017fa700 10 client.17385 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:26.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.024+0000 7f341d99b700 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56137192af90 0x56137192d3b0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2848b8eadba61fe7 server_cookie=b8d507ce7095b7f9 in_seq=0 out_seq=0 2023-12-11T20:22:26.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f34017fa700 1 -- 172.21.15.12:0/52849894 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5613718e4f40 con 0x56137192af90 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f34017fa700 10 client.17385 handle_command_reply: tid=0 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 client.17385 shutdown 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 -- 172.21.15.12:0/52849894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 msgr2=0x56137191f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x56137191f0e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f34080046a0 tx=0x7f34080047c0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 -- 172.21.15.12:0/52849894 shutdown_connections 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56137192af90 0x56137192d3b0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371926660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x56137191f0e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 --2- 172.21.15.12:0/52849894 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x56137191f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 -- 172.21.15.12:0/52849894 >> 172.21.15.12:0/52849894 conn(0x5613718447e0 msgr2=0x561371910a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f34017fa700 0 client.17385 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 -- 172.21.15.12:0/52849894 shutdown_connections 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 1 -- 172.21.15.12:0/52849894 wait complete. 2023-12-11T20:22:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.025+0000 7f343345cb80 20 client.17385 trim_cache size 0 max 16384 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.046+0000 7f343345cb80 1 Processor -- start 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.046+0000 7f343345cb80 1 -- start start 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.046+0000 7f343345cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371919b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.046+0000 7f343345cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x56137191a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.046+0000 7f343345cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371926620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.046+0000 7f343345cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56137191ec80 con 0x5613719153d0 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.046+0000 7f343345cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613719174b0 con 0x561371915d30 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.046+0000 7f343345cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561371928420 con 0x561371916c20 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371919b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371919b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54114/0 (socket says 172.21.15.12:54114) 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 -- 172.21.15.12:0/3591951405 learned_addr learned my addr 172.21.15.12:0/3591951405 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:26.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d99b700 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x56137191a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371926620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 -- 172.21.15.12:0/3591951405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 msgr2=0x561371926620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371926620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 -- 172.21.15.12:0/3591951405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 msgr2=0x56137191a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x56137191a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 -- 172.21.15.12:0/3591951405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56137167bc60 con 0x5613719153d0 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.047+0000 7f341d19a700 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371919b50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3408011610 tx=0x7f34080115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51cb5926b38e8c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f340cbff700 1 -- 172.21.15.12:0/3591951405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800e7c0 con 0x5613719153d0 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f340cbff700 1 -- 172.21.15.12:0/3591951405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f340800ea50 con 0x5613719153d0 2023-12-11T20:22:26.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f340cbff700 1 -- 172.21.15.12:0/3591951405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34080122b0 con 0x5613719153d0 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f343345cb80 1 -- 172.21.15.12:0/3591951405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 msgr2=0x561371919b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f343345cb80 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371919b50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3408011610 tx=0x7f34080115a0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f343345cb80 1 -- 172.21.15.12:0/3591951405 shutdown_connections 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f343345cb80 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371926620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f343345cb80 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371919b50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f343345cb80 1 --2- 172.21.15.12:0/3591951405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x56137191a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.048+0000 7f343345cb80 1 -- 172.21.15.12:0/3591951405 >> 172.21.15.12:0/3591951405 conn(0x5613718447e0 msgr2=0x561371931d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.049+0000 7f343345cb80 1 -- 172.21.15.12:0/3591951405 shutdown_connections 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.049+0000 7f343345cb80 1 -- 172.21.15.12:0/3591951405 wait complete. 2023-12-11T20:22:26.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.049+0000 7f343345cb80 1 -- start start 2023-12-11T20:22:26.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.049+0000 7f343345cb80 1 Processor -- start 2023-12-11T20:22:26.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f343345cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371922180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f343345cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x5613719226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f343345cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371925640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f343345cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561371925b80 con 0x5613719153d0 2023-12-11T20:22:26.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f343345cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561371925cf0 con 0x561371915d30 2023-12-11T20:22:26.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f343345cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561371925eb0 con 0x561371916c20 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f343345cb80 10 client.0 _ll_register_callbacks cb 0x56137174ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f341d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371922180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f341d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371922180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54122/0 (socket says 172.21.15.12:54122) 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f341d19a700 1 -- 172.21.15.12:0/2898775335 learned_addr learned my addr 172.21.15.12:0/2898775335 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.050+0000 7f341d99b700 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x5613719226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f341d19a700 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371925640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f341d99b700 1 -- 172.21.15.12:0/2898775335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 msgr2=0x561371925640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f341d99b700 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371925640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f341d99b700 1 -- 172.21.15.12:0/2898775335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 msgr2=0x561371922180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f341d99b700 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371922180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f341d99b700 1 -- 172.21.15.12:0/2898775335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561371692de0 con 0x561371915d30 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f341d19a700 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371922180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f341d99b700 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x5613719226c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3414003f60 tx=0x7f341401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36ccb3989713af17 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.051+0000 7f34017fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.052+0000 7f34017fa700 1 -- 172.21.15.12:0/2898775335 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414032040 con 0x561371915d30 2023-12-11T20:22:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.052+0000 7f343345cb80 1 -- 172.21.15.12:0/2898775335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f341401e040 con 0x561371915d30 2023-12-11T20:22:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.052+0000 7f34017fa700 1 -- 172.21.15.12:0/2898775335 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3414034e40 con 0x561371915d30 2023-12-11T20:22:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.052+0000 7f34017fa700 1 -- 172.21.15.12:0/2898775335 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f341401d040 con 0x561371915d30 2023-12-11T20:22:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.052+0000 7f343345cb80 10 client.27071 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.052+0000 7f343345cb80 1 -- 172.21.15.12:0/2898775335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5613716b9250 con 0x561371915d30 2023-12-11T20:22:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.053+0000 7f34017fa700 1 -- 172.21.15.12:0/2898775335 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3414044020 con 0x561371915d30 2023-12-11T20:22:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.053+0000 7f34017fa700 1 -- 172.21.15.12:0/2898775335 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f34140050d0 con 0x561371915d30 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.053+0000 7f343345cb80 10 client.27071 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.053+0000 7f343345cb80 10 client.27071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.053+0000 7f343345cb80 20 client.27071 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.053+0000 7f343345cb80 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561371981cc0 0x5613719840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.053+0000 7f343345cb80 4 client.27071 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.053+0000 7f343345cb80 1 -- 172.21.15.12:0/2898775335 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56137182ffd0 con 0x561371981cc0 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.054+0000 7f341d19a700 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561371981cc0 0x5613719840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.054+0000 7f341d19a700 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561371981cc0 0x5613719840e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ebab874ae5efb0f server_cookie=60f78f7335f8fbf3 in_seq=0 out_seq=0 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.054+0000 7f34017fa700 10 client.27071 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.054+0000 7f34017fa700 1 -- 172.21.15.12:0/2898775335 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56137182ffd0 con 0x561371981cc0 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f34017fa700 10 client.27071 handle_command_reply: tid=0 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 client.27071 shutdown 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 -- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 msgr2=0x5613719226c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x5613719226c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3414003f60 tx=0x7f341401a040 comp rx=0 tx=0).stop 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 -- 172.21.15.12:0/2898775335 shutdown_connections 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561371981cc0 0x5613719840e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561371916c20 0x561371925640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613719153d0 0x561371922180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f34017fa700 0 client.27071 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 --2- 172.21.15.12:0/2898775335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561371915d30 0x5613719226c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 -- 172.21.15.12:0/2898775335 >> 172.21.15.12:0/2898775335 conn(0x5613718447e0 msgr2=0x561371919b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 -- 172.21.15.12:0/2898775335 shutdown_connections 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 1 -- 172.21.15.12:0/2898775335 wait complete. 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.055+0000 7f343345cb80 20 client.27071 trim_cache size 0 max 16384 2023-12-11T20:22:26.056 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout: "0b3930c8-064e-446e-8721-f7919653b508": { 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "0b3930c8-064e-446e-8721-f7919653b508", 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:22:26.057 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 -- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34040a1500 msgr2=0x7f34040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34040a1500 0x7f34040a39c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3410095d80 tx=0x7f3410009580 comp rx=0 tx=0).stop 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 -- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418107240 msgr2=0x7f34181a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418107240 0x7f34181a0aa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3410007f10 tx=0x7f341000d3b0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 -- 172.21.15.12:0/1240879129 shutdown_connections 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34040a1500 0x7f34040a39c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3418101fe0 0x7f3418199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3418107240 0x7f34181a0aa0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 --2- 172.21.15.12:0/1240879129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3418104910 0x7f3418199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 -- 172.21.15.12:0/1240879129 >> 172.21.15.12:0/1240879129 conn(0x7f34180fb930 msgr2=0x7f34181018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 -- 172.21.15.12:0/1240879129 shutdown_connections 2023-12-11T20:22:26.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:26.056+0000 7f341fbff700 1 -- 172.21.15.12:0/1240879129 wait complete. 2023-12-11T20:22:26.074 INFO:tasks.cephfs.filesystem:scrub status for tag:0b3930c8-064e-446e-8721-f7919653b508 - {'path': '/', 'tag': '0b3930c8-064e-446e-8721-f7919653b508', 'options': 'recursive,force'} 2023-12-11T20:22:26.213 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:22:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:22:25.758+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v146>,<0x10000000003/client.0 v148>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v165>,<0x10000000001/sv_0 v189>,<0x10000000000/_nogroup v173>,<0x1/volumes v165>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:22:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:22:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:22:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:22:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:22:26.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:22:26.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:22:26.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:22:26.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:22:26.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:22:26.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:22:26.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:22:26.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:22:26.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:22:26.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:22:26.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:26.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:22:26.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:27 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:22:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:27 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:27 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:22:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:27 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:27 smithi032 ceph-mon[132488]: pgmap v571: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:22:27.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:27 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:22:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:27 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:27 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:22:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:27 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:27.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:27 smithi039 ceph-mon[102205]: pgmap v571: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:22:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:27 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:22:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:27 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:27 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:22:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:27 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:27 smithi012 ceph-mon[128787]: pgmap v571: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:22:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:29 smithi032 ceph-mon[132488]: pgmap v572: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:22:29.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:29 smithi039 ceph-mon[102205]: pgmap v572: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:22:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:29 smithi012 ceph-mon[128787]: pgmap v572: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:22:31.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:31 smithi039 ceph-mon[102205]: pgmap v573: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:31 smithi012 ceph-mon[128787]: pgmap v573: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:31 smithi032 ceph-mon[132488]: pgmap v573: 97 pgs: 97 active+clean; 4.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:33 smithi039 ceph-mon[102205]: pgmap v574: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:22:33.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:33 smithi012 ceph-mon[128787]: pgmap v574: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:22:33.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:33 smithi032 ceph-mon[132488]: pgmap v574: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.388+0000 7f13c13ff700 1 -- 172.21.15.12:0/2079566311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 msgr2=0x7f13bc109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.388+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2079566311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 0x7f13bc109930 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f13b400b0d0 tx=0x7f13b400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.389+0000 7f13c13ff700 1 -- 172.21.15.12:0/2079566311 shutdown_connections 2023-12-11T20:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.389+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2079566311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 0x7f13bc109930 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.389+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2079566311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13bc1014f0 0x7f13bc101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.389+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2079566311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc1026e0 0x7f13bc102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.389+0000 7f13c13ff700 1 -- 172.21.15.12:0/2079566311 >> 172.21.15.12:0/2079566311 conn(0x7f13bc0fca60 msgr2=0x7f13bc0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.389+0000 7f13c13ff700 1 -- 172.21.15.12:0/2079566311 shutdown_connections 2023-12-11T20:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.389+0000 7f13c13ff700 1 -- 172.21.15.12:0/2079566311 wait complete. 2023-12-11T20:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.390+0000 7f13c13ff700 1 Processor -- start 2023-12-11T20:22:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.390+0000 7f13c13ff700 1 -- start start 2023-12-11T20:22:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.390+0000 7f13c13ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13bc1014f0 0x7f13bc199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13c13ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc1026e0 0x7f13bc199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13c13ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 0x7f13bc1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13c13ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc1a1100 con 0x7f13bc103080 2023-12-11T20:22:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13c13ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc1a1240 con 0x7f13bc1026e0 2023-12-11T20:22:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13c13ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc1a13d0 con 0x7f13bc1014f0 2023-12-11T20:22:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13baffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13bc1014f0 0x7f13bc199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 0x7f13bc1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc1026e0 0x7f13bc199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc1026e0 0x7f13bc199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:48350/0 (socket says 172.21.15.12:48350) 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.391+0000 7f13ba7fc700 1 -- 172.21.15.12:0/2014084173 learned_addr learned my addr 172.21.15.12:0/2014084173 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13bb7fe700 1 -- 172.21.15.12:0/2014084173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13bc1014f0 msgr2=0x7f13bc199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13bb7fe700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13bc1014f0 0x7f13bc199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13bb7fe700 1 -- 172.21.15.12:0/2014084173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc1026e0 msgr2=0x7f13bc199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13bb7fe700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc1026e0 0x7f13bc199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13bb7fe700 1 -- 172.21.15.12:0/2014084173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b4009d00 con 0x7f13bc103080 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13bb7fe700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 0x7f13bc1a0b30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f13b400b770 tx=0x7f13b400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13a3fff700 1 -- 172.21.15.12:0/2014084173 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b400e040 con 0x7f13bc103080 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13a3fff700 1 -- 172.21.15.12:0/2014084173 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13b40094b0 con 0x7f13bc103080 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13a3fff700 1 -- 172.21.15.12:0/2014084173 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b401b450 con 0x7f13bc103080 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13c13ff700 1 -- 172.21.15.12:0/2014084173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc1a1650 con 0x7f13bc103080 2023-12-11T20:22:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.392+0000 7f13c13ff700 1 -- 172.21.15.12:0/2014084173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc1a1a80 con 0x7f13bc103080 2023-12-11T20:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.397+0000 7f13a3fff700 1 -- 172.21.15.12:0/2014084173 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f13b401d480 con 0x7f13bc103080 2023-12-11T20:22:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.398+0000 7f13d4c30b80 1 Processor -- start 2023-12-11T20:22:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.398+0000 7f13d4c30b80 1 -- start start 2023-12-11T20:22:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da99ed0 0x558e3da9a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3da9b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3da9bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3d9f5af0 con 0x558e3da9b720 2023-12-11T20:22:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3d9f3410 con 0x558e3da9a830 2023-12-11T20:22:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3d9eed00 con 0x558e3da99ed0 2023-12-11T20:22:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13a3fff700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13a40a1470 0x7f13a40a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3da9bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3da9bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35302/0 (socket says 172.21.15.12:35302) 2023-12-11T20:22:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.399+0000 7f13ba7fc700 1 -- 172.21.15.12:0/319221809 learned_addr learned my addr 172.21.15.12:0/319221809 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da99ed0 0x558e3da9a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13baffd700 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3da9b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13a3fff700 1 -- 172.21.15.12:0/2014084173 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f13b40ce570 con 0x7f13bc103080 2023-12-11T20:22:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13bb7fe700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13a40a1470 0x7f13a40a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13ba7fc700 1 -- 172.21.15.12:0/319221809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da99ed0 msgr2=0x558e3da9a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da99ed0 0x558e3da9a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13ba7fc700 1 -- 172.21.15.12:0/319221809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 msgr2=0x558e3da9b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3da9b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13ba7fc700 1 -- 172.21.15.12:0/319221809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e3d86b5d0 con 0x558e3da9b720 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3da9bba0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f13b0012970 tx=0x7f13b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6431783046f9d03 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.400+0000 7f13bb7fe700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13a40a1470 0x7f13a40a3930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f13b40cc020 tx=0x7f13b4009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.401+0000 7f13a17fa700 1 -- 172.21.15.12:0/319221809 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0004030 con 0x558e3da9b720 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.401+0000 7f13a17fa700 1 -- 172.21.15.12:0/319221809 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13b0003680 con 0x558e3da9b720 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.401+0000 7f13a17fa700 1 -- 172.21.15.12:0/319221809 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000f710 con 0x558e3da9b720 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.401+0000 7f13d4c30b80 1 -- 172.21.15.12:0/319221809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 msgr2=0x558e3da9bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.401+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3da9bba0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f13b0012970 tx=0x7f13b00047c0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.402+0000 7f13d4c30b80 1 -- 172.21.15.12:0/319221809 shutdown_connections 2023-12-11T20:22:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.402+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3da9bba0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.402+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da99ed0 0x558e3da9a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.402+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/319221809 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3da9b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.402+0000 7f13d4c30b80 1 -- 172.21.15.12:0/319221809 >> 172.21.15.12:0/319221809 conn(0x558e3d9c9780 msgr2=0x558e3da96880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.402+0000 7f13d4c30b80 1 -- 172.21.15.12:0/319221809 shutdown_connections 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.402+0000 7f13d4c30b80 1 -- 172.21.15.12:0/319221809 wait complete. 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.402+0000 7f13d4c30b80 1 -- start start 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13d4c30b80 1 Processor -- start 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3d9a8500 con 0x558e3da9b720 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3d9a81a0 con 0x558e3da99ed0 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3d86d8c0 con 0x558e3da9a830 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13d4c30b80 10 client.0 _ll_register_callbacks cb 0x558e3d8d3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.403+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35318/0 (socket says 172.21.15.12:35318) 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13ba7fc700 1 -- 172.21.15.12:0/2711524195 learned_addr learned my addr 172.21.15.12:0/2711524195 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13baffd700 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13baffd700 1 -- 172.21.15.12:0/2711524195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 msgr2=0x558e3daa3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13baffd700 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13baffd700 1 -- 172.21.15.12:0/2711524195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 msgr2=0x558e3daab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13baffd700 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13baffd700 1 -- 172.21.15.12:0/2711524195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b001a040 con 0x558e3da9a830 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f13baffd700 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa44e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0126d0 tx=0x7f13ac0129e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87dee17253ccd7dd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.404+0000 7f139eff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.405+0000 7f139eff5700 1 -- 172.21.15.12:0/2711524195 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac017070 con 0x558e3da9a830 2023-12-11T20:22:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.405+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2711524195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e3da8d730 con 0x558e3da9a830 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.405+0000 7f139eff5700 1 -- 172.21.15.12:0/2711524195 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f13ac004050 con 0x558e3da9a830 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.405+0000 7f139eff5700 1 -- 172.21.15.12:0/2711524195 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13ac004210 con 0x558e3da9a830 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.405+0000 7f13d4c30b80 10 client.27079 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.405+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2711524195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558e3d817d80 con 0x558e3da9a830 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.405+0000 7f139eff5700 1 -- 172.21.15.12:0/2711524195 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558e3da8d730 con 0x558e3da9a830 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.406+0000 7f139eff5700 1 -- 172.21.15.12:0/2711524195 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f13ac010430 con 0x558e3da9a830 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.406+0000 7f13d4c30b80 10 client.27079 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.406+0000 7f13d4c30b80 10 client.27079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.406+0000 7f13d4c30b80 20 client.27079 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.406+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e3daafe10 0x558e3dab2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.406+0000 7f13d4c30b80 4 client.27079 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.406+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2711524195 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e3da69ee0 con 0x558e3daafe10 2023-12-11T20:22:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.406+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e3daafe10 0x558e3dab2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.407+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e3daafe10 0x558e3dab2230 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b04dfbf4de7bf5db server_cookie=ec7edd0b47cc4ae6 in_seq=0 out_seq=0 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.407+0000 7f139eff5700 10 client.27079 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f139eff5700 1 -- 172.21.15.12:0/2711524195 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f13b002da90 con 0x558e3daafe10 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f139eff5700 10 client.27079 handle_command_reply: tid=0 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 client.27079 shutdown 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2711524195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 msgr2=0x558e3daa44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa44e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0126d0 tx=0x7f13ac0129e0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2711524195 shutdown_connections 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e3daafe10 0x558e3dab2230 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f139eff5700 0 client.27079 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2711524195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa44e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2711524195 >> 172.21.15.12:0/2711524195 conn(0x558e3d9c9780 msgr2=0x558e3da94ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2711524195 shutdown_connections 2023-12-11T20:22:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.408+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2711524195 wait complete. 2023-12-11T20:22:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.409+0000 7f13d4c30b80 20 client.27079 trim_cache size 0 max 16384 2023-12-11T20:22:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13d4c30b80 1 Processor -- start 2023-12-11T20:22:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13d4c30b80 1 -- start start 2023-12-11T20:22:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da99ed0 0x558e3dab2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3daab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9b720 0x558e3da9bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3daa4c80 con 0x558e3da99ed0 2023-12-11T20:22:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3daafbd0 con 0x558e3da9a830 2023-12-11T20:22:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3da9ac10 con 0x558e3da9b720 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da99ed0 0x558e3dab2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da99ed0 0x558e3dab2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35332/0 (socket says 172.21.15.12:35332) 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.428+0000 7f13ba7fc700 1 -- 172.21.15.12:0/1055257285 learned_addr learned my addr 172.21.15.12:0/1055257285 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13baffd700 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3daab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9b720 0x558e3da9bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13ba7fc700 1 -- 172.21.15.12:0/1055257285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9b720 msgr2=0x558e3da9bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9b720 0x558e3da9bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13ba7fc700 1 -- 172.21.15.12:0/1055257285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 msgr2=0x558e3daab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3daab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13ba7fc700 1 -- 172.21.15.12:0/1055257285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e3d800c00 con 0x558e3da99ed0 2023-12-11T20:22:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13baffd700 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3daab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.429+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da99ed0 0x558e3dab2200 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f13b0012970 tx=0x7f13b0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fef64a55bb47ccf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13a1ffb700 1 -- 172.21.15.12:0/1055257285 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0004830 con 0x558e3da99ed0 2023-12-11T20:22:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13a1ffb700 1 -- 172.21.15.12:0/1055257285 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13b0029070 con 0x558e3da99ed0 2023-12-11T20:22:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13a1ffb700 1 -- 172.21.15.12:0/1055257285 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00054e0 con 0x558e3da99ed0 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13d4c30b80 1 -- 172.21.15.12:0/1055257285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da99ed0 msgr2=0x558e3dab2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da99ed0 0x558e3dab2200 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f13b0012970 tx=0x7f13b0014040 comp rx=0 tx=0).stop 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13d4c30b80 1 -- 172.21.15.12:0/1055257285 shutdown_connections 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9b720 0x558e3da9bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da99ed0 0x558e3dab2200 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/1055257285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da9a830 0x558e3daab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.430+0000 7f13d4c30b80 1 -- 172.21.15.12:0/1055257285 >> 172.21.15.12:0/1055257285 conn(0x558e3d9c9780 msgr2=0x558e3daa1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.431+0000 7f13d4c30b80 1 -- 172.21.15.12:0/1055257285 shutdown_connections 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.431+0000 7f13d4c30b80 1 -- 172.21.15.12:0/1055257285 wait complete. 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.431+0000 7f13d4c30b80 1 -- start start 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.431+0000 7f13d4c30b80 1 Processor -- start 2023-12-11T20:22:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13d4c30b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daa9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3daaa450 con 0x558e3da9b720 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3daaa5c0 con 0x558e3da99ed0 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13d4c30b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e3daaa780 con 0x558e3da9a830 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13d4c30b80 10 client.0 _ll_register_callbacks cb 0x558e3d8d3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daa9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13baffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13baffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49984/0 (socket says 172.21.15.12:49984) 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13ba7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:48382/0 (socket says 172.21.15.12:48382) 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.432+0000 7f13baffd700 1 -- 172.21.15.12:0/2165118389 learned_addr learned my addr 172.21.15.12:0/2165118389 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f13ba7fc700 1 -- 172.21.15.12:0/2165118389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 msgr2=0x558e3daa8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f13ba7fc700 1 -- 172.21.15.12:0/2165118389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 msgr2=0x558e3daa9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:34.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daa9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f13ba7fc700 1 -- 172.21.15.12:0/2165118389 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e3d817d80 con 0x558e3da99ed0 2023-12-11T20:22:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f13ba7fc700 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa89c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13b0014010 tx=0x7f13b0005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58bd52dd08226c81 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f139eff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f139eff5700 1 -- 172.21.15.12:0/2165118389 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0005460 con 0x558e3da99ed0 2023-12-11T20:22:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.433+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2165118389 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13b0003680 con 0x558e3da99ed0 2023-12-11T20:22:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.434+0000 7f139eff5700 1 -- 172.21.15.12:0/2165118389 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f13b0017040 con 0x558e3da99ed0 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.434+0000 7f139eff5700 1 -- 172.21.15.12:0/2165118389 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13b00055c0 con 0x558e3da99ed0 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.434+0000 7f13d4c30b80 10 client.27089 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.434+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2165118389 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558e3d86b5d0 con 0x558e3da99ed0 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.434+0000 7f139eff5700 1 -- 172.21.15.12:0/2165118389 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13b0003680 con 0x558e3da99ed0 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.434+0000 7f139eff5700 1 -- 172.21.15.12:0/2165118389 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f13b0032470 con 0x558e3da99ed0 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.435+0000 7f13d4c30b80 10 client.27089 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.435+0000 7f13d4c30b80 10 client.27089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.435+0000 7f13d4c30b80 20 client.27089 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.435+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e3db06850 0x558e3db08c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.435+0000 7f13d4c30b80 4 client.27089 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.435+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2165118389 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558e3d9b4f70 con 0x558e3db06850 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.435+0000 7f13baffd700 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e3db06850 0x558e3db08c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.436+0000 7f13baffd700 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e3db06850 0x558e3db08c70 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9546d92467c6f24 server_cookie=5d8e7b82f465236e in_seq=0 out_seq=0 2023-12-11T20:22:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.436+0000 7f139eff5700 10 client.27089 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.445+0000 7f139eff5700 1 -- 172.21.15.12:0/2165118389 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558e3d9b4f70 con 0x558e3db06850 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.445+0000 7f139eff5700 10 client.27089 handle_command_reply: tid=0 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 client.27089 shutdown 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2165118389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 msgr2=0x558e3daa89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa89c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13b0014010 tx=0x7f13b0005910 comp rx=0 tx=0).stop 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2165118389 shutdown_connections 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e3db06850 0x558e3db08c70 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e3da99ed0 0x558e3daa89c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e3da9b720 0x558e3daa9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 --2- 172.21.15.12:0/2165118389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e3da9a830 0x558e3daa8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f139eff5700 0 client.27089 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2165118389 >> 172.21.15.12:0/2165118389 conn(0x558e3d9c9780 msgr2=0x558e3daa1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2165118389 shutdown_connections 2023-12-11T20:22:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 1 -- 172.21.15.12:0/2165118389 wait complete. 2023-12-11T20:22:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.446+0000 7f13d4c30b80 20 client.27089 trim_cache size 0 max 16384 2023-12-11T20:22:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:22:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:22:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:22:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:22:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 -- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13a40a1470 msgr2=0x7f13a40a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13a40a1470 0x7f13a40a3930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f13b40cc020 tx=0x7f13b4009040 comp rx=0 tx=0).stop 2023-12-11T20:22:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 -- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 msgr2=0x7f13bc1a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 0x7f13bc1a0b30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f13b400b770 tx=0x7f13b400ccc0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 -- 172.21.15.12:0/2014084173 shutdown_connections 2023-12-11T20:22:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f13a40a1470 0x7f13a40a3930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13bc103080 0x7f13bc1a0b30 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13bc1014f0 0x7f13bc199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 --2- 172.21.15.12:0/2014084173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc1026e0 0x7f13bc199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 -- 172.21.15.12:0/2014084173 >> 172.21.15.12:0/2014084173 conn(0x7f13bc0fca60 msgr2=0x7f13bc073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 -- 172.21.15.12:0/2014084173 shutdown_connections 2023-12-11T20:22:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:34.447+0000 7f13c13ff700 1 -- 172.21.15.12:0/2014084173 wait complete. 2023-12-11T20:22:35.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:35 smithi039 ceph-mon[102205]: pgmap v575: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:22:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:35 smithi012 ceph-mon[128787]: pgmap v575: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:22:35.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:35 smithi032 ceph-mon[132488]: pgmap v575: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:22:36.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:36 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:22:36.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:36 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:22:36.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:36 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:22:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:37 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:22:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:37 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:22:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:37 smithi039 ceph-mon[102205]: pgmap v576: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:37 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:22:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:37 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:22:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:37 smithi012 ceph-mon[128787]: pgmap v576: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:37.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:37 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:22:37.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:37 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:22:37.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:37 smithi032 ceph-mon[132488]: pgmap v576: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:22:39.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:39 smithi032 ceph-mon[132488]: pgmap v577: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 27 op/s 2023-12-11T20:22:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:39 smithi039 ceph-mon[102205]: pgmap v577: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 27 op/s 2023-12-11T20:22:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:39 smithi012 ceph-mon[128787]: pgmap v577: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 27 op/s 2023-12-11T20:22:41.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:41 smithi039 ceph-mon[102205]: pgmap v578: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:22:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:41 smithi012 ceph-mon[128787]: pgmap v578: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:22:41.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:41 smithi032 ceph-mon[132488]: pgmap v578: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:22:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:43 smithi039 ceph-mon[102205]: pgmap v579: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:43 smithi012 ceph-mon[128787]: pgmap v579: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:43 smithi032 ceph-mon[132488]: pgmap v579: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:45.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:45 smithi039 ceph-mon[102205]: pgmap v580: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:45 smithi012 ceph-mon[128787]: pgmap v580: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:45 smithi032 ceph-mon[132488]: pgmap v580: 97 pgs: 97 active+clean; 4.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:47.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:47 smithi039 ceph-mon[102205]: pgmap v581: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:47 smithi012 ceph-mon[128787]: pgmap v581: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.601+0000 7fbd5dfff700 1 -- 172.21.15.12:0/811670723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd58103080 msgr2=0x7fbd58109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.601+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/811670723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd58103080 0x7fbd58109930 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000b0d0 tx=0x7fbd5000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.601+0000 7fbd5dfff700 1 -- 172.21.15.12:0/811670723 shutdown_connections 2023-12-11T20:22:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.601+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/811670723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd58103080 0x7fbd58109930 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.601+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/811670723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd581014f0 0x7fbd58101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.601+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/811670723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd581026e0 0x7fbd58102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.601+0000 7fbd5dfff700 1 -- 172.21.15.12:0/811670723 >> 172.21.15.12:0/811670723 conn(0x7fbd580fca60 msgr2=0x7fbd580feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.601+0000 7fbd5dfff700 1 -- 172.21.15.12:0/811670723 shutdown_connections 2023-12-11T20:22:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.602+0000 7fbd5dfff700 1 -- 172.21.15.12:0/811670723 wait complete. 2023-12-11T20:22:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.603+0000 7fbd5dfff700 1 Processor -- start 2023-12-11T20:22:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.603+0000 7fbd5dfff700 1 -- start start 2023-12-11T20:22:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.603+0000 7fbd5dfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd581014f0 0x7fbd58199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.603+0000 7fbd5dfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd581026e0 0x7fbd58199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.603+0000 7fbd5dfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd58103080 0x7fbd581a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.603+0000 7fbd5dfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd581a1100 con 0x7fbd581026e0 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.603+0000 7fbd5dfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd581a1240 con 0x7fbd581014f0 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.603+0000 7fbd5dfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd581a13d0 con 0x7fbd58103080 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd581026e0 0x7fbd58199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd581014f0 0x7fbd58199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd581026e0 0x7fbd58199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33276/0 (socket says 172.21.15.12:33276) 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd56ffd700 1 -- 172.21.15.12:0/1836257335 learned_addr learned my addr 172.21.15.12:0/1836257335 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd57fff700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd58103080 0x7fbd581a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd56ffd700 1 -- 172.21.15.12:0/1836257335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd58103080 msgr2=0x7fbd581a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd58103080 0x7fbd581a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd56ffd700 1 -- 172.21.15.12:0/1836257335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd581014f0 msgr2=0x7fbd58199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd581014f0 0x7fbd58199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.604+0000 7fbd56ffd700 1 -- 172.21.15.12:0/1836257335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50009d00 con 0x7fbd581026e0 2023-12-11T20:22:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.605+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd581026e0 0x7fbd58199b60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00e9a0 tx=0x7fbd4c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.605+0000 7fbd54ff9700 1 -- 172.21.15.12:0/1836257335 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c009790 con 0x7fbd581026e0 2023-12-11T20:22:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.605+0000 7fbd54ff9700 1 -- 172.21.15.12:0/1836257335 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd4c010430 con 0x7fbd581026e0 2023-12-11T20:22:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.605+0000 7fbd5dfff700 1 -- 172.21.15.12:0/1836257335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd581a16b0 con 0x7fbd581026e0 2023-12-11T20:22:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.605+0000 7fbd54ff9700 1 -- 172.21.15.12:0/1836257335 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00cea0 con 0x7fbd581026e0 2023-12-11T20:22:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.605+0000 7fbd5dfff700 1 -- 172.21.15.12:0/1836257335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd581a1bc0 con 0x7fbd581026e0 2023-12-11T20:22:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.608+0000 7fbd54ff9700 1 -- 172.21.15.12:0/1836257335 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fbd4c0105a0 con 0x7fbd581026e0 2023-12-11T20:22:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.610+0000 7fbd54ff9700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbd400a1470 0x7fbd400a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.610+0000 7fbd54ff9700 1 -- 172.21.15.12:0/1836257335 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbd4c014070 con 0x7fbd581026e0 2023-12-11T20:22:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.610+0000 7fbd577fe700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbd400a1470 0x7fbd400a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.610+0000 7fbd719a5b80 1 Processor -- start 2023-12-11T20:22:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd719a5b80 1 -- start start 2023-12-11T20:22:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x5559577542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x555957755140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd577fe700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbd400a1470 0x7fbd400a3930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbd58102540 tx=0x7fbd48009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:47.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559576afaf0 con 0x555957753ed0 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559576ad410 con 0x555957755720 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559576a8d00 con 0x555957754830 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x5559577542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x5559577542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33282/0 (socket says 172.21.15.12:33282) 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd577fe700 1 -- 172.21.15.12:0/1998578491 learned_addr learned my addr 172.21.15.12:0/1998578491 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd57fff700 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.611+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x555957755140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.612+0000 7fbd577fe700 1 -- 172.21.15.12:0/1998578491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 msgr2=0x555957755140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.612+0000 7fbd577fe700 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x555957755140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.612+0000 7fbd577fe700 1 -- 172.21.15.12:0/1998578491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 msgr2=0x555957755ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.612+0000 7fbd577fe700 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.612+0000 7fbd577fe700 1 -- 172.21.15.12:0/1998578491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559575255d0 con 0x555957753ed0 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.612+0000 7fbd57fff700 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.612+0000 7fbd577fe700 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x5559577542f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbd48011d50 tx=0x7fbd48014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bbff2489ead4a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.613+0000 7fbd3dffb700 1 -- 172.21.15.12:0/1998578491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800ed20 con 0x555957753ed0 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.613+0000 7fbd3dffb700 1 -- 172.21.15.12:0/1998578491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd48021070 con 0x555957753ed0 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.613+0000 7fbd3dffb700 1 -- 172.21.15.12:0/1998578491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4801d670 con 0x555957753ed0 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.613+0000 7fbd719a5b80 1 -- 172.21.15.12:0/1998578491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 msgr2=0x5559577542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x5559577542f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbd48011d50 tx=0x7fbd48014000 comp rx=0 tx=0).stop 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 -- 172.21.15.12:0/1998578491 shutdown_connections 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x5559577542f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/1998578491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x555957755140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 -- 172.21.15.12:0/1998578491 >> 172.21.15.12:0/1998578491 conn(0x555957683780 msgr2=0x555957750880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 -- 172.21.15.12:0/1998578491 shutdown_connections 2023-12-11T20:22:47.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 -- 172.21.15.12:0/1998578491 wait complete. 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.614+0000 7fbd719a5b80 1 -- start start 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.615+0000 7fbd719a5b80 1 Processor -- start 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.615+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x55595775de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.615+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x55595775e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.615+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957765200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.615+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555957662500 con 0x555957753ed0 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.615+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559576621a0 con 0x555957755720 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.615+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559575278c0 con 0x555957754830 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.615+0000 7fbd719a5b80 10 client.0 _ll_register_callbacks cb 0x55595758da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x55595775de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957765200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x55595775de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33288/0 (socket says 172.21.15.12:33288) 2023-12-11T20:22:47.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957765200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49326/0 (socket says 172.21.15.12:49326) 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd56ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x55595775e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 -- 172.21.15.12:0/98019324 learned_addr learned my addr 172.21.15.12:0/98019324 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 -- 172.21.15.12:0/98019324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 msgr2=0x55595775e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x55595775e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 -- 172.21.15.12:0/98019324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 msgr2=0x555957765200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957765200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 -- 172.21.15.12:0/98019324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5810a280 con 0x555957753ed0 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd577fe700 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x55595775de90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbd48011b30 tx=0x7fbd4801cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd5fcccd63b6d45 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:47.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.616+0000 7fbd36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.617+0000 7fbd36ffd700 1 -- 172.21.15.12:0/98019324 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4801c410 con 0x555957753ed0 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.617+0000 7fbd719a5b80 1 -- 172.21.15.12:0/98019324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555957747730 con 0x555957753ed0 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.617+0000 7fbd36ffd700 1 -- 172.21.15.12:0/98019324 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbd4801c570 con 0x555957753ed0 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.617+0000 7fbd36ffd700 1 -- 172.21.15.12:0/98019324 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd4801c730 con 0x555957753ed0 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.617+0000 7fbd719a5b80 10 client.17421 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.617+0000 7fbd719a5b80 1 -- 172.21.15.12:0/98019324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fbd48017070 con 0x555957753ed0 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.617+0000 7fbd36ffd700 1 -- 172.21.15.12:0/98019324 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555957747730 con 0x555957753ed0 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.617+0000 7fbd36ffd700 1 -- 172.21.15.12:0/98019324 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd48004810 con 0x555957753ed0 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.618+0000 7fbd719a5b80 10 client.17421 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.618+0000 7fbd719a5b80 10 client.17421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.618+0000 7fbd719a5b80 20 client.17421 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.618+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555957769be0 0x55595776c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.618+0000 7fbd719a5b80 4 client.17421 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.618+0000 7fbd719a5b80 1 -- 172.21.15.12:0/98019324 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555957723ee0 con 0x555957769be0 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.618+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555957769be0 0x55595776c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.619+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555957769be0 0x55595776c000 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73a50072dceeb91c server_cookie=c6f3d4cec8648bc1 in_seq=0 out_seq=0 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.619+0000 7fbd36ffd700 10 client.17421 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.619+0000 7fbd36ffd700 1 -- 172.21.15.12:0/98019324 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555957723ee0 con 0x555957769be0 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.619+0000 7fbd36ffd700 10 client.17421 handle_command_reply: tid=0 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.619+0000 7fbd719a5b80 1 client.17421 shutdown 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 -- 172.21.15.12:0/98019324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 msgr2=0x55595775de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x55595775de90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbd48011b30 tx=0x7fbd4801cf40 comp rx=0 tx=0).stop 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 -- 172.21.15.12:0/98019324 shutdown_connections 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555957769be0 0x55595776c000 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957765200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd36ffd700 0 client.17421 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x55595775de90 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/98019324 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x55595775e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 -- 172.21.15.12:0/98019324 >> 172.21.15.12:0/98019324 conn(0x555957683780 msgr2=0x55595774eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 -- 172.21.15.12:0/98019324 shutdown_connections 2023-12-11T20:22:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 1 -- 172.21.15.12:0/98019324 wait complete. 2023-12-11T20:22:47.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.620+0000 7fbd719a5b80 20 client.17421 trim_cache size 0 max 16384 2023-12-11T20:22:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd719a5b80 1 Processor -- start 2023-12-11T20:22:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd719a5b80 1 -- start start 2023-12-11T20:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x555957765ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x5559577651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55595775d820 con 0x555957753ed0 2023-12-11T20:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55595776c390 con 0x555957755720 2023-12-11T20:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555957765830 con 0x555957754830 2023-12-11T20:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x555957765ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x555957765ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33300/0 (socket says 172.21.15.12:33300) 2023-12-11T20:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.644+0000 7fbd577fe700 1 -- 172.21.15.12:0/2441160707 learned_addr learned my addr 172.21.15.12:0/2441160707 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x5559577651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd57fff700 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd577fe700 1 -- 172.21.15.12:0/2441160707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 msgr2=0x5559577651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd577fe700 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x5559577651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd577fe700 1 -- 172.21.15.12:0/2441160707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 msgr2=0x555957755b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd577fe700 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd577fe700 1 -- 172.21.15.12:0/2441160707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559574d1d80 con 0x555957753ed0 2023-12-11T20:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd57fff700 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.645+0000 7fbd577fe700 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x555957765ae0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009ac0 tx=0x7fbd4800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7423dc73ec66fdf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd3e7fc700 1 -- 172.21.15.12:0/2441160707 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48004db0 con 0x555957753ed0 2023-12-11T20:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd3e7fc700 1 -- 172.21.15.12:0/2441160707 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd4801cbe0 con 0x555957753ed0 2023-12-11T20:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd3e7fc700 1 -- 172.21.15.12:0/2441160707 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48005040 con 0x555957753ed0 2023-12-11T20:22:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2441160707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 msgr2=0x555957765ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x555957765ae0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009ac0 tx=0x7fbd4800eb20 comp rx=0 tx=0).stop 2023-12-11T20:22:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2441160707 shutdown_connections 2023-12-11T20:22:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957755b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957753ed0 0x555957765ae0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2441160707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957754830 0x5559577651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.646+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2441160707 >> 172.21.15.12:0/2441160707 conn(0x555957683780 msgr2=0x555957770980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.647+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2441160707 shutdown_connections 2023-12-11T20:22:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.647+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2441160707 wait complete. 2023-12-11T20:22:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.647+0000 7fbd719a5b80 1 -- start start 2023-12-11T20:22:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.647+0000 7fbd719a5b80 1 Processor -- start 2023-12-11T20:22:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957753ed0 0x555957762aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957754830 0x555957762fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd719a5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957763f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555957764440 con 0x555957754830 2023-12-11T20:22:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559577645b0 con 0x555957755720 2023-12-11T20:22:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd719a5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555957764770 con 0x555957753ed0 2023-12-11T20:22:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd719a5b80 10 client.0 _ll_register_callbacks cb 0x55595758da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957754830 0x555957762fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957754830 0x555957762fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33316/0 (socket says 172.21.15.12:33316) 2023-12-11T20:22:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd56ffd700 1 -- 172.21.15.12:0/2595256061 learned_addr learned my addr 172.21.15.12:0/2595256061 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd577fe700 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957753ed0 0x555957762aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.648+0000 7fbd57fff700 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957763f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd56ffd700 1 -- 172.21.15.12:0/2595256061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957753ed0 msgr2=0x555957762aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957753ed0 0x555957762aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd56ffd700 1 -- 172.21.15.12:0/2595256061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 msgr2=0x555957763f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957763f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd56ffd700 1 -- 172.21.15.12:0/2595256061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd50009470 con 0x555957754830 2023-12-11T20:22:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd577fe700 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957753ed0 0x555957762aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd56ffd700 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957754830 0x555957762fe0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c096c50 tx=0x7fbd4c0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6309e23cafd8e9a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd36ffd700 1 -- 172.21.15.12:0/2595256061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c09a8e0 con 0x555957754830 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd36ffd700 1 -- 172.21.15.12:0/2595256061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbd4c09a1e0 con 0x555957754830 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2595256061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd48021070 con 0x555957754830 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd36ffd700 1 -- 172.21.15.12:0/2595256061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd4c09e330 con 0x555957754830 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd719a5b80 10 client.17427 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.649+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2595256061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fbd48017070 con 0x555957754830 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.650+0000 7fbd36ffd700 1 -- 172.21.15.12:0/2595256061 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd4c07b080 con 0x555957754830 2023-12-11T20:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.650+0000 7fbd36ffd700 1 -- 172.21.15.12:0/2595256061 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd4c0996d0 con 0x555957754830 2023-12-11T20:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.650+0000 7fbd719a5b80 10 client.17427 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.650+0000 7fbd719a5b80 10 client.17427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.650+0000 7fbd719a5b80 20 client.17427 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.650+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5559577c0bb0 0x5559577c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.650+0000 7fbd719a5b80 4 client.17427 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.650+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2595256061 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55595766ef70 con 0x5559577c0bb0 2023-12-11T20:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.651+0000 7fbd577fe700 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5559577c0bb0 0x5559577c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.651+0000 7fbd577fe700 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5559577c0bb0 0x5559577c2fd0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ce4ca372dd3f9d server_cookie=1325e2a1ebef905 in_seq=0 out_seq=0 2023-12-11T20:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.651+0000 7fbd36ffd700 10 client.17427 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd36ffd700 1 -- 172.21.15.12:0/2595256061 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55595766ef70 con 0x5559577c0bb0 2023-12-11T20:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd36ffd700 10 client.17427 handle_command_reply: tid=0 2023-12-11T20:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 client.17427 shutdown 2023-12-11T20:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2595256061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957754830 msgr2=0x555957762fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957754830 0x555957762fe0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c096c50 tx=0x7fbd4c0cc040 comp rx=0 tx=0).stop 2023-12-11T20:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2595256061 shutdown_connections 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5559577c0bb0 0x5559577c2fd0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555957755720 0x555957763f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555957753ed0 0x555957762aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 --2- 172.21.15.12:0/2595256061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555957754830 0x555957762fe0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2595256061 >> 172.21.15.12:0/2595256061 conn(0x555957683780 msgr2=0x555957770980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.662+0000 7fbd36ffd700 0 client.17427 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.663+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2595256061 shutdown_connections 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.663+0000 7fbd719a5b80 1 -- 172.21.15.12:0/2595256061 wait complete. 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.663+0000 7fbd719a5b80 20 client.17427 trim_cache size 0 max 16384 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:22:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:22:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:22:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:22:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.663+0000 7fbd5dfff700 1 -- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbd400a1470 msgr2=0x7fbd400a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.663+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbd400a1470 0x7fbd400a3930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbd58102540 tx=0x7fbd48009260 comp rx=0 tx=0).stop 2023-12-11T20:22:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.663+0000 7fbd5dfff700 1 -- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd581026e0 msgr2=0x7fbd58199b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.663+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd581026e0 0x7fbd58199b60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00e9a0 tx=0x7fbd4c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.664+0000 7fbd5dfff700 1 -- 172.21.15.12:0/1836257335 shutdown_connections 2023-12-11T20:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.664+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbd400a1470 0x7fbd400a3930 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.664+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd581014f0 0x7fbd58199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.664+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd58103080 0x7fbd581a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.664+0000 7fbd5dfff700 1 --2- 172.21.15.12:0/1836257335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd581026e0 0x7fbd58199b60 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.664+0000 7fbd5dfff700 1 -- 172.21.15.12:0/1836257335 >> 172.21.15.12:0/1836257335 conn(0x7fbd580fca60 msgr2=0x7fbd58073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.664+0000 7fbd5dfff700 1 -- 172.21.15.12:0/1836257335 shutdown_connections 2023-12-11T20:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:22:47.664+0000 7fbd5dfff700 1 -- 172.21.15.12:0/1836257335 wait complete. 2023-12-11T20:22:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:47 smithi032 ceph-mon[132488]: pgmap v581: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:49 smithi032 ceph-mon[132488]: pgmap v582: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:22:49.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:49 smithi039 ceph-mon[102205]: pgmap v582: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:22:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:49 smithi012 ceph-mon[128787]: pgmap v582: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:22:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:51 smithi039 ceph-mon[102205]: pgmap v583: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:22:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:51 smithi012 ceph-mon[128787]: pgmap v583: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:22:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:51 smithi032 ceph-mon[132488]: pgmap v583: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:22:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:53 smithi039 ceph-mon[102205]: pgmap v584: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:53 smithi012 ceph-mon[128787]: pgmap v584: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:53 smithi032 ceph-mon[132488]: pgmap v584: 97 pgs: 97 active+clean; 4.7 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:55 smithi039 ceph-mon[102205]: pgmap v585: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:55 smithi012 ceph-mon[128787]: pgmap v585: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:55.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:55 smithi032 ceph-mon[132488]: pgmap v585: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:22:56.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:22:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.318+0000 7fa0fb59e700 1 -- 172.21.15.12:0/3117706112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc0755b0 msgr2=0x7fa0fc073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.318+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/3117706112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc0755b0 0x7fa0fc073a00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009990 tx=0x7fa0ec009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.318+0000 7fa0fb59e700 1 -- 172.21.15.12:0/3117706112 shutdown_connections 2023-12-11T20:22:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.318+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/3117706112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0fc1091e0 0x7fa0fc10b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.318+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/3117706112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc0755b0 0x7fa0fc073a00 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.318+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/3117706112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0fc073fd0 0x7fa0fc074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.318+0000 7fa0fb59e700 1 -- 172.21.15.12:0/3117706112 >> 172.21.15.12:0/3117706112 conn(0x7fa0fc0fc860 msgr2=0x7fa0fc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.318+0000 7fa0fb59e700 1 -- 172.21.15.12:0/3117706112 shutdown_connections 2023-12-11T20:22:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.319+0000 7fa0fb59e700 1 -- 172.21.15.12:0/3117706112 wait complete. 2023-12-11T20:22:56.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.320+0000 7fa0fb59e700 1 Processor -- start 2023-12-11T20:22:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.320+0000 7fa0fb59e700 1 -- start start 2023-12-11T20:22:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.320+0000 7fa0fb59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0fc073fd0 0x7fa0fc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.320+0000 7fa0fb59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0fc0755b0 0x7fa0fc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.320+0000 7fa0fb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc1091e0 0x7fa0fc1a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.320+0000 7fa0fb59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc1a0db0 con 0x7fa0fc1091e0 2023-12-11T20:22:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.320+0000 7fa0fb59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc1a0ef0 con 0x7fa0fc0755b0 2023-12-11T20:22:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.320+0000 7fa0fb59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc1a1080 con 0x7fa0fc073fd0 2023-12-11T20:22:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0fc073fd0 0x7fa0fc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc1091e0 0x7fa0fc1a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0fc073fd0 0x7fa0fc199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34368/0 (socket says 172.21.15.12:34368) 2023-12-11T20:22:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 -- 172.21.15.12:0/429325968 learned_addr learned my addr 172.21.15.12:0/429325968 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0fc0755b0 0x7fa0fc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 -- 172.21.15.12:0/429325968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0fc0755b0 msgr2=0x7fa0fc1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0fc0755b0 0x7fa0fc1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 -- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc1091e0 msgr2=0x7fa0fc1a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc1091e0 0x7fa0fc1a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 -- 172.21.15.12:0/429325968 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec0095f0 con 0x7fa0fc073fd0 2023-12-11T20:22:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fad9d700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc1091e0 0x7fa0fc1a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.321+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0fc073fd0 0x7fa0fc199280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec006010 tx=0x7fa0ec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.322+0000 7fa0eb7fe700 1 -- 172.21.15.12:0/429325968 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec01d070 con 0x7fa0fc073fd0 2023-12-11T20:22:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.322+0000 7fa0eb7fe700 1 -- 172.21.15.12:0/429325968 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0ec00bdb0 con 0x7fa0fc073fd0 2023-12-11T20:22:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.322+0000 7fa0fb59e700 1 -- 172.21.15.12:0/429325968 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc1a1300 con 0x7fa0fc073fd0 2023-12-11T20:22:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.322+0000 7fa0eb7fe700 1 -- 172.21.15.12:0/429325968 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00fdf0 con 0x7fa0fc073fd0 2023-12-11T20:22:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.322+0000 7fa0fb59e700 1 -- 172.21.15.12:0/429325968 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc1a1720 con 0x7fa0fc073fd0 2023-12-11T20:22:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.327+0000 7fa0eb7fe700 1 -- 172.21.15.12:0/429325968 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa0ec00b920 con 0x7fa0fc073fd0 2023-12-11T20:22:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.328+0000 7fa1146fcb80 1 Processor -- start 2023-12-11T20:22:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.328+0000 7fa1146fcb80 1 -- start start 2023-12-11T20:22:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e5fee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e5ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 0x56072e600240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e559b50 con 0x56072e5ff3c0 2023-12-11T20:22:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e557470 con 0x56072e5ffde0 2023-12-11T20:22:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e552d60 con 0x56072e5fea60 2023-12-11T20:22:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0eb7fe700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa0e40a1520 0x7fa0e40a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e5ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0fad9d700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa0e40a1520 0x7fa0e40a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e5ff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57652/0 (socket says 172.21.15.12:57652) 2023-12-11T20:22:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0fa59c700 1 -- 172.21.15.12:0/348027308 learned_addr learned my addr 172.21.15.12:0/348027308 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0fad9d700 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e5fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0eb7fe700 1 -- 172.21.15.12:0/429325968 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa0ec0ce050 con 0x7fa0fc073fd0 2023-12-11T20:22:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 0x56072e600240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.329+0000 7fa0fa59c700 1 -- 172.21.15.12:0/348027308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 msgr2=0x56072e5fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e5fee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0fa59c700 1 -- 172.21.15.12:0/348027308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 msgr2=0x56072e600240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 0x56072e600240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0fa59c700 1 -- 172.21.15.12:0/348027308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56072e3cf630 con 0x56072e5ff3c0 2023-12-11T20:22:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 0x56072e600240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e5ff8a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec09b340 tx=0x7fa0ec004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d405f0bfd3ed4179 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0fad9d700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa0e40a1520 0x7fa0e40a39e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009550 tx=0x7fa0f4009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0e8ff9700 1 -- 172.21.15.12:0/348027308 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec09aef0 con 0x56072e5ff3c0 2023-12-11T20:22:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0e8ff9700 1 -- 172.21.15.12:0/348027308 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0ec09ad10 con 0x56072e5ff3c0 2023-12-11T20:22:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.330+0000 7fa0e8ff9700 1 -- 172.21.15.12:0/348027308 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec09f570 con 0x56072e5ff3c0 2023-12-11T20:22:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 -- 172.21.15.12:0/348027308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 msgr2=0x56072e5ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e5ff8a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec09b340 tx=0x7fa0ec004320 comp rx=0 tx=0).stop 2023-12-11T20:22:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 -- 172.21.15.12:0/348027308 shutdown_connections 2023-12-11T20:22:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 0x56072e600240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e5fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/348027308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e5ff8a0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 -- 172.21.15.12:0/348027308 >> 172.21.15.12:0/348027308 conn(0x56072e52d7e0 msgr2=0x56072e5f93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 -- 172.21.15.12:0/348027308 shutdown_connections 2023-12-11T20:22:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.331+0000 7fa1146fcb80 1 -- 172.21.15.12:0/348027308 wait complete. 2023-12-11T20:22:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.332+0000 7fa1146fcb80 1 -- start start 2023-12-11T20:22:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.332+0000 7fa1146fcb80 1 Processor -- start 2023-12-11T20:22:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e6080e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e608620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 0x56072e60f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e50c560 con 0x56072e5ff3c0 2023-12-11T20:22:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e50c200 con 0x56072e5ffde0 2023-12-11T20:22:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e3d1920 con 0x56072e5fea60 2023-12-11T20:22:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa1146fcb80 10 client.0 _ll_register_callbacks cb 0x56072e437a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e6080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e6080e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34380/0 (socket says 172.21.15.12:34380) 2023-12-11T20:22:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa0fa59c700 1 -- 172.21.15.12:0/3994169761 learned_addr learned my addr 172.21.15.12:0/3994169761 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.333+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e608620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0fa59c700 1 -- 172.21.15.12:0/3994169761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 msgr2=0x56072e60f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 0x56072e60f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0fa59c700 1 -- 172.21.15.12:0/3994169761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 msgr2=0x56072e608620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e608620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0fa59c700 1 -- 172.21.15.12:0/3994169761 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc1a1720 con 0x56072e5fea60 2023-12-11T20:22:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e6080e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec09b570 tx=0x7fa0ec00f460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12b6833f4debc3b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:22:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/3994169761 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec09bab0 con 0x56072e5fea60 2023-12-11T20:22:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa1146fcb80 1 -- 172.21.15.12:0/3994169761 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56072e5f19e0 con 0x56072e5fea60 2023-12-11T20:22:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.334+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/3994169761 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa0ec0a36b0 con 0x56072e5fea60 2023-12-11T20:22:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/3994169761 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0ec09b610 con 0x56072e5fea60 2023-12-11T20:22:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa1146fcb80 10 client.27115 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa1146fcb80 1 -- 172.21.15.12:0/3994169761 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56072e37bde0 con 0x56072e5fea60 2023-12-11T20:22:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/3994169761 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56072e5f19e0 con 0x56072e5fea60 2023-12-11T20:22:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/3994169761 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0ec09a910 con 0x56072e5fea60 2023-12-11T20:22:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa1146fcb80 10 client.27115 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa1146fcb80 10 client.27115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa1146fcb80 20 client.27115 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56072e6139d0 0x56072e615df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa1146fcb80 4 client.27115 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.335+0000 7fa1146fcb80 1 -- 172.21.15.12:0/3994169761 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56072e5cdf40 con 0x56072e6139d0 2023-12-11T20:22:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.336+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56072e6139d0 0x56072e615df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.336+0000 7fa0e1ffb700 10 client.27115 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.336+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56072e6139d0 0x56072e615df0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bf1604cf80e91c1 server_cookie=dc3f5e3f978f70e9 in_seq=0 out_seq=0 2023-12-11T20:22:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/3994169761 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56072e5cdf40 con 0x56072e6139d0 2023-12-11T20:22:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa0e1ffb700 10 client.27115 handle_command_reply: tid=0 2023-12-11T20:22:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 client.27115 shutdown 2023-12-11T20:22:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 -- 172.21.15.12:0/3994169761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 msgr2=0x56072e6080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e6080e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec09b570 tx=0x7fa0ec00f460 comp rx=0 tx=0).stop 2023-12-11T20:22:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 -- 172.21.15.12:0/3994169761 shutdown_connections 2023-12-11T20:22:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56072e6139d0 0x56072e615df0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ffde0 0x56072e60f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5fea60 0x56072e6080e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/3994169761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e608620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa0e1ffb700 0 client.27115 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.337+0000 7fa1146fcb80 1 -- 172.21.15.12:0/3994169761 >> 172.21.15.12:0/3994169761 conn(0x56072e52d7e0 msgr2=0x56072e5fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.338+0000 7fa1146fcb80 1 -- 172.21.15.12:0/3994169761 shutdown_connections 2023-12-11T20:22:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.338+0000 7fa1146fcb80 1 -- 172.21.15.12:0/3994169761 wait complete. 2023-12-11T20:22:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.338+0000 7fa1146fcb80 20 client.27115 trim_cache size 0 max 16384 2023-12-11T20:22:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa1146fcb80 1 Processor -- start 2023-12-11T20:22:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa1146fcb80 1 -- start start 2023-12-11T20:22:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5fea60 0x56072e606430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e60f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e5f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e61b000 con 0x56072e5ff3c0 2023-12-11T20:22:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e5fa700 con 0x56072e5fea60 2023-12-11T20:22:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e5f41e0 con 0x56072e5ffde0 2023-12-11T20:22:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.359+0000 7fa0f9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e60f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0f9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e60f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57674/0 (socket says 172.21.15.12:57674) 2023-12-11T20:22:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0f9d9b700 1 -- 172.21.15.12:0/1922530215 learned_addr learned my addr 172.21.15.12:0/1922530215 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5fea60 0x56072e606430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0fad9d700 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e5f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0f9d9b700 1 -- 172.21.15.12:0/1922530215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 msgr2=0x56072e5f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e5f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0f9d9b700 1 -- 172.21.15.12:0/1922530215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5fea60 msgr2=0x56072e606430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5fea60 0x56072e606430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0f9d9b700 1 -- 172.21.15.12:0/1922530215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56072e364c60 con 0x56072e5ff3c0 2023-12-11T20:22:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.360+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e60f4e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0005d90 tx=0x7fa0f0012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71161e1101fdb22 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa0e97fa700 1 -- 172.21.15.12:0/1922530215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0018040 con 0x56072e5ff3c0 2023-12-11T20:22:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa0e97fa700 1 -- 172.21.15.12:0/1922530215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0f0012e40 con 0x56072e5ff3c0 2023-12-11T20:22:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa0e97fa700 1 -- 172.21.15.12:0/1922530215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0011be0 con 0x56072e5ff3c0 2023-12-11T20:22:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa1146fcb80 1 -- 172.21.15.12:0/1922530215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 msgr2=0x56072e60f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e60f4e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0005d90 tx=0x7fa0f0012730 comp rx=0 tx=0).stop 2023-12-11T20:22:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa1146fcb80 1 -- 172.21.15.12:0/1922530215 shutdown_connections 2023-12-11T20:22:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5fea60 0x56072e606430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e5f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/1922530215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5ff3c0 0x56072e60f4e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa1146fcb80 1 -- 172.21.15.12:0/1922530215 >> 172.21.15.12:0/1922530215 conn(0x56072e52d7e0 msgr2=0x56072e5f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.361+0000 7fa1146fcb80 1 -- 172.21.15.12:0/1922530215 shutdown_connections 2023-12-11T20:22:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.362+0000 7fa1146fcb80 1 -- 172.21.15.12:0/1922530215 wait complete. 2023-12-11T20:22:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.362+0000 7fa1146fcb80 1 -- start start 2023-12-11T20:22:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.362+0000 7fa1146fcb80 1 Processor -- start 2023-12-11T20:22:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5fea60 0x56072e60f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ff3c0 0x56072e60d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa1146fcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e60de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e60e3a0 con 0x56072e5fea60 2023-12-11T20:22:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e60e4e0 con 0x56072e5ff3c0 2023-12-11T20:22:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa1146fcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072e60e6a0 con 0x56072e5ffde0 2023-12-11T20:22:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa1146fcb80 10 client.0 _ll_register_callbacks cb 0x56072e437a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5fea60 0x56072e60f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5fea60 0x56072e60f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57676/0 (socket says 172.21.15.12:57676) 2023-12-11T20:22:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fa59c700 1 -- 172.21.15.12:0/575408666 learned_addr learned my addr 172.21.15.12:0/575408666 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fad9d700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e60de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ff3c0 0x56072e60d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fa59c700 1 -- 172.21.15.12:0/575408666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 msgr2=0x56072e60de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e60de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fa59c700 1 -- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ff3c0 msgr2=0x56072e60d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ff3c0 0x56072e60d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fa59c700 1 -- 172.21.15.12:0/575408666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f0009a00 con 0x56072e5fea60 2023-12-11T20:22:56.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0fad9d700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e60de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:56.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.363+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ff3c0 0x56072e60d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:56.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa0fa59c700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5fea60 0x56072e60f220 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec09f6c0 tx=0x7fa0ec009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca53474e99932837 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:56.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa0e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:56.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/575408666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec09b3b0 con 0x56072e5fea60 2023-12-11T20:22:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa1146fcb80 1 -- 172.21.15.12:0/575408666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0ec09ad10 con 0x56072e5fea60 2023-12-11T20:22:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/575408666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa0ec0a3480 con 0x56072e5fea60 2023-12-11T20:22:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/575408666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0ec09bab0 con 0x56072e5fea60 2023-12-11T20:22:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa1146fcb80 10 client.17445 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa1146fcb80 1 -- 172.21.15.12:0/575408666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56072e3a2250 con 0x56072e5fea60 2023-12-11T20:22:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.364+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/575408666 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0ec09ad10 con 0x56072e5fea60 2023-12-11T20:22:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.365+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/575408666 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0ec0971a0 con 0x56072e5fea60 2023-12-11T20:22:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.365+0000 7fa1146fcb80 10 client.17445 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.365+0000 7fa1146fcb80 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.365+0000 7fa1146fcb80 20 client.17445 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.365+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56072e66b060 0x56072e66d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.365+0000 7fa1146fcb80 4 client.17445 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:22:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.365+0000 7fa1146fcb80 1 -- 172.21.15.12:0/575408666 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56072e518fd0 con 0x56072e66b060 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.365+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56072e66b060 0x56072e66d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.366+0000 7fa0f9d9b700 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56072e66b060 0x56072e66d450 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b69e5c8bd33bbe1 server_cookie=eecbd72dd60c8461 in_seq=0 out_seq=0 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.366+0000 7fa0e1ffb700 10 client.17445 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.366+0000 7fa0e1ffb700 1 -- 172.21.15.12:0/575408666 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56072e518fd0 con 0x56072e66b060 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.366+0000 7fa0e1ffb700 10 client.17445 handle_command_reply: tid=0 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.366+0000 7fa1146fcb80 1 client.17445 shutdown 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.366+0000 7fa1146fcb80 1 -- 172.21.15.12:0/575408666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5fea60 msgr2=0x56072e60f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.366+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5fea60 0x56072e60f220 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec09f6c0 tx=0x7fa0ec009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 1 -- 172.21.15.12:0/575408666 shutdown_connections 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56072e66b060 0x56072e66d450 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56072e5ffde0 0x56072e60de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072e5fea60 0x56072e60f220 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 1 --2- 172.21.15.12:0/575408666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56072e5ff3c0 0x56072e60d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa0e1ffb700 0 client.17445 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 1 -- 172.21.15.12:0/575408666 >> 172.21.15.12:0/575408666 conn(0x56072e52d7e0 msgr2=0x56072e6063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 1 -- 172.21.15.12:0/575408666 shutdown_connections 2023-12-11T20:22:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 1 -- 172.21.15.12:0/575408666 wait complete. 2023-12-11T20:22:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.367+0000 7fa1146fcb80 20 client.17445 trim_cache size 0 max 16384 2023-12-11T20:22:56.382 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:22:56.383 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:22:56.383 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:22:56.383 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:22:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 -- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa0e40a1520 msgr2=0x7fa0e40a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa0e40a1520 0x7fa0e40a39e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009550 tx=0x7fa0f4009920 comp rx=0 tx=0).stop 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 -- 172.21.15.12:0/429325968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0fc073fd0 msgr2=0x7fa0fc199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0fc073fd0 0x7fa0fc199280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec006010 tx=0x7fa0ec004730 comp rx=0 tx=0).stop 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 -- 172.21.15.12:0/429325968 shutdown_connections 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa0e40a1520 0x7fa0e40a39e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0fc1091e0 0x7fa0fc1a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0fc073fd0 0x7fa0fc199280 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 --2- 172.21.15.12:0/429325968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0fc0755b0 0x7fa0fc1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 -- 172.21.15.12:0/429325968 >> 172.21.15.12:0/429325968 conn(0x7fa0fc0fc860 msgr2=0x7fa0fc105130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 -- 172.21.15.12:0/429325968 shutdown_connections 2023-12-11T20:22:56.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.368+0000 7fa0fb59e700 1 -- 172.21.15.12:0/429325968 wait complete. 2023-12-11T20:22:56.385 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:22:56.385 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:22:56.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/412698578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 msgr2=0x7fcf38106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/412698578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 0x7fcf38106ab0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009990 tx=0x7fcf24009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/412698578 shutdown_connections 2023-12-11T20:22:56.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/412698578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf38106ff0 0x7fcf38109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/412698578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf38101d90 0x7fcf38104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/412698578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 0x7fcf38106ab0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/412698578 >> 172.21.15.12:0/412698578 conn(0x7fcf380fb760 msgr2=0x7fcf380fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:56.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/412698578 shutdown_connections 2023-12-11T20:22:56.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.617+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/412698578 wait complete. 2023-12-11T20:22:56.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.619+0000 7fcf3dd9d700 1 Processor -- start 2023-12-11T20:22:56.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.619+0000 7fcf3dd9d700 1 -- start start 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.619+0000 7fcf3dd9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf38101d90 0x7fcf381016b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.619+0000 7fcf3dd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 0x7fcf380ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.619+0000 7fcf3dd9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf38106ff0 0x7fcf38100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.619+0000 7fcf3dd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38100a20 con 0x7fcf381046c0 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.619+0000 7fcf3dd9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38100b90 con 0x7fcf38101d90 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.619+0000 7fcf3dd9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf381a11d0 con 0x7fcf38106ff0 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf3cd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf38101d90 0x7fcf381016b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 0x7fcf380ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf3cd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf38101d90 0x7fcf381016b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:53922/0 (socket says 172.21.15.12:53922) 2023-12-11T20:22:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf3cd9b700 1 -- 172.21.15.12:0/378500155 learned_addr learned my addr 172.21.15.12:0/378500155 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf3d59c700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf38106ff0 0x7fcf38100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf37fff700 1 -- 172.21.15.12:0/378500155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf38106ff0 msgr2=0x7fcf38100280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf37fff700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf38106ff0 0x7fcf38100280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf37fff700 1 -- 172.21.15.12:0/378500155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf38101d90 msgr2=0x7fcf381016b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf37fff700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf38101d90 0x7fcf381016b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.620+0000 7fcf37fff700 1 -- 172.21.15.12:0/378500155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf240095f0 con 0x7fcf381046c0 2023-12-11T20:22:56.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.621+0000 7fcf37fff700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 0x7fcf380ffd40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcf24003f60 tx=0x7fcf24005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:56.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.621+0000 7fcf35ffb700 1 -- 172.21.15.12:0/378500155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2401d070 con 0x7fcf381046c0 2023-12-11T20:22:56.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.621+0000 7fcf35ffb700 1 -- 172.21.15.12:0/378500155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf2400bdb0 con 0x7fcf381046c0 2023-12-11T20:22:56.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.621+0000 7fcf35ffb700 1 -- 172.21.15.12:0/378500155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24022d30 con 0x7fcf381046c0 2023-12-11T20:22:56.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.621+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf381a1400 con 0x7fcf381046c0 2023-12-11T20:22:56.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.621+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf381a17c0 con 0x7fcf381046c0 2023-12-11T20:22:56.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.622+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf380fd2e0 con 0x7fcf381046c0 2023-12-11T20:22:56.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.624+0000 7fcf35ffb700 1 -- 172.21.15.12:0/378500155 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcf24022470 con 0x7fcf381046c0 2023-12-11T20:22:56.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.626+0000 7fcf35ffb700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:56.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.626+0000 7fcf35ffb700 1 -- 172.21.15.12:0/378500155 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf240ce9e0 con 0x7fcf381046c0 2023-12-11T20:22:56.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.627+0000 7fcf3cd9b700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:56.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.627+0000 7fcf3cd9b700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009d20 tx=0x7fcf2c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:56.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.629+0000 7fcf35ffb700 1 -- 172.21.15.12:0/378500155 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcf24098020 con 0x7fcf381046c0 2023-12-11T20:22:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.952+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf3810ca10 con 0x7fcf381046c0 2023-12-11T20:22:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.953+0000 7fcf35ffb700 1 -- 172.21.15.12:0/378500155 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7fcf24027090 con 0x7fcf381046c0 2023-12-11T20:22:56.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:22:56.952 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.955+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 msgr2=0x7fcf280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.955+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009d20 tx=0x7fcf2c009260 comp rx=0 tx=0).stop 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 msgr2=0x7fcf380ffd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 0x7fcf380ffd40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcf24003f60 tx=0x7fcf24005740 comp rx=0 tx=0).stop 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 shutdown_connections 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf280a1500 0x7fcf280a39c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf38101d90 0x7fcf381016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf38106ff0 0x7fcf38100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 --2- 172.21.15.12:0/378500155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf381046c0 0x7fcf380ffd40 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 >> 172.21.15.12:0/378500155 conn(0x7fcf380fb760 msgr2=0x7fcf38103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 shutdown_connections 2023-12-11T20:22:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:56.956+0000 7fcf3dd9d700 1 -- 172.21.15.12:0/378500155 wait complete. 2023-12-11T20:22:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:22:56.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:22:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.214+0000 7f708cb9d700 1 -- 172.21.15.12:0/545191169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70881050a0 msgr2=0x7f708810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.214+0000 7f708cb9d700 1 --2- 172.21.15.12:0/545191169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70881050a0 0x7f708810b950 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f708000b0d0 tx=0x7f708000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.215+0000 7f708cb9d700 1 -- 172.21.15.12:0/545191169 shutdown_connections 2023-12-11T20:22:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.215+0000 7f708cb9d700 1 --2- 172.21.15.12:0/545191169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7088103510 0x7f7088103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.215+0000 7f708cb9d700 1 --2- 172.21.15.12:0/545191169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70881050a0 0x7f708810b950 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.215+0000 7f708cb9d700 1 --2- 172.21.15.12:0/545191169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7088104700 0x7f7088104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.215+0000 7f708cb9d700 1 -- 172.21.15.12:0/545191169 >> 172.21.15.12:0/545191169 conn(0x7f70880feaa0 msgr2=0x7f7088100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.215+0000 7f708cb9d700 1 -- 172.21.15.12:0/545191169 shutdown_connections 2023-12-11T20:22:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.215+0000 7f708cb9d700 1 -- 172.21.15.12:0/545191169 wait complete. 2023-12-11T20:22:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.216+0000 7f708cb9d700 1 Processor -- start 2023-12-11T20:22:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.216+0000 7f708cb9d700 1 -- start start 2023-12-11T20:22:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f708cb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7088103510 0x7f7088199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f708cb9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7088104700 0x7f7088199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f708cb9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70881050a0 0x7f70881a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f708cb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70881a0e80 con 0x7f7088103510 2023-12-11T20:22:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f708cb9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70881a0fc0 con 0x7f70881050a0 2023-12-11T20:22:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f708cb9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70881a1150 con 0x7f7088104700 2023-12-11T20:22:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f70877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7088103510 0x7f7088199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f70877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7088103510 0x7f7088199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57704/0 (socket says 172.21.15.12:57704) 2023-12-11T20:22:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f70877fe700 1 -- 172.21.15.12:0/2907861629 learned_addr learned my addr 172.21.15.12:0/2907861629 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f7087fff700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70881050a0 0x7f70881a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.217+0000 7f7086ffd700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7088104700 0x7f7088199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f70877fe700 1 -- 172.21.15.12:0/2907861629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7088104700 msgr2=0x7f7088199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f70877fe700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7088104700 0x7f7088199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f70877fe700 1 -- 172.21.15.12:0/2907861629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70881050a0 msgr2=0x7f70881a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f70877fe700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70881050a0 0x7f70881a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f70877fe700 1 -- 172.21.15.12:0/2907861629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080009d00 con 0x7f7088103510 2023-12-11T20:22:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f7086ffd700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7088104700 0x7f7088199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f70877fe700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7088103510 0x7f7088199350 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f707800e970 tx=0x7f707800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f7084ff9700 1 -- 172.21.15.12:0/2907861629 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078009790 con 0x7f7088103510 2023-12-11T20:22:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f7084ff9700 1 -- 172.21.15.12:0/2907861629 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f707800c7e0 con 0x7f7088103510 2023-12-11T20:22:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f708cb9d700 1 -- 172.21.15.12:0/2907861629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70881a1430 con 0x7f7088103510 2023-12-11T20:22:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f7084ff9700 1 -- 172.21.15.12:0/2907861629 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078003bd0 con 0x7f7088103510 2023-12-11T20:22:57.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.218+0000 7f708cb9d700 1 -- 172.21.15.12:0/2907861629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70881a1990 con 0x7f7088103510 2023-12-11T20:22:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.222+0000 7f7084ff9700 1 -- 172.21.15.12:0/2907861629 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f707800c950 con 0x7f7088103510 2023-12-11T20:22:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.223+0000 7f70a1742b80 1 Processor -- start 2023-12-11T20:22:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.223+0000 7f70a1742b80 1 -- start start 2023-12-11T20:22:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.223+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907efe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.223+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da907f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.223+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.223+0000 7f70a1742b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9074ab50 con 0x55da907efa60 2023-12-11T20:22:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.223+0000 7f70a1742b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da90748470 con 0x55da907f0de0 2023-12-11T20:22:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.223+0000 7f70a1742b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da90743d60 con 0x55da907f03c0 2023-12-11T20:22:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f7087fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f7087fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907efe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57718/0 (socket says 172.21.15.12:57718) 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f7087fff700 1 -- 172.21.15.12:0/1718594652 learned_addr learned my addr 172.21.15.12:0/1718594652 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f70877fe700 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da907f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f7086ffd700 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f70877fe700 1 -- 172.21.15.12:0/1718594652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 msgr2=0x55da907f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f70877fe700 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f70877fe700 1 -- 172.21.15.12:0/1718594652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 msgr2=0x55da907efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f70877fe700 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f70877fe700 1 -- 172.21.15.12:0/1718594652 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da905c0630 con 0x55da907f03c0 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f7087fff700 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.224+0000 7f7086ffd700 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.225+0000 7f7084ff9700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70700a15a0 0x7f70700a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.225+0000 7f70877fe700 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da907f08a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f70780ca900 tx=0x7f70780d0c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=675bc8cf584bab19 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.225+0000 7f7084ff9700 1 -- 172.21.15.12:0/2907861629 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7078014070 con 0x7f7088103510 2023-12-11T20:22:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.225+0000 7f7087fff700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70700a15a0 0x7f70700a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.225+0000 7f706dffb700 1 -- 172.21.15.12:0/1718594652 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780964c0 con 0x55da907f03c0 2023-12-11T20:22:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.225+0000 7f706dffb700 1 -- 172.21.15.12:0/1718594652 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7078099f50 con 0x55da907f03c0 2023-12-11T20:22:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.225+0000 7f706dffb700 1 -- 172.21.15.12:0/1718594652 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800cc50 con 0x55da907f03c0 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 -- 172.21.15.12:0/1718594652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 msgr2=0x55da907f08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f7087fff700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70700a15a0 0x7f70700a3a60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f708000b0d0 tx=0x7f708000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da907f08a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f70780ca900 tx=0x7f70780d0c80 comp rx=0 tx=0).stop 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 -- 172.21.15.12:0/1718594652 shutdown_connections 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 --2- 172.21.15.12:0/1718594652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da907f08a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 -- 172.21.15.12:0/1718594652 >> 172.21.15.12:0/1718594652 conn(0x55da9071e7e0 msgr2=0x55da907ea3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 -- 172.21.15.12:0/1718594652 shutdown_connections 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.226+0000 7f70a1742b80 1 -- 172.21.15.12:0/1718594652 wait complete. 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.227+0000 7f70a1742b80 1 -- start start 2023-12-11T20:22:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.227+0000 7f70a1742b80 1 Processor -- start 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.228+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907f9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.228+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907f9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.228+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f0de0 0x55da908008b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.228+0000 7f70a1742b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da906fd560 con 0x55da907efa60 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.228+0000 7f70a1742b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da906fd200 con 0x55da907f03c0 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.228+0000 7f70a1742b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da905c2920 con 0x55da907f0de0 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.228+0000 7f70a1742b80 10 client.0 _ll_register_callbacks cb 0x55da90628a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907f9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:53958/0 (socket says 172.21.15.12:53958) 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7087fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f0de0 0x55da908008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 -- 172.21.15.12:0/3034482821 learned_addr learned my addr 172.21.15.12:0/3034482821 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f70877fe700 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 -- 172.21.15.12:0/3034482821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f0de0 msgr2=0x55da908008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f0de0 0x55da908008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 -- 172.21.15.12:0/3034482821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 msgr2=0x55da907f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 -- 172.21.15.12:0/3034482821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708810c2a0 con 0x55da907f03c0 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f70877fe700 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7086ffd700 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907f9870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f707c012d10 tx=0x7f707c00f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=905482ed776fc0be server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.229+0000 7f7066ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.230+0000 7f7066ffd700 1 -- 172.21.15.12:0/3034482821 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c017070 con 0x55da907f03c0 2023-12-11T20:22:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.230+0000 7f7066ffd700 1 -- 172.21.15.12:0/3034482821 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f707c00fc00 con 0x55da907f03c0 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.230+0000 7f70a1742b80 1 -- 172.21.15.12:0/3034482821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da907e29e0 con 0x55da907f03c0 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.230+0000 7f7066ffd700 1 -- 172.21.15.12:0/3034482821 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f707c0122e0 con 0x55da907f03c0 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.230+0000 7f70a1742b80 10 client.27140 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.230+0000 7f70a1742b80 1 -- 172.21.15.12:0/3034482821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f70881a1990 con 0x55da907f03c0 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.230+0000 7f7066ffd700 1 -- 172.21.15.12:0/3034482821 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55da907e29e0 con 0x55da907f03c0 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.231+0000 7f7066ffd700 1 -- 172.21.15.12:0/3034482821 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f707c010430 con 0x55da907f03c0 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.231+0000 7f70a1742b80 10 client.27140 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.231+0000 7f70a1742b80 10 client.27140 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.231+0000 7f70a1742b80 20 client.27140 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.231+0000 7f70a1742b80 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55da90805230 0x55da90807650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.231+0000 7f70a1742b80 4 client.27140 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.231+0000 7f70a1742b80 1 -- 172.21.15.12:0/3034482821 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da907bef40 con 0x55da90805230 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.231+0000 7f70877fe700 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55da90805230 0x55da90807650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.232+0000 7f70877fe700 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55da90805230 0x55da90807650 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e41e78c788c41fd server_cookie=ec7596c9862a776e in_seq=0 out_seq=0 2023-12-11T20:22:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.232+0000 7f7066ffd700 10 client.27140 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:22:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.232+0000 7f7066ffd700 1 -- 172.21.15.12:0/3034482821 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55da907bef40 con 0x55da90805230 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.232+0000 7f7066ffd700 10 client.27140 handle_command_reply: tid=0 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 client.27140 shutdown 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 -- 172.21.15.12:0/3034482821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 msgr2=0x55da907f9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907f9870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f707c012d10 tx=0x7f707c00f6a0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 -- 172.21.15.12:0/3034482821 shutdown_connections 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55da90805230 0x55da90807650 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f0de0 0x55da908008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f7066ffd700 0 client.27140 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 --2- 172.21.15.12:0/3034482821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907f9870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 -- 172.21.15.12:0/3034482821 >> 172.21.15.12:0/3034482821 conn(0x55da9071e7e0 msgr2=0x55da907ee820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 -- 172.21.15.12:0/3034482821 shutdown_connections 2023-12-11T20:22:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 1 -- 172.21.15.12:0/3034482821 wait complete. 2023-12-11T20:22:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.233+0000 7f70a1742b80 20 client.27140 trim_cache size 0 max 16384 2023-12-11T20:22:57.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70a1742b80 1 Processor -- start 2023-12-11T20:22:57.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70a1742b80 1 -- start start 2023-12-11T20:22:57.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da90800870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70a1742b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da90801a30 con 0x55da907efa60 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70a1742b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da907eb750 con 0x55da907f0de0 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70a1742b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da907f8ea0 con 0x55da907f03c0 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.252+0000 7f70877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f70877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907eacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57736/0 (socket says 172.21.15.12:57736) 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f70877fe700 1 -- 172.21.15.12:0/741611574 learned_addr learned my addr 172.21.15.12:0/741611574 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f7087fff700 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f7086ffd700 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da90800870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f70877fe700 1 -- 172.21.15.12:0/741611574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 msgr2=0x55da90800870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f70877fe700 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da90800870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f70877fe700 1 -- 172.21.15.12:0/741611574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 msgr2=0x55da907f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f70877fe700 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f70877fe700 1 -- 172.21.15.12:0/741611574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da9056cde0 con 0x55da907efa60 2023-12-11T20:22:57.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f7087fff700 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:57.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.253+0000 7f70877fe700 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907eacd0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f70780d01f0 tx=0x7f7078000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b46cb93bccbc26 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.254+0000 7f706e7fc700 1 -- 172.21.15.12:0/741611574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780964c0 con 0x55da907efa60 2023-12-11T20:22:57.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.254+0000 7f706e7fc700 1 -- 172.21.15.12:0/741611574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7078099ae0 con 0x55da907efa60 2023-12-11T20:22:57.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.254+0000 7f706e7fc700 1 -- 172.21.15.12:0/741611574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707809a180 con 0x55da907efa60 2023-12-11T20:22:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.254+0000 7f70a1742b80 1 -- 172.21.15.12:0/741611574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 msgr2=0x55da907eacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.254+0000 7f70a1742b80 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907eacd0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f70780d01f0 tx=0x7f7078000bc0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 -- 172.21.15.12:0/741611574 shutdown_connections 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f0de0 0x55da907f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907efa60 0x55da907eacd0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 --2- 172.21.15.12:0/741611574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907f03c0 0x55da90800870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 -- 172.21.15.12:0/741611574 >> 172.21.15.12:0/741611574 conn(0x55da9071e7e0 msgr2=0x55da907ea280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 -- 172.21.15.12:0/741611574 shutdown_connections 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 -- 172.21.15.12:0/741611574 wait complete. 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 -- start start 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.255+0000 7f70a1742b80 1 Processor -- start 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907efa60 0x55da907fe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907fe590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70a1742b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907f0de0 0x55da907ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70a1742b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da907ffa00 con 0x55da907f0de0 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70a1742b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da907ffb70 con 0x55da907f03c0 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70a1742b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da907ffd30 con 0x55da907efa60 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70a1742b80 10 client.0 _ll_register_callbacks cb 0x55da90628a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f7087fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907f0de0 0x55da907ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70877fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907efa60 0x55da907fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70877fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907efa60 0x55da907fe050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34454/0 (socket says 172.21.15.12:34454) 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f7087fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907f0de0 0x55da907ff4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57744/0 (socket says 172.21.15.12:57744) 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f70877fe700 1 -- 172.21.15.12:0/8970441 learned_addr learned my addr 172.21.15.12:0/8970441 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.256+0000 7f7086ffd700 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70877fe700 1 -- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 msgr2=0x55da907fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70877fe700 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907fe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70877fe700 1 -- 172.21.15.12:0/8970441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907f0de0 msgr2=0x55da907ff4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70877fe700 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907f0de0 0x55da907ff4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70877fe700 1 -- 172.21.15.12:0/8970441 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70800074e0 con 0x55da907efa60 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f7087fff700 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907f0de0 0x55da907ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f7086ffd700 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70877fe700 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907efa60 0x55da907fe050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f707809a0c0 tx=0x7f70780d0fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a1b38a679dbf00f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f7066ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f7066ffd700 1 -- 172.21.15.12:0/8970441 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780d0280 con 0x55da907efa60 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f7066ffd700 1 -- 172.21.15.12:0/8970441 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f707809e2d0 con 0x55da907efa60 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70a1742b80 1 -- 172.21.15.12:0/8970441 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7078099f50 con 0x55da907efa60 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f7066ffd700 1 -- 172.21.15.12:0/8970441 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70780964c0 con 0x55da907efa60 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70a1742b80 10 client.27145 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:57.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.257+0000 7f70a1742b80 1 -- 172.21.15.12:0/8970441 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f70780d0040 con 0x55da907efa60 2023-12-11T20:22:57.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.258+0000 7f7066ffd700 1 -- 172.21.15.12:0/8970441 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7078099f50 con 0x55da907efa60 2023-12-11T20:22:57.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.258+0000 7f7066ffd700 1 -- 172.21.15.12:0/8970441 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7078003d30 con 0x55da907efa60 2023-12-11T20:22:57.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.258+0000 7f70a1742b80 10 client.27145 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:57.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.258+0000 7f70a1742b80 10 client.27145 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.258+0000 7f70a1742b80 20 client.27145 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.258+0000 7f70a1742b80 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55da9085baf0 0x55da9085df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.258+0000 7f70a1742b80 4 client.27145 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.258+0000 7f70a1742b80 1 -- 172.21.15.12:0/8970441 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55da90709fd0 con 0x55da9085baf0 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.259+0000 7f7086ffd700 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55da9085baf0 0x55da9085df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.259+0000 7f7066ffd700 10 client.27145 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.259+0000 7f7086ffd700 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55da9085baf0 0x55da9085df10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acf681c3a3ab4b9e server_cookie=91a469fb3bc4b623 in_seq=0 out_seq=0 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.259+0000 7f7066ffd700 1 -- 172.21.15.12:0/8970441 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55da90709fd0 con 0x55da9085baf0 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.259+0000 7f7066ffd700 10 client.27145 handle_command_reply: tid=0 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.259+0000 7f70a1742b80 1 client.27145 shutdown 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 -- 172.21.15.12:0/8970441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907efa60 msgr2=0x55da907fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907efa60 0x55da907fe050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f707809a0c0 tx=0x7f70780d0fd0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 -- 172.21.15.12:0/8970441 shutdown_connections 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55da9085baf0 0x55da9085df10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55da907f0de0 0x55da907ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55da907efa60 0x55da907fe050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f7066ffd700 0 client.27145 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 --2- 172.21.15.12:0/8970441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55da907f03c0 0x55da907fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 -- 172.21.15.12:0/8970441 >> 172.21.15.12:0/8970441 conn(0x55da9071e7e0 msgr2=0x55da907f84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 -- 172.21.15.12:0/8970441 shutdown_connections 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 1 -- 172.21.15.12:0/8970441 wait complete. 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.260+0000 7f70a1742b80 20 client.27145 trim_cache size 0 max 16384 2023-12-11T20:22:57.263 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:22:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 -- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70700a15a0 msgr2=0x7f70700a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70700a15a0 0x7f70700a3a60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f708000b0d0 tx=0x7f708000b040 comp rx=0 tx=0).stop 2023-12-11T20:22:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 -- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7088103510 msgr2=0x7f7088199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7088103510 0x7f7088199350 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f707800e970 tx=0x7f707800ec80 comp rx=0 tx=0).stop 2023-12-11T20:22:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 -- 172.21.15.12:0/2907861629 shutdown_connections 2023-12-11T20:22:57.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70700a15a0 0x7f70700a3a60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70881050a0 0x7f70881a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7088103510 0x7f7088199350 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2907861629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7088104700 0x7f7088199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 -- 172.21.15.12:0/2907861629 >> 172.21.15.12:0/2907861629 conn(0x7f70880feaa0 msgr2=0x7f70881079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 -- 172.21.15.12:0/2907861629 shutdown_connections 2023-12-11T20:22:57.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.261+0000 7f708cb9d700 1 -- 172.21.15.12:0/2907861629 wait complete. 2023-12-11T20:22:57.278 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:57 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/378500155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:22:57.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:22:57.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:57 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/378500155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:22:57.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:57 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/378500155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:22:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 -- 172.21.15.12:0/1546052006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9bc104910 msgr2=0x7ff9bc106d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/1546052006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9bc104910 0x7ff9bc106d00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009990 tx=0x7ff9ac009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 -- 172.21.15.12:0/1546052006 shutdown_connections 2023-12-11T20:22:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/1546052006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9bc107240 0x7ff9bc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/1546052006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9bc101fe0 0x7ff9bc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/1546052006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9bc104910 0x7ff9bc106d00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 -- 172.21.15.12:0/1546052006 >> 172.21.15.12:0/1546052006 conn(0x7ff9bc0fb930 msgr2=0x7ff9bc0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 -- 172.21.15.12:0/1546052006 shutdown_connections 2023-12-11T20:22:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.506+0000 7ff9c35ff700 1 -- 172.21.15.12:0/1546052006 wait complete. 2023-12-11T20:22:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.507+0000 7ff9c35ff700 1 Processor -- start 2023-12-11T20:22:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.507+0000 7ff9c35ff700 1 -- start start 2023-12-11T20:22:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c35ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9bc101fe0 0x7ff9bc1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c35ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9bc104910 0x7ff9bc197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c35ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9bc107240 0x7ff9bc19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c35ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc19ef10 con 0x7ff9bc104910 2023-12-11T20:22:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c35ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc19f050 con 0x7ff9bc107240 2023-12-11T20:22:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c35ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc19f1e0 con 0x7ff9bc101fe0 2023-12-11T20:22:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c139b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9bc101fe0 0x7ff9bc1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c139b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9bc101fe0 0x7ff9bc1973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34474/0 (socket says 172.21.15.12:34474) 2023-12-11T20:22:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c139b700 1 -- 172.21.15.12:0/3415090665 learned_addr learned my addr 172.21.15.12:0/3415090665 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c0b9a700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9bc104910 0x7ff9bc197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9bc107240 0x7ff9bc19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c139b700 1 -- 172.21.15.12:0/3415090665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9bc107240 msgr2=0x7ff9bc19e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c139b700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9bc107240 0x7ff9bc19e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c139b700 1 -- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9bc104910 msgr2=0x7ff9bc197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c139b700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9bc104910 0x7ff9bc197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c139b700 1 -- 172.21.15.12:0/3415090665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0095f0 con 0x7ff9bc101fe0 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.508+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9bc107240 0x7ff9bc19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.509+0000 7ff9c139b700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9bc101fe0 0x7ff9bc1973e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800e9a0 tx=0x7ff9b800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.509+0000 7ff9b27fc700 1 -- 172.21.15.12:0/3415090665 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8009790 con 0x7ff9bc101fe0 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.509+0000 7ff9b27fc700 1 -- 172.21.15.12:0/3415090665 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9b800cbd0 con 0x7ff9bc101fe0 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.509+0000 7ff9c35ff700 1 -- 172.21.15.12:0/3415090665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc19f4c0 con 0x7ff9bc101fe0 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.509+0000 7ff9b27fc700 1 -- 172.21.15.12:0/3415090665 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8018680 con 0x7ff9bc101fe0 2023-12-11T20:22:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.509+0000 7ff9c35ff700 1 -- 172.21.15.12:0/3415090665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc19f9d0 con 0x7ff9bc101fe0 2023-12-11T20:22:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.514+0000 7ff9b27fc700 1 -- 172.21.15.12:0/3415090665 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff9b800cd40 con 0x7ff9bc101fe0 2023-12-11T20:22:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.515+0000 7ff9d6e92b80 1 Processor -- start 2023-12-11T20:22:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.515+0000 7ff9d6e92b80 1 -- start start 2023-12-11T20:22:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.515+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da2fac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fb140 0x5620da2fba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fc030 0x5620da2fc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da251b50 con 0x5620da2fb140 2023-12-11T20:22:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da24f470 con 0x5620da2fc030 2023-12-11T20:22:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da24ad60 con 0x5620da2fa7e0 2023-12-11T20:22:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fb140 0x5620da2fba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c1b9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da2fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c1b9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da2fac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34482/0 (socket says 172.21.15.12:34482) 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/1356322401 learned_addr learned my addr 172.21.15.12:0/1356322401 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c0b9a700 1 --2- 172.21.15.12:0/1356322401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fc030 0x5620da2fc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9b27fc700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9a80a1480 0x7ff9a80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c139b700 1 -- 172.21.15.12:0/1356322401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 msgr2=0x5620da2fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c139b700 1 --2- 172.21.15.12:0/1356322401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da2fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c139b700 1 -- 172.21.15.12:0/1356322401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fc030 msgr2=0x5620da2fc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c139b700 1 --2- 172.21.15.12:0/1356322401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fc030 0x5620da2fc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.516+0000 7ff9c139b700 1 -- 172.21.15.12:0/1356322401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620da0c7630 con 0x5620da2fb140 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.517+0000 7ff9b27fc700 1 -- 172.21.15.12:0/3415090665 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff9b8014070 con 0x7ff9bc101fe0 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.517+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9a80a1480 0x7ff9a80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.517+0000 7ff9c139b700 1 --2- 172.21.15.12:0/1356322401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fb140 0x5620da2fba50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80caa50 tx=0x7ff9b8065650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342e5a19cd821257 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.517+0000 7ff9a77fe700 1 -- 172.21.15.12:0/1356322401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b809a070 con 0x5620da2fb140 2023-12-11T20:22:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.517+0000 7ff9a77fe700 1 -- 172.21.15.12:0/1356322401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9b8099de0 con 0x5620da2fb140 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.517+0000 7ff9a77fe700 1 -- 172.21.15.12:0/1356322401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80777d0 con 0x5620da2fb140 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1356322401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fb140 msgr2=0x5620da2fba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/1356322401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fb140 0x5620da2fba50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80caa50 tx=0x7ff9b8065650 comp rx=0 tx=0).stop 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9a80a1480 0x7ff9a80a3940 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40076a0 tx=0x7ff9b4009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1356322401 shutdown_connections 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/1356322401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fc030 0x5620da2fc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/1356322401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da2fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/1356322401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fb140 0x5620da2fba50 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1356322401 >> 172.21.15.12:0/1356322401 conn(0x5620da2257e0 msgr2=0x5620da2f2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1356322401 shutdown_connections 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.518+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1356322401 wait complete. 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.519+0000 7ff9d6e92b80 1 -- start start 2023-12-11T20:22:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.519+0000 7ff9d6e92b80 1 Processor -- start 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.519+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da304520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.519+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da304a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da204560 con 0x5620da2fc030 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da204200 con 0x5620da2fa7e0 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da0c9920 con 0x5620da2fb140 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9d6e92b80 10 client.0 _ll_register_callbacks cb 0x5620da12fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c139b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da304520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c139b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da304520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54038/0 (socket says 172.21.15.12:54038) 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c139b700 1 -- 172.21.15.12:0/3261402328 learned_addr learned my addr 172.21.15.12:0/3261402328 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c0b9a700 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da304a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c139b700 1 -- 172.21.15.12:0/3261402328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 msgr2=0x5620da304a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c139b700 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da304a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c139b700 1 -- 172.21.15.12:0/3261402328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 msgr2=0x5620da30baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c139b700 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.520+0000 7ff9c139b700 1 -- 172.21.15.12:0/3261402328 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc19f9d0 con 0x5620da2fa7e0 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9c139b700 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da304520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80cadf0 tx=0x7ff9b80d0410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9005223e423997c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/3261402328 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b809a070 con 0x5620da2fa7e0 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/3261402328 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620da2e9b40 con 0x5620da2fa7e0 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/3261402328 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff9b809a9a0 con 0x5620da2fa7e0 2023-12-11T20:22:57.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/3261402328 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b8099c00 con 0x5620da2fa7e0 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9d6e92b80 10 client.27158 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/3261402328 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5620da073de0 con 0x5620da2fa7e0 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.521+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/3261402328 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9b8069020 con 0x5620da2fa7e0 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.522+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/3261402328 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff9b809e080 con 0x5620da2fa7e0 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.522+0000 7ff9d6e92b80 10 client.27158 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.522+0000 7ff9d6e92b80 10 client.27158 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.522+0000 7ff9d6e92b80 20 client.27158 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.522+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5620da310000 0x5620da3123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.522+0000 7ff9d6e92b80 4 client.27158 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.522+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/3261402328 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620da2c5f40 con 0x5620da310000 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.522+0000 7ff9c0b9a700 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5620da310000 0x5620da3123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.523+0000 7ff9c0b9a700 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5620da310000 0x5620da3123f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a1ee85f35d80c488 server_cookie=8f085d06200753fe in_seq=0 out_seq=0 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.523+0000 7ff9a4ff9700 10 client.27158 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:22:57.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/3261402328 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5620da2c5f40 con 0x5620da310000 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9a4ff9700 10 client.27158 handle_command_reply: tid=0 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 client.27158 shutdown 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/3261402328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 msgr2=0x5620da304520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da304520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80cadf0 tx=0x7ff9b80d0410 comp rx=0 tx=0).stop 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/3261402328 shutdown_connections 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5620da310000 0x5620da3123f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da304520 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/3261402328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da304a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/3261402328 >> 172.21.15.12:0/3261402328 conn(0x5620da2257e0 msgr2=0x5620da2f1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9a4ff9700 0 client.27158 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/3261402328 shutdown_connections 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.524+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/3261402328 wait complete. 2023-12-11T20:22:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.525+0000 7ff9d6e92b80 20 client.27158 trim_cache size 0 max 16384 2023-12-11T20:22:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.543+0000 7ff9d6e92b80 1 Processor -- start 2023-12-11T20:22:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.543+0000 7ff9d6e92b80 1 -- start start 2023-12-11T20:22:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da2fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da30ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da316d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da2edb50 con 0x5620da2fc030 2023-12-11T20:22:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da302fc0 con 0x5620da2fa7e0 2023-12-11T20:22:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da305710 con 0x5620da2fb140 2023-12-11T20:22:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da316d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da316d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57802/0 (socket says 172.21.15.12:57802) 2023-12-11T20:22:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/1693951373 learned_addr learned my addr 172.21.15.12:0/1693951373 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c139b700 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da2fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c0b9a700 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da30ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/1693951373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 msgr2=0x5620da30ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da30ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/1693951373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 msgr2=0x5620da2fabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da2fabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/1693951373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620da05cc60 con 0x5620da2fc030 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.545+0000 7ff9c0b9a700 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da30ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.544+0000 7ff9c139b700 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da2fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.545+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da316d60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40178c0 tx=0x7ff9b4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396b3e8479fe9dff server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.545+0000 7ff9a7fff700 1 -- 172.21.15.12:0/1693951373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4024840 con 0x5620da2fc030 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.545+0000 7ff9a7fff700 1 -- 172.21.15.12:0/1693951373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9b400f040 con 0x5620da2fc030 2023-12-11T20:22:57.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.545+0000 7ff9a7fff700 1 -- 172.21.15.12:0/1693951373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4016b60 con 0x5620da2fc030 2023-12-11T20:22:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1693951373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 msgr2=0x5620da316d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da316d60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40178c0 tx=0x7ff9b4004b40 comp rx=0 tx=0).stop 2023-12-11T20:22:57.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1693951373 shutdown_connections 2023-12-11T20:22:57.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fa7e0 0x5620da2fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da316d60 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/1693951373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fb140 0x5620da30ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1693951373 >> 172.21.15.12:0/1693951373 conn(0x5620da2257e0 msgr2=0x5620da302520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1693951373 shutdown_connections 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/1693951373 wait complete. 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.546+0000 7ff9d6e92b80 1 -- start start 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.547+0000 7ff9d6e92b80 1 Processor -- start 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.547+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da307270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.547+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fb140 0x5620da3077b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.547+0000 7ff9d6e92b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.547+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da30ad10 con 0x5620da2fc030 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.547+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da30ae80 con 0x5620da2fb140 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.547+0000 7ff9d6e92b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da30b040 con 0x5620da2fa7e0 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.547+0000 7ff9d6e92b80 10 client.0 _ll_register_callbacks cb 0x5620da12fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57806/0 (socket says 172.21.15.12:57806) 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/858798906 learned_addr learned my addr 172.21.15.12:0/858798906 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c0b9a700 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fb140 0x5620da3077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c139b700 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da307270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 msgr2=0x5620da307270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da307270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/858798906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fb140 msgr2=0x5620da3077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fb140 0x5620da3077b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 -- 172.21.15.12:0/858798906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b4017570 con 0x5620da2fc030 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c139b700 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da307270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9c1b9c700 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30a7d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4017890 tx=0x7ff9b4016f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b01064ef486ef3f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.548+0000 7ff9a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.549+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/858798906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4024a50 con 0x5620da2fc030 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.549+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/858798906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9b8099de0 con 0x5620da2fc030 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.549+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/858798906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff9b401c030 con 0x5620da2fc030 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.549+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/858798906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b4024bb0 con 0x5620da2fc030 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.549+0000 7ff9d6e92b80 10 client.17487 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.549+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/858798906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5620da09a250 con 0x5620da2fc030 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.549+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/858798906 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9b8099de0 con 0x5620da2fc030 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/858798906 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff9b40353f0 con 0x5620da2fc030 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9d6e92b80 10 client.17487 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9d6e92b80 10 client.17487 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:22:57.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9d6e92b80 20 client.17487 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5620da366e90 0x5620da3692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9d6e92b80 4 client.17487 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/858798906 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5620da210fd0 con 0x5620da366e90 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9c139b700 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5620da366e90 0x5620da3692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.550+0000 7ff9c139b700 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5620da366e90 0x5620da3692b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be5a7cad53f7a319 server_cookie=3dc68901f380633e in_seq=0 out_seq=0 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9a4ff9700 10 client.17487 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9a4ff9700 1 -- 172.21.15.12:0/858798906 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5620da210fd0 con 0x5620da366e90 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9a4ff9700 10 client.17487 handle_command_reply: tid=0 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 client.17487 shutdown 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/858798906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 msgr2=0x5620da30a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30a7d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4017890 tx=0x7ff9b4016f60 comp rx=0 tx=0).stop 2023-12-11T20:22:57.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/858798906 shutdown_connections 2023-12-11T20:22:57.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5620da366e90 0x5620da3692b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5620da2fc030 0x5620da30a7d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620da2fa7e0 0x5620da307270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 --2- 172.21.15.12:0/858798906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5620da2fb140 0x5620da3077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/858798906 >> 172.21.15.12:0/858798906 conn(0x5620da2257e0 msgr2=0x5620da316d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9a4ff9700 0 client.17487 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:22:57.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/858798906 shutdown_connections 2023-12-11T20:22:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.551+0000 7ff9d6e92b80 1 -- 172.21.15.12:0/858798906 wait complete. 2023-12-11T20:22:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9d6e92b80 20 client.17487 trim_cache size 0 max 16384 2023-12-11T20:22:57.558 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:22:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 -- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9a80a1480 msgr2=0x7ff9a80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9a80a1480 0x7ff9a80a3940 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40076a0 tx=0x7ff9b4009040 comp rx=0 tx=0).stop 2023-12-11T20:22:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 -- 172.21.15.12:0/3415090665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9bc101fe0 msgr2=0x7ff9bc1973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9bc101fe0 0x7ff9bc1973e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800e9a0 tx=0x7ff9b800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 -- 172.21.15.12:0/3415090665 shutdown_connections 2023-12-11T20:22:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff9a80a1480 0x7ff9a80a3940 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9bc107240 0x7ff9bc19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9bc101fe0 0x7ff9bc1973e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 --2- 172.21.15.12:0/3415090665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9bc104910 0x7ff9bc197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.552+0000 7ff9c35ff700 1 -- 172.21.15.12:0/3415090665 >> 172.21.15.12:0/3415090665 conn(0x7ff9bc0fb930 msgr2=0x7ff9bc103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.553+0000 7ff9c35ff700 1 -- 172.21.15.12:0/3415090665 shutdown_connections 2023-12-11T20:22:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.553+0000 7ff9c35ff700 1 -- 172.21.15.12:0/3415090665 wait complete. 2023-12-11T20:22:57.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:22:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/3462780235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14074030 msgr2=0x7fdc140744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/3462780235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14074030 0x7fdc140744b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009990 tx=0x7fdc04009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/3462780235 shutdown_connections 2023-12-11T20:22:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/3462780235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc14109370 0x7fdc1410b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/3462780235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc14075610 0x7fdc14073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/3462780235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14074030 0x7fdc140744b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/3462780235 >> 172.21.15.12:0/3462780235 conn(0x7fdc140fca00 msgr2=0x7fdc140fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/3462780235 shutdown_connections 2023-12-11T20:22:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.814+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/3462780235 wait complete. 2023-12-11T20:22:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.815+0000 7fdc1b7ff700 1 Processor -- start 2023-12-11T20:22:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.815+0000 7fdc1b7ff700 1 -- start start 2023-12-11T20:22:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.815+0000 7fdc1b7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc14074030 0x7fdc141995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.815+0000 7fdc1b7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc14075610 0x7fdc14199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.815+0000 7fdc1b7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14109370 0x7fdc141a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.815+0000 7fdc1b7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141a1120 con 0x7fdc14109370 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.815+0000 7fdc1b7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141a1260 con 0x7fdc14075610 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.815+0000 7fdc1b7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141a13f0 con 0x7fdc14074030 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc19d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14109370 0x7fdc141a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc19d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14109370 0x7fdc141a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57836/0 (socket says 172.21.15.12:57836) 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc19d9c700 1 -- 172.21.15.12:0/1292172381 learned_addr learned my addr 172.21.15.12:0/1292172381 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc14075610 0x7fdc14199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc1959b700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc14074030 0x7fdc141995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc19d9c700 1 -- 172.21.15.12:0/1292172381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc14074030 msgr2=0x7fdc141995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc19d9c700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc14074030 0x7fdc141995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc19d9c700 1 -- 172.21.15.12:0/1292172381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc14075610 msgr2=0x7fdc14199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc19d9c700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc14075610 0x7fdc14199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc19d9c700 1 -- 172.21.15.12:0/1292172381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040095f0 con 0x7fdc14109370 2023-12-11T20:22:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.816+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc14075610 0x7fdc14199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.817+0000 7fdc19d9c700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14109370 0x7fdc141a0b50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007ee0 tx=0x7fdc0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.817+0000 7fdc0a7fc700 1 -- 172.21.15.12:0/1292172381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c00dd20 con 0x7fdc14109370 2023-12-11T20:22:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.817+0000 7fdc0a7fc700 1 -- 172.21.15.12:0/1292172381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc0c00f040 con 0x7fdc14109370 2023-12-11T20:22:57.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.817+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/1292172381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc141a16d0 con 0x7fdc14109370 2023-12-11T20:22:57.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.817+0000 7fdc0a7fc700 1 -- 172.21.15.12:0/1292172381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c004750 con 0x7fdc14109370 2023-12-11T20:22:57.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.817+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/1292172381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc141a1be0 con 0x7fdc14109370 2023-12-11T20:22:57.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.821+0000 7fdc0a7fc700 1 -- 172.21.15.12:0/1292172381 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fdc0c003a00 con 0x7fdc14109370 2023-12-11T20:22:57.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.822+0000 7fdc2f15ab80 1 Processor -- start 2023-12-11T20:22:57.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.822+0000 7fdc2f15ab80 1 -- start start 2023-12-11T20:22:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fd9e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9ec20 0x55f58fd9f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fcf8b50 con 0x55f58fd9d3d0 2023-12-11T20:22:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fcf6470 con 0x55f58fd9dd30 2023-12-11T20:22:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fcf1d60 con 0x55f58fd9ec20 2023-12-11T20:22:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc0a7fc700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc000a1500 0x7fdc000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc0a7fc700 1 -- 172.21.15.12:0/1292172381 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc0c0cc5f0 con 0x7fdc14109370 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57850/0 (socket says 172.21.15.12:57850) 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc18d9a700 1 -- 172.21.15.12:0/2967186470 learned_addr learned my addr 172.21.15.12:0/2967186470 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc1959b700 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fd9e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9ec20 0x55f58fd9f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.823+0000 7fdc19d9c700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc000a1500 0x7fdc000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdc18d9a700 1 -- 172.21.15.12:0/2967186470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9ec20 msgr2=0x55f58fd9f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9ec20 0x55f58fd9f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdc18d9a700 1 -- 172.21.15.12:0/2967186470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 msgr2=0x55f58fd9e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fd9e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdc18d9a700 1 -- 172.21.15.12:0/2967186470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f58fb6e630 con 0x55f58fd9d3d0 2023-12-11T20:22:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdc19d9c700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc000a1500 0x7fdc000a39c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c099560 tx=0x7fdc0c004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009990 tx=0x7fdc04005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c8e9c5afb43f49 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdbff7fe700 1 -- 172.21.15.12:0/2967186470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04005050 con 0x55f58fd9d3d0 2023-12-11T20:22:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdbff7fe700 1 -- 172.21.15.12:0/2967186470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc04005640 con 0x55f58fd9d3d0 2023-12-11T20:22:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.824+0000 7fdbff7fe700 1 -- 172.21.15.12:0/2967186470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04004c70 con 0x55f58fd9d3d0 2023-12-11T20:22:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.825+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/2967186470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 msgr2=0x55f58fd9d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.825+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009990 tx=0x7fdc04005fb0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.825+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/2967186470 shutdown_connections 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.825+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9ec20 0x55f58fd9f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.825+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.825+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/2967186470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fd9e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.825+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/2967186470 >> 172.21.15.12:0/2967186470 conn(0x55f58fccc7e0 msgr2=0x55f58fd99d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.826+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/2967186470 shutdown_connections 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.826+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/2967186470 wait complete. 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.826+0000 7fdc2f15ab80 1 -- start start 2023-12-11T20:22:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.826+0000 7fdc2f15ab80 1 Processor -- start 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 0x55f58fda7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fda76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9ec20 0x55f58fdae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fcab560 con 0x55f58fd9ec20 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fcab200 con 0x55f58fd9dd30 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fb70920 con 0x55f58fd9d3d0 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc2f15ab80 10 client.0 _ll_register_callbacks cb 0x55f58fbd6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 0x55f58fda7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.827+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9ec20 0x55f58fdae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc1959b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fda76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9ec20 0x55f58fdae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57852/0 (socket says 172.21.15.12:57852) 2023-12-11T20:22:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc1959b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fda76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54100/0 (socket says 172.21.15.12:54100) 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc18d9a700 1 -- 172.21.15.12:0/881063852 learned_addr learned my addr 172.21.15.12:0/881063852 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc18d9a700 1 -- 172.21.15.12:0/881063852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 msgr2=0x55f58fda7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 0x55f58fda7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc18d9a700 1 -- 172.21.15.12:0/881063852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 msgr2=0x55f58fda76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fda76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc18d9a700 1 -- 172.21.15.12:0/881063852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc04020040 con 0x55f58fd9ec20 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc1959b700 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fda76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9ec20 0x55f58fdae710 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdc04005850 tx=0x7fdc0400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42ffa8be3177a9c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.828+0000 7fdbfcff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.829+0000 7fdbfcff9700 1 -- 172.21.15.12:0/881063852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04004d70 con 0x55f58fd9ec20 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.829+0000 7fdbfcff9700 1 -- 172.21.15.12:0/881063852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc04004ed0 con 0x55f58fd9ec20 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.829+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/881063852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f58fd90b40 con 0x55f58fd9ec20 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.829+0000 7fdbfcff9700 1 -- 172.21.15.12:0/881063852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc04005090 con 0x55f58fd9ec20 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.829+0000 7fdc2f15ab80 10 client.17499 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.829+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/881063852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f58fb1ade0 con 0x55f58fd9ec20 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.829+0000 7fdbfcff9700 1 -- 172.21.15.12:0/881063852 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f58fd90b40 con 0x55f58fd9ec20 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.829+0000 7fdbfcff9700 1 -- 172.21.15.12:0/881063852 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc04003e40 con 0x55f58fd9ec20 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.830+0000 7fdc2f15ab80 10 client.17499 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.830+0000 7fdc2f15ab80 10 client.17499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.830+0000 7fdc2f15ab80 20 client.17499 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.830+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f58fdb2980 0x55f58fdb4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.830+0000 7fdc2f15ab80 4 client.17499 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.830+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/881063852 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f58fd6cf40 con 0x55f58fdb2980 2023-12-11T20:22:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.830+0000 7fdc1959b700 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f58fdb2980 0x55f58fdb4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.831+0000 7fdc1959b700 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f58fdb2980 0x55f58fdb4da0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a5b8bd9b707ba2d server_cookie=19990fd8b95e512 in_seq=0 out_seq=0 2023-12-11T20:22:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.831+0000 7fdbfcff9700 10 client.17499 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdbfcff9700 1 -- 172.21.15.12:0/881063852 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f58fd6cf40 con 0x55f58fdb2980 2023-12-11T20:22:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdbfcff9700 10 client.17499 handle_command_reply: tid=0 2023-12-11T20:22:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 client.17499 shutdown 2023-12-11T20:22:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/881063852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9ec20 msgr2=0x55f58fdae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9ec20 0x55f58fdae710 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdc04005850 tx=0x7fdc0400bfd0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/881063852 shutdown_connections 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f58fdb2980 0x55f58fdb4da0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9ec20 0x55f58fdae710 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 0x55f58fda7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdbfcff9700 0 client.17499 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/881063852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9dd30 0x55f58fda76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/881063852 >> 172.21.15.12:0/881063852 conn(0x55f58fccc7e0 msgr2=0x55f58fd98a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/881063852 shutdown_connections 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/881063852 wait complete. 2023-12-11T20:22:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.832+0000 7fdc2f15ab80 20 client.17499 trim_cache size 0 max 16384 2023-12-11T20:22:57.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.848+0000 7fdc2f15ab80 1 Processor -- start 2023-12-11T20:22:57.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc2f15ab80 1 -- start start 2023-12-11T20:22:57.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9dd30 0x55f58fdae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdb9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fd9eaa0 con 0x55f58fd9d3d0 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fdaf890 con 0x55f58fd9ec20 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fd9e360 con 0x55f58fd9dd30 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57858/0 (socket says 172.21.15.12:57858) 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc18d9a700 1 -- 172.21.15.12:0/1069535127 learned_addr learned my addr 172.21.15.12:0/1069535127 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.849+0000 7fdc1959b700 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9dd30 0x55f58fdae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdb9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdc18d9a700 1 -- 172.21.15.12:0/1069535127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9dd30 msgr2=0x55f58fdae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9dd30 0x55f58fdae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdc18d9a700 1 -- 172.21.15.12:0/1069535127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 msgr2=0x55f58fdb9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdb9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdc18d9a700 1 -- 172.21.15.12:0/1069535127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f58fb03c60 con 0x55f58fd9d3d0 2023-12-11T20:22:57.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fdc04001eb0 tx=0x7fdc04009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611addd3d149057c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdbfffff700 1 -- 172.21.15.12:0/1069535127 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04004500 con 0x55f58fd9d3d0 2023-12-11T20:22:57.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdbfffff700 1 -- 172.21.15.12:0/1069535127 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc0403d020 con 0x55f58fd9d3d0 2023-12-11T20:22:57.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.850+0000 7fdbfffff700 1 -- 172.21.15.12:0/1069535127 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04005020 con 0x55f58fd9d3d0 2023-12-11T20:22:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1069535127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 msgr2=0x55f58fd9d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fdc04001eb0 tx=0x7fdc04009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1069535127 shutdown_connections 2023-12-11T20:22:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdb9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9d3d0 0x55f58fd9d7b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1069535127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9dd30 0x55f58fdae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1069535127 >> 172.21.15.12:0/1069535127 conn(0x55f58fccc7e0 msgr2=0x55f58fda66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1069535127 shutdown_connections 2023-12-11T20:22:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.851+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1069535127 wait complete. 2023-12-11T20:22:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.852+0000 7fdc2f15ab80 1 -- start start 2023-12-11T20:22:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.852+0000 7fdc2f15ab80 1 Processor -- start 2023-12-11T20:22:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.852+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 0x55f58fdab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.852+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9dd30 0x55f58fdabe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.852+0000 7fdc2f15ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fdad3a0 con 0x55f58fd9dd30 2023-12-11T20:22:57.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fdad510 con 0x55f58fd9ec20 2023-12-11T20:22:57.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc2f15ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f58fdad6d0 con 0x55f58fd9d3d0 2023-12-11T20:22:57.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc2f15ab80 10 client.0 _ll_register_callbacks cb 0x55f58fbd6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:57.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc1959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9dd30 0x55f58fdabe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc1959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9dd30 0x55f58fdabe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57870/0 (socket says 172.21.15.12:57870) 2023-12-11T20:22:57.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc18d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54118/0 (socket says 172.21.15.12:54118) 2023-12-11T20:22:57.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc1959b700 1 -- 172.21.15.12:0/1031083048 learned_addr learned my addr 172.21.15.12:0/1031083048 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:57.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 0x55f58fdab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc1959b700 1 -- 172.21.15.12:0/1031083048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 msgr2=0x55f58fdab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc1959b700 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 0x55f58fdab910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc1959b700 1 -- 172.21.15.12:0/1031083048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 msgr2=0x55f58fdace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:57.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc1959b700 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.853+0000 7fdc1959b700 1 -- 172.21.15.12:0/1031083048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f58fb1ade0 con 0x55f58fd9dd30 2023-12-11T20:22:57.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.854+0000 7fdc1959b700 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9dd30 0x55f58fdabe50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fdc10000c00 tx=0x7fdc1000be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47986addb0bf8c90 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:57.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.854+0000 7fdbfcff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:57.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.854+0000 7fdbfcff9700 1 -- 172.21.15.12:0/1031083048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10016050 con 0x55f58fd9dd30 2023-12-11T20:22:57.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.854+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1031083048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc04005640 con 0x55f58fd9dd30 2023-12-11T20:22:57.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.854+0000 7fdbfcff9700 1 -- 172.21.15.12:0/1031083048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc10003df0 con 0x55f58fd9dd30 2023-12-11T20:22:57.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.854+0000 7fdbfcff9700 1 -- 172.21.15.12:0/1031083048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc10004830 con 0x55f58fd9dd30 2023-12-11T20:22:57.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.854+0000 7fdc2f15ab80 10 client.17505 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:57.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.854+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1031083048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f58fb41250 con 0x55f58fd9dd30 2023-12-11T20:22:57.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdbfcff9700 1 -- 172.21.15.12:0/1031083048 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc04005640 con 0x55f58fd9dd30 2023-12-11T20:22:57.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdbfcff9700 1 -- 172.21.15.12:0/1031083048 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc10026070 con 0x55f58fd9dd30 2023-12-11T20:22:57.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdc2f15ab80 10 client.17505 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:57.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdc2f15ab80 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:57.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdc2f15ab80 20 client.17505 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:57.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f58fe093e0 0x55f58fe0b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:57.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdc2f15ab80 4 client.17505 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:22:57.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1031083048 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f58fcb7fd0 con 0x55f58fe093e0 2023-12-11T20:22:57.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.855+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f58fe093e0 0x55f58fe0b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:57.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.856+0000 7fdc18d9a700 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f58fe093e0 0x55f58fe0b800 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90dae2e5616366f8 server_cookie=af5e07bd4f26f65a in_seq=0 out_seq=0 2023-12-11T20:22:57.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.856+0000 7fdbfcff9700 10 client.17505 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:57.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.856+0000 7fdbfcff9700 1 -- 172.21.15.12:0/1031083048 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f58fcb7fd0 con 0x55f58fe093e0 2023-12-11T20:22:57.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.856+0000 7fdbfcff9700 10 client.17505 handle_command_reply: tid=0 2023-12-11T20:22:57.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.856+0000 7fdc2f15ab80 1 client.17505 shutdown 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1031083048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9dd30 msgr2=0x55f58fdabe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9dd30 0x55f58fdabe50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fdc10000c00 tx=0x7fdc1000be40 comp rx=0 tx=0).stop 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1031083048 shutdown_connections 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f58fe093e0 0x55f58fe0b800 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f58fd9ec20 0x55f58fdace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f58fd9d3d0 0x55f58fdab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 --2- 172.21.15.12:0/1031083048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f58fd9dd30 0x55f58fdabe50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1031083048 >> 172.21.15.12:0/1031083048 conn(0x55f58fccc7e0 msgr2=0x55f58fd99970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdbfcff9700 0 client.17505 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1031083048 shutdown_connections 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 1 -- 172.21.15.12:0/1031083048 wait complete. 2023-12-11T20:22:57.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.857+0000 7fdc2f15ab80 20 client.17505 trim_cache size 0 max 16384 2023-12-11T20:22:57.866 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:22:57.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc000a1500 msgr2=0x7fdc000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc000a1500 0x7fdc000a39c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c099560 tx=0x7fdc0c004ad0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14109370 msgr2=0x7fdc141a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:57.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14109370 0x7fdc141a0b50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007ee0 tx=0x7fdc0c00d3b0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/1292172381 shutdown_connections 2023-12-11T20:22:57.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc000a1500 0x7fdc000a39c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc14109370 0x7fdc141a0b50 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc14074030 0x7fdc141995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 --2- 172.21.15.12:0/1292172381 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc14075610 0x7fdc14199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:57.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/1292172381 >> 172.21.15.12:0/1292172381 conn(0x7fdc140fca00 msgr2=0x7fdc14105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:57.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/1292172381 shutdown_connections 2023-12-11T20:22:57.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:57.858+0000 7fdc1b7ff700 1 -- 172.21.15.12:0/1292172381 wait complete. 2023-12-11T20:22:58.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:58 smithi039 ceph-mon[102205]: pgmap v586: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:58.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:58 smithi012 ceph-mon[128787]: pgmap v586: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:58.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:58 smithi032 ceph-mon[132488]: pgmap v586: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:22:58.877 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:22:58.877 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.123+0000 7f4067fff700 1 -- 172.21.15.12:0/807039954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601071e0 msgr2=0x7f4060109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.123+0000 7f4067fff700 1 --2- 172.21.15.12:0/807039954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601071e0 0x7f4060109650 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f405800b0a0 tx=0x7f405800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.123+0000 7f4067fff700 1 -- 172.21.15.12:0/807039954 shutdown_connections 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.123+0000 7f4067fff700 1 --2- 172.21.15.12:0/807039954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4060101f80 0x7f4060104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.123+0000 7f4067fff700 1 --2- 172.21.15.12:0/807039954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601071e0 0x7f4060109650 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.123+0000 7f4067fff700 1 --2- 172.21.15.12:0/807039954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40601048b0 0x7f4060106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.123+0000 7f4067fff700 1 -- 172.21.15.12:0/807039954 >> 172.21.15.12:0/807039954 conn(0x7f40600fb930 msgr2=0x7f40600fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.124+0000 7f4067fff700 1 -- 172.21.15.12:0/807039954 shutdown_connections 2023-12-11T20:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.124+0000 7f4067fff700 1 -- 172.21.15.12:0/807039954 wait complete. 2023-12-11T20:22:59.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.125+0000 7f4067fff700 1 Processor -- start 2023-12-11T20:22:59.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.125+0000 7f4067fff700 1 -- start start 2023-12-11T20:22:59.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.125+0000 7f4067fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4060101f80 0x7f40601995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.125+0000 7f4067fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601048b0 0x7f4060199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.125+0000 7f4067fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40601071e0 0x7f40601a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.125+0000 7f4067fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a1120 con 0x7f40601048b0 2023-12-11T20:22:59.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.125+0000 7f4067fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a1260 con 0x7f40601071e0 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.125+0000 7f4067fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601a13f0 con 0x7f4060101f80 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601048b0 0x7f4060199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601048b0 0x7f4060199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48622/0 (socket says 172.21.15.12:48622) 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406559a700 1 -- 172.21.15.12:0/380528827 learned_addr learned my addr 172.21.15.12:0/380528827 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f4065d9b700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4060101f80 0x7f40601995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406659c700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40601071e0 0x7f40601a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406559a700 1 -- 172.21.15.12:0/380528827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4060101f80 msgr2=0x7f40601995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406559a700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4060101f80 0x7f40601995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406559a700 1 -- 172.21.15.12:0/380528827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40601071e0 msgr2=0x7f40601a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406559a700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40601071e0 0x7f40601a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.126+0000 7f406559a700 1 -- 172.21.15.12:0/380528827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058009d00 con 0x7f40601048b0 2023-12-11T20:22:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.127+0000 7f406559a700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601048b0 0x7f4060199b30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f405000c9b0 tx=0x7f405000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.127+0000 7f4056ffd700 1 -- 172.21.15.12:0/380528827 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050007b00 con 0x7f40601048b0 2023-12-11T20:22:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.127+0000 7f4056ffd700 1 -- 172.21.15.12:0/380528827 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f405000ce50 con 0x7f40601048b0 2023-12-11T20:22:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.127+0000 7f4067fff700 1 -- 172.21.15.12:0/380528827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40601a16d0 con 0x7f40601048b0 2023-12-11T20:22:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.127+0000 7f4067fff700 1 -- 172.21.15.12:0/380528827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40601a1be0 con 0x7f40601048b0 2023-12-11T20:22:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.127+0000 7f4056ffd700 1 -- 172.21.15.12:0/380528827 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050018420 con 0x7f40601048b0 2023-12-11T20:22:59.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.131+0000 7f4056ffd700 1 -- 172.21.15.12:0/380528827 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f405000f450 con 0x7f40601048b0 2023-12-11T20:22:59.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.132+0000 7f407b871b80 1 Processor -- start 2023-12-11T20:22:59.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.132+0000 7f407b871b80 1 -- start start 2023-12-11T20:22:59.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.132+0000 7f407b871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa16870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.132+0000 7f407b871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa176c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f407b871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa18120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f407b871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561a971bd0 con 0x55561aa16450 2023-12-11T20:22:59.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f407b871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561a96f4f0 con 0x55561aa16db0 2023-12-11T20:22:59.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f407b871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561a96ade0 con 0x55561aa17ca0 2023-12-11T20:22:59.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa16870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa16870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48638/0 (socket says 172.21.15.12:48638) 2023-12-11T20:22:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406659c700 1 -- 172.21.15.12:0/4187151543 learned_addr learned my addr 172.21.15.12:0/4187151543 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406559a700 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa18120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f4065d9b700 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406659c700 1 -- 172.21.15.12:0/4187151543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 msgr2=0x55561aa18120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406659c700 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa18120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406659c700 1 -- 172.21.15.12:0/4187151543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 msgr2=0x55561aa176c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406659c700 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa176c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f406659c700 1 -- 172.21.15.12:0/4187151543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55561a7e76b0 con 0x55561aa16450 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.133+0000 7f4065d9b700 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa176c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.134+0000 7f4056ffd700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f404c0a1480 0x7f404c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.134+0000 7f406659c700 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa16870 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4058015000 tx=0x7f4058007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5862e11828c605 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.134+0000 7f4056ffd700 1 -- 172.21.15.12:0/380528827 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f40500cccf0 con 0x7f40601048b0 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.134+0000 7f4065d9b700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f404c0a1480 0x7f404c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.134+0000 7f404bfff700 1 -- 172.21.15.12:0/4187151543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800e040 con 0x55561aa16450 2023-12-11T20:22:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.134+0000 7f404bfff700 1 -- 172.21.15.12:0/4187151543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4058003a00 con 0x55561aa16450 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.134+0000 7f404bfff700 1 -- 172.21.15.12:0/4187151543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405801ca00 con 0x55561aa16450 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 -- 172.21.15.12:0/4187151543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 msgr2=0x55561aa16870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f4065d9b700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f404c0a1480 0x7f404c0a3940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f405c005950 tx=0x7f405c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa16870 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4058015000 tx=0x7f4058007590 comp rx=0 tx=0).stop 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 -- 172.21.15.12:0/4187151543 shutdown_connections 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa18120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa16870 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 --2- 172.21.15.12:0/4187151543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa176c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 -- 172.21.15.12:0/4187151543 >> 172.21.15.12:0/4187151543 conn(0x55561a945860 msgr2=0x55561aa12e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 -- 172.21.15.12:0/4187151543 shutdown_connections 2023-12-11T20:22:59.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.135+0000 7f407b871b80 1 -- 172.21.15.12:0/4187151543 wait complete. 2023-12-11T20:22:59.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.136+0000 7f407b871b80 1 -- start start 2023-12-11T20:22:59.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.136+0000 7f407b871b80 1 Processor -- start 2023-12-11T20:22:59.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f407b871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa20200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f407b871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa20740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f407b871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa27780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f407b871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561a9245e0 con 0x55561aa16450 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f407b871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561a924280 con 0x55561aa16db0 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f407b871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561a7e99a0 con 0x55561aa17ca0 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f4065d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa20200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f407b871b80 10 client.0 _ll_register_callbacks cb 0x55561a84fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f4065d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa20200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48654/0 (socket says 172.21.15.12:48654) 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.137+0000 7f4065d9b700 1 -- 172.21.15.12:0/990268186 learned_addr learned my addr 172.21.15.12:0/990268186 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f406659c700 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa27780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f406559a700 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa20740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f4065d9b700 1 -- 172.21.15.12:0/990268186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 msgr2=0x55561aa27780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f4065d9b700 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa27780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f4065d9b700 1 -- 172.21.15.12:0/990268186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 msgr2=0x55561aa20740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f4065d9b700 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa20740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f4065d9b700 1 -- 172.21.15.12:0/990268186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406010a240 con 0x55561aa16450 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f4065d9b700 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa20200 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f405c004150 tx=0x7f405c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548828561c01082a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.138+0000 7f40497fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.139+0000 7f40497fa700 1 -- 172.21.15.12:0/990268186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c012d40 con 0x55561aa16450 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.139+0000 7f40497fa700 1 -- 172.21.15.12:0/990268186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f405c01b460 con 0x55561aa16450 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.139+0000 7f407b871b80 1 -- 172.21.15.12:0/990268186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55561aa09bc0 con 0x55561aa16450 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.139+0000 7f40497fa700 1 -- 172.21.15.12:0/990268186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f405c012ea0 con 0x55561aa16450 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.139+0000 7f407b871b80 10 client.17517 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.139+0000 7f407b871b80 1 -- 172.21.15.12:0/990268186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55561a793e60 con 0x55561aa16450 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.139+0000 7f40497fa700 1 -- 172.21.15.12:0/990268186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55561aa09bc0 con 0x55561aa16450 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.139+0000 7f40497fa700 1 -- 172.21.15.12:0/990268186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f405c0307f0 con 0x55561aa16450 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.140+0000 7f407b871b80 10 client.17517 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.140+0000 7f407b871b80 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.140+0000 7f407b871b80 20 client.17517 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.140+0000 7f407b871b80 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55561aa2c020 0x55561aa2e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.140+0000 7f407b871b80 4 client.17517 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.140+0000 7f407b871b80 1 -- 172.21.15.12:0/990268186 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55561a9e5fc0 con 0x55561aa2c020 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.140+0000 7f406559a700 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55561aa2c020 0x55561aa2e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.141+0000 7f406559a700 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55561aa2c020 0x55561aa2e440 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3127523fd4753c38 server_cookie=73bf4012d313fd77 in_seq=0 out_seq=0 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.141+0000 7f40497fa700 10 client.17517 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.141+0000 7f40497fa700 1 -- 172.21.15.12:0/990268186 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55561a9e5fc0 con 0x55561aa2c020 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.141+0000 7f40497fa700 10 client.17517 handle_command_reply: tid=0 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.141+0000 7f407b871b80 1 client.17517 shutdown 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 -- 172.21.15.12:0/990268186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 msgr2=0x55561aa20200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa20200 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f405c004150 tx=0x7f405c004750 comp rx=0 tx=0).stop 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 -- 172.21.15.12:0/990268186 shutdown_connections 2023-12-11T20:22:59.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55561aa2c020 0x55561aa2e440 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa27780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa20200 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 --2- 172.21.15.12:0/990268186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa20740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f40497fa700 0 client.17517 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:59.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 -- 172.21.15.12:0/990268186 >> 172.21.15.12:0/990268186 conn(0x55561a945860 msgr2=0x55561aa11ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 -- 172.21.15.12:0/990268186 shutdown_connections 2023-12-11T20:22:59.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 1 -- 172.21.15.12:0/990268186 wait complete. 2023-12-11T20:22:59.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.142+0000 7f407b871b80 20 client.17517 trim_cache size 0 max 16384 2023-12-11T20:22:59.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.166+0000 7f407b871b80 1 Processor -- start 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f407b871b80 1 -- start start 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f407b871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16450 0x55561aa1ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f407b871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16db0 0x55561aa27740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f407b871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f407b871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561aa13450 con 0x55561aa16db0 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f407b871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561aa1ec30 con 0x55561aa16450 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f407b871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561aa33650 con 0x55561aa17ca0 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f406559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16db0 0x55561aa27740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f406559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16db0 0x55561aa27740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48658/0 (socket says 172.21.15.12:48658) 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f406559a700 1 -- 172.21.15.12:0/495661677 learned_addr learned my addr 172.21.15.12:0/495661677 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f406659c700 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.167+0000 7f4065d9b700 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16450 0x55561aa1ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f406559a700 1 -- 172.21.15.12:0/495661677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 msgr2=0x55561aa204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f406559a700 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f406559a700 1 -- 172.21.15.12:0/495661677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16450 msgr2=0x55561aa1ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f406559a700 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16450 0x55561aa1ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f406559a700 1 -- 172.21.15.12:0/495661677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55561a77cce0 con 0x55561aa16db0 2023-12-11T20:22:59.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f4065d9b700 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16450 0x55561aa1ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:59.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f406559a700 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16db0 0x55561aa27740 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4050099ef0 tx=0x7f40500d06f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70cd89a7c917bb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f4054ff9700 1 -- 172.21.15.12:0/495661677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40500998c0 con 0x55561aa16db0 2023-12-11T20:22:59.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f4054ff9700 1 -- 172.21.15.12:0/495661677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f405000f700 con 0x55561aa16db0 2023-12-11T20:22:59.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.168+0000 7f4054ff9700 1 -- 172.21.15.12:0/495661677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40500a22f0 con 0x55561aa16db0 2023-12-11T20:22:59.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 -- 172.21.15.12:0/495661677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16db0 msgr2=0x55561aa27740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16db0 0x55561aa27740 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4050099ef0 tx=0x7f40500d06f0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 -- 172.21.15.12:0/495661677 shutdown_connections 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16450 0x55561aa1ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 --2- 172.21.15.12:0/495661677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16db0 0x55561aa27740 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 -- 172.21.15.12:0/495661677 >> 172.21.15.12:0/495661677 conn(0x55561a945860 msgr2=0x55561aa1ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 -- 172.21.15.12:0/495661677 shutdown_connections 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.169+0000 7f407b871b80 1 -- 172.21.15.12:0/495661677 wait complete. 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.170+0000 7f407b871b80 1 -- start start 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.170+0000 7f407b871b80 1 Processor -- start 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.170+0000 7f407b871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa26390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.170+0000 7f407b871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa268f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.170+0000 7f407b871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa82530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.170+0000 7f407b871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561aa27190 con 0x55561aa16450 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.170+0000 7f407b871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561aa82a70 con 0x55561aa16db0 2023-12-11T20:22:59.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.170+0000 7f407b871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55561aa82bb0 con 0x55561aa17ca0 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f407b871b80 10 client.0 _ll_register_callbacks cb 0x55561a84fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f4065d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa26390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f4065d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa26390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48674/0 (socket says 172.21.15.12:48674) 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f4065d9b700 1 -- 172.21.15.12:0/1750705254 learned_addr learned my addr 172.21.15.12:0/1750705254 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f406559a700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa268f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f406659c700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa82530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f4065d9b700 1 -- 172.21.15.12:0/1750705254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 msgr2=0x55561aa82530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f4065d9b700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa82530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f4065d9b700 1 -- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 msgr2=0x55561aa268f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f4065d9b700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa268f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f4065d9b700 1 -- 172.21.15.12:0/1750705254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55561a793e60 con 0x55561aa16450 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f406659c700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa82530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.171+0000 7f406559a700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa268f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f4065d9b700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa26390 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f405c030b20 tx=0x7f405c012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fecbd4e9f5a334 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f40497fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f40497fa700 1 -- 172.21.15.12:0/1750705254 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c030860 con 0x55561aa16450 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f40497fa700 1 -- 172.21.15.12:0/1750705254 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f405c005020 con 0x55561aa16450 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f407b871b80 1 -- 172.21.15.12:0/1750705254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4058003a00 con 0x55561aa16450 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f40497fa700 1 -- 172.21.15.12:0/1750705254 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f405c0051e0 con 0x55561aa16450 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f407b871b80 10 client.17523 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f407b871b80 1 -- 172.21.15.12:0/1750705254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f40601a1be0 con 0x55561aa16450 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.172+0000 7f40497fa700 1 -- 172.21.15.12:0/1750705254 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f405c03f020 con 0x55561aa16450 2023-12-11T20:22:59.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.173+0000 7f40497fa700 1 -- 172.21.15.12:0/1750705254 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f405c0264c0 con 0x55561aa16450 2023-12-11T20:22:59.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.173+0000 7f407b871b80 10 client.17523 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:59.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.173+0000 7f407b871b80 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:59.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.173+0000 7f407b871b80 20 client.17523 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:59.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.173+0000 7f407b871b80 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55561aa84630 0x55561aa86a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.173+0000 7f407b871b80 4 client.17523 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:22:59.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.173+0000 7f407b871b80 1 -- 172.21.15.12:0/1750705254 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55561a931050 con 0x55561aa84630 2023-12-11T20:22:59.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.173+0000 7f406559a700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55561aa84630 0x55561aa86a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.174+0000 7f406559a700 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55561aa84630 0x55561aa86a50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc59873bc21799bc server_cookie=12ffcc0463579bf1 in_seq=0 out_seq=0 2023-12-11T20:22:59.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.174+0000 7f40497fa700 10 client.17523 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:59.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.175+0000 7f40497fa700 1 -- 172.21.15.12:0/1750705254 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55561a931050 con 0x55561aa84630 2023-12-11T20:22:59.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.175+0000 7f40497fa700 10 client.17523 handle_command_reply: tid=0 2023-12-11T20:22:59.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.175+0000 7f407b871b80 1 client.17523 shutdown 2023-12-11T20:22:59.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 -- 172.21.15.12:0/1750705254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 msgr2=0x55561aa26390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa26390 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f405c030b20 tx=0x7f405c012b70 comp rx=0 tx=0).stop 2023-12-11T20:22:59.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 -- 172.21.15.12:0/1750705254 shutdown_connections 2023-12-11T20:22:59.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55561aa84630 0x55561aa86a50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55561aa17ca0 0x55561aa82530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55561aa16450 0x55561aa26390 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 --2- 172.21.15.12:0/1750705254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55561aa16db0 0x55561aa268f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 -- 172.21.15.12:0/1750705254 >> 172.21.15.12:0/1750705254 conn(0x55561a945860 msgr2=0x55561aa1ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f40497fa700 0 client.17523 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:59.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 -- 172.21.15.12:0/1750705254 shutdown_connections 2023-12-11T20:22:59.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 1 -- 172.21.15.12:0/1750705254 wait complete. 2023-12-11T20:22:59.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.176+0000 7f407b871b80 20 client.17523 trim_cache size 0 max 16384 2023-12-11T20:22:59.182 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:22:59.182 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:22:59.182 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "e17c5f89-17bd-4cda-8a54-ca8b45074157", 2023-12-11T20:22:59.182 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:22:59.182 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:22:59.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 -- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f404c0a1480 msgr2=0x7f404c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f404c0a1480 0x7f404c0a3940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f405c005950 tx=0x7f405c00b410 comp rx=0 tx=0).stop 2023-12-11T20:22:59.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 -- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601048b0 msgr2=0x7f4060199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601048b0 0x7f4060199b30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f405000c9b0 tx=0x7f405000ccc0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 -- 172.21.15.12:0/380528827 shutdown_connections 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f404c0a1480 0x7f404c0a3940 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40601071e0 0x7f40601a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4060101f80 0x7f40601995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 --2- 172.21.15.12:0/380528827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40601048b0 0x7f4060199b30 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 -- 172.21.15.12:0/380528827 >> 172.21.15.12:0/380528827 conn(0x7f40600fb930 msgr2=0x7f40601016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 -- 172.21.15.12:0/380528827 shutdown_connections 2023-12-11T20:22:59.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.177+0000 7f4067fff700 1 -- 172.21.15.12:0/380528827 wait complete. 2023-12-11T20:22:59.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:22:59.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 -- 172.21.15.12:0/2694835756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 msgr2=0x7fceac104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 --2- 172.21.15.12:0/2694835756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 0x7fceac104370 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009990 tx=0x7fce9c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 -- 172.21.15.12:0/2694835756 shutdown_connections 2023-12-11T20:22:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 --2- 172.21.15.12:0/2694835756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceac1071e0 0x7fceac109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 --2- 172.21.15.12:0/2694835756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 0x7fceac104370 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 --2- 172.21.15.12:0/2694835756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceac1048b0 0x7fceac106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 -- 172.21.15.12:0/2694835756 >> 172.21.15.12:0/2694835756 conn(0x7fceac0fb930 msgr2=0x7fceac0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 -- 172.21.15.12:0/2694835756 shutdown_connections 2023-12-11T20:22:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.440+0000 7fceb23ff700 1 -- 172.21.15.12:0/2694835756 wait complete. 2023-12-11T20:22:59.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.441+0000 7fceb23ff700 1 Processor -- start 2023-12-11T20:22:59.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.441+0000 7fceb23ff700 1 -- start start 2023-12-11T20:22:59.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceb23ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 0x7fceac1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceb23ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceac1048b0 0x7fceac197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceb23ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceac1071e0 0x7fceac19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceb23ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac19ef20 con 0x7fceac101f80 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceb23ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac19f060 con 0x7fceac1048b0 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceb23ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac19f1f0 con 0x7fceac1071e0 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 0x7fceac1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 0x7fceac1973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48694/0 (socket says 172.21.15.12:48694) 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceabfff700 1 -- 172.21.15.12:0/26083268 learned_addr learned my addr 172.21.15.12:0/26083268 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceb099c700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceac1071e0 0x7fceac19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceab7fe700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceac1048b0 0x7fceac197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceabfff700 1 -- 172.21.15.12:0/26083268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceac1071e0 msgr2=0x7fceac19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceabfff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceac1071e0 0x7fceac19e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.442+0000 7fceabfff700 1 -- 172.21.15.12:0/26083268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceac1048b0 msgr2=0x7fceac197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fceabfff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceac1048b0 0x7fceac197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fceabfff700 1 -- 172.21.15.12:0/26083268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0095f0 con 0x7fceac101f80 2023-12-11T20:22:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fceab7fe700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceac1048b0 0x7fceac197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:22:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fceabfff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 0x7fceac1973f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00b2e0 tx=0x7fce9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fcea97fa700 1 -- 172.21.15.12:0/26083268 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c01d070 con 0x7fceac101f80 2023-12-11T20:22:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fcea97fa700 1 -- 172.21.15.12:0/26083268 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce9c00beb0 con 0x7fceac101f80 2023-12-11T20:22:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fcea97fa700 1 -- 172.21.15.12:0/26083268 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c021410 con 0x7fceac101f80 2023-12-11T20:22:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fceb23ff700 1 -- 172.21.15.12:0/26083268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac19f470 con 0x7fceac101f80 2023-12-11T20:22:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.443+0000 7fceb23ff700 1 -- 172.21.15.12:0/26083268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac19f840 con 0x7fceac101f80 2023-12-11T20:22:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.447+0000 7fcea97fa700 1 -- 172.21.15.12:0/26083268 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fce9c00f640 con 0x7fceac101f80 2023-12-11T20:22:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.448+0000 7fcec5d5eb80 1 Processor -- start 2023-12-11T20:22:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcec5d5eb80 1 -- start start 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fc97e0 0x5629a2fc9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fcaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fcb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcea97fa700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fce940a1480 0x7fce940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2f20b50 con 0x5629a2fcb030 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2f1e470 con 0x5629a2fca140 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2f19d60 con 0x5629a2fc97e0 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.449+0000 7fcea97fa700 1 -- 172.21.15.12:0/26083268 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fce9c0ce170 con 0x7fceac101f80 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fcb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fcb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48704/0 (socket says 172.21.15.12:48704) 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 -- 172.21.15.12:0/704487762 learned_addr learned my addr 172.21.15.12:0/704487762 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceabfff700 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fcaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fc97e0 0x5629a2fc9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceab7fe700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fce940a1480 0x7fce940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 -- 172.21.15.12:0/704487762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fc97e0 msgr2=0x5629a2fc9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fc97e0 0x5629a2fc9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 -- 172.21.15.12:0/704487762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 msgr2=0x5629a2fcaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fcaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.450+0000 7fceb099c700 1 -- 172.21.15.12:0/704487762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629a2d96630 con 0x5629a2fcb030 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.451+0000 7fceb099c700 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fcb4b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009550 tx=0x7fcea400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd24290a2d781255 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.451+0000 7fceab7fe700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fce940a1480 0x7fce940a3940 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009be0 tx=0x7fcea0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.451+0000 7fce927fc700 1 -- 172.21.15.12:0/704487762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004bb0 con 0x5629a2fcb030 2023-12-11T20:22:59.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.451+0000 7fce927fc700 1 -- 172.21.15.12:0/704487762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcea400f070 con 0x5629a2fcb030 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.451+0000 7fce927fc700 1 -- 172.21.15.12:0/704487762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4005a80 con 0x5629a2fcb030 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/704487762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 msgr2=0x5629a2fcb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fcb4b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009550 tx=0x7fcea400b040 comp rx=0 tx=0).stop 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/704487762 shutdown_connections 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fcb4b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fc97e0 0x5629a2fc9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/704487762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fcaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/704487762 >> 172.21.15.12:0/704487762 conn(0x5629a2ef47e0 msgr2=0x5629a2fc1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/704487762 shutdown_connections 2023-12-11T20:22:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.452+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/704487762 wait complete. 2023-12-11T20:22:59.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 1 -- start start 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 1 Processor -- start 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fd3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fd3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fcb030 0x5629a2fdab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2ed3560 con 0x5629a2fc97e0 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2ed3200 con 0x5629a2fca140 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2d98920 con 0x5629a2fcb030 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.453+0000 7fcec5d5eb80 10 client.0 _ll_register_callbacks cb 0x5629a2dfea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fd3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fd3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fd3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46626/0 (socket says 172.21.15.12:46626) 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceab7fe700 1 -- 172.21.15.12:0/3983229879 learned_addr learned my addr 172.21.15.12:0/3983229879 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceb099c700 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fcb030 0x5629a2fdab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceab7fe700 1 -- 172.21.15.12:0/3983229879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fcb030 msgr2=0x5629a2fdab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceab7fe700 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fcb030 0x5629a2fdab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceab7fe700 1 -- 172.21.15.12:0/3983229879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 msgr2=0x5629a2fd3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceab7fe700 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fd3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceab7fe700 1 -- 172.21.15.12:0/3983229879 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea4011040 con 0x5629a2fca140 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.454+0000 7fceabfff700 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fd3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.455+0000 7fceab7fe700 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fd3b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcea0010e80 tx=0x7fcea0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20ca1f1de859bbf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.455+0000 7fce8b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.455+0000 7fce8b7fe700 1 -- 172.21.15.12:0/3983229879 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0009890 con 0x5629a2fca140 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.455+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3983229879 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629a2fb8b40 con 0x5629a2fca140 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.455+0000 7fce8b7fe700 1 -- 172.21.15.12:0/3983229879 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcea001f450 con 0x5629a2fca140 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.455+0000 7fce8b7fe700 1 -- 172.21.15.12:0/3983229879 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcea0010eb0 con 0x5629a2fca140 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.455+0000 7fcec5d5eb80 10 client.27209 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.455+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3983229879 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5629a2d42de0 con 0x5629a2fca140 2023-12-11T20:22:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.456+0000 7fce8b7fe700 1 -- 172.21.15.12:0/3983229879 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5629a2fb8b40 con 0x5629a2fca140 2023-12-11T20:22:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.456+0000 7fce8b7fe700 1 -- 172.21.15.12:0/3983229879 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcea00277b0 con 0x5629a2fca140 2023-12-11T20:22:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.456+0000 7fcec5d5eb80 10 client.27209 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.456+0000 7fcec5d5eb80 10 client.27209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.456+0000 7fcec5d5eb80 20 client.27209 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.456+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5629a2fdf3f0 0x5629a2fe1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.456+0000 7fcec5d5eb80 4 client.27209 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.456+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3983229879 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629a2f94f40 con 0x5629a2fdf3f0 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.457+0000 7fceabfff700 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5629a2fdf3f0 0x5629a2fe1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.457+0000 7fceabfff700 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5629a2fdf3f0 0x5629a2fe1810 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b9ddbd4e358e6f server_cookie=2bd17314586f71ac in_seq=0 out_seq=0 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.457+0000 7fce8b7fe700 10 client.27209 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fce8b7fe700 1 -- 172.21.15.12:0/3983229879 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5629a2f94f40 con 0x5629a2fdf3f0 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fce8b7fe700 10 client.27209 handle_command_reply: tid=0 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 client.27209 shutdown 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3983229879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 msgr2=0x5629a2fd3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fd3b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcea0010e80 tx=0x7fcea0004750 comp rx=0 tx=0).stop 2023-12-11T20:22:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3983229879 shutdown_connections 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5629a2fdf3f0 0x5629a2fe1810 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fcb030 0x5629a2fdab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fd3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fce8b7fe700 0 client.27209 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3983229879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fca140 0x5629a2fd3b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.458+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3983229879 >> 172.21.15.12:0/3983229879 conn(0x5629a2ef47e0 msgr2=0x5629a2fc0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.459+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3983229879 shutdown_connections 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.459+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3983229879 wait complete. 2023-12-11T20:22:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.459+0000 7fcec5d5eb80 20 client.27209 trim_cache size 0 max 16384 2023-12-11T20:22:59.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-mon[132488]: pgmap v587: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:22:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:22:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:22:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:22:59.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:59.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:22:59 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:22:59.187+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v156>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v173>,<0x10000000001/sv_0 v197>,<0x10000000000/_nogroup v181>,<0x1/volumes v173>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:22:59.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.479+0000 7fcec5d5eb80 1 Processor -- start 2023-12-11T20:22:59.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.479+0000 7fcec5d5eb80 1 -- start start 2023-12-11T20:22:59.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fc2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fdab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fcb030 0x5629a2fd33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2fd31b0 con 0x5629a2fc97e0 2023-12-11T20:22:59.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2fe6a40 con 0x5629a2fcb030 2023-12-11T20:22:59.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2fcdbc0 con 0x5629a2fca140 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fc2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fc2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48728/0 (socket says 172.21.15.12:48728) 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceabfff700 1 -- 172.21.15.12:0/3933894240 learned_addr learned my addr 172.21.15.12:0/3933894240 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceb099c700 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fcb030 0x5629a2fd33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceab7fe700 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fdab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceabfff700 1 -- 172.21.15.12:0/3933894240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 msgr2=0x5629a2fdab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceabfff700 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fdab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceabfff700 1 -- 172.21.15.12:0/3933894240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fcb030 msgr2=0x5629a2fd33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceabfff700 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fcb030 0x5629a2fd33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceabfff700 1 -- 172.21.15.12:0/3933894240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629a2d2bc60 con 0x5629a2fc97e0 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.480+0000 7fceab7fe700 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fdab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.481+0000 7fceabfff700 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fc2080 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0860d0 tx=0x7fce9c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d3314cef4800c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.481+0000 7fce92ffd700 1 -- 172.21.15.12:0/3933894240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0b3ea0 con 0x5629a2fc97e0 2023-12-11T20:22:59.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.481+0000 7fce92ffd700 1 -- 172.21.15.12:0/3933894240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce9c00f460 con 0x5629a2fc97e0 2023-12-11T20:22:59.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.481+0000 7fce92ffd700 1 -- 172.21.15.12:0/3933894240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c099810 con 0x5629a2fc97e0 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3933894240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 msgr2=0x5629a2fc2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fc2080 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0860d0 tx=0x7fce9c086040 comp rx=0 tx=0).stop 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3933894240 shutdown_connections 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fcb030 0x5629a2fd33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fc97e0 0x5629a2fc2080 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/3933894240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fdab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3933894240 >> 172.21.15.12:0/3933894240 conn(0x5629a2ef47e0 msgr2=0x5629a2fc1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3933894240 shutdown_connections 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/3933894240 wait complete. 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 -- start start 2023-12-11T20:22:59.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.482+0000 7fcec5d5eb80 1 Processor -- start 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.483+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fc97e0 0x5629a2fd6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.483+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fd7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.483+0000 7fcec5d5eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fd9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.483+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2fda530 con 0x5629a2fcb030 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.483+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2fda6a0 con 0x5629a2fc97e0 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.483+0000 7fcec5d5eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a2fda810 con 0x5629a2fca140 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.483+0000 7fcec5d5eb80 10 client.0 _ll_register_callbacks cb 0x5629a2dfea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fc97e0 0x5629a2fd6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fc97e0 0x5629a2fd6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46644/0 (socket says 172.21.15.12:46644) 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceb099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fd9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 -- 172.21.15.12:0/2130667148 learned_addr learned my addr 172.21.15.12:0/2130667148 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceab7fe700 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fd7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 -- 172.21.15.12:0/2130667148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 msgr2=0x5629a2fd7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fd7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 -- 172.21.15.12:0/2130667148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 msgr2=0x5629a2fd9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fd9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 -- 172.21.15.12:0/2130667148 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac19f840 con 0x5629a2fc97e0 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fceabfff700 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fc97e0 0x5629a2fd6cc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce9c09b170 tx=0x7fce9c005ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a885288eda660a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fce8b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.484+0000 7fce8b7fe700 1 -- 172.21.15.12:0/2130667148 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0b3ea0 con 0x5629a2fc97e0 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.485+0000 7fce8b7fe700 1 -- 172.21.15.12:0/2130667148 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fce9c09bb70 con 0x5629a2fc97e0 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.485+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/2130667148 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcea400f070 con 0x5629a2fc97e0 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.485+0000 7fce8b7fe700 1 -- 172.21.15.12:0/2130667148 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce9c0cbcd0 con 0x5629a2fc97e0 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.485+0000 7fcec5d5eb80 10 client.27215 fetch_fsmap learned FSMap version 26 2023-12-11T20:22:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.485+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/2130667148 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5629a2d69250 con 0x5629a2fc97e0 2023-12-11T20:22:59.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.485+0000 7fce8b7fe700 1 -- 172.21.15.12:0/2130667148 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcea400f070 con 0x5629a2fc97e0 2023-12-11T20:22:59.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.485+0000 7fce8b7fe700 1 -- 172.21.15.12:0/2130667148 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fce9c0a32e0 con 0x5629a2fc97e0 2023-12-11T20:22:59.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fcec5d5eb80 10 client.27215 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:22:59.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fcec5d5eb80 10 client.27215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:22:59.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fcec5d5eb80 20 client.27215 populate_metadata read hostname 'smithi012' 2023-12-11T20:22:59.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5629a3036500 0x5629a30388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:22:59.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fcec5d5eb80 4 client.27215 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:22:59.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/2130667148 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5629a2edffd0 con 0x5629a3036500 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fceab7fe700 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5629a3036500 0x5629a30388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fceab7fe700 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5629a3036500 0x5629a30388f0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd1036e272df253 server_cookie=1357762758beb369 in_seq=0 out_seq=0 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.486+0000 7fce8b7fe700 10 client.27215 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fce8b7fe700 1 -- 172.21.15.12:0/2130667148 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5629a2edffd0 con 0x5629a3036500 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fce8b7fe700 10 client.27215 handle_command_reply: tid=0 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 client.27215 shutdown 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/2130667148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fc97e0 msgr2=0x5629a2fd6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fc97e0 0x5629a2fd6cc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce9c09b170 tx=0x7fce9c005ac0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/2130667148 shutdown_connections 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5629a3036500 0x5629a30388f0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5629a2fc97e0 0x5629a2fd6cc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5629a2fcb030 0x5629a2fd9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fce8b7fe700 0 client.27215 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 --2- 172.21.15.12:0/2130667148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a2fca140 0x5629a2fd7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/2130667148 >> 172.21.15.12:0/2130667148 conn(0x5629a2ef47e0 msgr2=0x5629a2fd33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/2130667148 shutdown_connections 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 1 -- 172.21.15.12:0/2130667148 wait complete. 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.487+0000 7fcec5d5eb80 20 client.27215 trim_cache size 0 max 16384 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout: "e17c5f89-17bd-4cda-8a54-ca8b45074157": { 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "e17c5f89-17bd-4cda-8a54-ca8b45074157", 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:22:59.490 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:22:59.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:22:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:22:59.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 -- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fce940a1480 msgr2=0x7fce940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fce940a1480 0x7fce940a3940 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009be0 tx=0x7fcea0009260 comp rx=0 tx=0).stop 2023-12-11T20:22:59.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 -- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 msgr2=0x7fceac1973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:22:59.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 0x7fceac1973f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00b2e0 tx=0x7fce9c004730 comp rx=0 tx=0).stop 2023-12-11T20:22:59.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 -- 172.21.15.12:0/26083268 shutdown_connections 2023-12-11T20:22:59.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fce940a1480 0x7fce940a3940 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceac1071e0 0x7fceac19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac101f80 0x7fceac1973f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 --2- 172.21.15.12:0/26083268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceac1048b0 0x7fceac197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:22:59.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 -- 172.21.15.12:0/26083268 >> 172.21.15.12:0/26083268 conn(0x7fceac0fb930 msgr2=0x7fceac103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:22:59.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 -- 172.21.15.12:0/26083268 shutdown_connections 2023-12-11T20:22:59.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:22:59.488+0000 7fceb23ff700 1 -- 172.21.15.12:0/26083268 wait complete. 2023-12-11T20:22:59.507 INFO:tasks.cephfs.filesystem:scrub status for tag:e17c5f89-17bd-4cda-8a54-ca8b45074157 - {'path': '/', 'tag': 'e17c5f89-17bd-4cda-8a54-ca8b45074157', 'options': 'recursive,force'} 2023-12-11T20:22:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:59 smithi012 ceph-mon[128787]: pgmap v587: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:59 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:22:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:22:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:22:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:59 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:22:59.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:22:59 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:59.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:59 smithi039 ceph-mon[102205]: pgmap v587: 97 pgs: 97 active+clean; 4.8 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:22:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:59 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:22:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:22:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:22:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:22:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:59 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:22:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:22:59 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:00 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:23:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:00 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:23:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:00 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:23:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 -- 172.21.15.12:0/2841709341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 msgr2=0x7f457c106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 --2- 172.21.15.12:0/2841709341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 0x7f457c106af0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f456c009990 tx=0x7f456c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 -- 172.21.15.12:0/2841709341 shutdown_connections 2023-12-11T20:23:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 --2- 172.21.15.12:0/2841709341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c101dd0 0x7f457c1041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 --2- 172.21.15.12:0/2841709341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f457c107030 0x7f457c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 --2- 172.21.15.12:0/2841709341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 0x7f457c106af0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 -- 172.21.15.12:0/2841709341 >> 172.21.15.12:0/2841709341 conn(0x7f457c0fb780 msgr2=0x7f457c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 -- 172.21.15.12:0/2841709341 shutdown_connections 2023-12-11T20:23:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.849+0000 7f4581d9d700 1 -- 172.21.15.12:0/2841709341 wait complete. 2023-12-11T20:23:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.850+0000 7f4581d9d700 1 Processor -- start 2023-12-11T20:23:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.850+0000 7f4581d9d700 1 -- start start 2023-12-11T20:23:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.850+0000 7f4581d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f457c101dd0 0x7f457c1016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f4581d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 0x7f457c0ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f4581d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c107030 0x7f457c1002c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f4581d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c100a60 con 0x7f457c104700 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f4581d9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c100bd0 con 0x7f457c107030 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f4581d9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c1a1170 con 0x7f457c101dd0 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f457bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 0x7f457c0ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f457bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 0x7f457c0ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48756/0 (socket says 172.21.15.12:48756) 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f457bfff700 1 -- 172.21.15.12:0/1984542435 learned_addr learned my addr 172.21.15.12:0/1984542435 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f457bfff700 1 -- 172.21.15.12:0/1984542435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f457c101dd0 msgr2=0x7f457c1016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f457bfff700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f457c101dd0 0x7f457c1016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f457bfff700 1 -- 172.21.15.12:0/1984542435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c107030 msgr2=0x7f457c1002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f457bfff700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c107030 0x7f457c1002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.851+0000 7f457bfff700 1 -- 172.21.15.12:0/1984542435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0095f0 con 0x7f457c104700 2023-12-11T20:23:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.852+0000 7f457bfff700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 0x7f457c0ffd80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f456c0098e0 tx=0x7f456c005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.852+0000 7f4579ffb700 1 -- 172.21.15.12:0/1984542435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c01d070 con 0x7f457c104700 2023-12-11T20:23:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.852+0000 7f4581d9d700 1 -- 172.21.15.12:0/1984542435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c1a13a0 con 0x7f457c104700 2023-12-11T20:23:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.852+0000 7f4579ffb700 1 -- 172.21.15.12:0/1984542435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f456c004080 con 0x7f457c104700 2023-12-11T20:23:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.852+0000 7f4579ffb700 1 -- 172.21.15.12:0/1984542435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c022c90 con 0x7f457c104700 2023-12-11T20:23:00.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.852+0000 7f4581d9d700 1 -- 172.21.15.12:0/1984542435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c1a17c0 con 0x7f457c104700 2023-12-11T20:23:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.856+0000 7f4579ffb700 1 -- 172.21.15.12:0/1984542435 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f456c00f460 con 0x7f457c104700 2023-12-11T20:23:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.857+0000 7f4596a20b80 1 Processor -- start 2023-12-11T20:23:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.858+0000 7f4596a20b80 1 -- start start 2023-12-11T20:23:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.858+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 0x55abe28aab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.858+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28af640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.858+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28afb80 0x55abe28b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.858+0000 7f4596a20b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe2805af0 con 0x55abe28afb80 2023-12-11T20:23:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.858+0000 7f4596a20b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe2803410 con 0x55abe28aa770 2023-12-11T20:23:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.858+0000 7f4596a20b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe27fed00 con 0x55abe28ab0d0 2023-12-11T20:23:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4580d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4580d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60074/0 (socket says 172.21.15.12:60074) 2023-12-11T20:23:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4580d9b700 1 -- 172.21.15.12:0/1331288712 learned_addr learned my addr 172.21.15.12:0/1331288712 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4579ffb700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45640a14f0 0x7f45640a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f457bfff700 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28afb80 0x55abe28b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f458159c700 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 0x55abe28aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4579ffb700 1 -- 172.21.15.12:0/1984542435 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f456c0ce360 con 0x7f457c104700 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4580d9b700 1 -- 172.21.15.12:0/1331288712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 msgr2=0x55abe28aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4580d9b700 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 0x55abe28aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4580d9b700 1 -- 172.21.15.12:0/1331288712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28afb80 msgr2=0x55abe28b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4580d9b700 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28afb80 0x55abe28b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f4580d9b700 1 -- 172.21.15.12:0/1331288712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abe267b5d0 con 0x55abe28ab0d0 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.859+0000 7f458159c700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45640a14f0 0x7f45640a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.860+0000 7f4580d9b700 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28af640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f457000bb90 tx=0x7f457000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e61e58300c01a56 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.860+0000 7f4562ffd700 1 -- 172.21.15.12:0/1331288712 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000d8f0 con 0x55abe28ab0d0 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.860+0000 7f4562ffd700 1 -- 172.21.15.12:0/1331288712 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4570004830 con 0x55abe28ab0d0 2023-12-11T20:23:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.860+0000 7f4562ffd700 1 -- 172.21.15.12:0/1331288712 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570005320 con 0x55abe28ab0d0 2023-12-11T20:23:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 -- 172.21.15.12:0/1331288712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 msgr2=0x55abe28af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f458159c700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45640a14f0 0x7f45640a39b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f457400b1e0 tx=0x7f457400a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28af640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f457000bb90 tx=0x7f457000bea0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 -- 172.21.15.12:0/1331288712 shutdown_connections 2023-12-11T20:23:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 0x55abe28aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28afb80 0x55abe28b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1331288712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28af640 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 -- 172.21.15.12:0/1331288712 >> 172.21.15.12:0/1331288712 conn(0x55abe27d9780 msgr2=0x55abe28a6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 -- 172.21.15.12:0/1331288712 shutdown_connections 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.861+0000 7f4596a20b80 1 -- 172.21.15.12:0/1331288712 wait complete. 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.862+0000 7f4596a20b80 1 -- start start 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.862+0000 7f4596a20b80 1 Processor -- start 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28aa770 0x55abe28b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 0x55abe28bb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4596a20b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe27b8500 con 0x55abe28ab0d0 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4596a20b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe27b81a0 con 0x55abe28afb80 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4596a20b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe267d8c0 con 0x55abe28aa770 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4596a20b80 10 client.0 _ll_register_callbacks cb 0x55abe26e3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4580d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28aa770 0x55abe28b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4580d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28aa770 0x55abe28b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60086/0 (socket says 172.21.15.12:60086) 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4580d9b700 1 -- 172.21.15.12:0/1929631816 learned_addr learned my addr 172.21.15.12:0/1929631816 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f457bfff700 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f458159c700 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 0x55abe28bb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4580d9b700 1 -- 172.21.15.12:0/1929631816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 msgr2=0x55abe28bb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.863+0000 7f4580d9b700 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 0x55abe28bb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f4580d9b700 1 -- 172.21.15.12:0/1929631816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 msgr2=0x55abe28b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f4580d9b700 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f4580d9b700 1 -- 172.21.15.12:0/1929631816 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457000b7c0 con 0x55abe28aa770 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f457bfff700 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f4580d9b700 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28aa770 0x55abe28b3e80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4570005d60 tx=0x7f4570004dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed3b52bbee7fe3d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f455bfff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f455bfff700 1 -- 172.21.15.12:0/1929631816 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000dcb0 con 0x55abe28aa770 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f455bfff700 1 -- 172.21.15.12:0/1929631816 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4570005100 con 0x55abe28aa770 2023-12-11T20:23:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.864+0000 7f4596a20b80 1 -- 172.21.15.12:0/1929631816 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abe289d730 con 0x55abe28aa770 2023-12-11T20:23:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f455bfff700 1 -- 172.21.15.12:0/1929631816 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45700052c0 con 0x55abe28aa770 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f4596a20b80 10 client.27214 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f4596a20b80 1 -- 172.21.15.12:0/1929631816 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55abe2627d80 con 0x55abe28aa770 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f455bfff700 1 -- 172.21.15.12:0/1929631816 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55abe289d730 con 0x55abe28aa770 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f455bfff700 1 -- 172.21.15.12:0/1929631816 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4570022020 con 0x55abe28aa770 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f4596a20b80 10 client.27214 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f4596a20b80 10 client.27214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f4596a20b80 20 client.27214 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55abe28bfa30 0x55abe28c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f4596a20b80 4 client.27214 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.865+0000 7f4596a20b80 1 -- 172.21.15.12:0/1929631816 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abe2879ee0 con 0x55abe28bfa30 2023-12-11T20:23:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.866+0000 7f457bfff700 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55abe28bfa30 0x55abe28c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.866+0000 7f457bfff700 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55abe28bfa30 0x55abe28c1e50 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f261c75199461cd1 server_cookie=6dbb61ac1b26f885 in_seq=0 out_seq=0 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.866+0000 7f455bfff700 10 client.27214 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.867+0000 7f455bfff700 1 -- 172.21.15.12:0/1929631816 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55abe2879ee0 con 0x55abe28bfa30 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.867+0000 7f455bfff700 10 client.27214 handle_command_reply: tid=0 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.867+0000 7f4596a20b80 1 client.27214 shutdown 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 -- 172.21.15.12:0/1929631816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28aa770 msgr2=0x55abe28b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28aa770 0x55abe28b3e80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4570005d60 tx=0x7f4570004dc0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 -- 172.21.15.12:0/1929631816 shutdown_connections 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55abe28bfa30 0x55abe28c1e50 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 0x55abe28bb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28aa770 0x55abe28b3e80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f455bfff700 0 client.27214 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1929631816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 -- 172.21.15.12:0/1929631816 >> 172.21.15.12:0/1929631816 conn(0x55abe27d9780 msgr2=0x55abe28a7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 -- 172.21.15.12:0/1929631816 shutdown_connections 2023-12-11T20:23:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 1 -- 172.21.15.12:0/1929631816 wait complete. 2023-12-11T20:23:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.868+0000 7f4596a20b80 20 client.27214 trim_cache size 0 max 16384 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.889+0000 7f4596a20b80 1 Processor -- start 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.889+0000 7f4596a20b80 1 -- start start 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 0x55abe28a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28bb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28afb80 0x55abe28b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f4596a20b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe28b5020 con 0x55abe28ab0d0 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f4596a20b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe28b4b00 con 0x55abe28aa770 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f4596a20b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe28aefe0 con 0x55abe28afb80 2023-12-11T20:23:00.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f457bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28bb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f457bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28bb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48788/0 (socket says 172.21.15.12:48788) 2023-12-11T20:23:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f457bfff700 1 -- 172.21.15.12:0/1053155730 learned_addr learned my addr 172.21.15.12:0/1053155730 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f458159c700 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28afb80 0x55abe28b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f4580d9b700 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 0x55abe28a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f457bfff700 1 -- 172.21.15.12:0/1053155730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28afb80 msgr2=0x55abe28b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f457bfff700 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28afb80 0x55abe28b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f457bfff700 1 -- 172.21.15.12:0/1053155730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 msgr2=0x55abe28a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f457bfff700 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 0x55abe28a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.890+0000 7f457bfff700 1 -- 172.21.15.12:0/1053155730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abe2610c00 con 0x55abe28ab0d0 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.891+0000 7f457bfff700 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28bb370 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f456c009ce0 tx=0x7f456c06f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f393f9fd21db31e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.891+0000 7f45637fe700 1 -- 172.21.15.12:0/1053155730 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c09bd60 con 0x55abe28ab0d0 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.891+0000 7f45637fe700 1 -- 172.21.15.12:0/1053155730 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f456c09b660 con 0x55abe28ab0d0 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.891+0000 7f45637fe700 1 -- 172.21.15.12:0/1053155730 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c099a90 con 0x55abe28ab0d0 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 -- 172.21.15.12:0/1053155730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 msgr2=0x55abe28bb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28bb370 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f456c009ce0 tx=0x7f456c06f460 comp rx=0 tx=0).stop 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 -- 172.21.15.12:0/1053155730 shutdown_connections 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28aa770 0x55abe28a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28afb80 0x55abe28b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 --2- 172.21.15.12:0/1053155730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28ab0d0 0x55abe28bb370 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 -- 172.21.15.12:0/1053155730 >> 172.21.15.12:0/1053155730 conn(0x55abe27d9780 msgr2=0x55abe28af360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 -- 172.21.15.12:0/1053155730 shutdown_connections 2023-12-11T20:23:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 -- 172.21.15.12:0/1053155730 wait complete. 2023-12-11T20:23:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 -- start start 2023-12-11T20:23:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.892+0000 7f4596a20b80 1 Processor -- start 2023-12-11T20:23:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28aa770 0x55abe28b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4596a20b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 0x55abe28ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4596a20b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe28ba800 con 0x55abe28aa770 2023-12-11T20:23:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4596a20b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe28ba970 con 0x55abe28afb80 2023-12-11T20:23:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4596a20b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abe28bab30 con 0x55abe28ab0d0 2023-12-11T20:23:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4596a20b80 10 client.0 _ll_register_callbacks cb 0x55abe26e3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4580d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28aa770 0x55abe28b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f457bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4580d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28aa770 0x55abe28b8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48794/0 (socket says 172.21.15.12:48794) 2023-12-11T20:23:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f4580d9b700 1 -- 172.21.15.12:0/2479406220 learned_addr learned my addr 172.21.15.12:0/2479406220 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.893+0000 7f458159c700 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 0x55abe28ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f457bfff700 1 -- 172.21.15.12:0/2479406220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 msgr2=0x55abe28ba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f457bfff700 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 0x55abe28ba2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f457bfff700 1 -- 172.21.15.12:0/2479406220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28aa770 msgr2=0x55abe28b8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f457bfff700 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28aa770 0x55abe28b8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f457bfff700 1 -- 172.21.15.12:0/2479406220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c1a17c0 con 0x55abe28ab0d0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f4580d9b700 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28aa770 0x55abe28b8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f457bfff700 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28b9350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f456c0a3b20 tx=0x7f456c067e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e347f20483a7fe12 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f455bfff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f455bfff700 1 -- 172.21.15.12:0/2479406220 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c09f7b0 con 0x55abe28ab0d0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f455bfff700 1 -- 172.21.15.12:0/2479406220 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f456c09bd60 con 0x55abe28ab0d0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.894+0000 7f4596a20b80 1 -- 172.21.15.12:0/2479406220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4570004830 con 0x55abe28ab0d0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f455bfff700 1 -- 172.21.15.12:0/2479406220 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f456c0860b0 con 0x55abe28ab0d0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f4596a20b80 10 client.27220 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f4596a20b80 1 -- 172.21.15.12:0/2479406220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55abe264e1f0 con 0x55abe28ab0d0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f455bfff700 1 -- 172.21.15.12:0/2479406220 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4570004830 con 0x55abe28ab0d0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f455bfff700 1 -- 172.21.15.12:0/2479406220 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f456c09b9e0 con 0x55abe28ab0d0 2023-12-11T20:23:00.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f4596a20b80 10 client.27220 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f4596a20b80 10 client.27220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f4596a20b80 20 client.27220 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f4596a20b80 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55abe2916700 0x55abe2918b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f4596a20b80 4 client.27220 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:23:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.895+0000 7f4596a20b80 1 -- 172.21.15.12:0/2479406220 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55abe27c4f70 con 0x55abe2916700 2023-12-11T20:23:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.896+0000 7f4580d9b700 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55abe2916700 0x55abe2918b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.896+0000 7f4580d9b700 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55abe2916700 0x55abe2918b20 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a94c1c84e29b084b server_cookie=801e8a3d29937b98 in_seq=0 out_seq=0 2023-12-11T20:23:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.896+0000 7f455bfff700 10 client.27220 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.905+0000 7f455bfff700 1 -- 172.21.15.12:0/2479406220 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55abe27c4f70 con 0x55abe2916700 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.905+0000 7f455bfff700 10 client.27220 handle_command_reply: tid=0 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.905+0000 7f4596a20b80 1 client.27220 shutdown 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.905+0000 7f4596a20b80 1 -- 172.21.15.12:0/2479406220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 msgr2=0x55abe28b9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.905+0000 7f4596a20b80 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28b9350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f456c0a3b20 tx=0x7f456c067e20 comp rx=0 tx=0).stop 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.905+0000 7f4596a20b80 1 -- 172.21.15.12:0/2479406220 shutdown_connections 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.905+0000 7f4596a20b80 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55abe2916700 0x55abe2918b20 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.906+0000 7f4596a20b80 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55abe28afb80 0x55abe28ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.906+0000 7f4596a20b80 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55abe28aa770 0x55abe28b8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.906+0000 7f4596a20b80 1 --2- 172.21.15.12:0/2479406220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55abe28ab0d0 0x55abe28b9350 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.906+0000 7f455bfff700 0 client.27220 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.906+0000 7f4596a20b80 1 -- 172.21.15.12:0/2479406220 >> 172.21.15.12:0/2479406220 conn(0x55abe27d9780 msgr2=0x55abe28abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.906+0000 7f4596a20b80 1 -- 172.21.15.12:0/2479406220 shutdown_connections 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.906+0000 7f4596a20b80 1 -- 172.21.15.12:0/2479406220 wait complete. 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.906+0000 7f4596a20b80 20 client.27220 trim_cache size 0 max 16384 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:23:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:23:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:23:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 -- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45640a14f0 msgr2=0x7f45640a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45640a14f0 0x7f45640a39b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f457400b1e0 tx=0x7f457400a040 comp rx=0 tx=0).stop 2023-12-11T20:23:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 -- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 msgr2=0x7f457c0ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 0x7f457c0ffd80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f456c0098e0 tx=0x7f456c005f10 comp rx=0 tx=0).stop 2023-12-11T20:23:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 -- 172.21.15.12:0/1984542435 shutdown_connections 2023-12-11T20:23:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45640a14f0 0x7f45640a39b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c107030 0x7f457c1002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f457c101dd0 0x7f457c1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 --2- 172.21.15.12:0/1984542435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f457c104700 0x7f457c0ffd80 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 -- 172.21.15.12:0/1984542435 >> 172.21.15.12:0/1984542435 conn(0x7f457c0fb780 msgr2=0x7f457c102730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 -- 172.21.15.12:0/1984542435 shutdown_connections 2023-12-11T20:23:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:00.907+0000 7f4581d9d700 1 -- 172.21.15.12:0/1984542435 wait complete. 2023-12-11T20:23:01.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:01 smithi032 ceph-mon[132488]: pgmap v588: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:23:01.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:01 smithi039 ceph-mon[102205]: pgmap v588: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:23:01.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:01 smithi012 ceph-mon[128787]: pgmap v588: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:23:03.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:03 smithi039 ceph-mon[102205]: pgmap v589: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:23:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:03 smithi012 ceph-mon[128787]: pgmap v589: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:23:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:03 smithi032 ceph-mon[132488]: pgmap v589: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:23:05.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:05 smithi039 ceph-mon[102205]: pgmap v590: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:05.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:05 smithi012 ceph-mon[128787]: pgmap v590: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:05 smithi032 ceph-mon[132488]: pgmap v590: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:07 smithi039 ceph-mon[102205]: pgmap v591: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:07 smithi012 ceph-mon[128787]: pgmap v591: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:07.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:07 smithi032 ceph-mon[132488]: pgmap v591: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:09 smithi032 ceph-mon[132488]: pgmap v592: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 MiB/s wr, 35 op/s 2023-12-11T20:23:09.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:09 smithi039 ceph-mon[102205]: pgmap v592: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 MiB/s wr, 35 op/s 2023-12-11T20:23:09.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:09 smithi012 ceph-mon[128787]: pgmap v592: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 MiB/s wr, 35 op/s 2023-12-11T20:23:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:11 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:23:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:11 smithi039 ceph-mon[102205]: pgmap v593: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:23:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:11 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:23:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:11 smithi012 ceph-mon[128787]: pgmap v593: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:23:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:11 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:23:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:11 smithi032 ceph-mon[132488]: pgmap v593: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:23:12.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:12 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:23:12.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:12 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:23:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:12 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:23:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:12 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:23:12.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:12 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:23:12.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:12 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:23:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:13 smithi039 ceph-mon[102205]: pgmap v594: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:23:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:13 smithi012 ceph-mon[128787]: pgmap v594: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:23:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:13 smithi032 ceph-mon[132488]: pgmap v594: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:23:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 -- 172.21.15.12:0/3500121194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 msgr2=0x7fc07c10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 --2- 172.21.15.12:0/3500121194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 0x7fc07c10b960 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc07400b0d0 tx=0x7fc07400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 -- 172.21.15.12:0/3500121194 shutdown_connections 2023-12-11T20:23:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 --2- 172.21.15.12:0/3500121194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 0x7fc07c10b960 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 --2- 172.21.15.12:0/3500121194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc07c103520 0x7fc07c103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 --2- 172.21.15.12:0/3500121194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc07c104710 0x7fc07c104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 -- 172.21.15.12:0/3500121194 >> 172.21.15.12:0/3500121194 conn(0x7fc07c0fead0 msgr2=0x7fc07c100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 -- 172.21.15.12:0/3500121194 shutdown_connections 2023-12-11T20:23:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.076+0000 7fc07b59e700 1 -- 172.21.15.12:0/3500121194 wait complete. 2023-12-11T20:23:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.077+0000 7fc07b59e700 1 Processor -- start 2023-12-11T20:23:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.077+0000 7fc07b59e700 1 -- start start 2023-12-11T20:23:14.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07b59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc07c103520 0x7fc07c199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc07c104710 0x7fc07c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 0x7fc07c1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c1a0f80 con 0x7fc07c1050b0 2023-12-11T20:23:14.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07b59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c1a10c0 con 0x7fc07c104710 2023-12-11T20:23:14.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07b59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c1a1250 con 0x7fc07c103520 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 0x7fc07c1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc079d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc07c104710 0x7fc07c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 0x7fc07c1a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33248/0 (socket says 172.21.15.12:33248) 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07ad9d700 1 -- 172.21.15.12:0/1007581780 learned_addr learned my addr 172.21.15.12:0/1007581780 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.078+0000 7fc07a59c700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc07c103520 0x7fc07c199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc079d9b700 1 -- 172.21.15.12:0/1007581780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc07c103520 msgr2=0x7fc07c199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc079d9b700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc07c103520 0x7fc07c199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc079d9b700 1 -- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 msgr2=0x7fc07c1a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc079d9b700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 0x7fc07c1a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc079d9b700 1 -- 172.21.15.12:0/1007581780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074009d00 con 0x7fc07c104710 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 0x7fc07c1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc079d9b700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc07c104710 0x7fc07c199990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc07000e9f0 tx=0x7fc07000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc06b7fe700 1 -- 172.21.15.12:0/1007581780 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000c9c0 con 0x7fc07c104710 2023-12-11T20:23:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc06b7fe700 1 -- 172.21.15.12:0/1007581780 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc070010430 con 0x7fc07c104710 2023-12-11T20:23:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc07b59e700 1 -- 172.21.15.12:0/1007581780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c1a1530 con 0x7fc07c104710 2023-12-11T20:23:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc06b7fe700 1 -- 172.21.15.12:0/1007581780 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070018680 con 0x7fc07c104710 2023-12-11T20:23:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.079+0000 7fc07b59e700 1 -- 172.21.15.12:0/1007581780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c1a1a40 con 0x7fc07c104710 2023-12-11T20:23:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.083+0000 7fc06b7fe700 1 -- 172.21.15.12:0/1007581780 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc0700105a0 con 0x7fc07c104710 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.084+0000 7fc06b7fe700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0640a1470 0x7fc0640a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.084+0000 7fc0944b3b80 1 Processor -- start 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.084+0000 7fc06b7fe700 1 -- 172.21.15.12:0/1007581780 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc070014070 con 0x7fc07c104710 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc0944b3b80 1 -- start start 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc07a59c700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0640a1470 0x7fc0640a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e31b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e36640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e38f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327d8caf0 con 0x55d327e31770 2023-12-11T20:23:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327d8a410 con 0x55d327e36b80 2023-12-11T20:23:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327d85d00 con 0x55d327e320d0 2023-12-11T20:23:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc07a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e31b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc07a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e31b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33258/0 (socket says 172.21.15.12:33258) 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc07ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e38f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.085+0000 7fc07a59c700 1 -- 172.21.15.12:0/848263544 learned_addr learned my addr 172.21.15.12:0/848263544 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc079d9b700 1 --2- 172.21.15.12:0/848263544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e36640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc07ad9d700 1 -- 172.21.15.12:0/848263544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 msgr2=0x55d327e36640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/848263544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e36640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc07ad9d700 1 -- 172.21.15.12:0/848263544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 msgr2=0x55d327e31b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/848263544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e31b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc07ad9d700 1 -- 172.21.15.12:0/848263544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d327c025d0 con 0x55d327e36b80 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc07a59c700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0640a1470 0x7fc0640a3930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc06c013650 tx=0x7fc06c013a10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/848263544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e38f90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc074009fd0 tx=0x7fc074006210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed0581cdd507b4cf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.086+0000 7fc068ff9700 1 -- 172.21.15.12:0/848263544 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07400e040 con 0x55d327e36b80 2023-12-11T20:23:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc068ff9700 1 -- 172.21.15.12:0/848263544 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0740074e0 con 0x55d327e36b80 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc068ff9700 1 -- 172.21.15.12:0/848263544 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07401c440 con 0x55d327e36b80 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 -- 172.21.15.12:0/848263544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 msgr2=0x55d327e38f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/848263544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e38f90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc074009fd0 tx=0x7fc074006210 comp rx=0 tx=0).stop 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 -- 172.21.15.12:0/848263544 shutdown_connections 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/848263544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e38f90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/848263544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e31b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/848263544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e36640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 -- 172.21.15.12:0/848263544 >> 172.21.15.12:0/848263544 conn(0x55d327d60780 msgr2=0x55d327e2db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 -- 172.21.15.12:0/848263544 shutdown_connections 2023-12-11T20:23:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.087+0000 7fc0944b3b80 1 -- 172.21.15.12:0/848263544 wait complete. 2023-12-11T20:23:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.088+0000 7fc0944b3b80 1 -- start start 2023-12-11T20:23:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.088+0000 7fc0944b3b80 1 Processor -- start 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e3aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e3b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e423c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327d3f500 con 0x55d327e31770 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327d3f1a0 con 0x55d327e36b80 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327c048c0 con 0x55d327e320d0 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc0944b3b80 10 client.0 _ll_register_callbacks cb 0x55d327c6aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e3aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e3aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33272/0 (socket says 172.21.15.12:33272) 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07a59c700 1 -- 172.21.15.12:0/4013220842 learned_addr learned my addr 172.21.15.12:0/4013220842 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc079d9b700 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e3b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07a59c700 1 -- 172.21.15.12:0/4013220842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 msgr2=0x55d327e3b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07a59c700 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e3b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07a59c700 1 -- 172.21.15.12:0/4013220842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 msgr2=0x55d327e423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07a59c700 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.089+0000 7fc07a59c700 1 -- 172.21.15.12:0/4013220842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c10c2b0 con 0x55d327e31770 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.090+0000 7fc079d9b700 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e3b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.090+0000 7fc07a59c700 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e3aee0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc06c020bd0 tx=0x7fc06c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585a6ca74fbe8025 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.090+0000 7fc061ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.090+0000 7fc061ffb700 1 -- 172.21.15.12:0/4013220842 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c018040 con 0x55d327e31770 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.090+0000 7fc061ffb700 1 -- 172.21.15.12:0/4013220842 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc06c00f850 con 0x55d327e31770 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.090+0000 7fc0944b3b80 1 -- 172.21.15.12:0/4013220842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d327e24730 con 0x55d327e31770 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.090+0000 7fc061ffb700 1 -- 172.21.15.12:0/4013220842 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc06c0122e0 con 0x55d327e31770 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.090+0000 7fc0944b3b80 10 client.17571 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc0944b3b80 1 -- 172.21.15.12:0/4013220842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d327baed80 con 0x55d327e31770 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc061ffb700 1 -- 172.21.15.12:0/4013220842 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d327e24730 con 0x55d327e31770 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc061ffb700 1 -- 172.21.15.12:0/4013220842 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc06c026070 con 0x55d327e31770 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc0944b3b80 10 client.17571 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc0944b3b80 10 client.17571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc0944b3b80 20 client.17571 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d327e46c80 0x55d327e490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc0944b3b80 4 client.17571 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.091+0000 7fc0944b3b80 1 -- 172.21.15.12:0/4013220842 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d327e00ee0 con 0x55d327e46c80 2023-12-11T20:23:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.092+0000 7fc079d9b700 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d327e46c80 0x55d327e490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.092+0000 7fc079d9b700 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d327e46c80 0x55d327e490a0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e213b3756ea3dc1 server_cookie=c3b0c70306f36916 in_seq=0 out_seq=0 2023-12-11T20:23:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.092+0000 7fc061ffb700 10 client.17571 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc061ffb700 1 -- 172.21.15.12:0/4013220842 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d327e00ee0 con 0x55d327e46c80 2023-12-11T20:23:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc061ffb700 10 client.17571 handle_command_reply: tid=0 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 client.17571 shutdown 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 -- 172.21.15.12:0/4013220842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 msgr2=0x55d327e3aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e3aee0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc06c020bd0 tx=0x7fc06c0047c0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 -- 172.21.15.12:0/4013220842 shutdown_connections 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d327e46c80 0x55d327e490a0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e36b80 0x55d327e423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e31770 0x55d327e3aee0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc061ffb700 0 client.17571 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/4013220842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e320d0 0x55d327e3b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 -- 172.21.15.12:0/4013220842 >> 172.21.15.12:0/4013220842 conn(0x55d327d60780 msgr2=0x55d327e2e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 -- 172.21.15.12:0/4013220842 shutdown_connections 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.093+0000 7fc0944b3b80 1 -- 172.21.15.12:0/4013220842 wait complete. 2023-12-11T20:23:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.094+0000 7fc0944b3b80 20 client.17571 trim_cache size 0 max 16384 2023-12-11T20:23:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.113+0000 7fc0944b3b80 1 Processor -- start 2023-12-11T20:23:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.113+0000 7fc0944b3b80 1 -- start start 2023-12-11T20:23:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.113+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e31770 0x55d327e324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.113+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e320d0 0x55d327e42380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e36b80 0x55d327e38f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327e2d210 con 0x55d327e320d0 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327e3bb60 con 0x55d327e31770 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327e36070 con 0x55d327e36b80 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc079d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e320d0 0x55d327e42380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc079d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e320d0 0x55d327e42380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33284/0 (socket says 172.21.15.12:33284) 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc079d9b700 1 -- 172.21.15.12:0/2726332247 learned_addr learned my addr 172.21.15.12:0/2726332247 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc07a59c700 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e31770 0x55d327e324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e36b80 0x55d327e38f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc079d9b700 1 -- 172.21.15.12:0/2726332247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e36b80 msgr2=0x55d327e38f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc079d9b700 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e36b80 0x55d327e38f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc079d9b700 1 -- 172.21.15.12:0/2726332247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e31770 msgr2=0x55d327e324b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc079d9b700 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e31770 0x55d327e324b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.114+0000 7fc079d9b700 1 -- 172.21.15.12:0/2726332247 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d327b97c00 con 0x55d327e320d0 2023-12-11T20:23:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.115+0000 7fc079d9b700 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e320d0 0x55d327e42380 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc070099e40 tx=0x7fc070096480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ded40920eda7a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.115+0000 7fc0697fa700 1 -- 172.21.15.12:0/2726332247 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07009a140 con 0x55d327e320d0 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.115+0000 7fc0697fa700 1 -- 172.21.15.12:0/2726332247 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc07009e290 con 0x55d327e320d0 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.115+0000 7fc0697fa700 1 -- 172.21.15.12:0/2726332247 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070099890 con 0x55d327e320d0 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 -- 172.21.15.12:0/2726332247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e320d0 msgr2=0x55d327e42380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e320d0 0x55d327e42380 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc070099e40 tx=0x7fc070096480 comp rx=0 tx=0).stop 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 -- 172.21.15.12:0/2726332247 shutdown_connections 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e31770 0x55d327e324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e36b80 0x55d327e38f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/2726332247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e320d0 0x55d327e42380 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 -- 172.21.15.12:0/2726332247 >> 172.21.15.12:0/2726332247 conn(0x55d327d60780 msgr2=0x55d327e363f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 -- 172.21.15.12:0/2726332247 shutdown_connections 2023-12-11T20:23:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 -- 172.21.15.12:0/2726332247 wait complete. 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 -- start start 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.116+0000 7fc0944b3b80 1 Processor -- start 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e31770 0x55d327e3fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e320d0 0x55d327e40160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc0944b3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e36b80 0x55d327e410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327e41620 con 0x55d327e36b80 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327e41790 con 0x55d327e320d0 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc0944b3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d327e41950 con 0x55d327e31770 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc0944b3b80 10 client.0 _ll_register_callbacks cb 0x55d327c6aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc07ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e36b80 0x55d327e410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc07a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e31770 0x55d327e3fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc07a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e31770 0x55d327e3fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48696/0 (socket says 172.21.15.12:48696) 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc07a59c700 1 -- 172.21.15.12:0/1322649481 learned_addr learned my addr 172.21.15.12:0/1322649481 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.117+0000 7fc079d9b700 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e320d0 0x55d327e40160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc07ad9d700 1 -- 172.21.15.12:0/1322649481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e31770 msgr2=0x55d327e3fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e31770 0x55d327e3fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc07ad9d700 1 -- 172.21.15.12:0/1322649481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e320d0 msgr2=0x55d327e40160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e320d0 0x55d327e40160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc07ad9d700 1 -- 172.21.15.12:0/1322649481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c1a1a40 con 0x55d327e36b80 2023-12-11T20:23:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc07a59c700 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e31770 0x55d327e3fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc07ad9d700 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e36b80 0x55d327e410e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc07400b420 tx=0x7fc074007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d5d54823f585ad server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc061ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.118+0000 7fc061ffb700 1 -- 172.21.15.12:0/1322649481 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07400e040 con 0x55d327e36b80 2023-12-11T20:23:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 1 -- 172.21.15.12:0/1322649481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc0740074e0 con 0x55d327e36b80 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc061ffb700 1 -- 172.21.15.12:0/1322649481 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc0740050b0 con 0x55d327e36b80 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc061ffb700 1 -- 172.21.15.12:0/1322649481 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc074005290 con 0x55d327e36b80 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 10 client.17577 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 1 -- 172.21.15.12:0/1322649481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d327bd51f0 con 0x55d327e36b80 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc061ffb700 1 -- 172.21.15.12:0/1322649481 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0740074e0 con 0x55d327e36b80 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc061ffb700 1 -- 172.21.15.12:0/1322649481 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc074019070 con 0x55d327e36b80 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 10 client.17577 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 10 client.17577 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 20 client.17577 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d327e9d840 0x55d327e9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 4 client.17577 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.119+0000 7fc0944b3b80 1 -- 172.21.15.12:0/1322649481 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d327d4bf70 con 0x55d327e9d840 2023-12-11T20:23:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.120+0000 7fc07a59c700 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d327e9d840 0x55d327e9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.120+0000 7fc07a59c700 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d327e9d840 0x55d327e9fc60 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f15f82e3a59ea7b server_cookie=1277a0c88ddeff3 in_seq=0 out_seq=0 2023-12-11T20:23:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.120+0000 7fc061ffb700 10 client.17577 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.130+0000 7fc061ffb700 1 -- 172.21.15.12:0/1322649481 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d327d4bf70 con 0x55d327e9d840 2023-12-11T20:23:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.130+0000 7fc061ffb700 10 client.17577 handle_command_reply: tid=0 2023-12-11T20:23:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.130+0000 7fc0944b3b80 1 client.17577 shutdown 2023-12-11T20:23:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 -- 172.21.15.12:0/1322649481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e36b80 msgr2=0x55d327e410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e36b80 0x55d327e410e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc07400b420 tx=0x7fc074007860 comp rx=0 tx=0).stop 2023-12-11T20:23:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 -- 172.21.15.12:0/1322649481 shutdown_connections 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d327e9d840 0x55d327e9fc60 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d327e36b80 0x55d327e410e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d327e31770 0x55d327e3fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 --2- 172.21.15.12:0/1322649481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d327e320d0 0x55d327e40160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 -- 172.21.15.12:0/1322649481 >> 172.21.15.12:0/1322649481 conn(0x55d327d60780 msgr2=0x55d327e36320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc061ffb700 0 client.17577 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 -- 172.21.15.12:0/1322649481 shutdown_connections 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 1 -- 172.21.15.12:0/1322649481 wait complete. 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.131+0000 7fc0944b3b80 20 client.17577 trim_cache size 0 max 16384 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:23:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:23:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:23:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:23:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 -- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0640a1470 msgr2=0x7fc0640a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0640a1470 0x7fc0640a3930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc06c013650 tx=0x7fc06c013a10 comp rx=0 tx=0).stop 2023-12-11T20:23:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 -- 172.21.15.12:0/1007581780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc07c104710 msgr2=0x7fc07c199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc07c104710 0x7fc07c199990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc07000e9f0 tx=0x7fc07000ed00 comp rx=0 tx=0).stop 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 -- 172.21.15.12:0/1007581780 shutdown_connections 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0640a1470 0x7fc0640a3930 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc07c1050b0 0x7fc07c1a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc07c103520 0x7fc07c199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 --2- 172.21.15.12:0/1007581780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc07c104710 0x7fc07c199990 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 -- 172.21.15.12:0/1007581780 >> 172.21.15.12:0/1007581780 conn(0x7fc07c0fead0 msgr2=0x7fc07c107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 -- 172.21.15.12:0/1007581780 shutdown_connections 2023-12-11T20:23:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:14.132+0000 7fc07b59e700 1 -- 172.21.15.12:0/1007581780 wait complete. 2023-12-11T20:23:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:15 smithi039 ceph-mon[102205]: pgmap v595: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:23:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:15 smithi012 ceph-mon[128787]: pgmap v595: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:23:15.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:15 smithi032 ceph-mon[132488]: pgmap v595: 97 pgs: 97 active+clean; 5.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:23:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:16 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:23:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:16 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:23:16.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:16 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi032 to 223.0M 2023-12-11T20:23:17.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi039 to 221.9M 2023-12-11T20:23:17.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: Unable to set osd_memory_target on smithi032 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:23:17.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: Unable to set osd_memory_target on smithi039 to 232772915: error parsing value: Value '232772915' is below minimum 939524096 2023-12-11T20:23:17.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:23:17.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:23:17.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:23:17.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:17 smithi039 ceph-mon[102205]: pgmap v596: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:23:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi032 to 223.0M 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi039 to 221.9M 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: Unable to set osd_memory_target on smithi032 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: Unable to set osd_memory_target on smithi039 to 232772915: error parsing value: Value '232772915' is below minimum 939524096 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:23:17.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:17 smithi012 ceph-mon[128787]: pgmap v596: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:23:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:23:17.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi032 to 223.0M 2023-12-11T20:23:17.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi039 to 221.9M 2023-12-11T20:23:17.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: Unable to set osd_memory_target on smithi032 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:23:17.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: Unable to set osd_memory_target on smithi039 to 232772915: error parsing value: Value '232772915' is below minimum 939524096 2023-12-11T20:23:17.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:23:17.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:23:17.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:23:17.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:17 smithi032 ceph-mon[132488]: pgmap v596: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:23:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:19 smithi032 ceph-mon[132488]: pgmap v597: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:19.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:19 smithi039 ceph-mon[102205]: pgmap v597: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:19 smithi012 ceph-mon[128787]: pgmap v597: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:21.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:21 smithi039 ceph-mon[102205]: pgmap v598: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:23:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:21 smithi012 ceph-mon[128787]: pgmap v598: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:23:21.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:21 smithi032 ceph-mon[132488]: pgmap v598: 97 pgs: 97 active+clean; 5.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:23:23.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:23 smithi039 ceph-mon[102205]: pgmap v599: 97 pgs: 97 active+clean; 5.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:23:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:23 smithi012 ceph-mon[128787]: pgmap v599: 97 pgs: 97 active+clean; 5.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:23:23.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:23 smithi032 ceph-mon[132488]: pgmap v599: 97 pgs: 97 active+clean; 5.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:23:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:25 smithi039 ceph-mon[102205]: pgmap v600: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:23:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:25 smithi012 ceph-mon[128787]: pgmap v600: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:23:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:25 smithi032 ceph-mon[132488]: pgmap v600: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.314+0000 7fc5b89fe700 1 -- 172.21.15.12:0/1374478312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b41046a0 msgr2=0x7fc5b4106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.314+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/1374478312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b41046a0 0x7fc5b4106a90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009990 tx=0x7fc5a8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.315+0000 7fc5b89fe700 1 -- 172.21.15.12:0/1374478312 shutdown_connections 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.315+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/1374478312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b4106fd0 0x7fc5b4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.315+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/1374478312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b4101d70 0x7fc5b4104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.315+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/1374478312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b41046a0 0x7fc5b4106a90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.315+0000 7fc5b89fe700 1 -- 172.21.15.12:0/1374478312 >> 172.21.15.12:0/1374478312 conn(0x7fc5b40fb780 msgr2=0x7fc5b40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.315+0000 7fc5b89fe700 1 -- 172.21.15.12:0/1374478312 shutdown_connections 2023-12-11T20:23:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.315+0000 7fc5b89fe700 1 -- 172.21.15.12:0/1374478312 wait complete. 2023-12-11T20:23:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.316+0000 7fc5b89fe700 1 Processor -- start 2023-12-11T20:23:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.316+0000 7fc5b89fe700 1 -- start start 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.317+0000 7fc5b89fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b4101d70 0x7fc5b41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.317+0000 7fc5b89fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b41046a0 0x7fc5b4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.317+0000 7fc5b89fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b4106fd0 0x7fc5b41a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.317+0000 7fc5b89fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41a0ef0 con 0x7fc5b4101d70 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.317+0000 7fc5b89fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41a1030 con 0x7fc5b41046a0 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.317+0000 7fc5b89fe700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41a11c0 con 0x7fc5b4106fd0 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.317+0000 7fc5b2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b4101d70 0x7fc5b41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b4101d70 0x7fc5b41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35710/0 (socket says 172.21.15.12:35710) 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b2d9d700 1 -- 172.21.15.12:0/2946941271 learned_addr learned my addr 172.21.15.12:0/2946941271 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b259c700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b41046a0 0x7fc5b4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b359e700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b4106fd0 0x7fc5b41a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b2d9d700 1 -- 172.21.15.12:0/2946941271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b4106fd0 msgr2=0x7fc5b41a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b4106fd0 0x7fc5b41a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b2d9d700 1 -- 172.21.15.12:0/2946941271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b41046a0 msgr2=0x7fc5b4199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b41046a0 0x7fc5b4199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b2d9d700 1 -- 172.21.15.12:0/2946941271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80095f0 con 0x7fc5b4101d70 2023-12-11T20:23:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.318+0000 7fc5b259c700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b41046a0 0x7fc5b4199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.319+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b4101d70 0x7fc5b41993c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400e9a0 tx=0x7fc5a400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.319+0000 7fc59bfff700 1 -- 172.21.15.12:0/2946941271 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4009790 con 0x7fc5b4101d70 2023-12-11T20:23:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.319+0000 7fc59bfff700 1 -- 172.21.15.12:0/2946941271 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5a400cbd0 con 0x7fc5b4101d70 2023-12-11T20:23:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.319+0000 7fc5b89fe700 1 -- 172.21.15.12:0/2946941271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b41a14a0 con 0x7fc5b4101d70 2023-12-11T20:23:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.319+0000 7fc59bfff700 1 -- 172.21.15.12:0/2946941271 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4018680 con 0x7fc5b4101d70 2023-12-11T20:23:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.319+0000 7fc5b89fe700 1 -- 172.21.15.12:0/2946941271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b41a19b0 con 0x7fc5b4101d70 2023-12-11T20:23:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.323+0000 7fc59bfff700 1 -- 172.21.15.12:0/2946941271 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc5a40187e0 con 0x7fc5b4101d70 2023-12-11T20:23:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.324+0000 7fc59bfff700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc59c0a1470 0x7fc59c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.324+0000 7fc59bfff700 1 -- 172.21.15.12:0/2946941271 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc5a4014070 con 0x7fc5b4101d70 2023-12-11T20:23:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.324+0000 7fc5b259c700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc59c0a1470 0x7fc59c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.325+0000 7fc5b259c700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc59c0a1470 0x7fc59c0a3930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8006010 tx=0x7fc5a800b630 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.325+0000 7fc5ccad9b80 1 Processor -- start 2023-12-11T20:23:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.326+0000 7fc5ccad9b80 1 -- start start 2023-12-11T20:23:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.326+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 0x555c8a125b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.326+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 0x555c8a12a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.326+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a12cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.326+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a080af0 con 0x555c8a12ab80 2023-12-11T20:23:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.326+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a07e410 con 0x555c8a125770 2023-12-11T20:23:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.326+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a079d00 con 0x555c8a1260d0 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a12cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 0x555c8a12a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 0x555c8a125b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a12cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35724/0 (socket says 172.21.15.12:35724) 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 -- 172.21.15.12:0/1579236242 learned_addr learned my addr 172.21.15.12:0/1579236242 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 -- 172.21.15.12:0/1579236242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 msgr2=0x555c8a12a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 --2- 172.21.15.12:0/1579236242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 0x555c8a12a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 -- 172.21.15.12:0/1579236242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 msgr2=0x555c8a125b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 --2- 172.21.15.12:0/1579236242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 0x555c8a125b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 -- 172.21.15.12:0/1579236242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c89ef65d0 con 0x555c8a12ab80 2023-12-11T20:23:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.327+0000 7fc5b359e700 1 --2- 172.21.15.12:0/1579236242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a12cf90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009440 tx=0x7fc5ac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109532df2429241f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:27.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.328+0000 7fc5997fa700 1 -- 172.21.15.12:0/1579236242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00e070 con 0x555c8a12ab80 2023-12-11T20:23:27.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.328+0000 7fc5997fa700 1 -- 172.21.15.12:0/1579236242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5ac00f040 con 0x555c8a12ab80 2023-12-11T20:23:27.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.328+0000 7fc5997fa700 1 -- 172.21.15.12:0/1579236242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac015a80 con 0x555c8a12ab80 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1579236242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 msgr2=0x555c8a12cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1579236242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a12cf90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009440 tx=0x7fc5ac009920 comp rx=0 tx=0).stop 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1579236242 shutdown_connections 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1579236242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 0x555c8a125b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1579236242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a12cf90 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1579236242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 0x555c8a12a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1579236242 >> 172.21.15.12:0/1579236242 conn(0x555c8a054780 msgr2=0x555c8a121b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1579236242 shutdown_connections 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.329+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1579236242 wait complete. 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.330+0000 7fc5ccad9b80 1 -- start start 2023-12-11T20:23:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.330+0000 7fc5ccad9b80 1 Processor -- start 2023-12-11T20:23:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.330+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a125770 0x555c8a12eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.330+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 0x555c8a12f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.330+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a12ab80 0x555c8a136420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.330+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a033500 con 0x555c8a125770 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.330+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a0331a0 con 0x555c8a12ab80 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.330+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c89ef88c0 con 0x555c8a1260d0 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5ccad9b80 10 client.0 _ll_register_callbacks cb 0x555c89f5ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a12ab80 0x555c8a136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a125770 0x555c8a12eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a12ab80 0x555c8a136420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60692/0 (socket says 172.21.15.12:60692) 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b359e700 1 -- 172.21.15.12:0/2034252893 learned_addr learned my addr 172.21.15.12:0/2034252893 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b259c700 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 0x555c8a12f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b359e700 1 -- 172.21.15.12:0/2034252893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 msgr2=0x555c8a12f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b359e700 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 0x555c8a12f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b359e700 1 -- 172.21.15.12:0/2034252893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a125770 msgr2=0x555c8a12eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b359e700 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a125770 0x555c8a12eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b359e700 1 -- 172.21.15.12:0/2034252893 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac0090f0 con 0x555c8a12ab80 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.331+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a125770 0x555c8a12eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.332+0000 7fc5b359e700 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a12ab80 0x555c8a136420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00b010 tx=0x7fc5ac0169c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd9c0384450e644 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.332+0000 7fc596ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.332+0000 7fc596ff5700 1 -- 172.21.15.12:0/2034252893 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00e040 con 0x555c8a12ab80 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.332+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/2034252893 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c8a118730 con 0x555c8a12ab80 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.332+0000 7fc596ff5700 1 -- 172.21.15.12:0/2034252893 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc5ac0095e0 con 0x555c8a12ab80 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.332+0000 7fc596ff5700 1 -- 172.21.15.12:0/2034252893 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5ac016e70 con 0x555c8a12ab80 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.332+0000 7fc5ccad9b80 10 client.27260 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.332+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/2034252893 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555c89ea2d80 con 0x555c8a12ab80 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.333+0000 7fc596ff5700 1 -- 172.21.15.12:0/2034252893 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555c8a118730 con 0x555c8a12ab80 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.333+0000 7fc596ff5700 1 -- 172.21.15.12:0/2034252893 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc5ac01c050 con 0x555c8a12ab80 2023-12-11T20:23:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.333+0000 7fc5ccad9b80 10 client.27260 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.333+0000 7fc5ccad9b80 10 client.27260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.333+0000 7fc5ccad9b80 20 client.27260 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.333+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555c8a13ab60 0x555c8a13cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.333+0000 7fc5ccad9b80 4 client.27260 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.333+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/2034252893 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c8a0f4ee0 con 0x555c8a13ab60 2023-12-11T20:23:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.334+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555c8a13ab60 0x555c8a13cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.334+0000 7fc596ff5700 10 client.27260 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.334+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555c8a13ab60 0x555c8a13cf80 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5fc006b0f12ae62 server_cookie=a0a174890d507c8f in_seq=0 out_seq=0 2023-12-11T20:23:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.335+0000 7fc596ff5700 1 -- 172.21.15.12:0/2034252893 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555c8a0f4ee0 con 0x555c8a13ab60 2023-12-11T20:23:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.335+0000 7fc596ff5700 10 client.27260 handle_command_reply: tid=0 2023-12-11T20:23:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.335+0000 7fc5ccad9b80 1 client.27260 shutdown 2023-12-11T20:23:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.335+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/2034252893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a12ab80 msgr2=0x555c8a136420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.335+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a12ab80 0x555c8a136420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00b010 tx=0x7fc5ac0169c0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/2034252893 shutdown_connections 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555c8a13ab60 0x555c8a13cf80 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a12ab80 0x555c8a136420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a125770 0x555c8a12eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc596ff5700 0 client.27260 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/2034252893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a1260d0 0x555c8a12f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/2034252893 >> 172.21.15.12:0/2034252893 conn(0x555c8a054780 msgr2=0x555c8a122560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/2034252893 shutdown_connections 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/2034252893 wait complete. 2023-12-11T20:23:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.336+0000 7fc5ccad9b80 20 client.27260 trim_cache size 0 max 16384 2023-12-11T20:23:27.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.359+0000 7fc5ccad9b80 1 Processor -- start 2023-12-11T20:23:27.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.359+0000 7fc5ccad9b80 1 -- start start 2023-12-11T20:23:27.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 0x555c8a13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a1260d0 0x555c8a1264d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a12ab80 0x555c8a1363e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a11c850 con 0x555c8a1260d0 2023-12-11T20:23:27.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a12a030 con 0x555c8a125770 2023-12-11T20:23:27.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a12fb00 con 0x555c8a12ab80 2023-12-11T20:23:27.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a1260d0 0x555c8a1264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a1260d0 0x555c8a1264d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35744/0 (socket says 172.21.15.12:35744) 2023-12-11T20:23:27.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b259c700 1 -- 172.21.15.12:0/279672828 learned_addr learned my addr 172.21.15.12:0/279672828 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b359e700 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a12ab80 0x555c8a1363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 0x555c8a13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b259c700 1 -- 172.21.15.12:0/279672828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a12ab80 msgr2=0x555c8a1363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b259c700 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a12ab80 0x555c8a1363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b259c700 1 -- 172.21.15.12:0/279672828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 msgr2=0x555c8a13cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.360+0000 7fc5b259c700 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 0x555c8a13cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.361+0000 7fc5b259c700 1 -- 172.21.15.12:0/279672828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c89e8bc00 con 0x555c8a1260d0 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.361+0000 7fc5b259c700 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a1260d0 0x555c8a1264d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009990 tx=0x7fc5a801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ee958c557eded6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.361+0000 7fc599ffb700 1 -- 172.21.15.12:0/279672828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a802b040 con 0x555c8a1260d0 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.361+0000 7fc599ffb700 1 -- 172.21.15.12:0/279672828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5a802c040 con 0x555c8a1260d0 2023-12-11T20:23:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.361+0000 7fc599ffb700 1 -- 172.21.15.12:0/279672828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a800fa20 con 0x555c8a1260d0 2023-12-11T20:23:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/279672828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a1260d0 msgr2=0x555c8a1264d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a1260d0 0x555c8a1264d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009990 tx=0x7fc5a801f000 comp rx=0 tx=0).stop 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/279672828 shutdown_connections 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a125770 0x555c8a13cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a12ab80 0x555c8a1363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/279672828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a1260d0 0x555c8a1264d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/279672828 >> 172.21.15.12:0/279672828 conn(0x555c8a054780 msgr2=0x555c8a120590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/279672828 shutdown_connections 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/279672828 wait complete. 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.362+0000 7fc5ccad9b80 1 -- start start 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5ccad9b80 1 Processor -- start 2023-12-11T20:23:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a125770 0x555c8a1340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a1260d0 0x555c8a134610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5ccad9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a135620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a135b60 con 0x555c8a12ab80 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a135cd0 con 0x555c8a1260d0 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5ccad9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c8a135e90 con 0x555c8a125770 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5ccad9b80 10 client.0 _ll_register_callbacks cb 0x555c89f5ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.363+0000 7fc5b359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a135620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a135620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35750/0 (socket says 172.21.15.12:35750) 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b359e700 1 -- 172.21.15.12:0/1715679384 learned_addr learned my addr 172.21.15.12:0/1715679384 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b259c700 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a1260d0 0x555c8a134610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a125770 0x555c8a1340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b359e700 1 -- 172.21.15.12:0/1715679384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a125770 msgr2=0x555c8a1340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b359e700 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a125770 0x555c8a1340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b359e700 1 -- 172.21.15.12:0/1715679384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a1260d0 msgr2=0x555c8a134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b359e700 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a1260d0 0x555c8a134610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b359e700 1 -- 172.21.15.12:0/1715679384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b410a030 con 0x555c8a12ab80 2023-12-11T20:23:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a125770 0x555c8a1340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5b359e700 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a135620 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac01f870 tx=0x7fc5ac006070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c8a02797f3dd6e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc596ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc596ff5700 1 -- 172.21.15.12:0/1715679384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00e040 con 0x555c8a12ab80 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.364+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1715679384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5ac00f040 con 0x555c8a12ab80 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc596ff5700 1 -- 172.21.15.12:0/1715679384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc5ac0095e0 con 0x555c8a12ab80 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc596ff5700 1 -- 172.21.15.12:0/1715679384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5ac016440 con 0x555c8a12ab80 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc5ccad9b80 10 client.17595 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1715679384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555c89ec91f0 con 0x555c8a12ab80 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc596ff5700 1 -- 172.21.15.12:0/1715679384 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5ac00f040 con 0x555c8a12ab80 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc596ff5700 1 -- 172.21.15.12:0/1715679384 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc5ac01c070 con 0x555c8a12ab80 2023-12-11T20:23:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc5ccad9b80 10 client.17595 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc5ccad9b80 10 client.17595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc5ccad9b80 20 client.17595 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555c8a191b00 0x555c8a193f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.365+0000 7fc5ccad9b80 4 client.17595 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:23:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.366+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1715679384 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555c8a03ff70 con 0x555c8a191b00 2023-12-11T20:23:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.366+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555c8a191b00 0x555c8a193f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.366+0000 7fc5b2d9d700 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555c8a191b00 0x555c8a193f20 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbf713ddc49c3a0 server_cookie=8d551ea8e94db45e in_seq=0 out_seq=0 2023-12-11T20:23:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.366+0000 7fc596ff5700 10 client.17595 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.376+0000 7fc596ff5700 1 -- 172.21.15.12:0/1715679384 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555c8a03ff70 con 0x555c8a191b00 2023-12-11T20:23:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.376+0000 7fc596ff5700 10 client.17595 handle_command_reply: tid=0 2023-12-11T20:23:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 client.17595 shutdown 2023-12-11T20:23:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1715679384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 msgr2=0x555c8a135620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a135620 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac01f870 tx=0x7fc5ac006070 comp rx=0 tx=0).stop 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1715679384 shutdown_connections 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555c8a191b00 0x555c8a193f20 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c8a12ab80 0x555c8a135620 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c8a125770 0x555c8a1340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc596ff5700 0 client.17595 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 --2- 172.21.15.12:0/1715679384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555c8a1260d0 0x555c8a134610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1715679384 >> 172.21.15.12:0/1715679384 conn(0x555c8a054780 msgr2=0x555c8a12a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1715679384 shutdown_connections 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 1 -- 172.21.15.12:0/1715679384 wait complete. 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.377+0000 7fc5ccad9b80 20 client.17595 trim_cache size 0 max 16384 2023-12-11T20:23:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:23:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:23:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:23:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:23:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 -- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc59c0a1470 msgr2=0x7fc59c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc59c0a1470 0x7fc59c0a3930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8006010 tx=0x7fc5a800b630 comp rx=0 tx=0).stop 2023-12-11T20:23:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 -- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b4101d70 msgr2=0x7fc5b41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b4101d70 0x7fc5b41993c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400e9a0 tx=0x7fc5a400ed60 comp rx=0 tx=0).stop 2023-12-11T20:23:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 -- 172.21.15.12:0/2946941271 shutdown_connections 2023-12-11T20:23:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc59c0a1470 0x7fc59c0a3930 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5b4106fd0 0x7fc5b41a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc5b4101d70 0x7fc5b41993c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 --2- 172.21.15.12:0/2946941271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5b41046a0 0x7fc5b4199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 -- 172.21.15.12:0/2946941271 >> 172.21.15.12:0/2946941271 conn(0x7fc5b40fb780 msgr2=0x7fc5b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 -- 172.21.15.12:0/2946941271 shutdown_connections 2023-12-11T20:23:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:27.378+0000 7fc5b89fe700 1 -- 172.21.15.12:0/2946941271 wait complete. 2023-12-11T20:23:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:27 smithi039 ceph-mon[102205]: pgmap v601: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:23:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:27 smithi012 ceph-mon[128787]: pgmap v601: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:23:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:27 smithi032 ceph-mon[132488]: pgmap v601: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:23:29.509 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:23:29.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:29 smithi032 ceph-mon[132488]: pgmap v602: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:23:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 -- 172.21.15.12:0/158620960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281036d0 msgr2=0x7f9528103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 --2- 172.21.15.12:0/158620960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281036d0 0x7f9528103af0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9524009990 tx=0x7f9524009ca0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 -- 172.21.15.12:0/158620960 shutdown_connections 2023-12-11T20:23:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 --2- 172.21.15.12:0/158620960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9528105260 0x7f952810bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 --2- 172.21.15.12:0/158620960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281036d0 0x7f9528103af0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 --2- 172.21.15.12:0/158620960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95281048c0 0x7f9528104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 -- 172.21.15.12:0/158620960 >> 172.21.15.12:0/158620960 conn(0x7f95280fec80 msgr2=0x7f95281010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 -- 172.21.15.12:0/158620960 shutdown_connections 2023-12-11T20:23:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.735+0000 7f952f3ff700 1 -- 172.21.15.12:0/158620960 wait complete. 2023-12-11T20:23:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.736+0000 7f952f3ff700 1 Processor -- start 2023-12-11T20:23:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.736+0000 7f952f3ff700 1 -- start start 2023-12-11T20:23:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.736+0000 7f952f3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95281036d0 0x7f9528199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.736+0000 7f952f3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281048c0 0x7f9528199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.736+0000 7f952f3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9528105260 0x7f95281a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.736+0000 7f952f3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95281a10b0 con 0x7f95281036d0 2023-12-11T20:23:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.736+0000 7f952f3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95281a11f0 con 0x7f9528105260 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.736+0000 7f952f3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95281a1380 con 0x7f95281048c0 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95281036d0 0x7f9528199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952c99a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281048c0 0x7f9528199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95281036d0 0x7f9528199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39292/0 (socket says 172.21.15.12:39292) 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952d19b700 1 -- 172.21.15.12:0/3886212834 learned_addr learned my addr 172.21.15.12:0/3886212834 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952c99a700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281048c0 0x7f9528199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47080/0 (socket says 172.21.15.12:47080) 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952d99c700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9528105260 0x7f95281a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952c99a700 1 -- 172.21.15.12:0/3886212834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9528105260 msgr2=0x7f95281a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952c99a700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9528105260 0x7f95281a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952c99a700 1 -- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95281036d0 msgr2=0x7f9528199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952c99a700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95281036d0 0x7f9528199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952c99a700 1 -- 172.21.15.12:0/3886212834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240095f0 con 0x7f95281048c0 2023-12-11T20:23:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.737+0000 7f952d19b700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95281036d0 0x7f9528199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.738+0000 7f952c99a700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281048c0 0x7f9528199ac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f951800e9f0 tx=0x7f951800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.738+0000 7f951e7fc700 1 -- 172.21.15.12:0/3886212834 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800c9c0 con 0x7f95281048c0 2023-12-11T20:23:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.738+0000 7f952f3ff700 1 -- 172.21.15.12:0/3886212834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95281a1660 con 0x7f95281048c0 2023-12-11T20:23:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.738+0000 7f951e7fc700 1 -- 172.21.15.12:0/3886212834 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9518010430 con 0x7f95281048c0 2023-12-11T20:23:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.738+0000 7f951e7fc700 1 -- 172.21.15.12:0/3886212834 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518018680 con 0x7f95281048c0 2023-12-11T20:23:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.738+0000 7f952f3ff700 1 -- 172.21.15.12:0/3886212834 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95281a1bc0 con 0x7f95281048c0 2023-12-11T20:23:29.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.742+0000 7f951e7fc700 1 -- 172.21.15.12:0/3886212834 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f95180105a0 con 0x7f95281048c0 2023-12-11T20:23:29.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.743+0000 7f9542d82b80 1 Processor -- start 2023-12-11T20:23:29.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.743+0000 7f9542d82b80 1 -- start start 2023-12-11T20:23:29.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.743+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.743+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2e2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.743+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f9542d82b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b23cb50 con 0x562c3b2e13d0 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f9542d82b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b23a470 con 0x562c3b2e2c20 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f9542d82b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b235d60 con 0x562c3b2e1d30 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2e17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2e17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39294/0 (socket says 172.21.15.12:39294) 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d99c700 1 -- 172.21.15.12:0/2829425138 learned_addr learned my addr 172.21.15.12:0/2829425138 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f951e7fc700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95140a1480 0x7f95140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952c99a700 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d19b700 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f951e7fc700 1 -- 172.21.15.12:0/3886212834 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9518014070 con 0x7f95281048c0 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d99c700 1 -- 172.21.15.12:0/2829425138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 msgr2=0x562c3b2e2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:29.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d99c700 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2e2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d99c700 1 -- 172.21.15.12:0/2829425138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 msgr2=0x562c3b2e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:29.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d99c700 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.744+0000 7f952d99c700 1 -- 172.21.15.12:0/2829425138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c3b0b2630 con 0x562c3b2e13d0 2023-12-11T20:23:29.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.745+0000 7f952d99c700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95140a1480 0x7f95140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.745+0000 7f952d99c700 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2e17f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9520011790 tx=0x7f9520011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80230a8778866f00 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:29.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.745+0000 7f95137fe700 1 -- 172.21.15.12:0/2829425138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000e040 con 0x562c3b2e13d0 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.745+0000 7f95137fe700 1 -- 172.21.15.12:0/2829425138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9520027070 con 0x562c3b2e13d0 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.745+0000 7f952d99c700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95140a1480 0x7f95140a3940 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9520022000 tx=0x7f952001f000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.745+0000 7f95137fe700 1 -- 172.21.15.12:0/2829425138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200236b0 con 0x562c3b2e13d0 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.746+0000 7f9542d82b80 1 -- 172.21.15.12:0/2829425138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 msgr2=0x562c3b2e17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.746+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2e17f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9520011790 tx=0x7f9520011aa0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.746+0000 7f9542d82b80 1 -- 172.21.15.12:0/2829425138 shutdown_connections 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.746+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.746+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2e17f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.746+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2829425138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2e2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.746+0000 7f9542d82b80 1 -- 172.21.15.12:0/2829425138 >> 172.21.15.12:0/2829425138 conn(0x562c3b2107e0 msgr2=0x562c3b2ddd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.747+0000 7f9542d82b80 1 -- 172.21.15.12:0/2829425138 shutdown_connections 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.747+0000 7f9542d82b80 1 -- 172.21.15.12:0/2829425138 wait complete. 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.747+0000 7f9542d82b80 1 -- start start 2023-12-11T20:23:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.747+0000 7f9542d82b80 1 Processor -- start 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2f2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f9542d82b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b1ef560 con 0x562c3b2e13d0 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f9542d82b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b1ef200 con 0x562c3b2e2c20 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f9542d82b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b0b4920 con 0x562c3b2e1d30 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f9542d82b80 10 client.0 _ll_register_callbacks cb 0x562c3b11aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f952d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f952d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2eb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39310/0 (socket says 172.21.15.12:39310) 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f952d19b700 1 -- 172.21.15.12:0/3679837372 learned_addr learned my addr 172.21.15.12:0/3679837372 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f952c99a700 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.748+0000 7f952d99c700 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f952d19b700 1 -- 172.21.15.12:0/3679837372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 msgr2=0x562c3b2eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f952d19b700 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2eb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f952d19b700 1 -- 172.21.15.12:0/3679837372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 msgr2=0x562c3b2f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f952d19b700 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f952d19b700 1 -- 172.21.15.12:0/3679837372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9520011380 con 0x562c3b2e13d0 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f952d19b700 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2eb180 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f952400bb50 tx=0x7f952400bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ff7618f348501d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f9510ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f9510ff9700 1 -- 172.21.15.12:0/3679837372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952401d070 con 0x562c3b2e13d0 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f9542d82b80 1 -- 172.21.15.12:0/3679837372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c3b2d4b40 con 0x562c3b2e13d0 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.749+0000 7f9510ff9700 1 -- 172.21.15.12:0/3679837372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9524003b10 con 0x562c3b2e13d0 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9510ff9700 1 -- 172.21.15.12:0/3679837372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9524003cd0 con 0x562c3b2e13d0 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9542d82b80 10 client.17607 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:29.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9542d82b80 1 -- 172.21.15.12:0/3679837372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562c3b05ede0 con 0x562c3b2e13d0 2023-12-11T20:23:29.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9510ff9700 1 -- 172.21.15.12:0/3679837372 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562c3b2d4b40 con 0x562c3b2e13d0 2023-12-11T20:23:29.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9510ff9700 1 -- 172.21.15.12:0/3679837372 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9524024450 con 0x562c3b2e13d0 2023-12-11T20:23:29.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9542d82b80 10 client.17607 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:29.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9542d82b80 10 client.17607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:29.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9542d82b80 20 client.17607 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:29.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9542d82b80 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c3b2f6fd0 0x562c3b2f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9542d82b80 4 client.17607 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:29.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.750+0000 7f9542d82b80 1 -- 172.21.15.12:0/3679837372 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c3b2b0f40 con 0x562c3b2f6fd0 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.751+0000 7f952c99a700 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c3b2f6fd0 0x562c3b2f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.751+0000 7f952c99a700 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c3b2f6fd0 0x562c3b2f93f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a090ea3411bf00ec server_cookie=45dd0bc44eec00ea in_seq=0 out_seq=0 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.751+0000 7f9510ff9700 10 client.17607 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9510ff9700 1 -- 172.21.15.12:0/3679837372 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562c3b2b0f40 con 0x562c3b2f6fd0 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9510ff9700 10 client.17607 handle_command_reply: tid=0 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 client.17607 shutdown 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 -- 172.21.15.12:0/3679837372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 msgr2=0x562c3b2eb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2eb180 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f952400bb50 tx=0x7f952400bb80 comp rx=0 tx=0).stop 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 -- 172.21.15.12:0/3679837372 shutdown_connections 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c3b2f6fd0 0x562c3b2f93f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2eb180 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9510ff9700 0 client.17607 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:29.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 --2- 172.21.15.12:0/3679837372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2eb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.752+0000 7f9542d82b80 1 -- 172.21.15.12:0/3679837372 >> 172.21.15.12:0/3679837372 conn(0x562c3b2107e0 msgr2=0x562c3b2dca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:29.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.753+0000 7f9542d82b80 1 -- 172.21.15.12:0/3679837372 shutdown_connections 2023-12-11T20:23:29.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.753+0000 7f9542d82b80 1 -- 172.21.15.12:0/3679837372 wait complete. 2023-12-11T20:23:29.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.753+0000 7f9542d82b80 20 client.17607 trim_cache size 0 max 16384 2023-12-11T20:23:29.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.775+0000 7f9542d82b80 1 Processor -- start 2023-12-11T20:23:29.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.775+0000 7f9542d82b80 1 -- start start 2023-12-11T20:23:29.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e13d0 0x562c3b2ea360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e2c20 0x562c3b2f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f9542d82b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b2e8db0 con 0x562c3b2e2c20 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f9542d82b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b2e66a0 con 0x562c3b2e13d0 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f9542d82b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b2dd4d0 con 0x562c3b2e1d30 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f952d99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e2c20 0x562c3b2f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f952c99a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f952d99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e2c20 0x562c3b2f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39312/0 (socket says 172.21.15.12:39312) 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f952c99a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2ea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47122/0 (socket says 172.21.15.12:47122) 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f952d99c700 1 -- 172.21.15.12:0/1254503468 learned_addr learned my addr 172.21.15.12:0/1254503468 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.776+0000 7f952d19b700 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e13d0 0x562c3b2ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f952c99a700 1 -- 172.21.15.12:0/1254503468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e13d0 msgr2=0x562c3b2ea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f952c99a700 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e13d0 0x562c3b2ea360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f952c99a700 1 -- 172.21.15.12:0/1254503468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e2c20 msgr2=0x562c3b2f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f952c99a700 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e2c20 0x562c3b2f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f952c99a700 1 -- 172.21.15.12:0/1254503468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c3b047c60 con 0x562c3b2e1d30 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f952d19b700 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e13d0 0x562c3b2ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f952d99c700 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e2c20 0x562c3b2f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f952c99a700 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2ea8a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9518096bb0 tx=0x7f9518010b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d922f83229210551 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f9513fff700 1 -- 172.21.15.12:0/1254503468 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951809a840 con 0x562c3b2e1d30 2023-12-11T20:23:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f9513fff700 1 -- 172.21.15.12:0/1254503468 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f951809e290 con 0x562c3b2e1d30 2023-12-11T20:23:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.777+0000 7f9513fff700 1 -- 172.21.15.12:0/1254503468 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951809a3a0 con 0x562c3b2e1d30 2023-12-11T20:23:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 -- 172.21.15.12:0/1254503468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 msgr2=0x562c3b2ea8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2ea8a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9518096bb0 tx=0x7f9518010b80 comp rx=0 tx=0).stop 2023-12-11T20:23:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 -- 172.21.15.12:0/1254503468 shutdown_connections 2023-12-11T20:23:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e13d0 0x562c3b2ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e2c20 0x562c3b2f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 --2- 172.21.15.12:0/1254503468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2ea8a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 -- 172.21.15.12:0/1254503468 >> 172.21.15.12:0/1254503468 conn(0x562c3b2107e0 msgr2=0x562c3b2e9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 -- 172.21.15.12:0/1254503468 shutdown_connections 2023-12-11T20:23:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.778+0000 7f9542d82b80 1 -- 172.21.15.12:0/1254503468 wait complete. 2023-12-11T20:23:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.779+0000 7f9542d82b80 1 -- start start 2023-12-11T20:23:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.779+0000 7f9542d82b80 1 Processor -- start 2023-12-11T20:23:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.779+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.779+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2f2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.779+0000 7f9542d82b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2eea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.779+0000 7f9542d82b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b2eefa0 con 0x562c3b2e13d0 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.779+0000 7f9542d82b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b2ef110 con 0x562c3b2e2c20 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.779+0000 7f9542d82b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c3b2ef2d0 con 0x562c3b2e1d30 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f9542d82b80 10 client.0 _ll_register_callbacks cb 0x562c3b11aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39320/0 (socket says 172.21.15.12:39320) 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d19b700 1 -- 172.21.15.12:0/2805707676 learned_addr learned my addr 172.21.15.12:0/2805707676 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d99c700 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952c99a700 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d19b700 1 -- 172.21.15.12:0/2805707676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 msgr2=0x562c3b2f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d19b700 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d19b700 1 -- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 msgr2=0x562c3b2eea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d19b700 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2eea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d19b700 1 -- 172.21.15.12:0/2805707676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c3b05ede0 con 0x562c3b2e13d0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.780+0000 7f952d99c700 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f952d19b700 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2f1ee0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9524001eb0 tx=0x7f9524009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3941a93e2696a599 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f9510ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f9510ff9700 1 -- 172.21.15.12:0/2805707676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952401d040 con 0x562c3b2e13d0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f9542d82b80 1 -- 172.21.15.12:0/2805707676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9520027070 con 0x562c3b2e13d0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f9510ff9700 1 -- 172.21.15.12:0/2805707676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9524003b10 con 0x562c3b2e13d0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f9510ff9700 1 -- 172.21.15.12:0/2805707676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9524003d10 con 0x562c3b2e13d0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f9542d82b80 10 client.17613 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f9542d82b80 1 -- 172.21.15.12:0/2805707676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562c3b0b2630 con 0x562c3b2e13d0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.781+0000 7f9510ff9700 1 -- 172.21.15.12:0/2805707676 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9520027070 con 0x562c3b2e13d0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.782+0000 7f9510ff9700 1 -- 172.21.15.12:0/2805707676 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9524037430 con 0x562c3b2e13d0 2023-12-11T20:23:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.782+0000 7f9542d82b80 10 client.17613 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.782+0000 7f9542d82b80 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.782+0000 7f9542d82b80 20 client.17613 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.782+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c3b34e670 0x562c3b350a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.782+0000 7f9542d82b80 4 client.17613 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.782+0000 7f9542d82b80 1 -- 172.21.15.12:0/2805707676 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562c3b1fbfd0 con 0x562c3b34e670 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.782+0000 7f952c99a700 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c3b34e670 0x562c3b350a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f952c99a700 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c3b34e670 0x562c3b350a90 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d79c2d973e85151 server_cookie=9b9c0c04554431f6 in_seq=0 out_seq=0 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9510ff9700 10 client.17613 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9510ff9700 1 -- 172.21.15.12:0/2805707676 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562c3b1fbfd0 con 0x562c3b34e670 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9510ff9700 10 client.17613 handle_command_reply: tid=0 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 client.17613 shutdown 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 -- 172.21.15.12:0/2805707676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 msgr2=0x562c3b2f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2f1ee0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9524001eb0 tx=0x7f9524009510 comp rx=0 tx=0).stop 2023-12-11T20:23:29.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 -- 172.21.15.12:0/2805707676 shutdown_connections 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c3b34e670 0x562c3b350a90 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c3b2e2c20 0x562c3b2eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c3b2e13d0 0x562c3b2f1ee0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9510ff9700 0 client.17613 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 --2- 172.21.15.12:0/2805707676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c3b2e1d30 0x562c3b2f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.783+0000 7f9542d82b80 1 -- 172.21.15.12:0/2805707676 >> 172.21.15.12:0/2805707676 conn(0x562c3b2107e0 msgr2=0x562c3b2e5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.784+0000 7f9542d82b80 1 -- 172.21.15.12:0/2805707676 shutdown_connections 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.784+0000 7f9542d82b80 1 -- 172.21.15.12:0/2805707676 wait complete. 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.784+0000 7f9542d82b80 20 client.17613 trim_cache size 0 max 16384 2023-12-11T20:23:29.788 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:23:29.789 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:23:29.789 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:23:29.789 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:23:29.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.784+0000 7f952f3ff700 1 -- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95140a1480 msgr2=0x7f95140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.784+0000 7f952f3ff700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95140a1480 0x7f95140a3940 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9520022000 tx=0x7f952001f000 comp rx=0 tx=0).stop 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.784+0000 7f952f3ff700 1 -- 172.21.15.12:0/3886212834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281048c0 msgr2=0x7f9528199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.784+0000 7f952f3ff700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281048c0 0x7f9528199ac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f951800e9f0 tx=0x7f951800ed00 comp rx=0 tx=0).stop 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.785+0000 7f952f3ff700 1 -- 172.21.15.12:0/3886212834 shutdown_connections 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.785+0000 7f952f3ff700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95140a1480 0x7f95140a3940 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.785+0000 7f952f3ff700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9528105260 0x7f95281a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.785+0000 7f952f3ff700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95281036d0 0x7f9528199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.785+0000 7f952f3ff700 1 --2- 172.21.15.12:0/3886212834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95281048c0 0x7f9528199ac0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.785+0000 7f952f3ff700 1 -- 172.21.15.12:0/3886212834 >> 172.21.15.12:0/3886212834 conn(0x7f95280fec80 msgr2=0x7f9528107d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.785+0000 7f952f3ff700 1 -- 172.21.15.12:0/3886212834 shutdown_connections 2023-12-11T20:23:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:29.785+0000 7f952f3ff700 1 -- 172.21.15.12:0/3886212834 wait complete. 2023-12-11T20:23:29.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:29 smithi012 ceph-mon[128787]: pgmap v602: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:23:29.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:29 smithi039 ceph-mon[102205]: pgmap v602: 97 pgs: 97 active+clean; 5.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:23:29.804 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:23:29.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:23:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.036+0000 7f77ce9ff700 1 -- 172.21.15.12:0/51614734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81036a0 msgr2=0x7f77c8103ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.036+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/51614734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81036a0 0x7f77c8103ac0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f77b80099c0 tx=0x7f77b8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.037+0000 7f77ce9ff700 1 -- 172.21.15.12:0/51614734 shutdown_connections 2023-12-11T20:23:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.037+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/51614734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c8105230 0x7f77c810bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.037+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/51614734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81036a0 0x7f77c8103ac0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.037+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/51614734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c8104890 0x7f77c8104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.037+0000 7f77ce9ff700 1 -- 172.21.15.12:0/51614734 >> 172.21.15.12:0/51614734 conn(0x7f77c80fec10 msgr2=0x7f77c8101050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.037+0000 7f77ce9ff700 1 -- 172.21.15.12:0/51614734 shutdown_connections 2023-12-11T20:23:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.037+0000 7f77ce9ff700 1 -- 172.21.15.12:0/51614734 wait complete. 2023-12-11T20:23:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.038+0000 7f77ce9ff700 1 Processor -- start 2023-12-11T20:23:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.038+0000 7f77ce9ff700 1 -- start start 2023-12-11T20:23:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.038+0000 7f77ce9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c81036a0 0x7f77c8199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.038+0000 7f77ce9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8104890 0x7f77c8199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.038+0000 7f77ce9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c8105230 0x7f77c81a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.038+0000 7f77ce9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81a10c0 con 0x7f77c8104890 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.038+0000 7f77ce9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81a1200 con 0x7f77c8105230 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.038+0000 7f77ce9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81a1390 con 0x7f77c81036a0 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8104890 0x7f77c8199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8104890 0x7f77c8199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39346/0 (socket says 172.21.15.12:39346) 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 -- 172.21.15.12:0/4205794358 learned_addr learned my addr 172.21.15.12:0/4205794358 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77ccf9c700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c8105230 0x7f77c81a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c7fff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c81036a0 0x7f77c8199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 -- 172.21.15.12:0/4205794358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c81036a0 msgr2=0x7f77c8199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c81036a0 0x7f77c8199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 -- 172.21.15.12:0/4205794358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c8105230 msgr2=0x7f77c81a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c8105230 0x7f77c81a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 -- 172.21.15.12:0/4205794358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b80095f0 con 0x7f77c8104890 2023-12-11T20:23:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.039+0000 7f77c77fe700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8104890 0x7f77c8199ad0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00d950 tx=0x7f77bc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.040+0000 7f77c57fa700 1 -- 172.21.15.12:0/4205794358 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00f890 con 0x7f77c8104890 2023-12-11T20:23:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.040+0000 7f77c57fa700 1 -- 172.21.15.12:0/4205794358 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77bc00fe80 con 0x7f77c8104890 2023-12-11T20:23:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.040+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c81a1670 con 0x7f77c8104890 2023-12-11T20:23:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.040+0000 7f77c57fa700 1 -- 172.21.15.12:0/4205794358 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00e3b0 con 0x7f77c8104890 2023-12-11T20:23:30.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.040+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c81a1bd0 con 0x7f77c8104890 2023-12-11T20:23:30.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.041+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c810ac10 con 0x7f77c8104890 2023-12-11T20:23:30.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.044+0000 7f77c57fa700 1 -- 172.21.15.12:0/4205794358 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f77bc010460 con 0x7f77c8104890 2023-12-11T20:23:30.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.045+0000 7f77c57fa700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a1500 0x7f77b00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.046+0000 7f77c57fa700 1 -- 172.21.15.12:0/4205794358 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f77bc0ccaf0 con 0x7f77c8104890 2023-12-11T20:23:30.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.046+0000 7f77c7fff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a1500 0x7f77b00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.046+0000 7f77c7fff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a1500 0x7f77b00a39c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f77b8000c00 tx=0x7f77b8003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.050+0000 7f77c57fa700 1 -- 172.21.15.12:0/4205794358 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f77bc0960a0 con 0x7f77c8104890 2023-12-11T20:23:30.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.351+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77c8068330 con 0x7f77c8104890 2023-12-11T20:23:30.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.352+0000 7f77c57fa700 1 -- 172.21.15.12:0/4205794358 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f77bc016090 con 0x7f77c8104890 2023-12-11T20:23:30.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:23:30.352 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:23:30.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a1500 msgr2=0x7f77b00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a1500 0x7f77b00a39c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f77b8000c00 tx=0x7f77b8003680 comp rx=0 tx=0).stop 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8104890 msgr2=0x7f77c8199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8104890 0x7f77c8199ad0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00d950 tx=0x7f77bc00dc60 comp rx=0 tx=0).stop 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 shutdown_connections 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a1500 0x7f77b00a39c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c8105230 0x7f77c81a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c81036a0 0x7f77c8199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 --2- 172.21.15.12:0/4205794358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8104890 0x7f77c8199ad0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 >> 172.21.15.12:0/4205794358 conn(0x7f77c80fec10 msgr2=0x7f77c8107d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 shutdown_connections 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.355+0000 7f77ce9ff700 1 -- 172.21.15.12:0/4205794358 wait complete. 2023-12-11T20:23:30.355 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:23:30.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:23:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.599+0000 7f8e03fff700 1 -- 172.21.15.12:0/2558844505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041012f0 msgr2=0x7f8e04101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.599+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2558844505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041012f0 0x7f8e04101710 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8df40099c0 tx=0x7f8df4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.599+0000 7f8e03fff700 1 -- 172.21.15.12:0/2558844505 shutdown_connections 2023-12-11T20:23:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.599+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2558844505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e04102e80 0x7f8e04109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.599+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2558844505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041012f0 0x7f8e04101710 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.599+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2558844505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e041024e0 0x7f8e04102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.599+0000 7f8e03fff700 1 -- 172.21.15.12:0/2558844505 >> 172.21.15.12:0/2558844505 conn(0x7f8e040fc860 msgr2=0x7f8e040feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.600+0000 7f8e03fff700 1 -- 172.21.15.12:0/2558844505 shutdown_connections 2023-12-11T20:23:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.600+0000 7f8e03fff700 1 -- 172.21.15.12:0/2558844505 wait complete. 2023-12-11T20:23:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.601+0000 7f8e03fff700 1 Processor -- start 2023-12-11T20:23:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.601+0000 7f8e03fff700 1 -- start start 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.601+0000 7f8e03fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e041012f0 0x7f8e04199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.601+0000 7f8e03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041024e0 0x7f8e04199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.601+0000 7f8e03fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e04102e80 0x7f8e041a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.601+0000 7f8e03fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041a0e70 con 0x7f8e041024e0 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.601+0000 7f8e03fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041a0fb0 con 0x7f8e041012f0 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.601+0000 7f8e03fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041a1140 con 0x7f8e04102e80 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041024e0 0x7f8e04199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e02ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e041012f0 0x7f8e04199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e02ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e041012f0 0x7f8e04199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:39392/0 (socket says 172.21.15.12:39392) 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e02ffd700 1 -- 172.21.15.12:0/2868730573 learned_addr learned my addr 172.21.15.12:0/2868730573 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e037fe700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e04102e80 0x7f8e041a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e027fc700 1 -- 172.21.15.12:0/2868730573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e04102e80 msgr2=0x7f8e041a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e027fc700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e04102e80 0x7f8e041a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e027fc700 1 -- 172.21.15.12:0/2868730573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e041012f0 msgr2=0x7f8e04199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e027fc700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e041012f0 0x7f8e04199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e027fc700 1 -- 172.21.15.12:0/2868730573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40095f0 con 0x7f8e041024e0 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.602+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e041012f0 0x7f8e04199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.603+0000 7f8e027fc700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041024e0 0x7f8e04199880 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8df800d750 tx=0x7f8df800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.603+0000 7f8debfff700 1 -- 172.21.15.12:0/2868730573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8004020 con 0x7f8e041024e0 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.603+0000 7f8debfff700 1 -- 172.21.15.12:0/2868730573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8df8004830 con 0x7f8e041024e0 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.603+0000 7f8e03fff700 1 -- 172.21.15.12:0/2868730573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e041a1420 con 0x7f8e041024e0 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.603+0000 7f8debfff700 1 -- 172.21.15.12:0/2868730573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8005400 con 0x7f8e041024e0 2023-12-11T20:23:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.603+0000 7f8e03fff700 1 -- 172.21.15.12:0/2868730573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e041a1980 con 0x7f8e041024e0 2023-12-11T20:23:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.606+0000 7f8debfff700 1 -- 172.21.15.12:0/2868730573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8df8004c80 con 0x7f8e041024e0 2023-12-11T20:23:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.608+0000 7f8debfff700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8dec0a15a0 0x7f8dec0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.608+0000 7f8debfff700 1 -- 172.21.15.12:0/2868730573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8df80cc6b0 con 0x7f8e041024e0 2023-12-11T20:23:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.608+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8dec0a15a0 0x7f8dec0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.608+0000 7f8e1d0bdb80 1 Processor -- start 2023-12-11T20:23:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e1d0bdb80 1 -- start start 2023-12-11T20:23:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3949e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d394a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d38a4b50 con 0x55b4d394a3c0 2023-12-11T20:23:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d38a2470 con 0x55b4d394ade0 2023-12-11T20:23:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d389dd60 con 0x55b4d3949a60 2023-12-11T20:23:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8dec0a15a0 0x7f8dec0a3a60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8df4006010 tx=0x7f8df401a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d394a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d394a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39372/0 (socket says 172.21.15.12:39372) 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e027fc700 1 -- 172.21.15.12:0/1315075872 learned_addr learned my addr 172.21.15.12:0/1315075872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.609+0000 7f8e037fe700 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3949e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8e027fc700 1 -- 172.21.15.12:0/1315075872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 msgr2=0x55b4d3949e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8e027fc700 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3949e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8e027fc700 1 -- 172.21.15.12:0/1315075872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 msgr2=0x55b4d394b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8e027fc700 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8e027fc700 1 -- 172.21.15.12:0/1315075872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4d371a630 con 0x55b4d394a3c0 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8e027fc700 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d394a8a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8df80998b0 tx=0x7f8df8004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b289c2f61aa3436 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8de97fa700 1 -- 172.21.15.12:0/1315075872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8099920 con 0x55b4d394a3c0 2023-12-11T20:23:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8de97fa700 1 -- 172.21.15.12:0/1315075872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8df809da70 con 0x55b4d394a3c0 2023-12-11T20:23:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.610+0000 7f8de97fa700 1 -- 172.21.15.12:0/1315075872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8099da0 con 0x55b4d394a3c0 2023-12-11T20:23:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1315075872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 msgr2=0x55b4d394a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d394a8a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8df80998b0 tx=0x7f8df8004a20 comp rx=0 tx=0).stop 2023-12-11T20:23:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1315075872 shutdown_connections 2023-12-11T20:23:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3949e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1315075872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d394a8a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1315075872 >> 172.21.15.12:0/1315075872 conn(0x55b4d38787e0 msgr2=0x55b4d39443d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1315075872 shutdown_connections 2023-12-11T20:23:30.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.611+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1315075872 wait complete. 2023-12-11T20:23:30.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.612+0000 7f8e1d0bdb80 1 -- start start 2023-12-11T20:23:30.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.612+0000 7f8e1d0bdb80 1 Processor -- start 2023-12-11T20:23:30.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3953350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394a3c0 0x55b4d3953890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394ade0 0x55b4d395a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d3857560 con 0x55b4d394ade0 2023-12-11T20:23:30.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d3857200 con 0x55b4d394a3c0 2023-12-11T20:23:30.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d371c920 con 0x55b4d3949a60 2023-12-11T20:23:30.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e1d0bdb80 10 client.0 _ll_register_callbacks cb 0x55b4d3782a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:30.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e037fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394ade0 0x55b4d395a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e02ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3953350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e02ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3953350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47190/0 (socket says 172.21.15.12:47190) 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e02ffd700 1 -- 172.21.15.12:0/944554252 learned_addr learned my addr 172.21.15.12:0/944554252 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.613+0000 7f8e027fc700 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394a3c0 0x55b4d3953890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8e037fe700 1 -- 172.21.15.12:0/944554252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 msgr2=0x55b4d3953350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8e037fe700 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3953350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8e037fe700 1 -- 172.21.15.12:0/944554252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394a3c0 msgr2=0x55b4d3953890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8e037fe700 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394a3c0 0x55b4d3953890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8e037fe700 1 -- 172.21.15.12:0/944554252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e041a1980 con 0x55b4d394ade0 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3953350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8e037fe700 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394ade0 0x55b4d395a8d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc011dd0 tx=0x7f8dfc014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2037def7e73fbe63 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8de6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:30.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8de6ff5700 1 -- 172.21.15.12:0/944554252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00e040 con 0x55b4d394ade0 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/944554252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4d393c9e0 con 0x55b4d394ade0 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.614+0000 7f8de6ff5700 1 -- 172.21.15.12:0/944554252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8dfc014e70 con 0x55b4d394ade0 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8de6ff5700 1 -- 172.21.15.12:0/944554252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dfc003a00 con 0x55b4d394ade0 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8e1d0bdb80 10 client.17631 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/944554252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b4d36c6de0 con 0x55b4d394ade0 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8de6ff5700 1 -- 172.21.15.12:0/944554252 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b4d393c9e0 con 0x55b4d394ade0 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8de6ff5700 1 -- 172.21.15.12:0/944554252 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8dfc01c070 con 0x55b4d394ade0 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8e1d0bdb80 10 client.17631 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:30.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8e1d0bdb80 10 client.17631 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8e1d0bdb80 20 client.17631 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b4d395f150 0x55b4d3961570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8e1d0bdb80 4 client.17631 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.615+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/944554252 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4d3918f40 con 0x55b4d395f150 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.616+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b4d395f150 0x55b4d3961570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.616+0000 7f8de6ff5700 10 client.17631 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.616+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b4d395f150 0x55b4d3961570 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e97c0777f5b05252 server_cookie=50aa0688d27f57f1 in_seq=0 out_seq=0 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.617+0000 7f8de6ff5700 1 -- 172.21.15.12:0/944554252 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b4d3918f40 con 0x55b4d395f150 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.617+0000 7f8de6ff5700 10 client.17631 handle_command_reply: tid=0 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 client.17631 shutdown 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/944554252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394ade0 msgr2=0x55b4d395a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394ade0 0x55b4d395a8d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc011dd0 tx=0x7f8dfc014600 comp rx=0 tx=0).stop 2023-12-11T20:23:30.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/944554252 shutdown_connections 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b4d395f150 0x55b4d3961570 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394ade0 0x55b4d395a8d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d3953350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/944554252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394a3c0 0x55b4d3953890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/944554252 >> 172.21.15.12:0/944554252 conn(0x55b4d38787e0 msgr2=0x55b4d3948820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8de6ff5700 0 client.17631 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/944554252 shutdown_connections 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/944554252 wait complete. 2023-12-11T20:23:30.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.618+0000 7f8e1d0bdb80 20 client.17631 trim_cache size 0 max 16384 2023-12-11T20:23:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e1d0bdb80 1 Processor -- start 2023-12-11T20:23:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e1d0bdb80 1 -- start start 2023-12-11T20:23:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d395af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d395a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d395ba50 con 0x55b4d394a3c0 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d3952ec0 con 0x55b4d394ade0 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d3945470 con 0x55b4d3949a60 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d395a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.633+0000 7f8e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d395a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39386/0 (socket says 172.21.15.12:39386) 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e027fc700 1 -- 172.21.15.12:0/3076161563 learned_addr learned my addr 172.21.15.12:0/3076161563 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d395af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e037fe700 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e027fc700 1 -- 172.21.15.12:0/3076161563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 msgr2=0x55b4d395af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e027fc700 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d395af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e027fc700 1 -- 172.21.15.12:0/3076161563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 msgr2=0x55b4d394b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e027fc700 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e027fc700 1 -- 172.21.15.12:0/3076161563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4d36afc60 con 0x55b4d394a3c0 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e037fe700 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8e027fc700 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d395a7f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8df8019000 tx=0x7f8df8099580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f7f8eadc120672 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8de9ffb700 1 -- 172.21.15.12:0/3076161563 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8099920 con 0x55b4d394a3c0 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8de9ffb700 1 -- 172.21.15.12:0/3076161563 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8df80a1cb0 con 0x55b4d394a3c0 2023-12-11T20:23:30.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.634+0000 7f8de9ffb700 1 -- 172.21.15.12:0/3076161563 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8099010 con 0x55b4d394a3c0 2023-12-11T20:23:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.635+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/3076161563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 msgr2=0x55b4d395a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.635+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d395a7f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8df8019000 tx=0x7f8df8099580 comp rx=0 tx=0).stop 2023-12-11T20:23:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.635+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/3076161563 shutdown_connections 2023-12-11T20:23:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.635+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d394ade0 0x55b4d394b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.635+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d3949a60 0x55b4d395af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.635+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/3076161563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d395a7f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.635+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/3076161563 >> 172.21.15.12:0/3076161563 conn(0x55b4d38787e0 msgr2=0x55b4d3944320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.636+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/3076161563 shutdown_connections 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.636+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/3076161563 wait complete. 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.636+0000 7f8e1d0bdb80 1 -- start start 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e1d0bdb80 1 Processor -- start 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d3949a60 0x55b4d39582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d39587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e1d0bdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d394ade0 0x55b4d3959800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d3959d40 con 0x55b4d394a3c0 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d3959eb0 con 0x55b4d3949a60 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e1d0bdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4d395a070 con 0x55b4d394ade0 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e1d0bdb80 10 client.0 _ll_register_callbacks cb 0x55b4d3782a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.637+0000 7f8e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d39587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d39587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39392/0 (socket says 172.21.15.12:39392) 2023-12-11T20:23:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e027fc700 1 -- 172.21.15.12:0/1434038131 learned_addr learned my addr 172.21.15.12:0/1434038131 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d3949a60 0x55b4d39582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e037fe700 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d394ade0 0x55b4d3959800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e027fc700 1 -- 172.21.15.12:0/1434038131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d394ade0 msgr2=0x55b4d3959800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e027fc700 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d394ade0 0x55b4d3959800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e027fc700 1 -- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d3949a60 msgr2=0x55b4d39582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e027fc700 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d3949a60 0x55b4d39582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e027fc700 1 -- 172.21.15.12:0/1434038131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4d371a630 con 0x55b4d394a3c0 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d3949a60 0x55b4d39582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e027fc700 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d39587f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8df80a1780 tx=0x7f8df80a1e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f00d6ddc46a304 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8de6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8de6ff5700 1 -- 172.21.15.12:0/1434038131 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df807e070 con 0x55b4d394a3c0 2023-12-11T20:23:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8de6ff5700 1 -- 172.21.15.12:0/1434038131 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8df8097cc0 con 0x55b4d394a3c0 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.638+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1434038131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8df809da70 con 0x55b4d394a3c0 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8de6ff5700 1 -- 172.21.15.12:0/1434038131 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8df80b92a0 con 0x55b4d394a3c0 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8e1d0bdb80 10 client.17637 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1434038131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b4d36ed250 con 0x55b4d394a3c0 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8de6ff5700 1 -- 172.21.15.12:0/1434038131 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8df80a5020 con 0x55b4d394a3c0 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8de6ff5700 1 -- 172.21.15.12:0/1434038131 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8df8081030 con 0x55b4d394a3c0 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8e1d0bdb80 10 client.17637 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8e1d0bdb80 10 client.17637 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8e1d0bdb80 20 client.17637 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b4d39b5e60 0x55b4d39b8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8e1d0bdb80 4 client.17637 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.639+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1434038131 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b4d3863fd0 con 0x55b4d39b5e60 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.640+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b4d39b5e60 0x55b4d39b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.640+0000 7f8e02ffd700 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b4d39b5e60 0x55b4d39b8280 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a4d3b991fd530b1 server_cookie=e6d534b7539ea0cf in_seq=0 out_seq=0 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.640+0000 7f8de6ff5700 10 client.17637 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.640+0000 7f8de6ff5700 1 -- 172.21.15.12:0/1434038131 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b4d3863fd0 con 0x55b4d39b5e60 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.640+0000 7f8de6ff5700 10 client.17637 handle_command_reply: tid=0 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.640+0000 7f8e1d0bdb80 1 client.17637 shutdown 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1434038131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 msgr2=0x55b4d39587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d39587f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8df80a1780 tx=0x7f8df80a1e20 comp rx=0 tx=0).stop 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1434038131 shutdown_connections 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b4d39b5e60 0x55b4d39b8280 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b4d3949a60 0x55b4d39582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b4d394ade0 0x55b4d3959800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8de6ff5700 0 client.17637 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:23:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 --2- 172.21.15.12:0/1434038131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4d394a3c0 0x55b4d39587f0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1434038131 >> 172.21.15.12:0/1434038131 conn(0x55b4d38787e0 msgr2=0x55b4d39532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1434038131 shutdown_connections 2023-12-11T20:23:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 1 -- 172.21.15.12:0/1434038131 wait complete. 2023-12-11T20:23:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.641+0000 7f8e1d0bdb80 20 client.17637 trim_cache size 0 max 16384 2023-12-11T20:23:30.645 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:23:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 -- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8dec0a15a0 msgr2=0x7f8dec0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8dec0a15a0 0x7f8dec0a3a60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8df4006010 tx=0x7f8df401a040 comp rx=0 tx=0).stop 2023-12-11T20:23:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 -- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041024e0 msgr2=0x7f8e04199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041024e0 0x7f8e04199880 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8df800d750 tx=0x7f8df800da60 comp rx=0 tx=0).stop 2023-12-11T20:23:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 -- 172.21.15.12:0/2868730573 shutdown_connections 2023-12-11T20:23:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8dec0a15a0 0x7f8dec0a3a60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e041012f0 0x7f8e04199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e04102e80 0x7f8e041a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 --2- 172.21.15.12:0/2868730573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e041024e0 0x7f8e04199880 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 -- 172.21.15.12:0/2868730573 >> 172.21.15.12:0/2868730573 conn(0x7f8e040fc860 msgr2=0x7f8e04073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 -- 172.21.15.12:0/2868730573 shutdown_connections 2023-12-11T20:23:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.642+0000 7f8e03fff700 1 -- 172.21.15.12:0/2868730573 wait complete. 2023-12-11T20:23:30.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:30 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4205794358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:23:30.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:23:30.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:30 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4205794358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:23:30.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:30 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4205794358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:23:30.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 -- 172.21.15.12:0/2417258263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd4104710 msgr2=0x7f7dd4104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 --2- 172.21.15.12:0/2417258263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd4104710 0x7f7dd4104b70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40099c0 tx=0x7f7dc4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 -- 172.21.15.12:0/2417258263 shutdown_connections 2023-12-11T20:23:30.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 --2- 172.21.15.12:0/2417258263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4103520 0x7f7dd4103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 --2- 172.21.15.12:0/2417258263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dd41050b0 0x7f7dd410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 --2- 172.21.15.12:0/2417258263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd4104710 0x7f7dd4104b70 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 -- 172.21.15.12:0/2417258263 >> 172.21.15.12:0/2417258263 conn(0x7f7dd40fea70 msgr2=0x7f7dd4100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 -- 172.21.15.12:0/2417258263 shutdown_connections 2023-12-11T20:23:30.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.884+0000 7f7dda59d700 1 -- 172.21.15.12:0/2417258263 wait complete. 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.885+0000 7f7dda59d700 1 Processor -- start 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.885+0000 7f7dda59d700 1 -- start start 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dda59d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4103520 0x7f7dd41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dda59d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dd4104710 0x7f7dd4199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dda59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd41050b0 0x7f7dd41a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dda59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41a0df0 con 0x7f7dd41050b0 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dda59d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41a0f30 con 0x7f7dd4103520 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dda59d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41a10c0 con 0x7f7dd4104710 2023-12-11T20:23:30.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dd9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd41050b0 0x7f7dd41a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dd8d9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dd4104710 0x7f7dd4199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dd9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd41050b0 0x7f7dd41a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39416/0 (socket says 172.21.15.12:39416) 2023-12-11T20:23:30.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dd959b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4103520 0x7f7dd41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dd8d9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dd4104710 0x7f7dd4199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47248/0 (socket says 172.21.15.12:47248) 2023-12-11T20:23:30.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.886+0000 7f7dd9d9c700 1 -- 172.21.15.12:0/234267787 learned_addr learned my addr 172.21.15.12:0/234267787 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dd9d9c700 1 -- 172.21.15.12:0/234267787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dd4104710 msgr2=0x7f7dd4199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dd9d9c700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dd4104710 0x7f7dd4199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dd9d9c700 1 -- 172.21.15.12:0/234267787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4103520 msgr2=0x7f7dd41992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dd9d9c700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4103520 0x7f7dd41992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dd9d9c700 1 -- 172.21.15.12:0/234267787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40095f0 con 0x7f7dd41050b0 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dd959b700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4103520 0x7f7dd41992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dd9d9c700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd41050b0 0x7f7dd41a0820 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc007ee0 tx=0x7f7dcc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dca7fc700 1 -- 172.21.15.12:0/234267787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc017070 con 0x7f7dd41050b0 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dca7fc700 1 -- 172.21.15.12:0/234267787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7dcc00f040 con 0x7f7dd41050b0 2023-12-11T20:23:30.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dda59d700 1 -- 172.21.15.12:0/234267787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd41a13a0 con 0x7f7dd41050b0 2023-12-11T20:23:30.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dca7fc700 1 -- 172.21.15.12:0/234267787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc005570 con 0x7f7dd41050b0 2023-12-11T20:23:30.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.887+0000 7f7dda59d700 1 -- 172.21.15.12:0/234267787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd41a18b0 con 0x7f7dd41050b0 2023-12-11T20:23:30.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.891+0000 7f7dca7fc700 1 -- 172.21.15.12:0/234267787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7dcc00db20 con 0x7f7dd41050b0 2023-12-11T20:23:30.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.892+0000 7f7def1ffb80 1 Processor -- start 2023-12-11T20:23:30.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.892+0000 7f7def1ffb80 1 -- start start 2023-12-11T20:23:30.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a5ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a5b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a5c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff69b5b50 con 0x555ff6a5aa60 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff69b3470 con 0x555ff6a5bde0 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff69aed60 con 0x555ff6a5b3c0 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a5ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a5ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39422/0 (socket says 172.21.15.12:39422) 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 -- 172.21.15.12:0/381947683 learned_addr learned my addr 172.21.15.12:0/381947683 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a5c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd959b700 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a5b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 -- 172.21.15.12:0/381947683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 msgr2=0x555ff6a5b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a5b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 -- 172.21.15.12:0/381947683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 msgr2=0x555ff6a5c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a5c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.893+0000 7f7dd8d9a700 1 -- 172.21.15.12:0/381947683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ff682b630 con 0x555ff6a5aa60 2023-12-11T20:23:30.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.894+0000 7f7dca7fc700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7dc00a15a0 0x7f7dc00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.894+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a5ae80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005950 tx=0x7f7dc40058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ccbfd6715a9298 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.894+0000 7f7dca7fc700 1 -- 172.21.15.12:0/234267787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7dcc0cc4e0 con 0x7f7dd41050b0 2023-12-11T20:23:30.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.894+0000 7f7dd959b700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7dc00a15a0 0x7f7dc00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.894+0000 7f7dbf7fe700 1 -- 172.21.15.12:0/381947683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40050d0 con 0x555ff6a5aa60 2023-12-11T20:23:30.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.894+0000 7f7dbf7fe700 1 -- 172.21.15.12:0/381947683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7dc40056c0 con 0x555ff6a5aa60 2023-12-11T20:23:30.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.894+0000 7f7dbf7fe700 1 -- 172.21.15.12:0/381947683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400f460 con 0x555ff6a5aa60 2023-12-11T20:23:30.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 -- 172.21.15.12:0/381947683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 msgr2=0x555ff6a5ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a5ae80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005950 tx=0x7f7dc40058e0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7dd959b700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7dc00a15a0 0x7f7dc00a3a60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4104570 tx=0x7f7dd0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 -- 172.21.15.12:0/381947683 shutdown_connections 2023-12-11T20:23:30.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a5c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a5ae80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/381947683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a5b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 -- 172.21.15.12:0/381947683 >> 172.21.15.12:0/381947683 conn(0x555ff69897e0 msgr2=0x555ff6a553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 -- 172.21.15.12:0/381947683 shutdown_connections 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.895+0000 7f7def1ffb80 1 -- 172.21.15.12:0/381947683 wait complete. 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.896+0000 7f7def1ffb80 1 -- start start 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.896+0000 7f7def1ffb80 1 Processor -- start 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.897+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.897+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a64900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.897+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.897+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff6968560 con 0x555ff6a5aa60 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.897+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff6968200 con 0x555ff6a5bde0 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.897+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff682d920 con 0x555ff6a5b3c0 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7def1ffb80 10 client.0 _ll_register_callbacks cb 0x555ff6893a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:30.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39438/0 (socket says 172.21.15.12:39438) 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd959b700 1 -- 172.21.15.12:0/1210430822 learned_addr learned my addr 172.21.15.12:0/1210430822 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a64900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd9d9c700 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd959b700 1 -- 172.21.15.12:0/1210430822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 msgr2=0x555ff6a64900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd959b700 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a64900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd959b700 1 -- 172.21.15.12:0/1210430822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 msgr2=0x555ff6a6b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd959b700 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd959b700 1 -- 172.21.15.12:0/1210430822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd410c2b0 con 0x555ff6a5aa60 2023-12-11T20:23:30.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.898+0000 7f7dd9d9c700 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:30.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.899+0000 7f7dd959b700 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a643c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7dd001ea40 tx=0x7f7dd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e522449bc507249e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.899+0000 7f7dbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.899+0000 7f7dbcff9700 1 -- 172.21.15.12:0/1210430822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0023070 con 0x555ff6a5aa60 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.899+0000 7f7def1ffb80 1 -- 172.21.15.12:0/1210430822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ff6a4d9e0 con 0x555ff6a5aa60 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.899+0000 7f7dbcff9700 1 -- 172.21.15.12:0/1210430822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7dd001ee00 con 0x555ff6a5aa60 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.899+0000 7f7dbcff9700 1 -- 172.21.15.12:0/1210430822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dd0017070 con 0x555ff6a5aa60 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.899+0000 7f7def1ffb80 10 client.17649 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.899+0000 7f7def1ffb80 1 -- 172.21.15.12:0/1210430822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555ff67d7de0 con 0x555ff6a5aa60 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.900+0000 7f7dbcff9700 1 -- 172.21.15.12:0/1210430822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ff6a4d9e0 con 0x555ff6a5aa60 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.900+0000 7f7dbcff9700 1 -- 172.21.15.12:0/1210430822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7dd0029940 con 0x555ff6a5aa60 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.900+0000 7f7def1ffb80 10 client.17649 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.900+0000 7f7def1ffb80 10 client.17649 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.900+0000 7f7def1ffb80 20 client.17649 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.900+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x555ff6a70290 0x555ff6a726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.900+0000 7f7def1ffb80 4 client.17649 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.900+0000 7f7def1ffb80 1 -- 172.21.15.12:0/1210430822 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ff6a29f40 con 0x555ff6a70290 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.901+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x555ff6a70290 0x555ff6a726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.901+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x555ff6a70290 0x555ff6a726b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43cb13e903e5487d server_cookie=812ab38cb03b1c26 in_seq=0 out_seq=0 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.901+0000 7f7dbcff9700 10 client.17649 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7dbcff9700 1 -- 172.21.15.12:0/1210430822 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555ff6a29f40 con 0x555ff6a70290 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7dbcff9700 10 client.17649 handle_command_reply: tid=0 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 client.17649 shutdown 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 -- 172.21.15.12:0/1210430822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 msgr2=0x555ff6a643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a643c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7dd001ea40 tx=0x7f7dd00047c0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 -- 172.21.15.12:0/1210430822 shutdown_connections 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x555ff6a70290 0x555ff6a726b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a643c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/1210430822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a64900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7dbcff9700 0 client.17649 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:23:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.902+0000 7f7def1ffb80 1 -- 172.21.15.12:0/1210430822 >> 172.21.15.12:0/1210430822 conn(0x555ff69897e0 msgr2=0x555ff6a59820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.903+0000 7f7def1ffb80 1 -- 172.21.15.12:0/1210430822 shutdown_connections 2023-12-11T20:23:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.903+0000 7f7def1ffb80 1 -- 172.21.15.12:0/1210430822 wait complete. 2023-12-11T20:23:30.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.903+0000 7f7def1ffb80 20 client.17649 trim_cache size 0 max 16384 2023-12-11T20:23:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7def1ffb80 1 Processor -- start 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7def1ffb80 1 -- start start 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a5c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff6a5c700 con 0x555ff6a5aa60 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff6a778e0 con 0x555ff6a5bde0 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff6a56700 con 0x555ff6a5b3c0 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7dd959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.917+0000 7f7dd959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39446/0 (socket says 172.21.15.12:39446) 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd959b700 1 -- 172.21.15.12:0/2835915379 learned_addr learned my addr 172.21.15.12:0/2835915379 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd9d9c700 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a5c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd959b700 1 -- 172.21.15.12:0/2835915379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 msgr2=0x555ff6a6b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd959b700 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd959b700 1 -- 172.21.15.12:0/2835915379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 msgr2=0x555ff6a5c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd959b700 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a5c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd959b700 1 -- 172.21.15.12:0/2835915379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ff67c0c60 con 0x555ff6a5aa60 2023-12-11T20:23:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.918+0000 7f7dd959b700 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a638d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0005a80 tx=0x7f7dd0005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b09fd484d9527f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.919+0000 7f7dbffff700 1 -- 172.21.15.12:0/2835915379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0023070 con 0x555ff6a5aa60 2023-12-11T20:23:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.919+0000 7f7dbffff700 1 -- 172.21.15.12:0/2835915379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7dd001e020 con 0x555ff6a5aa60 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.919+0000 7f7dbffff700 1 -- 172.21.15.12:0/2835915379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0004db0 con 0x555ff6a5aa60 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.919+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2835915379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 msgr2=0x555ff6a638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.919+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a638d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0005a80 tx=0x7f7dd0005dc0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.919+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2835915379 shutdown_connections 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.919+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a5c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.920+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5aa60 0x555ff6a638d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.920+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2835915379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.920+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2835915379 >> 172.21.15.12:0/2835915379 conn(0x555ff69897e0 msgr2=0x555ff6a62360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.920+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2835915379 shutdown_connections 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.920+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2835915379 wait complete. 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.920+0000 7f7def1ffb80 1 -- start start 2023-12-11T20:23:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.920+0000 7f7def1ffb80 1 Processor -- start 2023-12-11T20:23:30.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5aa60 0x555ff6a69e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7def1ffb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff6a6b040 con 0x555ff6a5b3c0 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff6a6b1b0 con 0x555ff6a5bde0 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7def1ffb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff6a6b370 con 0x555ff6a5aa60 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7def1ffb80 10 client.0 _ll_register_callbacks cb 0x555ff6893a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7dd8d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7dd959b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5aa60 0x555ff6a69e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7dd959b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5aa60 0x555ff6a69e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47278/0 (socket says 172.21.15.12:47278) 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7dd959b700 1 -- 172.21.15.12:0/2482349631 learned_addr learned my addr 172.21.15.12:0/2482349631 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.921+0000 7f7dd9d9c700 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dd959b700 1 -- 172.21.15.12:0/2482349631 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 msgr2=0x555ff6a6a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dd959b700 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dd959b700 1 -- 172.21.15.12:0/2482349631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5b3c0 msgr2=0x555ff6a6a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dd959b700 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dd959b700 1 -- 172.21.15.12:0/2482349631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ff67d7de0 con 0x555ff6a5aa60 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dd959b700 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5aa60 0x555ff6a69e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00097c0 tx=0x7f7dd0029420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a8beb6685e94513 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dbcff9700 1 -- 172.21.15.12:0/2482349631 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0023040 con 0x555ff6a5aa60 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2482349631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7dc40056c0 con 0x555ff6a5aa60 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.922+0000 7f7dbcff9700 1 -- 172.21.15.12:0/2482349631 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7dd0029820 con 0x555ff6a5aa60 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7dbcff9700 1 -- 172.21.15.12:0/2482349631 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dd0029a20 con 0x555ff6a5aa60 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7def1ffb80 10 client.27313 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2482349631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555ff67fe250 con 0x555ff6a5aa60 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7dbcff9700 1 -- 172.21.15.12:0/2482349631 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7dd004d020 con 0x555ff6a5aa60 2023-12-11T20:23:30.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7dbcff9700 1 -- 172.21.15.12:0/2482349631 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7dd0034750 con 0x555ff6a5aa60 2023-12-11T20:23:30.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7def1ffb80 10 client.27313 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:30.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7def1ffb80 10 client.27313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:23:30.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7def1ffb80 20 client.27313 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:30.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x555ff6ac7350 0x555ff6ac9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:30.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7def1ffb80 4 client.27313 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:23:30.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.923+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2482349631 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555ff6974fd0 con 0x555ff6ac7350 2023-12-11T20:23:30.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.924+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x555ff6ac7350 0x555ff6ac9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:30.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.924+0000 7f7dbcff9700 10 client.27313 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:23:30.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.924+0000 7f7dd8d9a700 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x555ff6ac7350 0x555ff6ac9770 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f9910de75e22479 server_cookie=eb60552e55732e84 in_seq=0 out_seq=0 2023-12-11T20:23:30.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.924+0000 7f7dbcff9700 1 -- 172.21.15.12:0/2482349631 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555ff6974fd0 con 0x555ff6ac7350 2023-12-11T20:23:30.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.924+0000 7f7dbcff9700 10 client.27313 handle_command_reply: tid=0 2023-12-11T20:23:30.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.924+0000 7f7def1ffb80 1 client.27313 shutdown 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2482349631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5aa60 msgr2=0x555ff6a69e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5aa60 0x555ff6a69e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00097c0 tx=0x7f7dd0029420 comp rx=0 tx=0).stop 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2482349631 shutdown_connections 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x555ff6ac7350 0x555ff6ac9770 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555ff6a5bde0 0x555ff6a6a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7dbcff9700 0 client.27313 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555ff6a5aa60 0x555ff6a69e50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 --2- 172.21.15.12:0/2482349631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555ff6a5b3c0 0x555ff6a6a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2482349631 >> 172.21.15.12:0/2482349631 conn(0x555ff69897e0 msgr2=0x555ff6a55320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2482349631 shutdown_connections 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 1 -- 172.21.15.12:0/2482349631 wait complete. 2023-12-11T20:23:30.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.925+0000 7f7def1ffb80 20 client.27313 trim_cache size 0 max 16384 2023-12-11T20:23:30.928 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:23:30.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 -- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7dc00a15a0 msgr2=0x7f7dc00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7dc00a15a0 0x7f7dc00a3a60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4104570 tx=0x7f7dd0009260 comp rx=0 tx=0).stop 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 -- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd41050b0 msgr2=0x7f7dd41a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd41050b0 0x7f7dd41a0820 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc007ee0 tx=0x7f7dcc00d3b0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 -- 172.21.15.12:0/234267787 shutdown_connections 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7dc00a15a0 0x7f7dc00a3a60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4103520 0x7f7dd41992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dd41050b0 0x7f7dd41a0820 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 --2- 172.21.15.12:0/234267787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dd4104710 0x7f7dd4199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 -- 172.21.15.12:0/234267787 >> 172.21.15.12:0/234267787 conn(0x7f7dd40fea70 msgr2=0x7f7dd4107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 -- 172.21.15.12:0/234267787 shutdown_connections 2023-12-11T20:23:30.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:30.926+0000 7f7dda59d700 1 -- 172.21.15.12:0/234267787 wait complete. 2023-12-11T20:23:30.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:23:31.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 -- 172.21.15.12:0/453723883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 msgr2=0x7f4420106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 --2- 172.21.15.12:0/453723883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 0x7f4420106ca0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4410009990 tx=0x7f4410009ca0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 -- 172.21.15.12:0/453723883 shutdown_connections 2023-12-11T20:23:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 --2- 172.21.15.12:0/453723883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4420101f80 0x7f4420104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 --2- 172.21.15.12:0/453723883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44201071e0 0x7f4420109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 --2- 172.21.15.12:0/453723883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 0x7f4420106ca0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 -- 172.21.15.12:0/453723883 >> 172.21.15.12:0/453723883 conn(0x7f44200fb930 msgr2=0x7f44200fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 -- 172.21.15.12:0/453723883 shutdown_connections 2023-12-11T20:23:31.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.171+0000 7f44275ff700 1 -- 172.21.15.12:0/453723883 wait complete. 2023-12-11T20:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f44275ff700 1 Processor -- start 2023-12-11T20:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f44275ff700 1 -- start start 2023-12-11T20:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f44275ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4420101f80 0x7f44201018a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f44275ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 0x7f44200fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f44275ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44201071e0 0x7f4420100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f44275ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420100c10 con 0x7f44201048b0 2023-12-11T20:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f44275ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420100d80 con 0x7f4420101f80 2023-12-11T20:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f44275ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201a13a0 con 0x7f44201071e0 2023-12-11T20:23:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.173+0000 7f4424b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 0x7f44200fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4424b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 0x7f44200fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39476/0 (socket says 172.21.15.12:39476) 2023-12-11T20:23:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4424b9a700 1 -- 172.21.15.12:0/2246678579 learned_addr learned my addr 172.21.15.12:0/2246678579 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f442539b700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4420101f80 0x7f44201018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4425b9c700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44201071e0 0x7f4420100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4424b9a700 1 -- 172.21.15.12:0/2246678579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44201071e0 msgr2=0x7f4420100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4424b9a700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44201071e0 0x7f4420100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4424b9a700 1 -- 172.21.15.12:0/2246678579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4420101f80 msgr2=0x7f44201018a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4424b9a700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4420101f80 0x7f44201018a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4424b9a700 1 -- 172.21.15.12:0/2246678579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100095f0 con 0x7f44201048b0 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.174+0000 7f4424b9a700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 0x7f44200fff30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f441000b2e0 tx=0x7f4410004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.175+0000 7f44167fc700 1 -- 172.21.15.12:0/2246678579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441001d070 con 0x7f44201048b0 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.175+0000 7f44167fc700 1 -- 172.21.15.12:0/2246678579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f441000beb0 con 0x7f44201048b0 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.175+0000 7f44275ff700 1 -- 172.21.15.12:0/2246678579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44201a15d0 con 0x7f44201048b0 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.175+0000 7f44167fc700 1 -- 172.21.15.12:0/2246678579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410021410 con 0x7f44201048b0 2023-12-11T20:23:31.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.175+0000 7f44275ff700 1 -- 172.21.15.12:0/2246678579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44201a1990 con 0x7f44201048b0 2023-12-11T20:23:31.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.179+0000 7f44167fc700 1 -- 172.21.15.12:0/2246678579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f441000f640 con 0x7f44201048b0 2023-12-11T20:23:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.180+0000 7f443ae48b80 1 Processor -- start 2023-12-11T20:23:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.180+0000 7f443ae48b80 1 -- start start 2023-12-11T20:23:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.180+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d23d0 0x55b5873d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.180+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d2d30 0x55b5873d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.180+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.180+0000 7f443ae48b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58732db50 con 0x55b5873d3c20 2023-12-11T20:23:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.180+0000 7f443ae48b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58732b470 con 0x55b5873d2d30 2023-12-11T20:23:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.181+0000 7f443ae48b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b587326d60 con 0x55b5873d23d0 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.181+0000 7f442539b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d2d30 0x55b5873d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.181+0000 7f4424b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.181+0000 7f4425b9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d23d0 0x55b5873d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.181+0000 7f442539b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d2d30 0x55b5873d3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:39502/0 (socket says 172.21.15.12:39502) 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.181+0000 7f442539b700 1 -- 172.21.15.12:0/916128649 learned_addr learned my addr 172.21.15.12:0/916128649 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.181+0000 7f44167fc700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f440c0a1480 0x7f440c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.181+0000 7f44167fc700 1 -- 172.21.15.12:0/2246678579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f44100ce1c0 con 0x7f44201048b0 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f442539b700 1 -- 172.21.15.12:0/916128649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d23d0 msgr2=0x55b5873d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f442539b700 1 --2- 172.21.15.12:0/916128649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d23d0 0x55b5873d27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f442539b700 1 -- 172.21.15.12:0/916128649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 msgr2=0x55b5873d40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f442539b700 1 --2- 172.21.15.12:0/916128649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873d40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f4425b9c700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f440c0a1480 0x7f440c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f442539b700 1 -- 172.21.15.12:0/916128649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5871a3630 con 0x55b5873d2d30 2023-12-11T20:23:31.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f442539b700 1 --2- 172.21.15.12:0/916128649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d2d30 0x55b5873d3640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f441c007d70 tx=0x7f441c0106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d30326439b86e8e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:31.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f4425b9c700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f440c0a1480 0x7f440c0a3940 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f44180075c0 tx=0x7f4418004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f440b7fe700 1 -- 172.21.15.12:0/916128649 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c010e10 con 0x55b5873d2d30 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f440b7fe700 1 -- 172.21.15.12:0/916128649 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f441c015070 con 0x55b5873d2d30 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.182+0000 7f440b7fe700 1 -- 172.21.15.12:0/916128649 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c003dc0 con 0x55b5873d2d30 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 -- 172.21.15.12:0/916128649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d2d30 msgr2=0x55b5873d3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 --2- 172.21.15.12:0/916128649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d2d30 0x55b5873d3640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f441c007d70 tx=0x7f441c0106b0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 -- 172.21.15.12:0/916128649 shutdown_connections 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 --2- 172.21.15.12:0/916128649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873d40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 --2- 172.21.15.12:0/916128649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d23d0 0x55b5873d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 --2- 172.21.15.12:0/916128649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d2d30 0x55b5873d3640 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 -- 172.21.15.12:0/916128649 >> 172.21.15.12:0/916128649 conn(0x55b5873017e0 msgr2=0x55b5873ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 -- 172.21.15.12:0/916128649 shutdown_connections 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.183+0000 7f443ae48b80 1 -- 172.21.15.12:0/916128649 wait complete. 2023-12-11T20:23:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.184+0000 7f443ae48b80 1 -- start start 2023-12-11T20:23:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.184+0000 7f443ae48b80 1 Processor -- start 2023-12-11T20:23:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d2d30 0x55b5873dc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873e3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f443ae48b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5872e0560 con 0x55b5873d3c20 2023-12-11T20:23:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f443ae48b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5872e0200 con 0x55b5873d23d0 2023-12-11T20:23:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f443ae48b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5871a5920 con 0x55b5873d2d30 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f443ae48b80 10 client.0 _ll_register_callbacks cb 0x55b58720ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4425b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4425b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873e3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39492/0 (socket says 172.21.15.12:39492) 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4425b9c700 1 -- 172.21.15.12:0/379838999 learned_addr learned my addr 172.21.15.12:0/379838999 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4424b9a700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d2d30 0x55b5873dc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f442539b700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4424b9a700 1 -- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 msgr2=0x55b5873dc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4424b9a700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4424b9a700 1 -- 172.21.15.12:0/379838999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 msgr2=0x55b5873e3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4424b9a700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873e3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4424b9a700 1 -- 172.21.15.12:0/379838999 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c0079a0 con 0x55b5873d2d30 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f442539b700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.185+0000 7f4425b9c700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.186+0000 7f4424b9a700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d2d30 0x55b5873dc6e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f441009b1c0 tx=0x7f4410097590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec7bd594ba1a7f22 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.186+0000 7f4408ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:23:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.186+0000 7f4408ff9700 1 -- 172.21.15.12:0/379838999 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441009abb0 con 0x55b5873d2d30 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.186+0000 7f443ae48b80 1 -- 172.21.15.12:0/379838999 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5873c5b40 con 0x55b5873d2d30 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.186+0000 7f4408ff9700 1 -- 172.21.15.12:0/379838999 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f441000f460 con 0x55b5873d2d30 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.186+0000 7f4408ff9700 1 -- 172.21.15.12:0/379838999 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f441009b290 con 0x55b5873d2d30 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.186+0000 7f443ae48b80 10 client.27325 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.186+0000 7f443ae48b80 1 -- 172.21.15.12:0/379838999 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b58714fde0 con 0x55b5873d2d30 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.187+0000 7f4408ff9700 1 -- 172.21.15.12:0/379838999 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b5873c5b40 con 0x55b5873d2d30 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.187+0000 7f4408ff9700 1 -- 172.21.15.12:0/379838999 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f44100b1020 con 0x55b5873d2d30 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.187+0000 7f443ae48b80 10 client.27325 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.187+0000 7f443ae48b80 10 client.27325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.187+0000 7f443ae48b80 20 client.27325 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.187+0000 7f443ae48b80 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b5873e7d20 0x55b5873ea110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.187+0000 7f443ae48b80 4 client.27325 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.187+0000 7f443ae48b80 1 -- 172.21.15.12:0/379838999 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5873a1f40 con 0x55b5873e7d20 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.188+0000 7f442539b700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b5873e7d20 0x55b5873ea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.188+0000 7f442539b700 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b5873e7d20 0x55b5873ea110 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f80e914ea8953e6b server_cookie=d2472b4233b8af42 in_seq=0 out_seq=0 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.188+0000 7f4408ff9700 10 client.27325 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f4408ff9700 1 -- 172.21.15.12:0/379838999 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b5873a1f40 con 0x55b5873e7d20 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f4408ff9700 10 client.27325 handle_command_reply: tid=0 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 client.27325 shutdown 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 -- 172.21.15.12:0/379838999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d2d30 msgr2=0x55b5873dc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d2d30 0x55b5873dc6e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f441009b1c0 tx=0x7f4410097590 comp rx=0 tx=0).stop 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 -- 172.21.15.12:0/379838999 shutdown_connections 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b5873e7d20 0x55b5873ea110 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f4408ff9700 0 client.27325 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:31.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d3c20 0x55b5873e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 --2- 172.21.15.12:0/379838999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d2d30 0x55b5873dc6e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.189+0000 7f443ae48b80 1 -- 172.21.15.12:0/379838999 >> 172.21.15.12:0/379838999 conn(0x55b5873017e0 msgr2=0x55b5873cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:31.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.190+0000 7f443ae48b80 1 -- 172.21.15.12:0/379838999 shutdown_connections 2023-12-11T20:23:31.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.190+0000 7f443ae48b80 1 -- 172.21.15.12:0/379838999 wait complete. 2023-12-11T20:23:31.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.190+0000 7f443ae48b80 20 client.27325 trim_cache size 0 max 16384 2023-12-11T20:23:31.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f443ae48b80 1 Processor -- start 2023-12-11T20:23:31.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f443ae48b80 1 -- start start 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873d4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873d6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f443ae48b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5873dbd30 con 0x55b5873d2d30 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f443ae48b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5873dd0a0 con 0x55b5873d23d0 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f443ae48b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5873e48a0 con 0x55b5873d3c20 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f4424b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f4424b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873e36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39508/0 (socket says 172.21.15.12:39508) 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.204+0000 7f4424b9a700 1 -- 172.21.15.12:0/3673105993 learned_addr learned my addr 172.21.15.12:0/3673105993 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f4425b9c700 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873d6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f442539b700 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f4424b9a700 1 -- 172.21.15.12:0/3673105993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 msgr2=0x55b5873d6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:31.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f4424b9a700 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873d6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f4424b9a700 1 -- 172.21.15.12:0/3673105993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 msgr2=0x55b5873d4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:31.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f4424b9a700 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873d4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f4424b9a700 1 -- 172.21.15.12:0/3673105993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b587138c60 con 0x55b5873d2d30 2023-12-11T20:23:31.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f442539b700 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873d4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:31.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f4424b9a700 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873e36e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4410097ee0 tx=0x7f4410097200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cacb451ca32852e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:31.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.205+0000 7f440bfff700 1 -- 172.21.15.12:0/3673105993 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441009ae20 con 0x55b5873d2d30 2023-12-11T20:23:31.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f440bfff700 1 -- 172.21.15.12:0/3673105993 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f441009b290 con 0x55b5873d2d30 2023-12-11T20:23:31.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f440bfff700 1 -- 172.21.15.12:0/3673105993 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441009abf0 con 0x55b5873d2d30 2023-12-11T20:23:31.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f443ae48b80 1 -- 172.21.15.12:0/3673105993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 msgr2=0x55b5873e36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f443ae48b80 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873e36e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4410097ee0 tx=0x7f4410097200 comp rx=0 tx=0).stop 2023-12-11T20:23:31.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f443ae48b80 1 -- 172.21.15.12:0/3673105993 shutdown_connections 2023-12-11T20:23:31.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f443ae48b80 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873d4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f443ae48b80 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873d6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f443ae48b80 1 --2- 172.21.15.12:0/3673105993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873e36e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.206+0000 7f443ae48b80 1 -- 172.21.15.12:0/3673105993 >> 172.21.15.12:0/3673105993 conn(0x55b5873017e0 msgr2=0x55b5873dc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.207+0000 7f443ae48b80 1 -- 172.21.15.12:0/3673105993 shutdown_connections 2023-12-11T20:23:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.207+0000 7f443ae48b80 1 -- 172.21.15.12:0/3673105993 wait complete. 2023-12-11T20:23:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.207+0000 7f443ae48b80 1 -- start start 2023-12-11T20:23:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.207+0000 7f443ae48b80 1 Processor -- start 2023-12-11T20:23:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873df190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f443ae48b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873e2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f443ae48b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5873e26a0 con 0x55b5873d2d30 2023-12-11T20:23:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f443ae48b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5873e2810 con 0x55b5873d23d0 2023-12-11T20:23:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f443ae48b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5873e29d0 con 0x55b5873d3c20 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f443ae48b80 10 client.0 _ll_register_callbacks cb 0x55b58720ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f4424b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f4424b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873df190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39524/0 (socket says 172.21.15.12:39524) 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f442539b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f4424b9a700 1 -- 172.21.15.12:0/1543606859 learned_addr learned my addr 172.21.15.12:0/1543606859 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.208+0000 7f4425b9c700 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4424b9a700 1 -- 172.21.15.12:0/1543606859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 msgr2=0x55b5873e2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4424b9a700 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873e2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4424b9a700 1 -- 172.21.15.12:0/1543606859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 msgr2=0x55b5873dec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4424b9a700 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4424b9a700 1 -- 172.21.15.12:0/1543606859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b58714fde0 con 0x55b5873d2d30 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f442539b700 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4425b9c700 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4424b9a700 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873df190 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f44100a3290 tx=0x7f44100a35c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2324d54601fadf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4408ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4408ff9700 1 -- 172.21.15.12:0/1543606859 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441009ae20 con 0x55b5873d2d30 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f4408ff9700 1 -- 172.21.15.12:0/1543606859 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f44100a37c0 con 0x55b5873d2d30 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.209+0000 7f443ae48b80 1 -- 172.21.15.12:0/1543606859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f441c015070 con 0x55b5873d2d30 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f4408ff9700 1 -- 172.21.15.12:0/1543606859 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f441009f360 con 0x55b5873d2d30 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f443ae48b80 10 client.17673 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f443ae48b80 1 -- 172.21.15.12:0/1543606859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b587176250 con 0x55b5873d2d30 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f4408ff9700 1 -- 172.21.15.12:0/1543606859 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f441c015070 con 0x55b5873d2d30 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f4408ff9700 1 -- 172.21.15.12:0/1543606859 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f44100a1430 con 0x55b5873d2d30 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f443ae48b80 10 client.17673 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f443ae48b80 10 client.17673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f443ae48b80 20 client.17673 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f443ae48b80 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b58743e1a0 0x55b587440590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f443ae48b80 4 client.17673 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:23:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f443ae48b80 1 -- 172.21.15.12:0/1543606859 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b5872ecfd0 con 0x55b58743e1a0 2023-12-11T20:23:31.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.210+0000 7f442539b700 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b58743e1a0 0x55b587440590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.211+0000 7f442539b700 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b58743e1a0 0x55b587440590 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60246e85ef17edf3 server_cookie=7e0b8155d2842e65 in_seq=0 out_seq=0 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.211+0000 7f4408ff9700 10 client.17673 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.211+0000 7f4408ff9700 1 -- 172.21.15.12:0/1543606859 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b5872ecfd0 con 0x55b58743e1a0 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.211+0000 7f4408ff9700 10 client.17673 handle_command_reply: tid=0 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.211+0000 7f443ae48b80 1 client.17673 shutdown 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.211+0000 7f443ae48b80 1 -- 172.21.15.12:0/1543606859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 msgr2=0x55b5873df190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.211+0000 7f443ae48b80 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873df190 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f44100a3290 tx=0x7f44100a35c0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 1 -- 172.21.15.12:0/1543606859 shutdown_connections 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b58743e1a0 0x55b587440590 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b5873d23d0 0x55b5873dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b5873d3c20 0x55b5873e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 1 --2- 172.21.15.12:0/1543606859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5873d2d30 0x55b5873df190 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 1 -- 172.21.15.12:0/1543606859 >> 172.21.15.12:0/1543606859 conn(0x55b5873017e0 msgr2=0x55b5873ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f4408ff9700 0 client.17673 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 1 -- 172.21.15.12:0/1543606859 shutdown_connections 2023-12-11T20:23:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 1 -- 172.21.15.12:0/1543606859 wait complete. 2023-12-11T20:23:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f443ae48b80 20 client.17673 trim_cache size 0 max 16384 2023-12-11T20:23:31.214 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f44275ff700 1 -- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f440c0a1480 msgr2=0x7f440c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f44275ff700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f440c0a1480 0x7f440c0a3940 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f44180075c0 tx=0x7f4418004b40 comp rx=0 tx=0).stop 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f44275ff700 1 -- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 msgr2=0x7f44200fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.212+0000 7f44275ff700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 0x7f44200fff30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f441000b2e0 tx=0x7f4410004730 comp rx=0 tx=0).stop 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.213+0000 7f44275ff700 1 -- 172.21.15.12:0/2246678579 shutdown_connections 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.213+0000 7f44275ff700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f440c0a1480 0x7f440c0a3940 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.213+0000 7f44275ff700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4420101f80 0x7f44201018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.213+0000 7f44275ff700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44201071e0 0x7f4420100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.213+0000 7f44275ff700 1 --2- 172.21.15.12:0/2246678579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44201048b0 0x7f44200fff30 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.213+0000 7f44275ff700 1 -- 172.21.15.12:0/2246678579 >> 172.21.15.12:0/2246678579 conn(0x7f44200fb930 msgr2=0x7f4420102980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.213+0000 7f44275ff700 1 -- 172.21.15.12:0/2246678579 shutdown_connections 2023-12-11T20:23:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:31.213+0000 7f44275ff700 1 -- 172.21.15.12:0/2246678579 wait complete. 2023-12-11T20:23:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:31 smithi012 ceph-mon[128787]: pgmap v603: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:23:31.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:31 smithi032 ceph-mon[132488]: pgmap v603: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:23:31.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:31 smithi039 ceph-mon[102205]: pgmap v603: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:23:32.231 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:23:32.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:23:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 -- 172.21.15.12:0/3807669187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c101f80 msgr2=0x7fcc3c104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 --2- 172.21.15.12:0/3807669187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c101f80 0x7fcc3c104370 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009990 tx=0x7fcc30009ca0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 -- 172.21.15.12:0/3807669187 shutdown_connections 2023-12-11T20:23:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 --2- 172.21.15.12:0/3807669187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc3c1071e0 0x7fcc3c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 --2- 172.21.15.12:0/3807669187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c101f80 0x7fcc3c104370 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 --2- 172.21.15.12:0/3807669187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc3c1048b0 0x7fcc3c106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 -- 172.21.15.12:0/3807669187 >> 172.21.15.12:0/3807669187 conn(0x7fcc3c0fb930 msgr2=0x7fcc3c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 -- 172.21.15.12:0/3807669187 shutdown_connections 2023-12-11T20:23:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.471+0000 7fcc431ff700 1 -- 172.21.15.12:0/3807669187 wait complete. 2023-12-11T20:23:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.472+0000 7fcc431ff700 1 Processor -- start 2023-12-11T20:23:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.472+0000 7fcc431ff700 1 -- start start 2023-12-11T20:23:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc431ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc3c101f80 0x7fcc3c1018a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc431ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c1048b0 0x7fcc3c0fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc431ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc3c1071e0 0x7fcc3c100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc431ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c19b1e0 con 0x7fcc3c1048b0 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc431ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c1009b0 con 0x7fcc3c1071e0 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc431ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c100b70 con 0x7fcc3c101f80 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c1048b0 0x7fcc3c0fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c1048b0 0x7fcc3c0fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39544/0 (socket says 172.21.15.12:39544) 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc3bfff700 1 -- 172.21.15.12:0/1167322037 learned_addr learned my addr 172.21.15.12:0/1167322037 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc3c101f80 0x7fcc3c1018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc4179c700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc3c1071e0 0x7fcc3c100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc3bfff700 1 -- 172.21.15.12:0/1167322037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc3c101f80 msgr2=0x7fcc3c1018a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.473+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc3c101f80 0x7fcc3c1018a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc3bfff700 1 -- 172.21.15.12:0/1167322037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc3c1071e0 msgr2=0x7fcc3c100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc3c1071e0 0x7fcc3c100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc3bfff700 1 -- 172.21.15.12:0/1167322037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300095f0 con 0x7fcc3c1048b0 2023-12-11T20:23:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc3c101f80 0x7fcc3c1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c1048b0 0x7fcc3c0fff30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800d950 tx=0x7fcc2800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc39ffb700 1 -- 172.21.15.12:0/1167322037 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800f890 con 0x7fcc3c1048b0 2023-12-11T20:23:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc39ffb700 1 -- 172.21.15.12:0/1167322037 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc2800fe80 con 0x7fcc3c1048b0 2023-12-11T20:23:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc431ff700 1 -- 172.21.15.12:0/1167322037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3c1a5b90 con 0x7fcc3c1048b0 2023-12-11T20:23:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc39ffb700 1 -- 172.21.15.12:0/1167322037 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800e3b0 con 0x7fcc3c1048b0 2023-12-11T20:23:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.474+0000 7fcc431ff700 1 -- 172.21.15.12:0/1167322037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3c1a5fb0 con 0x7fcc3c1048b0 2023-12-11T20:23:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.479+0000 7fcc39ffb700 1 -- 172.21.15.12:0/1167322037 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcc28010460 con 0x7fcc3c1048b0 2023-12-11T20:23:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.480+0000 7fcc56beab80 1 Processor -- start 2023-12-11T20:23:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.480+0000 7fcc56beab80 1 -- start start 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.480+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc0125870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.480+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc01266c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.480+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc0127120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.480+0000 7fcc56beab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc0080bd0 con 0x558bc0125db0 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.480+0000 7fcc56beab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc007e4f0 con 0x558bc0125450 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.480+0000 7fcc56beab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc0079de0 con 0x558bc0126ca0 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc40f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc01266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc40f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc01266c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39552/0 (socket says 172.21.15.12:39552) 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc40f9b700 1 -- 172.21.15.12:0/11654542 learned_addr learned my addr 172.21.15.12:0/11654542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc0127120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc4179c700 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc0125870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc4179c700 1 -- 172.21.15.12:0/11654542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 msgr2=0x558bc0127120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc4179c700 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc0127120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc4179c700 1 -- 172.21.15.12:0/11654542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 msgr2=0x558bc01266c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc4179c700 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc01266c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.481+0000 7fcc4179c700 1 -- 172.21.15.12:0/11654542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bbfef66b0 con 0x558bc0125450 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.482+0000 7fcc39ffb700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc2c0a1500 0x7fcc2c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.482+0000 7fcc4179c700 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc0125870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc34003e90 tx=0x7fcc34009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=169cab71b5053dcd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.482+0000 7fcc39ffb700 1 -- 172.21.15.12:0/1167322037 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc280cca90 con 0x7fcc3c1048b0 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.482+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc2c0a1500 0x7fcc2c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.482+0000 7fcc26ffd700 1 -- 172.21.15.12:0/11654542 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34019070 con 0x558bc0125450 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.482+0000 7fcc26ffd700 1 -- 172.21.15.12:0/11654542 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc3400f040 con 0x558bc0125450 2023-12-11T20:23:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.482+0000 7fcc26ffd700 1 -- 172.21.15.12:0/11654542 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc340078a0 con 0x558bc0125450 2023-12-11T20:23:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 -- 172.21.15.12:0/11654542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 msgr2=0x558bc0125870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc0125870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc34003e90 tx=0x7fcc34009c20 comp rx=0 tx=0).stop 2023-12-11T20:23:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc2c0a1500 0x7fcc2c0a39c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c010 tx=0x7fcc30005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 -- 172.21.15.12:0/11654542 shutdown_connections 2023-12-11T20:23:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc0125870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc0127120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 --2- 172.21.15.12:0/11654542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc01266c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 -- 172.21.15.12:0/11654542 >> 172.21.15.12:0/11654542 conn(0x558bc0054860 msgr2=0x558bc0121e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 -- 172.21.15.12:0/11654542 shutdown_connections 2023-12-11T20:23:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.483+0000 7fcc56beab80 1 -- 172.21.15.12:0/11654542 wait complete. 2023-12-11T20:23:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.484+0000 7fcc56beab80 1 -- start start 2023-12-11T20:23:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.484+0000 7fcc56beab80 1 Processor -- start 2023-12-11T20:23:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc012f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc01367e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc56beab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc00335e0 con 0x558bc0125db0 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc56beab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc0033280 con 0x558bc0125450 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc56beab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bbfef89a0 con 0x558bc0126ca0 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc56beab80 10 client.0 _ll_register_callbacks cb 0x558bbff5eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39562/0 (socket says 172.21.15.12:39562) 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc4179c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc01367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc3bfff700 1 -- 172.21.15.12:0/751058700 learned_addr learned my addr 172.21.15.12:0/751058700 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.485+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc012f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc3bfff700 1 -- 172.21.15.12:0/751058700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 msgr2=0x558bc01367e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc01367e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc3bfff700 1 -- 172.21.15.12:0/751058700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 msgr2=0x558bc012f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc012f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc3bfff700 1 -- 172.21.15.12:0/751058700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc34003ac0 con 0x558bc0125db0 2023-12-11T20:23:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f7a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcc28010710 tx=0x7fcc28099b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200057abecf6be32 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc1bfff700 1 -- 172.21.15.12:0/751058700 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28099450 con 0x558bc0125db0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc56beab80 1 -- 172.21.15.12:0/751058700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bc0118bc0 con 0x558bc0125db0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.486+0000 7fcc1bfff700 1 -- 172.21.15.12:0/751058700 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc28010760 con 0x558bc0125db0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc1bfff700 1 -- 172.21.15.12:0/751058700 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc280996c0 con 0x558bc0125db0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc56beab80 10 client.17685 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc56beab80 1 -- 172.21.15.12:0/751058700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558bbfea2e60 con 0x558bc0125db0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc1bfff700 1 -- 172.21.15.12:0/751058700 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558bc0118bc0 con 0x558bc0125db0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc1bfff700 1 -- 172.21.15.12:0/751058700 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc280a1c60 con 0x558bc0125db0 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc56beab80 10 client.17685 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc56beab80 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc56beab80 20 client.17685 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc56beab80 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558bc013b030 0x558bc013d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc56beab80 4 client.17685 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:32.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.487+0000 7fcc56beab80 1 -- 172.21.15.12:0/751058700 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558bc00f4fc0 con 0x558bc013b030 2023-12-11T20:23:32.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.488+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558bc013b030 0x558bc013d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.488+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558bc013b030 0x558bc013d450 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2bd631f547b2e43 server_cookie=c265843e24074bd0 in_seq=0 out_seq=0 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.488+0000 7fcc1bfff700 10 client.17685 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc1bfff700 1 -- 172.21.15.12:0/751058700 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558bc00f4fc0 con 0x558bc013b030 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc1bfff700 10 client.17685 handle_command_reply: tid=0 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 client.17685 shutdown 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 -- 172.21.15.12:0/751058700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 msgr2=0x558bc012f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f7a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcc28010710 tx=0x7fcc28099b30 comp rx=0 tx=0).stop 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 -- 172.21.15.12:0/751058700 shutdown_connections 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558bc013b030 0x558bc013d450 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125450 0x558bc012f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc01367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 --2- 172.21.15.12:0/751058700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f7a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc1bfff700 0 client.17685 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:32.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.489+0000 7fcc56beab80 1 -- 172.21.15.12:0/751058700 >> 172.21.15.12:0/751058700 conn(0x558bc0054860 msgr2=0x558bc0120ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.490+0000 7fcc56beab80 1 -- 172.21.15.12:0/751058700 shutdown_connections 2023-12-11T20:23:32.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.490+0000 7fcc56beab80 1 -- 172.21.15.12:0/751058700 wait complete. 2023-12-11T20:23:32.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.490+0000 7fcc56beab80 20 client.17685 trim_cache size 0 max 16384 2023-12-11T20:23:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.515+0000 7fcc56beab80 1 Processor -- start 2023-12-11T20:23:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc56beab80 1 -- start start 2023-12-11T20:23:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0125450 0x558bc012f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0126ca0 0x558bc01367a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc56beab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc012edd0 con 0x558bc0125db0 2023-12-11T20:23:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc56beab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc0118950 con 0x558bc0126ca0 2023-12-11T20:23:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc56beab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc011cbd0 con 0x558bc0125450 2023-12-11T20:23:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39576/0 (socket says 172.21.15.12:39576) 2023-12-11T20:23:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc3bfff700 1 -- 172.21.15.12:0/2674213031 learned_addr learned my addr 172.21.15.12:0/2674213031 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.516+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0125450 0x558bc012f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc3bfff700 1 -- 172.21.15.12:0/2674213031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0125450 msgr2=0x558bc012f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0125450 0x558bc012f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc4179c700 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0126ca0 0x558bc01367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc3bfff700 1 -- 172.21.15.12:0/2674213031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0126ca0 msgr2=0x558bc01367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0126ca0 0x558bc01367a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc3bfff700 1 -- 172.21.15.12:0/2674213031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bbfe8bce0 con 0x558bc0125db0 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc4179c700 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0126ca0 0x558bc01367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f760 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcc28010b10 tx=0x7fcc28000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfa2da0efae6a31 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc277fe700 1 -- 172.21.15.12:0/2674213031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280adb40 con 0x558bc0125db0 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc277fe700 1 -- 172.21.15.12:0/2674213031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc28010760 con 0x558bc0125db0 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.517+0000 7fcc277fe700 1 -- 172.21.15.12:0/2674213031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2809df40 con 0x558bc0125db0 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 -- 172.21.15.12:0/2674213031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 msgr2=0x558bc012f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f760 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcc28010b10 tx=0x7fcc28000bc0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 -- 172.21.15.12:0/2674213031 shutdown_connections 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0126ca0 0x558bc01367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0125450 0x558bc012f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 --2- 172.21.15.12:0/2674213031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125db0 0x558bc012f760 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 -- 172.21.15.12:0/2674213031 >> 172.21.15.12:0/2674213031 conn(0x558bc0054860 msgr2=0x558bc0129c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 -- 172.21.15.12:0/2674213031 shutdown_connections 2023-12-11T20:23:32.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.518+0000 7fcc56beab80 1 -- 172.21.15.12:0/2674213031 wait complete. 2023-12-11T20:23:32.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 1 -- start start 2023-12-11T20:23:32.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 1 Processor -- start 2023-12-11T20:23:32.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125450 0x558bc0135420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125db0 0x558bc0135980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc0191540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc0136220 con 0x558bc0125450 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc0191a80 con 0x558bc0125db0 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bc0191bc0 con 0x558bc0126ca0 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.519+0000 7fcc56beab80 10 client.0 _ll_register_callbacks cb 0x558bbff5eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125450 0x558bc0135420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125450 0x558bc0135420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39580/0 (socket says 172.21.15.12:39580) 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 -- 172.21.15.12:0/3473928736 learned_addr learned my addr 172.21.15.12:0/3473928736 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125db0 0x558bc0135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc4179c700 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc0191540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 -- 172.21.15.12:0/3473928736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 msgr2=0x558bc0191540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc0191540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 -- 172.21.15.12:0/3473928736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125db0 msgr2=0x558bc0135980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125db0 0x558bc0135980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 -- 172.21.15.12:0/3473928736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558bbfea2e60 con 0x558bc0125450 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc40f9b700 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125450 0x558bc0135420 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcc30000c00 tx=0x7fcc30009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29624047bd4bd8ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.520+0000 7fcc1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.521+0000 7fcc1bfff700 1 -- 172.21.15.12:0/3473928736 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30004ba0 con 0x558bc0125450 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.521+0000 7fcc1bfff700 1 -- 172.21.15.12:0/3473928736 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc30004d00 con 0x558bc0125450 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.521+0000 7fcc56beab80 1 -- 172.21.15.12:0/3473928736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc3400f040 con 0x558bc0125450 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.521+0000 7fcc1bfff700 1 -- 172.21.15.12:0/3473928736 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc30034050 con 0x558bc0125450 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.521+0000 7fcc56beab80 10 client.17691 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.521+0000 7fcc56beab80 1 -- 172.21.15.12:0/3473928736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558bbfec92d0 con 0x558bc0125450 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.521+0000 7fcc1bfff700 1 -- 172.21.15.12:0/3473928736 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc3400f040 con 0x558bc0125450 2023-12-11T20:23:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.521+0000 7fcc1bfff700 1 -- 172.21.15.12:0/3473928736 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc300039c0 con 0x558bc0125450 2023-12-11T20:23:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.522+0000 7fcc56beab80 10 client.17691 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.522+0000 7fcc56beab80 10 client.17691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.522+0000 7fcc56beab80 20 client.17691 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.522+0000 7fcc56beab80 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558bc0193610 0x558bc0195a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.522+0000 7fcc56beab80 4 client.17691 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:23:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.522+0000 7fcc56beab80 1 -- 172.21.15.12:0/3473928736 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558bc0040050 con 0x558bc0193610 2023-12-11T20:23:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.522+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558bc0193610 0x558bc0195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.523+0000 7fcc1bfff700 10 client.17691 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.523+0000 7fcc3bfff700 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558bc0193610 0x558bc0195a30 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb2f31c1c21e7bde server_cookie=bbb2379df3fcbb64 in_seq=0 out_seq=0 2023-12-11T20:23:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc1bfff700 1 -- 172.21.15.12:0/3473928736 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558bc0040050 con 0x558bc0193610 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc1bfff700 10 client.17691 handle_command_reply: tid=0 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 client.17691 shutdown 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 -- 172.21.15.12:0/3473928736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125450 msgr2=0x558bc0135420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125450 0x558bc0135420 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcc30000c00 tx=0x7fcc30009310 comp rx=0 tx=0).stop 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 -- 172.21.15.12:0/3473928736 shutdown_connections 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558bc0193610 0x558bc0195a30 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558bc0126ca0 0x558bc0191540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc0125450 0x558bc0135420 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc1bfff700 0 client.17691 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 --2- 172.21.15.12:0/3473928736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558bc0125db0 0x558bc0135980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 -- 172.21.15.12:0/3473928736 >> 172.21.15.12:0/3473928736 conn(0x558bc0054860 msgr2=0x558bc0129c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 -- 172.21.15.12:0/3473928736 shutdown_connections 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.524+0000 7fcc56beab80 1 -- 172.21.15.12:0/3473928736 wait complete. 2023-12-11T20:23:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc56beab80 20 client.17691 trim_cache size 0 max 16384 2023-12-11T20:23:32.527 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:23:32.527 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:23:32.527 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "74e478c5-482c-4a3e-861f-209e8ce6adbf", 2023-12-11T20:23:32.527 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:23:32.527 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:23:32.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 -- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc2c0a1500 msgr2=0x7fcc2c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc2c0a1500 0x7fcc2c0a39c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c010 tx=0x7fcc30005fb0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 -- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c1048b0 msgr2=0x7fcc3c0fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c1048b0 0x7fcc3c0fff30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800d950 tx=0x7fcc2800dc60 comp rx=0 tx=0).stop 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 -- 172.21.15.12:0/1167322037 shutdown_connections 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcc2c0a1500 0x7fcc2c0a39c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc3c1071e0 0x7fcc3c100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc3c101f80 0x7fcc3c1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 --2- 172.21.15.12:0/1167322037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3c1048b0 0x7fcc3c0fff30 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.525+0000 7fcc431ff700 1 -- 172.21.15.12:0/1167322037 >> 172.21.15.12:0/1167322037 conn(0x7fcc3c0fb930 msgr2=0x7fcc3c1029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.526+0000 7fcc431ff700 1 -- 172.21.15.12:0/1167322037 shutdown_connections 2023-12-11T20:23:32.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.526+0000 7fcc431ff700 1 -- 172.21.15.12:0/1167322037 wait complete. 2023-12-11T20:23:32.548 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 -- 172.21.15.12:0/4081019089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 msgr2=0x7f1654108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 --2- 172.21.15.12:0/4081019089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 0x7f1654108840 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b0d0 tx=0x7f164c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 -- 172.21.15.12:0/4081019089 shutdown_connections 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 --2- 172.21.15.12:0/4081019089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 0x7f1654108840 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 --2- 172.21.15.12:0/4081019089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1654100400 0x7f1654100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 --2- 172.21.15.12:0/4081019089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16541015f0 0x7f1654101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 -- 172.21.15.12:0/4081019089 >> 172.21.15.12:0/4081019089 conn(0x7f16540fb930 msgr2=0x7f16540fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 -- 172.21.15.12:0/4081019089 shutdown_connections 2023-12-11T20:23:32.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.789+0000 7f165c1ff700 1 -- 172.21.15.12:0/4081019089 wait complete. 2023-12-11T20:23:32.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.791+0000 7f165c1ff700 1 Processor -- start 2023-12-11T20:23:32.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.791+0000 7f165c1ff700 1 -- start start 2023-12-11T20:23:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.791+0000 7f165c1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1654100400 0x7f1654104340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165c1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16541015f0 0x7f16541029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165c1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 0x7f1654102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165c1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16541036b0 con 0x7f1654101f90 2023-12-11T20:23:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165c1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654103820 con 0x7f16541015f0 2023-12-11T20:23:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165c1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16541a14a0 con 0x7f1654100400 2023-12-11T20:23:32.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 0x7f1654102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165979a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16541015f0 0x7f16541029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165979a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16541015f0 0x7f16541029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:39598/0 (socket says 172.21.15.12:39598) 2023-12-11T20:23:32.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 0x7f1654102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39594/0 (socket says 172.21.15.12:39594) 2023-12-11T20:23:32.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165979a700 1 -- 172.21.15.12:0/202494935 learned_addr learned my addr 172.21.15.12:0/202494935 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f1659f9b700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1654100400 0x7f1654104340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165979a700 1 -- 172.21.15.12:0/202494935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1654100400 msgr2=0x7f1654104340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165979a700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1654100400 0x7f1654104340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165979a700 1 -- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 msgr2=0x7f1654102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165979a700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 0x7f1654102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165979a700 1 -- 172.21.15.12:0/202494935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009d00 con 0x7f16541015f0 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.792+0000 7f165a79c700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 0x7f1654102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.793+0000 7f165979a700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16541015f0 0x7f16541029d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f164400e9a0 tx=0x7f164400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.793+0000 7f164affd700 1 -- 172.21.15.12:0/202494935 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644009790 con 0x7f16541015f0 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.793+0000 7f164affd700 1 -- 172.21.15.12:0/202494935 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f164400ce40 con 0x7f16541015f0 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.793+0000 7f165c1ff700 1 -- 172.21.15.12:0/202494935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16541a1730 con 0x7f16541015f0 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.793+0000 7f164affd700 1 -- 172.21.15.12:0/202494935 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644018420 con 0x7f16541015f0 2023-12-11T20:23:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.793+0000 7f165c1ff700 1 -- 172.21.15.12:0/202494935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16541a1c90 con 0x7f16541015f0 2023-12-11T20:23:32.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.797+0000 7f164affd700 1 -- 172.21.15.12:0/202494935 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1644010430 con 0x7f16541015f0 2023-12-11T20:23:32.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.798+0000 7f164affd700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16400a1500 0x7f16400a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.798+0000 7f164affd700 1 -- 172.21.15.12:0/202494935 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1644014070 con 0x7f16541015f0 2023-12-11T20:23:32.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f1659f9b700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16400a1500 0x7f16400a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f166fb28b80 1 Processor -- start 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f166fb28b80 1 -- start start 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f1659f9b700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16400a1500 0x7f16400a39c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1654101450 tx=0x7f1650009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb52640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f166fb28b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedaacb50 con 0x562fedb52c20 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f166fb28b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedaaa470 con 0x562fedb51d30 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.799+0000 7f166fb28b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedaa5d60 con 0x562fedb513d0 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f1659f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165979a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb52640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39608/0 (socket says 172.21.15.12:39608) 2023-12-11T20:23:32.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165a79c700 1 -- 172.21.15.12:0/77592523 learned_addr learned my addr 172.21.15.12:0/77592523 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165979a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb52640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:39606/0 (socket says 172.21.15.12:39606) 2023-12-11T20:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165a79c700 1 -- 172.21.15.12:0/77592523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 msgr2=0x562fedb517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165a79c700 1 --2- 172.21.15.12:0/77592523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165a79c700 1 -- 172.21.15.12:0/77592523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 msgr2=0x562fedb52640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165a79c700 1 --2- 172.21.15.12:0/77592523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb52640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165a79c700 1 -- 172.21.15.12:0/77592523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fed922630 con 0x562fedb52c20 2023-12-11T20:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.800+0000 7f165979a700 1 --2- 172.21.15.12:0/77592523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb52640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.801+0000 7f165a79c700 1 --2- 172.21.15.12:0/77592523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb530a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b0d0 tx=0x7f164c009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b942f64ad166e14 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.801+0000 7f163ffff700 1 -- 172.21.15.12:0/77592523 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00e040 con 0x562fedb52c20 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.801+0000 7f163ffff700 1 -- 172.21.15.12:0/77592523 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f164c0074e0 con 0x562fedb52c20 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.801+0000 7f163ffff700 1 -- 172.21.15.12:0/77592523 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c01c660 con 0x562fedb52c20 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 -- 172.21.15.12:0/77592523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 msgr2=0x562fedb530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 --2- 172.21.15.12:0/77592523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb530a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b0d0 tx=0x7f164c009c60 comp rx=0 tx=0).stop 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 -- 172.21.15.12:0/77592523 shutdown_connections 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 --2- 172.21.15.12:0/77592523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb530a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 --2- 172.21.15.12:0/77592523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 --2- 172.21.15.12:0/77592523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb52640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 -- 172.21.15.12:0/77592523 >> 172.21.15.12:0/77592523 conn(0x562feda807e0 msgr2=0x562fedb4dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 -- 172.21.15.12:0/77592523 shutdown_connections 2023-12-11T20:23:32.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.802+0000 7f166fb28b80 1 -- 172.21.15.12:0/77592523 wait complete. 2023-12-11T20:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.803+0000 7f166fb28b80 1 -- start start 2023-12-11T20:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.803+0000 7f166fb28b80 1 Processor -- start 2023-12-11T20:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb5b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb51d30 0x562fedb5b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb52c20 0x562fedb626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f166fb28b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562feda5f560 con 0x562fedb513d0 2023-12-11T20:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f166fb28b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562feda5f200 con 0x562fedb52c20 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f166fb28b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fed924920 con 0x562fedb51d30 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f166fb28b80 10 client.0 _ll_register_callbacks cb 0x562fed98aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f1659f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb5b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f1659f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb5b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39618/0 (socket says 172.21.15.12:39618) 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f1659f9b700 1 -- 172.21.15.12:0/3882024658 learned_addr learned my addr 172.21.15.12:0/3882024658 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f165a79c700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb52c20 0x562fedb626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f165979a700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb51d30 0x562fedb5b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f1659f9b700 1 -- 172.21.15.12:0/3882024658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb51d30 msgr2=0x562fedb5b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f1659f9b700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb51d30 0x562fedb5b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f1659f9b700 1 -- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb52c20 msgr2=0x562fedb626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f1659f9b700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb52c20 0x562fedb626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f1659f9b700 1 -- 172.21.15.12:0/3882024658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16541a1c90 con 0x562fedb513d0 2023-12-11T20:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f165979a700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb51d30 0x562fedb5b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.804+0000 7f165a79c700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb52c20 0x562fedb626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.805+0000 7f1659f9b700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb5b140 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f165001d810 tx=0x7f16500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea94046f8d12197c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.805+0000 7f163d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.805+0000 7f163d7fa700 1 -- 172.21.15.12:0/3882024658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650022070 con 0x562fedb513d0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.805+0000 7f163d7fa700 1 -- 172.21.15.12:0/3882024658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f165001c620 con 0x562fedb513d0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.805+0000 7f166fb28b80 1 -- 172.21.15.12:0/3882024658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fedb44b40 con 0x562fedb513d0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.805+0000 7f163d7fa700 1 -- 172.21.15.12:0/3882024658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1650004020 con 0x562fedb513d0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.805+0000 7f166fb28b80 10 client.17703 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.805+0000 7f166fb28b80 1 -- 172.21.15.12:0/3882024658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f1654109190 con 0x562fedb513d0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.806+0000 7f163d7fa700 1 -- 172.21.15.12:0/3882024658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562fedb44b40 con 0x562fedb513d0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.806+0000 7f163d7fa700 1 -- 172.21.15.12:0/3882024658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1650003680 con 0x562fedb513d0 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.806+0000 7f166fb28b80 10 client.17703 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.806+0000 7f166fb28b80 10 client.17703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.806+0000 7f166fb28b80 20 client.17703 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.806+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562fedb67030 0x562fedb69450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.806+0000 7f166fb28b80 4 client.17703 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:32.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.806+0000 7f166fb28b80 1 -- 172.21.15.12:0/3882024658 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fedb20f40 con 0x562fedb67030 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.807+0000 7f165979a700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562fedb67030 0x562fedb69450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.807+0000 7f165979a700 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562fedb67030 0x562fedb69450 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dbe844496c2f1b4 server_cookie=6a13004a62a5ea16 in_seq=0 out_seq=0 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.807+0000 7f163d7fa700 10 client.17703 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f163d7fa700 1 -- 172.21.15.12:0/3882024658 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562fedb20f40 con 0x562fedb67030 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f163d7fa700 10 client.17703 handle_command_reply: tid=0 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 client.17703 shutdown 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 -- 172.21.15.12:0/3882024658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 msgr2=0x562fedb5b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb5b140 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f165001d810 tx=0x7f16500047c0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 -- 172.21.15.12:0/3882024658 shutdown_connections 2023-12-11T20:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562fedb67030 0x562fedb69450 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb52c20 0x562fedb626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb5b140 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3882024658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb51d30 0x562fedb5b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f163d7fa700 0 client.17703 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 -- 172.21.15.12:0/3882024658 >> 172.21.15.12:0/3882024658 conn(0x562feda807e0 msgr2=0x562fedb4ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 -- 172.21.15.12:0/3882024658 shutdown_connections 2023-12-11T20:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.808+0000 7f166fb28b80 1 -- 172.21.15.12:0/3882024658 wait complete. 2023-12-11T20:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.809+0000 7f166fb28b80 20 client.17703 trim_cache size 0 max 16384 2023-12-11T20:23:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.826+0000 7f166fb28b80 1 Processor -- start 2023-12-11T20:23:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f166fb28b80 1 -- start start 2023-12-11T20:23:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb53020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb62680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb52c20 0x562fedb4d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f166fb28b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedb5acb0 con 0x562fedb513d0 2023-12-11T20:23:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f166fb28b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedb6e680 con 0x562fedb51d30 2023-12-11T20:23:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f166fb28b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedb48b50 con 0x562fedb52c20 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f1659f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb53020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f1659f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb53020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39622/0 (socket says 172.21.15.12:39622) 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f1659f9b700 1 -- 172.21.15.12:0/2979565960 learned_addr learned my addr 172.21.15.12:0/2979565960 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.827+0000 7f165979a700 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f165a79c700 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb52c20 0x562fedb4d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f165979a700 1 -- 172.21.15.12:0/2979565960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb52c20 msgr2=0x562fedb4d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f165979a700 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb52c20 0x562fedb4d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f165979a700 1 -- 172.21.15.12:0/2979565960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 msgr2=0x562fedb53020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f165979a700 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb53020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f165979a700 1 -- 172.21.15.12:0/2979565960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fed8cede0 con 0x562fedb51d30 2023-12-11T20:23:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f165a79c700 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb52c20 0x562fedb4d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:32.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f165979a700 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb62680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f16440ca8d0 tx=0x7f16440ca7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d47c7b4d1f9394 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.828+0000 7f1648ff9700 1 -- 172.21.15.12:0/2979565960 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164409a0f0 con 0x562fedb51d30 2023-12-11T20:23:32.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f1648ff9700 1 -- 172.21.15.12:0/2979565960 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f164409e240 con 0x562fedb51d30 2023-12-11T20:23:32.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f1648ff9700 1 -- 172.21.15.12:0/2979565960 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440a1ff0 con 0x562fedb51d30 2023-12-11T20:23:32.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f166fb28b80 1 -- 172.21.15.12:0/2979565960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 msgr2=0x562fedb62680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f166fb28b80 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb62680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f16440ca8d0 tx=0x7f16440ca7a0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f166fb28b80 1 -- 172.21.15.12:0/2979565960 shutdown_connections 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f166fb28b80 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb52c20 0x562fedb4d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f166fb28b80 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb513d0 0x562fedb53020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f166fb28b80 1 --2- 172.21.15.12:0/2979565960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb62680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f166fb28b80 1 -- 172.21.15.12:0/2979565960 >> 172.21.15.12:0/2979565960 conn(0x562feda807e0 msgr2=0x562fedb59110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.829+0000 7f166fb28b80 1 -- 172.21.15.12:0/2979565960 shutdown_connections 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.830+0000 7f166fb28b80 1 -- 172.21.15.12:0/2979565960 wait complete. 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.830+0000 7f166fb28b80 1 -- start start 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.830+0000 7f166fb28b80 1 Processor -- start 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb5e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb5e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f166fb28b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb61870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f166fb28b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedb61db0 con 0x562fedb52c20 2023-12-11T20:23:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f166fb28b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedb61f20 con 0x562fedb51d30 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f166fb28b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fedb620e0 con 0x562fedb513d0 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f166fb28b80 10 client.0 _ll_register_callbacks cb 0x562fed98aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f1659f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb5e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f165a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb61870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f1659f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb5e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47434/0 (socket says 172.21.15.12:47434) 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f1659f9b700 1 -- 172.21.15.12:0/3150717656 learned_addr learned my addr 172.21.15.12:0/3150717656 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.831+0000 7f165979a700 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb5e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f1659f9b700 1 -- 172.21.15.12:0/3150717656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 msgr2=0x562fedb5e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f1659f9b700 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb5e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f1659f9b700 1 -- 172.21.15.12:0/3150717656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 msgr2=0x562fedb61870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f1659f9b700 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb61870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f1659f9b700 1 -- 172.21.15.12:0/3150717656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16541a1730 con 0x562fedb513d0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f1659f9b700 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb5e3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1650003a30 tx=0x7f165001c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f6c43707bfa8d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f163d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f163d7fa700 1 -- 172.21.15.12:0/3150717656 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650022040 con 0x562fedb513d0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f166fb28b80 1 -- 172.21.15.12:0/3150717656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f164c0074e0 con 0x562fedb513d0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.832+0000 7f163d7fa700 1 -- 172.21.15.12:0/3150717656 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f165001cb90 con 0x562fedb513d0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f163d7fa700 1 -- 172.21.15.12:0/3150717656 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f165001cd50 con 0x562fedb513d0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f166fb28b80 10 client.27367 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f166fb28b80 1 -- 172.21.15.12:0/3150717656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562fed8b7c60 con 0x562fedb513d0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f163d7fa700 1 -- 172.21.15.12:0/3150717656 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f164c0074e0 con 0x562fedb513d0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f163d7fa700 1 -- 172.21.15.12:0/3150717656 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f165003a480 con 0x562fedb513d0 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f166fb28b80 10 client.27367 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f166fb28b80 10 client.27367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f166fb28b80 20 client.27367 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562fedbbe310 0x562fedbc0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f166fb28b80 4 client.27367 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.833+0000 7f166fb28b80 1 -- 172.21.15.12:0/3150717656 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562feda6bfd0 con 0x562fedbbe310 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.834+0000 7f165979a700 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562fedbbe310 0x562fedbc0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.834+0000 7f165979a700 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562fedbbe310 0x562fedbc0730 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20b62d4aadd6dbe3 server_cookie=158073e67270cbd6 in_seq=0 out_seq=0 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.834+0000 7f163d7fa700 10 client.27367 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.834+0000 7f163d7fa700 1 -- 172.21.15.12:0/3150717656 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562feda6bfd0 con 0x562fedbbe310 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f163d7fa700 10 client.27367 handle_command_reply: tid=0 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 client.27367 shutdown 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 -- 172.21.15.12:0/3150717656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 msgr2=0x562fedb5e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb5e3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1650003a30 tx=0x7f165001c620 comp rx=0 tx=0).stop 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 -- 172.21.15.12:0/3150717656 shutdown_connections 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562fedbbe310 0x562fedbc0730 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fedb52c20 0x562fedb61870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f163d7fa700 0 client.27367 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562fedb513d0 0x562fedb5e3b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 --2- 172.21.15.12:0/3150717656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562fedb51d30 0x562fedb5e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 -- 172.21.15.12:0/3150717656 >> 172.21.15.12:0/3150717656 conn(0x562feda807e0 msgr2=0x562fedb4d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 -- 172.21.15.12:0/3150717656 shutdown_connections 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 1 -- 172.21.15.12:0/3150717656 wait complete. 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.835+0000 7f166fb28b80 20 client.27367 trim_cache size 0 max 16384 2023-12-11T20:23:32.837 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout: "74e478c5-482c-4a3e-861f-209e8ce6adbf": { 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "74e478c5-482c-4a3e-861f-209e8ce6adbf", 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:23:32.838 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 -- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16400a1500 msgr2=0x7f16400a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16400a1500 0x7f16400a39c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1654101450 tx=0x7f1650009260 comp rx=0 tx=0).stop 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 -- 172.21.15.12:0/202494935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16541015f0 msgr2=0x7f16541029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16541015f0 0x7f16541029d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f164400e9a0 tx=0x7f164400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 -- 172.21.15.12:0/202494935 shutdown_connections 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16400a1500 0x7f16400a39c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1654101f90 0x7f1654102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1654100400 0x7f1654104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 --2- 172.21.15.12:0/202494935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16541015f0 0x7f16541029d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 -- 172.21.15.12:0/202494935 >> 172.21.15.12:0/202494935 conn(0x7f16540fb930 msgr2=0x7f1654068830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 -- 172.21.15.12:0/202494935 shutdown_connections 2023-12-11T20:23:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:23:32.836+0000 7f165c1ff700 1 -- 172.21.15.12:0/202494935 wait complete. 2023-12-11T20:23:32.854 INFO:tasks.cephfs.filesystem:scrub status for tag:74e478c5-482c-4a3e-861f-209e8ce6adbf - {'path': '/', 'tag': '74e478c5-482c-4a3e-861f-209e8ce6adbf', 'options': 'recursive,force'} 2023-12-11T20:23:32.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:32 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:32.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:32 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:32.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:32 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:32.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:32 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:32.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:32 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:32.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:32 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:32.963 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:23:32 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:23:32.536+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v162>,<0x10000000003/client.0 v164>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v181>,<0x10000000001/sv_0 v205>,<0x10000000000/_nogroup v189>,<0x1/volumes v181>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:23:33.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:32 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:33.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:32 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:32 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:33.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:32 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:32 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:33.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:32 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:32 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:32 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:32 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:32 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:32 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:32 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:33.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:33 smithi032 ceph-mon[132488]: pgmap v604: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:34.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:33 smithi039 ceph-mon[102205]: pgmap v604: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:23:34.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:23:34.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:34.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:34.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:23:34.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:34.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:34.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:34.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:23:34.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:23:34.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:33 smithi012 ceph-mon[128787]: pgmap v604: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:23:35.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:35 smithi039 ceph-mon[102205]: pgmap v605: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 22 op/s 2023-12-11T20:23:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:35 smithi012 ceph-mon[128787]: pgmap v605: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 22 op/s 2023-12-11T20:23:35.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:35 smithi032 ceph-mon[132488]: pgmap v605: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 22 op/s 2023-12-11T20:23:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:37 smithi039 ceph-mon[102205]: pgmap v606: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:23:37.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:37 smithi012 ceph-mon[128787]: pgmap v606: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:23:37.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:37 smithi032 ceph-mon[132488]: pgmap v606: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:23:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:39 smithi032 ceph-mon[132488]: pgmap v607: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:39 smithi039 ceph-mon[102205]: pgmap v607: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:39 smithi012 ceph-mon[128787]: pgmap v607: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:23:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.539+0000 7f4e397ff700 1 -- 172.21.15.12:0/2973787165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34101f50 msgr2=0x7f4e34104340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.539+0000 7f4e397ff700 1 --2- 172.21.15.12:0/2973787165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34101f50 0x7f4e34104340 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009990 tx=0x7f4e24009ca0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.540+0000 7f4e397ff700 1 -- 172.21.15.12:0/2973787165 shutdown_connections 2023-12-11T20:23:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.540+0000 7f4e397ff700 1 --2- 172.21.15.12:0/2973787165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e341071b0 0x7f4e34109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.540+0000 7f4e397ff700 1 --2- 172.21.15.12:0/2973787165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34101f50 0x7f4e34104340 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.540+0000 7f4e397ff700 1 --2- 172.21.15.12:0/2973787165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e34104880 0x7f4e34106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.540+0000 7f4e397ff700 1 -- 172.21.15.12:0/2973787165 >> 172.21.15.12:0/2973787165 conn(0x7f4e340fb960 msgr2=0x7f4e340fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.540+0000 7f4e397ff700 1 -- 172.21.15.12:0/2973787165 shutdown_connections 2023-12-11T20:23:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.540+0000 7f4e397ff700 1 -- 172.21.15.12:0/2973787165 wait complete. 2023-12-11T20:23:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.541+0000 7f4e397ff700 1 Processor -- start 2023-12-11T20:23:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.541+0000 7f4e397ff700 1 -- start start 2023-12-11T20:23:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e397ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e34101f50 0x7f4e341995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e397ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34104880 0x7f4e34199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e397ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e341071b0 0x7f4e341a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e397ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e341a1100 con 0x7f4e34104880 2023-12-11T20:23:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e397ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e341a1240 con 0x7f4e34101f50 2023-12-11T20:23:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e397ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e341a13d0 con 0x7f4e341071b0 2023-12-11T20:23:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34104880 0x7f4e34199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34104880 0x7f4e34199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45878/0 (socket says 172.21.15.12:45878) 2023-12-11T20:23:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e327fc700 1 -- 172.21.15.12:0/844446871 learned_addr learned my addr 172.21.15.12:0/844446871 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.542+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e34101f50 0x7f4e341995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e337fe700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e341071b0 0x7f4e341a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e327fc700 1 -- 172.21.15.12:0/844446871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e341071b0 msgr2=0x7f4e341a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e327fc700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e341071b0 0x7f4e341a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e327fc700 1 -- 172.21.15.12:0/844446871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e34101f50 msgr2=0x7f4e341995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e327fc700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e34101f50 0x7f4e341995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e327fc700 1 -- 172.21.15.12:0/844446871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e240095f0 con 0x7f4e34104880 2023-12-11T20:23:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e337fe700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e341071b0 0x7f4e341a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:23:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e327fc700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34104880 0x7f4e34199b10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800e9a0 tx=0x7f4e2800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e1bfff700 1 -- 172.21.15.12:0/844446871 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28009790 con 0x7f4e34104880 2023-12-11T20:23:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e1bfff700 1 -- 172.21.15.12:0/844446871 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e2800cbd0 con 0x7f4e34104880 2023-12-11T20:23:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e1bfff700 1 -- 172.21.15.12:0/844446871 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28018680 con 0x7f4e34104880 2023-12-11T20:23:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e397ff700 1 -- 172.21.15.12:0/844446871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e341a16b0 con 0x7f4e34104880 2023-12-11T20:23:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.543+0000 7f4e397ff700 1 -- 172.21.15.12:0/844446871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e341a1bc0 con 0x7f4e34104880 2023-12-11T20:23:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.547+0000 7f4e1bfff700 1 -- 172.21.15.12:0/844446871 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4e2800cd40 con 0x7f4e34104880 2023-12-11T20:23:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.548+0000 7f4e4d11ab80 1 Processor -- start 2023-12-11T20:23:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.549+0000 7f4e4d11ab80 1 -- start start 2023-12-11T20:23:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.549+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa212052f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.549+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21206140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.549+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21206ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.549+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa21160af0 con 0x55aa21206720 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.549+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa2115e410 con 0x55aa21205830 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.549+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa21159d00 con 0x55aa21204ed0 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21206ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e32ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21206140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e337fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa212052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21206ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45880/0 (socket says 172.21.15.12:45880) 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e327fc700 1 -- 172.21.15.12:0/2317640238 learned_addr learned my addr 172.21.15.12:0/2317640238 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e1bfff700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e1c0a14f0 0x7f4e1c0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e1bfff700 1 -- 172.21.15.12:0/844446871 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4e28014070 con 0x7f4e34104880 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e32ffd700 1 -- 172.21.15.12:0/2317640238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 msgr2=0x55aa212052f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/2317640238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa212052f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e32ffd700 1 -- 172.21.15.12:0/2317640238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 msgr2=0x55aa21206ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/2317640238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21206ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e337fe700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e1c0a14f0 0x7f4e1c0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e32ffd700 1 -- 172.21.15.12:0/2317640238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa20fd65d0 con 0x55aa21205830 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.550+0000 7f4e327fc700 1 --2- 172.21.15.12:0/2317640238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21206ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.551+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/2317640238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21206140 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4e24003f60 tx=0x7f4e24005ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45b2182947d944f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.551+0000 7f4e337fe700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e1c0a14f0 0x7f4e1c0a39b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009fc0 tx=0x7f4e2c004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.551+0000 7f4e197fa700 1 -- 172.21.15.12:0/2317640238 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2401d070 con 0x55aa21205830 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.551+0000 7f4e197fa700 1 -- 172.21.15.12:0/2317640238 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e2401e040 con 0x55aa21205830 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.551+0000 7f4e197fa700 1 -- 172.21.15.12:0/2317640238 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400b710 con 0x55aa21205830 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/2317640238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 msgr2=0x55aa21206140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/2317640238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21206140 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4e24003f60 tx=0x7f4e24005ea0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/2317640238 shutdown_connections 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/2317640238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21206ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/2317640238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa212052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/2317640238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21206140 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/2317640238 >> 172.21.15.12:0/2317640238 conn(0x55aa21134780 msgr2=0x55aa21201880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/2317640238 shutdown_connections 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.552+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/2317640238 wait complete. 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 1 -- start start 2023-12-11T20:23:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 1 Processor -- start 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21204ed0 0x55aa2120ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa2120f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa212161c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa21113500 con 0x55aa21206720 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa211131a0 con 0x55aa21204ed0 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa20fd88c0 con 0x55aa21205830 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.553+0000 7f4e4d11ab80 10 client.0 _ll_register_callbacks cb 0x55aa2103ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e32ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21204ed0 0x55aa2120ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e32ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21204ed0 0x55aa2120ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42654/0 (socket says 172.21.15.12:42654) 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e32ffd700 1 -- 172.21.15.12:0/3123525590 learned_addr learned my addr 172.21.15.12:0/3123525590 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e337fe700 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa212161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e327fc700 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa2120f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e32ffd700 1 -- 172.21.15.12:0/3123525590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 msgr2=0x55aa2120f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa2120f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e32ffd700 1 -- 172.21.15.12:0/3123525590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 msgr2=0x55aa212161c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa212161c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.554+0000 7f4e32ffd700 1 -- 172.21.15.12:0/3123525590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3410a210 con 0x55aa21204ed0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.555+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21204ed0 0x55aa2120ee50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e24005b00 tx=0x7f4e240038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=affc30556ba47aec server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.555+0000 7f4e16ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.555+0000 7f4e16ff5700 1 -- 172.21.15.12:0/3123525590 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2401d040 con 0x55aa21204ed0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.555+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/3123525590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa211f8730 con 0x55aa21204ed0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.555+0000 7f4e16ff5700 1 -- 172.21.15.12:0/3123525590 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4e2400bb20 con 0x55aa21204ed0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e16ff5700 1 -- 172.21.15.12:0/3123525590 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e2400bce0 con 0x55aa21204ed0 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e4d11ab80 10 client.27389 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/3123525590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55aa20f82d80 con 0x55aa21204ed0 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e16ff5700 1 -- 172.21.15.12:0/3123525590 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e2403e080 con 0x55aa21204ed0 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e16ff5700 1 -- 172.21.15.12:0/3123525590 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4e2403a430 con 0x55aa21204ed0 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e4d11ab80 10 client.27389 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e4d11ab80 10 client.27389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e4d11ab80 20 client.27389 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa2121a850 0x55aa2121cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e4d11ab80 4 client.27389 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.556+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/3123525590 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa211d4ee0 con 0x55aa2121a850 2023-12-11T20:23:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.557+0000 7f4e327fc700 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa2121a850 0x55aa2121cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.557+0000 7f4e327fc700 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa2121a850 0x55aa2121cc70 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5f69d1c8bb26bb3 server_cookie=d221a46474dc5a95 in_seq=0 out_seq=0 2023-12-11T20:23:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.557+0000 7f4e16ff5700 10 client.27389 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e16ff5700 1 -- 172.21.15.12:0/3123525590 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f4e2807ea90 con 0x55aa2121a850 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e16ff5700 10 client.27389 handle_command_reply: tid=0 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 client.27389 shutdown 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/3123525590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21204ed0 msgr2=0x55aa2120ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21204ed0 0x55aa2120ee50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e24005b00 tx=0x7f4e240038b0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/3123525590 shutdown_connections 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa2121a850 0x55aa2121cc70 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21204ed0 0x55aa2120ee50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa212161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/3123525590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa2120f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e16ff5700 0 client.27389 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.558+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/3123525590 >> 172.21.15.12:0/3123525590 conn(0x55aa21134780 msgr2=0x55aa211ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.559+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/3123525590 shutdown_connections 2023-12-11T20:23:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.559+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/3123525590 wait complete. 2023-12-11T20:23:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.559+0000 7f4e4d11ab80 20 client.27389 trim_cache size 0 max 16384 2023-12-11T20:23:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.581+0000 7f4e4d11ab80 1 Processor -- start 2023-12-11T20:23:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.581+0000 7f4e4d11ab80 1 -- start start 2023-12-11T20:23:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.581+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21204ed0 0x55aa212052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.581+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa21216180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.581+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21206720 0x55aa2120d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.581+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa21221e60 con 0x55aa21204ed0 2023-12-11T20:23:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.581+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa2120d6b0 con 0x55aa21206720 2023-12-11T20:23:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.581+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa21205f30 con 0x55aa21205830 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21204ed0 0x55aa212052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21204ed0 0x55aa212052b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45896/0 (socket says 172.21.15.12:45896) 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 -- 172.21.15.12:0/655348912 learned_addr learned my addr 172.21.15.12:0/655348912 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e337fe700 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21206720 0x55aa2120d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e327fc700 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa21216180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 -- 172.21.15.12:0/655348912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 msgr2=0x55aa21216180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa21216180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 -- 172.21.15.12:0/655348912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21206720 msgr2=0x55aa2120d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21206720 0x55aa2120d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 -- 172.21.15.12:0/655348912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa20f6bc00 con 0x55aa21204ed0 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e327fc700 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa21216180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:23:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.582+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21204ed0 0x55aa212052b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4e2403a7c0 tx=0x7f4e24009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d3941e21f47d95 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.583+0000 7f4e19ffb700 1 -- 172.21.15.12:0/655348912 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24041070 con 0x55aa21204ed0 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.583+0000 7f4e19ffb700 1 -- 172.21.15.12:0/655348912 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aa211f8730 con 0x55aa21204ed0 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.583+0000 7f4e19ffb700 1 -- 172.21.15.12:0/655348912 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2401d030 con 0x55aa21204ed0 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/655348912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21204ed0 msgr2=0x55aa212052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21204ed0 0x55aa212052b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4e2403a7c0 tx=0x7f4e24009ca0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/655348912 shutdown_connections 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21206720 0x55aa2120d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21204ed0 0x55aa212052b0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/655348912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21205830 0x55aa21216180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/655348912 >> 172.21.15.12:0/655348912 conn(0x55aa21134780 msgr2=0x55aa2120e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/655348912 shutdown_connections 2023-12-11T20:23:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/655348912 wait complete. 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 -- start start 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.584+0000 7f4e4d11ab80 1 Processor -- start 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa21213a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21213fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e4d11ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21214df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa21215330 con 0x55aa21206720 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa212154a0 con 0x55aa21205830 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e4d11ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa21215660 con 0x55aa21204ed0 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e4d11ab80 10 client.0 _ll_register_callbacks cb 0x55aa2103ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21214df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21214df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45908/0 (socket says 172.21.15.12:45908) 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e337fe700 1 -- 172.21.15.12:0/479855154 learned_addr learned my addr 172.21.15.12:0/479855154 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.585+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa21213a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e327fc700 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21213fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e32ffd700 1 -- 172.21.15.12:0/479855154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 msgr2=0x55aa21213fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21213fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e32ffd700 1 -- 172.21.15.12:0/479855154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 msgr2=0x55aa21214df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21214df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e32ffd700 1 -- 172.21.15.12:0/479855154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa20f82d80 con 0x55aa21204ed0 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e32ffd700 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa21213a60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e2403a840 tx=0x7f4e2403a9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d3dfe746d295d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e16ff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.586+0000 7f4e16ff5700 1 -- 172.21.15.12:0/479855154 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24041070 con 0x55aa21204ed0 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.587+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/479855154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e2401e040 con 0x55aa21204ed0 2023-12-11T20:23:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.587+0000 7f4e16ff5700 1 -- 172.21.15.12:0/479855154 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4e24000e40 con 0x55aa21204ed0 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.587+0000 7f4e16ff5700 1 -- 172.21.15.12:0/479855154 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e2401d070 con 0x55aa21204ed0 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.587+0000 7f4e4d11ab80 10 client.27379 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.587+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/479855154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55aa20fa91f0 con 0x55aa21204ed0 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.587+0000 7f4e16ff5700 1 -- 172.21.15.12:0/479855154 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e2401e040 con 0x55aa21204ed0 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.587+0000 7f4e16ff5700 1 -- 172.21.15.12:0/479855154 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4e2400f7a0 con 0x55aa21204ed0 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e4d11ab80 10 client.27379 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e4d11ab80 10 client.27379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e4d11ab80 20 client.27379 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa21271170 0x55aa21273590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e4d11ab80 4 client.27379 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/479855154 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aa2111ff70 con 0x55aa21271170 2023-12-11T20:23:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e327fc700 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa21271170 0x55aa21273590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e327fc700 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa21271170 0x55aa21273590 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b21bb0cc277c42da server_cookie=6f2c8294e9b1b85a in_seq=0 out_seq=0 2023-12-11T20:23:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.588+0000 7f4e16ff5700 10 client.27379 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e16ff5700 1 -- 172.21.15.12:0/479855154 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aa2111ff70 con 0x55aa21271170 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e16ff5700 10 client.27379 handle_command_reply: tid=0 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e4d11ab80 1 client.27379 shutdown 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/479855154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 msgr2=0x55aa21213a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa21213a60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e2403a840 tx=0x7f4e2403a9b0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/479855154 shutdown_connections 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa21271170 0x55aa21273590 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa21206720 0x55aa21214df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa21204ed0 0x55aa21213a60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e4d11ab80 1 --2- 172.21.15.12:0/479855154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa21205830 0x55aa21213fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.598+0000 7f4e16ff5700 0 client.27379 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.599+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/479855154 >> 172.21.15.12:0/479855154 conn(0x55aa21134780 msgr2=0x55aa2120d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.599+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/479855154 shutdown_connections 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.599+0000 7f4e4d11ab80 1 -- 172.21.15.12:0/479855154 wait complete. 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.599+0000 7f4e4d11ab80 20 client.27379 trim_cache size 0 max 16384 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:23:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:23:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.599+0000 7f4e397ff700 1 -- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e1c0a14f0 msgr2=0x7f4e1c0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.599+0000 7f4e397ff700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e1c0a14f0 0x7f4e1c0a39b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009fc0 tx=0x7f4e2c004b40 comp rx=0 tx=0).stop 2023-12-11T20:23:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.599+0000 7f4e397ff700 1 -- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34104880 msgr2=0x7f4e34199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.599+0000 7f4e397ff700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34104880 0x7f4e34199b10 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800e9a0 tx=0x7f4e2800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.600+0000 7f4e397ff700 1 -- 172.21.15.12:0/844446871 shutdown_connections 2023-12-11T20:23:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.600+0000 7f4e397ff700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4e1c0a14f0 0x7f4e1c0a39b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.600+0000 7f4e397ff700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e34101f50 0x7f4e341995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.600+0000 7f4e397ff700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e341071b0 0x7f4e341a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.600+0000 7f4e397ff700 1 --2- 172.21.15.12:0/844446871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e34104880 0x7f4e34199b10 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.600+0000 7f4e397ff700 1 -- 172.21.15.12:0/844446871 >> 172.21.15.12:0/844446871 conn(0x7f4e340fb960 msgr2=0x7f4e34100000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.600+0000 7f4e397ff700 1 -- 172.21.15.12:0/844446871 shutdown_connections 2023-12-11T20:23:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:40.600+0000 7f4e397ff700 1 -- 172.21.15.12:0/844446871 wait complete. 2023-12-11T20:23:41.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:41 smithi039 ceph-mon[102205]: pgmap v608: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:23:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:41 smithi012 ceph-mon[128787]: pgmap v608: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:23:41.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:41 smithi032 ceph-mon[132488]: pgmap v608: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:23:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:43 smithi039 ceph-mon[102205]: pgmap v609: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:23:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:43 smithi012 ceph-mon[128787]: pgmap v609: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:23:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:43 smithi032 ceph-mon[132488]: pgmap v609: 97 pgs: 97 active+clean; 5.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:23:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:45 smithi039 ceph-mon[102205]: pgmap v610: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:23:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:45 smithi012 ceph-mon[128787]: pgmap v610: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:23:45.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:45 smithi032 ceph-mon[132488]: pgmap v610: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:23:46.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:46 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:23:46.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:46 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:23:46.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:46 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:23:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:47 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:23:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:47 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:23:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:47 smithi039 ceph-mon[102205]: pgmap v611: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 27 op/s 2023-12-11T20:23:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:47 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:23:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:47 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:23:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:47 smithi012 ceph-mon[128787]: pgmap v611: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 27 op/s 2023-12-11T20:23:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:47 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:23:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:47 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:23:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:47 smithi032 ceph-mon[132488]: pgmap v611: 97 pgs: 97 active+clean; 5.5 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 27 op/s 2023-12-11T20:23:49.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:49 smithi032 ceph-mon[132488]: pgmap v612: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:23:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:49 smithi039 ceph-mon[102205]: pgmap v612: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:23:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:49 smithi012 ceph-mon[128787]: pgmap v612: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:23:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:51 smithi039 ceph-mon[102205]: pgmap v613: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:23:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:51 smithi012 ceph-mon[128787]: pgmap v613: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:23:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:51 smithi032 ceph-mon[132488]: pgmap v613: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:23:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:53 smithi039 ceph-mon[102205]: pgmap v614: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:53 smithi012 ceph-mon[128787]: pgmap v614: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:53.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:53 smithi032 ceph-mon[132488]: pgmap v614: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.766+0000 7f3b8bfff700 1 -- 172.21.15.12:0/228266877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 msgr2=0x7f3b8c106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.766+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/228266877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 0x7f3b8c106a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009990 tx=0x7f3b80009ca0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.766+0000 7f3b8bfff700 1 -- 172.21.15.12:0/228266877 shutdown_connections 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.766+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/228266877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8c101d70 0x7f3b8c104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.766+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/228266877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b8c106fd0 0x7f3b8c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.766+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/228266877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 0x7f3b8c106a90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.766+0000 7f3b8bfff700 1 -- 172.21.15.12:0/228266877 >> 172.21.15.12:0/228266877 conn(0x7f3b8c0fb780 msgr2=0x7f3b8c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.766+0000 7f3b8bfff700 1 -- 172.21.15.12:0/228266877 shutdown_connections 2023-12-11T20:23:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.767+0000 7f3b8bfff700 1 -- 172.21.15.12:0/228266877 wait complete. 2023-12-11T20:23:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8bfff700 1 Processor -- start 2023-12-11T20:23:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8bfff700 1 -- start start 2023-12-11T20:23:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8c101d70 0x7f3b8c101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 0x7f3b8c0ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b8c106fd0 0x7f3b8c100260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c100a00 con 0x7f3b8c106fd0 2023-12-11T20:23:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8bfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c100b70 con 0x7f3b8c101d70 2023-12-11T20:23:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8bfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c1a11b0 con 0x7f3b8c1046a0 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b8c106fd0 0x7f3b8c100260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b8c106fd0 0x7f3b8c100260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41678/0 (socket says 172.21.15.12:41678) 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8b7fe700 1 -- 172.21.15.12:0/3405878580 learned_addr learned my addr 172.21.15.12:0/3405878580 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.768+0000 7f3b8affd700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8c101d70 0x7f3b8c101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 0x7f3b8c0ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8b7fe700 1 -- 172.21.15.12:0/3405878580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 msgr2=0x7f3b8c0ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8b7fe700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 0x7f3b8c0ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8b7fe700 1 -- 172.21.15.12:0/3405878580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8c101d70 msgr2=0x7f3b8c101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8b7fe700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8c101d70 0x7f3b8c101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8b7fe700 1 -- 172.21.15.12:0/3405878580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800095f0 con 0x7f3b8c106fd0 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 0x7f3b8c0ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8affd700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8c101d70 0x7f3b8c101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b8b7fe700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b8c106fd0 0x7f3b8c100260 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400ef30 tx=0x7f3b8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.769+0000 7f3b73fff700 1 -- 172.21.15.12:0/3405878580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84018070 con 0x7f3b8c106fd0 2023-12-11T20:23:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.770+0000 7f3b8bfff700 1 -- 172.21.15.12:0/3405878580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c1a13e0 con 0x7f3b8c106fd0 2023-12-11T20:23:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.770+0000 7f3b73fff700 1 -- 172.21.15.12:0/3405878580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b8400f040 con 0x7f3b8c106fd0 2023-12-11T20:23:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.770+0000 7f3b73fff700 1 -- 172.21.15.12:0/3405878580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400cc10 con 0x7f3b8c106fd0 2023-12-11T20:23:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.770+0000 7f3b8bfff700 1 -- 172.21.15.12:0/3405878580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c1a18a0 con 0x7f3b8c106fd0 2023-12-11T20:23:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.774+0000 7f3b73fff700 1 -- 172.21.15.12:0/3405878580 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3b84007500 con 0x7f3b8c106fd0 2023-12-11T20:23:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.775+0000 7f3ba4d17b80 1 Processor -- start 2023-12-11T20:23:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.775+0000 7f3ba4d17b80 1 -- start start 2023-12-11T20:23:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.775+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2bcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.775+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.775+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.775+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c217af0 con 0x55ae8c2c1b80 2023-12-11T20:23:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c215410 con 0x55ae8c2bc770 2023-12-11T20:23:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c210d00 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b73fff700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b740a1470 0x7f3b740a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:58198/0 (socket says 172.21.15.12:58198) 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8affd700 1 -- 172.21.15.12:0/1856226956 learned_addr learned my addr 172.21.15.12:0/1856226956 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2bcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b73fff700 1 -- 172.21.15.12:0/3405878580 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b840cc930 con 0x7f3b8c106fd0 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8b7fe700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b740a1470 0x7f3b740a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8affd700 1 -- 172.21.15.12:0/1856226956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 msgr2=0x55ae8c2bcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8affd700 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2bcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8affd700 1 -- 172.21.15.12:0/1856226956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 msgr2=0x55ae8c2c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.776+0000 7f3b8affd700 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.777+0000 7f3b8affd700 1 -- 172.21.15.12:0/1856226956 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae8c08d5d0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.777+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.777+0000 7f3b8affd700 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c1640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0115f0 tx=0x7f3b7c011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=582efb2b881d3e20 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.777+0000 7f3b8b7fe700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b740a1470 0x7f3b740a3930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3b840ca380 tx=0x7f3b84009ed0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.777+0000 7f3b717fa700 1 -- 172.21.15.12:0/1856226956 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c019630 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.777+0000 7f3b717fa700 1 -- 172.21.15.12:0/1856226956 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b7c019c20 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.777+0000 7f3b717fa700 1 -- 172.21.15.12:0/1856226956 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00eab0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1856226956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 msgr2=0x55ae8c2c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c1640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0115f0 tx=0x7f3b7c011900 comp rx=0 tx=0).stop 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1856226956 shutdown_connections 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2bcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1856226956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c1640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1856226956 >> 172.21.15.12:0/1856226956 conn(0x55ae8c1eb780 msgr2=0x55ae8c2b8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1856226956 shutdown_connections 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.778+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1856226956 wait complete. 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.779+0000 7f3ba4d17b80 1 -- start start 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.779+0000 7f3ba4d17b80 1 Processor -- start 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bc770 0x55ae8c2c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c1ca500 con 0x55ae8c2c1b80 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c1ca1a0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c08f8c0 con 0x55ae8c2bc770 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3ba4d17b80 10 client.0 _ll_register_callbacks cb 0x55ae8c0f5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bc770 0x55ae8c2c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3b8affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bc770 0x55ae8c2c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:58204/0 (socket says 172.21.15.12:58204) 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3b8a7fc700 1 -- 172.21.15.12:0/1287271596 learned_addr learned my addr 172.21.15.12:0/1287271596 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3b8affd700 1 -- 172.21.15.12:0/1287271596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bc770 msgr2=0x55ae8c2c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.780+0000 7f3b8affd700 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bc770 0x55ae8c2c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3b8affd700 1 -- 172.21.15.12:0/1287271596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 msgr2=0x55ae8c2cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3b8affd700 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3b8affd700 1 -- 172.21.15.12:0/1287271596 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c10a030 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bc770 0x55ae8c2c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3b8affd700 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c6470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000c00 tx=0x7f3b7c00e410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a420ef57cc01ab56 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3b6eff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3b6eff5700 1 -- 172.21.15.12:0/1287271596 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00ec40 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3b6eff5700 1 -- 172.21.15.12:0/1287271596 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b7c00eda0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.781+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1287271596 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae8c2af730 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.782+0000 7f3b6eff5700 1 -- 172.21.15.12:0/1287271596 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7c005020 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.782+0000 7f3ba4d17b80 10 client.27407 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.782+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1287271596 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f3b7c009dd0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.782+0000 7f3b6eff5700 1 -- 172.21.15.12:0/1287271596 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ae8c2af730 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.783+0000 7f3b6eff5700 1 -- 172.21.15.12:0/1287271596 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b7c0198e0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.783+0000 7f3ba4d17b80 10 client.27407 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.783+0000 7f3ba4d17b80 10 client.27407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.783+0000 7f3ba4d17b80 20 client.27407 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.783+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8c2d1c40 0x55ae8c2d4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.783+0000 7f3ba4d17b80 4 client.27407 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.783+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1287271596 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae8c28bee0 con 0x55ae8c2d1c40 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.783+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8c2d1c40 0x55ae8c2d4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.784+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8c2d1c40 0x55ae8c2d4060 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8414fa3cea50da9 server_cookie=e2c5e619d1f74a9e in_seq=0 out_seq=0 2023-12-11T20:23:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.784+0000 7f3b6eff5700 10 client.27407 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.784+0000 7f3b6eff5700 1 -- 172.21.15.12:0/1287271596 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ae8c28bee0 con 0x55ae8c2d1c40 2023-12-11T20:23:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.784+0000 7f3b6eff5700 10 client.27407 handle_command_reply: tid=0 2023-12-11T20:23:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 client.27407 shutdown 2023-12-11T20:23:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1287271596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bd0d0 msgr2=0x55ae8c2c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c6470 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000c00 tx=0x7f3b7c00e410 comp rx=0 tx=0).stop 2023-12-11T20:23:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1287271596 shutdown_connections 2023-12-11T20:23:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8c2d1c40 0x55ae8c2d4060 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bc770 0x55ae8c2c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/1287271596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2c6470 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3b6eff5700 0 client.27407 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1287271596 >> 172.21.15.12:0/1287271596 conn(0x55ae8c1eb780 msgr2=0x55ae8c2b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1287271596 shutdown_connections 2023-12-11T20:23:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/1287271596 wait complete. 2023-12-11T20:23:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.785+0000 7f3ba4d17b80 20 client.27407 trim_cache size 0 max 16384 2023-12-11T20:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.809+0000 7f3ba4d17b80 1 Processor -- start 2023-12-11T20:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3ba4d17b80 1 -- start start 2023-12-11T20:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2bde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c2d9270 con 0x55ae8c2c1b80 2023-12-11T20:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c2b8210 con 0x55ae8c2bc770 2023-12-11T20:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c2c6ed0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3b8affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2bde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41716/0 (socket says 172.21.15.12:41716) 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3b8a7fc700 1 -- 172.21.15.12:0/3728968140 learned_addr learned my addr 172.21.15.12:0/3728968140 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.810+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b8a7fc700 1 -- 172.21.15.12:0/3728968140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 msgr2=0x55ae8c2cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b8a7fc700 1 -- 172.21.15.12:0/3728968140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 msgr2=0x55ae8c2b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b8a7fc700 1 -- 172.21.15.12:0/3728968140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae8c039d80 con 0x55ae8c2c1b80 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b8affd700 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2bde80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3b80003f60 tx=0x7f3b8001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a7bb66d562f040 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b71ffb700 1 -- 172.21.15.12:0/3728968140 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80003d70 con 0x55ae8c2c1b80 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b71ffb700 1 -- 172.21.15.12:0/3728968140 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b8001e040 con 0x55ae8c2c1b80 2023-12-11T20:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.811+0000 7f3b71ffb700 1 -- 172.21.15.12:0/3728968140 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000f6f0 con 0x55ae8c2c1b80 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/3728968140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 msgr2=0x55ae8c2bde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2bde80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3b80003f60 tx=0x7f3b8001a040 comp rx=0 tx=0).stop 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/3728968140 shutdown_connections 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2bde80 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/3728968140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/3728968140 >> 172.21.15.12:0/3728968140 conn(0x55ae8c1eb780 msgr2=0x55ae8c2c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/3728968140 shutdown_connections 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.812+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/3728968140 wait complete. 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.813+0000 7f3ba4d17b80 1 -- start start 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.813+0000 7f3ba4d17b80 1 Processor -- start 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.813+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.813+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3ba4d17b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c2cbad0 con 0x55ae8c2c1b80 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c2cbc40 con 0x55ae8c2bc770 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3ba4d17b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8c2cbe00 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3ba4d17b80 10 client.0 _ll_register_callbacks cb 0x55ae8c0f5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41718/0 (socket says 172.21.15.12:41718) 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8a7fc700 1 -- 172.21.15.12:0/2327136063 learned_addr learned my addr 172.21.15.12:0/2327136063 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8affd700 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8affd700 1 -- 172.21.15.12:0/2327136063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 msgr2=0x55ae8c2ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8affd700 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8affd700 1 -- 172.21.15.12:0/2327136063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 msgr2=0x55ae8c2cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8affd700 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8affd700 1 -- 172.21.15.12:0/2327136063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c009dd0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.814+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:23:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.815+0000 7f3b8affd700 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0047d0 tx=0x7f3b7c009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20e8e56430b51ff6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:23:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.815+0000 7f3b6eff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.815+0000 7f3b6eff5700 1 -- 172.21.15.12:0/2327136063 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00ee50 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.815+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/2327136063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b7c019c20 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.815+0000 7f3b6eff5700 1 -- 172.21.15.12:0/2327136063 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b7c005ce0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.815+0000 7f3b6eff5700 1 -- 172.21.15.12:0/2327136063 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7c019430 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.815+0000 7f3ba4d17b80 10 client.27397 fetch_fsmap learned FSMap version 26 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.815+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/2327136063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f3b80031040 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.816+0000 7f3b6eff5700 1 -- 172.21.15.12:0/2327136063 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b7c019c20 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.816+0000 7f3b6eff5700 1 -- 172.21.15.12:0/2327136063 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b7c0037a0 con 0x55ae8c2bd0d0 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.816+0000 7f3ba4d17b80 10 client.27397 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.816+0000 7f3ba4d17b80 10 client.27397 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.816+0000 7f3ba4d17b80 20 client.27397 populate_metadata read hostname 'smithi012' 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.816+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8c3290e0 0x55ae8c32b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.816+0000 7f3ba4d17b80 4 client.27397 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.816+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/2327136063 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ae8c1d6f70 con 0x55ae8c3290e0 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.817+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8c3290e0 0x55ae8c32b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.817+0000 7f3b8a7fc700 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8c3290e0 0x55ae8c32b4d0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffda76fdc00e3800 server_cookie=a0bf3bd9d2ea4b72 in_seq=0 out_seq=0 2023-12-11T20:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.817+0000 7f3b6eff5700 10 client.27397 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.827+0000 7f3b6eff5700 1 -- 172.21.15.12:0/2327136063 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ae8c1d6f70 con 0x55ae8c3290e0 2023-12-11T20:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.827+0000 7f3b6eff5700 10 client.27397 handle_command_reply: tid=0 2023-12-11T20:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.827+0000 7f3ba4d17b80 1 client.27397 shutdown 2023-12-11T20:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.827+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/2327136063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 msgr2=0x55ae8c2cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.827+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0047d0 tx=0x7f3b7c009f60 comp rx=0 tx=0).stop 2023-12-11T20:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/2327136063 shutdown_connections 2023-12-11T20:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8c3290e0 0x55ae8c32b4d0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8c2bc770 0x55ae8c2ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3b6eff5700 0 client.27397 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8c2c1b80 0x55ae8c2cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 1 --2- 172.21.15.12:0/2327136063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8c2bd0d0 0x55ae8c2cd2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/2327136063 >> 172.21.15.12:0/2327136063 conn(0x55ae8c1eb780 msgr2=0x55ae8c2b8660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/2327136063 shutdown_connections 2023-12-11T20:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 1 -- 172.21.15.12:0/2327136063 wait complete. 2023-12-11T20:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3ba4d17b80 20 client.27397 trim_cache size 0 max 16384 2023-12-11T20:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3b8bfff700 1 -- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b740a1470 msgr2=0x7f3b740a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b740a1470 0x7f3b740a3930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3b840ca380 tx=0x7f3b84009ed0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3b8bfff700 1 -- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b8c106fd0 msgr2=0x7f3b8c100260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.828+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b8c106fd0 0x7f3b8c100260 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400ef30 tx=0x7f3b8400c3a0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.829+0000 7f3b8bfff700 1 -- 172.21.15.12:0/3405878580 shutdown_connections 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.829+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b740a1470 0x7f3b740a3930 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.829+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b8c101d70 0x7f3b8c101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.829+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b8c106fd0 0x7f3b8c100260 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.829+0000 7f3b8bfff700 1 --2- 172.21.15.12:0/3405878580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b8c1046a0 0x7f3b8c0ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.829+0000 7f3b8bfff700 1 -- 172.21.15.12:0/3405878580 >> 172.21.15.12:0/3405878580 conn(0x7f3b8c0fb780 msgr2=0x7f3b8c103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.829+0000 7f3b8bfff700 1 -- 172.21.15.12:0/3405878580 shutdown_connections 2023-12-11T20:23:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:23:53.829+0000 7f3b8bfff700 1 -- 172.21.15.12:0/3405878580 wait complete. 2023-12-11T20:23:55.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:55 smithi039 ceph-mon[102205]: pgmap v615: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:55 smithi012 ceph-mon[128787]: pgmap v615: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:55 smithi032 ceph-mon[132488]: pgmap v615: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:23:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:57 smithi039 ceph-mon[102205]: pgmap v616: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:23:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:57 smithi012 ceph-mon[128787]: pgmap v616: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:23:57.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:57 smithi032 ceph-mon[132488]: pgmap v616: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:23:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:23:59 smithi032 ceph-mon[132488]: pgmap v617: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:23:59.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:23:59 smithi039 ceph-mon[102205]: pgmap v617: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:23:59.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:23:59 smithi012 ceph-mon[128787]: pgmap v617: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:01 smithi039 ceph-mon[102205]: pgmap v618: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:24:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:01 smithi012 ceph-mon[128787]: pgmap v618: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:24:01.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:01 smithi032 ceph-mon[132488]: pgmap v618: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:24:02.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:24:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 -- 172.21.15.12:0/676731153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 msgr2=0x7f5334104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 --2- 172.21.15.12:0/676731153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 0x7f5334104370 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5324009990 tx=0x7f5324009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 -- 172.21.15.12:0/676731153 shutdown_connections 2023-12-11T20:24:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 --2- 172.21.15.12:0/676731153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53341071e0 0x7f5334109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 --2- 172.21.15.12:0/676731153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 0x7f5334104370 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 --2- 172.21.15.12:0/676731153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53341048b0 0x7f5334106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 -- 172.21.15.12:0/676731153 >> 172.21.15.12:0/676731153 conn(0x7f53340fb930 msgr2=0x7f53340fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 -- 172.21.15.12:0/676731153 shutdown_connections 2023-12-11T20:24:03.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.092+0000 7f533a1ff700 1 -- 172.21.15.12:0/676731153 wait complete. 2023-12-11T20:24:03.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.094+0000 7f533a1ff700 1 Processor -- start 2023-12-11T20:24:03.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.094+0000 7f533a1ff700 1 -- start start 2023-12-11T20:24:03.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.094+0000 7f533a1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 0x7f5334199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.094+0000 7f533a1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53341048b0 0x7f5334199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.094+0000 7f533a1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53341071e0 0x7f53341a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.094+0000 7f533a1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53341a1060 con 0x7f5334101f80 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.094+0000 7f533a1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53341a11a0 con 0x7f53341071e0 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.094+0000 7f533a1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53341a1330 con 0x7f53341048b0 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 0x7f5334199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 0x7f5334199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36342/0 (socket says 172.21.15.12:36342) 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 -- 172.21.15.12:0/839173656 learned_addr learned my addr 172.21.15.12:0/839173656 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f5333fff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53341071e0 0x7f53341a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f5332ffd700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53341048b0 0x7f5334199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 -- 172.21.15.12:0/839173656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53341048b0 msgr2=0x7f5334199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53341048b0 0x7f5334199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 -- 172.21.15.12:0/839173656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53341071e0 msgr2=0x7f53341a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53341071e0 0x7f53341a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 -- 172.21.15.12:0/839173656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240095f0 con 0x7f5334101f80 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f5333fff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53341071e0 0x7f53341a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.095+0000 7f53337fe700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 0x7f5334199530 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5324000c00 tx=0x7f53240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.096+0000 7f5330ff9700 1 -- 172.21.15.12:0/839173656 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532401d070 con 0x7f5334101f80 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.096+0000 7f533a1ff700 1 -- 172.21.15.12:0/839173656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53341a15b0 con 0x7f5334101f80 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.096+0000 7f5330ff9700 1 -- 172.21.15.12:0/839173656 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f532400be30 con 0x7f5334101f80 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.096+0000 7f5330ff9700 1 -- 172.21.15.12:0/839173656 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324022ea0 con 0x7f5334101f80 2023-12-11T20:24:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.096+0000 7f533a1ff700 1 -- 172.21.15.12:0/839173656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53341a1a30 con 0x7f5334101f80 2023-12-11T20:24:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.100+0000 7f5330ff9700 1 -- 172.21.15.12:0/839173656 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5324022670 con 0x7f5334101f80 2023-12-11T20:24:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.100+0000 7f534dc06b80 1 Processor -- start 2023-12-11T20:24:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f534dc06b80 1 -- start start 2023-12-11T20:24:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb503d0 0x55dacfb507f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb50d30 0x55dacfb51640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f534dc06b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfaabb50 con 0x55dacfb50d30 2023-12-11T20:24:03.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f534dc06b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfaa9470 con 0x55dacfb51c20 2023-12-11T20:24:03.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f534dc06b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfaa4d60 con 0x55dacfb503d0 2023-12-11T20:24:03.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f53337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb50d30 0x55dacfb51640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f53337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb50d30 0x55dacfb51640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36350/0 (socket says 172.21.15.12:36350) 2023-12-11T20:24:03.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.101+0000 7f53337fe700 1 -- 172.21.15.12:0/4254809233 learned_addr learned my addr 172.21.15.12:0/4254809233 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5332ffd700 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5333fff700 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb503d0 0x55dacfb507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5332ffd700 1 -- 172.21.15.12:0/4254809233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb503d0 msgr2=0x55dacfb507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5332ffd700 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb503d0 0x55dacfb507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5332ffd700 1 -- 172.21.15.12:0/4254809233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb50d30 msgr2=0x55dacfb51640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5332ffd700 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb50d30 0x55dacfb51640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5332ffd700 1 -- 172.21.15.12:0/4254809233 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dacf921630 con 0x55dacfb51c20 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5330ff9700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f531c0a1500 0x7f531c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5333fff700 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb503d0 0x55dacfb507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5330ff9700 1 -- 172.21.15.12:0/839173656 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f53240ce0d0 con 0x7f5334101f80 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5333fff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f531c0a1500 0x7f531c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.102+0000 7f5332ffd700 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb520a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5328009c00 tx=0x7f5328009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9c4afff18ee0e39 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.103+0000 7f5319ffb700 1 -- 172.21.15.12:0/4254809233 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328011b70 con 0x55dacfb51c20 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.103+0000 7f5319ffb700 1 -- 172.21.15.12:0/4254809233 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5328011cd0 con 0x55dacfb51c20 2023-12-11T20:24:03.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.103+0000 7f5319ffb700 1 -- 172.21.15.12:0/4254809233 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532800f6a0 con 0x55dacfb51c20 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 -- 172.21.15.12:0/4254809233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 msgr2=0x55dacfb520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb520a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5328009c00 tx=0x7f5328009f10 comp rx=0 tx=0).stop 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f5333fff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f531c0a1500 0x7f531c0a39c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f532c009fd0 tx=0x7f532c00b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 -- 172.21.15.12:0/4254809233 shutdown_connections 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb520a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb503d0 0x55dacfb507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 --2- 172.21.15.12:0/4254809233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb50d30 0x55dacfb51640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 -- 172.21.15.12:0/4254809233 >> 172.21.15.12:0/4254809233 conn(0x55dacfa7f7e0 msgr2=0x55dacfb4cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 -- 172.21.15.12:0/4254809233 shutdown_connections 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 -- 172.21.15.12:0/4254809233 wait complete. 2023-12-11T20:24:03.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.104+0000 7f534dc06b80 1 -- start start 2023-12-11T20:24:03.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.105+0000 7f534dc06b80 1 Processor -- start 2023-12-11T20:24:03.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.105+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.105+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb5a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.105+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.105+0000 7f534dc06b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfa5e560 con 0x55dacfb51c20 2023-12-11T20:24:03.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.105+0000 7f534dc06b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfa5e200 con 0x55dacfb503d0 2023-12-11T20:24:03.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.105+0000 7f534dc06b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacf923920 con 0x55dacfb50d30 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.105+0000 7f534dc06b80 10 client.0 _ll_register_callbacks cb 0x55dacf989a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5333fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5333fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36352/0 (socket says 172.21.15.12:36352) 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5333fff700 1 -- 172.21.15.12:0/2699225520 learned_addr learned my addr 172.21.15.12:0/2699225520 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5332ffd700 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb5a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f53337fe700 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5333fff700 1 -- 172.21.15.12:0/2699225520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 msgr2=0x55dacfb5a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5333fff700 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb5a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5333fff700 1 -- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 msgr2=0x55dacfb5a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5333fff700 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f5333fff700 1 -- 172.21.15.12:0/2699225520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c009050 con 0x55dacfb51c20 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.106+0000 7f53337fe700 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.107+0000 7f5333fff700 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb616c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f532c016e00 tx=0x7f532c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cfd4520fbd2815 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.107+0000 7f5312ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.107+0000 7f5312ffd700 1 -- 172.21.15.12:0/2699225520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c00e050 con 0x55dacfb51c20 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.107+0000 7f534dc06b80 1 -- 172.21.15.12:0/2699225520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dacfb43b40 con 0x55dacfb51c20 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.107+0000 7f5312ffd700 1 -- 172.21.15.12:0/2699225520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f532c016e30 con 0x55dacfb51c20 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.107+0000 7f5312ffd700 1 -- 172.21.15.12:0/2699225520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f532c015db0 con 0x55dacfb51c20 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.107+0000 7f534dc06b80 10 client.17757 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.107+0000 7f534dc06b80 1 -- 172.21.15.12:0/2699225520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f5328009830 con 0x55dacfb51c20 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.108+0000 7f5312ffd700 1 -- 172.21.15.12:0/2699225520 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f532c032020 con 0x55dacfb51c20 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.108+0000 7f5312ffd700 1 -- 172.21.15.12:0/2699225520 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f532c007d20 con 0x55dacfb51c20 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.108+0000 7f534dc06b80 10 client.17757 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.108+0000 7f534dc06b80 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.108+0000 7f534dc06b80 20 client.17757 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:03.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.108+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dacfb65fb0 0x55dacfb683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.108+0000 7f534dc06b80 4 client.17757 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.108+0000 7f534dc06b80 1 -- 172.21.15.12:0/2699225520 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dacfb1ff40 con 0x55dacfb65fb0 2023-12-11T20:24:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.109+0000 7f53337fe700 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dacfb65fb0 0x55dacfb683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.109+0000 7f53337fe700 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dacfb65fb0 0x55dacfb683d0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=332c157e59beeb9 server_cookie=931f281cf88ad1d6 in_seq=0 out_seq=0 2023-12-11T20:24:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.109+0000 7f5312ffd700 10 client.17757 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f5312ffd700 1 -- 172.21.15.12:0/2699225520 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dacfb1ff40 con 0x55dacfb65fb0 2023-12-11T20:24:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f5312ffd700 10 client.17757 handle_command_reply: tid=0 2023-12-11T20:24:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 client.17757 shutdown 2023-12-11T20:24:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 -- 172.21.15.12:0/2699225520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 msgr2=0x55dacfb616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb616c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f532c016e00 tx=0x7f532c004b40 comp rx=0 tx=0).stop 2023-12-11T20:24:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 -- 172.21.15.12:0/2699225520 shutdown_connections 2023-12-11T20:24:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dacfb65fb0 0x55dacfb683d0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb616c0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2699225520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb5a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 -- 172.21.15.12:0/2699225520 >> 172.21.15.12:0/2699225520 conn(0x55dacfa7f7e0 msgr2=0x55dacfb4ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f5312ffd700 0 client.17757 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 -- 172.21.15.12:0/2699225520 shutdown_connections 2023-12-11T20:24:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.110+0000 7f534dc06b80 1 -- 172.21.15.12:0/2699225520 wait complete. 2023-12-11T20:24:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.111+0000 7f534dc06b80 20 client.17757 trim_cache size 0 max 16384 2023-12-11T20:24:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.132+0000 7f534dc06b80 1 Processor -- start 2023-12-11T20:24:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.132+0000 7f534dc06b80 1 -- start start 2023-12-11T20:24:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.132+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb503d0 0x55dacfb52000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.132+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.132+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb54b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.132+0000 7f534dc06b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfb62840 con 0x55dacfb503d0 2023-12-11T20:24:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.132+0000 7f534dc06b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfb59cb0 con 0x55dacfb51c20 2023-12-11T20:24:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.132+0000 7f534dc06b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfb61b50 con 0x55dacfb50d30 2023-12-11T20:24:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb503d0 0x55dacfb52000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb503d0 0x55dacfb52000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36362/0 (socket says 172.21.15.12:36362) 2023-12-11T20:24:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 -- 172.21.15.12:0/3065358646 learned_addr learned my addr 172.21.15.12:0/3065358646 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f5333fff700 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb54b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f5332ffd700 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 -- 172.21.15.12:0/3065358646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 msgr2=0x55dacfb615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 -- 172.21.15.12:0/3065358646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 msgr2=0x55dacfb54b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb54b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 -- 172.21.15.12:0/3065358646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dacf8cdde0 con 0x55dacfb503d0 2023-12-11T20:24:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f5333fff700 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb54b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.133+0000 7f53337fe700 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb503d0 0x55dacfb52000 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5324005f50 tx=0x7f53240d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210f42e2dda3e22e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.134+0000 7f531a7fc700 1 -- 172.21.15.12:0/3065358646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532409b200 con 0x55dacfb503d0 2023-12-11T20:24:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.134+0000 7f531a7fc700 1 -- 172.21.15.12:0/3065358646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f532409af70 con 0x55dacfb503d0 2023-12-11T20:24:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.134+0000 7f531a7fc700 1 -- 172.21.15.12:0/3065358646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532409b430 con 0x55dacfb503d0 2023-12-11T20:24:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.134+0000 7f534dc06b80 1 -- 172.21.15.12:0/3065358646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb503d0 msgr2=0x55dacfb52000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.134+0000 7f534dc06b80 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb503d0 0x55dacfb52000 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5324005f50 tx=0x7f53240d0040 comp rx=0 tx=0).stop 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.134+0000 7f534dc06b80 1 -- 172.21.15.12:0/3065358646 shutdown_connections 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.135+0000 7f534dc06b80 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb51c20 0x55dacfb54b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.135+0000 7f534dc06b80 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb503d0 0x55dacfb52000 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.135+0000 7f534dc06b80 1 --2- 172.21.15.12:0/3065358646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.135+0000 7f534dc06b80 1 -- 172.21.15.12:0/3065358646 >> 172.21.15.12:0/3065358646 conn(0x55dacfa7f7e0 msgr2=0x55dacfb58170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.135+0000 7f534dc06b80 1 -- 172.21.15.12:0/3065358646 shutdown_connections 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.135+0000 7f534dc06b80 1 -- 172.21.15.12:0/3065358646 wait complete. 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.135+0000 7f534dc06b80 1 -- start start 2023-12-11T20:24:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.135+0000 7f534dc06b80 1 Processor -- start 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb5f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f534dc06b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb60590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f534dc06b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfb60ad0 con 0x55dacfb51c20 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f534dc06b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfb60c40 con 0x55dacfb503d0 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f534dc06b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacfb60e00 con 0x55dacfb50d30 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f534dc06b80 10 client.0 _ll_register_callbacks cb 0x55dacf989a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f5333fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb60590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f5333fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb60590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36370/0 (socket says 172.21.15.12:36370) 2023-12-11T20:24:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f5333fff700 1 -- 172.21.15.12:0/2238756551 learned_addr learned my addr 172.21.15.12:0/2238756551 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f53337fe700 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.136+0000 7f5332ffd700 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb5f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f53337fe700 1 -- 172.21.15.12:0/2238756551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 msgr2=0x55dacfb5f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f53337fe700 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb5f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f53337fe700 1 -- 172.21.15.12:0/2238756551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 msgr2=0x55dacfb60590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f53337fe700 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb60590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f53337fe700 1 -- 172.21.15.12:0/2238756551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53341a1a30 con 0x55dacfb503d0 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f5333fff700 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb60590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f53337fe700 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5f0e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f532400bfe0 tx=0x7f532409ad90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f71460b2d969424 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f5312ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:24:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f5312ffd700 1 -- 172.21.15.12:0/2238756551 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324022470 con 0x55dacfb503d0 2023-12-11T20:24:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f5312ffd700 1 -- 172.21.15.12:0/2238756551 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f532409f580 con 0x55dacfb503d0 2023-12-11T20:24:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.137+0000 7f534dc06b80 1 -- 172.21.15.12:0/2238756551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5328011cd0 con 0x55dacfb503d0 2023-12-11T20:24:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f5312ffd700 1 -- 172.21.15.12:0/2238756551 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53240a3730 con 0x55dacfb503d0 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f534dc06b80 10 client.27431 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f534dc06b80 1 -- 172.21.15.12:0/2238756551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55dacf8b6c60 con 0x55dacfb503d0 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f5312ffd700 1 -- 172.21.15.12:0/2238756551 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5328011cd0 con 0x55dacfb503d0 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f5312ffd700 1 -- 172.21.15.12:0/2238756551 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f53240a32a0 con 0x55dacfb503d0 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f534dc06b80 10 client.27431 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f534dc06b80 10 client.27431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f534dc06b80 20 client.27431 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dacfbbcca0 0x55dacfbbf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f534dc06b80 4 client.27431 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:24:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.138+0000 7f534dc06b80 1 -- 172.21.15.12:0/2238756551 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dacfa6afd0 con 0x55dacfbbcca0 2023-12-11T20:24:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.139+0000 7f5332ffd700 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dacfbbcca0 0x55dacfbbf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.139+0000 7f5332ffd700 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dacfbbcca0 0x55dacfbbf0c0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83da476ccfa77da7 server_cookie=5a1bce29468a3786 in_seq=0 out_seq=0 2023-12-11T20:24:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.139+0000 7f5312ffd700 10 client.27431 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f5312ffd700 1 -- 172.21.15.12:0/2238756551 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55dacfa6afd0 con 0x55dacfbbcca0 2023-12-11T20:24:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f5312ffd700 10 client.27431 handle_command_reply: tid=0 2023-12-11T20:24:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 client.27431 shutdown 2023-12-11T20:24:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 -- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 msgr2=0x55dacfb5f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5f0e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f532400bfe0 tx=0x7f532409ad90 comp rx=0 tx=0).stop 2023-12-11T20:24:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 -- 172.21.15.12:0/2238756551 shutdown_connections 2023-12-11T20:24:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dacfbbcca0 0x55dacfbbf0c0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dacfb503d0 0x55dacfb5f0e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dacfb51c20 0x55dacfb60590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f5312ffd700 0 client.27431 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 --2- 172.21.15.12:0/2238756551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dacfb50d30 0x55dacfb5f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 -- 172.21.15.12:0/2238756551 >> 172.21.15.12:0/2238756551 conn(0x55dacfa7f7e0 msgr2=0x55dacfb54b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 -- 172.21.15.12:0/2238756551 shutdown_connections 2023-12-11T20:24:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 1 -- 172.21.15.12:0/2238756551 wait complete. 2023-12-11T20:24:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.140+0000 7f534dc06b80 20 client.27431 trim_cache size 0 max 16384 2023-12-11T20:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:24:03.152 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:24:03.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 -- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f531c0a1500 msgr2=0x7f531c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f531c0a1500 0x7f531c0a39c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f532c009fd0 tx=0x7f532c00b040 comp rx=0 tx=0).stop 2023-12-11T20:24:03.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 -- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 msgr2=0x7f5334199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 0x7f5334199530 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5324000c00 tx=0x7f53240057f0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 -- 172.21.15.12:0/839173656 shutdown_connections 2023-12-11T20:24:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f531c0a1500 0x7f531c0a39c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53341071e0 0x7f53341a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5334101f80 0x7f5334199530 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 --2- 172.21.15.12:0/839173656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53341048b0 0x7f5334199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 -- 172.21.15.12:0/839173656 >> 172.21.15.12:0/839173656 conn(0x7f53340fb930 msgr2=0x7f53341029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 -- 172.21.15.12:0/839173656 shutdown_connections 2023-12-11T20:24:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.141+0000 7f533a1ff700 1 -- 172.21.15.12:0/839173656 wait complete. 2023-12-11T20:24:03.159 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:24:03.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:24:03.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 -- 172.21.15.12:0/3278605175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa810102e50 msgr2=0x7fa810109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 --2- 172.21.15.12:0/3278605175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa810102e50 0x7fa810109700 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fa80800b0d0 tx=0x7fa80800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 -- 172.21.15.12:0/3278605175 shutdown_connections 2023-12-11T20:24:03.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 --2- 172.21.15.12:0/3278605175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa810102e50 0x7fa810109700 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 --2- 172.21.15.12:0/3278605175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8101012c0 0x7fa8101016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 --2- 172.21.15.12:0/3278605175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8101024b0 0x7fa810102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 -- 172.21.15.12:0/3278605175 >> 172.21.15.12:0/3278605175 conn(0x7fa8100fc810 msgr2=0x7fa8100fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 -- 172.21.15.12:0/3278605175 shutdown_connections 2023-12-11T20:24:03.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.403+0000 7fa81499d700 1 -- 172.21.15.12:0/3278605175 wait complete. 2023-12-11T20:24:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.404+0000 7fa81499d700 1 Processor -- start 2023-12-11T20:24:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.404+0000 7fa81499d700 1 -- start start 2023-12-11T20:24:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa81499d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8101012c0 0x7fa810075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa81499d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8101024b0 0x7fa8100739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa81499d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa810102e50 0x7fa810073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa81499d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100746a0 con 0x7fa8101024b0 2023-12-11T20:24:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa81499d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa810074810 con 0x7fa8101012c0 2023-12-11T20:24:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa81499d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101a1260 con 0x7fa810102e50 2023-12-11T20:24:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa80effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8101024b0 0x7fa8100739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa80effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8101024b0 0x7fa8100739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36392/0 (socket says 172.21.15.12:36392) 2023-12-11T20:24:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa80effd700 1 -- 172.21.15.12:0/2281822542 learned_addr learned my addr 172.21.15.12:0/2281822542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa80f7fe700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8101012c0 0x7fa810075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.405+0000 7fa80ffff700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa810102e50 0x7fa810073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80effd700 1 -- 172.21.15.12:0/2281822542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa810102e50 msgr2=0x7fa810073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80effd700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa810102e50 0x7fa810073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80effd700 1 -- 172.21.15.12:0/2281822542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8101012c0 msgr2=0x7fa810075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80effd700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8101012c0 0x7fa810075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80effd700 1 -- 172.21.15.12:0/2281822542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808009d00 con 0x7fa8101024b0 2023-12-11T20:24:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80ffff700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa810102e50 0x7fa810073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80effd700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8101024b0 0x7fa8100739c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa80400e9a0 tx=0x7fa80400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80cff9700 1 -- 172.21.15.12:0/2281822542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804009790 con 0x7fa8101024b0 2023-12-11T20:24:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8101a14f0 con 0x7fa8101024b0 2023-12-11T20:24:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80cff9700 1 -- 172.21.15.12:0/2281822542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa804010430 con 0x7fa8101024b0 2023-12-11T20:24:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa80cff9700 1 -- 172.21.15.12:0/2281822542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804018680 con 0x7fa8101024b0 2023-12-11T20:24:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.406+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8101a1a00 con 0x7fa8101024b0 2023-12-11T20:24:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.407+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8101086f0 con 0x7fa8101024b0 2023-12-11T20:24:03.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.412+0000 7fa80cff9700 1 -- 172.21.15.12:0/2281822542 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa8040105a0 con 0x7fa8101024b0 2023-12-11T20:24:03.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.413+0000 7fa80cff9700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa7f80a1480 0x7fa7f80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.414+0000 7fa80cff9700 1 -- 172.21.15.12:0/2281822542 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa804014070 con 0x7fa8101024b0 2023-12-11T20:24:03.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.414+0000 7fa80f7fe700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa7f80a1480 0x7fa7f80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.414+0000 7fa80f7fe700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa7f80a1480 0x7fa7f80a3940 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa810102310 tx=0x7fa80000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.415+0000 7fa80cff9700 1 -- 172.21.15.12:0/2281822542 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa8040967d0 con 0x7fa8101024b0 2023-12-11T20:24:03.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:03 smithi039 ceph-mon[102205]: pgmap v619: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:03 smithi012 ceph-mon[128787]: pgmap v619: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:03 smithi032 ceph-mon[132488]: pgmap v619: 97 pgs: 97 active+clean; 5.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:03.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.718+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa81004f300 con 0x7fa8101024b0 2023-12-11T20:24:03.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.719+0000 7fa80cff9700 1 -- 172.21.15.12:0/2281822542 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7fa804099df0 con 0x7fa8101024b0 2023-12-11T20:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:24:03.717 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:24:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa7f80a1480 msgr2=0x7fa7f80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa7f80a1480 0x7fa7f80a3940 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa810102310 tx=0x7fa80000b410 comp rx=0 tx=0).stop 2023-12-11T20:24:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8101024b0 msgr2=0x7fa8100739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8101024b0 0x7fa8100739c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa80400e9a0 tx=0x7fa80400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 shutdown_connections 2023-12-11T20:24:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa7f80a1480 0x7fa7f80a3940 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8101012c0 0x7fa810075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa810102e50 0x7fa810073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 --2- 172.21.15.12:0/2281822542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8101024b0 0x7fa8100739c0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.721+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 >> 172.21.15.12:0/2281822542 conn(0x7fa8100fc810 msgr2=0x7fa810105830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.722+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 shutdown_connections 2023-12-11T20:24:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.722+0000 7fa81499d700 1 -- 172.21.15.12:0/2281822542 wait complete. 2023-12-11T20:24:03.721 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:24:03.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:24:03.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.970+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/1858154652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b48103040 msgr2=0x7f2b481098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.970+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/1858154652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b48103040 0x7f2b481098f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009fc0 tx=0x7f2b4000b330 comp rx=0 tx=0).stop 2023-12-11T20:24:03.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.971+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/1858154652 shutdown_connections 2023-12-11T20:24:03.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.971+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/1858154652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b481014b0 0x7f2b481018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.971+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/1858154652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b48103040 0x7f2b481098f0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.971+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/1858154652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b481026a0 0x7f2b48102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.971+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/1858154652 >> 172.21.15.12:0/1858154652 conn(0x7f2b480fca00 msgr2=0x7f2b480fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.971+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/1858154652 shutdown_connections 2023-12-11T20:24:03.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.971+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/1858154652 wait complete. 2023-12-11T20:24:03.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.972+0000 7f2b4f5ff700 1 Processor -- start 2023-12-11T20:24:03.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.973+0000 7f2b4f5ff700 1 -- start start 2023-12-11T20:24:03.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4f5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b481014b0 0x7f2b48075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4f5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b481026a0 0x7f2b480739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4f5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b48103040 0x7f2b48073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4f5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480746a0 con 0x7f2b481014b0 2023-12-11T20:24:03.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4f5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48074810 con 0x7f2b48103040 2023-12-11T20:24:03.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4f5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b481a14c0 con 0x7f2b481026a0 2023-12-11T20:24:03.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4d39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b481014b0 0x7f2b48075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4d39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b481014b0 0x7f2b48075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36408/0 (socket says 172.21.15.12:36408) 2023-12-11T20:24:03.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4d39b700 1 -- 172.21.15.12:0/369086642 learned_addr learned my addr 172.21.15.12:0/369086642 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.974+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b481026a0 0x7f2b480739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.975+0000 7f2b4d39b700 1 -- 172.21.15.12:0/369086642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b481026a0 msgr2=0x7f2b480739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.975+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b481026a0 0x7f2b480739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.975+0000 7f2b4d39b700 1 -- 172.21.15.12:0/369086642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b48103040 msgr2=0x7f2b48073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.975+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b48103040 0x7f2b48073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.975+0000 7f2b4d39b700 1 -- 172.21.15.12:0/369086642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380095f0 con 0x7f2b481014b0 2023-12-11T20:24:03.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.975+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b481014b0 0x7f2b48075330 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400e970 tx=0x7f2b4400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.976+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/369086642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44009790 con 0x7f2b481014b0 2023-12-11T20:24:03.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.976+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/369086642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b44004020 con 0x7f2b481014b0 2023-12-11T20:24:03.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.976+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/369086642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44003c50 con 0x7f2b481014b0 2023-12-11T20:24:03.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.976+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/369086642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b40009c40 con 0x7f2b481014b0 2023-12-11T20:24:03.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.976+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/369086642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b481a1a80 con 0x7f2b481014b0 2023-12-11T20:24:03.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.981+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/369086642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2b44004190 con 0x7f2b481014b0 2023-12-11T20:24:03.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.984+0000 7f2b62f23b80 1 Processor -- start 2023-12-11T20:24:03.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b3e7fc700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b340a15d0 0x7f2b340a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b62f23b80 1 -- start start 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b3e7fc700 1 -- 172.21.15.12:0/369086642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2b44014070 con 0x7f2b481014b0 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e5be0 0x56147d3e6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e7430 0x56147d3e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d338b50 con 0x56147d3e6540 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d336470 con 0x56147d3e5be0 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d331d60 con 0x56147d3e7430 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.985+0000 7f2b4db9c700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b340a15d0 0x7f2b340a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3e6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36420/0 (socket says 172.21.15.12:36420) 2023-12-11T20:24:03.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4cb9a700 1 -- 172.21.15.12:0/4079596660 learned_addr learned my addr 172.21.15.12:0/4079596660 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e5be0 0x56147d3e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4d39b700 1 -- 172.21.15.12:0/4079596660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e7430 msgr2=0x56147d3e78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e7430 0x56147d3e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4d39b700 1 -- 172.21.15.12:0/4079596660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 msgr2=0x56147d3e6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3e6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4d39b700 1 -- 172.21.15.12:0/4079596660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56147d1ae630 con 0x56147d3e5be0 2023-12-11T20:24:03.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3e6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.986+0000 7f2b4db9c700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b340a15d0 0x7f2b340a3a90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009550 tx=0x7f2b400092e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.987+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e5be0 0x56147d3e6000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400c5b0 tx=0x7f2b44099b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04bdb6ec739fd1d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.987+0000 7f2b337fe700 1 -- 172.21.15.12:0/4079596660 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4409a8e0 con 0x56147d3e5be0 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.987+0000 7f2b337fe700 1 -- 172.21.15.12:0/4079596660 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b4409a1e0 con 0x56147d3e5be0 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.987+0000 7f2b337fe700 1 -- 172.21.15.12:0/4079596660 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44098610 con 0x56147d3e5be0 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4079596660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e5be0 msgr2=0x56147d3e6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e5be0 0x56147d3e6000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400c5b0 tx=0x7f2b44099b40 comp rx=0 tx=0).stop 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4079596660 shutdown_connections 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e5be0 0x56147d3e6000 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e7430 0x56147d3e78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/4079596660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3e6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4079596660 >> 172.21.15.12:0/4079596660 conn(0x56147d30c7e0 msgr2=0x56147d3d9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4079596660 shutdown_connections 2023-12-11T20:24:03.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4079596660 wait complete. 2023-12-11T20:24:03.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.988+0000 7f2b62f23b80 1 -- start start 2023-12-11T20:24:03.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b62f23b80 1 Processor -- start 2023-12-11T20:24:03.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3eff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d2eb560 con 0x56147d3e6540 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d2eb200 con 0x56147d3e7430 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d1b0920 con 0x56147d3e5be0 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b62f23b80 10 client.0 _ll_register_callbacks cb 0x56147d216a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b4cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b4d39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b4cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3eff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36430/0 (socket says 172.21.15.12:36430) 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b4d39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ef9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46602/0 (socket says 172.21.15.12:46602) 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.989+0000 7f2b4cb9a700 1 -- 172.21.15.12:0/796719852 learned_addr learned my addr 172.21.15.12:0/796719852 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4db9c700 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4d39b700 1 -- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 msgr2=0x56147d3f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4d39b700 1 -- 172.21.15.12:0/796719852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 msgr2=0x56147d3eff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3eff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4d39b700 1 -- 172.21.15.12:0/796719852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b38009bb0 con 0x56147d3e5be0 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4db9c700 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ef9e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b44005950 tx=0x7f2b44095ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f36f68b4e0ccaf29 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.990+0000 7f2b30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.991+0000 7f2b30ff9700 1 -- 172.21.15.12:0/796719852 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440a2570 con 0x56147d3e5be0 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.991+0000 7f2b30ff9700 1 -- 172.21.15.12:0/796719852 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2b440996d0 con 0x56147d3e5be0 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.991+0000 7f2b62f23b80 1 -- 172.21.15.12:0/796719852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56147d3d0b40 con 0x56147d3e5be0 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.991+0000 7f2b30ff9700 1 -- 172.21.15.12:0/796719852 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b44099890 con 0x56147d3e5be0 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.991+0000 7f2b62f23b80 10 client.27430 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.991+0000 7f2b62f23b80 1 -- 172.21.15.12:0/796719852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f2b481a1a80 con 0x56147d3e5be0 2023-12-11T20:24:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.991+0000 7f2b30ff9700 1 -- 172.21.15.12:0/796719852 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56147d3d0b40 con 0x56147d3e5be0 2023-12-11T20:24:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.991+0000 7f2b30ff9700 1 -- 172.21.15.12:0/796719852 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2b440b8380 con 0x56147d3e5be0 2023-12-11T20:24:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.992+0000 7f2b62f23b80 10 client.27430 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.992+0000 7f2b62f23b80 10 client.27430 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:24:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.992+0000 7f2b62f23b80 20 client.27430 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.992+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56147d3fb410 0x56147d3fd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.992+0000 7f2b62f23b80 4 client.27430 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.992+0000 7f2b62f23b80 1 -- 172.21.15.12:0/796719852 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56147d3acf40 con 0x56147d3fb410 2023-12-11T20:24:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.992+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56147d3fb410 0x56147d3fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:03.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.993+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56147d3fb410 0x56147d3fd800 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=512fcc86ed7b8de6 server_cookie=7b52fdda9de6390d in_seq=0 out_seq=0 2023-12-11T20:24:03.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.993+0000 7f2b30ff9700 10 client.27430 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:24:03.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.993+0000 7f2b30ff9700 1 -- 172.21.15.12:0/796719852 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56147d3acf40 con 0x56147d3fb410 2023-12-11T20:24:03.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.993+0000 7f2b30ff9700 10 client.27430 handle_command_reply: tid=0 2023-12-11T20:24:03.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 client.27430 shutdown 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 -- 172.21.15.12:0/796719852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 msgr2=0x56147d3ef9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ef9e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b44005950 tx=0x7f2b44095ef0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 -- 172.21.15.12:0/796719852 shutdown_connections 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56147d3fb410 0x56147d3fd800 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ef9e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b30ff9700 0 client.27430 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/796719852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 -- 172.21.15.12:0/796719852 >> 172.21.15.12:0/796719852 conn(0x56147d30c7e0 msgr2=0x56147d3d8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 -- 172.21.15.12:0/796719852 shutdown_connections 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 1 -- 172.21.15.12:0/796719852 wait complete. 2023-12-11T20:24:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:03.994+0000 7f2b62f23b80 20 client.27430 trim_cache size 0 max 16384 2023-12-11T20:24:04.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.012+0000 7f2b62f23b80 1 Processor -- start 2023-12-11T20:24:04.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b62f23b80 1 -- start start 2023-12-11T20:24:04.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3e7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d3ef590 con 0x56147d3e6540 2023-12-11T20:24:04.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d3d4ba0 con 0x56147d3e7430 2023-12-11T20:24:04.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d3e69a0 con 0x56147d3e5be0 2023-12-11T20:24:04.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b4cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b4cb9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3f6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36436/0 (socket says 172.21.15.12:36436) 2023-12-11T20:24:04.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b4cb9a700 1 -- 172.21.15.12:0/4157543924 learned_addr learned my addr 172.21.15.12:0/4157543924 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.013+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b4db9c700 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b4cb9a700 1 -- 172.21.15.12:0/4157543924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 msgr2=0x56147d3ee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b4cb9a700 1 -- 172.21.15.12:0/4157543924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 msgr2=0x56147d3e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b4cb9a700 1 -- 172.21.15.12:0/4157543924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56147d15ade0 con 0x56147d3e6540 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b4db9c700 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3f6f20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x56147d3fe110 tx=0x7f2b38009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8142c28e89a038 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b33fff700 1 -- 172.21.15.12:0/4157543924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38017070 con 0x56147d3e6540 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b33fff700 1 -- 172.21.15.12:0/4157543924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b38018040 con 0x56147d3e6540 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.014+0000 7f2b33fff700 1 -- 172.21.15.12:0/4157543924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380052f0 con 0x56147d3e6540 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4157543924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 msgr2=0x56147d3f6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3f6f20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x56147d3fe110 tx=0x7f2b38009310 comp rx=0 tx=0).stop 2023-12-11T20:24:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4157543924 shutdown_connections 2023-12-11T20:24:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e7430 0x56147d3e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/4157543924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e6540 0x56147d3f6f20 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4157543924 >> 172.21.15.12:0/4157543924 conn(0x56147d30c7e0 msgr2=0x56147d3eda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4157543924 shutdown_connections 2023-12-11T20:24:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.015+0000 7f2b62f23b80 1 -- 172.21.15.12:0/4157543924 wait complete. 2023-12-11T20:24:04.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.016+0000 7f2b62f23b80 1 -- start start 2023-12-11T20:24:04.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.016+0000 7f2b62f23b80 1 Processor -- start 2023-12-11T20:24:04.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.016+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.016+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e6540 0x56147d3f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.016+0000 7f2b62f23b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e7430 0x56147d3f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d3f6110 con 0x56147d3e7430 2023-12-11T20:24:04.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d3f6280 con 0x56147d3e6540 2023-12-11T20:24:04.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b62f23b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d3f6440 con 0x56147d3e5be0 2023-12-11T20:24:04.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b62f23b80 10 client.0 _ll_register_callbacks cb 0x56147d216a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e7430 0x56147d3f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4d39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4d39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46624/0 (socket says 172.21.15.12:46624) 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e7430 0x56147d3f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36442/0 (socket says 172.21.15.12:36442) 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4d39b700 1 -- 172.21.15.12:0/454410663 learned_addr learned my addr 172.21.15.12:0/454410663 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e6540 0x56147d3f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4d39b700 1 -- 172.21.15.12:0/454410663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e6540 msgr2=0x56147d3f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e6540 0x56147d3f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4d39b700 1 -- 172.21.15.12:0/454410663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e7430 msgr2=0x56147d3f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e7430 0x56147d3f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.017+0000 7f2b4d39b700 1 -- 172.21.15.12:0/454410663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b38012a00 con 0x56147d3e5be0 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b4d39b700 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3f26c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b4409a170 tx=0x7f2b44099dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee4f6a3486515742 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:24:04.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b30ff9700 1 -- 172.21.15.12:0/454410663 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440998d0 con 0x56147d3e5be0 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b30ff9700 1 -- 172.21.15.12:0/454410663 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2b440a22f0 con 0x56147d3e5be0 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b62f23b80 1 -- 172.21.15.12:0/454410663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b4409a1e0 con 0x56147d3e5be0 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b30ff9700 1 -- 172.21.15.12:0/454410663 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b44096520 con 0x56147d3e5be0 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b62f23b80 10 client.27436 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b62f23b80 1 -- 172.21.15.12:0/454410663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56147d143c60 con 0x56147d3e5be0 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b30ff9700 1 -- 172.21.15.12:0/454410663 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b44088020 con 0x56147d3e5be0 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.018+0000 7f2b30ff9700 1 -- 172.21.15.12:0/454410663 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2b440b8310 con 0x56147d3e5be0 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.019+0000 7f2b62f23b80 10 client.27436 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:04.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.019+0000 7f2b62f23b80 10 client.27436 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.019+0000 7f2b62f23b80 20 client.27436 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.019+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56147d451ba0 0x56147d453f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.019+0000 7f2b62f23b80 4 client.27436 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.019+0000 7f2b62f23b80 1 -- 172.21.15.12:0/454410663 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56147d2f7fd0 con 0x56147d451ba0 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.019+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56147d451ba0 0x56147d453f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b4cb9a700 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56147d451ba0 0x56147d453f90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9410af8b56e16ba server_cookie=326fb8563fa0438a in_seq=0 out_seq=0 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b30ff9700 10 client.27436 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b30ff9700 1 -- 172.21.15.12:0/454410663 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56147d2f7fd0 con 0x56147d451ba0 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b30ff9700 10 client.27436 handle_command_reply: tid=0 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 client.27436 shutdown 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 -- 172.21.15.12:0/454410663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 msgr2=0x56147d3f26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3f26c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b4409a170 tx=0x7f2b44099dd0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 -- 172.21.15.12:0/454410663 shutdown_connections 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56147d451ba0 0x56147d453f90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147d3e7430 0x56147d3f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56147d3e5be0 0x56147d3f26c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b30ff9700 0 client.27436 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 --2- 172.21.15.12:0/454410663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56147d3e6540 0x56147d3f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 -- 172.21.15.12:0/454410663 >> 172.21.15.12:0/454410663 conn(0x56147d30c7e0 msgr2=0x56147d3d9970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 -- 172.21.15.12:0/454410663 shutdown_connections 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.020+0000 7f2b62f23b80 1 -- 172.21.15.12:0/454410663 wait complete. 2023-12-11T20:24:04.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b62f23b80 20 client.27436 trim_cache size 0 max 16384 2023-12-11T20:24:04.026 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:24:04.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b340a15d0 msgr2=0x7f2b340a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b340a15d0 0x7f2b340a3a90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009550 tx=0x7f2b400092e0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b481014b0 msgr2=0x7f2b48075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b481014b0 0x7f2b48075330 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400e970 tx=0x7f2b4400ed30 comp rx=0 tx=0).stop 2023-12-11T20:24:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/369086642 shutdown_connections 2023-12-11T20:24:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b340a15d0 0x7f2b340a3a90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b48103040 0x7f2b48073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b481014b0 0x7f2b48075330 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 --2- 172.21.15.12:0/369086642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b481026a0 0x7f2b480739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/369086642 >> 172.21.15.12:0/369086642 conn(0x7f2b480fca00 msgr2=0x7f2b48105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/369086642 shutdown_connections 2023-12-11T20:24:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.021+0000 7f2b4f5ff700 1 -- 172.21.15.12:0/369086642 wait complete. 2023-12-11T20:24:04.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:24:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 -- 172.21.15.12:0/3550355615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 msgr2=0x7f2ca8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/3550355615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 0x7f2ca8109650 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009f90 tx=0x7f2ca000b330 comp rx=0 tx=0).stop 2023-12-11T20:24:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 -- 172.21.15.12:0/3550355615 shutdown_connections 2023-12-11T20:24:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/3550355615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca8101f80 0x7f2ca8104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/3550355615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 0x7f2ca8109650 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/3550355615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ca81048b0 0x7f2ca8106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 -- 172.21.15.12:0/3550355615 >> 172.21.15.12:0/3550355615 conn(0x7f2ca80fb930 msgr2=0x7f2ca80fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 -- 172.21.15.12:0/3550355615 shutdown_connections 2023-12-11T20:24:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.260+0000 7f2cad9ff700 1 -- 172.21.15.12:0/3550355615 wait complete. 2023-12-11T20:24:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.261+0000 7f2cad9ff700 1 Processor -- start 2023-12-11T20:24:04.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2cad9ff700 1 -- start start 2023-12-11T20:24:04.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2cad9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ca8101f80 0x7f2ca8195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2cad9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca81048b0 0x7f2ca8196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2cad9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 0x7f2ca8192880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2cad9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8193020 con 0x7f2ca81071e0 2023-12-11T20:24:04.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2cad9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8193190 con 0x7f2ca81048b0 2023-12-11T20:24:04.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2cad9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8193350 con 0x7f2ca8101f80 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2ca77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 0x7f2ca8192880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2ca77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 0x7f2ca8192880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36470/0 (socket says 172.21.15.12:36470) 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.262+0000 7f2ca77fe700 1 -- 172.21.15.12:0/506873473 learned_addr learned my addr 172.21.15.12:0/506873473 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.263+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ca8101f80 0x7f2ca8195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.263+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca81048b0 0x7f2ca8196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.263+0000 7f2ca77fe700 1 -- 172.21.15.12:0/506873473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ca8101f80 msgr2=0x7f2ca8195cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.263+0000 7f2ca77fe700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ca8101f80 0x7f2ca8195cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.263+0000 7f2ca77fe700 1 -- 172.21.15.12:0/506873473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca81048b0 msgr2=0x7f2ca8196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.263+0000 7f2ca77fe700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca81048b0 0x7f2ca8196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.263+0000 7f2ca77fe700 1 -- 172.21.15.12:0/506873473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009c40 con 0x7f2ca81071e0 2023-12-11T20:24:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.263+0000 7f2ca77fe700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 0x7f2ca8192880 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009f60 tx=0x7f2ca0008c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.264+0000 7f2cac9fd700 1 -- 172.21.15.12:0/506873473 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000e040 con 0x7f2ca81071e0 2023-12-11T20:24:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.264+0000 7f2cac9fd700 1 -- 172.21.15.12:0/506873473 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ca000bc00 con 0x7f2ca81071e0 2023-12-11T20:24:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.264+0000 7f2cad9ff700 1 -- 172.21.15.12:0/506873473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca81a5b20 con 0x7f2ca81071e0 2023-12-11T20:24:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.264+0000 7f2cac9fd700 1 -- 172.21.15.12:0/506873473 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0005040 con 0x7f2ca81071e0 2023-12-11T20:24:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.264+0000 7f2cad9ff700 1 -- 172.21.15.12:0/506873473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca81a5fa0 con 0x7f2ca81071e0 2023-12-11T20:24:04.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.268+0000 7f2cac9fd700 1 -- 172.21.15.12:0/506873473 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2ca001d470 con 0x7f2ca81071e0 2023-12-11T20:24:04.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.269+0000 7f2cc12a1b80 1 Processor -- start 2023-12-11T20:24:04.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.269+0000 7f2cc12a1b80 1 -- start start 2023-12-11T20:24:04.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.269+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a917f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.269+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a92640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.269+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 0x563dd1a930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd19ecb50 con 0x563dd1a913d0 2023-12-11T20:24:04.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd19ea470 con 0x563dd1a92c20 2023-12-11T20:24:04.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd19e5d60 con 0x563dd1a91d30 2023-12-11T20:24:04.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a92640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a917f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a92640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46658/0 (socket says 172.21.15.12:46658) 2023-12-11T20:24:04.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/2172131456 learned_addr learned my addr 172.21.15.12:0/2172131456 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/2172131456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 msgr2=0x563dd1a930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/2172131456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 0x563dd1a930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/2172131456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 msgr2=0x563dd1a917f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/2172131456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a917f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/2172131456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dd1862630 con 0x563dd1a91d30 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/2172131456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a917f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.270+0000 7f2cac9fd700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c900a1480 0x7f2c900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.271+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/2172131456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a92640 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009d60 tx=0x7f2c98011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bd9def02a0ff1a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.271+0000 7f2cac9fd700 1 -- 172.21.15.12:0/506873473 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2ca00ce0f0 con 0x7f2ca81071e0 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.271+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c900a1480 0x7f2c900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.271+0000 7f2c8dffb700 1 -- 172.21.15.12:0/2172131456 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98019630 con 0x563dd1a91d30 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.271+0000 7f2c8dffb700 1 -- 172.21.15.12:0/2172131456 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c98019c20 con 0x563dd1a91d30 2023-12-11T20:24:04.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.271+0000 7f2c8dffb700 1 -- 172.21.15.12:0/2172131456 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800eb40 con 0x563dd1a91d30 2023-12-11T20:24:04.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c900a1480 0x7f2c900a3940 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x563dd1a92400 tx=0x7f2c9c0058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/2172131456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 msgr2=0x563dd1a92640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/2172131456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a92640 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009d60 tx=0x7f2c98011720 comp rx=0 tx=0).stop 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/2172131456 shutdown_connections 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/2172131456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 0x563dd1a930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/2172131456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a917f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/2172131456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a92640 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/2172131456 >> 172.21.15.12:0/2172131456 conn(0x563dd19c07e0 msgr2=0x563dd1a8dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/2172131456 shutdown_connections 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.272+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/2172131456 wait complete. 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.273+0000 7f2cc12a1b80 1 -- start start 2023-12-11T20:24:04.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.273+0000 7f2cc12a1b80 1 Processor -- start 2023-12-11T20:24:04.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a9b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a9b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 0x563dd1aa2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd199f560 con 0x563dd1a913d0 2023-12-11T20:24:04.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd199f200 con 0x563dd1a92c20 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd1864920 con 0x563dd1a91d30 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2cc12a1b80 10 client.0 _ll_register_callbacks cb 0x563dd18caa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a9b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2ca67fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a9b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a9b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36490/0 (socket says 172.21.15.12:36490) 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/273191511 learned_addr learned my addr 172.21.15.12:0/273191511 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.274+0000 7f2ca77fe700 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 0x563dd1aa2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/273191511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 msgr2=0x563dd1a9b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a9b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/273191511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 msgr2=0x563dd1aa2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 0x563dd1aa2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/273191511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c009a00 con 0x563dd1a913d0 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a9b1d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2c98000c00 tx=0x7f2c9800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294f683593482da3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2c86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2c86ffd700 1 -- 172.21.15.12:0/273191511 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98019840 con 0x563dd1a913d0 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/273191511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dd1a84b40 con 0x563dd1a913d0 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.275+0000 7f2c86ffd700 1 -- 172.21.15.12:0/273191511 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2c980199a0 con 0x563dd1a913d0 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2c86ffd700 1 -- 172.21.15.12:0/273191511 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c98004030 con 0x563dd1a913d0 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2cc12a1b80 10 client.17799 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/273191511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f2c980099c0 con 0x563dd1a913d0 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2c86ffd700 1 -- 172.21.15.12:0/273191511 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563dd1a84b40 con 0x563dd1a913d0 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2c86ffd700 1 -- 172.21.15.12:0/273191511 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2c98004750 con 0x563dd1a913d0 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2cc12a1b80 10 client.17799 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2cc12a1b80 10 client.17799 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2cc12a1b80 20 client.17799 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x563dd1aa6e60 0x563dd1aa9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2cc12a1b80 4 client.17799 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:04.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.276+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/273191511 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563dd1a60f40 con 0x563dd1aa6e60 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.277+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x563dd1aa6e60 0x563dd1aa9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.277+0000 7f2c86ffd700 10 client.17799 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.277+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x563dd1aa6e60 0x563dd1aa9280 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc222ed5ffdc6dbd server_cookie=17ed2a8dc755513e in_seq=0 out_seq=0 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.278+0000 7f2c86ffd700 1 -- 172.21.15.12:0/273191511 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563dd1a60f40 con 0x563dd1aa6e60 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.278+0000 7f2c86ffd700 10 client.17799 handle_command_reply: tid=0 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.278+0000 7f2cc12a1b80 1 client.17799 shutdown 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/273191511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 msgr2=0x563dd1a9b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a9b1d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2c98000c00 tx=0x7f2c9800eea0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/273191511 shutdown_connections 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x563dd1aa6e60 0x563dd1aa9280 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a92c20 0x563dd1aa2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2c86ffd700 0 client.17799 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:24:04.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a9b1d0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/273191511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1a9b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/273191511 >> 172.21.15.12:0/273191511 conn(0x563dd19c07e0 msgr2=0x563dd1a8ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/273191511 shutdown_connections 2023-12-11T20:24:04.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/273191511 wait complete. 2023-12-11T20:24:04.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.279+0000 7f2cc12a1b80 20 client.17799 trim_cache size 0 max 16384 2023-12-11T20:24:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.296+0000 7f2cc12a1b80 1 Processor -- start 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.296+0000 7f2cc12a1b80 1 -- start start 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a93000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a91d30 0x563dd1aa2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a92c20 0x563dd1a9a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd1a91050 con 0x563dd1a913d0 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd1aa38d0 con 0x563dd1a91d30 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd1a92110 con 0x563dd1a92c20 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a93000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a93000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36492/0 (socket says 172.21.15.12:36492) 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/3876253311 learned_addr learned my addr 172.21.15.12:0/3876253311 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca77fe700 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a92c20 0x563dd1a9a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a91d30 0x563dd1aa2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/3876253311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a92c20 msgr2=0x563dd1a9a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a92c20 0x563dd1a9a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/3876253311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a91d30 msgr2=0x563dd1aa2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a91d30 0x563dd1aa2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/3876253311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dd180ede0 con 0x563dd1a913d0 2023-12-11T20:24:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.297+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a91d30 0x563dd1aa2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.298+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a93000 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2c98011760 tx=0x7f2c98005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151a68b41d36b754 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.298+0000 7f2c8e7fc700 1 -- 172.21.15.12:0/3876253311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800e5b0 con 0x563dd1a913d0 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.298+0000 7f2c8e7fc700 1 -- 172.21.15.12:0/3876253311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c9802f030 con 0x563dd1a913d0 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.298+0000 7f2c8e7fc700 1 -- 172.21.15.12:0/3876253311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980055b0 con 0x563dd1a913d0 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3876253311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 msgr2=0x563dd1a93000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a93000 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2c98011760 tx=0x7f2c98005a40 comp rx=0 tx=0).stop 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3876253311 shutdown_connections 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a92c20 0x563dd1a9a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a913d0 0x563dd1a93000 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3876253311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a91d30 0x563dd1aa2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3876253311 >> 172.21.15.12:0/3876253311 conn(0x563dd19c07e0 msgr2=0x563dd1a99180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3876253311 shutdown_connections 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3876253311 wait complete. 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.299+0000 7f2cc12a1b80 1 -- start start 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2cc12a1b80 1 Processor -- start 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a913d0 0x563dd1aa0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1aa0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2cc12a1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a92c20 0x563dd1aa1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd1aa1ad0 con 0x563dd1a92c20 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd1aa1c40 con 0x563dd1a913d0 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2cc12a1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd1aa1e00 con 0x563dd1a91d30 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2cc12a1b80 10 client.0 _ll_register_callbacks cb 0x563dd18caa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2ca77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a92c20 0x563dd1aa1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a913d0 0x563dd1aa0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2ca67fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1aa0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a913d0 0x563dd1aa0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54156/0 (socket says 172.21.15.12:54156) 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.300+0000 7f2ca6ffd700 1 -- 172.21.15.12:0/3969914202 learned_addr learned my addr 172.21.15.12:0/3969914202 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2ca67fc700 1 -- 172.21.15.12:0/3969914202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a913d0 msgr2=0x563dd1aa0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a913d0 0x563dd1aa0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2ca67fc700 1 -- 172.21.15.12:0/3969914202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a92c20 msgr2=0x563dd1aa1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a92c20 0x563dd1aa1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2ca67fc700 1 -- 172.21.15.12:0/3969914202 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c980099c0 con 0x563dd1a91d30 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a913d0 0x563dd1aa0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2ca77fe700 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a92c20 0x563dd1aa1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2ca67fc700 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1aa0580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x563dd1aa9b50 tx=0x7f2c9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d06f81d4cfaeecdd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.301+0000 7f2c86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:24:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.302+0000 7f2c86ffd700 1 -- 172.21.15.12:0/3969914202 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c025040 con 0x563dd1a91d30 2023-12-11T20:24:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.302+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3969914202 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c98019c20 con 0x563dd1a91d30 2023-12-11T20:24:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.302+0000 7f2c86ffd700 1 -- 172.21.15.12:0/3969914202 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2c9c003cc0 con 0x563dd1a91d30 2023-12-11T20:24:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.302+0000 7f2c86ffd700 1 -- 172.21.15.12:0/3969914202 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c9c017070 con 0x563dd1a91d30 2023-12-11T20:24:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.302+0000 7f2cc12a1b80 10 client.27454 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.302+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3969914202 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563dd17f7c60 con 0x563dd1a91d30 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2c86ffd700 1 -- 172.21.15.12:0/3969914202 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c98019c20 con 0x563dd1a91d30 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2c86ffd700 1 -- 172.21.15.12:0/3969914202 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2c9c01f760 con 0x563dd1a91d30 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2cc12a1b80 10 client.27454 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2cc12a1b80 10 client.27454 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2cc12a1b80 20 client.27454 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x563dd1afde70 0x563dd1b00290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2cc12a1b80 4 client.27454 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3969914202 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563dd19abfd0 con 0x563dd1afde70 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.303+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x563dd1afde70 0x563dd1b00290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2ca6ffd700 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x563dd1afde70 0x563dd1b00290 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0a56a35352c94b4 server_cookie=e92861730f8d83f in_seq=0 out_seq=0 2023-12-11T20:24:04.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2c86ffd700 10 client.27454 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2c86ffd700 1 -- 172.21.15.12:0/3969914202 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563dd19abfd0 con 0x563dd1afde70 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2c86ffd700 10 client.27454 handle_command_reply: tid=0 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 client.27454 shutdown 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3969914202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 msgr2=0x563dd1aa0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1aa0580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x563dd1aa9b50 tx=0x7f2c9c004750 comp rx=0 tx=0).stop 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3969914202 shutdown_connections 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x563dd1afde70 0x563dd1b00290 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563dd1a913d0 0x563dd1aa0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dd1a92c20 0x563dd1aa1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 --2- 172.21.15.12:0/3969914202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563dd1a91d30 0x563dd1aa0580 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2c86ffd700 0 client.27454 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.304+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3969914202 >> 172.21.15.12:0/3969914202 conn(0x563dd19c07e0 msgr2=0x563dd1a9a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.305+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3969914202 shutdown_connections 2023-12-11T20:24:04.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.305+0000 7f2cc12a1b80 1 -- 172.21.15.12:0/3969914202 wait complete. 2023-12-11T20:24:04.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.305+0000 7f2cc12a1b80 20 client.27454 trim_cache size 0 max 16384 2023-12-11T20:24:04.307 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:24:04.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.305+0000 7f2cad9ff700 1 -- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c900a1480 msgr2=0x7f2c900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.305+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c900a1480 0x7f2c900a3940 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x563dd1a92400 tx=0x7f2c9c0058e0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.305+0000 7f2cad9ff700 1 -- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 msgr2=0x7f2ca8192880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.305+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 0x7f2ca8192880 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009f60 tx=0x7f2ca0008c80 comp rx=0 tx=0).stop 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.306+0000 7f2cad9ff700 1 -- 172.21.15.12:0/506873473 shutdown_connections 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.306+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2c900a1480 0x7f2c900a3940 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.306+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca81071e0 0x7f2ca8192880 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.306+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ca8101f80 0x7f2ca8195cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.306+0000 7f2cad9ff700 1 --2- 172.21.15.12:0/506873473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca81048b0 0x7f2ca8196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.306+0000 7f2cad9ff700 1 -- 172.21.15.12:0/506873473 >> 172.21.15.12:0/506873473 conn(0x7f2ca80fb930 msgr2=0x7f2ca8101760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.306+0000 7f2cad9ff700 1 -- 172.21.15.12:0/506873473 shutdown_connections 2023-12-11T20:24:04.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.306+0000 7f2cad9ff700 1 -- 172.21.15.12:0/506873473 wait complete. 2023-12-11T20:24:04.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.541+0000 7f0f92fff700 1 -- 172.21.15.12:0/1633444405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c10da80 msgr2=0x7f0f8c10fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.541+0000 7f0f92fff700 1 --2- 172.21.15.12:0/1633444405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c10da80 0x7f0f8c10fe70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400b0a0 tx=0x7f0f8400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.541+0000 7f0f92fff700 1 -- 172.21.15.12:0/1633444405 shutdown_connections 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.541+0000 7f0f92fff700 1 --2- 172.21.15.12:0/1633444405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8c075610 0x7f0f8c073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.541+0000 7f0f92fff700 1 --2- 172.21.15.12:0/1633444405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c10da80 0x7f0f8c10fe70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.541+0000 7f0f92fff700 1 --2- 172.21.15.12:0/1633444405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f8c074030 0x7f0f8c0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.541+0000 7f0f92fff700 1 -- 172.21.15.12:0/1633444405 >> 172.21.15.12:0/1633444405 conn(0x7f0f8c0fca00 msgr2=0x7f0f8c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.542+0000 7f0f92fff700 1 -- 172.21.15.12:0/1633444405 shutdown_connections 2023-12-11T20:24:04.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.542+0000 7f0f92fff700 1 -- 172.21.15.12:0/1633444405 wait complete. 2023-12-11T20:24:04.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.543+0000 7f0f92fff700 1 Processor -- start 2023-12-11T20:24:04.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.543+0000 7f0f92fff700 1 -- start start 2023-12-11T20:24:04.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.543+0000 7f0f92fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c074030 0x7f0f8c19da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.543+0000 7f0f92fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f8c075610 0x7f0f8c19df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.543+0000 7f0f92fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8c10da80 0x7f0f8c1a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.543+0000 7f0f92fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c1a5530 con 0x7f0f8c074030 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.543+0000 7f0f92fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c1a5670 con 0x7f0f8c10da80 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.543+0000 7f0f92fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c1a5800 con 0x7f0f8c075610 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f90d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c074030 0x7f0f8c19da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f90d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c074030 0x7f0f8c19da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36528/0 (socket says 172.21.15.12:36528) 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f9159c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8c10da80 0x7f0f8c1a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f90d9b700 1 -- 172.21.15.12:0/3041886322 learned_addr learned my addr 172.21.15.12:0/3041886322 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f8c075610 0x7f0f8c19df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f9159c700 1 -- 172.21.15.12:0/3041886322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f8c075610 msgr2=0x7f0f8c19df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f9159c700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f8c075610 0x7f0f8c19df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f9159c700 1 -- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c074030 msgr2=0x7f0f8c19da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f9159c700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c074030 0x7f0f8c19da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f9159c700 1 -- 172.21.15.12:0/3041886322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84009d00 con 0x7f0f8c10da80 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c074030 0x7f0f8c19da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:04.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.544+0000 7f0f9159c700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8c10da80 0x7f0f8c1a4f60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f84007af0 tx=0x7f0f84007870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.545+0000 7f0f89ffb700 1 -- 172.21.15.12:0/3041886322 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400e040 con 0x7f0f8c10da80 2023-12-11T20:24:04.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.545+0000 7f0f92fff700 1 -- 172.21.15.12:0/3041886322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c1a5a80 con 0x7f0f8c10da80 2023-12-11T20:24:04.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.545+0000 7f0f89ffb700 1 -- 172.21.15.12:0/3041886322 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f8400be40 con 0x7f0f8c10da80 2023-12-11T20:24:04.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.545+0000 7f0f89ffb700 1 -- 172.21.15.12:0/3041886322 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8401b6e0 con 0x7f0f8c10da80 2023-12-11T20:24:04.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.545+0000 7f0f92fff700 1 -- 172.21.15.12:0/3041886322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c1a5f00 con 0x7f0f8c10da80 2023-12-11T20:24:04.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.551+0000 7f0f89ffb700 1 -- 172.21.15.12:0/3041886322 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0f84003c00 con 0x7f0f8c10da80 2023-12-11T20:24:04.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.551+0000 7f0fa68ceb80 1 Processor -- start 2023-12-11T20:24:04.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.551+0000 7f0fa68ceb80 1 -- start start 2023-12-11T20:24:04.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f53137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5314640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 0x55f2f53150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f526eb50 con 0x55f2f53133d0 2023-12-11T20:24:04.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f526c470 con 0x55f2f5313d30 2023-12-11T20:24:04.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f5267d60 con 0x55f2f5314c20 2023-12-11T20:24:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0f8bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f53137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0f90d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5314640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0f90d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5314640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54170/0 (socket says 172.21.15.12:54170) 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0f90d9b700 1 -- 172.21.15.12:0/279504828 learned_addr learned my addr 172.21.15.12:0/279504828 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.552+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 0x55f2f53150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f90d9b700 1 -- 172.21.15.12:0/279504828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 msgr2=0x55f2f53150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 0x55f2f53150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f90d9b700 1 -- 172.21.15.12:0/279504828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 msgr2=0x55f2f53137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f53137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f90d9b700 1 -- 172.21.15.12:0/279504828 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2f50e4630 con 0x55f2f5313d30 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f53137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f89ffb700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0f7c0a1480 0x7f0f7c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5314640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0f800117e0 tx=0x7f0f80011af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77c53e400de08199 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f89ffb700 1 -- 172.21.15.12:0/3041886322 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f840cdb70 con 0x7f0f8c10da80 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0f7c0a1480 0x7f0f7c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f76ffd700 1 -- 172.21.15.12:0/279504828 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000f480 con 0x55f2f5313d30 2023-12-11T20:24:04.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f76ffd700 1 -- 172.21.15.12:0/279504828 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f8000fa70 con 0x55f2f5313d30 2023-12-11T20:24:04.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.553+0000 7f0f76ffd700 1 -- 172.21.15.12:0/279504828 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80019950 con 0x55f2f5313d30 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.554+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/279504828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 msgr2=0x55f2f5314640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.554+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0f7c0a1480 0x7f0f7c0a3940 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55f2f5314400 tx=0x7f0f780058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.554+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5314640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0f800117e0 tx=0x7f0f80011af0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.554+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/279504828 shutdown_connections 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.554+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 0x55f2f53150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.554+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f53137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.554+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/279504828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5314640 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.554+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/279504828 >> 172.21.15.12:0/279504828 conn(0x55f2f52427e0 msgr2=0x55f2f530fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.555+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/279504828 shutdown_connections 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.555+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/279504828 wait complete. 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.555+0000 7f0fa68ceb80 1 -- start start 2023-12-11T20:24:04.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.555+0000 7f0fa68ceb80 1 Processor -- start 2023-12-11T20:24:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.556+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f531d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.556+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5313d30 0x55f2f531d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.556+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5314c20 0x55f2f5324780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.556+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f5221560 con 0x55f2f53133d0 2023-12-11T20:24:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.556+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f5221200 con 0x55f2f5314c20 2023-12-11T20:24:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.556+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f50e6920 con 0x55f2f5313d30 2023-12-11T20:24:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.556+0000 7f0fa68ceb80 10 client.0 _ll_register_callbacks cb 0x55f2f514ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.557+0000 7f0f90d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f531d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.557+0000 7f0f90d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f531d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36548/0 (socket says 172.21.15.12:36548) 2023-12-11T20:24:04.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.557+0000 7f0f90d9b700 1 -- 172.21.15.12:0/176899855 learned_addr learned my addr 172.21.15.12:0/176899855 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.557+0000 7f0f90d9b700 1 -- 172.21.15.12:0/176899855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5313d30 msgr2=0x55f2f531d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.557+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5313d30 0x55f2f531d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.557+0000 7f0f90d9b700 1 -- 172.21.15.12:0/176899855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5314c20 msgr2=0x55f2f5324780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.557+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5314c20 0x55f2f5324780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.557+0000 7f0f90d9b700 1 -- 172.21.15.12:0/176899855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f78009d30 con 0x55f2f53133d0 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.558+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f531d200 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009880 tx=0x7f0f8000f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaf728a26545caa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.558+0000 7f0f6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.558+0000 7f0f6bfff700 1 -- 172.21.15.12:0/176899855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80005250 con 0x55f2f53133d0 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.558+0000 7f0f6bfff700 1 -- 172.21.15.12:0/176899855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f800053b0 con 0x55f2f53133d0 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.558+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/176899855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2f5306b40 con 0x55f2f53133d0 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.558+0000 7f0f6bfff700 1 -- 172.21.15.12:0/176899855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f80005570 con 0x55f2f53133d0 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.558+0000 7f0fa68ceb80 10 client.17817 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:04.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.558+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/176899855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f0f80011440 con 0x55f2f53133d0 2023-12-11T20:24:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.559+0000 7f0f6bfff700 1 -- 172.21.15.12:0/176899855 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f2f5306b40 con 0x55f2f53133d0 2023-12-11T20:24:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.559+0000 7f0f6bfff700 1 -- 172.21.15.12:0/176899855 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0f80019850 con 0x55f2f53133d0 2023-12-11T20:24:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.559+0000 7f0fa68ceb80 10 client.17817 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.559+0000 7f0fa68ceb80 10 client.17817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.559+0000 7f0fa68ceb80 20 client.17817 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:04.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.559+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f2f5329010 0x55f2f532b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.559+0000 7f0fa68ceb80 4 client.17817 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.559+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/176899855 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2f52e2f40 con 0x55f2f5329010 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.560+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f2f5329010 0x55f2f532b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.560+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f2f5329010 0x55f2f532b430 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b99c40e29c882d8 server_cookie=96d50fee20bfcb0e in_seq=0 out_seq=0 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.560+0000 7f0f6bfff700 10 client.17817 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.561+0000 7f0f6bfff700 1 -- 172.21.15.12:0/176899855 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f2f52e2f40 con 0x55f2f5329010 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.561+0000 7f0f6bfff700 10 client.17817 handle_command_reply: tid=0 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.561+0000 7f0fa68ceb80 1 client.17817 shutdown 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/176899855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 msgr2=0x55f2f531d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f531d200 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009880 tx=0x7f0f8000f7e0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/176899855 shutdown_connections 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f2f5329010 0x55f2f532b430 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5314c20 0x55f2f5324780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f531d200 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0f6bfff700 0 client.17817 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/176899855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5313d30 0x55f2f531d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/176899855 >> 172.21.15.12:0/176899855 conn(0x55f2f52427e0 msgr2=0x55f2f530ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/176899855 shutdown_connections 2023-12-11T20:24:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/176899855 wait complete. 2023-12-11T20:24:04.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.562+0000 7f0fa68ceb80 20 client.17817 trim_cache size 0 max 16384 2023-12-11T20:24:04.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.578+0000 7f0fa68ceb80 1 Processor -- start 2023-12-11T20:24:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.578+0000 7f0fa68ceb80 1 -- start start 2023-12-11T20:24:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.578+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f53133d0 0x55f2f5315000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.578+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5324740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f5314c20 0x55f2f531c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f5313bc0 con 0x55f2f5314c20 2023-12-11T20:24:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f5330660 con 0x55f2f5313d30 2023-12-11T20:24:04.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f531ae20 con 0x55f2f53133d0 2023-12-11T20:24:04.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f9159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f5314c20 0x55f2f531c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f9159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f5314c20 0x55f2f531c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36556/0 (socket says 172.21.15.12:36556) 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f9159c700 1 -- 172.21.15.12:0/858773834 learned_addr learned my addr 172.21.15.12:0/858773834 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5324740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f53133d0 0x55f2f5315000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f9159c700 1 -- 172.21.15.12:0/858773834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f53133d0 msgr2=0x55f2f5315000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f9159c700 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f53133d0 0x55f2f5315000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f9159c700 1 -- 172.21.15.12:0/858773834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 msgr2=0x55f2f5324740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f9159c700 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5324740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f9159c700 1 -- 172.21.15.12:0/858773834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2f5090de0 con 0x55f2f5314c20 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.579+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f53133d0 0x55f2f5315000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.580+0000 7f0f9159c700 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f5314c20 0x55f2f531c710 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009fd0 tx=0x7f0f84009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a551646e704e75 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.580+0000 7f0f777fe700 1 -- 172.21.15.12:0/858773834 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8409a830 con 0x55f2f5314c20 2023-12-11T20:24:04.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.580+0000 7f0f777fe700 1 -- 172.21.15.12:0/858773834 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f8401aea0 con 0x55f2f5314c20 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.580+0000 7f0f777fe700 1 -- 172.21.15.12:0/858773834 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84099270 con 0x55f2f5314c20 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/858773834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f5314c20 msgr2=0x55f2f531c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f5314c20 0x55f2f531c710 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009fd0 tx=0x7f0f84009a50 comp rx=0 tx=0).stop 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/858773834 shutdown_connections 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f5314c20 0x55f2f531c710 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f53133d0 0x55f2f5315000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/858773834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5324740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/858773834 >> 172.21.15.12:0/858773834 conn(0x55f2f52427e0 msgr2=0x55f2f531b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/858773834 shutdown_connections 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/858773834 wait complete. 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 -- start start 2023-12-11T20:24:04.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.581+0000 7f0fa68ceb80 1 Processor -- start 2023-12-11T20:24:04.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:04 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2281822542' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:24:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f5322130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5322670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0fa68ceb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 0x55f2f5323630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f5323b70 con 0x55f2f53133d0 2023-12-11T20:24:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f5323ce0 con 0x55f2f5313d30 2023-12-11T20:24:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0fa68ceb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2f5323ea0 con 0x55f2f5314c20 2023-12-11T20:24:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0fa68ceb80 10 client.0 _ll_register_callbacks cb 0x55f2f514ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0f90d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f5322130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0f90d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f5322130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36562/0 (socket says 172.21.15.12:36562) 2023-12-11T20:24:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0f90d9b700 1 -- 172.21.15.12:0/4291965221 learned_addr learned my addr 172.21.15.12:0/4291965221 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.582+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5322670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f9159c700 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 0x55f2f5323630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f90d9b700 1 -- 172.21.15.12:0/4291965221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 msgr2=0x55f2f5323630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 0x55f2f5323630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f90d9b700 1 -- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 msgr2=0x55f2f5322670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5322670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f90d9b700 1 -- 172.21.15.12:0/4291965221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c1a5f00 con 0x55f2f53133d0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5322670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f90d9b700 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f5322130 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0f80001eb0 tx=0x7f0f80005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca95e04c411d1a42 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f6bfff700 1 -- 172.21.15.12:0/4291965221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80005720 con 0x55f2f53133d0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/4291965221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f8000fa70 con 0x55f2f53133d0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.583+0000 7f0f6bfff700 1 -- 172.21.15.12:0/4291965221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f80000e40 con 0x55f2f53133d0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0f6bfff700 1 -- 172.21.15.12:0/4291965221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f8000f900 con 0x55f2f53133d0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0fa68ceb80 10 client.17823 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/4291965221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f2f5079c60 con 0x55f2f53133d0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0f6bfff700 1 -- 172.21.15.12:0/4291965221 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f8000fa70 con 0x55f2f53133d0 2023-12-11T20:24:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0f6bfff700 1 -- 172.21.15.12:0/4291965221 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0f80004b40 con 0x55f2f53133d0 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0fa68ceb80 10 client.17823 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0fa68ceb80 10 client.17823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0fa68ceb80 20 client.17823 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f2f537fd00 0x55f2f5382120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0fa68ceb80 4 client.17823 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.584+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/4291965221 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f2f522dfd0 con 0x55f2f537fd00 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.585+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f2f537fd00 0x55f2f5382120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.585+0000 7f0f8bfff700 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f2f537fd00 0x55f2f5382120 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87068dcce276f8a8 server_cookie=28eb81f557949d17 in_seq=0 out_seq=0 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.585+0000 7f0f6bfff700 10 client.17823 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0f6bfff700 1 -- 172.21.15.12:0/4291965221 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f2f522dfd0 con 0x55f2f537fd00 2023-12-11T20:24:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0f6bfff700 10 client.17823 handle_command_reply: tid=0 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 client.17823 shutdown 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/4291965221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 msgr2=0x55f2f5322130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f5322130 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0f80001eb0 tx=0x7f0f80005480 comp rx=0 tx=0).stop 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/4291965221 shutdown_connections 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f2f537fd00 0x55f2f5382120 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f2f5314c20 0x55f2f5323630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f2f53133d0 0x55f2f5322130 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 --2- 172.21.15.12:0/4291965221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f2f5313d30 0x55f2f5322670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0f6bfff700 0 client.17823 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/4291965221 >> 172.21.15.12:0/4291965221 conn(0x55f2f52427e0 msgr2=0x55f2f531c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/4291965221 shutdown_connections 2023-12-11T20:24:04.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 1 -- 172.21.15.12:0/4291965221 wait complete. 2023-12-11T20:24:04.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.586+0000 7f0fa68ceb80 20 client.17823 trim_cache size 0 max 16384 2023-12-11T20:24:04.590 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 -- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0f7c0a1480 msgr2=0x7f0f7c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0f7c0a1480 0x7f0f7c0a3940 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55f2f5314400 tx=0x7f0f780058e0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 -- 172.21.15.12:0/3041886322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8c10da80 msgr2=0x7f0f8c1a4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8c10da80 0x7f0f8c1a4f60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f84007af0 tx=0x7f0f84007870 comp rx=0 tx=0).stop 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 -- 172.21.15.12:0/3041886322 shutdown_connections 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0f7c0a1480 0x7f0f7c0a3940 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f8c10da80 0x7f0f8c1a4f60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c074030 0x7f0f8c19da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 --2- 172.21.15.12:0/3041886322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f8c075610 0x7f0f8c19df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 -- 172.21.15.12:0/3041886322 >> 172.21.15.12:0/3041886322 conn(0x7f0f8c0fca00 msgr2=0x7f0f8c100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:04.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 -- 172.21.15.12:0/3041886322 shutdown_connections 2023-12-11T20:24:04.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:04.587+0000 7f0f92fff700 1 -- 172.21.15.12:0/3041886322 wait complete. 2023-12-11T20:24:04.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:04 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2281822542' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:24:04.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:04 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2281822542' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:24:05.604 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:24:05.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:24:05.677 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:05 smithi012 ceph-mon[128787]: pgmap v620: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:05 smithi032 ceph-mon[132488]: pgmap v620: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:05.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:05 smithi039 ceph-mon[102205]: pgmap v620: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.844+0000 7f48d8dff700 1 -- 172.21.15.12:0/4186002317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d40755b0 msgr2=0x7f48d4073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.844+0000 7f48d8dff700 1 --2- 172.21.15.12:0/4186002317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d40755b0 0x7f48d4073a00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009990 tx=0x7f48c4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.844+0000 7f48d8dff700 1 -- 172.21.15.12:0/4186002317 shutdown_connections 2023-12-11T20:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.844+0000 7f48d8dff700 1 --2- 172.21.15.12:0/4186002317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4109390 0x7f48d410b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.844+0000 7f48d8dff700 1 --2- 172.21.15.12:0/4186002317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d40755b0 0x7f48d4073a00 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.844+0000 7f48d8dff700 1 --2- 172.21.15.12:0/4186002317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48d4073fd0 0x7f48d4074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.844+0000 7f48d8dff700 1 -- 172.21.15.12:0/4186002317 >> 172.21.15.12:0/4186002317 conn(0x7f48d40fca30 msgr2=0x7f48d40fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.844+0000 7f48d8dff700 1 -- 172.21.15.12:0/4186002317 shutdown_connections 2023-12-11T20:24:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.845+0000 7f48d8dff700 1 -- 172.21.15.12:0/4186002317 wait complete. 2023-12-11T20:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.846+0000 7f48d8dff700 1 Processor -- start 2023-12-11T20:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.846+0000 7f48d8dff700 1 -- start start 2023-12-11T20:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.846+0000 7f48d8dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4073fd0 0x7f48d41994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.846+0000 7f48d8dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48d40755b0 0x7f48d41999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.846+0000 7f48d8dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d4109390 0x7f48d41a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d8dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d41a0fe0 con 0x7f48d4109390 2023-12-11T20:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d8dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d41a1120 con 0x7f48d40755b0 2023-12-11T20:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d8dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d41a12b0 con 0x7f48d4073fd0 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4073fd0 0x7f48d41994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4073fd0 0x7f48d41994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46740/0 (socket says 172.21.15.12:46740) 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d4109390 0x7f48d41a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d259c700 1 -- 172.21.15.12:0/384667263 learned_addr learned my addr 172.21.15.12:0/384667263 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48d40755b0 0x7f48d41999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d2d9d700 1 -- 172.21.15.12:0/384667263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4073fd0 msgr2=0x7f48d41994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d2d9d700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4073fd0 0x7f48d41994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d2d9d700 1 -- 172.21.15.12:0/384667263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48d40755b0 msgr2=0x7f48d41999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d2d9d700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48d40755b0 0x7f48d41999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d2d9d700 1 -- 172.21.15.12:0/384667263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40095f0 con 0x7f48d4109390 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.847+0000 7f48d259c700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4073fd0 0x7f48d41994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.848+0000 7f48d2d9d700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d4109390 0x7f48d41a0a10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00efc0 tx=0x7f48cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.848+0000 7f48c37fe700 1 -- 172.21.15.12:0/384667263 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc018070 con 0x7f48d4109390 2023-12-11T20:24:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.848+0000 7f48d8dff700 1 -- 172.21.15.12:0/384667263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d41a1530 con 0x7f48d4109390 2023-12-11T20:24:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.848+0000 7f48c37fe700 1 -- 172.21.15.12:0/384667263 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48cc00f040 con 0x7f48d4109390 2023-12-11T20:24:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.848+0000 7f48c37fe700 1 -- 172.21.15.12:0/384667263 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00cba0 con 0x7f48d4109390 2023-12-11T20:24:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.848+0000 7f48d8dff700 1 -- 172.21.15.12:0/384667263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d41a19f0 con 0x7f48d4109390 2023-12-11T20:24:05.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.852+0000 7f48c37fe700 1 -- 172.21.15.12:0/384667263 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f48cc003a00 con 0x7f48d4109390 2023-12-11T20:24:05.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.853+0000 7f48ec702b80 1 Processor -- start 2023-12-11T20:24:05.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.853+0000 7f48ec702b80 1 -- start start 2023-12-11T20:24:05.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3819870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c381a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c381b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48ec702b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c3774bd0 con 0x5608c381aca0 2023-12-11T20:24:05.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48ec702b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c37724f0 con 0x5608c3819450 2023-12-11T20:24:05.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48ec702b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c376dde0 con 0x5608c3819db0 2023-12-11T20:24:05.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48d1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c381b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48d259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c381a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48d259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c381a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46750/0 (socket says 172.21.15.12:46750) 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48d1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c381b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36602/0 (socket says 172.21.15.12:36602) 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48d259c700 1 -- 172.21.15.12:0/2493300701 learned_addr learned my addr 172.21.15.12:0/2493300701 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.854+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3819870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48d259c700 1 -- 172.21.15.12:0/2493300701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 msgr2=0x5608c3819870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48d259c700 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3819870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48d259c700 1 -- 172.21.15.12:0/2493300701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 msgr2=0x5608c381b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48d259c700 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c381b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48d259c700 1 -- 172.21.15.12:0/2493300701 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608c35ea6b0 con 0x5608c3819db0 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c381b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48c37fe700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f48bc0a1480 0x7f48bc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48d259c700 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c381a6c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f48c4005ef0 tx=0x7f48c4005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e8dc9f9a35813bb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48c37fe700 1 -- 172.21.15.12:0/384667263 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f48cc0cc850 con 0x7f48d4109390 2023-12-11T20:24:05.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f48bc0a1480 0x7f48bc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48c0ff9700 1 -- 172.21.15.12:0/2493300701 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c401d050 con 0x5608c3819db0 2023-12-11T20:24:05.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48c0ff9700 1 -- 172.21.15.12:0/2493300701 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48c401e040 con 0x5608c3819db0 2023-12-11T20:24:05.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.855+0000 7f48c0ff9700 1 -- 172.21.15.12:0/2493300701 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4004ea0 con 0x5608c3819db0 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48ec702b80 1 -- 172.21.15.12:0/2493300701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 msgr2=0x5608c381a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c381a6c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f48c4005ef0 tx=0x7f48c4005bc0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f48bc0a1480 0x7f48bc0a3940 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x5608c381a480 tx=0x7f48c8009750 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48ec702b80 1 -- 172.21.15.12:0/2493300701 shutdown_connections 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3819870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c381b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2493300701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c381a6c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48ec702b80 1 -- 172.21.15.12:0/2493300701 >> 172.21.15.12:0/2493300701 conn(0x5608c3748860 msgr2=0x5608c3815e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.856+0000 7f48ec702b80 1 -- 172.21.15.12:0/2493300701 shutdown_connections 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.857+0000 7f48ec702b80 1 -- 172.21.15.12:0/2493300701 wait complete. 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.857+0000 7f48ec702b80 1 -- start start 2023-12-11T20:24:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.857+0000 7f48ec702b80 1 Processor -- start 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c38231c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c3823700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c382a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48ec702b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c37275e0 con 0x5608c3819450 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48ec702b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c3727280 con 0x5608c3819db0 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48ec702b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c35ec9a0 con 0x5608c381aca0 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48ec702b80 10 client.0 _ll_register_callbacks cb 0x5608c3652b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c38231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48d2d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c382a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c38231c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36606/0 (socket says 172.21.15.12:36606) 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48d259c700 1 -- 172.21.15.12:0/1675518888 learned_addr learned my addr 172.21.15.12:0/1675518888 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.858+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c3823700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48d259c700 1 -- 172.21.15.12:0/1675518888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 msgr2=0x5608c382a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48d259c700 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c382a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48d259c700 1 -- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 msgr2=0x5608c3823700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48d259c700 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c3823700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48d259c700 1 -- 172.21.15.12:0/1675518888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c8019040 con 0x5608c3819450 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c3823700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48d2d9d700 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c382a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48d259c700 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c38231c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009ce0 tx=0x7f48c400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a59e7d49fa065d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48b9ffb700 1 -- 172.21.15.12:0/1675518888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400b910 con 0x5608c3819450 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48ec702b80 1 -- 172.21.15.12:0/1675518888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608c380cbc0 con 0x5608c3819450 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.859+0000 7f48b9ffb700 1 -- 172.21.15.12:0/1675518888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f48c4003d00 con 0x5608c3819450 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48b9ffb700 1 -- 172.21.15.12:0/1675518888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48c400ba70 con 0x5608c3819450 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48ec702b80 10 client.17835 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48ec702b80 1 -- 172.21.15.12:0/1675518888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f48d410c420 con 0x5608c3819450 2023-12-11T20:24:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48b9ffb700 1 -- 172.21.15.12:0/1675518888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48c403c020 con 0x5608c3819450 2023-12-11T20:24:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48b9ffb700 1 -- 172.21.15.12:0/1675518888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f48c4023460 con 0x5608c3819450 2023-12-11T20:24:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48ec702b80 10 client.17835 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48ec702b80 10 client.17835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48ec702b80 20 client.17835 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48ec702b80 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5608c382eae0 0x5608c3830f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48ec702b80 4 client.17835 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.860+0000 7f48ec702b80 1 -- 172.21.15.12:0/1675518888 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608c37e8fc0 con 0x5608c382eae0 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.861+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5608c382eae0 0x5608c3830f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.862+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5608c382eae0 0x5608c3830f00 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aaff949a371058c server_cookie=f0b7caed21fbb88f in_seq=0 out_seq=0 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.862+0000 7f48b9ffb700 10 client.17835 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.862+0000 7f48b9ffb700 1 -- 172.21.15.12:0/1675518888 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5608c37e8fc0 con 0x5608c382eae0 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.862+0000 7f48b9ffb700 10 client.17835 handle_command_reply: tid=0 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.862+0000 7f48ec702b80 1 client.17835 shutdown 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 -- 172.21.15.12:0/1675518888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 msgr2=0x5608c38231c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c38231c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009ce0 tx=0x7f48c400b390 comp rx=0 tx=0).stop 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 -- 172.21.15.12:0/1675518888 shutdown_connections 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5608c382eae0 0x5608c3830f00 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c382a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c38231c0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 --2- 172.21.15.12:0/1675518888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c3823700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48b9ffb700 0 client.17835 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 -- 172.21.15.12:0/1675518888 >> 172.21.15.12:0/1675518888 conn(0x5608c3748860 msgr2=0x5608c3814ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 -- 172.21.15.12:0/1675518888 shutdown_connections 2023-12-11T20:24:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 1 -- 172.21.15.12:0/1675518888 wait complete. 2023-12-11T20:24:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.863+0000 7f48ec702b80 20 client.17835 trim_cache size 0 max 16384 2023-12-11T20:24:05.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.886+0000 7f48ec702b80 1 Processor -- start 2023-12-11T20:24:05.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.886+0000 7f48ec702b80 1 -- start start 2023-12-11T20:24:05.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.886+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c3823680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.886+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c382a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.886+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c3814210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.886+0000 7f48ec702b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c3836110 con 0x5608c3819450 2023-12-11T20:24:05.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.886+0000 7f48ec702b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c381a2a0 con 0x5608c3819db0 2023-12-11T20:24:05.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.886+0000 7f48ec702b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c3821c30 con 0x5608c381aca0 2023-12-11T20:24:05.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c3823680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c3823680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36608/0 (socket says 172.21.15.12:36608) 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 -- 172.21.15.12:0/3650492744 learned_addr learned my addr 172.21.15.12:0/3650492744 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d2d9d700 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c3814210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c382a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 -- 172.21.15.12:0/3650492744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 msgr2=0x5608c3814210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c3814210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 -- 172.21.15.12:0/3650492744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 msgr2=0x5608c382a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c382a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 -- 172.21.15.12:0/3650492744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608c3596e60 con 0x5608c3819450 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.887+0000 7f48d259c700 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c3823680 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f48c400b650 tx=0x7f48c4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e903a9f63b0bc442 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48c17fa700 1 -- 172.21.15.12:0/3650492744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c401d040 con 0x5608c3819450 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48c17fa700 1 -- 172.21.15.12:0/3650492744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48c403c070 con 0x5608c3819450 2023-12-11T20:24:05.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48c17fa700 1 -- 172.21.15.12:0/3650492744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400be00 con 0x5608c3819450 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48ec702b80 1 -- 172.21.15.12:0/3650492744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 msgr2=0x5608c3823680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48ec702b80 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c3823680 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f48c400b650 tx=0x7f48c4005e80 comp rx=0 tx=0).stop 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48ec702b80 1 -- 172.21.15.12:0/3650492744 shutdown_connections 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48ec702b80 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c381aca0 0x5608c3814210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48ec702b80 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c3819450 0x5608c3823680 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.888+0000 7f48ec702b80 1 --2- 172.21.15.12:0/3650492744 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819db0 0x5608c382a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.889+0000 7f48ec702b80 1 -- 172.21.15.12:0/3650492744 >> 172.21.15.12:0/3650492744 conn(0x5608c3748860 msgr2=0x5608c3822f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.889+0000 7f48ec702b80 1 -- 172.21.15.12:0/3650492744 shutdown_connections 2023-12-11T20:24:05.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.889+0000 7f48ec702b80 1 -- 172.21.15.12:0/3650492744 wait complete. 2023-12-11T20:24:05.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.889+0000 7f48ec702b80 1 -- start start 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.889+0000 7f48ec702b80 1 Processor -- start 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3827430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c3827970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48ec702b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c3884fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48ec702b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c382a8f0 con 0x5608c381aca0 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48ec702b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c382aa60 con 0x5608c3819450 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48ec702b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c3885510 con 0x5608c3819db0 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48ec702b80 10 client.0 _ll_register_callbacks cb 0x5608c3652b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48d2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c3884fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48d259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3827430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48d2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c3884fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36614/0 (socket says 172.21.15.12:36614) 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48d2d9d700 1 -- 172.21.15.12:0/2052797610 learned_addr learned my addr 172.21.15.12:0/2052797610 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:05.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.890+0000 7f48d1d9b700 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c3827970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48d2d9d700 1 -- 172.21.15.12:0/2052797610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 msgr2=0x5608c3827970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48d2d9d700 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c3827970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48d2d9d700 1 -- 172.21.15.12:0/2052797610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 msgr2=0x5608c3827430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48d2d9d700 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3827430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48d2d9d700 1 -- 172.21.15.12:0/2052797610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d410c420 con 0x5608c381aca0 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48d259c700 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3827430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48d2d9d700 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c3884fd0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0090a0 tx=0x7f48cc096020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9baa5e412e5e56 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48b9ffb700 1 -- 172.21.15.12:0/2052797610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc01b320 con 0x5608c381aca0 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48b9ffb700 1 -- 172.21.15.12:0/2052797610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f48cc09a2b0 con 0x5608c381aca0 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48ec702b80 1 -- 172.21.15.12:0/2052797610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f48c401e040 con 0x5608c381aca0 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48b9ffb700 1 -- 172.21.15.12:0/2052797610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48cc099bb0 con 0x5608c381aca0 2023-12-11T20:24:05.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48ec702b80 10 client.17841 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.891+0000 7f48ec702b80 1 -- 172.21.15.12:0/2052797610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5608c357fce0 con 0x5608c381aca0 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.892+0000 7f48b9ffb700 1 -- 172.21.15.12:0/2052797610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48cc07c080 con 0x5608c381aca0 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.892+0000 7f48b9ffb700 1 -- 172.21.15.12:0/2052797610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f48cc0b2180 con 0x5608c381aca0 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.892+0000 7f48ec702b80 10 client.17841 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.892+0000 7f48ec702b80 10 client.17841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.892+0000 7f48ec702b80 20 client.17841 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.892+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5608c3886d40 0x5608c3889160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.892+0000 7f48ec702b80 4 client.17841 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.892+0000 7f48ec702b80 1 -- 172.21.15.12:0/2052797610 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5608c3734050 con 0x5608c3886d40 2023-12-11T20:24:05.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.893+0000 7f48d259c700 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5608c3886d40 0x5608c3889160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:05.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.893+0000 7f48d259c700 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5608c3886d40 0x5608c3889160 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a873f1ce064723f server_cookie=c162b992eb82f2b3 in_seq=0 out_seq=0 2023-12-11T20:24:05.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.893+0000 7f48b9ffb700 10 client.17841 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:05.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.894+0000 7f48b9ffb700 1 -- 172.21.15.12:0/2052797610 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5608c3734050 con 0x5608c3886d40 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.894+0000 7f48b9ffb700 10 client.17841 handle_command_reply: tid=0 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.894+0000 7f48ec702b80 1 client.17841 shutdown 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.894+0000 7f48ec702b80 1 -- 172.21.15.12:0/2052797610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 msgr2=0x5608c3884fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.894+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c3884fd0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0090a0 tx=0x7f48cc096020 comp rx=0 tx=0).stop 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 1 -- 172.21.15.12:0/2052797610 shutdown_connections 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5608c3886d40 0x5608c3889160 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5608c3819450 0x5608c3827430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5608c381aca0 0x5608c3884fd0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 1 --2- 172.21.15.12:0/2052797610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5608c3819db0 0x5608c3827970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 1 -- 172.21.15.12:0/2052797610 >> 172.21.15.12:0/2052797610 conn(0x5608c3748860 msgr2=0x5608c380e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48b9ffb700 0 client.17841 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 1 -- 172.21.15.12:0/2052797610 shutdown_connections 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 1 -- 172.21.15.12:0/2052797610 wait complete. 2023-12-11T20:24:05.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.895+0000 7f48ec702b80 20 client.17841 trim_cache size 0 max 16384 2023-12-11T20:24:05.896 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:24:05.896 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:24:05.896 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "f7619220-39e6-49fc-8c56-7c10376b343a", 2023-12-11T20:24:05.896 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:24:05.896 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 -- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f48bc0a1480 msgr2=0x7f48bc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f48bc0a1480 0x7f48bc0a3940 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x5608c381a480 tx=0x7f48c8009750 comp rx=0 tx=0).stop 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 -- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d4109390 msgr2=0x7f48d41a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d4109390 0x7f48d41a0a10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00efc0 tx=0x7f48cc00c3a0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 -- 172.21.15.12:0/384667263 shutdown_connections 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f48bc0a1480 0x7f48bc0a3940 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48d4109390 0x7f48d41a0a10 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4073fd0 0x7f48d41994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 --2- 172.21.15.12:0/384667263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48d40755b0 0x7f48d41999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 -- 172.21.15.12:0/384667263 >> 172.21.15.12:0/384667263 conn(0x7f48d40fca30 msgr2=0x7f48d41052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 -- 172.21.15.12:0/384667263 shutdown_connections 2023-12-11T20:24:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:05.896+0000 7f48d8dff700 1 -- 172.21.15.12:0/384667263 wait complete. 2023-12-11T20:24:05.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:24:06.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 -- 172.21.15.12:0/904217040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 msgr2=0x7f57a0106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 --2- 172.21.15.12:0/904217040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 0x7f57a0106a90 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f5794009990 tx=0x7f5794009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 -- 172.21.15.12:0/904217040 shutdown_connections 2023-12-11T20:24:06.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 --2- 172.21.15.12:0/904217040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57a0106fd0 0x7f57a0109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 --2- 172.21.15.12:0/904217040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57a0101d70 0x7f57a0104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 --2- 172.21.15.12:0/904217040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 0x7f57a0106a90 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 -- 172.21.15.12:0/904217040 >> 172.21.15.12:0/904217040 conn(0x7f57a00fb740 msgr2=0x7f57a00fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:06.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 -- 172.21.15.12:0/904217040 shutdown_connections 2023-12-11T20:24:06.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.157+0000 7f579ffff700 1 -- 172.21.15.12:0/904217040 wait complete. 2023-12-11T20:24:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.158+0000 7f579ffff700 1 Processor -- start 2023-12-11T20:24:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.158+0000 7f579ffff700 1 -- start start 2023-12-11T20:24:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57a0101d70 0x7f57a0101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 0x7f57a00ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57a0106fd0 0x7f57a0100260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0100a00 con 0x7f57a01046a0 2023-12-11T20:24:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579ffff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0100b70 con 0x7f57a0106fd0 2023-12-11T20:24:06.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579ffff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01a1130 con 0x7f57a0101d70 2023-12-11T20:24:06.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 0x7f57a00ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 0x7f57a00ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36628/0 (socket says 172.21.15.12:36628) 2023-12-11T20:24:06.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579e7fc700 1 -- 172.21.15.12:0/2191657527 learned_addr learned my addr 172.21.15.12:0/2191657527 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:06.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579effd700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57a0101d70 0x7f57a0101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579f7fe700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57a0106fd0 0x7f57a0100260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579e7fc700 1 -- 172.21.15.12:0/2191657527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57a0101d70 msgr2=0x7f57a0101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579e7fc700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57a0101d70 0x7f57a0101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579e7fc700 1 -- 172.21.15.12:0/2191657527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57a0106fd0 msgr2=0x7f57a0100260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579e7fc700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57a0106fd0 0x7f57a0100260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579e7fc700 1 -- 172.21.15.12:0/2191657527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940095f0 con 0x7f57a01046a0 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.159+0000 7f579f7fe700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57a0106fd0 0x7f57a0100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.160+0000 7f579e7fc700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 0x7f57a00ffd20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f579400b2e0 tx=0x7f5794004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.160+0000 7f57a49fd700 1 -- 172.21.15.12:0/2191657527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579401d070 con 0x7f57a01046a0 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.160+0000 7f57a49fd700 1 -- 172.21.15.12:0/2191657527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f579400beb0 con 0x7f57a01046a0 2023-12-11T20:24:06.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.160+0000 7f579ffff700 1 -- 172.21.15.12:0/2191657527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a01a1360 con 0x7f57a01046a0 2023-12-11T20:24:06.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.160+0000 7f57a49fd700 1 -- 172.21.15.12:0/2191657527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794021410 con 0x7f57a01046a0 2023-12-11T20:24:06.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.160+0000 7f579ffff700 1 -- 172.21.15.12:0/2191657527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a01a1780 con 0x7f57a01046a0 2023-12-11T20:24:06.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.163+0000 7f57a49fd700 1 -- 172.21.15.12:0/2191657527 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f579400f640 con 0x7f57a01046a0 2023-12-11T20:24:06.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57b940bb80 1 Processor -- start 2023-12-11T20:24:06.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57b940bb80 1 -- start start 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f3a60 0x564cc21f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f43c0 0x564cc21f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21f5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57b940bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc214eb50 con 0x564cc21f4de0 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57b940bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc214c470 con 0x564cc21f43c0 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57b940bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc2147d60 con 0x564cc21f3a60 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.165+0000 7f57a49fd700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57880a15a0 0x7f57880a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f57a49fd700 1 -- 172.21.15.12:0/2191657527 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f57940ce180 con 0x7f57a01046a0 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f3a60 0x564cc21f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f3a60 0x564cc21f3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46794/0 (socket says 172.21.15.12:46794) 2023-12-11T20:24:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579f7fe700 1 -- 172.21.15.12:0/1490129797 learned_addr learned my addr 172.21.15.12:0/1490129797 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:06.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579e7fc700 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579f7fe700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57880a15a0 0x7f57880a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579effd700 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f43c0 0x564cc21f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579e7fc700 1 -- 172.21.15.12:0/1490129797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f3a60 msgr2=0x564cc21f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579e7fc700 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f3a60 0x564cc21f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579e7fc700 1 -- 172.21.15.12:0/1490129797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f43c0 msgr2=0x564cc21f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579e7fc700 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f43c0 0x564cc21f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.166+0000 7f579e7fc700 1 -- 172.21.15.12:0/1490129797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cc1fc4630 con 0x564cc21f4de0 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.167+0000 7f579e7fc700 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21f5240 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f579409b180 tx=0x7f5794009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf36007fe7f2ed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.167+0000 7f579f7fe700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57880a15a0 0x7f57880a3a60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5798007c20 tx=0x7f57980098b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.167+0000 7f5785ffb700 1 -- 172.21.15.12:0/1490129797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579409b250 con 0x564cc21f4de0 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.167+0000 7f5785ffb700 1 -- 172.21.15.12:0/1490129797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f579409afc0 con 0x564cc21f4de0 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.167+0000 7f5785ffb700 1 -- 172.21.15.12:0/1490129797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579409f5d0 con 0x564cc21f4de0 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 -- 172.21.15.12:0/1490129797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 msgr2=0x564cc21f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21f5240 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f579409b180 tx=0x7f5794009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 -- 172.21.15.12:0/1490129797 shutdown_connections 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21f5240 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f3a60 0x564cc21f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 --2- 172.21.15.12:0/1490129797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f43c0 0x564cc21f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 -- 172.21.15.12:0/1490129797 >> 172.21.15.12:0/1490129797 conn(0x564cc21227e0 msgr2=0x564cc21ee3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 -- 172.21.15.12:0/1490129797 shutdown_connections 2023-12-11T20:24:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.168+0000 7f57b940bb80 1 -- 172.21.15.12:0/1490129797 wait complete. 2023-12-11T20:24:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 1 -- start start 2023-12-11T20:24:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 1 Processor -- start 2023-12-11T20:24:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 0x564cc21fd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc2204540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc2101560 con 0x564cc21f4de0 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc2101200 con 0x564cc21f3a60 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc1fc6920 con 0x564cc21f43c0 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.169+0000 7f57b940bb80 10 client.0 _ll_register_callbacks cb 0x564cc202ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc2204540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fcfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54326/0 (socket says 172.21.15.12:54326) 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579effd700 1 -- 172.21.15.12:0/3476774170 learned_addr learned my addr 172.21.15.12:0/3476774170 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579e7fc700 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 0x564cc21fd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579f7fe700 1 -- 172.21.15.12:0/3476774170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 msgr2=0x564cc21fd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579f7fe700 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 0x564cc21fd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579f7fe700 1 -- 172.21.15.12:0/3476774170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 msgr2=0x564cc21fcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579f7fe700 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579f7fe700 1 -- 172.21.15.12:0/3476774170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a01a1780 con 0x564cc21f4de0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.170+0000 7f579f7fe700 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc2204540 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f5798017680 tx=0x7f57980093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474ab572567318ad server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.171+0000 7f577effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.171+0000 7f577effd700 1 -- 172.21.15.12:0/3476774170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798009b80 con 0x564cc21f4de0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.171+0000 7f57b940bb80 1 -- 172.21.15.12:0/3476774170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cc21e69e0 con 0x564cc21f4de0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.171+0000 7f577effd700 1 -- 172.21.15.12:0/3476774170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f57980243f0 con 0x564cc21f4de0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.171+0000 7f577effd700 1 -- 172.21.15.12:0/3476774170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57980245b0 con 0x564cc21f4de0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.171+0000 7f57b940bb80 10 client.17853 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.171+0000 7f57b940bb80 1 -- 172.21.15.12:0/3476774170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564cc1f70de0 con 0x564cc21f4de0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.172+0000 7f577effd700 1 -- 172.21.15.12:0/3476774170 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564cc21e69e0 con 0x564cc21f4de0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.172+0000 7f577effd700 1 -- 172.21.15.12:0/3476774170 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f579802e640 con 0x564cc21f4de0 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.172+0000 7f57b940bb80 10 client.17853 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.172+0000 7f57b940bb80 10 client.17853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.172+0000 7f57b940bb80 20 client.17853 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.172+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564cc2208e30 0x564cc220b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.172+0000 7f57b940bb80 4 client.17853 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.172+0000 7f57b940bb80 1 -- 172.21.15.12:0/3476774170 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564cc21c2f40 con 0x564cc2208e30 2023-12-11T20:24:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.173+0000 7f579effd700 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564cc2208e30 0x564cc220b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.173+0000 7f579effd700 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564cc2208e30 0x564cc220b250 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42052bcdbb20bb6 server_cookie=8ecd26e3c2360648 in_seq=0 out_seq=0 2023-12-11T20:24:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.173+0000 7f577effd700 10 client.17853 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f577effd700 1 -- 172.21.15.12:0/3476774170 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564cc21c2f40 con 0x564cc2208e30 2023-12-11T20:24:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f577effd700 10 client.17853 handle_command_reply: tid=0 2023-12-11T20:24:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 client.17853 shutdown 2023-12-11T20:24:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 -- 172.21.15.12:0/3476774170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 msgr2=0x564cc2204540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc2204540 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f5798017680 tx=0x7f57980093f0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 -- 172.21.15.12:0/3476774170 shutdown_connections 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564cc2208e30 0x564cc220b250 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc2204540 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3476774170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 0x564cc21fd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f577effd700 0 client.17853 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 -- 172.21.15.12:0/3476774170 >> 172.21.15.12:0/3476774170 conn(0x564cc21227e0 msgr2=0x564cc21f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 -- 172.21.15.12:0/3476774170 shutdown_connections 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.174+0000 7f57b940bb80 1 -- 172.21.15.12:0/3476774170 wait complete. 2023-12-11T20:24:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.175+0000 7f57b940bb80 20 client.17853 trim_cache size 0 max 16384 2023-12-11T20:24:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.199+0000 7f57b940bb80 1 Processor -- start 2023-12-11T20:24:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.199+0000 7f57b940bb80 1 -- start start 2023-12-11T20:24:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.199+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.199+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 0x564cc2204500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.199+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21fb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.199+0000 7f57b940bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc21e69e0 con 0x564cc21f4de0 2023-12-11T20:24:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.199+0000 7f57b940bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc22056c0 con 0x564cc21f3a60 2023-12-11T20:24:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.199+0000 7f57b940bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc21fcb30 con 0x564cc21f43c0 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21fb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21fb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36648/0 (socket says 172.21.15.12:36648) 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 0x564cc2204500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 -- 172.21.15.12:0/1407467794 learned_addr learned my addr 172.21.15.12:0/1407467794 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579effd700 1 --2- 172.21.15.12:0/1407467794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 -- 172.21.15.12:0/1407467794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 msgr2=0x564cc2204500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 --2- 172.21.15.12:0/1407467794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 0x564cc2204500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 -- 172.21.15.12:0/1407467794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 msgr2=0x564cc21fc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 --2- 172.21.15.12:0/1407467794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 -- 172.21.15.12:0/1407467794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cc1f59c60 con 0x564cc21f4de0 2023-12-11T20:24:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.200+0000 7f579f7fe700 1 --2- 172.21.15.12:0/1407467794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21fb320 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f579802e9f0 tx=0x7f5798009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5136b3a9f7c1470b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57867fc700 1 -- 172.21.15.12:0/1407467794 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980079b0 con 0x564cc21f4de0 2023-12-11T20:24:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57867fc700 1 -- 172.21.15.12:0/1407467794 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5798009b80 con 0x564cc21f4de0 2023-12-11T20:24:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57867fc700 1 -- 172.21.15.12:0/1407467794 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579802fbb0 con 0x564cc21f4de0 2023-12-11T20:24:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57b940bb80 1 -- 172.21.15.12:0/1407467794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 msgr2=0x564cc21fb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57b940bb80 1 --2- 172.21.15.12:0/1407467794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21fb320 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f579802e9f0 tx=0x7f5798009040 comp rx=0 tx=0).stop 2023-12-11T20:24:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57b940bb80 1 -- 172.21.15.12:0/1407467794 shutdown_connections 2023-12-11T20:24:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57b940bb80 1 --2- 172.21.15.12:0/1407467794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc21fc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57b940bb80 1 --2- 172.21.15.12:0/1407467794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f4de0 0x564cc21fb320 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57b940bb80 1 --2- 172.21.15.12:0/1407467794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f43c0 0x564cc2204500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.201+0000 7f57b940bb80 1 -- 172.21.15.12:0/1407467794 >> 172.21.15.12:0/1407467794 conn(0x564cc21227e0 msgr2=0x564cc21ee320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.202+0000 7f57b940bb80 1 -- 172.21.15.12:0/1407467794 shutdown_connections 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.202+0000 7f57b940bb80 1 -- 172.21.15.12:0/1407467794 wait complete. 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.202+0000 7f57b940bb80 1 -- start start 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.202+0000 7f57b940bb80 1 Processor -- start 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc2203d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f43c0 0x564cc2204270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f57b940bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f4de0 0x564cc2202340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f57b940bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc22028c0 con 0x564cc21f43c0 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f57b940bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc2202a30 con 0x564cc21f3a60 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f57b940bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cc2202bf0 con 0x564cc21f4de0 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f57b940bb80 10 client.0 _ll_register_callbacks cb 0x564cc202ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f43c0 0x564cc2204270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f43c0 0x564cc2204270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36652/0 (socket says 172.21.15.12:36652) 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579e7fc700 1 -- 172.21.15.12:0/3549455712 learned_addr learned my addr 172.21.15.12:0/3549455712 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579effd700 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc2203d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579f7fe700 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f4de0 0x564cc2202340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579e7fc700 1 -- 172.21.15.12:0/3549455712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f4de0 msgr2=0x564cc2202340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579e7fc700 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f4de0 0x564cc2202340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579e7fc700 1 -- 172.21.15.12:0/3549455712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 msgr2=0x564cc2203d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.203+0000 7f579e7fc700 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc2203d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f579e7fc700 1 -- 172.21.15.12:0/3549455712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564cc1f70de0 con 0x564cc21f43c0 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f579f7fe700 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f4de0 0x564cc2202340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f579e7fc700 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f43c0 0x564cc2204270 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f57940b8360 tx=0x7f5794009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485ef19d8116c0dc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f577effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f577effd700 1 -- 172.21.15.12:0/3549455712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940b8020 con 0x564cc21f43c0 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f577effd700 1 -- 172.21.15.12:0/3549455712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f579400f460 con 0x564cc21f43c0 2023-12-11T20:24:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f57b940bb80 1 -- 172.21.15.12:0/3549455712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f579409afc0 con 0x564cc21f43c0 2023-12-11T20:24:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f577effd700 1 -- 172.21.15.12:0/3549455712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f579409bb80 con 0x564cc21f43c0 2023-12-11T20:24:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f57b940bb80 10 client.17859 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.204+0000 7f57b940bb80 1 -- 172.21.15.12:0/3549455712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564cc1f97250 con 0x564cc21f43c0 2023-12-11T20:24:06.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f577effd700 1 -- 172.21.15.12:0/3549455712 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f579409afc0 con 0x564cc21f43c0 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f577effd700 1 -- 172.21.15.12:0/3549455712 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f579409aa90 con 0x564cc21f43c0 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f57b940bb80 10 client.17859 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f57b940bb80 10 client.17859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f57b940bb80 20 client.17859 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564cc22601c0 0x564cc22625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f57b940bb80 4 client.17859 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f57b940bb80 1 -- 172.21.15.12:0/3549455712 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564cc210dfd0 con 0x564cc22601c0 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.205+0000 7f579effd700 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564cc22601c0 0x564cc22625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f579effd700 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564cc22601c0 0x564cc22625e0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bde6020b978b8b73 server_cookie=fd10f518d45679f2 in_seq=0 out_seq=0 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f577effd700 10 client.17859 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f577effd700 1 -- 172.21.15.12:0/3549455712 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564cc210dfd0 con 0x564cc22601c0 2023-12-11T20:24:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f577effd700 10 client.17859 handle_command_reply: tid=0 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 client.17859 shutdown 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 -- 172.21.15.12:0/3549455712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f43c0 msgr2=0x564cc2204270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f43c0 0x564cc2204270 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f57940b8360 tx=0x7f5794009360 comp rx=0 tx=0).stop 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 -- 172.21.15.12:0/3549455712 shutdown_connections 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564cc22601c0 0x564cc22625e0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564cc21f3a60 0x564cc2203d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564cc21f4de0 0x564cc2202340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 --2- 172.21.15.12:0/3549455712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cc21f43c0 0x564cc2204270 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 -- 172.21.15.12:0/3549455712 >> 172.21.15.12:0/3549455712 conn(0x564cc21227e0 msgr2=0x564cc21fb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f577effd700 0 client.17859 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.206+0000 7f57b940bb80 1 -- 172.21.15.12:0/3549455712 shutdown_connections 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f57b940bb80 1 -- 172.21.15.12:0/3549455712 wait complete. 2023-12-11T20:24:06.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f57b940bb80 20 client.17859 trim_cache size 0 max 16384 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: "f7619220-39e6-49fc-8c56-7c10376b343a": { 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "f7619220-39e6-49fc-8c56-7c10376b343a", 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:24:06.209 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:24:06.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 -- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57880a15a0 msgr2=0x7f57880a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57880a15a0 0x7f57880a3a60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5798007c20 tx=0x7f57980098b0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 -- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 msgr2=0x7f57a00ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 0x7f57a00ffd20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f579400b2e0 tx=0x7f5794004730 comp rx=0 tx=0).stop 2023-12-11T20:24:06.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 -- 172.21.15.12:0/2191657527 shutdown_connections 2023-12-11T20:24:06.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57880a15a0 0x7f57880a3a60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57a0106fd0 0x7f57a0100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57a0101d70 0x7f57a0101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 --2- 172.21.15.12:0/2191657527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57a01046a0 0x7f57a00ffd20 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.207+0000 7f579ffff700 1 -- 172.21.15.12:0/2191657527 >> 172.21.15.12:0/2191657527 conn(0x7f57a00fb740 msgr2=0x7f57a0102850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:06.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.208+0000 7f579ffff700 1 -- 172.21.15.12:0/2191657527 shutdown_connections 2023-12-11T20:24:06.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:06.208+0000 7f579ffff700 1 -- 172.21.15.12:0/2191657527 wait complete. 2023-12-11T20:24:06.212 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:24:05 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:24:05.905+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v170>,<0x10000000003/client.0 v172>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v189>,<0x10000000001/sv_0 v213>,<0x10000000000/_nogroup v197>,<0x1/volumes v189>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:24:06.226 INFO:tasks.cephfs.filesystem:scrub status for tag:f7619220-39e6-49fc-8c56-7c10376b343a - {'path': '/', 'tag': 'f7619220-39e6-49fc-8c56-7c10376b343a', 'options': 'recursive,force'} 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:06.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:06 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:24:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:24:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:06.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:06 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:24:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:24:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:06.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:06 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 -- 172.21.15.12:0/3509571513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 msgr2=0x7ff814074450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3509571513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 0x7ff814074450 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff808009990 tx=0x7ff808009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 -- 172.21.15.12:0/3509571513 shutdown_connections 2023-12-11T20:24:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3509571513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8141093c0 0x7ff81410b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3509571513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8140755b0 0x7ff814073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3509571513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 0x7ff814074450 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 -- 172.21.15.12:0/3509571513 >> 172.21.15.12:0/3509571513 conn(0x7ff8140fca60 msgr2=0x7ff8140feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 -- 172.21.15.12:0/3509571513 shutdown_connections 2023-12-11T20:24:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.001+0000 7ff8197ff700 1 -- 172.21.15.12:0/3509571513 wait complete. 2023-12-11T20:24:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.002+0000 7ff8197ff700 1 Processor -- start 2023-12-11T20:24:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.002+0000 7ff8197ff700 1 -- start start 2023-12-11T20:24:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.002+0000 7ff8197ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 0x7ff8141995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.002+0000 7ff8197ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8140755b0 0x7ff814199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.002+0000 7ff8197ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8141093c0 0x7ff8141a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.002+0000 7ff8197ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141a1090 con 0x7ff814073fd0 2023-12-11T20:24:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.002+0000 7ff8197ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141a11d0 con 0x7ff8141093c0 2023-12-11T20:24:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.002+0000 7ff8197ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141a1360 con 0x7ff8140755b0 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff812ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 0x7ff8141995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff812ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 0x7ff8141995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36676/0 (socket says 172.21.15.12:36676) 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff812ffd700 1 -- 172.21.15.12:0/3199639784 learned_addr learned my addr 172.21.15.12:0/3199639784 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff8137fe700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8141093c0 0x7ff8141a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff8127fc700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8140755b0 0x7ff814199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff812ffd700 1 -- 172.21.15.12:0/3199639784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8140755b0 msgr2=0x7ff814199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8140755b0 0x7ff814199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff812ffd700 1 -- 172.21.15.12:0/3199639784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8141093c0 msgr2=0x7ff8141a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8141093c0 0x7ff8141a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff812ffd700 1 -- 172.21.15.12:0/3199639784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8080095f0 con 0x7ff814073fd0 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.003+0000 7ff8127fc700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8140755b0 0x7ff814199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.004+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 0x7ff8141995b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d950 tx=0x7ff80400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.004+0000 7ff7fbfff700 1 -- 172.21.15.12:0/3199639784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804009940 con 0x7ff814073fd0 2023-12-11T20:24:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.004+0000 7ff7fbfff700 1 -- 172.21.15.12:0/3199639784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff804010460 con 0x7ff814073fd0 2023-12-11T20:24:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.004+0000 7ff7fbfff700 1 -- 172.21.15.12:0/3199639784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400f620 con 0x7ff814073fd0 2023-12-11T20:24:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.004+0000 7ff8197ff700 1 -- 172.21.15.12:0/3199639784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8141a1640 con 0x7ff814073fd0 2023-12-11T20:24:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.004+0000 7ff8197ff700 1 -- 172.21.15.12:0/3199639784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8141a1b00 con 0x7ff814073fd0 2023-12-11T20:24:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.008+0000 7ff7fbfff700 1 -- 172.21.15.12:0/3199639784 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff8040105d0 con 0x7ff814073fd0 2023-12-11T20:24:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.009+0000 7ff82d064b80 1 Processor -- start 2023-12-11T20:24:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.009+0000 7ff82d064b80 1 -- start start 2023-12-11T20:24:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff7fbfff700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7fc0a1470 0x7ff7fc0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b152f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b16140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 0x55e577b16ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff82d064b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577a70af0 con 0x55e577b15830 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff82d064b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577a6e410 con 0x55e577b14ed0 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff82d064b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577a69d00 con 0x55e577b16720 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff7fbfff700 1 -- 172.21.15.12:0/3199639784 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff8040ccc10 con 0x7ff814073fd0 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff8137fe700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7fc0a1470 0x7ff7fc0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff812ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b152f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff8127fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b16140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff812ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b152f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:54388/0 (socket says 172.21.15.12:54388) 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff812ffd700 1 -- 172.21.15.12:0/3443377104 learned_addr learned my addr 172.21.15.12:0/3443377104 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.010+0000 7ff8137fe700 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 0x55e577b16ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff812ffd700 1 -- 172.21.15.12:0/3443377104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 msgr2=0x55e577b16ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 0x55e577b16ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff812ffd700 1 -- 172.21.15.12:0/3443377104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 msgr2=0x55e577b16140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b16140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff812ffd700 1 -- 172.21.15.12:0/3443377104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5778e65d0 con 0x55e577b14ed0 2023-12-11T20:24:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff8127fc700 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b16140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b152f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff804096380 tx=0x7ff804099a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44d708136f4b9d59 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff8137fe700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7fc0a1470 0x7ff7fc0a3930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55e577b15f00 tx=0x7ff80c003a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff7f97fa700 1 -- 172.21.15.12:0/3443377104 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040ac460 con 0x55e577b14ed0 2023-12-11T20:24:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff7f97fa700 1 -- 172.21.15.12:0/3443377104 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8040ac280 con 0x55e577b14ed0 2023-12-11T20:24:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.011+0000 7ff7f97fa700 1 -- 172.21.15.12:0/3443377104 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80409dfd0 con 0x55e577b14ed0 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 -- 172.21.15.12:0/3443377104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 msgr2=0x55e577b152f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b152f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff804096380 tx=0x7ff804099a90 comp rx=0 tx=0).stop 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 -- 172.21.15.12:0/3443377104 shutdown_connections 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b152f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 0x55e577b16ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3443377104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b16140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 -- 172.21.15.12:0/3443377104 >> 172.21.15.12:0/3443377104 conn(0x55e577a44780 msgr2=0x55e577b11880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 -- 172.21.15.12:0/3443377104 shutdown_connections 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.012+0000 7ff82d064b80 1 -- 172.21.15.12:0/3443377104 wait complete. 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.013+0000 7ff82d064b80 1 -- start start 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.013+0000 7ff82d064b80 1 Processor -- start 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b14ed0 0x55e577b1ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b15830 0x55e577b1f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b16720 0x55e577b26210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff82d064b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577a23500 con 0x55e577b14ed0 2023-12-11T20:24:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff82d064b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577a231a0 con 0x55e577b16720 2023-12-11T20:24:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff82d064b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5778e88c0 con 0x55e577b15830 2023-12-11T20:24:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff82d064b80 10 client.0 _ll_register_callbacks cb 0x55e57794ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff812ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b14ed0 0x55e577b1ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff812ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b14ed0 0x55e577b1ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36680/0 (socket says 172.21.15.12:36680) 2023-12-11T20:24:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.014+0000 7ff812ffd700 1 -- 172.21.15.12:0/1182978347 learned_addr learned my addr 172.21.15.12:0/1182978347 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff8137fe700 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b16720 0x55e577b26210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff8127fc700 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b15830 0x55e577b1f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff812ffd700 1 -- 172.21.15.12:0/1182978347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b15830 msgr2=0x55e577b1f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff812ffd700 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b15830 0x55e577b1f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff812ffd700 1 -- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b16720 msgr2=0x55e577b26210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff812ffd700 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b16720 0x55e577b26210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff812ffd700 1 -- 172.21.15.12:0/1182978347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81410c450 con 0x55e577b14ed0 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff8137fe700 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b16720 0x55e577b26210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff812ffd700 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b14ed0 0x55e577b1ef40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff804009520 tx=0x7ff804010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e74594b17553c48 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff7f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/1182978347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80409dfd0 con 0x55e577b14ed0 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/1182978347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff8040ca6e0 con 0x55e577b14ed0 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.015+0000 7ff82d064b80 1 -- 172.21.15.12:0/1182978347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e577b08730 con 0x55e577b14ed0 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/1182978347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8040ca8a0 con 0x55e577b14ed0 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff82d064b80 10 client.17871 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff82d064b80 1 -- 172.21.15.12:0/1182978347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ff8141a1b00 con 0x55e577b14ed0 2023-12-11T20:24:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/1182978347 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff804063020 con 0x55e577b14ed0 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/1182978347 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8040a1d80 con 0x55e577b14ed0 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff82d064b80 10 client.17871 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff82d064b80 10 client.17871 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff82d064b80 20 client.17871 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff82d064b80 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e577b2a880 0x55e577b2cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff82d064b80 4 client.17871 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.016+0000 7ff82d064b80 1 -- 172.21.15.12:0/1182978347 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e577ae4ee0 con 0x55e577b2a880 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.017+0000 7ff8127fc700 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e577b2a880 0x55e577b2cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.017+0000 7ff8127fc700 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e577b2a880 0x55e577b2cca0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49df319210e35c93 server_cookie=1015a0acb7790983 in_seq=0 out_seq=0 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.017+0000 7ff7f6ff5700 10 client.17871 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.018+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/1182978347 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e577ae4ee0 con 0x55e577b2a880 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.018+0000 7ff7f6ff5700 10 client.17871 handle_command_reply: tid=0 2023-12-11T20:24:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.018+0000 7ff82d064b80 1 client.17871 shutdown 2023-12-11T20:24:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.018+0000 7ff82d064b80 1 -- 172.21.15.12:0/1182978347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b14ed0 msgr2=0x55e577b1ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b14ed0 0x55e577b1ef40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff804009520 tx=0x7ff804010a00 comp rx=0 tx=0).stop 2023-12-11T20:24:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 -- 172.21.15.12:0/1182978347 shutdown_connections 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e577b2a880 0x55e577b2cca0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b16720 0x55e577b26210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b14ed0 0x55e577b1ef40 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff7f6ff5700 0 client.17871 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 --2- 172.21.15.12:0/1182978347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b15830 0x55e577b1f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 -- 172.21.15.12:0/1182978347 >> 172.21.15.12:0/1182978347 conn(0x55e577a44780 msgr2=0x55e577b0fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 -- 172.21.15.12:0/1182978347 shutdown_connections 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 1 -- 172.21.15.12:0/1182978347 wait complete. 2023-12-11T20:24:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.019+0000 7ff82d064b80 20 client.17871 trim_cache size 0 max 16384 2023-12-11T20:24:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff82d064b80 1 Processor -- start 2023-12-11T20:24:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff82d064b80 1 -- start start 2023-12-11T20:24:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b14ed0 0x55e577b1e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b15830 0x55e577b261d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b16720 0x55e577b16b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff82d064b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577b26880 con 0x55e577b16720 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff82d064b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577b15f30 con 0x55e577b15830 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff82d064b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577b1c9b0 con 0x55e577b14ed0 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff8137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b16720 0x55e577b16b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.039+0000 7ff8137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b16720 0x55e577b16b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36696/0 (socket says 172.21.15.12:36696) 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff8137fe700 1 -- 172.21.15.12:0/2124215429 learned_addr learned my addr 172.21.15.12:0/2124215429 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff8127fc700 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b15830 0x55e577b261d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff812ffd700 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b14ed0 0x55e577b1e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff8137fe700 1 -- 172.21.15.12:0/2124215429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b14ed0 msgr2=0x55e577b1e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff8137fe700 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b14ed0 0x55e577b1e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff8137fe700 1 -- 172.21.15.12:0/2124215429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b15830 msgr2=0x55e577b261d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff8137fe700 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b15830 0x55e577b261d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff8137fe700 1 -- 172.21.15.12:0/2124215429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e577892d80 con 0x55e577b16720 2023-12-11T20:24:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff8137fe700 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b16720 0x55e577b16b00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0046b0 tx=0x7ff80c00b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c16f4e91df9db2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.040+0000 7ff7f9ffb700 1 -- 172.21.15.12:0/2124215429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c008c80 con 0x55e577b16720 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff7f9ffb700 1 -- 172.21.15.12:0/2124215429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff80c00f040 con 0x55e577b16720 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff7f9ffb700 1 -- 172.21.15.12:0/2124215429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c019400 con 0x55e577b16720 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 -- 172.21.15.12:0/2124215429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b16720 msgr2=0x55e577b16b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b16720 0x55e577b16b00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0046b0 tx=0x7ff80c00b070 comp rx=0 tx=0).stop 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 -- 172.21.15.12:0/2124215429 shutdown_connections 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b16720 0x55e577b16b00 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b14ed0 0x55e577b1e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 --2- 172.21.15.12:0/2124215429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b15830 0x55e577b261d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 -- 172.21.15.12:0/2124215429 >> 172.21.15.12:0/2124215429 conn(0x55e577a44780 msgr2=0x55e577b19940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 -- 172.21.15.12:0/2124215429 shutdown_connections 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.041+0000 7ff82d064b80 1 -- 172.21.15.12:0/2124215429 wait complete. 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.042+0000 7ff82d064b80 1 -- start start 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.042+0000 7ff82d064b80 1 Processor -- start 2023-12-11T20:24:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.042+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b25bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b260f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff82d064b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 0x55e577b241e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff82d064b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577b248f0 con 0x55e577b15830 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff82d064b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577b24a60 con 0x55e577b14ed0 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff82d064b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e577b24c20 con 0x55e577b16720 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff82d064b80 10 client.0 _ll_register_callbacks cb 0x55e57794ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff8127fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff8127fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b260f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36710/0 (socket says 172.21.15.12:36710) 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff8127fc700 1 -- 172.21.15.12:0/3674562321 learned_addr learned my addr 172.21.15.12:0/3674562321 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b25bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff8137fe700 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 0x55e577b241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff8127fc700 1 -- 172.21.15.12:0/3674562321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 msgr2=0x55e577b241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff8127fc700 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 0x55e577b241e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff8127fc700 1 -- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 msgr2=0x55e577b25bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.043+0000 7ff8127fc700 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b25bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff8127fc700 1 -- 172.21.15.12:0/3674562321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c021040 con 0x55e577b15830 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b25bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff8127fc700 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b260f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7ff8080098e0 tx=0x7ff80800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92e7403eccef402 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff7f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/3674562321 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808005510 con 0x55e577b15830 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/3674562321 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff808005670 con 0x55e577b15830 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff82d064b80 1 -- 172.21.15.12:0/3674562321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8040ac280 con 0x55e577b15830 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/3674562321 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8080290c0 con 0x55e577b15830 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.044+0000 7ff82d064b80 10 client.17877 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff82d064b80 1 -- 172.21.15.12:0/3674562321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e57787bc00 con 0x55e577b15830 2023-12-11T20:24:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/3674562321 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8040ac280 con 0x55e577b15830 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/3674562321 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8080099c0 con 0x55e577b15830 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff82d064b80 10 client.17877 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff82d064b80 10 client.17877 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff82d064b80 20 client.17877 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e577b82270 0x55e577b84690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff82d064b80 4 client.17877 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.045+0000 7ff82d064b80 1 -- 172.21.15.12:0/3674562321 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e577a2ff70 con 0x55e577b82270 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.046+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e577b82270 0x55e577b84690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.046+0000 7ff7f6ff5700 10 client.17877 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.046+0000 7ff812ffd700 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e577b82270 0x55e577b84690 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc529f73377d0040 server_cookie=f21bbbc3ad1d1b7d in_seq=0 out_seq=0 2023-12-11T20:24:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff7f6ff5700 1 -- 172.21.15.12:0/3674562321 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e577a2ff70 con 0x55e577b82270 2023-12-11T20:24:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff7f6ff5700 10 client.17877 handle_command_reply: tid=0 2023-12-11T20:24:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 client.17877 shutdown 2023-12-11T20:24:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 -- 172.21.15.12:0/3674562321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 msgr2=0x55e577b260f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b260f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7ff8080098e0 tx=0x7ff80800be60 comp rx=0 tx=0).stop 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 -- 172.21.15.12:0/3674562321 shutdown_connections 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e577b82270 0x55e577b84690 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e577b14ed0 0x55e577b25bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e577b16720 0x55e577b241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 --2- 172.21.15.12:0/3674562321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e577b15830 0x55e577b260f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 -- 172.21.15.12:0/3674562321 >> 172.21.15.12:0/3674562321 conn(0x55e577a44780 msgr2=0x55e577b31600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff7f6ff5700 0 client.17877 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 -- 172.21.15.12:0/3674562321 shutdown_connections 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.057+0000 7ff82d064b80 1 -- 172.21.15.12:0/3674562321 wait complete. 2023-12-11T20:24:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff82d064b80 20 client.17877 trim_cache size 0 max 16384 2023-12-11T20:24:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:24:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:24:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:24:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 -- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7fc0a1470 msgr2=0x7ff7fc0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7fc0a1470 0x7ff7fc0a3930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55e577b15f00 tx=0x7ff80c003a20 comp rx=0 tx=0).stop 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 -- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 msgr2=0x7ff8141995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 0x7ff8141995b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d950 tx=0x7ff80400dc60 comp rx=0 tx=0).stop 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 -- 172.21.15.12:0/3199639784 shutdown_connections 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7fc0a1470 0x7ff7fc0a3930 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8141093c0 0x7ff8141a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff814073fd0 0x7ff8141995b0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 --2- 172.21.15.12:0/3199639784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8140755b0 0x7ff814199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 -- 172.21.15.12:0/3199639784 >> 172.21.15.12:0/3199639784 conn(0x7ff8140fca60 msgr2=0x7ff814105310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 -- 172.21.15.12:0/3199639784 shutdown_connections 2023-12-11T20:24:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:07.058+0000 7ff8197ff700 1 -- 172.21.15.12:0/3199639784 wait complete. 2023-12-11T20:24:07.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:07 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:07 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:07 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:07 smithi032 ceph-mon[132488]: pgmap v621: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 20 op/s 2023-12-11T20:24:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:07 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:07 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:07 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:07 smithi039 ceph-mon[102205]: pgmap v621: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 20 op/s 2023-12-11T20:24:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:07 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:07 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:07 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:07 smithi012 ceph-mon[128787]: pgmap v621: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 20 op/s 2023-12-11T20:24:09.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:09 smithi032 ceph-mon[132488]: pgmap v622: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:24:09.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:09 smithi039 ceph-mon[102205]: pgmap v622: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:24:09.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:09 smithi012 ceph-mon[128787]: pgmap v622: 97 pgs: 97 active+clean; 5.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:24:11.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:11 smithi039 ceph-mon[102205]: pgmap v623: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:24:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:11 smithi012 ceph-mon[128787]: pgmap v623: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:24:11.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:11 smithi032 ceph-mon[132488]: pgmap v623: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 14 MiB/s wr, 31 op/s 2023-12-11T20:24:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:13 smithi039 ceph-mon[102205]: pgmap v624: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:24:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:13 smithi012 ceph-mon[128787]: pgmap v624: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:24:13.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:13 smithi032 ceph-mon[132488]: pgmap v624: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:24:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:15 smithi039 ceph-mon[102205]: pgmap v625: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:24:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:15 smithi012 ceph-mon[128787]: pgmap v625: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:24:15.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:15 smithi032 ceph-mon[132488]: pgmap v625: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:24:16.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:16 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:24:16.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:16 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:24:16.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:16 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:24:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:17 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:24:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:17 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:24:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:17 smithi039 ceph-mon[102205]: pgmap v626: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:24:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:17 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:24:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:17 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:24:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:17 smithi012 ceph-mon[128787]: pgmap v626: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:24:17.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:17 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:24:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:17 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:24:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:17 smithi032 ceph-mon[132488]: pgmap v626: 97 pgs: 97 active+clean; 5.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:24:18.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:18 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:24:18.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:18 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:24:18.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:18 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:24:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:24:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:24:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:24:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:19 smithi039 ceph-mon[102205]: pgmap v627: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:24:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:24:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:24:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:24:19.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:19 smithi012 ceph-mon[128787]: pgmap v627: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:24:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:24:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:24:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:24:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:19 smithi032 ceph-mon[132488]: pgmap v627: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 -- 172.21.15.12:0/3758426694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62801014d0 msgr2=0x7f62801018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 --2- 172.21.15.12:0/3758426694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62801014d0 0x7f62801018f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f627c0099c0 tx=0x7f627c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 -- 172.21.15.12:0/3758426694 shutdown_connections 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 --2- 172.21.15.12:0/3758426694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6280103060 0x7f6280109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 --2- 172.21.15.12:0/3758426694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62801014d0 0x7f62801018f0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 --2- 172.21.15.12:0/3758426694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62801026c0 0x7f6280102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 -- 172.21.15.12:0/3758426694 >> 172.21.15.12:0/3758426694 conn(0x7f62800fca60 msgr2=0x7f62800fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 -- 172.21.15.12:0/3758426694 shutdown_connections 2023-12-11T20:24:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.237+0000 7f62873ff700 1 -- 172.21.15.12:0/3758426694 wait complete. 2023-12-11T20:24:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.239+0000 7f62873ff700 1 Processor -- start 2023-12-11T20:24:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.240+0000 7f62873ff700 1 -- start start 2023-12-11T20:24:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.240+0000 7f62873ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62801014d0 0x7f6280199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.240+0000 7f62873ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62801026c0 0x7f6280199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.240+0000 7f62873ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6280103060 0x7f62801a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.240+0000 7f62873ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62801a10b0 con 0x7f62801014d0 2023-12-11T20:24:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.240+0000 7f62873ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628006aff0 con 0x7f62801026c0 2023-12-11T20:24:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.240+0000 7f62873ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628006b180 con 0x7f6280103060 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628499a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62801026c0 0x7f6280199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62801014d0 0x7f6280199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628499a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62801026c0 0x7f6280199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:34764/0 (socket says 172.21.15.12:34764) 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628499a700 1 -- 172.21.15.12:0/3816177884 learned_addr learned my addr 172.21.15.12:0/3816177884 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628499a700 1 -- 172.21.15.12:0/3816177884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6280103060 msgr2=0x7f62801a0ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628499a700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6280103060 0x7f62801a0ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628499a700 1 -- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62801014d0 msgr2=0x7f6280199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628499a700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62801014d0 0x7f6280199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.241+0000 7f628499a700 1 -- 172.21.15.12:0/3816177884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0095f0 con 0x7f62801026c0 2023-12-11T20:24:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.242+0000 7f628499a700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62801026c0 0x7f6280199ac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f627000d950 tx=0x7f627000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.242+0000 7f62767fc700 1 -- 172.21.15.12:0/3816177884 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270009940 con 0x7f62801026c0 2023-12-11T20:24:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.242+0000 7f62873ff700 1 -- 172.21.15.12:0/3816177884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628006b460 con 0x7f62801026c0 2023-12-11T20:24:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.242+0000 7f62767fc700 1 -- 172.21.15.12:0/3816177884 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6270010460 con 0x7f62801026c0 2023-12-11T20:24:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.242+0000 7f62767fc700 1 -- 172.21.15.12:0/3816177884 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000f620 con 0x7f62801026c0 2023-12-11T20:24:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.242+0000 7f62873ff700 1 -- 172.21.15.12:0/3816177884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628006b9c0 con 0x7f62801026c0 2023-12-11T20:24:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.247+0000 7f62767fc700 1 -- 172.21.15.12:0/3816177884 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f62700105d0 con 0x7f62801026c0 2023-12-11T20:24:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.247+0000 7f629add2b80 1 Processor -- start 2023-12-11T20:24:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.247+0000 7f629add2b80 1 -- start start 2023-12-11T20:24:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f629add2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787aed0 0x562db787b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f629add2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787b830 0x562db787c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f629add2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db787cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f629add2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db77d6af0 con 0x562db787b830 2023-12-11T20:24:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f629add2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db77d4410 con 0x562db787c720 2023-12-11T20:24:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f629add2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db77cfd00 con 0x562db787aed0 2023-12-11T20:24:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f628519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787b830 0x562db787c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f628599c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787aed0 0x562db787b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f628519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787b830 0x562db787c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36746/0 (socket says 172.21.15.12:36746) 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f628519b700 1 -- 172.21.15.12:0/2566315616 learned_addr learned my addr 172.21.15.12:0/2566315616 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.248+0000 7f628499a700 1 --2- 172.21.15.12:0/2566315616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db787cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f628519b700 1 -- 172.21.15.12:0/2566315616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787aed0 msgr2=0x562db787b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f628519b700 1 --2- 172.21.15.12:0/2566315616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787aed0 0x562db787b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f628519b700 1 -- 172.21.15.12:0/2566315616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 msgr2=0x562db787cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f628519b700 1 --2- 172.21.15.12:0/2566315616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db787cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f628519b700 1 -- 172.21.15.12:0/2566315616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562db764c5d0 con 0x562db787b830 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f62767fc700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f626c0a1470 0x7f626c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f628519b700 1 --2- 172.21.15.12:0/2566315616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787b830 0x562db787c140 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f627c00b580 tx=0x7f627c005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b1b2fd49f68131 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f62767fc700 1 -- 172.21.15.12:0/3816177884 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f62700ccbf0 con 0x7f62801026c0 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.249+0000 7f628599c700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f626c0a1470 0x7f626c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.250+0000 7f626b7fe700 1 -- 172.21.15.12:0/2566315616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c01d070 con 0x562db787b830 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.250+0000 7f626b7fe700 1 -- 172.21.15.12:0/2566315616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f627c01e040 con 0x562db787b830 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.250+0000 7f626b7fe700 1 -- 172.21.15.12:0/2566315616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c005720 con 0x562db787b830 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.250+0000 7f629add2b80 1 -- 172.21.15.12:0/2566315616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787b830 msgr2=0x562db787c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.250+0000 7f628599c700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f626c0a1470 0x7f626c0a3930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6278003e90 tx=0x7f6278009100 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.250+0000 7f629add2b80 1 --2- 172.21.15.12:0/2566315616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787b830 0x562db787c140 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f627c00b580 tx=0x7f627c005bc0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 -- 172.21.15.12:0/2566315616 shutdown_connections 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 --2- 172.21.15.12:0/2566315616 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db787cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 --2- 172.21.15.12:0/2566315616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787aed0 0x562db787b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 --2- 172.21.15.12:0/2566315616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787b830 0x562db787c140 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 -- 172.21.15.12:0/2566315616 >> 172.21.15.12:0/2566315616 conn(0x562db77aa780 msgr2=0x562db7877880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 -- 172.21.15.12:0/2566315616 shutdown_connections 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 -- 172.21.15.12:0/2566315616 wait complete. 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 -- start start 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.251+0000 7f629add2b80 1 Processor -- start 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f629add2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787aed0 0x562db7884e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f629add2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7885390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f629add2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787c720 0x562db788c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f629add2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db7789500 con 0x562db787c720 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f629add2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db77891a0 con 0x562db787aed0 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f629add2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db764e8c0 con 0x562db787b830 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f629add2b80 10 client.0 _ll_register_callbacks cb 0x562db76b4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f628599c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787c720 0x562db788c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f628499a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7885390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f628599c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787c720 0x562db788c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36752/0 (socket says 172.21.15.12:36752) 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f628599c700 1 -- 172.21.15.12:0/3323757805 learned_addr learned my addr 172.21.15.12:0/3323757805 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.252+0000 7f628519b700 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787aed0 0x562db7884e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f628599c700 1 -- 172.21.15.12:0/3323757805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 msgr2=0x562db7885390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f628599c700 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7885390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f628599c700 1 -- 172.21.15.12:0/3323757805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787aed0 msgr2=0x562db7884e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f628599c700 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787aed0 0x562db7884e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f628599c700 1 -- 172.21.15.12:0/3323757805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628010a260 con 0x562db787c720 2023-12-11T20:24:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f628499a700 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7885390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f628599c700 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787c720 0x562db788c1c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6278007830 tx=0x7f6278004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b6e33fc927c660 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f6268ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.253+0000 7f6268ff9700 1 -- 172.21.15.12:0/3323757805 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278025070 con 0x562db787c720 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f629add2b80 1 -- 172.21.15.12:0/3323757805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562db786e730 con 0x562db787c720 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f6268ff9700 1 -- 172.21.15.12:0/3323757805 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6278004bb0 con 0x562db787c720 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f6268ff9700 1 -- 172.21.15.12:0/3323757805 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6278004900 con 0x562db787c720 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f629add2b80 10 client.17889 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f629add2b80 1 -- 172.21.15.12:0/3323757805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562db75f8d80 con 0x562db787c720 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f6268ff9700 1 -- 172.21.15.12:0/3323757805 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f627802f020 con 0x562db787c720 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f6268ff9700 1 -- 172.21.15.12:0/3323757805 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6278028030 con 0x562db787c720 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f629add2b80 10 client.17889 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f629add2b80 10 client.17889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f629add2b80 20 client.17889 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.254+0000 7f629add2b80 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562db7890d90 0x562db78931b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.255+0000 7f629add2b80 4 client.17889 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.255+0000 7f629add2b80 1 -- 172.21.15.12:0/3323757805 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562db784aee0 con 0x562db7890d90 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.255+0000 7f628519b700 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562db7890d90 0x562db78931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.256+0000 7f6268ff9700 10 client.17889 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.256+0000 7f628519b700 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562db7890d90 0x562db78931b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22458a1cfdc769d6 server_cookie=af4c70c9c9d2b965 in_seq=0 out_seq=0 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.256+0000 7f6268ff9700 1 -- 172.21.15.12:0/3323757805 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562db784aee0 con 0x562db7890d90 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.256+0000 7f6268ff9700 10 client.17889 handle_command_reply: tid=0 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.256+0000 7f629add2b80 1 client.17889 shutdown 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 -- 172.21.15.12:0/3323757805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787c720 msgr2=0x562db788c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787c720 0x562db788c1c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6278007830 tx=0x7f6278004b40 comp rx=0 tx=0).stop 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 -- 172.21.15.12:0/3323757805 shutdown_connections 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562db7890d90 0x562db78931b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787aed0 0x562db7884e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787c720 0x562db788c1c0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f6268ff9700 0 client.17889 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 --2- 172.21.15.12:0/3323757805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7885390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 -- 172.21.15.12:0/3323757805 >> 172.21.15.12:0/3323757805 conn(0x562db77aa780 msgr2=0x562db7875ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 -- 172.21.15.12:0/3323757805 shutdown_connections 2023-12-11T20:24:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 1 -- 172.21.15.12:0/3323757805 wait complete. 2023-12-11T20:24:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.257+0000 7f629add2b80 20 client.17889 trim_cache size 0 max 16384 2023-12-11T20:24:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.275+0000 7f629add2b80 1 Processor -- start 2023-12-11T20:24:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.275+0000 7f629add2b80 1 -- start start 2023-12-11T20:24:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.275+0000 7f629add2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db788caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.275+0000 7f629add2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787b830 0x562db788c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.275+0000 7f629add2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787c720 0x562db7884150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.275+0000 7f629add2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db78836b0 con 0x562db787aed0 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.275+0000 7f629add2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db7880200 con 0x562db787b830 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.275+0000 7f629add2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db786e4c0 con 0x562db787c720 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db788caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db788caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36764/0 (socket says 172.21.15.12:36764) 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 -- 172.21.15.12:0/4010672221 learned_addr learned my addr 172.21.15.12:0/4010672221 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628499a700 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787b830 0x562db788c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628599c700 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787c720 0x562db7884150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 -- 172.21.15.12:0/4010672221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787c720 msgr2=0x562db7884150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787c720 0x562db7884150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 -- 172.21.15.12:0/4010672221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787b830 msgr2=0x562db788c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787b830 0x562db788c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 -- 172.21.15.12:0/4010672221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562db75e1c00 con 0x562db787aed0 2023-12-11T20:24:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628599c700 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787c720 0x562db7884150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.276+0000 7f628519b700 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db788caa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f627c0099c0 tx=0x7f627c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a267f7aa25ddb91 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.277+0000 7f626bfff700 1 -- 172.21.15.12:0/4010672221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c032070 con 0x562db787aed0 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.277+0000 7f626bfff700 1 -- 172.21.15.12:0/4010672221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f627c0054e0 con 0x562db787aed0 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.277+0000 7f626bfff700 1 -- 172.21.15.12:0/4010672221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c01d040 con 0x562db787aed0 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.277+0000 7f629add2b80 1 -- 172.21.15.12:0/4010672221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 msgr2=0x562db788caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.277+0000 7f629add2b80 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db788caa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f627c0099c0 tx=0x7f627c01a040 comp rx=0 tx=0).stop 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 -- 172.21.15.12:0/4010672221 shutdown_connections 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787c720 0x562db7884150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db788caa0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 --2- 172.21.15.12:0/4010672221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787b830 0x562db788c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 -- 172.21.15.12:0/4010672221 >> 172.21.15.12:0/4010672221 conn(0x562db77aa780 msgr2=0x562db7882c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 -- 172.21.15.12:0/4010672221 shutdown_connections 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 -- 172.21.15.12:0/4010672221 wait complete. 2023-12-11T20:24:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 -- start start 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.278+0000 7f629add2b80 1 Processor -- start 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f629add2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db7889530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f629add2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7889a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f629add2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db788a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f629add2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db788af20 con 0x562db787aed0 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f629add2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db788b090 con 0x562db787c720 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f629add2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db788b250 con 0x562db787b830 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f629add2b80 10 client.0 _ll_register_callbacks cb 0x562db76b4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f628519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db7889530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.279+0000 7f628519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db7889530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36778/0 (socket says 172.21.15.12:36778) 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628519b700 1 -- 172.21.15.12:0/3174275581 learned_addr learned my addr 172.21.15.12:0/3174275581 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628499a700 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7889a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628599c700 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db788a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628519b700 1 -- 172.21.15.12:0/3174275581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 msgr2=0x562db7889a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628519b700 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7889a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628519b700 1 -- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 msgr2=0x562db788a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628519b700 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db788a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628519b700 1 -- 172.21.15.12:0/3174275581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562db764c5d0 con 0x562db787aed0 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628599c700 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db788a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f628519b700 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db7889530 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f627c009350 tx=0x7f627c0098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cb02afa71041c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f6268ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.280+0000 7f6268ff9700 1 -- 172.21.15.12:0/3174275581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c032070 con 0x562db787aed0 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 1 -- 172.21.15.12:0/3174275581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f627c01e040 con 0x562db787aed0 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f6268ff9700 1 -- 172.21.15.12:0/3174275581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f627c003a30 con 0x562db787aed0 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f6268ff9700 1 -- 172.21.15.12:0/3174275581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f627c01d050 con 0x562db787aed0 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 10 client.17895 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 1 -- 172.21.15.12:0/3174275581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562db761f1f0 con 0x562db787aed0 2023-12-11T20:24:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f6268ff9700 1 -- 172.21.15.12:0/3174275581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f627c01e040 con 0x562db787aed0 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f6268ff9700 1 -- 172.21.15.12:0/3174275581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f627c00f830 con 0x562db787aed0 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 10 client.17895 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 10 client.17895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 20 client.17895 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562db78e7290 0x562db78e9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 4 client.17895 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.281+0000 7f629add2b80 1 -- 172.21.15.12:0/3174275581 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562db7795f70 con 0x562db78e7290 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.282+0000 7f628499a700 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562db78e7290 0x562db78e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.282+0000 7f628499a700 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562db78e7290 0x562db78e9680 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=439bc59dc12803f9 server_cookie=9b4ce735be8de274 in_seq=0 out_seq=0 2023-12-11T20:24:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.282+0000 7f6268ff9700 10 client.17895 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.292+0000 7f6268ff9700 1 -- 172.21.15.12:0/3174275581 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562db7795f70 con 0x562db78e7290 2023-12-11T20:24:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.292+0000 7f6268ff9700 10 client.17895 handle_command_reply: tid=0 2023-12-11T20:24:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 client.17895 shutdown 2023-12-11T20:24:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 -- 172.21.15.12:0/3174275581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 msgr2=0x562db7889530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db7889530 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f627c009350 tx=0x7f627c0098c0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 -- 172.21.15.12:0/3174275581 shutdown_connections 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562db78e7290 0x562db78e9680 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562db787c720 0x562db788a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562db787aed0 0x562db7889530 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f6268ff9700 0 client.17895 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 --2- 172.21.15.12:0/3174275581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562db787b830 0x562db7889a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 -- 172.21.15.12:0/3174275581 >> 172.21.15.12:0/3174275581 conn(0x562db77aa780 msgr2=0x562db7884150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 -- 172.21.15.12:0/3174275581 shutdown_connections 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 1 -- 172.21.15.12:0/3174275581 wait complete. 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.293+0000 7f629add2b80 20 client.17895 trim_cache size 0 max 16384 2023-12-11T20:24:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:24:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:24:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:24:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:24:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 -- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f626c0a1470 msgr2=0x7f626c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f626c0a1470 0x7f626c0a3930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6278003e90 tx=0x7f6278009100 comp rx=0 tx=0).stop 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 -- 172.21.15.12:0/3816177884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62801026c0 msgr2=0x7f6280199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62801026c0 0x7f6280199ac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f627000d950 tx=0x7f627000dc60 comp rx=0 tx=0).stop 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 -- 172.21.15.12:0/3816177884 shutdown_connections 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f626c0a1470 0x7f626c0a3930 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6280103060 0x7f62801a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62801014d0 0x7f6280199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 --2- 172.21.15.12:0/3816177884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62801026c0 0x7f6280199ac0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 -- 172.21.15.12:0/3816177884 >> 172.21.15.12:0/3816177884 conn(0x7f62800fca60 msgr2=0x7f6280107ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 -- 172.21.15.12:0/3816177884 shutdown_connections 2023-12-11T20:24:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:20.294+0000 7f62873ff700 1 -- 172.21.15.12:0/3816177884 wait complete. 2023-12-11T20:24:21.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:21 smithi039 ceph-mon[102205]: pgmap v628: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:24:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:21 smithi012 ceph-mon[128787]: pgmap v628: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:24:21.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:21 smithi032 ceph-mon[132488]: pgmap v628: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 18 op/s 2023-12-11T20:24:23.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:23 smithi039 ceph-mon[102205]: pgmap v629: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:24:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:23 smithi012 ceph-mon[128787]: pgmap v629: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:24:23.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:23 smithi032 ceph-mon[132488]: pgmap v629: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:24:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:25 smithi039 ceph-mon[102205]: pgmap v630: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:25 smithi012 ceph-mon[128787]: pgmap v630: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:25.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:25 smithi032 ceph-mon[132488]: pgmap v630: 97 pgs: 97 active+clean; 6.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:27 smithi039 ceph-mon[102205]: pgmap v631: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:24:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:27 smithi012 ceph-mon[128787]: pgmap v631: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:24:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:27 smithi032 ceph-mon[132488]: pgmap v631: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:24:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:29 smithi032 ceph-mon[132488]: pgmap v632: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:24:29.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:29 smithi039 ceph-mon[102205]: pgmap v632: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:24:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:29 smithi012 ceph-mon[128787]: pgmap v632: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:24:31.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:31 smithi039 ceph-mon[102205]: pgmap v633: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:24:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:31 smithi012 ceph-mon[128787]: pgmap v633: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:24:31.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:31 smithi032 ceph-mon[132488]: pgmap v633: 97 pgs: 97 active+clean; 6.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:24:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 -- 172.21.15.12:0/2042364751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c104870 msgr2=0x7f223c106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 --2- 172.21.15.12:0/2042364751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c104870 0x7f223c106c60 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2228009990 tx=0x7f2228009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 -- 172.21.15.12:0/2042364751 shutdown_connections 2023-12-11T20:24:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 --2- 172.21.15.12:0/2042364751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f223c101f40 0x7f223c104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 --2- 172.21.15.12:0/2042364751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c1071a0 0x7f223c109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 --2- 172.21.15.12:0/2042364751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c104870 0x7f223c106c60 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 -- 172.21.15.12:0/2042364751 >> 172.21.15.12:0/2042364751 conn(0x7f223c0fb930 msgr2=0x7f223c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 -- 172.21.15.12:0/2042364751 shutdown_connections 2023-12-11T20:24:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.459+0000 7f2242bff700 1 -- 172.21.15.12:0/2042364751 wait complete. 2023-12-11T20:24:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.460+0000 7f2242bff700 1 Processor -- start 2023-12-11T20:24:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.460+0000 7f2242bff700 1 -- start start 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f2242bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f223c101f40 0x7f223c101860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f2242bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c104870 0x7f223c0ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f2242bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1071a0 0x7f223c100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f2242bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c100bd0 con 0x7f223c1071a0 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f2242bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c100d40 con 0x7f223c101f40 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f2242bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c1a1390 con 0x7f223c104870 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f224119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1071a0 0x7f223c100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f223bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c104870 0x7f223c0ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f224119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1071a0 0x7f223c100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57814/0 (socket says 172.21.15.12:57814) 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f223bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c104870 0x7f223c0ffef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:42606/0 (socket says 172.21.15.12:42606) 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f224119c700 1 -- 172.21.15.12:0/350212910 learned_addr learned my addr 172.21.15.12:0/350212910 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f224099b700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f223c101f40 0x7f223c101860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f224119c700 1 -- 172.21.15.12:0/350212910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c104870 msgr2=0x7f223c0ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f224119c700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c104870 0x7f223c0ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f224119c700 1 -- 172.21.15.12:0/350212910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f223c101f40 msgr2=0x7f223c101860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.461+0000 7f224119c700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f223c101f40 0x7f223c101860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f224119c700 1 -- 172.21.15.12:0/350212910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280095f0 con 0x7f223c1071a0 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f223bfff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c104870 0x7f223c0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f224099b700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f223c101f40 0x7f223c101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f224119c700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1071a0 0x7f223c100430 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2234007ee0 tx=0x7f223400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f2239ffb700 1 -- 172.21.15.12:0/350212910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234017070 con 0x7f223c1071a0 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f2242bff700 1 -- 172.21.15.12:0/350212910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c1a1620 con 0x7f223c1071a0 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f2239ffb700 1 -- 172.21.15.12:0/350212910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f223400f040 con 0x7f223c1071a0 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f2239ffb700 1 -- 172.21.15.12:0/350212910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234005570 con 0x7f223c1071a0 2023-12-11T20:24:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.462+0000 7f2242bff700 1 -- 172.21.15.12:0/350212910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c1a1b30 con 0x7f223c1071a0 2023-12-11T20:24:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.466+0000 7f2239ffb700 1 -- 172.21.15.12:0/350212910 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f223400db70 con 0x7f223c1071a0 2023-12-11T20:24:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.467+0000 7f225641fb80 1 Processor -- start 2023-12-11T20:24:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f225641fb80 1 -- start start 2023-12-11T20:24:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f2239ffb700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f222c0a1470 0x7f222c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f225641fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4bed0 0x55a793e4c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f225641fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4c830 0x55a793e4d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f2239ffb700 1 -- 172.21.15.12:0/350212910 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f22340cc530 con 0x7f223c1071a0 2023-12-11T20:24:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f225641fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e4dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f225641fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793da7af0 con 0x55a793e4bed0 2023-12-11T20:24:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f225641fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793da5410 con 0x55a793e4c830 2023-12-11T20:24:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f225641fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793da0d00 con 0x55a793e4d720 2023-12-11T20:24:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.468+0000 7f223bfff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f222c0a1470 0x7f222c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4bed0 0x55a793e4c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4bed0 0x55a793e4c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57816/0 (socket says 172.21.15.12:57816) 2023-12-11T20:24:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 -- 172.21.15.12:0/3510369870 learned_addr learned my addr 172.21.15.12:0/3510369870 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f223bfff700 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4c830 0x55a793e4d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224119c700 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e4dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 -- 172.21.15.12:0/3510369870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 msgr2=0x55a793e4dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e4dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 -- 172.21.15.12:0/3510369870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4c830 msgr2=0x55a793e4d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4c830 0x55a793e4d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 -- 172.21.15.12:0/3510369870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a793c1d5d0 con 0x55a793e4bed0 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f223bfff700 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4c830 0x55a793e4d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f223bfff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f222c0a1470 0x7f222c0a3930 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2228003780 tx=0x7f2228005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.469+0000 7f224099b700 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4bed0 0x55a793e4c2f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f223000bd90 tx=0x7f223000f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16f8af23e5ab2bc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.470+0000 7f2226ffd700 1 -- 172.21.15.12:0/3510369870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000fe50 con 0x55a793e4bed0 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.470+0000 7f2226ffd700 1 -- 172.21.15.12:0/3510369870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22300118d0 con 0x55a793e4bed0 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.470+0000 7f2226ffd700 1 -- 172.21.15.12:0/3510369870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230010680 con 0x55a793e4bed0 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.470+0000 7f225641fb80 1 -- 172.21.15.12:0/3510369870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4bed0 msgr2=0x55a793e4c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.470+0000 7f225641fb80 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4bed0 0x55a793e4c2f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f223000bd90 tx=0x7f223000f640 comp rx=0 tx=0).stop 2023-12-11T20:24:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.471+0000 7f225641fb80 1 -- 172.21.15.12:0/3510369870 shutdown_connections 2023-12-11T20:24:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.471+0000 7f225641fb80 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e4dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.471+0000 7f225641fb80 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4bed0 0x55a793e4c2f0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.471+0000 7f225641fb80 1 --2- 172.21.15.12:0/3510369870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4c830 0x55a793e4d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.471+0000 7f225641fb80 1 -- 172.21.15.12:0/3510369870 >> 172.21.15.12:0/3510369870 conn(0x55a793d7b780 msgr2=0x55a793e48880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.471+0000 7f225641fb80 1 -- 172.21.15.12:0/3510369870 shutdown_connections 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.471+0000 7f225641fb80 1 -- 172.21.15.12:0/3510369870 wait complete. 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.471+0000 7f225641fb80 1 -- start start 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f225641fb80 1 Processor -- start 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f225641fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e55eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f225641fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f225641fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f225641fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793d5a500 con 0x55a793e4c830 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f225641fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793d5a1a0 con 0x55a793e4bed0 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f225641fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793c1f8c0 con 0x55a793e4d720 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f225641fb80 10 client.0 _ll_register_callbacks cb 0x55a793c85a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f223bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f224119c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f223bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57832/0 (socket says 172.21.15.12:57832) 2023-12-11T20:24:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.472+0000 7f223bfff700 1 -- 172.21.15.12:0/716031957 learned_addr learned my addr 172.21.15.12:0/716031957 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f224099b700 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e55eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f224119c700 1 -- 172.21.15.12:0/716031957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 msgr2=0x55a793e55eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f224119c700 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e55eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f224119c700 1 -- 172.21.15.12:0/716031957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 msgr2=0x55a793e563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f224119c700 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f224119c700 1 -- 172.21.15.12:0/716031957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223000b9c0 con 0x55a793e4d720 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f223bfff700 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f224119c700 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5d220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2234009510 tx=0x7f22340991e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30be5a2eff2cd3e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f221bfff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.473+0000 7f221bfff700 1 -- 172.21.15.12:0/716031957 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234099f00 con 0x55a793e4d720 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.474+0000 7f221bfff700 1 -- 172.21.15.12:0/716031957 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2234099800 con 0x55a793e4d720 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.474+0000 7f225641fb80 1 -- 172.21.15.12:0/716031957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a793e3f730 con 0x55a793e4d720 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.474+0000 7f221bfff700 1 -- 172.21.15.12:0/716031957 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f223409d950 con 0x55a793e4d720 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.474+0000 7f225641fb80 10 client.27547 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.474+0000 7f225641fb80 1 -- 172.21.15.12:0/716031957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a793bc9d80 con 0x55a793e4d720 2023-12-11T20:24:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.474+0000 7f221bfff700 1 -- 172.21.15.12:0/716031957 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a793e3f730 con 0x55a793e4d720 2023-12-11T20:24:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.474+0000 7f221bfff700 1 -- 172.21.15.12:0/716031957 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2234098cf0 con 0x55a793e4d720 2023-12-11T20:24:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.475+0000 7f225641fb80 10 client.27547 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.475+0000 7f225641fb80 10 client.27547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.475+0000 7f225641fb80 20 client.27547 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.475+0000 7f225641fb80 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a793e61cb0 0x55a793e640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.475+0000 7f225641fb80 4 client.27547 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.475+0000 7f225641fb80 1 -- 172.21.15.12:0/716031957 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a793e1bee0 con 0x55a793e61cb0 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.475+0000 7f224099b700 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a793e61cb0 0x55a793e640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.476+0000 7f224099b700 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a793e61cb0 0x55a793e640d0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7834559786ef07d6 server_cookie=5efda8cfc2b6a429 in_seq=0 out_seq=0 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.476+0000 7f221bfff700 10 client.27547 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.476+0000 7f221bfff700 1 -- 172.21.15.12:0/716031957 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a793e1bee0 con 0x55a793e61cb0 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.476+0000 7f221bfff700 10 client.27547 handle_command_reply: tid=0 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 client.27547 shutdown 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 -- 172.21.15.12:0/716031957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 msgr2=0x55a793e5d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5d220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2234009510 tx=0x7f22340991e0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 -- 172.21.15.12:0/716031957 shutdown_connections 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a793e61cb0 0x55a793e640d0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e55eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f221bfff700 0 client.27547 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5d220 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 --2- 172.21.15.12:0/716031957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 -- 172.21.15.12:0/716031957 >> 172.21.15.12:0/716031957 conn(0x55a793d7b780 msgr2=0x55a793e46ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 -- 172.21.15.12:0/716031957 shutdown_connections 2023-12-11T20:24:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 1 -- 172.21.15.12:0/716031957 wait complete. 2023-12-11T20:24:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.477+0000 7f225641fb80 20 client.27547 trim_cache size 0 max 16384 2023-12-11T20:24:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.493+0000 7f225641fb80 1 Processor -- start 2023-12-11T20:24:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.493+0000 7f225641fb80 1 -- start start 2023-12-11T20:24:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.493+0000 7f225641fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.493+0000 7f225641fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.493+0000 7f225641fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.493+0000 7f225641fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793e43900 con 0x55a793e4c830 2023-12-11T20:24:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.493+0000 7f225641fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793e4baa0 con 0x55a793e4bed0 2023-12-11T20:24:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.493+0000 7f225641fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793e53910 con 0x55a793e4d720 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f223bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f223bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57846/0 (socket says 172.21.15.12:57846) 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f223bfff700 1 -- 172.21.15.12:0/80086645 learned_addr learned my addr 172.21.15.12:0/80086645 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f224119c700 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f224099b700 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f223bfff700 1 -- 172.21.15.12:0/80086645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 msgr2=0x55a793e551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f223bfff700 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f223bfff700 1 -- 172.21.15.12:0/80086645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 msgr2=0x55a793e5db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f223bfff700 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f223bfff700 1 -- 172.21.15.12:0/80086645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a793bb2c00 con 0x55a793e4c830 2023-12-11T20:24:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.494+0000 7f224119c700 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.495+0000 7f223bfff700 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5d1e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f2228005260 tx=0x7f2228022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fe0d749c564fa3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.495+0000 7f22277fe700 1 -- 172.21.15.12:0/80086645 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222801d030 con 0x55a793e4c830 2023-12-11T20:24:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.495+0000 7f22277fe700 1 -- 172.21.15.12:0/80086645 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2228004b10 con 0x55a793e4c830 2023-12-11T20:24:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.495+0000 7f22277fe700 1 -- 172.21.15.12:0/80086645 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228003e40 con 0x55a793e4c830 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 -- 172.21.15.12:0/80086645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 msgr2=0x55a793e5d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5d1e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f2228005260 tx=0x7f2228022000 comp rx=0 tx=0).stop 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 -- 172.21.15.12:0/80086645 shutdown_connections 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 --2- 172.21.15.12:0/80086645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5d1e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 -- 172.21.15.12:0/80086645 >> 172.21.15.12:0/80086645 conn(0x55a793d7b780 msgr2=0x55a793e53c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 -- 172.21.15.12:0/80086645 shutdown_connections 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 -- 172.21.15.12:0/80086645 wait complete. 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.496+0000 7f225641fb80 1 -- start start 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f225641fb80 1 Processor -- start 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f225641fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f225641fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f225641fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f225641fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793e5c3e0 con 0x55a793e4c830 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f225641fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793e5c550 con 0x55a793e4bed0 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f225641fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a793e5c710 con 0x55a793e4d720 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f225641fb80 10 client.0 _ll_register_callbacks cb 0x55a793c85a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f223bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f224099b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f224099b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40068/0 (socket says 172.21.15.12:40068) 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.497+0000 7f224099b700 1 -- 172.21.15.12:0/2954669196 learned_addr learned my addr 172.21.15.12:0/2954669196 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.498+0000 7f224119c700 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.498+0000 7f224099b700 1 -- 172.21.15.12:0/2954669196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 msgr2=0x55a793e5bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.498+0000 7f224099b700 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.498+0000 7f224099b700 1 -- 172.21.15.12:0/2954669196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 msgr2=0x55a793e5aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.498+0000 7f224099b700 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.498+0000 7f224099b700 1 -- 172.21.15.12:0/2954669196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a793bc9d80 con 0x55a793e4bed0 2023-12-11T20:24:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.498+0000 7f224099b700 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5a9a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2230005950 tx=0x7f223000b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753b847d58024546 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.498+0000 7f221bfff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:24:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.499+0000 7f221bfff700 1 -- 172.21.15.12:0/2954669196 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230020040 con 0x55a793e4bed0 2023-12-11T20:24:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.499+0000 7f225641fb80 1 -- 172.21.15.12:0/2954669196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22300118d0 con 0x55a793e4bed0 2023-12-11T20:24:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.499+0000 7f221bfff700 1 -- 172.21.15.12:0/2954669196 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2230011a40 con 0x55a793e4bed0 2023-12-11T20:24:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.499+0000 7f221bfff700 1 -- 172.21.15.12:0/2954669196 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2230011c00 con 0x55a793e4bed0 2023-12-11T20:24:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.499+0000 7f225641fb80 10 client.27563 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.499+0000 7f225641fb80 1 -- 172.21.15.12:0/2954669196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f2228020040 con 0x55a793e4bed0 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f221bfff700 1 -- 172.21.15.12:0/2954669196 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22300118d0 con 0x55a793e4bed0 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f221bfff700 1 -- 172.21.15.12:0/2954669196 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2230005240 con 0x55a793e4bed0 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f225641fb80 10 client.27563 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f225641fb80 10 client.27563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f225641fb80 20 client.27563 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f225641fb80 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a793eb8ba0 0x55a793ebafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f225641fb80 4 client.27563 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f225641fb80 1 -- 172.21.15.12:0/2954669196 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a793d66f70 con 0x55a793eb8ba0 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.500+0000 7f223bfff700 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a793eb8ba0 0x55a793ebafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.501+0000 7f221bfff700 10 client.27563 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.501+0000 7f223bfff700 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a793eb8ba0 0x55a793ebafc0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24ad2a9fb6de9986 server_cookie=e855bf8609ceaf30 in_seq=0 out_seq=0 2023-12-11T20:24:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.511+0000 7f221bfff700 1 -- 172.21.15.12:0/2954669196 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a793d66f70 con 0x55a793eb8ba0 2023-12-11T20:24:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.511+0000 7f221bfff700 10 client.27563 handle_command_reply: tid=0 2023-12-11T20:24:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 client.27563 shutdown 2023-12-11T20:24:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 -- 172.21.15.12:0/2954669196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 msgr2=0x55a793e5a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5a9a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2230005950 tx=0x7f223000b710 comp rx=0 tx=0).stop 2023-12-11T20:24:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 -- 172.21.15.12:0/2954669196 shutdown_connections 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a793eb8ba0 0x55a793ebafc0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a793e4bed0 0x55a793e5a9a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a793e4d720 0x55a793e5bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f221bfff700 0 client.27563 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 --2- 172.21.15.12:0/2954669196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a793e4c830 0x55a793e5aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 -- 172.21.15.12:0/2954669196 >> 172.21.15.12:0/2954669196 conn(0x55a793d7b780 msgr2=0x55a793e50940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 -- 172.21.15.12:0/2954669196 shutdown_connections 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 1 -- 172.21.15.12:0/2954669196 wait complete. 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.512+0000 7f225641fb80 20 client.27563 trim_cache size 0 max 16384 2023-12-11T20:24:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:24:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:24:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:24:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:24:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 -- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f222c0a1470 msgr2=0x7f222c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f222c0a1470 0x7f222c0a3930 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2228003780 tx=0x7f2228005ec0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 -- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1071a0 msgr2=0x7f223c100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1071a0 0x7f223c100430 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2234007ee0 tx=0x7f223400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 -- 172.21.15.12:0/350212910 shutdown_connections 2023-12-11T20:24:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f222c0a1470 0x7f222c0a3930 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f223c101f40 0x7f223c101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1071a0 0x7f223c100430 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 --2- 172.21.15.12:0/350212910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f223c104870 0x7f223c0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 -- 172.21.15.12:0/350212910 >> 172.21.15.12:0/350212910 conn(0x7f223c0fb930 msgr2=0x7f223c103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 -- 172.21.15.12:0/350212910 shutdown_connections 2023-12-11T20:24:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:33.513+0000 7f2242bff700 1 -- 172.21.15.12:0/350212910 wait complete. 2023-12-11T20:24:33.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:33 smithi039 ceph-mon[102205]: pgmap v634: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:24:33.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:33 smithi012 ceph-mon[128787]: pgmap v634: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:24:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:33 smithi032 ceph-mon[132488]: pgmap v634: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:24:35.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:35 smithi039 ceph-mon[102205]: pgmap v635: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:35 smithi012 ceph-mon[128787]: pgmap v635: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:35.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:35 smithi032 ceph-mon[132488]: pgmap v635: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:36.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 -- 172.21.15.12:0/2521757697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008107030 msgr2=0x7f8008109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 --2- 172.21.15.12:0/2521757697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008107030 0x7f8008109440 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f800000b0a0 tx=0x7f800000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 -- 172.21.15.12:0/2521757697 shutdown_connections 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 --2- 172.21.15.12:0/2521757697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008107030 0x7f8008109440 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 --2- 172.21.15.12:0/2521757697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8008101dd0 0x7f80081041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 --2- 172.21.15.12:0/2521757697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8008104700 0x7f8008106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 -- 172.21.15.12:0/2521757697 >> 172.21.15.12:0/2521757697 conn(0x7f80080fb740 msgr2=0x7f80080fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 -- 172.21.15.12:0/2521757697 shutdown_connections 2023-12-11T20:24:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.472+0000 7f800759e700 1 -- 172.21.15.12:0/2521757697 wait complete. 2023-12-11T20:24:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.474+0000 7f800759e700 1 Processor -- start 2023-12-11T20:24:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.474+0000 7f800759e700 1 -- start start 2023-12-11T20:24:36.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f800759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8008101dd0 0x7f80081016a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f800759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008104700 0x7f80080ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f800759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8008107030 0x7f80081002c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f800759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80081009c0 con 0x7f8008104700 2023-12-11T20:24:36.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f800759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008100b30 con 0x7f8008101dd0 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f800759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80081a11f0 con 0x7f8008107030 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8005d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008104700 0x7f80080ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8005d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008104700 0x7f80080ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57870/0 (socket says 172.21.15.12:57870) 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8005d9b700 1 -- 172.21.15.12:0/3400404538 learned_addr learned my addr 172.21.15.12:0/3400404538 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f800659c700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8008101dd0 0x7f80081016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8006d9d700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8008107030 0x7f80081002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8005d9b700 1 -- 172.21.15.12:0/3400404538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8008107030 msgr2=0x7f80081002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8005d9b700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8008107030 0x7f80081002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8005d9b700 1 -- 172.21.15.12:0/3400404538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8008101dd0 msgr2=0x7f80081016a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8005d9b700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8008101dd0 0x7f80081016a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.475+0000 7f8005d9b700 1 -- 172.21.15.12:0/3400404538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000009d00 con 0x7f8008104700 2023-12-11T20:24:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.476+0000 7f8005d9b700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008104700 0x7f80080ffd80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00d950 tx=0x7f7ffc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.476+0000 7f7ff77fe700 1 -- 172.21.15.12:0/3400404538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00f890 con 0x7f8008104700 2023-12-11T20:24:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.476+0000 7f7ff77fe700 1 -- 172.21.15.12:0/3400404538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ffc00fe80 con 0x7f8008104700 2023-12-11T20:24:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.476+0000 7f800759e700 1 -- 172.21.15.12:0/3400404538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80081a1450 con 0x7f8008104700 2023-12-11T20:24:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.476+0000 7f7ff77fe700 1 -- 172.21.15.12:0/3400404538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00e3b0 con 0x7f8008104700 2023-12-11T20:24:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.476+0000 7f800759e700 1 -- 172.21.15.12:0/3400404538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80081a19b0 con 0x7f8008104700 2023-12-11T20:24:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.480+0000 7f7ff77fe700 1 -- 172.21.15.12:0/3400404538 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7ffc010460 con 0x7f8008104700 2023-12-11T20:24:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.481+0000 7f8020748b80 1 Processor -- start 2023-12-11T20:24:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f7ff77fe700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff00a15a0 0x7f7ff00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f8020748b80 1 -- start start 2023-12-11T20:24:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f7ff77fe700 1 -- 172.21.15.12:0/3400404538 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ffc0ccaf0 con 0x7f8008104700 2023-12-11T20:24:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f8006d9d700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff00a15a0 0x7f7ff00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f8020748b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a0fa60 0x559e12a0fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f8020748b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a103c0 0x559e12a108a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f8020748b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a10de0 0x559e12a11240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f8020748b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1296ab50 con 0x559e12a10de0 2023-12-11T20:24:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f8020748b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e12968470 con 0x559e12a0fa60 2023-12-11T20:24:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.482+0000 7f8020748b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e12963d60 con 0x559e12a103c0 2023-12-11T20:24:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a0fa60 0x559e12a0fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a0fa60 0x559e12a0fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40088/0 (socket says 172.21.15.12:40088) 2023-12-11T20:24:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 -- 172.21.15.12:0/4102421282 learned_addr learned my addr 172.21.15.12:0/4102421282 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f8006d9d700 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a10de0 0x559e12a11240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f8005d9b700 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a103c0 0x559e12a108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f8006d9d700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff00a15a0 0x7f7ff00a3a60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f80000079c0 tx=0x7f8000009520 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 -- 172.21.15.12:0/4102421282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a103c0 msgr2=0x559e12a108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a103c0 0x559e12a108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 -- 172.21.15.12:0/4102421282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a10de0 msgr2=0x559e12a11240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a10de0 0x559e12a11240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 -- 172.21.15.12:0/4102421282 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e127e0630 con 0x559e12a0fa60 2023-12-11T20:24:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.483+0000 7f800659c700 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a0fa60 0x559e12a0fe80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009d80 tx=0x7f7ff8011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec642e8f98f52d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.484+0000 7f7ff4ff9700 1 -- 172.21.15.12:0/4102421282 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8004230 con 0x559e12a0fa60 2023-12-11T20:24:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.484+0000 7f7ff4ff9700 1 -- 172.21.15.12:0/4102421282 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ff8004390 con 0x559e12a0fa60 2023-12-11T20:24:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.484+0000 7f7ff4ff9700 1 -- 172.21.15.12:0/4102421282 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff80197e0 con 0x559e12a0fa60 2023-12-11T20:24:36.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 -- 172.21.15.12:0/4102421282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a0fa60 msgr2=0x559e12a0fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a0fa60 0x559e12a0fe80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009d80 tx=0x7f7ff8011720 comp rx=0 tx=0).stop 2023-12-11T20:24:36.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 -- 172.21.15.12:0/4102421282 shutdown_connections 2023-12-11T20:24:36.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a0fa60 0x559e12a0fe80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a10de0 0x559e12a11240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 --2- 172.21.15.12:0/4102421282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a103c0 0x559e12a108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 -- 172.21.15.12:0/4102421282 >> 172.21.15.12:0/4102421282 conn(0x559e1293e7e0 msgr2=0x559e12a0a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 -- 172.21.15.12:0/4102421282 shutdown_connections 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 -- 172.21.15.12:0/4102421282 wait complete. 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.485+0000 7f8020748b80 1 -- start start 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.486+0000 7f8020748b80 1 Processor -- start 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.486+0000 7f8020748b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a19300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.486+0000 7f8020748b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a19840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.486+0000 7f8020748b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a20880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.486+0000 7f8020748b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1291d560 con 0x559e12a0fa60 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.486+0000 7f8020748b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1291d200 con 0x559e12a103c0 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.486+0000 7f8020748b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e127e2920 con 0x559e12a10de0 2023-12-11T20:24:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.486+0000 7f8020748b80 10 client.0 _ll_register_callbacks cb 0x559e12848a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f800659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a19300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f800659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a19300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57886/0 (socket says 172.21.15.12:57886) 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f800659c700 1 -- 172.21.15.12:0/2788626285 learned_addr learned my addr 172.21.15.12:0/2788626285 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f8006d9d700 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a20880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f8005d9b700 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a19840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f800659c700 1 -- 172.21.15.12:0/2788626285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 msgr2=0x559e12a20880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f800659c700 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a20880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f800659c700 1 -- 172.21.15.12:0/2788626285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 msgr2=0x559e12a19840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f800659c700 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a19840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.487+0000 7f800659c700 1 -- 172.21.15.12:0/2788626285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff80099e0 con 0x559e12a0fa60 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f800659c700 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a19300 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000c00 tx=0x7f7ff8003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b4d5cd9bb0488b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f7fedffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f7fedffb700 1 -- 172.21.15.12:0/2788626285 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8005450 con 0x559e12a0fa60 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f7fedffb700 1 -- 172.21.15.12:0/2788626285 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ff8004500 con 0x559e12a0fa60 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f8020748b80 1 -- 172.21.15.12:0/2788626285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e12a029e0 con 0x559e12a0fa60 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f7fedffb700 1 -- 172.21.15.12:0/2788626285 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ff8003bd0 con 0x559e12a0fa60 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f8020748b80 10 client.17925 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f8020748b80 1 -- 172.21.15.12:0/2788626285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559e1278cde0 con 0x559e12a0fa60 2023-12-11T20:24:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.488+0000 7f7fedffb700 1 -- 172.21.15.12:0/2788626285 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559e12a029e0 con 0x559e12a0fa60 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.489+0000 7f7fedffb700 1 -- 172.21.15.12:0/2788626285 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7ff8021040 con 0x559e12a0fa60 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.489+0000 7f8020748b80 10 client.17925 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.489+0000 7f8020748b80 10 client.17925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.489+0000 7f8020748b80 20 client.17925 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.489+0000 7f8020748b80 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559e12a24ff0 0x559e12a27410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.489+0000 7f8020748b80 4 client.17925 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.489+0000 7f8020748b80 1 -- 172.21.15.12:0/2788626285 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e129def40 con 0x559e12a24ff0 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.489+0000 7f8005d9b700 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559e12a24ff0 0x559e12a27410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.490+0000 7f8005d9b700 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559e12a24ff0 0x559e12a27410 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=374db9cb428b935a server_cookie=b9a74b38c5dcb51a in_seq=0 out_seq=0 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.490+0000 7f7fedffb700 10 client.17925 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f7fedffb700 1 -- 172.21.15.12:0/2788626285 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559e129def40 con 0x559e12a24ff0 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f7fedffb700 10 client.17925 handle_command_reply: tid=0 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 client.17925 shutdown 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 -- 172.21.15.12:0/2788626285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 msgr2=0x559e12a19300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a19300 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000c00 tx=0x7f7ff8003930 comp rx=0 tx=0).stop 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 -- 172.21.15.12:0/2788626285 shutdown_connections 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559e12a24ff0 0x559e12a27410 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a20880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a19300 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 --2- 172.21.15.12:0/2788626285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a19840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f7fedffb700 0 client.17925 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 -- 172.21.15.12:0/2788626285 >> 172.21.15.12:0/2788626285 conn(0x559e1293e7e0 msgr2=0x559e12a0e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 -- 172.21.15.12:0/2788626285 shutdown_connections 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.491+0000 7f8020748b80 1 -- 172.21.15.12:0/2788626285 wait complete. 2023-12-11T20:24:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.492+0000 7f8020748b80 20 client.17925 trim_cache size 0 max 16384 2023-12-11T20:24:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f8020748b80 1 Processor -- start 2023-12-11T20:24:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f8020748b80 1 -- start start 2023-12-11T20:24:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f8020748b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a0fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f8020748b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a20840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f8020748b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a111c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f8020748b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e12a277a0 con 0x559e12a0fa60 2023-12-11T20:24:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f8020748b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e12a11700 con 0x559e12a103c0 2023-12-11T20:24:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f8020748b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e12a09ec0 con 0x559e12a10de0 2023-12-11T20:24:36.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.513+0000 7f800659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a0fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f800659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a0fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57902/0 (socket says 172.21.15.12:57902) 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f800659c700 1 -- 172.21.15.12:0/2239614804 learned_addr learned my addr 172.21.15.12:0/2239614804 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f8005d9b700 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a20840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f8006d9d700 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f800659c700 1 -- 172.21.15.12:0/2239614804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 msgr2=0x559e12a111c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f800659c700 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a111c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f800659c700 1 -- 172.21.15.12:0/2239614804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 msgr2=0x559e12a20840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f800659c700 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a20840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f800659c700 1 -- 172.21.15.12:0/2239614804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e12775c60 con 0x559e12a0fa60 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f800659c700 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a0fe40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8003f80 tx=0x7f7ff80194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f17a1a0948c8a46 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f7ff57fa700 1 -- 172.21.15.12:0/2239614804 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8005c20 con 0x559e12a0fa60 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.514+0000 7f7ff57fa700 1 -- 172.21.15.12:0/2239614804 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ff8019e60 con 0x559e12a0fa60 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f7ff57fa700 1 -- 172.21.15.12:0/2239614804 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8005740 con 0x559e12a0fa60 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f8020748b80 1 -- 172.21.15.12:0/2239614804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 msgr2=0x559e12a0fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f8020748b80 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a0fe40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8003f80 tx=0x7f7ff80194a0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f8020748b80 1 -- 172.21.15.12:0/2239614804 shutdown_connections 2023-12-11T20:24:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f8020748b80 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f8020748b80 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a0fe40 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f8020748b80 1 --2- 172.21.15.12:0/2239614804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a20840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f8020748b80 1 -- 172.21.15.12:0/2239614804 >> 172.21.15.12:0/2239614804 conn(0x559e1293e7e0 msgr2=0x559e12a0a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.515+0000 7f8020748b80 1 -- 172.21.15.12:0/2239614804 shutdown_connections 2023-12-11T20:24:36.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.516+0000 7f8020748b80 1 -- 172.21.15.12:0/2239614804 wait complete. 2023-12-11T20:24:36.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.516+0000 7f8020748b80 1 -- start start 2023-12-11T20:24:36.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.516+0000 7f8020748b80 1 Processor -- start 2023-12-11T20:24:36.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8020748b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8020748b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a77a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8020748b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a79f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8020748b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e12a7a4c0 con 0x559e12a0fa60 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8020748b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e12a7a630 con 0x559e12a103c0 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8020748b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e12a7a7f0 con 0x559e12a10de0 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8020748b80 10 client.0 _ll_register_callbacks cb 0x559e12848a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8005d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a77a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8005d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a77a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40114/0 (socket says 172.21.15.12:40114) 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8005d9b700 1 -- 172.21.15.12:0/2652370717 learned_addr learned my addr 172.21.15.12:0/2652370717 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f800659c700 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8006d9d700 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a79f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8005d9b700 1 -- 172.21.15.12:0/2652370717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 msgr2=0x559e12a79f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8005d9b700 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a79f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8005d9b700 1 -- 172.21.15.12:0/2652370717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 msgr2=0x559e12a754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8005d9b700 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.517+0000 7f8005d9b700 1 -- 172.21.15.12:0/2652370717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e1278cde0 con 0x559e12a103c0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.518+0000 7f8005d9b700 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a77a00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc099ca0 tx=0x7f7ffc0961d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f422f6cdf66a8e1b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.518+0000 7f7fedffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.518+0000 7f7fedffb700 1 -- 172.21.15.12:0/2652370717 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0a20f0 con 0x559e12a103c0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.518+0000 7f7fedffb700 1 -- 172.21.15.12:0/2652370717 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ffc099250 con 0x559e12a103c0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.518+0000 7f8020748b80 1 -- 172.21.15.12:0/2652370717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e12a05260 con 0x559e12a103c0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.518+0000 7f7fedffb700 1 -- 172.21.15.12:0/2652370717 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ffc099410 con 0x559e12a103c0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.518+0000 7f8020748b80 10 client.27581 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.518+0000 7f8020748b80 1 -- 172.21.15.12:0/2652370717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559e127b3250 con 0x559e12a103c0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f7fedffb700 1 -- 172.21.15.12:0/2652370717 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559e12a05260 con 0x559e12a103c0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f7fedffb700 1 -- 172.21.15.12:0/2652370717 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7ffc0adb40 con 0x559e12a103c0 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f8020748b80 10 client.27581 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f8020748b80 10 client.27581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:36.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f8020748b80 20 client.27581 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f8020748b80 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559e12a7c2a0 0x559e12a7e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f8020748b80 4 client.27581 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f8020748b80 1 -- 172.21.15.12:0/2652370717 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f7ff8004390 con 0x559e12a7c2a0 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.519+0000 7f800659c700 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559e12a7c2a0 0x559e12a7e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f7fedffb700 10 client.27581 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f800659c700 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559e12a7c2a0 0x559e12a7e6c0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94cd0de3f1641415 server_cookie=9b52cc22c46755fc in_seq=0 out_seq=0 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f7fedffb700 1 -- 172.21.15.12:0/2652370717 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f7ff8004390 con 0x559e12a7c2a0 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f7fedffb700 10 client.27581 handle_command_reply: tid=0 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 client.27581 shutdown 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 -- 172.21.15.12:0/2652370717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 msgr2=0x559e12a77a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a77a00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc099ca0 tx=0x7f7ffc0961d0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 -- 172.21.15.12:0/2652370717 shutdown_connections 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559e12a7c2a0 0x559e12a7e6c0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559e12a10de0 0x559e12a79f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e12a0fa60 0x559e12a754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 --2- 172.21.15.12:0/2652370717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559e12a103c0 0x559e12a77a00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f7fedffb700 0 client.27581 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.520+0000 7f8020748b80 1 -- 172.21.15.12:0/2652370717 >> 172.21.15.12:0/2652370717 conn(0x559e1293e7e0 msgr2=0x559e12a18850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.521+0000 7f8020748b80 1 -- 172.21.15.12:0/2652370717 shutdown_connections 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.521+0000 7f8020748b80 1 -- 172.21.15.12:0/2652370717 wait complete. 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.521+0000 7f8020748b80 20 client.27581 trim_cache size 0 max 16384 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:24:36.524 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:24:36.525 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:24:36.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.521+0000 7f800759e700 1 -- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff00a15a0 msgr2=0x7f7ff00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.521+0000 7f800759e700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff00a15a0 0x7f7ff00a3a60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f80000079c0 tx=0x7f8000009520 comp rx=0 tx=0).stop 2023-12-11T20:24:36.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.521+0000 7f800759e700 1 -- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008104700 msgr2=0x7f80080ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.521+0000 7f800759e700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008104700 0x7f80080ffd80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00d950 tx=0x7f7ffc00dc60 comp rx=0 tx=0).stop 2023-12-11T20:24:36.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.522+0000 7f800759e700 1 -- 172.21.15.12:0/3400404538 shutdown_connections 2023-12-11T20:24:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.522+0000 7f800759e700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff00a15a0 0x7f7ff00a3a60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.522+0000 7f800759e700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8008101dd0 0x7f80081016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.522+0000 7f800759e700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8008107030 0x7f80081002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.522+0000 7f800759e700 1 --2- 172.21.15.12:0/3400404538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8008104700 0x7f80080ffd80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.522+0000 7f800759e700 1 -- 172.21.15.12:0/3400404538 >> 172.21.15.12:0/3400404538 conn(0x7f80080fb740 msgr2=0x7f8008102710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.522+0000 7f800759e700 1 -- 172.21.15.12:0/3400404538 shutdown_connections 2023-12-11T20:24:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.522+0000 7f800759e700 1 -- 172.21.15.12:0/3400404538 wait complete. 2023-12-11T20:24:36.543 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:24:36.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:24:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 -- 172.21.15.12:0/2049348008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c100760 msgr2=0x7faf2c100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 --2- 172.21.15.12:0/2049348008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c100760 0x7faf2c100be0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7faf20009990 tx=0x7faf20009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 -- 172.21.15.12:0/2049348008 shutdown_connections 2023-12-11T20:24:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 --2- 172.21.15.12:0/2049348008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf2c101120 0x7faf2c1015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 --2- 172.21.15.12:0/2049348008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf2c0ffe00 0x7faf2c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 --2- 172.21.15.12:0/2049348008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c100760 0x7faf2c100be0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 -- 172.21.15.12:0/2049348008 >> 172.21.15.12:0/2049348008 conn(0x7faf2c0fb980 msgr2=0x7faf2c0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 -- 172.21.15.12:0/2049348008 shutdown_connections 2023-12-11T20:24:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.775+0000 7faf327ff700 1 -- 172.21.15.12:0/2049348008 wait complete. 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.776+0000 7faf327ff700 1 Processor -- start 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.776+0000 7faf327ff700 1 -- start start 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf327ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c0ffe00 0x7faf2c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf327ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf2c100760 0x7faf2c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf327ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf2c101120 0x7faf2c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf327ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c1a10c0 con 0x7faf2c0ffe00 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf327ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c1a1200 con 0x7faf2c100760 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf327ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c1a1390 con 0x7faf2c101120 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c0ffe00 0x7faf2c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf2b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf2c100760 0x7faf2c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c0ffe00 0x7faf2c199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57922/0 (socket says 172.21.15.12:57922) 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf2bfff700 1 -- 172.21.15.12:0/1305183797 learned_addr learned my addr 172.21.15.12:0/1305183797 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.777+0000 7faf30d9c700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf2c101120 0x7faf2c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf2bfff700 1 -- 172.21.15.12:0/1305183797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf2c101120 msgr2=0x7faf2c1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf2bfff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf2c101120 0x7faf2c1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf2bfff700 1 -- 172.21.15.12:0/1305183797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf2c100760 msgr2=0x7faf2c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf2bfff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf2c100760 0x7faf2c199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf2bfff700 1 -- 172.21.15.12:0/1305183797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200095f0 con 0x7faf2c0ffe00 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf2b7fe700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf2c100760 0x7faf2c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf2bfff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c0ffe00 0x7faf2c199590 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00d980 tx=0x7faf1c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf297fa700 1 -- 172.21.15.12:0/1305183797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c004220 con 0x7faf2c0ffe00 2023-12-11T20:24:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf297fa700 1 -- 172.21.15.12:0/1305183797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf1c007640 con 0x7faf2c0ffe00 2023-12-11T20:24:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c1a1670 con 0x7faf2c0ffe00 2023-12-11T20:24:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf297fa700 1 -- 172.21.15.12:0/1305183797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c005660 con 0x7faf2c0ffe00 2023-12-11T20:24:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.778+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c1a1bd0 con 0x7faf2c0ffe00 2023-12-11T20:24:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.780+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c10abe0 con 0x7faf2c0ffe00 2023-12-11T20:24:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.782+0000 7faf297fa700 1 -- 172.21.15.12:0/1305183797 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7faf1c004750 con 0x7faf2c0ffe00 2023-12-11T20:24:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.784+0000 7faf297fa700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf140a1500 0x7faf140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.784+0000 7faf297fa700 1 -- 172.21.15.12:0/1305183797 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faf1c0ccab0 con 0x7faf2c0ffe00 2023-12-11T20:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.784+0000 7faf2b7fe700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf140a1500 0x7faf140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.785+0000 7faf2b7fe700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf140a1500 0x7faf140a39c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faf2000b5c0 tx=0x7faf20003720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:36.789+0000 7faf297fa700 1 -- 172.21.15.12:0/1305183797 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faf1c096060 con 0x7faf2c0ffe00 2023-12-11T20:24:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.052+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf2c10efd0 con 0x7faf2c0ffe00 2023-12-11T20:24:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.053+0000 7faf297fa700 1 -- 172.21.15.12:0/1305183797 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7faf1c016020 con 0x7faf2c0ffe00 2023-12-11T20:24:37.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:24:37.053 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf140a1500 msgr2=0x7faf140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf140a1500 0x7faf140a39c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faf2000b5c0 tx=0x7faf20003720 comp rx=0 tx=0).stop 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c0ffe00 msgr2=0x7faf2c199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c0ffe00 0x7faf2c199590 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00d980 tx=0x7faf1c00dc90 comp rx=0 tx=0).stop 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 shutdown_connections 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf140a1500 0x7faf140a39c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf2c101120 0x7faf2c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf2c0ffe00 0x7faf2c199590 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 --2- 172.21.15.12:0/1305183797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf2c100760 0x7faf2c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 >> 172.21.15.12:0/1305183797 conn(0x7faf2c0fb980 msgr2=0x7faf2c0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 shutdown_connections 2023-12-11T20:24:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.056+0000 7faf327ff700 1 -- 172.21.15.12:0/1305183797 wait complete. 2023-12-11T20:24:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:24:37.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:24:37.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 -- 172.21.15.12:0/2514869429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 msgr2=0x7f5cf0074430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/2514869429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 0x7f5cf0074430 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009990 tx=0x7f5ce4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 -- 172.21.15.12:0/2514869429 shutdown_connections 2023-12-11T20:24:37.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/2514869429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cf0075590 0x7f5cf00739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/2514869429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cf01093e0 0x7f5cf010b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/2514869429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 0x7f5cf0074430 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 -- 172.21.15.12:0/2514869429 >> 172.21.15.12:0/2514869429 conn(0x7f5cf00fca60 msgr2=0x7f5cf00feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 -- 172.21.15.12:0/2514869429 shutdown_connections 2023-12-11T20:24:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.310+0000 7f5cf5fff700 1 -- 172.21.15.12:0/2514869429 wait complete. 2023-12-11T20:24:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.312+0000 7f5cf5fff700 1 Processor -- start 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.312+0000 7f5cf5fff700 1 -- start start 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.312+0000 7f5cf5fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 0x7f5cf0199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.312+0000 7f5cf5fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cf0075590 0x7f5cf0199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.312+0000 7f5cf5fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cf01093e0 0x7f5cf01a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cf5fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a1030 con 0x7f5cf0073fb0 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cf5fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a1170 con 0x7f5cf01093e0 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cf5fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a1300 con 0x7f5cf0075590 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cef7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 0x7f5cf0199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cef7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 0x7f5cf0199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57948/0 (socket says 172.21.15.12:57948) 2023-12-11T20:24:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cef7fe700 1 -- 172.21.15.12:0/4104202623 learned_addr learned my addr 172.21.15.12:0/4104202623 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cf0075590 0x7f5cf0199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5ceffff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cf01093e0 0x7f5cf01a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cef7fe700 1 -- 172.21.15.12:0/4104202623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cf0075590 msgr2=0x7f5cf0199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cf0075590 0x7f5cf0199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cef7fe700 1 -- 172.21.15.12:0/4104202623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cf01093e0 msgr2=0x7f5cf01a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cf01093e0 0x7f5cf01a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5cef7fe700 1 -- 172.21.15.12:0/4104202623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40095f0 con 0x7f5cf0073fb0 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.313+0000 7f5ceffff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cf01093e0 0x7f5cf01a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.314+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 0x7f5cf0199500 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000e9a0 tx=0x7f5ce000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.314+0000 7f5cecff9700 1 -- 172.21.15.12:0/4104202623 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0009790 con 0x7f5cf0073fb0 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.314+0000 7f5cecff9700 1 -- 172.21.15.12:0/4104202623 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ce000cbd0 con 0x7f5cf0073fb0 2023-12-11T20:24:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.314+0000 7f5cf5fff700 1 -- 172.21.15.12:0/4104202623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf01a15e0 con 0x7f5cf0073fb0 2023-12-11T20:24:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.314+0000 7f5cecff9700 1 -- 172.21.15.12:0/4104202623 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0018680 con 0x7f5cf0073fb0 2023-12-11T20:24:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.314+0000 7f5cf5fff700 1 -- 172.21.15.12:0/4104202623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf01a1b40 con 0x7f5cf0073fb0 2023-12-11T20:24:37.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.318+0000 7f5cecff9700 1 -- 172.21.15.12:0/4104202623 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5ce000cd40 con 0x7f5cf0073fb0 2023-12-11T20:24:37.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.319+0000 7f5d0996eb80 1 Processor -- start 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.319+0000 7f5d0996eb80 1 -- start start 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.319+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 0x55828ce627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.319+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce62d30 0x55828ce63640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.319+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828cdbdb50 con 0x55828ce63c20 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828cdbb470 con 0x55828ce623d0 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828cdb6d60 con 0x55828ce62d30 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57964/0 (socket says 172.21.15.12:57964) 2023-12-11T20:24:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceeffd700 1 -- 172.21.15.12:0/2742086913 learned_addr learned my addr 172.21.15.12:0/2742086913 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceffff700 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 0x55828ce627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce62d30 0x55828ce63640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5cecff9700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5cd80a1500 0x7f5cd80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceeffd700 1 -- 172.21.15.12:0/2742086913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce62d30 msgr2=0x55828ce63640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5cecff9700 1 -- 172.21.15.12:0/4104202623 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5ce0014070 con 0x7f5cf0073fb0 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceffff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5cd80a1500 0x7f5cd80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce62d30 0x55828ce63640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceeffd700 1 -- 172.21.15.12:0/2742086913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 msgr2=0x55828ce627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 0x55828ce627f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.320+0000 7f5ceeffd700 1 -- 172.21.15.12:0/2742086913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828cc33630 con 0x55828ce63c20 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.321+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce640a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400b710 tx=0x7f5ce4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49707668c71b05a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.321+0000 7f5cd5ffb700 1 -- 172.21.15.12:0/2742086913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4005240 con 0x55828ce63c20 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.321+0000 7f5ceffff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5cd80a1500 0x7f5cd80a39c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009fc0 tx=0x7f5ce8004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.321+0000 7f5cd5ffb700 1 -- 172.21.15.12:0/2742086913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ce401e040 con 0x55828ce63c20 2023-12-11T20:24:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.321+0000 7f5cd5ffb700 1 -- 172.21.15.12:0/2742086913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400ba10 con 0x55828ce63c20 2023-12-11T20:24:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.322+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2742086913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 msgr2=0x55828ce640a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.322+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce640a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400b710 tx=0x7f5ce4005c00 comp rx=0 tx=0).stop 2023-12-11T20:24:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.322+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2742086913 shutdown_connections 2023-12-11T20:24:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.322+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 0x55828ce627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.322+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce640a0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.322+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/2742086913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce62d30 0x55828ce63640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.322+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2742086913 >> 172.21.15.12:0/2742086913 conn(0x55828cd917e0 msgr2=0x55828ce5ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.322+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2742086913 shutdown_connections 2023-12-11T20:24:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.323+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2742086913 wait complete. 2023-12-11T20:24:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.323+0000 7f5d0996eb80 1 -- start start 2023-12-11T20:24:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.323+0000 7f5d0996eb80 1 Processor -- start 2023-12-11T20:24:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 0x55828ce6c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce63c20 0x55828ce736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828cd70560 con 0x55828ce62d30 2023-12-11T20:24:37.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828cd70200 con 0x55828ce623d0 2023-12-11T20:24:37.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828cc35920 con 0x55828ce63c20 2023-12-11T20:24:37.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5d0996eb80 10 client.0 _ll_register_callbacks cb 0x55828cc9ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57968/0 (socket says 172.21.15.12:57968) 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5ceeffd700 1 -- 172.21.15.12:0/118972395 learned_addr learned my addr 172.21.15.12:0/118972395 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.324+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 0x55828ce6c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5ceeffd700 1 -- 172.21.15.12:0/118972395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce63c20 msgr2=0x55828ce736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce63c20 0x55828ce736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5ceeffd700 1 -- 172.21.15.12:0/118972395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 msgr2=0x55828ce6c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 0x55828ce6c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5ceeffd700 1 -- 172.21.15.12:0/118972395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf010c460 con 0x55828ce62d30 2023-12-11T20:24:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6c6b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40095c0 tx=0x7f5ce40052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2146bce6511cf1ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5cceffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5cceffd700 1 -- 172.21.15.12:0/118972395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400b9b0 con 0x55828ce62d30 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5d0996eb80 1 -- 172.21.15.12:0/118972395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55828ce55b40 con 0x55828ce62d30 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.325+0000 7f5cceffd700 1 -- 172.21.15.12:0/118972395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5ce4003d30 con 0x55828ce62d30 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5cceffd700 1 -- 172.21.15.12:0/118972395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ce400bb10 con 0x55828ce62d30 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5d0996eb80 10 client.17949 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5d0996eb80 1 -- 172.21.15.12:0/118972395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55828cbdfde0 con 0x55828ce62d30 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5cceffd700 1 -- 172.21.15.12:0/118972395 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ce403b080 con 0x55828ce62d30 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5cceffd700 1 -- 172.21.15.12:0/118972395 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5ce4004ce0 con 0x55828ce62d30 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5d0996eb80 10 client.17949 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5d0996eb80 10 client.17949 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5d0996eb80 20 client.17949 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55828ce77b10 0x55828ce79f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5d0996eb80 4 client.17949 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.326+0000 7f5d0996eb80 1 -- 172.21.15.12:0/118972395 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55828ce31f40 con 0x55828ce77b10 2023-12-11T20:24:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.327+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55828ce77b10 0x55828ce79f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.327+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55828ce77b10 0x55828ce79f30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f6557604f01f4d7 server_cookie=8d36b63dd114c451 in_seq=0 out_seq=0 2023-12-11T20:24:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.327+0000 7f5cceffd700 10 client.17949 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5cceffd700 1 -- 172.21.15.12:0/118972395 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55828ce31f40 con 0x55828ce77b10 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5cceffd700 10 client.17949 handle_command_reply: tid=0 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 client.17949 shutdown 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 -- 172.21.15.12:0/118972395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 msgr2=0x55828ce6c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6c6b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40095c0 tx=0x7f5ce40052f0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 -- 172.21.15.12:0/118972395 shutdown_connections 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55828ce77b10 0x55828ce79f30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce623d0 0x55828ce6c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce63c20 0x55828ce736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5cceffd700 0 client.17949 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:24:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/118972395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6c6b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.328+0000 7f5d0996eb80 1 -- 172.21.15.12:0/118972395 >> 172.21.15.12:0/118972395 conn(0x55828cd917e0 msgr2=0x55828ce5da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.329+0000 7f5d0996eb80 1 -- 172.21.15.12:0/118972395 shutdown_connections 2023-12-11T20:24:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.329+0000 7f5d0996eb80 1 -- 172.21.15.12:0/118972395 wait complete. 2023-12-11T20:24:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.329+0000 7f5d0996eb80 20 client.17949 trim_cache size 0 max 16384 2023-12-11T20:24:37.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:37 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1305183797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:24:37.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.346+0000 7f5d0996eb80 1 Processor -- start 2023-12-11T20:24:37.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.346+0000 7f5d0996eb80 1 -- start start 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.346+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 0x55828ce73da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.346+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce62d30 0x55828ce736b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.346+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce6c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.346+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828ce63140 con 0x55828ce63c20 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.346+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828ce7f120 con 0x55828ce62d30 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.346+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828ce558d0 con 0x55828ce623d0 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce6c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce62d30 0x55828ce736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce6c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57978/0 (socket says 172.21.15.12:57978) 2023-12-11T20:24:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 -- 172.21.15.12:0/2762706125 learned_addr learned my addr 172.21.15.12:0/2762706125 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5cef7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 0x55828ce73da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 -- 172.21.15.12:0/2762706125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 msgr2=0x55828ce73da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 --2- 172.21.15.12:0/2762706125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 0x55828ce73da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 -- 172.21.15.12:0/2762706125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce62d30 msgr2=0x55828ce736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 --2- 172.21.15.12:0/2762706125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce62d30 0x55828ce736b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 -- 172.21.15.12:0/2762706125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828cbc8c60 con 0x55828ce63c20 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.347+0000 7f5ceffff700 1 --2- 172.21.15.12:0/2762706125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce6c170 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80077b0 tx=0x7f5ce800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7938f5de3049b268 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5cd67fc700 1 -- 172.21.15.12:0/2762706125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8019e60 con 0x55828ce63c20 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5cd67fc700 1 -- 172.21.15.12:0/2762706125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ce800f030 con 0x55828ce63c20 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5cd67fc700 1 -- 172.21.15.12:0/2762706125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8024e30 con 0x55828ce63c20 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2762706125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 msgr2=0x55828ce6c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/2762706125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce6c170 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80077b0 tx=0x7f5ce800b040 comp rx=0 tx=0).stop 2023-12-11T20:24:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2762706125 shutdown_connections 2023-12-11T20:24:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/2762706125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce63c20 0x55828ce6c170 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/2762706125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 0x55828ce73da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.348+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/2762706125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce62d30 0x55828ce736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.349+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2762706125 >> 172.21.15.12:0/2762706125 conn(0x55828cd917e0 msgr2=0x55828ce6b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.349+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2762706125 shutdown_connections 2023-12-11T20:24:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.349+0000 7f5d0996eb80 1 -- 172.21.15.12:0/2762706125 wait complete. 2023-12-11T20:24:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.349+0000 7f5d0996eb80 1 -- start start 2023-12-11T20:24:37.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.349+0000 7f5d0996eb80 1 Processor -- start 2023-12-11T20:24:37.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 0x55828ce6f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5d0996eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce63c20 0x55828ce729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828ce72f00 con 0x55828ce62d30 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828ce73070 con 0x55828ce63c20 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5d0996eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828ce73230 con 0x55828ce623d0 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5d0996eb80 10 client.0 _ll_register_callbacks cb 0x55828cc9ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57986/0 (socket says 172.21.15.12:57986) 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceeffd700 1 -- 172.21.15.12:0/905335061 learned_addr learned my addr 172.21.15.12:0/905335061 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 0x55828ce6f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceffff700 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce63c20 0x55828ce729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceeffd700 1 -- 172.21.15.12:0/905335061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 msgr2=0x55828ce6f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 0x55828ce6f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceeffd700 1 -- 172.21.15.12:0/905335061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce63c20 msgr2=0x55828ce729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce63c20 0x55828ce729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.350+0000 7f5ceeffd700 1 -- 172.21.15.12:0/905335061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce8011040 con 0x55828ce62d30 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.351+0000 7f5ceeffd700 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6fa90 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4001eb0 tx=0x7f5ce4003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaadce75c6e79152 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.351+0000 7f5cceffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.351+0000 7f5cceffd700 1 -- 172.21.15.12:0/905335061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400fe90 con 0x55828ce62d30 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.351+0000 7f5d0996eb80 1 -- 172.21.15.12:0/905335061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ce401e040 con 0x55828ce62d30 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.351+0000 7f5cceffd700 1 -- 172.21.15.12:0/905335061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5ce4000e40 con 0x55828ce62d30 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.351+0000 7f5cceffd700 1 -- 172.21.15.12:0/905335061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ce40053a0 con 0x55828ce62d30 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.351+0000 7f5d0996eb80 10 client.17955 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.351+0000 7f5d0996eb80 1 -- 172.21.15.12:0/905335061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55828cc06250 con 0x55828ce62d30 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5cceffd700 1 -- 172.21.15.12:0/905335061 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ce401e040 con 0x55828ce62d30 2023-12-11T20:24:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5cceffd700 1 -- 172.21.15.12:0/905335061 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5ce4004600 con 0x55828ce62d30 2023-12-11T20:24:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5d0996eb80 10 client.17955 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5d0996eb80 10 client.17955 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:24:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5d0996eb80 20 client.17955 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55828ceceaf0 0x55828ced0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5d0996eb80 4 client.17955 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:24:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5d0996eb80 1 -- 172.21.15.12:0/905335061 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55828cd7cfd0 con 0x55828ceceaf0 2023-12-11T20:24:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.352+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55828ceceaf0 0x55828ced0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.353+0000 7f5cceffd700 10 client.17955 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:24:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.353+0000 7f5cef7fe700 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55828ceceaf0 0x55828ced0ee0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f39dbf462487654 server_cookie=b95aab1b79c753c4 in_seq=0 out_seq=0 2023-12-11T20:24:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.353+0000 7f5cceffd700 1 -- 172.21.15.12:0/905335061 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55828cd7cfd0 con 0x55828ceceaf0 2023-12-11T20:24:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.353+0000 7f5cceffd700 10 client.17955 handle_command_reply: tid=0 2023-12-11T20:24:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.353+0000 7f5d0996eb80 1 client.17955 shutdown 2023-12-11T20:24:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.353+0000 7f5d0996eb80 1 -- 172.21.15.12:0/905335061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 msgr2=0x55828ce6fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.353+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6fa90 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4001eb0 tx=0x7f5ce4003de0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 1 -- 172.21.15.12:0/905335061 shutdown_connections 2023-12-11T20:24:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55828ceceaf0 0x55828ced0ee0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55828ce63c20 0x55828ce729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55828ce623d0 0x55828ce6f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 1 --2- 172.21.15.12:0/905335061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55828ce62d30 0x55828ce6fa90 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5cceffd700 0 client.17955 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:24:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 1 -- 172.21.15.12:0/905335061 >> 172.21.15.12:0/905335061 conn(0x55828cd917e0 msgr2=0x55828ce66b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 1 -- 172.21.15.12:0/905335061 shutdown_connections 2023-12-11T20:24:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 1 -- 172.21.15.12:0/905335061 wait complete. 2023-12-11T20:24:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.354+0000 7f5d0996eb80 20 client.17955 trim_cache size 0 max 16384 2023-12-11T20:24:37.359 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:24:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 -- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5cd80a1500 msgr2=0x7f5cd80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5cd80a1500 0x7f5cd80a39c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009fc0 tx=0x7f5ce8004b40 comp rx=0 tx=0).stop 2023-12-11T20:24:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 -- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 msgr2=0x7f5cf0199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 0x7f5cf0199500 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000e9a0 tx=0x7f5ce000ed60 comp rx=0 tx=0).stop 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 -- 172.21.15.12:0/4104202623 shutdown_connections 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5cd80a1500 0x7f5cd80a39c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cf01093e0 0x7f5cf01a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf0073fb0 0x7f5cf0199500 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 --2- 172.21.15.12:0/4104202623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cf0075590 0x7f5cf0199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 -- 172.21.15.12:0/4104202623 >> 172.21.15.12:0/4104202623 conn(0x7f5cf00fca60 msgr2=0x7f5cf0105330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 -- 172.21.15.12:0/4104202623 shutdown_connections 2023-12-11T20:24:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.355+0000 7f5cf5fff700 1 -- 172.21.15.12:0/4104202623 wait complete. 2023-12-11T20:24:37.373 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:24:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:37 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1305183797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:24:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:37 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1305183797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.594+0000 7faf993ff700 1 -- 172.21.15.12:0/3431655728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf941014b0 msgr2=0x7faf941018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.594+0000 7faf993ff700 1 --2- 172.21.15.12:0/3431655728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf941014b0 0x7faf941018d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7faf840099c0 tx=0x7faf84009cd0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.594+0000 7faf993ff700 1 -- 172.21.15.12:0/3431655728 shutdown_connections 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.594+0000 7faf993ff700 1 --2- 172.21.15.12:0/3431655728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf94103040 0x7faf941098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.594+0000 7faf993ff700 1 --2- 172.21.15.12:0/3431655728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf941014b0 0x7faf941018d0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.594+0000 7faf993ff700 1 --2- 172.21.15.12:0/3431655728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf941026a0 0x7faf94102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.594+0000 7faf993ff700 1 -- 172.21.15.12:0/3431655728 >> 172.21.15.12:0/3431655728 conn(0x7faf940fca00 msgr2=0x7faf940fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.595+0000 7faf993ff700 1 -- 172.21.15.12:0/3431655728 shutdown_connections 2023-12-11T20:24:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.595+0000 7faf993ff700 1 -- 172.21.15.12:0/3431655728 wait complete. 2023-12-11T20:24:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.596+0000 7faf993ff700 1 Processor -- start 2023-12-11T20:24:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.596+0000 7faf993ff700 1 -- start start 2023-12-11T20:24:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.596+0000 7faf993ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf941014b0 0x7faf941995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.596+0000 7faf993ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf941026a0 0x7faf94199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.596+0000 7faf993ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf94103040 0x7faf941a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.596+0000 7faf993ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf941a10d0 con 0x7faf94103040 2023-12-11T20:24:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.596+0000 7faf993ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf941a1210 con 0x7faf941026a0 2023-12-11T20:24:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.596+0000 7faf993ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf941a13a0 con 0x7faf941014b0 2023-12-11T20:24:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf94103040 0x7faf941a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf927fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf941026a0 0x7faf94199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf94103040 0x7faf941a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58010/0 (socket says 172.21.15.12:58010) 2023-12-11T20:24:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf92ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf941014b0 0x7faf941995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf927fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf941026a0 0x7faf94199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40208/0 (socket says 172.21.15.12:40208) 2023-12-11T20:24:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf937fe700 1 -- 172.21.15.12:0/2071672846 learned_addr learned my addr 172.21.15.12:0/2071672846 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf937fe700 1 -- 172.21.15.12:0/2071672846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf941014b0 msgr2=0x7faf941995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf937fe700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf941014b0 0x7faf941995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf937fe700 1 -- 172.21.15.12:0/2071672846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf941026a0 msgr2=0x7faf94199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf937fe700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf941026a0 0x7faf94199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.597+0000 7faf937fe700 1 -- 172.21.15.12:0/2071672846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf88009520 con 0x7faf94103040 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.598+0000 7faf937fe700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf94103040 0x7faf941a0b00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7faf8c007ee0 tx=0x7faf8c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.598+0000 7faf7bfff700 1 -- 172.21.15.12:0/2071672846 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c00dd20 con 0x7faf94103040 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.598+0000 7faf7bfff700 1 -- 172.21.15.12:0/2071672846 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf8c00f040 con 0x7faf94103040 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.598+0000 7faf993ff700 1 -- 172.21.15.12:0/2071672846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf840095f0 con 0x7faf94103040 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.598+0000 7faf7bfff700 1 -- 172.21.15.12:0/2071672846 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c004750 con 0x7faf94103040 2023-12-11T20:24:37.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.598+0000 7faf993ff700 1 -- 172.21.15.12:0/2071672846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf941a1a00 con 0x7faf94103040 2023-12-11T20:24:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.601+0000 7faf7bfff700 1 -- 172.21.15.12:0/2071672846 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7faf8c003a00 con 0x7faf94103040 2023-12-11T20:24:37.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.602+0000 7faf7bfff700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf7c0a1500 0x7faf7c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.602+0000 7faf7bfff700 1 -- 172.21.15.12:0/2071672846 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faf8c0cc5f0 con 0x7faf94103040 2023-12-11T20:24:37.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7fafacda1b80 1 Processor -- start 2023-12-11T20:24:37.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7faf92ffd700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf7c0a1500 0x7faf7c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7fafacda1b80 1 -- start start 2023-12-11T20:24:37.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b56523d0 0x55e0b56527f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 0x55e0b5653640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7fafacda1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b55adb50 con 0x55e0b56523d0 2023-12-11T20:24:37.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7fafacda1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b55ab470 con 0x55e0b5652d30 2023-12-11T20:24:37.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.603+0000 7fafacda1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b55a6d60 con 0x55e0b5653c20 2023-12-11T20:24:37.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b56523d0 0x55e0b56527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf937fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b56523d0 0x55e0b56527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58026/0 (socket says 172.21.15.12:58026) 2023-12-11T20:24:37.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 -- 172.21.15.12:0/166359799 learned_addr learned my addr 172.21.15.12:0/166359799 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf937fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:42832/0 (socket says 172.21.15.12:42832) 2023-12-11T20:24:37.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf7c0a1500 0x7faf7c0a39c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faf84000c00 tx=0x7faf84003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf927fc700 1 --2- 172.21.15.12:0/166359799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 0x55e0b5653640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 -- 172.21.15.12:0/166359799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 msgr2=0x55e0b56540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 --2- 172.21.15.12:0/166359799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 -- 172.21.15.12:0/166359799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 msgr2=0x55e0b5653640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 --2- 172.21.15.12:0/166359799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 0x55e0b5653640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.604+0000 7faf92ffd700 1 -- 172.21.15.12:0/166359799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b5423630 con 0x55e0b56523d0 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.605+0000 7faf92ffd700 1 --2- 172.21.15.12:0/166359799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b56523d0 0x55e0b56527f0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faf84009990 tx=0x7faf8401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93109244fda5f957 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.605+0000 7faf797fa700 1 -- 172.21.15.12:0/166359799 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf840056d0 con 0x55e0b56523d0 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.605+0000 7faf797fa700 1 -- 172.21.15.12:0/166359799 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf8401e040 con 0x55e0b56523d0 2023-12-11T20:24:37.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.605+0000 7faf797fa700 1 -- 172.21.15.12:0/166359799 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400fa80 con 0x55e0b56523d0 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 -- 172.21.15.12:0/166359799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b56523d0 msgr2=0x55e0b56527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 --2- 172.21.15.12:0/166359799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b56523d0 0x55e0b56527f0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faf84009990 tx=0x7faf8401f000 comp rx=0 tx=0).stop 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 -- 172.21.15.12:0/166359799 shutdown_connections 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 --2- 172.21.15.12:0/166359799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 --2- 172.21.15.12:0/166359799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b56523d0 0x55e0b56527f0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 --2- 172.21.15.12:0/166359799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 0x55e0b5653640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 -- 172.21.15.12:0/166359799 >> 172.21.15.12:0/166359799 conn(0x55e0b55817e0 msgr2=0x55e0b564ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 -- 172.21.15.12:0/166359799 shutdown_connections 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 -- 172.21.15.12:0/166359799 wait complete. 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.606+0000 7fafacda1b80 1 -- start start 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.607+0000 7fafacda1b80 1 Processor -- start 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.607+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b56523d0 0x55e0b565c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.607+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 0x55e0b565c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.607+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5653c20 0x55e0b5663660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.607+0000 7fafacda1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5560560 con 0x55e0b5653c20 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.607+0000 7fafacda1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5560200 con 0x55e0b5652d30 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.607+0000 7fafacda1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5425920 con 0x55e0b56523d0 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.607+0000 7fafacda1b80 10 client.0 _ll_register_callbacks cb 0x55e0b548ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5653c20 0x55e0b5663660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf92ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b56523d0 0x55e0b565c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf92ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b56523d0 0x55e0b565c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:42844/0 (socket says 172.21.15.12:42844) 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf92ffd700 1 -- 172.21.15.12:0/2126146323 learned_addr learned my addr 172.21.15.12:0/2126146323 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf927fc700 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 0x55e0b565c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf937fe700 1 -- 172.21.15.12:0/2126146323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b56523d0 msgr2=0x55e0b565c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf937fe700 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b56523d0 0x55e0b565c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf937fe700 1 -- 172.21.15.12:0/2126146323 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 msgr2=0x55e0b565c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf937fe700 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 0x55e0b565c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf937fe700 1 -- 172.21.15.12:0/2126146323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9410a240 con 0x55e0b5653c20 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf92ffd700 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b56523d0 0x55e0b565c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf937fe700 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5653c20 0x55e0b5663660 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0997f0 tx=0x7faf8c0992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d760e170d610d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.608+0000 7faf76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.609+0000 7faf76ff5700 1 -- 172.21.15.12:0/2126146323 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c099cc0 con 0x55e0b5653c20 2023-12-11T20:24:37.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.609+0000 7faf76ff5700 1 -- 172.21.15.12:0/2126146323 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faf8c00de80 con 0x55e0b5653c20 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.609+0000 7fafacda1b80 1 -- 172.21.15.12:0/2126146323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0b5645b40 con 0x55e0b5653c20 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.609+0000 7faf76ff5700 1 -- 172.21.15.12:0/2126146323 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf8c009410 con 0x55e0b5653c20 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.609+0000 7fafacda1b80 10 client.17967 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.609+0000 7fafacda1b80 1 -- 172.21.15.12:0/2126146323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e0b53cfde0 con 0x55e0b5653c20 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.609+0000 7faf76ff5700 1 -- 172.21.15.12:0/2126146323 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf8c07c020 con 0x55e0b5653c20 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.609+0000 7faf76ff5700 1 -- 172.21.15.12:0/2126146323 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf8c098d50 con 0x55e0b5653c20 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7fafacda1b80 10 client.17967 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7fafacda1b80 10 client.17967 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7fafacda1b80 20 client.17967 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7fafacda1b80 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e0b5667f20 0x55e0b566a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7fafacda1b80 4 client.17967 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7fafacda1b80 1 -- 172.21.15.12:0/2126146323 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0b5621f40 con 0x55e0b5667f20 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7faf92ffd700 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e0b5667f20 0x55e0b566a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7faf92ffd700 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e0b5667f20 0x55e0b566a340 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d6a85c54340847b server_cookie=d485e4a072b5a261 in_seq=0 out_seq=0 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.610+0000 7faf76ff5700 10 client.17967 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.611+0000 7faf76ff5700 1 -- 172.21.15.12:0/2126146323 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e0b5621f40 con 0x55e0b5667f20 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.611+0000 7faf76ff5700 10 client.17967 handle_command_reply: tid=0 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.611+0000 7fafacda1b80 1 client.17967 shutdown 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.611+0000 7fafacda1b80 1 -- 172.21.15.12:0/2126146323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5653c20 msgr2=0x55e0b5663660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.611+0000 7fafacda1b80 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5653c20 0x55e0b5663660 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0997f0 tx=0x7faf8c0992e0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 1 -- 172.21.15.12:0/2126146323 shutdown_connections 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e0b5667f20 0x55e0b566a340 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5653c20 0x55e0b5663660 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b56523d0 0x55e0b565c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 1 --2- 172.21.15.12:0/2126146323 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b5652d30 0x55e0b565c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 1 -- 172.21.15.12:0/2126146323 >> 172.21.15.12:0/2126146323 conn(0x55e0b55817e0 msgr2=0x55e0b564da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7faf76ff5700 0 client.17967 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:24:37.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 1 -- 172.21.15.12:0/2126146323 shutdown_connections 2023-12-11T20:24:37.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 1 -- 172.21.15.12:0/2126146323 wait complete. 2023-12-11T20:24:37.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.612+0000 7fafacda1b80 20 client.17967 trim_cache size 0 max 16384 2023-12-11T20:24:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.628+0000 7fafacda1b80 1 Processor -- start 2023-12-11T20:24:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7fafacda1b80 1 -- start start 2023-12-11T20:24:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b565b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b5663620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b566ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7fafacda1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5664820 con 0x55e0b5652d30 2023-12-11T20:24:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7fafacda1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b565bc80 con 0x55e0b56523d0 2023-12-11T20:24:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7fafacda1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5651fc0 con 0x55e0b5653c20 2023-12-11T20:24:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7faf927fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b5663620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7faf927fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b5663620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58058/0 (socket says 172.21.15.12:58058) 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7faf927fc700 1 -- 172.21.15.12:0/1960630111 learned_addr learned my addr 172.21.15.12:0/1960630111 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.629+0000 7faf937fe700 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b566ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf92ffd700 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b565b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf927fc700 1 -- 172.21.15.12:0/1960630111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 msgr2=0x55e0b566ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf927fc700 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b566ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf927fc700 1 -- 172.21.15.12:0/1960630111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 msgr2=0x55e0b565b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf927fc700 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b565b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf927fc700 1 -- 172.21.15.12:0/1960630111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b53b8c60 con 0x55e0b5652d30 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf92ffd700 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b565b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf927fc700 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b5663620 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7faf88012550 tx=0x7faf88009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee1a443844bcd2e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf79ffb700 1 -- 172.21.15.12:0/1960630111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88020070 con 0x55e0b5652d30 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf79ffb700 1 -- 172.21.15.12:0/1960630111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf88018040 con 0x55e0b5652d30 2023-12-11T20:24:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.630+0000 7faf79ffb700 1 -- 172.21.15.12:0/1960630111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88017050 con 0x55e0b5652d30 2023-12-11T20:24:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 -- 172.21.15.12:0/1960630111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 msgr2=0x55e0b5663620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b5663620 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7faf88012550 tx=0x7faf88009260 comp rx=0 tx=0).stop 2023-12-11T20:24:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 -- 172.21.15.12:0/1960630111 shutdown_connections 2023-12-11T20:24:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b565b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b566ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 --2- 172.21.15.12:0/1960630111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b5663620 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 -- 172.21.15.12:0/1960630111 >> 172.21.15.12:0/1960630111 conn(0x55e0b55817e0 msgr2=0x55e0b564e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 -- 172.21.15.12:0/1960630111 shutdown_connections 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.631+0000 7fafacda1b80 1 -- 172.21.15.12:0/1960630111 wait complete. 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.632+0000 7fafacda1b80 1 -- start start 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.632+0000 7fafacda1b80 1 Processor -- start 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b5660b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b56610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7fafacda1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7fafacda1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5662600 con 0x55e0b5652d30 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7fafacda1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5662770 con 0x55e0b56523d0 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7fafacda1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5662930 con 0x55e0b5653c20 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7fafacda1b80 10 client.0 _ll_register_callbacks cb 0x55e0b5664230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf927fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b56610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf927fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b56610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58072/0 (socket says 172.21.15.12:58072) 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf927fc700 1 -- 172.21.15.12:0/989179929 learned_addr learned my addr 172.21.15.12:0/989179929 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf937fe700 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf92ffd700 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b5660b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf927fc700 1 -- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 msgr2=0x55e0b56620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf927fc700 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf927fc700 1 -- 172.21.15.12:0/989179929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 msgr2=0x55e0b5660b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf927fc700 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b5660b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf927fc700 1 -- 172.21.15.12:0/989179929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf88009d60 con 0x55e0b5652d30 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.633+0000 7faf937fe700 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.634+0000 7faf927fc700 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b56610b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7faf88005c50 tx=0x7faf88012170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d032a9d31b8f760a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.634+0000 7faf76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.634+0000 7faf76ff5700 1 -- 172.21.15.12:0/989179929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88020030 con 0x55e0b5652d30 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.634+0000 7faf76ff5700 1 -- 172.21.15.12:0/989179929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faf88003b00 con 0x55e0b5652d30 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.634+0000 7fafacda1b80 1 -- 172.21.15.12:0/989179929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf8401e040 con 0x55e0b5652d30 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.634+0000 7faf76ff5700 1 -- 172.21.15.12:0/989179929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf88003cc0 con 0x55e0b5652d30 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.634+0000 7fafacda1b80 10 client.17973 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.634+0000 7fafacda1b80 1 -- 172.21.15.12:0/989179929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e0b53f6250 con 0x55e0b5652d30 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7faf76ff5700 1 -- 172.21.15.12:0/989179929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf8401e040 con 0x55e0b5652d30 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7faf76ff5700 1 -- 172.21.15.12:0/989179929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf88010430 con 0x55e0b5652d30 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7fafacda1b80 10 client.17973 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7fafacda1b80 10 client.17973 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7fafacda1b80 20 client.17973 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7fafacda1b80 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e0b56beab0 0x55e0b56c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7fafacda1b80 4 client.17973 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7fafacda1b80 1 -- 172.21.15.12:0/989179929 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e0b556cfd0 con 0x55e0b56beab0 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.635+0000 7faf92ffd700 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e0b56beab0 0x55e0b56c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.636+0000 7faf92ffd700 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e0b56beab0 0x55e0b56c0ed0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f4ad8dd389d1ed0 server_cookie=cd5797ee2e1417ea in_seq=0 out_seq=0 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.636+0000 7faf76ff5700 10 client.17973 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.636+0000 7faf76ff5700 1 -- 172.21.15.12:0/989179929 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e0b556cfd0 con 0x55e0b56beab0 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.636+0000 7faf76ff5700 10 client.17973 handle_command_reply: tid=0 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.636+0000 7fafacda1b80 1 client.17973 shutdown 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 -- 172.21.15.12:0/989179929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 msgr2=0x55e0b56610b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b56610b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7faf88005c50 tx=0x7faf88012170 comp rx=0 tx=0).stop 2023-12-11T20:24:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 -- 172.21.15.12:0/989179929 shutdown_connections 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e0b56beab0 0x55e0b56c0ed0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e0b56523d0 0x55e0b5660b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0b5653c20 0x55e0b56620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 --2- 172.21.15.12:0/989179929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0b5652d30 0x55e0b56610b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 -- 172.21.15.12:0/989179929 >> 172.21.15.12:0/989179929 conn(0x55e0b55817e0 msgr2=0x55e0b566ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7faf76ff5700 0 client.17973 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 -- 172.21.15.12:0/989179929 shutdown_connections 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 1 -- 172.21.15.12:0/989179929 wait complete. 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.637+0000 7fafacda1b80 20 client.17973 trim_cache size 0 max 16384 2023-12-11T20:24:37.639 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 -- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf7c0a1500 msgr2=0x7faf7c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf7c0a1500 0x7faf7c0a39c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faf84000c00 tx=0x7faf84003680 comp rx=0 tx=0).stop 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 -- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf94103040 msgr2=0x7faf941a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf94103040 0x7faf941a0b00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7faf8c007ee0 tx=0x7faf8c00d3b0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 -- 172.21.15.12:0/2071672846 shutdown_connections 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faf7c0a1500 0x7faf7c0a39c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf94103040 0x7faf941a0b00 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf941014b0 0x7faf941995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 --2- 172.21.15.12:0/2071672846 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf941026a0 0x7faf94199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 -- 172.21.15.12:0/2071672846 >> 172.21.15.12:0/2071672846 conn(0x7faf940fca00 msgr2=0x7faf94107f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 -- 172.21.15.12:0/2071672846 shutdown_connections 2023-12-11T20:24:37.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.638+0000 7faf993ff700 1 -- 172.21.15.12:0/2071672846 wait complete. 2023-12-11T20:24:37.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:24:37.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.900+0000 7f87ca59d700 1 -- 172.21.15.12:0/2370496588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 msgr2=0x7f87c4100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.900+0000 7f87ca59d700 1 --2- 172.21.15.12:0/2370496588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 0x7f87c4100610 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f87c00099c0 tx=0x7f87c0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.901+0000 7f87ca59d700 1 -- 172.21.15.12:0/2370496588 shutdown_connections 2023-12-11T20:24:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.901+0000 7f87ca59d700 1 --2- 172.21.15.12:0/2370496588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87c4101d80 0x7f87c4108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.901+0000 7f87ca59d700 1 --2- 172.21.15.12:0/2370496588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 0x7f87c4100610 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.901+0000 7f87ca59d700 1 --2- 172.21.15.12:0/2370496588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87c41013e0 0x7f87c4101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.901+0000 7f87ca59d700 1 -- 172.21.15.12:0/2370496588 >> 172.21.15.12:0/2370496588 conn(0x7f87c40fb740 msgr2=0x7f87c40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.901+0000 7f87ca59d700 1 -- 172.21.15.12:0/2370496588 shutdown_connections 2023-12-11T20:24:37.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.901+0000 7f87ca59d700 1 -- 172.21.15.12:0/2370496588 wait complete. 2023-12-11T20:24:37.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.902+0000 7f87ca59d700 1 Processor -- start 2023-12-11T20:24:37.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.902+0000 7f87ca59d700 1 -- start start 2023-12-11T20:24:37.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.902+0000 7f87ca59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 0x7f87c41992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87ca59d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87c41013e0 0x7f87c41997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87ca59d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87c4101d80 0x7f87c41a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87ca59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41a0de0 con 0x7f87c41001f0 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87ca59d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41a0f20 con 0x7f87c41013e0 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87ca59d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41a10b0 con 0x7f87c4101d80 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 0x7f87c41992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 0x7f87c41992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58086/0 (socket says 172.21.15.12:58086) 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c959b700 1 -- 172.21.15.12:0/1870782471 learned_addr learned my addr 172.21.15.12:0/1870782471 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c9d9c700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87c4101d80 0x7f87c41a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87c41013e0 0x7f87c41997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c959b700 1 -- 172.21.15.12:0/1870782471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87c4101d80 msgr2=0x7f87c41a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c959b700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87c4101d80 0x7f87c41a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c959b700 1 -- 172.21.15.12:0/1870782471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87c41013e0 msgr2=0x7f87c41997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c959b700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87c41013e0 0x7f87c41997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c959b700 1 -- 172.21.15.12:0/1870782471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00095f0 con 0x7f87c41001f0 2023-12-11T20:24:37.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.903+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87c41013e0 0x7f87c41997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:24:37.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.904+0000 7f87c959b700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 0x7f87c41992b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f87c0006010 tx=0x7f87c000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.904+0000 7f87ba7fc700 1 -- 172.21.15.12:0/1870782471 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c001d070 con 0x7f87c41001f0 2023-12-11T20:24:37.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.904+0000 7f87ca59d700 1 -- 172.21.15.12:0/1870782471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c41a1330 con 0x7f87c41001f0 2023-12-11T20:24:37.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.904+0000 7f87ba7fc700 1 -- 172.21.15.12:0/1870782471 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87c00054c0 con 0x7f87c41001f0 2023-12-11T20:24:37.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.904+0000 7f87ba7fc700 1 -- 172.21.15.12:0/1870782471 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0004bf0 con 0x7f87c41001f0 2023-12-11T20:24:37.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.904+0000 7f87ca59d700 1 -- 172.21.15.12:0/1870782471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c41a1750 con 0x7f87c41001f0 2023-12-11T20:24:37.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.908+0000 7f87ba7fc700 1 -- 172.21.15.12:0/1870782471 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f87c0004d50 con 0x7f87c41001f0 2023-12-11T20:24:37.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.909+0000 7f87ba7fc700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87b00a1520 0x7f87b00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.909+0000 7f87ba7fc700 1 -- 172.21.15.12:0/1870782471 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f87c00cd9e0 con 0x7f87c41001f0 2023-12-11T20:24:37.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87df027b80 1 Processor -- start 2023-12-11T20:24:37.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87b00a1520 0x7f87b00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87df027b80 1 -- start start 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87df027b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae1a60 0x55cd1aae1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87df027b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 0x55cd1aae28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87df027b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae2de0 0x55cd1aae3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87df027b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aa3cb50 con 0x55cd1aae2de0 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87df027b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aa3a470 con 0x55cd1aae23c0 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87df027b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aa35d60 con 0x55cd1aae1a60 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.910+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87b00a1520 0x7f87b00a39e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009be0 tx=0x7f87b4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae2de0 0x55cd1aae3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae2de0 0x55cd1aae3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58102/0 (socket says 172.21.15.12:58102) 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c9d9c700 1 -- 172.21.15.12:0/93740475 learned_addr learned my addr 172.21.15.12:0/93740475 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c959b700 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae1a60 0x55cd1aae1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 0x55cd1aae28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c959b700 1 -- 172.21.15.12:0/93740475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 msgr2=0x55cd1aae28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c959b700 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 0x55cd1aae28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c959b700 1 -- 172.21.15.12:0/93740475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae2de0 msgr2=0x55cd1aae3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c959b700 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae2de0 0x55cd1aae3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c959b700 1 -- 172.21.15.12:0/93740475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd1a8b2630 con 0x55cd1aae1a60 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c9d9c700 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae2de0 0x55cd1aae3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.911+0000 7f87c959b700 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae1a60 0x55cd1aae1e80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cb430 tx=0x7f87c0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a7f72e0e0a2c20f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.912+0000 7f87af7fe700 1 -- 172.21.15.12:0/93740475 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c009d070 con 0x55cd1aae1a60 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.912+0000 7f87af7fe700 1 -- 172.21.15.12:0/93740475 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87c009ae00 con 0x55cd1aae1a60 2023-12-11T20:24:37.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.912+0000 7f87af7fe700 1 -- 172.21.15.12:0/93740475 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000fc10 con 0x55cd1aae1a60 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.912+0000 7f87df027b80 1 -- 172.21.15.12:0/93740475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae1a60 msgr2=0x55cd1aae1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.912+0000 7f87df027b80 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae1a60 0x55cd1aae1e80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cb430 tx=0x7f87c0009310 comp rx=0 tx=0).stop 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.913+0000 7f87df027b80 1 -- 172.21.15.12:0/93740475 shutdown_connections 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.913+0000 7f87df027b80 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae2de0 0x55cd1aae3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.913+0000 7f87df027b80 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae1a60 0x55cd1aae1e80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.913+0000 7f87df027b80 1 --2- 172.21.15.12:0/93740475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 0x55cd1aae28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.913+0000 7f87df027b80 1 -- 172.21.15.12:0/93740475 >> 172.21.15.12:0/93740475 conn(0x55cd1aa107e0 msgr2=0x55cd1aadc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.913+0000 7f87df027b80 1 -- 172.21.15.12:0/93740475 shutdown_connections 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.913+0000 7f87df027b80 1 -- 172.21.15.12:0/93740475 wait complete. 2023-12-11T20:24:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.913+0000 7f87df027b80 1 -- start start 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87df027b80 1 Processor -- start 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87df027b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaeaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87df027b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaeb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87df027b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 0x55cd1aaf2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87df027b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1a9ef560 con 0x55cd1aae1a60 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87df027b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1a9ef200 con 0x55cd1aae2de0 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87df027b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1a8b4920 con 0x55cd1aae23c0 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87df027b80 10 client.0 _ll_register_callbacks cb 0x55cd1a91aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87c959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaeaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87c959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaeaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58116/0 (socket says 172.21.15.12:58116) 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.914+0000 7f87c959b700 1 -- 172.21.15.12:0/127743360 learned_addr learned my addr 172.21.15.12:0/127743360 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87c9d9c700 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 0x55cd1aaf2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaeb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87c959b700 1 -- 172.21.15.12:0/127743360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 msgr2=0x55cd1aaeb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87c959b700 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaeb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87c959b700 1 -- 172.21.15.12:0/127743360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 msgr2=0x55cd1aaf2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87c959b700 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 0x55cd1aaf2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87c959b700 1 -- 172.21.15.12:0/127743360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc011330 con 0x55cd1aae1a60 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87c959b700 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaeaff0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f87c00a10c0 tx=0x7f87c0005860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c69c74c17ce91d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.915+0000 7f87acff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87acff9700 1 -- 172.21.15.12:0/127743360 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c009d070 con 0x55cd1aae1a60 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87df027b80 1 -- 172.21.15.12:0/127743360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd1aad49e0 con 0x55cd1aae1a60 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87acff9700 1 -- 172.21.15.12:0/127743360 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f87c00a3100 con 0x55cd1aae1a60 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87acff9700 1 -- 172.21.15.12:0/127743360 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87c009ef50 con 0x55cd1aae1a60 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87df027b80 10 client.17985 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87df027b80 1 -- 172.21.15.12:0/127743360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f87c41a1750 con 0x55cd1aae1a60 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87acff9700 1 -- 172.21.15.12:0/127743360 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cd1aad49e0 con 0x55cd1aae1a60 2023-12-11T20:24:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87acff9700 1 -- 172.21.15.12:0/127743360 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f87c00a2c70 con 0x55cd1aae1a60 2023-12-11T20:24:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87df027b80 10 client.17985 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87df027b80 10 client.17985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.916+0000 7f87df027b80 20 client.17985 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.917+0000 7f87df027b80 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cd1aaf6920 0x55cd1aaf8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.917+0000 7f87df027b80 4 client.17985 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.917+0000 7f87df027b80 1 -- 172.21.15.12:0/127743360 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd1aab0f40 con 0x55cd1aaf6920 2023-12-11T20:24:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.917+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cd1aaf6920 0x55cd1aaf8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.918+0000 7f87acff9700 10 client.17985 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:37.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.918+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cd1aaf6920 0x55cd1aaf8d40 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4d1370b33ad266 server_cookie=9f3b65d9ec4c6de4 in_seq=0 out_seq=0 2023-12-11T20:24:37.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.918+0000 7f87acff9700 1 -- 172.21.15.12:0/127743360 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cd1aab0f40 con 0x55cd1aaf6920 2023-12-11T20:24:37.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87acff9700 10 client.17985 handle_command_reply: tid=0 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 client.17985 shutdown 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 -- 172.21.15.12:0/127743360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 msgr2=0x55cd1aaeaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaeaff0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f87c00a10c0 tx=0x7f87c0005860 comp rx=0 tx=0).stop 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 -- 172.21.15.12:0/127743360 shutdown_connections 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cd1aaf6920 0x55cd1aaf8d40 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 0x55cd1aaf2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaeaff0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87acff9700 0 client.17985 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 --2- 172.21.15.12:0/127743360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaeb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 -- 172.21.15.12:0/127743360 >> 172.21.15.12:0/127743360 conn(0x55cd1aa107e0 msgr2=0x55cd1aae0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 -- 172.21.15.12:0/127743360 shutdown_connections 2023-12-11T20:24:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 1 -- 172.21.15.12:0/127743360 wait complete. 2023-12-11T20:24:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.919+0000 7f87df027b80 20 client.17985 trim_cache size 0 max 16384 2023-12-11T20:24:37.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.934+0000 7f87df027b80 1 Processor -- start 2023-12-11T20:24:37.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.934+0000 7f87df027b80 1 -- start start 2023-12-11T20:24:37.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87df027b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aae31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87df027b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87df027b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 0x55cd1aaea500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87df027b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aad49f0 con 0x55cd1aae1a60 2023-12-11T20:24:37.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87df027b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aaf3720 con 0x55cd1aae2de0 2023-12-11T20:24:37.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87df027b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aae9ff0 con 0x55cd1aae23c0 2023-12-11T20:24:37.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aae31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c8d9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aae31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58120/0 (socket says 172.21.15.12:58120) 2023-12-11T20:24:37.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c959b700 1 -- 172.21.15.12:0/732532474 learned_addr learned my addr 172.21.15.12:0/732532474 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c9d9c700 1 --2- 172.21.15.12:0/732532474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 0x55cd1aaea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c8d9a700 1 -- 172.21.15.12:0/732532474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 msgr2=0x55cd1aaea500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/732532474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 0x55cd1aaea500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c8d9a700 1 -- 172.21.15.12:0/732532474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 msgr2=0x55cd1aae31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/732532474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aae31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.935+0000 7f87c8d9a700 1 -- 172.21.15.12:0/732532474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd1a85ede0 con 0x55cd1aae23c0 2023-12-11T20:24:37.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.936+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/732532474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf2530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55cd1aaf9320 tx=0x7f87b4013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f411534ceaa647bf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.936+0000 7f87affff700 1 -- 172.21.15.12:0/732532474 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4025030 con 0x55cd1aae23c0 2023-12-11T20:24:37.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.936+0000 7f87affff700 1 -- 172.21.15.12:0/732532474 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87b4026040 con 0x55cd1aae23c0 2023-12-11T20:24:37.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.936+0000 7f87affff700 1 -- 172.21.15.12:0/732532474 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4029a90 con 0x55cd1aae23c0 2023-12-11T20:24:37.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 -- 172.21.15.12:0/732532474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 msgr2=0x55cd1aaf2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 --2- 172.21.15.12:0/732532474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf2530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55cd1aaf9320 tx=0x7f87b4013000 comp rx=0 tx=0).stop 2023-12-11T20:24:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 -- 172.21.15.12:0/732532474 shutdown_connections 2023-12-11T20:24:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 --2- 172.21.15.12:0/732532474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae2de0 0x55cd1aaea500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 --2- 172.21.15.12:0/732532474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aae31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 --2- 172.21.15.12:0/732532474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf2530 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 -- 172.21.15.12:0/732532474 >> 172.21.15.12:0/732532474 conn(0x55cd1aa107e0 msgr2=0x55cd1aadc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 -- 172.21.15.12:0/732532474 shutdown_connections 2023-12-11T20:24:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.937+0000 7f87df027b80 1 -- 172.21.15.12:0/732532474 wait complete. 2023-12-11T20:24:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.938+0000 7f87df027b80 1 -- start start 2023-12-11T20:24:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.938+0000 7f87df027b80 1 Processor -- start 2023-12-11T20:24:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87df027b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaf1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87df027b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87df027b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae2de0 0x55cd1aaf0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87df027b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aaf0b10 con 0x55cd1aae1a60 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87df027b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aaf0c80 con 0x55cd1aae23c0 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87df027b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd1aaf0e40 con 0x55cd1aae2de0 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87df027b80 10 client.0 _ll_register_callbacks cb 0x55cd1a91aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaf1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaf1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58124/0 (socket says 172.21.15.12:58124) 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c959b700 1 -- 172.21.15.12:0/1125032672 learned_addr learned my addr 172.21.15.12:0/1125032672 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c9d9c700 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae2de0 0x55cd1aaf0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c959b700 1 -- 172.21.15.12:0/1125032672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae2de0 msgr2=0x55cd1aaf0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c959b700 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae2de0 0x55cd1aaf0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c959b700 1 -- 172.21.15.12:0/1125032672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 msgr2=0x55cd1aaf23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c959b700 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.939+0000 7f87c959b700 1 -- 172.21.15.12:0/1125032672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b40109e0 con 0x55cd1aae1a60 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87c959b700 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaf1e90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f87c009ab00 tx=0x7f87c0096ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74d2137d44db957 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87acff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87acff9700 1 -- 172.21.15.12:0/1125032672 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c009d060 con 0x55cd1aae1a60 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87acff9700 1 -- 172.21.15.12:0/1125032672 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f87c0096f50 con 0x55cd1aae1a60 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87df027b80 1 -- 172.21.15.12:0/1125032672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87c009ae00 con 0x55cd1aae1a60 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87acff9700 1 -- 172.21.15.12:0/1125032672 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87c0096db0 con 0x55cd1aae1a60 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87df027b80 10 client.17991 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87df027b80 1 -- 172.21.15.12:0/1125032672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cd1a847c60 con 0x55cd1aae1a60 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.940+0000 7f87acff9700 1 -- 172.21.15.12:0/1125032672 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87c009ae00 con 0x55cd1aae1a60 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.941+0000 7f87acff9700 1 -- 172.21.15.12:0/1125032672 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f87c009a2f0 con 0x55cd1aae1a60 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.941+0000 7f87df027b80 10 client.17991 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.941+0000 7f87df027b80 10 client.17991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.941+0000 7f87df027b80 20 client.17991 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.941+0000 7f87df027b80 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cd1ab4dab0 0x55cd1ab4fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.941+0000 7f87df027b80 4 client.17991 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.941+0000 7f87df027b80 1 -- 172.21.15.12:0/1125032672 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cd1a9fbfd0 con 0x55cd1ab4dab0 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.941+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cd1ab4dab0 0x55cd1ab4fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.942+0000 7f87c8d9a700 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cd1ab4dab0 0x55cd1ab4fea0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dddd35a254671c8a server_cookie=fb71b5125e8aa2e7 in_seq=0 out_seq=0 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.942+0000 7f87acff9700 10 client.17991 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.942+0000 7f87acff9700 1 -- 172.21.15.12:0/1125032672 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cd1a9fbfd0 con 0x55cd1ab4dab0 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.942+0000 7f87acff9700 10 client.17991 handle_command_reply: tid=0 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.942+0000 7f87df027b80 1 client.17991 shutdown 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 -- 172.21.15.12:0/1125032672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 msgr2=0x55cd1aaf1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaf1e90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f87c009ab00 tx=0x7f87c0096ce0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 -- 172.21.15.12:0/1125032672 shutdown_connections 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cd1ab4dab0 0x55cd1ab4fea0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd1aae2de0 0x55cd1aaf0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd1aae1a60 0x55cd1aaf1e90 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 --2- 172.21.15.12:0/1125032672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cd1aae23c0 0x55cd1aaf23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 -- 172.21.15.12:0/1125032672 >> 172.21.15.12:0/1125032672 conn(0x55cd1aa107e0 msgr2=0x55cd1aaea4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87acff9700 0 client.17991 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 -- 172.21.15.12:0/1125032672 shutdown_connections 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 1 -- 172.21.15.12:0/1125032672 wait complete. 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.943+0000 7f87df027b80 20 client.17991 trim_cache size 0 max 16384 2023-12-11T20:24:37.951 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:24:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 -- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87b00a1520 msgr2=0x7f87b00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87b00a1520 0x7f87b00a39e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009be0 tx=0x7f87b4009260 comp rx=0 tx=0).stop 2023-12-11T20:24:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 -- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 msgr2=0x7f87c41992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 0x7f87c41992b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f87c0006010 tx=0x7f87c000f690 comp rx=0 tx=0).stop 2023-12-11T20:24:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 -- 172.21.15.12:0/1870782471 shutdown_connections 2023-12-11T20:24:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87b00a1520 0x7f87b00a39e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87c4101d80 0x7f87c41a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c41001f0 0x7f87c41992b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 --2- 172.21.15.12:0/1870782471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87c41013e0 0x7f87c41997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 -- 172.21.15.12:0/1870782471 >> 172.21.15.12:0/1870782471 conn(0x7f87c40fb740 msgr2=0x7f87c4106bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 -- 172.21.15.12:0/1870782471 shutdown_connections 2023-12-11T20:24:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:37.944+0000 7f87ca59d700 1 -- 172.21.15.12:0/1870782471 wait complete. 2023-12-11T20:24:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:38 smithi012 ceph-mon[128787]: pgmap v636: 97 pgs: 97 active+clean; 6.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:24:38.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:38 smithi032 ceph-mon[132488]: pgmap v636: 97 pgs: 97 active+clean; 6.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:24:38.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:38 smithi039 ceph-mon[102205]: pgmap v636: 97 pgs: 97 active+clean; 6.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:24:38.963 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:24:38.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:24:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 -- 172.21.15.12:0/3395858367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c1026a0 msgr2=0x7ff42c102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 --2- 172.21.15.12:0/3395858367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c1026a0 0x7ff42c102b00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff4200099c0 tx=0x7ff420009cd0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 -- 172.21.15.12:0/3395858367 shutdown_connections 2023-12-11T20:24:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 --2- 172.21.15.12:0/3395858367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff42c103040 0x7ff42c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 --2- 172.21.15.12:0/3395858367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff42c1014b0 0x7ff42c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 --2- 172.21.15.12:0/3395858367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c1026a0 0x7ff42c102b00 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 -- 172.21.15.12:0/3395858367 >> 172.21.15.12:0/3395858367 conn(0x7ff42c0fca00 msgr2=0x7ff42c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 -- 172.21.15.12:0/3395858367 shutdown_connections 2023-12-11T20:24:39.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.215+0000 7ff431dff700 1 -- 172.21.15.12:0/3395858367 wait complete. 2023-12-11T20:24:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.216+0000 7ff431dff700 1 Processor -- start 2023-12-11T20:24:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.216+0000 7ff431dff700 1 -- start start 2023-12-11T20:24:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff431dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff42c1014b0 0x7ff42c1071e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff431dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff42c1026a0 0x7ff42c107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff431dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c103040 0x7ff42c103d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff431dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c104510 con 0x7ff42c103040 2023-12-11T20:24:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff431dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c104680 con 0x7ff42c1026a0 2023-12-11T20:24:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff431dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c104840 con 0x7ff42c1014b0 2023-12-11T20:24:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff42c1014b0 0x7ff42c1071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff42affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff42c1026a0 0x7ff42c107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c103040 0x7ff42c103d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff42c1014b0 0x7ff42c1071e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46076/0 (socket says 172.21.15.12:46076) 2023-12-11T20:24:39.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff42b7fe700 1 -- 172.21.15.12:0/2703506740 learned_addr learned my addr 172.21.15.12:0/2703506740 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.217+0000 7ff42bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c103040 0x7ff42c103d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60052/0 (socket says 172.21.15.12:60052) 2023-12-11T20:24:39.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff42bfff700 1 -- 172.21.15.12:0/2703506740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff42c1014b0 msgr2=0x7ff42c1071e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff42bfff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff42c1014b0 0x7ff42c1071e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff42bfff700 1 -- 172.21.15.12:0/2703506740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff42c1026a0 msgr2=0x7ff42c107720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff42bfff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff42c1026a0 0x7ff42c107720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff42bfff700 1 -- 172.21.15.12:0/2703506740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4200095f0 con 0x7ff42c103040 2023-12-11T20:24:39.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff42bfff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c103040 0x7ff42c103d70 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff424007f10 tx=0x7ff42400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff428ff9700 1 -- 172.21.15.12:0/2703506740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424009ea0 con 0x7ff42c103040 2023-12-11T20:24:39.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff431dff700 1 -- 172.21.15.12:0/2703506740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c1a5ae0 con 0x7ff42c103040 2023-12-11T20:24:39.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.218+0000 7ff428ff9700 1 -- 172.21.15.12:0/2703506740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff42400f040 con 0x7ff42c103040 2023-12-11T20:24:39.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.219+0000 7ff428ff9700 1 -- 172.21.15.12:0/2703506740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424004280 con 0x7ff42c103040 2023-12-11T20:24:39.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.219+0000 7ff431dff700 1 -- 172.21.15.12:0/2703506740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c1a5fc0 con 0x7ff42c103040 2023-12-11T20:24:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.223+0000 7ff428ff9700 1 -- 172.21.15.12:0/2703506740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff42400db20 con 0x7ff42c103040 2023-12-11T20:24:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.224+0000 7ff4456eeb80 1 Processor -- start 2023-12-11T20:24:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.224+0000 7ff4456eeb80 1 -- start start 2023-12-11T20:24:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ed8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed8db0 0x55f994ed96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed9ca0 0x55f994eda120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994e33bd0 con 0x55f994ed8450 2023-12-11T20:24:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994e314f0 con 0x55f994ed8db0 2023-12-11T20:24:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994e2cde0 con 0x55f994ed9ca0 2023-12-11T20:24:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff42affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ed8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff42affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ed8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60054/0 (socket says 172.21.15.12:60054) 2023-12-11T20:24:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff42affd700 1 -- 172.21.15.12:0/2251286461 learned_addr learned my addr 172.21.15.12:0/2251286461 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff428ff9700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4140a1480 0x7ff4140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed8db0 0x55f994ed96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff42affd700 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed9ca0 0x55f994eda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff428ff9700 1 -- 172.21.15.12:0/2703506740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff4240cc6d0 con 0x7ff42c103040 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff42affd700 1 -- 172.21.15.12:0/2251286461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed9ca0 msgr2=0x55f994eda120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff42affd700 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed9ca0 0x55f994eda120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.225+0000 7ff42affd700 1 -- 172.21.15.12:0/2251286461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed8db0 msgr2=0x55f994ed96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.226+0000 7ff42affd700 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed8db0 0x55f994ed96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.226+0000 7ff42affd700 1 -- 172.21.15.12:0/2251286461 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f994ca96b0 con 0x55f994ed8450 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.226+0000 7ff42bfff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4140a1480 0x7ff4140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.226+0000 7ff42affd700 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ed8870 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff420006010 tx=0x7ff420005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd136e6b1921bcb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.226+0000 7ff411ffb700 1 -- 172.21.15.12:0/2251286461 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200050d0 con 0x55f994ed8450 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.226+0000 7ff42bfff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4140a1480 0x7ff4140a3940 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff424004b80 tx=0x7ff424004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.226+0000 7ff411ffb700 1 -- 172.21.15.12:0/2251286461 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4200056c0 con 0x55f994ed8450 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.226+0000 7ff411ffb700 1 -- 172.21.15.12:0/2251286461 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000f460 con 0x55f994ed8450 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2251286461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 msgr2=0x55f994ed8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ed8870 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff420006010 tx=0x7ff420005bc0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2251286461 shutdown_connections 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed9ca0 0x55f994eda120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ed8870 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/2251286461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed8db0 0x55f994ed96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2251286461 >> 172.21.15.12:0/2251286461 conn(0x55f994e07860 msgr2=0x55f994ed4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2251286461 shutdown_connections 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.227+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2251286461 wait complete. 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.228+0000 7ff4456eeb80 1 -- start start 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.228+0000 7ff4456eeb80 1 Processor -- start 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.228+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.228+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8db0 0x55f994ee2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.228+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.228+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994de65e0 con 0x55f994ed8db0 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.228+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994de6280 con 0x55f994ed9ca0 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.228+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994cab9a0 con 0x55f994ed8450 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff4456eeb80 10 client.0 _ll_register_callbacks cb 0x55f994d11b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8db0 0x55f994ee2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8db0 0x55f994ee2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60056/0 (socket says 172.21.15.12:60056) 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 -- 172.21.15.12:0/3114721325 learned_addr learned my addr 172.21.15.12:0/3114721325 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42affd700 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42affd700 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 -- 172.21.15.12:0/3114721325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8450 msgr2=0x55f994ee2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 -- 172.21.15.12:0/3114721325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 msgr2=0x55f994ee9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 -- 172.21.15.12:0/3114721325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c10a240 con 0x55f994ed8db0 2023-12-11T20:24:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42affd700 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.229+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8db0 0x55f994ee2740 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff41c012840 tx=0x7ff41c012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a08661512d1fa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.230+0000 7ff40affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.230+0000 7ff40affd700 1 -- 172.21.15.12:0/3114721325 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c017070 con 0x55f994ed8db0 2023-12-11T20:24:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.230+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3114721325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f994ecbbc0 con 0x55f994ed8db0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.230+0000 7ff40affd700 1 -- 172.21.15.12:0/3114721325 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff41c00f540 con 0x55f994ed8db0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.230+0000 7ff40affd700 1 -- 172.21.15.12:0/3114721325 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff41c00f700 con 0x55f994ed8db0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.230+0000 7ff4456eeb80 10 client.18003 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.230+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3114721325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f994c55e60 con 0x55f994ed8db0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.230+0000 7ff40affd700 1 -- 172.21.15.12:0/3114721325 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f994ecbbc0 con 0x55f994ed8db0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.231+0000 7ff40affd700 1 -- 172.21.15.12:0/3114721325 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff41c026820 con 0x55f994ed8db0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.231+0000 7ff4456eeb80 10 client.18003 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.231+0000 7ff4456eeb80 10 client.18003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.231+0000 7ff4456eeb80 20 client.18003 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.231+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f994eee0a0 0x55f994ef04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.231+0000 7ff4456eeb80 4 client.18003 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.231+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3114721325 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f994ea7fc0 con 0x55f994eee0a0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.231+0000 7ff42affd700 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f994eee0a0 0x55f994ef04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.232+0000 7ff42affd700 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f994eee0a0 0x55f994ef04c0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=753c9a56e680e2a6 server_cookie=7c030689653c14f in_seq=0 out_seq=0 2023-12-11T20:24:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.232+0000 7ff40affd700 10 client.18003 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff40affd700 1 -- 172.21.15.12:0/3114721325 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f994ea7fc0 con 0x55f994eee0a0 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff40affd700 10 client.18003 handle_command_reply: tid=0 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 client.18003 shutdown 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3114721325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8db0 msgr2=0x55f994ee2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8db0 0x55f994ee2740 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff41c012840 tx=0x7ff41c012b50 comp rx=0 tx=0).stop 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3114721325 shutdown_connections 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f994eee0a0 0x55f994ef04c0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3114721325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8db0 0x55f994ee2740 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3114721325 >> 172.21.15.12:0/3114721325 conn(0x55f994e07860 msgr2=0x55f994ed3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff40affd700 0 client.18003 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3114721325 shutdown_connections 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.233+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3114721325 wait complete. 2023-12-11T20:24:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.234+0000 7ff4456eeb80 20 client.18003 trim_cache size 0 max 16384 2023-12-11T20:24:39.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.253+0000 7ff4456eeb80 1 Processor -- start 2023-12-11T20:24:39.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.253+0000 7ff4456eeb80 1 -- start start 2023-12-11T20:24:39.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.253+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.253+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.253+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.253+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994ed5280 con 0x55f994ed8450 2023-12-11T20:24:39.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.253+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994ee0c30 con 0x55f994ed9ca0 2023-12-11T20:24:39.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994ee08e0 con 0x55f994ed8db0 2023-12-11T20:24:39.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60062/0 (socket says 172.21.15.12:60062) 2023-12-11T20:24:39.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42affd700 1 -- 172.21.15.12:0/2222921640 learned_addr learned my addr 172.21.15.12:0/2222921640 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42affd700 1 -- 172.21.15.12:0/2222921640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 msgr2=0x55f994ee9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42affd700 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42affd700 1 -- 172.21.15.12:0/2222921640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 msgr2=0x55f994ee2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42affd700 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42affd700 1 -- 172.21.15.12:0/2222921640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f994c3ece0 con 0x55f994ed8450 2023-12-11T20:24:39.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.254+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:39.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.255+0000 7ff42affd700 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee2200 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff42000bf10 tx=0x7ff420005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48d55e203d14650 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.255+0000 7ff4127fc700 1 -- 172.21.15.12:0/2222921640 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42002e040 con 0x55f994ed8450 2023-12-11T20:24:39.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.255+0000 7ff4127fc700 1 -- 172.21.15.12:0/2222921640 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff420003a70 con 0x55f994ed8450 2023-12-11T20:24:39.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.255+0000 7ff4127fc700 1 -- 172.21.15.12:0/2222921640 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420036540 con 0x55f994ed8450 2023-12-11T20:24:39.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2222921640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 msgr2=0x55f994ee2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee2200 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff42000bf10 tx=0x7ff420005bc0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2222921640 shutdown_connections 2023-12-11T20:24:39.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee2200 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/2222921640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2222921640 >> 172.21.15.12:0/2222921640 conn(0x55f994e07860 msgr2=0x55f994ef4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2222921640 shutdown_connections 2023-12-11T20:24:39.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 -- 172.21.15.12:0/2222921640 wait complete. 2023-12-11T20:24:39.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.256+0000 7ff4456eeb80 1 -- start start 2023-12-11T20:24:39.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.257+0000 7ff4456eeb80 1 Processor -- start 2023-12-11T20:24:39.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.257+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.257+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.257+0000 7ff4456eeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.257+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994ee8fe0 con 0x55f994ed8450 2023-12-11T20:24:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.257+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994ee9150 con 0x55f994ed9ca0 2023-12-11T20:24:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.257+0000 7ff4456eeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f994ee9310 con 0x55f994ed8db0 2023-12-11T20:24:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.257+0000 7ff4456eeb80 10 client.0 _ll_register_callbacks cb 0x55f994d11b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60076/0 (socket says 172.21.15.12:60076) 2023-12-11T20:24:39.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 -- 172.21.15.12:0/3801156580 learned_addr learned my addr 172.21.15.12:0/3801156580 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 -- 172.21.15.12:0/3801156580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 msgr2=0x55f994ee7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 -- 172.21.15.12:0/3801156580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 msgr2=0x55f994ee8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 -- 172.21.15.12:0/3801156580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420031040 con 0x55f994ed8450 2023-12-11T20:24:39.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff42affd700 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee75a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff4200095c0 tx=0x7ff42000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48b433e73ae388b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.258+0000 7ff40affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:39.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff40affd700 1 -- 172.21.15.12:0/3801156580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42002e070 con 0x55f994ed8450 2023-12-11T20:24:39.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3801156580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4200056c0 con 0x55f994ed8450 2023-12-11T20:24:39.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff40affd700 1 -- 172.21.15.12:0/3801156580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff420000e40 con 0x55f994ed8450 2023-12-11T20:24:39.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff40affd700 1 -- 172.21.15.12:0/3801156580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4200050d0 con 0x55f994ed8450 2023-12-11T20:24:39.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff4456eeb80 10 client.18009 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:39.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3801156580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f994c7c2d0 con 0x55f994ed8450 2023-12-11T20:24:39.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff40affd700 1 -- 172.21.15.12:0/3801156580 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4200056c0 con 0x55f994ed8450 2023-12-11T20:24:39.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff40affd700 1 -- 172.21.15.12:0/3801156580 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff42003d030 con 0x55f994ed8450 2023-12-11T20:24:39.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.259+0000 7ff4456eeb80 10 client.18009 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:39.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.260+0000 7ff4456eeb80 10 client.18009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:39.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.260+0000 7ff4456eeb80 20 client.18009 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:39.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.260+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f994f450d0 0x55f994f474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.260+0000 7ff4456eeb80 4 client.18009 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:24:39.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.260+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3801156580 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f994df3050 con 0x55f994f450d0 2023-12-11T20:24:39.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.260+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f994f450d0 0x55f994f474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.261+0000 7ff40affd700 10 client.18009 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:39.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.261+0000 7ff42b7fe700 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f994f450d0 0x55f994f474f0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a8c0625d3a09c76 server_cookie=b359d886d1c8712f in_seq=0 out_seq=0 2023-12-11T20:24:39.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff40affd700 1 -- 172.21.15.12:0/3801156580 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f994df3050 con 0x55f994f450d0 2023-12-11T20:24:39.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff40affd700 10 client.18009 handle_command_reply: tid=0 2023-12-11T20:24:39.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 client.18009 shutdown 2023-12-11T20:24:39.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3801156580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 msgr2=0x55f994ee75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee75a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff4200095c0 tx=0x7ff42000b630 comp rx=0 tx=0).stop 2023-12-11T20:24:39.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3801156580 shutdown_connections 2023-12-11T20:24:39.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f994f450d0 0x55f994f474f0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f994ed9ca0 0x55f994ee8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f994ed8450 0x55f994ee75a0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 --2- 172.21.15.12:0/3801156580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f994ed8db0 0x55f994ee7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3801156580 >> 172.21.15.12:0/3801156580 conn(0x55f994e07860 msgr2=0x55f994edcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.262+0000 7ff40affd700 0 client.18009 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:39.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.263+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3801156580 shutdown_connections 2023-12-11T20:24:39.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.263+0000 7ff4456eeb80 1 -- 172.21.15.12:0/3801156580 wait complete. 2023-12-11T20:24:39.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.263+0000 7ff4456eeb80 20 client.18009 trim_cache size 0 max 16384 2023-12-11T20:24:39.278 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:24:39.278 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:24:39.278 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "b4528837-6184-43cd-a137-10da0d45c6e3", 2023-12-11T20:24:39.278 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:24:39.278 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:24:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.263+0000 7ff431dff700 1 -- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4140a1480 msgr2=0x7ff4140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4140a1480 0x7ff4140a3940 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff424004b80 tx=0x7ff424004ad0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 -- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c103040 msgr2=0x7ff42c103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c103040 0x7ff42c103d70 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff424007f10 tx=0x7ff42400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 -- 172.21.15.12:0/2703506740 shutdown_connections 2023-12-11T20:24:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4140a1480 0x7ff4140a3940 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42c103040 0x7ff42c103d70 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff42c1014b0 0x7ff42c1071e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 --2- 172.21.15.12:0/2703506740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff42c1026a0 0x7ff42c107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 -- 172.21.15.12:0/2703506740 >> 172.21.15.12:0/2703506740 conn(0x7ff42c0fca00 msgr2=0x7ff42c107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.264+0000 7ff431dff700 1 -- 172.21.15.12:0/2703506740 shutdown_connections 2023-12-11T20:24:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.265+0000 7ff431dff700 1 -- 172.21.15.12:0/2703506740 wait complete. 2023-12-11T20:24:39.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 -- 172.21.15.12:0/1872702509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301006e0 msgr2=0x7f4930100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 --2- 172.21.15.12:0/1872702509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301006e0 0x7f4930100b60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f49240099c0 tx=0x7f4924009cd0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 -- 172.21.15.12:0/1872702509 shutdown_connections 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 --2- 172.21.15.12:0/1872702509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49301010a0 0x7f4930101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 --2- 172.21.15.12:0/1872702509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49300ffd80 0x7f49301001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 --2- 172.21.15.12:0/1872702509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301006e0 0x7f4930100b60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 -- 172.21.15.12:0/1872702509 >> 172.21.15.12:0/1872702509 conn(0x7f49300fb920 msgr2=0x7f49300fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 -- 172.21.15.12:0/1872702509 shutdown_connections 2023-12-11T20:24:39.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.541+0000 7f4934fff700 1 -- 172.21.15.12:0/1872702509 wait complete. 2023-12-11T20:24:39.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.543+0000 7f4934fff700 1 Processor -- start 2023-12-11T20:24:39.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.543+0000 7f4934fff700 1 -- start start 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.543+0000 7f4934fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49300ffd80 0x7f4930199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.543+0000 7f4934fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49301006e0 0x7f4930199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.543+0000 7f4934fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301010a0 0x7f49301a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.543+0000 7f4934fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49301a1050 con 0x7f49301010a0 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.543+0000 7f4934fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49301a1190 con 0x7f49301006e0 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.543+0000 7f4934fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49301a1320 con 0x7f49300ffd80 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301010a0 0x7f49301a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301010a0 0x7f49301a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60086/0 (socket says 172.21.15.12:60086) 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49300ffd80 0x7f4930199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492ed9d700 1 -- 172.21.15.12:0/2956512838 learned_addr learned my addr 172.21.15.12:0/2956512838 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492dd9b700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49301006e0 0x7f4930199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492ed9d700 1 -- 172.21.15.12:0/2956512838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49300ffd80 msgr2=0x7f4930199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492ed9d700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49300ffd80 0x7f4930199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492ed9d700 1 -- 172.21.15.12:0/2956512838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49301006e0 msgr2=0x7f4930199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492ed9d700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49301006e0 0x7f4930199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.544+0000 7f492ed9d700 1 -- 172.21.15.12:0/2956512838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240095f0 con 0x7f49301010a0 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.545+0000 7f492ed9d700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301010a0 0x7f49301a0a80 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f492800ef30 tx=0x7f492800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.545+0000 7f491f7fe700 1 -- 172.21.15.12:0/2956512838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928018070 con 0x7f49301010a0 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.545+0000 7f491f7fe700 1 -- 172.21.15.12:0/2956512838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f492800f040 con 0x7f49301010a0 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.545+0000 7f491f7fe700 1 -- 172.21.15.12:0/2956512838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492800cbc0 con 0x7f49301010a0 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.545+0000 7f4934fff700 1 -- 172.21.15.12:0/2956512838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49301a15a0 con 0x7f49301010a0 2023-12-11T20:24:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.545+0000 7f4934fff700 1 -- 172.21.15.12:0/2956512838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49301a1a60 con 0x7f49301010a0 2023-12-11T20:24:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.549+0000 7f491f7fe700 1 -- 172.21.15.12:0/2956512838 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4928007500 con 0x7f49301010a0 2023-12-11T20:24:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.550+0000 7f4948939b80 1 Processor -- start 2023-12-11T20:24:39.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.550+0000 7f4948939b80 1 -- start start 2023-12-11T20:24:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.550+0000 7f4948939b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.550+0000 7f4948939b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.550+0000 7f4948939b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.550+0000 7f4948939b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559725202b50 con 0x5597252a73d0 2023-12-11T20:24:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f4948939b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559725200470 con 0x5597252a8c20 2023-12-11T20:24:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f4948939b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597251fbd60 con 0x5597252a7d30 2023-12-11T20:24:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f491f7fe700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49180a1500 0x7f49180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f492e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f492dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f492e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46138/0 (socket says 172.21.15.12:46138) 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f492e59c700 1 -- 172.21.15.12:0/362915789 learned_addr learned my addr 172.21.15.12:0/362915789 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f491f7fe700 1 -- 172.21.15.12:0/2956512838 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f49280cc790 con 0x7f49301010a0 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f492ed9d700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49180a1500 0x7f49180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f492dd9b700 1 --2- 172.21.15.12:0/362915789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f492e59c700 1 -- 172.21.15.12:0/362915789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 msgr2=0x5597252a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.551+0000 7f492e59c700 1 --2- 172.21.15.12:0/362915789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252a90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.552+0000 7f492e59c700 1 -- 172.21.15.12:0/362915789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 msgr2=0x5597252a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.552+0000 7f492e59c700 1 --2- 172.21.15.12:0/362915789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252a77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.552+0000 7f492e59c700 1 -- 172.21.15.12:0/362915789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559725078630 con 0x5597252a7d30 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.552+0000 7f492ed9d700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49180a1500 0x7f49180a39c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4928009c10 tx=0x7f4928009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.552+0000 7f492e59c700 1 --2- 172.21.15.12:0/362915789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252a8640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4920009d80 tx=0x7f4920011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f20433fe1bd81ab server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.552+0000 7f491cff9700 1 -- 172.21.15.12:0/362915789 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920004230 con 0x5597252a7d30 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.552+0000 7f491cff9700 1 -- 172.21.15.12:0/362915789 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4920004390 con 0x5597252a7d30 2023-12-11T20:24:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.552+0000 7f491cff9700 1 -- 172.21.15.12:0/362915789 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920019800 con 0x5597252a7d30 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 -- 172.21.15.12:0/362915789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 msgr2=0x5597252a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 --2- 172.21.15.12:0/362915789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252a8640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4920009d80 tx=0x7f4920011720 comp rx=0 tx=0).stop 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 -- 172.21.15.12:0/362915789 shutdown_connections 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 --2- 172.21.15.12:0/362915789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 --2- 172.21.15.12:0/362915789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 --2- 172.21.15.12:0/362915789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252a8640 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 -- 172.21.15.12:0/362915789 >> 172.21.15.12:0/362915789 conn(0x5597251d67e0 msgr2=0x5597252a3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 -- 172.21.15.12:0/362915789 shutdown_connections 2023-12-11T20:24:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.553+0000 7f4948939b80 1 -- 172.21.15.12:0/362915789 wait complete. 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.554+0000 7f4948939b80 1 -- start start 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.554+0000 7f4948939b80 1 Processor -- start 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f4948939b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a73d0 0x5597252b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f4948939b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f4948939b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a8c20 0x5597252b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f4948939b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597251b5560 con 0x5597252a7d30 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f4948939b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597251b5200 con 0x5597252a73d0 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f4948939b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55972507a920 con 0x5597252a8c20 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f4948939b80 10 client.0 _ll_register_callbacks cb 0x5597250e0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f492e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f492e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60116/0 (socket says 172.21.15.12:60116) 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f492e59c700 1 -- 172.21.15.12:0/1882402129 learned_addr learned my addr 172.21.15.12:0/1882402129 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f492dd9b700 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a8c20 0x5597252b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.555+0000 7f492dd9b700 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a73d0 0x5597252b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f492dd9b700 1 -- 172.21.15.12:0/1882402129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a73d0 msgr2=0x5597252b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f492dd9b700 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a73d0 0x5597252b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f492dd9b700 1 -- 172.21.15.12:0/1882402129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 msgr2=0x5597252b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f492dd9b700 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f492dd9b700 1 -- 172.21.15.12:0/1882402129 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49200099e0 con 0x5597252a8c20 2023-12-11T20:24:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f492e59c700 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f492dd9b700 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a8c20 0x5597252b8750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4924000c00 tx=0x7f4924003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca559336473d15 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f4915ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:24:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f4915ffb700 1 -- 172.21.15.12:0/1882402129 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924003820 con 0x5597252a8c20 2023-12-11T20:24:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f4948939b80 1 -- 172.21.15.12:0/1882402129 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55972529ab40 con 0x5597252a8c20 2023-12-11T20:24:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.556+0000 7f4915ffb700 1 -- 172.21.15.12:0/1882402129 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4924003980 con 0x5597252a8c20 2023-12-11T20:24:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4915ffb700 1 -- 172.21.15.12:0/1882402129 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4924005710 con 0x5597252a8c20 2023-12-11T20:24:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4948939b80 10 client.27655 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4948939b80 1 -- 172.21.15.12:0/1882402129 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559725024de0 con 0x5597252a8c20 2023-12-11T20:24:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4915ffb700 1 -- 172.21.15.12:0/1882402129 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55972529ab40 con 0x5597252a8c20 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4915ffb700 1 -- 172.21.15.12:0/1882402129 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4924023040 con 0x5597252a8c20 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4948939b80 10 client.27655 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4948939b80 10 client.27655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4948939b80 20 client.27655 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4948939b80 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5597252bcf20 0x5597252bf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4948939b80 4 client.27655 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.557+0000 7f4948939b80 1 -- 172.21.15.12:0/1882402129 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559725276f40 con 0x5597252bcf20 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.558+0000 7f492e59c700 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5597252bcf20 0x5597252bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.558+0000 7f492e59c700 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5597252bcf20 0x5597252bf340 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f4c5576bbcd0b91 server_cookie=4b93b8236feeb8e2 in_seq=0 out_seq=0 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.558+0000 7f4915ffb700 10 client.27655 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.559+0000 7f4915ffb700 1 -- 172.21.15.12:0/1882402129 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559725276f40 con 0x5597252bcf20 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.559+0000 7f4915ffb700 10 client.27655 handle_command_reply: tid=0 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.559+0000 7f4948939b80 1 client.27655 shutdown 2023-12-11T20:24:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 -- 172.21.15.12:0/1882402129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a8c20 msgr2=0x5597252b8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a8c20 0x5597252b8750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4924000c00 tx=0x7f4924003680 comp rx=0 tx=0).stop 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 -- 172.21.15.12:0/1882402129 shutdown_connections 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5597252bcf20 0x5597252bf340 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a73d0 0x5597252b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4915ffb700 0 client.27655 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a8c20 0x5597252b8750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 --2- 172.21.15.12:0/1882402129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 -- 172.21.15.12:0/1882402129 >> 172.21.15.12:0/1882402129 conn(0x5597251d67e0 msgr2=0x5597252a2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 -- 172.21.15.12:0/1882402129 shutdown_connections 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 1 -- 172.21.15.12:0/1882402129 wait complete. 2023-12-11T20:24:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.560+0000 7f4948939b80 20 client.27655 trim_cache size 0 max 16384 2023-12-11T20:24:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:39 smithi012 ceph-mon[128787]: pgmap v637: 97 pgs: 97 active+clean; 6.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:39 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:39 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:39 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:39 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f4948939b80 1 Processor -- start 2023-12-11T20:24:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f4948939b80 1 -- start start 2023-12-11T20:24:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f4948939b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f4948939b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252b8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f4948939b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252abb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f4948939b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597252a8110 con 0x5597252a73d0 2023-12-11T20:24:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f4948939b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597252c4570 con 0x5597252a8c20 2023-12-11T20:24:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f4948939b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597252b23c0 con 0x5597252a7d30 2023-12-11T20:24:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f492dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f492dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60128/0 (socket says 172.21.15.12:60128) 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f492dd9b700 1 -- 172.21.15.12:0/1920761442 learned_addr learned my addr 172.21.15.12:0/1920761442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.584+0000 7f492e59c700 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.585+0000 7f492dd9b700 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.585+0000 7f492e59c700 1 -- 172.21.15.12:0/1920761442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 msgr2=0x5597252abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.585+0000 7f492e59c700 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.585+0000 7f492e59c700 1 -- 172.21.15.12:0/1920761442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 msgr2=0x5597252afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.585+0000 7f492e59c700 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.585+0000 7f492e59c700 1 -- 172.21.15.12:0/1920761442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55972500dc60 con 0x5597252a7d30 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.585+0000 7f492dd9b700 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.585+0000 7f492e59c700 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252b8710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4920009770 tx=0x7f4920011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1192c379ae74014c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.586+0000 7f491d7fa700 1 -- 172.21.15.12:0/1920761442 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920029040 con 0x5597252a7d30 2023-12-11T20:24:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.586+0000 7f491d7fa700 1 -- 172.21.15.12:0/1920761442 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4920009ed0 con 0x5597252a7d30 2023-12-11T20:24:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.586+0000 7f491d7fa700 1 -- 172.21.15.12:0/1920761442 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920005330 con 0x5597252a7d30 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.586+0000 7f4948939b80 1 -- 172.21.15.12:0/1920761442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 msgr2=0x5597252b8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.586+0000 7f4948939b80 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252b8710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4920009770 tx=0x7f4920011720 comp rx=0 tx=0).stop 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 -- 172.21.15.12:0/1920761442 shutdown_connections 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a73d0 0x5597252afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 --2- 172.21.15.12:0/1920761442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a7d30 0x5597252b8710 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 -- 172.21.15.12:0/1920761442 >> 172.21.15.12:0/1920761442 conn(0x5597251d67e0 msgr2=0x5597252b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 -- 172.21.15.12:0/1920761442 shutdown_connections 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 -- 172.21.15.12:0/1920761442 wait complete. 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 -- start start 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.587+0000 7f4948939b80 1 Processor -- start 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f4948939b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a73d0 0x5597252b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f4948939b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f4948939b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f4948939b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597252b7c70 con 0x5597252a7d30 2023-12-11T20:24:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f4948939b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597252b7de0 con 0x5597252a8c20 2023-12-11T20:24:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f4948939b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597252b7fa0 con 0x5597252a73d0 2023-12-11T20:24:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f4948939b80 10 client.0 _ll_register_callbacks cb 0x5597250e0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f492e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f492e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60136/0 (socket says 172.21.15.12:60136) 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f492e59c700 1 -- 172.21.15.12:0/2094635507 learned_addr learned my addr 172.21.15.12:0/2094635507 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f492dd9b700 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a73d0 0x5597252b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.588+0000 7f492dd9b700 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f492e59c700 1 -- 172.21.15.12:0/2094635507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a73d0 msgr2=0x5597252b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f492e59c700 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a73d0 0x5597252b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f492e59c700 1 -- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 msgr2=0x5597252b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f492e59c700 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f492e59c700 1 -- 172.21.15.12:0/2094635507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559725024de0 con 0x5597252a7d30 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f492dd9b700 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f492e59c700 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b4760 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f4920009710 tx=0x7f4920003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d3a6f63da1e2fd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f4915ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f4915ffb700 1 -- 172.21.15.12:0/2094635507 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920029070 con 0x5597252a7d30 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f4948939b80 1 -- 172.21.15.12:0/2094635507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4920004390 con 0x5597252a7d30 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.589+0000 7f4915ffb700 1 -- 172.21.15.12:0/2094635507 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f49200050b0 con 0x5597252a7d30 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4915ffb700 1 -- 172.21.15.12:0/2094635507 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4920005270 con 0x5597252a7d30 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4948939b80 10 client.18027 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4948939b80 1 -- 172.21.15.12:0/2094635507 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559725078630 con 0x5597252a7d30 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4915ffb700 1 -- 172.21.15.12:0/2094635507 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4920004390 con 0x5597252a7d30 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4915ffb700 1 -- 172.21.15.12:0/2094635507 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4920011440 con 0x5597252a7d30 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4948939b80 10 client.18027 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4948939b80 10 client.18027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4948939b80 20 client.18027 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4948939b80 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559725313d60 0x559725316180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4948939b80 4 client.18027 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:24:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.590+0000 7f4948939b80 1 -- 172.21.15.12:0/2094635507 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5597251c1fd0 con 0x559725313d60 2023-12-11T20:24:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.591+0000 7f492dd9b700 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559725313d60 0x559725316180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:39.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.591+0000 7f492dd9b700 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559725313d60 0x559725316180 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b57de00fe0265a4 server_cookie=fbda071e5eae7eca in_seq=0 out_seq=0 2023-12-11T20:24:39.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.591+0000 7f4915ffb700 10 client.18027 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:39.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4915ffb700 1 -- 172.21.15.12:0/2094635507 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5597251c1fd0 con 0x559725313d60 2023-12-11T20:24:39.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4915ffb700 10 client.18027 handle_command_reply: tid=0 2023-12-11T20:24:39.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 client.18027 shutdown 2023-12-11T20:24:39.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 -- 172.21.15.12:0/2094635507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 msgr2=0x5597252b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b4760 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f4920009710 tx=0x7f4920003680 comp rx=0 tx=0).stop 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 -- 172.21.15.12:0/2094635507 shutdown_connections 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559725313d60 0x559725316180 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597252a8c20 0x5597252b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597252a73d0 0x5597252b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 --2- 172.21.15.12:0/2094635507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597252a7d30 0x5597252b4760 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 -- 172.21.15.12:0/2094635507 >> 172.21.15.12:0/2094635507 conn(0x5597251d67e0 msgr2=0x5597252a3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4915ffb700 0 client.18027 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 -- 172.21.15.12:0/2094635507 shutdown_connections 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 1 -- 172.21.15.12:0/2094635507 wait complete. 2023-12-11T20:24:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.592+0000 7f4948939b80 20 client.18027 trim_cache size 0 max 16384 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "b4528837-6184-43cd-a137-10da0d45c6e3": { 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "b4528837-6184-43cd-a137-10da0d45c6e3", 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:24:39.595 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:24:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 -- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49180a1500 msgr2=0x7f49180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49180a1500 0x7f49180a39c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4928009c10 tx=0x7f4928009040 comp rx=0 tx=0).stop 2023-12-11T20:24:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 -- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301010a0 msgr2=0x7f49301a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301010a0 0x7f49301a0a80 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f492800ef30 tx=0x7f492800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 -- 172.21.15.12:0/2956512838 shutdown_connections 2023-12-11T20:24:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49180a1500 0x7f49180a39c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49301010a0 0x7f49301a0a80 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49300ffd80 0x7f4930199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 --2- 172.21.15.12:0/2956512838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49301006e0 0x7f4930199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:39.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 -- 172.21.15.12:0/2956512838 >> 172.21.15.12:0/2956512838 conn(0x7f49300fb920 msgr2=0x7f49300fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:39.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 -- 172.21.15.12:0/2956512838 shutdown_connections 2023-12-11T20:24:39.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:24:39.593+0000 7f4934fff700 1 -- 172.21.15.12:0/2956512838 wait complete. 2023-12-11T20:24:39.613 INFO:tasks.cephfs.filesystem:scrub status for tag:b4528837-6184-43cd-a137-10da0d45c6e3 - {'path': '/', 'tag': 'b4528837-6184-43cd-a137-10da0d45c6e3', 'options': 'recursive,force'} 2023-12-11T20:24:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:39 smithi032 ceph-mon[132488]: pgmap v637: 97 pgs: 97 active+clean; 6.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:39 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:39 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:39 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:39 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:39.713 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:24:39 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:24:39.273+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v178>,<0x10000000003/client.0 v180>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v197>,<0x10000000001/sv_0 v221>,<0x10000000000/_nogroup v205>,<0x1/volumes v197>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:24:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:39 smithi039 ceph-mon[102205]: pgmap v637: 97 pgs: 97 active+clean; 6.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:24:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:39 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:39 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:39 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:39.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:39 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:40 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:24:40.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:40.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:40.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:40.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:24:40.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:24:40.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:40 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:24:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:40.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:24:40.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:24:40.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:40.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:40 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:24:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:41 smithi032 ceph-mon[132488]: pgmap v638: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 20 op/s 2023-12-11T20:24:41.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:41 smithi039 ceph-mon[102205]: pgmap v638: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 20 op/s 2023-12-11T20:24:41.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:41 smithi012 ceph-mon[128787]: pgmap v638: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 20 op/s 2023-12-11T20:24:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:43 smithi039 ceph-mon[102205]: pgmap v639: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 30 op/s 2023-12-11T20:24:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:43 smithi012 ceph-mon[128787]: pgmap v639: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 30 op/s 2023-12-11T20:24:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:43 smithi032 ceph-mon[132488]: pgmap v639: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 30 op/s 2023-12-11T20:24:45.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:45 smithi039 ceph-mon[102205]: pgmap v640: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:24:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:45 smithi012 ceph-mon[128787]: pgmap v640: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:24:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:45 smithi032 ceph-mon[132488]: pgmap v640: 97 pgs: 97 active+clean; 6.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 -- 172.21.15.12:0/3949395798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 msgr2=0x7f4b0c104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 --2- 172.21.15.12:0/3949395798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 0x7f4b0c104330 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009990 tx=0x7f4b08009ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 -- 172.21.15.12:0/3949395798 shutdown_connections 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 --2- 172.21.15.12:0/3949395798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b0c1071a0 0x7f4b0c109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 --2- 172.21.15.12:0/3949395798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 0x7f4b0c104330 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 --2- 172.21.15.12:0/3949395798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c104870 0x7f4b0c106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 -- 172.21.15.12:0/3949395798 >> 172.21.15.12:0/3949395798 conn(0x7f4b0c0fb930 msgr2=0x7f4b0c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 -- 172.21.15.12:0/3949395798 shutdown_connections 2023-12-11T20:24:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.695+0000 7f4b143ff700 1 -- 172.21.15.12:0/3949395798 wait complete. 2023-12-11T20:24:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.696+0000 7f4b143ff700 1 Processor -- start 2023-12-11T20:24:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b143ff700 1 -- start start 2023-12-11T20:24:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b143ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 0x7f4b0c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b143ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c104870 0x7f4b0c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b143ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b0c1071a0 0x7f4b0c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b143ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c19ee30 con 0x7f4b0c101f40 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b143ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c19ef70 con 0x7f4b0c1071a0 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b143ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c19f100 con 0x7f4b0c104870 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b1219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 0x7f4b0c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b1219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 0x7f4b0c197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60168/0 (socket says 172.21.15.12:60168) 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b1219b700 1 -- 172.21.15.12:0/765012055 learned_addr learned my addr 172.21.15.12:0/765012055 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b1299c700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b0c1071a0 0x7f4b0c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.697+0000 7f4b1199a700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c104870 0x7f4b0c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b1219b700 1 -- 172.21.15.12:0/765012055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c104870 msgr2=0x7f4b0c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b1219b700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c104870 0x7f4b0c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b1219b700 1 -- 172.21.15.12:0/765012055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b0c1071a0 msgr2=0x7f4b0c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b1219b700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b0c1071a0 0x7f4b0c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b1219b700 1 -- 172.21.15.12:0/765012055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b080095f0 con 0x7f4b0c101f40 2023-12-11T20:24:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b1219b700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 0x7f4b0c197300 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4b08006010 tx=0x7f4b08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b037fe700 1 -- 172.21.15.12:0/765012055 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0801d070 con 0x7f4b0c101f40 2023-12-11T20:24:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b037fe700 1 -- 172.21.15.12:0/765012055 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b0800bdb0 con 0x7f4b0c101f40 2023-12-11T20:24:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b037fe700 1 -- 172.21.15.12:0/765012055 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800fda0 con 0x7f4b0c101f40 2023-12-11T20:24:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.698+0000 7f4b143ff700 1 -- 172.21.15.12:0/765012055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c19f380 con 0x7f4b0c101f40 2023-12-11T20:24:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.699+0000 7f4b143ff700 1 -- 172.21.15.12:0/765012055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c19f7a0 con 0x7f4b0c101f40 2023-12-11T20:24:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.702+0000 7f4b037fe700 1 -- 172.21.15.12:0/765012055 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4b0800f460 con 0x7f4b0c101f40 2023-12-11T20:24:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.703+0000 7f4b27e07b80 1 Processor -- start 2023-12-11T20:24:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.703+0000 7f4b27e07b80 1 -- start start 2023-12-11T20:24:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0a3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584ceffdaf0 con 0x5584cf0a3720 2023-12-11T20:24:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584ceffb410 con 0x5584cf0a2830 2023-12-11T20:24:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584ceff6d00 con 0x5584cf0a1ed0 2023-12-11T20:24:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b1299c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b1299c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46196/0 (socket says 172.21.15.12:46196) 2023-12-11T20:24:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b1299c700 1 -- 172.21.15.12:0/3610016032 learned_addr learned my addr 172.21.15.12:0/3610016032 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b1199a700 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.704+0000 7f4b037fe700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4af80a14f0 0x7f4af80a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.705+0000 7f4b1219b700 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.705+0000 7f4b037fe700 1 -- 172.21.15.12:0/765012055 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4b080cdff0 con 0x7f4b0c101f40 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.705+0000 7f4b1299c700 1 -- 172.21.15.12:0/3610016032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 msgr2=0x5584cf0a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.705+0000 7f4b1299c700 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0a3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.705+0000 7f4b1299c700 1 -- 172.21.15.12:0/3610016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 msgr2=0x5584cf0a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.705+0000 7f4b1299c700 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.705+0000 7f4b1299c700 1 -- 172.21.15.12:0/3610016032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584cee735d0 con 0x5584cf0a1ed0 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.705+0000 7f4b1199a700 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.706+0000 7f4b1299c700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4af80a14f0 0x7f4af80a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.706+0000 7f4b1299c700 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a22f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b04013b20 tx=0x7f4b04013e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bdc577d8e784a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.706+0000 7f4b00bfe700 1 -- 172.21.15.12:0/3610016032 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04024030 con 0x5584cf0a1ed0 2023-12-11T20:24:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.706+0000 7f4b1299c700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4af80a14f0 0x7f4af80a39b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4b04024000 tx=0x7f4b04021000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.707+0000 7f4b00bfe700 1 -- 172.21.15.12:0/3610016032 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b0400f040 con 0x5584cf0a1ed0 2023-12-11T20:24:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.707+0000 7f4b00bfe700 1 -- 172.21.15.12:0/3610016032 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400e040 con 0x5584cf0a1ed0 2023-12-11T20:24:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3610016032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 msgr2=0x5584cf0a22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a22f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b04013b20 tx=0x7f4b04013e30 comp rx=0 tx=0).stop 2023-12-11T20:24:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3610016032 shutdown_connections 2023-12-11T20:24:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a22f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3610016032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0a3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3610016032 >> 172.21.15.12:0/3610016032 conn(0x5584cefd1780 msgr2=0x5584cf09e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3610016032 shutdown_connections 2023-12-11T20:24:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.708+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3610016032 wait complete. 2023-12-11T20:24:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.709+0000 7f4b27e07b80 1 -- start start 2023-12-11T20:24:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.709+0000 7f4b27e07b80 1 Processor -- start 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.709+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.709+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.709+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.709+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cefb0500 con 0x5584cf0a3720 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cefb01a0 con 0x5584cf0a2830 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cee758c0 con 0x5584cf0a1ed0 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b27e07b80 10 client.0 _ll_register_callbacks cb 0x5584ceedba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1299c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1299c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60188/0 (socket says 172.21.15.12:60188) 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1299c700 1 -- 172.21.15.12:0/3697493143 learned_addr learned my addr 172.21.15.12:0/3697493143 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1219b700 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1199a700 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1299c700 1 -- 172.21.15.12:0/3697493143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 msgr2=0x5584cf0abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1299c700 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1299c700 1 -- 172.21.15.12:0/3697493143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 msgr2=0x5584cf0ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1299c700 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.710+0000 7f4b1299c700 1 -- 172.21.15.12:0/3697493143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc0098e0 con 0x5584cf0a3720 2023-12-11T20:24:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.711+0000 7f4b1299c700 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b3260 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4b040094f0 tx=0x7f4b04007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ec6311cb0744d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.711+0000 7f4af5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.711+0000 7f4af5ffb700 1 -- 172.21.15.12:0/3697493143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04004cd0 con 0x5584cf0a3720 2023-12-11T20:24:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.711+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3697493143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584cf095730 con 0x5584cf0a3720 2023-12-11T20:24:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.711+0000 7f4af5ffb700 1 -- 172.21.15.12:0/3697493143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4b04025070 con 0x5584cf0a3720 2023-12-11T20:24:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4af5ffb700 1 -- 172.21.15.12:0/3697493143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b04004e30 con 0x5584cf0a3720 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4b27e07b80 10 client.18039 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3697493143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f4b04013710 con 0x5584cf0a3720 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4af5ffb700 1 -- 172.21.15.12:0/3697493143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5584cf095730 con 0x5584cf0a3720 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4af5ffb700 1 -- 172.21.15.12:0/3697493143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4b04004610 con 0x5584cf0a3720 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4b27e07b80 10 client.18039 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4b27e07b80 10 client.18039 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4b27e07b80 20 client.18039 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584cf0b7d20 0x5584cf0ba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4b27e07b80 4 client.18039 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.712+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3697493143 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584cf071ee0 con 0x5584cf0b7d20 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.713+0000 7f4b1219b700 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584cf0b7d20 0x5584cf0ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.714+0000 7f4b1219b700 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584cf0b7d20 0x5584cf0ba140 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863fafa2654b0013 server_cookie=51a528ac1d8f2010 in_seq=0 out_seq=0 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.714+0000 7f4af5ffb700 10 client.18039 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.714+0000 7f4af5ffb700 1 -- 172.21.15.12:0/3697493143 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5584cf071ee0 con 0x5584cf0b7d20 2023-12-11T20:24:46.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.714+0000 7f4af5ffb700 10 client.18039 handle_command_reply: tid=0 2023-12-11T20:24:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.714+0000 7f4b27e07b80 1 client.18039 shutdown 2023-12-11T20:24:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3697493143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 msgr2=0x5584cf0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b3260 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4b040094f0 tx=0x7f4b04007d50 comp rx=0 tx=0).stop 2023-12-11T20:24:46.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3697493143 shutdown_connections 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584cf0b7d20 0x5584cf0ba140 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b3260 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3697493143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4af5ffb700 0 client.18039 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3697493143 >> 172.21.15.12:0/3697493143 conn(0x5584cefd1780 msgr2=0x5584cf09cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3697493143 shutdown_connections 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3697493143 wait complete. 2023-12-11T20:24:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.715+0000 7f4b27e07b80 20 client.18039 trim_cache size 0 max 16384 2023-12-11T20:24:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.732+0000 7f4b27e07b80 1 Processor -- start 2023-12-11T20:24:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.732+0000 7f4b27e07b80 1 -- start start 2023-12-11T20:24:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.732+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.732+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.732+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a3720 0x5584cf0ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.732+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cf0bf310 con 0x5584cf0a1ed0 2023-12-11T20:24:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.732+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cf099860 con 0x5584cf0a2830 2023-12-11T20:24:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.732+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cf0a2f30 con 0x5584cf0a3720 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60200/0 (socket says 172.21.15.12:60200) 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 -- 172.21.15.12:0/3043366800 learned_addr learned my addr 172.21.15.12:0/3043366800 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1299c700 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a3720 0x5584cf0ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1199a700 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 -- 172.21.15.12:0/3043366800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a3720 msgr2=0x5584cf0ab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a3720 0x5584cf0ab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 -- 172.21.15.12:0/3043366800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 msgr2=0x5584cf0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 -- 172.21.15.12:0/3043366800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584cee1fd80 con 0x5584cf0a1ed0 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1199a700 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.733+0000 7f4b1219b700 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a3b00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4b08005950 tx=0x7f4b0806d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729a4727930385b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.734+0000 7f4b013ff700 1 -- 172.21.15.12:0/3043366800 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08083070 con 0x5584cf0a1ed0 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.734+0000 7f4b013ff700 1 -- 172.21.15.12:0/3043366800 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b0809ac90 con 0x5584cf0a1ed0 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.734+0000 7f4b013ff700 1 -- 172.21.15.12:0/3043366800 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0809f510 con 0x5584cf0a1ed0 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.734+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3043366800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a1ed0 msgr2=0x5584cf0a3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.734+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a3b00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4b08005950 tx=0x7f4b0806d240 comp rx=0 tx=0).stop 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3043366800 shutdown_connections 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a3720 0x5584cf0ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a1ed0 0x5584cf0a3b00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/3043366800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3043366800 >> 172.21.15.12:0/3043366800 conn(0x5584cefd1780 msgr2=0x5584cf0a9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3043366800 shutdown_connections 2023-12-11T20:24:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 -- 172.21.15.12:0/3043366800 wait complete. 2023-12-11T20:24:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 -- start start 2023-12-11T20:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.735+0000 7f4b27e07b80 1 Processor -- start 2023-12-11T20:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b27e07b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cf0b29c0 con 0x5584cf0a3720 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cf0b2b30 con 0x5584cf0a2830 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b27e07b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cf0b2cf0 con 0x5584cf0a1ed0 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b27e07b80 10 client.0 _ll_register_callbacks cb 0x5584ceedba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b1299c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b1299c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60216/0 (socket says 172.21.15.12:60216) 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b1299c700 1 -- 172.21.15.12:0/2167181228 learned_addr learned my addr 172.21.15.12:0/2167181228 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b1219b700 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.736+0000 7f4b1199a700 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b1299c700 1 -- 172.21.15.12:0/2167181228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 msgr2=0x5584cf0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b1299c700 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b1299c700 1 -- 172.21.15.12:0/2167181228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 msgr2=0x5584cf0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b1299c700 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b1299c700 1 -- 172.21.15.12:0/2167181228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c19f7a0 con 0x5584cf0a3720 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b1299c700 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b2480 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4b040078e0 tx=0x7f4b04007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f77ed53d72fa03 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4af5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4af5ffb700 1 -- 172.21.15.12:0/2167181228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0401fd20 con 0x5584cf0a3720 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b27e07b80 1 -- 172.21.15.12:0/2167181228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b0400f040 con 0x5584cf0a3720 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4af5ffb700 1 -- 172.21.15.12:0/2167181228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4b04004a70 con 0x5584cf0a3720 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4af5ffb700 1 -- 172.21.15.12:0/2167181228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b0401fe80 con 0x5584cf0a3720 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b27e07b80 10 client.18045 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.737+0000 7f4b27e07b80 1 -- 172.21.15.12:0/2167181228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5584cee08c00 con 0x5584cf0a3720 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4af5ffb700 1 -- 172.21.15.12:0/2167181228 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b04049020 con 0x5584cf0a3720 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4af5ffb700 1 -- 172.21.15.12:0/2167181228 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4b04042030 con 0x5584cf0a3720 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4b27e07b80 10 client.18045 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4b27e07b80 10 client.18045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4b27e07b80 20 client.18045 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584cf10ed20 0x5584cf111140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4b27e07b80 4 client.18045 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4b27e07b80 1 -- 172.21.15.12:0/2167181228 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5584cefbcf70 con 0x5584cf10ed20 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.738+0000 7f4b1219b700 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584cf10ed20 0x5584cf111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.739+0000 7f4b1219b700 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584cf10ed20 0x5584cf111140 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3f1ce6ac08a384b server_cookie=b951ac8a5ce98ad1 in_seq=0 out_seq=0 2023-12-11T20:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.739+0000 7f4af5ffb700 10 client.18045 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.748+0000 7f4af5ffb700 1 -- 172.21.15.12:0/2167181228 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5584cefbcf70 con 0x5584cf10ed20 2023-12-11T20:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.748+0000 7f4af5ffb700 10 client.18045 handle_command_reply: tid=0 2023-12-11T20:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.748+0000 7f4b27e07b80 1 client.18045 shutdown 2023-12-11T20:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 -- 172.21.15.12:0/2167181228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 msgr2=0x5584cf0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b2480 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4b040078e0 tx=0x7f4b04007ca0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 -- 172.21.15.12:0/2167181228 shutdown_connections 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5584cf10ed20 0x5584cf111140 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584cf0a3720 0x5584cf0b2480 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5584cf0a1ed0 0x5584cf0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 --2- 172.21.15.12:0/2167181228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5584cf0a2830 0x5584cf0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 -- 172.21.15.12:0/2167181228 >> 172.21.15.12:0/2167181228 conn(0x5584cefd1780 msgr2=0x5584cf09e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4af5ffb700 0 client.18045 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 -- 172.21.15.12:0/2167181228 shutdown_connections 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 1 -- 172.21.15.12:0/2167181228 wait complete. 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.749+0000 7f4b27e07b80 20 client.18045 trim_cache size 0 max 16384 2023-12-11T20:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:24:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:24:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:24:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:24:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 -- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4af80a14f0 msgr2=0x7f4af80a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4af80a14f0 0x7f4af80a39b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4b04024000 tx=0x7f4b04021000 comp rx=0 tx=0).stop 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 -- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 msgr2=0x7f4b0c197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 0x7f4b0c197300 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4b08006010 tx=0x7f4b08004730 comp rx=0 tx=0).stop 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 -- 172.21.15.12:0/765012055 shutdown_connections 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4af80a14f0 0x7f4af80a39b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b0c1071a0 0x7f4b0c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b0c101f40 0x7f4b0c197300 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 --2- 172.21.15.12:0/765012055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b0c104870 0x7f4b0c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 -- 172.21.15.12:0/765012055 >> 172.21.15.12:0/765012055 conn(0x7f4b0c0fb930 msgr2=0x7f4b0c103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.750+0000 7f4b143ff700 1 -- 172.21.15.12:0/765012055 shutdown_connections 2023-12-11T20:24:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:46.751+0000 7f4b143ff700 1 -- 172.21.15.12:0/765012055 wait complete. 2023-12-11T20:24:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:47 smithi039 ceph-mon[102205]: pgmap v641: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:24:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:47 smithi012 ceph-mon[128787]: pgmap v641: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:24:47.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:47 smithi032 ceph-mon[132488]: pgmap v641: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:24:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:49 smithi032 ceph-mon[132488]: pgmap v642: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:24:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:49 smithi039 ceph-mon[102205]: pgmap v642: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:24:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:49 smithi012 ceph-mon[128787]: pgmap v642: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:24:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:51 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:24:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:51 smithi039 ceph-mon[102205]: pgmap v643: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:24:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:51 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:24:51.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:51 smithi012 ceph-mon[128787]: pgmap v643: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:24:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:51 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:24:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:51 smithi032 ceph-mon[132488]: pgmap v643: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 31 op/s 2023-12-11T20:24:52.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:52 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:24:52.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:52 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:24:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:52 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:24:52.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:52 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:24:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:52 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:24:52.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:52 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:24:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:53 smithi039 ceph-mon[102205]: pgmap v644: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:24:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:53 smithi012 ceph-mon[128787]: pgmap v644: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:24:53.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:53 smithi032 ceph-mon[132488]: pgmap v644: 97 pgs: 97 active+clean; 6.4 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:24:55.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:55 smithi039 ceph-mon[102205]: pgmap v645: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:24:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:55 smithi012 ceph-mon[128787]: pgmap v645: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:24:55.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:55 smithi032 ceph-mon[132488]: pgmap v645: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:24:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:57 smithi039 ceph-mon[102205]: pgmap v646: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:24:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:57 smithi012 ceph-mon[128787]: pgmap v646: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:24:57.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:57 smithi032 ceph-mon[132488]: pgmap v646: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:24:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:24:59 smithi032 ceph-mon[132488]: pgmap v647: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:59.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:24:59 smithi039 ceph-mon[102205]: pgmap v647: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:59.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:24:59 smithi012 ceph-mon[128787]: pgmap v647: 97 pgs: 97 active+clean; 6.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:24:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 -- 172.21.15.12:0/3508120923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 msgr2=0x7f18cc1054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 --2- 172.21.15.12:0/3508120923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 0x7f18cc1054f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f18c400b0a0 tx=0x7f18c400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 -- 172.21.15.12:0/3508120923 shutdown_connections 2023-12-11T20:24:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 --2- 172.21.15.12:0/3508120923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 0x7f18cc1054f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 --2- 172.21.15.12:0/3508120923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18cc0ffd30 0x7f18cc102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 --2- 172.21.15.12:0/3508120923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18cc1026a0 0x7f18cc104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 -- 172.21.15.12:0/3508120923 >> 172.21.15.12:0/3508120923 conn(0x7f18cc0fb930 msgr2=0x7f18cc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 -- 172.21.15.12:0/3508120923 shutdown_connections 2023-12-11T20:24:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.928+0000 7f18d25ff700 1 -- 172.21.15.12:0/3508120923 wait complete. 2023-12-11T20:24:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.929+0000 7f18d25ff700 1 Processor -- start 2023-12-11T20:24:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.929+0000 7f18d25ff700 1 -- start start 2023-12-11T20:24:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.929+0000 7f18d25ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18cc0ffd30 0x7f18cc19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.929+0000 7f18d25ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18cc1026a0 0x7f18cc19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.929+0000 7f18d25ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 0x7f18cc1a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d25ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc1a5570 con 0x7f18cc105070 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d25ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc1a56b0 con 0x7f18cc1026a0 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d25ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc1a5840 con 0x7f18cc0ffd30 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18cc0ffd30 0x7f18cc19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18cc1026a0 0x7f18cc19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18cbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18cc0ffd30 0x7f18cc19da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:42376/0 (socket says 172.21.15.12:42376) 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18cbfff700 1 -- 172.21.15.12:0/119692983 learned_addr learned my addr 172.21.15.12:0/119692983 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 0x7f18cc1a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d0b9c700 1 -- 172.21.15.12:0/119692983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18cc0ffd30 msgr2=0x7f18cc19da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18cc0ffd30 0x7f18cc19da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d0b9c700 1 -- 172.21.15.12:0/119692983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18cc1026a0 msgr2=0x7f18cc19dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18cc1026a0 0x7f18cc19dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18d0b9c700 1 -- 172.21.15.12:0/119692983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4009d00 con 0x7f18cc105070 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.930+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18cc1026a0 0x7f18cc19dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.931+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 0x7f18cc1a4fa0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f18c4007b60 tx=0x7f18c4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.931+0000 7f18c97fa700 1 -- 172.21.15.12:0/119692983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400e040 con 0x7f18cc105070 2023-12-11T20:24:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.931+0000 7f18c97fa700 1 -- 172.21.15.12:0/119692983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18c4003e90 con 0x7f18cc105070 2023-12-11T20:24:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.931+0000 7f18d25ff700 1 -- 172.21.15.12:0/119692983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc1a5ac0 con 0x7f18cc105070 2023-12-11T20:24:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.931+0000 7f18c97fa700 1 -- 172.21.15.12:0/119692983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c401dcf0 con 0x7f18cc105070 2023-12-11T20:24:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.931+0000 7f18d25ff700 1 -- 172.21.15.12:0/119692983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc1a5f40 con 0x7f18cc105070 2023-12-11T20:24:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.934+0000 7f18c97fa700 1 -- 172.21.15.12:0/119692983 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f18c4003a00 con 0x7f18cc105070 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18e5e5fb80 1 Processor -- start 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18e5e5fb80 1 -- start start 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18c97fa700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18b40a1470 0x7f18b40a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f522f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f52830 0x559c57f53140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f53720 0x559c57f53ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57eadaf0 con 0x559c57f53720 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57eab410 con 0x559c57f51ed0 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57ea6d00 con 0x559c57f52830 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.936+0000 7f18c97fa700 1 -- 172.21.15.12:0/119692983 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f18c40ce440 con 0x7f18cc105070 2023-12-11T20:24:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18b40a1470 0x7f18b40a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18d0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f53720 0x559c57f53ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18d0b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f53720 0x559c57f53ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42284/0 (socket says 172.21.15.12:42284) 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18d0b9c700 1 -- 172.21.15.12:0/775305097 learned_addr learned my addr 172.21.15.12:0/775305097 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f52830 0x559c57f53140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cbfff700 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cbfff700 1 -- 172.21.15.12:0/775305097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f52830 msgr2=0x559c57f53140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cbfff700 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f52830 0x559c57f53140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cbfff700 1 -- 172.21.15.12:0/775305097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f53720 msgr2=0x559c57f53ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cbfff700 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f53720 0x559c57f53ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cbfff700 1 -- 172.21.15.12:0/775305097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c57d235d0 con 0x559c57f51ed0 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f53720 0x559c57f53ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.937+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18b40a1470 0x7f18b40a3930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f18c0012ca0 tx=0x7f18c0007eb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.938+0000 7f18cbfff700 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f522f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00bdb0 tx=0x7f18bc0106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ed7ca9c97263d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.938+0000 7f18b27fc700 1 -- 172.21.15.12:0/775305097 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc010d90 con 0x559c57f51ed0 2023-12-11T20:24:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.938+0000 7f18b27fc700 1 -- 172.21.15.12:0/775305097 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18bc015070 con 0x559c57f51ed0 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.938+0000 7f18b27fc700 1 -- 172.21.15.12:0/775305097 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc003db0 con 0x559c57f51ed0 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/775305097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 msgr2=0x559c57f522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f522f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00bdb0 tx=0x7f18bc0106b0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/775305097 shutdown_connections 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f522f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f53720 0x559c57f53ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/775305097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f52830 0x559c57f53140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/775305097 >> 172.21.15.12:0/775305097 conn(0x559c57e81780 msgr2=0x559c57f4e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/775305097 shutdown_connections 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/775305097 wait complete. 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.939+0000 7f18e5e5fb80 1 -- start start 2023-12-11T20:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.940+0000 7f18e5e5fb80 1 Processor -- start 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.940+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f5beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f5c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 0x559c57f63220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57e60500 con 0x559c57f52830 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57e601a0 con 0x559c57f51ed0 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57d258c0 con 0x559c57f53720 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18e5e5fb80 10 client.0 _ll_register_callbacks cb 0x559c57d8ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f5c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f5c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42290/0 (socket says 172.21.15.12:42290) 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cb7fe700 1 -- 172.21.15.12:0/2323496078 learned_addr learned my addr 172.21.15.12:0/2323496078 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cbfff700 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f5beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 0x559c57f63220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cb7fe700 1 -- 172.21.15.12:0/2323496078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 msgr2=0x559c57f63220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 0x559c57f63220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cb7fe700 1 -- 172.21.15.12:0/2323496078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 msgr2=0x559c57f5beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f5beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.941+0000 7f18cb7fe700 1 -- 172.21.15.12:0/2323496078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc1a5f40 con 0x559c57f52830 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.942+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f5c3f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f18c0010df0 tx=0x7f18c00073d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a4f8d71507b82b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.942+0000 7f18ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.942+0000 7f18ab7fe700 1 -- 172.21.15.12:0/2323496078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0010e20 con 0x559c57f52830 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.942+0000 7f18ab7fe700 1 -- 172.21.15.12:0/2323496078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f18c001eda0 con 0x559c57f52830 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.942+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2323496078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c57f45730 con 0x559c57f52830 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.942+0000 7f18ab7fe700 1 -- 172.21.15.12:0/2323496078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18c002a410 con 0x559c57f52830 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.942+0000 7f18e5e5fb80 10 client.18057 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2323496078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f18bc00ba10 con 0x559c57f52830 2023-12-11T20:24:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18ab7fe700 1 -- 172.21.15.12:0/2323496078 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559c57f45730 con 0x559c57f52830 2023-12-11T20:24:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18ab7fe700 1 -- 172.21.15.12:0/2323496078 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f18c00343b0 con 0x559c57f52830 2023-12-11T20:24:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18e5e5fb80 10 client.18057 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18e5e5fb80 10 client.18057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18e5e5fb80 20 client.18057 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559c57f67d60 0x559c57f6a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18e5e5fb80 4 client.18057 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:24:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.943+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2323496078 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c57f21ee0 con 0x559c57f67d60 2023-12-11T20:24:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.944+0000 7f18cbfff700 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559c57f67d60 0x559c57f6a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.944+0000 7f18cbfff700 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559c57f67d60 0x559c57f6a180 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c1c50361d3d7eee server_cookie=81d55c7836007368 in_seq=0 out_seq=0 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.944+0000 7f18ab7fe700 10 client.18057 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18ab7fe700 1 -- 172.21.15.12:0/2323496078 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559c57f21ee0 con 0x559c57f67d60 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18ab7fe700 10 client.18057 handle_command_reply: tid=0 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 client.18057 shutdown 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2323496078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 msgr2=0x559c57f5c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f5c3f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f18c0010df0 tx=0x7f18c00073d0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2323496078 shutdown_connections 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559c57f67d60 0x559c57f6a180 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f51ed0 0x559c57f5beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 0x559c57f63220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2323496078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f5c3f0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2323496078 >> 172.21.15.12:0/2323496078 conn(0x559c57e81780 msgr2=0x559c57f4cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.945+0000 7f18ab7fe700 0 client.18057 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.946+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2323496078 shutdown_connections 2023-12-11T20:24:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.946+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2323496078 wait complete. 2023-12-11T20:24:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.946+0000 7f18e5e5fb80 20 client.18057 trim_cache size 0 max 16384 2023-12-11T20:24:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.965+0000 7f18e5e5fb80 1 Processor -- start 2023-12-11T20:24:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.965+0000 7f18e5e5fb80 1 -- start start 2023-12-11T20:24:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.965+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f51ed0 0x559c57f522b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.965+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f52830 0x559c57f631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.965+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 0x559c57f5a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.965+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57f59910 con 0x559c57f51ed0 2023-12-11T20:24:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.965+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57f57200 con 0x559c57f52830 2023-12-11T20:24:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.965+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57f49860 con 0x559c57f53720 2023-12-11T20:24:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f51ed0 0x559c57f522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f52830 0x559c57f631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f51ed0 0x559c57f522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42304/0 (socket says 172.21.15.12:42304) 2023-12-11T20:24:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 -- 172.21.15.12:0/2415651562 learned_addr learned my addr 172.21.15.12:0/2415651562 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 0x559c57f5a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 -- 172.21.15.12:0/2415651562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 msgr2=0x559c57f5a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 0x559c57f5a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 -- 172.21.15.12:0/2415651562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f52830 msgr2=0x559c57f631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f52830 0x559c57f631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 -- 172.21.15.12:0/2415651562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c57ccfd80 con 0x559c57f51ed0 2023-12-11T20:24:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f52830 0x559c57f631e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:24:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.966+0000 7f18cbfff700 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f51ed0 0x559c57f522b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f18bc000c00 tx=0x7f18bc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfa9eff89d17401 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.967+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2415651562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc003ae0 con 0x559c57f51ed0 2023-12-11T20:24:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.967+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2415651562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18bc01f040 con 0x559c57f51ed0 2023-12-11T20:24:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.967+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2415651562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc0270d0 con 0x559c57f51ed0 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2415651562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f51ed0 msgr2=0x559c57f522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f51ed0 0x559c57f522b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f18bc000c00 tx=0x7f18bc00b860 comp rx=0 tx=0).stop 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2415651562 shutdown_connections 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f53720 0x559c57f5a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f51ed0 0x559c57f522b0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/2415651562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f52830 0x559c57f631e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2415651562 >> 172.21.15.12:0/2415651562 conn(0x559c57e81780 msgr2=0x559c57f5b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2415651562 shutdown_connections 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/2415651562 wait complete. 2023-12-11T20:24:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.968+0000 7f18e5e5fb80 1 -- start start 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18e5e5fb80 1 Processor -- start 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f51ed0 0x559c57f610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f61630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18e5e5fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f53720 0x559c57f625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57f62b30 con 0x559c57f52830 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57f62ca0 con 0x559c57f53720 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18e5e5fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c57f62e60 con 0x559c57f51ed0 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18e5e5fb80 10 client.0 _ll_register_callbacks cb 0x559c57d8ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f61630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f61630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42314/0 (socket says 172.21.15.12:42314) 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.969+0000 7f18cb7fe700 1 -- 172.21.15.12:0/509964612 learned_addr learned my addr 172.21.15.12:0/509964612 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18cbfff700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f51ed0 0x559c57f610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f53720 0x559c57f625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18cb7fe700 1 -- 172.21.15.12:0/509964612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f51ed0 msgr2=0x559c57f610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f51ed0 0x559c57f610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18cb7fe700 1 -- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f53720 msgr2=0x559c57f625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f53720 0x559c57f625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18cb7fe700 1 -- 172.21.15.12:0/509964612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc00ba10 con 0x559c57f52830 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18cbfff700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f51ed0 0x559c57f610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18d0b9c700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f53720 0x559c57f625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f61630 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f18c0034790 tx=0x7f18c0012a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08c85c1d113604e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18ab7fe700 1 -- 172.21.15.12:0/509964612 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0010e20 con 0x559c57f52830 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/509964612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18bc015070 con 0x559c57f52830 2023-12-11T20:24:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.970+0000 7f18ab7fe700 1 -- 172.21.15.12:0/509964612 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f18c0030030 con 0x559c57f52830 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18ab7fe700 1 -- 172.21.15.12:0/509964612 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18c0034930 con 0x559c57f52830 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18e5e5fb80 10 client.18063 fetch_fsmap learned FSMap version 26 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/509964612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559c57d235d0 con 0x559c57f52830 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18ab7fe700 1 -- 172.21.15.12:0/509964612 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18bc015070 con 0x559c57f52830 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18ab7fe700 1 -- 172.21.15.12:0/509964612 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f18c0035920 con 0x559c57f52830 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18e5e5fb80 10 client.18063 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18e5e5fb80 10 client.18063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18e5e5fb80 20 client.18063 populate_metadata read hostname 'smithi012' 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559c57fbf320 0x559c57fc1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18e5e5fb80 4 client.18063 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.971+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/509964612 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559c57e6cf70 con 0x559c57fbf320 2023-12-11T20:24:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.972+0000 7f18cbfff700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559c57fbf320 0x559c57fc1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:24:59.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.972+0000 7f18ab7fe700 10 client.18063 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:59.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.972+0000 7f18cbfff700 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559c57fbf320 0x559c57fc1740 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b3d427938b9c137 server_cookie=f661326274e4c6d5 in_seq=0 out_seq=0 2023-12-11T20:24:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.982+0000 7f18ab7fe700 1 -- 172.21.15.12:0/509964612 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559c57e6cf70 con 0x559c57fbf320 2023-12-11T20:24:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.982+0000 7f18ab7fe700 10 client.18063 handle_command_reply: tid=0 2023-12-11T20:24:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.982+0000 7f18e5e5fb80 1 client.18063 shutdown 2023-12-11T20:24:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/509964612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 msgr2=0x559c57f61630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f61630 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f18c0034790 tx=0x7f18c0012a50 comp rx=0 tx=0).stop 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/509964612 shutdown_connections 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559c57fbf320 0x559c57fc1740 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c57f53720 0x559c57f625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c57f51ed0 0x559c57f610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 --2- 172.21.15.12:0/509964612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c57f52830 0x559c57f61630 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/509964612 >> 172.21.15.12:0/509964612 conn(0x559c57e81780 msgr2=0x559c57f5be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18ab7fe700 0 client.18063 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/509964612 shutdown_connections 2023-12-11T20:24:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 1 -- 172.21.15.12:0/509964612 wait complete. 2023-12-11T20:24:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.983+0000 7f18e5e5fb80 20 client.18063 trim_cache size 0 max 16384 2023-12-11T20:24:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:24:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:24:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:24:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 -- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18b40a1470 msgr2=0x7f18b40a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18b40a1470 0x7f18b40a3930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f18c0012ca0 tx=0x7f18c0007eb0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 -- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 msgr2=0x7f18cc1a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 0x7f18cc1a4fa0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f18c4007b60 tx=0x7f18c4004c80 comp rx=0 tx=0).stop 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 -- 172.21.15.12:0/119692983 shutdown_connections 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18b40a1470 0x7f18b40a3930 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc105070 0x7f18cc1a4fa0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18cc0ffd30 0x7f18cc19da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 --2- 172.21.15.12:0/119692983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18cc1026a0 0x7f18cc19dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 -- 172.21.15.12:0/119692983 >> 172.21.15.12:0/119692983 conn(0x7f18cc0fb930 msgr2=0x7f18cc1006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:24:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 -- 172.21.15.12:0/119692983 shutdown_connections 2023-12-11T20:24:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:24:59.984+0000 7f18d25ff700 1 -- 172.21.15.12:0/119692983 wait complete. 2023-12-11T20:25:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:01 smithi039 ceph-mon[102205]: pgmap v648: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-12-11T20:25:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:01 smithi012 ceph-mon[128787]: pgmap v648: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-12-11T20:25:01.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:01 smithi032 ceph-mon[132488]: pgmap v648: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-12-11T20:25:03.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:03 smithi039 ceph-mon[102205]: pgmap v649: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:25:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:03 smithi012 ceph-mon[128787]: pgmap v649: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:25:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:03 smithi032 ceph-mon[132488]: pgmap v649: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:25:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:05 smithi039 ceph-mon[102205]: pgmap v650: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:05.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:05 smithi012 ceph-mon[128787]: pgmap v650: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:05 smithi032 ceph-mon[132488]: pgmap v650: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:07 smithi039 ceph-mon[102205]: pgmap v651: 97 pgs: 97 active+clean; 6.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:07 smithi012 ceph-mon[128787]: pgmap v651: 97 pgs: 97 active+clean; 6.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:07 smithi032 ceph-mon[132488]: pgmap v651: 97 pgs: 97 active+clean; 6.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:09.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:25:09.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:09 smithi032 ceph-mon[132488]: pgmap v652: 97 pgs: 97 active+clean; 6.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:25:09.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:09 smithi039 ceph-mon[102205]: pgmap v652: 97 pgs: 97 active+clean; 6.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:25:09.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:09 smithi012 ceph-mon[128787]: pgmap v652: 97 pgs: 97 active+clean; 6.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:25:09.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 -- 172.21.15.12:0/1505954745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0074030 msgr2=0x7f21b00744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1505954745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0074030 0x7f21b00744b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009990 tx=0x7f21a0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 -- 172.21.15.12:0/1505954745 shutdown_connections 2023-12-11T20:25:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1505954745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21b0075610 0x7f21b0073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1505954745 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b010da80 0x7f21b010fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1505954745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0074030 0x7f21b00744b0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 -- 172.21.15.12:0/1505954745 >> 172.21.15.12:0/1505954745 conn(0x7f21b00fca00 msgr2=0x7f21b00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 -- 172.21.15.12:0/1505954745 shutdown_connections 2023-12-11T20:25:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.855+0000 7f21b79ff700 1 -- 172.21.15.12:0/1505954745 wait complete. 2023-12-11T20:25:09.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.857+0000 7f21b79ff700 1 Processor -- start 2023-12-11T20:25:09.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.857+0000 7f21b79ff700 1 -- start start 2023-12-11T20:25:09.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.857+0000 7f21b79ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b0074030 0x7f21b019d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.857+0000 7f21b79ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0075610 0x7f21b019dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.857+0000 7f21b79ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21b010da80 0x7f21b01a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.857+0000 7f21b79ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b01a54d0 con 0x7f21b0075610 2023-12-11T20:25:09.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.857+0000 7f21b79ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b01a5610 con 0x7f21b010da80 2023-12-11T20:25:09.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.857+0000 7f21b79ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b01a57a0 con 0x7f21b0074030 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0075610 0x7f21b019dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0075610 0x7f21b019dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37090/0 (socket says 172.21.15.12:37090) 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 -- 172.21.15.12:0/1612354097 learned_addr learned my addr 172.21.15.12:0/1612354097 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b5f9c700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21b010da80 0x7f21b01a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b579b700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b0074030 0x7f21b019d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 -- 172.21.15.12:0/1612354097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b0074030 msgr2=0x7f21b019d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b0074030 0x7f21b019d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 -- 172.21.15.12:0/1612354097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21b010da80 msgr2=0x7f21b01a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21b010da80 0x7f21b01a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 -- 172.21.15.12:0/1612354097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00095f0 con 0x7f21b0075610 2023-12-11T20:25:09.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.858+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0075610 0x7f21b019dee0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f21a0005910 tx=0x7f21a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:09.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.859+0000 7f21a67fc700 1 -- 172.21.15.12:0/1612354097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a001d070 con 0x7f21b0075610 2023-12-11T20:25:09.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.859+0000 7f21a67fc700 1 -- 172.21.15.12:0/1612354097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21a000bdb0 con 0x7f21b0075610 2023-12-11T20:25:09.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.859+0000 7f21b79ff700 1 -- 172.21.15.12:0/1612354097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b01a5a20 con 0x7f21b0075610 2023-12-11T20:25:09.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.859+0000 7f21a67fc700 1 -- 172.21.15.12:0/1612354097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0022cb0 con 0x7f21b0075610 2023-12-11T20:25:09.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.859+0000 7f21b79ff700 1 -- 172.21.15.12:0/1612354097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b01a5e40 con 0x7f21b0075610 2023-12-11T20:25:09.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.862+0000 7f21a67fc700 1 -- 172.21.15.12:0/1612354097 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f21a0022470 con 0x7f21b0075610 2023-12-11T20:25:09.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.864+0000 7f21cb323b80 1 Processor -- start 2023-12-11T20:25:09.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.864+0000 7f21cb323b80 1 -- start start 2023-12-11T20:25:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9fe67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9fe7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9fe80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21cb323b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9f41b50 con 0x5618f9fe63d0 2023-12-11T20:25:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21cb323b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9f3f470 con 0x5618f9fe7c20 2023-12-11T20:25:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21cb323b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9f3ad60 con 0x5618f9fe6d30 2023-12-11T20:25:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21a67fc700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f219c0a1480 0x7f219c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21b579b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9fe7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21b4f9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9fe80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21b5f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9fe67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21b579b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9fe7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:42690/0 (socket says 172.21.15.12:42690) 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21b579b700 1 -- 172.21.15.12:0/3768652395 learned_addr learned my addr 172.21.15.12:0/3768652395 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21a67fc700 1 -- 172.21.15.12:0/1612354097 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21a00ce340 con 0x7f21b0075610 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.865+0000 7f21b5f9c700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f219c0a1480 0x7f219c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b579b700 1 -- 172.21.15.12:0/3768652395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 msgr2=0x5618f9fe80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b579b700 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9fe80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b579b700 1 -- 172.21.15.12:0/3768652395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 msgr2=0x5618f9fe67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b579b700 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9fe67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b579b700 1 -- 172.21.15.12:0/3768652395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618f9db7630 con 0x5618f9fe6d30 2023-12-11T20:25:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b5f9c700 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9fe67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9fe80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b579b700 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9fe7640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009d80 tx=0x7f21ac011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=615f6d1efa6dd270 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f21b5f9c700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f219c0a1480 0x7f219c0a3940 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009ec0 tx=0x7f21a800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.866+0000 7f219b7fe700 1 -- 172.21.15.12:0/3768652395 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac004230 con 0x5618f9fe6d30 2023-12-11T20:25:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f219b7fe700 1 -- 172.21.15.12:0/3768652395 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21ac004390 con 0x5618f9fe6d30 2023-12-11T20:25:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f219b7fe700 1 -- 172.21.15.12:0/3768652395 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac019800 con 0x5618f9fe6d30 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 -- 172.21.15.12:0/3768652395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 msgr2=0x5618f9fe7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9fe7640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009d80 tx=0x7f21ac011720 comp rx=0 tx=0).stop 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 -- 172.21.15.12:0/3768652395 shutdown_connections 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9fe80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9fe67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3768652395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9fe7640 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 -- 172.21.15.12:0/3768652395 >> 172.21.15.12:0/3768652395 conn(0x5618f9f157e0 msgr2=0x5618f9fe2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 -- 172.21.15.12:0/3768652395 shutdown_connections 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.867+0000 7f21cb323b80 1 -- 172.21.15.12:0/3768652395 wait complete. 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.868+0000 7f21cb323b80 1 -- start start 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.868+0000 7f21cb323b80 1 Processor -- start 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9ff06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21cb323b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9ef4560 con 0x5618f9fe63d0 2023-12-11T20:25:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21cb323b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9ef4200 con 0x5618f9fe7c20 2023-12-11T20:25:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21cb323b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9db9920 con 0x5618f9fe6d30 2023-12-11T20:25:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21cb323b80 10 client.0 _ll_register_callbacks cb 0x5618f9e1fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21b579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21b579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37114/0 (socket says 172.21.15.12:37114) 2023-12-11T20:25:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21b579b700 1 -- 172.21.15.12:0/3455312811 learned_addr learned my addr 172.21.15.12:0/3455312811 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:09.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9ff06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.869+0000 7f21b5f9c700 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f21b579b700 1 -- 172.21.15.12:0/3455312811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 msgr2=0x5618f9ff06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:09.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f21b579b700 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9ff06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f21b579b700 1 -- 172.21.15.12:0/3455312811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 msgr2=0x5618f9ff7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f21b579b700 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f21b579b700 1 -- 172.21.15.12:0/3455312811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a8008a20 con 0x5618f9fe63d0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f21b579b700 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff0180 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009230 tx=0x7f21ac0038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1593728e303e607a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f2198ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f2198ff9700 1 -- 172.21.15.12:0/3455312811 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac005450 con 0x5618f9fe63d0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f2198ff9700 1 -- 172.21.15.12:0/3455312811 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21ac005ce0 con 0x5618f9fe63d0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.870+0000 7f21cb323b80 1 -- 172.21.15.12:0/3455312811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618f9fd9b40 con 0x5618f9fe63d0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f2198ff9700 1 -- 172.21.15.12:0/3455312811 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21ac009ed0 con 0x5618f9fe63d0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f21cb323b80 10 client.18075 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f21cb323b80 1 -- 172.21.15.12:0/3455312811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f21ac0099e0 con 0x5618f9fe63d0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f2198ff9700 1 -- 172.21.15.12:0/3455312811 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5618f9fd9b40 con 0x5618f9fe63d0 2023-12-11T20:25:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f2198ff9700 1 -- 172.21.15.12:0/3455312811 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f21ac028020 con 0x5618f9fe63d0 2023-12-11T20:25:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f21cb323b80 10 client.18075 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f21cb323b80 10 client.18075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f21cb323b80 20 client.18075 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5618f9ffbe20 0x5618f9ffe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f21cb323b80 4 client.18075 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.871+0000 7f21cb323b80 1 -- 172.21.15.12:0/3455312811 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618f9fb5f40 con 0x5618f9ffbe20 2023-12-11T20:25:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.872+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5618f9ffbe20 0x5618f9ffe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.872+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5618f9ffbe20 0x5618f9ffe240 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30f61d471820810b server_cookie=a18f4601843fb3d8 in_seq=0 out_seq=0 2023-12-11T20:25:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.872+0000 7f2198ff9700 10 client.18075 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f2198ff9700 1 -- 172.21.15.12:0/3455312811 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5618f9fb5f40 con 0x5618f9ffbe20 2023-12-11T20:25:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f2198ff9700 10 client.18075 handle_command_reply: tid=0 2023-12-11T20:25:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 client.18075 shutdown 2023-12-11T20:25:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 -- 172.21.15.12:0/3455312811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 msgr2=0x5618f9ff0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff0180 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009230 tx=0x7f21ac0038b0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 -- 172.21.15.12:0/3455312811 shutdown_connections 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5618f9ffbe20 0x5618f9ffe240 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff0180 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f2198ff9700 0 client.18075 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 --2- 172.21.15.12:0/3455312811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9ff06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.873+0000 7f21cb323b80 1 -- 172.21.15.12:0/3455312811 >> 172.21.15.12:0/3455312811 conn(0x5618f9f157e0 msgr2=0x5618f9fe1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.874+0000 7f21cb323b80 1 -- 172.21.15.12:0/3455312811 shutdown_connections 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.874+0000 7f21cb323b80 1 -- 172.21.15.12:0/3455312811 wait complete. 2023-12-11T20:25:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.874+0000 7f21cb323b80 20 client.18075 trim_cache size 0 max 16384 2023-12-11T20:25:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21cb323b80 1 Processor -- start 2023-12-11T20:25:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21cb323b80 1 -- start start 2023-12-11T20:25:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe63d0 0x5618f9fef690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe6d30 0x5618f9ff76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe7c20 0x5618f9feab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21cb323b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9fe7150 con 0x5618f9fe7c20 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21cb323b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9ff88b0 con 0x5618f9fe6d30 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21cb323b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fa003470 con 0x5618f9fe63d0 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.892+0000 7f21b5f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe7c20 0x5618f9feab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b4f9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe6d30 0x5618f9ff76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b579b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe63d0 0x5618f9fef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b5f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe7c20 0x5618f9feab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37126/0 (socket says 172.21.15.12:37126) 2023-12-11T20:25:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b5f9c700 1 -- 172.21.15.12:0/1660041553 learned_addr learned my addr 172.21.15.12:0/1660041553 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b579b700 1 -- 172.21.15.12:0/1660041553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe6d30 msgr2=0x5618f9ff76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b579b700 1 --2- 172.21.15.12:0/1660041553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe6d30 0x5618f9ff76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b579b700 1 -- 172.21.15.12:0/1660041553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe7c20 msgr2=0x5618f9feab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b579b700 1 --2- 172.21.15.12:0/1660041553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe7c20 0x5618f9feab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b579b700 1 -- 172.21.15.12:0/1660041553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618f9d63de0 con 0x5618f9fe63d0 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/1660041553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe6d30 0x5618f9ff76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.893+0000 7f21b579b700 1 --2- 172.21.15.12:0/1660041553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe63d0 0x5618f9fef690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006010 tx=0x7f21ac011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d2ae8f203aed7a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f219bfff700 1 -- 172.21.15.12:0/1660041553 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac009ed0 con 0x5618f9fe63d0 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f219bfff700 1 -- 172.21.15.12:0/1660041553 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21ac02f020 con 0x5618f9fe63d0 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f219bfff700 1 -- 172.21.15.12:0/1660041553 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0055a0 con 0x5618f9fe63d0 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 -- 172.21.15.12:0/1660041553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe63d0 msgr2=0x5618f9fef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 --2- 172.21.15.12:0/1660041553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe63d0 0x5618f9fef690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006010 tx=0x7f21ac011720 comp rx=0 tx=0).stop 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 -- 172.21.15.12:0/1660041553 shutdown_connections 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 --2- 172.21.15.12:0/1660041553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe7c20 0x5618f9feab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 --2- 172.21.15.12:0/1660041553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe63d0 0x5618f9fef690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 --2- 172.21.15.12:0/1660041553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe6d30 0x5618f9ff76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 -- 172.21.15.12:0/1660041553 >> 172.21.15.12:0/1660041553 conn(0x5618f9f157e0 msgr2=0x5618f9feee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 -- 172.21.15.12:0/1660041553 shutdown_connections 2023-12-11T20:25:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.894+0000 7f21cb323b80 1 -- 172.21.15.12:0/1660041553 wait complete. 2023-12-11T20:25:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.895+0000 7f21cb323b80 1 -- start start 2023-12-11T20:25:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.895+0000 7f21cb323b80 1 Processor -- start 2023-12-11T20:25:09.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.895+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.895+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9ff59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21cb323b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21cb323b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9ff6e90 con 0x5618f9fe63d0 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21cb323b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9ff7000 con 0x5618f9fe7c20 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21cb323b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618f9ff71c0 con 0x5618f9fe6d30 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21cb323b80 10 client.0 _ll_register_callbacks cb 0x5618f9e1fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37140/0 (socket says 172.21.15.12:37140) 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b579b700 1 -- 172.21.15.12:0/4247886717 learned_addr learned my addr 172.21.15.12:0/4247886717 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9ff59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b5f9c700 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b579b700 1 -- 172.21.15.12:0/4247886717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 msgr2=0x5618f9ff59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b579b700 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9ff59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b579b700 1 -- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 msgr2=0x5618f9ff6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b579b700 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b579b700 1 -- 172.21.15.12:0/4247886717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b01a5e40 con 0x5618f9fe63d0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.896+0000 7f21b5f9c700 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f21b579b700 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff54a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009cd0 tx=0x7f21ac0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f47858a2404e876 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f2198ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f2198ff9700 1 -- 172.21.15.12:0/4247886717 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0196d0 con 0x5618f9fe63d0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f21cb323b80 1 -- 172.21.15.12:0/4247886717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21ac004390 con 0x5618f9fe63d0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f2198ff9700 1 -- 172.21.15.12:0/4247886717 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21ac000e40 con 0x5618f9fe63d0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f2198ff9700 1 -- 172.21.15.12:0/4247886717 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21ac0039d0 con 0x5618f9fe63d0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f21cb323b80 10 client.18081 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f21cb323b80 1 -- 172.21.15.12:0/4247886717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f21ac0099e0 con 0x5618f9fe63d0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.897+0000 7f2198ff9700 1 -- 172.21.15.12:0/4247886717 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21ac004390 con 0x5618f9fe63d0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.898+0000 7f2198ff9700 1 -- 172.21.15.12:0/4247886717 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f21ac03b030 con 0x5618f9fe63d0 2023-12-11T20:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.898+0000 7f21cb323b80 10 client.18081 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.898+0000 7f21cb323b80 10 client.18081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.898+0000 7f21cb323b80 20 client.18081 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.898+0000 7f21cb323b80 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5618fa052dd0 0x5618fa0551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.898+0000 7f21cb323b80 4 client.18081 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.898+0000 7f21cb323b80 1 -- 172.21.15.12:0/4247886717 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5618f9f00fd0 con 0x5618fa052dd0 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.898+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5618fa052dd0 0x5618fa0551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f2198ff9700 10 client.18081 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21b4f9a700 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5618fa052dd0 0x5618fa0551f0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=307e7d87becd965b server_cookie=d7fd62e518e0471 in_seq=0 out_seq=0 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f2198ff9700 1 -- 172.21.15.12:0/4247886717 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5618f9f00fd0 con 0x5618fa052dd0 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f2198ff9700 10 client.18081 handle_command_reply: tid=0 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 client.18081 shutdown 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 -- 172.21.15.12:0/4247886717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 msgr2=0x5618f9ff54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff54a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009cd0 tx=0x7f21ac0042c0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 -- 172.21.15.12:0/4247886717 shutdown_connections 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5618fa052dd0 0x5618fa0551f0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5618f9fe7c20 0x5618f9ff6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618f9fe63d0 0x5618f9ff54a0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 --2- 172.21.15.12:0/4247886717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5618f9fe6d30 0x5618f9ff59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 -- 172.21.15.12:0/4247886717 >> 172.21.15.12:0/4247886717 conn(0x5618f9f157e0 msgr2=0x5618f9feff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f2198ff9700 0 client.18081 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 -- 172.21.15.12:0/4247886717 shutdown_connections 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.899+0000 7f21cb323b80 1 -- 172.21.15.12:0/4247886717 wait complete. 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21cb323b80 20 client.18081 trim_cache size 0 max 16384 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:25:09.907 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:25:09.908 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:25:09.908 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 -- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f219c0a1480 msgr2=0x7f219c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f219c0a1480 0x7f219c0a3940 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009ec0 tx=0x7f21a800b040 comp rx=0 tx=0).stop 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 -- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0075610 msgr2=0x7f21b019dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0075610 0x7f21b019dee0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f21a0005910 tx=0x7f21a0004730 comp rx=0 tx=0).stop 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 -- 172.21.15.12:0/1612354097 shutdown_connections 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f219c0a1480 0x7f219c0a3940 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21b010da80 0x7f21b01a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21b0074030 0x7f21b019d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 --2- 172.21.15.12:0/1612354097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21b0075610 0x7f21b019dee0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 -- 172.21.15.12:0/1612354097 >> 172.21.15.12:0/1612354097 conn(0x7f21b00fca00 msgr2=0x7f21b0100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 -- 172.21.15.12:0/1612354097 shutdown_connections 2023-12-11T20:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:09.900+0000 7f21b79ff700 1 -- 172.21.15.12:0/1612354097 wait complete. 2023-12-11T20:25:09.923 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:25:09.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:25:10.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/1680178201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 msgr2=0x7fa4c41018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/1680178201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 0x7fa4c41018c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40099c0 tx=0x7fa4b4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/1680178201 shutdown_connections 2023-12-11T20:25:10.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/1680178201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4c4103030 0x7fa4c41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/1680178201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 0x7fa4c41018c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/1680178201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4c4102690 0x7fa4c4102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/1680178201 >> 172.21.15.12:0/1680178201 conn(0x7fa4c40fca10 msgr2=0x7fa4c40fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/1680178201 shutdown_connections 2023-12-11T20:25:10.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.139+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/1680178201 wait complete. 2023-12-11T20:25:10.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.140+0000 7fa4ca1ff700 1 Processor -- start 2023-12-11T20:25:10.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.140+0000 7fa4ca1ff700 1 -- start start 2023-12-11T20:25:10.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4ca1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 0x7fa4c4075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4ca1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4c4102690 0x7fa4c40739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4ca1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4c4103030 0x7fa4c4073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4ca1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c40746a0 con 0x7fa4c41014a0 2023-12-11T20:25:10.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4ca1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4074810 con 0x7fa4c4103030 2023-12-11T20:25:10.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4ca1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c41a13f0 con 0x7fa4c4102690 2023-12-11T20:25:10.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4c37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 0x7fa4c4075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4c37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 0x7fa4c4075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37148/0 (socket says 172.21.15.12:37148) 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4c37fe700 1 -- 172.21.15.12:0/3254317801 learned_addr learned my addr 172.21.15.12:0/3254317801 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4c2ffd700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4c4102690 0x7fa4c40739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.141+0000 7fa4c3fff700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4c4103030 0x7fa4c4073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c37fe700 1 -- 172.21.15.12:0/3254317801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4c4102690 msgr2=0x7fa4c40739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c37fe700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4c4102690 0x7fa4c40739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c37fe700 1 -- 172.21.15.12:0/3254317801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4c4103030 msgr2=0x7fa4c4073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c37fe700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4c4103030 0x7fa4c4073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c37fe700 1 -- 172.21.15.12:0/3254317801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b40095f0 con 0x7fa4c41014a0 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c3fff700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4c4103030 0x7fa4c4073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c37fe700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 0x7fa4c4075330 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009990 tx=0x7fa4b400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c0ff9700 1 -- 172.21.15.12:0/3254317801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b401d070 con 0x7fa4c41014a0 2023-12-11T20:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c41a1620 con 0x7fa4c41014a0 2023-12-11T20:25:10.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c0ff9700 1 -- 172.21.15.12:0/3254317801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4b400bd10 con 0x7fa4c41014a0 2023-12-11T20:25:10.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4c0ff9700 1 -- 172.21.15.12:0/3254317801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4017650 con 0x7fa4c41014a0 2023-12-11T20:25:10.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.142+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c41a19e0 con 0x7fa4c41014a0 2023-12-11T20:25:10.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.144+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c41089e0 con 0x7fa4c41014a0 2023-12-11T20:25:10.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.145+0000 7fa4c0ff9700 1 -- 172.21.15.12:0/3254317801 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa4b4022470 con 0x7fa4c41014a0 2023-12-11T20:25:10.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.147+0000 7fa4c0ff9700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa4ac0a1480 0x7fa4ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.147+0000 7fa4c0ff9700 1 -- 172.21.15.12:0/3254317801 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa4b40ce1b0 con 0x7fa4c41014a0 2023-12-11T20:25:10.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.147+0000 7fa4c2ffd700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa4ac0a1480 0x7fa4ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.148+0000 7fa4c2ffd700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa4ac0a1480 0x7fa4ac0a3940 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009c60 tx=0x7fa4b8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.152+0000 7fa4c0ff9700 1 -- 172.21.15.12:0/3254317801 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa4b40977f0 con 0x7fa4c41014a0 2023-12-11T20:25:10.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.431+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4c410ce00 con 0x7fa4c41014a0 2023-12-11T20:25:10.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.432+0000 7fa4c0ff9700 1 -- 172.21.15.12:0/3254317801 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7fa4b409ae10 con 0x7fa4c41014a0 2023-12-11T20:25:10.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:25:10.432 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:25:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa4ac0a1480 msgr2=0x7fa4ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa4ac0a1480 0x7fa4ac0a3940 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009c60 tx=0x7fa4b8009260 comp rx=0 tx=0).stop 2023-12-11T20:25:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 msgr2=0x7fa4c4075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 0x7fa4c4075330 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009990 tx=0x7fa4b400fa00 comp rx=0 tx=0).stop 2023-12-11T20:25:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 shutdown_connections 2023-12-11T20:25:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa4ac0a1480 0x7fa4ac0a3940 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4c4103030 0x7fa4c4073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c41014a0 0x7fa4c4075330 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 --2- 172.21.15.12:0/3254317801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4c4102690 0x7fa4c40739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 >> 172.21.15.12:0/3254317801 conn(0x7fa4c40fca10 msgr2=0x7fa4c4105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 shutdown_connections 2023-12-11T20:25:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.435+0000 7fa4ca1ff700 1 -- 172.21.15.12:0/3254317801 wait complete. 2023-12-11T20:25:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:25:10.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.698+0000 7fcf545ff700 1 -- 172.21.15.12:0/492841710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 msgr2=0x7fcf4c10bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.698+0000 7fcf545ff700 1 --2- 172.21.15.12:0/492841710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 0x7fcf4c10bb10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400b0d0 tx=0x7fcf4400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.698+0000 7fcf545ff700 1 -- 172.21.15.12:0/492841710 shutdown_connections 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.698+0000 7fcf545ff700 1 --2- 172.21.15.12:0/492841710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 0x7fcf4c10bb10 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.698+0000 7fcf545ff700 1 --2- 172.21.15.12:0/492841710 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf4c1036d0 0x7fcf4c103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.698+0000 7fcf545ff700 1 --2- 172.21.15.12:0/492841710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf4c1048c0 0x7fcf4c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.698+0000 7fcf545ff700 1 -- 172.21.15.12:0/492841710 >> 172.21.15.12:0/492841710 conn(0x7fcf4c0fec40 msgr2=0x7fcf4c101080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.699+0000 7fcf545ff700 1 -- 172.21.15.12:0/492841710 shutdown_connections 2023-12-11T20:25:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.699+0000 7fcf545ff700 1 -- 172.21.15.12:0/492841710 wait complete. 2023-12-11T20:25:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.700+0000 7fcf545ff700 1 Processor -- start 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.700+0000 7fcf545ff700 1 -- start start 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.700+0000 7fcf545ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf4c1036d0 0x7fcf4c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.700+0000 7fcf545ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf4c1048c0 0x7fcf4c199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.700+0000 7fcf545ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 0x7fcf4c1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.700+0000 7fcf545ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c1a1130 con 0x7fcf4c105260 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.700+0000 7fcf545ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c1a1270 con 0x7fcf4c1036d0 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.700+0000 7fcf545ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c1a1400 con 0x7fcf4c1048c0 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 0x7fcf4c1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf5239b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf4c1036d0 0x7fcf4c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 0x7fcf4c1a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37160/0 (socket says 172.21.15.12:37160) 2023-12-11T20:25:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 -- 172.21.15.12:0/2690436107 learned_addr learned my addr 172.21.15.12:0/2690436107 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf4c1048c0 0x7fcf4c199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 -- 172.21.15.12:0/2690436107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf4c1048c0 msgr2=0x7fcf4c199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf4c1048c0 0x7fcf4c199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 -- 172.21.15.12:0/2690436107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf4c1036d0 msgr2=0x7fcf4c199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf4c1036d0 0x7fcf4c199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 -- 172.21.15.12:0/2690436107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44009d00 con 0x7fcf4c105260 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.701+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 0x7fcf4c1a0b60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fcf44007af0 tx=0x7fcf44007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.702+0000 7fcf437fe700 1 -- 172.21.15.12:0/2690436107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400e040 con 0x7fcf4c105260 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.702+0000 7fcf437fe700 1 -- 172.21.15.12:0/2690436107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf4400be30 con 0x7fcf4c105260 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.702+0000 7fcf437fe700 1 -- 172.21.15.12:0/2690436107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4401b930 con 0x7fcf4c105260 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.702+0000 7fcf545ff700 1 -- 172.21.15.12:0/2690436107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c1a1680 con 0x7fcf4c105260 2023-12-11T20:25:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.702+0000 7fcf545ff700 1 -- 172.21.15.12:0/2690436107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c1a1ab0 con 0x7fcf4c105260 2023-12-11T20:25:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.705+0000 7fcf437fe700 1 -- 172.21.15.12:0/2690436107 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcf4401d670 con 0x7fcf4c105260 2023-12-11T20:25:10.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.706+0000 7fcf437fe700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf380a1500 0x7fcf380a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.706+0000 7fcf437fe700 1 -- 172.21.15.12:0/2690436107 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf440ce240 con 0x7fcf4c105260 2023-12-11T20:25:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.707+0000 7fcf5239b700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf380a1500 0x7fcf380a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.707+0000 7fcf67eecb80 1 Processor -- start 2023-12-11T20:25:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.707+0000 7fcf67eecb80 1 -- start start 2023-12-11T20:25:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.707+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f63d0 0x55b57b5f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.707+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 0x55b57b5f7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.707+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f7c20 0x55b57b5f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b551b50 con 0x55b57b5f7c20 2023-12-11T20:25:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b54f470 con 0x55b57b5f63d0 2023-12-11T20:25:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b54ad60 con 0x55b57b5f6d30 2023-12-11T20:25:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf5239b700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf380a1500 0x7fcf380a39c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c104720 tx=0x7fcf48009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf52b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f7c20 0x55b57b5f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf52b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f7c20 0x55b57b5f80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37168/0 (socket says 172.21.15.12:37168) 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf52b9c700 1 -- 172.21.15.12:0/2446047658 learned_addr learned my addr 172.21.15.12:0/2446047658 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf5239b700 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f63d0 0x55b57b5f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 0x55b57b5f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf52b9c700 1 -- 172.21.15.12:0/2446047658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 msgr2=0x55b57b5f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 0x55b57b5f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf52b9c700 1 -- 172.21.15.12:0/2446047658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f63d0 msgr2=0x55b57b5f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f63d0 0x55b57b5f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.708+0000 7fcf52b9c700 1 -- 172.21.15.12:0/2446047658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b57b3c7630 con 0x55b57b5f7c20 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.709+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f7c20 0x55b57b5f80a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009850 tx=0x7fcf4400b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358cf8279dbcac25 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.709+0000 7fcf40bfe700 1 -- 172.21.15.12:0/2446047658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4409aea0 con 0x55b57b5f7c20 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.709+0000 7fcf40bfe700 1 -- 172.21.15.12:0/2446047658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf4409bc40 con 0x55b57b5f7c20 2023-12-11T20:25:10.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.709+0000 7fcf40bfe700 1 -- 172.21.15.12:0/2446047658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4401d920 con 0x55b57b5f7c20 2023-12-11T20:25:10.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 -- 172.21.15.12:0/2446047658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f7c20 msgr2=0x55b57b5f80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f7c20 0x55b57b5f80a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009850 tx=0x7fcf4400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 -- 172.21.15.12:0/2446047658 shutdown_connections 2023-12-11T20:25:10.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f63d0 0x55b57b5f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f7c20 0x55b57b5f80a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/2446047658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 0x55b57b5f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 -- 172.21.15.12:0/2446047658 >> 172.21.15.12:0/2446047658 conn(0x55b57b5257e0 msgr2=0x55b57b5f2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 -- 172.21.15.12:0/2446047658 shutdown_connections 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 -- 172.21.15.12:0/2446047658 wait complete. 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.710+0000 7fcf67eecb80 1 -- start start 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf67eecb80 1 Processor -- start 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5fff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f6d30 0x55b57b6004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f7c20 0x55b57b6074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b504560 con 0x55b57b5f63d0 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b504200 con 0x55b57b5f6d30 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b3c9920 con 0x55b57b5f7c20 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf67eecb80 10 client.0 _ll_register_callbacks cb 0x55b57b42fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf5239b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.711+0000 7fcf5239b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5fff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37184/0 (socket says 172.21.15.12:37184) 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf5239b700 1 -- 172.21.15.12:0/3088638096 learned_addr learned my addr 172.21.15.12:0/3088638096 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f6d30 0x55b57b6004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f7c20 0x55b57b6074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf5239b700 1 -- 172.21.15.12:0/3088638096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f7c20 msgr2=0x55b57b6074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf5239b700 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f7c20 0x55b57b6074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf5239b700 1 -- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f6d30 msgr2=0x55b57b6004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf5239b700 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f6d30 0x55b57b6004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf5239b700 1 -- 172.21.15.12:0/3088638096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c1a1ab0 con 0x55b57b5f63d0 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f6d30 0x55b57b6004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.712+0000 7fcf5239b700 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5fff60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcf48005c50 tx=0x7fcf480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9787f6f860b0f44f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.713+0000 7fcf35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.713+0000 7fcf35ffb700 1 -- 172.21.15.12:0/3088638096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48022070 con 0x55b57b5f63d0 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.713+0000 7fcf35ffb700 1 -- 172.21.15.12:0/3088638096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf4801c6d0 con 0x55b57b5f63d0 2023-12-11T20:25:10.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.713+0000 7fcf67eecb80 1 -- 172.21.15.12:0/3088638096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b57b5e9b40 con 0x55b57b5f63d0 2023-12-11T20:25:10.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.713+0000 7fcf35ffb700 1 -- 172.21.15.12:0/3088638096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf48004020 con 0x55b57b5f63d0 2023-12-11T20:25:10.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.713+0000 7fcf67eecb80 10 client.18099 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:10.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.713+0000 7fcf67eecb80 1 -- 172.21.15.12:0/3088638096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b57b373de0 con 0x55b57b5f63d0 2023-12-11T20:25:10.715 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:10 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3254317801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.714+0000 7fcf35ffb700 1 -- 172.21.15.12:0/3088638096 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b57b5e9b40 con 0x55b57b5f63d0 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.714+0000 7fcf35ffb700 1 -- 172.21.15.12:0/3088638096 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcf48003710 con 0x55b57b5f63d0 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.714+0000 7fcf67eecb80 10 client.18099 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.714+0000 7fcf67eecb80 10 client.18099 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.714+0000 7fcf67eecb80 20 client.18099 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.714+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b57b60bde0 0x55b57b60e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.714+0000 7fcf67eecb80 4 client.18099 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.714+0000 7fcf67eecb80 1 -- 172.21.15.12:0/3088638096 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b57b5c5f40 con 0x55b57b60bde0 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.715+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b57b60bde0 0x55b57b60e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.715+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b57b60bde0 0x55b57b60e200 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2711698c340bd1d7 server_cookie=b866b1f35ac1d53a in_seq=0 out_seq=0 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.715+0000 7fcf35ffb700 10 client.18099 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf35ffb700 1 -- 172.21.15.12:0/3088638096 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b57b5c5f40 con 0x55b57b60bde0 2023-12-11T20:25:10.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf35ffb700 10 client.18099 handle_command_reply: tid=0 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 client.18099 shutdown 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 -- 172.21.15.12:0/3088638096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 msgr2=0x55b57b5fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5fff60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcf48005c50 tx=0x7fcf480047c0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 -- 172.21.15.12:0/3088638096 shutdown_connections 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b57b60bde0 0x55b57b60e200 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f7c20 0x55b57b6074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5fff60 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/3088638096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f6d30 0x55b57b6004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf67eecb80 1 -- 172.21.15.12:0/3088638096 >> 172.21.15.12:0/3088638096 conn(0x55b57b5257e0 msgr2=0x55b57b5f1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.716+0000 7fcf35ffb700 0 client.18099 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.717+0000 7fcf67eecb80 1 -- 172.21.15.12:0/3088638096 shutdown_connections 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.717+0000 7fcf67eecb80 1 -- 172.21.15.12:0/3088638096 wait complete. 2023-12-11T20:25:10.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.717+0000 7fcf67eecb80 20 client.18099 trim_cache size 0 max 16384 2023-12-11T20:25:10.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.731+0000 7fcf67eecb80 1 Processor -- start 2023-12-11T20:25:10.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.731+0000 7fcf67eecb80 1 -- start start 2023-12-11T20:25:10.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.731+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.731+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 0x55b57b6074a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.731+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b5fab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.731+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b5f7aa0 con 0x55b57b5f63d0 2023-12-11T20:25:10.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.731+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b608660 con 0x55b57b5f7c20 2023-12-11T20:25:10.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.731+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b5ffb00 con 0x55b57b5f6d30 2023-12-11T20:25:10.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf51b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 0x55b57b6074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5f8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37194/0 (socket says 172.21.15.12:37194) 2023-12-11T20:25:10.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 -- 172.21.15.12:0/1121950356 learned_addr learned my addr 172.21.15.12:0/1121950356 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b5fab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 -- 172.21.15.12:0/1121950356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 msgr2=0x55b57b6074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 0x55b57b6074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 -- 172.21.15.12:0/1121950356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 msgr2=0x55b57b5fab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b5fab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 -- 172.21.15.12:0/1121950356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b57b35cc60 con 0x55b57b5f63d0 2023-12-11T20:25:10.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b5fab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:10.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.732+0000 7fcf5239b700 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5f8020 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fcf48016040 tx=0x7fcf48000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed3ccb24afaf18f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.733+0000 7fcf413ff700 1 -- 172.21.15.12:0/1121950356 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48022070 con 0x55b57b5f63d0 2023-12-11T20:25:10.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.733+0000 7fcf413ff700 1 -- 172.21.15.12:0/1121950356 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf48003680 con 0x55b57b5f63d0 2023-12-11T20:25:10.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.733+0000 7fcf413ff700 1 -- 172.21.15.12:0/1121950356 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48004000 con 0x55b57b5f63d0 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.733+0000 7fcf67eecb80 1 -- 172.21.15.12:0/1121950356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 msgr2=0x55b57b5f8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.733+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5f8020 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fcf48016040 tx=0x7fcf48000bc0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.734+0000 7fcf67eecb80 1 -- 172.21.15.12:0/1121950356 shutdown_connections 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.734+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b5fab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.734+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f63d0 0x55b57b5f8020 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.734+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/1121950356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f6d30 0x55b57b6074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.734+0000 7fcf67eecb80 1 -- 172.21.15.12:0/1121950356 >> 172.21.15.12:0/1121950356 conn(0x55b57b5257e0 msgr2=0x55b57b612b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.734+0000 7fcf67eecb80 1 -- 172.21.15.12:0/1121950356 shutdown_connections 2023-12-11T20:25:10.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.734+0000 7fcf67eecb80 1 -- 172.21.15.12:0/1121950356 wait complete. 2023-12-11T20:25:10.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.734+0000 7fcf67eecb80 1 -- start start 2023-12-11T20:25:10.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf67eecb80 1 Processor -- start 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f63d0 0x55b57b602fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f6d30 0x55b57b6034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf67eecb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b606510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b606a50 con 0x55b57b5f6d30 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b606bc0 con 0x55b57b5f7c20 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf67eecb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57b606d80 con 0x55b57b5f63d0 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf67eecb80 10 client.0 _ll_register_callbacks cb 0x55b57b42fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf51b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f6d30 0x55b57b6034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf51b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f6d30 0x55b57b6034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37208/0 (socket says 172.21.15.12:37208) 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.735+0000 7fcf51b9a700 1 -- 172.21.15.12:0/842318914 learned_addr learned my addr 172.21.15.12:0/842318914 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf52b9c700 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b606510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf5239b700 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f63d0 0x55b57b602fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf51b9a700 1 -- 172.21.15.12:0/842318914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f63d0 msgr2=0x55b57b602fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f63d0 0x55b57b602fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf51b9a700 1 -- 172.21.15.12:0/842318914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 msgr2=0x55b57b606510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b606510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf51b9a700 1 -- 172.21.15.12:0/842318914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b57b3c7630 con 0x55b57b5f6d30 2023-12-11T20:25:10.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf51b9a700 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f6d30 0x55b57b6034f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0124a0 tx=0x7fcf3c012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15506f4c5234a921 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.736+0000 7fcf35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.737+0000 7fcf35ffb700 1 -- 172.21.15.12:0/842318914 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c017030 con 0x55b57b5f6d30 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.737+0000 7fcf35ffb700 1 -- 172.21.15.12:0/842318914 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf3c020630 con 0x55b57b5f6d30 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.737+0000 7fcf67eecb80 1 -- 172.21.15.12:0/842318914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf4409bc40 con 0x55b57b5f6d30 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.737+0000 7fcf35ffb700 1 -- 172.21.15.12:0/842318914 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf3c0207f0 con 0x55b57b5f6d30 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.737+0000 7fcf67eecb80 10 client.18105 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.737+0000 7fcf67eecb80 1 -- 172.21.15.12:0/842318914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b57b373de0 con 0x55b57b5f6d30 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.737+0000 7fcf35ffb700 1 -- 172.21.15.12:0/842318914 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf4409bc40 con 0x55b57b5f6d30 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.737+0000 7fcf35ffb700 1 -- 172.21.15.12:0/842318914 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcf3c029440 con 0x55b57b5f6d30 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.738+0000 7fcf67eecb80 10 client.18105 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.738+0000 7fcf67eecb80 10 client.18105 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.738+0000 7fcf67eecb80 20 client.18105 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.738+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b57b662fb0 0x55b57b6653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.738+0000 7fcf67eecb80 4 client.18105 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:25:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.738+0000 7fcf67eecb80 1 -- 172.21.15.12:0/842318914 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b57b510fd0 con 0x55b57b662fb0 2023-12-11T20:25:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.738+0000 7fcf5239b700 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b57b662fb0 0x55b57b6653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf5239b700 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b57b662fb0 0x55b57b6653d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d2f911486ff3614 server_cookie=e1e1461411fe379d in_seq=0 out_seq=0 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf35ffb700 10 client.18105 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf35ffb700 1 -- 172.21.15.12:0/842318914 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b57b510fd0 con 0x55b57b662fb0 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf35ffb700 10 client.18105 handle_command_reply: tid=0 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 client.18105 shutdown 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 -- 172.21.15.12:0/842318914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f6d30 msgr2=0x55b57b6034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f6d30 0x55b57b6034f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0124a0 tx=0x7fcf3c012b50 comp rx=0 tx=0).stop 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 -- 172.21.15.12:0/842318914 shutdown_connections 2023-12-11T20:25:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b57b662fb0 0x55b57b6653d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b57b5f7c20 0x55b57b606510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b57b5f63d0 0x55b57b602fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 --2- 172.21.15.12:0/842318914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b57b5f6d30 0x55b57b6034f0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 -- 172.21.15.12:0/842318914 >> 172.21.15.12:0/842318914 conn(0x55b57b5257e0 msgr2=0x55b57b5fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf35ffb700 0 client.18105 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 -- 172.21.15.12:0/842318914 shutdown_connections 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.739+0000 7fcf67eecb80 1 -- 172.21.15.12:0/842318914 wait complete. 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf67eecb80 20 client.18105 trim_cache size 0 max 16384 2023-12-11T20:25:10.744 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 -- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf380a1500 msgr2=0x7fcf380a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf380a1500 0x7fcf380a39c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c104720 tx=0x7fcf48009260 comp rx=0 tx=0).stop 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 -- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 msgr2=0x7fcf4c1a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 0x7fcf4c1a0b60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fcf44007af0 tx=0x7fcf44007870 comp rx=0 tx=0).stop 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 -- 172.21.15.12:0/2690436107 shutdown_connections 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf380a1500 0x7fcf380a39c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf4c1036d0 0x7fcf4c199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf4c105260 0x7fcf4c1a0b60 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 --2- 172.21.15.12:0/2690436107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf4c1048c0 0x7fcf4c199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.740+0000 7fcf545ff700 1 -- 172.21.15.12:0/2690436107 >> 172.21.15.12:0/2690436107 conn(0x7fcf4c0fec40 msgr2=0x7fcf4c107c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.741+0000 7fcf545ff700 1 -- 172.21.15.12:0/2690436107 shutdown_connections 2023-12-11T20:25:10.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.741+0000 7fcf545ff700 1 -- 172.21.15.12:0/2690436107 wait complete. 2023-12-11T20:25:10.755 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:10 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3254317801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:25:10.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:25:10.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:10 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3254317801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 -- 172.21.15.12:0/590276501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4102ea0 msgr2=0x7f21e4109750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 --2- 172.21.15.12:0/590276501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4102ea0 0x7f21e4109750 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00b0d0 tx=0x7f21dc00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 -- 172.21.15.12:0/590276501 shutdown_connections 2023-12-11T20:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 --2- 172.21.15.12:0/590276501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21e4101310 0x7f21e4101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 --2- 172.21.15.12:0/590276501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4102ea0 0x7f21e4109750 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 --2- 172.21.15.12:0/590276501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21e4102500 0x7f21e4102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 -- 172.21.15.12:0/590276501 >> 172.21.15.12:0/590276501 conn(0x7f21e40fc860 msgr2=0x7f21e40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 -- 172.21.15.12:0/590276501 shutdown_connections 2023-12-11T20:25:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.979+0000 7f21e3fff700 1 -- 172.21.15.12:0/590276501 wait complete. 2023-12-11T20:25:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.980+0000 7f21e3fff700 1 Processor -- start 2023-12-11T20:25:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.980+0000 7f21e3fff700 1 -- start start 2023-12-11T20:25:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4101310 0x7f21e4199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21e4102500 0x7f21e41998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21e4102ea0 0x7f21e41a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e41a0eb0 con 0x7f21e4101310 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e3fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e41a0ff0 con 0x7f21e4102ea0 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e3fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e41a1180 con 0x7f21e4102500 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4101310 0x7f21e4199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4101310 0x7f21e4199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37220/0 (socket says 172.21.15.12:37220) 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e2ffd700 1 -- 172.21.15.12:0/2456264624 learned_addr learned my addr 172.21.15.12:0/2456264624 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e27fc700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21e4102500 0x7f21e41998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e2ffd700 1 -- 172.21.15.12:0/2456264624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21e4102500 msgr2=0x7f21e41998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21e4102500 0x7f21e41998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e37fe700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21e4102ea0 0x7f21e41a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e2ffd700 1 -- 172.21.15.12:0/2456264624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21e4102ea0 msgr2=0x7f21e41a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21e4102ea0 0x7f21e41a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.981+0000 7f21e2ffd700 1 -- 172.21.15.12:0/2456264624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc009d00 con 0x7f21e4101310 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.982+0000 7f21e27fc700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21e4102500 0x7f21e41998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.982+0000 7f21e37fe700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21e4102ea0 0x7f21e41a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.982+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4101310 0x7f21e4199380 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f21d400e970 tx=0x7f21d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.982+0000 7f21e89fd700 1 -- 172.21.15.12:0/2456264624 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4009790 con 0x7f21e4101310 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.982+0000 7f21e3fff700 1 -- 172.21.15.12:0/2456264624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e41a1460 con 0x7f21e4101310 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.982+0000 7f21e89fd700 1 -- 172.21.15.12:0/2456264624 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21d40044b0 con 0x7f21e4101310 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.982+0000 7f21e89fd700 1 -- 172.21.15.12:0/2456264624 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4003dd0 con 0x7f21e4101310 2023-12-11T20:25:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.982+0000 7f21e3fff700 1 -- 172.21.15.12:0/2456264624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e41a19c0 con 0x7f21e4101310 2023-12-11T20:25:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.986+0000 7f21e89fd700 1 -- 172.21.15.12:0/2456264624 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f21d4003f30 con 0x7f21e4101310 2023-12-11T20:25:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.987+0000 7f21fd396b80 1 Processor -- start 2023-12-11T20:25:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.987+0000 7f21e89fd700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21cc0a15a0 0x7f21cc0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.987+0000 7f21fd396b80 1 -- start start 2023-12-11T20:25:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.987+0000 7f21e89fd700 1 -- 172.21.15.12:0/2456264624 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21d4014070 con 0x7f21e4101310 2023-12-11T20:25:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.987+0000 7f21e37fe700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21cc0a15a0 0x7f21cc0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.987+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920464ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920464d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464dde0 0x55920464e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21fd396b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592045a7b50 con 0x55920464d3c0 2023-12-11T20:25:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21fd396b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592045a5470 con 0x55920464dde0 2023-12-11T20:25:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21fd396b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592045a0d60 con 0x55920464ca60 2023-12-11T20:25:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920464d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920464d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37230/0 (socket says 172.21.15.12:37230) 2023-12-11T20:25:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e27fc700 1 -- 172.21.15.12:0/3197937677 learned_addr learned my addr 172.21.15.12:0/3197937677 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920464ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e37fe700 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464dde0 0x55920464e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e27fc700 1 -- 172.21.15.12:0/3197937677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 msgr2=0x55920464ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e27fc700 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920464ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e27fc700 1 -- 172.21.15.12:0/3197937677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464dde0 msgr2=0x55920464e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e27fc700 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464dde0 0x55920464e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e37fe700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21cc0a15a0 0x7f21cc0a3a60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009fd0 tx=0x7f21dc0092e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e27fc700 1 -- 172.21.15.12:0/3197937677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55920441d630 con 0x55920464d3c0 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.988+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920464ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.989+0000 7f21e27fc700 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920464d8a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009de0 tx=0x7f21d80116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8707d46509f56a3f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.989+0000 7f21c9ffb700 1 -- 172.21.15.12:0/3197937677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8011e20 con 0x55920464d3c0 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.989+0000 7f21c9ffb700 1 -- 172.21.15.12:0/3197937677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21d80128e0 con 0x55920464d3c0 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.989+0000 7f21c9ffb700 1 -- 172.21.15.12:0/3197937677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d800f7c0 con 0x55920464d3c0 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 -- 172.21.15.12:0/3197937677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 msgr2=0x55920464d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920464d8a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009de0 tx=0x7f21d80116c0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 -- 172.21.15.12:0/3197937677 shutdown_connections 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464dde0 0x55920464e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920464ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 --2- 172.21.15.12:0/3197937677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920464d8a0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 -- 172.21.15.12:0/3197937677 >> 172.21.15.12:0/3197937677 conn(0x55920457b7e0 msgr2=0x5592046473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 -- 172.21.15.12:0/3197937677 shutdown_connections 2023-12-11T20:25:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.990+0000 7f21fd396b80 1 -- 172.21.15.12:0/3197937677 wait complete. 2023-12-11T20:25:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.991+0000 7f21fd396b80 1 -- start start 2023-12-11T20:25:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.991+0000 7f21fd396b80 1 Processor -- start 2023-12-11T20:25:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.991+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x5592046563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.991+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464d3c0 0x5592046568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.991+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 0x55920465d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21fd396b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920455a560 con 0x55920464dde0 2023-12-11T20:25:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21fd396b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920455a200 con 0x55920464ca60 2023-12-11T20:25:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21fd396b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920441f920 con 0x55920464d3c0 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21fd396b80 10 client.0 _ll_register_callbacks cb 0x559204485a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x5592046563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x5592046563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49782/0 (socket says 172.21.15.12:49782) 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e2ffd700 1 -- 172.21.15.12:0/1121856489 learned_addr learned my addr 172.21.15.12:0/1121856489 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e27fc700 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464d3c0 0x5592046568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e37fe700 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 0x55920465d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e2ffd700 1 -- 172.21.15.12:0/1121856489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464d3c0 msgr2=0x5592046568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464d3c0 0x5592046568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e2ffd700 1 -- 172.21.15.12:0/1121856489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 msgr2=0x55920465d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 0x55920465d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.992+0000 7f21e2ffd700 1 -- 172.21.15.12:0/1121856489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e41a19c0 con 0x55920464ca60 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x5592046563a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f21d4005950 tx=0x7f21d409ab40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b82e59d4f581107 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21c2ffd700 1 -- 172.21.15.12:0/1121856489 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d40a26a0 con 0x55920464ca60 2023-12-11T20:25:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21c2ffd700 1 -- 172.21.15.12:0/1121856489 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21d40b0070 con 0x55920464ca60 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21fd396b80 1 -- 172.21.15.12:0/1121856489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55920463f9e0 con 0x55920464ca60 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21c2ffd700 1 -- 172.21.15.12:0/1121856489 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21d4016df0 con 0x55920464ca60 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21fd396b80 10 client.27740 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21fd396b80 1 -- 172.21.15.12:0/1121856489 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f21d8009a10 con 0x55920464ca60 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.993+0000 7f21c2ffd700 1 -- 172.21.15.12:0/1121856489 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55920463f9e0 con 0x55920464ca60 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.994+0000 7f21c2ffd700 1 -- 172.21.15.12:0/1121856489 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f21d4099800 con 0x55920464ca60 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.994+0000 7f21fd396b80 10 client.27740 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.994+0000 7f21fd396b80 10 client.27740 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.994+0000 7f21fd396b80 20 client.27740 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.994+0000 7f21fd396b80 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559204662120 0x559204664540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.994+0000 7f21fd396b80 4 client.27740 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.994+0000 7f21fd396b80 1 -- 172.21.15.12:0/1121856489 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55920461bf40 con 0x559204662120 2023-12-11T20:25:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.994+0000 7f21e27fc700 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559204662120 0x559204664540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:10.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.995+0000 7f21e27fc700 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559204662120 0x559204664540 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=65146569a7cbfcec server_cookie=f30329045ceaf435 in_seq=0 out_seq=0 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.995+0000 7f21c2ffd700 10 client.27740 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21c2ffd700 1 -- 172.21.15.12:0/1121856489 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55920461bf40 con 0x559204662120 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21c2ffd700 10 client.27740 handle_command_reply: tid=0 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 client.27740 shutdown 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 -- 172.21.15.12:0/1121856489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 msgr2=0x5592046563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x5592046563a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f21d4005950 tx=0x7f21d409ab40 comp rx=0 tx=0).stop 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 -- 172.21.15.12:0/1121856489 shutdown_connections 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x559204662120 0x559204664540 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x5592046563a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 0x55920465d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 --2- 172.21.15.12:0/1121856489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464d3c0 0x5592046568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21c2ffd700 0 client.27740 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 -- 172.21.15.12:0/1121856489 >> 172.21.15.12:0/1121856489 conn(0x55920457b7e0 msgr2=0x55920464b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 -- 172.21.15.12:0/1121856489 shutdown_connections 2023-12-11T20:25:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 1 -- 172.21.15.12:0/1121856489 wait complete. 2023-12-11T20:25:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:10.996+0000 7f21fd396b80 20 client.27740 trim_cache size 0 max 16384 2023-12-11T20:25:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21fd396b80 1 Processor -- start 2023-12-11T20:25:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21fd396b80 1 -- start start 2023-12-11T20:25:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x559204664510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920465d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464dde0 0x5592046558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21fd396b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920465f6a0 con 0x55920464d3c0 2023-12-11T20:25:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21fd396b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592046438b0 con 0x55920464ca60 2023-12-11T20:25:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21fd396b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559204669770 con 0x55920464dde0 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21e27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920465d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21e27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920465d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37238/0 (socket says 172.21.15.12:37238) 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.011+0000 7f21e27fc700 1 -- 172.21.15.12:0/57951680 learned_addr learned my addr 172.21.15.12:0/57951680 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x559204664510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e37fe700 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464dde0 0x5592046558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e27fc700 1 -- 172.21.15.12:0/57951680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464dde0 msgr2=0x5592046558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e27fc700 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464dde0 0x5592046558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e27fc700 1 -- 172.21.15.12:0/57951680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 msgr2=0x559204664510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e27fc700 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x559204664510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e27fc700 1 -- 172.21.15.12:0/57951680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592043c9de0 con 0x55920464d3c0 2023-12-11T20:25:11.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x559204664510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:11.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.012+0000 7f21e27fc700 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920465d890 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f21d801c040 tx=0x7f21d8005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8807ffa9ea263c38 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:11.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21ca7fc700 1 -- 172.21.15.12:0/57951680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d80126d0 con 0x55920464d3c0 2023-12-11T20:25:11.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21ca7fc700 1 -- 172.21.15.12:0/57951680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21d802e070 con 0x55920464d3c0 2023-12-11T20:25:11.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21ca7fc700 1 -- 172.21.15.12:0/57951680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d80055c0 con 0x55920464d3c0 2023-12-11T20:25:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21fd396b80 1 -- 172.21.15.12:0/57951680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 msgr2=0x55920465d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21fd396b80 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920465d890 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f21d801c040 tx=0x7f21d8005940 comp rx=0 tx=0).stop 2023-12-11T20:25:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21fd396b80 1 -- 172.21.15.12:0/57951680 shutdown_connections 2023-12-11T20:25:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21fd396b80 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464ca60 0x559204664510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21fd396b80 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464dde0 0x5592046558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21fd396b80 1 --2- 172.21.15.12:0/57951680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464d3c0 0x55920465d890 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.013+0000 7f21fd396b80 1 -- 172.21.15.12:0/57951680 >> 172.21.15.12:0/57951680 conn(0x55920457b7e0 msgr2=0x5592046473a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.014+0000 7f21fd396b80 1 -- 172.21.15.12:0/57951680 shutdown_connections 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.014+0000 7f21fd396b80 1 -- 172.21.15.12:0/57951680 wait complete. 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.014+0000 7f21fd396b80 1 -- start start 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.014+0000 7f21fd396b80 1 Processor -- start 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920465b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464d3c0 0x55920465b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21fd396b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 0x55920465c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21fd396b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920465c9a0 con 0x55920464dde0 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21fd396b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920465cb10 con 0x55920464d3c0 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21fd396b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920465ccd0 con 0x55920464ca60 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21fd396b80 10 client.0 _ll_register_callbacks cb 0x559204485a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920465b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 0x55920465c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920465b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:42844/0 (socket says 172.21.15.12:42844) 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e2ffd700 1 -- 172.21.15.12:0/2228434256 learned_addr learned my addr 172.21.15.12:0/2228434256 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e27fc700 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464d3c0 0x55920465b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e2ffd700 1 -- 172.21.15.12:0/2228434256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464d3c0 msgr2=0x55920465b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464d3c0 0x55920465b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e2ffd700 1 -- 172.21.15.12:0/2228434256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 msgr2=0x55920465c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.015+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 0x55920465c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.016+0000 7f21e2ffd700 1 -- 172.21.15.12:0/2228434256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d8009a10 con 0x55920464ca60 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.016+0000 7f21e2ffd700 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920465b010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21d40a2170 tx=0x7f21d4099f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93f7343cc532b3f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.016+0000 7f21c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.016+0000 7f21c2ffd700 1 -- 172.21.15.12:0/2228434256 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4062030 con 0x55920464ca60 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.016+0000 7f21c2ffd700 1 -- 172.21.15.12:0/2228434256 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21d40b0050 con 0x55920464ca60 2023-12-11T20:25:11.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.016+0000 7f21fd396b80 1 -- 172.21.15.12:0/2228434256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21d80128e0 con 0x55920464ca60 2023-12-11T20:25:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.016+0000 7f21c2ffd700 1 -- 172.21.15.12:0/2228434256 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21d40041e0 con 0x55920464ca60 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21fd396b80 10 client.27754 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21fd396b80 1 -- 172.21.15.12:0/2228434256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55920441d630 con 0x55920464ca60 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21c2ffd700 1 -- 172.21.15.12:0/2228434256 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21d80128e0 con 0x55920464ca60 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21c2ffd700 1 -- 172.21.15.12:0/2228434256 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f21d40a2210 con 0x55920464ca60 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21fd396b80 10 client.27754 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21fd396b80 10 client.27754 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21fd396b80 20 client.27754 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21fd396b80 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5592046b8c80 0x5592046bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21fd396b80 4 client.27754 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.017+0000 7f21fd396b80 1 -- 172.21.15.12:0/2228434256 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559204566fd0 con 0x5592046b8c80 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.018+0000 7f21e27fc700 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5592046b8c80 0x5592046bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.018+0000 7f21e27fc700 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5592046b8c80 0x5592046bb0a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=abd38756e9696197 server_cookie=2b0596eecbda5bde in_seq=0 out_seq=0 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.018+0000 7f21c2ffd700 10 client.27754 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21c2ffd700 1 -- 172.21.15.12:0/2228434256 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559204566fd0 con 0x5592046b8c80 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21c2ffd700 10 client.27754 handle_command_reply: tid=0 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 client.27754 shutdown 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 -- 172.21.15.12:0/2228434256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 msgr2=0x55920465b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920465b010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21d40a2170 tx=0x7f21d4099f20 comp rx=0 tx=0).stop 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 -- 172.21.15.12:0/2228434256 shutdown_connections 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5592046b8c80 0x5592046bb0a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920464dde0 0x55920465c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920464ca60 0x55920465b010 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21c2ffd700 0 client.27754 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 --2- 172.21.15.12:0/2228434256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920464d3c0 0x55920465b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 -- 172.21.15.12:0/2228434256 >> 172.21.15.12:0/2228434256 conn(0x55920457b7e0 msgr2=0x559204654290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 -- 172.21.15.12:0/2228434256 shutdown_connections 2023-12-11T20:25:11.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 1 -- 172.21.15.12:0/2228434256 wait complete. 2023-12-11T20:25:11.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.019+0000 7f21fd396b80 20 client.27754 trim_cache size 0 max 16384 2023-12-11T20:25:11.023 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 -- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21cc0a15a0 msgr2=0x7f21cc0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21cc0a15a0 0x7f21cc0a3a60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009fd0 tx=0x7f21dc0092e0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 -- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4101310 msgr2=0x7f21e4199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4101310 0x7f21e4199380 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f21d400e970 tx=0x7f21d400ed30 comp rx=0 tx=0).stop 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 -- 172.21.15.12:0/2456264624 shutdown_connections 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f21cc0a15a0 0x7f21cc0a3a60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21e4102ea0 0x7f21e41a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21e4101310 0x7f21e4199380 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 --2- 172.21.15.12:0/2456264624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21e4102500 0x7f21e41998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 -- 172.21.15.12:0/2456264624 >> 172.21.15.12:0/2456264624 conn(0x7f21e40fc860 msgr2=0x7f21e4073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 -- 172.21.15.12:0/2456264624 shutdown_connections 2023-12-11T20:25:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.020+0000 7f21e3fff700 1 -- 172.21.15.12:0/2456264624 wait complete. 2023-12-11T20:25:11.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:25:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.281+0000 7f8861b9d700 1 -- 172.21.15.12:0/2559247671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c1046e0 msgr2=0x7f885c106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.281+0000 7f8861b9d700 1 --2- 172.21.15.12:0/2559247671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c1046e0 0x7f885c106ad0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8848009990 tx=0x7f8848009ca0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.282+0000 7f8861b9d700 1 -- 172.21.15.12:0/2559247671 shutdown_connections 2023-12-11T20:25:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.282+0000 7f8861b9d700 1 --2- 172.21.15.12:0/2559247671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f885c101db0 0x7f885c1041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.282+0000 7f8861b9d700 1 --2- 172.21.15.12:0/2559247671 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f885c107010 0x7f885c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.282+0000 7f8861b9d700 1 --2- 172.21.15.12:0/2559247671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c1046e0 0x7f885c106ad0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.282+0000 7f8861b9d700 1 -- 172.21.15.12:0/2559247671 >> 172.21.15.12:0/2559247671 conn(0x7f885c0fb740 msgr2=0x7f885c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.282+0000 7f8861b9d700 1 -- 172.21.15.12:0/2559247671 shutdown_connections 2023-12-11T20:25:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.282+0000 7f8861b9d700 1 -- 172.21.15.12:0/2559247671 wait complete. 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.283+0000 7f8861b9d700 1 Processor -- start 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.283+0000 7f8861b9d700 1 -- start start 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.283+0000 7f8861b9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f885c101db0 0x7f885c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f8861b9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f885c1046e0 0x7f885c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f8861b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c107010 0x7f885c1a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f8861b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1a0df0 con 0x7f885c107010 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f8861b9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1a0f30 con 0x7f885c1046e0 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f8861b9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1a10c0 con 0x7f885c101db0 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f886139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c107010 0x7f885c1a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f8860b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f885c101db0 0x7f885c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f886139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c107010 0x7f885c1a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37256/0 (socket says 172.21.15.12:37256) 2023-12-11T20:25:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f886139c700 1 -- 172.21.15.12:0/3246206618 learned_addr learned my addr 172.21.15.12:0/3246206618 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f885bfff700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f885c1046e0 0x7f885c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f886139c700 1 -- 172.21.15.12:0/3246206618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f885c101db0 msgr2=0x7f885c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f886139c700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f885c101db0 0x7f885c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f886139c700 1 -- 172.21.15.12:0/3246206618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f885c1046e0 msgr2=0x7f885c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f886139c700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f885c1046e0 0x7f885c199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.284+0000 7f886139c700 1 -- 172.21.15.12:0/3246206618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480095f0 con 0x7f885c107010 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.285+0000 7f886139c700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c107010 0x7f885c1a0820 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8854007ee0 tx=0x7f885400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.285+0000 7f8859ffb700 1 -- 172.21.15.12:0/3246206618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885400dd20 con 0x7f885c107010 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.285+0000 7f8859ffb700 1 -- 172.21.15.12:0/3246206618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f885400f040 con 0x7f885c107010 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.285+0000 7f8859ffb700 1 -- 172.21.15.12:0/3246206618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854004750 con 0x7f885c107010 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.285+0000 7f8861b9d700 1 -- 172.21.15.12:0/3246206618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c1a13a0 con 0x7f885c107010 2023-12-11T20:25:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.285+0000 7f8861b9d700 1 -- 172.21.15.12:0/3246206618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c1a1860 con 0x7f885c107010 2023-12-11T20:25:11.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.290+0000 7f8859ffb700 1 -- 172.21.15.12:0/3246206618 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8854003a00 con 0x7f885c107010 2023-12-11T20:25:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.291+0000 7f887668cb80 1 Processor -- start 2023-12-11T20:25:11.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.291+0000 7f887668cb80 1 -- start start 2023-12-11T20:25:11.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.291+0000 7f887668cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a67de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.291+0000 7f887668cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a67e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.291+0000 7f887668cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a67f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.291+0000 7f887668cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a5d8b50 con 0x559a8a67da60 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f887668cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a5d6470 con 0x559a8a67e3c0 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f887668cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a5d1d60 con 0x559a8a67ede0 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f885bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a67de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f885bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a67de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37258/0 (socket says 172.21.15.12:37258) 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f885bfff700 1 -- 172.21.15.12:0/4241211166 learned_addr learned my addr 172.21.15.12:0/4241211166 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f8860b9b700 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a67e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f8859ffb700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f884c0a15a0 0x7f884c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f885bfff700 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a67f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f8859ffb700 1 -- 172.21.15.12:0/3246206618 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f88540cc590 con 0x7f885c107010 2023-12-11T20:25:11.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f885bfff700 1 -- 172.21.15.12:0/4241211166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 msgr2=0x559a8a67f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f885bfff700 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a67f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f885bfff700 1 -- 172.21.15.12:0/4241211166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 msgr2=0x559a8a67e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.292+0000 7f886139c700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f884c0a15a0 0x7f884c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.293+0000 7f885bfff700 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a67e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.293+0000 7f885bfff700 1 -- 172.21.15.12:0/4241211166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a8a44e630 con 0x559a8a67da60 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.293+0000 7f8860b9b700 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a67e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.293+0000 7f885bfff700 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a67de80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f884800b2e0 tx=0x7f8848009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ec1aa613e50942 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.293+0000 7f886139c700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f884c0a15a0 0x7f884c0a3a60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88540ca040 tx=0x7f8854004130 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.293+0000 7f8846ffd700 1 -- 172.21.15.12:0/4241211166 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884801d070 con 0x559a8a67da60 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.293+0000 7f8846ffd700 1 -- 172.21.15.12:0/4241211166 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88480054a0 con 0x559a8a67da60 2023-12-11T20:25:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.293+0000 7f8846ffd700 1 -- 172.21.15.12:0/4241211166 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800b710 con 0x559a8a67da60 2023-12-11T20:25:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 -- 172.21.15.12:0/4241211166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 msgr2=0x559a8a67de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a67de80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f884800b2e0 tx=0x7f8848009510 comp rx=0 tx=0).stop 2023-12-11T20:25:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 -- 172.21.15.12:0/4241211166 shutdown_connections 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a67f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a67de80 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 --2- 172.21.15.12:0/4241211166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a67e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 -- 172.21.15.12:0/4241211166 >> 172.21.15.12:0/4241211166 conn(0x559a8a5ac7e0 msgr2=0x559a8a6783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 -- 172.21.15.12:0/4241211166 shutdown_connections 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.294+0000 7f887668cb80 1 -- 172.21.15.12:0/4241211166 wait complete. 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.295+0000 7f887668cb80 1 -- start start 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.295+0000 7f887668cb80 1 Processor -- start 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.295+0000 7f887668cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a687340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f887668cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a687880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f887668cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a68e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f887668cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a58b560 con 0x559a8a67da60 2023-12-11T20:25:11.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f887668cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a58b200 con 0x559a8a67e3c0 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f887668cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a450920 con 0x559a8a67ede0 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f887668cb80 10 client.0 _ll_register_callbacks cb 0x559a8a4b6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f885bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a687340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f885bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a687340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37268/0 (socket says 172.21.15.12:37268) 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f885bfff700 1 -- 172.21.15.12:0/2681182135 learned_addr learned my addr 172.21.15.12:0/2681182135 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f8860b9b700 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a687880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f885bfff700 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a68e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f8860b9b700 1 -- 172.21.15.12:0/2681182135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 msgr2=0x559a8a68e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f8860b9b700 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a68e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f8860b9b700 1 -- 172.21.15.12:0/2681182135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 msgr2=0x559a8a687340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f8860b9b700 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a687340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f8860b9b700 1 -- 172.21.15.12:0/2681182135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88500098e0 con 0x559a8a67e3c0 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.296+0000 7f885bfff700 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a68e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:25:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.297+0000 7f8860b9b700 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a687880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8850012980 tx=0x7f8850012c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5776cc0512bee8c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.297+0000 7f883bfff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.297+0000 7f883bfff700 1 -- 172.21.15.12:0/2681182135 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850017070 con 0x559a8a67e3c0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.297+0000 7f887668cb80 1 -- 172.21.15.12:0/2681182135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a8a6709e0 con 0x559a8a67e3c0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.297+0000 7f883bfff700 1 -- 172.21.15.12:0/2681182135 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8850004030 con 0x559a8a67e3c0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.297+0000 7f883bfff700 1 -- 172.21.15.12:0/2681182135 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88500041f0 con 0x559a8a67e3c0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.297+0000 7f887668cb80 10 client.27758 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.297+0000 7f887668cb80 1 -- 172.21.15.12:0/2681182135 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f8848020040 con 0x559a8a67e3c0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f883bfff700 1 -- 172.21.15.12:0/2681182135 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559a8a6709e0 con 0x559a8a67e3c0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f883bfff700 1 -- 172.21.15.12:0/2681182135 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8850003710 con 0x559a8a67e3c0 2023-12-11T20:25:11.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f887668cb80 10 client.27758 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f887668cb80 10 client.27758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f887668cb80 20 client.27758 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f887668cb80 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559a8a693140 0x559a8a695560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f887668cb80 4 client.27758 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f887668cb80 1 -- 172.21.15.12:0/2681182135 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a8a64cf40 con 0x559a8a693140 2023-12-11T20:25:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.298+0000 7f885bfff700 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559a8a693140 0x559a8a695560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.299+0000 7f885bfff700 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559a8a693140 0x559a8a695560 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d3b8b672b9913 server_cookie=db106172349d33cb in_seq=0 out_seq=0 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.299+0000 7f883bfff700 10 client.27758 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f883bfff700 1 -- 172.21.15.12:0/2681182135 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559a8a64cf40 con 0x559a8a693140 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f883bfff700 10 client.27758 handle_command_reply: tid=0 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 client.27758 shutdown 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 -- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 msgr2=0x559a8a687880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a687880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8850012980 tx=0x7f8850012c90 comp rx=0 tx=0).stop 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 -- 172.21.15.12:0/2681182135 shutdown_connections 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559a8a693140 0x559a8a695560 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a68e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a687340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f883bfff700 0 client.27758 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 --2- 172.21.15.12:0/2681182135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a687880 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 -- 172.21.15.12:0/2681182135 >> 172.21.15.12:0/2681182135 conn(0x559a8a5ac7e0 msgr2=0x559a8a67c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 -- 172.21.15.12:0/2681182135 shutdown_connections 2023-12-11T20:25:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.300+0000 7f887668cb80 1 -- 172.21.15.12:0/2681182135 wait complete. 2023-12-11T20:25:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.301+0000 7f887668cb80 20 client.27758 trim_cache size 0 max 16384 2023-12-11T20:25:11.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f887668cb80 1 Processor -- start 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f887668cb80 1 -- start start 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f887668cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a68ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f887668cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a68e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f887668cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a678280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f887668cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a68fa40 con 0x559a8a67da60 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f887668cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a679750 con 0x559a8a67e3c0 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f887668cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a686eb0 con 0x559a8a67ede0 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.318+0000 7f885bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a68ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f885bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a68ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37270/0 (socket says 172.21.15.12:37270) 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f885bfff700 1 -- 172.21.15.12:0/3583255860 learned_addr learned my addr 172.21.15.12:0/3583255860 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f8860b9b700 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a68e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f885bfff700 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a678280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f8860b9b700 1 -- 172.21.15.12:0/3583255860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 msgr2=0x559a8a678280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f8860b9b700 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a678280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f8860b9b700 1 -- 172.21.15.12:0/3583255860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 msgr2=0x559a8a68ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f8860b9b700 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a68ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f8860b9b700 1 -- 172.21.15.12:0/3583255860 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a8a3fade0 con 0x559a8a67e3c0 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f885bfff700 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a678280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f8860b9b700 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a68e880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8850003b20 tx=0x7f8850003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddde07233fd8aed5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.319+0000 7f88477fe700 1 -- 172.21.15.12:0/3583255860 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850017040 con 0x559a8a67e3c0 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f88477fe700 1 -- 172.21.15.12:0/3583255860 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8850021020 con 0x559a8a67e3c0 2023-12-11T20:25:11.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f88477fe700 1 -- 172.21.15.12:0/3583255860 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000fe20 con 0x559a8a67e3c0 2023-12-11T20:25:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 -- 172.21.15.12:0/3583255860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 msgr2=0x559a8a68e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a68e880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8850003b20 tx=0x7f8850003680 comp rx=0 tx=0).stop 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 -- 172.21.15.12:0/3583255860 shutdown_connections 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67ede0 0x559a8a678280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67da60 0x559a8a68ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 --2- 172.21.15.12:0/3583255860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67e3c0 0x559a8a68e880 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 -- 172.21.15.12:0/3583255860 >> 172.21.15.12:0/3583255860 conn(0x559a8a5ac7e0 msgr2=0x559a8a685300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 -- 172.21.15.12:0/3583255860 shutdown_connections 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.320+0000 7f887668cb80 1 -- 172.21.15.12:0/3583255860 wait complete. 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 1 -- start start 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 1 Processor -- start 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67da60 0x559a8a68c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67e3c0 0x559a8a68c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67ede0 0x559a8a68d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a68db70 con 0x559a8a67ede0 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a68dce0 con 0x559a8a67da60 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8a68dea0 con 0x559a8a67e3c0 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.321+0000 7f887668cb80 10 client.0 _ll_register_callbacks cb 0x559a8a4b6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67da60 0x559a8a68c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67ede0 0x559a8a68d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f8860b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67e3c0 0x559a8a68c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67ede0 0x559a8a68d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37282/0 (socket says 172.21.15.12:37282) 2023-12-11T20:25:11.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 -- 172.21.15.12:0/2723999353 learned_addr learned my addr 172.21.15.12:0/2723999353 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 -- 172.21.15.12:0/2723999353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67e3c0 msgr2=0x559a8a68c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67e3c0 0x559a8a68c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 -- 172.21.15.12:0/2723999353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67da60 msgr2=0x559a8a68c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67da60 0x559a8a68c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 -- 172.21.15.12:0/2723999353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8848020040 con 0x559a8a67ede0 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f885bfff700 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67ede0 0x559a8a68d630 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f88480095c0 tx=0x7f8848004100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfb4570352c6c77 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.322+0000 7f883bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.323+0000 7f883bfff700 1 -- 172.21.15.12:0/2723999353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884801d040 con 0x559a8a67ede0 2023-12-11T20:25:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.323+0000 7f883bfff700 1 -- 172.21.15.12:0/2723999353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f88480038d0 con 0x559a8a67ede0 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.323+0000 7f887668cb80 1 -- 172.21.15.12:0/2723999353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88480054a0 con 0x559a8a67ede0 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.323+0000 7f883bfff700 1 -- 172.21.15.12:0/2723999353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8848003a90 con 0x559a8a67ede0 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.323+0000 7f887668cb80 10 client.18141 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.323+0000 7f887668cb80 1 -- 172.21.15.12:0/2723999353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559a8a3e3c60 con 0x559a8a67ede0 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.323+0000 7f883bfff700 1 -- 172.21.15.12:0/2723999353 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88480054a0 con 0x559a8a67ede0 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.323+0000 7f883bfff700 1 -- 172.21.15.12:0/2723999353 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8848033050 con 0x559a8a67ede0 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.324+0000 7f887668cb80 10 client.18141 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.324+0000 7f887668cb80 10 client.18141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.324+0000 7f887668cb80 20 client.18141 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.324+0000 7f887668cb80 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559a8a6e9c40 0x559a8a6ec060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.324+0000 7f887668cb80 4 client.18141 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:25:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.324+0000 7f887668cb80 1 -- 172.21.15.12:0/2723999353 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559a8a597fd0 con 0x559a8a6e9c40 2023-12-11T20:25:11.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.324+0000 7f8860b9b700 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559a8a6e9c40 0x559a8a6ec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:11.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f883bfff700 10 client.18141 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:11.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f8860b9b700 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559a8a6e9c40 0x559a8a6ec060 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cb77fc1d36cebd7 server_cookie=4e93354a0ad39c96 in_seq=0 out_seq=0 2023-12-11T20:25:11.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f883bfff700 1 -- 172.21.15.12:0/2723999353 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559a8a597fd0 con 0x559a8a6e9c40 2023-12-11T20:25:11.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f883bfff700 10 client.18141 handle_command_reply: tid=0 2023-12-11T20:25:11.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 client.18141 shutdown 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 -- 172.21.15.12:0/2723999353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67ede0 msgr2=0x559a8a68d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67ede0 0x559a8a68d630 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f88480095c0 tx=0x7f8848004100 comp rx=0 tx=0).stop 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 -- 172.21.15.12:0/2723999353 shutdown_connections 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559a8a6e9c40 0x559a8a6ec060 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559a8a67da60 0x559a8a68c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a8a67ede0 0x559a8a68d630 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f883bfff700 0 client.18141 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 --2- 172.21.15.12:0/2723999353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559a8a67e3c0 0x559a8a68c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 -- 172.21.15.12:0/2723999353 >> 172.21.15.12:0/2723999353 conn(0x559a8a5ac7e0 msgr2=0x559a8a678280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 -- 172.21.15.12:0/2723999353 shutdown_connections 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.325+0000 7f887668cb80 1 -- 172.21.15.12:0/2723999353 wait complete. 2023-12-11T20:25:11.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f887668cb80 20 client.18141 trim_cache size 0 max 16384 2023-12-11T20:25:11.331 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:25:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 -- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f884c0a15a0 msgr2=0x7f884c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f884c0a15a0 0x7f884c0a3a60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88540ca040 tx=0x7f8854004130 comp rx=0 tx=0).stop 2023-12-11T20:25:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 -- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c107010 msgr2=0x7f885c1a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:11.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c107010 0x7f885c1a0820 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8854007ee0 tx=0x7f885400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 -- 172.21.15.12:0/3246206618 shutdown_connections 2023-12-11T20:25:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f884c0a15a0 0x7f884c0a3a60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f885c107010 0x7f885c1a0820 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f885c101db0 0x7f885c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 --2- 172.21.15.12:0/3246206618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f885c1046e0 0x7f885c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.326+0000 7f8861b9d700 1 -- 172.21.15.12:0/3246206618 >> 172.21.15.12:0/3246206618 conn(0x7f885c0fb740 msgr2=0x7f885c101510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.327+0000 7f8861b9d700 1 -- 172.21.15.12:0/3246206618 shutdown_connections 2023-12-11T20:25:11.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:11.327+0000 7f8861b9d700 1 -- 172.21.15.12:0/3246206618 wait complete. 2023-12-11T20:25:11.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:11 smithi032 ceph-mon[132488]: pgmap v653: 97 pgs: 97 active+clean; 6.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:25:11.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:11 smithi039 ceph-mon[102205]: pgmap v653: 97 pgs: 97 active+clean; 6.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:25:11.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:11 smithi012 ceph-mon[128787]: pgmap v653: 97 pgs: 97 active+clean; 6.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:25:12.346 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:25:12.346 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/4131858700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081036f0 msgr2=0x7f6d08103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/4131858700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081036f0 0x7f6d08103b10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80099c0 tx=0x7f6cf8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/4131858700 shutdown_connections 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/4131858700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d08105280 0x7f6d0810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/4131858700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081036f0 0x7f6d08103b10 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/4131858700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d081048e0 0x7f6d08104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/4131858700 >> 172.21.15.12:0/4131858700 conn(0x7f6d080fec80 msgr2=0x7f6d081010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/4131858700 shutdown_connections 2023-12-11T20:25:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.596+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/4131858700 wait complete. 2023-12-11T20:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.598+0000 7f6d0d1ff700 1 Processor -- start 2023-12-11T20:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.598+0000 7f6d0d1ff700 1 -- start start 2023-12-11T20:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.598+0000 7f6d0d1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d081036f0 0x7f6d08199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.598+0000 7f6d0d1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081048e0 0x7f6d08199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.598+0000 7f6d0d1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d08105280 0x7f6d081a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.598+0000 7f6d0d1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d081a1020 con 0x7f6d081048e0 2023-12-11T20:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.598+0000 7f6d0d1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d081a1160 con 0x7f6d08105280 2023-12-11T20:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.598+0000 7f6d0d1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d081a12f0 con 0x7f6d081036f0 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081048e0 0x7f6d08199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081048e0 0x7f6d08199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37302/0 (socket says 172.21.15.12:37302) 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0659c700 1 -- 172.21.15.12:0/1815413808 learned_addr learned my addr 172.21.15.12:0/1815413808 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0759e700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d08105280 0x7f6d081a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d081036f0 0x7f6d08199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0659c700 1 -- 172.21.15.12:0/1815413808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d081036f0 msgr2=0x7f6d08199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0659c700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d081036f0 0x7f6d08199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0659c700 1 -- 172.21.15.12:0/1815413808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d08105280 msgr2=0x7f6d081a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0659c700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d08105280 0x7f6d081a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.599+0000 7f6d0659c700 1 -- 172.21.15.12:0/1815413808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf80095f0 con 0x7f6d081048e0 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.600+0000 7f6d0659c700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081048e0 0x7f6d08199ad0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00d950 tx=0x7f6cfc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.600+0000 7f6ceffff700 1 -- 172.21.15.12:0/1815413808 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc00f890 con 0x7f6d081048e0 2023-12-11T20:25:12.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.600+0000 7f6ceffff700 1 -- 172.21.15.12:0/1815413808 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cfc00fe80 con 0x7f6d081048e0 2023-12-11T20:25:12.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.600+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/1815413808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d081a15d0 con 0x7f6d081048e0 2023-12-11T20:25:12.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.600+0000 7f6ceffff700 1 -- 172.21.15.12:0/1815413808 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc00e3b0 con 0x7f6d081048e0 2023-12-11T20:25:12.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.600+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/1815413808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d081a1ae0 con 0x7f6d081048e0 2023-12-11T20:25:12.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.604+0000 7f6ceffff700 1 -- 172.21.15.12:0/1815413808 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6cfc010460 con 0x7f6d081048e0 2023-12-11T20:25:12.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d20acfb80 1 Processor -- start 2023-12-11T20:25:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d20acfb80 1 -- start start 2023-12-11T20:25:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076c450 0x557af076c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076cdb0 0x557af076d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af076e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af06c7bd0 con 0x557af076dca0 2023-12-11T20:25:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af06c54f0 con 0x557af076c450 2023-12-11T20:25:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af06c0de0 con 0x557af076cdb0 2023-12-11T20:25:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.605+0000 7f6d0659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af076e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d0659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af076e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37318/0 (socket says 172.21.15.12:37318) 2023-12-11T20:25:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d0659c700 1 -- 172.21.15.12:0/838510356 learned_addr learned my addr 172.21.15.12:0/838510356 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d0759e700 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076c450 0x557af076c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076cdb0 0x557af076d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d0759e700 1 -- 172.21.15.12:0/838510356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076cdb0 msgr2=0x557af076d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d0759e700 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076cdb0 0x557af076d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d0759e700 1 -- 172.21.15.12:0/838510356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 msgr2=0x557af076e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d0759e700 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af076e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6d0759e700 1 -- 172.21.15.12:0/838510356 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557af053d6b0 con 0x557af076c450 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6ceffff700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6cf00a1480 0x7f6cf00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.606+0000 7f6ceffff700 1 -- 172.21.15.12:0/1815413808 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6cfc0ccb30 con 0x7f6d081048e0 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.607+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6cf00a1480 0x7f6cf00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.607+0000 7f6d0759e700 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076c450 0x557af076c870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000f410 tx=0x7f6d0000f720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299a5f860581dcb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.607+0000 7f6ced7fa700 1 -- 172.21.15.12:0/838510356 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00004bb0 con 0x557af076c450 2023-12-11T20:25:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.607+0000 7f6ced7fa700 1 -- 172.21.15.12:0/838510356 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d00004d10 con 0x557af076c450 2023-12-11T20:25:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.607+0000 7f6ced7fa700 1 -- 172.21.15.12:0/838510356 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00005020 con 0x557af076c450 2023-12-11T20:25:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 -- 172.21.15.12:0/838510356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076c450 msgr2=0x557af076c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076c450 0x557af076c870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000f410 tx=0x7f6d0000f720 comp rx=0 tx=0).stop 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6cf00a1480 0x7f6cf00a3940 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8006010 tx=0x7f6cf8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 -- 172.21.15.12:0/838510356 shutdown_connections 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076c450 0x557af076c870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af076e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/838510356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076cdb0 0x557af076d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 -- 172.21.15.12:0/838510356 >> 172.21.15.12:0/838510356 conn(0x557af069b860 msgr2=0x557af0768e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 -- 172.21.15.12:0/838510356 shutdown_connections 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.608+0000 7f6d20acfb80 1 -- 172.21.15.12:0/838510356 wait complete. 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.609+0000 7f6d20acfb80 1 -- start start 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.609+0000 7f6d20acfb80 1 Processor -- start 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.609+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0776250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.609+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af0776790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.609+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af077d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.609+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af067a5e0 con 0x557af076cdb0 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.609+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af067a280 con 0x557af076dca0 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.609+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af053f9a0 con 0x557af076c450 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d20acfb80 10 client.0 _ll_register_callbacks cb 0x557af05a5b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af0776790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af0776790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37332/0 (socket says 172.21.15.12:37332) 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0659c700 1 -- 172.21.15.12:0/2428326200 learned_addr learned my addr 172.21.15.12:0/2428326200 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0776250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0759e700 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af077d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0659c700 1 -- 172.21.15.12:0/2428326200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 msgr2=0x557af0776250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0659c700 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0776250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0659c700 1 -- 172.21.15.12:0/2428326200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 msgr2=0x557af077d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0659c700 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af077d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.610+0000 7f6d0659c700 1 -- 172.21.15.12:0/2428326200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d00007e10 con 0x557af076cdb0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6d0659c700 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af0776790 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc096300 tx=0x7f6cfc010950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c41ee54a8062b46 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6ceaff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6ceaff5700 1 -- 172.21.15.12:0/2428326200 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc09c070 con 0x557af076cdb0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6ceaff5700 1 -- 172.21.15.12:0/2428326200 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6cfc010760 con 0x557af076cdb0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6d20acfb80 1 -- 172.21.15.12:0/2428326200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557af075fbc0 con 0x557af076cdb0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6ceaff5700 1 -- 172.21.15.12:0/2428326200 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cfc099940 con 0x557af076cdb0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6d20acfb80 10 client.18153 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6d20acfb80 1 -- 172.21.15.12:0/2428326200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557af04e9e60 con 0x557af076cdb0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.611+0000 7f6ceaff5700 1 -- 172.21.15.12:0/2428326200 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557af075fbc0 con 0x557af076cdb0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.612+0000 7f6ceaff5700 1 -- 172.21.15.12:0/2428326200 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6cfc0992f0 con 0x557af076cdb0 2023-12-11T20:25:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.612+0000 7f6d20acfb80 10 client.18153 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.612+0000 7f6d20acfb80 10 client.18153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.612+0000 7f6d20acfb80 20 client.18153 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.612+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557af0781fd0 0x557af07843f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.612+0000 7f6d20acfb80 4 client.18153 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.612+0000 7f6d20acfb80 1 -- 172.21.15.12:0/2428326200 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557af073bfc0 con 0x557af0781fd0 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.612+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557af0781fd0 0x557af07843f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.613+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557af0781fd0 0x557af07843f0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=508c06f6f00f58c server_cookie=d74a65efcdaeb4b3 in_seq=0 out_seq=0 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.613+0000 7f6ceaff5700 10 client.18153 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6ceaff5700 1 -- 172.21.15.12:0/2428326200 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557af073bfc0 con 0x557af0781fd0 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6ceaff5700 10 client.18153 handle_command_reply: tid=0 2023-12-11T20:25:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 client.18153 shutdown 2023-12-11T20:25:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 -- 172.21.15.12:0/2428326200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 msgr2=0x557af0776790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af0776790 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc096300 tx=0x7f6cfc010950 comp rx=0 tx=0).stop 2023-12-11T20:25:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 -- 172.21.15.12:0/2428326200 shutdown_connections 2023-12-11T20:25:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557af0781fd0 0x557af07843f0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af077d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0776250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/2428326200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af0776790 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6ceaff5700 0 client.18153 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 -- 172.21.15.12:0/2428326200 >> 172.21.15.12:0/2428326200 conn(0x557af069b860 msgr2=0x557af0767ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 -- 172.21.15.12:0/2428326200 shutdown_connections 2023-12-11T20:25:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.614+0000 7f6d20acfb80 1 -- 172.21.15.12:0/2428326200 wait complete. 2023-12-11T20:25:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.615+0000 7f6d20acfb80 20 client.18153 trim_cache size 0 max 16384 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.635+0000 7f6d20acfb80 1 Processor -- start 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.635+0000 7f6d20acfb80 1 -- start start 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.635+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0769100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.635+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076cdb0 0x557af077d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.635+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af0767230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.635+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af076d190 con 0x557af076dca0 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.635+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af076bff0 con 0x557af076cdb0 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.635+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af075f950 con 0x557af076c450 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d0759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af0767230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d0759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af0767230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37342/0 (socket says 172.21.15.12:37342) 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d0759e700 1 -- 172.21.15.12:0/455285352 learned_addr learned my addr 172.21.15.12:0/455285352 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d06d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0769100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d0659c700 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076cdb0 0x557af077d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d06d9d700 1 -- 172.21.15.12:0/455285352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076cdb0 msgr2=0x557af077d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076cdb0 0x557af077d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d06d9d700 1 -- 172.21.15.12:0/455285352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 msgr2=0x557af0767230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af0767230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d06d9d700 1 -- 172.21.15.12:0/455285352 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557af04d2ce0 con 0x557af076c450 2023-12-11T20:25:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d0759e700 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af0767230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.636+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0769100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80098e0 tx=0x7f6cf801a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e66fe6955f5aa493 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6cedffb700 1 -- 172.21.15.12:0/455285352 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80340d0 con 0x557af076c450 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6cedffb700 1 -- 172.21.15.12:0/455285352 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cf801e040 con 0x557af076c450 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6cedffb700 1 -- 172.21.15.12:0/455285352 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80049f0 con 0x557af076c450 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6d20acfb80 1 -- 172.21.15.12:0/455285352 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 msgr2=0x557af0769100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0769100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80098e0 tx=0x7f6cf801a050 comp rx=0 tx=0).stop 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6d20acfb80 1 -- 172.21.15.12:0/455285352 shutdown_connections 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076dca0 0x557af0767230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af0769100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.637+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/455285352 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076cdb0 0x557af077d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.638+0000 7f6d20acfb80 1 -- 172.21.15.12:0/455285352 >> 172.21.15.12:0/455285352 conn(0x557af069b860 msgr2=0x557af07689f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.638+0000 7f6d20acfb80 1 -- 172.21.15.12:0/455285352 shutdown_connections 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.638+0000 7f6d20acfb80 1 -- 172.21.15.12:0/455285352 wait complete. 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.638+0000 7f6d20acfb80 1 -- start start 2023-12-11T20:25:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.638+0000 7f6d20acfb80 1 Processor -- start 2023-12-11T20:25:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af077cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af077d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d20acfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af07d8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af07d9190 con 0x557af076cdb0 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af07d92d0 con 0x557af076dca0 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d20acfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af07d9460 con 0x557af076c450 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d20acfb80 10 client.0 _ll_register_callbacks cb 0x557af05a5b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d0659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af077d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d06d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af077cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d0659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af077d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37354/0 (socket says 172.21.15.12:37354) 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d0659c700 1 -- 172.21.15.12:0/3387501861 learned_addr learned my addr 172.21.15.12:0/3387501861 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d0759e700 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af07d8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.639+0000 7f6d0659c700 1 -- 172.21.15.12:0/3387501861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 msgr2=0x557af077cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d0659c700 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af077cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d0659c700 1 -- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 msgr2=0x557af07d8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d0659c700 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af07d8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d0659c700 1 -- 172.21.15.12:0/3387501861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557af053d6b0 con 0x557af076cdb0 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d0759e700 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af07d8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af077cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d0659c700 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af077d490 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc099b00 tx=0x7f6cfc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167a50951697e2c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6ceaff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6ceaff5700 1 -- 172.21.15.12:0/3387501861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc09c070 con 0x557af076cdb0 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6ceaff5700 1 -- 172.21.15.12:0/3387501861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6cfc010760 con 0x557af076cdb0 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d20acfb80 1 -- 172.21.15.12:0/3387501861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557af07755c0 con 0x557af076cdb0 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6ceaff5700 1 -- 172.21.15.12:0/3387501861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cfc099940 con 0x557af076cdb0 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d20acfb80 10 client.18159 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.640+0000 7f6d20acfb80 1 -- 172.21.15.12:0/3387501861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f6d0810c480 con 0x557af076cdb0 2023-12-11T20:25:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6ceaff5700 1 -- 172.21.15.12:0/3387501861 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cfc065020 con 0x557af076cdb0 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6ceaff5700 1 -- 172.21.15.12:0/3387501861 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6cfc0a1d00 con 0x557af076cdb0 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6d20acfb80 10 client.18159 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6d20acfb80 10 client.18159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6d20acfb80 20 client.18159 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557af07daa70 0x557af07dce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6d20acfb80 4 client.18159 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6d20acfb80 1 -- 172.21.15.12:0/3387501861 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f6d00004d10 con 0x557af07daa70 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.641+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557af07daa70 0x557af07dce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.642+0000 7f6d06d9d700 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557af07daa70 0x557af07dce90 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1df8b3d0ee1de66 server_cookie=df60c4359663cf3b in_seq=0 out_seq=0 2023-12-11T20:25:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.642+0000 7f6ceaff5700 10 client.18159 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.643+0000 7f6ceaff5700 1 -- 172.21.15.12:0/3387501861 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f6d00004d10 con 0x557af07daa70 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.643+0000 7f6ceaff5700 10 client.18159 handle_command_reply: tid=0 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.643+0000 7f6d20acfb80 1 client.18159 shutdown 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 -- 172.21.15.12:0/3387501861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 msgr2=0x557af077d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af077d490 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc099b00 tx=0x7f6cfc010000 comp rx=0 tx=0).stop 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 -- 172.21.15.12:0/3387501861 shutdown_connections 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557af07daa70 0x557af07dce90 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557af076dca0 0x557af07d8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557af076c450 0x557af077cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 --2- 172.21.15.12:0/3387501861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557af076cdb0 0x557af077d490 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 -- 172.21.15.12:0/3387501861 >> 172.21.15.12:0/3387501861 conn(0x557af069b860 msgr2=0x557af0761550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6ceaff5700 0 client.18159 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 -- 172.21.15.12:0/3387501861 shutdown_connections 2023-12-11T20:25:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 1 -- 172.21.15.12:0/3387501861 wait complete. 2023-12-11T20:25:12.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.644+0000 7f6d20acfb80 20 client.18159 trim_cache size 0 max 16384 2023-12-11T20:25:12.647 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:25:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:25:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "acb3f466-9823-4954-b7d3-03d73cbbf307", 2023-12-11T20:25:12.647 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:25:12.647 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6cf00a1480 msgr2=0x7f6cf00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6cf00a1480 0x7f6cf00a3940 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8006010 tx=0x7f6cf8000bc0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081048e0 msgr2=0x7f6d08199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081048e0 0x7f6d08199ad0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00d950 tx=0x7f6cfc00dc60 comp rx=0 tx=0).stop 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/1815413808 shutdown_connections 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6cf00a1480 0x7f6cf00a3940 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d08105280 0x7f6d081a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d081036f0 0x7f6d08199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 --2- 172.21.15.12:0/1815413808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d081048e0 0x7f6d08199ad0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/1815413808 >> 172.21.15.12:0/1815413808 conn(0x7f6d080fec80 msgr2=0x7f6d08107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/1815413808 shutdown_connections 2023-12-11T20:25:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.645+0000 7f6d0d1ff700 1 -- 172.21.15.12:0/1815413808 wait complete. 2023-12-11T20:25:12.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:25:12.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 -- 172.21.15.12:0/4266532681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c107010 msgr2=0x7fdc5c109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/4266532681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c107010 0x7fdc5c109440 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400b0a0 tx=0x7fdc5400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 -- 172.21.15.12:0/4266532681 shutdown_connections 2023-12-11T20:25:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/4266532681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c107010 0x7fdc5c109440 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/4266532681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc5c101db0 0x7fdc5c1041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/4266532681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc5c1046e0 0x7fdc5c106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 -- 172.21.15.12:0/4266532681 >> 172.21.15.12:0/4266532681 conn(0x7fdc5c0fb740 msgr2=0x7fdc5c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 -- 172.21.15.12:0/4266532681 shutdown_connections 2023-12-11T20:25:12.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.909+0000 7fdc5bfff700 1 -- 172.21.15.12:0/4266532681 wait complete. 2023-12-11T20:25:12.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.910+0000 7fdc5bfff700 1 Processor -- start 2023-12-11T20:25:12.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.910+0000 7fdc5bfff700 1 -- start start 2023-12-11T20:25:12.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.910+0000 7fdc5bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c101db0 0x7fdc5c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.910+0000 7fdc5bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc5c1046e0 0x7fdc5c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc5c107010 0x7fdc5c1a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c1a0e90 con 0x7fdc5c101db0 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5bfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c1a0fd0 con 0x7fdc5c107010 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5bfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c1a1160 con 0x7fdc5c1046e0 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c101db0 0x7fdc5c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c101db0 0x7fdc5c199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37382/0 (socket says 172.21.15.12:37382) 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5affd700 1 -- 172.21.15.12:0/2132362723 learned_addr learned my addr 172.21.15.12:0/2132362723 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5a7fc700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc5c1046e0 0x7fdc5c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc5c107010 0x7fdc5c1a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5affd700 1 -- 172.21.15.12:0/2132362723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc5c1046e0 msgr2=0x7fdc5c1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5affd700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc5c1046e0 0x7fdc5c1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5affd700 1 -- 172.21.15.12:0/2132362723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc5c107010 msgr2=0x7fdc5c1a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5affd700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc5c107010 0x7fdc5c1a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.911+0000 7fdc5affd700 1 -- 172.21.15.12:0/2132362723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc54009d00 con 0x7fdc5c101db0 2023-12-11T20:25:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.912+0000 7fdc5affd700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c101db0 0x7fdc5c199360 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00e9a0 tx=0x7fdc4c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.912+0000 7fdc43fff700 1 -- 172.21.15.12:0/2132362723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c009790 con 0x7fdc5c101db0 2023-12-11T20:25:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.912+0000 7fdc43fff700 1 -- 172.21.15.12:0/2132362723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc4c010430 con 0x7fdc5c101db0 2023-12-11T20:25:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.912+0000 7fdc5bfff700 1 -- 172.21.15.12:0/2132362723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c1a1440 con 0x7fdc5c101db0 2023-12-11T20:25:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.912+0000 7fdc43fff700 1 -- 172.21.15.12:0/2132362723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c00cea0 con 0x7fdc5c101db0 2023-12-11T20:25:12.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.912+0000 7fdc5bfff700 1 -- 172.21.15.12:0/2132362723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c1a19a0 con 0x7fdc5c101db0 2023-12-11T20:25:12.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.916+0000 7fdc43fff700 1 -- 172.21.15.12:0/2132362723 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fdc4c0105a0 con 0x7fdc5c101db0 2023-12-11T20:25:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.917+0000 7fdc7520db80 1 Processor -- start 2023-12-11T20:25:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.917+0000 7fdc7520db80 1 -- start start 2023-12-11T20:25:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.917+0000 7fdc43fff700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc440a15a0 0x7fdc440a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.917+0000 7fdc43fff700 1 -- 172.21.15.12:0/2132362723 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc4c014070 con 0x7fdc5c101db0 2023-12-11T20:25:12.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be1380 0x556c69be17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc440a15a0 0x7fdc440a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69be04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69be82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc7520db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69b32b50 con 0x556c69be0a00 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc7520db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69b30470 con 0x556c69be1380 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc7520db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69b2bd60 con 0x556c69be0040 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69be82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc5affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be1380 0x556c69be17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69be82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37398/0 (socket says 172.21.15.12:37398) 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc5b7fe700 1 -- 172.21.15.12:0/3468118292 learned_addr learned my addr 172.21.15.12:0/3468118292 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc5affd700 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be1380 0x556c69be17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49920/0 (socket says 172.21.15.12:49920) 2023-12-11T20:25:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.918+0000 7fdc5a7fc700 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69be04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc5affd700 1 -- 172.21.15.12:0/3468118292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 msgr2=0x556c69be04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc5affd700 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69be04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc5affd700 1 -- 172.21.15.12:0/3468118292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 msgr2=0x556c69be82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc5affd700 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69be82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc5affd700 1 -- 172.21.15.12:0/3468118292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c699a8630 con 0x556c69be1380 2023-12-11T20:25:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc5a7fc700 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69be04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:12.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc440a15a0 0x7fdc440a3a60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400d010 tx=0x7fdc54009340 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc5affd700 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be1380 0x556c69be17a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0ca920 tx=0x7fdc4c09a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8be051d838f53e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc417fa700 1 -- 172.21.15.12:0/3468118292 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c09a140 con 0x556c69be1380 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc417fa700 1 -- 172.21.15.12:0/3468118292 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc4c09e290 con 0x556c69be1380 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.919+0000 7fdc417fa700 1 -- 172.21.15.12:0/3468118292 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0a2040 con 0x556c69be1380 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 -- 172.21.15.12:0/3468118292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be1380 msgr2=0x556c69be17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be1380 0x556c69be17a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0ca920 tx=0x7fdc4c09a040 comp rx=0 tx=0).stop 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 -- 172.21.15.12:0/3468118292 shutdown_connections 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be1380 0x556c69be17a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69be82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3468118292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69be04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 -- 172.21.15.12:0/3468118292 >> 172.21.15.12:0/3468118292 conn(0x556c69b067e0 msgr2=0x556c69bd23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 -- 172.21.15.12:0/3468118292 shutdown_connections 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.920+0000 7fdc7520db80 1 -- 172.21.15.12:0/3468118292 wait complete. 2023-12-11T20:25:12.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.921+0000 7fdc7520db80 1 -- start start 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.921+0000 7fdc7520db80 1 Processor -- start 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bf10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc7520db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69ae5560 con 0x556c69be0a00 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc7520db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69ae5200 con 0x556c69be0040 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc7520db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c699aa920 con 0x556c69be1380 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc7520db80 10 client.0 _ll_register_callbacks cb 0x556c69a10a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc5a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc5affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc5affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49926/0 (socket says 172.21.15.12:49926) 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc5affd700 1 -- 172.21.15.12:0/4087770335 learned_addr learned my addr 172.21.15.12:0/4087770335 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bf10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc5a7fc700 1 -- 172.21.15.12:0/4087770335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 msgr2=0x556c69bf10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc5a7fc700 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bf10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.922+0000 7fdc5a7fc700 1 -- 172.21.15.12:0/4087770335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 msgr2=0x556c69be9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc5a7fc700 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc5a7fc700 1 -- 172.21.15.12:0/4087770335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c1a19a0 con 0x556c69be0a00 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bf10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc5affd700 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc5a7fc700 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bea070 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fdc50012700 tx=0x7fdc50012a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac3a3a4b94cd4ee server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc3eff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc3eff5700 1 -- 172.21.15.12:0/4087770335 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50017070 con 0x556c69be0a00 2023-12-11T20:25:12.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc7520db80 1 -- 172.21.15.12:0/4087770335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c69bca9e0 con 0x556c69be0a00 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.923+0000 7fdc3eff5700 1 -- 172.21.15.12:0/4087770335 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc50004830 con 0x556c69be0a00 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc3eff5700 1 -- 172.21.15.12:0/4087770335 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc500049f0 con 0x556c69be0a00 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc7520db80 10 client.18171 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc7520db80 1 -- 172.21.15.12:0/4087770335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556c69954de0 con 0x556c69be0a00 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc3eff5700 1 -- 172.21.15.12:0/4087770335 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556c69bca9e0 con 0x556c69be0a00 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc3eff5700 1 -- 172.21.15.12:0/4087770335 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc50010430 con 0x556c69be0a00 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc7520db80 10 client.18171 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc7520db80 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc7520db80 20 client.18171 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556c69bf5940 0x556c69bf7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc7520db80 4 client.18171 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.924+0000 7fdc7520db80 1 -- 172.21.15.12:0/4087770335 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c69ba6f40 con 0x556c69bf5940 2023-12-11T20:25:12.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.925+0000 7fdc5affd700 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556c69bf5940 0x556c69bf7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.925+0000 7fdc5affd700 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556c69bf5940 0x556c69bf7d60 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9bd92f5130211e server_cookie=6bd4172ab32b28a2 in_seq=0 out_seq=0 2023-12-11T20:25:12.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.925+0000 7fdc3eff5700 10 client.18171 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.926+0000 7fdc3eff5700 1 -- 172.21.15.12:0/4087770335 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c69ba6f40 con 0x556c69bf5940 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.926+0000 7fdc3eff5700 10 client.18171 handle_command_reply: tid=0 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.926+0000 7fdc7520db80 1 client.18171 shutdown 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.926+0000 7fdc7520db80 1 -- 172.21.15.12:0/4087770335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 msgr2=0x556c69bea070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.926+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bea070 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fdc50012700 tx=0x7fdc50012a10 comp rx=0 tx=0).stop 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 1 -- 172.21.15.12:0/4087770335 shutdown_connections 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556c69bf5940 0x556c69bf7d60 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bf10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc3eff5700 0 client.18171 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4087770335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bea070 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 1 -- 172.21.15.12:0/4087770335 >> 172.21.15.12:0/4087770335 conn(0x556c69b067e0 msgr2=0x556c69bd6820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 1 -- 172.21.15.12:0/4087770335 shutdown_connections 2023-12-11T20:25:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 1 -- 172.21.15.12:0/4087770335 wait complete. 2023-12-11T20:25:12.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.927+0000 7fdc7520db80 20 client.18171 trim_cache size 0 max 16384 2023-12-11T20:25:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc7520db80 1 Processor -- start 2023-12-11T20:25:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc7520db80 1 -- start start 2023-12-11T20:25:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bf1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bd2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc7520db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69be96a0 con 0x556c69be0a00 2023-12-11T20:25:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc7520db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69be0f70 con 0x556c69be0040 2023-12-11T20:25:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc7520db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69be1eb0 con 0x556c69be1380 2023-12-11T20:25:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc5a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bf1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc5a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bf1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37424/0 (socket says 172.21.15.12:37424) 2023-12-11T20:25:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.947+0000 7fdc5a7fc700 1 -- 172.21.15.12:0/4278069475 learned_addr learned my addr 172.21.15.12:0/4278069475 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc5affd700 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bd2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc5affd700 1 -- 172.21.15.12:0/4278069475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 msgr2=0x556c69bd2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc5affd700 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bd2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc5affd700 1 -- 172.21.15.12:0/4278069475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 msgr2=0x556c69bf1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc5affd700 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bf1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc5affd700 1 -- 172.21.15.12:0/4278069475 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c6993dc60 con 0x556c69be0040 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc5affd700 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c096640 tx=0x7fdc4c0109a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c23c90dd23a9627 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.948+0000 7fdc41ffb700 1 -- 172.21.15.12:0/4278069475 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c09a140 con 0x556c69be0040 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc41ffb700 1 -- 172.21.15.12:0/4278069475 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc4c0a24d0 con 0x556c69be0040 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc41ffb700 1 -- 172.21.15.12:0/4278069475 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0834d0 con 0x556c69be0040 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc7520db80 1 -- 172.21.15.12:0/4278069475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 msgr2=0x556c69be9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c096640 tx=0x7fdc4c0109a0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc7520db80 1 -- 172.21.15.12:0/4278069475 shutdown_connections 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0040 0x556c69be9040 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be1380 0x556c69bd2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc7520db80 1 --2- 172.21.15.12:0/4278069475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be0a00 0x556c69bf1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc7520db80 1 -- 172.21.15.12:0/4278069475 >> 172.21.15.12:0/4278069475 conn(0x556c69b067e0 msgr2=0x556c69be7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.949+0000 7fdc7520db80 1 -- 172.21.15.12:0/4278069475 shutdown_connections 2023-12-11T20:25:12.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.950+0000 7fdc7520db80 1 -- 172.21.15.12:0/4278069475 wait complete. 2023-12-11T20:25:12.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.950+0000 7fdc7520db80 1 -- start start 2023-12-11T20:25:12.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.950+0000 7fdc7520db80 1 Processor -- start 2023-12-11T20:25:12.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69beed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0a00 0x556c69bef280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc7520db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be1380 0x556c69bf0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc7520db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69bf07d0 con 0x556c69be1380 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc7520db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69bf0940 con 0x556c69be0a00 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc7520db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c69bf0b00 con 0x556c69be0040 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc7520db80 10 client.0 _ll_register_callbacks cb 0x556c69a10a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be1380 0x556c69bf0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc5affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69beed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc5affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69beed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:42994/0 (socket says 172.21.15.12:42994) 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be1380 0x556c69bf0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37430/0 (socket says 172.21.15.12:37430) 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc5affd700 1 -- 172.21.15.12:0/3642200598 learned_addr learned my addr 172.21.15.12:0/3642200598 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc5a7fc700 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0a00 0x556c69bef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc5b7fe700 1 -- 172.21.15.12:0/3642200598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 msgr2=0x556c69beed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.951+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69beed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc5b7fe700 1 -- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0a00 msgr2=0x556c69bef280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0a00 0x556c69bef280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc5b7fe700 1 -- 172.21.15.12:0/3642200598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c699a8630 con 0x556c69be1380 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc5affd700 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69beed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc5a7fc700 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0a00 0x556c69bef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc5b7fe700 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be1380 0x556c69bf0290 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x556c69bd3190 tx=0x7fdc5400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6384ec21c9765e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc3eff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc3eff5700 1 -- 172.21.15.12:0/3642200598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54005510 con 0x556c69be1380 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc3eff5700 1 -- 172.21.15.12:0/3642200598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc54005670 con 0x556c69be1380 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.952+0000 7fdc7520db80 1 -- 172.21.15.12:0/3642200598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc4c09e290 con 0x556c69be1380 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc3eff5700 1 -- 172.21.15.12:0/3642200598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc54005850 con 0x556c69be1380 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc7520db80 10 client.18177 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc7520db80 1 -- 172.21.15.12:0/3642200598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556c6997b250 con 0x556c69be1380 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc3eff5700 1 -- 172.21.15.12:0/3642200598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc4c09e290 con 0x556c69be1380 2023-12-11T20:25:12.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc3eff5700 1 -- 172.21.15.12:0/3642200598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc5401e430 con 0x556c69be1380 2023-12-11T20:25:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc7520db80 10 client.18177 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc7520db80 10 client.18177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc7520db80 20 client.18177 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556c69c4cd10 0x556c69c4f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc7520db80 4 client.18177 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:25:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.953+0000 7fdc7520db80 1 -- 172.21.15.12:0/3642200598 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556c69af1fd0 con 0x556c69c4cd10 2023-12-11T20:25:12.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.954+0000 7fdc5affd700 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556c69c4cd10 0x556c69c4f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.954+0000 7fdc5affd700 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556c69c4cd10 0x556c69c4f130 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=842ae6b828792c4d server_cookie=68fead592c545aab in_seq=0 out_seq=0 2023-12-11T20:25:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.954+0000 7fdc3eff5700 10 client.18177 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.954+0000 7fdc3eff5700 1 -- 172.21.15.12:0/3642200598 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556c69af1fd0 con 0x556c69c4cd10 2023-12-11T20:25:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.954+0000 7fdc3eff5700 10 client.18177 handle_command_reply: tid=0 2023-12-11T20:25:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.954+0000 7fdc7520db80 1 client.18177 shutdown 2023-12-11T20:25:12.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 -- 172.21.15.12:0/3642200598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be1380 msgr2=0x556c69bf0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be1380 0x556c69bf0290 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x556c69bd3190 tx=0x7fdc5400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 -- 172.21.15.12:0/3642200598 shutdown_connections 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556c69c4cd10 0x556c69c4f130 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c69be1380 0x556c69bf0290 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556c69be0040 0x556c69beed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 --2- 172.21.15.12:0/3642200598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556c69be0a00 0x556c69bef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc3eff5700 0 client.18177 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 -- 172.21.15.12:0/3642200598 >> 172.21.15.12:0/3642200598 conn(0x556c69b067e0 msgr2=0x556c69bd2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 -- 172.21.15.12:0/3642200598 shutdown_connections 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 1 -- 172.21.15.12:0/3642200598 wait complete. 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.955+0000 7fdc7520db80 20 client.18177 trim_cache size 0 max 16384 2023-12-11T20:25:12.957 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "acb3f466-9823-4954-b7d3-03d73cbbf307": { 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "acb3f466-9823-4954-b7d3-03d73cbbf307", 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:25:12.958 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:25:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 -- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc440a15a0 msgr2=0x7fdc440a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc440a15a0 0x7fdc440a3a60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400d010 tx=0x7fdc54009340 comp rx=0 tx=0).stop 2023-12-11T20:25:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 -- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c101db0 msgr2=0x7fdc5c199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c101db0 0x7fdc5c199360 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00e9a0 tx=0x7fdc4c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 -- 172.21.15.12:0/2132362723 shutdown_connections 2023-12-11T20:25:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdc440a15a0 0x7fdc440a3a60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc5c107010 0x7fdc5c1a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc5c101db0 0x7fdc5c199360 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 --2- 172.21.15.12:0/2132362723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc5c1046e0 0x7fdc5c1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 -- 172.21.15.12:0/2132362723 >> 172.21.15.12:0/2132362723 conn(0x7fdc5c0fb740 msgr2=0x7fdc5c101480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 -- 172.21.15.12:0/2132362723 shutdown_connections 2023-12-11T20:25:12.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:12.956+0000 7fdc5bfff700 1 -- 172.21.15.12:0/2132362723 wait complete. 2023-12-11T20:25:12.963 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:25:12 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:25:12.655+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v186>,<0x10000000003/client.0 v188>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v205>,<0x10000000001/sv_0 v229>,<0x10000000000/_nogroup v213>,<0x1/volumes v205>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:25:12.973 INFO:tasks.cephfs.filesystem:scrub status for tag:acb3f466-9823-4954-b7d3-03d73cbbf307 - {'path': '/', 'tag': 'acb3f466-9823-4954-b7d3-03d73cbbf307', 'options': 'recursive,force'} 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 -- 172.21.15.12:0/982109364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 msgr2=0x7f3448102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 --2- 172.21.15.12:0/982109364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 0x7f3448102950 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f34380099c0 tx=0x7f3438009cd0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 -- 172.21.15.12:0/982109364 shutdown_connections 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 --2- 172.21.15.12:0/982109364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3448102e90 0x7f3448109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 --2- 172.21.15.12:0/982109364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3448101300 0x7f3448101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 --2- 172.21.15.12:0/982109364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 0x7f3448102950 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 -- 172.21.15.12:0/982109364 >> 172.21.15.12:0/982109364 conn(0x7f34480fc890 msgr2=0x7f34480fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 -- 172.21.15.12:0/982109364 shutdown_connections 2023-12-11T20:25:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.144+0000 7f344e59d700 1 -- 172.21.15.12:0/982109364 wait complete. 2023-12-11T20:25:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344e59d700 1 Processor -- start 2023-12-11T20:25:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344e59d700 1 -- start start 2023-12-11T20:25:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344e59d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3448101300 0x7f34481993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344e59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 0x7f3448199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344e59d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3448102e90 0x7f34481a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344e59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34481a0e80 con 0x7f34481024f0 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344e59d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34481a0fc0 con 0x7f3448101300 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344e59d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34481a1150 con 0x7f3448102e90 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.146+0000 7f344cd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 0x7f3448199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344cd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 0x7f3448199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37436/0 (socket says 172.21.15.12:37436) 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344cd9a700 1 -- 172.21.15.12:0/1791995450 learned_addr learned my addr 172.21.15.12:0/1791995450 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344dd9c700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3448102e90 0x7f34481a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344d59b700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3448101300 0x7f34481993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344cd9a700 1 -- 172.21.15.12:0/1791995450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3448102e90 msgr2=0x7f34481a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344cd9a700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3448102e90 0x7f34481a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344cd9a700 1 -- 172.21.15.12:0/1791995450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3448101300 msgr2=0x7f34481993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344cd9a700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3448101300 0x7f34481993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344cd9a700 1 -- 172.21.15.12:0/1791995450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380095f0 con 0x7f34481024f0 2023-12-11T20:25:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.147+0000 7f344cd9a700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 0x7f3448199930 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3438009fd0 tx=0x7f343800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.148+0000 7f343e7fc700 1 -- 172.21.15.12:0/1791995450 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343801d070 con 0x7f34481024f0 2023-12-11T20:25:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.148+0000 7f344e59d700 1 -- 172.21.15.12:0/1791995450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34481a13d0 con 0x7f34481024f0 2023-12-11T20:25:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.148+0000 7f343e7fc700 1 -- 172.21.15.12:0/1791995450 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f343800bd10 con 0x7f34481024f0 2023-12-11T20:25:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.148+0000 7f343e7fc700 1 -- 172.21.15.12:0/1791995450 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438004ae0 con 0x7f34481024f0 2023-12-11T20:25:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.148+0000 7f344e59d700 1 -- 172.21.15.12:0/1791995450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34481a1800 con 0x7f34481024f0 2023-12-11T20:25:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.151+0000 7f343e7fc700 1 -- 172.21.15.12:0/1791995450 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3438004c40 con 0x7f34481024f0 2023-12-11T20:25:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.153+0000 7f343e7fc700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34340a1470 0x7f34340a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.153+0000 7f3463058b80 1 Processor -- start 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.153+0000 7f343e7fc700 1 -- 172.21.15.12:0/1791995450 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f34380cdb00 con 0x7f34481024f0 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.153+0000 7f3463058b80 1 -- start start 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.153+0000 7f344d59b700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34340a1470 0x7f34340a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f3463058b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc98770 0x56166fc98b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f3463058b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 0x56166fc9d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f3463058b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc9db80 0x56166fc9ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f3463058b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fbf3af0 con 0x56166fc98770 2023-12-11T20:25:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f3463058b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fbf1410 con 0x56166fc990d0 2023-12-11T20:25:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f3463058b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fbecd00 con 0x56166fc9db80 2023-12-11T20:25:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f344d59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc98770 0x56166fc98b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f344d59b700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34340a1470 0x7f34340a3930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3448102350 tx=0x7f344400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f344d59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc98770 0x56166fc98b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37452/0 (socket says 172.21.15.12:37452) 2023-12-11T20:25:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f344d59b700 1 -- 172.21.15.12:0/3186877481 learned_addr learned my addr 172.21.15.12:0/3186877481 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f344dd9c700 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc9db80 0x56166fc9ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.154+0000 7f344cd9a700 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 0x56166fc9d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.155+0000 7f344dd9c700 1 -- 172.21.15.12:0/3186877481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 msgr2=0x56166fc9d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.155+0000 7f344dd9c700 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 0x56166fc9d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.155+0000 7f344dd9c700 1 -- 172.21.15.12:0/3186877481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc98770 msgr2=0x56166fc98b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.155+0000 7f344dd9c700 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc98770 0x56166fc98b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.155+0000 7f344dd9c700 1 -- 172.21.15.12:0/3186877481 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56166fa695d0 con 0x56166fc9db80 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.155+0000 7f344d59b700 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc98770 0x56166fc98b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.155+0000 7f344dd9c700 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc9db80 0x56166fc9ff90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3440011580 tx=0x7f3440009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf1f09da210679e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.155+0000 7f34337fe700 1 -- 172.21.15.12:0/3186877481 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000e040 con 0x56166fc9db80 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f34337fe700 1 -- 172.21.15.12:0/3186877481 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f344000f040 con 0x56166fc9db80 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f34337fe700 1 -- 172.21.15.12:0/3186877481 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440004320 con 0x56166fc9db80 2023-12-11T20:25:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f3463058b80 1 -- 172.21.15.12:0/3186877481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc9db80 msgr2=0x56166fc9ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f3463058b80 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc9db80 0x56166fc9ff90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3440011580 tx=0x7f3440009920 comp rx=0 tx=0).stop 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f3463058b80 1 -- 172.21.15.12:0/3186877481 shutdown_connections 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f3463058b80 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc9db80 0x56166fc9ff90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f3463058b80 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc98770 0x56166fc98b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f3463058b80 1 --2- 172.21.15.12:0/3186877481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 0x56166fc9d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f3463058b80 1 -- 172.21.15.12:0/3186877481 >> 172.21.15.12:0/3186877481 conn(0x56166fbc7780 msgr2=0x56166fc94b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.156+0000 7f3463058b80 1 -- 172.21.15.12:0/3186877481 shutdown_connections 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.157+0000 7f3463058b80 1 -- 172.21.15.12:0/3186877481 wait complete. 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.157+0000 7f3463058b80 1 -- start start 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.157+0000 7f3463058b80 1 Processor -- start 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f3463058b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f3463058b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 0x56166fca23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f3463058b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fca9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f3463058b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fba6500 con 0x56166fc9db80 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f3463058b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fba61a0 con 0x56166fc990d0 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f3463058b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fa6b8c0 con 0x56166fc98770 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f3463058b80 10 client.0 _ll_register_callbacks cb 0x56166fad1a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f344dd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fca9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f344dd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fca9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37468/0 (socket says 172.21.15.12:37468) 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f344dd9c700 1 -- 172.21.15.12:0/3302537004 learned_addr learned my addr 172.21.15.12:0/3302537004 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f344cd9a700 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 0x56166fca23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.158+0000 7f344d59b700 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f344dd9c700 1 -- 172.21.15.12:0/3302537004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 msgr2=0x56166fca1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f344dd9c700 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f344dd9c700 1 -- 172.21.15.12:0/3302537004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 msgr2=0x56166fca23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f344dd9c700 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 0x56166fca23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f344dd9c700 1 -- 172.21.15.12:0/3302537004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3444010c50 con 0x56166fc9db80 2023-12-11T20:25:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f344dd9c700 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fca9420 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3440006050 tx=0x7f3440009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccebf451fa3df864 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f3430ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f3430ff9700 1 -- 172.21.15.12:0/3302537004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000e040 con 0x56166fc9db80 2023-12-11T20:25:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f3463058b80 1 -- 172.21.15.12:0/3302537004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56166fc8b730 con 0x56166fc9db80 2023-12-11T20:25:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.159+0000 7f3430ff9700 1 -- 172.21.15.12:0/3302537004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f34400040a0 con 0x56166fc9db80 2023-12-11T20:25:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3430ff9700 1 -- 172.21.15.12:0/3302537004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3440004260 con 0x56166fc9db80 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3463058b80 10 client.18189 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3463058b80 1 -- 172.21.15.12:0/3302537004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f3440011230 con 0x56166fc9db80 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3430ff9700 1 -- 172.21.15.12:0/3302537004 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56166fc8b730 con 0x56166fc9db80 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3430ff9700 1 -- 172.21.15.12:0/3302537004 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f344001b020 con 0x56166fc9db80 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3463058b80 10 client.18189 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3463058b80 10 client.18189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3463058b80 20 client.18189 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3463058b80 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56166fcadbd0 0x56166fcafff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3463058b80 4 client.18189 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.160+0000 7f3463058b80 1 -- 172.21.15.12:0/3302537004 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56166fc67ee0 con 0x56166fcadbd0 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.161+0000 7f344d59b700 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56166fcadbd0 0x56166fcafff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.161+0000 7f344d59b700 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56166fcadbd0 0x56166fcafff0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=162630c271fdf818 server_cookie=d3b4050e50a34b56 in_seq=0 out_seq=0 2023-12-11T20:25:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.161+0000 7f3430ff9700 10 client.18189 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3430ff9700 1 -- 172.21.15.12:0/3302537004 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56166fc67ee0 con 0x56166fcadbd0 2023-12-11T20:25:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3430ff9700 10 client.18189 handle_command_reply: tid=0 2023-12-11T20:25:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3463058b80 1 client.18189 shutdown 2023-12-11T20:25:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3463058b80 1 -- 172.21.15.12:0/3302537004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 msgr2=0x56166fca9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3463058b80 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fca9420 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3440006050 tx=0x7f3440009e10 comp rx=0 tx=0).stop 2023-12-11T20:25:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3463058b80 1 -- 172.21.15.12:0/3302537004 shutdown_connections 2023-12-11T20:25:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3463058b80 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56166fcadbd0 0x56166fcafff0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3463058b80 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fca9420 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3463058b80 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3430ff9700 0 client.18189 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.162+0000 7f3463058b80 1 --2- 172.21.15.12:0/3302537004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc990d0 0x56166fca23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.163+0000 7f3463058b80 1 -- 172.21.15.12:0/3302537004 >> 172.21.15.12:0/3302537004 conn(0x56166fbc7780 msgr2=0x56166fc95560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.163+0000 7f3463058b80 1 -- 172.21.15.12:0/3302537004 shutdown_connections 2023-12-11T20:25:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.163+0000 7f3463058b80 1 -- 172.21.15.12:0/3302537004 wait complete. 2023-12-11T20:25:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.163+0000 7f3463058b80 20 client.18189 trim_cache size 0 max 16384 2023-12-11T20:25:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f3463058b80 1 Processor -- start 2023-12-11T20:25:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f3463058b80 1 -- start start 2023-12-11T20:25:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f3463058b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc98770 0x56166fca9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f3463058b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc990d0 0x56166fca93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f3463058b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fc9ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f3463058b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fc9a740 con 0x56166fc9db80 2023-12-11T20:25:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f3463058b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fc92db0 con 0x56166fc98770 2023-12-11T20:25:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f3463058b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fc8b4c0 con 0x56166fc990d0 2023-12-11T20:25:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f344dd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fc9ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f344dd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fc9ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37482/0 (socket says 172.21.15.12:37482) 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f344dd9c700 1 -- 172.21.15.12:0/1362277528 learned_addr learned my addr 172.21.15.12:0/1362277528 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f344d59b700 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc98770 0x56166fca9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.181+0000 7f344cd9a700 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc990d0 0x56166fca93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f344dd9c700 1 -- 172.21.15.12:0/1362277528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc990d0 msgr2=0x56166fca93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f344dd9c700 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc990d0 0x56166fca93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f344dd9c700 1 -- 172.21.15.12:0/1362277528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc98770 msgr2=0x56166fca9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f344dd9c700 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc98770 0x56166fca9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f344dd9c700 1 -- 172.21.15.12:0/1362277528 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56166fa15d80 con 0x56166fc9db80 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f344d59b700 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc98770 0x56166fca9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f344dd9c700 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fc9ff70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3440009ec0 tx=0x7f3440011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315190bb7ea47e96 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f3433fff700 1 -- 172.21.15.12:0/1362277528 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400092e0 con 0x56166fc9db80 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f3433fff700 1 -- 172.21.15.12:0/1362277528 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3440022070 con 0x56166fc9db80 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.182+0000 7f3433fff700 1 -- 172.21.15.12:0/1362277528 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440031c20 con 0x56166fc9db80 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 -- 172.21.15.12:0/1362277528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 msgr2=0x56166fc9ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fc9ff70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3440009ec0 tx=0x7f3440011b70 comp rx=0 tx=0).stop 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 -- 172.21.15.12:0/1362277528 shutdown_connections 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc98770 0x56166fca9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc9db80 0x56166fc9ff70 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 --2- 172.21.15.12:0/1362277528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc990d0 0x56166fca93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 -- 172.21.15.12:0/1362277528 >> 172.21.15.12:0/1362277528 conn(0x56166fbc7780 msgr2=0x56166fc9d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 -- 172.21.15.12:0/1362277528 shutdown_connections 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.183+0000 7f3463058b80 1 -- 172.21.15.12:0/1362277528 wait complete. 2023-12-11T20:25:13.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.184+0000 7f3463058b80 1 -- start start 2023-12-11T20:25:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.184+0000 7f3463058b80 1 Processor -- start 2023-12-11T20:25:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.184+0000 7f3463058b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f3463058b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc990d0 0x56166fca74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f3463058b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc9db80 0x56166fca84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f3463058b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fca8a20 con 0x56166fc990d0 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f3463058b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fca8b90 con 0x56166fc9db80 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f3463058b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166fca8d50 con 0x56166fc98770 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f3463058b80 10 client.0 _ll_register_callbacks cb 0x56166fad1a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344cd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc990d0 0x56166fca74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344dd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc9db80 0x56166fca84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344d59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344dd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc9db80 0x56166fca84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49998/0 (socket says 172.21.15.12:49998) 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344dd9c700 1 -- 172.21.15.12:0/2114488813 learned_addr learned my addr 172.21.15.12:0/2114488813 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344d59b700 1 -- 172.21.15.12:0/2114488813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc9db80 msgr2=0x56166fca84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344d59b700 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc9db80 0x56166fca84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344d59b700 1 -- 172.21.15.12:0/2114488813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc990d0 msgr2=0x56166fca74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344d59b700 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc990d0 0x56166fca74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344d59b700 1 -- 172.21.15.12:0/2114488813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3444010e20 con 0x56166fc98770 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344cd9a700 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc990d0 0x56166fca74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.185+0000 7f344dd9c700 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc9db80 0x56166fca84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.186+0000 7f344d59b700 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca6f90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x56166fcb05d0 tx=0x7f34440047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6409b79363c0f859 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.186+0000 7f3430ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.186+0000 7f3430ff9700 1 -- 172.21.15.12:0/2114488813 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444024040 con 0x56166fc98770 2023-12-11T20:25:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.186+0000 7f3463058b80 1 -- 172.21.15.12:0/2114488813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f344000f040 con 0x56166fc98770 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.186+0000 7f3430ff9700 1 -- 172.21.15.12:0/2114488813 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3444017070 con 0x56166fc98770 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.186+0000 7f3430ff9700 1 -- 172.21.15.12:0/2114488813 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3444029720 con 0x56166fc98770 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.186+0000 7f3463058b80 10 client.27817 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.186+0000 7f3463058b80 1 -- 172.21.15.12:0/2114488813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f3440011230 con 0x56166fc98770 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.187+0000 7f3430ff9700 1 -- 172.21.15.12:0/2114488813 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f344000f040 con 0x56166fc98770 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.187+0000 7f3430ff9700 1 -- 172.21.15.12:0/2114488813 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3444003a00 con 0x56166fc98770 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.187+0000 7f3463058b80 10 client.27817 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.187+0000 7f3463058b80 10 client.27817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.187+0000 7f3463058b80 20 client.27817 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.187+0000 7f3463058b80 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56166fd04ec0 0x56166fd072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.187+0000 7f3463058b80 4 client.27817 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.187+0000 7f3463058b80 1 -- 172.21.15.12:0/2114488813 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56166fbb2f70 con 0x56166fd04ec0 2023-12-11T20:25:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.188+0000 7f344cd9a700 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56166fd04ec0 0x56166fd072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.188+0000 7f3430ff9700 10 client.27817 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.188+0000 7f344cd9a700 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56166fd04ec0 0x56166fd072e0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=420837f64b045970 server_cookie=f7e8b48fbdadb20e in_seq=0 out_seq=0 2023-12-11T20:25:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3430ff9700 1 -- 172.21.15.12:0/2114488813 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56166fbb2f70 con 0x56166fd04ec0 2023-12-11T20:25:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3430ff9700 10 client.27817 handle_command_reply: tid=0 2023-12-11T20:25:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 client.27817 shutdown 2023-12-11T20:25:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 -- 172.21.15.12:0/2114488813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 msgr2=0x56166fca6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca6f90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x56166fcb05d0 tx=0x7f34440047c0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 -- 172.21.15.12:0/2114488813 shutdown_connections 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56166fd04ec0 0x56166fd072e0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56166fc9db80 0x56166fca84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56166fc98770 0x56166fca6f90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3430ff9700 0 client.27817 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 --2- 172.21.15.12:0/2114488813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56166fc990d0 0x56166fca74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.198+0000 7f3463058b80 1 -- 172.21.15.12:0/2114488813 >> 172.21.15.12:0/2114488813 conn(0x56166fbc7780 msgr2=0x56166fcb4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.199+0000 7f3463058b80 1 -- 172.21.15.12:0/2114488813 shutdown_connections 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.199+0000 7f3463058b80 1 -- 172.21.15.12:0/2114488813 wait complete. 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.199+0000 7f3463058b80 20 client.27817 trim_cache size 0 max 16384 2023-12-11T20:25:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:25:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:25:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:25:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:25:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.199+0000 7f344e59d700 1 -- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34340a1470 msgr2=0x7f34340a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.199+0000 7f344e59d700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34340a1470 0x7f34340a3930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3448102350 tx=0x7f344400b410 comp rx=0 tx=0).stop 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.199+0000 7f344e59d700 1 -- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 msgr2=0x7f3448199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.199+0000 7f344e59d700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 0x7f3448199930 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3438009fd0 tx=0x7f343800fa00 comp rx=0 tx=0).stop 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.200+0000 7f344e59d700 1 -- 172.21.15.12:0/1791995450 shutdown_connections 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.200+0000 7f344e59d700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f34340a1470 0x7f34340a3930 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.200+0000 7f344e59d700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3448101300 0x7f34481993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.200+0000 7f344e59d700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3448102e90 0x7f34481a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.200+0000 7f344e59d700 1 --2- 172.21.15.12:0/1791995450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34481024f0 0x7f3448199930 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.200+0000 7f344e59d700 1 -- 172.21.15.12:0/1791995450 >> 172.21.15.12:0/1791995450 conn(0x7f34480fc890 msgr2=0x7f3448073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.200+0000 7f344e59d700 1 -- 172.21.15.12:0/1791995450 shutdown_connections 2023-12-11T20:25:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:13.200+0000 7f344e59d700 1 -- 172.21.15.12:0/1791995450 wait complete. 2023-12-11T20:25:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:13 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:25:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:13 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:13 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:25:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:13 smithi039 ceph-mon[102205]: pgmap v654: 97 pgs: 97 active+clean; 6.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 MiB/s wr, 13 op/s 2023-12-11T20:25:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:13 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:25:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:13 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:13 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:25:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:13 smithi012 ceph-mon[128787]: pgmap v654: 97 pgs: 97 active+clean; 6.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 MiB/s wr, 13 op/s 2023-12-11T20:25:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:13 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:25:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:13 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:13 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:25:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:13.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:13 smithi032 ceph-mon[132488]: pgmap v654: 97 pgs: 97 active+clean; 6.7 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 12 MiB/s wr, 13 op/s 2023-12-11T20:25:14.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:14 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:14 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:14 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:14 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:14 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:14 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:14 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:14 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:14 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:14 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:14 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:14 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:14 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:14 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:14 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:14 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:14 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:14.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:14 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:14 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:14.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:14 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:14.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:14 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:14 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:14.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:14 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:14.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:14 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:15.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:15 smithi039 ceph-mon[102205]: pgmap v655: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 21 op/s 2023-12-11T20:25:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:15 smithi012 ceph-mon[128787]: pgmap v655: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 21 op/s 2023-12-11T20:25:15.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:15 smithi032 ceph-mon[132488]: pgmap v655: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 21 op/s 2023-12-11T20:25:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:17 smithi039 ceph-mon[102205]: pgmap v656: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:25:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:17 smithi012 ceph-mon[128787]: pgmap v656: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:25:17.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:17 smithi032 ceph-mon[132488]: pgmap v656: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:25:19.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:19 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:25:19.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:19 smithi032 ceph-mon[132488]: pgmap v657: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 34 op/s 2023-12-11T20:25:19.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:19 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:25:19.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:19 smithi039 ceph-mon[102205]: pgmap v657: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 34 op/s 2023-12-11T20:25:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:19 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:25:19.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:19 smithi012 ceph-mon[128787]: pgmap v657: 97 pgs: 97 active+clean; 6.8 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 34 op/s 2023-12-11T20:25:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:25:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:25:20.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:25:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:25:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:25:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:25:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:25:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:25:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:25:21.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:21 smithi032 ceph-mon[132488]: pgmap v658: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:25:21.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:21 smithi039 ceph-mon[102205]: pgmap v658: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:25:21.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:21 smithi012 ceph-mon[128787]: pgmap v658: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:25:23.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:23 smithi039 ceph-mon[102205]: pgmap v659: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:23 smithi012 ceph-mon[128787]: pgmap v659: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:23.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:23 smithi032 ceph-mon[132488]: pgmap v659: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:25 smithi039 ceph-mon[102205]: pgmap v660: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:25 smithi012 ceph-mon[128787]: pgmap v660: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:25 smithi032 ceph-mon[132488]: pgmap v660: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.369+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/2552027002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc1091e0 msgr2=0x7ff4cc10b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.369+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/2552027002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc1091e0 0x7ff4cc10b650 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b0a0 tx=0x7ff4c400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.370+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/2552027002 shutdown_connections 2023-12-11T20:25:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.370+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/2552027002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc1091e0 0x7ff4cc10b650 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.370+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/2552027002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4cc0755b0 0x7ff4cc073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.370+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/2552027002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4cc073fd0 0x7ff4cc074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.370+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/2552027002 >> 172.21.15.12:0/2552027002 conn(0x7ff4cc0fc880 msgr2=0x7ff4cc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.370+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/2552027002 shutdown_connections 2023-12-11T20:25:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.370+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/2552027002 wait complete. 2023-12-11T20:25:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.371+0000 7ff4d1b9d700 1 Processor -- start 2023-12-11T20:25:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.371+0000 7ff4d1b9d700 1 -- start start 2023-12-11T20:25:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.371+0000 7ff4d1b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc073fd0 0x7ff4cc199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.371+0000 7ff4d1b9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4cc0755b0 0x7ff4cc199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d1b9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4cc1091e0 0x7ff4cc1a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d1b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc1a0f60 con 0x7ff4cc073fd0 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d1b9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc1a10a0 con 0x7ff4cc0755b0 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d1b9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc1a1230 con 0x7ff4cc1091e0 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc073fd0 0x7ff4cc199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc073fd0 0x7ff4cc199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57388/0 (socket says 172.21.15.12:57388) 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/3785057775 learned_addr learned my addr 172.21.15.12:0/3785057775 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4cbfff700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4cc0755b0 0x7ff4cc199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d139c700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4cc1091e0 0x7ff4cc1a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/3785057775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4cc1091e0 msgr2=0x7ff4cc1a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4cc1091e0 0x7ff4cc1a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/3785057775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4cc0755b0 msgr2=0x7ff4cc199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4cc0755b0 0x7ff4cc199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.372+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/3785057775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4009d00 con 0x7ff4cc073fd0 2023-12-11T20:25:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.373+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc073fd0 0x7ff4cc199430 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000e9a0 tx=0x7ff4c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.373+0000 7ff4c9ffb700 1 -- 172.21.15.12:0/3785057775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0009790 con 0x7ff4cc073fd0 2023-12-11T20:25:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.373+0000 7ff4c9ffb700 1 -- 172.21.15.12:0/3785057775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4c000cbd0 con 0x7ff4cc073fd0 2023-12-11T20:25:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.373+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/3785057775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4cc1a1510 con 0x7ff4cc073fd0 2023-12-11T20:25:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.373+0000 7ff4c9ffb700 1 -- 172.21.15.12:0/3785057775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0018680 con 0x7ff4cc073fd0 2023-12-11T20:25:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.373+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/3785057775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc1a1a70 con 0x7ff4cc073fd0 2023-12-11T20:25:26.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.376+0000 7ff4c9ffb700 1 -- 172.21.15.12:0/3785057775 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff4c000cd40 con 0x7ff4cc073fd0 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.378+0000 7ff4c9ffb700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4bc0a14f0 0x7ff4bc0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.378+0000 7ff4c9ffb700 1 -- 172.21.15.12:0/3785057775 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff4c0014070 con 0x7ff4cc073fd0 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.378+0000 7ff4cbfff700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4bc0a14f0 0x7ff4bc0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4e665db80 1 Processor -- start 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4e665db80 1 -- start start 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4cbfff700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4bc0a14f0 0x7ff4bc0a39b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009c60 tx=0x7ff4b8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a4770 0x559dd56a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56a9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a9b80 0x559dd56abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4e665db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd55ffaf0 con 0x559dd56a4770 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4e665db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd55fd410 con 0x559dd56a50d0 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4e665db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd55f8d00 con 0x559dd56a9b80 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.379+0000 7ff4d0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a4770 0x559dd56a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a4770 0x559dd56a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57394/0 (socket says 172.21.15.12:57394) 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/2578471130 learned_addr learned my addr 172.21.15.12:0/2578471130 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d139c700 1 --2- 172.21.15.12:0/2578471130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a9b80 0x559dd56abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/2578471130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a9b80 msgr2=0x559dd56abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/2578471130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a9b80 0x559dd56abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/2578471130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 msgr2=0x559dd56a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/2578471130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/2578471130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd54755d0 con 0x559dd56a4770 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/2578471130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a4770 0x559dd56a4b90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0096730 tx=0x7ff4c0099e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108f92a9c18db5c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.380+0000 7ff4b6ffd700 1 -- 172.21.15.12:0/2578471130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c009a930 con 0x559dd56a4770 2023-12-11T20:25:26.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4b6ffd700 1 -- 172.21.15.12:0/2578471130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4c009a230 con 0x559dd56a4770 2023-12-11T20:25:26.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4b6ffd700 1 -- 172.21.15.12:0/2578471130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0099980 con 0x559dd56a4770 2023-12-11T20:25:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4e665db80 1 -- 172.21.15.12:0/2578471130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a4770 msgr2=0x559dd56a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4e665db80 1 --2- 172.21.15.12:0/2578471130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a4770 0x559dd56a4b90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0096730 tx=0x7ff4c0099e40 comp rx=0 tx=0).stop 2023-12-11T20:25:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4e665db80 1 -- 172.21.15.12:0/2578471130 shutdown_connections 2023-12-11T20:25:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4e665db80 1 --2- 172.21.15.12:0/2578471130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a9b80 0x559dd56abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4e665db80 1 --2- 172.21.15.12:0/2578471130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a4770 0x559dd56a4b90 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4e665db80 1 --2- 172.21.15.12:0/2578471130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.381+0000 7ff4e665db80 1 -- 172.21.15.12:0/2578471130 >> 172.21.15.12:0/2578471130 conn(0x559dd55d3780 msgr2=0x559dd56a0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.382+0000 7ff4e665db80 1 -- 172.21.15.12:0/2578471130 shutdown_connections 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.382+0000 7ff4e665db80 1 -- 172.21.15.12:0/2578471130 wait complete. 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.382+0000 7ff4e665db80 1 -- start start 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.382+0000 7ff4e665db80 1 Processor -- start 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4e665db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd55b2500 con 0x559dd56a9b80 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4e665db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd55b21a0 con 0x559dd56a50d0 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4e665db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd54778c0 con 0x559dd56a4770 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4e665db80 10 client.0 _ll_register_callbacks cb 0x559dd54dda20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4d139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4d0b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4d139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57396/0 (socket says 172.21.15.12:57396) 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4d139c700 1 -- 172.21.15.12:0/3527419841 learned_addr learned my addr 172.21.15.12:0/3527419841 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.383+0000 7ff4cbfff700 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4d139c700 1 -- 172.21.15.12:0/3527419841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 msgr2=0x559dd56adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4d139c700 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4d139c700 1 -- 172.21.15.12:0/3527419841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 msgr2=0x559dd56ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4d139c700 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4d139c700 1 -- 172.21.15.12:0/3527419841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc1a1a70 con 0x559dd56a9b80 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4d139c700 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b5480 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4006130 tx=0x7ff4c4007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b31101ef770f0b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4abfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4abfff700 1 -- 172.21.15.12:0/3527419841 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400e040 con 0x559dd56a9b80 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4e665db80 1 -- 172.21.15.12:0/3527419841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559dd5697730 con 0x559dd56a9b80 2023-12-11T20:25:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.384+0000 7ff4abfff700 1 -- 172.21.15.12:0/3527419841 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff4c400bcb0 con 0x559dd56a9b80 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4abfff700 1 -- 172.21.15.12:0/3527419841 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4c40077f0 con 0x559dd56a9b80 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4e665db80 10 client.18207 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4e665db80 1 -- 172.21.15.12:0/3527419841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559dd5421d80 con 0x559dd56a9b80 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4abfff700 1 -- 172.21.15.12:0/3527419841 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559dd5697730 con 0x559dd56a9b80 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4abfff700 1 -- 172.21.15.12:0/3527419841 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff4c4019050 con 0x559dd56a9b80 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4e665db80 10 client.18207 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4e665db80 10 client.18207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4e665db80 20 client.18207 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4e665db80 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559dd56b9d60 0x559dd56bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4e665db80 4 client.18207 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.385+0000 7ff4e665db80 1 -- 172.21.15.12:0/3527419841 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559dd5673ee0 con 0x559dd56b9d60 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.386+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559dd56b9d60 0x559dd56bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.386+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559dd56b9d60 0x559dd56bc180 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccaf114c40784669 server_cookie=1fc649a126ff4f6e in_seq=0 out_seq=0 2023-12-11T20:25:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.386+0000 7ff4abfff700 10 client.18207 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4abfff700 1 -- 172.21.15.12:0/3527419841 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7ff4c007ea90 con 0x559dd56b9d60 2023-12-11T20:25:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4abfff700 10 client.18207 handle_command_reply: tid=0 2023-12-11T20:25:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 client.18207 shutdown 2023-12-11T20:25:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 -- 172.21.15.12:0/3527419841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 msgr2=0x559dd56b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b5480 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4006130 tx=0x7ff4c4007e30 comp rx=0 tx=0).stop 2023-12-11T20:25:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 -- 172.21.15.12:0/3527419841 shutdown_connections 2023-12-11T20:25:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559dd56b9d60 0x559dd56bc180 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b5480 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 --2- 172.21.15.12:0/3527419841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4e665db80 1 -- 172.21.15.12:0/3527419841 >> 172.21.15.12:0/3527419841 conn(0x559dd55d3780 msgr2=0x559dd56a1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.387+0000 7ff4abfff700 0 client.18207 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.388+0000 7ff4e665db80 1 -- 172.21.15.12:0/3527419841 shutdown_connections 2023-12-11T20:25:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.388+0000 7ff4e665db80 1 -- 172.21.15.12:0/3527419841 wait complete. 2023-12-11T20:25:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.388+0000 7ff4e665db80 20 client.18207 trim_cache size 0 max 16384 2023-12-11T20:25:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.411+0000 7ff4e665db80 1 Processor -- start 2023-12-11T20:25:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4e665db80 1 -- start start 2023-12-11T20:25:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56b5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd569f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4e665db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd569b630 con 0x559dd56a9b80 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4e665db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd56aefe0 con 0x559dd56a50d0 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4e665db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd56a9080 con 0x559dd56a4770 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4d139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd569f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4d139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd569f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57398/0 (socket says 172.21.15.12:57398) 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4d139c700 1 -- 172.21.15.12:0/2548463140 learned_addr learned my addr 172.21.15.12:0/2548463140 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.412+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/2548463140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 msgr2=0x559dd56b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/2548463140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 msgr2=0x559dd569f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd569f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4d0b9b700 1 -- 172.21.15.12:0/2548463140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd540ac00 con 0x559dd56a4770 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4d139c700 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd569f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56ad410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4c009a1c0 tx=0x7ff4c0098370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb22829fe0d5031b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4b77fe700 1 -- 172.21.15.12:0/2548463140 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00a25c0 con 0x559dd56a4770 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4b77fe700 1 -- 172.21.15.12:0/2548463140 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559dd5673ee0 con 0x559dd56a4770 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.413+0000 7ff4b77fe700 1 -- 172.21.15.12:0/2548463140 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0099720 con 0x559dd56a4770 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 -- 172.21.15.12:0/2548463140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 msgr2=0x559dd56ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56ad410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4c009a1c0 tx=0x7ff4c0098370 comp rx=0 tx=0).stop 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 -- 172.21.15.12:0/2548463140 shutdown_connections 2023-12-11T20:25:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd569f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56ad410 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 --2- 172.21.15.12:0/2548463140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 -- 172.21.15.12:0/2548463140 >> 172.21.15.12:0/2548463140 conn(0x559dd55d3780 msgr2=0x559dd56abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 -- 172.21.15.12:0/2548463140 shutdown_connections 2023-12-11T20:25:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.414+0000 7ff4e665db80 1 -- 172.21.15.12:0/2548463140 wait complete. 2023-12-11T20:25:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.415+0000 7ff4e665db80 1 -- start start 2023-12-11T20:25:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.415+0000 7ff4e665db80 1 Processor -- start 2023-12-11T20:25:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.415+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.415+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.415+0000 7ff4e665db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4e665db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd56b44f0 con 0x559dd56a9b80 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4e665db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd56b4660 con 0x559dd56a50d0 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4e665db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd56b4820 con 0x559dd56a4770 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4e665db80 10 client.0 _ll_register_callbacks cb 0x559dd54dda20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57406/0 (socket says 172.21.15.12:57406) 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d139c700 1 -- 172.21.15.12:0/1482209382 learned_addr learned my addr 172.21.15.12:0/1482209382 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d139c700 1 -- 172.21.15.12:0/1482209382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 msgr2=0x559dd56b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d139c700 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56b2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d139c700 1 -- 172.21.15.12:0/1482209382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 msgr2=0x559dd56b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d139c700 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.416+0000 7ff4d139c700 1 -- 172.21.15.12:0/1482209382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559dd5421d80 con 0x559dd56a9b80 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.417+0000 7ff4d139c700 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b3fb0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009fd0 tx=0x7ff4c400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb13e151c03c489 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.417+0000 7ff4abfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.417+0000 7ff4abfff700 1 -- 172.21.15.12:0/1482209382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400e040 con 0x559dd56a9b80 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.417+0000 7ff4e665db80 1 -- 172.21.15.12:0/1482209382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4c009a230 con 0x559dd56a9b80 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.417+0000 7ff4abfff700 1 -- 172.21.15.12:0/1482209382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff4c4004e60 con 0x559dd56a9b80 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.417+0000 7ff4abfff700 1 -- 172.21.15.12:0/1482209382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4c40077f0 con 0x559dd56a9b80 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.417+0000 7ff4e665db80 10 client.18213 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.417+0000 7ff4e665db80 1 -- 172.21.15.12:0/1482209382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559dd54755d0 con 0x559dd56a9b80 2023-12-11T20:25:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4abfff700 1 -- 172.21.15.12:0/1482209382 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4c009a230 con 0x559dd56a9b80 2023-12-11T20:25:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4abfff700 1 -- 172.21.15.12:0/1482209382 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff4c400b420 con 0x559dd56a9b80 2023-12-11T20:25:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4e665db80 10 client.18213 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4e665db80 10 client.18213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4e665db80 20 client.18213 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4e665db80 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559dd5710600 0x559dd57129f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4e665db80 4 client.18213 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:25:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4e665db80 1 -- 172.21.15.12:0/1482209382 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559dd55bef70 con 0x559dd5710600 2023-12-11T20:25:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.418+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559dd5710600 0x559dd57129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.419+0000 7ff4d0b9b700 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559dd5710600 0x559dd57129f0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e8f004c027e618f server_cookie=235d91f01abaa6f3 in_seq=0 out_seq=0 2023-12-11T20:25:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.419+0000 7ff4abfff700 10 client.18213 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.429+0000 7ff4abfff700 1 -- 172.21.15.12:0/1482209382 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559dd55bef70 con 0x559dd5710600 2023-12-11T20:25:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.429+0000 7ff4abfff700 10 client.18213 handle_command_reply: tid=0 2023-12-11T20:25:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.429+0000 7ff4e665db80 1 client.18213 shutdown 2023-12-11T20:25:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 -- 172.21.15.12:0/1482209382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 msgr2=0x559dd56b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b3fb0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009fd0 tx=0x7ff4c400bd60 comp rx=0 tx=0).stop 2023-12-11T20:25:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 -- 172.21.15.12:0/1482209382 shutdown_connections 2023-12-11T20:25:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559dd5710600 0x559dd57129f0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559dd56a9b80 0x559dd56b3fb0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559dd56a4770 0x559dd56b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 --2- 172.21.15.12:0/1482209382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559dd56a50d0 0x559dd56b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 -- 172.21.15.12:0/1482209382 >> 172.21.15.12:0/1482209382 conn(0x559dd55d3780 msgr2=0x559dd56abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4abfff700 0 client.18213 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 -- 172.21.15.12:0/1482209382 shutdown_connections 2023-12-11T20:25:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 1 -- 172.21.15.12:0/1482209382 wait complete. 2023-12-11T20:25:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.430+0000 7ff4e665db80 20 client.18213 trim_cache size 0 max 16384 2023-12-11T20:25:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:25:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:25:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:25:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4bc0a14f0 msgr2=0x7ff4bc0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4bc0a14f0 0x7ff4bc0a39b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009c60 tx=0x7ff4b8009260 comp rx=0 tx=0).stop 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc073fd0 msgr2=0x7ff4cc199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc073fd0 0x7ff4cc199430 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000e9a0 tx=0x7ff4c000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/3785057775 shutdown_connections 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4bc0a14f0 0x7ff4bc0a39b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4cc1091e0 0x7ff4cc1a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4cc073fd0 0x7ff4cc199430 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 --2- 172.21.15.12:0/3785057775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4cc0755b0 0x7ff4cc199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/3785057775 >> 172.21.15.12:0/3785057775 conn(0x7ff4cc0fc880 msgr2=0x7ff4cc105130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/3785057775 shutdown_connections 2023-12-11T20:25:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:26.431+0000 7ff4d1b9d700 1 -- 172.21.15.12:0/3785057775 wait complete. 2023-12-11T20:25:26.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:26 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:25:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:26 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:25:26.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:26 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:25:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:27 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:25:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:27 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:25:27.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:27 smithi039 ceph-mon[102205]: pgmap v661: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 26 op/s 2023-12-11T20:25:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:27 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:25:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:27 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:25:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:27 smithi012 ceph-mon[128787]: pgmap v661: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 26 op/s 2023-12-11T20:25:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:27 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:25:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:27 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:25:27.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:27 smithi032 ceph-mon[132488]: pgmap v661: 97 pgs: 97 active+clean; 6.9 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 26 op/s 2023-12-11T20:25:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:29 smithi032 ceph-mon[132488]: pgmap v662: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:25:29.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:29 smithi039 ceph-mon[102205]: pgmap v662: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:25:29.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:29 smithi012 ceph-mon[128787]: pgmap v662: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:25:31.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:31 smithi039 ceph-mon[102205]: pgmap v663: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:25:31.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:31 smithi012 ceph-mon[128787]: pgmap v663: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:25:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:31 smithi032 ceph-mon[132488]: pgmap v663: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:25:33.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:33 smithi039 ceph-mon[102205]: pgmap v664: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:25:33.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:33 smithi012 ceph-mon[128787]: pgmap v664: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:25:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:33 smithi032 ceph-mon[132488]: pgmap v664: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:25:35.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:35 smithi039 ceph-mon[102205]: pgmap v665: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:35 smithi012 ceph-mon[128787]: pgmap v665: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:35.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:35 smithi032 ceph-mon[132488]: pgmap v665: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:25:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:37 smithi039 ceph-mon[102205]: pgmap v666: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 15 op/s 2023-12-11T20:25:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:37 smithi012 ceph-mon[128787]: pgmap v666: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 15 op/s 2023-12-11T20:25:37.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:37 smithi032 ceph-mon[132488]: pgmap v666: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 15 op/s 2023-12-11T20:25:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 -- 172.21.15.12:0/339805144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0104870 msgr2=0x7f11b0106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 --2- 172.21.15.12:0/339805144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0104870 0x7f11b0106c60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009990 tx=0x7f11a4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 -- 172.21.15.12:0/339805144 shutdown_connections 2023-12-11T20:25:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 --2- 172.21.15.12:0/339805144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b0101f40 0x7f11b0104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 --2- 172.21.15.12:0/339805144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b01071a0 0x7f11b0109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 --2- 172.21.15.12:0/339805144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0104870 0x7f11b0106c60 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 -- 172.21.15.12:0/339805144 >> 172.21.15.12:0/339805144 conn(0x7f11b00fb930 msgr2=0x7f11b00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 -- 172.21.15.12:0/339805144 shutdown_connections 2023-12-11T20:25:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.594+0000 7f11b51ff700 1 -- 172.21.15.12:0/339805144 wait complete. 2023-12-11T20:25:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.595+0000 7f11b51ff700 1 Processor -- start 2023-12-11T20:25:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.595+0000 7f11b51ff700 1 -- start start 2023-12-11T20:25:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.595+0000 7f11b51ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0101f40 0x7f11b0197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.595+0000 7f11b51ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b0104870 0x7f11b0197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.595+0000 7f11b51ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b01071a0 0x7f11b019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.595+0000 7f11b51ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b019ee70 con 0x7f11b0101f40 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11b51ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b019efb0 con 0x7f11b0104870 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11b51ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b019f140 con 0x7f11b01071a0 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0101f40 0x7f11b0197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0101f40 0x7f11b0197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38654/0 (socket says 172.21.15.12:38654) 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 -- 172.21.15.12:0/1072994459 learned_addr learned my addr 172.21.15.12:0/1072994459 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11af59e700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b01071a0 0x7f11b019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11ae59c700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b0104870 0x7f11b0197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 -- 172.21.15.12:0/1072994459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b01071a0 msgr2=0x7f11b019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b01071a0 0x7f11b019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 -- 172.21.15.12:0/1072994459 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b0104870 msgr2=0x7f11b0197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b0104870 0x7f11b0197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 -- 172.21.15.12:0/1072994459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40095f0 con 0x7f11b0101f40 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.596+0000 7f11aed9d700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0101f40 0x7f11b0197340 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f11a000e9a0 tx=0x7f11a000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.597+0000 7f1197fff700 1 -- 172.21.15.12:0/1072994459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0009790 con 0x7f11b0101f40 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.597+0000 7f1197fff700 1 -- 172.21.15.12:0/1072994459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11a000cbd0 con 0x7f11b0101f40 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.597+0000 7f1197fff700 1 -- 172.21.15.12:0/1072994459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0018680 con 0x7f11b0101f40 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.597+0000 7f11b51ff700 1 -- 172.21.15.12:0/1072994459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b019f420 con 0x7f11b0101f40 2023-12-11T20:25:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.597+0000 7f11b51ff700 1 -- 172.21.15.12:0/1072994459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b019f8e0 con 0x7f11b0101f40 2023-12-11T20:25:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.602+0000 7f1197fff700 1 -- 172.21.15.12:0/1072994459 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f11a000cd40 con 0x7f11b0101f40 2023-12-11T20:25:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.603+0000 7f11c8b05b80 1 Processor -- start 2023-12-11T20:25:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.603+0000 7f11c8b05b80 1 -- start start 2023-12-11T20:25:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.603+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fe2e0 0x5655520fe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.603+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fec40 0x5655520ff550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.603+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x5655520fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.603+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x565552055af0 con 0x5655520ffb30 2023-12-11T20:25:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.603+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x565552053410 con 0x5655520fe2e0 2023-12-11T20:25:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.603+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56555204ed00 con 0x5655520fec40 2023-12-11T20:25:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f11ae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x5655520fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f11af59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fe2e0 0x5655520fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f1197fff700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11980a1470 0x7f11980a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f11af59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fe2e0 0x5655520fe700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50276/0 (socket says 172.21.15.12:50276) 2023-12-11T20:25:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f11af59e700 1 -- 172.21.15.12:0/3249763442 learned_addr learned my addr 172.21.15.12:0/3249763442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f11ae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x5655520fffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38658/0 (socket says 172.21.15.12:38658) 2023-12-11T20:25:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f11aed9d700 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fec40 0x5655520ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f1197fff700 1 -- 172.21.15.12:0/1072994459 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11a0014070 con 0x7f11b0101f40 2023-12-11T20:25:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.604+0000 7f11af59e700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11980a1470 0x7f11980a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11ae59c700 1 -- 172.21.15.12:0/3249763442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fec40 msgr2=0x5655520ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11ae59c700 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fec40 0x5655520ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11ae59c700 1 -- 172.21.15.12:0/3249763442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fe2e0 msgr2=0x5655520fe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11ae59c700 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fe2e0 0x5655520fe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11ae59c700 1 -- 172.21.15.12:0/3249763442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565551ecb5d0 con 0x5655520ffb30 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11af59e700 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fe2e0 0x5655520fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11ae59c700 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x5655520fffb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f11a40098e0 tx=0x7f11a4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba154ae22f7c590a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11af59e700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11980a1470 0x7f11980a3930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009510 tx=0x7f11a8004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11957fa700 1 -- 172.21.15.12:0/3249763442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4005240 con 0x5655520ffb30 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11957fa700 1 -- 172.21.15.12:0/3249763442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11a401e040 con 0x5655520ffb30 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.605+0000 7f11957fa700 1 -- 172.21.15.12:0/3249763442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400b710 con 0x5655520ffb30 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3249763442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 msgr2=0x5655520fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x5655520fffb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f11a40098e0 tx=0x7f11a4005e80 comp rx=0 tx=0).stop 2023-12-11T20:25:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3249763442 shutdown_connections 2023-12-11T20:25:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fe2e0 0x5655520fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x5655520fffb0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/3249763442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fec40 0x5655520ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3249763442 >> 172.21.15.12:0/3249763442 conn(0x565552029780 msgr2=0x5655520f6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3249763442 shutdown_connections 2023-12-11T20:25:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.606+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3249763442 wait complete. 2023-12-11T20:25:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.607+0000 7f11c8b05b80 1 -- start start 2023-12-11T20:25:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.607+0000 7f11c8b05b80 1 Processor -- start 2023-12-11T20:25:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 0x5655521081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x565552008500 con 0x5655520ffb30 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655520081a0 con 0x5655520fec40 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x565551ecd8c0 con 0x5655520fe2e0 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11c8b05b80 10 client.0 _ll_register_callbacks cb 0x565551f33a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38672/0 (socket says 172.21.15.12:38672) 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11af59e700 1 -- 172.21.15.12:0/726690510 learned_addr learned my addr 172.21.15.12:0/726690510 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11ae59c700 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11aed9d700 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 0x5655521081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11af59e700 1 -- 172.21.15.12:0/726690510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 msgr2=0x5655521081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11af59e700 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 0x5655521081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11af59e700 1 -- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 msgr2=0x565552108710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11af59e700 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11af59e700 1 -- 172.21.15.12:0/726690510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a8007620 con 0x5655520ffb30 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.608+0000 7f11ae59c700 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.609+0000 7f11af59e700 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f540 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f11a8017db0 tx=0x7f11a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d376b7f6e0909a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.609+0000 7f1192ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.609+0000 7f1192ff5700 1 -- 172.21.15.12:0/726690510 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800e040 con 0x5655520ffb30 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.609+0000 7f11c8b05b80 1 -- 172.21.15.12:0/726690510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5655520ed730 con 0x5655520ffb30 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.609+0000 7f1192ff5700 1 -- 172.21.15.12:0/726690510 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11a801e040 con 0x5655520ffb30 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.609+0000 7f1192ff5700 1 -- 172.21.15.12:0/726690510 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11a8019c20 con 0x5655520ffb30 2023-12-11T20:25:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.609+0000 7f11c8b05b80 10 client.18225 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.609+0000 7f11c8b05b80 1 -- 172.21.15.12:0/726690510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f11b010a200 con 0x5655520ffb30 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.610+0000 7f1192ff5700 1 -- 172.21.15.12:0/726690510 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5655520ed730 con 0x5655520ffb30 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.610+0000 7f1192ff5700 1 -- 172.21.15.12:0/726690510 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11a8023ca0 con 0x5655520ffb30 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.610+0000 7f11c8b05b80 10 client.18225 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.610+0000 7f11c8b05b80 10 client.18225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.610+0000 7f11c8b05b80 20 client.18225 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.610+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x565552114090 0x5655521164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.610+0000 7f11c8b05b80 4 client.18225 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.610+0000 7f11c8b05b80 1 -- 172.21.15.12:0/726690510 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5655520c9ee0 con 0x565552114090 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.611+0000 7f11aed9d700 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x565552114090 0x5655521164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.611+0000 7f11aed9d700 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x565552114090 0x5655521164b0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1a4a44499ae2c1 server_cookie=665e8e42fa23199e in_seq=0 out_seq=0 2023-12-11T20:25:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.611+0000 7f1192ff5700 10 client.18225 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f1192ff5700 1 -- 172.21.15.12:0/726690510 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5655520c9ee0 con 0x565552114090 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f1192ff5700 10 client.18225 handle_command_reply: tid=0 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 client.18225 shutdown 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 -- 172.21.15.12:0/726690510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 msgr2=0x56555210f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f540 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f11a8017db0 tx=0x7f11a8004ad0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 -- 172.21.15.12:0/726690510 shutdown_connections 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x565552114090 0x5655521164b0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f540 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 0x5655521081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/726690510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f11c8b05b80 1 -- 172.21.15.12:0/726690510 >> 172.21.15.12:0/726690510 conn(0x565552029780 msgr2=0x5655520f4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.612+0000 7f1192ff5700 0 client.18225 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.613+0000 7f11c8b05b80 1 -- 172.21.15.12:0/726690510 shutdown_connections 2023-12-11T20:25:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.613+0000 7f11c8b05b80 1 -- 172.21.15.12:0/726690510 wait complete. 2023-12-11T20:25:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.613+0000 7f11c8b05b80 20 client.18225 trim_cache size 0 max 16384 2023-12-11T20:25:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.632+0000 7f11c8b05b80 1 Processor -- start 2023-12-11T20:25:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11c8b05b80 1 -- start start 2023-12-11T20:25:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 0x5655521081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x565552113e50 con 0x5655520ffb30 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655520ff340 con 0x5655520fec40 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x565552105cb0 con 0x5655520fe2e0 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38676/0 (socket says 172.21.15.12:38676) 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11af59e700 1 -- 172.21.15.12:0/3167177111 learned_addr learned my addr 172.21.15.12:0/3167177111 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11aed9d700 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 0x5655521081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.633+0000 7f11ae59c700 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f11af59e700 1 -- 172.21.15.12:0/3167177111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 msgr2=0x5655521081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f11af59e700 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 0x5655521081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f11af59e700 1 -- 172.21.15.12:0/3167177111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 msgr2=0x565552108710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f11af59e700 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f11af59e700 1 -- 172.21.15.12:0/3167177111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565551e77d80 con 0x5655520ffb30 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f11af59e700 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f460 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f11a8018010 tx=0x7f11a8022500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ceaa53b6e9a830 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f1195ffb700 1 -- 172.21.15.12:0/3167177111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800e040 con 0x5655520ffb30 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f1195ffb700 1 -- 172.21.15.12:0/3167177111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11a800f040 con 0x5655520ffb30 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.634+0000 7f1195ffb700 1 -- 172.21.15.12:0/3167177111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8023650 con 0x5655520ffb30 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3167177111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 msgr2=0x56555210f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f460 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f11a8018010 tx=0x7f11a8022500 comp rx=0 tx=0).stop 2023-12-11T20:25:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3167177111 shutdown_connections 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520ffb30 0x56555210f460 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520fe2e0 0x5655521081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/3167177111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3167177111 >> 172.21.15.12:0/3167177111 conn(0x565552029780 msgr2=0x56555211adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3167177111 shutdown_connections 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.635+0000 7f11c8b05b80 1 -- 172.21.15.12:0/3167177111 wait complete. 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 1 -- start start 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 1 Processor -- start 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520fe2e0 0x5655521052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552166540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520ffb30 0x565552168a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x565552168fd0 con 0x5655520fe2e0 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x565552169110 con 0x5655520fec40 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x565552169250 con 0x5655520ffb30 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.636+0000 7f11c8b05b80 10 client.0 _ll_register_callbacks cb 0x565551f33a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11aed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520fe2e0 0x5655521052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11af59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520ffb30 0x565552168a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11aed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520fe2e0 0x5655521052b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38682/0 (socket says 172.21.15.12:38682) 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11aed9d700 1 -- 172.21.15.12:0/2446141825 learned_addr learned my addr 172.21.15.12:0/2446141825 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11ae59c700 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11af59e700 1 -- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 msgr2=0x565552166540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11af59e700 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552166540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11af59e700 1 -- 172.21.15.12:0/2446141825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520fe2e0 msgr2=0x5655521052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11af59e700 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520fe2e0 0x5655521052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11af59e700 1 -- 172.21.15.12:0/2446141825 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b010a200 con 0x5655520ffb30 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11ae59c700 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11aed9d700 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520fe2e0 0x5655521052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f11af59e700 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520ffb30 0x565552168a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f11a8018010 tx=0x7f11a80073e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=104bbec378838161 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.637+0000 7f1192ff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:25:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.638+0000 7f1192ff5700 1 -- 172.21.15.12:0/2446141825 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800e040 con 0x5655520ffb30 2023-12-11T20:25:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.638+0000 7f1192ff5700 1 -- 172.21.15.12:0/2446141825 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11a8022b40 con 0x5655520ffb30 2023-12-11T20:25:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.638+0000 7f11c8b05b80 1 -- 172.21.15.12:0/2446141825 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11a401e040 con 0x5655520ffb30 2023-12-11T20:25:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.638+0000 7f1192ff5700 1 -- 172.21.15.12:0/2446141825 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11a8022d00 con 0x5655520ffb30 2023-12-11T20:25:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.638+0000 7f11c8b05b80 10 client.27853 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.638+0000 7f11c8b05b80 1 -- 172.21.15.12:0/2446141825 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x565551e60c00 con 0x5655520ffb30 2023-12-11T20:25:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.639+0000 7f1192ff5700 1 -- 172.21.15.12:0/2446141825 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11a401e040 con 0x5655520ffb30 2023-12-11T20:25:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.639+0000 7f1192ff5700 1 -- 172.21.15.12:0/2446141825 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11a8019400 con 0x5655520ffb30 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.639+0000 7f11c8b05b80 10 client.27853 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.639+0000 7f11c8b05b80 10 client.27853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.639+0000 7f11c8b05b80 20 client.27853 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.639+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56555216a850 0x56555216cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.639+0000 7f11c8b05b80 4 client.27853 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.639+0000 7f11c8b05b80 1 -- 172.21.15.12:0/2446141825 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565552014f70 con 0x56555216a850 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.640+0000 7f11aed9d700 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56555216a850 0x56555216cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.640+0000 7f1192ff5700 10 client.27853 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:39.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.640+0000 7f11aed9d700 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56555216a850 0x56555216cc70 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6c42def384214d server_cookie=9ec59b0583750e7e in_seq=0 out_seq=0 2023-12-11T20:25:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f1192ff5700 1 -- 172.21.15.12:0/2446141825 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565552014f70 con 0x56555216a850 2023-12-11T20:25:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f1192ff5700 10 client.27853 handle_command_reply: tid=0 2023-12-11T20:25:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 client.27853 shutdown 2023-12-11T20:25:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 -- 172.21.15.12:0/2446141825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520ffb30 msgr2=0x565552168a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520ffb30 0x565552168a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f11a8018010 tx=0x7f11a80073e0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 -- 172.21.15.12:0/2446141825 shutdown_connections 2023-12-11T20:25:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56555216a850 0x56555216cc70 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5655520ffb30 0x565552168a90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5655520fe2e0 0x5655521052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f1192ff5700 0 client.27853 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 --2- 172.21.15.12:0/2446141825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5655520fec40 0x565552166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.650+0000 7f11c8b05b80 1 -- 172.21.15.12:0/2446141825 >> 172.21.15.12:0/2446141825 conn(0x565552029780 msgr2=0x5655520f6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11c8b05b80 1 -- 172.21.15.12:0/2446141825 shutdown_connections 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11c8b05b80 1 -- 172.21.15.12:0/2446141825 wait complete. 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11c8b05b80 20 client.27853 trim_cache size 0 max 16384 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:25:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:25:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 -- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11980a1470 msgr2=0x7f11980a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11980a1470 0x7f11980a3930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009510 tx=0x7f11a8004b40 comp rx=0 tx=0).stop 2023-12-11T20:25:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 -- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0101f40 msgr2=0x7f11b0197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0101f40 0x7f11b0197340 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f11a000e9a0 tx=0x7f11a000ed60 comp rx=0 tx=0).stop 2023-12-11T20:25:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 -- 172.21.15.12:0/1072994459 shutdown_connections 2023-12-11T20:25:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f11980a1470 0x7f11980a3930 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11b01071a0 0x7f11b019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11b0101f40 0x7f11b0197340 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.651+0000 7f11b51ff700 1 --2- 172.21.15.12:0/1072994459 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b0104870 0x7f11b0197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.652+0000 7f11b51ff700 1 -- 172.21.15.12:0/1072994459 >> 172.21.15.12:0/1072994459 conn(0x7f11b00fb930 msgr2=0x7f11b0103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.652+0000 7f11b51ff700 1 -- 172.21.15.12:0/1072994459 shutdown_connections 2023-12-11T20:25:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:39.652+0000 7f11b51ff700 1 -- 172.21.15.12:0/1072994459 wait complete. 2023-12-11T20:25:39.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:39 smithi032 ceph-mon[132488]: pgmap v667: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:25:39.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:39 smithi039 ceph-mon[102205]: pgmap v667: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:25:39.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:39 smithi012 ceph-mon[128787]: pgmap v667: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:25:41.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:41 smithi039 ceph-mon[102205]: pgmap v668: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 14 MiB/s wr, 11 op/s 2023-12-11T20:25:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:41 smithi012 ceph-mon[128787]: pgmap v668: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 14 MiB/s wr, 11 op/s 2023-12-11T20:25:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:41 smithi032 ceph-mon[132488]: pgmap v668: 97 pgs: 97 active+clean; 7.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 14 MiB/s wr, 11 op/s 2023-12-11T20:25:42.974 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:25:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 -- 172.21.15.12:0/3071213346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1026a0 msgr2=0x7f621c102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 --2- 172.21.15.12:0/3071213346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1026a0 0x7f621c102b00 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f62100099c0 tx=0x7f6210009cd0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 -- 172.21.15.12:0/3071213346 shutdown_connections 2023-12-11T20:25:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 --2- 172.21.15.12:0/3071213346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f621c1014b0 0x7f621c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 --2- 172.21.15.12:0/3071213346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f621c103040 0x7f621c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 --2- 172.21.15.12:0/3071213346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1026a0 0x7f621c102b00 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 -- 172.21.15.12:0/3071213346 >> 172.21.15.12:0/3071213346 conn(0x7f621c0fca00 msgr2=0x7f621c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 -- 172.21.15.12:0/3071213346 shutdown_connections 2023-12-11T20:25:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.194+0000 7f62223ff700 1 -- 172.21.15.12:0/3071213346 wait complete. 2023-12-11T20:25:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.195+0000 7f62223ff700 1 Processor -- start 2023-12-11T20:25:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.195+0000 7f62223ff700 1 -- start start 2023-12-11T20:25:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f62223ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1014b0 0x7f621c199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f62223ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f621c1026a0 0x7f621c199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f62223ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f621c103040 0x7f621c1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f62223ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1a1090 con 0x7f621c1014b0 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f62223ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1a11d0 con 0x7f621c103040 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f62223ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1a1360 con 0x7f621c1026a0 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1014b0 0x7f621c199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1014b0 0x7f621c199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38702/0 (socket says 172.21.15.12:38702) 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621bfff700 1 -- 172.21.15.12:0/1125565418 learned_addr learned my addr 172.21.15.12:0/1125565418 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f621c1026a0 0x7f621c199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f622099c700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f621c103040 0x7f621c1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621bfff700 1 -- 172.21.15.12:0/1125565418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f621c1026a0 msgr2=0x7f621c199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621bfff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f621c1026a0 0x7f621c199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621bfff700 1 -- 172.21.15.12:0/1125565418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f621c103040 msgr2=0x7f621c1a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621bfff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f621c103040 0x7f621c1a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621bfff700 1 -- 172.21.15.12:0/1125565418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100095f0 con 0x7f621c1014b0 2023-12-11T20:25:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f621c1026a0 0x7f621c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.196+0000 7f622099c700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f621c103040 0x7f621c1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:25:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.197+0000 7f621bfff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1014b0 0x7f621c199560 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f620c00d980 tx=0x7f620c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.197+0000 7f62197fa700 1 -- 172.21.15.12:0/1125565418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00de60 con 0x7f621c1014b0 2023-12-11T20:25:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.197+0000 7f62197fa700 1 -- 172.21.15.12:0/1125565418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f620c0044b0 con 0x7f621c1014b0 2023-12-11T20:25:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.197+0000 7f62223ff700 1 -- 172.21.15.12:0/1125565418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c1a1640 con 0x7f621c1014b0 2023-12-11T20:25:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.197+0000 7f62197fa700 1 -- 172.21.15.12:0/1125565418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c003b40 con 0x7f621c1014b0 2023-12-11T20:25:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.197+0000 7f62223ff700 1 -- 172.21.15.12:0/1125565418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c1a1ba0 con 0x7f621c1014b0 2023-12-11T20:25:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.201+0000 7f62197fa700 1 -- 172.21.15.12:0/1125565418 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f620c003ca0 con 0x7f621c1014b0 2023-12-11T20:25:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.202+0000 7f6235c83b80 1 Processor -- start 2023-12-11T20:25:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.202+0000 7f6235c83b80 1 -- start start 2023-12-11T20:25:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f62197fa700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62040a1500 0x7f62040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566ac3d0 0x5613566ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566acd30 0x5613566ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566adc20 0x5613566ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f6235c83b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561356607b50 con 0x5613566acd30 2023-12-11T20:25:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f6235c83b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561356605470 con 0x5613566ac3d0 2023-12-11T20:25:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f6235c83b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561356600d60 con 0x5613566adc20 2023-12-11T20:25:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f62197fa700 1 -- 172.21.15.12:0/1125565418 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f620c0cca00 con 0x7f621c1014b0 2023-12-11T20:25:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f621b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566acd30 0x5613566ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f621b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566acd30 0x5613566ad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38708/0 (socket says 172.21.15.12:38708) 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f621b7fe700 1 -- 172.21.15.12:0/85000336 learned_addr learned my addr 172.21.15.12:0/85000336 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f622099c700 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566adc20 0x5613566ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f622099c700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62040a1500 0x7f62040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.203+0000 7f621bfff700 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566ac3d0 0x5613566ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f621b7fe700 1 -- 172.21.15.12:0/85000336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566adc20 msgr2=0x5613566ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f621b7fe700 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566adc20 0x5613566ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f621b7fe700 1 -- 172.21.15.12:0/85000336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566ac3d0 msgr2=0x5613566ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f621b7fe700 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566ac3d0 0x5613566ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f621b7fe700 1 -- 172.21.15.12:0/85000336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56135647d630 con 0x5613566acd30 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f621b7fe700 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566acd30 0x5613566ad640 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f62100099c0 tx=0x7f6210009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c7374e34e599ae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f622099c700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62040a1500 0x7f62040a39c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x5613566ad400 tx=0x7f6214009620 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f62027fc700 1 -- 172.21.15.12:0/85000336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000b990 con 0x5613566acd30 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f62027fc700 1 -- 172.21.15.12:0/85000336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f621001e040 con 0x5613566acd30 2023-12-11T20:25:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.204+0000 7f62027fc700 1 -- 172.21.15.12:0/85000336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210004760 con 0x5613566acd30 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 -- 172.21.15.12:0/85000336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566acd30 msgr2=0x5613566ad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566acd30 0x5613566ad640 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f62100099c0 tx=0x7f6210009f10 comp rx=0 tx=0).stop 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 -- 172.21.15.12:0/85000336 shutdown_connections 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566ac3d0 0x5613566ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566adc20 0x5613566ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 --2- 172.21.15.12:0/85000336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566acd30 0x5613566ad640 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 -- 172.21.15.12:0/85000336 >> 172.21.15.12:0/85000336 conn(0x5613565db7e0 msgr2=0x5613566a8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 -- 172.21.15.12:0/85000336 shutdown_connections 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.205+0000 7f6235c83b80 1 -- 172.21.15.12:0/85000336 wait complete. 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.206+0000 7f6235c83b80 1 -- start start 2023-12-11T20:25:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.206+0000 7f6235c83b80 1 Processor -- start 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566b6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f6235c83b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613565ba560 con 0x5613566ac3d0 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f6235c83b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613565ba200 con 0x5613566adc20 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f6235c83b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135647f920 con 0x5613566acd30 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f6235c83b80 10 client.0 _ll_register_callbacks cb 0x5613564e5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f621bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f621bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38714/0 (socket says 172.21.15.12:38714) 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f621bfff700 1 -- 172.21.15.12:0/1533116203 learned_addr learned my addr 172.21.15.12:0/1533116203 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f622099c700 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.207+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f621bfff700 1 -- 172.21.15.12:0/1533116203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 msgr2=0x5613566b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f621bfff700 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f621bfff700 1 -- 172.21.15.12:0/1533116203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 msgr2=0x5613566bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f621bfff700 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f621bfff700 1 -- 172.21.15.12:0/1533116203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c10a240 con 0x5613566ac3d0 2023-12-11T20:25:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f621bfff700 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566b6150 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f620c0ca4b0 tx=0x7f620c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e748f2d62f5d733c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f61fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f61fb7fe700 1 -- 172.21.15.12:0/1533116203 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c099cd0 con 0x5613566ac3d0 2023-12-11T20:25:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f61fb7fe700 1 -- 172.21.15.12:0/1533116203 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f620c09de20 con 0x5613566ac3d0 2023-12-11T20:25:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f6235c83b80 1 -- 172.21.15.12:0/1533116203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56135669fb40 con 0x5613566ac3d0 2023-12-11T20:25:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f61fb7fe700 1 -- 172.21.15.12:0/1533116203 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f620c0a2060 con 0x5613566ac3d0 2023-12-11T20:25:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f6235c83b80 10 client.18243 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.208+0000 7f6235c83b80 1 -- 172.21.15.12:0/1533116203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561356429de0 con 0x5613566ac3d0 2023-12-11T20:25:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.209+0000 7f61fb7fe700 1 -- 172.21.15.12:0/1533116203 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56135669fb40 con 0x5613566ac3d0 2023-12-11T20:25:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.209+0000 7f61fb7fe700 1 -- 172.21.15.12:0/1533116203 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f620c0992e0 con 0x5613566ac3d0 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.209+0000 7f6235c83b80 10 client.18243 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.209+0000 7f6235c83b80 10 client.18243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.209+0000 7f6235c83b80 20 client.18243 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.209+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5613566c1f40 0x5613566c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.209+0000 7f6235c83b80 4 client.18243 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.209+0000 7f6235c83b80 1 -- 172.21.15.12:0/1533116203 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56135667bf40 con 0x5613566c1f40 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.210+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5613566c1f40 0x5613566c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.210+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5613566c1f40 0x5613566c4380 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80e48b433555da1f server_cookie=575ef5c0d9362d02 in_seq=0 out_seq=0 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.210+0000 7f61fb7fe700 10 client.18243 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.211+0000 7f61fb7fe700 1 -- 172.21.15.12:0/1533116203 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56135667bf40 con 0x5613566c1f40 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.211+0000 7f61fb7fe700 10 client.18243 handle_command_reply: tid=0 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.211+0000 7f6235c83b80 1 client.18243 shutdown 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.211+0000 7f6235c83b80 1 -- 172.21.15.12:0/1533116203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 msgr2=0x5613566b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.211+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566b6150 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f620c0ca4b0 tx=0x7f620c009c30 comp rx=0 tx=0).stop 2023-12-11T20:25:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.211+0000 7f6235c83b80 1 -- 172.21.15.12:0/1533116203 shutdown_connections 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.211+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5613566c1f40 0x5613566c4380 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.212+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.212+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566b6150 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.212+0000 7f61fb7fe700 0 client.18243 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.212+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1533116203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.212+0000 7f6235c83b80 1 -- 172.21.15.12:0/1533116203 >> 172.21.15.12:0/1533116203 conn(0x5613565db7e0 msgr2=0x5613566a7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.212+0000 7f6235c83b80 1 -- 172.21.15.12:0/1533116203 shutdown_connections 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.212+0000 7f6235c83b80 1 -- 172.21.15.12:0/1533116203 wait complete. 2023-12-11T20:25:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.212+0000 7f6235c83b80 20 client.18243 trim_cache size 0 max 16384 2023-12-11T20:25:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.242+0000 7f6235c83b80 1 Processor -- start 2023-12-11T20:25:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.242+0000 7f6235c83b80 1 -- start start 2023-12-11T20:25:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f6235c83b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613566be850 con 0x5613566ac3d0 2023-12-11T20:25:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f6235c83b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613566b5cc0 con 0x5613566adc20 2023-12-11T20:25:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f6235c83b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613566b4bb0 con 0x5613566acd30 2023-12-11T20:25:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f621bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f621bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38730/0 (socket says 172.21.15.12:38730) 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f621bfff700 1 -- 172.21.15.12:0/1857260736 learned_addr learned my addr 172.21.15.12:0/1857260736 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.243+0000 7f622099c700 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f621b7fe700 1 -- 172.21.15.12:0/1857260736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 msgr2=0x5613566b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f621b7fe700 1 -- 172.21.15.12:0/1857260736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 msgr2=0x5613566ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f621b7fe700 1 -- 172.21.15.12:0/1857260736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561356412c60 con 0x5613566acd30 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f621bfff700 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f621b7fe700 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bd690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f621000bef0 tx=0x7f6210000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8385af1b6d73c2c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f6202ffd700 1 -- 172.21.15.12:0/1857260736 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000bd90 con 0x5613566acd30 2023-12-11T20:25:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f6202ffd700 1 -- 172.21.15.12:0/1857260736 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f621000b930 con 0x5613566acd30 2023-12-11T20:25:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.244+0000 7f6202ffd700 1 -- 172.21.15.12:0/1857260736 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100315f0 con 0x5613566acd30 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 -- 172.21.15.12:0/1857260736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 msgr2=0x5613566bd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bd690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f621000bef0 tx=0x7f6210000bc0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 -- 172.21.15.12:0/1857260736 shutdown_connections 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 --2- 172.21.15.12:0/1857260736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bd690 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 -- 172.21.15.12:0/1857260736 >> 172.21.15.12:0/1857260736 conn(0x5613565db7e0 msgr2=0x5613566b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 -- 172.21.15.12:0/1857260736 shutdown_connections 2023-12-11T20:25:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.245+0000 7f6235c83b80 1 -- 172.21.15.12:0/1857260736 wait complete. 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 1 -- start start 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 1 Processor -- start 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566bb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613566bce20 con 0x5613566ac3d0 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613566bcf90 con 0x5613566adc20 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613566bd150 con 0x5613566acd30 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.246+0000 7f6235c83b80 10 client.0 _ll_register_callbacks cb 0x5613564e5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566bb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38746/0 (socket says 172.21.15.12:38746) 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 -- 172.21.15.12:0/674855118 learned_addr learned my addr 172.21.15.12:0/674855118 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f622099c700 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621b7fe700 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 -- 172.21.15.12:0/674855118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 msgr2=0x5613566bb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 -- 172.21.15.12:0/674855118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 msgr2=0x5613566bc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566bc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 -- 172.21.15.12:0/674855118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561356429de0 con 0x5613566ac3d0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f621bfff700 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566bb480 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f620c096740 tx=0x7f620c099b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d24c8fd9f7e2e19 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f61fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.247+0000 7f61fb7fe700 1 -- 172.21.15.12:0/674855118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c09de20 con 0x5613566ac3d0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f61fb7fe700 1 -- 172.21.15.12:0/674855118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f620c099cd0 con 0x5613566ac3d0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 1 -- 172.21.15.12:0/674855118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f621001e040 con 0x5613566ac3d0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f61fb7fe700 1 -- 172.21.15.12:0/674855118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f620c0a2060 con 0x5613566ac3d0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 10 client.18249 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 1 -- 172.21.15.12:0/674855118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56135647d630 con 0x5613566ac3d0 2023-12-11T20:25:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f61fb7fe700 1 -- 172.21.15.12:0/674855118 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f621001e040 con 0x5613566ac3d0 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f61fb7fe700 1 -- 172.21.15.12:0/674855118 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f620c0a3080 con 0x5613566ac3d0 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 10 client.18249 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 10 client.18249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 20 client.18249 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561356718f50 0x56135671b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 4 client.18249 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.248+0000 7f6235c83b80 1 -- 172.21.15.12:0/674855118 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5613565c6fd0 con 0x561356718f50 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.249+0000 7f621b7fe700 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561356718f50 0x56135671b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.249+0000 7f621b7fe700 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561356718f50 0x56135671b370 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6261cc1a7bb83c52 server_cookie=ed06ee558ffa6a7b in_seq=0 out_seq=0 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.249+0000 7f61fb7fe700 10 client.18249 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f61fb7fe700 1 -- 172.21.15.12:0/674855118 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5613565c6fd0 con 0x561356718f50 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f61fb7fe700 10 client.18249 handle_command_reply: tid=0 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 client.18249 shutdown 2023-12-11T20:25:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 -- 172.21.15.12:0/674855118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 msgr2=0x5613566bb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566bb480 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f620c096740 tx=0x7f620c099b60 comp rx=0 tx=0).stop 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 -- 172.21.15.12:0/674855118 shutdown_connections 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561356718f50 0x56135671b370 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5613566adc20 0x5613566bc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613566ac3d0 0x5613566bb480 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f61fb7fe700 0 client.18249 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 --2- 172.21.15.12:0/674855118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5613566acd30 0x5613566bb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 -- 172.21.15.12:0/674855118 >> 172.21.15.12:0/674855118 conn(0x5613565db7e0 msgr2=0x5613566b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 -- 172.21.15.12:0/674855118 shutdown_connections 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 1 -- 172.21.15.12:0/674855118 wait complete. 2023-12-11T20:25:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.250+0000 7f6235c83b80 20 client.18249 trim_cache size 0 max 16384 2023-12-11T20:25:43.255 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:25:43.255 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:25:43.255 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:25:43.255 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:25:43.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 -- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62040a1500 msgr2=0x7f62040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62040a1500 0x7f62040a39c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x5613566ad400 tx=0x7f6214009620 comp rx=0 tx=0).stop 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 -- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1014b0 msgr2=0x7f621c199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1014b0 0x7f621c199560 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f620c00d980 tx=0x7f620c00dd40 comp rx=0 tx=0).stop 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 -- 172.21.15.12:0/1125565418 shutdown_connections 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62040a1500 0x7f62040a39c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f621c103040 0x7f621c1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f621c1014b0 0x7f621c199560 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 --2- 172.21.15.12:0/1125565418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f621c1026a0 0x7f621c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 -- 172.21.15.12:0/1125565418 >> 172.21.15.12:0/1125565418 conn(0x7f621c0fca00 msgr2=0x7f621c107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 -- 172.21.15.12:0/1125565418 shutdown_connections 2023-12-11T20:25:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.251+0000 7f62223ff700 1 -- 172.21.15.12:0/1125565418 wait complete. 2023-12-11T20:25:43.271 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:25:43.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:25:43.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:43 smithi012 ceph-mon[128787]: pgmap v669: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:25:43.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 -- 172.21.15.12:0/892424984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44106fa0 msgr2=0x7f5b44109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 --2- 172.21.15.12:0/892424984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44106fa0 0x7f5b44109410 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00b0a0 tx=0x7f5b3c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 -- 172.21.15.12:0/892424984 shutdown_connections 2023-12-11T20:25:43.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 --2- 172.21.15.12:0/892424984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44106fa0 0x7f5b44109410 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 --2- 172.21.15.12:0/892424984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44101d40 0x7f5b44104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 --2- 172.21.15.12:0/892424984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b44104670 0x7f5b44106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 -- 172.21.15.12:0/892424984 >> 172.21.15.12:0/892424984 conn(0x7f5b440fb730 msgr2=0x7f5b440fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:43.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 -- 172.21.15.12:0/892424984 shutdown_connections 2023-12-11T20:25:43.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.495+0000 7f5b4999d700 1 -- 172.21.15.12:0/892424984 wait complete. 2023-12-11T20:25:43.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.496+0000 7f5b4999d700 1 Processor -- start 2023-12-11T20:25:43.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b4999d700 1 -- start start 2023-12-11T20:25:43.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b4999d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44101d40 0x7f5b44199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b4999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44104670 0x7f5b441999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b4999d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b44106fa0 0x7f5b441a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b4999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b441a0f90 con 0x7f5b44104670 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b4999d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b441a10d0 con 0x7f5b44106fa0 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b4999d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b441a1260 con 0x7f5b44101d40 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44104670 0x7f5b441999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44104670 0x7f5b441999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38768/0 (socket says 172.21.15.12:38768) 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b43fff700 1 -- 172.21.15.12:0/2799033208 learned_addr learned my addr 172.21.15.12:0/2799033208 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.497+0000 7f5b4899b700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44101d40 0x7f5b44199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.498+0000 7f5b4919c700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b44106fa0 0x7f5b441a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.498+0000 7f5b43fff700 1 -- 172.21.15.12:0/2799033208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44101d40 msgr2=0x7f5b44199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.498+0000 7f5b43fff700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44101d40 0x7f5b44199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.498+0000 7f5b43fff700 1 -- 172.21.15.12:0/2799033208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b44106fa0 msgr2=0x7f5b441a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.498+0000 7f5b43fff700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b44106fa0 0x7f5b441a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.498+0000 7f5b43fff700 1 -- 172.21.15.12:0/2799033208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c009d00 con 0x7f5b44104670 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.498+0000 7f5b43fff700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44104670 0x7f5b441999a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000d950 tx=0x7f5b3000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.499+0000 7f5b41ffb700 1 -- 172.21.15.12:0/2799033208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000f890 con 0x7f5b44104670 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.499+0000 7f5b41ffb700 1 -- 172.21.15.12:0/2799033208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b3000fe80 con 0x7f5b44104670 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.499+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b441a1540 con 0x7f5b44104670 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.499+0000 7f5b41ffb700 1 -- 172.21.15.12:0/2799033208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000e3b0 con 0x7f5b44104670 2023-12-11T20:25:43.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.499+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b441a1a50 con 0x7f5b44104670 2023-12-11T20:25:43.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.500+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b44108b20 con 0x7f5b44104670 2023-12-11T20:25:43.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.503+0000 7f5b41ffb700 1 -- 172.21.15.12:0/2799033208 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5b30010460 con 0x7f5b44104670 2023-12-11T20:25:43.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.504+0000 7f5b41ffb700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5b340a1480 0x7f5b340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:43.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.505+0000 7f5b41ffb700 1 -- 172.21.15.12:0/2799033208 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5b300ccb10 con 0x7f5b44104670 2023-12-11T20:25:43.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.505+0000 7f5b4899b700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5b340a1480 0x7f5b340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:43.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.505+0000 7f5b4899b700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5b340a1480 0x7f5b340a3940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5b38007c60 tx=0x7f5b380073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:43.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.511+0000 7f5b41ffb700 1 -- 172.21.15.12:0/2799033208 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5b300960c0 con 0x7f5b44104670 2023-12-11T20:25:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:43 smithi039 ceph-mon[102205]: pgmap v669: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:25:43.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:43 smithi032 ceph-mon[132488]: pgmap v669: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:25:43.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.839+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b4404f300 con 0x7f5b44104670 2023-12-11T20:25:43.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.840+0000 7f5b41ffb700 1 -- 172.21.15.12:0/2799033208 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f5b30016090 con 0x7f5b44104670 2023-12-11T20:25:43.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:25:43.839 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:25:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5b340a1480 msgr2=0x7f5b340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5b340a1480 0x7f5b340a3940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5b38007c60 tx=0x7f5b380073d0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44104670 msgr2=0x7f5b441999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44104670 0x7f5b441999a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000d950 tx=0x7f5b3000dc60 comp rx=0 tx=0).stop 2023-12-11T20:25:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 shutdown_connections 2023-12-11T20:25:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5b340a1480 0x7f5b340a3940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b44106fa0 0x7f5b441a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b44101d40 0x7f5b44199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 --2- 172.21.15.12:0/2799033208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b44104670 0x7f5b441999a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 >> 172.21.15.12:0/2799033208 conn(0x7f5b440fb730 msgr2=0x7f5b441014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 shutdown_connections 2023-12-11T20:25:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:43.843+0000 7f5b4999d700 1 -- 172.21.15.12:0/2799033208 wait complete. 2023-12-11T20:25:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:25:43.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:25:44.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 -- 172.21.15.12:0/2370514419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 msgr2=0x7f2ae0073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/2370514419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 0x7f2ae0073a60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009990 tx=0x7f2ad0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 -- 172.21.15.12:0/2370514419 shutdown_connections 2023-12-11T20:25:44.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/2370514419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ae010da20 0x7f2ae010fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/2370514419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 0x7f2ae0073a60 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/2370514419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ae0074030 0x7f2ae00744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 -- 172.21.15.12:0/2370514419 >> 172.21.15.12:0/2370514419 conn(0x7f2ae00fc980 msgr2=0x7f2ae00fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 -- 172.21.15.12:0/2370514419 shutdown_connections 2023-12-11T20:25:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.077+0000 7f2ae61ff700 1 -- 172.21.15.12:0/2370514419 wait complete. 2023-12-11T20:25:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.078+0000 7f2ae61ff700 1 Processor -- start 2023-12-11T20:25:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.078+0000 7f2ae61ff700 1 -- start start 2023-12-11T20:25:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.078+0000 7f2ae61ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ae0074030 0x7f2ae019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.078+0000 7f2ae61ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 0x7f2ae019dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.078+0000 7f2ae61ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ae010da20 0x7f2ae01a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.078+0000 7f2ae61ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01a53d0 con 0x7f2ae0075610 2023-12-11T20:25:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.078+0000 7f2ae61ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01a5510 con 0x7f2ae010da20 2023-12-11T20:25:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.078+0000 7f2ae61ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01a56a0 con 0x7f2ae0074030 2023-12-11T20:25:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 0x7f2ae019dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 0x7f2ae019dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38788/0 (socket says 172.21.15.12:38788) 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 -- 172.21.15.12:0/1131665315 learned_addr learned my addr 172.21.15.12:0/1131665315 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adffff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ae010da20 0x7f2ae01a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ae0074030 0x7f2ae019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 -- 172.21.15.12:0/1131665315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ae0074030 msgr2=0x7f2ae019d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ae0074030 0x7f2ae019d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 -- 172.21.15.12:0/1131665315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ae010da20 msgr2=0x7f2ae01a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ae010da20 0x7f2ae01a4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 -- 172.21.15.12:0/1131665315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00095f0 con 0x7f2ae0075610 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.079+0000 7f2adeffd700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 0x7f2ae019dde0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400d980 tx=0x7f2ad400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.080+0000 7f2adcff9700 1 -- 172.21.15.12:0/1131665315 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4004020 con 0x7f2ae0075610 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.080+0000 7f2adcff9700 1 -- 172.21.15.12:0/1131665315 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ad4009730 con 0x7f2ae0075610 2023-12-11T20:25:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.080+0000 7f2ae61ff700 1 -- 172.21.15.12:0/1131665315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae01a5980 con 0x7f2ae0075610 2023-12-11T20:25:44.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.080+0000 7f2adcff9700 1 -- 172.21.15.12:0/1131665315 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4003a00 con 0x7f2ae0075610 2023-12-11T20:25:44.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.080+0000 7f2ae61ff700 1 -- 172.21.15.12:0/1131665315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae01a5e90 con 0x7f2ae0075610 2023-12-11T20:25:44.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.083+0000 7f2adcff9700 1 -- 172.21.15.12:0/1131665315 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2ad40098a0 con 0x7f2ae0075610 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.085+0000 7f2af9a51b80 1 Processor -- start 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.085+0000 7f2adcff9700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2ac80a1480 0x7f2ac80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.085+0000 7f2af9a51b80 1 -- start start 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.085+0000 7f2adcff9700 1 -- 172.21.15.12:0/1131665315 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2ad40cca70 con 0x7f2ae0075610 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2adffff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2ac80a1480 0x7f2ac80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccda3d0 0x556a5ccda7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdad30 0x556a5ccdb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 0x556a5ccdc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cc35b50 con 0x556a5ccda3d0 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cc33470 con 0x556a5ccdad30 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cc2ed60 con 0x556a5ccdbc20 2023-12-11T20:25:44.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2adf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccda3d0 0x556a5ccda7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2adf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccda3d0 0x556a5ccda7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38798/0 (socket says 172.21.15.12:38798) 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2adf7fe700 1 -- 172.21.15.12:0/738256980 learned_addr learned my addr 172.21.15.12:0/738256980 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2adeffd700 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdad30 0x556a5ccdb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2adf7fe700 1 -- 172.21.15.12:0/738256980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 msgr2=0x556a5ccdc0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.086+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 0x556a5ccdc0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2adf7fe700 1 -- 172.21.15.12:0/738256980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdad30 msgr2=0x556a5ccdb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdad30 0x556a5ccdb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2adf7fe700 1 -- 172.21.15.12:0/738256980 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a5caab630 con 0x556a5ccda3d0 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2adeffd700 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdad30 0x556a5ccdb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2adffff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2ac80a1480 0x7f2ac80a3940 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800f400 tx=0x7f2ad8007950 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccda3d0 0x556a5ccda7f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0015000 tx=0x7f2ad0005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589030cae2a75d1f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2ac5ffb700 1 -- 172.21.15.12:0/738256980 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000ba50 con 0x556a5ccda3d0 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2ac5ffb700 1 -- 172.21.15.12:0/738256980 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ad001e040 con 0x556a5ccda3d0 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.087+0000 7f2ac5ffb700 1 -- 172.21.15.12:0/738256980 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0004900 con 0x556a5ccda3d0 2023-12-11T20:25:44.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 -- 172.21.15.12:0/738256980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccda3d0 msgr2=0x556a5ccda7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccda3d0 0x556a5ccda7f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0015000 tx=0x7f2ad0005c00 comp rx=0 tx=0).stop 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 -- 172.21.15.12:0/738256980 shutdown_connections 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 0x556a5ccdc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccda3d0 0x556a5ccda7f0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/738256980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdad30 0x556a5ccdb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 -- 172.21.15.12:0/738256980 >> 172.21.15.12:0/738256980 conn(0x556a5cc097e0 msgr2=0x556a5ccd6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 -- 172.21.15.12:0/738256980 shutdown_connections 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.088+0000 7f2af9a51b80 1 -- 172.21.15.12:0/738256980 wait complete. 2023-12-11T20:25:44.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.089+0000 7f2af9a51b80 1 -- start start 2023-12-11T20:25:44.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.089+0000 7f2af9a51b80 1 Processor -- start 2023-12-11T20:25:44.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccda3d0 0x556a5cce4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 0x556a5cceb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cbe8560 con 0x556a5ccdad30 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cbe8200 con 0x556a5ccda3d0 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5caad920 con 0x556a5ccdbc20 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2af9a51b80 10 client.0 _ll_register_callbacks cb 0x556a5cb13a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2adf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccda3d0 0x556a5cce4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2adeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2adf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccda3d0 0x556a5cce4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50434/0 (socket says 172.21.15.12:50434) 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2adf7fe700 1 -- 172.21.15.12:0/2581455367 learned_addr learned my addr 172.21.15.12:0/2581455367 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.090+0000 7f2adffff700 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 0x556a5cceb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2adf7fe700 1 -- 172.21.15.12:0/2581455367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 msgr2=0x556a5cceb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 0x556a5cceb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2adf7fe700 1 -- 172.21.15.12:0/2581455367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 msgr2=0x556a5cce46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2adf7fe700 1 -- 172.21.15.12:0/2581455367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae01a5e90 con 0x556a5ccda3d0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2adeffd700 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccda3d0 0x556a5cce4180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00098e0 tx=0x7f2ad000ba80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e66faf67c310f97 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2abeffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.091+0000 7f2abeffd700 1 -- 172.21.15.12:0/2581455367 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0004680 con 0x556a5ccda3d0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.092+0000 7f2af9a51b80 1 -- 172.21.15.12:0/2581455367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a5cccdb40 con 0x556a5ccda3d0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.092+0000 7f2abeffd700 1 -- 172.21.15.12:0/2581455367 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2ad00047e0 con 0x556a5ccda3d0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.092+0000 7f2abeffd700 1 -- 172.21.15.12:0/2581455367 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ad00049a0 con 0x556a5ccda3d0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.092+0000 7f2af9a51b80 10 client.27887 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.092+0000 7f2af9a51b80 1 -- 172.21.15.12:0/2581455367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f2ae01107c0 con 0x556a5ccda3d0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.092+0000 7f2abeffd700 1 -- 172.21.15.12:0/2581455367 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556a5cccdb40 con 0x556a5ccda3d0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.092+0000 7f2abeffd700 1 -- 172.21.15.12:0/2581455367 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2ad0003d60 con 0x556a5ccda3d0 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.093+0000 7f2af9a51b80 10 client.27887 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.093+0000 7f2af9a51b80 10 client.27887 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.093+0000 7f2af9a51b80 20 client.27887 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.093+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556a5ccefab0 0x556a5ccf1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.093+0000 7f2af9a51b80 4 client.27887 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.093+0000 7f2af9a51b80 1 -- 172.21.15.12:0/2581455367 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a5cca9f40 con 0x556a5ccefab0 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.093+0000 7f2adeffd700 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556a5ccefab0 0x556a5ccf1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.094+0000 7f2adeffd700 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556a5ccefab0 0x556a5ccf1ed0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47e322d6027ce44 server_cookie=a6babcbec092c2c7 in_seq=0 out_seq=0 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.094+0000 7f2abeffd700 10 client.27887 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2abeffd700 1 -- 172.21.15.12:0/2581455367 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556a5cca9f40 con 0x556a5ccefab0 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2abeffd700 10 client.27887 handle_command_reply: tid=0 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 client.27887 shutdown 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 -- 172.21.15.12:0/2581455367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccda3d0 msgr2=0x556a5cce4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccda3d0 0x556a5cce4180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00098e0 tx=0x7f2ad000ba80 comp rx=0 tx=0).stop 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 -- 172.21.15.12:0/2581455367 shutdown_connections 2023-12-11T20:25:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556a5ccefab0 0x556a5ccf1ed0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccda3d0 0x556a5cce4180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccdbc20 0x556a5cceb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/2581455367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2abeffd700 0 client.27887 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:25:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 -- 172.21.15.12:0/2581455367 >> 172.21.15.12:0/2581455367 conn(0x556a5cc097e0 msgr2=0x556a5ccd5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 -- 172.21.15.12:0/2581455367 shutdown_connections 2023-12-11T20:25:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 1 -- 172.21.15.12:0/2581455367 wait complete. 2023-12-11T20:25:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.095+0000 7f2af9a51b80 20 client.27887 trim_cache size 0 max 16384 2023-12-11T20:25:44.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2af9a51b80 1 Processor -- start 2023-12-11T20:25:44.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2af9a51b80 1 -- start start 2023-12-11T20:25:44.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5ccdc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cceb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5cce3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5ccec880 con 0x556a5ccdad30 2023-12-11T20:25:44.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cce5370 con 0x556a5ccdbc20 2023-12-11T20:25:44.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5ccf70a0 con 0x556a5ccda3d0 2023-12-11T20:25:44.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2adeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cceb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.113+0000 7f2adeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cceb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38816/0 (socket says 172.21.15.12:38816) 2023-12-11T20:25:44.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adeffd700 1 -- 172.21.15.12:0/3543426983 learned_addr learned my addr 172.21.15.12:0/3543426983 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5ccdc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adffff700 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5cce3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adeffd700 1 -- 172.21.15.12:0/3543426983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 msgr2=0x556a5ccdc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adeffd700 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5ccdc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adeffd700 1 -- 172.21.15.12:0/3543426983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 msgr2=0x556a5cce3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adeffd700 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5cce3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adeffd700 1 -- 172.21.15.12:0/3543426983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a5ca57de0 con 0x556a5ccdad30 2023-12-11T20:25:44.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.114+0000 7f2adeffd700 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cceb6c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4099c70 tx=0x7f2ad4009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15ecb17275732f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.115+0000 7f2ac67fc700 1 -- 172.21.15.12:0/3543426983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad409de30 con 0x556a5ccdad30 2023-12-11T20:25:44.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.115+0000 7f2ac67fc700 1 -- 172.21.15.12:0/3543426983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ad40b1070 con 0x556a5ccdad30 2023-12-11T20:25:44.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.115+0000 7f2ac67fc700 1 -- 172.21.15.12:0/3543426983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad409a1a0 con 0x556a5ccdad30 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.115+0000 7f2af9a51b80 1 -- 172.21.15.12:0/3543426983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 msgr2=0x556a5cceb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.115+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cceb6c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4099c70 tx=0x7f2ad4009e80 comp rx=0 tx=0).stop 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.116+0000 7f2af9a51b80 1 -- 172.21.15.12:0/3543426983 shutdown_connections 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.116+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5cce3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.116+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5ccdc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.116+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/3543426983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cceb6c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.116+0000 7f2af9a51b80 1 -- 172.21.15.12:0/3543426983 >> 172.21.15.12:0/3543426983 conn(0x556a5cc097e0 msgr2=0x556a5cce21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.116+0000 7f2af9a51b80 1 -- 172.21.15.12:0/3543426983 shutdown_connections 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.116+0000 7f2af9a51b80 1 -- 172.21.15.12:0/3543426983 wait complete. 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.116+0000 7f2af9a51b80 1 -- start start 2023-12-11T20:25:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.117+0000 7f2af9a51b80 1 Processor -- start 2023-12-11T20:25:44.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.117+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5cce9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.117+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.117+0000 7f2af9a51b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5ccea910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.117+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cceae50 con 0x556a5ccdad30 2023-12-11T20:25:44.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.117+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cceafc0 con 0x556a5ccdbc20 2023-12-11T20:25:44.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.117+0000 7f2af9a51b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a5cceb180 con 0x556a5ccda3d0 2023-12-11T20:25:44.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2af9a51b80 10 client.0 _ll_register_callbacks cb 0x556a5cb13a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5ccea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5ccea910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50452/0 (socket says 172.21.15.12:50452) 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adffff700 1 -- 172.21.15.12:0/160211668 learned_addr learned my addr 172.21.15.12:0/160211668 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5cce9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adeffd700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adf7fe700 1 -- 172.21.15.12:0/160211668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 msgr2=0x556a5ccea910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5ccea910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adf7fe700 1 -- 172.21.15.12:0/160211668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 msgr2=0x556a5cce9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adf7fe700 1 -- 172.21.15.12:0/160211668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae01a5980 con 0x556a5ccda3d0 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adeffd700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.118+0000 7f2adffff700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5ccea910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.119+0000 7f2adf7fe700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5cce9410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0005830 tx=0x7f2ad0003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6422fafa588c2939 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.119+0000 7f2abeffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:25:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.119+0000 7f2abeffd700 1 -- 172.21.15.12:0/160211668 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0009ee0 con 0x556a5ccda3d0 2023-12-11T20:25:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.119+0000 7f2af9a51b80 1 -- 172.21.15.12:0/160211668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ad001e040 con 0x556a5ccda3d0 2023-12-11T20:25:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.119+0000 7f2abeffd700 1 -- 172.21.15.12:0/160211668 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2ad0000e40 con 0x556a5ccda3d0 2023-12-11T20:25:44.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2abeffd700 1 -- 172.21.15.12:0/160211668 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ad000bba0 con 0x556a5ccda3d0 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2af9a51b80 10 client.27889 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2af9a51b80 1 -- 172.21.15.12:0/160211668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556a5ca40c60 con 0x556a5ccda3d0 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2abeffd700 1 -- 172.21.15.12:0/160211668 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ad001e040 con 0x556a5ccda3d0 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2abeffd700 1 -- 172.21.15.12:0/160211668 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2ad0004500 con 0x556a5ccda3d0 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2af9a51b80 10 client.27889 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2af9a51b80 10 client.27889 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2af9a51b80 20 client.27889 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556a5cd46940 0x556a5cd48d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2af9a51b80 4 client.27889 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.120+0000 7f2af9a51b80 1 -- 172.21.15.12:0/160211668 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556a5cbf4fd0 con 0x556a5cd46940 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.121+0000 7f2adeffd700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556a5cd46940 0x556a5cd48d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.121+0000 7f2adeffd700 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556a5cd46940 0x556a5cd48d60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=457b4f58af4086f3 server_cookie=68217c8dbc6c1c75 in_seq=0 out_seq=0 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.121+0000 7f2abeffd700 10 client.27889 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2abeffd700 1 -- 172.21.15.12:0/160211668 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556a5cbf4fd0 con 0x556a5cd46940 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2abeffd700 10 client.27889 handle_command_reply: tid=0 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 client.27889 shutdown 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 -- 172.21.15.12:0/160211668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 msgr2=0x556a5cce9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5cce9410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0005830 tx=0x7f2ad0003a50 comp rx=0 tx=0).stop 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 -- 172.21.15.12:0/160211668 shutdown_connections 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556a5cd46940 0x556a5cd48d60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556a5ccdbc20 0x556a5ccea910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a5ccda3d0 0x556a5cce9410 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 --2- 172.21.15.12:0/160211668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a5ccdad30 0x556a5cce9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2abeffd700 0 client.27889 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 -- 172.21.15.12:0/160211668 >> 172.21.15.12:0/160211668 conn(0x556a5cc097e0 msgr2=0x556a5cce1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 -- 172.21.15.12:0/160211668 shutdown_connections 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 1 -- 172.21.15.12:0/160211668 wait complete. 2023-12-11T20:25:44.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.122+0000 7f2af9a51b80 20 client.27889 trim_cache size 0 max 16384 2023-12-11T20:25:44.124 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 -- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2ac80a1480 msgr2=0x7f2ac80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2ac80a1480 0x7f2ac80a3940 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800f400 tx=0x7f2ad8007950 comp rx=0 tx=0).stop 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 -- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 msgr2=0x7f2ae019dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 0x7f2ae019dde0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400d980 tx=0x7f2ad400dc90 comp rx=0 tx=0).stop 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 -- 172.21.15.12:0/1131665315 shutdown_connections 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2ac80a1480 0x7f2ac80a3940 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ae010da20 0x7f2ae01a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ae0074030 0x7f2ae019d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 --2- 172.21.15.12:0/1131665315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae0075610 0x7f2ae019dde0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 -- 172.21.15.12:0/1131665315 >> 172.21.15.12:0/1131665315 conn(0x7f2ae00fc980 msgr2=0x7f2ae0100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 -- 172.21.15.12:0/1131665315 shutdown_connections 2023-12-11T20:25:44.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.123+0000 7f2ae61ff700 1 -- 172.21.15.12:0/1131665315 wait complete. 2023-12-11T20:25:44.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:25:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 -- 172.21.15.12:0/1569782350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f8103040 msgr2=0x7f09f81098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 --2- 172.21.15.12:0/1569782350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f8103040 0x7f09f81098f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f09f000b0d0 tx=0x7f09f000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 -- 172.21.15.12:0/1569782350 shutdown_connections 2023-12-11T20:25:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 --2- 172.21.15.12:0/1569782350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09f81014b0 0x7f09f81018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 --2- 172.21.15.12:0/1569782350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f8103040 0x7f09f81098f0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 --2- 172.21.15.12:0/1569782350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09f81026a0 0x7f09f8102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 -- 172.21.15.12:0/1569782350 >> 172.21.15.12:0/1569782350 conn(0x7f09f80fca00 msgr2=0x7f09f80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 -- 172.21.15.12:0/1569782350 shutdown_connections 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.378+0000 7f09ffdff700 1 -- 172.21.15.12:0/1569782350 wait complete. 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.379+0000 7f09ffdff700 1 Processor -- start 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.379+0000 7f09ffdff700 1 -- start start 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09ffdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f81014b0 0x7f09f8197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09ffdff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09f81026a0 0x7f09f8197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09ffdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09f8103040 0x7f09f819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09ffdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f819ef60 con 0x7f09f81014b0 2023-12-11T20:25:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09ffdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f819f0a0 con 0x7f09f8103040 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09ffdff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f819f230 con 0x7f09f81026a0 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fdb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f81014b0 0x7f09f8197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fdb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f81014b0 0x7f09f8197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38844/0 (socket says 172.21.15.12:38844) 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fdb9b700 1 -- 172.21.15.12:0/29520580 learned_addr learned my addr 172.21.15.12:0/29520580 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fd39a700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09f81026a0 0x7f09f8197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fe39c700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09f8103040 0x7f09f819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fdb9b700 1 -- 172.21.15.12:0/29520580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09f81026a0 msgr2=0x7f09f8197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09f81026a0 0x7f09f8197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fdb9b700 1 -- 172.21.15.12:0/29520580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09f8103040 msgr2=0x7f09f819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09f8103040 0x7f09f819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.380+0000 7f09fdb9b700 1 -- 172.21.15.12:0/29520580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0009d00 con 0x7f09f81014b0 2023-12-11T20:25:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.381+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f81014b0 0x7f09f8197430 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f09f400e970 tx=0x7f09f400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.381+0000 7f09eeffd700 1 -- 172.21.15.12:0/29520580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4009790 con 0x7f09f81014b0 2023-12-11T20:25:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.381+0000 7f09eeffd700 1 -- 172.21.15.12:0/29520580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f09f400eec0 con 0x7f09f81014b0 2023-12-11T20:25:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.381+0000 7f09eeffd700 1 -- 172.21.15.12:0/29520580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4003c10 con 0x7f09f81014b0 2023-12-11T20:25:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.381+0000 7f09ffdff700 1 -- 172.21.15.12:0/29520580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f819f510 con 0x7f09f81014b0 2023-12-11T20:25:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.381+0000 7f09ffdff700 1 -- 172.21.15.12:0/29520580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f819f9d0 con 0x7f09f81014b0 2023-12-11T20:25:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.385+0000 7f09eeffd700 1 -- 172.21.15.12:0/29520580 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f09f4003db0 con 0x7f09f81014b0 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.386+0000 7f09eeffd700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f09e40a1500 0x7f09e40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.386+0000 7f09eeffd700 1 -- 172.21.15.12:0/29520580 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f09f4014070 con 0x7f09f81014b0 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.386+0000 7f09fd39a700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f09e40a1500 0x7f09e40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f0a1367cb80 1 Processor -- start 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f0a1367cb80 1 -- start start 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 0x55ccb926c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb927a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb91c7b50 con 0x55ccb927aaf0 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb91c5470 con 0x55ccb926c220 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb91c0d60 con 0x55ccb926cb80 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.387+0000 7f09fd39a700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f09e40a1500 0x7f09e40a39c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009c60 tx=0x7f09e8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38848/0 (socket says 172.21.15.12:38848) 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 -- 172.21.15.12:0/2908783007 learned_addr learned my addr 172.21.15.12:0/2908783007 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 0x55ccb926c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fd39a700 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb927a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 -- 172.21.15.12:0/2908783007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 msgr2=0x55ccb927a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb927a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 -- 172.21.15.12:0/2908783007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 msgr2=0x55ccb926c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 0x55ccb926c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 -- 172.21.15.12:0/2908783007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccb903d630 con 0x55ccb927aaf0 2023-12-11T20:25:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.388+0000 7f09fe39c700 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f09f0015000 tx=0x7f09f0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3c6fc460ab4289 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.389+0000 7f09e3fff700 1 -- 172.21.15.12:0/2908783007 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000e070 con 0x55ccb927aaf0 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.389+0000 7f09e3fff700 1 -- 172.21.15.12:0/2908783007 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f09f0007b90 con 0x55ccb927aaf0 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.389+0000 7f09e3fff700 1 -- 172.21.15.12:0/2908783007 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0004e70 con 0x55ccb927aaf0 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.389+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2908783007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 msgr2=0x55ccb927cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.389+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f09f0015000 tx=0x7f09f0009c50 comp rx=0 tx=0).stop 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.389+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2908783007 shutdown_connections 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.389+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 0x55ccb926c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.390+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.390+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2908783007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb927a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.390+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2908783007 >> 172.21.15.12:0/2908783007 conn(0x55ccb919b7e0 msgr2=0x55ccb9268d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.390+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2908783007 shutdown_connections 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.390+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2908783007 wait complete. 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.390+0000 7f0a1367cb80 1 -- start start 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.390+0000 7f0a1367cb80 1 Processor -- start 2023-12-11T20:25:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 0x55ccb927e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb927eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb9285ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb917a560 con 0x55ccb927aaf0 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb917a200 con 0x55ccb926c220 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb903f920 con 0x55ccb926cb80 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f0a1367cb80 10 client.0 _ll_register_callbacks cb 0x55ccb90a5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f09fe39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb9285ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f09fe39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb9285ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38858/0 (socket says 172.21.15.12:38858) 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.391+0000 7f09fe39c700 1 -- 172.21.15.12:0/4102628650 learned_addr learned my addr 172.21.15.12:0/4102628650 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09fd39a700 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb927eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 0x55ccb927e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09fe39c700 1 -- 172.21.15.12:0/4102628650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 msgr2=0x55ccb927eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09fe39c700 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb927eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09fe39c700 1 -- 172.21.15.12:0/4102628650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 msgr2=0x55ccb927e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09fe39c700 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 0x55ccb927e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09fe39c700 1 -- 172.21.15.12:0/4102628650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f810a240 con 0x55ccb927aaf0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09fe39c700 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb9285ee0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009a20 tx=0x7f09f00060c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77792b3b8a54d6a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.392+0000 7f09e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f09e17fa700 1 -- 172.21.15.12:0/4102628650 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000e040 con 0x55ccb927aaf0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4102628650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ccb925fb40 con 0x55ccb927aaf0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f09e17fa700 1 -- 172.21.15.12:0/4102628650 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f09f00075a0 con 0x55ccb927aaf0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f09e17fa700 1 -- 172.21.15.12:0/4102628650 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09f0024450 con 0x55ccb927aaf0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f0a1367cb80 10 client.18285 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4102628650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ccb8fe9de0 con 0x55ccb927aaf0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f09e17fa700 1 -- 172.21.15.12:0/4102628650 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ccb925fb40 con 0x55ccb927aaf0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f09e17fa700 1 -- 172.21.15.12:0/4102628650 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09f000b100 con 0x55ccb927aaf0 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f0a1367cb80 10 client.18285 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.393+0000 7f0a1367cb80 10 client.18285 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:25:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.394+0000 7f0a1367cb80 20 client.18285 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:44.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.394+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ccb928a3a0 0x55ccb928c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.394+0000 7f0a1367cb80 4 client.18285 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:44.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.394+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4102628650 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ccb923bf40 con 0x55ccb928a3a0 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.394+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ccb928a3a0 0x55ccb928c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.395+0000 7f09e17fa700 10 client.18285 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.395+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ccb928a3a0 0x55ccb928c7c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=38ffd4126379829d server_cookie=cedc484704ac9e33 in_seq=0 out_seq=0 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.395+0000 7f09e17fa700 1 -- 172.21.15.12:0/4102628650 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ccb923bf40 con 0x55ccb928a3a0 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.395+0000 7f09e17fa700 10 client.18285 handle_command_reply: tid=0 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.395+0000 7f0a1367cb80 1 client.18285 shutdown 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4102628650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 msgr2=0x55ccb9285ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb9285ee0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009a20 tx=0x7f09f00060c0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4102628650 shutdown_connections 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ccb928a3a0 0x55ccb928c7c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926c220 0x55ccb927e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb927aaf0 0x55ccb9285ee0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4102628650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb927eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f09e17fa700 0 client.18285 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4102628650 >> 172.21.15.12:0/4102628650 conn(0x55ccb919b7e0 msgr2=0x55ccb9267a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4102628650 shutdown_connections 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4102628650 wait complete. 2023-12-11T20:25:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.396+0000 7f0a1367cb80 20 client.18285 trim_cache size 0 max 16384 2023-12-11T20:25:44.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.413+0000 7f0a1367cb80 1 Processor -- start 2023-12-11T20:25:44.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.413+0000 7f0a1367cb80 1 -- start start 2023-12-11T20:25:44.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.413+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9276590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb9285ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb927e4d0 con 0x55ccb926c220 2023-12-11T20:25:44.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb927d420 con 0x55ccb927aaf0 2023-12-11T20:25:44.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb926d1f0 con 0x55ccb926cb80 2023-12-11T20:25:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f09fdb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9276590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f09fdb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9276590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38866/0 (socket says 172.21.15.12:38866) 2023-12-11T20:25:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f09fdb9b700 1 -- 172.21.15.12:0/4047967224 learned_addr learned my addr 172.21.15.12:0/4047967224 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.414+0000 7f09fd39a700 1 --2- 172.21.15.12:0/4047967224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb9285ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09fdb9b700 1 -- 172.21.15.12:0/4047967224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 msgr2=0x55ccb9285ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/4047967224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb9285ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09fdb9b700 1 -- 172.21.15.12:0/4047967224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb927aaf0 msgr2=0x55ccb927cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/4047967224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09fdb9b700 1 -- 172.21.15.12:0/4047967224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccb8fd2c60 con 0x55ccb926c220 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/4047967224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9276590 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f09f4096c90 tx=0x7f09f4096560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56c7b75748b97c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09ecbff700 1 -- 172.21.15.12:0/4047967224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f407a030 con 0x55ccb926c220 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09ecbff700 1 -- 172.21.15.12:0/4047967224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f09f409a220 con 0x55ccb926c220 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.415+0000 7f09ecbff700 1 -- 172.21.15.12:0/4047967224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f407ea90 con 0x55ccb926c220 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4047967224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 msgr2=0x55ccb9276590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4047967224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9276590 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f09f4096c90 tx=0x7f09f4096560 comp rx=0 tx=0).stop 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4047967224 shutdown_connections 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4047967224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb927aaf0 0x55ccb927cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4047967224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9276590 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/4047967224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb926cb80 0x55ccb9285ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4047967224 >> 172.21.15.12:0/4047967224 conn(0x55ccb919b7e0 msgr2=0x55ccb9268970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4047967224 shutdown_connections 2023-12-11T20:25:44.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.416+0000 7f0a1367cb80 1 -- 172.21.15.12:0/4047967224 wait complete. 2023-12-11T20:25:44.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.417+0000 7f0a1367cb80 1 -- start start 2023-12-11T20:25:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.417+0000 7f0a1367cb80 1 Processor -- start 2023-12-11T20:25:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9283910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926cb80 0x55ccb9283e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f0a1367cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb927aaf0 0x55ccb9284e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb9285350 con 0x55ccb926c220 2023-12-11T20:25:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb92854c0 con 0x55ccb926cb80 2023-12-11T20:25:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f0a1367cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb9285680 con 0x55ccb927aaf0 2023-12-11T20:25:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f0a1367cb80 10 client.0 _ll_register_callbacks cb 0x55ccb90a5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f09fdb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9283910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f09fe39c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb927aaf0 0x55ccb9284e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f09fdb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9283910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38872/0 (socket says 172.21.15.12:38872) 2023-12-11T20:25:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f09fdb9b700 1 -- 172.21.15.12:0/2702905111 learned_addr learned my addr 172.21.15.12:0/2702905111 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.418+0000 7f09fd39a700 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926cb80 0x55ccb9283e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09fe39c700 1 -- 172.21.15.12:0/2702905111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926cb80 msgr2=0x55ccb9283e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09fe39c700 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926cb80 0x55ccb9283e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09fe39c700 1 -- 172.21.15.12:0/2702905111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 msgr2=0x55ccb9283910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09fe39c700 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9283910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09fe39c700 1 -- 172.21.15.12:0/2702905111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f819f9d0 con 0x55ccb927aaf0 2023-12-11T20:25:44.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9283910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09fe39c700 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb927aaf0 0x55ccb9284e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009610 tx=0x7f09f000bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47f0ab60f3457d6e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:25:44.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.419+0000 7f09e17fa700 1 -- 172.21.15.12:0/2702905111 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000e070 con 0x55ccb927aaf0 2023-12-11T20:25:44.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.420+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2702905111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09f0007b90 con 0x55ccb927aaf0 2023-12-11T20:25:44.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.420+0000 7f09e17fa700 1 -- 172.21.15.12:0/2702905111 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f09f0006000 con 0x55ccb927aaf0 2023-12-11T20:25:44.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.420+0000 7f09e17fa700 1 -- 172.21.15.12:0/2702905111 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09f0009b80 con 0x55ccb927aaf0 2023-12-11T20:25:44.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.420+0000 7f0a1367cb80 10 client.27907 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:44.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.420+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2702905111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ccb9010250 con 0x55ccb927aaf0 2023-12-11T20:25:44.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.420+0000 7f09e17fa700 1 -- 172.21.15.12:0/2702905111 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f09f0007b90 con 0x55ccb927aaf0 2023-12-11T20:25:44.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.421+0000 7f09e17fa700 1 -- 172.21.15.12:0/2702905111 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09f0037460 con 0x55ccb927aaf0 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.421+0000 7f0a1367cb80 10 client.27907 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.421+0000 7f0a1367cb80 10 client.27907 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.421+0000 7f0a1367cb80 20 client.27907 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.421+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ccb92e1020 0x55ccb92e3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.421+0000 7f0a1367cb80 4 client.27907 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.421+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2702905111 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ccb9186fd0 con 0x55ccb92e1020 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.421+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ccb92e1020 0x55ccb92e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f09e17fa700 10 client.27907 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f09fdb9b700 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ccb92e1020 0x55ccb92e3440 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11d2cd4185f82d5e server_cookie=e3ee64e5608e1521 in_seq=0 out_seq=0 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f09e17fa700 1 -- 172.21.15.12:0/2702905111 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ccb9186fd0 con 0x55ccb92e1020 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f09e17fa700 10 client.27907 handle_command_reply: tid=0 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 client.27907 shutdown 2023-12-11T20:25:44.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2702905111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb927aaf0 msgr2=0x55ccb9284e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb927aaf0 0x55ccb9284e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009610 tx=0x7f09f000bef0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2702905111 shutdown_connections 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ccb92e1020 0x55ccb92e3440 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ccb927aaf0 0x55ccb9284e10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ccb926c220 0x55ccb9283910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f09e17fa700 0 client.27907 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 --2- 172.21.15.12:0/2702905111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ccb926cb80 0x55ccb9283e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2702905111 >> 172.21.15.12:0/2702905111 conn(0x55ccb919b7e0 msgr2=0x55ccb927a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.422+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2702905111 shutdown_connections 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.423+0000 7f0a1367cb80 1 -- 172.21.15.12:0/2702905111 wait complete. 2023-12-11T20:25:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.423+0000 7f0a1367cb80 20 client.27907 trim_cache size 0 max 16384 2023-12-11T20:25:44.428 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:25:44.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.423+0000 7f09ffdff700 1 -- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f09e40a1500 msgr2=0x7f09e40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.423+0000 7f09ffdff700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f09e40a1500 0x7f09e40a39c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009c60 tx=0x7f09e8009260 comp rx=0 tx=0).stop 2023-12-11T20:25:44.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.423+0000 7f09ffdff700 1 -- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f81014b0 msgr2=0x7f09f8197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.423+0000 7f09ffdff700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f81014b0 0x7f09f8197430 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f09f400e970 tx=0x7f09f400ec80 comp rx=0 tx=0).stop 2023-12-11T20:25:44.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.424+0000 7f09ffdff700 1 -- 172.21.15.12:0/29520580 shutdown_connections 2023-12-11T20:25:44.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.424+0000 7f09ffdff700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f09e40a1500 0x7f09e40a39c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.424+0000 7f09ffdff700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09f8103040 0x7f09f819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.424+0000 7f09ffdff700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09f81014b0 0x7f09f8197430 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.424+0000 7f09ffdff700 1 --2- 172.21.15.12:0/29520580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09f81026a0 0x7f09f8197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.424+0000 7f09ffdff700 1 -- 172.21.15.12:0/29520580 >> 172.21.15.12:0/29520580 conn(0x7f09f80fca00 msgr2=0x7f09f8105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.424+0000 7f09ffdff700 1 -- 172.21.15.12:0/29520580 shutdown_connections 2023-12-11T20:25:44.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.424+0000 7f09ffdff700 1 -- 172.21.15.12:0/29520580 wait complete. 2023-12-11T20:25:44.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:25:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 -- 172.21.15.12:0/179231798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27201048b0 msgr2=0x7f2720106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 --2- 172.21.15.12:0/179231798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27201048b0 0x7f2720106ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2710009990 tx=0x7f2710009ca0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 -- 172.21.15.12:0/179231798 shutdown_connections 2023-12-11T20:25:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 --2- 172.21.15.12:0/179231798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27201071e0 0x7f2720109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 --2- 172.21.15.12:0/179231798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2720101f80 0x7f2720104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 --2- 172.21.15.12:0/179231798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27201048b0 0x7f2720106ca0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 -- 172.21.15.12:0/179231798 >> 172.21.15.12:0/179231798 conn(0x7f27200fb930 msgr2=0x7f27200fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 -- 172.21.15.12:0/179231798 shutdown_connections 2023-12-11T20:25:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.674+0000 7f27273ff700 1 -- 172.21.15.12:0/179231798 wait complete. 2023-12-11T20:25:44.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.676+0000 7f27273ff700 1 Processor -- start 2023-12-11T20:25:44.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.676+0000 7f27273ff700 1 -- start start 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.676+0000 7f27273ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2720101f80 0x7f27201018a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.676+0000 7f27273ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27201048b0 0x7f27200fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.676+0000 7f27273ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27201071e0 0x7f2720100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.676+0000 7f27273ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720100c10 con 0x7f27201071e0 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.676+0000 7f27273ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720100d80 con 0x7f2720101f80 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.676+0000 7f27273ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27201a13d0 con 0x7f27201048b0 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272519b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2720101f80 0x7f27201018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272519b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2720101f80 0x7f27201018a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50536/0 (socket says 172.21.15.12:50536) 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272519b700 1 -- 172.21.15.12:0/1460874148 learned_addr learned my addr 172.21.15.12:0/1460874148 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272599c700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27201071e0 0x7f2720100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272499a700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27201048b0 0x7f27200fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272519b700 1 -- 172.21.15.12:0/1460874148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27201048b0 msgr2=0x7f27200fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272519b700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27201048b0 0x7f27200fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272519b700 1 -- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27201071e0 msgr2=0x7f2720100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272519b700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27201071e0 0x7f2720100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272519b700 1 -- 172.21.15.12:0/1460874148 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718009c40 con 0x7f2720101f80 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272499a700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27201048b0 0x7f27200fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.677+0000 7f272599c700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27201071e0 0x7f2720100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.678+0000 7f272519b700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2720101f80 0x7f27201018a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e9a0 tx=0x7f271c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.678+0000 7f27167fc700 1 -- 172.21.15.12:0/1460874148 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c009790 con 0x7f2720101f80 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.678+0000 7f27167fc700 1 -- 172.21.15.12:0/1460874148 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f271c010430 con 0x7f2720101f80 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.678+0000 7f27273ff700 1 -- 172.21.15.12:0/1460874148 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27100095f0 con 0x7f2720101f80 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.678+0000 7f27167fc700 1 -- 172.21.15.12:0/1460874148 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00eee0 con 0x7f2720101f80 2023-12-11T20:25:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.678+0000 7f27273ff700 1 -- 172.21.15.12:0/1460874148 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27201a1a30 con 0x7f2720101f80 2023-12-11T20:25:44.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.681+0000 7f27167fc700 1 -- 172.21.15.12:0/1460874148 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f271c0105a0 con 0x7f2720101f80 2023-12-11T20:25:44.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f273ac8db80 1 Processor -- start 2023-12-11T20:25:44.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f273ac8db80 1 -- start start 2023-12-11T20:25:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f27167fc700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f270c0a1500 0x7f270c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af7823d0 0x5591af7827f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af782d30 0x5591af783640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af7840a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f273ac8db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af6ddb50 con 0x5591af7823d0 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f273ac8db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af6db470 con 0x5591af782d30 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f273ac8db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af6d6d60 con 0x5591af783c20 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f27167fc700 1 -- 172.21.15.12:0/1460874148 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f271c014070 con 0x7f2720101f80 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.683+0000 7f272599c700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f270c0a1500 0x7f270c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272599c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af7840a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272519b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af7823d0 0x5591af7827f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272599c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af7840a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:58128/0 (socket says 172.21.15.12:58128) 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272599c700 1 -- 172.21.15.12:0/2322839931 learned_addr learned my addr 172.21.15.12:0/2322839931 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272499a700 1 --2- 172.21.15.12:0/2322839931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af782d30 0x5591af783640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272519b700 1 -- 172.21.15.12:0/2322839931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 msgr2=0x5591af7840a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272519b700 1 --2- 172.21.15.12:0/2322839931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af7840a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272519b700 1 -- 172.21.15.12:0/2322839931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af782d30 msgr2=0x5591af783640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272519b700 1 --2- 172.21.15.12:0/2322839931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af782d30 0x5591af783640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272519b700 1 -- 172.21.15.12:0/2322839931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591af553630 con 0x5591af7823d0 2023-12-11T20:25:44.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.684+0000 7f272519b700 1 --2- 172.21.15.12:0/2322839931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af7823d0 0x5591af7827f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c5b0 tx=0x7f271c099e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5386952b033d7bb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.685+0000 7f272599c700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f270c0a1500 0x7f270c0a39c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2718007e80 tx=0x7f2718007500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.685+0000 7f270b7fe700 1 -- 172.21.15.12:0/2322839931 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c09e120 con 0x5591af7823d0 2023-12-11T20:25:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.685+0000 7f270b7fe700 1 -- 172.21.15.12:0/2322839931 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f271c09a890 con 0x5591af7823d0 2023-12-11T20:25:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.685+0000 7f270b7fe700 1 -- 172.21.15.12:0/2322839931 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0998e0 con 0x5591af7823d0 2023-12-11T20:25:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.685+0000 7f273ac8db80 1 -- 172.21.15.12:0/2322839931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af7823d0 msgr2=0x5591af7827f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.685+0000 7f273ac8db80 1 --2- 172.21.15.12:0/2322839931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af7823d0 0x5591af7827f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c5b0 tx=0x7f271c099e00 comp rx=0 tx=0).stop 2023-12-11T20:25:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.686+0000 7f273ac8db80 1 -- 172.21.15.12:0/2322839931 shutdown_connections 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.686+0000 7f273ac8db80 1 --2- 172.21.15.12:0/2322839931 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af7840a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.686+0000 7f273ac8db80 1 --2- 172.21.15.12:0/2322839931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af7823d0 0x5591af7827f0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.686+0000 7f273ac8db80 1 --2- 172.21.15.12:0/2322839931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af782d30 0x5591af783640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.686+0000 7f273ac8db80 1 -- 172.21.15.12:0/2322839931 >> 172.21.15.12:0/2322839931 conn(0x5591af6b17e0 msgr2=0x5591af77ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.686+0000 7f273ac8db80 1 -- 172.21.15.12:0/2322839931 shutdown_connections 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.686+0000 7f273ac8db80 1 -- 172.21.15.12:0/2322839931 wait complete. 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.686+0000 7f273ac8db80 1 -- start start 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f273ac8db80 1 Processor -- start 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af7823d0 0x5591af78c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af783c20 0x5591af793720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f273ac8db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af690560 con 0x5591af782d30 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f273ac8db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af690200 con 0x5591af783c20 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f273ac8db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af555920 con 0x5591af7823d0 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f273ac8db80 10 client.0 _ll_register_callbacks cb 0x5591af5bba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f272499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f272519b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af7823d0 0x5591af78c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f272499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38902/0 (socket says 172.21.15.12:38902) 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f272519b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af7823d0 0x5591af78c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:58138/0 (socket says 172.21.15.12:58138) 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.687+0000 7f272499a700 1 -- 172.21.15.12:0/293483529 learned_addr learned my addr 172.21.15.12:0/293483529 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f272599c700 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af783c20 0x5591af793720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f272519b700 1 -- 172.21.15.12:0/293483529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af783c20 msgr2=0x5591af793720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f272519b700 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af783c20 0x5591af793720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f272519b700 1 -- 172.21.15.12:0/293483529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 msgr2=0x5591af78c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f272519b700 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f272519b700 1 -- 172.21.15.12:0/293483529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27201a1a30 con 0x5591af7823d0 2023-12-11T20:25:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f272499a700 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f272519b700 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af7823d0 0x5591af78c1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5591af78a930 tx=0x7f271c010ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5984c6d9d2246b70 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.688+0000 7f2708ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:25:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.689+0000 7f2708ff9700 1 -- 172.21.15.12:0/293483529 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c09a190 con 0x5591af7823d0 2023-12-11T20:25:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.689+0000 7f2708ff9700 1 -- 172.21.15.12:0/293483529 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f271c09e2e0 con 0x5591af7823d0 2023-12-11T20:25:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.689+0000 7f273ac8db80 1 -- 172.21.15.12:0/293483529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591af775b40 con 0x5591af7823d0 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.689+0000 7f2708ff9700 1 -- 172.21.15.12:0/293483529 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f271c07c020 con 0x5591af7823d0 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.689+0000 7f273ac8db80 10 client.27919 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.689+0000 7f273ac8db80 1 -- 172.21.15.12:0/293483529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5591af4ffde0 con 0x5591af7823d0 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.689+0000 7f2708ff9700 1 -- 172.21.15.12:0/293483529 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591af775b40 con 0x5591af7823d0 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.690+0000 7f2708ff9700 1 -- 172.21.15.12:0/293483529 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f271c0990f0 con 0x5591af7823d0 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.690+0000 7f273ac8db80 10 client.27919 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.690+0000 7f273ac8db80 10 client.27919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.690+0000 7f273ac8db80 20 client.27919 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.690+0000 7f273ac8db80 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591af797c70 0x5591af79a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.690+0000 7f273ac8db80 4 client.27919 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.690+0000 7f273ac8db80 1 -- 172.21.15.12:0/293483529 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591af751f40 con 0x5591af797c70 2023-12-11T20:25:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.690+0000 7f272499a700 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591af797c70 0x5591af79a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.691+0000 7f272499a700 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591af797c70 0x5591af79a090 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1facf3d4a8c4dcb7 server_cookie=92b81e3ea0b82f7 in_seq=0 out_seq=0 2023-12-11T20:25:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.691+0000 7f2708ff9700 10 client.27919 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f2708ff9700 1 -- 172.21.15.12:0/293483529 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5591af751f40 con 0x5591af797c70 2023-12-11T20:25:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f2708ff9700 10 client.27919 handle_command_reply: tid=0 2023-12-11T20:25:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 client.27919 shutdown 2023-12-11T20:25:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 -- 172.21.15.12:0/293483529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af7823d0 msgr2=0x5591af78c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af7823d0 0x5591af78c1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5591af78a930 tx=0x7f271c010ae0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 -- 172.21.15.12:0/293483529 shutdown_connections 2023-12-11T20:25:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591af797c70 0x5591af79a090 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af783c20 0x5591af793720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af7823d0 0x5591af78c1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f2708ff9700 0 client.27919 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 --2- 172.21.15.12:0/293483529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 -- 172.21.15.12:0/293483529 >> 172.21.15.12:0/293483529 conn(0x5591af6b17e0 msgr2=0x5591af77da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 -- 172.21.15.12:0/293483529 shutdown_connections 2023-12-11T20:25:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.692+0000 7f273ac8db80 1 -- 172.21.15.12:0/293483529 wait complete. 2023-12-11T20:25:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.693+0000 7f273ac8db80 20 client.27919 trim_cache size 0 max 16384 2023-12-11T20:25:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.709+0000 7f273ac8db80 1 Processor -- start 2023-12-11T20:25:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.709+0000 7f273ac8db80 1 -- start start 2023-12-11T20:25:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.709+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af793dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.709+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af7936e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af784000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f273ac8db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af78bd10 con 0x5591af782d30 2023-12-11T20:25:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f273ac8db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af79f2a0 con 0x5591af7823d0 2023-12-11T20:25:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f273ac8db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af797870 con 0x5591af783c20 2023-12-11T20:25:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af7936e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af7936e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38914/0 (socket says 172.21.15.12:38914) 2023-12-11T20:25:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272519b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af793dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272499a700 1 -- 172.21.15.12:0/2099744527 learned_addr learned my addr 172.21.15.12:0/2099744527 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272599c700 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af784000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272499a700 1 -- 172.21.15.12:0/2099744527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 msgr2=0x5591af784000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272499a700 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af784000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272499a700 1 -- 172.21.15.12:0/2099744527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 msgr2=0x5591af793dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272499a700 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af793dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272499a700 1 -- 172.21.15.12:0/2099744527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591af4e8c60 con 0x5591af782d30 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.710+0000 7f272519b700 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af793dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.711+0000 7f272499a700 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af7936e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f27100098e0 tx=0x7f2710005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb2d55b62e2f3df server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.711+0000 7f270bfff700 1 -- 172.21.15.12:0/2099744527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710003980 con 0x5591af782d30 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.711+0000 7f270bfff700 1 -- 172.21.15.12:0/2099744527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f271001e040 con 0x5591af782d30 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f270bfff700 1 -- 172.21.15.12:0/2099744527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000f6c0 con 0x5591af782d30 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 -- 172.21.15.12:0/2099744527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 msgr2=0x5591af7936e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af7936e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f27100098e0 tx=0x7f2710005a90 comp rx=0 tx=0).stop 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 -- 172.21.15.12:0/2099744527 shutdown_connections 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af793dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af784000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 --2- 172.21.15.12:0/2099744527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af7936e0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 -- 172.21.15.12:0/2099744527 >> 172.21.15.12:0/2099744527 conn(0x5591af6b17e0 msgr2=0x5591af78a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 -- 172.21.15.12:0/2099744527 shutdown_connections 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.712+0000 7f273ac8db80 1 -- 172.21.15.12:0/2099744527 wait complete. 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.713+0000 7f273ac8db80 1 -- start start 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.713+0000 7f273ac8db80 1 Processor -- start 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af78f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f273ac8db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af792660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f273ac8db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af792ba0 con 0x5591af782d30 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f273ac8db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af792d10 con 0x5591af7823d0 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f273ac8db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591af792ed0 con 0x5591af783c20 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f273ac8db80 10 client.0 _ll_register_callbacks cb 0x5591af5bba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f272499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f272499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38928/0 (socket says 172.21.15.12:38928) 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f272499a700 1 -- 172.21.15.12:0/585442992 learned_addr learned my addr 172.21.15.12:0/585442992 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f272519b700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af78f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.714+0000 7f272599c700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af792660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f272599c700 1 -- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 msgr2=0x5591af78f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f272599c700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af78f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f272599c700 1 -- 172.21.15.12:0/585442992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 msgr2=0x5591af78f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f272599c700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f272599c700 1 -- 172.21.15.12:0/585442992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591af4ffde0 con 0x5591af783c20 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f272499a700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f272519b700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af78f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f272599c700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af792660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2718009fd0 tx=0x7f2718004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b3eb8b438bd548 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f2708ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.715+0000 7f2708ff9700 1 -- 172.21.15.12:0/585442992 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718004770 con 0x5591af783c20 2023-12-11T20:25:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.716+0000 7f273ac8db80 1 -- 172.21.15.12:0/585442992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f271c09a890 con 0x5591af783c20 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.716+0000 7f2708ff9700 1 -- 172.21.15.12:0/585442992 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2718021040 con 0x5591af783c20 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.716+0000 7f2708ff9700 1 -- 172.21.15.12:0/585442992 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27180048d0 con 0x5591af783c20 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.716+0000 7f273ac8db80 10 client.27925 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.716+0000 7f273ac8db80 1 -- 172.21.15.12:0/585442992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f272010a240 con 0x5591af783c20 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.716+0000 7f2708ff9700 1 -- 172.21.15.12:0/585442992 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f271c09a890 con 0x5591af783c20 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.716+0000 7f2708ff9700 1 -- 172.21.15.12:0/585442992 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f271801b4e0 con 0x5591af783c20 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.717+0000 7f273ac8db80 10 client.27925 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.717+0000 7f273ac8db80 10 client.27925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.717+0000 7f273ac8db80 20 client.27925 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.717+0000 7f273ac8db80 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591af7eedf0 0x5591af7f1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.717+0000 7f273ac8db80 4 client.27925 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.717+0000 7f273ac8db80 1 -- 172.21.15.12:0/585442992 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5591af69cfd0 con 0x5591af7eedf0 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.717+0000 7f272519b700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591af7eedf0 0x5591af7f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f272519b700 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591af7eedf0 0x5591af7f1210 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35e5b84e21b7eb21 server_cookie=926beaad0c4abebe in_seq=0 out_seq=0 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f2708ff9700 10 client.27925 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f2708ff9700 1 -- 172.21.15.12:0/585442992 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5591af69cfd0 con 0x5591af7eedf0 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f2708ff9700 10 client.27925 handle_command_reply: tid=0 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 client.27925 shutdown 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 -- 172.21.15.12:0/585442992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 msgr2=0x5591af792660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af792660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2718009fd0 tx=0x7f2718004b40 comp rx=0 tx=0).stop 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 -- 172.21.15.12:0/585442992 shutdown_connections 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5591af7eedf0 0x5591af7f1210 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5591af7823d0 0x5591af78f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591af783c20 0x5591af792660 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 --2- 172.21.15.12:0/585442992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5591af782d30 0x5591af78f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 -- 172.21.15.12:0/585442992 >> 172.21.15.12:0/585442992 conn(0x5591af6b17e0 msgr2=0x5591af77e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f2708ff9700 0 client.27925 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 -- 172.21.15.12:0/585442992 shutdown_connections 2023-12-11T20:25:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.718+0000 7f273ac8db80 1 -- 172.21.15.12:0/585442992 wait complete. 2023-12-11T20:25:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f273ac8db80 20 client.27925 trim_cache size 0 max 16384 2023-12-11T20:25:44.724 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 -- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f270c0a1500 msgr2=0x7f270c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f270c0a1500 0x7f270c0a39c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2718007e80 tx=0x7f2718007500 comp rx=0 tx=0).stop 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 -- 172.21.15.12:0/1460874148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2720101f80 msgr2=0x7f27201018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2720101f80 0x7f27201018a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e9a0 tx=0x7f271c00ed60 comp rx=0 tx=0).stop 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 -- 172.21.15.12:0/1460874148 shutdown_connections 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f270c0a1500 0x7f270c0a39c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2720101f80 0x7f27201018a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27201071e0 0x7f2720100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 --2- 172.21.15.12:0/1460874148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27201048b0 0x7f27200fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:44.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.719+0000 7f27273ff700 1 -- 172.21.15.12:0/1460874148 >> 172.21.15.12:0/1460874148 conn(0x7f27200fb930 msgr2=0x7f27201029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:44.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.720+0000 7f27273ff700 1 -- 172.21.15.12:0/1460874148 shutdown_connections 2023-12-11T20:25:44.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:44.720+0000 7f27273ff700 1 -- 172.21.15.12:0/1460874148 wait complete. 2023-12-11T20:25:44.726 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:44 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2799033208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:25:44.737 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:44 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2799033208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:25:44.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:44 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2799033208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:25:45.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:45 smithi032 ceph-mon[132488]: pgmap v670: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:25:45.741 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:25:45.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:25:45.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:45 smithi039 ceph-mon[102205]: pgmap v670: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:25:45.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:45 smithi012 ceph-mon[128787]: pgmap v670: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:25:45.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 -- 172.21.15.12:0/38791224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 msgr2=0x7ff804102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/38791224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 0x7ff804102af0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40099c0 tx=0x7ff7f4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 -- 172.21.15.12:0/38791224 shutdown_connections 2023-12-11T20:25:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/38791224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff804103030 0x7ff8041098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/38791224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8041014a0 0x7ff8041018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/38791224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 0x7ff804102af0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 -- 172.21.15.12:0/38791224 >> 172.21.15.12:0/38791224 conn(0x7ff8040fca30 msgr2=0x7ff8040fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 -- 172.21.15.12:0/38791224 shutdown_connections 2023-12-11T20:25:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.971+0000 7ff80b9ff700 1 -- 172.21.15.12:0/38791224 wait complete. 2023-12-11T20:25:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.972+0000 7ff80b9ff700 1 Processor -- start 2023-12-11T20:25:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff80b9ff700 1 -- start start 2023-12-11T20:25:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff80b9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8041014a0 0x7ff804197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff80b9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 0x7ff8041978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff80b9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff804103030 0x7ff80419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff80b9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80419eea0 con 0x7ff804102690 2023-12-11T20:25:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff80b9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80419efe0 con 0x7ff8041014a0 2023-12-11T20:25:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff80b9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80419f170 con 0x7ff804103030 2023-12-11T20:25:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff808f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 0x7ff8041978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff80979b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8041014a0 0x7ff804197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff808f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 0x7ff8041978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38942/0 (socket says 172.21.15.12:38942) 2023-12-11T20:25:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.973+0000 7ff808f9a700 1 -- 172.21.15.12:0/3398350903 learned_addr learned my addr 172.21.15.12:0/3398350903 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff809f9c700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff804103030 0x7ff80419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff808f9a700 1 -- 172.21.15.12:0/3398350903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff804103030 msgr2=0x7ff80419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff808f9a700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff804103030 0x7ff80419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff808f9a700 1 -- 172.21.15.12:0/3398350903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8041014a0 msgr2=0x7ff804197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff808f9a700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8041014a0 0x7ff804197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff808f9a700 1 -- 172.21.15.12:0/3398350903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f40095f0 con 0x7ff804102690 2023-12-11T20:25:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff80979b700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8041014a0 0x7ff804197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff808f9a700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 0x7ff8041978b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4005910 tx=0x7ff7f4005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.974+0000 7ff7fa7fc700 1 -- 172.21.15.12:0/3398350903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f401d070 con 0x7ff804102690 2023-12-11T20:25:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.975+0000 7ff7fa7fc700 1 -- 172.21.15.12:0/3398350903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7f400bd30 con 0x7ff804102690 2023-12-11T20:25:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.975+0000 7ff80b9ff700 1 -- 172.21.15.12:0/3398350903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80419f3f0 con 0x7ff804102690 2023-12-11T20:25:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.975+0000 7ff7fa7fc700 1 -- 172.21.15.12:0/3398350903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4022cd0 con 0x7ff804102690 2023-12-11T20:25:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.975+0000 7ff80b9ff700 1 -- 172.21.15.12:0/3398350903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80419f870 con 0x7ff804102690 2023-12-11T20:25:45.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.978+0000 7ff7fa7fc700 1 -- 172.21.15.12:0/3398350903 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff7f4022470 con 0x7ff804102690 2023-12-11T20:25:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.979+0000 7ff81f395b80 1 Processor -- start 2023-12-11T20:25:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff81f395b80 1 -- start start 2023-12-11T20:25:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbc1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbc26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbc3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff81f395b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fb1cbd0 con 0x559f1fbc1db0 2023-12-11T20:25:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff81f395b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fb1a4f0 con 0x559f1fbc1450 2023-12-11T20:25:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff81f395b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fb15de0 con 0x559f1fbc2ca0 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff80979b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbc26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff80979b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbc26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38952/0 (socket says 172.21.15.12:38952) 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.980+0000 7ff80979b700 1 -- 172.21.15.12:0/3953810377 learned_addr learned my addr 172.21.15.12:0/3953810377 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff809f9c700 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbc1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff808f9a700 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbc3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff7fa7fc700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7f00a1500 0x7ff7f00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff80979b700 1 -- 172.21.15.12:0/3953810377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 msgr2=0x559f1fbc3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff7fa7fc700 1 -- 172.21.15.12:0/3398350903 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff7f40cdd50 con 0x7ff804102690 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff80979b700 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbc3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff80979b700 1 -- 172.21.15.12:0/3953810377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 msgr2=0x559f1fbc1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff80979b700 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbc1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff80979b700 1 -- 172.21.15.12:0/3953810377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f1f9926b0 con 0x559f1fbc1db0 2023-12-11T20:25:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff809f9c700 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbc1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.981+0000 7ff809f9c700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7f00a1500 0x7ff7f00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.982+0000 7ff80979b700 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbc26c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff800010580 tx=0x7ff800010890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8daa41fd145547 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.982+0000 7ff7ef7fe700 1 -- 172.21.15.12:0/3953810377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80001c680 con 0x559f1fbc1db0 2023-12-11T20:25:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.982+0000 7ff7ef7fe700 1 -- 172.21.15.12:0/3953810377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff800015070 con 0x559f1fbc1db0 2023-12-11T20:25:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.982+0000 7ff7ef7fe700 1 -- 172.21.15.12:0/3953810377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000119d0 con 0x559f1fbc1db0 2023-12-11T20:25:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 -- 172.21.15.12:0/3953810377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 msgr2=0x559f1fbc26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff809f9c700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7f00a1500 0x7ff7f00a39c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc003fd0 tx=0x7ff7fc004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbc26c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff800010580 tx=0x7ff800010890 comp rx=0 tx=0).stop 2023-12-11T20:25:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 -- 172.21.15.12:0/3953810377 shutdown_connections 2023-12-11T20:25:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbc1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbc3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 --2- 172.21.15.12:0/3953810377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbc26c0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 -- 172.21.15.12:0/3953810377 >> 172.21.15.12:0/3953810377 conn(0x559f1faf0860 msgr2=0x559f1fbbde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 -- 172.21.15.12:0/3953810377 shutdown_connections 2023-12-11T20:25:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.983+0000 7ff81f395b80 1 -- 172.21.15.12:0/3953810377 wait complete. 2023-12-11T20:25:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.984+0000 7ff81f395b80 1 -- start start 2023-12-11T20:25:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.984+0000 7ff81f395b80 1 Processor -- start 2023-12-11T20:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1db0 0x559f1fbcb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff81f395b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1facf5e0 con 0x559f1fbc2ca0 2023-12-11T20:25:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff81f395b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1facf280 con 0x559f1fbc1450 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff81f395b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1f9949a0 con 0x559f1fbc1db0 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff81f395b80 10 client.0 _ll_register_callbacks cb 0x559f1f9fab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff809f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff80979b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff809f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38966/0 (socket says 172.21.15.12:38966) 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff80979b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50604/0 (socket says 172.21.15.12:50604) 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff809f9c700 1 -- 172.21.15.12:0/1072651442 learned_addr learned my addr 172.21.15.12:0/1072651442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.985+0000 7ff808f9a700 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1db0 0x559f1fbcb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff809f9c700 1 -- 172.21.15.12:0/1072651442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1db0 msgr2=0x559f1fbcb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff809f9c700 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1db0 0x559f1fbcb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff809f9c700 1 -- 172.21.15.12:0/1072651442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 msgr2=0x559f1fbcb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff809f9c700 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff809f9c700 1 -- 172.21.15.12:0/1072651442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc003ba0 con 0x559f1fbc2ca0 2023-12-11T20:25:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff809f9c700 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd2780 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc008b70 tx=0x7ff7fc009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27853e729ba3a07 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff7ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff7ecff9700 1 -- 172.21.15.12:0/1072651442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc017cf0 con 0x559f1fbc2ca0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff7ecff9700 1 -- 172.21.15.12:0/1072651442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff7fc01c030 con 0x559f1fbc2ca0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.986+0000 7ff81f395b80 1 -- 172.21.15.12:0/1072651442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f1fbb4bc0 con 0x559f1fbc2ca0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff7ecff9700 1 -- 172.21.15.12:0/1072651442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7fc017e50 con 0x559f1fbc2ca0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff81f395b80 10 client.18321 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff81f395b80 1 -- 172.21.15.12:0/1072651442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ff80000bd50 con 0x559f1fbc2ca0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff7ecff9700 1 -- 172.21.15.12:0/1072651442 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7fc032020 con 0x559f1fbc2ca0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff7ecff9700 1 -- 172.21.15.12:0/1072651442 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff7fc02c400 con 0x559f1fbc2ca0 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff81f395b80 10 client.18321 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff81f395b80 10 client.18321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff81f395b80 20 client.18321 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff81f395b80 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559f1fbd70a0 0x559f1fbd94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff81f395b80 4 client.18321 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.987+0000 7ff81f395b80 1 -- 172.21.15.12:0/1072651442 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f1fb90fc0 con 0x559f1fbd70a0 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.988+0000 7ff80979b700 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559f1fbd70a0 0x559f1fbd94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.988+0000 7ff80979b700 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559f1fbd70a0 0x559f1fbd94c0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8660db81e8554ef6 server_cookie=41f711a1ff724917 in_seq=0 out_seq=0 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.988+0000 7ff7ecff9700 10 client.18321 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff7ecff9700 1 -- 172.21.15.12:0/1072651442 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559f1fb90fc0 con 0x559f1fbd70a0 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff7ecff9700 10 client.18321 handle_command_reply: tid=0 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 client.18321 shutdown 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 -- 172.21.15.12:0/1072651442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 msgr2=0x559f1fbd2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd2780 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc008b70 tx=0x7ff7fc009100 comp rx=0 tx=0).stop 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 -- 172.21.15.12:0/1072651442 shutdown_connections 2023-12-11T20:25:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559f1fbd70a0 0x559f1fbd94c0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd2780 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff7ecff9700 0 client.18321 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 --2- 172.21.15.12:0/1072651442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1db0 0x559f1fbcb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.989+0000 7ff81f395b80 1 -- 172.21.15.12:0/1072651442 >> 172.21.15.12:0/1072651442 conn(0x559f1faf0860 msgr2=0x559f1fbbcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.990+0000 7ff81f395b80 1 -- 172.21.15.12:0/1072651442 shutdown_connections 2023-12-11T20:25:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.990+0000 7ff81f395b80 1 -- 172.21.15.12:0/1072651442 wait complete. 2023-12-11T20:25:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:45.990+0000 7ff81f395b80 20 client.18321 trim_cache size 0 max 16384 2023-12-11T20:25:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.012+0000 7ff81f395b80 1 Processor -- start 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.012+0000 7ff81f395b80 1 -- start start 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbd2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbcb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff81f395b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fbd3900 con 0x559f1fbc1db0 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff81f395b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fbcad70 con 0x559f1fbc1450 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff81f395b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fbb8c20 con 0x559f1fbc2ca0 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff808f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbd2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff808f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbd2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38982/0 (socket says 172.21.15.12:38982) 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff808f9a700 1 -- 172.21.15.12:0/3510983514 learned_addr learned my addr 172.21.15.12:0/3510983514 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff80979b700 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff809f9c700 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbcb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff808f9a700 1 -- 172.21.15.12:0/3510983514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 msgr2=0x559f1fbcb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff808f9a700 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbcb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff808f9a700 1 -- 172.21.15.12:0/3510983514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 msgr2=0x559f1fbcb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff808f9a700 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff808f9a700 1 -- 172.21.15.12:0/3510983514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f1f93ee60 con 0x559f1fbc1db0 2023-12-11T20:25:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.013+0000 7ff809f9c700 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbcb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.014+0000 7ff808f9a700 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbd2740 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009d10 tx=0x7ff7f4097270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b4879cbb96f18a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:46.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.014+0000 7ff7effff700 1 -- 172.21.15.12:0/3510983514 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f409ae20 con 0x559f1fbc1db0 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.014+0000 7ff7effff700 1 -- 172.21.15.12:0/3510983514 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7f409ab90 con 0x559f1fbc1db0 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.014+0000 7ff7effff700 1 -- 172.21.15.12:0/3510983514 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40cb8b0 con 0x559f1fbc1db0 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 -- 172.21.15.12:0/3510983514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 msgr2=0x559f1fbd2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbd2740 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009d10 tx=0x7ff7f4097270 comp rx=0 tx=0).stop 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 -- 172.21.15.12:0/3510983514 shutdown_connections 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1450 0x559f1fbcb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc2ca0 0x559f1fbcb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 --2- 172.21.15.12:0/3510983514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc1db0 0x559f1fbd2740 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 -- 172.21.15.12:0/3510983514 >> 172.21.15.12:0/3510983514 conn(0x559f1faf0860 msgr2=0x559f1fbc5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 -- 172.21.15.12:0/3510983514 shutdown_connections 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 -- 172.21.15.12:0/3510983514 wait complete. 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.015+0000 7ff81f395b80 1 -- start start 2023-12-11T20:25:46.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.016+0000 7ff81f395b80 1 Processor -- start 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.016+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1450 0x559f1fbd0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.016+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1db0 0x559f1fbd1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.016+0000 7ff81f395b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.016+0000 7ff81f395b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fc2d5d0 con 0x559f1fbc2ca0 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.016+0000 7ff81f395b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fc2d710 con 0x559f1fbc1db0 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.016+0000 7ff81f395b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1fc2d8d0 con 0x559f1fbc1450 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.016+0000 7ff81f395b80 10 client.0 _ll_register_callbacks cb 0x559f1f9fab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1db0 0x559f1fbd1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1db0 0x559f1fbd1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50634/0 (socket says 172.21.15.12:50634) 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 -- 172.21.15.12:0/777263658 learned_addr learned my addr 172.21.15.12:0/777263658 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff809f9c700 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff80979b700 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1450 0x559f1fbd0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 -- 172.21.15.12:0/777263658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1450 msgr2=0x559f1fbd0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1450 0x559f1fbd0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 -- 172.21.15.12:0/777263658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 msgr2=0x559f1fbd1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 -- 172.21.15.12:0/777263658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80419f870 con 0x559f1fbc1db0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff808f9a700 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1db0 0x559f1fbd1500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40993a0 tx=0x7ff7f4099600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=427275afc7501dfc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.017+0000 7ff7ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.018+0000 7ff7ecff9700 1 -- 172.21.15.12:0/777263658 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f409b4b0 con 0x559f1fbc1db0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.018+0000 7ff81f395b80 1 -- 172.21.15.12:0/777263658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff800015070 con 0x559f1fbc1db0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.018+0000 7ff7ecff9700 1 -- 172.21.15.12:0/777263658 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff7f409b050 con 0x559f1fbc1db0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.018+0000 7ff7ecff9700 1 -- 172.21.15.12:0/777263658 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f409a9b0 con 0x559f1fbc1db0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.018+0000 7ff81f395b80 10 client.27941 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.018+0000 7ff81f395b80 1 -- 172.21.15.12:0/777263658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559f1f927ce0 con 0x559f1fbc1db0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.018+0000 7ff7ecff9700 1 -- 172.21.15.12:0/777263658 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff800015070 con 0x559f1fbc1db0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.019+0000 7ff7ecff9700 1 -- 172.21.15.12:0/777263658 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff7f40a2ec0 con 0x559f1fbc1db0 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.019+0000 7ff81f395b80 10 client.27941 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:46.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.019+0000 7ff81f395b80 10 client.27941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:46.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.019+0000 7ff81f395b80 20 client.27941 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:46.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.019+0000 7ff81f395b80 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559f1fc2ee10 0x559f1fc31230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.019+0000 7ff81f395b80 4 client.27941 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:25:46.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.019+0000 7ff81f395b80 1 -- 172.21.15.12:0/777263658 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559f1fadc050 con 0x559f1fc2ee10 2023-12-11T20:25:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.019+0000 7ff80979b700 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559f1fc2ee10 0x559f1fc31230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.020+0000 7ff80979b700 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559f1fc2ee10 0x559f1fc31230 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5b682084b776d4 server_cookie=b85c1988ebb346e6 in_seq=0 out_seq=0 2023-12-11T20:25:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.020+0000 7ff7ecff9700 10 client.27941 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.021+0000 7ff7ecff9700 1 -- 172.21.15.12:0/777263658 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559f1fadc050 con 0x559f1fc2ee10 2023-12-11T20:25:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.021+0000 7ff7ecff9700 10 client.27941 handle_command_reply: tid=0 2023-12-11T20:25:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.021+0000 7ff81f395b80 1 client.27941 shutdown 2023-12-11T20:25:46.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.021+0000 7ff81f395b80 1 -- 172.21.15.12:0/777263658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1db0 msgr2=0x559f1fbd1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.021+0000 7ff81f395b80 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1db0 0x559f1fbd1500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40993a0 tx=0x7ff7f4099600 comp rx=0 tx=0).stop 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.021+0000 7ff81f395b80 1 -- 172.21.15.12:0/777263658 shutdown_connections 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.021+0000 7ff81f395b80 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559f1fc2ee10 0x559f1fc31230 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff81f395b80 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f1fbc2ca0 0x559f1fbd1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff81f395b80 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559f1fbc1450 0x559f1fbd0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff7ecff9700 0 client.27941 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff81f395b80 1 --2- 172.21.15.12:0/777263658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559f1fbc1db0 0x559f1fbd1500 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff81f395b80 1 -- 172.21.15.12:0/777263658 >> 172.21.15.12:0/777263658 conn(0x559f1faf0860 msgr2=0x559f1fbcb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff81f395b80 1 -- 172.21.15.12:0/777263658 shutdown_connections 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff81f395b80 1 -- 172.21.15.12:0/777263658 wait complete. 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff81f395b80 20 client.27941 trim_cache size 0 max 16384 2023-12-11T20:25:46.023 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:25:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:25:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "2d20b7f5-8362-4ce6-a8eb-b22fec7942e9", 2023-12-11T20:25:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:25:46.024 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:25:46.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff80b9ff700 1 -- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7f00a1500 msgr2=0x7ff7f00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7f00a1500 0x7ff7f00a39c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc003fd0 tx=0x7ff7fc004ad0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff80b9ff700 1 -- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 msgr2=0x7ff8041978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.022+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 0x7ff8041978b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4005910 tx=0x7ff7f4005b00 comp rx=0 tx=0).stop 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.023+0000 7ff80b9ff700 1 -- 172.21.15.12:0/3398350903 shutdown_connections 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.023+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff7f00a1500 0x7ff7f00a39c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.023+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8041014a0 0x7ff804197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.023+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff804103030 0x7ff80419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.023+0000 7ff80b9ff700 1 --2- 172.21.15.12:0/3398350903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff804102690 0x7ff8041978b0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.023+0000 7ff80b9ff700 1 -- 172.21.15.12:0/3398350903 >> 172.21.15.12:0/3398350903 conn(0x7ff8040fca30 msgr2=0x7ff804105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.023+0000 7ff80b9ff700 1 -- 172.21.15.12:0/3398350903 shutdown_connections 2023-12-11T20:25:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.023+0000 7ff80b9ff700 1 -- 172.21.15.12:0/3398350903 wait complete. 2023-12-11T20:25:46.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.294+0000 7f4f80dff700 1 -- 172.21.15.12:0/104715751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c1026a0 msgr2=0x7f4f7c102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.294+0000 7f4f80dff700 1 --2- 172.21.15.12:0/104715751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c1026a0 0x7f4f7c102b00 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4f640099c0 tx=0x7f4f64009cd0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.294+0000 7f4f80dff700 1 -- 172.21.15.12:0/104715751 shutdown_connections 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.294+0000 7f4f80dff700 1 --2- 172.21.15.12:0/104715751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f7c1014b0 0x7f4f7c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.294+0000 7f4f80dff700 1 --2- 172.21.15.12:0/104715751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f7c103040 0x7f4f7c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.294+0000 7f4f80dff700 1 --2- 172.21.15.12:0/104715751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c1026a0 0x7f4f7c102b00 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.294+0000 7f4f80dff700 1 -- 172.21.15.12:0/104715751 >> 172.21.15.12:0/104715751 conn(0x7f4f7c0fca00 msgr2=0x7f4f7c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.295+0000 7f4f80dff700 1 -- 172.21.15.12:0/104715751 shutdown_connections 2023-12-11T20:25:46.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.295+0000 7f4f80dff700 1 -- 172.21.15.12:0/104715751 wait complete. 2023-12-11T20:25:46.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f80dff700 1 Processor -- start 2023-12-11T20:25:46.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f80dff700 1 -- start start 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f80dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f7c1014b0 0x7f4f7c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f80dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f7c1026a0 0x7f4f7c199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f80dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c103040 0x7f4f7c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f80dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1a10a0 con 0x7f4f7c103040 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f80dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1a11e0 con 0x7f4f7c1014b0 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f80dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1a1370 con 0x7f4f7c1026a0 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f7ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c103040 0x7f4f7c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f7a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f7c1014b0 0x7f4f7c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f7ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c103040 0x7f4f7c1a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38998/0 (socket says 172.21.15.12:38998) 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.296+0000 7f4f7ad9d700 1 -- 172.21.15.12:0/2246564740 learned_addr learned my addr 172.21.15.12:0/2246564740 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.297+0000 7f4f73fff700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f7c1026a0 0x7f4f7c199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.297+0000 7f4f7ad9d700 1 -- 172.21.15.12:0/2246564740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f7c1026a0 msgr2=0x7f4f7c199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.297+0000 7f4f7ad9d700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f7c1026a0 0x7f4f7c199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.297+0000 7f4f7ad9d700 1 -- 172.21.15.12:0/2246564740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f7c1014b0 msgr2=0x7f4f7c199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.297+0000 7f4f7ad9d700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f7c1014b0 0x7f4f7c199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.297+0000 7f4f7ad9d700 1 -- 172.21.15.12:0/2246564740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640095f0 con 0x7f4f7c103040 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.297+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f7c1014b0 0x7f4f7c199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.297+0000 7f4f7ad9d700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c103040 0x7f4f7c1a0ad0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400ef30 tx=0x7f4f7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.298+0000 7f4f737fe700 1 -- 172.21.15.12:0/2246564740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74018070 con 0x7f4f7c103040 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.298+0000 7f4f80dff700 1 -- 172.21.15.12:0/2246564740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c1a15f0 con 0x7f4f7c103040 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.298+0000 7f4f737fe700 1 -- 172.21.15.12:0/2246564740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f7400f040 con 0x7f4f7c103040 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.298+0000 7f4f737fe700 1 -- 172.21.15.12:0/2246564740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400cbc0 con 0x7f4f7c103040 2023-12-11T20:25:46.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.298+0000 7f4f80dff700 1 -- 172.21.15.12:0/2246564740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c1a1b00 con 0x7f4f7c103040 2023-12-11T20:25:46.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.302+0000 7f4f737fe700 1 -- 172.21.15.12:0/2246564740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4f74007500 con 0x7f4f7c103040 2023-12-11T20:25:46.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f9465bb80 1 Processor -- start 2023-12-11T20:25:46.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f9465bb80 1 -- start start 2023-12-11T20:25:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be4797f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be47a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be47b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be3d4b50 con 0x55d9be479d30 2023-12-11T20:25:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be3d2470 con 0x55d9be4793d0 2023-12-11T20:25:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be3cdd60 con 0x55d9be47ac20 2023-12-11T20:25:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.303+0000 7f4f7a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be47a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be47a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39012/0 (socket says 172.21.15.12:39012) 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7a59c700 1 -- 172.21.15.12:0/1453610492 learned_addr learned my addr 172.21.15.12:0/1453610492 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f73fff700 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be4797f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f737fe700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f680a1500 0x7f4f680a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f73fff700 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be47b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f737fe700 1 -- 172.21.15.12:0/2246564740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f740cc810 con 0x7f4f7c103040 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7a59c700 1 -- 172.21.15.12:0/1453610492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 msgr2=0x55d9be47b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be47b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7a59c700 1 -- 172.21.15.12:0/1453610492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 msgr2=0x55d9be4797f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be4797f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7a59c700 1 -- 172.21.15.12:0/1453610492 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9be24a630 con 0x55d9be479d30 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7ad9d700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f680a1500 0x7f4f680a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.304+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be47a640 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0115c0 tx=0x7f4f6c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff11e958659994db server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.305+0000 7f4f70ff9700 1 -- 172.21.15.12:0/1453610492 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c004220 con 0x55d9be479d30 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.305+0000 7f4f70ff9700 1 -- 172.21.15.12:0/1453610492 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f6c004cc0 con 0x55d9be479d30 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.305+0000 7f4f70ff9700 1 -- 172.21.15.12:0/1453610492 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c005470 con 0x55d9be479d30 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 -- 172.21.15.12:0/1453610492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 msgr2=0x55d9be47a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be47a640 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0115c0 tx=0x7f4f6c0118d0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f7ad9d700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f680a1500 0x7f4f680a39c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4f74004b80 tx=0x7f4f74004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 -- 172.21.15.12:0/1453610492 shutdown_connections 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be4797f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be47b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/1453610492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be47a640 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 -- 172.21.15.12:0/1453610492 >> 172.21.15.12:0/1453610492 conn(0x55d9be3a87e0 msgr2=0x55d9be475d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 -- 172.21.15.12:0/1453610492 shutdown_connections 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 -- 172.21.15.12:0/1453610492 wait complete. 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.306+0000 7f4f9465bb80 1 -- start start 2023-12-11T20:25:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.307+0000 7f4f9465bb80 1 Processor -- start 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.307+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be483170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.307+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be4836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.307+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be48a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.307+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be387560 con 0x55d9be479d30 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.307+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be387200 con 0x55d9be4793d0 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.307+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be24c920 con 0x55d9be47ac20 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.307+0000 7f4f9465bb80 10 client.0 _ll_register_callbacks cb 0x55d9be2b2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f7a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be4836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f7a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be4836b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39028/0 (socket says 172.21.15.12:39028) 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f7a59c700 1 -- 172.21.15.12:0/3907692116 learned_addr learned my addr 172.21.15.12:0/3907692116 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be483170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be48a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f7a59c700 1 -- 172.21.15.12:0/3907692116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 msgr2=0x55d9be48a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be48a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f7a59c700 1 -- 172.21.15.12:0/3907692116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 msgr2=0x55d9be483170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be483170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.308+0000 7f4f7a59c700 1 -- 172.21.15.12:0/3907692116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c009d50 con 0x55d9be479d30 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be4836b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c000c00 tx=0x7f4f6c0053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60aa27bf0387e59c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f61ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3907692116 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c005ce0 con 0x55d9be479d30 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3907692116 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f6c01f040 con 0x55d9be479d30 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3907692116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9be46cb40 con 0x55d9be479d30 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3907692116 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f6c024430 con 0x55d9be479d30 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f9465bb80 10 client.18339 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3907692116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d9be1f6de0 con 0x55d9be479d30 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.309+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3907692116 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d9be46cb40 con 0x55d9be479d30 2023-12-11T20:25:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.310+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3907692116 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f6c0195c0 con 0x55d9be479d30 2023-12-11T20:25:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.310+0000 7f4f9465bb80 10 client.18339 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.310+0000 7f4f9465bb80 10 client.18339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.310+0000 7f4f9465bb80 20 client.18339 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.310+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d9be48ef00 0x55d9be491320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.310+0000 7f4f9465bb80 4 client.18339 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.310+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3907692116 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9be448f40 con 0x55d9be48ef00 2023-12-11T20:25:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.310+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d9be48ef00 0x55d9be491320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.311+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d9be48ef00 0x55d9be491320 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1555bbe10a215b9 server_cookie=d6550449f5c887bb in_seq=0 out_seq=0 2023-12-11T20:25:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.311+0000 7f4f61ffb700 10 client.18339 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3907692116 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d9be448f40 con 0x55d9be48ef00 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f61ffb700 10 client.18339 handle_command_reply: tid=0 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 client.18339 shutdown 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3907692116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 msgr2=0x55d9be4836b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be4836b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c000c00 tx=0x7f4f6c0053a0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3907692116 shutdown_connections 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d9be48ef00 0x55d9be491320 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be483170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be48a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f61ffb700 0 client.18339 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3907692116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be4836b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3907692116 >> 172.21.15.12:0/3907692116 conn(0x55d9be3a87e0 msgr2=0x55d9be474a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3907692116 shutdown_connections 2023-12-11T20:25:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.312+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3907692116 wait complete. 2023-12-11T20:25:46.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.313+0000 7f4f9465bb80 20 client.18339 trim_cache size 0 max 16384 2023-12-11T20:25:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.337+0000 7f4f9465bb80 1 Processor -- start 2023-12-11T20:25:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.337+0000 7f4f9465bb80 1 -- start start 2023-12-11T20:25:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be4793d0 0x55d9be482680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be479d30 0x55d9be48a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be47ac20 0x55d9be483170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be47e680 con 0x55d9be47ac20 2023-12-11T20:25:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be47a850 con 0x55d9be479d30 2023-12-11T20:25:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be46c8d0 con 0x55d9be4793d0 2023-12-11T20:25:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f73fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be47ac20 0x55d9be483170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f73fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be47ac20 0x55d9be483170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39032/0 (socket says 172.21.15.12:39032) 2023-12-11T20:25:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f73fff700 1 -- 172.21.15.12:0/2752874957 learned_addr learned my addr 172.21.15.12:0/2752874957 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f73fff700 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be4793d0 0x55d9be482680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be479d30 0x55d9be48a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.338+0000 7f4f73fff700 1 -- 172.21.15.12:0/2752874957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be4793d0 msgr2=0x55d9be482680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.339+0000 7f4f73fff700 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be4793d0 0x55d9be482680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.339+0000 7f4f73fff700 1 -- 172.21.15.12:0/2752874957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be479d30 msgr2=0x55d9be48a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.339+0000 7f4f73fff700 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be479d30 0x55d9be48a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.339+0000 7f4f73fff700 1 -- 172.21.15.12:0/2752874957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9be1dfc60 con 0x55d9be47ac20 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.339+0000 7f4f73fff700 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be47ac20 0x55d9be483170 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x55d9be480d20 tx=0x7f4f64005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b911120a3b2d618f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.339+0000 7f4f717fa700 1 -- 172.21.15.12:0/2752874957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64005480 con 0x55d9be47ac20 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.339+0000 7f4f717fa700 1 -- 172.21.15.12:0/2752874957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f64033070 con 0x55d9be47ac20 2023-12-11T20:25:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.339+0000 7f4f717fa700 1 -- 172.21.15.12:0/2752874957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6402d3a0 con 0x55d9be47ac20 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 -- 172.21.15.12:0/2752874957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be47ac20 msgr2=0x55d9be483170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be47ac20 0x55d9be483170 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x55d9be480d20 tx=0x7f4f64005c60 comp rx=0 tx=0).stop 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 -- 172.21.15.12:0/2752874957 shutdown_connections 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be47ac20 0x55d9be483170 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be4793d0 0x55d9be482680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/2752874957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be479d30 0x55d9be48a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 -- 172.21.15.12:0/2752874957 >> 172.21.15.12:0/2752874957 conn(0x55d9be3a87e0 msgr2=0x55d9be481110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 -- 172.21.15.12:0/2752874957 shutdown_connections 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.340+0000 7f4f9465bb80 1 -- 172.21.15.12:0/2752874957 wait complete. 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 1 -- start start 2023-12-11T20:25:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 1 Processor -- start 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be4866f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be486c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be489c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be48a140 con 0x55d9be479d30 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be48a2b0 con 0x55d9be4793d0 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9be48a470 con 0x55d9be47ac20 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.341+0000 7f4f9465bb80 10 client.0 _ll_register_callbacks cb 0x55d9be2b2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be486c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be486c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39046/0 (socket says 172.21.15.12:39046) 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 -- 172.21.15.12:0/3248162241 learned_addr learned my addr 172.21.15.12:0/3248162241 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be4866f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be489c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 -- 172.21.15.12:0/3248162241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 msgr2=0x55d9be489c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be489c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 -- 172.21.15.12:0/3248162241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 msgr2=0x55d9be4866f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be4866f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 -- 172.21.15.12:0/3248162241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c10a240 con 0x55d9be479d30 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be489c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f7a59c700 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be486c30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c004c90 tx=0x7f4f6c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5b2978a296dee server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.342+0000 7f4f61ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3248162241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c004f80 con 0x55d9be479d30 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3248162241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f6c000e40 con 0x55d9be479d30 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3248162241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f6c004cc0 con 0x55d9be479d30 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3248162241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f6c019430 con 0x55d9be479d30 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f9465bb80 10 client.18345 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3248162241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d9be21d250 con 0x55d9be479d30 2023-12-11T20:25:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3248162241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f6c045080 con 0x55d9be479d30 2023-12-11T20:25:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3248162241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f6c003680 con 0x55d9be479d30 2023-12-11T20:25:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f9465bb80 10 client.18345 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f9465bb80 10 client.18345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.343+0000 7f4f9465bb80 20 client.18345 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:46.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.344+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d9be4e63a0 0x55d9be4e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.344+0000 7f4f9465bb80 4 client.18345 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:25:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.344+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3248162241 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d9be393fd0 con 0x55d9be4e63a0 2023-12-11T20:25:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.344+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d9be4e63a0 0x55d9be4e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f61ffb700 10 client.18345 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f73fff700 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d9be4e63a0 0x55d9be4e87c0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbcdea1f2857a008 server_cookie=e3620d266715fa5b in_seq=0 out_seq=0 2023-12-11T20:25:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f61ffb700 1 -- 172.21.15.12:0/3248162241 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d9be393fd0 con 0x55d9be4e63a0 2023-12-11T20:25:46.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f61ffb700 10 client.18345 handle_command_reply: tid=0 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 client.18345 shutdown 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3248162241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 msgr2=0x55d9be486c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be486c30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c004c90 tx=0x7f4f6c005e50 comp rx=0 tx=0).stop 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3248162241 shutdown_connections 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d9be4e63a0 0x55d9be4e87c0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d9be4793d0 0x55d9be4866f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d9be47ac20 0x55d9be489c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 --2- 172.21.15.12:0/3248162241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9be479d30 0x55d9be486c30 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3248162241 >> 172.21.15.12:0/3248162241 conn(0x55d9be3a87e0 msgr2=0x55d9be480fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f61ffb700 0 client.18345 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.345+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3248162241 shutdown_connections 2023-12-11T20:25:46.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.346+0000 7f4f9465bb80 1 -- 172.21.15.12:0/3248162241 wait complete. 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.346+0000 7f4f9465bb80 20 client.18345 trim_cache size 0 max 16384 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout: "2d20b7f5-8362-4ce6-a8eb-b22fec7942e9": { 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "2d20b7f5-8362-4ce6-a8eb-b22fec7942e9", 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:25:46.350 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:25:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.346+0000 7f4f80dff700 1 -- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f680a1500 msgr2=0x7f4f680a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.346+0000 7f4f80dff700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f680a1500 0x7f4f680a39c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4f74004b80 tx=0x7f4f74004ad0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.346+0000 7f4f80dff700 1 -- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c103040 msgr2=0x7f4f7c1a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.346+0000 7f4f80dff700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c103040 0x7f4f7c1a0ad0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400ef30 tx=0x7f4f7400c3a0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.347+0000 7f4f80dff700 1 -- 172.21.15.12:0/2246564740 shutdown_connections 2023-12-11T20:25:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.347+0000 7f4f80dff700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4f680a1500 0x7f4f680a39c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.347+0000 7f4f80dff700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f7c1014b0 0x7f4f7c199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.347+0000 7f4f80dff700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f7c103040 0x7f4f7c1a0ad0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.347+0000 7f4f80dff700 1 --2- 172.21.15.12:0/2246564740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f7c1026a0 0x7f4f7c199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.347+0000 7f4f80dff700 1 -- 172.21.15.12:0/2246564740 >> 172.21.15.12:0/2246564740 conn(0x7f4f7c0fca00 msgr2=0x7f4f7c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.347+0000 7f4f80dff700 1 -- 172.21.15.12:0/2246564740 shutdown_connections 2023-12-11T20:25:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:25:46.347+0000 7f4f80dff700 1 -- 172.21.15.12:0/2246564740 wait complete. 2023-12-11T20:25:46.366 INFO:tasks.cephfs.filesystem:scrub status for tag:2d20b7f5-8362-4ce6-a8eb-b22fec7942e9 - {'path': '/', 'tag': '2d20b7f5-8362-4ce6-a8eb-b22fec7942e9', 'options': 'recursive,force'} 2023-12-11T20:25:46.446 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:25:46.032+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v194>,<0x10000000003/client.0 v196>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v213>,<0x10000000001/sv_0 v237>,<0x10000000000/_nogroup v221>,<0x1/volumes v213>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:46.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:46 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:46.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:46 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:25:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:25:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:46.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:46 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:47.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:47 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:47 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:47 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:25:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:47 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:47 smithi032 ceph-mon[132488]: pgmap v671: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:25:47.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:47 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:47 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:47 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:25:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:47 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:47.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:47 smithi039 ceph-mon[102205]: pgmap v671: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:25:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:47 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:47 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:47 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:25:47.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:47 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:25:47.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:47 smithi012 ceph-mon[128787]: pgmap v671: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:25:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:49 smithi032 ceph-mon[132488]: pgmap v672: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:25:49.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:49 smithi039 ceph-mon[102205]: pgmap v672: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:25:49.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:49 smithi012 ceph-mon[128787]: pgmap v672: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 27 op/s 2023-12-11T20:25:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:51 smithi039 ceph-mon[102205]: pgmap v673: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:25:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:51 smithi012 ceph-mon[128787]: pgmap v673: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:25:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:51 smithi032 ceph-mon[132488]: pgmap v673: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.812+0000 7fd70dfff700 1 -- 172.21.15.12:0/211671035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd708101f50 msgr2=0x7fd708108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.812+0000 7fd70dfff700 1 --2- 172.21.15.12:0/211671035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd708101f50 0x7fd708108800 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fd70000b0d0 tx=0x7fd70000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.812+0000 7fd70dfff700 1 -- 172.21.15.12:0/211671035 shutdown_connections 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.812+0000 7fd70dfff700 1 --2- 172.21.15.12:0/211671035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7081003c0 0x7fd7081007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.812+0000 7fd70dfff700 1 --2- 172.21.15.12:0/211671035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd708101f50 0x7fd708108800 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.812+0000 7fd70dfff700 1 --2- 172.21.15.12:0/211671035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7081015b0 0x7fd708101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.812+0000 7fd70dfff700 1 -- 172.21.15.12:0/211671035 >> 172.21.15.12:0/211671035 conn(0x7fd7080fb930 msgr2=0x7fd7080fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.813+0000 7fd70dfff700 1 -- 172.21.15.12:0/211671035 shutdown_connections 2023-12-11T20:25:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.813+0000 7fd70dfff700 1 -- 172.21.15.12:0/211671035 wait complete. 2023-12-11T20:25:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd70dfff700 1 Processor -- start 2023-12-11T20:25:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd70dfff700 1 -- start start 2023-12-11T20:25:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd70dfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7081003c0 0x7fd7081042b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd70dfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7081015b0 0x7fd708102990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd70dfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd708101f50 0x7fd708102ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd70dfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081035d0 con 0x7fd7081015b0 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd70dfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd708103740 con 0x7fd708101f50 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd70dfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081a14e0 con 0x7fd7081003c0 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.814+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7081015b0 0x7fd708102990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7081015b0 0x7fd708102990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51290/0 (socket says 172.21.15.12:51290) 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd706ffd700 1 -- 172.21.15.12:0/95515641 learned_addr learned my addr 172.21.15.12:0/95515641 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd707fff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd708101f50 0x7fd708102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd7077fe700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7081003c0 0x7fd7081042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd707fff700 1 -- 172.21.15.12:0/95515641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7081003c0 msgr2=0x7fd7081042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd707fff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7081003c0 0x7fd7081042b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd707fff700 1 -- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7081015b0 msgr2=0x7fd708102990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd707fff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7081015b0 0x7fd708102990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd707fff700 1 -- 172.21.15.12:0/95515641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700009d00 con 0x7fd708101f50 2023-12-11T20:25:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.815+0000 7fd707fff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd708101f50 0x7fd708102ed0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd70000b770 tx=0x7fd70000ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.816+0000 7fd704ff9700 1 -- 172.21.15.12:0/95515641 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000e040 con 0x7fd708101f50 2023-12-11T20:25:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.816+0000 7fd70dfff700 1 -- 172.21.15.12:0/95515641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7081a16e0 con 0x7fd708101f50 2023-12-11T20:25:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.816+0000 7fd704ff9700 1 -- 172.21.15.12:0/95515641 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7000094b0 con 0x7fd708101f50 2023-12-11T20:25:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.816+0000 7fd704ff9700 1 -- 172.21.15.12:0/95515641 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70001b450 con 0x7fd708101f50 2023-12-11T20:25:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.816+0000 7fd70dfff700 1 -- 172.21.15.12:0/95515641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7081a1bb0 con 0x7fd708101f50 2023-12-11T20:25:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.821+0000 7fd704ff9700 1 -- 172.21.15.12:0/95515641 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd70001d480 con 0x7fd708101f50 2023-12-11T20:25:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.822+0000 7fd721961b80 1 Processor -- start 2023-12-11T20:25:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.822+0000 7fd721961b80 1 -- start start 2023-12-11T20:25:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.822+0000 7fd721961b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.822+0000 7fd721961b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7d8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.822+0000 7fd721961b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d8720 0x55a26a7d8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.822+0000 7fd721961b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a732af0 con 0x55a26a7d8720 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.822+0000 7fd721961b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a730410 con 0x55a26a7d7830 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.822+0000 7fd721961b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a72bd00 con 0x55a26a7d6ed0 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d8720 0x55a26a7d8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:46398/0 (socket says 172.21.15.12:46398) 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 -- 172.21.15.12:0/3419497653 learned_addr learned my addr 172.21.15.12:0/3419497653 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd7077fe700 1 --2- 172.21.15.12:0/3419497653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7d8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 -- 172.21.15.12:0/3419497653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d6ed0 msgr2=0x55a26a7d72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 --2- 172.21.15.12:0/3419497653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 -- 172.21.15.12:0/3419497653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 msgr2=0x55a26a7d8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 --2- 172.21.15.12:0/3419497653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7d8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd706ffd700 1 -- 172.21.15.12:0/3419497653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a26a5a85d0 con 0x55a26a7d8720 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.823+0000 7fd704ff9700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd6f00a1470 0x7fd6f00a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.824+0000 7fd706ffd700 1 --2- 172.21.15.12:0/3419497653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d8720 0x55a26a7d8ba0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005c50 tx=0x7fd6fc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd18ceebdb1269f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.824+0000 7fd704ff9700 1 -- 172.21.15.12:0/95515641 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd7000ce5d0 con 0x7fd708101f50 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.824+0000 7fd7077fe700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd6f00a1470 0x7fd6f00a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.824+0000 7fd6edffb700 1 -- 172.21.15.12:0/3419497653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc004830 con 0x55a26a7d8720 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.824+0000 7fd6edffb700 1 -- 172.21.15.12:0/3419497653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6fc004e20 con 0x55a26a7d8720 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.824+0000 7fd6edffb700 1 -- 172.21.15.12:0/3419497653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc00f480 con 0x55a26a7d8720 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 -- 172.21.15.12:0/3419497653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d8720 msgr2=0x55a26a7d8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd7077fe700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd6f00a1470 0x7fd6f00a3930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd708101410 tx=0x7fd6f8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 --2- 172.21.15.12:0/3419497653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d8720 0x55a26a7d8ba0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005c50 tx=0x7fd6fc00b780 comp rx=0 tx=0).stop 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 -- 172.21.15.12:0/3419497653 shutdown_connections 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 --2- 172.21.15.12:0/3419497653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d8720 0x55a26a7d8ba0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 --2- 172.21.15.12:0/3419497653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 --2- 172.21.15.12:0/3419497653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7d8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 -- 172.21.15.12:0/3419497653 >> 172.21.15.12:0/3419497653 conn(0x55a26a706780 msgr2=0x55a26a7d3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 -- 172.21.15.12:0/3419497653 shutdown_connections 2023-12-11T20:25:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.825+0000 7fd721961b80 1 -- 172.21.15.12:0/3419497653 wait complete. 2023-12-11T20:25:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.826+0000 7fd721961b80 1 -- start start 2023-12-11T20:25:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.826+0000 7fd721961b80 1 Processor -- start 2023-12-11T20:25:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd721961b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd721961b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 0x55a26a7e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd721961b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7e8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd721961b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a6e5500 con 0x55a26a7d6ed0 2023-12-11T20:25:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd721961b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a6e51a0 con 0x55a26a7d8720 2023-12-11T20:25:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd721961b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a5aa8c0 con 0x55a26a7d7830 2023-12-11T20:25:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd721961b80 10 client.0 _ll_register_callbacks cb 0x55a26a610a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 0x55a26a7e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51302/0 (socket says 172.21.15.12:51302) 2023-12-11T20:25:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd7077fe700 1 -- 172.21.15.12:0/1183237019 learned_addr learned my addr 172.21.15.12:0/1183237019 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.827+0000 7fd707fff700 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd7077fe700 1 -- 172.21.15.12:0/1183237019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 msgr2=0x55a26a7e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd7077fe700 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 0x55a26a7e14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd7077fe700 1 -- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 msgr2=0x55a26a7e8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd7077fe700 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7e8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd7077fe700 1 -- 172.21.15.12:0/1183237019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc01a040 con 0x55a26a7d6ed0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd707fff700 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7e8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd7077fe700 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e0f70 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80095f0 tx=0x7fd6f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90de4e33224913e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd6e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/1183237019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8017070 con 0x55a26a7d6ed0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/1183237019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd6f8012d00 con 0x55a26a7d6ed0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.828+0000 7fd721961b80 1 -- 172.21.15.12:0/1183237019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a26a7ca730 con 0x55a26a7d6ed0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/1183237019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6f8012ec0 con 0x55a26a7d6ed0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd721961b80 10 client.18357 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd721961b80 1 -- 172.21.15.12:0/1183237019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a26a554d80 con 0x55a26a7d6ed0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/1183237019 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a26a7ca730 con 0x55a26a7d6ed0 2023-12-11T20:25:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/1183237019 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd6f80295d0 con 0x55a26a7d6ed0 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd721961b80 10 client.18357 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd721961b80 10 client.18357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd721961b80 20 client.18357 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd721961b80 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a26a7ecd50 0x55a26a7ef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd721961b80 4 client.18357 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.829+0000 7fd721961b80 1 -- 172.21.15.12:0/1183237019 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a26a7a6ee0 con 0x55a26a7ecd50 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.830+0000 7fd706ffd700 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a26a7ecd50 0x55a26a7ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.830+0000 7fd706ffd700 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a26a7ecd50 0x55a26a7ef170 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16af4eb3c3f334f4 server_cookie=84deb6f96004a2cf in_seq=0 out_seq=0 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.830+0000 7fd6e6ffd700 10 client.18357 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/1183237019 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a26a7a6ee0 con 0x55a26a7ecd50 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd6e6ffd700 10 client.18357 handle_command_reply: tid=0 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 client.18357 shutdown 2023-12-11T20:25:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 -- 172.21.15.12:0/1183237019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 msgr2=0x55a26a7e0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e0f70 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80095f0 tx=0x7fd6f80047c0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 -- 172.21.15.12:0/1183237019 shutdown_connections 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a26a7ecd50 0x55a26a7ef170 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7e8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e0f70 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 --2- 172.21.15.12:0/1183237019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 0x55a26a7e14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd6e6ffd700 0 client.18357 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.831+0000 7fd721961b80 1 -- 172.21.15.12:0/1183237019 >> 172.21.15.12:0/1183237019 conn(0x55a26a706780 msgr2=0x55a26a7d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.832+0000 7fd721961b80 1 -- 172.21.15.12:0/1183237019 shutdown_connections 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.832+0000 7fd721961b80 1 -- 172.21.15.12:0/1183237019 wait complete. 2023-12-11T20:25:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.832+0000 7fd721961b80 20 client.18357 trim_cache size 0 max 16384 2023-12-11T20:25:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.849+0000 7fd721961b80 1 Processor -- start 2023-12-11T20:25:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.849+0000 7fd721961b80 1 -- start start 2023-12-11T20:25:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.849+0000 7fd721961b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.849+0000 7fd721961b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 0x55a26a7e8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.849+0000 7fd721961b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.849+0000 7fd721961b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a7e08d0 con 0x55a26a7d6ed0 2023-12-11T20:25:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.849+0000 7fd721961b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a7d7f30 con 0x55a26a7d8720 2023-12-11T20:25:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.849+0000 7fd721961b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a7de980 con 0x55a26a7d7830 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51306/0 (socket says 172.21.15.12:51306) 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 -- 172.21.15.12:0/470256680 learned_addr learned my addr 172.21.15.12:0/470256680 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd706ffd700 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 0x55a26a7e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd707fff700 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 -- 172.21.15.12:0/470256680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 msgr2=0x55a26a7e8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 0x55a26a7e8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 -- 172.21.15.12:0/470256680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 msgr2=0x55a26a7f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7f3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 -- 172.21.15.12:0/470256680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a26a53dc00 con 0x55a26a7d6ed0 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd707fff700 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:25:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd7077fe700 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d8b60 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8029980 tx=0x7fd6f8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56a9a21fdb2bb1b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd6ee7fc700 1 -- 172.21.15.12:0/470256680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8029b70 con 0x55a26a7d6ed0 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.850+0000 7fd6ee7fc700 1 -- 172.21.15.12:0/470256680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6f8029cd0 con 0x55a26a7d6ed0 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd6ee7fc700 1 -- 172.21.15.12:0/470256680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8005280 con 0x55a26a7d6ed0 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 -- 172.21.15.12:0/470256680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 msgr2=0x55a26a7d8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d8b60 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8029980 tx=0x7fd6f8009b20 comp rx=0 tx=0).stop 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 -- 172.21.15.12:0/470256680 shutdown_connections 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d8720 0x55a26a7f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7d8b60 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 --2- 172.21.15.12:0/470256680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d7830 0x55a26a7e8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 -- 172.21.15.12:0/470256680 >> 172.21.15.12:0/470256680 conn(0x55a26a706780 msgr2=0x55a26a7ded00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 -- 172.21.15.12:0/470256680 shutdown_connections 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.851+0000 7fd721961b80 1 -- 172.21.15.12:0/470256680 wait complete. 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.852+0000 7fd721961b80 1 -- start start 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.852+0000 7fd721961b80 1 Processor -- start 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd721961b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd721961b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd721961b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d8720 0x55a26a7e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd721961b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a7e7620 con 0x55a26a7d6ed0 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd721961b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a7e7790 con 0x55a26a7d7830 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd721961b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26a7e7950 con 0x55a26a7d8720 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd721961b80 10 client.0 _ll_register_callbacks cb 0x55a26a610a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51308/0 (socket says 172.21.15.12:51308) 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd7077fe700 1 -- 172.21.15.12:0/3639031288 learned_addr learned my addr 172.21.15.12:0/3639031288 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:25:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd707fff700 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d8720 0x55a26a7e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd706ffd700 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd7077fe700 1 -- 172.21.15.12:0/3639031288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d8720 msgr2=0x55a26a7e70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd7077fe700 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d8720 0x55a26a7e70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd7077fe700 1 -- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 msgr2=0x55a26a7e60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd7077fe700 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7e60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd7077fe700 1 -- 172.21.15.12:0/3639031288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a26a554d80 con 0x55a26a7d6ed0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.853+0000 7fd706ffd700 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.854+0000 7fd7077fe700 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e5b90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8029a50 tx=0x7fd6f8029c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f29d27988ccbde4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.854+0000 7fd6e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.854+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/3639031288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8004950 con 0x55a26a7d6ed0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.854+0000 7fd721961b80 1 -- 172.21.15.12:0/3639031288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6fc004e20 con 0x55a26a7d6ed0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.854+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/3639031288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd6f8004ab0 con 0x55a26a7d6ed0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.854+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/3639031288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6f8004c70 con 0x55a26a7d6ed0 2023-12-11T20:25:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.854+0000 7fd721961b80 10 client.18363 fetch_fsmap learned FSMap version 26 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.854+0000 7fd721961b80 1 -- 172.21.15.12:0/3639031288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a26a57b1f0 con 0x55a26a7d6ed0 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/3639031288 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6fc004e20 con 0x55a26a7d6ed0 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/3639031288 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd6f80334e0 con 0x55a26a7d6ed0 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd721961b80 10 client.18363 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd721961b80 10 client.18363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd721961b80 20 client.18363 populate_metadata read hostname 'smithi012' 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd721961b80 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a26a8438b0 0x55a26a845cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd721961b80 4 client.18363 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:25:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd721961b80 1 -- 172.21.15.12:0/3639031288 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a26a6f1f70 con 0x55a26a8438b0 2023-12-11T20:25:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.855+0000 7fd706ffd700 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a26a8438b0 0x55a26a845cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:25:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.856+0000 7fd706ffd700 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a26a8438b0 0x55a26a845cd0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2dc234599d6d72 server_cookie=a69ff51784aa9766 in_seq=0 out_seq=0 2023-12-11T20:25:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.856+0000 7fd6e6ffd700 10 client.18363 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd6e6ffd700 1 -- 172.21.15.12:0/3639031288 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a26a6f1f70 con 0x55a26a8438b0 2023-12-11T20:25:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd6e6ffd700 10 client.18363 handle_command_reply: tid=0 2023-12-11T20:25:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 client.18363 shutdown 2023-12-11T20:25:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 -- 172.21.15.12:0/3639031288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 msgr2=0x55a26a7e5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e5b90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8029a50 tx=0x7fd6f8029c50 comp rx=0 tx=0).stop 2023-12-11T20:25:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 -- 172.21.15.12:0/3639031288 shutdown_connections 2023-12-11T20:25:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a26a8438b0 0x55a26a845cd0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a26a7d8720 0x55a26a7e70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a26a7d6ed0 0x55a26a7e5b90 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd6e6ffd700 0 client.18363 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 --2- 172.21.15.12:0/3639031288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a26a7d7830 0x55a26a7e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 -- 172.21.15.12:0/3639031288 >> 172.21.15.12:0/3639031288 conn(0x55a26a706780 msgr2=0x55a26a7f3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 -- 172.21.15.12:0/3639031288 shutdown_connections 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.866+0000 7fd721961b80 1 -- 172.21.15.12:0/3639031288 wait complete. 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd721961b80 20 client.18363 trim_cache size 0 max 16384 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:25:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:25:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 -- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd6f00a1470 msgr2=0x7fd6f00a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd6f00a1470 0x7fd6f00a3930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd708101410 tx=0x7fd6f8009260 comp rx=0 tx=0).stop 2023-12-11T20:25:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 -- 172.21.15.12:0/95515641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd708101f50 msgr2=0x7fd708102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:25:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd708101f50 0x7fd708102ed0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd70000b770 tx=0x7fd70000ccc0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 -- 172.21.15.12:0/95515641 shutdown_connections 2023-12-11T20:25:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd6f00a1470 0x7fd6f00a3930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd708101f50 0x7fd708102ed0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7081003c0 0x7fd7081042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 --2- 172.21.15.12:0/95515641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7081015b0 0x7fd708102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:25:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.867+0000 7fd70dfff700 1 -- 172.21.15.12:0/95515641 >> 172.21.15.12:0/95515641 conn(0x7fd7080fb930 msgr2=0x7fd7080fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:25:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.868+0000 7fd70dfff700 1 -- 172.21.15.12:0/95515641 shutdown_connections 2023-12-11T20:25:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:25:52.868+0000 7fd70dfff700 1 -- 172.21.15.12:0/95515641 wait complete. 2023-12-11T20:25:54.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:54 smithi032 ceph-mon[132488]: pgmap v674: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:54.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:54 smithi039 ceph-mon[102205]: pgmap v674: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:54 smithi012 ceph-mon[128787]: pgmap v674: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:25:56.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:56 smithi032 ceph-mon[132488]: pgmap v675: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:25:56.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:56 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:25:56.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:56 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:25:56.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:56 smithi039 ceph-mon[102205]: pgmap v675: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:25:56.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:56 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:25:56.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:56 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:25:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:56 smithi012 ceph-mon[128787]: pgmap v675: 97 pgs: 97 active+clean; 7.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:25:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:56 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:25:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:56 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:25:57.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:57 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:25:57.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:57 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:25:57.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:57 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:25:58.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:25:58 smithi032 ceph-mon[132488]: pgmap v676: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:25:58.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:25:58 smithi039 ceph-mon[102205]: pgmap v676: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:25:58.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:25:58 smithi012 ceph-mon[128787]: pgmap v676: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:26:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:00 smithi032 ceph-mon[132488]: pgmap v677: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:26:00.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:00 smithi039 ceph-mon[102205]: pgmap v677: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:26:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:00 smithi012 ceph-mon[128787]: pgmap v677: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:26:02.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:02 smithi032 ceph-mon[132488]: pgmap v678: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:26:02.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:02 smithi039 ceph-mon[102205]: pgmap v678: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:26:02.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:02 smithi012 ceph-mon[128787]: pgmap v678: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 19 op/s 2023-12-11T20:26:04.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:04 smithi032 ceph-mon[132488]: pgmap v679: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:26:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:04 smithi039 ceph-mon[102205]: pgmap v679: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:26:04.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:04 smithi012 ceph-mon[128787]: pgmap v679: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:26:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 -- 172.21.15.12:0/3907315073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c81046a0 msgr2=0x7f43c8106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 --2- 172.21.15.12:0/3907315073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c81046a0 0x7f43c8106a90 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009990 tx=0x7f43bc009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 -- 172.21.15.12:0/3907315073 shutdown_connections 2023-12-11T20:26:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 --2- 172.21.15.12:0/3907315073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c8106fd0 0x7f43c8109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 --2- 172.21.15.12:0/3907315073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43c8101d70 0x7f43c8104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 --2- 172.21.15.12:0/3907315073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c81046a0 0x7f43c8106a90 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 -- 172.21.15.12:0/3907315073 >> 172.21.15.12:0/3907315073 conn(0x7f43c80fb780 msgr2=0x7f43c80fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 -- 172.21.15.12:0/3907315073 shutdown_connections 2023-12-11T20:26:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.031+0000 7f43c759e700 1 -- 172.21.15.12:0/3907315073 wait complete. 2023-12-11T20:26:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.032+0000 7f43c759e700 1 Processor -- start 2023-12-11T20:26:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c759e700 1 -- start start 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c8101d70 0x7f43c8101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c81046a0 0x7f43c80ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43c8106fd0 0x7f43c8100260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8100a00 con 0x7f43c8101d70 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8100b70 con 0x7f43c81046a0 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c81a11d0 con 0x7f43c8106fd0 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c8101d70 0x7f43c8101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c8101d70 0x7f43c8101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46296/0 (socket says 172.21.15.12:46296) 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.033+0000 7f43c659c700 1 -- 172.21.15.12:0/321327448 learned_addr learned my addr 172.21.15.12:0/321327448 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c81046a0 0x7f43c80ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c6d9d700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43c8106fd0 0x7f43c8100260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c659c700 1 -- 172.21.15.12:0/321327448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43c8106fd0 msgr2=0x7f43c8100260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c659c700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43c8106fd0 0x7f43c8100260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c659c700 1 -- 172.21.15.12:0/321327448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c81046a0 msgr2=0x7f43c80ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c659c700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c81046a0 0x7f43c80ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c659c700 1 -- 172.21.15.12:0/321327448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0095f0 con 0x7f43c8101d70 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c659c700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c8101d70 0x7f43c8101690 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f43b800e9a0 tx=0x7f43b800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43b77fe700 1 -- 172.21.15.12:0/321327448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8009790 con 0x7f43c8101d70 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43b77fe700 1 -- 172.21.15.12:0/321327448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43b8010430 con 0x7f43c8101d70 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43b77fe700 1 -- 172.21.15.12:0/321327448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8018680 con 0x7f43c8101d70 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.034+0000 7f43c759e700 1 -- 172.21.15.12:0/321327448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c81a1460 con 0x7f43c8101d70 2023-12-11T20:26:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.035+0000 7f43c759e700 1 -- 172.21.15.12:0/321327448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c81a1920 con 0x7f43c8101d70 2023-12-11T20:26:06.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.038+0000 7f43b77fe700 1 -- 172.21.15.12:0/321327448 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f43b80105a0 con 0x7f43c8101d70 2023-12-11T20:26:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.039+0000 7f43b77fe700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43b00a14f0 0x7f43b00a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.039+0000 7f43e053cb80 1 Processor -- start 2023-12-11T20:26:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.039+0000 7f43b77fe700 1 -- 172.21.15.12:0/321327448 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43b8014070 con 0x7f43c8101d70 2023-12-11T20:26:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.039+0000 7f43e053cb80 1 -- start start 2023-12-11T20:26:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.039+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43b00a14f0 0x7f43b00a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938427eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x559384283640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384285f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43e053cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593841d9af0 con 0x559384283b80 2023-12-11T20:26:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43e053cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593841d7410 con 0x55938427e770 2023-12-11T20:26:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43e053cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593841d2d00 con 0x55938427f0d0 2023-12-11T20:26:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43b00a14f0 0x7f43b00a39b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00b670 tx=0x7f43bc005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384285f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384285f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46304/0 (socket says 172.21.15.12:46304) 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43c6d9d700 1 -- 172.21.15.12:0/416469182 learned_addr learned my addr 172.21.15.12:0/416469182 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.040+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x559384283640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43c659c700 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938427eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43c6d9d700 1 -- 172.21.15.12:0/416469182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 msgr2=0x559384283640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43c6d9d700 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x559384283640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43c6d9d700 1 -- 172.21.15.12:0/416469182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 msgr2=0x55938427eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43c6d9d700 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938427eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43c6d9d700 1 -- 172.21.15.12:0/416469182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55938404f5d0 con 0x559384283b80 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43c659c700 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938427eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43c6d9d700 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384285f90 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009440 tx=0x7f43c0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8422432fbe4938 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:06.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.041+0000 7f43b4ff9700 1 -- 172.21.15.12:0/416469182 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000e070 con 0x559384283b80 2023-12-11T20:26:06.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43b4ff9700 1 -- 172.21.15.12:0/416469182 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43c000f040 con 0x559384283b80 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43b4ff9700 1 -- 172.21.15.12:0/416469182 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0015ab0 con 0x559384283b80 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43e053cb80 1 -- 172.21.15.12:0/416469182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 msgr2=0x559384285f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43e053cb80 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384285f90 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009440 tx=0x7f43c0009920 comp rx=0 tx=0).stop 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43e053cb80 1 -- 172.21.15.12:0/416469182 shutdown_connections 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43e053cb80 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938427eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43e053cb80 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384285f90 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43e053cb80 1 --2- 172.21.15.12:0/416469182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x559384283640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.042+0000 7f43e053cb80 1 -- 172.21.15.12:0/416469182 >> 172.21.15.12:0/416469182 conn(0x5593841ad780 msgr2=0x55938427ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.043+0000 7f43e053cb80 1 -- 172.21.15.12:0/416469182 shutdown_connections 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.043+0000 7f43e053cb80 1 -- 172.21.15.12:0/416469182 wait complete. 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.043+0000 7f43e053cb80 1 -- start start 2023-12-11T20:26:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.044+0000 7f43e053cb80 1 Processor -- start 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.044+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x559384287eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.044+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x5593842883f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.044+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.044+0000 7f43e053cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55938418c500 con 0x559384283b80 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.044+0000 7f43e053cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55938418c1a0 con 0x55938427e770 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.044+0000 7f43e053cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593840518c0 con 0x55938427f0d0 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.044+0000 7f43e053cb80 10 client.0 _ll_register_callbacks cb 0x5593840b7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x559384287eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x559384287eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40598/0 (socket says 172.21.15.12:40598) 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46316/0 (socket says 172.21.15.12:46316) 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 -- 172.21.15.12:0/4162255578 learned_addr learned my addr 172.21.15.12:0/4162255578 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x5593842883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 -- 172.21.15.12:0/4162255578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 msgr2=0x5593842883f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x5593842883f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 -- 172.21.15.12:0/4162255578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 msgr2=0x55938428f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 -- 172.21.15.12:0/4162255578 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c81a1920 con 0x55938427e770 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43c659c700 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x559384287eb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f43b800f010 tx=0x7f43b809a7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3673dcdf07bb0e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.045+0000 7f43adffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.046+0000 7f43adffb700 1 -- 172.21.15.12:0/4162255578 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b809a2a0 con 0x55938427e770 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.046+0000 7f43e053cb80 1 -- 172.21.15.12:0/4162255578 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559384271730 con 0x55938427e770 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.046+0000 7f43adffb700 1 -- 172.21.15.12:0/4162255578 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43b809e3f0 con 0x55938427e770 2023-12-11T20:26:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.046+0000 7f43adffb700 1 -- 172.21.15.12:0/4162255578 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43b80a2630 con 0x55938427e770 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.046+0000 7f43e053cb80 10 client.27986 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.046+0000 7f43e053cb80 1 -- 172.21.15.12:0/4162255578 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f43c00090f0 con 0x55938427e770 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.046+0000 7f43adffb700 1 -- 172.21.15.12:0/4162255578 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559384271730 con 0x55938427e770 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.046+0000 7f43adffb700 1 -- 172.21.15.12:0/4162255578 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f43b807c020 con 0x55938427e770 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.047+0000 7f43e053cb80 10 client.27986 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.047+0000 7f43e053cb80 10 client.27986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.047+0000 7f43e053cb80 20 client.27986 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.047+0000 7f43e053cb80 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559384293c00 0x559384296020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.047+0000 7f43e053cb80 4 client.27986 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.047+0000 7f43e053cb80 1 -- 172.21.15.12:0/4162255578 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55938424dee0 con 0x559384293c00 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.047+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559384293c00 0x559384296020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.048+0000 7f43adffb700 10 client.27986 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.048+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559384293c00 0x559384296020 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f5b25525472b539 server_cookie=7ad4cfd367df13e0 in_seq=0 out_seq=0 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43adffb700 1 -- 172.21.15.12:0/4162255578 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55938424dee0 con 0x559384293c00 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43adffb700 10 client.27986 handle_command_reply: tid=0 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 client.27986 shutdown 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 -- 172.21.15.12:0/4162255578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 msgr2=0x559384287eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x559384287eb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f43b800f010 tx=0x7f43b809a7e0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 -- 172.21.15.12:0/4162255578 shutdown_connections 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559384293c00 0x559384296020 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x559384287eb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 --2- 172.21.15.12:0/4162255578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x5593842883f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 -- 172.21.15.12:0/4162255578 >> 172.21.15.12:0/4162255578 conn(0x5593841ad780 msgr2=0x55938427b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43adffb700 0 client.27986 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 -- 172.21.15.12:0/4162255578 shutdown_connections 2023-12-11T20:26:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 1 -- 172.21.15.12:0/4162255578 wait complete. 2023-12-11T20:26:06.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.049+0000 7f43e053cb80 20 client.27986 trim_cache size 0 max 16384 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.069+0000 7f43e053cb80 1 Processor -- start 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43e053cb80 1 -- start start 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427e770 0x55938427f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427f0d0 0x55938428f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384273240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43e053cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559384291170 con 0x559384283b80 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43e053cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55938427a210 con 0x55938427f0d0 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43e053cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593842714c0 con 0x55938427e770 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384273240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43c659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427e770 0x55938427f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384273240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46324/0 (socket says 172.21.15.12:46324) 2023-12-11T20:26:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.070+0000 7f43c6d9d700 1 -- 172.21.15.12:0/2072495594 learned_addr learned my addr 172.21.15.12:0/2072495594 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/2072495594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427f0d0 0x55938428f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43c659c700 1 -- 172.21.15.12:0/2072495594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427f0d0 msgr2=0x55938428f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43c659c700 1 --2- 172.21.15.12:0/2072495594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427f0d0 0x55938428f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43c659c700 1 -- 172.21.15.12:0/2072495594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 msgr2=0x559384273240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43c659c700 1 --2- 172.21.15.12:0/2072495594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384273240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43c659c700 1 -- 172.21.15.12:0/2072495594 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559383ffbd80 con 0x55938427e770 2023-12-11T20:26:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43c659c700 1 --2- 172.21.15.12:0/2072495594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427e770 0x55938427f4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43b80967a0 tx=0x7f43b8098850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60de67174f0c3d41 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43b57fa700 1 -- 172.21.15.12:0/2072495594 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b80a21a0 con 0x55938427e770 2023-12-11T20:26:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43b57fa700 1 -- 172.21.15.12:0/2072495594 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43b809e3f0 con 0x55938427e770 2023-12-11T20:26:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.071+0000 7f43b57fa700 1 -- 172.21.15.12:0/2072495594 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b80b8350 con 0x55938427e770 2023-12-11T20:26:06.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 -- 172.21.15.12:0/2072495594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427e770 msgr2=0x55938427f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 --2- 172.21.15.12:0/2072495594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427e770 0x55938427f4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43b80967a0 tx=0x7f43b8098850 comp rx=0 tx=0).stop 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 -- 172.21.15.12:0/2072495594 shutdown_connections 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 --2- 172.21.15.12:0/2072495594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x559384273240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 --2- 172.21.15.12:0/2072495594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427e770 0x55938427f4b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 --2- 172.21.15.12:0/2072495594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427f0d0 0x55938428f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 -- 172.21.15.12:0/2072495594 >> 172.21.15.12:0/2072495594 conn(0x5593841ad780 msgr2=0x559384285f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 -- 172.21.15.12:0/2072495594 shutdown_connections 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.072+0000 7f43e053cb80 1 -- 172.21.15.12:0/2072495594 wait complete. 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.073+0000 7f43e053cb80 1 -- start start 2023-12-11T20:26:06.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.073+0000 7f43e053cb80 1 Processor -- start 2023-12-11T20:26:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938428ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x55938428d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43e053cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43e053cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55938428e8a0 con 0x559384283b80 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43e053cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55938428ea10 con 0x55938427e770 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43e053cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55938428ebd0 con 0x55938427f0d0 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43e053cb80 10 client.0 _ll_register_callbacks cb 0x5593840b7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46336/0 (socket says 172.21.15.12:46336) 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43c6d9d700 1 -- 172.21.15.12:0/3737691484 learned_addr learned my addr 172.21.15.12:0/3737691484 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43c659c700 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938428ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.074+0000 7f43c5d9b700 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x55938428d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.075+0000 7f43c6d9d700 1 -- 172.21.15.12:0/3737691484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 msgr2=0x55938428d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.075+0000 7f43c6d9d700 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x55938428d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.075+0000 7f43c6d9d700 1 -- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 msgr2=0x55938428ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.075+0000 7f43c6d9d700 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938428ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.075+0000 7f43c6d9d700 1 -- 172.21.15.12:0/3737691484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c00090f0 con 0x559384283b80 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.075+0000 7f43c659c700 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938428ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.075+0000 7f43c6d9d700 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428e360 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f43c0018000 tx=0x7f43c0013780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab77a7decb801ee3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.075+0000 7f43adffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.076+0000 7f43adffb700 1 -- 172.21.15.12:0/3737691484 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000e040 con 0x559384283b80 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.076+0000 7f43e053cb80 1 -- 172.21.15.12:0/3737691484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43c000f040 con 0x559384283b80 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.076+0000 7f43adffb700 1 -- 172.21.15.12:0/3737691484 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43c0013d30 con 0x559384283b80 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.076+0000 7f43adffb700 1 -- 172.21.15.12:0/3737691484 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43c0013ef0 con 0x559384283b80 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.076+0000 7f43e053cb80 10 client.18381 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.076+0000 7f43e053cb80 1 -- 172.21.15.12:0/3737691484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559383fe4c00 con 0x559384283b80 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.076+0000 7f43adffb700 1 -- 172.21.15.12:0/3737691484 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43c000f040 con 0x559384283b80 2023-12-11T20:26:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.076+0000 7f43adffb700 1 -- 172.21.15.12:0/3737691484 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f43c001c070 con 0x559384283b80 2023-12-11T20:26:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.077+0000 7f43e053cb80 10 client.18381 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.077+0000 7f43e053cb80 10 client.18381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.077+0000 7f43e053cb80 20 client.18381 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.077+0000 7f43e053cb80 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5593842ead20 0x5593842ed140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.077+0000 7f43e053cb80 4 client.18381 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:26:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.077+0000 7f43e053cb80 1 -- 172.21.15.12:0/3737691484 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559384198f70 con 0x5593842ead20 2023-12-11T20:26:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.077+0000 7f43c659c700 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5593842ead20 0x5593842ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.078+0000 7f43c659c700 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5593842ead20 0x5593842ed140 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b5b1974065e226e server_cookie=8d1d265eb514e2f in_seq=0 out_seq=0 2023-12-11T20:26:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.078+0000 7f43adffb700 10 client.18381 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.088+0000 7f43adffb700 1 -- 172.21.15.12:0/3737691484 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559384198f70 con 0x5593842ead20 2023-12-11T20:26:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.088+0000 7f43adffb700 10 client.18381 handle_command_reply: tid=0 2023-12-11T20:26:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.088+0000 7f43e053cb80 1 client.18381 shutdown 2023-12-11T20:26:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.088+0000 7f43e053cb80 1 -- 172.21.15.12:0/3737691484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 msgr2=0x55938428e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.088+0000 7f43e053cb80 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428e360 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f43c0018000 tx=0x7f43c0013780 comp rx=0 tx=0).stop 2023-12-11T20:26:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.088+0000 7f43e053cb80 1 -- 172.21.15.12:0/3737691484 shutdown_connections 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.088+0000 7f43e053cb80 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5593842ead20 0x5593842ed140 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.089+0000 7f43e053cb80 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55938427e770 0x55938428ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.089+0000 7f43e053cb80 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559384283b80 0x55938428e360 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.089+0000 7f43e053cb80 1 --2- 172.21.15.12:0/3737691484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55938427f0d0 0x55938428d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.089+0000 7f43adffb700 0 client.18381 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.089+0000 7f43e053cb80 1 -- 172.21.15.12:0/3737691484 >> 172.21.15.12:0/3737691484 conn(0x5593841ad780 msgr2=0x559384273240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.089+0000 7f43e053cb80 1 -- 172.21.15.12:0/3737691484 shutdown_connections 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.089+0000 7f43e053cb80 1 -- 172.21.15.12:0/3737691484 wait complete. 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.089+0000 7f43e053cb80 20 client.18381 trim_cache size 0 max 16384 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:26:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:26:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:26:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:26:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 -- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43b00a14f0 msgr2=0x7f43b00a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43b00a14f0 0x7f43b00a39b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00b670 tx=0x7f43bc005fb0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 -- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c8101d70 msgr2=0x7f43c8101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c8101d70 0x7f43c8101690 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f43b800e9a0 tx=0x7f43b800ed60 comp rx=0 tx=0).stop 2023-12-11T20:26:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 -- 172.21.15.12:0/321327448 shutdown_connections 2023-12-11T20:26:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43b00a14f0 0x7f43b00a39b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43c8106fd0 0x7f43c8100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43c8101d70 0x7f43c8101690 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 --2- 172.21.15.12:0/321327448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c81046a0 0x7f43c80ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 -- 172.21.15.12:0/321327448 >> 172.21.15.12:0/321327448 conn(0x7f43c80fb780 msgr2=0x7f43c8103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 -- 172.21.15.12:0/321327448 shutdown_connections 2023-12-11T20:26:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:06.090+0000 7f43c759e700 1 -- 172.21.15.12:0/321327448 wait complete. 2023-12-11T20:26:06.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:06 smithi039 ceph-mon[102205]: pgmap v680: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:26:06.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:06 smithi012 ceph-mon[128787]: pgmap v680: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:26:06.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:06 smithi032 ceph-mon[132488]: pgmap v680: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:26:08.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:08 smithi039 ceph-mon[102205]: pgmap v681: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:08.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:08 smithi012 ceph-mon[128787]: pgmap v681: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:08.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:08 smithi032 ceph-mon[132488]: pgmap v681: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:10.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:10 smithi039 ceph-mon[102205]: pgmap v682: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:26:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:10 smithi012 ceph-mon[128787]: pgmap v682: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:26:10.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:10 smithi032 ceph-mon[132488]: pgmap v682: 97 pgs: 97 active+clean; 7.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:26:12.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:12 smithi039 ceph-mon[102205]: pgmap v683: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:12.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:12 smithi012 ceph-mon[128787]: pgmap v683: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:12.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:12 smithi032 ceph-mon[132488]: pgmap v683: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:14.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:14 smithi039 ceph-mon[102205]: pgmap v684: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:14.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:14 smithi012 ceph-mon[128787]: pgmap v684: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:14 smithi032 ceph-mon[132488]: pgmap v684: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:16.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:26:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 -- 172.21.15.12:0/2229053017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 msgr2=0x7f5d5c103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 --2- 172.21.15.12:0/2229053017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 0x7f5d5c103ad0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0099c0 tx=0x7f5d4c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 -- 172.21.15.12:0/2229053017 shutdown_connections 2023-12-11T20:26:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 --2- 172.21.15.12:0/2229053017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d5c105240 0x7f5d5c10baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 --2- 172.21.15.12:0/2229053017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 0x7f5d5c103ad0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 --2- 172.21.15.12:0/2229053017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d5c1048a0 0x7f5d5c104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 -- 172.21.15.12:0/2229053017 >> 172.21.15.12:0/2229053017 conn(0x7f5d5c0fec80 msgr2=0x7f5d5c1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 -- 172.21.15.12:0/2229053017 shutdown_connections 2023-12-11T20:26:16.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.603+0000 7f5d61dff700 1 -- 172.21.15.12:0/2229053017 wait complete. 2023-12-11T20:26:16.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.604+0000 7f5d61dff700 1 Processor -- start 2023-12-11T20:26:16.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.604+0000 7f5d61dff700 1 -- start start 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d61dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 0x7f5d5c1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d61dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d5c1048a0 0x7f5d5c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d61dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d5c105240 0x7f5d5c1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d61dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c1a1060 con 0x7f5d5c1036b0 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d61dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c1a11a0 con 0x7f5d5c105240 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d61dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c1a1330 con 0x7f5d5c1048a0 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 0x7f5d5c1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 0x7f5d5c1995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32792/0 (socket says 172.21.15.12:32792) 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/3840639942 learned_addr learned my addr 172.21.15.12:0/3840639942 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5affd700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d5c1048a0 0x7f5d5c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d5c105240 0x7f5d5c1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/3840639942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d5c1048a0 msgr2=0x7f5d5c199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d5c1048a0 0x7f5d5c199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/3840639942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d5c105240 msgr2=0x7f5d5c1a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d5c105240 0x7f5d5c1a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/3840639942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0095f0 con 0x7f5d5c1036b0 2023-12-11T20:26:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.605+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d5c105240 0x7f5d5c1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.606+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 0x7f5d5c1995d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009f50 tx=0x7f5d4c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.606+0000 7f5d58ff9700 1 -- 172.21.15.12:0/3840639942 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c01d070 con 0x7f5d5c1036b0 2023-12-11T20:26:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.606+0000 7f5d58ff9700 1 -- 172.21.15.12:0/3840639942 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d4c00bda0 con 0x7f5d5c1036b0 2023-12-11T20:26:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.606+0000 7f5d61dff700 1 -- 172.21.15.12:0/3840639942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5c1a15b0 con 0x7f5d5c1036b0 2023-12-11T20:26:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.606+0000 7f5d58ff9700 1 -- 172.21.15.12:0/3840639942 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c022c70 con 0x7f5d5c1036b0 2023-12-11T20:26:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.606+0000 7f5d61dff700 1 -- 172.21.15.12:0/3840639942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c1a1ab0 con 0x7f5d5c1036b0 2023-12-11T20:26:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.609+0000 7f5d58ff9700 1 -- 172.21.15.12:0/3840639942 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5d4c022470 con 0x7f5d5c1036b0 2023-12-11T20:26:16.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d75686b80 1 Processor -- start 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d75686b80 1 -- start start 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225ccbd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbdd30 0x56225ccbe640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 0x56225ccbf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d75686b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225cc18b50 con 0x56225ccbdd30 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d75686b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225cc16470 con 0x56225ccbd3d0 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d75686b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225cc11d60 con 0x56225ccbec20 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.611+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbdd30 0x56225ccbe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbdd30 0x56225ccbe640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32794/0 (socket says 172.21.15.12:32794) 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225ccbd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/605195747 learned_addr learned my addr 172.21.15.12:0/605195747 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d58ff9700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d440a1500 0x7f5d440a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5affd700 1 --2- 172.21.15.12:0/605195747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 0x56225ccbf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d58ff9700 1 -- 172.21.15.12:0/3840639942 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5d4c0cdf80 con 0x7f5d5c1036b0 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d440a1500 0x7f5d440a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/605195747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 msgr2=0x56225ccbf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/605195747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 0x56225ccbf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/605195747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 msgr2=0x56225ccbd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/605195747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225ccbd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/605195747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56225ca8e630 con 0x56225ccbdd30 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.612+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/605195747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbdd30 0x56225ccbe640 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0a3050 tx=0x7f5d4c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed2f5079c5eb00e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.613+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d440a1500 0x7f5d440a39c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5d540078e0 tx=0x7f5d54004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.613+0000 7f5d41ffb700 1 -- 172.21.15.12:0/605195747 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c09adc0 con 0x56225ccbdd30 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.613+0000 7f5d41ffb700 1 -- 172.21.15.12:0/605195747 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d4c0cbe90 con 0x56225ccbdd30 2023-12-11T20:26:16.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.613+0000 7f5d41ffb700 1 -- 172.21.15.12:0/605195747 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0a3580 con 0x56225ccbdd30 2023-12-11T20:26:16.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 -- 172.21.15.12:0/605195747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbdd30 msgr2=0x56225ccbe640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 --2- 172.21.15.12:0/605195747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbdd30 0x56225ccbe640 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0a3050 tx=0x7f5d4c00bf90 comp rx=0 tx=0).stop 2023-12-11T20:26:16.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 -- 172.21.15.12:0/605195747 shutdown_connections 2023-12-11T20:26:16.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 --2- 172.21.15.12:0/605195747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225ccbd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 --2- 172.21.15.12:0/605195747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 0x56225ccbf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 --2- 172.21.15.12:0/605195747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbdd30 0x56225ccbe640 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 -- 172.21.15.12:0/605195747 >> 172.21.15.12:0/605195747 conn(0x56225cbec7e0 msgr2=0x56225ccb9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:16.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 -- 172.21.15.12:0/605195747 shutdown_connections 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 -- 172.21.15.12:0/605195747 wait complete. 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.614+0000 7f5d75686b80 1 -- start start 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d75686b80 1 Processor -- start 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbd3d0 0x56225ccc6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbdd30 0x56225ccc7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 0x56225ccce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d75686b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225cbcb560 con 0x56225ccbd3d0 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d75686b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225cbcb200 con 0x56225ccbdd30 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d75686b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ca90920 con 0x56225ccbec20 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d75686b80 10 client.0 _ll_register_callbacks cb 0x56225caf6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbd3d0 0x56225ccc6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbd3d0 0x56225ccc6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32800/0 (socket says 172.21.15.12:32800) 2023-12-11T20:26:16.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.615+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/148002393 learned_addr learned my addr 172.21.15.12:0/148002393 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 0x56225ccce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d5affd700 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbdd30 0x56225ccc7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/148002393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 msgr2=0x56225ccce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 0x56225ccce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/148002393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbdd30 msgr2=0x56225ccc7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbdd30 0x56225ccc7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d5b7fe700 1 -- 172.21.15.12:0/148002393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c1a1ab0 con 0x56225ccbd3d0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbd3d0 0x56225ccc6e20 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c09af80 tx=0x7f5d4c09b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81709be28a54474a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d3affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d3affd700 1 -- 172.21.15.12:0/148002393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c09abe0 con 0x56225ccbd3d0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d3affd700 1 -- 172.21.15.12:0/148002393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5d4c09b980 con 0x56225ccbd3d0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.616+0000 7f5d75686b80 1 -- 172.21.15.12:0/148002393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56225ccb0b40 con 0x56225ccbd3d0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d3affd700 1 -- 172.21.15.12:0/148002393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d4c09adc0 con 0x56225ccbd3d0 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d75686b80 10 client.18393 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:16.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d75686b80 1 -- 172.21.15.12:0/148002393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56225ca3ade0 con 0x56225ccbd3d0 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d3affd700 1 -- 172.21.15.12:0/148002393 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56225ccb0b40 con 0x56225ccbd3d0 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d3affd700 1 -- 172.21.15.12:0/148002393 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5d4c0b9240 con 0x56225ccbd3d0 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d75686b80 10 client.18393 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d75686b80 10 client.18393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d75686b80 20 client.18393 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d75686b80 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56225ccd2700 0x56225ccd4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d75686b80 4 client.18393 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.617+0000 7f5d75686b80 1 -- 172.21.15.12:0/148002393 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56225cc8cf40 con 0x56225ccd2700 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.618+0000 7f5d5affd700 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56225ccd2700 0x56225ccd4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.618+0000 7f5d5affd700 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56225ccd2700 0x56225ccd4b20 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e4483caaf411582 server_cookie=9127bc8e4afbcd21 in_seq=0 out_seq=0 2023-12-11T20:26:16.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.618+0000 7f5d3affd700 10 client.18393 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.619+0000 7f5d3affd700 1 -- 172.21.15.12:0/148002393 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56225cc8cf40 con 0x56225ccd2700 2023-12-11T20:26:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.619+0000 7f5d3affd700 10 client.18393 handle_command_reply: tid=0 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.619+0000 7f5d75686b80 1 client.18393 shutdown 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.619+0000 7f5d75686b80 1 -- 172.21.15.12:0/148002393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbd3d0 msgr2=0x56225ccc6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.619+0000 7f5d75686b80 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbd3d0 0x56225ccc6e20 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c09af80 tx=0x7f5d4c09b110 comp rx=0 tx=0).stop 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.619+0000 7f5d75686b80 1 -- 172.21.15.12:0/148002393 shutdown_connections 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d75686b80 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56225ccd2700 0x56225ccd4b20 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d75686b80 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbec20 0x56225ccce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d75686b80 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbd3d0 0x56225ccc6e20 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d3affd700 0 client.18393 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d75686b80 1 --2- 172.21.15.12:0/148002393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbdd30 0x56225ccc7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d75686b80 1 -- 172.21.15.12:0/148002393 >> 172.21.15.12:0/148002393 conn(0x56225cbec7e0 msgr2=0x56225ccb8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d75686b80 1 -- 172.21.15.12:0/148002393 shutdown_connections 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d75686b80 1 -- 172.21.15.12:0/148002393 wait complete. 2023-12-11T20:26:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.620+0000 7f5d75686b80 20 client.18393 trim_cache size 0 max 16384 2023-12-11T20:26:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.642+0000 7f5d75686b80 1 Processor -- start 2023-12-11T20:26:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.642+0000 7f5d75686b80 1 -- start start 2023-12-11T20:26:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225ccbf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225ccc1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d75686b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ccbcf70 con 0x56225ccbec20 2023-12-11T20:26:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d75686b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225cccf4d0 con 0x56225ccbd3d0 2023-12-11T20:26:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d75686b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ccc6990 con 0x56225ccbdd30 2023-12-11T20:26:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d5bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225ccc1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d5affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d5affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49708/0 (socket says 172.21.15.12:49708) 2023-12-11T20:26:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d5affd700 1 -- 172.21.15.12:0/2250461998 learned_addr learned my addr 172.21.15.12:0/2250461998 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:16.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.643+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225ccbf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.644+0000 7f5d5affd700 1 -- 172.21.15.12:0/2250461998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 msgr2=0x56225ccbf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:16.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.644+0000 7f5d5affd700 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225ccbf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.644+0000 7f5d5affd700 1 -- 172.21.15.12:0/2250461998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 msgr2=0x56225ccc1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.644+0000 7f5d5affd700 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225ccc1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.644+0000 7f5d5affd700 1 -- 172.21.15.12:0/2250461998 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56225ca23c60 con 0x56225ccbdd30 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.644+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225ccc1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.644+0000 7f5d5affd700 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56225ccd5430 tx=0x7f5d5000b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139cdc106ff4640a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.644+0000 7f5d427fc700 1 -- 172.21.15.12:0/2250461998 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50003c60 con 0x56225ccbdd30 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d427fc700 1 -- 172.21.15.12:0/2250461998 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d50017040 con 0x56225ccbdd30 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d427fc700 1 -- 172.21.15.12:0/2250461998 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500054e0 con 0x56225ccbdd30 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d75686b80 1 -- 172.21.15.12:0/2250461998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 msgr2=0x56225ccce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d75686b80 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56225ccd5430 tx=0x7f5d5000b410 comp rx=0 tx=0).stop 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d75686b80 1 -- 172.21.15.12:0/2250461998 shutdown_connections 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d75686b80 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225ccbf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d75686b80 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225ccc1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d75686b80 1 --2- 172.21.15.12:0/2250461998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce310 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.645+0000 7f5d75686b80 1 -- 172.21.15.12:0/2250461998 >> 172.21.15.12:0/2250461998 conn(0x56225cbec7e0 msgr2=0x56225ccc5170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.646+0000 7f5d75686b80 1 -- 172.21.15.12:0/2250461998 shutdown_connections 2023-12-11T20:26:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.646+0000 7f5d75686b80 1 -- 172.21.15.12:0/2250461998 wait complete. 2023-12-11T20:26:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.646+0000 7f5d75686b80 1 -- start start 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.646+0000 7f5d75686b80 1 Processor -- start 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225cccdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d75686b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225cccc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d75686b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225cccc9d0 con 0x56225ccbec20 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d75686b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ccccb40 con 0x56225ccbd3d0 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d75686b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ccccd00 con 0x56225ccbdd30 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d75686b80 10 client.0 _ll_register_callbacks cb 0x56225caf6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d5bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225cccc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d5affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d5bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225cccc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32814/0 (socket says 172.21.15.12:32814) 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d5bfff700 1 -- 172.21.15.12:0/3242692193 learned_addr learned my addr 172.21.15.12:0/3242692193 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.647+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225cccdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d5bfff700 1 -- 172.21.15.12:0/3242692193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 msgr2=0x56225ccce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d5bfff700 1 -- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 msgr2=0x56225cccdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225cccdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d5bfff700 1 -- 172.21.15.12:0/3242692193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d54011040 con 0x56225ccbec20 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d5affd700 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225cccdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d5bfff700 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225cccc2c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5d54016e00 tx=0x7f5d54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0afbe0c411b3f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d3affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d3affd700 1 -- 172.21.15.12:0/3242692193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54020040 con 0x56225ccbec20 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d75686b80 1 -- 172.21.15.12:0/3242692193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d4c0cbe90 con 0x56225ccbec20 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.648+0000 7f5d3affd700 1 -- 172.21.15.12:0/3242692193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5d5401bd40 con 0x56225ccbec20 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d3affd700 1 -- 172.21.15.12:0/3242692193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d5401b2e0 con 0x56225ccbec20 2023-12-11T20:26:16.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d75686b80 10 client.18399 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d75686b80 1 -- 172.21.15.12:0/3242692193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f5d5000b8c0 con 0x56225ccbec20 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d3affd700 1 -- 172.21.15.12:0/3242692193 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d4c0cbe90 con 0x56225ccbec20 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d3affd700 1 -- 172.21.15.12:0/3242692193 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5d54019430 con 0x56225ccbec20 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d75686b80 10 client.18399 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d75686b80 10 client.18399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d75686b80 20 client.18399 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d75686b80 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56225cd2a0f0 0x56225cd2c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d75686b80 4 client.18399 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.649+0000 7f5d75686b80 1 -- 172.21.15.12:0/3242692193 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56225cbd7fd0 con 0x56225cd2a0f0 2023-12-11T20:26:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.650+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56225cd2a0f0 0x56225cd2c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.650+0000 7f5d5b7fe700 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56225cd2a0f0 0x56225cd2c510 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fea8cd6e7deec4cb server_cookie=4b419d9fd4a1c40b in_seq=0 out_seq=0 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.650+0000 7f5d3affd700 10 client.18399 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.650+0000 7f5d3affd700 1 -- 172.21.15.12:0/3242692193 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56225cbd7fd0 con 0x56225cd2a0f0 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.650+0000 7f5d3affd700 10 client.18399 handle_command_reply: tid=0 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 client.18399 shutdown 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 -- 172.21.15.12:0/3242692193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 msgr2=0x56225cccc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225cccc2c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5d54016e00 tx=0x7f5d54004ad0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 -- 172.21.15.12:0/3242692193 shutdown_connections 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56225cd2a0f0 0x56225cd2c510 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56225ccbd3d0 0x56225cccdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56225ccbec20 0x56225cccc2c0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 --2- 172.21.15.12:0/3242692193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56225ccbdd30 0x56225ccce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 -- 172.21.15.12:0/3242692193 >> 172.21.15.12:0/3242692193 conn(0x56225cbec7e0 msgr2=0x56225ccc1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d3affd700 0 client.18399 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 -- 172.21.15.12:0/3242692193 shutdown_connections 2023-12-11T20:26:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 1 -- 172.21.15.12:0/3242692193 wait complete. 2023-12-11T20:26:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.651+0000 7f5d75686b80 20 client.18399 trim_cache size 0 max 16384 2023-12-11T20:26:16.653 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:26:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:26:16.653 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:26:16.653 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 -- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d440a1500 msgr2=0x7f5d440a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d440a1500 0x7f5d440a39c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5d540078e0 tx=0x7f5d54004b40 comp rx=0 tx=0).stop 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 -- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 msgr2=0x7f5d5c1995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 0x7f5d5c1995d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009f50 tx=0x7f5d4c005b00 comp rx=0 tx=0).stop 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 -- 172.21.15.12:0/3840639942 shutdown_connections 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5d440a1500 0x7f5d440a39c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d5c105240 0x7f5d5c1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d5c1036b0 0x7f5d5c1995d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 --2- 172.21.15.12:0/3840639942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d5c1048a0 0x7f5d5c199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 -- 172.21.15.12:0/3840639942 >> 172.21.15.12:0/3840639942 conn(0x7f5d5c0fec80 msgr2=0x7f5d5c107d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 -- 172.21.15.12:0/3840639942 shutdown_connections 2023-12-11T20:26:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.652+0000 7f5d61dff700 1 -- 172.21.15.12:0/3840639942 wait complete. 2023-12-11T20:26:16.671 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:26:16.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:26:16.741 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:16 smithi012 ceph-mon[128787]: pgmap v685: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:16 smithi039 ceph-mon[102205]: pgmap v685: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:16.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.904+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/3080593663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41050c0 msgr2=0x7fa2c4105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.904+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/3080593663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41050c0 0x7fa2c4105540 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00b0a0 tx=0x7fa2bc00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.904+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/3080593663 shutdown_connections 2023-12-11T20:26:16.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.904+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/3080593663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41050c0 0x7fa2c4105540 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.904+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/3080593663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c40ffd80 0x7fa2c41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.904+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/3080593663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c41026f0 0x7fa2c4104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.904+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/3080593663 >> 172.21.15.12:0/3080593663 conn(0x7fa2c40fb980 msgr2=0x7fa2c40fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:16.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.904+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/3080593663 shutdown_connections 2023-12-11T20:26:16.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.905+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/3080593663 wait complete. 2023-12-11T20:26:16.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2cc1ff700 1 Processor -- start 2023-12-11T20:26:16.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2cc1ff700 1 -- start start 2023-12-11T20:26:16.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2cc1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c40ffd80 0x7fa2c419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2cc1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41026f0 0x7fa2c419df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2cc1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c41050c0 0x7fa2c41a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2cc1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c41a5520 con 0x7fa2c41026f0 2023-12-11T20:26:16.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2cc1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c41a5660 con 0x7fa2c41050c0 2023-12-11T20:26:16.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2cc1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c41a57f0 con 0x7fa2c40ffd80 2023-12-11T20:26:16.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2c979a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41026f0 0x7fa2c419df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2c979a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41026f0 0x7fa2c419df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32832/0 (socket says 172.21.15.12:32832) 2023-12-11T20:26:16.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.906+0000 7fa2c979a700 1 -- 172.21.15.12:0/2086138784 learned_addr learned my addr 172.21.15.12:0/2086138784 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:16.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2c9f9b700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c40ffd80 0x7fa2c419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2ca79c700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c41050c0 0x7fa2c41a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2c979a700 1 -- 172.21.15.12:0/2086138784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c40ffd80 msgr2=0x7fa2c419d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2c979a700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c40ffd80 0x7fa2c419d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2c979a700 1 -- 172.21.15.12:0/2086138784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c41050c0 msgr2=0x7fa2c41a4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:16.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2c979a700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c41050c0 0x7fa2c41a4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:16.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2c979a700 1 -- 172.21.15.12:0/2086138784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc009d00 con 0x7fa2c41026f0 2023-12-11T20:26:16.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2c9f9b700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c40ffd80 0x7fa2c419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:16.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2c979a700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41026f0 0x7fa2c419df30 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400e9a0 tx=0x7fa2b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:16.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.907+0000 7fa2baffd700 1 -- 172.21.15.12:0/2086138784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4009790 con 0x7fa2c41026f0 2023-12-11T20:26:16.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.908+0000 7fa2baffd700 1 -- 172.21.15.12:0/2086138784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2b400cbd0 con 0x7fa2c41026f0 2023-12-11T20:26:16.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.908+0000 7fa2baffd700 1 -- 172.21.15.12:0/2086138784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4018680 con 0x7fa2c41026f0 2023-12-11T20:26:16.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.908+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c41a5ad0 con 0x7fa2c41026f0 2023-12-11T20:26:16.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.908+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c41a5f90 con 0x7fa2c41026f0 2023-12-11T20:26:16.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.909+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c40fd500 con 0x7fa2c41026f0 2023-12-11T20:26:16.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.911+0000 7fa2baffd700 1 -- 172.21.15.12:0/2086138784 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa2b400cd40 con 0x7fa2c41026f0 2023-12-11T20:26:16.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.912+0000 7fa2baffd700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1500 0x7fa2b00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:16.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.912+0000 7fa2baffd700 1 -- 172.21.15.12:0/2086138784 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2b4014070 con 0x7fa2c41026f0 2023-12-11T20:26:16.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.913+0000 7fa2c9f9b700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1500 0x7fa2b00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:16.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.913+0000 7fa2c9f9b700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1500 0x7fa2b00a39c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0005fd0 tx=0x7fa2c0005f60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:16.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:16.917+0000 7fa2baffd700 1 -- 172.21.15.12:0/2086138784 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa2b40522f0 con 0x7fa2c41026f0 2023-12-11T20:26:16.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:16 smithi032 ceph-mon[132488]: pgmap v685: 97 pgs: 97 active+clean; 7.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:17.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.224+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2c4068380 con 0x7fa2c41026f0 2023-12-11T20:26:17.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.225+0000 7fa2baffd700 1 -- 172.21.15.12:0/2086138784 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7fa2b4096540 con 0x7fa2c41026f0 2023-12-11T20:26:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:26:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:26:17.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1500 msgr2=0x7fa2b00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1500 0x7fa2b00a39c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0005fd0 tx=0x7fa2c0005f60 comp rx=0 tx=0).stop 2023-12-11T20:26:17.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41026f0 msgr2=0x7fa2c419df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41026f0 0x7fa2c419df30 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400e9a0 tx=0x7fa2b400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 shutdown_connections 2023-12-11T20:26:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2b00a1500 0x7fa2b00a39c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2c41050c0 0x7fa2c41a4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2c40ffd80 0x7fa2c419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 --2- 172.21.15.12:0/2086138784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2c41026f0 0x7fa2c419df30 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.227+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 >> 172.21.15.12:0/2086138784 conn(0x7fa2c40fb980 msgr2=0x7fa2c4100680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.228+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 shutdown_connections 2023-12-11T20:26:17.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.228+0000 7fa2cc1ff700 1 -- 172.21.15.12:0/2086138784 wait complete. 2023-12-11T20:26:17.228 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:26:17.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 -- 172.21.15.12:0/2946005827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 msgr2=0x7ff5781018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/2946005827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 0x7ff5781018d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ff5680099c0 tx=0x7ff568009cd0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 -- 172.21.15.12:0/2946005827 shutdown_connections 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/2946005827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff578103040 0x7ff5781098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/2946005827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 0x7ff5781018d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/2946005827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5781026a0 0x7ff578102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 -- 172.21.15.12:0/2946005827 >> 172.21.15.12:0/2946005827 conn(0x7ff5780fca00 msgr2=0x7ff5780fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 -- 172.21.15.12:0/2946005827 shutdown_connections 2023-12-11T20:26:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.497+0000 7ff57e1ff700 1 -- 172.21.15.12:0/2946005827 wait complete. 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.498+0000 7ff57e1ff700 1 Processor -- start 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff57e1ff700 1 -- start start 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff57e1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 0x7ff578075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff57e1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5781026a0 0x7ff5780739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff57e1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff578103040 0x7ff578073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff57e1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780746a0 con 0x7ff5781014b0 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff57e1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578074810 con 0x7ff5781026a0 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff57e1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5781a13a0 con 0x7ff578103040 2023-12-11T20:26:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff5777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 0x7ff578075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff5777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 0x7ff578075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32854/0 (socket says 172.21.15.12:32854) 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.499+0000 7ff5777fe700 1 -- 172.21.15.12:0/163979771 learned_addr learned my addr 172.21.15.12:0/163979771 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff577fff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff578103040 0x7ff578073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff576ffd700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5781026a0 0x7ff5780739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff5777fe700 1 -- 172.21.15.12:0/163979771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff578103040 msgr2=0x7ff578073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff5777fe700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff578103040 0x7ff578073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff5777fe700 1 -- 172.21.15.12:0/163979771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5781026a0 msgr2=0x7ff5780739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff5777fe700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5781026a0 0x7ff5780739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff5777fe700 1 -- 172.21.15.12:0/163979771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680095f0 con 0x7ff5781014b0 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff576ffd700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5781026a0 0x7ff5780739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:26:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff5777fe700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 0x7ff578075330 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ff568009f50 tx=0x7ff568003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff574ff9700 1 -- 172.21.15.12:0/163979771 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56801d070 con 0x7ff5781014b0 2023-12-11T20:26:17.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff574ff9700 1 -- 172.21.15.12:0/163979771 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff56800bda0 con 0x7ff5781014b0 2023-12-11T20:26:17.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff57e1ff700 1 -- 172.21.15.12:0/163979771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5781a15d0 con 0x7ff5781014b0 2023-12-11T20:26:17.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.500+0000 7ff574ff9700 1 -- 172.21.15.12:0/163979771 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568022dc0 con 0x7ff5781014b0 2023-12-11T20:26:17.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.501+0000 7ff57e1ff700 1 -- 172.21.15.12:0/163979771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5781a1990 con 0x7ff5781014b0 2023-12-11T20:26:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.505+0000 7ff574ff9700 1 -- 172.21.15.12:0/163979771 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff568004000 con 0x7ff5781014b0 2023-12-11T20:26:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.506+0000 7ff591b67b80 1 Processor -- start 2023-12-11T20:26:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.506+0000 7ff591b67b80 1 -- start start 2023-12-11T20:26:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff591b67b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c40cb50 con 0x55ba8c4b1d30 2023-12-11T20:26:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff591b67b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c40a470 con 0x55ba8c4b13d0 2023-12-11T20:26:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff591b67b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c405d60 con 0x55ba8c4b2c20 2023-12-11T20:26:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff574ff9700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5600a1480 0x7ff5600a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff5777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff577fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff577fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:59654/0 (socket says 172.21.15.12:59654) 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff5777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32868/0 (socket says 172.21.15.12:32868) 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff577fff700 1 -- 172.21.15.12:0/3318042202 learned_addr learned my addr 172.21.15.12:0/3318042202 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.507+0000 7ff576ffd700 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff574ff9700 1 -- 172.21.15.12:0/163979771 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5680ce250 con 0x7ff5781014b0 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff577fff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5600a1480 0x7ff5600a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff576ffd700 1 -- 172.21.15.12:0/3318042202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 msgr2=0x55ba8c4b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff576ffd700 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff576ffd700 1 -- 172.21.15.12:0/3318042202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 msgr2=0x55ba8c4b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff576ffd700 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff576ffd700 1 -- 172.21.15.12:0/3318042202 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba8c282630 con 0x55ba8c4b2c20 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff577fff700 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.508+0000 7ff576ffd700 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b30a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009c90 tx=0x7ff56c00e2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ae0e0d0d80fa22 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.509+0000 7ff577fff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5600a1480 0x7ff5600a3940 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff570012b60 tx=0x7ff570004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.509+0000 7ff55dffb700 1 -- 172.21.15.12:0/3318042202 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00eb10 con 0x55ba8c4b2c20 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.509+0000 7ff55dffb700 1 -- 172.21.15.12:0/3318042202 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff56c004cc0 con 0x55ba8c4b2c20 2023-12-11T20:26:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.509+0000 7ff55dffb700 1 -- 172.21.15.12:0/3318042202 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c005620 con 0x55ba8c4b2c20 2023-12-11T20:26:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.509+0000 7ff591b67b80 1 -- 172.21.15.12:0/3318042202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 msgr2=0x55ba8c4b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.509+0000 7ff591b67b80 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b30a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009c90 tx=0x7ff56c00e2f0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.510+0000 7ff591b67b80 1 -- 172.21.15.12:0/3318042202 shutdown_connections 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.510+0000 7ff591b67b80 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.510+0000 7ff591b67b80 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b30a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.510+0000 7ff591b67b80 1 --2- 172.21.15.12:0/3318042202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.510+0000 7ff591b67b80 1 -- 172.21.15.12:0/3318042202 >> 172.21.15.12:0/3318042202 conn(0x55ba8c3e07e0 msgr2=0x55ba8c4add90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.510+0000 7ff591b67b80 1 -- 172.21.15.12:0/3318042202 shutdown_connections 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.510+0000 7ff591b67b80 1 -- 172.21.15.12:0/3318042202 wait complete. 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.510+0000 7ff591b67b80 1 -- start start 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff591b67b80 1 Processor -- start 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4bb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4bb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4c2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff591b67b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c3bf560 con 0x55ba8c4b13d0 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff591b67b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c3bf200 con 0x55ba8c4b2c20 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff591b67b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c284920 con 0x55ba8c4b1d30 2023-12-11T20:26:17.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff591b67b80 10 client.0 _ll_register_callbacks cb 0x55ba8c2eaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff5777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff5777fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4bb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32878/0 (socket says 172.21.15.12:32878) 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.511+0000 7ff5777fe700 1 -- 172.21.15.12:0/1117664337 learned_addr learned my addr 172.21.15.12:0/1117664337 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff576ffd700 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff577fff700 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff5777fe700 1 -- 172.21.15.12:0/1117664337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b1d30 msgr2=0x55ba8c4bb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff5777fe700 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4bb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff5777fe700 1 -- 172.21.15.12:0/1117664337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b2c20 msgr2=0x55ba8c4c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff5777fe700 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff5777fe700 1 -- 172.21.15.12:0/1117664337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff570012610 con 0x55ba8c4b13d0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff5777fe700 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4bb200 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ff56809b2b0 tx=0x7ff56809baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b5abf1b583c06 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff556ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff556ffd700 1 -- 172.21.15.12:0/1117664337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680a3620 con 0x55ba8c4b13d0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff556ffd700 1 -- 172.21.15.12:0/1117664337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff56809bcb0 con 0x55ba8c4b13d0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.512+0000 7ff591b67b80 1 -- 172.21.15.12:0/1117664337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba8c4a4b40 con 0x55ba8c4b13d0 2023-12-11T20:26:17.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff556ffd700 1 -- 172.21.15.12:0/1117664337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff56809b380 con 0x55ba8c4b13d0 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff591b67b80 10 client.18417 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff591b67b80 1 -- 172.21.15.12:0/1117664337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ff56c0098c0 con 0x55ba8c4b13d0 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff556ffd700 1 -- 172.21.15.12:0/1117664337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba8c4a4b40 con 0x55ba8c4b13d0 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff556ffd700 1 -- 172.21.15.12:0/1117664337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff5680a3b00 con 0x55ba8c4b13d0 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff591b67b80 10 client.18417 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff591b67b80 10 client.18417 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff591b67b80 20 client.18417 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ba8c4c6ba0 0x55ba8c4c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff591b67b80 4 client.18417 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.513+0000 7ff591b67b80 1 -- 172.21.15.12:0/1117664337 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba8c480f40 con 0x55ba8c4c6ba0 2023-12-11T20:26:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.514+0000 7ff576ffd700 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ba8c4c6ba0 0x55ba8c4c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.514+0000 7ff576ffd700 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ba8c4c6ba0 0x55ba8c4c8fc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=56a1a3a3c17798de server_cookie=1db1dff91b07cabc in_seq=0 out_seq=0 2023-12-11T20:26:17.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.514+0000 7ff556ffd700 10 client.18417 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:26:17.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff556ffd700 1 -- 172.21.15.12:0/1117664337 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ba8c480f40 con 0x55ba8c4c6ba0 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff556ffd700 10 client.18417 handle_command_reply: tid=0 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 client.18417 shutdown 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 -- 172.21.15.12:0/1117664337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b13d0 msgr2=0x55ba8c4bb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4bb200 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ff56809b2b0 tx=0x7ff56809baf0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 -- 172.21.15.12:0/1117664337 shutdown_connections 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ba8c4c6ba0 0x55ba8c4c8fc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4bb200 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1117664337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4bb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff556ffd700 0 client.18417 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.515+0000 7ff591b67b80 1 -- 172.21.15.12:0/1117664337 >> 172.21.15.12:0/1117664337 conn(0x55ba8c3e07e0 msgr2=0x55ba8c4aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.516+0000 7ff591b67b80 1 -- 172.21.15.12:0/1117664337 shutdown_connections 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.516+0000 7ff591b67b80 1 -- 172.21.15.12:0/1117664337 wait complete. 2023-12-11T20:26:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.516+0000 7ff591b67b80 20 client.18417 trim_cache size 0 max 16384 2023-12-11T20:26:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.534+0000 7ff591b67b80 1 Processor -- start 2023-12-11T20:26:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.534+0000 7ff591b67b80 1 -- start start 2023-12-11T20:26:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff591b67b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c4ac050 con 0x55ba8c4b1d30 2023-12-11T20:26:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff591b67b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c4b2ad0 con 0x55ba8c4b13d0 2023-12-11T20:26:17.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff591b67b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c4bad70 con 0x55ba8c4b2c20 2023-12-11T20:26:17.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff576ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff576ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32882/0 (socket says 172.21.15.12:32882) 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff576ffd700 1 -- 172.21.15.12:0/3622282192 learned_addr learned my addr 172.21.15.12:0/3622282192 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff5777fe700 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff577fff700 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff576ffd700 1 -- 172.21.15.12:0/3622282192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 msgr2=0x55ba8c4b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff576ffd700 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff576ffd700 1 -- 172.21.15.12:0/3622282192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 msgr2=0x55ba8c4c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.535+0000 7ff576ffd700 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.536+0000 7ff576ffd700 1 -- 172.21.15.12:0/3622282192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba8c22ede0 con 0x55ba8c4b1d30 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.536+0000 7ff5777fe700 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.536+0000 7ff576ffd700 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c26f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7ff56c000c00 tx=0x7ff56c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47f351da4f628f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.536+0000 7ff55e7fc700 1 -- 172.21.15.12:0/3622282192 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c021040 con 0x55ba8c4b1d30 2023-12-11T20:26:17.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.536+0000 7ff55e7fc700 1 -- 172.21.15.12:0/3622282192 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff56c022040 con 0x55ba8c4b1d30 2023-12-11T20:26:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.536+0000 7ff55e7fc700 1 -- 172.21.15.12:0/3622282192 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00ec00 con 0x55ba8c4b1d30 2023-12-11T20:26:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 -- 172.21.15.12:0/3622282192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 msgr2=0x55ba8c4c26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c26f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7ff56c000c00 tx=0x7ff56c01e040 comp rx=0 tx=0).stop 2023-12-11T20:26:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 -- 172.21.15.12:0/3622282192 shutdown_connections 2023-12-11T20:26:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 --2- 172.21.15.12:0/3622282192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c26f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 -- 172.21.15.12:0/3622282192 >> 172.21.15.12:0/3622282192 conn(0x55ba8c3e07e0 msgr2=0x55ba8c4b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 -- 172.21.15.12:0/3622282192 shutdown_connections 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 -- 172.21.15.12:0/3622282192 wait complete. 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.537+0000 7ff591b67b80 1 -- start start 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff591b67b80 1 Processor -- start 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff591b67b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4c0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff591b67b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c4c0c70 con 0x55ba8c4b1d30 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff591b67b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c4c0de0 con 0x55ba8c4b13d0 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff591b67b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8c4c0fa0 con 0x55ba8c4b2c20 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff591b67b80 10 client.0 _ll_register_callbacks cb 0x55ba8c2eaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff576ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff576ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32890/0 (socket says 172.21.15.12:32890) 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff576ffd700 1 -- 172.21.15.12:0/1551876135 learned_addr learned my addr 172.21.15.12:0/1551876135 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.538+0000 7ff5777fe700 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff577fff700 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff576ffd700 1 -- 172.21.15.12:0/1551876135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 msgr2=0x55ba8c4c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff576ffd700 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4c0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff576ffd700 1 -- 172.21.15.12:0/1551876135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 msgr2=0x55ba8c4c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff576ffd700 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff576ffd700 1 -- 172.21.15.12:0/1551876135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba8c282630 con 0x55ba8c4b1d30 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff576ffd700 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c2530 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009c30 tx=0x7ff56c004eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36dabe6dcad58f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff556ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.539+0000 7ff556ffd700 1 -- 172.21.15.12:0/1551876135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0055e0 con 0x55ba8c4b1d30 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.540+0000 7ff556ffd700 1 -- 172.21.15.12:0/1551876135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff56c00e980 con 0x55ba8c4b1d30 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.540+0000 7ff591b67b80 1 -- 172.21.15.12:0/1551876135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff56c004cc0 con 0x55ba8c4b1d30 2023-12-11T20:26:17.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.540+0000 7ff556ffd700 1 -- 172.21.15.12:0/1551876135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff56c004920 con 0x55ba8c4b1d30 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.540+0000 7ff591b67b80 10 client.18423 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.540+0000 7ff591b67b80 1 -- 172.21.15.12:0/1551876135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ba8c217c60 con 0x55ba8c4b1d30 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.540+0000 7ff556ffd700 1 -- 172.21.15.12:0/1551876135 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff56c004cc0 con 0x55ba8c4b1d30 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.541+0000 7ff556ffd700 1 -- 172.21.15.12:0/1551876135 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff56c030070 con 0x55ba8c4b1d30 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.541+0000 7ff591b67b80 10 client.18423 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.541+0000 7ff591b67b80 10 client.18423 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.541+0000 7ff591b67b80 20 client.18423 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.541+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ba8c51df20 0x55ba8c520340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.541+0000 7ff591b67b80 4 client.18423 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:26:17.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.541+0000 7ff591b67b80 1 -- 172.21.15.12:0/1551876135 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ba8c3cbfd0 con 0x55ba8c51df20 2023-12-11T20:26:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.541+0000 7ff5777fe700 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ba8c51df20 0x55ba8c520340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff5777fe700 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ba8c51df20 0x55ba8c520340 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83991153de1f0f2a server_cookie=a068d748047ac48b in_seq=0 out_seq=0 2023-12-11T20:26:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff556ffd700 10 client.18423 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:26:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff556ffd700 1 -- 172.21.15.12:0/1551876135 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ba8c3cbfd0 con 0x55ba8c51df20 2023-12-11T20:26:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff556ffd700 10 client.18423 handle_command_reply: tid=0 2023-12-11T20:26:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 client.18423 shutdown 2023-12-11T20:26:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 -- 172.21.15.12:0/1551876135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 msgr2=0x55ba8c4c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c2530 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009c30 tx=0x7ff56c004eb0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 -- 172.21.15.12:0/1551876135 shutdown_connections 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ba8c51df20 0x55ba8c520340 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ba8c4b13d0 0x55ba8c4c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba8c4b2c20 0x55ba8c4c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 --2- 172.21.15.12:0/1551876135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba8c4b1d30 0x55ba8c4c2530 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 -- 172.21.15.12:0/1551876135 >> 172.21.15.12:0/1551876135 conn(0x55ba8c3e07e0 msgr2=0x55ba8c4b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff556ffd700 0 client.18423 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 -- 172.21.15.12:0/1551876135 shutdown_connections 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 1 -- 172.21.15.12:0/1551876135 wait complete. 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.542+0000 7ff591b67b80 20 client.18423 trim_cache size 0 max 16384 2023-12-11T20:26:17.544 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:26:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 -- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5600a1480 msgr2=0x7ff5600a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5600a1480 0x7ff5600a3940 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff570012b60 tx=0x7ff570004b40 comp rx=0 tx=0).stop 2023-12-11T20:26:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 -- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 msgr2=0x7ff578075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 0x7ff578075330 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ff568009f50 tx=0x7ff568003b00 comp rx=0 tx=0).stop 2023-12-11T20:26:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 -- 172.21.15.12:0/163979771 shutdown_connections 2023-12-11T20:26:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff5600a1480 0x7ff5600a3940 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff578103040 0x7ff578073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5781014b0 0x7ff578075330 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 --2- 172.21.15.12:0/163979771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5781026a0 0x7ff5780739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 -- 172.21.15.12:0/163979771 >> 172.21.15.12:0/163979771 conn(0x7ff5780fca00 msgr2=0x7ff578105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 -- 172.21.15.12:0/163979771 shutdown_connections 2023-12-11T20:26:17.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.543+0000 7ff57e1ff700 1 -- 172.21.15.12:0/163979771 wait complete. 2023-12-11T20:26:17.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:17 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2086138784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:26:17.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:26:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.797+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/1583491036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181024e0 msgr2=0x7f2f18102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.797+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/1583491036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181024e0 0x7f2f18102940 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2f040099c0 tx=0x7f2f04009cd0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.798+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/1583491036 shutdown_connections 2023-12-11T20:26:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.798+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/1583491036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f181012f0 0x7f2f18101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.798+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/1583491036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f18102e80 0x7f2f18109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.798+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/1583491036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181024e0 0x7f2f18102940 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.798+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/1583491036 >> 172.21.15.12:0/1583491036 conn(0x7f2f180fc860 msgr2=0x7f2f180feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.798+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/1583491036 shutdown_connections 2023-12-11T20:26:17.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.798+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/1583491036 wait complete. 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.799+0000 7f2f1dd9d700 1 Processor -- start 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.799+0000 7f2f1dd9d700 1 -- start start 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.799+0000 7f2f1dd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181012f0 0x7f2f181992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.799+0000 7f2f1dd9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f181024e0 0x7f2f18199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.799+0000 7f2f1dd9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f18102e80 0x7f2f181a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.799+0000 7f2f1dd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181a0e20 con 0x7f2f181012f0 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.799+0000 7f2f1dd9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181a0f60 con 0x7f2f18102e80 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.799+0000 7f2f1dd9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181a10f0 con 0x7f2f181024e0 2023-12-11T20:26:17.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181012f0 0x7f2f181992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181012f0 0x7f2f181992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32896/0 (socket says 172.21.15.12:32896) 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/344649019 learned_addr learned my addr 172.21.15.12:0/344649019 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1d59c700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f18102e80 0x7f2f181a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f17fff700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f181024e0 0x7f2f18199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/344649019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f181024e0 msgr2=0x7f2f18199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f181024e0 0x7f2f18199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/344649019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f18102e80 msgr2=0x7f2f181a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f18102e80 0x7f2f181a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/344649019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040095f0 con 0x7f2f181012f0 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.800+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181012f0 0x7f2f181992f0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00d980 tx=0x7f2f0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.801+0000 7f2f15ffb700 1 -- 172.21.15.12:0/344649019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00f890 con 0x7f2f181012f0 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.801+0000 7f2f15ffb700 1 -- 172.21.15.12:0/344649019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f0c00fe80 con 0x7f2f181012f0 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.801+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/344649019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f181a13d0 con 0x7f2f181012f0 2023-12-11T20:26:17.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.801+0000 7f2f15ffb700 1 -- 172.21.15.12:0/344649019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c019360 con 0x7f2f181012f0 2023-12-11T20:26:17.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.801+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/344649019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f181a1930 con 0x7f2f181012f0 2023-12-11T20:26:17.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:17 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2086138784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:26:17.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.804+0000 7f2f15ffb700 1 -- 172.21.15.12:0/344649019 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2f0c00f9f0 con 0x7f2f181012f0 2023-12-11T20:26:17.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f32949b80 1 Processor -- start 2023-12-11T20:26:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f32949b80 1 -- start start 2023-12-11T20:26:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f15ffb700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f080a15a0 0x7f2f080a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f15ffb700 1 -- 172.21.15.12:0/344649019 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2f0c0cc750 con 0x7f2f181012f0 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e713de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e713e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 0x55e7e713f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f32949b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e7098b50 con 0x55e7e713da60 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f32949b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e7096470 con 0x55e7e713e3c0 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f32949b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e7091d60 con 0x55e7e713ede0 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.807+0000 7f2f1d59c700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f080a15a0 0x7f2f080a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e713de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e713de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32912/0 (socket says 172.21.15.12:32912) 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/2711073133 learned_addr learned my addr 172.21.15.12:0/2711073133 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f17fff700 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e713e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/2711073133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 msgr2=0x55e7e713f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 0x55e7e713f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/2711073133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 msgr2=0x55e7e713e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e713e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/2711073133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e6f0e630 con 0x55e7e713da60 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f17fff700 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e713e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1d59c700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f080a15a0 0x7f2f080a3a60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000f540 tx=0x7f2f10009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.808+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e713de80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c096430 tx=0x7f2f0c099600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c17e4d679029a08 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.809+0000 7f2f02ffd700 1 -- 172.21.15.12:0/2711073133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00fca0 con 0x55e7e713da60 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.809+0000 7f2f02ffd700 1 -- 172.21.15.12:0/2711073133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f0c09a0c0 con 0x55e7e713da60 2023-12-11T20:26:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.809+0000 7f2f02ffd700 1 -- 172.21.15.12:0/2711073133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c098eb0 con 0x55e7e713da60 2023-12-11T20:26:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.809+0000 7f2f32949b80 1 -- 172.21.15.12:0/2711073133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 msgr2=0x55e7e713de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.809+0000 7f2f32949b80 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e713de80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c096430 tx=0x7f2f0c099600 comp rx=0 tx=0).stop 2023-12-11T20:26:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.810+0000 7f2f32949b80 1 -- 172.21.15.12:0/2711073133 shutdown_connections 2023-12-11T20:26:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.810+0000 7f2f32949b80 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 0x55e7e713f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.810+0000 7f2f32949b80 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e713de80 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.810+0000 7f2f32949b80 1 --2- 172.21.15.12:0/2711073133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e713e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.810+0000 7f2f32949b80 1 -- 172.21.15.12:0/2711073133 >> 172.21.15.12:0/2711073133 conn(0x55e7e706c7e0 msgr2=0x55e7e71383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.810+0000 7f2f32949b80 1 -- 172.21.15.12:0/2711073133 shutdown_connections 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.810+0000 7f2f32949b80 1 -- 172.21.15.12:0/2711073133 wait complete. 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.810+0000 7f2f32949b80 1 -- start start 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f32949b80 1 Processor -- start 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7147260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71477a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e714e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f32949b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e704b560 con 0x55e7e713ede0 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f32949b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e704b200 con 0x55e7e713e3c0 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f32949b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e6f10920 con 0x55e7e713da60 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f32949b80 10 client.0 _ll_register_callbacks cb 0x55e7e6f76a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f17fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f17fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:59708/0 (socket says 172.21.15.12:59708) 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.811+0000 7f2f17fff700 1 -- 172.21.15.12:0/1858702759 learned_addr learned my addr 172.21.15.12:0/1858702759 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f1d59c700 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e714e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f17fff700 1 -- 172.21.15.12:0/1858702759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 msgr2=0x55e7e7147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f17fff700 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f17fff700 1 -- 172.21.15.12:0/1858702759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 msgr2=0x55e7e714e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f17fff700 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e714e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f17fff700 1 -- 172.21.15.12:0/1858702759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f181a1930 con 0x55e7e713e3c0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f1d59c700 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e714e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2f17fff700 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71477a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2f040099c0 tx=0x7f2f04005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd7cf0fa55717ce server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2ef7fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.812+0000 7f2ef7fff700 1 -- 172.21.15.12:0/1858702759 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04005720 con 0x55e7e713e3c0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.813+0000 7f2f32949b80 1 -- 172.21.15.12:0/1858702759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7e71309e0 con 0x55e7e713e3c0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.813+0000 7f2ef7fff700 1 -- 172.21.15.12:0/1858702759 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2f04003960 con 0x55e7e713e3c0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.813+0000 7f2ef7fff700 1 -- 172.21.15.12:0/1858702759 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f0400bd20 con 0x55e7e713e3c0 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.813+0000 7f2f32949b80 10 client.28040 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:17.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.813+0000 7f2f32949b80 1 -- 172.21.15.12:0/1858702759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e7e6ebade0 con 0x55e7e713e3c0 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.813+0000 7f2ef7fff700 1 -- 172.21.15.12:0/1858702759 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f04032080 con 0x55e7e713e3c0 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.814+0000 7f2ef7fff700 1 -- 172.21.15.12:0/1858702759 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f0400fb30 con 0x55e7e713e3c0 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.814+0000 7f2f32949b80 10 client.28040 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.814+0000 7f2f32949b80 10 client.28040 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.814+0000 7f2f32949b80 20 client.28040 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.814+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e7e7153070 0x55e7e7155490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.814+0000 7f2f32949b80 4 client.28040 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.814+0000 7f2f32949b80 1 -- 172.21.15.12:0/1858702759 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7e710cf40 con 0x55e7e7153070 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.814+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e7e7153070 0x55e7e7155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.815+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e7e7153070 0x55e7e7155490 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d287e9a3e7dbddd9 server_cookie=f6ccb43a1769d7c in_seq=0 out_seq=0 2023-12-11T20:26:17.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.815+0000 7f2ef7fff700 10 client.28040 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.815+0000 7f2ef7fff700 1 -- 172.21.15.12:0/1858702759 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e7e710cf40 con 0x55e7e7153070 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.815+0000 7f2ef7fff700 10 client.28040 handle_command_reply: tid=0 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 client.28040 shutdown 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 -- 172.21.15.12:0/1858702759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 msgr2=0x55e7e71477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71477a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2f040099c0 tx=0x7f2f04005270 comp rx=0 tx=0).stop 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 -- 172.21.15.12:0/1858702759 shutdown_connections 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e7e7153070 0x55e7e7155490 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e714e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1858702759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71477a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 -- 172.21.15.12:0/1858702759 >> 172.21.15.12:0/1858702759 conn(0x55e7e706c7e0 msgr2=0x55e7e713c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2ef7fff700 0 client.28040 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 -- 172.21.15.12:0/1858702759 shutdown_connections 2023-12-11T20:26:17.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 1 -- 172.21.15.12:0/1858702759 wait complete. 2023-12-11T20:26:17.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.816+0000 7f2f32949b80 20 client.28040 trim_cache size 0 max 16384 2023-12-11T20:26:17.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f32949b80 1 Processor -- start 2023-12-11T20:26:17.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f32949b80 1 -- start start 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e714e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e713f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f32949b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e7134b30 con 0x55e7e713ede0 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f32949b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e71331e0 con 0x55e7e713e3c0 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f32949b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e7147ee0 con 0x55e7e713da60 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.832+0000 7f2f1d59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e713f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1cd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1d59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e713f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32932/0 (socket says 172.21.15.12:32932) 2023-12-11T20:26:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1d59c700 1 -- 172.21.15.12:0/1599687120 learned_addr learned my addr 172.21.15.12:0/1599687120 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f17fff700 1 --2- 172.21.15.12:0/1599687120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e714e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/1599687120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 msgr2=0x55e7e714e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/1599687120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e714e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/1599687120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 msgr2=0x55e7e713f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/1599687120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e713f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/1599687120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e6ea3c60 con 0x55e7e713da60 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.833+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/1599687120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7146770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007e60 tx=0x7f2f0c09a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4329cf41cf25b8ec server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f037fe700 1 -- 172.21.15.12:0/1599687120 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c099a40 con 0x55e7e713da60 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f037fe700 1 -- 172.21.15.12:0/1599687120 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f0c010460 con 0x55e7e713da60 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f037fe700 1 -- 172.21.15.12:0/1599687120 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c098eb0 con 0x55e7e713da60 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f32949b80 1 -- 172.21.15.12:0/1599687120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 msgr2=0x55e7e7146770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1599687120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7146770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007e60 tx=0x7f2f0c09a230 comp rx=0 tx=0).stop 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f32949b80 1 -- 172.21.15.12:0/1599687120 shutdown_connections 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1599687120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713ede0 0x55e7e713f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1599687120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713da60 0x55e7e7146770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f32949b80 1 --2- 172.21.15.12:0/1599687120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e714e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.834+0000 7f2f32949b80 1 -- 172.21.15.12:0/1599687120 >> 172.21.15.12:0/1599687120 conn(0x55e7e706c7e0 msgr2=0x55e7e7138320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.835+0000 7f2f32949b80 1 -- 172.21.15.12:0/1599687120 shutdown_connections 2023-12-11T20:26:17.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.835+0000 7f2f32949b80 1 -- 172.21.15.12:0/1599687120 wait complete. 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.835+0000 7f2f32949b80 1 -- start start 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.835+0000 7f2f32949b80 1 Processor -- start 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e71a3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f32949b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 0x55e7e71a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f32949b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e71a8510 con 0x55e7e713da60 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f32949b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e71a8650 con 0x55e7e713e3c0 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f32949b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e71a8790 con 0x55e7e713ede0 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f32949b80 10 client.0 _ll_register_callbacks cb 0x55e7e6f76a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e71a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e71a3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32938/0 (socket says 172.21.15.12:32938) 2023-12-11T20:26:17.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/970724494 learned_addr learned my addr 172.21.15.12:0/970724494 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f17fff700 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1d59c700 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 0x55e7e71a7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/970724494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 msgr2=0x55e7e71a7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 0x55e7e71a7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/970724494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 msgr2=0x55e7e71a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.836+0000 7f2f1cd9b700 1 -- 172.21.15.12:0/970724494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7e6f0e630 con 0x55e7e713da60 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2f1cd9b700 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e71a3530 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c095e70 tx=0x7f2f0c099450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbec9c4ba66821c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2ef7fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2ef7fff700 1 -- 172.21.15.12:0/970724494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0999c0 con 0x55e7e713da60 2023-12-11T20:26:17.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2ef7fff700 1 -- 172.21.15.12:0/970724494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2f0c098eb0 con 0x55e7e713da60 2023-12-11T20:26:17.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2f32949b80 1 -- 172.21.15.12:0/970724494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f0c09a0c0 con 0x55e7e713da60 2023-12-11T20:26:17.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2ef7fff700 1 -- 172.21.15.12:0/970724494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f0c099070 con 0x55e7e713da60 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2f32949b80 10 client.18441 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2f32949b80 1 -- 172.21.15.12:0/970724494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e7e6ee1250 con 0x55e7e713da60 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.837+0000 7f2ef7fff700 1 -- 172.21.15.12:0/970724494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f0c09a0c0 con 0x55e7e713da60 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.838+0000 7f2ef7fff700 1 -- 172.21.15.12:0/970724494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f0c0b9150 con 0x55e7e713da60 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.838+0000 7f2f32949b80 10 client.18441 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.838+0000 7f2f32949b80 10 client.18441 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.838+0000 7f2f32949b80 20 client.18441 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.838+0000 7f2f32949b80 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e7e71a9d10 0x55e7e71ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.838+0000 7f2f32949b80 4 client.18441 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.838+0000 7f2f32949b80 1 -- 172.21.15.12:0/970724494 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e7e7057fd0 con 0x55e7e71a9d10 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.838+0000 7f2f17fff700 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e7e71a9d10 0x55e7e71ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f17fff700 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e7e71a9d10 0x55e7e71ac130 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=16106ae14770a1f8 server_cookie=450db7737ad86f51 in_seq=0 out_seq=0 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2ef7fff700 10 client.18441 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:26:17.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2ef7fff700 1 -- 172.21.15.12:0/970724494 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e7e7057fd0 con 0x55e7e71a9d10 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2ef7fff700 10 client.18441 handle_command_reply: tid=0 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 client.18441 shutdown 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 -- 172.21.15.12:0/970724494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 msgr2=0x55e7e71a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e71a3530 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c095e70 tx=0x7f2f0c099450 comp rx=0 tx=0).stop 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 -- 172.21.15.12:0/970724494 shutdown_connections 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55e7e71a9d10 0x55e7e71ac130 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e7e713ede0 0x55e7e71a7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e7e713da60 0x55e7e71a3530 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2ef7fff700 0 client.18441 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 --2- 172.21.15.12:0/970724494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e7e713e3c0 0x55e7e71a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 -- 172.21.15.12:0/970724494 >> 172.21.15.12:0/970724494 conn(0x55e7e706c7e0 msgr2=0x55e7e71452a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.839+0000 7f2f32949b80 1 -- 172.21.15.12:0/970724494 shutdown_connections 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f32949b80 1 -- 172.21.15.12:0/970724494 wait complete. 2023-12-11T20:26:17.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f32949b80 20 client.18441 trim_cache size 0 max 16384 2023-12-11T20:26:17.842 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:26:17.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f080a15a0 msgr2=0x7f2f080a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f080a15a0 0x7f2f080a3a60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000f540 tx=0x7f2f10009920 comp rx=0 tx=0).stop 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181012f0 msgr2=0x7f2f181992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181012f0 0x7f2f181992f0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00d980 tx=0x7f2f0c00dc90 comp rx=0 tx=0).stop 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/344649019 shutdown_connections 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f080a15a0 0x7f2f080a3a60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2f18102e80 0x7f2f181a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f181012f0 0x7f2f181992f0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 --2- 172.21.15.12:0/344649019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f181024e0 0x7f2f18199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.840+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/344649019 >> 172.21.15.12:0/344649019 conn(0x7f2f180fc860 msgr2=0x7f2f18073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.841+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/344649019 shutdown_connections 2023-12-11T20:26:17.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:17.841+0000 7f2f1dd9d700 1 -- 172.21.15.12:0/344649019 wait complete. 2023-12-11T20:26:17.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:26:17.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:17 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2086138784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:26:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 -- 172.21.15.12:0/2415074327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 msgr2=0x7fea400739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 --2- 172.21.15.12:0/2415074327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 0x7fea400739e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009990 tx=0x7fea3c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 -- 172.21.15.12:0/2415074327 shutdown_connections 2023-12-11T20:26:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 --2- 172.21.15.12:0/2415074327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea401093a0 0x7fea4010b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 --2- 172.21.15.12:0/2415074327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 0x7fea400739e0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 --2- 172.21.15.12:0/2415074327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea40073fb0 0x7fea40074430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 -- 172.21.15.12:0/2415074327 >> 172.21.15.12:0/2415074327 conn(0x7fea400fca00 msgr2=0x7fea400fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 -- 172.21.15.12:0/2415074327 shutdown_connections 2023-12-11T20:26:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.092+0000 7fea481ff700 1 -- 172.21.15.12:0/2415074327 wait complete. 2023-12-11T20:26:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.093+0000 7fea481ff700 1 Processor -- start 2023-12-11T20:26:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.094+0000 7fea481ff700 1 -- start start 2023-12-11T20:26:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.094+0000 7fea481ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea40073fb0 0x7fea40199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.094+0000 7fea481ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 0x7fea40199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.094+0000 7fea481ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea401093a0 0x7fea401a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.094+0000 7fea481ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea401a1050 con 0x7fea40075590 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.094+0000 7fea481ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea401a1190 con 0x7fea401093a0 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.094+0000 7fea481ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea401a1320 con 0x7fea40073fb0 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 0x7fea40199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 0x7fea40199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32966/0 (socket says 172.21.15.12:32966) 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 -- 172.21.15.12:0/1430502196 learned_addr learned my addr 172.21.15.12:0/1430502196 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea45f9b700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea40073fb0 0x7fea40199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4679c700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea401093a0 0x7fea401a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 -- 172.21.15.12:0/1430502196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea40073fb0 msgr2=0x7fea40199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea40073fb0 0x7fea40199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 -- 172.21.15.12:0/1430502196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea401093a0 msgr2=0x7fea401a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea401093a0 0x7fea401a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 -- 172.21.15.12:0/1430502196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c0095f0 con 0x7fea40075590 2023-12-11T20:26:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.095+0000 7fea4579a700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 0x7fea40199a60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fea3000e9a0 tx=0x7fea3000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.096+0000 7fea36ffd700 1 -- 172.21.15.12:0/1430502196 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30009790 con 0x7fea40075590 2023-12-11T20:26:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.096+0000 7fea481ff700 1 -- 172.21.15.12:0/1430502196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea401a1600 con 0x7fea40075590 2023-12-11T20:26:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.096+0000 7fea36ffd700 1 -- 172.21.15.12:0/1430502196 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea30010430 con 0x7fea40075590 2023-12-11T20:26:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.096+0000 7fea36ffd700 1 -- 172.21.15.12:0/1430502196 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000cea0 con 0x7fea40075590 2023-12-11T20:26:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.096+0000 7fea481ff700 1 -- 172.21.15.12:0/1430502196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea401a1b60 con 0x7fea40075590 2023-12-11T20:26:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.099+0000 7fea36ffd700 1 -- 172.21.15.12:0/1430502196 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fea300105a0 con 0x7fea40075590 2023-12-11T20:26:18.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.101+0000 7fea36ffd700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea2c0a1480 0x7fea2c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.101+0000 7fea5bb12b80 1 Processor -- start 2023-12-11T20:26:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.101+0000 7fea36ffd700 1 -- 172.21.15.12:0/1430502196 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea30014070 con 0x7fea40075590 2023-12-11T20:26:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.101+0000 7fea5bb12b80 1 -- start start 2023-12-11T20:26:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.101+0000 7fea45f9b700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea2c0a1480 0x7fea2c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454e1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394543bb50 con 0x5639454e0d30 2023-12-11T20:26:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563945439470 con 0x5639454e1c20 2023-12-11T20:26:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563945434d60 con 0x5639454e03d0 2023-12-11T20:26:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea45f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea45f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49886/0 (socket says 172.21.15.12:49886) 2023-12-11T20:26:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea45f9b700 1 -- 172.21.15.12:0/1388057019 learned_addr learned my addr 172.21.15.12:0/1388057019 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea4679c700 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea4579a700 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454e1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea45f9b700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea2c0a1480 0x7fea2c0a3940 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fea3c005910 tx=0x7fea3c00b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea45f9b700 1 -- 172.21.15.12:0/1388057019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 msgr2=0x5639454e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea45f9b700 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454e20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.102+0000 7fea45f9b700 1 -- 172.21.15.12:0/1388057019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 msgr2=0x5639454e1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.103+0000 7fea45f9b700 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454e1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.103+0000 7fea45f9b700 1 -- 172.21.15.12:0/1388057019 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639452b1630 con 0x5639454e03d0 2023-12-11T20:26:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.103+0000 7fea45f9b700 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e07f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009990 tx=0x7fea3c028000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a8bc35c719d5ae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.103+0000 7fea2bfff700 1 -- 172.21.15.12:0/1388057019 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c003ce0 con 0x5639454e03d0 2023-12-11T20:26:18.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.103+0000 7fea2bfff700 1 -- 172.21.15.12:0/1388057019 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea3c01e040 con 0x5639454e03d0 2023-12-11T20:26:18.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea2bfff700 1 -- 172.21.15.12:0/1388057019 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c004920 con 0x5639454e03d0 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea5bb12b80 1 -- 172.21.15.12:0/1388057019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 msgr2=0x5639454e07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e07f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009990 tx=0x7fea3c028000 comp rx=0 tx=0).stop 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea5bb12b80 1 -- 172.21.15.12:0/1388057019 shutdown_connections 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e07f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/1388057019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454e1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea5bb12b80 1 -- 172.21.15.12:0/1388057019 >> 172.21.15.12:0/1388057019 conn(0x56394540f7e0 msgr2=0x5639454dcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.104+0000 7fea5bb12b80 1 -- 172.21.15.12:0/1388057019 shutdown_connections 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.105+0000 7fea5bb12b80 1 -- 172.21.15.12:0/1388057019 wait complete. 2023-12-11T20:26:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.105+0000 7fea5bb12b80 1 -- start start 2023-12-11T20:26:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.105+0000 7fea5bb12b80 1 Processor -- start 2023-12-11T20:26:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e03d0 0x5639454ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e1c20 0x5639454f1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639453ee560 con 0x5639454e1c20 2023-12-11T20:26:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639453ee200 con 0x5639454e03d0 2023-12-11T20:26:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639452b3920 con 0x5639454e0d30 2023-12-11T20:26:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea5bb12b80 10 client.0 _ll_register_callbacks cb 0x563945319a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea4679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e1c20 0x5639454f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea4679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e1c20 0x5639454f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32988/0 (socket says 172.21.15.12:32988) 2023-12-11T20:26:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea4679c700 1 -- 172.21.15.12:0/3243815145 learned_addr learned my addr 172.21.15.12:0/3243815145 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea4579a700 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.106+0000 7fea45f9b700 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e03d0 0x5639454ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.107+0000 7fea4579a700 1 -- 172.21.15.12:0/3243815145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e03d0 msgr2=0x5639454ea0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.107+0000 7fea4579a700 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e03d0 0x5639454ea0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.107+0000 7fea4579a700 1 -- 172.21.15.12:0/3243815145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e1c20 msgr2=0x5639454f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.107+0000 7fea4579a700 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e1c20 0x5639454f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.107+0000 7fea4579a700 1 -- 172.21.15.12:0/3243815145 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4010c420 con 0x5639454e0d30 2023-12-11T20:26:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.107+0000 7fea4679c700 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e1c20 0x5639454f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.107+0000 7fea4579a700 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ea5f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea3000e970 tx=0x7fea3009a720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c13d70cccc7e9751 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.107+0000 7fea297fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:26:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.108+0000 7fea297fa700 1 -- 172.21.15.12:0/3243815145 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3009e170 con 0x5639454e0d30 2023-12-11T20:26:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.108+0000 7fea5bb12b80 1 -- 172.21.15.12:0/3243815145 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639454d3b40 con 0x5639454e0d30 2023-12-11T20:26:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.108+0000 7fea297fa700 1 -- 172.21.15.12:0/3243815145 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea3009a1e0 con 0x5639454e0d30 2023-12-11T20:26:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.108+0000 7fea297fa700 1 -- 172.21.15.12:0/3243815145 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea3009e330 con 0x5639454e0d30 2023-12-11T20:26:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.108+0000 7fea5bb12b80 10 client.28057 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.108+0000 7fea5bb12b80 1 -- 172.21.15.12:0/3243815145 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56394525dde0 con 0x5639454e0d30 2023-12-11T20:26:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.108+0000 7fea297fa700 1 -- 172.21.15.12:0/3243815145 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea30063080 con 0x5639454e0d30 2023-12-11T20:26:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.108+0000 7fea297fa700 1 -- 172.21.15.12:0/3243815145 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fea300b82e0 con 0x5639454e0d30 2023-12-11T20:26:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.109+0000 7fea5bb12b80 10 client.28057 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.109+0000 7fea5bb12b80 10 client.28057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.109+0000 7fea5bb12b80 20 client.28057 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.109+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5639454f5ed0 0x5639454f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.109+0000 7fea5bb12b80 4 client.28057 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.109+0000 7fea5bb12b80 1 -- 172.21.15.12:0/3243815145 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639454aff40 con 0x5639454f5ed0 2023-12-11T20:26:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.109+0000 7fea45f9b700 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5639454f5ed0 0x5639454f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.110+0000 7fea45f9b700 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5639454f5ed0 0x5639454f82f0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecdcaf02e55ce4f7 server_cookie=8832a9f6cba09c00 in_seq=0 out_seq=0 2023-12-11T20:26:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.110+0000 7fea297fa700 10 client.28057 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea297fa700 1 -- 172.21.15.12:0/3243815145 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5639454aff40 con 0x5639454f5ed0 2023-12-11T20:26:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea297fa700 10 client.28057 handle_command_reply: tid=0 2023-12-11T20:26:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 client.28057 shutdown 2023-12-11T20:26:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 -- 172.21.15.12:0/3243815145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 msgr2=0x5639454ea5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ea5f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea3000e970 tx=0x7fea3009a720 comp rx=0 tx=0).stop 2023-12-11T20:26:18.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 -- 172.21.15.12:0/3243815145 shutdown_connections 2023-12-11T20:26:18.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5639454f5ed0 0x5639454f82f0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e03d0 0x5639454ea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e1c20 0x5639454f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/3243815145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ea5f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea297fa700 0 client.28057 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:18.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 -- 172.21.15.12:0/3243815145 >> 172.21.15.12:0/3243815145 conn(0x56394540f7e0 msgr2=0x5639454dba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:18.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 -- 172.21.15.12:0/3243815145 shutdown_connections 2023-12-11T20:26:18.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.111+0000 7fea5bb12b80 1 -- 172.21.15.12:0/3243815145 wait complete. 2023-12-11T20:26:18.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.112+0000 7fea5bb12b80 20 client.28057 trim_cache size 0 max 16384 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.129+0000 7fea5bb12b80 1 Processor -- start 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.129+0000 7fea5bb12b80 1 -- start start 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.129+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.129+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.129+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454e2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.129+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639454dff70 con 0x5639454e0d30 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.129+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639454f5cf0 con 0x5639454e1c20 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.129+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639454e9c20 con 0x5639454e03d0 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33004/0 (socket says 172.21.15.12:33004) 2023-12-11T20:26:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 -- 172.21.15.12:0/574758503 learned_addr learned my addr 172.21.15.12:0/574758503 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4679c700 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea45f9b700 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 -- 172.21.15.12:0/574758503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 msgr2=0x5639454e95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 -- 172.21.15.12:0/574758503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 msgr2=0x5639454e2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454e2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 -- 172.21.15.12:0/574758503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563945246c60 con 0x5639454e0d30 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea4579a700 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454f15f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fea3000c2d0 tx=0x7fea30005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34b547f8007042b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.130+0000 7fea34ff9700 1 -- 172.21.15.12:0/574758503 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300960c0 con 0x5639454e0d30 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea34ff9700 1 -- 172.21.15.12:0/574758503 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5639454d3b40 con 0x5639454e0d30 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea34ff9700 1 -- 172.21.15.12:0/574758503 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300a2340 con 0x5639454e0d30 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 -- 172.21.15.12:0/574758503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 msgr2=0x5639454f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454f15f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fea3000c2d0 tx=0x7fea30005b40 comp rx=0 tx=0).stop 2023-12-11T20:26:18.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 -- 172.21.15.12:0/574758503 shutdown_connections 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454e2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e03d0 0x5639454e95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/574758503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e0d30 0x5639454f15f0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 -- 172.21.15.12:0/574758503 >> 172.21.15.12:0/574758503 conn(0x56394540f7e0 msgr2=0x5639454fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 -- 172.21.15.12:0/574758503 shutdown_connections 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.131+0000 7fea5bb12b80 1 -- 172.21.15.12:0/574758503 wait complete. 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 1 -- start start 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 1 Processor -- start 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e03d0 0x5639454eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639454f0700 con 0x5639454e03d0 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639454f0870 con 0x5639454e1c20 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639454f0a30 con 0x5639454e0d30 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.132+0000 7fea5bb12b80 10 client.0 _ll_register_callbacks cb 0x563945319a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:18.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea45f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e03d0 0x5639454eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea45f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e03d0 0x5639454eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33006/0 (socket says 172.21.15.12:33006) 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea45f9b700 1 -- 172.21.15.12:0/665758670 learned_addr learned my addr 172.21.15.12:0/665758670 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea4679c700 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea4579a700 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea45f9b700 1 -- 172.21.15.12:0/665758670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 msgr2=0x5639454ed1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea45f9b700 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ed1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea45f9b700 1 -- 172.21.15.12:0/665758670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 msgr2=0x5639454f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea45f9b700 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea45f9b700 1 -- 172.21.15.12:0/665758670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56394525dde0 con 0x5639454e03d0 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.133+0000 7fea4579a700 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea45f9b700 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e03d0 0x5639454eccb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00c010 tx=0x7fea3c005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38391d1f7aa0627 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea297fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea297fa700 1 -- 172.21.15.12:0/665758670 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00b2e0 con 0x5639454e03d0 2023-12-11T20:26:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea5bb12b80 1 -- 172.21.15.12:0/665758670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea3c01e040 con 0x5639454e03d0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea297fa700 1 -- 172.21.15.12:0/665758670 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea3c0039e0 con 0x5639454e03d0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea297fa700 1 -- 172.21.15.12:0/665758670 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea3c00b710 con 0x5639454e03d0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea5bb12b80 10 client.18459 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea5bb12b80 1 -- 172.21.15.12:0/665758670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563945284250 con 0x5639454e03d0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.134+0000 7fea297fa700 1 -- 172.21.15.12:0/665758670 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea3c01e040 con 0x5639454e03d0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.135+0000 7fea297fa700 1 -- 172.21.15.12:0/665758670 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fea3c03f510 con 0x5639454e03d0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.135+0000 7fea5bb12b80 10 client.18459 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.135+0000 7fea5bb12b80 10 client.18459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.135+0000 7fea5bb12b80 20 client.18459 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.135+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56394554c8a0 0x56394554ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.135+0000 7fea5bb12b80 4 client.18459 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.135+0000 7fea5bb12b80 1 -- 172.21.15.12:0/665758670 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5639453fafd0 con 0x56394554c8a0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.135+0000 7fea4579a700 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56394554c8a0 0x56394554ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea4579a700 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56394554c8a0 0x56394554ecc0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd14027c05118eb1 server_cookie=1aa5d7e8916cbfb1 in_seq=0 out_seq=0 2023-12-11T20:26:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea297fa700 10 client.18459 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:18.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea297fa700 1 -- 172.21.15.12:0/665758670 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5639453fafd0 con 0x56394554c8a0 2023-12-11T20:26:18.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea297fa700 10 client.18459 handle_command_reply: tid=0 2023-12-11T20:26:18.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 client.18459 shutdown 2023-12-11T20:26:18.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 -- 172.21.15.12:0/665758670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e03d0 msgr2=0x5639454eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e03d0 0x5639454eccb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00c010 tx=0x7fea3c005320 comp rx=0 tx=0).stop 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 -- 172.21.15.12:0/665758670 shutdown_connections 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56394554c8a0 0x56394554ecc0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5639454e1c20 0x5639454f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5639454e03d0 0x5639454eccb0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea297fa700 0 client.18459 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 --2- 172.21.15.12:0/665758670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5639454e0d30 0x5639454ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 -- 172.21.15.12:0/665758670 >> 172.21.15.12:0/665758670 conn(0x56394540f7e0 msgr2=0x5639454e7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 -- 172.21.15.12:0/665758670 shutdown_connections 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.136+0000 7fea5bb12b80 1 -- 172.21.15.12:0/665758670 wait complete. 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea5bb12b80 20 client.18459 trim_cache size 0 max 16384 2023-12-11T20:26:18.140 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:26:18.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 -- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea2c0a1480 msgr2=0x7fea2c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea2c0a1480 0x7fea2c0a3940 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fea3c005910 tx=0x7fea3c00b610 comp rx=0 tx=0).stop 2023-12-11T20:26:18.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 -- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 msgr2=0x7fea40199a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:18.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 0x7fea40199a60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fea3000e9a0 tx=0x7fea3000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 -- 172.21.15.12:0/1430502196 shutdown_connections 2023-12-11T20:26:18.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fea2c0a1480 0x7fea2c0a3940 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea401093a0 0x7fea401a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea40073fb0 0x7fea40199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 --2- 172.21.15.12:0/1430502196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea40075590 0x7fea40199a60 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:18.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.137+0000 7fea481ff700 1 -- 172.21.15.12:0/1430502196 >> 172.21.15.12:0/1430502196 conn(0x7fea400fca00 msgr2=0x7fea401052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:18.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.138+0000 7fea481ff700 1 -- 172.21.15.12:0/1430502196 shutdown_connections 2023-12-11T20:26:18.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:18.138+0000 7fea481ff700 1 -- 172.21.15.12:0/1430502196 wait complete. 2023-12-11T20:26:18.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:18 smithi039 ceph-mon[102205]: pgmap v686: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:26:18.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:18 smithi012 ceph-mon[128787]: pgmap v686: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:26:18.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:18 smithi032 ceph-mon[132488]: pgmap v686: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:26:19.157 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:26:19.157 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.267+0000 7fcfae7ff700 1 -- 172.21.15.12:0/1156467684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa81026a0 msgr2=0x7fcfa8104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.267+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/1156467684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa81026a0 0x7fcfa8104b30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009990 tx=0x7fcf9c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.267+0000 7fcfae7ff700 1 -- 172.21.15.12:0/1156467684 shutdown_connections 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.267+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/1156467684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfa80ffd30 0x7fcfa8102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.267+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/1156467684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfa8105070 0x7fcfa81054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.267+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/1156467684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa81026a0 0x7fcfa8104b30 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.267+0000 7fcfae7ff700 1 -- 172.21.15.12:0/1156467684 >> 172.21.15.12:0/1156467684 conn(0x7fcfa80fb930 msgr2=0x7fcfa80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.268+0000 7fcfae7ff700 1 -- 172.21.15.12:0/1156467684 shutdown_connections 2023-12-11T20:26:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.268+0000 7fcfae7ff700 1 -- 172.21.15.12:0/1156467684 wait complete. 2023-12-11T20:26:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.269+0000 7fcfae7ff700 1 Processor -- start 2023-12-11T20:26:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.269+0000 7fcfae7ff700 1 -- start start 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.269+0000 7fcfae7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfa80ffd30 0x7fcfa819d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.269+0000 7fcfae7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfa81026a0 0x7fcfa819de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.269+0000 7fcfae7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa8105070 0x7fcfa81a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.269+0000 7fcfae7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81a5460 con 0x7fcfa8105070 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.269+0000 7fcfae7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81a55a0 con 0x7fcfa81026a0 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.269+0000 7fcfae7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81a5730 con 0x7fcfa80ffd30 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfa80ffd30 0x7fcfa819d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfa81026a0 0x7fcfa819de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfa80ffd30 0x7fcfa819d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44598/0 (socket says 172.21.15.12:44598) 2023-12-11T20:26:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa7fff700 1 -- 172.21.15.12:0/504992401 learned_addr learned my addr 172.21.15.12:0/504992401 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfa81026a0 0x7fcfa819de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:59202/0 (socket says 172.21.15.12:59202) 2023-12-11T20:26:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa8105070 0x7fcfa81a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa7fff700 1 -- 172.21.15.12:0/504992401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfa81026a0 msgr2=0x7fcfa819de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfa81026a0 0x7fcfa819de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa7fff700 1 -- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa8105070 msgr2=0x7fcfa81a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa8105070 0x7fcfa81a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfa7fff700 1 -- 172.21.15.12:0/504992401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0095f0 con 0x7fcfa80ffd30 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.270+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa8105070 0x7fcfa81a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.271+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfa80ffd30 0x7fcfa819d930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800d950 tx=0x7fcf9800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.271+0000 7fcfa57fa700 1 -- 172.21.15.12:0/504992401 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800f890 con 0x7fcfa80ffd30 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.271+0000 7fcfae7ff700 1 -- 172.21.15.12:0/504992401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa81a5a10 con 0x7fcfa80ffd30 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.271+0000 7fcfa57fa700 1 -- 172.21.15.12:0/504992401 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf9800fe80 con 0x7fcfa80ffd30 2023-12-11T20:26:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.271+0000 7fcfa57fa700 1 -- 172.21.15.12:0/504992401 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800e3b0 con 0x7fcfa80ffd30 2023-12-11T20:26:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.272+0000 7fcfae7ff700 1 -- 172.21.15.12:0/504992401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa81a5f70 con 0x7fcfa80ffd30 2023-12-11T20:26:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.277+0000 7fcfa57fa700 1 -- 172.21.15.12:0/504992401 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcf98010460 con 0x7fcfa80ffd30 2023-12-11T20:26:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.278+0000 7fcfc2222b80 1 Processor -- start 2023-12-11T20:26:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.278+0000 7fcfc2222b80 1 -- start start 2023-12-11T20:26:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.278+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.278+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.278+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 0x5610713adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.278+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561071307af0 con 0x5610713abed0 2023-12-11T20:26:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.278+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561071305410 con 0x5610713ad720 2023-12-11T20:26:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.278+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561071300d00 con 0x5610713ac830 2023-12-11T20:26:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfa57fa700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf900a14f0 0x7fcf900a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfa7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49740/0 (socket says 172.21.15.12:49740) 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 -- 172.21.15.12:0/615853261 learned_addr learned my addr 172.21.15.12:0/615853261 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfa77fe700 1 --2- 172.21.15.12:0/615853261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 0x5610713adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfa57fa700 1 -- 172.21.15.12:0/504992401 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf980cca90 con 0x7fcfa80ffd30 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf900a14f0 0x7fcf900a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 -- 172.21.15.12:0/615853261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 msgr2=0x5610713ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/615853261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 -- 172.21.15.12:0/615853261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 msgr2=0x5610713adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/615853261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 0x5610713adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.279+0000 7fcfacd9c700 1 -- 172.21.15.12:0/615853261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56107117d5d0 con 0x5610713abed0 2023-12-11T20:26:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.280+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/615853261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713ac2f0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007eb0 tx=0x7fcfa00175d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27afc5c06b3d174 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.280+0000 7fcf8e7fc700 1 -- 172.21.15.12:0/615853261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0027070 con 0x5610713abed0 2023-12-11T20:26:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.280+0000 7fcf8e7fc700 1 -- 172.21.15.12:0/615853261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa000f040 con 0x5610713abed0 2023-12-11T20:26:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.280+0000 7fcf8e7fc700 1 -- 172.21.15.12:0/615853261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0023580 con 0x5610713abed0 2023-12-11T20:26:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 -- 172.21.15.12:0/615853261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 msgr2=0x5610713ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf900a14f0 0x7fcf900a39b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0022000 tx=0x7fcfa001d000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/615853261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713ac2f0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007eb0 tx=0x7fcfa00175d0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 -- 172.21.15.12:0/615853261 shutdown_connections 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/615853261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 0x5610713adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/615853261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713ac2f0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/615853261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 -- 172.21.15.12:0/615853261 >> 172.21.15.12:0/615853261 conn(0x5610712db780 msgr2=0x5610713a8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 -- 172.21.15.12:0/615853261 shutdown_connections 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.281+0000 7fcfc2222b80 1 -- 172.21.15.12:0/615853261 wait complete. 2023-12-11T20:26:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.282+0000 7fcfc2222b80 1 -- start start 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.282+0000 7fcfc2222b80 1 Processor -- start 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713abed0 0x5610713b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ad720 0x5610713bd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610712ba500 con 0x5610713ad720 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610712ba1a0 con 0x5610713abed0 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56107117f8c0 con 0x5610713ac830 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfc2222b80 10 client.0 _ll_register_callbacks cb 0x5610711e5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfacd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ad720 0x5610713bd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfacd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ad720 0x5610713bd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49744/0 (socket says 172.21.15.12:49744) 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfacd9c700 1 -- 172.21.15.12:0/2548146646 learned_addr learned my addr 172.21.15.12:0/2548146646 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713abed0 0x5610713b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfacd9c700 1 -- 172.21.15.12:0/2548146646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 msgr2=0x5610713b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfacd9c700 1 -- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713abed0 msgr2=0x5610713b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713abed0 0x5610713b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfacd9c700 1 -- 172.21.15.12:0/2548146646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa0007a60 con 0x5610713ad720 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.283+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713abed0 0x5610713b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcfa77fe700 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ad720 0x5610713bd1f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007a30 tx=0x7fcfa0017a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3461169852a14a9c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcf877fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcf877fe700 1 -- 172.21.15.12:0/2548146646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0027040 con 0x5610713ad720 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcfc2222b80 1 -- 172.21.15.12:0/2548146646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56107139f730 con 0x5610713ad720 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcf877fe700 1 -- 172.21.15.12:0/2548146646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcfa0003a00 con 0x5610713ad720 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcf877fe700 1 -- 172.21.15.12:0/2548146646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa0007860 con 0x5610713ad720 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcfc2222b80 10 client.18471 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.284+0000 7fcfc2222b80 1 -- 172.21.15.12:0/2548146646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561071129d80 con 0x5610713ad720 2023-12-11T20:26:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.285+0000 7fcf877fe700 1 -- 172.21.15.12:0/2548146646 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56107139f730 con 0x5610713ad720 2023-12-11T20:26:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.285+0000 7fcf877fe700 1 -- 172.21.15.12:0/2548146646 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcfa0004040 con 0x5610713ad720 2023-12-11T20:26:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.285+0000 7fcfc2222b80 10 client.18471 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.285+0000 7fcfc2222b80 10 client.18471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.285+0000 7fcfc2222b80 20 client.18471 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.285+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5610713c1ce0 0x5610713c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.285+0000 7fcfc2222b80 4 client.18471 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.285+0000 7fcfc2222b80 1 -- 172.21.15.12:0/2548146646 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56107137bee0 con 0x5610713c1ce0 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.286+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5610713c1ce0 0x5610713c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.286+0000 7fcf877fe700 10 client.18471 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.286+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5610713c1ce0 0x5610713c4100 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f83d683b2e1a6478 server_cookie=9b5aa7b1cc06fa5a in_seq=0 out_seq=0 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcf877fe700 1 -- 172.21.15.12:0/2548146646 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56107137bee0 con 0x5610713c1ce0 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcf877fe700 10 client.18471 handle_command_reply: tid=0 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 client.18471 shutdown 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 -- 172.21.15.12:0/2548146646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ad720 msgr2=0x5610713bd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ad720 0x5610713bd1f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007a30 tx=0x7fcfa0017a60 comp rx=0 tx=0).stop 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 -- 172.21.15.12:0/2548146646 shutdown_connections 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5610713c1ce0 0x5610713c4100 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713abed0 0x5610713b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ad720 0x5610713bd1f0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/2548146646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ac830 0x5610713b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcfc2222b80 1 -- 172.21.15.12:0/2548146646 >> 172.21.15.12:0/2548146646 conn(0x5610712db780 msgr2=0x5610713a6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.287+0000 7fcf877fe700 0 client.18471 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.288+0000 7fcfc2222b80 1 -- 172.21.15.12:0/2548146646 shutdown_connections 2023-12-11T20:26:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.288+0000 7fcfc2222b80 1 -- 172.21.15.12:0/2548146646 wait complete. 2023-12-11T20:26:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.288+0000 7fcfc2222b80 20 client.18471 trim_cache size 0 max 16384 2023-12-11T20:26:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.307+0000 7fcfc2222b80 1 Processor -- start 2023-12-11T20:26:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfc2222b80 1 -- start start 2023-12-11T20:26:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713bdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ac830 0x5610713bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ad720 0x5610713b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610713acc80 con 0x5610713abed0 2023-12-11T20:26:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610713c9320 con 0x5610713ac830 2023-12-11T20:26:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56107139f4f0 con 0x5610713ad720 2023-12-11T20:26:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfa7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713bdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfa7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713bdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49752/0 (socket says 172.21.15.12:49752) 2023-12-11T20:26:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.308+0000 7fcfa7fff700 1 -- 172.21.15.12:0/1873784207 learned_addr learned my addr 172.21.15.12:0/1873784207 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ad720 0x5610713b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcfa77fe700 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ac830 0x5610713bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcfa7fff700 1 -- 172.21.15.12:0/1873784207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ad720 msgr2=0x5610713b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ad720 0x5610713b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcfa7fff700 1 -- 172.21.15.12:0/1873784207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ac830 msgr2=0x5610713bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ac830 0x5610713bd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcfa7fff700 1 -- 172.21.15.12:0/1873784207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561071112c00 con 0x5610713abed0 2023-12-11T20:26:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713bdad0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fcf980967d0 tx=0x7fcf980cef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea186bc42a73f50 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.309+0000 7fcf8effd700 1 -- 172.21.15.12:0/1873784207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980b1070 con 0x5610713abed0 2023-12-11T20:26:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.310+0000 7fcf8effd700 1 -- 172.21.15.12:0/1873784207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf9809a460 con 0x5610713abed0 2023-12-11T20:26:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.310+0000 7fcf8effd700 1 -- 172.21.15.12:0/1873784207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98098100 con 0x5610713abed0 2023-12-11T20:26:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 -- 172.21.15.12:0/1873784207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 msgr2=0x5610713bdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713bdad0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fcf980967d0 tx=0x7fcf980cef60 comp rx=0 tx=0).stop 2023-12-11T20:26:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 -- 172.21.15.12:0/1873784207 shutdown_connections 2023-12-11T20:26:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713ad720 0x5610713b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713abed0 0x5610713bdad0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/1873784207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ac830 0x5610713bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 -- 172.21.15.12:0/1873784207 >> 172.21.15.12:0/1873784207 conn(0x5610712db780 msgr2=0x5610713b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 -- 172.21.15.12:0/1873784207 shutdown_connections 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 -- 172.21.15.12:0/1873784207 wait complete. 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.311+0000 7fcfc2222b80 1 -- start start 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfc2222b80 1 Processor -- start 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713abed0 0x5610713b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ac830 0x5610714141b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfc2222b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 0x561071416700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561071416c40 con 0x5610713ac830 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561071416d80 con 0x5610713ad720 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfc2222b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561071416ec0 con 0x5610713abed0 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfc2222b80 10 client.0 _ll_register_callbacks cb 0x5610711e5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ac830 0x5610714141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ac830 0x5610714141b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49760/0 (socket says 172.21.15.12:49760) 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.312+0000 7fcfa77fe700 1 -- 172.21.15.12:0/402403807 learned_addr learned my addr 172.21.15.12:0/402403807 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcfacd9c700 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 0x561071416700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713abed0 0x5610713b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcfa77fe700 1 -- 172.21.15.12:0/402403807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713abed0 msgr2=0x5610713b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcfa77fe700 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713abed0 0x5610713b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcfa77fe700 1 -- 172.21.15.12:0/402403807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 msgr2=0x561071416700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcfa77fe700 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 0x561071416700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcfa77fe700 1 -- 172.21.15.12:0/402403807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa81a5f70 con 0x5610713ac830 2023-12-11T20:26:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcfa77fe700 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ac830 0x5610714141b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c015000 tx=0x7fcf9c005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd561c770b80c7b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.313+0000 7fcf877fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.314+0000 7fcf877fe700 1 -- 172.21.15.12:0/402403807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c01d040 con 0x5610713ac830 2023-12-11T20:26:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.314+0000 7fcfc2222b80 1 -- 172.21.15.12:0/402403807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610713b4c80 con 0x5610713ac830 2023-12-11T20:26:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.314+0000 7fcf877fe700 1 -- 172.21.15.12:0/402403807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf9c004700 con 0x5610713ac830 2023-12-11T20:26:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.314+0000 7fcf877fe700 1 -- 172.21.15.12:0/402403807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf9c0048c0 con 0x5610713ac830 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.314+0000 7fcfc2222b80 10 client.18477 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.314+0000 7fcfc2222b80 1 -- 172.21.15.12:0/402403807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5610711501f0 con 0x5610713ac830 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.314+0000 7fcf877fe700 1 -- 172.21.15.12:0/402403807 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5610713b4c80 con 0x5610713ac830 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.315+0000 7fcf877fe700 1 -- 172.21.15.12:0/402403807 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcf9c023070 con 0x5610713ac830 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.315+0000 7fcfc2222b80 10 client.18477 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.315+0000 7fcfc2222b80 10 client.18477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.315+0000 7fcfc2222b80 20 client.18477 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.315+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5610714189c0 0x56107141ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.315+0000 7fcfc2222b80 4 client.18477 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.315+0000 7fcfc2222b80 1 -- 172.21.15.12:0/402403807 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fcfa000f040 con 0x5610714189c0 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.315+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5610714189c0 0x56107141ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.316+0000 7fcfa7fff700 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5610714189c0 0x56107141ade0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f666addbc4a9a47a server_cookie=c0a786016a029564 in_seq=0 out_seq=0 2023-12-11T20:26:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.316+0000 7fcf877fe700 10 client.18477 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcf877fe700 1 -- 172.21.15.12:0/402403807 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fcfa000f040 con 0x5610714189c0 2023-12-11T20:26:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcf877fe700 10 client.18477 handle_command_reply: tid=0 2023-12-11T20:26:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 client.18477 shutdown 2023-12-11T20:26:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 -- 172.21.15.12:0/402403807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ac830 msgr2=0x5610714141b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ac830 0x5610714141b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c015000 tx=0x7fcf9c005460 comp rx=0 tx=0).stop 2023-12-11T20:26:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 -- 172.21.15.12:0/402403807 shutdown_connections 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5610714189c0 0x56107141ade0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610713ad720 0x561071416700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610713abed0 0x5610713b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcf877fe700 0 client.18477 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 --2- 172.21.15.12:0/402403807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610713ac830 0x5610714141b0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.327+0000 7fcfc2222b80 1 -- 172.21.15.12:0/402403807 >> 172.21.15.12:0/402403807 conn(0x5610712db780 msgr2=0x5610713b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.328+0000 7fcfc2222b80 1 -- 172.21.15.12:0/402403807 shutdown_connections 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.328+0000 7fcfc2222b80 1 -- 172.21.15.12:0/402403807 wait complete. 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.328+0000 7fcfc2222b80 20 client.18477 trim_cache size 0 max 16384 2023-12-11T20:26:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:26:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:26:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:26:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:26:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.328+0000 7fcfae7ff700 1 -- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf900a14f0 msgr2=0x7fcf900a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.328+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf900a14f0 0x7fcf900a39b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0022000 tx=0x7fcfa001d000 comp rx=0 tx=0).stop 2023-12-11T20:26:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.328+0000 7fcfae7ff700 1 -- 172.21.15.12:0/504992401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfa80ffd30 msgr2=0x7fcfa819d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.328+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfa80ffd30 0x7fcfa819d930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800d950 tx=0x7fcf9800dc60 comp rx=0 tx=0).stop 2023-12-11T20:26:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.329+0000 7fcfae7ff700 1 -- 172.21.15.12:0/504992401 shutdown_connections 2023-12-11T20:26:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.329+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcf900a14f0 0x7fcf900a39b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.329+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfa8105070 0x7fcfa81a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.329+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfa80ffd30 0x7fcfa819d930 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.329+0000 7fcfae7ff700 1 --2- 172.21.15.12:0/504992401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfa81026a0 0x7fcfa819de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.329+0000 7fcfae7ff700 1 -- 172.21.15.12:0/504992401 >> 172.21.15.12:0/504992401 conn(0x7fcfa80fb930 msgr2=0x7fcfa8100830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.329+0000 7fcfae7ff700 1 -- 172.21.15.12:0/504992401 shutdown_connections 2023-12-11T20:26:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:19.329+0000 7fcfae7ff700 1 -- 172.21.15.12:0/504992401 wait complete. 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.404+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3292509512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b81012d0 msgr2=0x7fb2b81016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.404+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3292509512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b81012d0 0x7fb2b81016f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80099c0 tx=0x7fb2a8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.404+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3292509512 shutdown_connections 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.404+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3292509512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2b8102e60 0x7fb2b8109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.404+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3292509512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b81012d0 0x7fb2b81016f0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.404+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3292509512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2b81024c0 0x7fb2b8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.404+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3292509512 >> 172.21.15.12:0/3292509512 conn(0x7fb2b80fc860 msgr2=0x7fb2b80fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.405+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3292509512 shutdown_connections 2023-12-11T20:26:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.405+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3292509512 wait complete. 2023-12-11T20:26:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b7fff700 1 Processor -- start 2023-12-11T20:26:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b7fff700 1 -- start start 2023-12-11T20:26:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2b81012d0 0x7fb2b8197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2b81024c0 0x7fb2b8197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b8102e60 0x7fb2b819e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b819ec40 con 0x7fb2b8102e60 2023-12-11T20:26:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b7fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b819ed80 con 0x7fb2b81024c0 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b7fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b819ef10 con 0x7fb2b81012d0 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.406+0000 7fb2b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b8102e60 0x7fb2b819e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b67fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2b81024c0 0x7fb2b8197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b8102e60 0x7fb2b819e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49776/0 (socket says 172.21.15.12:49776) 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b77fe700 1 -- 172.21.15.12:0/3339952260 learned_addr learned my addr 172.21.15.12:0/3339952260 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2b81012d0 0x7fb2b8197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b77fe700 1 -- 172.21.15.12:0/3339952260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2b81012d0 msgr2=0x7fb2b8197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2b81012d0 0x7fb2b8197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b77fe700 1 -- 172.21.15.12:0/3339952260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2b81024c0 msgr2=0x7fb2b8197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2b81024c0 0x7fb2b8197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b77fe700 1 -- 172.21.15.12:0/3339952260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a80095f0 con 0x7fb2b8102e60 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2b81024c0 0x7fb2b8197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.407+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b8102e60 0x7fb2b819e670 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000ef30 tx=0x7fb2b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.408+0000 7fb29ffff700 1 -- 172.21.15.12:0/3339952260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0018070 con 0x7fb2b8102e60 2023-12-11T20:26:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.408+0000 7fb29ffff700 1 -- 172.21.15.12:0/3339952260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2b000f040 con 0x7fb2b8102e60 2023-12-11T20:26:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.408+0000 7fb29ffff700 1 -- 172.21.15.12:0/3339952260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000cbc0 con 0x7fb2b8102e60 2023-12-11T20:26:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.408+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3339952260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b8073800 con 0x7fb2b8102e60 2023-12-11T20:26:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.408+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3339952260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b8073cc0 con 0x7fb2b8102e60 2023-12-11T20:26:19.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.411+0000 7fb29ffff700 1 -- 172.21.15.12:0/3339952260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb2b0007500 con 0x7fb2b8102e60 2023-12-11T20:26:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2d11e8b80 1 Processor -- start 2023-12-11T20:26:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb29ffff700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2a00a15a0 0x7fb2a00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2d11e8b80 1 -- start start 2023-12-11T20:26:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb29ffff700 1 -- 172.21.15.12:0/3339952260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb2b00cc7f0 con 0x7fb2b8102e60 2023-12-11T20:26:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2a00a15a0 0x7fb2a00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567decf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567ded920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567dede60 0x559567dee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567d47bd0 con 0x559567decae0 2023-12-11T20:26:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567d454f0 con 0x559567ded440 2023-12-11T20:26:19.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.414+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567d40de0 con 0x559567dede60 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567decf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567decf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49784/0 (socket says 172.21.15.12:49784) 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b67fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567ded920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b6ffd700 1 -- 172.21.15.12:0/2371048097 learned_addr learned my addr 172.21.15.12:0/2371048097 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/2371048097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567dede60 0x559567dee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b6ffd700 1 -- 172.21.15.12:0/2371048097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567dede60 msgr2=0x559567dee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/2371048097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567dede60 0x559567dee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b6ffd700 1 -- 172.21.15.12:0/2371048097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 msgr2=0x559567ded920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/2371048097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567ded920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b6ffd700 1 -- 172.21.15.12:0/2371048097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559567bbd6b0 con 0x559567decae0 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.415+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2a00a15a0 0x7fb2a00a3a60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac010fd0 tx=0x7fb2ac009eb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.416+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/2371048097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567decf00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009990 tx=0x7fb2a8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b8542c225e381f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.416+0000 7fb29d7fa700 1 -- 172.21.15.12:0/2371048097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800b990 con 0x559567decae0 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.416+0000 7fb29d7fa700 1 -- 172.21.15.12:0/2371048097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2a801e040 con 0x559567decae0 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.416+0000 7fb29d7fa700 1 -- 172.21.15.12:0/2371048097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8003a50 con 0x559567decae0 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/2371048097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 msgr2=0x559567decf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/2371048097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567decf00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009990 tx=0x7fb2a8005e80 comp rx=0 tx=0).stop 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/2371048097 shutdown_connections 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/2371048097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567dede60 0x559567dee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/2371048097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567decf00 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/2371048097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567ded920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/2371048097 >> 172.21.15.12:0/2371048097 conn(0x559567d1b860 msgr2=0x559567de7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/2371048097 shutdown_connections 2023-12-11T20:26:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.417+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/2371048097 wait complete. 2023-12-11T20:26:19.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 1 -- start start 2023-12-11T20:26:19.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 1 Processor -- start 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567df6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567ded440 0x559567df6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567dede60 0x559567dfd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567cfa5e0 con 0x559567ded440 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567cfa280 con 0x559567dede60 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567bbf9a0 con 0x559567decae0 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.418+0000 7fb2d11e8b80 10 client.0 _ll_register_callbacks cb 0x559567c25b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567ded440 0x559567df6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567df6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567ded440 0x559567df6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49800/0 (socket says 172.21.15.12:49800) 2023-12-11T20:26:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 -- 172.21.15.12:0/4261398148 learned_addr learned my addr 172.21.15.12:0/4261398148 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567dede60 0x559567dfd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 -- 172.21.15.12:0/4261398148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 msgr2=0x559567df6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567df6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 -- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567dede60 msgr2=0x559567dfd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567dede60 0x559567dfd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 -- 172.21.15.12:0/4261398148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b810a060 con 0x559567ded440 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567df6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567dede60 0x559567dfd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567ded440 0x559567df6940 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac004310 tx=0x7fb2ac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9323eefbebdcc88 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.419+0000 7fb29aff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.420+0000 7fb29aff5700 1 -- 172.21.15.12:0/4261398148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac015030 con 0x559567ded440 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.420+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/4261398148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559567ddfa60 con 0x559567ded440 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.420+0000 7fb29aff5700 1 -- 172.21.15.12:0/4261398148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb2ac00be80 con 0x559567ded440 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.420+0000 7fb29aff5700 1 -- 172.21.15.12:0/4261398148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2ac003680 con 0x559567ded440 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.420+0000 7fb2d11e8b80 10 client.18489 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.420+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/4261398148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559567b69e60 con 0x559567ded440 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.420+0000 7fb29aff5700 1 -- 172.21.15.12:0/4261398148 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2ac038020 con 0x559567ded440 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.421+0000 7fb29aff5700 1 -- 172.21.15.12:0/4261398148 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb2ac0328f0 con 0x559567ded440 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.421+0000 7fb2d11e8b80 10 client.18489 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.421+0000 7fb2d11e8b80 10 client.18489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.421+0000 7fb2d11e8b80 20 client.18489 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.421+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559567e02270 0x559567e04690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.421+0000 7fb2d11e8b80 4 client.18489 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.421+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/4261398148 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559567dbbfc0 con 0x559567e02270 2023-12-11T20:26:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.421+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559567e02270 0x559567e04690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.422+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559567e02270 0x559567e04690 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1eff6c13ac31e server_cookie=7be8bb41691a6cc7 in_seq=0 out_seq=0 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.422+0000 7fb29aff5700 10 client.18489 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb29aff5700 1 -- 172.21.15.12:0/4261398148 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559567dbbfc0 con 0x559567e02270 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb29aff5700 10 client.18489 handle_command_reply: tid=0 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 client.18489 shutdown 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/4261398148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567ded440 msgr2=0x559567df6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567ded440 0x559567df6940 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac004310 tx=0x7fb2ac0047c0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/4261398148 shutdown_connections 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559567e02270 0x559567e04690 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567dede60 0x559567dfd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567df6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/4261398148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567ded440 0x559567df6940 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/4261398148 >> 172.21.15.12:0/4261398148 conn(0x559567d1b860 msgr2=0x559567deb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb29aff5700 0 client.18489 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/4261398148 shutdown_connections 2023-12-11T20:26:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/4261398148 wait complete. 2023-12-11T20:26:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.423+0000 7fb2d11e8b80 20 client.18489 trim_cache size 0 max 16384 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.444+0000 7fb2d11e8b80 1 Processor -- start 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.444+0000 7fb2d11e8b80 1 -- start start 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.444+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567d1b860 0x559567e08fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.444+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567dfd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.444+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567df6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.444+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567de3900 con 0x559567d1b860 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.444+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567df5f90 con 0x559567ded440 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.444+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567dfeab0 con 0x559567decae0 2023-12-11T20:26:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567d1b860 0x559567e08fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b67fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567dfd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b67fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567dfd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44680/0 (socket says 172.21.15.12:44680) 2023-12-11T20:26:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567d1b860 0x559567e08fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49810/0 (socket says 172.21.15.12:49810) 2023-12-11T20:26:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b67fc700 1 -- 172.21.15.12:0/642137197 learned_addr learned my addr 172.21.15.12:0/642137197 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567df6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b67fc700 1 -- 172.21.15.12:0/642137197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 msgr2=0x559567df6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567df6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b67fc700 1 -- 172.21.15.12:0/642137197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567d1b860 msgr2=0x559567e08fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567d1b860 0x559567e08fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b67fc700 1 -- 172.21.15.12:0/642137197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559567b52ce0 con 0x559567decae0 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567df6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.445+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567d1b860 0x559567e08fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.446+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567dfd8f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac004750 tx=0x7fb2ac032ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a0e2eba2a0508eb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.446+0000 7fb29dffb700 1 -- 172.21.15.12:0/642137197 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac015070 con 0x559567decae0 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.446+0000 7fb29dffb700 1 -- 172.21.15.12:0/642137197 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2ac038070 con 0x559567decae0 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.446+0000 7fb29dffb700 1 -- 172.21.15.12:0/642137197 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac032640 con 0x559567decae0 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/642137197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 msgr2=0x559567dfd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567dfd8f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac004750 tx=0x7fb2ac032ee0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/642137197 shutdown_connections 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567ded440 0x559567df6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567d1b860 0x559567e08fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/642137197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567decae0 0x559567dfd8f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/642137197 >> 172.21.15.12:0/642137197 conn(0x559567de7780 msgr2=0x559567df5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/642137197 shutdown_connections 2023-12-11T20:26:19.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.447+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/642137197 wait complete. 2023-12-11T20:26:19.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 1 -- start start 2023-12-11T20:26:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 1 Processor -- start 2023-12-11T20:26:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567d1b860 0x559567dfd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567dfbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567ded440 0x559567dfc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567dfc9d0 con 0x559567decae0 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567dfcb40 con 0x559567d1b860 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559567e58720 con 0x559567ded440 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.448+0000 7fb2d11e8b80 10 client.0 _ll_register_callbacks cb 0x559567c25b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567dfbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567dfbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49818/0 (socket says 172.21.15.12:49818) 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 -- 172.21.15.12:0/737367017 learned_addr learned my addr 172.21.15.12:0/737367017 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567d1b860 0x559567dfd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b77fe700 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567ded440 0x559567dfc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 -- 172.21.15.12:0/737367017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567ded440 msgr2=0x559567dfc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567ded440 0x559567dfc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 -- 172.21.15.12:0/737367017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567d1b860 msgr2=0x559567dfd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567d1b860 0x559567dfd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 -- 172.21.15.12:0/737367017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559567bbd6b0 con 0x559567decae0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb2b67fc700 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567dfbdf0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac032c70 tx=0x7fb2ac0049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8d61e4f7f7e3ce server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.449+0000 7fb29aff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.450+0000 7fb29aff5700 1 -- 172.21.15.12:0/737367017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac015040 con 0x559567decae0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.450+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/737367017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2a801e040 con 0x559567decae0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.450+0000 7fb29aff5700 1 -- 172.21.15.12:0/737367017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb2ac039080 con 0x559567decae0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.450+0000 7fb29aff5700 1 -- 172.21.15.12:0/737367017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2ac004c10 con 0x559567decae0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.450+0000 7fb2d11e8b80 10 client.18495 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.450+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/737367017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fb2b8073cc0 con 0x559567decae0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.450+0000 7fb29aff5700 1 -- 172.21.15.12:0/737367017 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2a801e040 con 0x559567decae0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.451+0000 7fb29aff5700 1 -- 172.21.15.12:0/737367017 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb2ac005370 con 0x559567decae0 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.451+0000 7fb2d11e8b80 10 client.18495 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.451+0000 7fb2d11e8b80 10 client.18495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.451+0000 7fb2d11e8b80 20 client.18495 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.451+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559567dede60 0x559567e5bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.451+0000 7fb2d11e8b80 4 client.18495 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:26:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.451+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/737367017 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559567d07050 con 0x559567dede60 2023-12-11T20:26:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.451+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559567dede60 0x559567e5bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.452+0000 7fb29aff5700 10 client.18495 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.452+0000 7fb2b6ffd700 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559567dede60 0x559567e5bc10 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b8e05eb24169d16 server_cookie=341478bf87b59e93 in_seq=0 out_seq=0 2023-12-11T20:26:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.453+0000 7fb29aff5700 1 -- 172.21.15.12:0/737367017 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559567d07050 con 0x559567dede60 2023-12-11T20:26:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.453+0000 7fb29aff5700 10 client.18495 handle_command_reply: tid=0 2023-12-11T20:26:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.453+0000 7fb2d11e8b80 1 client.18495 shutdown 2023-12-11T20:26:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/737367017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 msgr2=0x559567dfbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567dfbdf0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac032c70 tx=0x7fb2ac0049f0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/737367017 shutdown_connections 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559567dede60 0x559567e5bc10 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559567d1b860 0x559567dfd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559567ded440 0x559567dfc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 --2- 172.21.15.12:0/737367017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559567decae0 0x559567dfbdf0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb29aff5700 0 client.18495 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/737367017 >> 172.21.15.12:0/737367017 conn(0x559567de7780 msgr2=0x559567e08fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/737367017 shutdown_connections 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 1 -- 172.21.15.12:0/737367017 wait complete. 2023-12-11T20:26:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.454+0000 7fb2d11e8b80 20 client.18495 trim_cache size 0 max 16384 2023-12-11T20:26:19.455 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:26:19.455 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:26:19.455 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "887a86e8-2faa-4e8e-8c2f-95315d1101fd", 2023-12-11T20:26:19.455 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:26:19.455 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:26:19.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2a00a15a0 msgr2=0x7fb2a00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2a00a15a0 0x7fb2a00a3a60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac010fd0 tx=0x7fb2ac009eb0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b8102e60 msgr2=0x7fb2b819e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b8102e60 0x7fb2b819e670 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000ef30 tx=0x7fb2b000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3339952260 shutdown_connections 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb2a00a15a0 0x7fb2a00a3a60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2b8102e60 0x7fb2b819e670 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2b81012d0 0x7fb2b8197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 --2- 172.21.15.12:0/3339952260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2b81024c0 0x7fb2b8197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3339952260 >> 172.21.15.12:0/3339952260 conn(0x7fb2b80fc860 msgr2=0x7fb2b8105830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3339952260 shutdown_connections 2023-12-11T20:26:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.455+0000 7fb2b7fff700 1 -- 172.21.15.12:0/3339952260 wait complete. 2023-12-11T20:26:19.478 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 -- 172.21.15.12:0/2169561808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684074030 msgr2=0x7f36840744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 --2- 172.21.15.12:0/2169561808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684074030 0x7f36840744b0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f3670009990 tx=0x7f3670009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 -- 172.21.15.12:0/2169561808 shutdown_connections 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 --2- 172.21.15.12:0/2169561808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3684075610 0x7f3684073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 --2- 172.21.15.12:0/2169561808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f368410da80 0x7f368410fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 --2- 172.21.15.12:0/2169561808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684074030 0x7f36840744b0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 -- 172.21.15.12:0/2169561808 >> 172.21.15.12:0/2169561808 conn(0x7f36840fca00 msgr2=0x7f36840fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 -- 172.21.15.12:0/2169561808 shutdown_connections 2023-12-11T20:26:19.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.748+0000 7f368afff700 1 -- 172.21.15.12:0/2169561808 wait complete. 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.749+0000 7f368afff700 1 Processor -- start 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f368afff700 1 -- start start 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f368afff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3684074030 0x7f368419d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f368afff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684075610 0x7f368419df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f368afff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f368410da80 0x7f36841a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f368afff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36841a54f0 con 0x7f3684075610 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f368afff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36841a5630 con 0x7f368410da80 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f368afff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36841a57c0 con 0x7f3684074030 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f3683fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684075610 0x7f368419df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f3683fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684075610 0x7f368419df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49836/0 (socket says 172.21.15.12:49836) 2023-12-11T20:26:19.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.750+0000 7f3683fff700 1 -- 172.21.15.12:0/906768283 learned_addr learned my addr 172.21.15.12:0/906768283 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.751+0000 7f368959c700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f368410da80 0x7f36841a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.751+0000 7f3688d9b700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3684074030 0x7f368419d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.751+0000 7f3683fff700 1 -- 172.21.15.12:0/906768283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3684074030 msgr2=0x7f368419d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.751+0000 7f3683fff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3684074030 0x7f368419d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.751+0000 7f3683fff700 1 -- 172.21.15.12:0/906768283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f368410da80 msgr2=0x7f36841a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.751+0000 7f3683fff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f368410da80 0x7f36841a4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.751+0000 7f3683fff700 1 -- 172.21.15.12:0/906768283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700095f0 con 0x7f3684075610 2023-12-11T20:26:19.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.751+0000 7f3683fff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684075610 0x7f368419df00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f3670000c00 tx=0x7f3670003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.752+0000 7f3681ffb700 1 -- 172.21.15.12:0/906768283 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367001d070 con 0x7f3684075610 2023-12-11T20:26:19.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.752+0000 7f368afff700 1 -- 172.21.15.12:0/906768283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36841a5a40 con 0x7f3684075610 2023-12-11T20:26:19.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.752+0000 7f3681ffb700 1 -- 172.21.15.12:0/906768283 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f367000bd70 con 0x7f3684075610 2023-12-11T20:26:19.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.752+0000 7f3681ffb700 1 -- 172.21.15.12:0/906768283 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670022c40 con 0x7f3684075610 2023-12-11T20:26:19.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.752+0000 7f368afff700 1 -- 172.21.15.12:0/906768283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36841a5ec0 con 0x7f3684075610 2023-12-11T20:26:19.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.755+0000 7f3681ffb700 1 -- 172.21.15.12:0/906768283 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3670022470 con 0x7f3684075610 2023-12-11T20:26:19.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.757+0000 7f3681ffb700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36740a1500 0x7f36740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.758+0000 7f3681ffb700 1 -- 172.21.15.12:0/906768283 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f36700ce1f0 con 0x7f3684075610 2023-12-11T20:26:19.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.758+0000 7f3688d9b700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36740a1500 0x7f36740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.758+0000 7f369e94db80 1 Processor -- start 2023-12-11T20:26:19.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.758+0000 7f369e94db80 1 -- start start 2023-12-11T20:26:19.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f369e94db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a63d0 0x555e5f0a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f369e94db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0a7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f369e94db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f369e94db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5f001b50 con 0x555e5f0a63d0 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f369e94db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5efff470 con 0x555e5f0a6d30 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f369e94db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5effad60 con 0x555e5f0a7c20 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36740a1500 0x7f36740a39c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3678007c60 tx=0x7f36780073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a63d0 0x555e5f0a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a63d0 0x555e5f0a67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49848/0 (socket says 172.21.15.12:49848) 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 -- 172.21.15.12:0/273171010 learned_addr learned my addr 172.21.15.12:0/273171010 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f368959c700 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3683fff700 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 -- 172.21.15.12:0/273171010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 msgr2=0x555e5f0a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 -- 172.21.15.12:0/273171010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 msgr2=0x555e5f0a7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0a7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.759+0000 7f3688d9b700 1 -- 172.21.15.12:0/273171010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e5ee77630 con 0x555e5f0a63d0 2023-12-11T20:26:19.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.760+0000 7f3688d9b700 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a63d0 0x555e5f0a67f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f3678010fa0 tx=0x7f3678013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9547d52ee8dd1141 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.760+0000 7f366effd700 1 -- 172.21.15.12:0/273171010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678011e60 con 0x555e5f0a63d0 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.760+0000 7f366effd700 1 -- 172.21.15.12:0/273171010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3678015070 con 0x555e5f0a63d0 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.760+0000 7f366effd700 1 -- 172.21.15.12:0/273171010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678026600 con 0x555e5f0a63d0 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 -- 172.21.15.12:0/273171010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a63d0 msgr2=0x555e5f0a67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a63d0 0x555e5f0a67f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f3678010fa0 tx=0x7f3678013000 comp rx=0 tx=0).stop 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 -- 172.21.15.12:0/273171010 shutdown_connections 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a63d0 0x555e5f0a67f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 --2- 172.21.15.12:0/273171010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0a7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 -- 172.21.15.12:0/273171010 >> 172.21.15.12:0/273171010 conn(0x555e5efd57e0 msgr2=0x555e5f0a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 -- 172.21.15.12:0/273171010 shutdown_connections 2023-12-11T20:26:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.761+0000 7f369e94db80 1 -- 172.21.15.12:0/273171010 wait complete. 2023-12-11T20:26:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.762+0000 7f369e94db80 1 -- start start 2023-12-11T20:26:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.762+0000 7f369e94db80 1 Processor -- start 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f369e94db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f369e94db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f369e94db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f369e94db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5efb4560 con 0x555e5f0a6d30 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f369e94db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5efb4200 con 0x555e5f0a63d0 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f369e94db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5ee79920 con 0x555e5f0a7c20 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f369e94db80 10 client.0 _ll_register_callbacks cb 0x555e5eedfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3683fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3683fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49856/0 (socket says 172.21.15.12:49856) 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3683fff700 1 -- 172.21.15.12:0/2678698168 learned_addr learned my addr 172.21.15.12:0/2678698168 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f368959c700 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3688d9b700 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3683fff700 1 -- 172.21.15.12:0/2678698168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 msgr2=0x555e5f0b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3683fff700 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3683fff700 1 -- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 msgr2=0x555e5f0b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3683fff700 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3683fff700 1 -- 172.21.15.12:0/2678698168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3678010c50 con 0x555e5f0a6d30 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.763+0000 7f3688d9b700 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.764+0000 7f3683fff700 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b07a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f36700cbca0 tx=0x7f3670009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca37338cb3592c06 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.764+0000 7f3663fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.764+0000 7f3663fff700 1 -- 172.21.15.12:0/2678698168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700a35c0 con 0x555e5f0a6d30 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.764+0000 7f3663fff700 1 -- 172.21.15.12:0/2678698168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f367009bc50 con 0x555e5f0a6d30 2023-12-11T20:26:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.764+0000 7f369e94db80 1 -- 172.21.15.12:0/2678698168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e5f099b40 con 0x555e5f0a6d30 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.764+0000 7f3663fff700 1 -- 172.21.15.12:0/2678698168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f367009b550 con 0x555e5f0a6d30 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.764+0000 7f369e94db80 10 client.18507 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.764+0000 7f369e94db80 1 -- 172.21.15.12:0/2678698168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555e5ee23de0 con 0x555e5f0a6d30 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f3663fff700 1 -- 172.21.15.12:0/2678698168 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555e5f099b40 con 0x555e5f0a6d30 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f3663fff700 1 -- 172.21.15.12:0/2678698168 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3670084d10 con 0x555e5f0a6d30 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f369e94db80 10 client.18507 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f369e94db80 10 client.18507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f369e94db80 20 client.18507 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f369e94db80 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555e5f0bbb10 0x555e5f0bdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f369e94db80 4 client.18507 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f369e94db80 1 -- 172.21.15.12:0/2678698168 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e5f075f40 con 0x555e5f0bbb10 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.765+0000 7f3688d9b700 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555e5f0bbb10 0x555e5f0bdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.766+0000 7f3688d9b700 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555e5f0bbb10 0x555e5f0bdf30 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15073bfcc7ca255b server_cookie=cf71474eee3f6f1c in_seq=0 out_seq=0 2023-12-11T20:26:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.766+0000 7f3663fff700 10 client.18507 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f3663fff700 1 -- 172.21.15.12:0/2678698168 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555e5f075f40 con 0x555e5f0bbb10 2023-12-11T20:26:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f3663fff700 10 client.18507 handle_command_reply: tid=0 2023-12-11T20:26:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 client.18507 shutdown 2023-12-11T20:26:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 -- 172.21.15.12:0/2678698168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 msgr2=0x555e5f0b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b07a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f36700cbca0 tx=0x7f3670009310 comp rx=0 tx=0).stop 2023-12-11T20:26:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 -- 172.21.15.12:0/2678698168 shutdown_connections 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555e5f0bbb10 0x555e5f0bdf30 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 --2- 172.21.15.12:0/2678698168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b07a0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f369e94db80 1 -- 172.21.15.12:0/2678698168 >> 172.21.15.12:0/2678698168 conn(0x555e5efd57e0 msgr2=0x555e5f0a1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.767+0000 7f3663fff700 0 client.18507 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.768+0000 7f369e94db80 1 -- 172.21.15.12:0/2678698168 shutdown_connections 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.768+0000 7f369e94db80 1 -- 172.21.15.12:0/2678698168 wait complete. 2023-12-11T20:26:19.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.768+0000 7f369e94db80 20 client.18507 trim_cache size 0 max 16384 2023-12-11T20:26:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f369e94db80 1 Processor -- start 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f369e94db80 1 -- start start 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f369e94db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f369e94db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f369e94db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f369e94db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5f0afe10 con 0x555e5f0a6d30 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f369e94db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5f09db80 con 0x555e5f0a63d0 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f369e94db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5f0c3150 con 0x555e5f0a7c20 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.792+0000 7f3683fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f368959c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f3683fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49864/0 (socket says 172.21.15.12:49864) 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f3683fff700 1 -- 172.21.15.12:0/2074381465 learned_addr learned my addr 172.21.15.12:0/2074381465 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f3688d9b700 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f368959c700 1 -- 172.21.15.12:0/2074381465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 msgr2=0x555e5f0aaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f368959c700 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0aaca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f368959c700 1 -- 172.21.15.12:0/2074381465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 msgr2=0x555e5f0b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f368959c700 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f368959c700 1 -- 172.21.15.12:0/2074381465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e5ee0cc60 con 0x555e5f0a7c20 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f3683fff700 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.793+0000 7f368959c700 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0ab1e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x555e5f0a7400 tx=0x7f367c009100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d04a4466368415b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f366f7fe700 1 -- 172.21.15.12:0/2074381465 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c007e00 con 0x555e5f0a7c20 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f366f7fe700 1 -- 172.21.15.12:0/2074381465 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f367c00f040 con 0x555e5f0a7c20 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f366f7fe700 1 -- 172.21.15.12:0/2074381465 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c017e90 con 0x555e5f0a7c20 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f369e94db80 1 -- 172.21.15.12:0/2074381465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 msgr2=0x555e5f0ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f369e94db80 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0ab1e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x555e5f0a7400 tx=0x7f367c009100 comp rx=0 tx=0).stop 2023-12-11T20:26:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f369e94db80 1 -- 172.21.15.12:0/2074381465 shutdown_connections 2023-12-11T20:26:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f369e94db80 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a63d0 0x555e5f0aaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f369e94db80 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a7c20 0x555e5f0ab1e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f369e94db80 1 --2- 172.21.15.12:0/2074381465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a6d30 0x555e5f0b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.794+0000 7f369e94db80 1 -- 172.21.15.12:0/2074381465 >> 172.21.15.12:0/2074381465 conn(0x555e5efd57e0 msgr2=0x555e5f0aa130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.795+0000 7f369e94db80 1 -- 172.21.15.12:0/2074381465 shutdown_connections 2023-12-11T20:26:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.795+0000 7f369e94db80 1 -- 172.21.15.12:0/2074381465 wait complete. 2023-12-11T20:26:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.795+0000 7f369e94db80 1 -- start start 2023-12-11T20:26:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.795+0000 7f369e94db80 1 Processor -- start 2023-12-11T20:26:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f369e94db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a63d0 0x555e5f0b7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f369e94db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f369e94db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a7c20 0x555e5f0b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f369e94db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5f0b49a0 con 0x555e5f0a7c20 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f369e94db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5f0b7910 con 0x555e5f0a6d30 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f369e94db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e5f0b7aa0 con 0x555e5f0a63d0 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f369e94db80 10 client.0 _ll_register_callbacks cb 0x555e5eedfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f368959c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a7c20 0x555e5f0b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f368959c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a7c20 0x555e5f0b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49876/0 (socket says 172.21.15.12:49876) 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f3683fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f368959c700 1 -- 172.21.15.12:0/1991775605 learned_addr learned my addr 172.21.15.12:0/1991775605 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.796+0000 7f3688d9b700 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a63d0 0x555e5f0b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f368959c700 1 -- 172.21.15.12:0/1991775605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a63d0 msgr2=0x555e5f0b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f368959c700 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a63d0 0x555e5f0b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f368959c700 1 -- 172.21.15.12:0/1991775605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 msgr2=0x555e5f0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f368959c700 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f368959c700 1 -- 172.21.15.12:0/1991775605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3678010c50 con 0x555e5f0a7c20 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f3683fff700 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f368959c700 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a7c20 0x555e5f0b42c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f367c004d00 tx=0x7f367c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20f6424b8b45379 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f3663fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f3663fff700 1 -- 172.21.15.12:0/1991775605 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c025070 con 0x555e5f0a7c20 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f3663fff700 1 -- 172.21.15.12:0/1991775605 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f367c017650 con 0x555e5f0a7c20 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.797+0000 7f369e94db80 1 -- 172.21.15.12:0/1991775605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3678015070 con 0x555e5f0a7c20 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f3663fff700 1 -- 172.21.15.12:0/1991775605 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f367c017810 con 0x555e5f0a7c20 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f369e94db80 10 client.18513 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f369e94db80 1 -- 172.21.15.12:0/1991775605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f367c009b30 con 0x555e5f0a7c20 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f3663fff700 1 -- 172.21.15.12:0/1991775605 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3678015070 con 0x555e5f0a7c20 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f3663fff700 1 -- 172.21.15.12:0/1991775605 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f367c014050 con 0x555e5f0a7c20 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f369e94db80 10 client.18513 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f369e94db80 10 client.18513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f369e94db80 20 client.18513 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:19.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f369e94db80 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555e5f1137d0 0x555e5f115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f369e94db80 4 client.18513 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:26:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.798+0000 7f369e94db80 1 -- 172.21.15.12:0/1991775605 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555e5efc0fd0 con 0x555e5f1137d0 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.799+0000 7f3688d9b700 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555e5f1137d0 0x555e5f115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.799+0000 7f3663fff700 10 client.18513 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.799+0000 7f3688d9b700 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555e5f1137d0 0x555e5f115bf0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d439dc94f4a7ae3 server_cookie=ccbc87c1a7faa4ee in_seq=0 out_seq=0 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f3663fff700 1 -- 172.21.15.12:0/1991775605 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555e5efc0fd0 con 0x555e5f1137d0 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f3663fff700 10 client.18513 handle_command_reply: tid=0 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 client.18513 shutdown 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 -- 172.21.15.12:0/1991775605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a7c20 msgr2=0x555e5f0b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a7c20 0x555e5f0b42c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f367c004d00 tx=0x7f367c004d30 comp rx=0 tx=0).stop 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 -- 172.21.15.12:0/1991775605 shutdown_connections 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555e5f1137d0 0x555e5f115bf0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e5f0a7c20 0x555e5f0b42c0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555e5f0a63d0 0x555e5f0b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 --2- 172.21.15.12:0/1991775605 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555e5f0a6d30 0x555e5f0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 -- 172.21.15.12:0/1991775605 >> 172.21.15.12:0/1991775605 conn(0x555e5efd57e0 msgr2=0x555e5f0b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f3663fff700 0 client.18513 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 -- 172.21.15.12:0/1991775605 shutdown_connections 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 1 -- 172.21.15.12:0/1991775605 wait complete. 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.800+0000 7f369e94db80 20 client.18513 trim_cache size 0 max 16384 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:26:19.801 INFO:teuthology.orchestra.run.smithi012.stdout: "887a86e8-2faa-4e8e-8c2f-95315d1101fd": { 2023-12-11T20:26:19.802 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:26:19.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "887a86e8-2faa-4e8e-8c2f-95315d1101fd", 2023-12-11T20:26:19.802 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:26:19.802 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:26:19.802 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:26:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:26:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 -- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36740a1500 msgr2=0x7f36740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36740a1500 0x7f36740a39c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3678007c60 tx=0x7f36780073d0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 -- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684075610 msgr2=0x7f368419df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684075610 0x7f368419df00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f3670000c00 tx=0x7f3670003a80 comp rx=0 tx=0).stop 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 -- 172.21.15.12:0/906768283 shutdown_connections 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36740a1500 0x7f36740a39c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f368410da80 0x7f36841a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3684074030 0x7f368419d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 --2- 172.21.15.12:0/906768283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3684075610 0x7f368419df00 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 -- 172.21.15.12:0/906768283 >> 172.21.15.12:0/906768283 conn(0x7f36840fca00 msgr2=0x7f3684100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 -- 172.21.15.12:0/906768283 shutdown_connections 2023-12-11T20:26:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:19.801+0000 7f368afff700 1 -- 172.21.15.12:0/906768283 wait complete. 2023-12-11T20:26:19.819 INFO:tasks.cephfs.filesystem:scrub status for tag:887a86e8-2faa-4e8e-8c2f-95315d1101fd - {'path': '/', 'tag': '887a86e8-2faa-4e8e-8c2f-95315d1101fd', 'options': 'recursive,force'} 2023-12-11T20:26:19.963 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:26:19 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:26:19.464+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v202>,<0x10000000003/client.0 v204>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v221>,<0x10000000001/sv_0 v245>,<0x10000000000/_nogroup v229>,<0x1/volumes v221>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:26:20.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: pgmap v687: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:20.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:20 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:26:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: pgmap v687: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:26:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:26:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:26:20.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:20.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:20.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:20 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: pgmap v687: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:20.964 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:20 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:26:22.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:21 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:22.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:21 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:21 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:22.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:21 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:21 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:21 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:23.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:22 smithi032 ceph-mon[132488]: pgmap v688: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:26:23.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:22 smithi039 ceph-mon[102205]: pgmap v688: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:26:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:22 smithi012 ceph-mon[128787]: pgmap v688: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:26:25.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:24 smithi039 ceph-mon[102205]: pgmap v689: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 26 op/s 2023-12-11T20:26:25.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:24 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:24 smithi012 ceph-mon[128787]: pgmap v689: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 26 op/s 2023-12-11T20:26:25.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:24 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:24 smithi032 ceph-mon[132488]: pgmap v689: 97 pgs: 97 active+clean; 7.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 26 op/s 2023-12-11T20:26:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:24 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:27.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:26 smithi039 ceph-mon[102205]: pgmap v690: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:26:27.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:26:27.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:26:27.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:26 smithi012 ceph-mon[128787]: pgmap v690: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:26:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:26:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:26:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:26 smithi032 ceph-mon[132488]: pgmap v690: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:26:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:26:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:26:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:26:29.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:28 smithi039 ceph-mon[102205]: pgmap v691: 97 pgs: 97 active+clean; 7.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:26:29.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:28 smithi012 ceph-mon[128787]: pgmap v691: 97 pgs: 97 active+clean; 7.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:26:29.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:28 smithi032 ceph-mon[132488]: pgmap v691: 97 pgs: 97 active+clean; 7.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:26:31.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:30 smithi039 ceph-mon[102205]: pgmap v692: 97 pgs: 97 active+clean; 7.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:26:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:30 smithi012 ceph-mon[128787]: pgmap v692: 97 pgs: 97 active+clean; 7.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:26:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:30 smithi032 ceph-mon[132488]: pgmap v692: 97 pgs: 97 active+clean; 7.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:26:32.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:31 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:26:32.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:31 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:26:32.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:31 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:26:32.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:31 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:26:32.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:31 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:26:32.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:31 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:26:32.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:31 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:26:32.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:31 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:26:32.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:31 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:26:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.498+0000 7f7ca3fff700 1 -- 172.21.15.12:0/31784589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca41046a0 msgr2=0x7f7ca4106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.498+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/31784589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca41046a0 0x7f7ca4106a90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009990 tx=0x7f7c98009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.499+0000 7f7ca3fff700 1 -- 172.21.15.12:0/31784589 shutdown_connections 2023-12-11T20:26:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.499+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/31784589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca4101d70 0x7f7ca4104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.499+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/31784589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ca4106fd0 0x7f7ca4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.499+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/31784589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca41046a0 0x7f7ca4106a90 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.499+0000 7f7ca3fff700 1 -- 172.21.15.12:0/31784589 >> 172.21.15.12:0/31784589 conn(0x7f7ca40fb780 msgr2=0x7f7ca40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.499+0000 7f7ca3fff700 1 -- 172.21.15.12:0/31784589 shutdown_connections 2023-12-11T20:26:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.499+0000 7f7ca3fff700 1 -- 172.21.15.12:0/31784589 wait complete. 2023-12-11T20:26:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.500+0000 7f7ca3fff700 1 Processor -- start 2023-12-11T20:26:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.500+0000 7f7ca3fff700 1 -- start start 2023-12-11T20:26:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.500+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca4101d70 0x7f7ca41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.500+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca41046a0 0x7f7ca4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.500+0000 7f7ca3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ca4106fd0 0x7f7ca41a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.500+0000 7f7ca3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41a0ef0 con 0x7f7ca4101d70 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.500+0000 7f7ca3fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41a1030 con 0x7f7ca41046a0 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.500+0000 7f7ca3fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41a11c0 con 0x7f7ca4106fd0 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca4101d70 0x7f7ca41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca4101d70 0x7f7ca41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56450/0 (socket says 172.21.15.12:56450) 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/1743185084 learned_addr learned my addr 172.21.15.12:0/1743185084 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca41046a0 0x7f7ca4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca37fe700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ca4106fd0 0x7f7ca41a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/1743185084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ca4106fd0 msgr2=0x7f7ca41a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ca4106fd0 0x7f7ca41a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/1743185084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca41046a0 msgr2=0x7f7ca4199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca41046a0 0x7f7ca4199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/1743185084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980095f0 con 0x7f7ca4101d70 2023-12-11T20:26:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.501+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca4101d70 0x7f7ca41993c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400d980 tx=0x7f7c9400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.502+0000 7f7c8bfff700 1 -- 172.21.15.12:0/1743185084 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94004220 con 0x7f7ca4101d70 2023-12-11T20:26:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.502+0000 7f7c8bfff700 1 -- 172.21.15.12:0/1743185084 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c94007640 con 0x7f7ca4101d70 2023-12-11T20:26:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.502+0000 7f7ca3fff700 1 -- 172.21.15.12:0/1743185084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca41a14a0 con 0x7f7ca4101d70 2023-12-11T20:26:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.502+0000 7f7c8bfff700 1 -- 172.21.15.12:0/1743185084 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94005660 con 0x7f7ca4101d70 2023-12-11T20:26:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.502+0000 7f7ca3fff700 1 -- 172.21.15.12:0/1743185084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca41a1a00 con 0x7f7ca4101d70 2023-12-11T20:26:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.506+0000 7f7c8bfff700 1 -- 172.21.15.12:0/1743185084 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7c94004750 con 0x7f7ca4101d70 2023-12-11T20:26:32.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.507+0000 7f7c8bfff700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c8c0a14f0 0x7f7c8c0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.507+0000 7f7cbce9bb80 1 Processor -- start 2023-12-11T20:26:32.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.507+0000 7f7c8bfff700 1 -- 172.21.15.12:0/1743185084 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c940ccab0 con 0x7f7ca4101d70 2023-12-11T20:26:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.507+0000 7f7cbce9bb80 1 -- start start 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.507+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c8c0a14f0 0x7f7c8c0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab46b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab470d0 0x56011ab4b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab4bb80 0x56011ab4df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011aaa1af0 con 0x56011ab4bb80 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011aa9f410 con 0x56011ab470d0 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011aa9ad00 con 0x56011ab46770 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7ca37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab4bb80 0x56011ab4df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab46b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab46b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:43398/0 (socket says 172.21.15.12:43398) 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/3404508531 learned_addr learned my addr 172.21.15.12:0/3404508531 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.508+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c8c0a14f0 0x7f7c8c0a39b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7c98006010 tx=0x7f7c9800b610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/3404508531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab470d0 msgr2=0x56011ab4b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/3404508531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab470d0 0x56011ab4b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/3404508531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab4bb80 msgr2=0x56011ab4df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/3404508531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab4bb80 0x56011ab4df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/3404508531 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56011a9175d0 con 0x56011ab46770 2023-12-11T20:26:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/3404508531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab46b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c94096790 tx=0x7f7c94099780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9da3dc866b80ce server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7c897fa700 1 -- 172.21.15.12:0/3404508531 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9409a420 con 0x56011ab46770 2023-12-11T20:26:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7c897fa700 1 -- 172.21.15.12:0/3404508531 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c94099d20 con 0x56011ab46770 2023-12-11T20:26:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.509+0000 7f7c897fa700 1 -- 172.21.15.12:0/3404508531 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94099470 con 0x56011ab46770 2023-12-11T20:26:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3404508531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 msgr2=0x56011ab46b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/3404508531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab46b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c94096790 tx=0x7f7c94099780 comp rx=0 tx=0).stop 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3404508531 shutdown_connections 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/3404508531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab4bb80 0x56011ab4df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/3404508531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab46b90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/3404508531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab470d0 0x56011ab4b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3404508531 >> 172.21.15.12:0/3404508531 conn(0x56011aa75780 msgr2=0x56011ab42b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3404508531 shutdown_connections 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.510+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3404508531 wait complete. 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.511+0000 7f7cbce9bb80 1 -- start start 2023-12-11T20:26:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.511+0000 7f7cbce9bb80 1 Processor -- start 2023-12-11T20:26:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab4ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab50440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 0x56011ab57480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011aa54500 con 0x56011ab470d0 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011aa541a0 con 0x56011ab46770 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a9198c0 con 0x56011ab4bb80 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7cbce9bb80 10 client.0 _ll_register_callbacks cb 0x56011a97fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab50440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab50440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56476/0 (socket says 172.21.15.12:56476) 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7ca27fc700 1 -- 172.21.15.12:0/2036592620 learned_addr learned my addr 172.21.15.12:0/2036592620 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab4ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.512+0000 7f7ca37fe700 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 0x56011ab57480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7ca27fc700 1 -- 172.21.15.12:0/2036592620 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 msgr2=0x56011ab57480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 0x56011ab57480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7ca27fc700 1 -- 172.21.15.12:0/2036592620 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 msgr2=0x56011ab4ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab4ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7ca27fc700 1 -- 172.21.15.12:0/2036592620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca41a1a00 con 0x56011ab470d0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab50440 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f7c98015000 tx=0x7f7c98009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd689f11c9cf438 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7c86ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7c86ff5700 1 -- 172.21.15.12:0/2036592620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800beb0 con 0x56011ab470d0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7c86ff5700 1 -- 172.21.15.12:0/2036592620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c98003d20 con 0x56011ab470d0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.513+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/2036592620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56011ab39730 con 0x56011ab470d0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7c86ff5700 1 -- 172.21.15.12:0/2036592620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c98004500 con 0x56011ab470d0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7cbce9bb80 10 client.18525 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/2036592620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56011a8c3d80 con 0x56011ab470d0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7c86ff5700 1 -- 172.21.15.12:0/2036592620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56011ab39730 con 0x56011ab470d0 2023-12-11T20:26:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7c86ff5700 1 -- 172.21.15.12:0/2036592620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7c9800f660 con 0x56011ab470d0 2023-12-11T20:26:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7cbce9bb80 10 client.18525 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7cbce9bb80 10 client.18525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7cbce9bb80 20 client.18525 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56011ab5bd20 0x56011ab5e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7cbce9bb80 4 client.18525 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.514+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/2036592620 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56011ab15ee0 con 0x56011ab5bd20 2023-12-11T20:26:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.515+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56011ab5bd20 0x56011ab5e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.515+0000 7f7c86ff5700 10 client.18525 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.515+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56011ab5bd20 0x56011ab5e140 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66b51b7e5da339e server_cookie=20de061f9d50889e in_seq=0 out_seq=0 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7c86ff5700 1 -- 172.21.15.12:0/2036592620 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56011ab15ee0 con 0x56011ab5bd20 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7c86ff5700 10 client.18525 handle_command_reply: tid=0 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 client.18525 shutdown 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/2036592620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 msgr2=0x56011ab50440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab50440 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f7c98015000 tx=0x7f7c98009310 comp rx=0 tx=0).stop 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/2036592620 shutdown_connections 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56011ab5bd20 0x56011ab5e140 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab4ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 0x56011ab57480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7c86ff5700 0 client.18525 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/2036592620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab50440 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.516+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/2036592620 >> 172.21.15.12:0/2036592620 conn(0x56011aa75780 msgr2=0x56011ab43560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.517+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/2036592620 shutdown_connections 2023-12-11T20:26:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.517+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/2036592620 wait complete. 2023-12-11T20:26:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.517+0000 7f7cbce9bb80 20 client.18525 trim_cache size 0 max 16384 2023-12-11T20:26:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.533+0000 7f7cbce9bb80 1 Processor -- start 2023-12-11T20:26:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.533+0000 7f7cbce9bb80 1 -- start start 2023-12-11T20:26:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.533+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab41590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.533+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab57440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.533+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 0x56011ab4f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.533+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011ab3bf90 con 0x56011ab470d0 2023-12-11T20:26:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.533+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011ab4fa70 con 0x56011ab46770 2023-12-11T20:26:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.533+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011ab48770 con 0x56011ab4bb80 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab41590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab57440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab41590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:53294/0 (socket says 172.21.15.12:53294) 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca2ffd700 1 -- 172.21.15.12:0/3180524311 learned_addr learned my addr 172.21.15.12:0/3180524311 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca37fe700 1 --2- 172.21.15.12:0/3180524311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 0x56011ab4f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca27fc700 1 -- 172.21.15.12:0/3180524311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 msgr2=0x56011ab4f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/3180524311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 0x56011ab4f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca27fc700 1 -- 172.21.15.12:0/3180524311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 msgr2=0x56011ab41590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/3180524311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab41590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca27fc700 1 -- 172.21.15.12:0/3180524311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56011a8acc00 con 0x56011ab470d0 2023-12-11T20:26:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.534+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/3180524311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab57440 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800f9e0 tx=0x7f7c98010fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f54c22eaddef2d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7c89ffb700 1 -- 172.21.15.12:0/3180524311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800beb0 con 0x56011ab470d0 2023-12-11T20:26:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7c89ffb700 1 -- 172.21.15.12:0/3180524311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c98028070 con 0x56011ab470d0 2023-12-11T20:26:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7c89ffb700 1 -- 172.21.15.12:0/3180524311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98004b80 con 0x56011ab470d0 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3180524311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 msgr2=0x56011ab57440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/3180524311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab57440 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800f9e0 tx=0x7f7c98010fc0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3180524311 shutdown_connections 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/3180524311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab46770 0x56011ab41590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/3180524311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab4bb80 0x56011ab4f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/3180524311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab57440 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.535+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3180524311 >> 172.21.15.12:0/3180524311 conn(0x56011aa75780 msgr2=0x56011ab4b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.536+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3180524311 shutdown_connections 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.536+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/3180524311 wait complete. 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.536+0000 7f7cbce9bb80 1 -- start start 2023-12-11T20:26:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.536+0000 7f7cbce9bb80 1 Processor -- start 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab54c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab55180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7cbce9bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab4bb80 0x56011ab56140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011ab56680 con 0x56011ab470d0 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011ab567f0 con 0x56011ab4bb80 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7cbce9bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011ab569b0 con 0x56011ab46770 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7cbce9bb80 10 client.0 _ll_register_callbacks cb 0x56011a97fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab55180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab55180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56494/0 (socket says 172.21.15.12:56494) 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca27fc700 1 -- 172.21.15.12:0/1444410193 learned_addr learned my addr 172.21.15.12:0/1444410193 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab54c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca37fe700 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab4bb80 0x56011ab56140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca27fc700 1 -- 172.21.15.12:0/1444410193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 msgr2=0x56011ab54c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab54c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca27fc700 1 -- 172.21.15.12:0/1444410193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab4bb80 msgr2=0x56011ab56140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab4bb80 0x56011ab56140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.537+0000 7f7ca27fc700 1 -- 172.21.15.12:0/1444410193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56011a8c3d80 con 0x56011ab470d0 2023-12-11T20:26:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.538+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab54c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.538+0000 7f7ca27fc700 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab55180 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800ba70 tx=0x7f7c98000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2928432b8005263 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.538+0000 7f7c86ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.538+0000 7f7c86ff5700 1 -- 172.21.15.12:0/1444410193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98049070 con 0x56011ab470d0 2023-12-11T20:26:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.538+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/1444410193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c94099d20 con 0x56011ab470d0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.538+0000 7f7c86ff5700 1 -- 172.21.15.12:0/1444410193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c9800f460 con 0x56011ab470d0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.538+0000 7f7c86ff5700 1 -- 172.21.15.12:0/1444410193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c9800f620 con 0x56011ab470d0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7cbce9bb80 10 client.18531 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/1444410193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56011a8ea1f0 con 0x56011ab470d0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7c86ff5700 1 -- 172.21.15.12:0/1444410193 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c94099d20 con 0x56011ab470d0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7c86ff5700 1 -- 172.21.15.12:0/1444410193 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7c98043810 con 0x56011ab470d0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7cbce9bb80 10 client.18531 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7cbce9bb80 10 client.18531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7cbce9bb80 20 client.18531 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56011abb27c0 0x56011abb4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7cbce9bb80 4 client.18531 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.539+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/1444410193 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56011aa60f70 con 0x56011abb27c0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.540+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56011abb27c0 0x56011abb4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.540+0000 7f7ca2ffd700 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56011abb27c0 0x56011abb4be0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8269144777fdbfa server_cookie=f26235ec51ff66a0 in_seq=0 out_seq=0 2023-12-11T20:26:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.540+0000 7f7c86ff5700 10 client.18531 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7c86ff5700 1 -- 172.21.15.12:0/1444410193 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56011aa60f70 con 0x56011abb27c0 2023-12-11T20:26:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7c86ff5700 10 client.18531 handle_command_reply: tid=0 2023-12-11T20:26:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 client.18531 shutdown 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/1444410193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 msgr2=0x56011ab55180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab55180 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800ba70 tx=0x7f7c98000bc0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/1444410193 shutdown_connections 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56011abb27c0 0x56011abb4be0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56011ab4bb80 0x56011ab56140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7c86ff5700 0 client.18531 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56011ab46770 0x56011ab54c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 --2- 172.21.15.12:0/1444410193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56011ab470d0 0x56011ab55180 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/1444410193 >> 172.21.15.12:0/1444410193 conn(0x56011aa75780 msgr2=0x56011ab4f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/1444410193 shutdown_connections 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 1 -- 172.21.15.12:0/1444410193 wait complete. 2023-12-11T20:26:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.551+0000 7f7cbce9bb80 20 client.18531 trim_cache size 0 max 16384 2023-12-11T20:26:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:26:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:26:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:26:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 -- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c8c0a14f0 msgr2=0x7f7c8c0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c8c0a14f0 0x7f7c8c0a39b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7c98006010 tx=0x7f7c9800b610 comp rx=0 tx=0).stop 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 -- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca4101d70 msgr2=0x7f7ca41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca4101d70 0x7f7ca41993c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400d980 tx=0x7f7c9400dc90 comp rx=0 tx=0).stop 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 -- 172.21.15.12:0/1743185084 shutdown_connections 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c8c0a14f0 0x7f7c8c0a39b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ca4106fd0 0x7f7ca41a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ca4101d70 0x7f7ca41993c0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 --2- 172.21.15.12:0/1743185084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca41046a0 0x7f7ca4199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 -- 172.21.15.12:0/1743185084 >> 172.21.15.12:0/1743185084 conn(0x7f7ca40fb780 msgr2=0x7f7ca40ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 -- 172.21.15.12:0/1743185084 shutdown_connections 2023-12-11T20:26:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:32.552+0000 7f7ca3fff700 1 -- 172.21.15.12:0/1743185084 wait complete. 2023-12-11T20:26:33.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:32 smithi039 ceph-mon[102205]: pgmap v693: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:26:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:32 smithi012 ceph-mon[128787]: pgmap v693: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:26:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:32 smithi032 ceph-mon[132488]: pgmap v693: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:26:35.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:34 smithi039 ceph-mon[102205]: pgmap v694: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:26:35.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:34 smithi012 ceph-mon[128787]: pgmap v694: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:26:35.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:34 smithi032 ceph-mon[132488]: pgmap v694: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:26:37.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:36 smithi039 ceph-mon[102205]: pgmap v695: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 21 op/s 2023-12-11T20:26:37.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:36 smithi012 ceph-mon[128787]: pgmap v695: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 21 op/s 2023-12-11T20:26:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:36 smithi032 ceph-mon[132488]: pgmap v695: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 21 op/s 2023-12-11T20:26:39.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:38 smithi039 ceph-mon[102205]: pgmap v696: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:26:39.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:38 smithi012 ceph-mon[128787]: pgmap v696: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:26:39.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:38 smithi032 ceph-mon[132488]: pgmap v696: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:26:41.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:40 smithi039 ceph-mon[102205]: pgmap v697: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:26:41.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:40 smithi012 ceph-mon[128787]: pgmap v697: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:26:41.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:40 smithi032 ceph-mon[132488]: pgmap v697: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:26:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:42 smithi012 ceph-mon[128787]: pgmap v698: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:42 smithi032 ceph-mon[132488]: pgmap v698: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:43.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:42 smithi039 ceph-mon[102205]: pgmap v698: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:45.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:44 smithi012 ceph-mon[128787]: pgmap v699: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:26:45.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:44 smithi032 ceph-mon[132488]: pgmap v699: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:26:45.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:44 smithi039 ceph-mon[102205]: pgmap v699: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:26:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 -- 172.21.15.12:0/1128151423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8481046a0 msgr2=0x7fd848106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/1128151423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8481046a0 0x7fd848106a90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009990 tx=0x7fd83c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 -- 172.21.15.12:0/1128151423 shutdown_connections 2023-12-11T20:26:45.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/1128151423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd848106fd0 0x7fd848109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/1128151423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd848101d70 0x7fd848104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/1128151423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8481046a0 0x7fd848106a90 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 -- 172.21.15.12:0/1128151423 >> 172.21.15.12:0/1128151423 conn(0x7fd8480fb780 msgr2=0x7fd8480fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 -- 172.21.15.12:0/1128151423 shutdown_connections 2023-12-11T20:26:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.726+0000 7fd84c9fe700 1 -- 172.21.15.12:0/1128151423 wait complete. 2023-12-11T20:26:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.727+0000 7fd84c9fe700 1 Processor -- start 2023-12-11T20:26:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.727+0000 7fd84c9fe700 1 -- start start 2023-12-11T20:26:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.727+0000 7fd84c9fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd848101d70 0x7fd848101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.727+0000 7fd84c9fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8481046a0 0x7fd8480ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd84c9fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd848106fd0 0x7fd848100260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd84c9fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848100a00 con 0x7fd848101d70 2023-12-11T20:26:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd84c9fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848100b70 con 0x7fd848106fd0 2023-12-11T20:26:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd84c9fe700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481a11f0 con 0x7fd8481046a0 2023-12-11T20:26:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd846d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd848101d70 0x7fd848101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd846d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd848101d70 0x7fd848101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52332/0 (socket says 172.21.15.12:52332) 2023-12-11T20:26:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd846d9d700 1 -- 172.21.15.12:0/2563846923 learned_addr learned my addr 172.21.15.12:0/2563846923 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:45.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd84659c700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8481046a0 0x7fd8480ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd84759e700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd848106fd0 0x7fd848100260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd846d9d700 1 -- 172.21.15.12:0/2563846923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8481046a0 msgr2=0x7fd8480ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd846d9d700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8481046a0 0x7fd8480ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd846d9d700 1 -- 172.21.15.12:0/2563846923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd848106fd0 msgr2=0x7fd848100260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd846d9d700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd848106fd0 0x7fd848100260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.728+0000 7fd846d9d700 1 -- 172.21.15.12:0/2563846923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0095f0 con 0x7fd848101d70 2023-12-11T20:26:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.729+0000 7fd846d9d700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd848101d70 0x7fd848101690 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd83800e9a0 tx=0x7fd83800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.729+0000 7fd82ffff700 1 -- 172.21.15.12:0/2563846923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838009790 con 0x7fd848101d70 2023-12-11T20:26:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.729+0000 7fd82ffff700 1 -- 172.21.15.12:0/2563846923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd83800ce40 con 0x7fd848101d70 2023-12-11T20:26:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.729+0000 7fd84c9fe700 1 -- 172.21.15.12:0/2563846923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8481a1480 con 0x7fd848101d70 2023-12-11T20:26:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.729+0000 7fd82ffff700 1 -- 172.21.15.12:0/2563846923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838018420 con 0x7fd848101d70 2023-12-11T20:26:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.729+0000 7fd84c9fe700 1 -- 172.21.15.12:0/2563846923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8481a1990 con 0x7fd848101d70 2023-12-11T20:26:45.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.733+0000 7fd82ffff700 1 -- 172.21.15.12:0/2563846923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd838010430 con 0x7fd848101d70 2023-12-11T20:26:45.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.734+0000 7fd860a33b80 1 Processor -- start 2023-12-11T20:26:45.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.734+0000 7fd860a33b80 1 -- start start 2023-12-11T20:26:45.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafc5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafc7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd860a33b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdaf1baf0 con 0x562bdafc0770 2023-12-11T20:26:45.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd860a33b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdaf19410 con 0x562bdafc10d0 2023-12-11T20:26:45.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd860a33b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdaf14d00 con 0x562bdafc5b80 2023-12-11T20:26:45.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd84759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd84759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52348/0 (socket says 172.21.15.12:52348) 2023-12-11T20:26:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd84759e700 1 -- 172.21.15.12:0/454636544 learned_addr learned my addr 172.21.15.12:0/454636544 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd84659c700 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafc7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.735+0000 7fd846d9d700 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafc5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd82ffff700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8300a1470 0x7fd8300a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd84659c700 1 -- 172.21.15.12:0/454636544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 msgr2=0x562bdafc5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd84659c700 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafc5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd84659c700 1 -- 172.21.15.12:0/454636544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 msgr2=0x562bdafc0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd84659c700 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd84659c700 1 -- 172.21.15.12:0/454636544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bdad915d0 con 0x562bdafc5b80 2023-12-11T20:26:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd84759e700 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd82ffff700 1 -- 172.21.15.12:0/2563846923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd838014070 con 0x7fd848101d70 2023-12-11T20:26:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd84659c700 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafc7f90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0098e0 tx=0x7fd83c005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa02d89919aba2ce server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd84759e700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8300a1470 0x7fd8300a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.736+0000 7fd82d7fa700 1 -- 172.21.15.12:0/454636544 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c01d070 con 0x562bdafc5b80 2023-12-11T20:26:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd82d7fa700 1 -- 172.21.15.12:0/454636544 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd83c01e040 con 0x562bdafc5b80 2023-12-11T20:26:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd82d7fa700 1 -- 172.21.15.12:0/454636544 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00b710 con 0x562bdafc5b80 2023-12-11T20:26:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd860a33b80 1 -- 172.21.15.12:0/454636544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 msgr2=0x562bdafc7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd860a33b80 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafc7f90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0098e0 tx=0x7fd83c005bc0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd84759e700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8300a1470 0x7fd8300a3930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd840003fd0 tx=0x7fd840004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd860a33b80 1 -- 172.21.15.12:0/454636544 shutdown_connections 2023-12-11T20:26:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd860a33b80 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafc7f90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd860a33b80 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd860a33b80 1 --2- 172.21.15.12:0/454636544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafc5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.737+0000 7fd860a33b80 1 -- 172.21.15.12:0/454636544 >> 172.21.15.12:0/454636544 conn(0x562bdaeef780 msgr2=0x562bdafbcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.738+0000 7fd860a33b80 1 -- 172.21.15.12:0/454636544 shutdown_connections 2023-12-11T20:26:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.738+0000 7fd860a33b80 1 -- 172.21.15.12:0/454636544 wait complete. 2023-12-11T20:26:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.738+0000 7fd860a33b80 1 -- start start 2023-12-11T20:26:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.738+0000 7fd860a33b80 1 Processor -- start 2023-12-11T20:26:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.739+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafc9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.739+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc10d0 0x562bdafca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.739+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc5b80 0x562bdafd1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.739+0000 7fd860a33b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdaece500 con 0x562bdafc10d0 2023-12-11T20:26:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.739+0000 7fd860a33b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdaece1a0 con 0x562bdafc5b80 2023-12-11T20:26:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.739+0000 7fd860a33b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdad938c0 con 0x562bdafc0770 2023-12-11T20:26:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.739+0000 7fd860a33b80 10 client.0 _ll_register_callbacks cb 0x562bdadf9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.739+0000 7fd84659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc10d0 0x562bdafca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd84659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc10d0 0x562bdafca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52354/0 (socket says 172.21.15.12:52354) 2023-12-11T20:26:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd84659c700 1 -- 172.21.15.12:0/3238322971 learned_addr learned my addr 172.21.15.12:0/3238322971 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd846d9d700 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafc9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd84759e700 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc5b80 0x562bdafd1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd846d9d700 1 -- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc5b80 msgr2=0x562bdafd1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd846d9d700 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc5b80 0x562bdafd1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd846d9d700 1 -- 172.21.15.12:0/3238322971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc10d0 msgr2=0x562bdafca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd846d9d700 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc10d0 0x562bdafca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd846d9d700 1 -- 172.21.15.12:0/3238322971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd840003bf0 con 0x562bdafc0770 2023-12-11T20:26:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.740+0000 7fd84759e700 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc5b80 0x562bdafd1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.741+0000 7fd846d9d700 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafc9e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd838010fd0 tx=0x7fd83809a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fc3196b8467ff74 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.741+0000 7fd82aff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:26:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.741+0000 7fd82aff5700 1 -- 172.21.15.12:0/3238322971 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380a22d0 con 0x562bdafc0770 2023-12-11T20:26:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.741+0000 7fd860a33b80 1 -- 172.21.15.12:0/3238322971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bdafb3730 con 0x562bdafc0770 2023-12-11T20:26:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.741+0000 7fd82aff5700 1 -- 172.21.15.12:0/3238322971 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd838010710 con 0x562bdafc0770 2023-12-11T20:26:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.741+0000 7fd82aff5700 1 -- 172.21.15.12:0/3238322971 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd838099fa0 con 0x562bdafc0770 2023-12-11T20:26:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.741+0000 7fd860a33b80 10 client.28144 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.741+0000 7fd860a33b80 1 -- 172.21.15.12:0/3238322971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fd84810a030 con 0x562bdafc0770 2023-12-11T20:26:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.742+0000 7fd82aff5700 1 -- 172.21.15.12:0/3238322971 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562bdafb3730 con 0x562bdafc0770 2023-12-11T20:26:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.742+0000 7fd82aff5700 1 -- 172.21.15.12:0/3238322971 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd838095fc0 con 0x562bdafc0770 2023-12-11T20:26:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.742+0000 7fd860a33b80 10 client.28144 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.742+0000 7fd860a33b80 10 client.28144 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.742+0000 7fd860a33b80 20 client.28144 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.742+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562bdafd5c40 0x562bdafd8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.742+0000 7fd860a33b80 4 client.28144 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.742+0000 7fd860a33b80 1 -- 172.21.15.12:0/3238322971 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bdaf8fee0 con 0x562bdafd5c40 2023-12-11T20:26:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.743+0000 7fd84659c700 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562bdafd5c40 0x562bdafd8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.743+0000 7fd82aff5700 10 client.28144 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.743+0000 7fd84659c700 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562bdafd5c40 0x562bdafd8060 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a396a6be60e221e9 server_cookie=38a1ca4f294be6df in_seq=0 out_seq=0 2023-12-11T20:26:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.744+0000 7fd82aff5700 1 -- 172.21.15.12:0/3238322971 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562bdaf8fee0 con 0x562bdafd5c40 2023-12-11T20:26:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.744+0000 7fd82aff5700 10 client.28144 handle_command_reply: tid=0 2023-12-11T20:26:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.744+0000 7fd860a33b80 1 client.28144 shutdown 2023-12-11T20:26:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 -- 172.21.15.12:0/3238322971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 msgr2=0x562bdafc9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafc9e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd838010fd0 tx=0x7fd83809a710 comp rx=0 tx=0).stop 2023-12-11T20:26:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 -- 172.21.15.12:0/3238322971 shutdown_connections 2023-12-11T20:26:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562bdafd5c40 0x562bdafd8060 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc5b80 0x562bdafd1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafc9e80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3238322971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc10d0 0x562bdafca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 -- 172.21.15.12:0/3238322971 >> 172.21.15.12:0/3238322971 conn(0x562bdaeef780 msgr2=0x562bdafbd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd82aff5700 0 client.28144 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 -- 172.21.15.12:0/3238322971 shutdown_connections 2023-12-11T20:26:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 1 -- 172.21.15.12:0/3238322971 wait complete. 2023-12-11T20:26:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.745+0000 7fd860a33b80 20 client.28144 trim_cache size 0 max 16384 2023-12-11T20:26:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd860a33b80 1 Processor -- start 2023-12-11T20:26:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd860a33b80 1 -- start start 2023-12-11T20:26:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafd13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafd7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd860a33b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdafd2580 con 0x562bdafc0770 2023-12-11T20:26:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd860a33b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdafb5f90 con 0x562bdafc10d0 2023-12-11T20:26:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd860a33b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdafc85d0 con 0x562bdafc5b80 2023-12-11T20:26:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.768+0000 7fd846d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd846d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52356/0 (socket says 172.21.15.12:52356) 2023-12-11T20:26:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd846d9d700 1 -- 172.21.15.12:0/3822192055 learned_addr learned my addr 172.21.15.12:0/3822192055 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd84659c700 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafd13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd84759e700 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafd7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd846d9d700 1 -- 172.21.15.12:0/3822192055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 msgr2=0x562bdafd7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd846d9d700 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafd7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd846d9d700 1 -- 172.21.15.12:0/3822192055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 msgr2=0x562bdafd13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd846d9d700 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafd13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd846d9d700 1 -- 172.21.15.12:0/3822192055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bdad3dd80 con 0x562bdafc0770 2023-12-11T20:26:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.769+0000 7fd846d9d700 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc9390 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd8380966d0 tx=0x7fd8380999a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7191a2bf5a62c698 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd82dffb700 1 -- 172.21.15.12:0/3822192055 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838099b30 con 0x562bdafc0770 2023-12-11T20:26:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd82dffb700 1 -- 172.21.15.12:0/3822192055 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd838099d10 con 0x562bdafc0770 2023-12-11T20:26:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd82dffb700 1 -- 172.21.15.12:0/3822192055 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380a2560 con 0x562bdafc0770 2023-12-11T20:26:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd860a33b80 1 -- 172.21.15.12:0/3822192055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 msgr2=0x562bdafc9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc9390 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd8380966d0 tx=0x7fd8380999a0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd860a33b80 1 -- 172.21.15.12:0/3822192055 shutdown_connections 2023-12-11T20:26:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc5b80 0x562bdafd7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc0770 0x562bdafc9390 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd860a33b80 1 --2- 172.21.15.12:0/3822192055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafd13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd860a33b80 1 -- 172.21.15.12:0/3822192055 >> 172.21.15.12:0/3822192055 conn(0x562bdaeef780 msgr2=0x562bdafc53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.770+0000 7fd860a33b80 1 -- 172.21.15.12:0/3822192055 shutdown_connections 2023-12-11T20:26:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.771+0000 7fd860a33b80 1 -- 172.21.15.12:0/3822192055 wait complete. 2023-12-11T20:26:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.771+0000 7fd860a33b80 1 -- start start 2023-12-11T20:26:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.771+0000 7fd860a33b80 1 Processor -- start 2023-12-11T20:26:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd860a33b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc5b80 0x562bdafcfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd860a33b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdafcfff0 con 0x562bdafc5b80 2023-12-11T20:26:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd860a33b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdafd0160 con 0x562bdafc10d0 2023-12-11T20:26:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd860a33b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bdafd0320 con 0x562bdafc0770 2023-12-11T20:26:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd860a33b80 10 client.0 _ll_register_callbacks cb 0x562bdadf9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd84759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc5b80 0x562bdafcfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd84759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc5b80 0x562bdafcfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52366/0 (socket says 172.21.15.12:52366) 2023-12-11T20:26:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd84759e700 1 -- 172.21.15.12:0/2453086238 learned_addr learned my addr 172.21.15.12:0/2453086238 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd84659c700 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.772+0000 7fd846d9d700 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd84759e700 1 -- 172.21.15.12:0/2453086238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 msgr2=0x562bdafce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd84759e700 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd84759e700 1 -- 172.21.15.12:0/2453086238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 msgr2=0x562bdafceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd84759e700 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd84759e700 1 -- 172.21.15.12:0/2453086238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84810a030 con 0x562bdafc5b80 2023-12-11T20:26:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd84759e700 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc5b80 0x562bdafcfab0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd840025490 tx=0x7fd840009130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db45a0a6037d3d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd82aff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd82aff5700 1 -- 172.21.15.12:0/2453086238 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840007620 con 0x562bdafc5b80 2023-12-11T20:26:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd82aff5700 1 -- 172.21.15.12:0/2453086238 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd84001c070 con 0x562bdafc5b80 2023-12-11T20:26:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.773+0000 7fd860a33b80 1 -- 172.21.15.12:0/2453086238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd83c01e040 con 0x562bdafc5b80 2023-12-11T20:26:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd82aff5700 1 -- 172.21.15.12:0/2453086238 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd840025e80 con 0x562bdafc5b80 2023-12-11T20:26:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd860a33b80 10 client.18549 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd860a33b80 1 -- 172.21.15.12:0/2453086238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562bdad26c00 con 0x562bdafc5b80 2023-12-11T20:26:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd82aff5700 1 -- 172.21.15.12:0/2453086238 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd83c01e040 con 0x562bdafc5b80 2023-12-11T20:26:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd82aff5700 1 -- 172.21.15.12:0/2453086238 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd840038850 con 0x562bdafc5b80 2023-12-11T20:26:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd860a33b80 10 client.18549 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd860a33b80 10 client.18549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd860a33b80 20 client.18549 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd860a33b80 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562bdb02c620 0x562bdb02ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd860a33b80 4 client.18549 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:26:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.774+0000 7fd860a33b80 1 -- 172.21.15.12:0/2453086238 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562bdaedaf70 con 0x562bdb02c620 2023-12-11T20:26:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.775+0000 7fd846d9d700 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562bdb02c620 0x562bdb02ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.775+0000 7fd82aff5700 10 client.18549 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.775+0000 7fd846d9d700 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562bdb02c620 0x562bdb02ea40 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfca4c14b56c331d server_cookie=ef68afba4633031f in_seq=0 out_seq=0 2023-12-11T20:26:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd82aff5700 1 -- 172.21.15.12:0/2453086238 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562bdaedaf70 con 0x562bdb02c620 2023-12-11T20:26:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd82aff5700 10 client.18549 handle_command_reply: tid=0 2023-12-11T20:26:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 client.18549 shutdown 2023-12-11T20:26:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 -- 172.21.15.12:0/2453086238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc5b80 msgr2=0x562bdafcfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc5b80 0x562bdafcfab0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd840025490 tx=0x7fd840009130 comp rx=0 tx=0).stop 2023-12-11T20:26:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 -- 172.21.15.12:0/2453086238 shutdown_connections 2023-12-11T20:26:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562bdb02c620 0x562bdb02ea40 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bdafc5b80 0x562bdafcfab0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bdafc0770 0x562bdafce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 --2- 172.21.15.12:0/2453086238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bdafc10d0 0x562bdafceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 -- 172.21.15.12:0/2453086238 >> 172.21.15.12:0/2453086238 conn(0x562bdaeef780 msgr2=0x562bdafdc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd82aff5700 0 client.18549 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 -- 172.21.15.12:0/2453086238 shutdown_connections 2023-12-11T20:26:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.786+0000 7fd860a33b80 1 -- 172.21.15.12:0/2453086238 wait complete. 2023-12-11T20:26:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd860a33b80 20 client.18549 trim_cache size 0 max 16384 2023-12-11T20:26:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:26:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:26:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:26:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 -- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8300a1470 msgr2=0x7fd8300a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8300a1470 0x7fd8300a3930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd840003fd0 tx=0x7fd840004ad0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 -- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd848101d70 msgr2=0x7fd848101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd848101d70 0x7fd848101690 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd83800e9a0 tx=0x7fd83800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 -- 172.21.15.12:0/2563846923 shutdown_connections 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8300a1470 0x7fd8300a3930 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd848106fd0 0x7fd848100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd848101d70 0x7fd848101690 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 --2- 172.21.15.12:0/2563846923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8481046a0 0x7fd8480ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.787+0000 7fd84c9fe700 1 -- 172.21.15.12:0/2563846923 >> 172.21.15.12:0/2563846923 conn(0x7fd8480fb780 msgr2=0x7fd8481026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.788+0000 7fd84c9fe700 1 -- 172.21.15.12:0/2563846923 shutdown_connections 2023-12-11T20:26:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:45.788+0000 7fd84c9fe700 1 -- 172.21.15.12:0/2563846923 wait complete. 2023-12-11T20:26:47.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:46 smithi012 ceph-mon[128787]: pgmap v700: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:47.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:46 smithi032 ceph-mon[132488]: pgmap v700: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:47.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:46 smithi039 ceph-mon[102205]: pgmap v700: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:49.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:48 smithi012 ceph-mon[128787]: pgmap v701: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:48 smithi032 ceph-mon[132488]: pgmap v701: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:49.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:48 smithi039 ceph-mon[102205]: pgmap v701: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:26:49.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:26:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.056+0000 7fdecad9d700 1 -- 172.21.15.12:0/4175333971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec41050b0 msgr2=0x7fdec410b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.056+0000 7fdecad9d700 1 --2- 172.21.15.12:0/4175333971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec41050b0 0x7fdec410b960 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00b0d0 tx=0x7fdebc00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.057+0000 7fdecad9d700 1 -- 172.21.15.12:0/4175333971 shutdown_connections 2023-12-11T20:26:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.057+0000 7fdecad9d700 1 --2- 172.21.15.12:0/4175333971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdec4103520 0x7fdec4103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.057+0000 7fdecad9d700 1 --2- 172.21.15.12:0/4175333971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec41050b0 0x7fdec410b960 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.057+0000 7fdecad9d700 1 --2- 172.21.15.12:0/4175333971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdec4104710 0x7fdec4104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.057+0000 7fdecad9d700 1 -- 172.21.15.12:0/4175333971 >> 172.21.15.12:0/4175333971 conn(0x7fdec40fea70 msgr2=0x7fdec4100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.057+0000 7fdecad9d700 1 -- 172.21.15.12:0/4175333971 shutdown_connections 2023-12-11T20:26:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.057+0000 7fdecad9d700 1 -- 172.21.15.12:0/4175333971 wait complete. 2023-12-11T20:26:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.058+0000 7fdecad9d700 1 Processor -- start 2023-12-11T20:26:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.058+0000 7fdecad9d700 1 -- start start 2023-12-11T20:26:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.058+0000 7fdecad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec4103520 0x7fdec41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.058+0000 7fdecad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdec4104710 0x7fdec4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.058+0000 7fdecad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdec41050b0 0x7fdec41a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.058+0000 7fdecad9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41a0ef0 con 0x7fdec4103520 2023-12-11T20:26:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.058+0000 7fdecad9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41a1030 con 0x7fdec41050b0 2023-12-11T20:26:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.058+0000 7fdecad9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41a11c0 con 0x7fdec4104710 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec4103520 0x7fdec41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec4103520 0x7fdec41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40022/0 (socket says 172.21.15.12:40022) 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3016249373 learned_addr learned my addr 172.21.15.12:0/3016249373 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec959a700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdec4104710 0x7fdec4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdeca59c700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdec41050b0 0x7fdec41a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3016249373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdec4104710 msgr2=0x7fdec4199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdec4104710 0x7fdec4199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3016249373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdec41050b0 msgr2=0x7fdec41a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdec41050b0 0x7fdec41a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3016249373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc009d00 con 0x7fdec4103520 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdeca59c700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdec41050b0 0x7fdec41a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec959a700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdec4104710 0x7fdec4199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.059+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec4103520 0x7fdec41993c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fdec000e970 tx=0x7fdec000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.060+0000 7fdebaffd700 1 -- 172.21.15.12:0/3016249373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0009790 con 0x7fdec4103520 2023-12-11T20:26:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.060+0000 7fdebaffd700 1 -- 172.21.15.12:0/3016249373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdec00044b0 con 0x7fdec4103520 2023-12-11T20:26:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.060+0000 7fdebaffd700 1 -- 172.21.15.12:0/3016249373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0003dd0 con 0x7fdec4103520 2023-12-11T20:26:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.060+0000 7fdecad9d700 1 -- 172.21.15.12:0/3016249373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec41a14a0 con 0x7fdec4103520 2023-12-11T20:26:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.060+0000 7fdecad9d700 1 -- 172.21.15.12:0/3016249373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec41a1960 con 0x7fdec4103520 2023-12-11T20:26:50.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.063+0000 7fdebaffd700 1 -- 172.21.15.12:0/3016249373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fdec0003f30 con 0x7fdec4103520 2023-12-11T20:26:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.065+0000 7fdedf82bb80 1 Processor -- start 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdedf82bb80 1 -- start start 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdebaffd700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdeb00a15a0 0x7fdeb00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdebaffd700 1 -- 172.21.15.12:0/3016249373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdec0014070 con 0x7fdec4103520 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e76e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e773c0 0x560a46e778a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e78240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46dd1b50 con 0x560a46e76a60 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46dcf470 con 0x560a46e77de0 2023-12-11T20:26:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46dcad60 con 0x560a46e773c0 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdeca59c700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdeb00a15a0 0x7fdeb00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.066+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e76e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e76e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40028/0 (socket says 172.21.15.12:40028) 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3990700801 learned_addr learned my addr 172.21.15.12:0/3990700801 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec959a700 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e773c0 0x560a46e778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdeca59c700 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e78240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3990700801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e773c0 msgr2=0x560a46e778a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e773c0 0x560a46e778a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3990700801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 msgr2=0x560a46e78240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e78240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3990700801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a46c47630 con 0x560a46e76a60 2023-12-11T20:26:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdeca59c700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdeb00a15a0 0x7fdeb00a3a60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0062a0 tx=0x7fdebc0094a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.067+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e76e80 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fdec00a20f0 tx=0x7fdec0099e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e66f91c1b70cf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdeaffff700 1 -- 172.21.15.12:0/3990700801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec009a290 con 0x560a46e76a60 2023-12-11T20:26:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdeaffff700 1 -- 172.21.15.12:0/3990700801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdec009e3e0 con 0x560a46e76a60 2023-12-11T20:26:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdeaffff700 1 -- 172.21.15.12:0/3990700801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0098630 con 0x560a46e76a60 2023-12-11T20:26:50.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3990700801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 msgr2=0x560a46e76e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e76e80 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fdec00a20f0 tx=0x7fdec0099e50 comp rx=0 tx=0).stop 2023-12-11T20:26:50.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3990700801 shutdown_connections 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e78240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e76e80 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3990700801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e773c0 0x560a46e778a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.068+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3990700801 >> 172.21.15.12:0/3990700801 conn(0x560a46da57e0 msgr2=0x560a46e713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.069+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3990700801 shutdown_connections 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.069+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3990700801 wait complete. 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.069+0000 7fdedf82bb80 1 -- start start 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.069+0000 7fdedf82bb80 1 Processor -- start 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e773c0 0x560a46e80900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e77de0 0x560a46e878f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46d84560 con 0x560a46e76a60 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46d84200 con 0x560a46e773c0 2023-12-11T20:26:50.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46c49920 con 0x560a46e77de0 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdedf82bb80 10 client.0 _ll_register_callbacks cb 0x560a46cafa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e803c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40044/0 (socket says 172.21.15.12:40044) 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.070+0000 7fdec9d9b700 1 -- 172.21.15.12:0/979936115 learned_addr learned my addr 172.21.15.12:0/979936115 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdeca59c700 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e77de0 0x560a46e878f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdec959a700 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e773c0 0x560a46e80900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdec9d9b700 1 -- 172.21.15.12:0/979936115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e77de0 msgr2=0x560a46e878f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e77de0 0x560a46e878f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdec9d9b700 1 -- 172.21.15.12:0/979936115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e773c0 msgr2=0x560a46e80900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e773c0 0x560a46e80900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdec9d9b700 1 -- 172.21.15.12:0/979936115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec41a1960 con 0x560a46e76a60 2023-12-11T20:26:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdeca59c700 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e77de0 0x560a46e878f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e803c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fdec0096740 tx=0x7fdec0003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7f1446a21c937c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdead7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdead7fa700 1 -- 172.21.15.12:0/979936115 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec009a290 con 0x560a46e76a60 2023-12-11T20:26:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdead7fa700 1 -- 172.21.15.12:0/979936115 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdec0098630 con 0x560a46e76a60 2023-12-11T20:26:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.071+0000 7fdedf82bb80 1 -- 172.21.15.12:0/979936115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a46e699e0 con 0x560a46e76a60 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdead7fa700 1 -- 172.21.15.12:0/979936115 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdec00041e0 con 0x560a46e76a60 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdedf82bb80 10 client.18561 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdedf82bb80 1 -- 172.21.15.12:0/979936115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560a46bf3de0 con 0x560a46e76a60 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdead7fa700 1 -- 172.21.15.12:0/979936115 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560a46e699e0 con 0x560a46e76a60 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdead7fa700 1 -- 172.21.15.12:0/979936115 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdec00a2190 con 0x560a46e76a60 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdedf82bb80 10 client.18561 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdedf82bb80 10 client.18561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdedf82bb80 20 client.18561 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560a46e8be30 0x560a46e8e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdedf82bb80 4 client.18561 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.072+0000 7fdedf82bb80 1 -- 172.21.15.12:0/979936115 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a46e45f40 con 0x560a46e8be30 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.073+0000 7fdec959a700 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560a46e8be30 0x560a46e8e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.073+0000 7fdead7fa700 10 client.18561 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.073+0000 7fdec959a700 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560a46e8be30 0x560a46e8e250 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18390ff333a89163 server_cookie=9cf808824c0fa9c7 in_seq=0 out_seq=0 2023-12-11T20:26:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdead7fa700 1 -- 172.21.15.12:0/979936115 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560a46e45f40 con 0x560a46e8be30 2023-12-11T20:26:50.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdead7fa700 10 client.18561 handle_command_reply: tid=0 2023-12-11T20:26:50.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 client.18561 shutdown 2023-12-11T20:26:50.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 -- 172.21.15.12:0/979936115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 msgr2=0x560a46e803c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e803c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fdec0096740 tx=0x7fdec0003680 comp rx=0 tx=0).stop 2023-12-11T20:26:50.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 -- 172.21.15.12:0/979936115 shutdown_connections 2023-12-11T20:26:50.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560a46e8be30 0x560a46e8e250 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e77de0 0x560a46e878f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e76a60 0x560a46e803c0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/979936115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e773c0 0x560a46e80900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdead7fa700 0 client.18561 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:50.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.074+0000 7fdedf82bb80 1 -- 172.21.15.12:0/979936115 >> 172.21.15.12:0/979936115 conn(0x560a46da57e0 msgr2=0x560a46e75820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.075+0000 7fdedf82bb80 1 -- 172.21.15.12:0/979936115 shutdown_connections 2023-12-11T20:26:50.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.075+0000 7fdedf82bb80 1 -- 172.21.15.12:0/979936115 wait complete. 2023-12-11T20:26:50.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.075+0000 7fdedf82bb80 20 client.18561 trim_cache size 0 max 16384 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.095+0000 7fdedf82bb80 1 Processor -- start 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.095+0000 7fdedf82bb80 1 -- start start 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.095+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e781c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.095+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.095+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e7f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.095+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46e93460 con 0x560a46e773c0 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.095+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46e6c1e0 con 0x560a46e77de0 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.095+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46e81040 con 0x560a46e7e360 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e781c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40056/0 (socket says 172.21.15.12:40056) 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3518240000 learned_addr learned my addr 172.21.15.12:0/3518240000 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec959a700 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdeca59c700 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e7f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3518240000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 msgr2=0x560a46e7f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e7f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3518240000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 msgr2=0x560a46e878b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e878b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3518240000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a46bdcc60 con 0x560a46e773c0 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.096+0000 7fdeca59c700 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e7f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.097+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e781c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fdec00a2590 tx=0x7fdec00036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251f371534365472 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.097+0000 7fdeb8ff9700 1 -- 172.21.15.12:0/3518240000 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec009a290 con 0x560a46e773c0 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.097+0000 7fdeb8ff9700 1 -- 172.21.15.12:0/3518240000 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdec0098630 con 0x560a46e773c0 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.097+0000 7fdeb8ff9700 1 -- 172.21.15.12:0/3518240000 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00a2190 con 0x560a46e773c0 2023-12-11T20:26:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.097+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3518240000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 msgr2=0x560a46e781c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.097+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e781c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fdec00a2590 tx=0x7fdec00036f0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3518240000 shutdown_connections 2023-12-11T20:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e7f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e781c0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3518240000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3518240000 >> 172.21.15.12:0/3518240000 conn(0x560a46da57e0 msgr2=0x560a46e713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3518240000 shutdown_connections 2023-12-11T20:26:50.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3518240000 wait complete. 2023-12-11T20:26:50.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 -- start start 2023-12-11T20:26:50.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.098+0000 7fdedf82bb80 1 Processor -- start 2023-12-11T20:26:50.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e87510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e85b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdedf82bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46e865f0 con 0x560a46e773c0 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46e86760 con 0x560a46e77de0 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdedf82bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a46e86920 con 0x560a46e7e360 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdedf82bb80 10 client.0 _ll_register_callbacks cb 0x560a46cafa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e87510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e87510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40064/0 (socket says 172.21.15.12:40064) 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3730248703 learned_addr learned my addr 172.21.15.12:0/3730248703 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdec959a700 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e85b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.099+0000 7fdeca59c700 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3730248703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 msgr2=0x560a46e860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e860b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3730248703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 msgr2=0x560a46e85b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e85b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdec9d9b700 1 -- 172.21.15.12:0/3730248703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a46bf3de0 con 0x560a46e773c0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdec9d9b700 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e87510 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fdec0096570 tx=0x7fdec009a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5236926fb0b6bda8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdead7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdead7fa700 1 -- 172.21.15.12:0/3730248703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00965d0 con 0x560a46e773c0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdead7fa700 1 -- 172.21.15.12:0/3730248703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdec009a290 con 0x560a46e773c0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.100+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3730248703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdec009e3e0 con 0x560a46e773c0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdead7fa700 1 -- 172.21.15.12:0/3730248703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdec0099780 con 0x560a46e773c0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdedf82bb80 10 client.18567 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3730248703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560a46c1a250 con 0x560a46e773c0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdead7fa700 1 -- 172.21.15.12:0/3730248703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdec009e3e0 con 0x560a46e773c0 2023-12-11T20:26:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdead7fa700 1 -- 172.21.15.12:0/3730248703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdec009f120 con 0x560a46e773c0 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdedf82bb80 10 client.18567 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdedf82bb80 10 client.18567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdedf82bb80 20 client.18567 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560a46ee3300 0x560a46ee56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdedf82bb80 4 client.18567 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.101+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3730248703 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560a46d90fd0 con 0x560a46ee3300 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.102+0000 7fdec959a700 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560a46ee3300 0x560a46ee56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdec959a700 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560a46ee3300 0x560a46ee56f0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=193006305b0cf702 server_cookie=25e868e8e2e14c6 in_seq=0 out_seq=0 2023-12-11T20:26:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdead7fa700 10 client.18567 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdead7fa700 1 -- 172.21.15.12:0/3730248703 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560a46d90fd0 con 0x560a46ee3300 2023-12-11T20:26:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdead7fa700 10 client.18567 handle_command_reply: tid=0 2023-12-11T20:26:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 client.18567 shutdown 2023-12-11T20:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3730248703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 msgr2=0x560a46e87510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e87510 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fdec0096570 tx=0x7fdec009a800 comp rx=0 tx=0).stop 2023-12-11T20:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3730248703 shutdown_connections 2023-12-11T20:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560a46ee3300 0x560a46ee56f0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560a46e7e360 0x560a46e860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a46e773c0 0x560a46e87510 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 --2- 172.21.15.12:0/3730248703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560a46e77de0 0x560a46e85b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3730248703 >> 172.21.15.12:0/3730248703 conn(0x560a46da57e0 msgr2=0x560a46e7f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.103+0000 7fdead7fa700 0 client.18567 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.104+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3730248703 shutdown_connections 2023-12-11T20:26:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.104+0000 7fdedf82bb80 1 -- 172.21.15.12:0/3730248703 wait complete. 2023-12-11T20:26:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.104+0000 7fdedf82bb80 20 client.18567 trim_cache size 0 max 16384 2023-12-11T20:26:50.107 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:26:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:26:50.107 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:26:50.107 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 -- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdeb00a15a0 msgr2=0x7fdeb00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdeb00a15a0 0x7fdeb00a3a60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0062a0 tx=0x7fdebc0094a0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 -- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec4103520 msgr2=0x7fdec41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec4103520 0x7fdec41993c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fdec000e970 tx=0x7fdec000ed30 comp rx=0 tx=0).stop 2023-12-11T20:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 -- 172.21.15.12:0/3016249373 shutdown_connections 2023-12-11T20:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdeb00a15a0 0x7fdeb00a3a60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdec41050b0 0x7fdec41a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdec4103520 0x7fdec41993c0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 --2- 172.21.15.12:0/3016249373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdec4104710 0x7fdec4199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 -- 172.21.15.12:0/3016249373 >> 172.21.15.12:0/3016249373 conn(0x7fdec40fea70 msgr2=0x7fdec41079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 -- 172.21.15.12:0/3016249373 shutdown_connections 2023-12-11T20:26:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.105+0000 7fdecad9d700 1 -- 172.21.15.12:0/3016249373 wait complete. 2023-12-11T20:26:50.124 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:26:50.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:26:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/3665486647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58075590 msgr2=0x7f5e580739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/3665486647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58075590 0x7f5e580739e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009990 tx=0x7f5e48009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/3665486647 shutdown_connections 2023-12-11T20:26:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/3665486647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e581093a0 0x7f5e5810b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/3665486647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58075590 0x7f5e580739e0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/3665486647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e58073fb0 0x7f5e58074430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/3665486647 >> 172.21.15.12:0/3665486647 conn(0x7f5e580fca40 msgr2=0x7f5e580fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/3665486647 shutdown_connections 2023-12-11T20:26:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.360+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/3665486647 wait complete. 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.361+0000 7f5e5d9ff700 1 Processor -- start 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.361+0000 7f5e5d9ff700 1 -- start start 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e5d9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e58073fb0 0x7f5e58199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e5d9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e58075590 0x7f5e58199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e5d9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e581093a0 0x7f5e581a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e5d9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581a10b0 con 0x7f5e581093a0 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e5d9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581a11f0 con 0x7f5e58073fb0 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e5d9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581a1380 con 0x7f5e58075590 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e58073fb0 0x7f5e58199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e567fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e58075590 0x7f5e58199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e581093a0 0x7f5e581a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e567fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e58075590 0x7f5e58199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53976/0 (socket says 172.21.15.12:53976) 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e58073fb0 0x7f5e58199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:57118/0 (socket says 172.21.15.12:57118) 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.362+0000 7f5e567fc700 1 -- 172.21.15.12:0/4049307489 learned_addr learned my addr 172.21.15.12:0/4049307489 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e577fe700 1 -- 172.21.15.12:0/4049307489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e58075590 msgr2=0x7f5e58199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e577fe700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e58075590 0x7f5e58199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e577fe700 1 -- 172.21.15.12:0/4049307489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e58073fb0 msgr2=0x7f5e58199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e577fe700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e58073fb0 0x7f5e58199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e577fe700 1 -- 172.21.15.12:0/4049307489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e480095f0 con 0x7f5e581093a0 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e56ffd700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e58073fb0 0x7f5e58199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e577fe700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e581093a0 0x7f5e581a0ae0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000be20 tx=0x7f5e50009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e5c9fd700 1 -- 172.21.15.12:0/4049307489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000cb90 con 0x7f5e581093a0 2023-12-11T20:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e5c9fd700 1 -- 172.21.15.12:0/4049307489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e5000ccf0 con 0x7f5e581093a0 2023-12-11T20:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e581a1660 con 0x7f5e581093a0 2023-12-11T20:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e5c9fd700 1 -- 172.21.15.12:0/4049307489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500125a0 con 0x7f5e581093a0 2023-12-11T20:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.363+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e581a1b20 con 0x7f5e581093a0 2023-12-11T20:26:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.365+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e581081b0 con 0x7f5e581093a0 2023-12-11T20:26:50.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.367+0000 7f5e5c9fd700 1 -- 172.21.15.12:0/4049307489 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5e50014440 con 0x7f5e581093a0 2023-12-11T20:26:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.369+0000 7f5e5c9fd700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e400a1480 0x7f5e400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.369+0000 7f5e5c9fd700 1 -- 172.21.15.12:0/4049307489 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5e50006e40 con 0x7f5e581093a0 2023-12-11T20:26:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.369+0000 7f5e56ffd700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e400a1480 0x7f5e400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.370+0000 7f5e56ffd700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e400a1480 0x7f5e400a3940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5e48003780 tx=0x7f5e48005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.374+0000 7f5e5c9fd700 1 -- 172.21.15.12:0/4049307489 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5e5004f2f0 con 0x7f5e581093a0 2023-12-11T20:26:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.702+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e5810f0a0 con 0x7f5e581093a0 2023-12-11T20:26:50.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.703+0000 7f5e5c9fd700 1 -- 172.21.15.12:0/4049307489 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f5e50095ba0 con 0x7f5e581093a0 2023-12-11T20:26:50.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:26:50.702 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:26:50.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e400a1480 msgr2=0x7f5e400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e400a1480 0x7f5e400a3940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5e48003780 tx=0x7f5e48005fb0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e581093a0 msgr2=0x7f5e581a0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e581093a0 0x7f5e581a0ae0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000be20 tx=0x7f5e50009ed0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 shutdown_connections 2023-12-11T20:26:50.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e400a1480 0x7f5e400a3940 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e58073fb0 0x7f5e58199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e581093a0 0x7f5e581a0ae0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 --2- 172.21.15.12:0/4049307489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e58075590 0x7f5e58199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 >> 172.21.15.12:0/4049307489 conn(0x7f5e580fca40 msgr2=0x7f5e581052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 shutdown_connections 2023-12-11T20:26:50.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.706+0000 7f5e5d9ff700 1 -- 172.21.15.12:0/4049307489 wait complete. 2023-12-11T20:26:50.706 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:26:50.724 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:26:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.955+0000 7f53465ff700 1 -- 172.21.15.12:0/100917140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 msgr2=0x7f5340104300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.955+0000 7f53465ff700 1 --2- 172.21.15.12:0/100917140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 0x7f5340104300 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5330009990 tx=0x7f5330009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.955+0000 7f53465ff700 1 -- 172.21.15.12:0/100917140 shutdown_connections 2023-12-11T20:26:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.955+0000 7f53465ff700 1 --2- 172.21.15.12:0/100917140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5340107170 0x7f53401095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.955+0000 7f53465ff700 1 --2- 172.21.15.12:0/100917140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 0x7f5340104300 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.955+0000 7f53465ff700 1 --2- 172.21.15.12:0/100917140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5340104840 0x7f5340106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.955+0000 7f53465ff700 1 -- 172.21.15.12:0/100917140 >> 172.21.15.12:0/100917140 conn(0x7f53400fb940 msgr2=0x7f53400fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.956+0000 7f53465ff700 1 -- 172.21.15.12:0/100917140 shutdown_connections 2023-12-11T20:26:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.956+0000 7f53465ff700 1 -- 172.21.15.12:0/100917140 wait complete. 2023-12-11T20:26:50.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.957+0000 7f53465ff700 1 Processor -- start 2023-12-11T20:26:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.957+0000 7f53465ff700 1 -- start start 2023-12-11T20:26:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f53465ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 0x7f5340199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f53465ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5340104840 0x7f5340199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f53465ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5340107170 0x7f53401a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f53465ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53401a1070 con 0x7f5340101f10 2023-12-11T20:26:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f53465ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53401a11b0 con 0x7f5340107170 2023-12-11T20:26:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f53465ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53401a1340 con 0x7f5340104840 2023-12-11T20:26:50.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 0x7f5340199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 0x7f5340199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40096/0 (socket says 172.21.15.12:40096) 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533ffff700 1 -- 172.21.15.12:0/3282746699 learned_addr learned my addr 172.21.15.12:0/3282746699 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5340104840 0x7f5340199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f5344b9c700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5340107170 0x7f53401a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533ffff700 1 -- 172.21.15.12:0/3282746699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5340104840 msgr2=0x7f5340199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533ffff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5340104840 0x7f5340199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533ffff700 1 -- 172.21.15.12:0/3282746699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5340107170 msgr2=0x7f53401a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533ffff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5340107170 0x7f53401a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f533ffff700 1 -- 172.21.15.12:0/3282746699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300095f0 con 0x7f5340101f10 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.958+0000 7f5344b9c700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5340107170 0x7f53401a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.959+0000 7f533ffff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 0x7f5340199540 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f5330006010 tx=0x7f5330004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.959+0000 7f533d7fa700 1 -- 172.21.15.12:0/3282746699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533001d070 con 0x7f5340101f10 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.959+0000 7f533d7fa700 1 -- 172.21.15.12:0/3282746699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f533000bdb0 con 0x7f5340101f10 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.959+0000 7f53465ff700 1 -- 172.21.15.12:0/3282746699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53401a15c0 con 0x7f5340101f10 2023-12-11T20:26:50.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.959+0000 7f533d7fa700 1 -- 172.21.15.12:0/3282746699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533000fdf0 con 0x7f5340101f10 2023-12-11T20:26:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.959+0000 7f53465ff700 1 -- 172.21.15.12:0/3282746699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53401a1a40 con 0x7f5340101f10 2023-12-11T20:26:50.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.963+0000 7f533d7fa700 1 -- 172.21.15.12:0/3282746699 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f533000b920 con 0x7f5340101f10 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.965+0000 7f533d7fa700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53280a1500 0x7f53280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.965+0000 7f5359fefb80 1 Processor -- start 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.965+0000 7f533d7fa700 1 -- 172.21.15.12:0/3282746699 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f53300ce000 con 0x7f5340101f10 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.965+0000 7f5359fefb80 1 -- start start 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53280a1500 0x7f53280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196977f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519697d30 0x55f519698640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519698c20 0x55f5196990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f5359fefb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5195f2b50 con 0x55f519698c20 2023-12-11T20:26:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f5359fefb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5195f0470 con 0x55f519697d30 2023-12-11T20:26:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f5359fefb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5195ebd60 con 0x55f5196973d0 2023-12-11T20:26:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f5344b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519698c20 0x55f5196990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.966+0000 7f5344b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519698c20 0x55f5196990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40108/0 (socket says 172.21.15.12:40108) 2023-12-11T20:26:50.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.967+0000 7f5344b9c700 1 -- 172.21.15.12:0/3869260897 learned_addr learned my addr 172.21.15.12:0/3869260897 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.967+0000 7f533ffff700 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.967+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53280a1500 0x7f53280a39c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5334009cb0 tx=0x7f5334009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.967+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519697d30 0x55f519698640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.968+0000 7f5344b9c700 1 -- 172.21.15.12:0/3869260897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 msgr2=0x55f5196977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.968+0000 7f5344b9c700 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.968+0000 7f5344b9c700 1 -- 172.21.15.12:0/3869260897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519697d30 msgr2=0x55f519698640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.968+0000 7f5344b9c700 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519697d30 0x55f519698640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.968+0000 7f5344b9c700 1 -- 172.21.15.12:0/3869260897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f519468630 con 0x55f519698c20 2023-12-11T20:26:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.968+0000 7f5344b9c700 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519698c20 0x55f5196990a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5338009440 tx=0x7f5338009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc54e1a5e01777b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.968+0000 7f53267fc700 1 -- 172.21.15.12:0/3869260897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533800e070 con 0x55f519698c20 2023-12-11T20:26:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.968+0000 7f53267fc700 1 -- 172.21.15.12:0/3869260897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f533800f040 con 0x55f519698c20 2023-12-11T20:26:50.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.969+0000 7f53267fc700 1 -- 172.21.15.12:0/3869260897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338015b90 con 0x55f519698c20 2023-12-11T20:26:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.969+0000 7f5359fefb80 1 -- 172.21.15.12:0/3869260897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519698c20 msgr2=0x55f5196990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.969+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519698c20 0x55f5196990a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5338009440 tx=0x7f5338009920 comp rx=0 tx=0).stop 2023-12-11T20:26:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.970+0000 7f5359fefb80 1 -- 172.21.15.12:0/3869260897 shutdown_connections 2023-12-11T20:26:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.970+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519698c20 0x55f5196990a0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.970+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.970+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3869260897 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519697d30 0x55f519698640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.970+0000 7f5359fefb80 1 -- 172.21.15.12:0/3869260897 >> 172.21.15.12:0/3869260897 conn(0x55f5195c67e0 msgr2=0x55f519693d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.970+0000 7f5359fefb80 1 -- 172.21.15.12:0/3869260897 shutdown_connections 2023-12-11T20:26:50.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.970+0000 7f5359fefb80 1 -- 172.21.15.12:0/3869260897 wait complete. 2023-12-11T20:26:50.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.970+0000 7f5359fefb80 1 -- start start 2023-12-11T20:26:50.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.971+0000 7f5359fefb80 1 Processor -- start 2023-12-11T20:26:50.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.971+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196a1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.971+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.971+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.971+0000 7f5359fefb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5195a5560 con 0x55f519697d30 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.971+0000 7f5359fefb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5195a5200 con 0x55f519698c20 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.971+0000 7f5359fefb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f51946a920 con 0x55f5196973d0 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.971+0000 7f5359fefb80 10 client.0 _ll_register_callbacks cb 0x55f5194d0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40122/0 (socket says 172.21.15.12:40122) 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533f7fe700 1 -- 172.21.15.12:0/1528808622 learned_addr learned my addr 172.21.15.12:0/1528808622 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f5344b9c700 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533ffff700 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533f7fe700 1 -- 172.21.15.12:0/1528808622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 msgr2=0x55f5196a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533f7fe700 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533f7fe700 1 -- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 msgr2=0x55f5196a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533f7fe700 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f533f7fe700 1 -- 172.21.15.12:0/1528808622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53380090f0 con 0x55f519697d30 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.972+0000 7f5344b9c700 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.973+0000 7f533f7fe700 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a17c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f533401ea00 tx=0x7f53340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8bdb47a7a7c39 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.973+0000 7f531f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.973+0000 7f531f7fe700 1 -- 172.21.15.12:0/1528808622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400f750 con 0x55f519697d30 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.973+0000 7f531f7fe700 1 -- 172.21.15.12:0/1528808622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f533400f8b0 con 0x55f519697d30 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.973+0000 7f5359fefb80 1 -- 172.21.15.12:0/1528808622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f51968ab40 con 0x55f519697d30 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.973+0000 7f531f7fe700 1 -- 172.21.15.12:0/1528808622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f533400fa70 con 0x55f519697d30 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.973+0000 7f5359fefb80 10 client.18585 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.973+0000 7f5359fefb80 1 -- 172.21.15.12:0/1528808622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f519414de0 con 0x55f519697d30 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f531f7fe700 1 -- 172.21.15.12:0/1528808622 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5334035080 con 0x55f519697d30 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f531f7fe700 1 -- 172.21.15.12:0/1528808622 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5334031d00 con 0x55f519697d30 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f5359fefb80 10 client.18585 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:50.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f5359fefb80 10 client.18585 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f5359fefb80 20 client.18585 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f5359fefb80 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f5196ad080 0x55f5196af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f5359fefb80 4 client.18585 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f5359fefb80 1 -- 172.21.15.12:0/1528808622 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f519666f40 con 0x55f5196ad080 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.974+0000 7f533ffff700 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f5196ad080 0x55f5196af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.975+0000 7f533ffff700 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f5196ad080 0x55f5196af4a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dff48fb7e2402966 server_cookie=4a0e5f6442f91177 in_seq=0 out_seq=0 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.975+0000 7f531f7fe700 10 client.18585 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f531f7fe700 1 -- 172.21.15.12:0/1528808622 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f519666f40 con 0x55f5196ad080 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f531f7fe700 10 client.18585 handle_command_reply: tid=0 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 client.18585 shutdown 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 -- 172.21.15.12:0/1528808622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 msgr2=0x55f5196a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a17c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f533401ea00 tx=0x7f53340047c0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 -- 172.21.15.12:0/1528808622 shutdown_connections 2023-12-11T20:26:50.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f5196ad080 0x55f5196af4a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f531f7fe700 0 client.18585 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:26:50.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 --2- 172.21.15.12:0/1528808622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a17c0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 -- 172.21.15.12:0/1528808622 >> 172.21.15.12:0/1528808622 conn(0x55f5195c67e0 msgr2=0x55f519692a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 -- 172.21.15.12:0/1528808622 shutdown_connections 2023-12-11T20:26:50.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.976+0000 7f5359fefb80 1 -- 172.21.15.12:0/1528808622 wait complete. 2023-12-11T20:26:50.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.977+0000 7f5359fefb80 20 client.18585 trim_cache size 0 max 16384 2023-12-11T20:26:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f5359fefb80 1 Processor -- start 2023-12-11T20:26:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f5359fefb80 1 -- start start 2023-12-11T20:26:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5196973d0 0x55f519699020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f519697d30 0x55f5196a8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f51969b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f5359fefb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f519698200 con 0x55f5196973d0 2023-12-11T20:26:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f5359fefb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f51968e870 con 0x55f519698c20 2023-12-11T20:26:50.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f5359fefb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5196acda0 con 0x55f519697d30 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f533ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5196973d0 0x55f519699020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f533ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5196973d0 0x55f519699020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40124/0 (socket says 172.21.15.12:40124) 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.993+0000 7f533ffff700 1 -- 172.21.15.12:0/3913531795 learned_addr learned my addr 172.21.15.12:0/3913531795 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f5344b9c700 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f51969b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f519697d30 0x55f5196a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f533ffff700 1 -- 172.21.15.12:0/3913531795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f519697d30 msgr2=0x55f5196a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f533ffff700 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f519697d30 0x55f5196a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f533ffff700 1 -- 172.21.15.12:0/3913531795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 msgr2=0x55f51969b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f533ffff700 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f51969b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f533ffff700 1 -- 172.21.15.12:0/3913531795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5193fdc60 con 0x55f5196973d0 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f519697d30 0x55f5196a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f533ffff700 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5196973d0 0x55f519699020 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f53300cbb00 tx=0x7f5330009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ce501934a2fd9a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f5326ffd700 1 -- 172.21.15.12:0/3913531795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330062070 con 0x55f5196973d0 2023-12-11T20:26:50.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f5326ffd700 1 -- 172.21.15.12:0/3913531795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f533009ba60 con 0x55f5196973d0 2023-12-11T20:26:50.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.994+0000 7f5326ffd700 1 -- 172.21.15.12:0/3913531795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330066a90 con 0x55f5196973d0 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 -- 172.21.15.12:0/3913531795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5196973d0 msgr2=0x55f519699020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5196973d0 0x55f519699020 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f53300cbb00 tx=0x7f5330009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 -- 172.21.15.12:0/3913531795 shutdown_connections 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f51969b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5196973d0 0x55f519699020 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3913531795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f519697d30 0x55f5196a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 -- 172.21.15.12:0/3913531795 >> 172.21.15.12:0/3913531795 conn(0x55f5195c67e0 msgr2=0x55f51969f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 -- 172.21.15.12:0/3913531795 shutdown_connections 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.995+0000 7f5359fefb80 1 -- 172.21.15.12:0/3913531795 wait complete. 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.996+0000 7f5359fefb80 1 -- start start 2023-12-11T20:26:50.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.996+0000 7f5359fefb80 1 Processor -- start 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f5359fefb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f5359fefb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5196a7b90 con 0x55f519697d30 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f5359fefb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5196a7d00 con 0x55f519698c20 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f5359fefb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5196a7ec0 con 0x55f5196973d0 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f5359fefb80 10 client.0 _ll_register_callbacks cb 0x55f5194d0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40134/0 (socket says 172.21.15.12:40134) 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533f7fe700 1 -- 172.21.15.12:0/3992301891 learned_addr learned my addr 172.21.15.12:0/3992301891 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533ffff700 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f5344b9c700 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533f7fe700 1 -- 172.21.15.12:0/3992301891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 msgr2=0x55f5196a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533f7fe700 1 -- 172.21.15.12:0/3992301891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 msgr2=0x55f5196a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.997+0000 7f533f7fe700 1 -- 172.21.15.12:0/3992301891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53401a1a40 con 0x55f519697d30 2023-12-11T20:26:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.998+0000 7f533f7fe700 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a4680 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f5334026540 tx=0x7f53340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91971d08e98c607c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.998+0000 7f531f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.998+0000 7f531f7fe700 1 -- 172.21.15.12:0/3992301891 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400f960 con 0x55f519697d30 2023-12-11T20:26:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.998+0000 7f531f7fe700 1 -- 172.21.15.12:0/3992301891 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5334036030 con 0x55f519697d30 2023-12-11T20:26:50.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.998+0000 7f5359fefb80 1 -- 172.21.15.12:0/3992301891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f533800f040 con 0x55f519697d30 2023-12-11T20:26:51.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.998+0000 7f531f7fe700 1 -- 172.21.15.12:0/3992301891 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f533400fac0 con 0x55f519697d30 2023-12-11T20:26:51.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.998+0000 7f5359fefb80 10 client.18591 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:51.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.998+0000 7f5359fefb80 1 -- 172.21.15.12:0/3992301891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f51943b250 con 0x55f519697d30 2023-12-11T20:26:51.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.999+0000 7f531f7fe700 1 -- 172.21.15.12:0/3992301891 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f533800f040 con 0x55f519697d30 2023-12-11T20:26:51.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.999+0000 7f531f7fe700 1 -- 172.21.15.12:0/3992301891 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5334026660 con 0x55f519697d30 2023-12-11T20:26:51.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.999+0000 7f5359fefb80 10 client.18591 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:51.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.999+0000 7f5359fefb80 10 client.18591 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.999+0000 7f5359fefb80 20 client.18591 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.999+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f519704040 0x55f519706460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.999+0000 7f5359fefb80 4 client.18591 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:50.999+0000 7f5359fefb80 1 -- 172.21.15.12:0/3992301891 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f5195b1fd0 con 0x55f519704040 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.000+0000 7f533ffff700 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f519704040 0x55f519706460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.000+0000 7f533ffff700 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f519704040 0x55f519706460 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c57af64701b7c0d server_cookie=9826718b27399c70 in_seq=0 out_seq=0 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.000+0000 7f531f7fe700 10 client.18591 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.000+0000 7f531f7fe700 1 -- 172.21.15.12:0/3992301891 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f5195b1fd0 con 0x55f519704040 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.000+0000 7f531f7fe700 10 client.18591 handle_command_reply: tid=0 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.000+0000 7f5359fefb80 1 client.18591 shutdown 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 -- 172.21.15.12:0/3992301891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 msgr2=0x55f5196a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a4680 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f5334026540 tx=0x7f53340042f0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 -- 172.21.15.12:0/3992301891 shutdown_connections 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f519704040 0x55f519706460 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f519698c20 0x55f5196a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5196973d0 0x55f5196a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 --2- 172.21.15.12:0/3992301891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f519697d30 0x55f5196a4680 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f531f7fe700 0 client.18591 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 -- 172.21.15.12:0/3992301891 >> 172.21.15.12:0/3992301891 conn(0x55f5195c67e0 msgr2=0x55f519693970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 -- 172.21.15.12:0/3992301891 shutdown_connections 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 1 -- 172.21.15.12:0/3992301891 wait complete. 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.001+0000 7f5359fefb80 20 client.18591 trim_cache size 0 max 16384 2023-12-11T20:26:51.003 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:26:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 -- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53280a1500 msgr2=0x7f53280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53280a1500 0x7f53280a39c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5334009cb0 tx=0x7f5334009260 comp rx=0 tx=0).stop 2023-12-11T20:26:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 -- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 msgr2=0x7f5340199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 0x7f5340199540 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f5330006010 tx=0x7f5330004730 comp rx=0 tx=0).stop 2023-12-11T20:26:51.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 -- 172.21.15.12:0/3282746699 shutdown_connections 2023-12-11T20:26:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f53280a1500 0x7f53280a39c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5340107170 0x7f53401a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5340101f10 0x7f5340199540 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 --2- 172.21.15.12:0/3282746699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5340104840 0x7f5340199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 -- 172.21.15.12:0/3282746699 >> 172.21.15.12:0/3282746699 conn(0x7f53400fb940 msgr2=0x7f53401016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 -- 172.21.15.12:0/3282746699 shutdown_connections 2023-12-11T20:26:51.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.002+0000 7f53465ff700 1 -- 172.21.15.12:0/3282746699 wait complete. 2023-12-11T20:26:51.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:50 smithi012 ceph-mon[128787]: pgmap v702: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:26:51.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:50 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/4049307489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:26:51.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:26:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:50 smithi032 ceph-mon[132488]: pgmap v702: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:26:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:50 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/4049307489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:26:51.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780586965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 msgr2=0x7faf08101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780586965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 0x7faf08101710 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7faef80099c0 tx=0x7faef8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780586965 shutdown_connections 2023-12-11T20:26:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780586965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf08102e80 0x7faf08109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780586965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 0x7faf08101710 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780586965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf081024e0 0x7faf08102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780586965 >> 172.21.15.12:0/1780586965 conn(0x7faf080fc860 msgr2=0x7faf080feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780586965 shutdown_connections 2023-12-11T20:26:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.258+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780586965 wait complete. 2023-12-11T20:26:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.259+0000 7faf0d79d700 1 Processor -- start 2023-12-11T20:26:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.259+0000 7faf0d79d700 1 -- start start 2023-12-11T20:26:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.259+0000 7faf0d79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 0x7faf081992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.259+0000 7faf0d79d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf081024e0 0x7faf08199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf0d79d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf08102e80 0x7faf081a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf0d79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf081a0e10 con 0x7faf081012f0 2023-12-11T20:26:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf0d79d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf081a0f50 con 0x7faf08102e80 2023-12-11T20:26:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf0d79d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf081a10e0 con 0x7faf081024e0 2023-12-11T20:26:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf07fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 0x7faf081992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf07fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 0x7faf081992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40156/0 (socket says 172.21.15.12:40156) 2023-12-11T20:26:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf07fff700 1 -- 172.21.15.12:0/1780367307 learned_addr learned my addr 172.21.15.12:0/1780367307 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf077fe700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf081024e0 0x7faf08199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf0cf9c700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf08102e80 0x7faf081a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf07fff700 1 -- 172.21.15.12:0/1780367307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf081024e0 msgr2=0x7faf08199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf07fff700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf081024e0 0x7faf08199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf07fff700 1 -- 172.21.15.12:0/1780367307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf08102e80 msgr2=0x7faf081a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf07fff700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf08102e80 0x7faf081a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf07fff700 1 -- 172.21.15.12:0/1780367307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80095f0 con 0x7faf081012f0 2023-12-11T20:26:51.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.260+0000 7faf0cf9c700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf08102e80 0x7faf081a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:26:51.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.261+0000 7faf07fff700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 0x7faf081992e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7faef8009fd0 tx=0x7faef800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.261+0000 7faf057fa700 1 -- 172.21.15.12:0/1780367307 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef801d070 con 0x7faf081012f0 2023-12-11T20:26:51.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.261+0000 7faf057fa700 1 -- 172.21.15.12:0/1780367307 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faef800bd10 con 0x7faf081012f0 2023-12-11T20:26:51.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.261+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780367307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf081a1360 con 0x7faf081012f0 2023-12-11T20:26:51.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.261+0000 7faf057fa700 1 -- 172.21.15.12:0/1780367307 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8004cb0 con 0x7faf081012f0 2023-12-11T20:26:51.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.261+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780367307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf081a17e0 con 0x7faf081012f0 2023-12-11T20:26:51.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.264+0000 7faf057fa700 1 -- 172.21.15.12:0/1780367307 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7faef8005050 con 0x7faf081012f0 2023-12-11T20:26:51.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.266+0000 7faf057fa700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faef00a15a0 0x7faef00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.266+0000 7faf057fa700 1 -- 172.21.15.12:0/1780367307 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faef80cdc20 con 0x7faf081012f0 2023-12-11T20:26:51.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.266+0000 7faf077fe700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faef00a15a0 0x7faef00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf22412b80 1 Processor -- start 2023-12-11T20:26:51.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf22412b80 1 -- start start 2023-12-11T20:26:51.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf22412b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415ca60 0x558c9415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf22412b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415d3c0 0x558c9415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf22412b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415dde0 0x558c9415e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf22412b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c940b7b50 con 0x558c9415ca60 2023-12-11T20:26:51.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf22412b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c940b5470 con 0x558c9415dde0 2023-12-11T20:26:51.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf22412b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c940b0d60 con 0x558c9415d3c0 2023-12-11T20:26:51.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.267+0000 7faf077fe700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faef00a15a0 0x7faef00a3a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faefc009bf0 tx=0x7faefc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415ca60 0x558c9415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415ca60 0x558c9415ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40168/0 (socket says 172.21.15.12:40168) 2023-12-11T20:26:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 -- 172.21.15.12:0/2916343582 learned_addr learned my addr 172.21.15.12:0/2916343582 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf077fe700 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415d3c0 0x558c9415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf0cf9c700 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415dde0 0x558c9415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 -- 172.21.15.12:0/2916343582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415d3c0 msgr2=0x558c9415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415d3c0 0x558c9415d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 -- 172.21.15.12:0/2916343582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415dde0 msgr2=0x558c9415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415dde0 0x558c9415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 -- 172.21.15.12:0/2916343582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c93f2d630 con 0x558c9415ca60 2023-12-11T20:26:51.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.268+0000 7faf07fff700 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415ca60 0x558c9415ce80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7faef80a2cf0 tx=0x7faef809aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2edac89d808b27 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.269+0000 7faeee7fc700 1 -- 172.21.15.12:0/2916343582 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef809b620 con 0x558c9415ca60 2023-12-11T20:26:51.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.269+0000 7faeee7fc700 1 -- 172.21.15.12:0/2916343582 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faef809af20 con 0x558c9415ca60 2023-12-11T20:26:51.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.269+0000 7faeee7fc700 1 -- 172.21.15.12:0/2916343582 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80993e0 con 0x558c9415ca60 2023-12-11T20:26:51.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.269+0000 7faf22412b80 1 -- 172.21.15.12:0/2916343582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415ca60 msgr2=0x558c9415ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.269+0000 7faf22412b80 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415ca60 0x558c9415ce80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7faef80a2cf0 tx=0x7faef809aa60 comp rx=0 tx=0).stop 2023-12-11T20:26:51.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.270+0000 7faf22412b80 1 -- 172.21.15.12:0/2916343582 shutdown_connections 2023-12-11T20:26:51.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.270+0000 7faf22412b80 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415dde0 0x558c9415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.270+0000 7faf22412b80 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415ca60 0x558c9415ce80 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.270+0000 7faf22412b80 1 --2- 172.21.15.12:0/2916343582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415d3c0 0x558c9415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.270+0000 7faf22412b80 1 -- 172.21.15.12:0/2916343582 >> 172.21.15.12:0/2916343582 conn(0x558c9408b7e0 msgr2=0x558c941573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.270+0000 7faf22412b80 1 -- 172.21.15.12:0/2916343582 shutdown_connections 2023-12-11T20:26:51.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.270+0000 7faf22412b80 1 -- 172.21.15.12:0/2916343582 wait complete. 2023-12-11T20:26:51.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.270+0000 7faf22412b80 1 -- start start 2023-12-11T20:26:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf22412b80 1 Processor -- start 2023-12-11T20:26:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf22412b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c94165fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf22412b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c94166500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf22412b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c9416d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf22412b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9406a560 con 0x558c9415d3c0 2023-12-11T20:26:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf22412b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9406a200 con 0x558c9415ca60 2023-12-11T20:26:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf22412b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c93f2f920 con 0x558c9415dde0 2023-12-11T20:26:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf22412b80 10 client.0 _ll_register_callbacks cb 0x558c93f95a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.271+0000 7faf077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c94166500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c94166500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40178/0 (socket says 172.21.15.12:40178) 2023-12-11T20:26:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf077fe700 1 -- 172.21.15.12:0/2904415982 learned_addr learned my addr 172.21.15.12:0/2904415982 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf07fff700 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c94165fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf0cf9c700 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c9416d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf077fe700 1 -- 172.21.15.12:0/2904415982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 msgr2=0x558c9416d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf077fe700 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c9416d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf077fe700 1 -- 172.21.15.12:0/2904415982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 msgr2=0x558c94165fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf077fe700 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c94165fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf077fe700 1 -- 172.21.15.12:0/2904415982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf081a17e0 con 0x558c9415d3c0 2023-12-11T20:26:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faf077fe700 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c94166500 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7faefc012870 tx=0x7faefc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f435f505b3feb25f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.272+0000 7faee77fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.273+0000 7faee77fe700 1 -- 172.21.15.12:0/2904415982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc004220 con 0x558c9415d3c0 2023-12-11T20:26:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.273+0000 7faf22412b80 1 -- 172.21.15.12:0/2904415982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c9414f9e0 con 0x558c9415d3c0 2023-12-11T20:26:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.273+0000 7faee77fe700 1 -- 172.21.15.12:0/2904415982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faefc018070 con 0x558c9415d3c0 2023-12-11T20:26:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.273+0000 7faee77fe700 1 -- 172.21.15.12:0/2904415982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faefc004380 con 0x558c9415d3c0 2023-12-11T20:26:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.273+0000 7faf22412b80 10 client.18603 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.273+0000 7faf22412b80 1 -- 172.21.15.12:0/2904415982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558c93ed9de0 con 0x558c9415d3c0 2023-12-11T20:26:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.273+0000 7faee77fe700 1 -- 172.21.15.12:0/2904415982 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c9414f9e0 con 0x558c9415d3c0 2023-12-11T20:26:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.273+0000 7faee77fe700 1 -- 172.21.15.12:0/2904415982 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faefc020810 con 0x558c9415d3c0 2023-12-11T20:26:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.274+0000 7faf22412b80 10 client.18603 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.274+0000 7faf22412b80 10 client.18603 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:26:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.274+0000 7faf22412b80 20 client.18603 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.274+0000 7faf22412b80 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558c94171db0 0x558c941741d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.274+0000 7faf22412b80 4 client.18603 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.274+0000 7faf22412b80 1 -- 172.21.15.12:0/2904415982 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c9412bf40 con 0x558c94171db0 2023-12-11T20:26:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.274+0000 7faf07fff700 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558c94171db0 0x558c941741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.275+0000 7faf07fff700 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558c94171db0 0x558c941741d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d7591eb6da97982 server_cookie=a90f5508b6f4a88f in_seq=0 out_seq=0 2023-12-11T20:26:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.275+0000 7faee77fe700 10 client.18603 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:26:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.275+0000 7faee77fe700 1 -- 172.21.15.12:0/2904415982 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558c9412bf40 con 0x558c94171db0 2023-12-11T20:26:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.275+0000 7faee77fe700 10 client.18603 handle_command_reply: tid=0 2023-12-11T20:26:51.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.275+0000 7faf22412b80 1 client.18603 shutdown 2023-12-11T20:26:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 -- 172.21.15.12:0/2904415982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 msgr2=0x558c94166500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c94166500 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7faefc012870 tx=0x7faefc0047c0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 -- 172.21.15.12:0/2904415982 shutdown_connections 2023-12-11T20:26:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558c94171db0 0x558c941741d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c94165fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c9416d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 --2- 172.21.15.12:0/2904415982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c94166500 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faee77fe700 0 client.18603 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:26:51.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 -- 172.21.15.12:0/2904415982 >> 172.21.15.12:0/2904415982 conn(0x558c9408b7e0 msgr2=0x558c9415b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 -- 172.21.15.12:0/2904415982 shutdown_connections 2023-12-11T20:26:51.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 1 -- 172.21.15.12:0/2904415982 wait complete. 2023-12-11T20:26:51.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.276+0000 7faf22412b80 20 client.18603 trim_cache size 0 max 16384 2023-12-11T20:26:51.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf22412b80 1 Processor -- start 2023-12-11T20:26:51.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf22412b80 1 -- start start 2023-12-11T20:26:51.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf22412b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf22412b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf22412b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c941654d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf22412b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c941538b0 con 0x558c9415d3c0 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf22412b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9414f9f0 con 0x558c9415ca60 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf22412b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c94165b30 con 0x558c9415dde0 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.297+0000 7faf077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40184/0 (socket says 172.21.15.12:40184) 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf077fe700 1 -- 172.21.15.12:0/636776038 learned_addr learned my addr 172.21.15.12:0/636776038 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf0cf9c700 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c941654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf07fff700 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf077fe700 1 -- 172.21.15.12:0/636776038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 msgr2=0x558c941654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf077fe700 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c941654d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf077fe700 1 -- 172.21.15.12:0/636776038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 msgr2=0x558c9416dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf077fe700 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf077fe700 1 -- 172.21.15.12:0/636776038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c93ec2c60 con 0x558c9415d3c0 2023-12-11T20:26:51.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.298+0000 7faf077fe700 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416d500 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7faefc0284c0 tx=0x7faefc009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72911d84600f1390 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.299+0000 7faeeeffd700 1 -- 172.21.15.12:0/636776038 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc020630 con 0x558c9415d3c0 2023-12-11T20:26:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.299+0000 7faeeeffd700 1 -- 172.21.15.12:0/636776038 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faefc02d020 con 0x558c9415d3c0 2023-12-11T20:26:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.299+0000 7faeeeffd700 1 -- 172.21.15.12:0/636776038 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc03b420 con 0x558c9415d3c0 2023-12-11T20:26:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.299+0000 7faf22412b80 1 -- 172.21.15.12:0/636776038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 msgr2=0x558c9416d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.299+0000 7faf22412b80 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416d500 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7faefc0284c0 tx=0x7faefc009400 comp rx=0 tx=0).stop 2023-12-11T20:26:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 -- 172.21.15.12:0/636776038 shutdown_connections 2023-12-11T20:26:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c941654d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 --2- 172.21.15.12:0/636776038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416d500 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 -- 172.21.15.12:0/636776038 >> 172.21.15.12:0/636776038 conn(0x558c9408b7e0 msgr2=0x558c94157280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 -- 172.21.15.12:0/636776038 shutdown_connections 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 -- 172.21.15.12:0/636776038 wait complete. 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 -- start start 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.300+0000 7faf22412b80 1 Processor -- start 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf22412b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf22412b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf22412b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c9416c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf22412b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9416caf0 con 0x558c9415d3c0 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf22412b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9416cc60 con 0x558c9415ca60 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf22412b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9416ce20 con 0x558c9415dde0 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf22412b80 10 client.0 _ll_register_callbacks cb 0x558c93f95a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:51.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40186/0 (socket says 172.21.15.12:40186) 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf077fe700 1 -- 172.21.15.12:0/1151475445 learned_addr learned my addr 172.21.15.12:0/1151475445 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf07fff700 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.301+0000 7faf0cf9c700 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c9416c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faf077fe700 1 -- 172.21.15.12:0/1151475445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 msgr2=0x558c9416c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faf077fe700 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c9416c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faf077fe700 1 -- 172.21.15.12:0/1151475445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 msgr2=0x558c9416b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faf077fe700 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faf077fe700 1 -- 172.21.15.12:0/1151475445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c93ed9de0 con 0x558c9415d3c0 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faf07fff700 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faf077fe700 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416b5f0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7faefc020ba0 tx=0x7faefc029ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c3e8864ca18379 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faee77fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faee77fe700 1 -- 172.21.15.12:0/1151475445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc020630 con 0x558c9415d3c0 2023-12-11T20:26:51.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faf22412b80 1 -- 172.21.15.12:0/1151475445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faef809af20 con 0x558c9415d3c0 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.302+0000 7faee77fe700 1 -- 172.21.15.12:0/1151475445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faefc037070 con 0x558c9415d3c0 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faee77fe700 1 -- 172.21.15.12:0/1151475445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faefc028880 con 0x558c9415d3c0 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf22412b80 10 client.18609 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf22412b80 1 -- 172.21.15.12:0/1151475445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558c93f00250 con 0x558c9415d3c0 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faee77fe700 1 -- 172.21.15.12:0/1151475445 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faefc055080 con 0x558c9415d3c0 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faee77fe700 1 -- 172.21.15.12:0/1151475445 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faefc0048b0 con 0x558c9415d3c0 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf22412b80 10 client.18609 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf22412b80 10 client.18609 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf22412b80 20 client.18609 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf22412b80 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558c941c8e10 0x558c941cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf22412b80 4 client.18609 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:26:51.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf22412b80 1 -- 172.21.15.12:0/1151475445 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558c94076fd0 con 0x558c941c8e10 2023-12-11T20:26:51.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:50 smithi039 ceph-mon[102205]: pgmap v702: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:26:51.306 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:50 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/4049307489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:26:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.303+0000 7faf07fff700 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558c941c8e10 0x558c941cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.304+0000 7faf07fff700 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558c941c8e10 0x558c941cb200 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f12b1dc7c6b7bd54 server_cookie=56d11597167de24c in_seq=0 out_seq=0 2023-12-11T20:26:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.304+0000 7faee77fe700 10 client.18609 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:26:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.304+0000 7faee77fe700 1 -- 172.21.15.12:0/1151475445 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558c94076fd0 con 0x558c941c8e10 2023-12-11T20:26:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.304+0000 7faee77fe700 10 client.18609 handle_command_reply: tid=0 2023-12-11T20:26:51.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.304+0000 7faf22412b80 1 client.18609 shutdown 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 -- 172.21.15.12:0/1151475445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 msgr2=0x558c9416b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416b5f0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7faefc020ba0 tx=0x7faefc029ed0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 -- 172.21.15.12:0/1151475445 shutdown_connections 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558c941c8e10 0x558c941cb200 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558c9415ca60 0x558c9416b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558c9415dde0 0x558c9416c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faee77fe700 0 client.18609 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 --2- 172.21.15.12:0/1151475445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c9415d3c0 0x558c9416b5f0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 -- 172.21.15.12:0/1151475445 >> 172.21.15.12:0/1151475445 conn(0x558c9408b7e0 msgr2=0x558c94178b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 -- 172.21.15.12:0/1151475445 shutdown_connections 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 1 -- 172.21.15.12:0/1151475445 wait complete. 2023-12-11T20:26:51.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.305+0000 7faf22412b80 20 client.18609 trim_cache size 0 max 16384 2023-12-11T20:26:51.309 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:26:51.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faef00a15a0 msgr2=0x7faef00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faef00a15a0 0x7faef00a3a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faefc009bf0 tx=0x7faefc009260 comp rx=0 tx=0).stop 2023-12-11T20:26:51.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 msgr2=0x7faf081992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 0x7faf081992e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7faef8009fd0 tx=0x7faef800fab0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780367307 shutdown_connections 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faef00a15a0 0x7faef00a3a60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf08102e80 0x7faf081a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf081012f0 0x7faf081992e0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 --2- 172.21.15.12:0/1780367307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf081024e0 0x7faf08199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780367307 >> 172.21.15.12:0/1780367307 conn(0x7faf080fc860 msgr2=0x7faf08073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780367307 shutdown_connections 2023-12-11T20:26:51.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.306+0000 7faf0d79d700 1 -- 172.21.15.12:0/1780367307 wait complete. 2023-12-11T20:26:51.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:26:51.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.556+0000 7f4a67fff700 1 -- 172.21.15.12:0/1378131159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a681046a0 msgr2=0x7f4a68106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.556+0000 7f4a67fff700 1 --2- 172.21.15.12:0/1378131159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a681046a0 0x7f4a68106a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0098f0 tx=0x7f4a5c009c00 comp rx=0 tx=0).stop 2023-12-11T20:26:51.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.556+0000 7f4a67fff700 1 -- 172.21.15.12:0/1378131159 shutdown_connections 2023-12-11T20:26:51.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.556+0000 7f4a67fff700 1 --2- 172.21.15.12:0/1378131159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a68106fd0 0x7f4a68109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.556+0000 7f4a67fff700 1 --2- 172.21.15.12:0/1378131159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a68101d70 0x7f4a68104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.556+0000 7f4a67fff700 1 --2- 172.21.15.12:0/1378131159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a681046a0 0x7f4a68106a90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.556+0000 7f4a67fff700 1 -- 172.21.15.12:0/1378131159 >> 172.21.15.12:0/1378131159 conn(0x7f4a680fb740 msgr2=0x7f4a680fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.556+0000 7f4a67fff700 1 -- 172.21.15.12:0/1378131159 shutdown_connections 2023-12-11T20:26:51.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.557+0000 7f4a67fff700 1 -- 172.21.15.12:0/1378131159 wait complete. 2023-12-11T20:26:51.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.558+0000 7f4a67fff700 1 Processor -- start 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.558+0000 7f4a67fff700 1 -- start start 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a67fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a68101d70 0x7f4a68199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a67fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a681046a0 0x7f4a68199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a67fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a68106fd0 0x7f4a681a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a67fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a681a0e50 con 0x7f4a681046a0 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a67fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a681a0f90 con 0x7f4a68106fd0 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a67fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a681a1120 con 0x7f4a68101d70 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a667fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a681046a0 0x7f4a68199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a66ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a68101d70 0x7f4a68199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a667fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a681046a0 0x7f4a68199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40208/0 (socket says 172.21.15.12:40208) 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a667fc700 1 -- 172.21.15.12:0/2143046513 learned_addr learned my addr 172.21.15.12:0/2143046513 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a677fe700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a68106fd0 0x7f4a681a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a667fc700 1 -- 172.21.15.12:0/2143046513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a68101d70 msgr2=0x7f4a68199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a68101d70 0x7f4a68199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a667fc700 1 -- 172.21.15.12:0/2143046513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a68106fd0 msgr2=0x7f4a681a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a68106fd0 0x7f4a681a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a667fc700 1 -- 172.21.15.12:0/2143046513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580095f0 con 0x7f4a681046a0 2023-12-11T20:26:51.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.559+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a68101d70 0x7f4a68199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:51.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.560+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a681046a0 0x7f4a68199860 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009810 tx=0x7f4a5c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.560+0000 7f4a4ffff700 1 -- 172.21.15.12:0/2143046513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c01c070 con 0x7f4a681046a0 2023-12-11T20:26:51.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.560+0000 7f4a4ffff700 1 -- 172.21.15.12:0/2143046513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a5c00f7b0 con 0x7f4a681046a0 2023-12-11T20:26:51.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.560+0000 7f4a67fff700 1 -- 172.21.15.12:0/2143046513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c009520 con 0x7f4a681046a0 2023-12-11T20:26:51.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.560+0000 7f4a4ffff700 1 -- 172.21.15.12:0/2143046513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0038e0 con 0x7f4a681046a0 2023-12-11T20:26:51.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.560+0000 7f4a67fff700 1 -- 172.21.15.12:0/2143046513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a681a1630 con 0x7f4a681046a0 2023-12-11T20:26:51.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.564+0000 7f4a4ffff700 1 -- 172.21.15.12:0/2143046513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4a5c020030 con 0x7f4a681046a0 2023-12-11T20:26:51.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.565+0000 7f4a4ffff700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a500a1520 0x7f4a500a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.565+0000 7f4a4ffff700 1 -- 172.21.15.12:0/2143046513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a5c0cded0 con 0x7f4a681046a0 2023-12-11T20:26:51.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.566+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a500a1520 0x7f4a500a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.566+0000 7f4a80e12b80 1 Processor -- start 2023-12-11T20:26:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.566+0000 7f4a80e12b80 1 -- start start 2023-12-11T20:26:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.566+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a500a1520 0x7f4a500a39e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4a58005fd0 tx=0x7f4a58009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.566+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b3fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b3fc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b355b50 con 0x563b8b3fbde0 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b353470 con 0x563b8b3faa60 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b34ed60 con 0x563b8b3fb3c0 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a677fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b3fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a677fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b3fc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40210/0 (socket says 172.21.15.12:40210) 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a677fe700 1 -- 172.21.15.12:0/1309305245 learned_addr learned my addr 172.21.15.12:0/1309305245 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a667fc700 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b3fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a677fe700 1 -- 172.21.15.12:0/1309305245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 msgr2=0x563b8b3fb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a677fe700 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b3fb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a677fe700 1 -- 172.21.15.12:0/1309305245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 msgr2=0x563b8b3fae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a677fe700 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.567+0000 7f4a677fe700 1 -- 172.21.15.12:0/1309305245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b8b1cb630 con 0x563b8b3fbde0 2023-12-11T20:26:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.568+0000 7f4a677fe700 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b3fc240 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4a60011680 tx=0x7f4a60009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf9bf59831fe08f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.568+0000 7f4a4d7fa700 1 -- 172.21.15.12:0/1309305245 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000e040 con 0x563b8b3fbde0 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.568+0000 7f4a4d7fa700 1 -- 172.21.15.12:0/1309305245 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a6000f040 con 0x563b8b3fbde0 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.568+0000 7f4a4d7fa700 1 -- 172.21.15.12:0/1309305245 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a60004730 con 0x563b8b3fbde0 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1309305245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 msgr2=0x563b8b3fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b3fc240 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4a60011680 tx=0x7f4a60009920 comp rx=0 tx=0).stop 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1309305245 shutdown_connections 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b3fc240 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/1309305245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b3fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1309305245 >> 172.21.15.12:0/1309305245 conn(0x563b8b3297e0 msgr2=0x563b8b3f53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1309305245 shutdown_connections 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.569+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1309305245 wait complete. 2023-12-11T20:26:51.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.570+0000 7f4a80e12b80 1 -- start start 2023-12-11T20:26:51.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.570+0000 7f4a80e12b80 1 Processor -- start 2023-12-11T20:26:51.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3faa60 0x563b8b404330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fb3c0 0x563b8b404870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b308560 con 0x563b8b3fb3c0 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b308200 con 0x563b8b3fbde0 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b1cd920 con 0x563b8b3faa60 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a80e12b80 10 client.0 _ll_register_callbacks cb 0x563b8b233a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a667fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fb3c0 0x563b8b404870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a66ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3faa60 0x563b8b404330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a667fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fb3c0 0x563b8b404870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40226/0 (socket says 172.21.15.12:40226) 2023-12-11T20:26:51.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a66ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3faa60 0x563b8b404330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54132/0 (socket says 172.21.15.12:54132) 2023-12-11T20:26:51.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a667fc700 1 -- 172.21.15.12:0/2599818146 learned_addr learned my addr 172.21.15.12:0/2599818146 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.571+0000 7f4a677fe700 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a667fc700 1 -- 172.21.15.12:0/2599818146 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3faa60 msgr2=0x563b8b404330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3faa60 0x563b8b404330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a667fc700 1 -- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 msgr2=0x563b8b40b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a667fc700 1 -- 172.21.15.12:0/2599818146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a60011330 con 0x563b8b3fb3c0 2023-12-11T20:26:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a677fe700 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fb3c0 0x563b8b404870 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00f9d0 tx=0x7f4a5c09b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2018ab5fe6d40c53 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a4aff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2599818146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c09f320 con 0x563b8b3fb3c0 2023-12-11T20:26:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2599818146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a5c0a34d0 con 0x563b8b3fb3c0 2023-12-11T20:26:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.572+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2599818146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b8b3ed9e0 con 0x563b8b3fb3c0 2023-12-11T20:26:51.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2599818146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a5c0978e0 con 0x563b8b3fb3c0 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a80e12b80 10 client.18621 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2599818146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563b8b177de0 con 0x563b8b3fb3c0 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2599818146 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a5c064070 con 0x563b8b3fb3c0 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2599818146 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4a5c0b91f0 con 0x563b8b3fb3c0 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a80e12b80 10 client.18621 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a80e12b80 10 client.18621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a80e12b80 20 client.18621 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563b8b40fdb0 0x563b8b4121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a80e12b80 4 client.18621 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.573+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2599818146 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b8b3c9f40 con 0x563b8b40fdb0 2023-12-11T20:26:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.574+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563b8b40fdb0 0x563b8b4121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.575+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563b8b40fdb0 0x563b8b4121d0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=112ea739d70f580b server_cookie=568b6e76ddd632c5 in_seq=0 out_seq=0 2023-12-11T20:26:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.575+0000 7f4a4aff5700 10 client.18621 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.575+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2599818146 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563b8b3c9f40 con 0x563b8b40fdb0 2023-12-11T20:26:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.575+0000 7f4a4aff5700 10 client.18621 handle_command_reply: tid=0 2023-12-11T20:26:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 client.18621 shutdown 2023-12-11T20:26:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2599818146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fb3c0 msgr2=0x563b8b404870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fb3c0 0x563b8b404870 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00f9d0 tx=0x7f4a5c09b8d0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2599818146 shutdown_connections 2023-12-11T20:26:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563b8b40fdb0 0x563b8b4121d0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3faa60 0x563b8b404330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2599818146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fb3c0 0x563b8b404870 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a4aff5700 0 client.18621 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2599818146 >> 172.21.15.12:0/2599818146 conn(0x563b8b3297e0 msgr2=0x563b8b3f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2599818146 shutdown_connections 2023-12-11T20:26:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2599818146 wait complete. 2023-12-11T20:26:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.576+0000 7f4a80e12b80 20 client.18621 trim_cache size 0 max 16384 2023-12-11T20:26:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.596+0000 7f4a80e12b80 1 Processor -- start 2023-12-11T20:26:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.596+0000 7f4a80e12b80 1 -- start start 2023-12-11T20:26:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.596+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.596+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b40b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.596+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b403840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.596+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b4173a0 con 0x563b8b3fbde0 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.596+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b3f1ba0 con 0x563b8b3faa60 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.596+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b3f01e0 con 0x563b8b3fb3c0 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a677fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b403840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a677fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b403840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40242/0 (socket says 172.21.15.12:40242) 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a677fe700 1 -- 172.21.15.12:0/1218883118 learned_addr learned my addr 172.21.15.12:0/1218883118 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a667fc700 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b40b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a677fe700 1 -- 172.21.15.12:0/1218883118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 msgr2=0x563b8b40b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a677fe700 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b40b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a677fe700 1 -- 172.21.15.12:0/1218883118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 msgr2=0x563b8b3fae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a677fe700 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a677fe700 1 -- 172.21.15.12:0/1218883118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b8b160c60 con 0x563b8b3fbde0 2023-12-11T20:26:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.597+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:51.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.598+0000 7f4a677fe700 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b403840 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4a60011620 tx=0x7f4a60009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b3430e0d244127 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.598+0000 7f4a4dffb700 1 -- 172.21.15.12:0/1218883118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000e050 con 0x563b8b3fbde0 2023-12-11T20:26:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.598+0000 7f4a4dffb700 1 -- 172.21.15.12:0/1218883118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a60006000 con 0x563b8b3fbde0 2023-12-11T20:26:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.598+0000 7f4a4dffb700 1 -- 172.21.15.12:0/1218883118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a60007970 con 0x563b8b3fbde0 2023-12-11T20:26:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1218883118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 msgr2=0x563b8b403840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b403840 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4a60011620 tx=0x7f4a60009dd0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1218883118 shutdown_connections 2023-12-11T20:26:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3faa60 0x563b8b3fae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3fbde0 0x563b8b403840 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/1218883118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b40b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1218883118 >> 172.21.15.12:0/1218883118 conn(0x563b8b3297e0 msgr2=0x563b8b4030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1218883118 shutdown_connections 2023-12-11T20:26:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 -- 172.21.15.12:0/1218883118 wait complete. 2023-12-11T20:26:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.599+0000 7f4a80e12b80 1 -- start start 2023-12-11T20:26:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a80e12b80 1 Processor -- start 2023-12-11T20:26:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3faa60 0x563b8b4097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b409ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a80e12b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b40b230 con 0x563b8b3faa60 2023-12-11T20:26:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b40b3a0 con 0x563b8b3fbde0 2023-12-11T20:26:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a80e12b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8b40b560 con 0x563b8b3fb3c0 2023-12-11T20:26:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a80e12b80 10 client.0 _ll_register_callbacks cb 0x563b8b233a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a66ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3faa60 0x563b8b4097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a66ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3faa60 0x563b8b4097a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40256/0 (socket says 172.21.15.12:40256) 2023-12-11T20:26:51.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.600+0000 7f4a66ffd700 1 -- 172.21.15.12:0/2827055049 learned_addr learned my addr 172.21.15.12:0/2827055049 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:51.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b409ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a677fe700 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a66ffd700 1 -- 172.21.15.12:0/2827055049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 msgr2=0x563b8b409ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b409ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a66ffd700 1 -- 172.21.15.12:0/2827055049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 msgr2=0x563b8b40acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:51.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a66ffd700 1 -- 172.21.15.12:0/2827055049 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a58017070 con 0x563b8b3faa60 2023-12-11T20:26:51.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a66ffd700 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3faa60 0x563b8b4097a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x563b8b412a70 tx=0x7f4a580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1beb3f077442e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:51.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a4aff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:51.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.601+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2827055049 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58024040 con 0x563b8b3faa60 2023-12-11T20:26:51.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2827055049 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a58029570 con 0x563b8b3faa60 2023-12-11T20:26:51.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2827055049 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a6000f040 con 0x563b8b3faa60 2023-12-11T20:26:51.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2827055049 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a58029730 con 0x563b8b3faa60 2023-12-11T20:26:51.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 10 client.18627 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:51.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2827055049 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563b8b1cb630 con 0x563b8b3faa60 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2827055049 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a6000f040 con 0x563b8b3faa60 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2827055049 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4a5801e420 con 0x563b8b3faa60 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 10 client.18627 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 10 client.18627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 20 client.18627 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563b8b467350 0x563b8b469770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 4 client.18627 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.602+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2827055049 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563b8b314fd0 con 0x563b8b467350 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.603+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563b8b467350 0x563b8b469770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.603+0000 7f4a667fc700 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563b8b467350 0x563b8b469770 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b529f94ad8bbdc0 server_cookie=244db3a14161f813 in_seq=0 out_seq=0 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.603+0000 7f4a4aff5700 10 client.18627 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:51.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a4aff5700 1 -- 172.21.15.12:0/2827055049 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563b8b314fd0 con 0x563b8b467350 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a4aff5700 10 client.18627 handle_command_reply: tid=0 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 client.18627 shutdown 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2827055049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3faa60 msgr2=0x563b8b4097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3faa60 0x563b8b4097a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x563b8b412a70 tx=0x7f4a580047c0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2827055049 shutdown_connections 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563b8b467350 0x563b8b469770 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563b8b3fbde0 0x563b8b40acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b8b3faa60 0x563b8b4097a0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a4aff5700 0 client.18627 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 --2- 172.21.15.12:0/2827055049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563b8b3fb3c0 0x563b8b409ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2827055049 >> 172.21.15.12:0/2827055049 conn(0x563b8b3297e0 msgr2=0x563b8b3f5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2827055049 shutdown_connections 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 1 -- 172.21.15.12:0/2827055049 wait complete. 2023-12-11T20:26:51.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.604+0000 7f4a80e12b80 20 client.18627 trim_cache size 0 max 16384 2023-12-11T20:26:51.612 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:26:51.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 -- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a500a1520 msgr2=0x7f4a500a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a500a1520 0x7f4a500a39e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4a58005fd0 tx=0x7f4a58009310 comp rx=0 tx=0).stop 2023-12-11T20:26:51.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 -- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a681046a0 msgr2=0x7f4a68199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:51.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a681046a0 0x7f4a68199860 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009810 tx=0x7f4a5c00b790 comp rx=0 tx=0).stop 2023-12-11T20:26:51.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 -- 172.21.15.12:0/2143046513 shutdown_connections 2023-12-11T20:26:51.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4a500a1520 0x7f4a500a39e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a68106fd0 0x7f4a681a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a68101d70 0x7f4a68199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 --2- 172.21.15.12:0/2143046513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a681046a0 0x7f4a68199860 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:51.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 -- 172.21.15.12:0/2143046513 >> 172.21.15.12:0/2143046513 conn(0x7f4a680fb740 msgr2=0x7f4a68101580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:51.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 -- 172.21.15.12:0/2143046513 shutdown_connections 2023-12-11T20:26:51.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:51.605+0000 7f4a67fff700 1 -- 172.21.15.12:0/2143046513 wait complete. 2023-12-11T20:26:52.625 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:26:52.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:26:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 -- 172.21.15.12:0/2216884368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4101d70 msgr2=0x7f96c4104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 --2- 172.21.15.12:0/2216884368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4101d70 0x7f96c4104160 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009990 tx=0x7f96b4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 -- 172.21.15.12:0/2216884368 shutdown_connections 2023-12-11T20:26:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 --2- 172.21.15.12:0/2216884368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96c4106fd0 0x7f96c4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 --2- 172.21.15.12:0/2216884368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4101d70 0x7f96c4104160 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 --2- 172.21.15.12:0/2216884368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96c41046a0 0x7f96c4106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 -- 172.21.15.12:0/2216884368 >> 172.21.15.12:0/2216884368 conn(0x7f96c40fb740 msgr2=0x7f96c40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 -- 172.21.15.12:0/2216884368 shutdown_connections 2023-12-11T20:26:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.862+0000 7f96c359e700 1 -- 172.21.15.12:0/2216884368 wait complete. 2023-12-11T20:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.864+0000 7f96c359e700 1 Processor -- start 2023-12-11T20:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.864+0000 7f96c359e700 1 -- start start 2023-12-11T20:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.864+0000 7f96c359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96c4101d70 0x7f96c4101640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.864+0000 7f96c359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96c41046a0 0x7f96c40ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.864+0000 7f96c359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4106fd0 0x7f96c4100260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.864+0000 7f96c359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4100960 con 0x7f96c4106fd0 2023-12-11T20:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.864+0000 7f96c359e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4100ad0 con 0x7f96c4101d70 2023-12-11T20:26:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.864+0000 7f96c359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41a1180 con 0x7f96c41046a0 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4106fd0 0x7f96c4100260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4106fd0 0x7f96c4100260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40276/0 (socket says 172.21.15.12:40276) 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 -- 172.21.15.12:0/133331797 learned_addr learned my addr 172.21.15.12:0/133331797 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c259c700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96c4101d70 0x7f96c4101640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96c41046a0 0x7f96c40ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 -- 172.21.15.12:0/133331797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96c41046a0 msgr2=0x7f96c40ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96c41046a0 0x7f96c40ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 -- 172.21.15.12:0/133331797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96c4101d70 msgr2=0x7f96c4101640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96c4101d70 0x7f96c4101640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 -- 172.21.15.12:0/133331797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b40095f0 con 0x7f96c4106fd0 2023-12-11T20:26:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.865+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4106fd0 0x7f96c4100260 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f96bc007ee0 tx=0x7f96bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.866+0000 7f96b37fe700 1 -- 172.21.15.12:0/133331797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00ddd0 con 0x7f96c4106fd0 2023-12-11T20:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.866+0000 7f96b37fe700 1 -- 172.21.15.12:0/133331797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96bc00f040 con 0x7f96c4106fd0 2023-12-11T20:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.866+0000 7f96c359e700 1 -- 172.21.15.12:0/133331797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c41a13e0 con 0x7f96c4106fd0 2023-12-11T20:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.866+0000 7f96b37fe700 1 -- 172.21.15.12:0/133331797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc004870 con 0x7f96c4106fd0 2023-12-11T20:26:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.866+0000 7f96c359e700 1 -- 172.21.15.12:0/133331797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c41a18a0 con 0x7f96c4106fd0 2023-12-11T20:26:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.870+0000 7f96b37fe700 1 -- 172.21.15.12:0/133331797 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f96bc003a00 con 0x7f96c4106fd0 2023-12-11T20:26:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.871+0000 7f96dc93bb80 1 Processor -- start 2023-12-11T20:26:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.871+0000 7f96dc93bb80 1 -- start start 2023-12-11T20:26:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.871+0000 7f96b37fe700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96ac0a1520 0x7f96ac0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.871+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.871+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4440 0x55dbca0a4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.871+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 0x55dbca0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.871+0000 7f96b37fe700 1 -- 172.21.15.12:0/133331797 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96bc0cc700 con 0x7f96c4106fd0 2023-12-11T20:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9ffebd0 con 0x55dbca0a4440 2023-12-11T20:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9ffc4f0 con 0x55dbca0a4e60 2023-12-11T20:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9ff7de0 con 0x55dbca0a3ae0 2023-12-11T20:26:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96ac0a1520 0x7f96ac0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96c1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4440 0x55dbca0a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96c1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4440 0x55dbca0a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40284/0 (socket says 172.21.15.12:40284) 2023-12-11T20:26:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96c1d9b700 1 -- 172.21.15.12:0/3338736307 learned_addr learned my addr 172.21.15.12:0/3338736307 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96c259c700 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.872+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 0x55dbca0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96c259c700 1 -- 172.21.15.12:0/3338736307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 msgr2=0x55dbca0a52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96c259c700 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 0x55dbca0a52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96c259c700 1 -- 172.21.15.12:0/3338736307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4440 msgr2=0x55dbca0a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96c259c700 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4440 0x55dbca0a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96c259c700 1 -- 172.21.15.12:0/3338736307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbc9e746b0 con 0x55dbca0a3ae0 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4440 0x55dbca0a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96ac0a1520 0x7f96ac0a39e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f96b8012a00 tx=0x7f96b8009ba0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96c259c700 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0a3f00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96b4003f60 tx=0x7f96b4005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249c350f044eac30 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96b0ff9700 1 -- 172.21.15.12:0/3338736307 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4005240 con 0x55dbca0a3ae0 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96b0ff9700 1 -- 172.21.15.12:0/3338736307 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96b401e040 con 0x55dbca0a3ae0 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.873+0000 7f96b0ff9700 1 -- 172.21.15.12:0/3338736307 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400b710 con 0x55dbca0a3ae0 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.874+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3338736307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 msgr2=0x55dbca0a3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.874+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0a3f00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96b4003f60 tx=0x7f96b4005e80 comp rx=0 tx=0).stop 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.874+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3338736307 shutdown_connections 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.874+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 0x55dbca0a52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.874+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0a3f00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.874+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/3338736307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4440 0x55dbca0a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.874+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3338736307 >> 172.21.15.12:0/3338736307 conn(0x55dbc9fd2860 msgr2=0x55dbca09e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.874+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3338736307 shutdown_connections 2023-12-11T20:26:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.875+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3338736307 wait complete. 2023-12-11T20:26:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.875+0000 7f96dc93bb80 1 -- start start 2023-12-11T20:26:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.876+0000 7f96dc93bb80 1 Processor -- start 2023-12-11T20:26:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.876+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.876+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.876+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4e60 0x55dbca0b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.876+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9fb15e0 con 0x55dbca0a3ae0 2023-12-11T20:26:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.876+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9fb1280 con 0x55dbca0a4440 2023-12-11T20:26:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.876+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9e769a0 con 0x55dbca0a4e60 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.876+0000 7f96dc93bb80 10 client.0 _ll_register_callbacks cb 0x55dbc9edcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c1d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40294/0 (socket says 172.21.15.12:40294) 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c259c700 1 -- 172.21.15.12:0/1376344913 learned_addr learned my addr 172.21.15.12:0/1376344913 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4e60 0x55dbca0b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c1d9b700 1 -- 172.21.15.12:0/1376344913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4e60 msgr2=0x55dbca0b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4e60 0x55dbca0b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c1d9b700 1 -- 172.21.15.12:0/1376344913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 msgr2=0x55dbca0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.877+0000 7f96c1d9b700 1 -- 172.21.15.12:0/1376344913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b801a040 con 0x55dbca0a4440 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.878+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96b80106b0 tx=0x7f96b8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f6d95d60978ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.878+0000 7f96a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.878+0000 7f96a9ffb700 1 -- 172.21.15.12:0/1376344913 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b80122b0 con 0x55dbca0a4440 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.878+0000 7f96dc93bb80 1 -- 172.21.15.12:0/1376344913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dbca096a60 con 0x55dbca0a4440 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.878+0000 7f96a9ffb700 1 -- 172.21.15.12:0/1376344913 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96b8011440 con 0x55dbca0a4440 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.878+0000 7f96a9ffb700 1 -- 172.21.15.12:0/1376344913 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96b8011600 con 0x55dbca0a4440 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.878+0000 7f96dc93bb80 10 client.28232 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.878+0000 7f96dc93bb80 1 -- 172.21.15.12:0/1376344913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f96c410a030 con 0x55dbca0a4440 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.879+0000 7f96a9ffb700 1 -- 172.21.15.12:0/1376344913 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dbca096a60 con 0x55dbca0a4440 2023-12-11T20:26:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.879+0000 7f96a9ffb700 1 -- 172.21.15.12:0/1376344913 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f96b8033570 con 0x55dbca0a4440 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.879+0000 7f96dc93bb80 10 client.28232 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.879+0000 7f96dc93bb80 10 client.28232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.879+0000 7f96dc93bb80 20 client.28232 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.879+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dbca0b90d0 0x55dbca0bb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.879+0000 7f96dc93bb80 4 client.28232 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.879+0000 7f96dc93bb80 1 -- 172.21.15.12:0/1376344913 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dbca072fc0 con 0x55dbca0b90d0 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.880+0000 7f96c259c700 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dbca0b90d0 0x55dbca0bb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.880+0000 7f96c259c700 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dbca0b90d0 0x55dbca0bb4f0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8448587fc2352696 server_cookie=7eca7b24c38d51ff in_seq=0 out_seq=0 2023-12-11T20:26:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.880+0000 7f96a9ffb700 10 client.28232 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96a9ffb700 1 -- 172.21.15.12:0/1376344913 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dbca072fc0 con 0x55dbca0b90d0 2023-12-11T20:26:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96a9ffb700 10 client.28232 handle_command_reply: tid=0 2023-12-11T20:26:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 client.28232 shutdown 2023-12-11T20:26:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 -- 172.21.15.12:0/1376344913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 msgr2=0x55dbca0ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96b80106b0 tx=0x7f96b8009260 comp rx=0 tx=0).stop 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 -- 172.21.15.12:0/1376344913 shutdown_connections 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dbca0b90d0 0x55dbca0bb4f0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4e60 0x55dbca0b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96a9ffb700 0 client.28232 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/1376344913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 -- 172.21.15.12:0/1376344913 >> 172.21.15.12:0/1376344913 conn(0x55dbc9fd2860 msgr2=0x55dbca0a28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 -- 172.21.15.12:0/1376344913 shutdown_connections 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.881+0000 7f96dc93bb80 1 -- 172.21.15.12:0/1376344913 wait complete. 2023-12-11T20:26:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.882+0000 7f96dc93bb80 20 client.28232 trim_cache size 0 max 16384 2023-12-11T20:26:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.903+0000 7f96dc93bb80 1 Processor -- start 2023-12-11T20:26:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.903+0000 7f96dc93bb80 1 -- start start 2023-12-11T20:26:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 0x55dbca0b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbca09a900 con 0x55dbca0a3ae0 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbca0b59b0 con 0x55dbca0a4e60 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbca0ace20 con 0x55dbca0a4440 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40306/0 (socket says 172.21.15.12:40306) 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c259c700 1 -- 172.21.15.12:0/3995147371 learned_addr learned my addr 172.21.15.12:0/3995147371 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 0x55dbca0b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c259c700 1 -- 172.21.15.12:0/3995147371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4440 msgr2=0x55dbca0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c259c700 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c259c700 1 -- 172.21.15.12:0/3995147371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 msgr2=0x55dbca0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c259c700 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 0x55dbca0b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c259c700 1 -- 172.21.15.12:0/3995147371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbc9e20e60 con 0x55dbca0a3ae0 2023-12-11T20:26:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.904+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:26:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.905+0000 7f96c259c700 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009350 tx=0x7f96b4009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ed9d2b42208186 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.905+0000 7f96b17fa700 1 -- 172.21.15.12:0/3995147371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4032070 con 0x55dbca0a3ae0 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.905+0000 7f96b17fa700 1 -- 172.21.15.12:0/3995147371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96b4003700 con 0x55dbca0a3ae0 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.905+0000 7f96b17fa700 1 -- 172.21.15.12:0/3995147371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400ba90 con 0x55dbca0a3ae0 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3995147371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 msgr2=0x55dbca0ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009350 tx=0x7f96b4009290 comp rx=0 tx=0).stop 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3995147371 shutdown_connections 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4e60 0x55dbca0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a3ae0 0x55dbca0ad270 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/3995147371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a4440 0x55dbca0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3995147371 >> 172.21.15.12:0/3995147371 conn(0x55dbc9fd2860 msgr2=0x55dbca0ab300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3995147371 shutdown_connections 2023-12-11T20:26:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.906+0000 7f96dc93bb80 1 -- 172.21.15.12:0/3995147371 wait complete. 2023-12-11T20:26:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 1 -- start start 2023-12-11T20:26:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 1 Processor -- start 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4e60 0x55dbca0b3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbca0b35b0 con 0x55dbca0a4e60 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbca0b3720 con 0x55dbca0a4440 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbca0b38e0 con 0x55dbca0a3ae0 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.907+0000 7f96dc93bb80 10 client.0 _ll_register_callbacks cb 0x55dbc9edcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4e60 0x55dbca0b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4e60 0x55dbca0b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40312/0 (socket says 172.21.15.12:40312) 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c2d9d700 1 -- 172.21.15.12:0/412011268 learned_addr learned my addr 172.21.15.12:0/412011268 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c259c700 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c2d9d700 1 -- 172.21.15.12:0/412011268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 msgr2=0x55dbca0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c2d9d700 1 -- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 msgr2=0x55dbca0b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c2d9d700 1 -- 172.21.15.12:0/412011268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbc9e746b0 con 0x55dbca0a4e60 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.908+0000 7f96c1d9b700 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96c2d9d700 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4e60 0x55dbca0b3070 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0ca200 tx=0x7f96bc099330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1723dabf094d5199 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96a9ffb700 1 -- 172.21.15.12:0/412011268 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0999d0 con 0x55dbca0a4e60 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96a9ffb700 1 -- 172.21.15.12:0/412011268 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96bc09db20 con 0x55dbca0a4e60 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96dc93bb80 1 -- 172.21.15.12:0/412011268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dbc9fbe050 con 0x55dbca0a4e60 2023-12-11T20:26:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96a9ffb700 1 -- 172.21.15.12:0/412011268 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96bc0a1d60 con 0x55dbca0a4e60 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96dc93bb80 10 client.18645 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96dc93bb80 1 -- 172.21.15.12:0/412011268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55dbc9e09ce0 con 0x55dbca0a4e60 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96a9ffb700 1 -- 172.21.15.12:0/412011268 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dbc9fbe050 con 0x55dbca0a4e60 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.909+0000 7f96a9ffb700 1 -- 172.21.15.12:0/412011268 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f96bc004bd0 con 0x55dbca0a4e60 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.910+0000 7f96dc93bb80 10 client.18645 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.910+0000 7f96dc93bb80 10 client.18645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.910+0000 7f96dc93bb80 20 client.18645 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.910+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dbca110d20 0x55dbca113140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.910+0000 7f96dc93bb80 4 client.18645 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.910+0000 7f96dc93bb80 1 -- 172.21.15.12:0/412011268 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55dbc9fb0510 con 0x55dbca110d20 2023-12-11T20:26:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.910+0000 7f96c259c700 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dbca110d20 0x55dbca113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.911+0000 7f96a9ffb700 10 client.18645 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.911+0000 7f96c259c700 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dbca110d20 0x55dbca113140 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aedc98dd6e24719 server_cookie=34f81744439f80ef in_seq=0 out_seq=0 2023-12-11T20:26:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96a9ffb700 1 -- 172.21.15.12:0/412011268 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55dbc9fb0510 con 0x55dbca110d20 2023-12-11T20:26:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96a9ffb700 10 client.18645 handle_command_reply: tid=0 2023-12-11T20:26:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 client.18645 shutdown 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 -- 172.21.15.12:0/412011268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4e60 msgr2=0x55dbca0b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4e60 0x55dbca0b3070 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0ca200 tx=0x7f96bc099330 comp rx=0 tx=0).stop 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 -- 172.21.15.12:0/412011268 shutdown_connections 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dbca110d20 0x55dbca113140 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dbca0a4e60 0x55dbca0b3070 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dbca0a3ae0 0x55dbca0b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 --2- 172.21.15.12:0/412011268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dbca0a4440 0x55dbca0b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96dc93bb80 1 -- 172.21.15.12:0/412011268 >> 172.21.15.12:0/412011268 conn(0x55dbc9fd2860 msgr2=0x55dbca0a7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.912+0000 7f96a9ffb700 0 client.18645 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.913+0000 7f96dc93bb80 1 -- 172.21.15.12:0/412011268 shutdown_connections 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.913+0000 7f96dc93bb80 1 -- 172.21.15.12:0/412011268 wait complete. 2023-12-11T20:26:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.913+0000 7f96dc93bb80 20 client.18645 trim_cache size 0 max 16384 2023-12-11T20:26:52.914 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:26:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:26:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "0686d8d9-76a1-4bd1-b636-3e256064dbbe", 2023-12-11T20:26:52.914 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:26:52.914 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:26:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.913+0000 7f96c359e700 1 -- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96ac0a1520 msgr2=0x7f96ac0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.913+0000 7f96c359e700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96ac0a1520 0x7f96ac0a39e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f96b8012a00 tx=0x7f96b8009ba0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.913+0000 7f96c359e700 1 -- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4106fd0 msgr2=0x7f96c4100260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.913+0000 7f96c359e700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4106fd0 0x7f96c4100260 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f96bc007ee0 tx=0x7f96bc00d3b0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.914+0000 7f96c359e700 1 -- 172.21.15.12:0/133331797 shutdown_connections 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.914+0000 7f96c359e700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96ac0a1520 0x7f96ac0a39e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.914+0000 7f96c359e700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96c4101d70 0x7f96c4101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.914+0000 7f96c359e700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96c4106fd0 0x7f96c4100260 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.914+0000 7f96c359e700 1 --2- 172.21.15.12:0/133331797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96c41046a0 0x7f96c40ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.914+0000 7f96c359e700 1 -- 172.21.15.12:0/133331797 >> 172.21.15.12:0/133331797 conn(0x7f96c40fb740 msgr2=0x7f96c41026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.914+0000 7f96c359e700 1 -- 172.21.15.12:0/133331797 shutdown_connections 2023-12-11T20:26:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:52.914+0000 7f96c359e700 1 -- 172.21.15.12:0/133331797 wait complete. 2023-12-11T20:26:52.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:26:53.008 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:52 smithi012 ceph-mon[128787]: pgmap v703: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.159+0000 7f31cbdff700 1 -- 172.21.15.12:0/520261775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41048c0 msgr2=0x7f31c4104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.159+0000 7f31cbdff700 1 --2- 172.21.15.12:0/520261775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41048c0 0x7f31c4104d20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f31b40099c0 tx=0x7f31b4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.159+0000 7f31cbdff700 1 -- 172.21.15.12:0/520261775 shutdown_connections 2023-12-11T20:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.159+0000 7f31cbdff700 1 --2- 172.21.15.12:0/520261775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31c41036d0 0x7f31c4103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.159+0000 7f31cbdff700 1 --2- 172.21.15.12:0/520261775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31c4105260 0x7f31c410bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.159+0000 7f31cbdff700 1 --2- 172.21.15.12:0/520261775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41048c0 0x7f31c4104d20 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.159+0000 7f31cbdff700 1 -- 172.21.15.12:0/520261775 >> 172.21.15.12:0/520261775 conn(0x7f31c40fec80 msgr2=0x7f31c41010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.159+0000 7f31cbdff700 1 -- 172.21.15.12:0/520261775 shutdown_connections 2023-12-11T20:26:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.160+0000 7f31cbdff700 1 -- 172.21.15.12:0/520261775 wait complete. 2023-12-11T20:26:53.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31cbdff700 1 Processor -- start 2023-12-11T20:26:53.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31cbdff700 1 -- start start 2023-12-11T20:26:53.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31cbdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41036d0 0x7f31c4199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31cbdff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31c41048c0 0x7f31c4199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31cbdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31c4105260 0x7f31c41a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31cbdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c41a1070 con 0x7f31c41036d0 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31cbdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c41a11b0 con 0x7f31c4105260 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31cbdff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c41a1340 con 0x7f31c41048c0 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31c9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41036d0 0x7f31c4199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31c9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41036d0 0x7f31c4199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40318/0 (socket says 172.21.15.12:40318) 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.161+0000 7f31c9b9b700 1 -- 172.21.15.12:0/2287358554 learned_addr learned my addr 172.21.15.12:0/2287358554 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31ca39c700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31c4105260 0x7f31c41a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31c939a700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31c41048c0 0x7f31c4199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31c9b9b700 1 -- 172.21.15.12:0/2287358554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31c41048c0 msgr2=0x7f31c4199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31c9b9b700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31c41048c0 0x7f31c4199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31c9b9b700 1 -- 172.21.15.12:0/2287358554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31c4105260 msgr2=0x7f31c41a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31c9b9b700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31c4105260 0x7f31c41a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31c9b9b700 1 -- 172.21.15.12:0/2287358554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0009520 con 0x7f31c41036d0 2023-12-11T20:26:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31c9b9b700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41036d0 0x7f31c4199540 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f31c000ea50 tx=0x7f31c000ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.162+0000 7f31baffd700 1 -- 172.21.15.12:0/2287358554 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c000cc90 con 0x7f31c41036d0 2023-12-11T20:26:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.163+0000 7f31baffd700 1 -- 172.21.15.12:0/2287358554 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31c000cdf0 con 0x7f31c41036d0 2023-12-11T20:26:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.163+0000 7f31cbdff700 1 -- 172.21.15.12:0/2287358554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b40095f0 con 0x7f31c41036d0 2023-12-11T20:26:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.163+0000 7f31baffd700 1 -- 172.21.15.12:0/2287358554 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0018680 con 0x7f31c41036d0 2023-12-11T20:26:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.163+0000 7f31cbdff700 1 -- 172.21.15.12:0/2287358554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c41a19a0 con 0x7f31c41036d0 2023-12-11T20:26:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.167+0000 7f31baffd700 1 -- 172.21.15.12:0/2287358554 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f31c0010430 con 0x7f31c41036d0 2023-12-11T20:26:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.168+0000 7f31df7aab80 1 Processor -- start 2023-12-11T20:26:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.168+0000 7f31df7aab80 1 -- start start 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb2727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb273640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb2740a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31df7aab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb1cdb50 con 0x5601bb272d30 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31df7aab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb1cb470 con 0x5601bb273c20 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31df7aab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb1c6d60 con 0x5601bb2723d0 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31c9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb273640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31c9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb273640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40326/0 (socket says 172.21.15.12:40326) 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31c9b9b700 1 -- 172.21.15.12:0/911204019 learned_addr learned my addr 172.21.15.12:0/911204019 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31ca39c700 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb2727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.169+0000 7f31c939a700 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb2740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31ca39c700 1 -- 172.21.15.12:0/911204019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 msgr2=0x5601bb2740a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31ca39c700 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb2740a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31ca39c700 1 -- 172.21.15.12:0/911204019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 msgr2=0x5601bb273640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31ca39c700 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb273640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31ca39c700 1 -- 172.21.15.12:0/911204019 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601bb043630 con 0x5601bb2723d0 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31c939a700 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb2740a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31baffd700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31b00a1480 0x7f31b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31baffd700 1 -- 172.21.15.12:0/2287358554 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31c0014070 con 0x7f31c41036d0 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31ca39c700 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb2727f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009310 tx=0x7f31bc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d6fee17e932d370 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31c9b9b700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31b00a1480 0x7f31b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31affff700 1 -- 172.21.15.12:0/911204019 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00e070 con 0x5601bb2723d0 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31affff700 1 -- 172.21.15.12:0/911204019 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31bc00f040 con 0x5601bb2723d0 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.170+0000 7f31affff700 1 -- 172.21.15.12:0/911204019 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0146d0 con 0x5601bb2723d0 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31df7aab80 1 -- 172.21.15.12:0/911204019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 msgr2=0x5601bb2727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31c9b9b700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31b00a1480 0x7f31b00a3940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f31c0005950 tx=0x7f31c00d0b50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31df7aab80 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb2727f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009310 tx=0x7f31bc009920 comp rx=0 tx=0).stop 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31df7aab80 1 -- 172.21.15.12:0/911204019 shutdown_connections 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31df7aab80 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb2740a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31df7aab80 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb2727f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31df7aab80 1 --2- 172.21.15.12:0/911204019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb273640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31df7aab80 1 -- 172.21.15.12:0/911204019 >> 172.21.15.12:0/911204019 conn(0x5601bb1a17e0 msgr2=0x5601bb26ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.171+0000 7f31df7aab80 1 -- 172.21.15.12:0/911204019 shutdown_connections 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.172+0000 7f31df7aab80 1 -- 172.21.15.12:0/911204019 wait complete. 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.172+0000 7f31df7aab80 1 -- start start 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.172+0000 7f31df7aab80 1 Processor -- start 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb2723d0 0x5601bb27c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb272d30 0x5601bb27c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb2836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31df7aab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb180560 con 0x5601bb273c20 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31df7aab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb180200 con 0x5601bb2723d0 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31df7aab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb045920 con 0x5601bb272d30 2023-12-11T20:26:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31df7aab80 10 client.0 _ll_register_callbacks cb 0x5601bb0aba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31ca39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb2836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31ca39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb2836c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40336/0 (socket says 172.21.15.12:40336) 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31ca39c700 1 -- 172.21.15.12:0/271851289 learned_addr learned my addr 172.21.15.12:0/271851289 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.173+0000 7f31c939a700 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb272d30 0x5601bb27c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ca39c700 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb2723d0 0x5601bb27c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ca39c700 1 -- 172.21.15.12:0/271851289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb272d30 msgr2=0x5601bb27c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ca39c700 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb272d30 0x5601bb27c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ca39c700 1 -- 172.21.15.12:0/271851289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb2723d0 msgr2=0x5601bb27c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ca39c700 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb2723d0 0x5601bb27c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ca39c700 1 -- 172.21.15.12:0/271851289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc009050 con 0x5601bb273c20 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31c939a700 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb272d30 0x5601bb27c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ca39c700 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb2836c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f31bc005bb0 tx=0x7f31bc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c9ee0fe33479be server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ad7fa700 1 -- 172.21.15.12:0/271851289 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00e040 con 0x5601bb273c20 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31df7aab80 1 -- 172.21.15.12:0/271851289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601bb265b40 con 0x5601bb273c20 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.174+0000 7f31ad7fa700 1 -- 172.21.15.12:0/271851289 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31bc014e80 con 0x5601bb273c20 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31ad7fa700 1 -- 172.21.15.12:0/271851289 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31bc015850 con 0x5601bb273c20 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31df7aab80 10 client.18657 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31df7aab80 1 -- 172.21.15.12:0/271851289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5601bafefde0 con 0x5601bb273c20 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31ad7fa700 1 -- 172.21.15.12:0/271851289 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5601bb265b40 con 0x5601bb273c20 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31ad7fa700 1 -- 172.21.15.12:0/271851289 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f31bc01eca0 con 0x5601bb273c20 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31df7aab80 10 client.18657 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31df7aab80 10 client.18657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31df7aab80 20 client.18657 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31df7aab80 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5601bb287e10 0x5601bb28a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31df7aab80 4 client.18657 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.175+0000 7f31df7aab80 1 -- 172.21.15.12:0/271851289 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601bb241f40 con 0x5601bb287e10 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.176+0000 7f31c939a700 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5601bb287e10 0x5601bb28a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.176+0000 7f31ad7fa700 10 client.18657 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.176+0000 7f31c939a700 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5601bb287e10 0x5601bb28a230 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2384cd5bb979d6ae server_cookie=b0a2ff90f7e7d54a in_seq=0 out_seq=0 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31ad7fa700 1 -- 172.21.15.12:0/271851289 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5601bb241f40 con 0x5601bb287e10 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31ad7fa700 10 client.18657 handle_command_reply: tid=0 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 client.18657 shutdown 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 -- 172.21.15.12:0/271851289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 msgr2=0x5601bb2836c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb2836c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f31bc005bb0 tx=0x7f31bc005b00 comp rx=0 tx=0).stop 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 -- 172.21.15.12:0/271851289 shutdown_connections 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5601bb287e10 0x5601bb28a230 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb2723d0 0x5601bb27c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb2836c0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 --2- 172.21.15.12:0/271851289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb272d30 0x5601bb27c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31df7aab80 1 -- 172.21.15.12:0/271851289 >> 172.21.15.12:0/271851289 conn(0x5601bb1a17e0 msgr2=0x5601bb26da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.177+0000 7f31ad7fa700 0 client.18657 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:53.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.178+0000 7f31df7aab80 1 -- 172.21.15.12:0/271851289 shutdown_connections 2023-12-11T20:26:53.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.178+0000 7f31df7aab80 1 -- 172.21.15.12:0/271851289 wait complete. 2023-12-11T20:26:53.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.178+0000 7f31df7aab80 20 client.18657 trim_cache size 0 max 16384 2023-12-11T20:26:53.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.197+0000 7f31df7aab80 1 Processor -- start 2023-12-11T20:26:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.197+0000 7f31df7aab80 1 -- start start 2023-12-11T20:26:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.197+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb27a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.197+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb283680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb28eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31df7aab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb2744b0 con 0x5601bb272d30 2023-12-11T20:26:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31df7aab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb269b50 con 0x5601bb273c20 2023-12-11T20:26:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31df7aab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb273110 con 0x5601bb2723d0 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31c939a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb283680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31c939a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb283680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40352/0 (socket says 172.21.15.12:40352) 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31c939a700 1 -- 172.21.15.12:0/553893737 learned_addr learned my addr 172.21.15.12:0/553893737 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31ca39c700 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb28eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31ca39c700 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb27a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31c939a700 1 -- 172.21.15.12:0/553893737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 msgr2=0x5601bb27a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31c939a700 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb27a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31c939a700 1 -- 172.21.15.12:0/553893737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 msgr2=0x5601bb28eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31c939a700 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb28eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31c939a700 1 -- 172.21.15.12:0/553893737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601bafd8c60 con 0x5601bb272d30 2023-12-11T20:26:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.198+0000 7f31ca39c700 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb28eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.199+0000 7f31c939a700 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb283680 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f31b4015000 tx=0x7f31b401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d74a9bef6ab562 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.199+0000 7f31b8bff700 1 -- 172.21.15.12:0/553893737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b401d040 con 0x5601bb272d30 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.199+0000 7f31b8bff700 1 -- 172.21.15.12:0/553893737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31b402b070 con 0x5601bb272d30 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.199+0000 7f31b8bff700 1 -- 172.21.15.12:0/553893737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4003bf0 con 0x5601bb272d30 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 -- 172.21.15.12:0/553893737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 msgr2=0x5601bb283680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb283680 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f31b4015000 tx=0x7f31b401a040 comp rx=0 tx=0).stop 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 -- 172.21.15.12:0/553893737 shutdown_connections 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb273c20 0x5601bb28eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb27a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 --2- 172.21.15.12:0/553893737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb272d30 0x5601bb283680 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 -- 172.21.15.12:0/553893737 >> 172.21.15.12:0/553893737 conn(0x5601bb1a17e0 msgr2=0x5601bb27b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 -- 172.21.15.12:0/553893737 shutdown_connections 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 -- 172.21.15.12:0/553893737 wait complete. 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.200+0000 7f31df7aab80 1 -- start start 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.201+0000 7f31df7aab80 1 Processor -- start 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.201+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb27f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.201+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb272d30 0x5601bb27f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.201+0000 7f31df7aab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb282980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.201+0000 7f31df7aab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb282ec0 con 0x5601bb273c20 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.201+0000 7f31df7aab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb283030 con 0x5601bb272d30 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.201+0000 7f31df7aab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb2831f0 con 0x5601bb2723d0 2023-12-11T20:26:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.201+0000 7f31df7aab80 10 client.0 _ll_register_callbacks cb 0x5601bb0aba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31ca39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb282980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb272d30 0x5601bb27f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb272d30 0x5601bb27f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:57400/0 (socket says 172.21.15.12:57400) 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 -- 172.21.15.12:0/1829850804 learned_addr learned my addr 172.21.15.12:0/1829850804 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31ca39c700 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb27f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 -- 172.21.15.12:0/1829850804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 msgr2=0x5601bb27f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb27f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 -- 172.21.15.12:0/1829850804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 msgr2=0x5601bb282980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb282980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 -- 172.21.15.12:0/1829850804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c410c460 con 0x5601bb272d30 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31c939a700 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb272d30 0x5601bb27f960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009d10 tx=0x7f31b400bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2bc8a4b6547c36 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.202+0000 7f31ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.203+0000 7f31ad7fa700 1 -- 172.21.15.12:0/1829850804 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b401d040 con 0x5601bb272d30 2023-12-11T20:26:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.203+0000 7f31df7aab80 1 -- 172.21.15.12:0/1829850804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31bc00f040 con 0x5601bb272d30 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.203+0000 7f31ad7fa700 1 -- 172.21.15.12:0/1829850804 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31b4003b70 con 0x5601bb272d30 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.203+0000 7f31ad7fa700 1 -- 172.21.15.12:0/1829850804 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31b4003d50 con 0x5601bb272d30 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.203+0000 7f31df7aab80 10 client.28256 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.203+0000 7f31df7aab80 1 -- 172.21.15.12:0/1829850804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5601bb016250 con 0x5601bb272d30 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31ad7fa700 1 -- 172.21.15.12:0/1829850804 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31bc00f040 con 0x5601bb272d30 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31ad7fa700 1 -- 172.21.15.12:0/1829850804 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f31b4027410 con 0x5601bb272d30 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31df7aab80 10 client.28256 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31df7aab80 10 client.28256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31df7aab80 20 client.28256 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31df7aab80 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5601bb2ded80 0x5601bb2e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31df7aab80 4 client.28256 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:26:53.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31df7aab80 1 -- 172.21.15.12:0/1829850804 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5601bb18cfd0 con 0x5601bb2ded80 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.204+0000 7f31ca39c700 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5601bb2ded80 0x5601bb2e11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31ca39c700 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5601bb2ded80 0x5601bb2e11a0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e7770c3ad3ba808 server_cookie=16dd788cf0b558dd in_seq=0 out_seq=0 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31ad7fa700 10 client.28256 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31ad7fa700 1 -- 172.21.15.12:0/1829850804 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5601bb18cfd0 con 0x5601bb2ded80 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31ad7fa700 10 client.28256 handle_command_reply: tid=0 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 client.28256 shutdown 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 -- 172.21.15.12:0/1829850804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb272d30 msgr2=0x5601bb27f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb272d30 0x5601bb27f960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009d10 tx=0x7f31b400bd50 comp rx=0 tx=0).stop 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 -- 172.21.15.12:0/1829850804 shutdown_connections 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5601bb2ded80 0x5601bb2e11a0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601bb273c20 0x5601bb282980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5601bb2723d0 0x5601bb27f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31ad7fa700 0 client.28256 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:53.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 --2- 172.21.15.12:0/1829850804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5601bb272d30 0x5601bb27f960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.205+0000 7f31df7aab80 1 -- 172.21.15.12:0/1829850804 >> 172.21.15.12:0/1829850804 conn(0x5601bb1a17e0 msgr2=0x5601bb26e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.206+0000 7f31df7aab80 1 -- 172.21.15.12:0/1829850804 shutdown_connections 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.206+0000 7f31df7aab80 1 -- 172.21.15.12:0/1829850804 wait complete. 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.206+0000 7f31df7aab80 20 client.28256 trim_cache size 0 max 16384 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stdout: "0686d8d9-76a1-4bd1-b636-3e256064dbbe": { 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "0686d8d9-76a1-4bd1-b636-3e256064dbbe", 2023-12-11T20:26:53.209 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:26:53.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:26:53.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:26:53.210 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:26:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.206+0000 7f31cbdff700 1 -- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31b00a1480 msgr2=0x7f31b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.206+0000 7f31cbdff700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31b00a1480 0x7f31b00a3940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f31c0005950 tx=0x7f31c00d0b50 comp rx=0 tx=0).stop 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.206+0000 7f31cbdff700 1 -- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41036d0 msgr2=0x7f31c4199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.206+0000 7f31cbdff700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41036d0 0x7f31c4199540 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f31c000ea50 tx=0x7f31c000ee10 comp rx=0 tx=0).stop 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.207+0000 7f31cbdff700 1 -- 172.21.15.12:0/2287358554 shutdown_connections 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.207+0000 7f31cbdff700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31b00a1480 0x7f31b00a3940 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.207+0000 7f31cbdff700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31c4105260 0x7f31c41a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.207+0000 7f31cbdff700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c41036d0 0x7f31c4199540 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.207+0000 7f31cbdff700 1 --2- 172.21.15.12:0/2287358554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31c41048c0 0x7f31c4199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.207+0000 7f31cbdff700 1 -- 172.21.15.12:0/2287358554 >> 172.21.15.12:0/2287358554 conn(0x7f31c40fec80 msgr2=0x7f31c4107c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.207+0000 7f31cbdff700 1 -- 172.21.15.12:0/2287358554 shutdown_connections 2023-12-11T20:26:53.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:26:53.207+0000 7f31cbdff700 1 -- 172.21.15.12:0/2287358554 wait complete. 2023-12-11T20:26:53.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:52 smithi032 ceph-mon[132488]: pgmap v703: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:53.213 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:26:52 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:26:52.923+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v210>,<0x10000000003/client.0 v212>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v229>,<0x10000000001/sv_0 v253>,<0x10000000000/_nogroup v237>,<0x1/volumes v229>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:26:53.225 INFO:tasks.cephfs.filesystem:scrub status for tag:0686d8d9-76a1-4bd1-b636-3e256064dbbe - {'path': '/', 'tag': '0686d8d9-76a1-4bd1-b636-3e256064dbbe', 'options': 'recursive,force'} 2023-12-11T20:26:53.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:52 smithi039 ceph-mon[102205]: pgmap v703: 97 pgs: 97 active+clean; 8.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:26:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:26:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:54.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:26:54.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:26:54.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:53 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:53 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:53 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:26:55.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:54 smithi012 ceph-mon[128787]: pgmap v704: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:26:55.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:54 smithi032 ceph-mon[132488]: pgmap v704: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:26:55.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:54 smithi039 ceph-mon[102205]: pgmap v704: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 15 op/s 2023-12-11T20:26:57.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:56 smithi012 ceph-mon[128787]: pgmap v705: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:26:57.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:56 smithi032 ceph-mon[132488]: pgmap v705: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:26:57.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:56 smithi039 ceph-mon[102205]: pgmap v705: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 22 op/s 2023-12-11T20:26:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.956+0000 7fe46b19d700 1 -- 172.21.15.12:0/2676489203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 msgr2=0x7fe464074450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.956+0000 7fe46b19d700 1 --2- 172.21.15.12:0/2676489203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 0x7fe464074450 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fe454009990 tx=0x7fe454009ca0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.957+0000 7fe46b19d700 1 -- 172.21.15.12:0/2676489203 shutdown_connections 2023-12-11T20:26:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.957+0000 7fe46b19d700 1 --2- 172.21.15.12:0/2676489203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4640755b0 0x7fe464073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.957+0000 7fe46b19d700 1 --2- 172.21.15.12:0/2676489203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4641091e0 0x7fe46410b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.957+0000 7fe46b19d700 1 --2- 172.21.15.12:0/2676489203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 0x7fe464074450 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.957+0000 7fe46b19d700 1 -- 172.21.15.12:0/2676489203 >> 172.21.15.12:0/2676489203 conn(0x7fe4640fc8a0 msgr2=0x7fe4640fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.957+0000 7fe46b19d700 1 -- 172.21.15.12:0/2676489203 shutdown_connections 2023-12-11T20:26:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.957+0000 7fe46b19d700 1 -- 172.21.15.12:0/2676489203 wait complete. 2023-12-11T20:26:58.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.958+0000 7fe46b19d700 1 Processor -- start 2023-12-11T20:26:58.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.958+0000 7fe46b19d700 1 -- start start 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.958+0000 7fe46b19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 0x7fe464199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.958+0000 7fe46b19d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4640755b0 0x7fe464199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.958+0000 7fe46b19d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4641091e0 0x7fe4641a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.958+0000 7fe46b19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641a0e80 con 0x7fe464073fd0 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46b19d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641a0fc0 con 0x7fe4640755b0 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46b19d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641a1150 con 0x7fe4641091e0 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 0x7fe464199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 0x7fe464199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34976/0 (socket says 172.21.15.12:34976) 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a19b700 1 -- 172.21.15.12:0/537435405 learned_addr learned my addr 172.21.15.12:0/537435405 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46999a700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4640755b0 0x7fe464199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a99c700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4641091e0 0x7fe4641a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a19b700 1 -- 172.21.15.12:0/537435405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4641091e0 msgr2=0x7fe4641a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a19b700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4641091e0 0x7fe4641a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a19b700 1 -- 172.21.15.12:0/537435405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4640755b0 msgr2=0x7fe464199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a19b700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4640755b0 0x7fe464199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46a19b700 1 -- 172.21.15.12:0/537435405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4540095f0 con 0x7fe464073fd0 2023-12-11T20:26:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.959+0000 7fe46999a700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4640755b0 0x7fe464199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.960+0000 7fe46a19b700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 0x7fe464199350 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe46000e9a0 tx=0x7fe46000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.960+0000 7fe45b7fe700 1 -- 172.21.15.12:0/537435405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460009790 con 0x7fe464073fd0 2023-12-11T20:26:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.960+0000 7fe45b7fe700 1 -- 172.21.15.12:0/537435405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe460010430 con 0x7fe464073fd0 2023-12-11T20:26:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.960+0000 7fe46b19d700 1 -- 172.21.15.12:0/537435405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4641a1430 con 0x7fe464073fd0 2023-12-11T20:26:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.960+0000 7fe45b7fe700 1 -- 172.21.15.12:0/537435405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000cea0 con 0x7fe464073fd0 2023-12-11T20:26:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.960+0000 7fe46b19d700 1 -- 172.21.15.12:0/537435405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4641a1990 con 0x7fe464073fd0 2023-12-11T20:26:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.964+0000 7fe45b7fe700 1 -- 172.21.15.12:0/537435405 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe4600105a0 con 0x7fe464073fd0 2023-12-11T20:26:58.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.965+0000 7fe47fe22b80 1 Processor -- start 2023-12-11T20:26:58.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.965+0000 7fe47fe22b80 1 -- start start 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.965+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd11b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.965+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 0x55794cd16640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.965+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd18f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.965+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cc6caf0 con 0x55794cd11770 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.965+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cc6a410 con 0x55794cd16b80 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.965+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cc65d00 con 0x55794cd120d0 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd11b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd11b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34986/0 (socket says 172.21.15.12:34986) 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46a99c700 1 -- 172.21.15.12:0/35359670 learned_addr learned my addr 172.21.15.12:0/35359670 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46999a700 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd18f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe45b7fe700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4500a14f0 0x7fe4500a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46a19b700 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 0x55794cd16640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe45b7fe700 1 -- 172.21.15.12:0/537435405 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe460014070 con 0x7fe464073fd0 2023-12-11T20:26:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46999a700 1 -- 172.21.15.12:0/35359670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 msgr2=0x55794cd16640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46999a700 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 0x55794cd16640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46999a700 1 -- 172.21.15.12:0/35359670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 msgr2=0x55794cd11b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46999a700 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd11b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46999a700 1 -- 172.21.15.12:0/35359670 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55794cae25d0 con 0x55794cd16b80 2023-12-11T20:26:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.966+0000 7fe46a99c700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4500a14f0 0x7fe4500a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.967+0000 7fe46999a700 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd18f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe4540098e0 tx=0x7fe454005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b1238c6c652ee1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.967+0000 7fe458bfe700 1 -- 172.21.15.12:0/35359670 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45401d050 con 0x55794cd16b80 2023-12-11T20:26:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.967+0000 7fe458bfe700 1 -- 172.21.15.12:0/35359670 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe45401e040 con 0x55794cd16b80 2023-12-11T20:26:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.967+0000 7fe458bfe700 1 -- 172.21.15.12:0/35359670 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454005030 con 0x55794cd16b80 2023-12-11T20:26:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.967+0000 7fe46a99c700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4500a14f0 0x7fe4500a39b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00fb80 tx=0x7fe45c004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 -- 172.21.15.12:0/35359670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 msgr2=0x55794cd18f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd18f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe4540098e0 tx=0x7fe454005e80 comp rx=0 tx=0).stop 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 -- 172.21.15.12:0/35359670 shutdown_connections 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd18f90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd11b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/35359670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 0x55794cd16640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 -- 172.21.15.12:0/35359670 >> 172.21.15.12:0/35359670 conn(0x55794cc40780 msgr2=0x55794cd0db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 -- 172.21.15.12:0/35359670 shutdown_connections 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.968+0000 7fe47fe22b80 1 -- 172.21.15.12:0/35359670 wait complete. 2023-12-11T20:26:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.969+0000 7fe47fe22b80 1 -- start start 2023-12-11T20:26:58.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.969+0000 7fe47fe22b80 1 Processor -- start 2023-12-11T20:26:58.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.969+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd11770 0x55794cd1ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd120d0 0x55794cd1b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 0x55794cd223d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cc1f500 con 0x55794cd120d0 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cc1f1a0 con 0x55794cd11770 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cae48c0 con 0x55794cd16b80 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe47fe22b80 10 client.0 _ll_register_callbacks cb 0x55794cb4aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe46a19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd11770 0x55794cd1ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe46999a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd120d0 0x55794cd1b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe46a19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd11770 0x55794cd1ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:45672/0 (socket says 172.21.15.12:45672) 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe46a19b700 1 -- 172.21.15.12:0/1084699445 learned_addr learned my addr 172.21.15.12:0/1084699445 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.970+0000 7fe46a99c700 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 0x55794cd223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe46a19b700 1 -- 172.21.15.12:0/1084699445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 msgr2=0x55794cd223d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe46a19b700 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 0x55794cd223d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe46a19b700 1 -- 172.21.15.12:0/1084699445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd120d0 msgr2=0x55794cd1b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe46a19b700 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd120d0 0x55794cd1b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe46a19b700 1 -- 172.21.15.12:0/1084699445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46410c270 con 0x55794cd11770 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe46999a700 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd120d0 0x55794cd1b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe46a19b700 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd11770 0x55794cd1ae50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe460096bb0 tx=0x7fe460069640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87e46f812d199539 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe44dffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe44dffb700 1 -- 172.21.15.12:0/1084699445 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460010880 con 0x55794cd11770 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe44dffb700 1 -- 172.21.15.12:0/1084699445 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe46006b040 con 0x55794cd11770 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.971+0000 7fe47fe22b80 1 -- 172.21.15.12:0/1084699445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55794cd04730 con 0x55794cd11770 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe44dffb700 1 -- 172.21.15.12:0/1084699445 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe460065a00 con 0x55794cd11770 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe47fe22b80 10 client.28268 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe47fe22b80 1 -- 172.21.15.12:0/1084699445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55794ca8ed80 con 0x55794cd11770 2023-12-11T20:26:58.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe44dffb700 1 -- 172.21.15.12:0/1084699445 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55794cd04730 con 0x55794cd11770 2023-12-11T20:26:58.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe44dffb700 1 -- 172.21.15.12:0/1084699445 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe460067d20 con 0x55794cd11770 2023-12-11T20:26:58.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe47fe22b80 10 client.28268 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:58.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe47fe22b80 10 client.28268 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:58.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe47fe22b80 20 client.28268 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:58.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55794cd26bc0 0x55794cd28fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe47fe22b80 4 client.28268 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.972+0000 7fe47fe22b80 1 -- 172.21.15.12:0/1084699445 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55794cce0ee0 con 0x55794cd26bc0 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.973+0000 7fe46999a700 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55794cd26bc0 0x55794cd28fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.974+0000 7fe46999a700 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55794cd26bc0 0x55794cd28fe0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a68b4f6cedec7488 server_cookie=7d27abdafa6a86ed in_seq=0 out_seq=0 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.974+0000 7fe44dffb700 10 client.28268 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.974+0000 7fe44dffb700 1 -- 172.21.15.12:0/1084699445 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55794cce0ee0 con 0x55794cd26bc0 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.974+0000 7fe44dffb700 10 client.28268 handle_command_reply: tid=0 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.974+0000 7fe47fe22b80 1 client.28268 shutdown 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 -- 172.21.15.12:0/1084699445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd11770 msgr2=0x55794cd1ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd11770 0x55794cd1ae50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe460096bb0 tx=0x7fe460069640 comp rx=0 tx=0).stop 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 -- 172.21.15.12:0/1084699445 shutdown_connections 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55794cd26bc0 0x55794cd28fe0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd11770 0x55794cd1ae50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 0x55794cd223d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe44dffb700 0 client.28268 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:58.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/1084699445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd120d0 0x55794cd1b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 -- 172.21.15.12:0/1084699445 >> 172.21.15.12:0/1084699445 conn(0x55794cc40780 msgr2=0x55794cd0e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 -- 172.21.15.12:0/1084699445 shutdown_connections 2023-12-11T20:26:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 1 -- 172.21.15.12:0/1084699445 wait complete. 2023-12-11T20:26:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.975+0000 7fe47fe22b80 20 client.28268 trim_cache size 0 max 16384 2023-12-11T20:26:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.996+0000 7fe47fe22b80 1 Processor -- start 2023-12-11T20:26:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.996+0000 7fe47fe22b80 1 -- start start 2023-12-11T20:26:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.996+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd0c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.996+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd120d0 0x55794cd22390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.996+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 0x55794cd06240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.996+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cd1be80 con 0x55794cd11770 2023-12-11T20:26:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.996+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cd13740 con 0x55794cd120d0 2023-12-11T20:26:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cd269b0 con 0x55794cd16b80 2023-12-11T20:26:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd0c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd0c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35012/0 (socket says 172.21.15.12:35012) 2023-12-11T20:26:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a19b700 1 -- 172.21.15.12:0/622596082 learned_addr learned my addr 172.21.15.12:0/622596082 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a99c700 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 0x55794cd06240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46999a700 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd120d0 0x55794cd22390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a19b700 1 -- 172.21.15.12:0/622596082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 msgr2=0x55794cd06240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a19b700 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 0x55794cd06240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a19b700 1 -- 172.21.15.12:0/622596082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd120d0 msgr2=0x55794cd22390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a19b700 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd120d0 0x55794cd22390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46a19b700 1 -- 172.21.15.12:0/622596082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55794ca77c00 con 0x55794cd11770 2023-12-11T20:26:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.997+0000 7fe46999a700 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd120d0 0x55794cd22390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.998+0000 7fe46a19b700 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd0c590 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe46000c2d0 tx=0x7fe46009a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4a33deb20095ae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.998+0000 7fe4593ff700 1 -- 172.21.15.12:0/622596082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460010880 con 0x55794cd11770 2023-12-11T20:26:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.998+0000 7fe4593ff700 1 -- 172.21.15.12:0/622596082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe46009a840 con 0x55794cd11770 2023-12-11T20:26:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.998+0000 7fe4593ff700 1 -- 172.21.15.12:0/622596082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460096190 con 0x55794cd11770 2023-12-11T20:26:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 -- 172.21.15.12:0/622596082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 msgr2=0x55794cd0c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd0c590 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe46000c2d0 tx=0x7fe46009a760 comp rx=0 tx=0).stop 2023-12-11T20:26:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 -- 172.21.15.12:0/622596082 shutdown_connections 2023-12-11T20:26:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd16b80 0x55794cd06240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd0c590 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/622596082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd120d0 0x55794cd22390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 -- 172.21.15.12:0/622596082 >> 172.21.15.12:0/622596082 conn(0x55794cc40780 msgr2=0x55794cd18f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 -- 172.21.15.12:0/622596082 shutdown_connections 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 -- 172.21.15.12:0/622596082 wait complete. 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:58.999+0000 7fe47fe22b80 1 -- start start 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.000+0000 7fe47fe22b80 1 Processor -- start 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.000+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd1fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.000+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 0x55794cd203d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.000+0000 7fe47fe22b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.000+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cd217e0 con 0x55794cd11770 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.000+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cd21950 con 0x55794cd16b80 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.000+0000 7fe47fe22b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55794cd21b10 con 0x55794cd120d0 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.000+0000 7fe47fe22b80 10 client.0 _ll_register_callbacks cb 0x55794cb4aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:26:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd1fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd1fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35014/0 (socket says 172.21.15.12:35014) 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 -- 172.21.15.12:0/932387905 learned_addr learned my addr 172.21.15.12:0/932387905 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a99c700 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46999a700 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 0x55794cd203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 -- 172.21.15.12:0/932387905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 msgr2=0x55794cd203d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 0x55794cd203d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 -- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 msgr2=0x55794cd212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 -- 172.21.15.12:0/932387905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55794ca8ed80 con 0x55794cd11770 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a99c700 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe46a19b700 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd1fe90 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe460009230 tx=0x7fe460096480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355b637530515f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe44dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.001+0000 7fe44dffb700 1 -- 172.21.15.12:0/932387905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600a2040 con 0x55794cd11770 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe44dffb700 1 -- 172.21.15.12:0/932387905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe46006b070 con 0x55794cd11770 2023-12-11T20:26:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 1 -- 172.21.15.12:0/932387905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe45401e040 con 0x55794cd11770 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe44dffb700 1 -- 172.21.15.12:0/932387905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe460010880 con 0x55794cd11770 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 10 client.18681 fetch_fsmap learned FSMap version 26 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 1 -- 172.21.15.12:0/932387905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55794cab51f0 con 0x55794cd11770 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe44dffb700 1 -- 172.21.15.12:0/932387905 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4600b6080 con 0x55794cd11770 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe44dffb700 1 -- 172.21.15.12:0/932387905 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe460005040 con 0x55794cd11770 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 10 client.18681 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 10 client.18681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 20 client.18681 populate_metadata read hostname 'smithi012' 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55794cd7d610 0x55794cd7fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 4 client.18681 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:26:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.002+0000 7fe47fe22b80 1 -- 172.21.15.12:0/932387905 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55794cc2bf70 con 0x55794cd7d610 2023-12-11T20:26:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.003+0000 7fe46999a700 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55794cd7d610 0x55794cd7fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:26:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.003+0000 7fe46999a700 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55794cd7d610 0x55794cd7fa30 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed14ba68a3652107 server_cookie=8801595d0120c2ef in_seq=0 out_seq=0 2023-12-11T20:26:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.003+0000 7fe44dffb700 10 client.18681 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.013+0000 7fe44dffb700 1 -- 172.21.15.12:0/932387905 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55794cc2bf70 con 0x55794cd7d610 2023-12-11T20:26:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe44dffb700 10 client.18681 handle_command_reply: tid=0 2023-12-11T20:26:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 client.18681 shutdown 2023-12-11T20:26:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 -- 172.21.15.12:0/932387905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 msgr2=0x55794cd1fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd1fe90 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe460009230 tx=0x7fe460096480 comp rx=0 tx=0).stop 2023-12-11T20:26:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 -- 172.21.15.12:0/932387905 shutdown_connections 2023-12-11T20:26:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55794cd7d610 0x55794cd7fa30 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55794cd16b80 0x55794cd212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55794cd11770 0x55794cd1fe90 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 --2- 172.21.15.12:0/932387905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55794cd120d0 0x55794cd203d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe44dffb700 0 client.18681 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 -- 172.21.15.12:0/932387905 >> 172.21.15.12:0/932387905 conn(0x55794cc40780 msgr2=0x55794cd1a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 -- 172.21.15.12:0/932387905 shutdown_connections 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 1 -- 172.21.15.12:0/932387905 wait complete. 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.014+0000 7fe47fe22b80 20 client.18681 trim_cache size 0 max 16384 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:26:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:26:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:26:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:26:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 -- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4500a14f0 msgr2=0x7fe4500a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4500a14f0 0x7fe4500a39b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00fb80 tx=0x7fe45c004b40 comp rx=0 tx=0).stop 2023-12-11T20:26:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 -- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 msgr2=0x7fe464199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 0x7fe464199350 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe46000e9a0 tx=0x7fe46000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 -- 172.21.15.12:0/537435405 shutdown_connections 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe4500a14f0 0x7fe4500a39b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4641091e0 0x7fe4641a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe464073fd0 0x7fe464199350 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 --2- 172.21.15.12:0/537435405 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4640755b0 0x7fe464199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 -- 172.21.15.12:0/537435405 >> 172.21.15.12:0/537435405 conn(0x7fe4640fc8a0 msgr2=0x7fe464105130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 -- 172.21.15.12:0/537435405 shutdown_connections 2023-12-11T20:26:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:26:59.015+0000 7fe46b19d700 1 -- 172.21.15.12:0/537435405 wait complete. 2023-12-11T20:26:59.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:26:58 smithi012 ceph-mon[128787]: pgmap v706: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:26:59.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:26:58 smithi032 ceph-mon[132488]: pgmap v706: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:26:59.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:26:58 smithi039 ceph-mon[102205]: pgmap v706: 97 pgs: 97 active+clean; 8.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:27:01.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:00 smithi032 ceph-mon[132488]: pgmap v707: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:27:01.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:00 smithi039 ceph-mon[102205]: pgmap v707: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:27:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:00 smithi012 ceph-mon[128787]: pgmap v707: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:27:03.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:02 smithi032 ceph-mon[132488]: pgmap v708: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 31 op/s 2023-12-11T20:27:03.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:02 smithi039 ceph-mon[102205]: pgmap v708: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 31 op/s 2023-12-11T20:27:03.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:02 smithi012 ceph-mon[128787]: pgmap v708: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 31 op/s 2023-12-11T20:27:05.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:04 smithi032 ceph-mon[132488]: pgmap v709: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 32 op/s 2023-12-11T20:27:05.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:04 smithi039 ceph-mon[102205]: pgmap v709: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 32 op/s 2023-12-11T20:27:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:04 smithi012 ceph-mon[128787]: pgmap v709: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 32 op/s 2023-12-11T20:27:07.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:06 smithi032 ceph-mon[132488]: pgmap v710: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:27:07.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:06 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:27:07.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:06 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:27:07.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:06 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:27:07.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:06 smithi039 ceph-mon[102205]: pgmap v710: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:27:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:06 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:27:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:06 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:27:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:06 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:27:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:06 smithi012 ceph-mon[128787]: pgmap v710: 97 pgs: 97 active+clean; 8.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:27:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:06 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:27:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:06 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:27:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:06 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:27:09.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:08 smithi032 ceph-mon[132488]: pgmap v711: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 26 op/s 2023-12-11T20:27:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:08 smithi039 ceph-mon[102205]: pgmap v711: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 26 op/s 2023-12-11T20:27:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:08 smithi012 ceph-mon[128787]: pgmap v711: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 26 op/s 2023-12-11T20:27:11.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:10 smithi032 ceph-mon[132488]: pgmap v712: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:27:11.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:10 smithi039 ceph-mon[102205]: pgmap v712: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:27:11.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:10 smithi012 ceph-mon[128787]: pgmap v712: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:27:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 -- 172.21.15.12:0/4169697279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8103060 msgr2=0x7f77c8109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/4169697279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8103060 0x7f77c8109910 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f77c000b0d0 tx=0x7f77c000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 -- 172.21.15.12:0/4169697279 shutdown_connections 2023-12-11T20:27:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/4169697279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c81014d0 0x7f77c81018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/4169697279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c8103060 0x7f77c8109910 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/4169697279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c81026c0 0x7f77c8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 -- 172.21.15.12:0/4169697279 >> 172.21.15.12:0/4169697279 conn(0x7f77c80fca60 msgr2=0x7f77c80fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 -- 172.21.15.12:0/4169697279 shutdown_connections 2023-12-11T20:27:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.201+0000 7f77cd1ff700 1 -- 172.21.15.12:0/4169697279 wait complete. 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.202+0000 7f77cd1ff700 1 Processor -- start 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.202+0000 7f77cd1ff700 1 -- start start 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77cd1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81014d0 0x7f77c8199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77cd1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c81026c0 0x7f77c8199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77cd1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c8103060 0x7f77c81a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77cd1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81a1190 con 0x7f77c81014d0 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77cd1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81a12d0 con 0x7f77c81026c0 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77cd1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81a1460 con 0x7f77c8103060 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81014d0 0x7f77c8199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81014d0 0x7f77c8199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55012/0 (socket says 172.21.15.12:55012) 2023-12-11T20:27:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c6d9d700 1 -- 172.21.15.12:0/1953578287 learned_addr learned my addr 172.21.15.12:0/1953578287 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c659c700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c81026c0 0x7f77c8199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c759e700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c8103060 0x7f77c81a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c6d9d700 1 -- 172.21.15.12:0/1953578287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c8103060 msgr2=0x7f77c81a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c8103060 0x7f77c81a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c6d9d700 1 -- 172.21.15.12:0/1953578287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c81026c0 msgr2=0x7f77c8199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c81026c0 0x7f77c8199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.203+0000 7f77c6d9d700 1 -- 172.21.15.12:0/1953578287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009d00 con 0x7f77c81014d0 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.204+0000 7f77c759e700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c8103060 0x7f77c81a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.204+0000 7f77c659c700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c81026c0 0x7f77c8199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.204+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81014d0 0x7f77c8199700 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f77b800e970 tx=0x7f77b800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.204+0000 7f77affff700 1 -- 172.21.15.12:0/1953578287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8009790 con 0x7f77c81014d0 2023-12-11T20:27:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.204+0000 7f77affff700 1 -- 172.21.15.12:0/1953578287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77b80044b0 con 0x7f77c81014d0 2023-12-11T20:27:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.204+0000 7f77cd1ff700 1 -- 172.21.15.12:0/1953578287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c81a1740 con 0x7f77c81014d0 2023-12-11T20:27:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.204+0000 7f77affff700 1 -- 172.21.15.12:0/1953578287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8003dd0 con 0x7f77c81014d0 2023-12-11T20:27:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.204+0000 7f77cd1ff700 1 -- 172.21.15.12:0/1953578287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c81a1ca0 con 0x7f77c81014d0 2023-12-11T20:27:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.209+0000 7f77affff700 1 -- 172.21.15.12:0/1953578287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f77b8004000 con 0x7f77c81014d0 2023-12-11T20:27:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.209+0000 7f77e0ba1b80 1 Processor -- start 2023-12-11T20:27:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77e0ba1b80 1 -- start start 2023-12-11T20:27:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0bed0 0x556223d0c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0c830 0x556223d0d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d0dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223c67af0 con 0x556223d0d720 2023-12-11T20:27:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223c65410 con 0x556223d0c830 2023-12-11T20:27:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223c60d00 con 0x556223d0bed0 2023-12-11T20:27:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d0dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77c759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0bed0 0x556223d0c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77c759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0bed0 0x556223d0c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:59638/0 (socket says 172.21.15.12:59638) 2023-12-11T20:27:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77c759e700 1 -- 172.21.15.12:0/2514878040 learned_addr learned my addr 172.21.15.12:0/2514878040 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.210+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/2514878040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0c830 0x556223d0d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77c659c700 1 -- 172.21.15.12:0/2514878040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0bed0 msgr2=0x556223d0c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77c659c700 1 --2- 172.21.15.12:0/2514878040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0bed0 0x556223d0c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77c659c700 1 -- 172.21.15.12:0/2514878040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0c830 msgr2=0x556223d0d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77c659c700 1 --2- 172.21.15.12:0/2514878040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0c830 0x556223d0d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77affff700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a14f0 0x7f77b00a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77c659c700 1 -- 172.21.15.12:0/2514878040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556223add5d0 con 0x556223d0d720 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77affff700 1 -- 172.21.15.12:0/1953578287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f77b8014070 con 0x7f77c81014d0 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77c759e700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a14f0 0x7f77b00a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.211+0000 7f77c659c700 1 --2- 172.21.15.12:0/2514878040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d0dba0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009cc0 tx=0x7f77bc0113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a857bb5190c531 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.212+0000 7f77ad7fa700 1 -- 172.21.15.12:0/2514878040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc011c30 con 0x556223d0d720 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.212+0000 7f77ad7fa700 1 -- 172.21.15.12:0/2514878040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77bc011d90 con 0x556223d0d720 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.212+0000 7f77ad7fa700 1 -- 172.21.15.12:0/2514878040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00f6a0 con 0x556223d0d720 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.212+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2514878040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 msgr2=0x556223d0dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.212+0000 7f77c759e700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a14f0 0x7f77b00a39b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009850 tx=0x7f77c0009780 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.212+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/2514878040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d0dba0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009cc0 tx=0x7f77bc0113e0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.213+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2514878040 shutdown_connections 2023-12-11T20:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.213+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/2514878040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d0dba0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.213+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/2514878040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0bed0 0x556223d0c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.213+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/2514878040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0c830 0x556223d0d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.213+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2514878040 >> 172.21.15.12:0/2514878040 conn(0x556223c3b780 msgr2=0x556223d08880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.213+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2514878040 shutdown_connections 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.213+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2514878040 wait complete. 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.213+0000 7f77e0ba1b80 1 -- start start 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.214+0000 7f77e0ba1b80 1 Processor -- start 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.214+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d15eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.214+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 0x556223d163f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.214+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.214+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223c1a500 con 0x556223d0d720 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.214+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223c1a1a0 con 0x556223d0bed0 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.214+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223adf8c0 con 0x556223d0c830 2023-12-11T20:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.214+0000 7f77e0ba1b80 10 client.0 _ll_register_callbacks cb 0x556223b45a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55042/0 (socket says 172.21.15.12:55042) 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c759e700 1 -- 172.21.15.12:0/775958491 learned_addr learned my addr 172.21.15.12:0/775958491 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d15eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c659c700 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 0x556223d163f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c6d9d700 1 -- 172.21.15.12:0/775958491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 msgr2=0x556223d163f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 0x556223d163f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c6d9d700 1 -- 172.21.15.12:0/775958491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 msgr2=0x556223d1d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c6d9d700 1 -- 172.21.15.12:0/775958491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc0098f0 con 0x556223d0bed0 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c759e700 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d15eb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77b80caae0 tx=0x7f77b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a77183557d225d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.215+0000 7f77aaff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.216+0000 7f77aaff5700 1 -- 172.21.15.12:0/775958491 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b809a080 con 0x556223d0bed0 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.216+0000 7f77aaff5700 1 -- 172.21.15.12:0/775958491 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f77b809a9b0 con 0x556223d0bed0 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.216+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/775958491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556223cff730 con 0x556223d0bed0 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.216+0000 7f77aaff5700 1 -- 172.21.15.12:0/775958491 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77b80b0050 con 0x556223d0bed0 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.216+0000 7f77e0ba1b80 10 client.28286 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.216+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/775958491 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556223a89d80 con 0x556223d0bed0 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.217+0000 7f77aaff5700 1 -- 172.21.15.12:0/775958491 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556223cff730 con 0x556223d0bed0 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.217+0000 7f77aaff5700 1 -- 172.21.15.12:0/775958491 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77b80997a0 con 0x556223d0bed0 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.217+0000 7f77e0ba1b80 10 client.28286 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.217+0000 7f77e0ba1b80 10 client.28286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.217+0000 7f77e0ba1b80 20 client.28286 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.217+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556223d21cc0 0x556223d240e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.217+0000 7f77e0ba1b80 4 client.28286 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.217+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/775958491 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556223cdbee0 con 0x556223d21cc0 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.218+0000 7f77c659c700 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556223d21cc0 0x556223d240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.218+0000 7f77c659c700 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556223d21cc0 0x556223d240e0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6534f32659bc6b0a server_cookie=ebf14564aa4440b4 in_seq=0 out_seq=0 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.218+0000 7f77aaff5700 10 client.28286 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77aaff5700 1 -- 172.21.15.12:0/775958491 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556223cdbee0 con 0x556223d21cc0 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77aaff5700 10 client.28286 handle_command_reply: tid=0 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 client.28286 shutdown 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 msgr2=0x556223d15eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d15eb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77b80caae0 tx=0x7f77b8004750 comp rx=0 tx=0).stop 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/775958491 shutdown_connections 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556223d21cc0 0x556223d240e0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d15eb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77aaff5700 0 client.28286 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/775958491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 0x556223d163f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/775958491 >> 172.21.15.12:0/775958491 conn(0x556223c3b780 msgr2=0x556223d06ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/775958491 shutdown_connections 2023-12-11T20:27:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.219+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/775958491 wait complete. 2023-12-11T20:27:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.220+0000 7f77e0ba1b80 20 client.28286 trim_cache size 0 max 16384 2023-12-11T20:27:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.243+0000 7f77e0ba1b80 1 Processor -- start 2023-12-11T20:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.243+0000 7f77e0ba1b80 1 -- start start 2023-12-11T20:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0c830 0x556223d1d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0d720 0x556223d151b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223d16d80 con 0x556223d0c830 2023-12-11T20:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223d0c670 con 0x556223d0bed0 2023-12-11T20:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223d29310 con 0x556223d0d720 2023-12-11T20:27:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0c830 0x556223d1d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0c830 0x556223d1d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55054/0 (socket says 172.21.15.12:55054) 2023-12-11T20:27:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77c659c700 1 -- 172.21.15.12:0/2294360491 learned_addr learned my addr 172.21.15.12:0/2294360491 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77c759e700 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0d720 0x556223d151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77c659c700 1 -- 172.21.15.12:0/2294360491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0d720 msgr2=0x556223d151b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.244+0000 7f77c659c700 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0d720 0x556223d151b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77c659c700 1 -- 172.21.15.12:0/2294360491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 msgr2=0x556223d1db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77c659c700 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77c659c700 1 -- 172.21.15.12:0/2294360491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556223a72c00 con 0x556223d0c830 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77c759e700 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0d720 0x556223d151b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77c659c700 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0c830 0x556223d1d1e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x556223d0cf00 tx=0x7f77bc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8a754bf80c2df9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77adffb700 1 -- 172.21.15.12:0/2294360491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc02b070 con 0x556223d0c830 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77adffb700 1 -- 172.21.15.12:0/2294360491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77bc02f070 con 0x556223d0c830 2023-12-11T20:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.245+0000 7f77adffb700 1 -- 172.21.15.12:0/2294360491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0056c0 con 0x556223d0c830 2023-12-11T20:27:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2294360491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0c830 msgr2=0x556223d1d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0c830 0x556223d1d1e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x556223d0cf00 tx=0x7f77bc0095c0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2294360491 shutdown_connections 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0d720 0x556223d151b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/2294360491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0c830 0x556223d1d1e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2294360491 >> 172.21.15.12:0/2294360491 conn(0x556223c3b780 msgr2=0x556223d10940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2294360491 shutdown_connections 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/2294360491 wait complete. 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.246+0000 7f77e0ba1b80 1 -- start start 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.247+0000 7f77e0ba1b80 1 Processor -- start 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.247+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.247+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 0x556223d1b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.247+0000 7f77e0ba1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.247+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223d1c670 con 0x556223d0d720 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.247+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223d1c7e0 con 0x556223d0bed0 2023-12-11T20:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.247+0000 7f77e0ba1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556223d1c9a0 con 0x556223d0c830 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.247+0000 7f77e0ba1b80 10 client.0 _ll_register_callbacks cb 0x556223b45a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55068/0 (socket says 172.21.15.12:55068) 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c759e700 1 -- 172.21.15.12:0/1073693936 learned_addr learned my addr 172.21.15.12:0/1073693936 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c659c700 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 0x556223d1b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c759e700 1 -- 172.21.15.12:0/1073693936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 msgr2=0x556223d1b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c759e700 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 0x556223d1b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c759e700 1 -- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 msgr2=0x556223d1ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c759e700 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c759e700 1 -- 172.21.15.12:0/1073693936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556223a89d80 con 0x556223d0d720 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.248+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77c759e700 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1c130 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f77c000b0d0 tx=0x7f77c00099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8caefc14373f68 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77aaff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77aaff5700 1 -- 172.21.15.12:0/1073693936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c002e070 con 0x556223d0d720 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/1073693936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556223d14cb0 con 0x556223d0d720 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77aaff5700 1 -- 172.21.15.12:0/1073693936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f77c0005040 con 0x556223d0d720 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77aaff5700 1 -- 172.21.15.12:0/1073693936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77c000e040 con 0x556223d0d720 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77e0ba1b80 10 client.18699 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/1073693936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f77c810a260 con 0x556223d0d720 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.249+0000 7f77aaff5700 1 -- 172.21.15.12:0/1073693936 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556223d14cb0 con 0x556223d0d720 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.250+0000 7f77aaff5700 1 -- 172.21.15.12:0/1073693936 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77c003c6c0 con 0x556223d0d720 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.250+0000 7f77e0ba1b80 10 client.18699 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.250+0000 7f77e0ba1b80 10 client.18699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.250+0000 7f77e0ba1b80 20 client.18699 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.250+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556223d78eb0 0x556223d7b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.250+0000 7f77e0ba1b80 4 client.18699 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:27:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.250+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/1073693936 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f77bc011d90 con 0x556223d78eb0 2023-12-11T20:27:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.250+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556223d78eb0 0x556223d7b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.251+0000 7f77c6d9d700 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556223d78eb0 0x556223d7b2d0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8ded6f5d86d8477 server_cookie=6b349474e52c7f08 in_seq=0 out_seq=0 2023-12-11T20:27:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.251+0000 7f77aaff5700 10 client.18699 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77aaff5700 1 -- 172.21.15.12:0/1073693936 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f77bc011d90 con 0x556223d78eb0 2023-12-11T20:27:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77aaff5700 10 client.18699 handle_command_reply: tid=0 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 client.18699 shutdown 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/1073693936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 msgr2=0x556223d1c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1c130 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f77c000b0d0 tx=0x7f77c00099e0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/1073693936 shutdown_connections 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556223d78eb0 0x556223d7b2d0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556223d0bed0 0x556223d1ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556223d0d720 0x556223d1c130 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 --2- 172.21.15.12:0/1073693936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556223d0c830 0x556223d1b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/1073693936 >> 172.21.15.12:0/1073693936 conn(0x556223c3b780 msgr2=0x556223d08460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77aaff5700 0 client.18699 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/1073693936 shutdown_connections 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.261+0000 7f77e0ba1b80 1 -- 172.21.15.12:0/1073693936 wait complete. 2023-12-11T20:27:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77e0ba1b80 20 client.18699 trim_cache size 0 max 16384 2023-12-11T20:27:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:27:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:27:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:27:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 -- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a14f0 msgr2=0x7f77b00a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a14f0 0x7f77b00a39b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009850 tx=0x7f77c0009780 comp rx=0 tx=0).stop 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 -- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81014d0 msgr2=0x7f77c8199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81014d0 0x7f77c8199700 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f77b800e970 tx=0x7f77b800ed30 comp rx=0 tx=0).stop 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 -- 172.21.15.12:0/1953578287 shutdown_connections 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f77b00a14f0 0x7f77b00a39b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77c8103060 0x7f77c81a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c81014d0 0x7f77c8199700 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 --2- 172.21.15.12:0/1953578287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77c81026c0 0x7f77c8199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 -- 172.21.15.12:0/1953578287 >> 172.21.15.12:0/1953578287 conn(0x7f77c80fca60 msgr2=0x7f77c8073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:12.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.262+0000 7f77cd1ff700 1 -- 172.21.15.12:0/1953578287 shutdown_connections 2023-12-11T20:27:12.264 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:12.263+0000 7f77cd1ff700 1 -- 172.21.15.12:0/1953578287 wait complete. 2023-12-11T20:27:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:12 smithi032 ceph-mon[132488]: pgmap v713: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:27:13.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:12 smithi039 ceph-mon[102205]: pgmap v713: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:27:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:12 smithi012 ceph-mon[128787]: pgmap v713: 97 pgs: 97 active+clean; 8.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:27:15.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:14 smithi032 ceph-mon[132488]: pgmap v714: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:15.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:14 smithi039 ceph-mon[102205]: pgmap v714: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:14 smithi012 ceph-mon[128787]: pgmap v714: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:17.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:16 smithi032 ceph-mon[132488]: pgmap v715: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:27:17.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:16 smithi039 ceph-mon[102205]: pgmap v715: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:27:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:16 smithi012 ceph-mon[128787]: pgmap v715: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:27:19.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:18 smithi032 ceph-mon[132488]: pgmap v716: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:27:19.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:18 smithi039 ceph-mon[102205]: pgmap v716: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:27:19.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:18 smithi012 ceph-mon[128787]: pgmap v716: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:27:21.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:20 smithi032 ceph-mon[132488]: pgmap v717: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:21.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:20 smithi039 ceph-mon[102205]: pgmap v717: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:21.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:20 smithi012 ceph-mon[128787]: pgmap v717: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:23.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:22 smithi032 ceph-mon[132488]: pgmap v718: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:27:23.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:27:23.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:22 smithi012 ceph-mon[128787]: pgmap v718: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:27:23.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:22 smithi039 ceph-mon[102205]: pgmap v718: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:27:23.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 -- 172.21.15.12:0/1606393765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 msgr2=0x7f7600073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 --2- 172.21.15.12:0/1606393765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 0x7f7600073a60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009990 tx=0x7f75fc009ca0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 -- 172.21.15.12:0/1606393765 shutdown_connections 2023-12-11T20:27:23.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 --2- 172.21.15.12:0/1606393765 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 0x7f7600073a60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 --2- 172.21.15.12:0/1606393765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f760010da80 0x7f760010fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 --2- 172.21.15.12:0/1606393765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7600074030 0x7f76000744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 -- 172.21.15.12:0/1606393765 >> 172.21.15.12:0/1606393765 conn(0x7f76000fca00 msgr2=0x7f76000fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 -- 172.21.15.12:0/1606393765 shutdown_connections 2023-12-11T20:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.451+0000 7f7607fff700 1 -- 172.21.15.12:0/1606393765 wait complete. 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.452+0000 7f7607fff700 1 Processor -- start 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.452+0000 7f7607fff700 1 -- start start 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.452+0000 7f7607fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7600074030 0x7f760019d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7607fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 0x7f760019df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7607fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760010da80 0x7f76001a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7607fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76001a54c0 con 0x7f7600074030 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7607fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76001a5600 con 0x7f7600075610 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7607fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76001a5790 con 0x7f760010da80 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7600074030 0x7f760019d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7600074030 0x7f760019d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48788/0 (socket says 172.21.15.12:48788) 2023-12-11T20:27:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7605d9b700 1 -- 172.21.15.12:0/2235181855 learned_addr learned my addr 172.21.15.12:0/2235181855 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f760559a700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 0x7f760019df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f760659c700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760010da80 0x7f76001a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7605d9b700 1 -- 172.21.15.12:0/2235181855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760010da80 msgr2=0x7f76001a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7605d9b700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760010da80 0x7f76001a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7605d9b700 1 -- 172.21.15.12:0/2235181855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 msgr2=0x7f760019df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7605d9b700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 0x7f760019df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f7605d9b700 1 -- 172.21.15.12:0/2235181855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0095f0 con 0x7f7600074030 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.453+0000 7f760559a700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 0x7f760019df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.454+0000 7f7605d9b700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7600074030 0x7f760019d9e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f75fc003ec0 tx=0x7f75fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.454+0000 7f75f6ffd700 1 -- 172.21.15.12:0/2235181855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc01d070 con 0x7f7600074030 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.454+0000 7f75f6ffd700 1 -- 172.21.15.12:0/2235181855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75fc00be30 con 0x7f7600074030 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.454+0000 7f7607fff700 1 -- 172.21.15.12:0/2235181855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76001a5a10 con 0x7f7600074030 2023-12-11T20:27:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.454+0000 7f75f6ffd700 1 -- 172.21.15.12:0/2235181855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00fe90 con 0x7f7600074030 2023-12-11T20:27:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.454+0000 7f7607fff700 1 -- 172.21.15.12:0/2235181855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76001a5e90 con 0x7f7600074030 2023-12-11T20:27:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.457+0000 7f75f6ffd700 1 -- 172.21.15.12:0/2235181855 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f75fc00f660 con 0x7f7600074030 2023-12-11T20:27:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.459+0000 7f75f6ffd700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f75ec0a1500 0x7f75ec0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.459+0000 7f75f6ffd700 1 -- 172.21.15.12:0/2235181855 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f75fc0ce050 con 0x7f7600074030 2023-12-11T20:27:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f760559a700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f75ec0a1500 0x7f75ec0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f761b854b80 1 Processor -- start 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f761b854b80 1 -- start start 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f761b854b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f761b854b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8f2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f761b854b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf8f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f761b854b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf84cb50 con 0x55addf8f2c20 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f761b854b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf84a470 con 0x55addf8f1d30 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.460+0000 7f761b854b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf845d60 con 0x55addf8f13d0 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f75ec0a1500 0x7f75ec0a39c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7600075330 tx=0x7f75f0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf8f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8f2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50924/0 (socket says 172.21.15.12:50924) 2023-12-11T20:27:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 -- 172.21.15.12:0/585059478 learned_addr learned my addr 172.21.15.12:0/585059478 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 -- 172.21.15.12:0/585059478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 msgr2=0x55addf8f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 --2- 172.21.15.12:0/585059478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8f17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 -- 172.21.15.12:0/585059478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 msgr2=0x55addf8f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 --2- 172.21.15.12:0/585059478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf8f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760559a700 1 -- 172.21.15.12:0/585059478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55addf6c2630 con 0x55addf8f1d30 2023-12-11T20:27:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.461+0000 7f760659c700 1 --2- 172.21.15.12:0/585059478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf8f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.462+0000 7f760559a700 1 --2- 172.21.15.12:0/585059478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8f2640 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f75f0011f80 tx=0x7f75f0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecc8d319b616d6e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.464+0000 7f75ebfff700 1 -- 172.21.15.12:0/585059478 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0012dc0 con 0x55addf8f1d30 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.464+0000 7f75ebfff700 1 -- 172.21.15.12:0/585059478 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75f0016070 con 0x55addf8f1d30 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.464+0000 7f75ebfff700 1 -- 172.21.15.12:0/585059478 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0027400 con 0x55addf8f1d30 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 -- 172.21.15.12:0/585059478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 msgr2=0x55addf8f2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 --2- 172.21.15.12:0/585059478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8f2640 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f75f0011f80 tx=0x7f75f0014000 comp rx=0 tx=0).stop 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 -- 172.21.15.12:0/585059478 shutdown_connections 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 --2- 172.21.15.12:0/585059478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf8f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 --2- 172.21.15.12:0/585059478 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 --2- 172.21.15.12:0/585059478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8f2640 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 -- 172.21.15.12:0/585059478 >> 172.21.15.12:0/585059478 conn(0x55addf8207e0 msgr2=0x55addf8edd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 -- 172.21.15.12:0/585059478 shutdown_connections 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.465+0000 7f761b854b80 1 -- 172.21.15.12:0/585059478 wait complete. 2023-12-11T20:27:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.466+0000 7f761b854b80 1 -- start start 2023-12-11T20:27:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.466+0000 7f761b854b80 1 Processor -- start 2023-12-11T20:27:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.466+0000 7f761b854b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8fb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.466+0000 7f761b854b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8fb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.466+0000 7f761b854b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf902790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.466+0000 7f761b854b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf7ff560 con 0x55addf8f2c20 2023-12-11T20:27:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.466+0000 7f761b854b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf7ff200 con 0x55addf8f1d30 2023-12-11T20:27:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.466+0000 7f761b854b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf6c4920 con 0x55addf8f13d0 2023-12-11T20:27:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f761b854b80 10 client.0 _ll_register_callbacks cb 0x55addf72aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf902790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760559a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8fb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf902790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48804/0 (socket says 172.21.15.12:48804) 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760659c700 1 -- 172.21.15.12:0/3911415410 learned_addr learned my addr 172.21.15.12:0/3911415410 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f7605d9b700 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8fb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760659c700 1 -- 172.21.15.12:0/3911415410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 msgr2=0x55addf8fb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760659c700 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8fb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760659c700 1 -- 172.21.15.12:0/3911415410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 msgr2=0x55addf8fb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760659c700 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8fb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760659c700 1 -- 172.21.15.12:0/3911415410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f8009050 con 0x55addf8f2c20 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f7605d9b700 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.467+0000 7f760559a700 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8fb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.468+0000 7f760659c700 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf902790 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009d10 tx=0x7f75f8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cae97d5622ae5c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.468+0000 7f75e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.468+0000 7f75e97fa700 1 -- 172.21.15.12:0/3911415410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800e050 con 0x55addf8f2c20 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.468+0000 7f761b854b80 1 -- 172.21.15.12:0/3911415410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55addf8e4b40 con 0x55addf8f2c20 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.468+0000 7f75e97fa700 1 -- 172.21.15.12:0/3911415410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f75f8013b30 con 0x55addf8f2c20 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.468+0000 7f75e97fa700 1 -- 172.21.15.12:0/3911415410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75f8013cf0 con 0x55addf8f2c20 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.468+0000 7f761b854b80 10 client.18711 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.468+0000 7f761b854b80 1 -- 172.21.15.12:0/3911415410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f75f0011c60 con 0x55addf8f2c20 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f75e97fa700 1 -- 172.21.15.12:0/3911415410 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55addf8e4b40 con 0x55addf8f2c20 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f75e97fa700 1 -- 172.21.15.12:0/3911415410 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f75f80203e0 con 0x55addf8f2c20 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f761b854b80 10 client.18711 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f761b854b80 10 client.18711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f761b854b80 20 client.18711 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f761b854b80 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55addf9070c0 0x55addf9094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f761b854b80 4 client.18711 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:23.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f761b854b80 1 -- 172.21.15.12:0/3911415410 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55addf8c0f40 con 0x55addf9070c0 2023-12-11T20:27:23.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.469+0000 7f7605d9b700 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55addf9070c0 0x55addf9094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.470+0000 7f7605d9b700 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55addf9070c0 0x55addf9094e0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f12db53e1b02647 server_cookie=28d1e3e0b4486d90 in_seq=0 out_seq=0 2023-12-11T20:27:23.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.470+0000 7f75e97fa700 10 client.18711 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:23.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f75e97fa700 1 -- 172.21.15.12:0/3911415410 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55addf8c0f40 con 0x55addf9070c0 2023-12-11T20:27:23.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f75e97fa700 10 client.18711 handle_command_reply: tid=0 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 client.18711 shutdown 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 -- 172.21.15.12:0/3911415410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 msgr2=0x55addf902790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf902790 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009d10 tx=0x7f75f8007f40 comp rx=0 tx=0).stop 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 -- 172.21.15.12:0/3911415410 shutdown_connections 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55addf9070c0 0x55addf9094e0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f2c20 0x55addf902790 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f75e97fa700 0 client.18711 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f13d0 0x55addf8fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 --2- 172.21.15.12:0/3911415410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf8fb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 -- 172.21.15.12:0/3911415410 >> 172.21.15.12:0/3911415410 conn(0x55addf8207e0 msgr2=0x55addf8eca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 -- 172.21.15.12:0/3911415410 shutdown_connections 2023-12-11T20:27:23.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.471+0000 7f761b854b80 1 -- 172.21.15.12:0/3911415410 wait complete. 2023-12-11T20:27:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.472+0000 7f761b854b80 20 client.18711 trim_cache size 0 max 16384 2023-12-11T20:27:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.494+0000 7f761b854b80 1 Processor -- start 2023-12-11T20:27:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.494+0000 7f761b854b80 1 -- start start 2023-12-11T20:27:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f761b854b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf8f3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f761b854b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf9026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f761b854b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf8ed970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f761b854b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf8e8b50 con 0x55addf8f13d0 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f761b854b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf8f2110 con 0x55addf8f1d30 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f761b854b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf90e710 con 0x55addf8f2c20 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf8f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf8f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48808/0 (socket says 172.21.15.12:48808) 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f7605d9b700 1 -- 172.21.15.12:0/143506490 learned_addr learned my addr 172.21.15.12:0/143506490 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f760559a700 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf9026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.495+0000 7f760659c700 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf8ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f7605d9b700 1 -- 172.21.15.12:0/143506490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 msgr2=0x55addf8ed970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f7605d9b700 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf8ed970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f7605d9b700 1 -- 172.21.15.12:0/143506490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 msgr2=0x55addf9026b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f7605d9b700 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf9026b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f7605d9b700 1 -- 172.21.15.12:0/143506490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55addf66ede0 con 0x55addf8f13d0 2023-12-11T20:27:23.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f760659c700 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf8ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f7605d9b700 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf8f3000 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0cbe70 tx=0x7f75fc0cb9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8481a6bda5cf7ebd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f75f4ff9700 1 -- 172.21.15.12:0/143506490 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc09b3b0 con 0x55addf8f13d0 2023-12-11T20:27:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f75f4ff9700 1 -- 172.21.15.12:0/143506490 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75fc09f500 con 0x55addf8f13d0 2023-12-11T20:27:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.496+0000 7f75f4ff9700 1 -- 172.21.15.12:0/143506490 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0a3220 con 0x55addf8f13d0 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 -- 172.21.15.12:0/143506490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 msgr2=0x55addf8f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf8f3000 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0cbe70 tx=0x7f75fc0cb9d0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 -- 172.21.15.12:0/143506490 shutdown_connections 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf8ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf8f3000 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 --2- 172.21.15.12:0/143506490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf9026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 -- 172.21.15.12:0/143506490 >> 172.21.15.12:0/143506490 conn(0x55addf8207e0 msgr2=0x55addf8f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 -- 172.21.15.12:0/143506490 shutdown_connections 2023-12-11T20:27:23.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.497+0000 7f761b854b80 1 -- 172.21.15.12:0/143506490 wait complete. 2023-12-11T20:27:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.498+0000 7f761b854b80 1 -- start start 2023-12-11T20:27:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.498+0000 7f761b854b80 1 Processor -- start 2023-12-11T20:27:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f761b854b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf900160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f761b854b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf9006a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f761b854b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf901610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f761b854b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf901b50 con 0x55addf8f13d0 2023-12-11T20:27:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f761b854b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf901cc0 con 0x55addf8f1d30 2023-12-11T20:27:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f761b854b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55addf901e80 con 0x55addf8f2c20 2023-12-11T20:27:23.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f761b854b80 10 client.0 _ll_register_callbacks cb 0x55addf72aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:23.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf900160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f7605d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf900160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48822/0 (socket says 172.21.15.12:48822) 2023-12-11T20:27:23.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f7605d9b700 1 -- 172.21.15.12:0/1746076895 learned_addr learned my addr 172.21.15.12:0/1746076895 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:23.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f760659c700 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf901610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f760559a700 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf9006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f7605d9b700 1 -- 172.21.15.12:0/1746076895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 msgr2=0x55addf901610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:23.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f7605d9b700 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf901610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f7605d9b700 1 -- 172.21.15.12:0/1746076895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 msgr2=0x55addf9006a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:23.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f7605d9b700 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf9006a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.499+0000 7f7605d9b700 1 -- 172.21.15.12:0/1746076895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76001a5e90 con 0x55addf8f13d0 2023-12-11T20:27:23.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f7605d9b700 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf900160 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f75fc097e20 tx=0x7f75fc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced415cb5078d3f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:23.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f75e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:23.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f75e97fa700 1 -- 172.21.15.12:0/1746076895 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0a3420 con 0x55addf8f13d0 2023-12-11T20:27:23.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f761b854b80 1 -- 172.21.15.12:0/1746076895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75f0016070 con 0x55addf8f13d0 2023-12-11T20:27:23.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f75e97fa700 1 -- 172.21.15.12:0/1746076895 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f75fc0a36b0 con 0x55addf8f13d0 2023-12-11T20:27:23.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f75e97fa700 1 -- 172.21.15.12:0/1746076895 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75fc00b9a0 con 0x55addf8f13d0 2023-12-11T20:27:23.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f761b854b80 10 client.18717 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:23.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f761b854b80 1 -- 172.21.15.12:0/1746076895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55addf657c60 con 0x55addf8f13d0 2023-12-11T20:27:23.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.500+0000 7f75e97fa700 1 -- 172.21.15.12:0/1746076895 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75f0016070 con 0x55addf8f13d0 2023-12-11T20:27:23.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.501+0000 7f75e97fa700 1 -- 172.21.15.12:0/1746076895 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f75fc09a310 con 0x55addf8f13d0 2023-12-11T20:27:23.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.501+0000 7f761b854b80 10 client.18717 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:23.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.501+0000 7f761b854b80 10 client.18717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:23.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.501+0000 7f761b854b80 20 client.18717 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:23.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.501+0000 7f761b854b80 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55addf95ddd0 0x55addf9601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.501+0000 7f761b854b80 4 client.18717 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:27:23.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.501+0000 7f761b854b80 1 -- 172.21.15.12:0/1746076895 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55addf80bfd0 con 0x55addf95ddd0 2023-12-11T20:27:23.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.501+0000 7f760559a700 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55addf95ddd0 0x55addf9601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f760559a700 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55addf95ddd0 0x55addf9601f0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9b11dfcaf8ea255 server_cookie=74102a3e524bf0dd in_seq=0 out_seq=0 2023-12-11T20:27:23.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f75e97fa700 10 client.18717 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:23.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f75e97fa700 1 -- 172.21.15.12:0/1746076895 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55addf80bfd0 con 0x55addf95ddd0 2023-12-11T20:27:23.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f75e97fa700 10 client.18717 handle_command_reply: tid=0 2023-12-11T20:27:23.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 client.18717 shutdown 2023-12-11T20:27:23.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 -- 172.21.15.12:0/1746076895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 msgr2=0x55addf900160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf900160 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f75fc097e20 tx=0x7f75fc009ca0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 -- 172.21.15.12:0/1746076895 shutdown_connections 2023-12-11T20:27:23.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55addf95ddd0 0x55addf9601f0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55addf8f2c20 0x55addf901610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55addf8f13d0 0x55addf900160 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f75e97fa700 0 client.18717 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 --2- 172.21.15.12:0/1746076895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55addf8f1d30 0x55addf9006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.502+0000 7f761b854b80 1 -- 172.21.15.12:0/1746076895 >> 172.21.15.12:0/1746076895 conn(0x55addf8207e0 msgr2=0x55addf8ed970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.503+0000 7f761b854b80 1 -- 172.21.15.12:0/1746076895 shutdown_connections 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.503+0000 7f761b854b80 1 -- 172.21.15.12:0/1746076895 wait complete. 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.503+0000 7f761b854b80 20 client.18717 trim_cache size 0 max 16384 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:27:23.513 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:27:23.514 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:27:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.503+0000 7f7607fff700 1 -- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f75ec0a1500 msgr2=0x7f75ec0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.503+0000 7f7607fff700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f75ec0a1500 0x7f75ec0a39c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7600075330 tx=0x7f75f0009260 comp rx=0 tx=0).stop 2023-12-11T20:27:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.503+0000 7f7607fff700 1 -- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7600074030 msgr2=0x7f760019d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.503+0000 7f7607fff700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7600074030 0x7f760019d9e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f75fc003ec0 tx=0x7f75fc0057f0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.504+0000 7f7607fff700 1 -- 172.21.15.12:0/2235181855 shutdown_connections 2023-12-11T20:27:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.504+0000 7f7607fff700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f75ec0a1500 0x7f75ec0a39c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.504+0000 7f7607fff700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760010da80 0x7f76001a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.504+0000 7f7607fff700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7600074030 0x7f760019d9e0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.504+0000 7f7607fff700 1 --2- 172.21.15.12:0/2235181855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7600075610 0x7f760019df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.504+0000 7f7607fff700 1 -- 172.21.15.12:0/2235181855 >> 172.21.15.12:0/2235181855 conn(0x7f76000fca00 msgr2=0x7f7600100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.504+0000 7f7607fff700 1 -- 172.21.15.12:0/2235181855 shutdown_connections 2023-12-11T20:27:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.504+0000 7f7607fff700 1 -- 172.21.15.12:0/2235181855 wait complete. 2023-12-11T20:27:23.525 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:27:23.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:27:23.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 -- 172.21.15.12:0/1404264251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 msgr2=0x7f64741043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 --2- 172.21.15.12:0/1404264251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 0x7f64741043e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6464009990 tx=0x7f6464009ca0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 -- 172.21.15.12:0/1404264251 shutdown_connections 2023-12-11T20:27:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 --2- 172.21.15.12:0/1404264251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6474107250 0x7f6474109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 --2- 172.21.15.12:0/1404264251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 0x7f64741043e0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 --2- 172.21.15.12:0/1404264251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6474104920 0x7f6474106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 -- 172.21.15.12:0/1404264251 >> 172.21.15.12:0/1404264251 conn(0x7f64740fb980 msgr2=0x7f64740fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 -- 172.21.15.12:0/1404264251 shutdown_connections 2023-12-11T20:27:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.756+0000 7f6478dff700 1 -- 172.21.15.12:0/1404264251 wait complete. 2023-12-11T20:27:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.757+0000 7f6478dff700 1 Processor -- start 2023-12-11T20:27:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f6478dff700 1 -- start start 2023-12-11T20:27:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f6478dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 0x7f6474199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f6478dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6474104920 0x7f6474199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f6478dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6474107250 0x7f64741a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f6478dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64741a1060 con 0x7f6474101ff0 2023-12-11T20:27:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f6478dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64741a11a0 con 0x7f6474107250 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f6478dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64741a1330 con 0x7f6474104920 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f647259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 0x7f6474199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f647259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 0x7f6474199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48842/0 (socket says 172.21.15.12:48842) 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.758+0000 7f647259c700 1 -- 172.21.15.12:0/2296028858 learned_addr learned my addr 172.21.15.12:0/2296028858 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.759+0000 7f6472d9d700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6474107250 0x7f64741a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.759+0000 7f6471d9b700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6474104920 0x7f6474199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.759+0000 7f647259c700 1 -- 172.21.15.12:0/2296028858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6474104920 msgr2=0x7f6474199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.759+0000 7f647259c700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6474104920 0x7f6474199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.759+0000 7f647259c700 1 -- 172.21.15.12:0/2296028858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6474107250 msgr2=0x7f64741a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.759+0000 7f647259c700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6474107250 0x7f64741a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:23.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.759+0000 7f647259c700 1 -- 172.21.15.12:0/2296028858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64640095f0 con 0x7f6474101ff0 2023-12-11T20:27:23.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.759+0000 7f647259c700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 0x7f6474199530 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f646400b2e0 tx=0x7f6464004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:23.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.760+0000 7f64637fe700 1 -- 172.21.15.12:0/2296028858 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646401d070 con 0x7f6474101ff0 2023-12-11T20:27:23.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.760+0000 7f64637fe700 1 -- 172.21.15.12:0/2296028858 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f646400bdb0 con 0x7f6474101ff0 2023-12-11T20:27:23.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.760+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64741a15b0 con 0x7f6474101ff0 2023-12-11T20:27:23.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.760+0000 7f64637fe700 1 -- 172.21.15.12:0/2296028858 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400fdc0 con 0x7f6474101ff0 2023-12-11T20:27:23.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.760+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64741a19d0 con 0x7f6474101ff0 2023-12-11T20:27:23.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.761+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6474108df0 con 0x7f6474101ff0 2023-12-11T20:27:23.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.764+0000 7f64637fe700 1 -- 172.21.15.12:0/2296028858 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f646400f560 con 0x7f6474101ff0 2023-12-11T20:27:23.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.765+0000 7f64637fe700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f645c0a1480 0x7f645c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:23.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.765+0000 7f64637fe700 1 -- 172.21.15.12:0/2296028858 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f64640ce5d0 con 0x7f6474101ff0 2023-12-11T20:27:23.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.765+0000 7f6471d9b700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f645c0a1480 0x7f645c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:23.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.766+0000 7f6471d9b700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f645c0a1480 0x7f645c0a3940 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6468009c60 tx=0x7f6468009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:23.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:23.768+0000 7f64637fe700 1 -- 172.21.15.12:0/2296028858 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6464097d30 con 0x7f6474101ff0 2023-12-11T20:27:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.071+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6474068330 con 0x7f6474101ff0 2023-12-11T20:27:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.072+0000 7f64637fe700 1 -- 172.21.15.12:0/2296028858 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11303 (secure 0 0 0) 0x7f6464026020 con 0x7f6474101ff0 2023-12-11T20:27:24.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:27:24.071 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:20:01.106867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:27:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f645c0a1480 msgr2=0x7f645c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f645c0a1480 0x7f645c0a3940 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6468009c60 tx=0x7f6468009260 comp rx=0 tx=0).stop 2023-12-11T20:27:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 msgr2=0x7f6474199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 0x7f6474199530 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f646400b2e0 tx=0x7f6464004730 comp rx=0 tx=0).stop 2023-12-11T20:27:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 shutdown_connections 2023-12-11T20:27:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f645c0a1480 0x7f645c0a3940 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6474107250 0x7f64741a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6474101ff0 0x7f6474199530 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 --2- 172.21.15.12:0/2296028858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6474104920 0x7f6474199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 >> 172.21.15.12:0/2296028858 conn(0x7f64740fb980 msgr2=0x7f6474101710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 shutdown_connections 2023-12-11T20:27:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.075+0000 7f6478dff700 1 -- 172.21.15.12:0/2296028858 wait complete. 2023-12-11T20:27:24.075 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-12-11T20:27:24.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 -- 172.21.15.12:0/15508072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80107280 msgr2=0x7ffa80109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 --2- 172.21.15.12:0/15508072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80107280 0x7ffa80109670 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800b0a0 tx=0x7ffa7800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 -- 172.21.15.12:0/15508072 shutdown_connections 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 --2- 172.21.15.12:0/15508072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80107280 0x7ffa80109670 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 --2- 172.21.15.12:0/15508072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa80102020 0x7ffa80104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 --2- 172.21.15.12:0/15508072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa80104950 0x7ffa80106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 -- 172.21.15.12:0/15508072 >> 172.21.15.12:0/15508072 conn(0x7ffa800fb930 msgr2=0x7ffa800fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 -- 172.21.15.12:0/15508072 shutdown_connections 2023-12-11T20:27:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.329+0000 7ffa86fff700 1 -- 172.21.15.12:0/15508072 wait complete. 2023-12-11T20:27:24.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.330+0000 7ffa86fff700 1 Processor -- start 2023-12-11T20:27:24.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.330+0000 7ffa86fff700 1 -- start start 2023-12-11T20:27:24.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa86fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa80102020 0x7ffa801973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa86fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80104950 0x7ffa80197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa86fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa80107280 0x7ffa8019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa86fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8019ef20 con 0x7ffa80104950 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa86fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8019f060 con 0x7ffa80102020 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa86fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8019f1f0 con 0x7ffa80107280 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80104950 0x7ffa80197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80104950 0x7ffa80197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48866/0 (socket says 172.21.15.12:48866) 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa7ffff700 1 -- 172.21.15.12:0/4213700431 learned_addr learned my addr 172.21.15.12:0/4213700431 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa80102020 0x7ffa801973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.331+0000 7ffa8559c700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa80107280 0x7ffa8019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7ffff700 1 -- 172.21.15.12:0/4213700431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa80107280 msgr2=0x7ffa8019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa80107280 0x7ffa8019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7ffff700 1 -- 172.21.15.12:0/4213700431 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa80102020 msgr2=0x7ffa801973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa80102020 0x7ffa801973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7ffff700 1 -- 172.21.15.12:0/4213700431 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78009d00 con 0x7ffa80104950 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80104950 0x7ffa80197930 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00d980 tx=0x7ffa6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7dffb700 1 -- 172.21.15.12:0/4213700431 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c004220 con 0x7ffa80104950 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7dffb700 1 -- 172.21.15.12:0/4213700431 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa6c007640 con 0x7ffa80104950 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa86fff700 1 -- 172.21.15.12:0/4213700431 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8019f4d0 con 0x7ffa80104950 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa7dffb700 1 -- 172.21.15.12:0/4213700431 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c005660 con 0x7ffa80104950 2023-12-11T20:27:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.332+0000 7ffa86fff700 1 -- 172.21.15.12:0/4213700431 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8019fa30 con 0x7ffa80104950 2023-12-11T20:27:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.337+0000 7ffa7dffb700 1 -- 172.21.15.12:0/4213700431 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ffa6c004750 con 0x7ffa80104950 2023-12-11T20:27:24.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.338+0000 7ffa9a8c0b80 1 Processor -- start 2023-12-11T20:27:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa9a8c0b80 1 -- start start 2023-12-11T20:27:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 0x55624ff7a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff7b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff7c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624fed5b50 con 0x55624ff7bc20 2023-12-11T20:27:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624fed3470 con 0x55624ff7ad30 2023-12-11T20:27:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624feced60 con 0x55624ff7a3d0 2023-12-11T20:27:24.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff7c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa7dffb700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa700a1500 0x7ffa700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff7c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48874/0 (socket says 172.21.15.12:48874) 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa7ffff700 1 -- 172.21.15.12:0/1482692304 learned_addr learned my addr 172.21.15.12:0/1482692304 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa8559c700 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 0x55624ff7a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.339+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff7b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa7dffb700 1 -- 172.21.15.12:0/4213700431 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffa6c0cca30 con 0x7ffa80104950 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa8559c700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa700a1500 0x7ffa700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa7ffff700 1 -- 172.21.15.12:0/1482692304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 msgr2=0x55624ff7a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 0x55624ff7a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa7ffff700 1 -- 172.21.15.12:0/1482692304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 msgr2=0x55624ff7b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff7b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa7ffff700 1 -- 172.21.15.12:0/1482692304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55624fd4b630 con 0x55624ff7bc20 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff7b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff7c0a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0050d0 tx=0x7ffa6c099a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7839a1bcbe6e3b33 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.340+0000 7ffa6affd700 1 -- 172.21.15.12:0/1482692304 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c019e60 con 0x55624ff7bc20 2023-12-11T20:27:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa6affd700 1 -- 172.21.15.12:0/1482692304 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa6c004380 con 0x55624ff7bc20 2023-12-11T20:27:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa6affd700 1 -- 172.21.15.12:0/1482692304 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0a20c0 con 0x55624ff7bc20 2023-12-11T20:27:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1482692304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 msgr2=0x55624ff7c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa8559c700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa700a1500 0x7ffa700a39c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffa780060d0 tx=0x7ffa7800b7b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff7c0a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0050d0 tx=0x7ffa6c099a70 comp rx=0 tx=0).stop 2023-12-11T20:27:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1482692304 shutdown_connections 2023-12-11T20:27:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff7c0a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 0x55624ff7a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1482692304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff7b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1482692304 >> 172.21.15.12:0/1482692304 conn(0x55624fea97e0 msgr2=0x55624ff76d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.341+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1482692304 shutdown_connections 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.342+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1482692304 wait complete. 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.342+0000 7ffa9a8c0b80 1 -- start start 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.342+0000 7ffa9a8c0b80 1 Processor -- start 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7a3d0 0x55624ff84210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff84750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7bc20 0x55624ff8b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624fe88560 con 0x55624ff7a3d0 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624fe88200 con 0x55624ff7ad30 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624fd4d920 con 0x55624ff7bc20 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa9a8c0b80 10 client.0 _ll_register_callbacks cb 0x55624fdb3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa84d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7a3d0 0x55624ff84210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa84d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7a3d0 0x55624ff84210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48890/0 (socket says 172.21.15.12:48890) 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa84d9b700 1 -- 172.21.15.12:0/1650035406 learned_addr learned my addr 172.21.15.12:0/1650035406 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa8559c700 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7bc20 0x55624ff8b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.343+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff84750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa84d9b700 1 -- 172.21.15.12:0/1650035406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7bc20 msgr2=0x55624ff8b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7bc20 0x55624ff8b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa84d9b700 1 -- 172.21.15.12:0/1650035406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 msgr2=0x55624ff84750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff84750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa84d9b700 1 -- 172.21.15.12:0/1650035406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7400b8e0 con 0x55624ff7a3d0 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7a3d0 0x55624ff84210 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ffa740042f0 tx=0x7ffa7400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b525132855880a35 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa5ffff700 1 -- 172.21.15.12:0/1650035406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74016070 con 0x55624ff7a3d0 2023-12-11T20:27:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa5ffff700 1 -- 172.21.15.12:0/1650035406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffa74011440 con 0x55624ff7a3d0 2023-12-11T20:27:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1650035406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55624ff6db40 con 0x55624ff7a3d0 2023-12-11T20:27:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa5ffff700 1 -- 172.21.15.12:0/1650035406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa74003e70 con 0x55624ff7a3d0 2023-12-11T20:27:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa9a8c0b80 10 client.18735 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.344+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1650035406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ffa8019fa30 con 0x55624ff7a3d0 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa5ffff700 1 -- 172.21.15.12:0/1650035406 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55624ff6db40 con 0x55624ff7a3d0 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa5ffff700 1 -- 172.21.15.12:0/1650035406 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffa74025750 con 0x55624ff7a3d0 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa9a8c0b80 10 client.18735 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa9a8c0b80 10 client.18735 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa9a8c0b80 20 client.18735 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55624ff90070 0x55624ff92490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa9a8c0b80 4 client.18735 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1650035406 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55624ff49f40 con 0x55624ff90070 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.345+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55624ff90070 0x55624ff92490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.346+0000 7ffa5ffff700 10 client.18735 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.346+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55624ff90070 0x55624ff92490 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9398d814e0c39803 server_cookie=8d127fcabebfec48 in_seq=0 out_seq=0 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa5ffff700 1 -- 172.21.15.12:0/1650035406 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55624ff49f40 con 0x55624ff90070 2023-12-11T20:27:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa5ffff700 10 client.18735 handle_command_reply: tid=0 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 client.18735 shutdown 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1650035406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7a3d0 msgr2=0x55624ff84210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7a3d0 0x55624ff84210 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ffa740042f0 tx=0x7ffa7400bf00 comp rx=0 tx=0).stop 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1650035406 shutdown_connections 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55624ff90070 0x55624ff92490 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7bc20 0x55624ff8b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7a3d0 0x55624ff84210 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/1650035406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff84750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.347+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1650035406 >> 172.21.15.12:0/1650035406 conn(0x55624fea97e0 msgr2=0x55624ff75a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.348+0000 7ffa5ffff700 0 client.18735 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.348+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1650035406 shutdown_connections 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.348+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/1650035406 wait complete. 2023-12-11T20:27:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.348+0000 7ffa9a8c0b80 20 client.18735 trim_cache size 0 max 16384 2023-12-11T20:27:24.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa9a8c0b80 1 Processor -- start 2023-12-11T20:27:24.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa9a8c0b80 1 -- start start 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 0x55624ff7c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff8b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff833f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624ff8d520 con 0x55624ff7bc20 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624ff8c910 con 0x55624ff7ad30 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624ff71b80 con 0x55624ff7a3d0 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa8559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff833f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa8559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff833f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48898/0 (socket says 172.21.15.12:48898) 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa8559c700 1 -- 172.21.15.12:0/3629856415 learned_addr learned my addr 172.21.15.12:0/3629856415 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff8b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.366+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 0x55624ff7c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa8559c700 1 -- 172.21.15.12:0/3629856415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 msgr2=0x55624ff7c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa8559c700 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 0x55624ff7c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa8559c700 1 -- 172.21.15.12:0/3629856415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 msgr2=0x55624ff8b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa8559c700 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff8b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa8559c700 1 -- 172.21.15.12:0/3629856415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55624fcf7de0 con 0x55624ff7bc20 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa7ffff700 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff8b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa8559c700 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff833f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800b0a0 tx=0x7ffa78006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc24993d9d01d41a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa6b7fe700 1 -- 172.21.15.12:0/3629856415 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800e070 con 0x55624ff7bc20 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.367+0000 7ffa6b7fe700 1 -- 172.21.15.12:0/3629856415 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa78003c80 con 0x55624ff7bc20 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.368+0000 7ffa6b7fe700 1 -- 172.21.15.12:0/3629856415 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780052a0 con 0x55624ff7bc20 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.368+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/3629856415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 msgr2=0x55624ff833f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.368+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff833f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800b0a0 tx=0x7ffa78006000 comp rx=0 tx=0).stop 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.368+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/3629856415 shutdown_connections 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.368+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff833f0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.368+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7a3d0 0x55624ff7c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.368+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/3629856415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7ad30 0x55624ff8b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.368+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/3629856415 >> 172.21.15.12:0/3629856415 conn(0x55624fea97e0 msgr2=0x55624ff7eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.369+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/3629856415 shutdown_connections 2023-12-11T20:27:24.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.369+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/3629856415 wait complete. 2023-12-11T20:27:24.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.369+0000 7ffa9a8c0b80 1 -- start start 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.369+0000 7ffa9a8c0b80 1 Processor -- start 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7a3d0 0x55624ff89020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7ad30 0x55624ff89560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa9a8c0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff8a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624ff8aa10 con 0x55624ff7bc20 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624ff8ab80 con 0x55624ff7a3d0 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa9a8c0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624ff8ad40 con 0x55624ff7ad30 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa9a8c0b80 10 client.0 _ll_register_callbacks cb 0x55624ff8c360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa8559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff8a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7ad30 0x55624ff89560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa84d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7a3d0 0x55624ff89020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa8559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff8a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48906/0 (socket says 172.21.15.12:48906) 2023-12-11T20:27:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa8559c700 1 -- 172.21.15.12:0/2687997202 learned_addr learned my addr 172.21.15.12:0/2687997202 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7ad30 0x55624ff89560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40514/0 (socket says 172.21.15.12:40514) 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa8559c700 1 -- 172.21.15.12:0/2687997202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7ad30 msgr2=0x55624ff89560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa8559c700 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7ad30 0x55624ff89560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.370+0000 7ffa8559c700 1 -- 172.21.15.12:0/2687997202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7a3d0 msgr2=0x55624ff89020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.371+0000 7ffa8559c700 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7a3d0 0x55624ff89020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.371+0000 7ffa8559c700 1 -- 172.21.15.12:0/2687997202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55624fd4b630 con 0x55624ff7bc20 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.371+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7a3d0 0x55624ff89020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.371+0000 7ffa8559c700 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff8a4d0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009a20 tx=0x7ffa7801f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58a3c87b6f1deb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.371+0000 7ffa5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.371+0000 7ffa5ffff700 1 -- 172.21.15.12:0/2687997202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780052c0 con 0x55624ff7bc20 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.371+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/2687997202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa6c004380 con 0x55624ff7bc20 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.371+0000 7ffa5ffff700 1 -- 172.21.15.12:0/2687997202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffa78026070 con 0x55624ff7bc20 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa5ffff700 1 -- 172.21.15.12:0/2687997202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa78005420 con 0x55624ff7bc20 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa9a8c0b80 10 client.18741 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/2687997202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ffa8010a240 con 0x55624ff7bc20 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa5ffff700 1 -- 172.21.15.12:0/2687997202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa78047080 con 0x55624ff7bc20 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa5ffff700 1 -- 172.21.15.12:0/2687997202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffa78038910 con 0x55624ff7bc20 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa9a8c0b80 10 client.18741 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa9a8c0b80 10 client.18741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa9a8c0b80 20 client.18741 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55624ffe6b70 0x55624ffe8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa9a8c0b80 4 client.18741 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.372+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/2687997202 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55624fe94fd0 con 0x55624ffe6b70 2023-12-11T20:27:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.373+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55624ffe6b70 0x55624ffe8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.373+0000 7ffa84d9b700 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55624ffe6b70 0x55624ffe8f90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9883c048817d1671 server_cookie=9670c6b7324e4df in_seq=0 out_seq=0 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.373+0000 7ffa5ffff700 10 client.18741 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.373+0000 7ffa5ffff700 1 -- 172.21.15.12:0/2687997202 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55624fe94fd0 con 0x55624ffe6b70 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.373+0000 7ffa5ffff700 10 client.18741 handle_command_reply: tid=0 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.373+0000 7ffa9a8c0b80 1 client.18741 shutdown 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/2687997202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 msgr2=0x55624ff8a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff8a4d0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009a20 tx=0x7ffa7801f930 comp rx=0 tx=0).stop 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/2687997202 shutdown_connections 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55624ffe6b70 0x55624ffe8f90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55624ff7a3d0 0x55624ff89020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55624ff7bc20 0x55624ff8a4d0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 --2- 172.21.15.12:0/2687997202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55624ff7ad30 0x55624ff89560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa5ffff700 0 client.18741 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/2687997202 >> 172.21.15.12:0/2687997202 conn(0x55624fea97e0 msgr2=0x55624ff833f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/2687997202 shutdown_connections 2023-12-11T20:27:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 1 -- 172.21.15.12:0/2687997202 wait complete. 2023-12-11T20:27:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.374+0000 7ffa9a8c0b80 20 client.18741 trim_cache size 0 max 16384 2023-12-11T20:27:24.377 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 -- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa700a1500 msgr2=0x7ffa700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa700a1500 0x7ffa700a39c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffa780060d0 tx=0x7ffa7800b7b0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 -- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80104950 msgr2=0x7ffa80197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80104950 0x7ffa80197930 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00d980 tx=0x7ffa6c00dc90 comp rx=0 tx=0).stop 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 -- 172.21.15.12:0/4213700431 shutdown_connections 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffa700a1500 0x7ffa700a39c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa80102020 0x7ffa801973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa80107280 0x7ffa8019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 --2- 172.21.15.12:0/4213700431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa80104950 0x7ffa80197930 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 -- 172.21.15.12:0/4213700431 >> 172.21.15.12:0/4213700431 conn(0x7ffa800fb930 msgr2=0x7ffa80103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 -- 172.21.15.12:0/4213700431 shutdown_connections 2023-12-11T20:27:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.375+0000 7ffa86fff700 1 -- 172.21.15.12:0/4213700431 wait complete. 2023-12-11T20:27:24.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:27:24.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 -- 172.21.15.12:0/3996775074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 msgr2=0x7fc0001098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 --2- 172.21.15.12:0/3996775074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 0x7fc0001098f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbff800b0d0 tx=0x7fbff800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 -- 172.21.15.12:0/3996775074 shutdown_connections 2023-12-11T20:27:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 --2- 172.21.15.12:0/3996775074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 0x7fc0001098f0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 --2- 172.21.15.12:0/3996775074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0001014b0 0x7fc0001018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 --2- 172.21.15.12:0/3996775074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0001026a0 0x7fc000102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 -- 172.21.15.12:0/3996775074 >> 172.21.15.12:0/3996775074 conn(0x7fc0000fca00 msgr2=0x7fc0000fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 -- 172.21.15.12:0/3996775074 shutdown_connections 2023-12-11T20:27:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.631+0000 7fc0065ff700 1 -- 172.21.15.12:0/3996775074 wait complete. 2023-12-11T20:27:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.632+0000 7fc0065ff700 1 Processor -- start 2023-12-11T20:27:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fc0065ff700 1 -- start start 2023-12-11T20:27:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fc0065ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0001014b0 0x7fc000197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fc0065ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0001026a0 0x7fc000197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fc0065ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 0x7fc00019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fc0065ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00019ef70 con 0x7fc000103040 2023-12-11T20:27:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fc0065ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00019f0b0 con 0x7fc0001026a0 2023-12-11T20:27:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fc0065ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00019f240 con 0x7fc0001014b0 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fbffffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0001014b0 0x7fc000197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fbffffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0001014b0 0x7fc000197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40536/0 (socket says 172.21.15.12:40536) 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fbffffff700 1 -- 172.21.15.12:0/588532673 learned_addr learned my addr 172.21.15.12:0/588532673 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.633+0000 7fc004b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 0x7fc00019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.634+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0001026a0 0x7fc000197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.634+0000 7fbffffff700 1 -- 172.21.15.12:0/588532673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0001026a0 msgr2=0x7fc000197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.634+0000 7fbffffff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0001026a0 0x7fc000197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.634+0000 7fbffffff700 1 -- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 msgr2=0x7fc00019e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.634+0000 7fbffffff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 0x7fc00019e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.634+0000 7fbffffff700 1 -- 172.21.15.12:0/588532673 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8009d00 con 0x7fc0001014b0 2023-12-11T20:27:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.634+0000 7fc004b9c700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 0x7fc00019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.634+0000 7fbffffff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0001014b0 0x7fc000197440 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbff000d980 tx=0x7fbff000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.635+0000 7fbffd7fa700 1 -- 172.21.15.12:0/588532673 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0004020 con 0x7fc0001014b0 2023-12-11T20:27:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.635+0000 7fc0065ff700 1 -- 172.21.15.12:0/588532673 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00019f520 con 0x7fc0001014b0 2023-12-11T20:27:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.635+0000 7fbffd7fa700 1 -- 172.21.15.12:0/588532673 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbff000f690 con 0x7fc0001014b0 2023-12-11T20:27:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.635+0000 7fbffd7fa700 1 -- 172.21.15.12:0/588532673 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff00039e0 con 0x7fc0001014b0 2023-12-11T20:27:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.635+0000 7fc0065ff700 1 -- 172.21.15.12:0/588532673 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00019fa80 con 0x7fc0001014b0 2023-12-11T20:27:24.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.638+0000 7fbffd7fa700 1 -- 172.21.15.12:0/588532673 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fbff000f800 con 0x7fc0001014b0 2023-12-11T20:27:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.639+0000 7fc019fd2b80 1 Processor -- start 2023-12-11T20:27:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.639+0000 7fc019fd2b80 1 -- start start 2023-12-11T20:27:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c7627e0 0x56079c762c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 0x56079c763a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c764030 0x56079c7644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c6b9b50 con 0x56079c764030 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c6b7470 con 0x56079c7627e0 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c6b2d60 con 0x56079c763140 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbfff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c764030 0x56079c7644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbfff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c764030 0x56079c7644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48942/0 (socket says 172.21.15.12:48942) 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbfff7fe700 1 -- 172.21.15.12:0/1377781879 learned_addr learned my addr 172.21.15.12:0/1377781879 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fc004b9c700 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c7627e0 0x56079c762c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbffffff700 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 0x56079c763a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbffd7fa700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbfe80a1480 0x7fbfe80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbfff7fe700 1 -- 172.21.15.12:0/1377781879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 msgr2=0x56079c763a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 0x56079c763a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fc004b9c700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbfe80a1480 0x7fbfe80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbffd7fa700 1 -- 172.21.15.12:0/588532673 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbff00cc970 con 0x7fc0001014b0 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.640+0000 7fbfff7fe700 1 -- 172.21.15.12:0/1377781879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c7627e0 msgr2=0x56079c762c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.641+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c7627e0 0x56079c762c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.641+0000 7fbfff7fe700 1 -- 172.21.15.12:0/1377781879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56079c52f630 con 0x56079c764030 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.641+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c764030 0x56079c7644b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbff400bd70 tx=0x7fbff40106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805d4636d5e67e77 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.641+0000 7fbfe67fc700 1 -- 172.21.15.12:0/1377781879 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4010e10 con 0x56079c764030 2023-12-11T20:27:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.641+0000 7fbfe67fc700 1 -- 172.21.15.12:0/1377781879 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbff4015070 con 0x56079c764030 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.641+0000 7fbfe67fc700 1 -- 172.21.15.12:0/1377781879 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4011680 con 0x56079c764030 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 -- 172.21.15.12:0/1377781879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c764030 msgr2=0x56079c7644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc004b9c700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbfe80a1480 0x7fbfe80a3940 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbff8007990 tx=0x7fbff800b3e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c764030 0x56079c7644b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbff400bd70 tx=0x7fbff40106b0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 -- 172.21.15.12:0/1377781879 shutdown_connections 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c7627e0 0x56079c762c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c764030 0x56079c7644b0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/1377781879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 0x56079c763a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 -- 172.21.15.12:0/1377781879 >> 172.21.15.12:0/1377781879 conn(0x56079c68d7e0 msgr2=0x56079c75ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 -- 172.21.15.12:0/1377781879 shutdown_connections 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.642+0000 7fc019fd2b80 1 -- 172.21.15.12:0/1377781879 wait complete. 2023-12-11T20:27:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.643+0000 7fc019fd2b80 1 -- start start 2023-12-11T20:27:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.643+0000 7fc019fd2b80 1 Processor -- start 2023-12-11T20:27:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.643+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.643+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 0x56079c76caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.643+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 0x56079c773b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.643+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c66c560 con 0x56079c7627e0 2023-12-11T20:27:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.643+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c66c200 con 0x56079c763140 2023-12-11T20:27:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.643+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c531920 con 0x56079c764030 2023-12-11T20:27:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fc019fd2b80 10 client.0 _ll_register_callbacks cb 0x56079c597a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbffffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbffffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48958/0 (socket says 172.21.15.12:48958) 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbffffff700 1 -- 172.21.15.12:0/944611584 learned_addr learned my addr 172.21.15.12:0/944611584 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fc004b9c700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 0x56079c773b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 0x56079c76caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbffffff700 1 -- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 msgr2=0x56079c773b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbffffff700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 0x56079c773b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbffffff700 1 -- 172.21.15.12:0/944611584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 msgr2=0x56079c76caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbffffff700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 0x56079c76caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbffffff700 1 -- 172.21.15.12:0/944611584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff400b9a0 con 0x56079c7627e0 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 0x56079c76caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.644+0000 7fc004b9c700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 0x56079c773b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fbffffff700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76c5b0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbff00998e0 tx=0x7fbff000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a57bd23233ee22 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fbfdf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/944611584 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff00cfea0 con 0x56079c7627e0 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/944611584 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbff00a1f70 con 0x56079c7627e0 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fc019fd2b80 1 -- 172.21.15.12:0/944611584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56079c751b40 con 0x56079c7627e0 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/944611584 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbff009dd30 con 0x56079c7627e0 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fc019fd2b80 10 client.18753 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fc019fd2b80 1 -- 172.21.15.12:0/944611584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56079c4dbde0 con 0x56079c7627e0 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/944611584 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbff00b6020 con 0x56079c7627e0 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.645+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/944611584 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbff00ccd20 con 0x56079c7627e0 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.646+0000 7fc019fd2b80 10 client.18753 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.646+0000 7fc019fd2b80 10 client.18753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.646+0000 7fc019fd2b80 20 client.18753 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.646+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56079c778340 0x56079c77a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.646+0000 7fc019fd2b80 4 client.18753 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.646+0000 7fc019fd2b80 1 -- 172.21.15.12:0/944611584 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56079c72df40 con 0x56079c778340 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.646+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56079c778340 0x56079c77a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.647+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56079c778340 0x56079c77a760 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8eb3a6832e2588c9 server_cookie=23b67f0c35c48566 in_seq=0 out_seq=0 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.647+0000 7fbfdf7fe700 10 client.18753 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.647+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/944611584 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56079c72df40 con 0x56079c778340 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.647+0000 7fbfdf7fe700 10 client.18753 handle_command_reply: tid=0 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.647+0000 7fc019fd2b80 1 client.18753 shutdown 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 -- 172.21.15.12:0/944611584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 msgr2=0x56079c76c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76c5b0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbff00998e0 tx=0x7fbff000fc30 comp rx=0 tx=0).stop 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 -- 172.21.15.12:0/944611584 shutdown_connections 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56079c778340 0x56079c77a760 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 0x56079c773b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fbfdf7fe700 0 client.18753 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76c5b0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/944611584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 0x56079c76caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 -- 172.21.15.12:0/944611584 >> 172.21.15.12:0/944611584 conn(0x56079c68d7e0 msgr2=0x56079c759a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 -- 172.21.15.12:0/944611584 shutdown_connections 2023-12-11T20:27:24.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 1 -- 172.21.15.12:0/944611584 wait complete. 2023-12-11T20:27:24.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.648+0000 7fc019fd2b80 20 client.18753 trim_cache size 0 max 16384 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.669+0000 7fc019fd2b80 1 Processor -- start 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.669+0000 7fc019fd2b80 1 -- start start 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 0x56079c773af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 0x56079c764410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c763840 con 0x56079c7627e0 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c7623e0 con 0x56079c763140 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c76a1f0 con 0x56079c764030 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48970/0 (socket says 172.21.15.12:48970) 2023-12-11T20:27:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 -- 172.21.15.12:0/2791522538 learned_addr learned my addr 172.21.15.12:0/2791522538 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 -- 172.21.15.12:0/2791522538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 msgr2=0x56079c764410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 --2- 172.21.15.12:0/2791522538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 0x56079c764410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 -- 172.21.15.12:0/2791522538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 msgr2=0x56079c773af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 --2- 172.21.15.12:0/2791522538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 0x56079c773af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 -- 172.21.15.12:0/2791522538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56079c4c4c60 con 0x56079c7627e0 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.670+0000 7fbffffff700 1 --2- 172.21.15.12:0/2791522538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76bac0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fbff000be80 tx=0x7fbff0099ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9988465520eaa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.671+0000 7fbfe6ffd700 1 -- 172.21.15.12:0/2791522538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff00a1db0 con 0x56079c7627e0 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.671+0000 7fbfe6ffd700 1 -- 172.21.15.12:0/2791522538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbff00b6070 con 0x56079c7627e0 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.671+0000 7fbfe6ffd700 1 -- 172.21.15.12:0/2791522538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff009a0a0 con 0x56079c7627e0 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.671+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2791522538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 msgr2=0x56079c76bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.671+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2791522538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76bac0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fbff000be80 tx=0x7fbff0099ae0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.672+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2791522538 shutdown_connections 2023-12-11T20:27:24.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.672+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2791522538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c764030 0x56079c764410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.672+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2791522538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c76bac0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.672+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2791522538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c763140 0x56079c773af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.672+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2791522538 >> 172.21.15.12:0/2791522538 conn(0x56079c68d7e0 msgr2=0x56079c76a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.672+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2791522538 shutdown_connections 2023-12-11T20:27:24.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.672+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2791522538 wait complete. 2023-12-11T20:27:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.672+0000 7fc019fd2b80 1 -- start start 2023-12-11T20:27:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fc019fd2b80 1 Processor -- start 2023-12-11T20:27:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c771510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 0x56079c771a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fc019fd2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c764030 0x56079c772a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c772fa0 con 0x56079c7627e0 2023-12-11T20:27:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c773110 con 0x56079c764030 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fc019fd2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56079c7732d0 con 0x56079c763140 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fc019fd2b80 10 client.0 _ll_register_callbacks cb 0x56079c597a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.673+0000 7fbffffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c771510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbffffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c771510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48972/0 (socket says 172.21.15.12:48972) 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbffffff700 1 -- 172.21.15.12:0/2542907685 learned_addr learned my addr 172.21.15.12:0/2542907685 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fc004b9c700 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c764030 0x56079c772a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 0x56079c771a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbffffff700 1 -- 172.21.15.12:0/2542907685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 msgr2=0x56079c771a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbffffff700 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 0x56079c771a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbffffff700 1 -- 172.21.15.12:0/2542907685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c764030 msgr2=0x56079c772a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbffffff700 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c764030 0x56079c772a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbffffff700 1 -- 172.21.15.12:0/2542907685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56079c4dbde0 con 0x56079c7627e0 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbffffff700 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c771510 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fbff000feb0 tx=0x7fbff00990d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246b45e26bc581fb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbfdf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/2542907685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff009a040 con 0x56079c7627e0 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2542907685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbff4015070 con 0x56079c7627e0 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.674+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/2542907685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbff00b7080 con 0x56079c7627e0 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/2542907685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbff0004180 con 0x56079c7627e0 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fc019fd2b80 10 client.18759 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2542907685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56079c502250 con 0x56079c7627e0 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/2542907685 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbff4015070 con 0x56079c7627e0 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/2542907685 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbff0095af0 con 0x56079c7627e0 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fc019fd2b80 10 client.18759 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fc019fd2b80 10 client.18759 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fc019fd2b80 20 client.18759 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56079c7cee10 0x56079c7d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fc019fd2b80 4 client.18759 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:27:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.675+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2542907685 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56079c678fd0 con 0x56079c7cee10 2023-12-11T20:27:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.676+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56079c7cee10 0x56079c7d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.676+0000 7fbfff7fe700 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56079c7cee10 0x56079c7d1200 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dcf2f3cbb0ff5019 server_cookie=30558c70bf99208b in_seq=0 out_seq=0 2023-12-11T20:27:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.676+0000 7fbfdf7fe700 10 client.18759 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fbfdf7fe700 1 -- 172.21.15.12:0/2542907685 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56079c678fd0 con 0x56079c7cee10 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fbfdf7fe700 10 client.18759 handle_command_reply: tid=0 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 client.18759 shutdown 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2542907685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 msgr2=0x56079c771510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c771510 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fbff000feb0 tx=0x7fbff00990d0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2542907685 shutdown_connections 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56079c7cee10 0x56079c7d1200 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56079c764030 0x56079c772a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56079c7627e0 0x56079c771510 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 --2- 172.21.15.12:0/2542907685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56079c763140 0x56079c771a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fbfdf7fe700 0 client.18759 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2542907685 >> 172.21.15.12:0/2542907685 conn(0x56079c68d7e0 msgr2=0x56079c75a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2542907685 shutdown_connections 2023-12-11T20:27:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 1 -- 172.21.15.12:0/2542907685 wait complete. 2023-12-11T20:27:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.677+0000 7fc019fd2b80 20 client.18759 trim_cache size 0 max 16384 2023-12-11T20:27:24.680 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:27:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 -- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbfe80a1480 msgr2=0x7fbfe80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbfe80a1480 0x7fbfe80a3940 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbff8007990 tx=0x7fbff800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 -- 172.21.15.12:0/588532673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0001014b0 msgr2=0x7fc000197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0001014b0 0x7fc000197440 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbff000d980 tx=0x7fbff000dc90 comp rx=0 tx=0).stop 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 -- 172.21.15.12:0/588532673 shutdown_connections 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbfe80a1480 0x7fbfe80a3940 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc000103040 0x7fc00019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc0001014b0 0x7fc000197440 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 --2- 172.21.15.12:0/588532673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0001026a0 0x7fc000197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 -- 172.21.15.12:0/588532673 >> 172.21.15.12:0/588532673 conn(0x7fc0000fca00 msgr2=0x7fc000105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 -- 172.21.15.12:0/588532673 shutdown_connections 2023-12-11T20:27:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.678+0000 7fc0065ff700 1 -- 172.21.15.12:0/588532673 wait complete. 2023-12-11T20:27:24.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:27:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 -- 172.21.15.12:0/1382283027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1048e0 msgr2=0x7fbecc104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 --2- 172.21.15.12:0/1382283027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1048e0 0x7fbecc104d40 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0099c0 tx=0x7fbebc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 -- 172.21.15.12:0/1382283027 shutdown_connections 2023-12-11T20:27:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 --2- 172.21.15.12:0/1382283027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbecc105280 0x7fbecc10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 --2- 172.21.15.12:0/1382283027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbecc1036f0 0x7fbecc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 --2- 172.21.15.12:0/1382283027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1048e0 0x7fbecc104d40 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 -- 172.21.15.12:0/1382283027 >> 172.21.15.12:0/1382283027 conn(0x7fbecc0fec80 msgr2=0x7fbecc1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 -- 172.21.15.12:0/1382283027 shutdown_connections 2023-12-11T20:27:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.934+0000 7fbed3fff700 1 -- 172.21.15.12:0/1382283027 wait complete. 2023-12-11T20:27:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.935+0000 7fbed3fff700 1 Processor -- start 2023-12-11T20:27:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.935+0000 7fbed3fff700 1 -- start start 2023-12-11T20:27:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.935+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1036f0 0x7fbecc199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.935+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbecc1048e0 0x7fbecc199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.935+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbecc105280 0x7fbecc1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.935+0000 7fbed3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1a10c0 con 0x7fbecc1036f0 2023-12-11T20:27:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.935+0000 7fbed3fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1a1200 con 0x7fbecc105280 2023-12-11T20:27:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.935+0000 7fbed3fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1a1390 con 0x7fbecc1048e0 2023-12-11T20:27:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1036f0 0x7fbecc199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1036f0 0x7fbecc199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48996/0 (socket says 172.21.15.12:48996) 2023-12-11T20:27:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 -- 172.21.15.12:0/2487197590 learned_addr learned my addr 172.21.15.12:0/2487197590 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed259c700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbecc105280 0x7fbecc1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed159a700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbecc1048e0 0x7fbecc199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 -- 172.21.15.12:0/2487197590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbecc1048e0 msgr2=0x7fbecc199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbecc1048e0 0x7fbecc199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 -- 172.21.15.12:0/2487197590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbecc105280 msgr2=0x7fbecc1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbecc105280 0x7fbecc1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 -- 172.21.15.12:0/2487197590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0095f0 con 0x7fbecc1036f0 2023-12-11T20:27:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.936+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1036f0 0x7fbecc199590 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fbec800e970 tx=0x7fbec800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.937+0000 7fbec2ffd700 1 -- 172.21.15.12:0/2487197590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8009790 con 0x7fbecc1036f0 2023-12-11T20:27:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.937+0000 7fbec2ffd700 1 -- 172.21.15.12:0/2487197590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbec800eec0 con 0x7fbecc1036f0 2023-12-11T20:27:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.937+0000 7fbed3fff700 1 -- 172.21.15.12:0/2487197590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc1a1670 con 0x7fbecc1036f0 2023-12-11T20:27:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.937+0000 7fbec2ffd700 1 -- 172.21.15.12:0/2487197590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8003c10 con 0x7fbecc1036f0 2023-12-11T20:27:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.937+0000 7fbed3fff700 1 -- 172.21.15.12:0/2487197590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc1a1bd0 con 0x7fbecc1036f0 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.940+0000 7fbec2ffd700 1 -- 172.21.15.12:0/2487197590 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fbec8003db0 con 0x7fbecc1036f0 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbee7899b80 1 Processor -- start 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbee7899b80 1 -- start start 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbec2ffd700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbeb80a1500 0x7fbeb80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbec2ffd700 1 -- 172.21.15.12:0/2487197590 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbec8014070 con 0x7fbecc1036f0 2023-12-11T20:27:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbee7899b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d12cb50 con 0x55ae8d1d13d0 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbee7899b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d12a470 con 0x55ae8d1d2c20 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.942+0000 7fbee7899b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d125d60 con 0x55ae8d1d1d30 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49000/0 (socket says 172.21.15.12:49000) 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 -- 172.21.15.12:0/1578076 learned_addr learned my addr 172.21.15.12:0/1578076 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed259c700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbeb80a1500 0x7fbeb80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed159a700 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed259c700 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 -- 172.21.15.12:0/1578076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 msgr2=0x55ae8d1d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 -- 172.21.15.12:0/1578076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 msgr2=0x55ae8d1d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1d30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 -- 172.21.15.12:0/1578076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae8cfa2630 con 0x55ae8d1d13d0 2023-12-11T20:27:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed159a700 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.943+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fbec8096720 tx=0x7fbec8099e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb226b20b4fa6e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.944+0000 7fbed259c700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbeb80a1500 0x7fbeb80a39c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55ae8d1d2400 tx=0x7fbec400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.944+0000 7fbeb7fff700 1 -- 172.21.15.12:0/1578076 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec80b1070 con 0x55ae8d1d13d0 2023-12-11T20:27:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.944+0000 7fbeb7fff700 1 -- 172.21.15.12:0/1578076 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbec809e170 con 0x55ae8d1d13d0 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.944+0000 7fbeb7fff700 1 -- 172.21.15.12:0/1578076 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec809a480 con 0x55ae8d1d13d0 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 -- 172.21.15.12:0/1578076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d13d0 msgr2=0x55ae8d1d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fbec8096720 tx=0x7fbec8099e60 comp rx=0 tx=0).stop 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 -- 172.21.15.12:0/1578076 shutdown_connections 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17f0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1578076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 -- 172.21.15.12:0/1578076 >> 172.21.15.12:0/1578076 conn(0x55ae8d1007e0 msgr2=0x55ae8d1cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 -- 172.21.15.12:0/1578076 shutdown_connections 2023-12-11T20:27:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 -- 172.21.15.12:0/1578076 wait complete. 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.945+0000 7fbee7899b80 1 -- start start 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.946+0000 7fbee7899b80 1 Processor -- start 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.946+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.946+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.946+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.946+0000 7fbee7899b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d0df560 con 0x55ae8d1d1d30 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.946+0000 7fbee7899b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d0df200 con 0x55ae8d1d13d0 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.946+0000 7fbee7899b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8cfa4920 con 0x55ae8d1d2c20 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.946+0000 7fbee7899b80 10 client.0 _ll_register_callbacks cb 0x55ae8d00aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49004/0 (socket says 172.21.15.12:49004) 2023-12-11T20:27:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 -- 172.21.15.12:0/1865783038 learned_addr learned my addr 172.21.15.12:0/1865783038 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed259c700 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 -- 172.21.15.12:0/1865783038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d2c20 msgr2=0x55ae8d1eaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1eaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 -- 172.21.15.12:0/1865783038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 msgr2=0x55ae8d1e39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 -- 172.21.15.12:0/1865783038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc1a1bd0 con 0x55ae8d1d1d30 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbed159a700 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e3f00 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0099c0 tx=0x7fbebc005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55dd30018182039b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.947+0000 7fbeb57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.948+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1865783038 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc01d050 con 0x55ae8d1d1d30 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.948+0000 7fbee7899b80 1 -- 172.21.15.12:0/1865783038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae8d1c4b40 con 0x55ae8d1d1d30 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.948+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1865783038 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbebc005620 con 0x55ae8d1d1d30 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.948+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1865783038 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbebc003760 con 0x55ae8d1d1d30 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.948+0000 7fbee7899b80 10 client.18771 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.948+0000 7fbee7899b80 1 -- 172.21.15.12:0/1865783038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ae8cf4ede0 con 0x55ae8d1d1d30 2023-12-11T20:27:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.948+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1865783038 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbebc032020 con 0x55ae8d1d1d30 2023-12-11T20:27:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.948+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1865783038 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbebc023990 con 0x55ae8d1d1d30 2023-12-11T20:27:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.949+0000 7fbee7899b80 10 client.18771 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.949+0000 7fbee7899b80 10 client.18771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.949+0000 7fbee7899b80 20 client.18771 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.949+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8d1ef7e0 0x55ae8d1f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.949+0000 7fbee7899b80 4 client.18771 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.949+0000 7fbee7899b80 1 -- 172.21.15.12:0/1865783038 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae8d1a0f40 con 0x55ae8d1ef7e0 2023-12-11T20:27:24.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.949+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8d1ef7e0 0x55ae8d1f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.950+0000 7fbeb57fa700 10 client.18771 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.950+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8d1ef7e0 0x55ae8d1f1c00 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a07358136bbd3 server_cookie=aa41289c0ea04cec in_seq=0 out_seq=0 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.950+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1865783038 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ae8d1a0f40 con 0x55ae8d1ef7e0 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.950+0000 7fbeb57fa700 10 client.18771 handle_command_reply: tid=0 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.950+0000 7fbee7899b80 1 client.18771 shutdown 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 -- 172.21.15.12:0/1865783038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 msgr2=0x55ae8d1e3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e3f00 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0099c0 tx=0x7fbebc005c00 comp rx=0 tx=0).stop 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 -- 172.21.15.12:0/1865783038 shutdown_connections 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8d1ef7e0 0x55ae8d1f1c00 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1865783038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e3f00 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 -- 172.21.15.12:0/1865783038 >> 172.21.15.12:0/1865783038 conn(0x55ae8d1007e0 msgr2=0x55ae8d1cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbeb57fa700 0 client.18771 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:24.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 -- 172.21.15.12:0/1865783038 shutdown_connections 2023-12-11T20:27:24.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 1 -- 172.21.15.12:0/1865783038 wait complete. 2023-12-11T20:27:24.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.951+0000 7fbee7899b80 20 client.18771 trim_cache size 0 max 16384 2023-12-11T20:27:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.967+0000 7fbee7899b80 1 Processor -- start 2023-12-11T20:27:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.967+0000 7fbee7899b80 1 -- start start 2023-12-11T20:27:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.967+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.967+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.967+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1f6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.967+0000 7fbee7899b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d1c8b50 con 0x55ae8d1d1d30 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.967+0000 7fbee7899b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d1e23c0 con 0x55ae8d1d2c20 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.967+0000 7fbee7899b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d1e4640 con 0x55ae8d1d13d0 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1eaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49006/0 (socket says 172.21.15.12:49006) 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 -- 172.21.15.12:0/38578907 learned_addr learned my addr 172.21.15.12:0/38578907 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed259c700 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 -- 172.21.15.12:0/38578907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d13d0 msgr2=0x55ae8d1d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 -- 172.21.15.12:0/38578907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 msgr2=0x55ae8d1f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 -- 172.21.15.12:0/38578907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae8cf37c60 con 0x55ae8d1d1d30 2023-12-11T20:27:24.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.968+0000 7fbed159a700 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1eaf00 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fbebc006010 tx=0x7fbebc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492795dc67233de server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.969+0000 7fbec0ff9700 1 -- 172.21.15.12:0/38578907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc01d040 con 0x55ae8d1d1d30 2023-12-11T20:27:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.969+0000 7fbec0ff9700 1 -- 172.21.15.12:0/38578907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ae8d1c4b40 con 0x55ae8d1d1d30 2023-12-11T20:27:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.969+0000 7fbec0ff9700 1 -- 172.21.15.12:0/38578907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0039c0 con 0x55ae8d1d1d30 2023-12-11T20:27:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.969+0000 7fbee7899b80 1 -- 172.21.15.12:0/38578907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 msgr2=0x55ae8d1eaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.969+0000 7fbee7899b80 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1eaf00 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fbebc006010 tx=0x7fbebc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 -- 172.21.15.12:0/38578907 shutdown_connections 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 --2- 172.21.15.12:0/38578907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1eaf00 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 -- 172.21.15.12:0/38578907 >> 172.21.15.12:0/38578907 conn(0x55ae8d1007e0 msgr2=0x55ae8d1d9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 -- 172.21.15.12:0/38578907 shutdown_connections 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 -- 172.21.15.12:0/38578907 wait complete. 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 -- start start 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.970+0000 7fbee7899b80 1 Processor -- start 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbee7899b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbee7899b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d1ea1f0 con 0x55ae8d1d2c20 2023-12-11T20:27:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbee7899b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d1ea360 con 0x55ae8d1d13d0 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbee7899b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae8d1ea520 con 0x55ae8d1d1d30 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbee7899b80 10 client.0 _ll_register_callbacks cb 0x55ae8d00aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbed259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbed259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1e9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49020/0 (socket says 172.21.15.12:49020) 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbed259c700 1 -- 172.21.15.12:0/1450927175 learned_addr learned my addr 172.21.15.12:0/1450927175 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbed159a700 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.971+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbed259c700 1 -- 172.21.15.12:0/1450927175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 msgr2=0x55ae8d1e8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbed259c700 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbed259c700 1 -- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 msgr2=0x55ae8d1e8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbed259c700 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbed259c700 1 -- 172.21.15.12:0/1450927175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae8cf4ede0 con 0x55ae8d1d2c20 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbed259c700 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1e9cb0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbec4019c40 tx=0x7fbec4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd374f563f99a5e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbeb57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1450927175 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4004bb0 con 0x55ae8d1d2c20 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbee7899b80 1 -- 172.21.15.12:0/1450927175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbec809e170 con 0x55ae8d1d2c20 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.972+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1450927175 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbec4004d10 con 0x55ae8d1d2c20 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1450927175 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec4018760 con 0x55ae8d1d2c20 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbee7899b80 10 client.18777 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbee7899b80 1 -- 172.21.15.12:0/1450927175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ae8cf75250 con 0x55ae8d1d2c20 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1450927175 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbec809e170 con 0x55ae8d1d2c20 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1450927175 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbec40268e0 con 0x55ae8d1d2c20 2023-12-11T20:27:24.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbee7899b80 10 client.18777 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbee7899b80 10 client.18777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbee7899b80 20 client.18777 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8d2467f0 0x55ae8d248c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbee7899b80 4 client.18777 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:27:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.973+0000 7fbee7899b80 1 -- 172.21.15.12:0/1450927175 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ae8d0ebfd0 con 0x55ae8d2467f0 2023-12-11T20:27:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.974+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8d2467f0 0x55ae8d248c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.974+0000 7fbeb57fa700 10 client.18777 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:24.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.974+0000 7fbed1d9b700 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8d2467f0 0x55ae8d248c10 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2a387f751dcbf11 server_cookie=638c1d25f96c8d57 in_seq=0 out_seq=0 2023-12-11T20:27:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbeb57fa700 1 -- 172.21.15.12:0/1450927175 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ae8d0ebfd0 con 0x55ae8d2467f0 2023-12-11T20:27:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbeb57fa700 10 client.18777 handle_command_reply: tid=0 2023-12-11T20:27:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 client.18777 shutdown 2023-12-11T20:27:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 -- 172.21.15.12:0/1450927175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d2c20 msgr2=0x55ae8d1e9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1e9cb0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbec4019c40 tx=0x7fbec4004b40 comp rx=0 tx=0).stop 2023-12-11T20:27:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 -- 172.21.15.12:0/1450927175 shutdown_connections 2023-12-11T20:27:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ae8d2467f0 0x55ae8d248c10 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ae8d1d13d0 0x55ae8d1e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae8d1d2c20 0x55ae8d1e9cb0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 --2- 172.21.15.12:0/1450927175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ae8d1d1d30 0x55ae8d1e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 -- 172.21.15.12:0/1450927175 >> 172.21.15.12:0/1450927175 conn(0x55ae8d1007e0 msgr2=0x55ae8d1f6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbeb57fa700 0 client.18777 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:24.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 -- 172.21.15.12:0/1450927175 shutdown_connections 2023-12-11T20:27:24.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 1 -- 172.21.15.12:0/1450927175 wait complete. 2023-12-11T20:27:24.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.975+0000 7fbee7899b80 20 client.18777 trim_cache size 0 max 16384 2023-12-11T20:27:24.983 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:27:24.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 -- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbeb80a1500 msgr2=0x7fbeb80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbeb80a1500 0x7fbeb80a39c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55ae8d1d2400 tx=0x7fbec400b040 comp rx=0 tx=0).stop 2023-12-11T20:27:24.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 -- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1036f0 msgr2=0x7fbecc199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1036f0 0x7fbecc199590 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fbec800e970 tx=0x7fbec800ec80 comp rx=0 tx=0).stop 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 -- 172.21.15.12:0/2487197590 shutdown_connections 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbeb80a1500 0x7fbeb80a39c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbecc105280 0x7fbecc1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbecc1036f0 0x7fbecc199590 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 --2- 172.21.15.12:0/2487197590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbecc1048e0 0x7fbecc199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 -- 172.21.15.12:0/2487197590 >> 172.21.15.12:0/2487197590 conn(0x7fbecc0fec80 msgr2=0x7fbecc107d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 -- 172.21.15.12:0/2487197590 shutdown_connections 2023-12-11T20:27:24.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:24.976+0000 7fbed3fff700 1 -- 172.21.15.12:0/2487197590 wait complete. 2023-12-11T20:27:24.995 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:24 smithi012 ceph-mon[128787]: pgmap v719: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:24.995 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:24 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2296028858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:27:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:24 smithi032 ceph-mon[132488]: pgmap v719: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:24 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2296028858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:27:25.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:24 smithi039 ceph-mon[102205]: pgmap v719: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:25.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:24 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2296028858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:27:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 -- 172.21.15.12:0/2066572814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c1010d0 msgr2=0x7fdd7c101550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 --2- 172.21.15.12:0/2066572814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c1010d0 0x7fdd7c101550 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400b0a0 tx=0x7fdd7400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 -- 172.21.15.12:0/2066572814 shutdown_connections 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 --2- 172.21.15.12:0/2066572814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c1010d0 0x7fdd7c101550 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 --2- 172.21.15.12:0/2066572814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7c0ffdb0 0x7fdd7c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 --2- 172.21.15.12:0/2066572814 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd7c100710 0x7fdd7c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 -- 172.21.15.12:0/2066572814 >> 172.21.15.12:0/2066572814 conn(0x7fdd7c0fb930 msgr2=0x7fdd7c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 -- 172.21.15.12:0/2066572814 shutdown_connections 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.416+0000 7fdd82bff700 1 -- 172.21.15.12:0/2066572814 wait complete. 2023-12-11T20:27:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.418+0000 7fdd82bff700 1 Processor -- start 2023-12-11T20:27:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.418+0000 7fdd82bff700 1 -- start start 2023-12-11T20:27:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.418+0000 7fdd82bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c0ffdb0 0x7fdd7c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd82bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7c100710 0x7fdd7c199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd82bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd7c1010d0 0x7fdd7c1a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd82bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c1a11b0 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd82bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c1a12f0 con 0x7fdd7c1010d0 2023-12-11T20:27:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd82bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c1a1480 con 0x7fdd7c100710 2023-12-11T20:27:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c0ffdb0 0x7fdd7c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd7bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7c100710 0x7fdd7c199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c0ffdb0 0x7fdd7c199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49044/0 (socket says 172.21.15.12:49044) 2023-12-11T20:27:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8099b700 1 -- 172.21.15.12:0/3640307998 learned_addr learned my addr 172.21.15.12:0/3640307998 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8119c700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd7c1010d0 0x7fdd7c1a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8099b700 1 -- 172.21.15.12:0/3640307998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7c100710 msgr2=0x7fdd7c199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8099b700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7c100710 0x7fdd7c199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8099b700 1 -- 172.21.15.12:0/3640307998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd7c1010d0 msgr2=0x7fdd7c1a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8099b700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd7c1010d0 0x7fdd7c1a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.419+0000 7fdd8099b700 1 -- 172.21.15.12:0/3640307998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74009d00 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.420+0000 7fdd8099b700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c0ffdb0 0x7fdd7c199680 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000e9a0 tx=0x7fdd7000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.420+0000 7fdd79ffb700 1 -- 172.21.15.12:0/3640307998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70009790 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.420+0000 7fdd79ffb700 1 -- 172.21.15.12:0/3640307998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd70010430 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.420+0000 7fdd82bff700 1 -- 172.21.15.12:0/3640307998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7c1a1760 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.420+0000 7fdd79ffb700 1 -- 172.21.15.12:0/3640307998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000cea0 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.420+0000 7fdd82bff700 1 -- 172.21.15.12:0/3640307998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c1a1c20 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.425+0000 7fdd79ffb700 1 -- 172.21.15.12:0/3640307998 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fdd700105a0 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.426+0000 7fdd96421b80 1 Processor -- start 2023-12-11T20:27:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.426+0000 7fdd96421b80 1 -- start start 2023-12-11T20:27:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d6a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d6aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd96421b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2cc4af0 con 0x560db2d68ed0 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd96421b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2cc2410 con 0x560db2d6a720 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd96421b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2cbdd00 con 0x560db2d69830 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd79ffb700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdd6c0a1470 0x7fdd6c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd79ffb700 1 -- 172.21.15.12:0/3640307998 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd70014070 con 0x7fdd7c0ffdb0 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd8119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd8119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d692f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49052/0 (socket says 172.21.15.12:49052) 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd8119c700 1 -- 172.21.15.12:0/2158852101 learned_addr learned my addr 172.21.15.12:0/2158852101 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd8119c700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdd6c0a1470 0x7fdd6c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd8099b700 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d6a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.427+0000 7fdd7bfff700 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d6aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.428+0000 7fdd8099b700 1 -- 172.21.15.12:0/2158852101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 msgr2=0x560db2d6aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.428+0000 7fdd8099b700 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d6aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.428+0000 7fdd8099b700 1 -- 172.21.15.12:0/2158852101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 msgr2=0x560db2d692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.428+0000 7fdd8099b700 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.428+0000 7fdd8099b700 1 -- 172.21.15.12:0/2158852101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560db2b3a5d0 con 0x560db2d69830 2023-12-11T20:27:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.428+0000 7fdd8119c700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdd6c0a1470 0x7fdd6c0a3930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009cd0 tx=0x7fdd7400b700 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.428+0000 7fdd8099b700 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d6a140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd70099ee0 tx=0x7fdd7009a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e651529fb0cd3efd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd66ffd700 1 -- 172.21.15.12:0/2158852101 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7009e120 con 0x560db2d69830 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd66ffd700 1 -- 172.21.15.12:0/2158852101 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7009a8e0 con 0x560db2d69830 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd66ffd700 1 -- 172.21.15.12:0/2158852101 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd700996d0 con 0x560db2d69830 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd96421b80 1 -- 172.21.15.12:0/2158852101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 msgr2=0x560db2d6a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd96421b80 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d6a140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd70099ee0 tx=0x7fdd7009a0e0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd96421b80 1 -- 172.21.15.12:0/2158852101 shutdown_connections 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd96421b80 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d6aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd96421b80 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd96421b80 1 --2- 172.21.15.12:0/2158852101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d6a140 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.429+0000 7fdd96421b80 1 -- 172.21.15.12:0/2158852101 >> 172.21.15.12:0/2158852101 conn(0x560db2c98780 msgr2=0x560db2d65880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:25.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.430+0000 7fdd96421b80 1 -- 172.21.15.12:0/2158852101 shutdown_connections 2023-12-11T20:27:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.430+0000 7fdd96421b80 1 -- 172.21.15.12:0/2158852101 wait complete. 2023-12-11T20:27:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.430+0000 7fdd96421b80 1 -- start start 2023-12-11T20:27:25.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.430+0000 7fdd96421b80 1 Processor -- start 2023-12-11T20:27:25.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d72eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d6a720 0x560db2d7a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd96421b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2c77500 con 0x560db2d6a720 2023-12-11T20:27:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd96421b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2c771a0 con 0x560db2d68ed0 2023-12-11T20:27:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd96421b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2b3c8c0 con 0x560db2d69830 2023-12-11T20:27:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd96421b80 10 client.0 _ll_register_callbacks cb 0x560db2ba2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd8119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d6a720 0x560db2d7a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd8119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d6a720 0x560db2d7a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49062/0 (socket says 172.21.15.12:49062) 2023-12-11T20:27:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd8119c700 1 -- 172.21.15.12:0/500203954 learned_addr learned my addr 172.21.15.12:0/500203954 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd7bfff700 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.431+0000 7fdd8099b700 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d72eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd8119c700 1 -- 172.21.15.12:0/500203954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 msgr2=0x560db2d733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd8119c700 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd8119c700 1 -- 172.21.15.12:0/500203954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 msgr2=0x560db2d72eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd8119c700 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d72eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd8119c700 1 -- 172.21.15.12:0/500203954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c1a1c20 con 0x560db2d6a720 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd8119c700 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d6a720 0x560db2d7a220 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400cd00 tx=0x7fdd740099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecde247d24e6483c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd5bfff700 1 -- 172.21.15.12:0/500203954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7400e040 con 0x560db2d6a720 2023-12-11T20:27:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd5bfff700 1 -- 172.21.15.12:0/500203954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd74020450 con 0x560db2d6a720 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.432+0000 7fdd96421b80 1 -- 172.21.15.12:0/500203954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560db2d5c730 con 0x560db2d6a720 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd5bfff700 1 -- 172.21.15.12:0/500203954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd74020650 con 0x560db2d6a720 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd96421b80 10 client.18789 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd96421b80 1 -- 172.21.15.12:0/500203954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560db2ae6d80 con 0x560db2d6a720 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd5bfff700 1 -- 172.21.15.12:0/500203954 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7403a080 con 0x560db2d6a720 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd5bfff700 1 -- 172.21.15.12:0/500203954 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdd7402a070 con 0x560db2d6a720 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd96421b80 10 client.18789 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd96421b80 10 client.18789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd96421b80 20 client.18789 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd96421b80 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560db2d7eca0 0x560db2d810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd96421b80 4 client.18789 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.433+0000 7fdd96421b80 1 -- 172.21.15.12:0/500203954 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560db2d38ee0 con 0x560db2d7eca0 2023-12-11T20:27:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.434+0000 7fdd8099b700 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560db2d7eca0 0x560db2d810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.434+0000 7fdd5bfff700 10 client.18789 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.434+0000 7fdd8099b700 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560db2d7eca0 0x560db2d810c0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7bb2a6082ccfec2 server_cookie=d8875beb5b2d832b in_seq=0 out_seq=0 2023-12-11T20:27:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.435+0000 7fdd5bfff700 1 -- 172.21.15.12:0/500203954 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560db2d38ee0 con 0x560db2d7eca0 2023-12-11T20:27:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.435+0000 7fdd5bfff700 10 client.18789 handle_command_reply: tid=0 2023-12-11T20:27:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.435+0000 7fdd96421b80 1 client.18789 shutdown 2023-12-11T20:27:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.435+0000 7fdd96421b80 1 -- 172.21.15.12:0/500203954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d6a720 msgr2=0x560db2d7a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.435+0000 7fdd96421b80 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d6a720 0x560db2d7a220 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400cd00 tx=0x7fdd740099e0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 1 -- 172.21.15.12:0/500203954 shutdown_connections 2023-12-11T20:27:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560db2d7eca0 0x560db2d810c0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d72eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d6a720 0x560db2d7a220 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd5bfff700 0 client.18789 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 1 --2- 172.21.15.12:0/500203954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 1 -- 172.21.15.12:0/500203954 >> 172.21.15.12:0/500203954 conn(0x560db2c98780 msgr2=0x560db2d63ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 1 -- 172.21.15.12:0/500203954 shutdown_connections 2023-12-11T20:27:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 1 -- 172.21.15.12:0/500203954 wait complete. 2023-12-11T20:27:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.436+0000 7fdd96421b80 20 client.18789 trim_cache size 0 max 16384 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.453+0000 7fdd96421b80 1 Processor -- start 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.453+0000 7fdd96421b80 1 -- start start 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.453+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.453+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d69830 0x560db2d7a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.453+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d6a720 0x560db2d6ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.453+0000 7fdd96421b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2d7a820 con 0x560db2d69830 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.453+0000 7fdd96421b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2d862f0 con 0x560db2d68ed0 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.453+0000 7fdd96421b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2d69c10 con 0x560db2d6a720 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d69830 0x560db2d7a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d69830 0x560db2d7a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49072/0 (socket says 172.21.15.12:49072) 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 -- 172.21.15.12:0/2979743947 learned_addr learned my addr 172.21.15.12:0/2979743947 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd8099b700 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd8119c700 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d6a720 0x560db2d6ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 -- 172.21.15.12:0/2979743947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d6a720 msgr2=0x560db2d6ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d6a720 0x560db2d6ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 -- 172.21.15.12:0/2979743947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 msgr2=0x560db2d7ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d7ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 -- 172.21.15.12:0/2979743947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560db2acfc00 con 0x560db2d69830 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd8099b700 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d7ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.454+0000 7fdd7bfff700 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d69830 0x560db2d7a1e0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009ec0 tx=0x7fdd68009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8974c0e27a760183 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.455+0000 7fdd677fe700 1 -- 172.21.15.12:0/2979743947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68017050 con 0x560db2d69830 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.455+0000 7fdd677fe700 1 -- 172.21.15.12:0/2979743947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd68018040 con 0x560db2d69830 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.455+0000 7fdd677fe700 1 -- 172.21.15.12:0/2979743947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68003a00 con 0x560db2d69830 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.455+0000 7fdd96421b80 1 -- 172.21.15.12:0/2979743947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d69830 msgr2=0x560db2d7a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.455+0000 7fdd96421b80 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d69830 0x560db2d7a1e0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009ec0 tx=0x7fdd68009260 comp rx=0 tx=0).stop 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 -- 172.21.15.12:0/2979743947 shutdown_connections 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d68ed0 0x560db2d7ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d6a720 0x560db2d6ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 --2- 172.21.15.12:0/2979743947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d69830 0x560db2d7a1e0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 -- 172.21.15.12:0/2979743947 >> 172.21.15.12:0/2979743947 conn(0x560db2c98780 msgr2=0x560db2d70c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 -- 172.21.15.12:0/2979743947 shutdown_connections 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 -- 172.21.15.12:0/2979743947 wait complete. 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 -- start start 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.456+0000 7fdd96421b80 1 Processor -- start 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d77ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d78410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd96421b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d792e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd96421b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2d79820 con 0x560db2d68ed0 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd96421b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2d79990 con 0x560db2d6a720 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd96421b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2d79b50 con 0x560db2d69830 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd96421b80 10 client.0 _ll_register_callbacks cb 0x560db2ba2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:25.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd8099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d77ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd8099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d77ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49082/0 (socket says 172.21.15.12:49082) 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd8099b700 1 -- 172.21.15.12:0/3908369714 learned_addr learned my addr 172.21.15.12:0/3908369714 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd7bfff700 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d78410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.457+0000 7fdd8119c700 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d792e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd8099b700 1 -- 172.21.15.12:0/3908369714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 msgr2=0x560db2d78410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd8099b700 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d78410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd8099b700 1 -- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 msgr2=0x560db2d792e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd8099b700 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d792e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd8099b700 1 -- 172.21.15.12:0/3908369714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd700b1040 con 0x560db2d68ed0 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd8119c700 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d792e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd8099b700 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d77ed0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fdd70096c50 tx=0x7fdd700ccff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571f58c3397d12fa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd5bfff700 1 -- 172.21.15.12:0/3908369714 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd700a2570 con 0x560db2d68ed0 2023-12-11T20:27:25.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd96421b80 1 -- 172.21.15.12:0/3908369714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd7009a8e0 con 0x560db2d68ed0 2023-12-11T20:27:25.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd5bfff700 1 -- 172.21.15.12:0/3908369714 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd7009e330 con 0x560db2d68ed0 2023-12-11T20:27:25.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd5bfff700 1 -- 172.21.15.12:0/3908369714 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd70098580 con 0x560db2d68ed0 2023-12-11T20:27:25.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd96421b80 10 client.18795 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:25.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.458+0000 7fdd96421b80 1 -- 172.21.15.12:0/3908369714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fdd68009ba0 con 0x560db2d68ed0 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd5bfff700 1 -- 172.21.15.12:0/3908369714 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7009a8e0 con 0x560db2d68ed0 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd5bfff700 1 -- 172.21.15.12:0/3908369714 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdd700a20e0 con 0x560db2d68ed0 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd96421b80 10 client.18795 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd96421b80 10 client.18795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd96421b80 20 client.18795 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd96421b80 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560db2dd5d50 0x560db2dd8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd96421b80 4 client.18795 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd96421b80 1 -- 172.21.15.12:0/3908369714 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560db2c83f70 con 0x560db2dd5d50 2023-12-11T20:27:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.459+0000 7fdd7bfff700 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560db2dd5d50 0x560db2dd8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.460+0000 7fdd7bfff700 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560db2dd5d50 0x560db2dd8170 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41d8da2a805419ed server_cookie=90a3fbc5b93eb44 in_seq=0 out_seq=0 2023-12-11T20:27:25.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.460+0000 7fdd5bfff700 10 client.18795 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:25.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd5bfff700 1 -- 172.21.15.12:0/3908369714 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560db2c83f70 con 0x560db2dd5d50 2023-12-11T20:27:25.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd5bfff700 10 client.18795 handle_command_reply: tid=0 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 client.18795 shutdown 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 -- 172.21.15.12:0/3908369714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 msgr2=0x560db2d77ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d77ed0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fdd70096c50 tx=0x7fdd700ccff0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 -- 172.21.15.12:0/3908369714 shutdown_connections 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560db2dd5d50 0x560db2dd8170 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560db2d6a720 0x560db2d792e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560db2d68ed0 0x560db2d77ed0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 --2- 172.21.15.12:0/3908369714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560db2d69830 0x560db2d78410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd5bfff700 0 client.18795 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 -- 172.21.15.12:0/3908369714 >> 172.21.15.12:0/3908369714 conn(0x560db2c98780 msgr2=0x560db2d70c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 -- 172.21.15.12:0/3908369714 shutdown_connections 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 1 -- 172.21.15.12:0/3908369714 wait complete. 2023-12-11T20:27:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.471+0000 7fdd96421b80 20 client.18795 trim_cache size 0 max 16384 2023-12-11T20:27:25.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:27:25.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:27:25.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:27:25.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 -- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdd6c0a1470 msgr2=0x7fdd6c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdd6c0a1470 0x7fdd6c0a3930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009cd0 tx=0x7fdd7400b700 comp rx=0 tx=0).stop 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 -- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c0ffdb0 msgr2=0x7fdd7c199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c0ffdb0 0x7fdd7c199680 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000e9a0 tx=0x7fdd7000ecb0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 -- 172.21.15.12:0/3640307998 shutdown_connections 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdd6c0a1470 0x7fdd6c0a3930 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd7c1010d0 0x7fdd7c1a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd7c0ffdb0 0x7fdd7c199680 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 --2- 172.21.15.12:0/3640307998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7c100710 0x7fdd7c199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 -- 172.21.15.12:0/3640307998 >> 172.21.15.12:0/3640307998 conn(0x7fdd7c0fb930 msgr2=0x7fdd7c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 -- 172.21.15.12:0/3640307998 shutdown_connections 2023-12-11T20:27:25.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:25.472+0000 7fdd82bff700 1 -- 172.21.15.12:0/3640307998 wait complete. 2023-12-11T20:27:25.999 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:27:25.999 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:27:26.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 -- 172.21.15.12:0/1645272787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4180755b0 msgr2=0x7fb418073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/1645272787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4180755b0 0x7fb418073a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb4080098f0 tx=0x7fb408009c00 comp rx=0 tx=0).stop 2023-12-11T20:27:26.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 -- 172.21.15.12:0/1645272787 shutdown_connections 2023-12-11T20:27:26.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/1645272787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4181093c0 0x7fb41810b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/1645272787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4180755b0 0x7fb418073a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/1645272787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb418073fd0 0x7fb418074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 -- 172.21.15.12:0/1645272787 >> 172.21.15.12:0/1645272787 conn(0x7fb4180fca60 msgr2=0x7fb4180feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 -- 172.21.15.12:0/1645272787 shutdown_connections 2023-12-11T20:27:26.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.260+0000 7fb41d9ff700 1 -- 172.21.15.12:0/1645272787 wait complete. 2023-12-11T20:27:26.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.261+0000 7fb41d9ff700 1 Processor -- start 2023-12-11T20:27:26.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.261+0000 7fb41d9ff700 1 -- start start 2023-12-11T20:27:26.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb41d9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb418073fd0 0x7fb418199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb41d9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4180755b0 0x7fb418199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb41d9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4181093c0 0x7fb4181a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb41d9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4181a1070 con 0x7fb4180755b0 2023-12-11T20:27:26.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb41d9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4181a11b0 con 0x7fb4181093c0 2023-12-11T20:27:26.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb41d9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4181a1340 con 0x7fb418073fd0 2023-12-11T20:27:26.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb418073fd0 0x7fb418199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb4167fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4180755b0 0x7fb418199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb418073fd0 0x7fb418199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40682/0 (socket says 172.21.15.12:40682) 2023-12-11T20:27:26.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb416ffd700 1 -- 172.21.15.12:0/65751703 learned_addr learned my addr 172.21.15.12:0/65751703 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.262+0000 7fb4177fe700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4181093c0 0x7fb4181a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.263+0000 7fb416ffd700 1 -- 172.21.15.12:0/65751703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4181093c0 msgr2=0x7fb4181a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.263+0000 7fb416ffd700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4181093c0 0x7fb4181a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.263+0000 7fb416ffd700 1 -- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4180755b0 msgr2=0x7fb418199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.263+0000 7fb416ffd700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4180755b0 0x7fb418199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.263+0000 7fb416ffd700 1 -- 172.21.15.12:0/65751703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408009520 con 0x7fb418073fd0 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.263+0000 7fb4177fe700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4181093c0 0x7fb4181a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.263+0000 7fb416ffd700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb418073fd0 0x7fb418199540 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb408009810 tx=0x7fb40800b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.263+0000 7fb41c9fd700 1 -- 172.21.15.12:0/65751703 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40801c070 con 0x7fb418073fd0 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.264+0000 7fb41c9fd700 1 -- 172.21.15.12:0/65751703 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb40800f7d0 con 0x7fb418073fd0 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.264+0000 7fb41d9ff700 1 -- 172.21.15.12:0/65751703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4181a15c0 con 0x7fb418073fd0 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.264+0000 7fb41c9fd700 1 -- 172.21.15.12:0/65751703 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408003970 con 0x7fb418073fd0 2023-12-11T20:27:26.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.264+0000 7fb41d9ff700 1 -- 172.21.15.12:0/65751703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4181a19e0 con 0x7fb418073fd0 2023-12-11T20:27:26.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.267+0000 7fb41c9fd700 1 -- 172.21.15.12:0/65751703 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb408020030 con 0x7fb418073fd0 2023-12-11T20:27:26.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.269+0000 7fb41c9fd700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4000a1480 0x7fb4000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.270+0000 7fb41c9fd700 1 -- 172.21.15.12:0/65751703 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb4080cdcc0 con 0x7fb418073fd0 2023-12-11T20:27:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.270+0000 7fb4167fc700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4000a1480 0x7fb4000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.271+0000 7fb4167fc700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4000a1480 0x7fb4000a3940 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005fd0 tx=0x7fb40c009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.271+0000 7fb431366b80 1 Processor -- start 2023-12-11T20:27:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.271+0000 7fb431366b80 1 -- start start 2023-12-11T20:27:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb431366b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84450 0x556e2bd84870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb431366b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84db0 0x556e2bd856c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb431366b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 0x556e2bd86120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb431366b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bcdfbd0 con 0x556e2bd84db0 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb431366b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bcdd4f0 con 0x556e2bd84450 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb431366b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bcd8de0 con 0x556e2bd85ca0 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb4167fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84db0 0x556e2bd856c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84450 0x556e2bd84870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84450 0x556e2bd84870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:51196/0 (socket says 172.21.15.12:51196) 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb416ffd700 1 -- 172.21.15.12:0/1222901750 learned_addr learned my addr 172.21.15.12:0/1222901750 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.272+0000 7fb4177fe700 1 --2- 172.21.15.12:0/1222901750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 0x556e2bd86120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb416ffd700 1 -- 172.21.15.12:0/1222901750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 msgr2=0x556e2bd86120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb416ffd700 1 --2- 172.21.15.12:0/1222901750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 0x556e2bd86120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb416ffd700 1 -- 172.21.15.12:0/1222901750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84db0 msgr2=0x556e2bd856c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb416ffd700 1 --2- 172.21.15.12:0/1222901750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84db0 0x556e2bd856c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb416ffd700 1 -- 172.21.15.12:0/1222901750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e2bb556b0 con 0x556e2bd84450 2023-12-11T20:27:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb416ffd700 1 --2- 172.21.15.12:0/1222901750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84450 0x556e2bd84870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb40809af50 tx=0x7fb40809ac30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5617d8f91722558 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb3fdffb700 1 -- 172.21.15.12:0/1222901750 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080213e0 con 0x556e2bd84450 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb3fdffb700 1 -- 172.21.15.12:0/1222901750 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb40809b6c0 con 0x556e2bd84450 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.273+0000 7fb3fdffb700 1 -- 172.21.15.12:0/1222901750 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080976d0 con 0x556e2bd84450 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.274+0000 7fb431366b80 1 -- 172.21.15.12:0/1222901750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84450 msgr2=0x556e2bd84870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.274+0000 7fb431366b80 1 --2- 172.21.15.12:0/1222901750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84450 0x556e2bd84870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb40809af50 tx=0x7fb40809ac30 comp rx=0 tx=0).stop 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.274+0000 7fb431366b80 1 -- 172.21.15.12:0/1222901750 shutdown_connections 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.274+0000 7fb431366b80 1 --2- 172.21.15.12:0/1222901750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84450 0x556e2bd84870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.274+0000 7fb431366b80 1 --2- 172.21.15.12:0/1222901750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 0x556e2bd86120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.274+0000 7fb431366b80 1 --2- 172.21.15.12:0/1222901750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84db0 0x556e2bd856c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.274+0000 7fb431366b80 1 -- 172.21.15.12:0/1222901750 >> 172.21.15.12:0/1222901750 conn(0x556e2bcb3860 msgr2=0x556e2bd80e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.275+0000 7fb431366b80 1 -- 172.21.15.12:0/1222901750 shutdown_connections 2023-12-11T20:27:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.275+0000 7fb431366b80 1 -- 172.21.15.12:0/1222901750 wait complete. 2023-12-11T20:27:26.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.275+0000 7fb431366b80 1 -- start start 2023-12-11T20:27:26.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.276+0000 7fb431366b80 1 Processor -- start 2023-12-11T20:27:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb431366b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd8dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb431366b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd8e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb431366b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd95460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb431366b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bc925e0 con 0x556e2bd85ca0 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb431366b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bc92280 con 0x556e2bd84db0 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb431366b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bb579a0 con 0x556e2bd84450 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb431366b80 10 client.0 _ll_register_callbacks cb 0x556e2bbbdb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd8dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd8dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40706/0 (socket says 172.21.15.12:40706) 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb416ffd700 1 -- 172.21.15.12:0/3593468551 learned_addr learned my addr 172.21.15.12:0/3593468551 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb4167fc700 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd8e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb4177fe700 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd95460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb416ffd700 1 -- 172.21.15.12:0/3593468551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 msgr2=0x556e2bd8e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb416ffd700 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd8e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb416ffd700 1 -- 172.21.15.12:0/3593468551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 msgr2=0x556e2bd95460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb416ffd700 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd95460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.277+0000 7fb416ffd700 1 -- 172.21.15.12:0/3593468551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4181a19e0 con 0x556e2bd84450 2023-12-11T20:27:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb4177fe700 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd95460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:27:26.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb416ffd700 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd8dee0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4080a2d90 tx=0x7fb40809f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dd6a347959a8214 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb3f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:27:26.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3593468551 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40809afc0 con 0x556e2bd84450 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3593468551 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb4080b91c0 con 0x556e2bd84450 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb431366b80 1 -- 172.21.15.12:0/3593468551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e2bd77bc0 con 0x556e2bd84450 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3593468551 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4080976d0 con 0x556e2bd84450 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb431366b80 10 client.28402 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.278+0000 7fb431366b80 1 -- 172.21.15.12:0/3593468551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556e2bb01e60 con 0x556e2bd84450 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.279+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3593468551 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556e2bd77bc0 con 0x556e2bd84450 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.279+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3593468551 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb40809a4b0 con 0x556e2bd84450 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.279+0000 7fb431366b80 10 client.28402 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.279+0000 7fb431366b80 10 client.28402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.279+0000 7fb431366b80 20 client.28402 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.279+0000 7fb431366b80 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556e2bd99730 0x556e2bd9bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.279+0000 7fb431366b80 4 client.28402 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.279+0000 7fb431366b80 1 -- 172.21.15.12:0/3593468551 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e2bd53fc0 con 0x556e2bd99730 2023-12-11T20:27:26.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.280+0000 7fb4167fc700 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556e2bd99730 0x556e2bd9bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.280+0000 7fb4167fc700 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556e2bd99730 0x556e2bd9bb50 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0ce99ced4702563 server_cookie=9316d56d33d31c93 in_seq=0 out_seq=0 2023-12-11T20:27:26.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.280+0000 7fb3f6ffd700 10 client.28402 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.281+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3593468551 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556e2bd53fc0 con 0x556e2bd99730 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.281+0000 7fb3f6ffd700 10 client.28402 handle_command_reply: tid=0 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.281+0000 7fb431366b80 1 client.28402 shutdown 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.281+0000 7fb431366b80 1 -- 172.21.15.12:0/3593468551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 msgr2=0x556e2bd8dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.281+0000 7fb431366b80 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd8dee0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4080a2d90 tx=0x7fb40809f1c0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.281+0000 7fb431366b80 1 -- 172.21.15.12:0/3593468551 shutdown_connections 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.281+0000 7fb431366b80 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556e2bd99730 0x556e2bd9bb50 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.281+0000 7fb431366b80 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd95460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.282+0000 7fb3f6ffd700 0 client.28402 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.282+0000 7fb431366b80 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd8dee0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.282+0000 7fb431366b80 1 --2- 172.21.15.12:0/3593468551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd8e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.282+0000 7fb431366b80 1 -- 172.21.15.12:0/3593468551 >> 172.21.15.12:0/3593468551 conn(0x556e2bcb3860 msgr2=0x556e2bd7fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.282+0000 7fb431366b80 1 -- 172.21.15.12:0/3593468551 shutdown_connections 2023-12-11T20:27:26.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.282+0000 7fb431366b80 1 -- 172.21.15.12:0/3593468551 wait complete. 2023-12-11T20:27:26.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.282+0000 7fb431366b80 20 client.28402 trim_cache size 0 max 16384 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.305+0000 7fb431366b80 1 Processor -- start 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.305+0000 7fb431366b80 1 -- start start 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.305+0000 7fb431366b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd88c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.305+0000 7fb431366b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd95420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.305+0000 7fb431366b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd89150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.305+0000 7fb431366b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bd96610 con 0x556e2bd85ca0 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.305+0000 7fb431366b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bd53fc0 con 0x556e2bd84db0 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.305+0000 7fb431366b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bd77bc0 con 0x556e2bd84450 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd88c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4167fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd95420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4167fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd95420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:51222/0 (socket says 172.21.15.12:51222) 2023-12-11T20:27:26.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd88c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40712/0 (socket says 172.21.15.12:40712) 2023-12-11T20:27:26.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4167fc700 1 -- 172.21.15.12:0/2547751054 learned_addr learned my addr 172.21.15.12:0/2547751054 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4177fe700 1 --2- 172.21.15.12:0/2547751054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd89150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4167fc700 1 -- 172.21.15.12:0/2547751054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 msgr2=0x556e2bd88c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4167fc700 1 --2- 172.21.15.12:0/2547751054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd88c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4167fc700 1 -- 172.21.15.12:0/2547751054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 msgr2=0x556e2bd89150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4167fc700 1 --2- 172.21.15.12:0/2547751054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd89150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.306+0000 7fb4167fc700 1 -- 172.21.15.12:0/2547751054 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e2baeace0 con 0x556e2bd84db0 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.307+0000 7fb4167fc700 1 --2- 172.21.15.12:0/2547751054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd95420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb40c013010 tx=0x7fb40c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660e845e6df04fbf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.307+0000 7fb3fe7fc700 1 -- 172.21.15.12:0/2547751054 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c024040 con 0x556e2bd84db0 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.307+0000 7fb3fe7fc700 1 -- 172.21.15.12:0/2547751054 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb40c0298b0 con 0x556e2bd84db0 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.307+0000 7fb3fe7fc700 1 -- 172.21.15.12:0/2547751054 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c01e880 con 0x556e2bd84db0 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 -- 172.21.15.12:0/2547751054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 msgr2=0x556e2bd95420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 --2- 172.21.15.12:0/2547751054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd95420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb40c013010 tx=0x7fb40c014000 comp rx=0 tx=0).stop 2023-12-11T20:27:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 -- 172.21.15.12:0/2547751054 shutdown_connections 2023-12-11T20:27:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 --2- 172.21.15.12:0/2547751054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd85ca0 0x556e2bd89150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 --2- 172.21.15.12:0/2547751054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd84450 0x556e2bd88c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 --2- 172.21.15.12:0/2547751054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd95420 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 -- 172.21.15.12:0/2547751054 >> 172.21.15.12:0/2547751054 conn(0x556e2bcb3860 msgr2=0x556e2bda04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 -- 172.21.15.12:0/2547751054 shutdown_connections 2023-12-11T20:27:26.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 -- 172.21.15.12:0/2547751054 wait complete. 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.308+0000 7fb431366b80 1 -- start start 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb431366b80 1 Processor -- start 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb431366b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84450 0x556e2bd93e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb431366b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd943a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb431366b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 0x556e2bd948e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb431366b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bdefc60 con 0x556e2bd84450 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb431366b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bdefdd0 con 0x556e2bd84db0 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb431366b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e2bdeff90 con 0x556e2bd85ca0 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb431366b80 10 client.0 _ll_register_callbacks cb 0x556e2bbbdb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb4167fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.309+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84450 0x556e2bd93e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4167fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd943a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:51224/0 (socket says 172.21.15.12:51224) 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4167fc700 1 -- 172.21.15.12:0/3262446117 learned_addr learned my addr 172.21.15.12:0/3262446117 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4177fe700 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 0x556e2bd948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4167fc700 1 -- 172.21.15.12:0/3262446117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 msgr2=0x556e2bd948e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4167fc700 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 0x556e2bd948e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4167fc700 1 -- 172.21.15.12:0/3262446117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84450 msgr2=0x556e2bd93e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4167fc700 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84450 0x556e2bd93e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4167fc700 1 -- 172.21.15.12:0/3262446117 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40c017070 con 0x556e2bd84db0 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb4167fc700 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd943a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb40c02c040 tx=0x7fb40c0040d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24b0a9da81fc9198 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.310+0000 7fb3f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.311+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3262446117 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c024050 con 0x556e2bd84db0 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.311+0000 7fb431366b80 1 -- 172.21.15.12:0/3262446117 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb40809b6c0 con 0x556e2bd84db0 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.311+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3262446117 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb40c003c60 con 0x556e2bd84db0 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.311+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3262446117 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb40c022040 con 0x556e2bd84db0 2023-12-11T20:27:26.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.311+0000 7fb431366b80 10 client.28397 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:26.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.311+0000 7fb431366b80 1 -- 172.21.15.12:0/3262446117 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556e2bb282d0 con 0x556e2bd84db0 2023-12-11T20:27:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.311+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3262446117 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb40809b6c0 con 0x556e2bd84db0 2023-12-11T20:27:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.311+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3262446117 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb40c005200 con 0x556e2bd84db0 2023-12-11T20:27:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.312+0000 7fb431366b80 10 client.28397 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.312+0000 7fb431366b80 10 client.28397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.312+0000 7fb431366b80 20 client.28397 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.312+0000 7fb431366b80 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556e2bdf19d0 0x556e2bdf3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.312+0000 7fb431366b80 4 client.28397 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.312+0000 7fb431366b80 1 -- 172.21.15.12:0/3262446117 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556e2bc9f050 con 0x556e2bdf19d0 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.312+0000 7fb416ffd700 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556e2bdf19d0 0x556e2bdf3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.313+0000 7fb416ffd700 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556e2bdf19d0 0x556e2bdf3df0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa041d876050b242 server_cookie=5dc93a60150ba832 in_seq=0 out_seq=0 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.313+0000 7fb3f6ffd700 10 client.28397 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb3f6ffd700 1 -- 172.21.15.12:0/3262446117 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556e2bc9f050 con 0x556e2bdf19d0 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb3f6ffd700 10 client.28397 handle_command_reply: tid=0 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 client.28397 shutdown 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 -- 172.21.15.12:0/3262446117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 msgr2=0x556e2bd943a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd943a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb40c02c040 tx=0x7fb40c0040d0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 -- 172.21.15.12:0/3262446117 shutdown_connections 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556e2bdf19d0 0x556e2bdf3df0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556e2bd85ca0 0x556e2bd948e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2bd84450 0x556e2bd93e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb3f6ffd700 0 client.28397 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 --2- 172.21.15.12:0/3262446117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556e2bd84db0 0x556e2bd943a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 -- 172.21.15.12:0/3262446117 >> 172.21.15.12:0/3262446117 conn(0x556e2bcb3860 msgr2=0x556e2bd88c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 -- 172.21.15.12:0/3262446117 shutdown_connections 2023-12-11T20:27:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.314+0000 7fb431366b80 1 -- 172.21.15.12:0/3262446117 wait complete. 2023-12-11T20:27:26.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.315+0000 7fb431366b80 20 client.28397 trim_cache size 0 max 16384 2023-12-11T20:27:26.316 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:27:26.316 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:27:26.316 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "e9ae231e-77ff-49f2-b822-e30bc74b6aa8", 2023-12-11T20:27:26.316 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:27:26.316 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 -- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4000a1480 msgr2=0x7fb4000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4000a1480 0x7fb4000a3940 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005fd0 tx=0x7fb40c009310 comp rx=0 tx=0).stop 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 -- 172.21.15.12:0/65751703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb418073fd0 msgr2=0x7fb418199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb418073fd0 0x7fb418199540 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb408009810 tx=0x7fb40800b790 comp rx=0 tx=0).stop 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 -- 172.21.15.12:0/65751703 shutdown_connections 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4000a1480 0x7fb4000a3940 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4181093c0 0x7fb4181a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb418073fd0 0x7fb418199540 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 --2- 172.21.15.12:0/65751703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4180755b0 0x7fb418199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 -- 172.21.15.12:0/65751703 >> 172.21.15.12:0/65751703 conn(0x7fb4180fca60 msgr2=0x7fb418105310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 -- 172.21.15.12:0/65751703 shutdown_connections 2023-12-11T20:27:26.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.316+0000 7fb41d9ff700 1 -- 172.21.15.12:0/65751703 wait complete. 2023-12-11T20:27:26.340 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:27:26.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.591+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1152444844 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 msgr2=0x7f1dc8101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.591+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1152444844 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 0x7f1dc8101a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0099c0 tx=0x7f1dbc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.591+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1152444844 shutdown_connections 2023-12-11T20:27:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.591+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1152444844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc8101f90 0x7f1dc8108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.591+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1152444844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc8100400 0x7f1dc8100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.591+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1152444844 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 0x7f1dc8101a50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.591+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1152444844 >> 172.21.15.12:0/1152444844 conn(0x7f1dc80fb930 msgr2=0x7f1dc80fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.591+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1152444844 shutdown_connections 2023-12-11T20:27:26.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.592+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1152444844 wait complete. 2023-12-11T20:27:26.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.593+0000 7f1dcdfff700 1 Processor -- start 2023-12-11T20:27:26.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.593+0000 7f1dcdfff700 1 -- start start 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.593+0000 7f1dcdfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc8100400 0x7f1dc8199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.593+0000 7f1dcdfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 0x7f1dc8199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.593+0000 7f1dcdfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc8101f90 0x7f1dc81a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.593+0000 7f1dcdfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc81a10a0 con 0x7f1dc8100400 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.593+0000 7f1dcdfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc81a11e0 con 0x7f1dc81015f0 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.593+0000 7f1dcdfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc81a1370 con 0x7f1dc8101f90 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc8100400 0x7f1dc8199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc8100400 0x7f1dc8199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49150/0 (socket says 172.21.15.12:49150) 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1851510818 learned_addr learned my addr 172.21.15.12:0/1851510818 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc8101f90 0x7f1dc81a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 0x7f1dc8199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1851510818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc8101f90 msgr2=0x7f1dc81a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc8101f90 0x7f1dc81a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1851510818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 msgr2=0x7f1dc8199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 0x7f1dc8199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1851510818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0009c40 con 0x7f1dc8100400 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.594+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 0x7f1dc8199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.595+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc8100400 0x7f1dc8199570 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e970 tx=0x7f1db800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.595+0000 7f1dc4ff9700 1 -- 172.21.15.12:0/1851510818 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8009790 con 0x7f1dc8100400 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.595+0000 7f1dc4ff9700 1 -- 172.21.15.12:0/1851510818 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1db800eeb0 con 0x7f1dc8100400 2023-12-11T20:27:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.595+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1851510818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc0095f0 con 0x7f1dc8100400 2023-12-11T20:27:26.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.595+0000 7f1dc4ff9700 1 -- 172.21.15.12:0/1851510818 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8003c50 con 0x7f1dc8100400 2023-12-11T20:27:26.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.595+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1851510818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc81a19d0 con 0x7f1dc8100400 2023-12-11T20:27:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.599+0000 7f1dc4ff9700 1 -- 172.21.15.12:0/1851510818 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1db8018430 con 0x7f1dc8100400 2023-12-11T20:27:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.600+0000 7f1de19aab80 1 Processor -- start 2023-12-11T20:27:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1de19aab80 1 -- start start 2023-12-11T20:27:26.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1dc4ff9700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1db00a1480 0x7f1db00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f53d0 0x5633b39f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1dc4ff9700 1 -- 172.21.15.12:0/1851510818 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1db8014070 con 0x7f1dc8100400 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f5d30 0x5633b39f6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f6c20 0x5633b39f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1de19aab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b3950b50 con 0x5633b39f5d30 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1de19aab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b394e470 con 0x5633b39f6c20 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1de19aab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b3949d60 con 0x5633b39f53d0 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.601+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1db00a1480 0x7f1db00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f6c20 0x5633b39f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f6c20 0x5633b39f70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:51256/0 (socket says 172.21.15.12:51256) 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc7fff700 1 -- 172.21.15.12:0/3274627543 learned_addr learned my addr 172.21.15.12:0/3274627543 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f53d0 0x5633b39f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f5d30 0x5633b39f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc7fff700 1 -- 172.21.15.12:0/3274627543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f53d0 msgr2=0x5633b39f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f53d0 0x5633b39f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc7fff700 1 -- 172.21.15.12:0/3274627543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f5d30 msgr2=0x5633b39f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f5d30 0x5633b39f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc7fff700 1 -- 172.21.15.12:0/3274627543 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633b37c6630 con 0x5633b39f6c20 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.602+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f53d0 0x5633b39f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.603+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f6c20 0x5633b39f70a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1dc001a6a0 tx=0x7f1dc001a9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df685252f64bbab server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.603+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1db00a1480 0x7f1db00a3940 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1dc001ad00 tx=0x7f1dc0013000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.603+0000 7f1dadffb700 1 -- 172.21.15.12:0/3274627543 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000e040 con 0x5633b39f6c20 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.603+0000 7f1dadffb700 1 -- 172.21.15.12:0/3274627543 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dc001f070 con 0x5633b39f6c20 2023-12-11T20:27:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.603+0000 7f1dadffb700 1 -- 172.21.15.12:0/3274627543 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0007760 con 0x5633b39f6c20 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.604+0000 7f1de19aab80 1 -- 172.21.15.12:0/3274627543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f6c20 msgr2=0x5633b39f70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.604+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f6c20 0x5633b39f70a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1dc001a6a0 tx=0x7f1dc001a9b0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.604+0000 7f1de19aab80 1 -- 172.21.15.12:0/3274627543 shutdown_connections 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.604+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f6c20 0x5633b39f70a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.604+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f53d0 0x5633b39f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.604+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3274627543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f5d30 0x5633b39f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.604+0000 7f1de19aab80 1 -- 172.21.15.12:0/3274627543 >> 172.21.15.12:0/3274627543 conn(0x5633b39247e0 msgr2=0x5633b39f1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.604+0000 7f1de19aab80 1 -- 172.21.15.12:0/3274627543 shutdown_connections 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.605+0000 7f1de19aab80 1 -- 172.21.15.12:0/3274627543 wait complete. 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.605+0000 7f1de19aab80 1 -- start start 2023-12-11T20:27:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.605+0000 7f1de19aab80 1 Processor -- start 2023-12-11T20:27:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39ff280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b39ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b3a066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1de19aab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b3903560 con 0x5633b39f6c20 2023-12-11T20:27:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1de19aab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b3903200 con 0x5633b39f53d0 2023-12-11T20:27:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1de19aab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b37c8920 con 0x5633b39f5d30 2023-12-11T20:27:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1de19aab80 10 client.0 _ll_register_callbacks cb 0x5633b382ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1dc77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1dc77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39ff280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:51262/0 (socket says 172.21.15.12:51262) 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.606+0000 7f1dc77fe700 1 -- 172.21.15.12:0/3071823014 learned_addr learned my addr 172.21.15.12:0/3071823014 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b39ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b3a066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc77fe700 1 -- 172.21.15.12:0/3071823014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 msgr2=0x5633b39ff7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b39ff7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc77fe700 1 -- 172.21.15.12:0/3071823014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 msgr2=0x5633b3a066c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b3a066c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc77fe700 1 -- 172.21.15.12:0/3071823014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc81a19d0 con 0x5633b39f53d0 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b3a066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b39ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39ff280 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1db8003730 tx=0x7f1db8099d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce5ce318af1292bf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.607+0000 7f1da6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1da6ffd700 1 -- 172.21.15.12:0/3071823014 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db809a2e0 con 0x5633b39f53d0 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1da6ffd700 1 -- 172.21.15.12:0/3071823014 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1db809e430 con 0x5633b39f53d0 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 1 -- 172.21.15.12:0/3071823014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633b39e8b40 con 0x5633b39f53d0 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1da6ffd700 1 -- 172.21.15.12:0/3071823014 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1db80a2670 con 0x5633b39f53d0 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 10 client.28409 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 1 -- 172.21.15.12:0/3071823014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f1dc0011e10 con 0x5633b39f53d0 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1da6ffd700 1 -- 172.21.15.12:0/3071823014 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5633b39e8b40 con 0x5633b39f53d0 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1da6ffd700 1 -- 172.21.15.12:0/3071823014 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1db8099860 con 0x5633b39f53d0 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 10 client.28409 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 10 client.28409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 20 client.28409 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633b3a0aec0 0x5633b3a0d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 4 client.28409 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.608+0000 7f1de19aab80 1 -- 172.21.15.12:0/3071823014 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633b39c4f40 con 0x5633b3a0aec0 2023-12-11T20:27:26.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.609+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633b3a0aec0 0x5633b3a0d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.610+0000 7f1da6ffd700 10 client.28409 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.610+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633b3a0aec0 0x5633b3a0d2b0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca9ce08dd844f35e server_cookie=a613ab9a928261b4 in_seq=0 out_seq=0 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.610+0000 7f1da6ffd700 1 -- 172.21.15.12:0/3071823014 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5633b39c4f40 con 0x5633b3a0aec0 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.610+0000 7f1da6ffd700 10 client.28409 handle_command_reply: tid=0 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.610+0000 7f1de19aab80 1 client.28409 shutdown 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 -- 172.21.15.12:0/3071823014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 msgr2=0x5633b39ff280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39ff280 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1db8003730 tx=0x7f1db8099d00 comp rx=0 tx=0).stop 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 -- 172.21.15.12:0/3071823014 shutdown_connections 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633b3a0aec0 0x5633b3a0d2b0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39ff280 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b3a066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 --2- 172.21.15.12:0/3071823014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b39ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 -- 172.21.15.12:0/3071823014 >> 172.21.15.12:0/3071823014 conn(0x5633b39247e0 msgr2=0x5633b39f0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1da6ffd700 0 client.28409 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:26.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 -- 172.21.15.12:0/3071823014 shutdown_connections 2023-12-11T20:27:26.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 1 -- 172.21.15.12:0/3071823014 wait complete. 2023-12-11T20:27:26.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.611+0000 7f1de19aab80 20 client.28409 trim_cache size 0 max 16384 2023-12-11T20:27:26.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1de19aab80 1 Processor -- start 2023-12-11T20:27:26.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1de19aab80 1 -- start start 2023-12-11T20:27:26.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39fd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b3a06680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b39f9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1de19aab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b39f6110 con 0x5633b39f6c20 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1de19aab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b39fdbb0 con 0x5633b39f53d0 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1de19aab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b3a124a0 con 0x5633b39f5d30 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b39f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1dc77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1dc6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b3a06680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1dc77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39fd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:51272/0 (socket says 172.21.15.12:51272) 2023-12-11T20:27:26.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.637+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1699303367 learned_addr learned my addr 172.21.15.12:0/1699303367 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.638+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1699303367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 msgr2=0x5633b3a06680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.638+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1699303367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b3a06680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.638+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1699303367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 msgr2=0x5633b39f9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.638+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1699303367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b39f9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.638+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1699303367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633b3772de0 con 0x5633b39f53d0 2023-12-11T20:27:26.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.638+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/1699303367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b3a06680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:26.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.638+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1699303367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39fd300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1db8004800 tx=0x7f1db8098890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbd8ecc76de1e9c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.638+0000 7f1dae7fc700 1 -- 172.21.15.12:0/1699303367 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db809e430 con 0x5633b39f53d0 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.639+0000 7f1dae7fc700 1 -- 172.21.15.12:0/1699303367 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1db809a2e0 con 0x5633b39f53d0 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.639+0000 7f1dae7fc700 1 -- 172.21.15.12:0/1699303367 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db809a7a0 con 0x5633b39f53d0 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 -- 172.21.15.12:0/1699303367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 msgr2=0x5633b39fd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1699303367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39fd300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1db8004800 tx=0x7f1db8098890 comp rx=0 tx=0).stop 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 -- 172.21.15.12:0/1699303367 shutdown_connections 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1699303367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f53d0 0x5633b39fd300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1699303367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f6c20 0x5633b39f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1699303367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f5d30 0x5633b3a06680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 -- 172.21.15.12:0/1699303367 >> 172.21.15.12:0/1699303367 conn(0x5633b39247e0 msgr2=0x5633b39fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 -- 172.21.15.12:0/1699303367 shutdown_connections 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 -- 172.21.15.12:0/1699303367 wait complete. 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 -- start start 2023-12-11T20:27:26.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.640+0000 7f1de19aab80 1 Processor -- start 2023-12-11T20:27:26.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f53d0 0x5633b3a01a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f5d30 0x5633b3a01fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1de19aab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f6c20 0x5633b3a04fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1de19aab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b3a054e0 con 0x5633b39f53d0 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1de19aab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b3a05650 con 0x5633b39f5d30 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1de19aab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b3a05810 con 0x5633b39f6c20 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1de19aab80 10 client.0 _ll_register_callbacks cb 0x5633b382ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f53d0 0x5633b3a01a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f53d0 0x5633b3a01a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49178/0 (socket says 172.21.15.12:49178) 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1dc6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f5d30 0x5633b3a01fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1278843397 learned_addr learned my addr 172.21.15.12:0/1278843397 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f6c20 0x5633b3a04fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1278843397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f6c20 msgr2=0x5633b3a04fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.641+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f6c20 0x5633b3a04fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1278843397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f5d30 msgr2=0x5633b3a01fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f5d30 0x5633b3a01fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1dc77fe700 1 -- 172.21.15.12:0/1278843397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc8109190 con 0x5633b39f53d0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1dc7fff700 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f6c20 0x5633b3a04fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f5d30 0x5633b3a01fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1dc77fe700 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f53d0 0x5633b3a01a90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1db80a2140 tx=0x7f1db8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28c832143bb74a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1da6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1da6ffd700 1 -- 172.21.15.12:0/1278843397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db80a2670 con 0x5633b39f53d0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1da6ffd700 1 -- 172.21.15.12:0/1278843397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1db809e430 con 0x5633b39f53d0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1de19aab80 1 -- 172.21.15.12:0/1278843397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1dc001f070 con 0x5633b39f53d0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1da6ffd700 1 -- 172.21.15.12:0/1278843397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1db80b8250 con 0x5633b39f53d0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1de19aab80 10 client.18825 fetch_fsmap learned FSMap version 26 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.642+0000 7f1de19aab80 1 -- 172.21.15.12:0/1278843397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f1dc0011e10 con 0x5633b39f53d0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1da6ffd700 1 -- 172.21.15.12:0/1278843397 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dc001f070 con 0x5633b39f53d0 2023-12-11T20:27:26.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1da6ffd700 1 -- 172.21.15.12:0/1278843397 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1db809f170 con 0x5633b39f53d0 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1de19aab80 10 client.18825 fetch_fsmap finished waiting for FSMap version 26 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1de19aab80 10 client.18825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1de19aab80 20 client.18825 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633b3a614b0 0x5633b3a638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1de19aab80 4 client.18825 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1de19aab80 1 -- 172.21.15.12:0/1278843397 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5633b390ffd0 con 0x5633b3a614b0 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.643+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633b3a614b0 0x5633b3a638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1dc6ffd700 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633b3a614b0 0x5633b3a638d0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fd271bf030b5928 server_cookie=19c5887507edace8 in_seq=0 out_seq=0 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1da6ffd700 10 client.18825 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1da6ffd700 1 -- 172.21.15.12:0/1278843397 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5633b390ffd0 con 0x5633b3a614b0 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1da6ffd700 10 client.18825 handle_command_reply: tid=0 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 client.18825 shutdown 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 -- 172.21.15.12:0/1278843397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f53d0 msgr2=0x5633b3a01a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f53d0 0x5633b3a01a90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1db80a2140 tx=0x7f1db8000bc0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 -- 172.21.15.12:0/1278843397 shutdown_connections 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633b3a614b0 0x5633b3a638d0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633b39f6c20 0x5633b3a04fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633b39f53d0 0x5633b3a01a90 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1da6ffd700 0 client.18825 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 --2- 172.21.15.12:0/1278843397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633b39f5d30 0x5633b3a01fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.644+0000 7f1de19aab80 1 -- 172.21.15.12:0/1278843397 >> 172.21.15.12:0/1278843397 conn(0x5633b39247e0 msgr2=0x5633b39fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.645+0000 7f1de19aab80 1 -- 172.21.15.12:0/1278843397 shutdown_connections 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.645+0000 7f1de19aab80 1 -- 172.21.15.12:0/1278843397 wait complete. 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.645+0000 7f1de19aab80 20 client.18825 trim_cache size 0 max 16384 2023-12-11T20:27:26.647 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "e9ae231e-77ff-49f2-b822-e30bc74b6aa8": { 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "e9ae231e-77ff-49f2-b822-e30bc74b6aa8", 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:27:26.648 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1db00a1480 msgr2=0x7f1db00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1db00a1480 0x7f1db00a3940 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1dc001ad00 tx=0x7f1dc0013000 comp rx=0 tx=0).stop 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc8100400 msgr2=0x7f1dc8199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc8100400 0x7f1dc8199570 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e970 tx=0x7f1db800ed30 comp rx=0 tx=0).stop 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1851510818 shutdown_connections 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1db00a1480 0x7f1db00a3940 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1dc8101f90 0x7f1dc81a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dc8100400 0x7f1dc8199570 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 --2- 172.21.15.12:0/1851510818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1dc81015f0 0x7f1dc8199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1851510818 >> 172.21.15.12:0/1851510818 conn(0x7f1dc80fb930 msgr2=0x7f1dc80687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1851510818 shutdown_connections 2023-12-11T20:27:26.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:26.646+0000 7f1dcdfff700 1 -- 172.21.15.12:0/1851510818 wait complete. 2023-12-11T20:27:26.666 INFO:tasks.cephfs.filesystem:scrub status for tag:e9ae231e-77ff-49f2-b822-e30bc74b6aa8 - {'path': '/', 'tag': 'e9ae231e-77ff-49f2-b822-e30bc74b6aa8', 'options': 'recursive,force'} 2023-12-11T20:27:26.713 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:27:26.323+0000 7f064a734700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{1=1,2=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@178} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561ea069c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3351>,<0x10000000005/tmp v218>,<0x10000000003/client.0 v220>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v237>,<0x10000000001/sv_0 v261>,<0x10000000000/_nogroup v245>,<0x1/volumes v237>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:27:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: pgmap v720: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:27:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:27:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:27:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:27:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:27:27.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:26 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: pgmap v720: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:26 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: pgmap v720: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:26 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:28.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:27:28.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:27 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:28.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:27:28.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:27 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:27:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:27:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.b log and `damage ls` output for details 2023-12-11T20:27:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:27:28.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:27:28.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:27:28.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:27:28.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:27 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:27:29.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:28 smithi032 ceph-mon[132488]: pgmap v721: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 19 op/s 2023-12-11T20:27:29.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:28 smithi039 ceph-mon[102205]: pgmap v721: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 19 op/s 2023-12-11T20:27:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:28 smithi012 ceph-mon[128787]: pgmap v721: 97 pgs: 97 active+clean; 8.6 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 19 op/s 2023-12-11T20:27:31.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:30 smithi032 ceph-mon[132488]: pgmap v722: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 25 op/s 2023-12-11T20:27:31.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:30 smithi039 ceph-mon[102205]: pgmap v722: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 25 op/s 2023-12-11T20:27:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:30 smithi012 ceph-mon[128787]: pgmap v722: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 25 op/s 2023-12-11T20:27:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:32 smithi032 ceph-mon[132488]: pgmap v723: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:27:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:32 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:27:33.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:32 smithi039 ceph-mon[102205]: pgmap v723: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:27:33.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:32 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:27:33.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:32 smithi012 ceph-mon[128787]: pgmap v723: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:27:33.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:32 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:27:35.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:34 smithi032 ceph-mon[132488]: pgmap v724: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:27:35.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:34 smithi039 ceph-mon[102205]: pgmap v724: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:27:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:34 smithi012 ceph-mon[128787]: pgmap v724: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:27:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:36 smithi032 ceph-mon[132488]: pgmap v725: 97 pgs: 97 active+clean; 8.8 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:27:37.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:36 smithi039 ceph-mon[102205]: pgmap v725: 97 pgs: 97 active+clean; 8.8 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:27:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:36 smithi012 ceph-mon[128787]: pgmap v725: 97 pgs: 97 active+clean; 8.8 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:27:38.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:37 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:27:38.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:37 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:27:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:37 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:27:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 -- 172.21.15.12:0/642795414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 msgr2=0x7fbe3c101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 --2- 172.21.15.12:0/642795414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 0x7fbe3c101a10 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fbe280099c0 tx=0x7fbe28009cd0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 -- 172.21.15.12:0/642795414 shutdown_connections 2023-12-11T20:27:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 --2- 172.21.15.12:0/642795414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe3c1003c0 0x7fbe3c1007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 --2- 172.21.15.12:0/642795414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3c101f50 0x7fbe3c108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 --2- 172.21.15.12:0/642795414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 0x7fbe3c101a10 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 -- 172.21.15.12:0/642795414 >> 172.21.15.12:0/642795414 conn(0x7fbe3c0fb930 msgr2=0x7fbe3c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 -- 172.21.15.12:0/642795414 shutdown_connections 2023-12-11T20:27:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.644+0000 7fbe431ff700 1 -- 172.21.15.12:0/642795414 wait complete. 2023-12-11T20:27:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.645+0000 7fbe431ff700 1 Processor -- start 2023-12-11T20:27:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.645+0000 7fbe431ff700 1 -- start start 2023-12-11T20:27:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe431ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3c1003c0 0x7fbe3c104300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe431ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 0x7fbe3c102990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe431ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe3c101f50 0x7fbe3c102ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe431ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c103670 con 0x7fbe3c1015b0 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe431ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1037e0 con 0x7fbe3c101f50 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe431ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1a13b0 con 0x7fbe3c1003c0 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 0x7fbe3c102990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe40f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3c1003c0 0x7fbe3c104300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe3bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 0x7fbe3c102990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34816/0 (socket says 172.21.15.12:34816) 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe3bfff700 1 -- 172.21.15.12:0/788830533 learned_addr learned my addr 172.21.15.12:0/788830533 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.646+0000 7fbe4179c700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe3c101f50 0x7fbe3c102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe40f9b700 1 -- 172.21.15.12:0/788830533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe3c101f50 msgr2=0x7fbe3c102ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe3c101f50 0x7fbe3c102ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe40f9b700 1 -- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 msgr2=0x7fbe3c102990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 0x7fbe3c102990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe40f9b700 1 -- 172.21.15.12:0/788830533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280095f0 con 0x7fbe3c1003c0 2023-12-11T20:27:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe4179c700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe3c101f50 0x7fbe3c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe3bfff700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 0x7fbe3c102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3c1003c0 0x7fbe3c104300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000e9c0 tx=0x7fbe3000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe39ffb700 1 -- 172.21.15.12:0/788830533 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30004220 con 0x7fbe3c1003c0 2023-12-11T20:27:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.647+0000 7fbe431ff700 1 -- 172.21.15.12:0/788830533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c1a15e0 con 0x7fbe3c1003c0 2023-12-11T20:27:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.648+0000 7fbe39ffb700 1 -- 172.21.15.12:0/788830533 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe30004380 con 0x7fbe3c1003c0 2023-12-11T20:27:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.648+0000 7fbe39ffb700 1 -- 172.21.15.12:0/788830533 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30003b40 con 0x7fbe3c1003c0 2023-12-11T20:27:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.648+0000 7fbe431ff700 1 -- 172.21.15.12:0/788830533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c1a1b40 con 0x7fbe3c1003c0 2023-12-11T20:27:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.651+0000 7fbe39ffb700 1 -- 172.21.15.12:0/788830533 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fbe30003ca0 con 0x7fbe3c1003c0 2023-12-11T20:27:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.652+0000 7fbe56bd0b80 1 Processor -- start 2023-12-11T20:27:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.652+0000 7fbe56bd0b80 1 -- start start 2023-12-11T20:27:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e36c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36c830 0x55d94e36d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36d720 0x55d94e36dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e2c7af0 con 0x55d94e36c830 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e2c5410 con 0x55d94e36d720 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e2c0d00 con 0x55d94e36bed0 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe4179c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e36c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe40f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36c830 0x55d94e36d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe4179c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e36c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44296/0 (socket says 172.21.15.12:44296) 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe4179c700 1 -- 172.21.15.12:0/508207238 learned_addr learned my addr 172.21.15.12:0/508207238 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.653+0000 7fbe3bfff700 1 --2- 172.21.15.12:0/508207238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36d720 0x55d94e36dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe39ffb700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe2c0a1470 0x7fbe2c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe4179c700 1 -- 172.21.15.12:0/508207238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36d720 msgr2=0x55d94e36dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe4179c700 1 --2- 172.21.15.12:0/508207238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36d720 0x55d94e36dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe4179c700 1 -- 172.21.15.12:0/508207238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36c830 msgr2=0x55d94e36d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe4179c700 1 --2- 172.21.15.12:0/508207238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36c830 0x55d94e36d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe4179c700 1 -- 172.21.15.12:0/508207238 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d94e13d5d0 con 0x55d94e36bed0 2023-12-11T20:27:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe39ffb700 1 -- 172.21.15.12:0/788830533 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbe30014070 con 0x7fbe3c1003c0 2023-12-11T20:27:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe4179c700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe2c0a1470 0x7fbe2c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.654+0000 7fbe4179c700 1 --2- 172.21.15.12:0/508207238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e36c2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe340078d0 tx=0x7fbe34007be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73396e0331e7144d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.655+0000 7fbe26ffd700 1 -- 172.21.15.12:0/508207238 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe340127b0 con 0x55d94e36bed0 2023-12-11T20:27:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.655+0000 7fbe26ffd700 1 -- 172.21.15.12:0/508207238 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe3400f040 con 0x55d94e36bed0 2023-12-11T20:27:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.655+0000 7fbe26ffd700 1 -- 172.21.15.12:0/508207238 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34020810 con 0x55d94e36bed0 2023-12-11T20:27:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.655+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/508207238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 msgr2=0x55d94e36c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.655+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/508207238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e36c2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe340078d0 tx=0x7fbe34007be0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.655+0000 7fbe4179c700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe2c0a1470 0x7fbe2c0a3930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbe3401f000 tx=0x7fbe34020000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.656+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/508207238 shutdown_connections 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.656+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/508207238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36d720 0x55d94e36dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.656+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/508207238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e36c2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.656+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/508207238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36c830 0x55d94e36d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.656+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/508207238 >> 172.21.15.12:0/508207238 conn(0x55d94e29b780 msgr2=0x55d94e368880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.656+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/508207238 shutdown_connections 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.656+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/508207238 wait complete. 2023-12-11T20:27:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.656+0000 7fbe56bd0b80 1 -- start start 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.657+0000 7fbe56bd0b80 1 Processor -- start 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.657+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36bed0 0x55d94e375eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.657+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36c830 0x55d94e3763f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.657+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.657+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e27a500 con 0x55d94e36d720 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.657+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e27a1a0 con 0x55d94e36bed0 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.657+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e13f8c0 con 0x55d94e36c830 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.657+0000 7fbe56bd0b80 10 client.0 _ll_register_callbacks cb 0x55d94e1a5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe4179c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe40f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36bed0 0x55d94e375eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe3bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36c830 0x55d94e3763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe40f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36bed0 0x55d94e375eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:34290/0 (socket says 172.21.15.12:34290) 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe4179c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34836/0 (socket says 172.21.15.12:34836) 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe40f9b700 1 -- 172.21.15.12:0/547146007 learned_addr learned my addr 172.21.15.12:0/547146007 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe3bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36c830 0x55d94e3763f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44300/0 (socket says 172.21.15.12:44300) 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe40f9b700 1 -- 172.21.15.12:0/547146007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36c830 msgr2=0x55d94e3763f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36c830 0x55d94e3763f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe40f9b700 1 -- 172.21.15.12:0/547146007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 msgr2=0x55d94e37d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe40f9b700 1 -- 172.21.15.12:0/547146007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe34007500 con 0x55d94e36bed0 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.658+0000 7fbe4179c700 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.659+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36bed0 0x55d94e375eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe300a2120 tx=0x7fbe3000cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c9f13e70d2c4af7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.659+0000 7fbe1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:27:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.659+0000 7fbe1bfff700 1 -- 172.21.15.12:0/547146007 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30099e00 con 0x55d94e36bed0 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.659+0000 7fbe1bfff700 1 -- 172.21.15.12:0/547146007 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbe300044f0 con 0x55d94e36bed0 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.659+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/547146007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d94e35f730 con 0x55d94e36bed0 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.659+0000 7fbe1bfff700 1 -- 172.21.15.12:0/547146007 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe300b1030 con 0x55d94e36bed0 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.659+0000 7fbe56bd0b80 10 client.28427 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.659+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/547146007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d94e0e9d80 con 0x55d94e36bed0 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.660+0000 7fbe1bfff700 1 -- 172.21.15.12:0/547146007 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe300b6020 con 0x55d94e36bed0 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.660+0000 7fbe1bfff700 1 -- 172.21.15.12:0/547146007 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbe300997b0 con 0x55d94e36bed0 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.660+0000 7fbe56bd0b80 10 client.28427 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.660+0000 7fbe56bd0b80 10 client.28427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.660+0000 7fbe56bd0b80 20 client.28427 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.660+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d94e381c90 0x55d94e3840b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.660+0000 7fbe56bd0b80 4 client.28427 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.660+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/547146007 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d94e33bee0 con 0x55d94e381c90 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.661+0000 7fbe3bfff700 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d94e381c90 0x55d94e3840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.661+0000 7fbe3bfff700 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d94e381c90 0x55d94e3840b0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39839588f5c469d server_cookie=ff973f204709b934 in_seq=0 out_seq=0 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.661+0000 7fbe1bfff700 10 client.28427 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe1bfff700 1 -- 172.21.15.12:0/547146007 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d94e33bee0 con 0x55d94e381c90 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe1bfff700 10 client.28427 handle_command_reply: tid=0 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 client.28427 shutdown 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/547146007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36bed0 msgr2=0x55d94e375eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36bed0 0x55d94e375eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbe300a2120 tx=0x7fbe3000cf50 comp rx=0 tx=0).stop 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/547146007 shutdown_connections 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d94e381c90 0x55d94e3840b0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36bed0 0x55d94e375eb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/547146007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36c830 0x55d94e3763f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe1bfff700 0 client.28427 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/547146007 >> 172.21.15.12:0/547146007 conn(0x55d94e29b780 msgr2=0x55d94e366ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/547146007 shutdown_connections 2023-12-11T20:27:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.662+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/547146007 wait complete. 2023-12-11T20:27:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.663+0000 7fbe56bd0b80 20 client.28427 trim_cache size 0 max 16384 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.682+0000 7fbe56bd0b80 1 Processor -- start 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.682+0000 7fbe56bd0b80 1 -- start start 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.682+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36bed0 0x55d94e36c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.682+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 0x55d94e37d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.682+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36d720 0x55d94e374980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.682+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e375810 con 0x55d94e36bed0 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.682+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e36ba50 con 0x55d94e36c830 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.682+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e36cc10 con 0x55d94e36d720 2023-12-11T20:27:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe40f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36bed0 0x55d94e36c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe40f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36bed0 0x55d94e36c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34848/0 (socket says 172.21.15.12:34848) 2023-12-11T20:27:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe40f9b700 1 -- 172.21.15.12:0/276884300 learned_addr learned my addr 172.21.15.12:0/276884300 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe3bfff700 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 0x55d94e37d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe4179c700 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36d720 0x55d94e374980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe40f9b700 1 -- 172.21.15.12:0/276884300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36d720 msgr2=0x55d94e374980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36d720 0x55d94e374980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe40f9b700 1 -- 172.21.15.12:0/276884300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 msgr2=0x55d94e37d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 0x55d94e37d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.683+0000 7fbe40f9b700 1 -- 172.21.15.12:0/276884300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d94e0d2c00 con 0x55d94e36bed0 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.684+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36bed0 0x55d94e36c2b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fbe300967c0 tx=0x7fbe3009e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f9ee22a91b28c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.684+0000 7fbe277fe700 1 -- 172.21.15.12:0/276884300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30099e00 con 0x55d94e36bed0 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.684+0000 7fbe277fe700 1 -- 172.21.15.12:0/276884300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe300b6030 con 0x55d94e36bed0 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.684+0000 7fbe277fe700 1 -- 172.21.15.12:0/276884300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3009a2c0 con 0x55d94e36bed0 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/276884300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36bed0 msgr2=0x55d94e36c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36bed0 0x55d94e36c2b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fbe300967c0 tx=0x7fbe3009e410 comp rx=0 tx=0).stop 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/276884300 shutdown_connections 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36d720 0x55d94e374980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36bed0 0x55d94e36c2b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/276884300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 0x55d94e37d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/276884300 >> 172.21.15.12:0/276884300 conn(0x55d94e29b780 msgr2=0x55d94e373c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/276884300 shutdown_connections 2023-12-11T20:27:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/276884300 wait complete. 2023-12-11T20:27:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 -- start start 2023-12-11T20:27:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.685+0000 7fbe56bd0b80 1 Processor -- start 2023-12-11T20:27:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e37a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 0x55d94e37ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe56bd0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e37c3e0 con 0x55d94e36d720 2023-12-11T20:27:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e37c550 con 0x55d94e36c830 2023-12-11T20:27:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe56bd0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d94e37c710 con 0x55d94e36bed0 2023-12-11T20:27:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe56bd0b80 10 client.0 _ll_register_callbacks cb 0x55d94e1a5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe4179c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe40f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e37a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe4179c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34850/0 (socket says 172.21.15.12:34850) 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe4179c700 1 -- 172.21.15.12:0/3007739172 learned_addr learned my addr 172.21.15.12:0/3007739172 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.686+0000 7fbe3bfff700 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 0x55d94e37ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe4179c700 1 -- 172.21.15.12:0/3007739172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 msgr2=0x55d94e37a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe4179c700 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e37a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe4179c700 1 -- 172.21.15.12:0/3007739172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 msgr2=0x55d94e37ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe4179c700 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 0x55d94e37ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe4179c700 1 -- 172.21.15.12:0/3007739172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d94e0e9d80 con 0x55d94e36d720 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e37a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe4179c700 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37bea0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fbe34022000 tx=0x7fbe340094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95e4479b24db922 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.687+0000 7fbe1bfff700 1 -- 172.21.15.12:0/3007739172 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34004a50 con 0x55d94e36d720 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe1bfff700 1 -- 172.21.15.12:0/3007739172 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbe34004bb0 con 0x55d94e36d720 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/3007739172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe3400f040 con 0x55d94e36d720 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe1bfff700 1 -- 172.21.15.12:0/3007739172 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe34004d70 con 0x55d94e36d720 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 10 client.18843 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/3007739172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d94e1101f0 con 0x55d94e36d720 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe1bfff700 1 -- 172.21.15.12:0/3007739172 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe3400f040 con 0x55d94e36d720 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe1bfff700 1 -- 172.21.15.12:0/3007739172 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbe3402d640 con 0x55d94e36d720 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 10 client.18843 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 10 client.18843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 20 client.18843 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d94e3d8b90 0x55d94e3dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 4 client.18843 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.688+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/3007739172 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d94e286f70 con 0x55d94e3d8b90 2023-12-11T20:27:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.689+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d94e3d8b90 0x55d94e3dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.690+0000 7fbe40f9b700 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d94e3d8b90 0x55d94e3dafb0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a0928e756ea1c server_cookie=eaec41edce0b5a42 in_seq=0 out_seq=0 2023-12-11T20:27:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.690+0000 7fbe1bfff700 10 client.18843 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe1bfff700 1 -- 172.21.15.12:0/3007739172 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d94e286f70 con 0x55d94e3d8b90 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe1bfff700 10 client.18843 handle_command_reply: tid=0 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 client.18843 shutdown 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/3007739172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 msgr2=0x55d94e37bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37bea0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fbe34022000 tx=0x7fbe340094c0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/3007739172 shutdown_connections 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d94e3d8b90 0x55d94e3dafb0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d94e36d720 0x55d94e37bea0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d94e36bed0 0x55d94e37a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe1bfff700 0 client.18843 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 --2- 172.21.15.12:0/3007739172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d94e36c830 0x55d94e37ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/3007739172 >> 172.21.15.12:0/3007739172 conn(0x55d94e29b780 msgr2=0x55d94e373c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/3007739172 shutdown_connections 2023-12-11T20:27:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.700+0000 7fbe56bd0b80 1 -- 172.21.15.12:0/3007739172 wait complete. 2023-12-11T20:27:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe56bd0b80 20 client.18843 trim_cache size 0 max 16384 2023-12-11T20:27:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:27:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:27:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:27:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:27:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 -- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe2c0a1470 msgr2=0x7fbe2c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe2c0a1470 0x7fbe2c0a3930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbe3401f000 tx=0x7fbe34020000 comp rx=0 tx=0).stop 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 -- 172.21.15.12:0/788830533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3c1003c0 msgr2=0x7fbe3c104300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3c1003c0 0x7fbe3c104300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000e9c0 tx=0x7fbe3000ecd0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 -- 172.21.15.12:0/788830533 shutdown_connections 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbe2c0a1470 0x7fbe2c0a3930 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe3c101f50 0x7fbe3c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3c1003c0 0x7fbe3c104300 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 --2- 172.21.15.12:0/788830533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c1015b0 0x7fbe3c102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.701+0000 7fbe431ff700 1 -- 172.21.15.12:0/788830533 >> 172.21.15.12:0/788830533 conn(0x7fbe3c0fb930 msgr2=0x7fbe3c068a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.702+0000 7fbe431ff700 1 -- 172.21.15.12:0/788830533 shutdown_connections 2023-12-11T20:27:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:38.702+0000 7fbe431ff700 1 -- 172.21.15.12:0/788830533 wait complete. 2023-12-11T20:27:39.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:38 smithi032 ceph-mon[132488]: pgmap v726: 97 pgs: 97 active+clean; 8.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:27:39.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:38 smithi039 ceph-mon[102205]: pgmap v726: 97 pgs: 97 active+clean; 8.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:27:39.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:38 smithi012 ceph-mon[128787]: pgmap v726: 97 pgs: 97 active+clean; 8.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:27:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:40 smithi032 ceph-mon[132488]: pgmap v727: 97 pgs: 97 active+clean; 8.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:27:41.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:40 smithi039 ceph-mon[102205]: pgmap v727: 97 pgs: 97 active+clean; 8.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:27:41.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:40 smithi012 ceph-mon[128787]: pgmap v727: 97 pgs: 97 active+clean; 8.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:27:42.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:41 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:27:42.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:41 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:27:42.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:41 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:27:42.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:41 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:27:42.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:41 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:27:42.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:41 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:27:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:41 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:27:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:41 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:27:42.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:41 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:27:43.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:42 smithi032 ceph-mon[132488]: pgmap v728: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:27:43.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:42 smithi039 ceph-mon[102205]: pgmap v728: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:27:43.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:42 smithi012 ceph-mon[128787]: pgmap v728: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:27:45.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:44 smithi032 ceph-mon[132488]: pgmap v729: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 17 op/s 2023-12-11T20:27:45.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:44 smithi039 ceph-mon[102205]: pgmap v729: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 17 op/s 2023-12-11T20:27:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:44 smithi012 ceph-mon[128787]: pgmap v729: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 17 op/s 2023-12-11T20:27:47.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:46 smithi032 ceph-mon[132488]: pgmap v730: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:27:47.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:46 smithi039 ceph-mon[102205]: pgmap v730: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:27:47.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:46 smithi012 ceph-mon[128787]: pgmap v730: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:27:49.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:48 smithi032 ceph-mon[132488]: pgmap v731: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:27:49.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:48 smithi039 ceph-mon[102205]: pgmap v731: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:27:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:48 smithi012 ceph-mon[128787]: pgmap v731: 97 pgs: 97 active+clean; 8.9 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:27:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:50 smithi032 ceph-mon[132488]: pgmap v732: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:27:51.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:50 smithi039 ceph-mon[102205]: pgmap v732: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:27:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:50 smithi012 ceph-mon[128787]: pgmap v732: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:27:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.863+0000 7f55a57ff700 1 -- 172.21.15.12:0/1681300240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 msgr2=0x7f55a0104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.863+0000 7f55a57ff700 1 --2- 172.21.15.12:0/1681300240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 0x7f55a0104330 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5590009990 tx=0x7f5590009ca0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.864+0000 7f55a57ff700 1 -- 172.21.15.12:0/1681300240 shutdown_connections 2023-12-11T20:27:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.864+0000 7f55a57ff700 1 --2- 172.21.15.12:0/1681300240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55a01071a0 0x7f55a0109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.864+0000 7f55a57ff700 1 --2- 172.21.15.12:0/1681300240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 0x7f55a0104330 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.864+0000 7f55a57ff700 1 --2- 172.21.15.12:0/1681300240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55a0104870 0x7f55a0106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.864+0000 7f55a57ff700 1 -- 172.21.15.12:0/1681300240 >> 172.21.15.12:0/1681300240 conn(0x7f55a00fb930 msgr2=0x7f55a00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.864+0000 7f55a57ff700 1 -- 172.21.15.12:0/1681300240 shutdown_connections 2023-12-11T20:27:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.864+0000 7f55a57ff700 1 -- 172.21.15.12:0/1681300240 wait complete. 2023-12-11T20:27:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.865+0000 7f55a57ff700 1 Processor -- start 2023-12-11T20:27:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.865+0000 7f55a57ff700 1 -- start start 2023-12-11T20:27:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.865+0000 7f55a57ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 0x7f55a0197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.865+0000 7f55a57ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55a0104870 0x7f55a0197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.865+0000 7f55a57ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55a01071a0 0x7f55a019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f55a57ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a019ee30 con 0x7f55a0101f40 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f55a57ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a019ef70 con 0x7f55a0104870 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f55a57ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a019f100 con 0x7f55a01071a0 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 0x7f55a0197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 0x7f55a0197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50304/0 (socket says 172.21.15.12:50304) 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559effd700 1 -- 172.21.15.12:0/2711304282 learned_addr learned my addr 172.21.15.12:0/2711304282 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559e7fc700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55a0104870 0x7f55a0197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559f7fe700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55a01071a0 0x7f55a019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559effd700 1 -- 172.21.15.12:0/2711304282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55a01071a0 msgr2=0x7f55a019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559effd700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55a01071a0 0x7f55a019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559effd700 1 -- 172.21.15.12:0/2711304282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55a0104870 msgr2=0x7f55a0197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559effd700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55a0104870 0x7f55a0197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.866+0000 7f559effd700 1 -- 172.21.15.12:0/2711304282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55900095f0 con 0x7f55a0101f40 2023-12-11T20:27:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.867+0000 7f559effd700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 0x7f55a0197300 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f55900098e0 tx=0x7f5590005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.867+0000 7f5587fff700 1 -- 172.21.15.12:0/2711304282 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559001d070 con 0x7f55a0101f40 2023-12-11T20:27:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.867+0000 7f55a57ff700 1 -- 172.21.15.12:0/2711304282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a019f380 con 0x7f55a0101f40 2023-12-11T20:27:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.867+0000 7f5587fff700 1 -- 172.21.15.12:0/2711304282 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5590004000 con 0x7f55a0101f40 2023-12-11T20:27:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.867+0000 7f5587fff700 1 -- 172.21.15.12:0/2711304282 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590022ca0 con 0x7f55a0101f40 2023-12-11T20:27:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.867+0000 7f55a57ff700 1 -- 172.21.15.12:0/2711304282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a019f7a0 con 0x7f55a0101f40 2023-12-11T20:27:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.870+0000 7f5587fff700 1 -- 172.21.15.12:0/2711304282 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5590022470 con 0x7f55a0101f40 2023-12-11T20:27:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.872+0000 7f5587fff700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55880a1470 0x7f55880a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.872+0000 7f5587fff700 1 -- 172.21.15.12:0/2711304282 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f55900ce210 con 0x7f55a0101f40 2023-12-11T20:27:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.872+0000 7f559e7fc700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55880a1470 0x7f55880a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.873+0000 7f55b905eb80 1 Processor -- start 2023-12-11T20:27:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.873+0000 7f55b905eb80 1 -- start start 2023-12-11T20:27:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.873+0000 7f559e7fc700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55880a1470 0x7f55880a3930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5594007c60 tx=0x7f55940073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.873+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c04002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.873+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0401140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.873+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0401720 0x5600c0401ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.873+0000 7f55b905eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c035baf0 con 0x5600c03ffed0 2023-12-11T20:27:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.873+0000 7f55b905eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c0359410 con 0x5600c0400830 2023-12-11T20:27:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f55b905eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c0354d00 con 0x5600c0401720 2023-12-11T20:27:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c04002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c04002f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50310/0 (socket says 172.21.15.12:50310) 2023-12-11T20:27:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 -- 172.21.15.12:0/4059649970 learned_addr learned my addr 172.21.15.12:0/4059649970 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559f7fe700 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0401720 0x5600c0401ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559e7fc700 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0401140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 -- 172.21.15.12:0/4059649970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0401720 msgr2=0x5600c0401ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0401720 0x5600c0401ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 -- 172.21.15.12:0/4059649970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 msgr2=0x5600c0401140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0401140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 -- 172.21.15.12:0/4059649970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c01d15d0 con 0x5600c03ffed0 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.874+0000 7f559effd700 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c04002f0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f55900058b0 tx=0x7f5590005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a1e38a183ecf83 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.875+0000 7f55857fa700 1 -- 172.21.15.12:0/4059649970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590004170 con 0x5600c03ffed0 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.875+0000 7f55857fa700 1 -- 172.21.15.12:0/4059649970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f559009bc10 con 0x5600c03ffed0 2023-12-11T20:27:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.875+0000 7f55857fa700 1 -- 172.21.15.12:0/4059649970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559009aa00 con 0x5600c03ffed0 2023-12-11T20:27:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 -- 172.21.15.12:0/4059649970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 msgr2=0x5600c04002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c04002f0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f55900058b0 tx=0x7f5590005ab0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 -- 172.21.15.12:0/4059649970 shutdown_connections 2023-12-11T20:27:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0401720 0x5600c0401ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c04002f0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 --2- 172.21.15.12:0/4059649970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0401140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 -- 172.21.15.12:0/4059649970 >> 172.21.15.12:0/4059649970 conn(0x5600c032f780 msgr2=0x5600c03fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 -- 172.21.15.12:0/4059649970 shutdown_connections 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.876+0000 7f55b905eb80 1 -- 172.21.15.12:0/4059649970 wait complete. 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.877+0000 7f55b905eb80 1 -- start start 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.877+0000 7f55b905eb80 1 Processor -- start 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.877+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c040df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0400830 0x5600c040e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c04152b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f55b905eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c030e500 con 0x5600c03ffed0 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f55b905eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c030e1a0 con 0x5600c0401720 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f55b905eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c01d38c0 con 0x5600c0400830 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f55b905eb80 10 client.0 _ll_register_callbacks cb 0x5600c0239a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c040df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c040df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50316/0 (socket says 172.21.15.12:50316) 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559effd700 1 -- 172.21.15.12:0/674505306 learned_addr learned my addr 172.21.15.12:0/674505306 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559e7fc700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0400830 0x5600c040e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559f7fe700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c04152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559effd700 1 -- 172.21.15.12:0/674505306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0400830 msgr2=0x5600c040e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559effd700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0400830 0x5600c040e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559effd700 1 -- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 msgr2=0x5600c04152b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559effd700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c04152b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559effd700 1 -- 172.21.15.12:0/674505306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a019f7a0 con 0x5600c03ffed0 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559e7fc700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0400830 0x5600c040e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.878+0000 7f559f7fe700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c04152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f559effd700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c040df40 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f559009bb70 tx=0x7f5590097900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6268349bc8bf3b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f5582ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f5582ff5700 1 -- 172.21.15.12:0/674505306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590004170 con 0x5600c03ffed0 2023-12-11T20:27:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f5582ff5700 1 -- 172.21.15.12:0/674505306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f559009b510 con 0x5600c03ffed0 2023-12-11T20:27:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f55b905eb80 1 -- 172.21.15.12:0/674505306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600c03f3730 con 0x5600c03ffed0 2023-12-11T20:27:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f5582ff5700 1 -- 172.21.15.12:0/674505306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55900a3590 con 0x5600c03ffed0 2023-12-11T20:27:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f55b905eb80 10 client.18855 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f55b905eb80 1 -- 172.21.15.12:0/674505306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5600c017dd80 con 0x5600c03ffed0 2023-12-11T20:27:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.879+0000 7f5582ff5700 1 -- 172.21.15.12:0/674505306 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5600c03f3730 con 0x5600c03ffed0 2023-12-11T20:27:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.880+0000 7f5582ff5700 1 -- 172.21.15.12:0/674505306 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f55900a1410 con 0x5600c03ffed0 2023-12-11T20:27:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.880+0000 7f55b905eb80 10 client.18855 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.880+0000 7f55b905eb80 10 client.18855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.880+0000 7f55b905eb80 20 client.18855 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.880+0000 7f55b905eb80 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600c0419940 0x5600c041bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.880+0000 7f55b905eb80 4 client.18855 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.880+0000 7f55b905eb80 1 -- 172.21.15.12:0/674505306 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600c03cfee0 con 0x5600c0419940 2023-12-11T20:27:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.880+0000 7f559e7fc700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600c0419940 0x5600c041bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.881+0000 7f559e7fc700 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600c0419940 0x5600c041bd60 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b4dae50a4aa4143 server_cookie=94ca77701da73a8a in_seq=0 out_seq=0 2023-12-11T20:27:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.881+0000 7f5582ff5700 10 client.18855 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f5582ff5700 1 -- 172.21.15.12:0/674505306 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5600c03cfee0 con 0x5600c0419940 2023-12-11T20:27:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f5582ff5700 10 client.18855 handle_command_reply: tid=0 2023-12-11T20:27:51.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 client.18855 shutdown 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 -- 172.21.15.12:0/674505306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 msgr2=0x5600c040df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c040df40 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f559009bb70 tx=0x7f5590097900 comp rx=0 tx=0).stop 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 -- 172.21.15.12:0/674505306 shutdown_connections 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600c0419940 0x5600c041bd60 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c04152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c03ffed0 0x5600c040df40 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f5582ff5700 0 client.18855 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 --2- 172.21.15.12:0/674505306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c0400830 0x5600c040e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 -- 172.21.15.12:0/674505306 >> 172.21.15.12:0/674505306 conn(0x5600c032f780 msgr2=0x5600c03faca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:51.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 -- 172.21.15.12:0/674505306 shutdown_connections 2023-12-11T20:27:51.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.882+0000 7f55b905eb80 1 -- 172.21.15.12:0/674505306 wait complete. 2023-12-11T20:27:51.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.883+0000 7f55b905eb80 20 client.18855 trim_cache size 0 max 16384 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.903+0000 7f55b905eb80 1 Processor -- start 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.903+0000 7f55b905eb80 1 -- start start 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.903+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0415b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.903+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0400830 0x5600c0415270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.903+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c0401b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.903+0000 7f55b905eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c03f3700 con 0x5600c0400830 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.903+0000 7f55b905eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c04158b0 con 0x5600c0401720 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.903+0000 7f55b905eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c0420f70 con 0x5600c03ffed0 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0400830 0x5600c0415270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0400830 0x5600c0415270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50330/0 (socket says 172.21.15.12:50330) 2023-12-11T20:27:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 -- 172.21.15.12:0/3331131195 learned_addr learned my addr 172.21.15.12:0/3331131195 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559f7fe700 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c0401b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559effd700 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0415b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 -- 172.21.15.12:0/3331131195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 msgr2=0x5600c0415b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0415b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 -- 172.21.15.12:0/3331131195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 msgr2=0x5600c0401b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c0401b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 -- 172.21.15.12:0/3331131195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c0166c00 con 0x5600c0400830 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559effd700 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0415b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559f7fe700 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c0401b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.904+0000 7f559e7fc700 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0400830 0x5600c0415270 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x5600c041c640 tx=0x7f5594013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3120763c4fe3d8ae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.905+0000 7f5585ffb700 1 -- 172.21.15.12:0/3331131195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594026070 con 0x5600c0400830 2023-12-11T20:27:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.905+0000 7f5585ffb700 1 -- 172.21.15.12:0/3331131195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5594015070 con 0x5600c0400830 2023-12-11T20:27:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.905+0000 7f5585ffb700 1 -- 172.21.15.12:0/3331131195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940042b0 con 0x5600c0400830 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.905+0000 7f55b905eb80 1 -- 172.21.15.12:0/3331131195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0400830 msgr2=0x5600c0415270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.905+0000 7f55b905eb80 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0400830 0x5600c0415270 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x5600c041c640 tx=0x7f5594013000 comp rx=0 tx=0).stop 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 -- 172.21.15.12:0/3331131195 shutdown_connections 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0401720 0x5600c0401b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0415b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 --2- 172.21.15.12:0/3331131195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0400830 0x5600c0415270 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 -- 172.21.15.12:0/3331131195 >> 172.21.15.12:0/3331131195 conn(0x5600c032f780 msgr2=0x5600c0407c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 -- 172.21.15.12:0/3331131195 shutdown_connections 2023-12-11T20:27:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 -- 172.21.15.12:0/3331131195 wait complete. 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 -- start start 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.906+0000 7f55b905eb80 1 Processor -- start 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0413250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0413790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f55b905eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0401720 0x5600c0414700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f55b905eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c0414c40 con 0x5600c0401720 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f55b905eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c0414db0 con 0x5600c0400830 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f55b905eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c0414f70 con 0x5600c03ffed0 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f55b905eb80 10 client.0 _ll_register_callbacks cb 0x5600c0239a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0401720 0x5600c0414700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f559effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0413250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0401720 0x5600c0414700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50342/0 (socket says 172.21.15.12:50342) 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.907+0000 7f559f7fe700 1 -- 172.21.15.12:0/2633114318 learned_addr learned my addr 172.21.15.12:0/2633114318 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559e7fc700 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0413790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559f7fe700 1 -- 172.21.15.12:0/2633114318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 msgr2=0x5600c0413250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559f7fe700 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0413250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559f7fe700 1 -- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 msgr2=0x5600c0413790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559f7fe700 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0413790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559f7fe700 1 -- 172.21.15.12:0/2633114318 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5594010c50 con 0x5600c0401720 2023-12-11T20:27:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559effd700 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0413250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559e7fc700 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0413790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f559f7fe700 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0401720 0x5600c0414700 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5598007b90 tx=0x7f5598007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9498d9c32c7d6e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f5582ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f5582ff5700 1 -- 172.21.15.12:0/2633114318 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598004db0 con 0x5600c0401720 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f5582ff5700 1 -- 172.21.15.12:0/2633114318 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5598016b60 con 0x5600c0401720 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.908+0000 7f55b905eb80 1 -- 172.21.15.12:0/2633114318 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f559009bc10 con 0x5600c0401720 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f5582ff5700 1 -- 172.21.15.12:0/2633114318 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5598016d20 con 0x5600c0401720 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f55b905eb80 10 client.18861 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f55b905eb80 1 -- 172.21.15.12:0/2633114318 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5600c01a41f0 con 0x5600c0401720 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f5582ff5700 1 -- 172.21.15.12:0/2633114318 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f559009bc10 con 0x5600c0401720 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f5582ff5700 1 -- 172.21.15.12:0/2633114318 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5598014050 con 0x5600c0401720 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f55b905eb80 10 client.18861 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f55b905eb80 10 client.18861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f55b905eb80 20 client.18861 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f55b905eb80 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600c04710b0 0x5600c04734d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f55b905eb80 4 client.18861 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:27:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.909+0000 7f55b905eb80 1 -- 172.21.15.12:0/2633114318 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5600c031af70 con 0x5600c04710b0 2023-12-11T20:27:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.910+0000 7f559effd700 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600c04710b0 0x5600c04734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.910+0000 7f5582ff5700 10 client.18861 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.910+0000 7f559effd700 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600c04710b0 0x5600c04734d0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a4cf7edfd1ed16d server_cookie=4bdeb6df65f68f87 in_seq=0 out_seq=0 2023-12-11T20:27:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.920+0000 7f5582ff5700 1 -- 172.21.15.12:0/2633114318 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5600c031af70 con 0x5600c04710b0 2023-12-11T20:27:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.920+0000 7f5582ff5700 10 client.18861 handle_command_reply: tid=0 2023-12-11T20:27:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.920+0000 7f55b905eb80 1 client.18861 shutdown 2023-12-11T20:27:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 -- 172.21.15.12:0/2633114318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0401720 msgr2=0x5600c0414700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0401720 0x5600c0414700 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5598007b90 tx=0x7f5598007ea0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 -- 172.21.15.12:0/2633114318 shutdown_connections 2023-12-11T20:27:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5600c04710b0 0x5600c04734d0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600c0401720 0x5600c0414700 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5600c03ffed0 0x5600c0413250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 --2- 172.21.15.12:0/2633114318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5600c0400830 0x5600c0413790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 -- 172.21.15.12:0/2633114318 >> 172.21.15.12:0/2633114318 conn(0x5600c032f780 msgr2=0x5600c0404940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f5582ff5700 0 client.18861 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 -- 172.21.15.12:0/2633114318 shutdown_connections 2023-12-11T20:27:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 1 -- 172.21.15.12:0/2633114318 wait complete. 2023-12-11T20:27:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.921+0000 7f55b905eb80 20 client.18861 trim_cache size 0 max 16384 2023-12-11T20:27:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:27:51.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:27:51.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:27:51.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:27:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 -- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55880a1470 msgr2=0x7f55880a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55880a1470 0x7f55880a3930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5594007c60 tx=0x7f55940073d0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 -- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 msgr2=0x7f55a0197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 0x7f55a0197300 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f55900098e0 tx=0x7f5590005f10 comp rx=0 tx=0).stop 2023-12-11T20:27:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 -- 172.21.15.12:0/2711304282 shutdown_connections 2023-12-11T20:27:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55880a1470 0x7f55880a3930 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55a01071a0 0x7f55a019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a0101f40 0x7f55a0197300 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 --2- 172.21.15.12:0/2711304282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55a0104870 0x7f55a0197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 -- 172.21.15.12:0/2711304282 >> 172.21.15.12:0/2711304282 conn(0x7f55a00fb930 msgr2=0x7f55a0103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:51.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 -- 172.21.15.12:0/2711304282 shutdown_connections 2023-12-11T20:27:51.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:27:51.922+0000 7f55a57ff700 1 -- 172.21.15.12:0/2711304282 wait complete. 2023-12-11T20:27:53.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:52 smithi032 ceph-mon[132488]: pgmap v733: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:27:53.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:52 smithi039 ceph-mon[102205]: pgmap v733: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:27:53.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:52 smithi012 ceph-mon[128787]: pgmap v733: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:27:55.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:54 smithi032 ceph-mon[132488]: pgmap v734: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:55.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:54 smithi039 ceph-mon[102205]: pgmap v734: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:55.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:54 smithi012 ceph-mon[128787]: pgmap v734: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:27:56.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:27:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 -- 172.21.15.12:0/1839715568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 msgr2=0x7f8814100820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 --2- 172.21.15.12:0/1839715568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 0x7f8814100820 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f880400b0d0 tx=0x7f880400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 -- 172.21.15.12:0/1839715568 shutdown_connections 2023-12-11T20:27:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 --2- 172.21.15.12:0/1839715568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8814101f90 0x7f8814108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 --2- 172.21.15.12:0/1839715568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 0x7f8814100820 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 --2- 172.21.15.12:0/1839715568 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88141015f0 0x7f8814101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 -- 172.21.15.12:0/1839715568 >> 172.21.15.12:0/1839715568 conn(0x7f88140fb930 msgr2=0x7f88140fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 -- 172.21.15.12:0/1839715568 shutdown_connections 2023-12-11T20:27:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.908+0000 7f8819bff700 1 -- 172.21.15.12:0/1839715568 wait complete. 2023-12-11T20:27:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.909+0000 7f8819bff700 1 Processor -- start 2023-12-11T20:27:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8819bff700 1 -- start start 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8819bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 0x7f881410b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8819bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88141015f0 0x7f8814109e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8819bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8814101f90 0x7f881410a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8819bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881410aac0 con 0x7f8814100400 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8819bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881410ac30 con 0x7f88141015f0 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8819bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88141a1580 con 0x7f8814101f90 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f88137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 0x7f881410b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f88137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 0x7f881410b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50350/0 (socket says 172.21.15.12:50350) 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f88137fe700 1 -- 172.21.15.12:0/465190712 learned_addr learned my addr 172.21.15.12:0/465190712 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8813fff700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8814101f90 0x7f881410a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.910+0000 7f8812ffd700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88141015f0 0x7f8814109e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f88137fe700 1 -- 172.21.15.12:0/465190712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8814101f90 msgr2=0x7f881410a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f88137fe700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8814101f90 0x7f881410a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f88137fe700 1 -- 172.21.15.12:0/465190712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88141015f0 msgr2=0x7f8814109e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f88137fe700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88141015f0 0x7f8814109e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f88137fe700 1 -- 172.21.15.12:0/465190712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804009d00 con 0x7f8814100400 2023-12-11T20:27:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f8812ffd700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88141015f0 0x7f8814109e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:56.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f88137fe700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 0x7f881410b7a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f88040094c0 tx=0x7f88040094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f8810ff9700 1 -- 172.21.15.12:0/465190712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400e040 con 0x7f8814100400 2023-12-11T20:27:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f8810ff9700 1 -- 172.21.15.12:0/465190712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8804012d90 con 0x7f8814100400 2023-12-11T20:27:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f8819bff700 1 -- 172.21.15.12:0/465190712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88141a1780 con 0x7f8814100400 2023-12-11T20:27:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.911+0000 7f8810ff9700 1 -- 172.21.15.12:0/465190712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880401b450 con 0x7f8814100400 2023-12-11T20:27:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.912+0000 7f8819bff700 1 -- 172.21.15.12:0/465190712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88141a1c00 con 0x7f8814100400 2023-12-11T20:27:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.916+0000 7f8810ff9700 1 -- 172.21.15.12:0/465190712 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8804012900 con 0x7f8814100400 2023-12-11T20:27:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.916+0000 7f882d48db80 1 Processor -- start 2023-12-11T20:27:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.916+0000 7f882d48db80 1 -- start start 2023-12-11T20:27:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.916+0000 7f882d48db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f882d48db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf128f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f882d48db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128fc20 0x55fcf12900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f882d48db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf11e9b50 con 0x55fcf128e3d0 2023-12-11T20:27:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f882d48db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf11e7470 con 0x55fcf128ed30 2023-12-11T20:27:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f882d48db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf11e2d60 con 0x55fcf128fc20 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f8813fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f8813fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50352/0 (socket says 172.21.15.12:50352) 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f8813fff700 1 -- 172.21.15.12:0/3938716873 learned_addr learned my addr 172.21.15.12:0/3938716873 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f8812ffd700 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128fc20 0x55fcf12900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f88137fe700 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf128f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f8813fff700 1 -- 172.21.15.12:0/3938716873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128fc20 msgr2=0x55fcf12900a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f8813fff700 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128fc20 0x55fcf12900a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f8813fff700 1 -- 172.21.15.12:0/3938716873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 msgr2=0x55fcf128f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.917+0000 7f8813fff700 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf128f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f8813fff700 1 -- 172.21.15.12:0/3938716873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcf105f630 con 0x55fcf128e3d0 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f88137fe700 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf128f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f8813fff700 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128e7f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f880c004670 tx=0x7f880c0046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc8694a7fd3540d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f87f9ffb700 1 -- 172.21.15.12:0/3938716873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c004a30 con 0x55fcf128e3d0 2023-12-11T20:27:56.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f8810ff9700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87fc0a1480 0x7f87fc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f87f9ffb700 1 -- 172.21.15.12:0/3938716873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f880c0054b0 con 0x55fcf128e3d0 2023-12-11T20:27:56.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f87f9ffb700 1 -- 172.21.15.12:0/3938716873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c003a60 con 0x55fcf128e3d0 2023-12-11T20:27:56.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f8810ff9700 1 -- 172.21.15.12:0/465190712 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f88040ceb80 con 0x7f8814100400 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.918+0000 7f88137fe700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87fc0a1480 0x7f87fc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 -- 172.21.15.12:0/3938716873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 msgr2=0x55fcf128e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f88137fe700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87fc0a1480 0x7f87fc0a3940 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f88040cc5d0 tx=0x7f8804000f40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128e7f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f880c004670 tx=0x7f880c0046a0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 -- 172.21.15.12:0/3938716873 shutdown_connections 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128fc20 0x55fcf12900a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128e7f0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 --2- 172.21.15.12:0/3938716873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf128f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 -- 172.21.15.12:0/3938716873 >> 172.21.15.12:0/3938716873 conn(0x55fcf11bd7e0 msgr2=0x55fcf128ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 -- 172.21.15.12:0/3938716873 shutdown_connections 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.919+0000 7f882d48db80 1 -- 172.21.15.12:0/3938716873 wait complete. 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.920+0000 7f882d48db80 1 -- start start 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.920+0000 7f882d48db80 1 Processor -- start 2023-12-11T20:27:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f882d48db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf1298260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f882d48db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf12987a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f882d48db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128fc20 0x55fcf129f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f882d48db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf119c560 con 0x55fcf128fc20 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f882d48db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf119c200 con 0x55fcf128ed30 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f882d48db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf1061920 con 0x55fcf128e3d0 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f882d48db80 10 client.0 _ll_register_callbacks cb 0x55fcf10c7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f8813fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf1298260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f8812ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf12987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f8813fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf1298260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34912/0 (socket says 172.21.15.12:34912) 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f8813fff700 1 -- 172.21.15.12:0/1672043771 learned_addr learned my addr 172.21.15.12:0/1672043771 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.921+0000 7f8813fff700 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128fc20 0x55fcf129f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f8812ffd700 1 -- 172.21.15.12:0/1672043771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 msgr2=0x55fcf1298260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f8812ffd700 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf1298260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f8812ffd700 1 -- 172.21.15.12:0/1672043771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128fc20 msgr2=0x55fcf129f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f8812ffd700 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128fc20 0x55fcf129f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f8812ffd700 1 -- 172.21.15.12:0/1672043771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c0042a0 con 0x55fcf128ed30 2023-12-11T20:27:56.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f8812ffd700 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf12987a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f880800baa0 tx=0x7f880800bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18dabbb29d4735e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:56.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f87f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:27:56.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f87f2ffd700 1 -- 172.21.15.12:0/1672043771 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808004500 con 0x55fcf128ed30 2023-12-11T20:27:56.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f87f2ffd700 1 -- 172.21.15.12:0/1672043771 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f880801b440 con 0x55fcf128ed30 2023-12-11T20:27:56.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.922+0000 7f882d48db80 1 -- 172.21.15.12:0/1672043771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcf1281b40 con 0x55fcf128ed30 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f87f2ffd700 1 -- 172.21.15.12:0/1672043771 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f880801b600 con 0x55fcf128ed30 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f882d48db80 10 client.28463 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f882d48db80 1 -- 172.21.15.12:0/1672043771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55fcf100bde0 con 0x55fcf128ed30 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f87f2ffd700 1 -- 172.21.15.12:0/1672043771 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fcf1281b40 con 0x55fcf128ed30 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f87f2ffd700 1 -- 172.21.15.12:0/1672043771 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f88080115d0 con 0x55fcf128ed30 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f882d48db80 10 client.28463 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f882d48db80 10 client.28463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f882d48db80 20 client.28463 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f882d48db80 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fcf12a4130 0x55fcf12a6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f882d48db80 4 client.28463 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.923+0000 7f882d48db80 1 -- 172.21.15.12:0/1672043771 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcf125df40 con 0x55fcf12a4130 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.924+0000 7f8813fff700 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fcf12a4130 0x55fcf12a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.924+0000 7f8813fff700 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fcf12a4130 0x55fcf12a6550 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e63089f0e0a1af45 server_cookie=b72eef26f7f4df5d in_seq=0 out_seq=0 2023-12-11T20:27:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.924+0000 7f87f2ffd700 10 client.28463 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f87f2ffd700 1 -- 172.21.15.12:0/1672043771 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fcf125df40 con 0x55fcf12a4130 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f87f2ffd700 10 client.28463 handle_command_reply: tid=0 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 client.28463 shutdown 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 -- 172.21.15.12:0/1672043771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 msgr2=0x55fcf12987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf12987a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f880800baa0 tx=0x7f880800bdb0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 -- 172.21.15.12:0/1672043771 shutdown_connections 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fcf12a4130 0x55fcf12a6550 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128fc20 0x55fcf129f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf1298260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f87f2ffd700 0 client.28463 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 --2- 172.21.15.12:0/1672043771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128ed30 0x55fcf12987a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 -- 172.21.15.12:0/1672043771 >> 172.21.15.12:0/1672043771 conn(0x55fcf11bd7e0 msgr2=0x55fcf1289a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 -- 172.21.15.12:0/1672043771 shutdown_connections 2023-12-11T20:27:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.925+0000 7f882d48db80 1 -- 172.21.15.12:0/1672043771 wait complete. 2023-12-11T20:27:56.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.926+0000 7f882d48db80 20 client.28463 trim_cache size 0 max 16384 2023-12-11T20:27:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f882d48db80 1 Processor -- start 2023-12-11T20:27:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f882d48db80 1 -- start start 2023-12-11T20:27:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f882d48db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f882d48db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128ed30 0x55fcf128aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f882d48db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 0x55fcf129f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f882d48db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf1299450 con 0x55fcf128e3d0 2023-12-11T20:27:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f882d48db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf128df70 con 0x55fcf128fc20 2023-12-11T20:27:56.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f882d48db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf12a14f0 con 0x55fcf128ed30 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f8813fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f8812ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128ed30 0x55fcf128aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f8813fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50370/0 (socket says 172.21.15.12:50370) 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f8812ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128ed30 0x55fcf128aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34928/0 (socket says 172.21.15.12:34928) 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.951+0000 7f8813fff700 1 -- 172.21.15.12:0/3245475474 learned_addr learned my addr 172.21.15.12:0/3245475474 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f8813fff700 1 -- 172.21.15.12:0/3245475474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128ed30 msgr2=0x55fcf128aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f8813fff700 1 --2- 172.21.15.12:0/3245475474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128ed30 0x55fcf128aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f8813fff700 1 -- 172.21.15.12:0/3245475474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 msgr2=0x55fcf129f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f8813fff700 1 --2- 172.21.15.12:0/3245475474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 0x55fcf129f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f8813fff700 1 -- 172.21.15.12:0/3245475474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcf0ff4c60 con 0x55fcf128e3d0 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f8812ffd700 1 --2- 172.21.15.12:0/3245475474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128ed30 0x55fcf128aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:56.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f8813fff700 1 --2- 172.21.15.12:0/3245475474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128a970 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f880c004590 tx=0x7f880c004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41923614c5f16948 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:56.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f87fa7fc700 1 -- 172.21.15.12:0/3245475474 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c02c5f0 con 0x55fcf128e3d0 2023-12-11T20:27:56.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f87fa7fc700 1 -- 172.21.15.12:0/3245475474 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f880c004ea0 con 0x55fcf128e3d0 2023-12-11T20:27:56.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.952+0000 7f87fa7fc700 1 -- 172.21.15.12:0/3245475474 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c003b40 con 0x55fcf128e3d0 2023-12-11T20:27:56.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 -- 172.21.15.12:0/3245475474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 msgr2=0x55fcf128a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 --2- 172.21.15.12:0/3245475474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128a970 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f880c004590 tx=0x7f880c004d20 comp rx=0 tx=0).stop 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 -- 172.21.15.12:0/3245475474 shutdown_connections 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 --2- 172.21.15.12:0/3245475474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 0x55fcf129f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 --2- 172.21.15.12:0/3245475474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128e3d0 0x55fcf128a970 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 --2- 172.21.15.12:0/3245475474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128ed30 0x55fcf128aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 -- 172.21.15.12:0/3245475474 >> 172.21.15.12:0/3245475474 conn(0x55fcf11bd7e0 msgr2=0x55fcf1296220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 -- 172.21.15.12:0/3245475474 shutdown_connections 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.953+0000 7f882d48db80 1 -- 172.21.15.12:0/3245475474 wait complete. 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.954+0000 7f882d48db80 1 -- start start 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.954+0000 7f882d48db80 1 Processor -- start 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f882d48db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf129d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f882d48db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128ed30 0x55fcf129db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f882d48db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 0x55fcf129eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f882d48db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf129f050 con 0x55fcf128ed30 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f882d48db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf129f1c0 con 0x55fcf128fc20 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f882d48db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcf129f380 con 0x55fcf128e3d0 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f882d48db80 10 client.0 _ll_register_callbacks cb 0x55fcf10c7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f8812ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128ed30 0x55fcf129db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f8813fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf129d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f8812ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128ed30 0x55fcf129db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50380/0 (socket says 172.21.15.12:50380) 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f8813fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf129d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34938/0 (socket says 172.21.15.12:34938) 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f8812ffd700 1 -- 172.21.15.12:0/2401236821 learned_addr learned my addr 172.21.15.12:0/2401236821 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.955+0000 7f8813fff700 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 0x55fcf129eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f8812ffd700 1 -- 172.21.15.12:0/2401236821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 msgr2=0x55fcf129d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:56.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f8812ffd700 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf129d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f8812ffd700 1 -- 172.21.15.12:0/2401236821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 msgr2=0x55fcf129eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f8812ffd700 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 0x55fcf129eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f8812ffd700 1 -- 172.21.15.12:0/2401236821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fcf100bde0 con 0x55fcf128ed30 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f8812ffd700 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128ed30 0x55fcf129db50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x55fcf1285cf0 tx=0x7f8808004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f9c2ff8afde121 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f87f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f87f2ffd700 1 -- 172.21.15.12:0/2401236821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808011d50 con 0x55fcf128ed30 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f882d48db80 1 -- 172.21.15.12:0/2401236821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f880c0054b0 con 0x55fcf128ed30 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.956+0000 7f87f2ffd700 1 -- 172.21.15.12:0/2401236821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8808021030 con 0x55fcf128ed30 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f87f2ffd700 1 -- 172.21.15.12:0/2401236821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8808011440 con 0x55fcf128ed30 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f882d48db80 10 client.18879 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f882d48db80 1 -- 172.21.15.12:0/2401236821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f880c022040 con 0x55fcf128ed30 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f87f2ffd700 1 -- 172.21.15.12:0/2401236821 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f880803f080 con 0x55fcf128ed30 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f87f2ffd700 1 -- 172.21.15.12:0/2401236821 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8808004710 con 0x55fcf128ed30 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f882d48db80 10 client.18879 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f882d48db80 10 client.18879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f882d48db80 20 client.18879 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f882d48db80 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fcf12fb780 0x55fcf12fdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f882d48db80 4 client.18879 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.957+0000 7f882d48db80 1 -- 172.21.15.12:0/2401236821 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fcf11a8fd0 con 0x55fcf12fb780 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.958+0000 7f8813fff700 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fcf12fb780 0x55fcf12fdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.958+0000 7f87f2ffd700 10 client.18879 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.958+0000 7f8813fff700 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fcf12fb780 0x55fcf12fdba0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54189980e5aabf26 server_cookie=31a0af4a9226813d in_seq=0 out_seq=0 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f87f2ffd700 1 -- 172.21.15.12:0/2401236821 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55fcf11a8fd0 con 0x55fcf12fb780 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f87f2ffd700 10 client.18879 handle_command_reply: tid=0 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 client.18879 shutdown 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 -- 172.21.15.12:0/2401236821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128ed30 msgr2=0x55fcf129db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128ed30 0x55fcf129db50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x55fcf1285cf0 tx=0x7f8808004180 comp rx=0 tx=0).stop 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 -- 172.21.15.12:0/2401236821 shutdown_connections 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fcf12fb780 0x55fcf12fdba0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fcf128fc20 0x55fcf129eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fcf128e3d0 0x55fcf129d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f87f2ffd700 0 client.18879 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 --2- 172.21.15.12:0/2401236821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fcf128ed30 0x55fcf129db50 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 -- 172.21.15.12:0/2401236821 >> 172.21.15.12:0/2401236821 conn(0x55fcf11bd7e0 msgr2=0x55fcf128a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 -- 172.21.15.12:0/2401236821 shutdown_connections 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 1 -- 172.21.15.12:0/2401236821 wait complete. 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.959+0000 7f882d48db80 20 client.18879 trim_cache size 0 max 16384 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:27:56.961 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:27:56.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 -- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87fc0a1480 msgr2=0x7f87fc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87fc0a1480 0x7f87fc0a3940 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f88040cc5d0 tx=0x7f8804000f40 comp rx=0 tx=0).stop 2023-12-11T20:27:56.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 -- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 msgr2=0x7f881410b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 0x7f881410b7a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f88040094c0 tx=0x7f88040094f0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 -- 172.21.15.12:0/465190712 shutdown_connections 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f87fc0a1480 0x7f87fc0a3940 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8814101f90 0x7f881410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8814100400 0x7f881410b7a0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 --2- 172.21.15.12:0/465190712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88141015f0 0x7f8814109e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 -- 172.21.15.12:0/465190712 >> 172.21.15.12:0/465190712 conn(0x7f88140fb930 msgr2=0x7f8814104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 -- 172.21.15.12:0/465190712 shutdown_connections 2023-12-11T20:27:56.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:56.960+0000 7f8819bff700 1 -- 172.21.15.12:0/465190712 wait complete. 2023-12-11T20:27:56.981 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:27:56.981 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:27:57.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:56 smithi012 ceph-mon[128787]: pgmap v735: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:27:57.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 -- 172.21.15.12:0/323992275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41048c0 msgr2=0x7f67d4106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 --2- 172.21.15.12:0/323992275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41048c0 0x7f67d4106cb0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009990 tx=0x7f67c8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 -- 172.21.15.12:0/323992275 shutdown_connections 2023-12-11T20:27:57.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 --2- 172.21.15.12:0/323992275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d4101f90 0x7f67d4104380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 --2- 172.21.15.12:0/323992275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d41071f0 0x7f67d4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 --2- 172.21.15.12:0/323992275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41048c0 0x7f67d4106cb0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 -- 172.21.15.12:0/323992275 >> 172.21.15.12:0/323992275 conn(0x7f67d40fb980 msgr2=0x7f67d40fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:57.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 -- 172.21.15.12:0/323992275 shutdown_connections 2023-12-11T20:27:57.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.208+0000 7f67d95ff700 1 -- 172.21.15.12:0/323992275 wait complete. 2023-12-11T20:27:57.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.209+0000 7f67d95ff700 1 Processor -- start 2023-12-11T20:27:57.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.210+0000 7f67d95ff700 1 -- start start 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.210+0000 7f67d95ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d4101f90 0x7f67d4199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.210+0000 7f67d95ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d41048c0 0x7f67d4199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.210+0000 7f67d95ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41071f0 0x7f67d41a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.210+0000 7f67d95ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d41a1030 con 0x7f67d41071f0 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.210+0000 7f67d95ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d41a1170 con 0x7f67d4101f90 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.210+0000 7f67d95ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d41a1300 con 0x7f67d41048c0 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41071f0 0x7f67d41a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41071f0 0x7f67d41a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50402/0 (socket says 172.21.15.12:50402) 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d37fe700 1 -- 172.21.15.12:0/1731827186 learned_addr learned my addr 172.21.15.12:0/1731827186 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d27fc700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d41048c0 0x7f67d4199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d2ffd700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d4101f90 0x7f67d4199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d37fe700 1 -- 172.21.15.12:0/1731827186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d41048c0 msgr2=0x7f67d4199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d37fe700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d41048c0 0x7f67d4199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d37fe700 1 -- 172.21.15.12:0/1731827186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d4101f90 msgr2=0x7f67d4199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d37fe700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d4101f90 0x7f67d4199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.211+0000 7f67d37fe700 1 -- 172.21.15.12:0/1731827186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c80095f0 con 0x7f67d41071f0 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.212+0000 7f67d37fe700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41071f0 0x7f67d41a0a60 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00ef30 tx=0x7f67cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.212+0000 7f67bbfff700 1 -- 172.21.15.12:0/1731827186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc018070 con 0x7f67d41071f0 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.212+0000 7f67bbfff700 1 -- 172.21.15.12:0/1731827186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67cc00f040 con 0x7f67d41071f0 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.212+0000 7f67bbfff700 1 -- 172.21.15.12:0/1731827186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00cbc0 con 0x7f67d41071f0 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.212+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d41a1580 con 0x7f67d41071f0 2023-12-11T20:27:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.212+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d41a1a40 con 0x7f67d41071f0 2023-12-11T20:27:57.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:56 smithi032 ceph-mon[132488]: pgmap v735: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:27:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.213+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d4108df0 con 0x7f67d41071f0 2023-12-11T20:27:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.216+0000 7f67bbfff700 1 -- 172.21.15.12:0/1731827186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f67cc00cd80 con 0x7f67d41071f0 2023-12-11T20:27:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.217+0000 7f67bbfff700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67bc0a1500 0x7f67bc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.218+0000 7f67bbfff700 1 -- 172.21.15.12:0/1731827186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f67cc0ccd90 con 0x7f67d41071f0 2023-12-11T20:27:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.218+0000 7f67d2ffd700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67bc0a1500 0x7f67bc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.219+0000 7f67d2ffd700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67bc0a1500 0x7f67bc0a39c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009c60 tx=0x7f67c4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.221+0000 7f67bbfff700 1 -- 172.21.15.12:0/1731827186 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f67cc096430 con 0x7f67d41071f0 2023-12-11T20:27:57.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:56 smithi039 ceph-mon[102205]: pgmap v735: 97 pgs: 97 active+clean; 9.0 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:27:57.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.517+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67d4068330 con 0x7f67d41071f0 2023-12-11T20:27:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.518+0000 7f67bbfff700 1 -- 172.21.15.12:0/1731827186 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f67cc099a50 con 0x7f67d41071f0 2023-12-11T20:27:57.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:27:57.517 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:27:36.118534+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:27:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67bc0a1500 msgr2=0x7f67bc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67bc0a1500 0x7f67bc0a39c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009c60 tx=0x7f67c4009260 comp rx=0 tx=0).stop 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41071f0 msgr2=0x7f67d41a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41071f0 0x7f67d41a0a60 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00ef30 tx=0x7f67cc00c3a0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 shutdown_connections 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67bc0a1500 0x7f67bc0a39c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67d4101f90 0x7f67d4199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d41071f0 0x7f67d41a0a60 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 --2- 172.21.15.12:0/1731827186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d41048c0 0x7f67d4199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 >> 172.21.15.12:0/1731827186 conn(0x7f67d40fb980 msgr2=0x7f67d41017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.520+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 shutdown_connections 2023-12-11T20:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.521+0000 7f67d95ff700 1 -- 172.21.15.12:0/1731827186 wait complete. 2023-12-11T20:27:57.521 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2023-12-11T20:27:57.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:27:57.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.776+0000 7f32ea1ff700 1 -- 172.21.15.12:0/3883633874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e41071e0 msgr2=0x7f32e4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.776+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/3883633874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e41071e0 0x7f32e4109650 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00b0a0 tx=0x7f32dc00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.777+0000 7f32ea1ff700 1 -- 172.21.15.12:0/3883633874 shutdown_connections 2023-12-11T20:27:57.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.777+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/3883633874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e4101f80 0x7f32e4104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.777+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/3883633874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e41071e0 0x7f32e4109650 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.777+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/3883633874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e41048b0 0x7f32e4106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.777+0000 7f32ea1ff700 1 -- 172.21.15.12:0/3883633874 >> 172.21.15.12:0/3883633874 conn(0x7f32e40fb930 msgr2=0x7f32e40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:57.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.777+0000 7f32ea1ff700 1 -- 172.21.15.12:0/3883633874 shutdown_connections 2023-12-11T20:27:57.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.777+0000 7f32ea1ff700 1 -- 172.21.15.12:0/3883633874 wait complete. 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.778+0000 7f32ea1ff700 1 Processor -- start 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.778+0000 7f32ea1ff700 1 -- start start 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.778+0000 7f32ea1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e4101f80 0x7f32e41973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.778+0000 7f32ea1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e41048b0 0x7f32e4197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.778+0000 7f32ea1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e41071e0 0x7f32e419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.778+0000 7f32ea1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e419eef0 con 0x7f32e4101f80 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.778+0000 7f32ea1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e419f030 con 0x7f32e41071e0 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.778+0000 7f32ea1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e419f1c0 con 0x7f32e41048b0 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e4101f80 0x7f32e41973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e4101f80 0x7f32e41973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50422/0 (socket says 172.21.15.12:50422) 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 -- 172.21.15.12:0/681257501 learned_addr learned my addr 172.21.15.12:0/681257501 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e41048b0 0x7f32e4197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e3fff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e41071e0 0x7f32e419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 -- 172.21.15.12:0/681257501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e41048b0 msgr2=0x7f32e4197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e41048b0 0x7f32e4197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 -- 172.21.15.12:0/681257501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e41071e0 msgr2=0x7f32e419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e41071e0 0x7f32e419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 -- 172.21.15.12:0/681257501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc009d00 con 0x7f32e4101f80 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.779+0000 7f32e37fe700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e4101f80 0x7f32e41973c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f32d400d950 tx=0x7f32d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.780+0000 7f32e0ff9700 1 -- 172.21.15.12:0/681257501 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4009940 con 0x7f32e4101f80 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.780+0000 7f32e0ff9700 1 -- 172.21.15.12:0/681257501 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32d4010460 con 0x7f32e4101f80 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.780+0000 7f32e0ff9700 1 -- 172.21.15.12:0/681257501 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400f620 con 0x7f32e4101f80 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.780+0000 7f32ea1ff700 1 -- 172.21.15.12:0/681257501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e419f4a0 con 0x7f32e4101f80 2023-12-11T20:27:57.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.780+0000 7f32ea1ff700 1 -- 172.21.15.12:0/681257501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e419f960 con 0x7f32e4101f80 2023-12-11T20:27:57.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.783+0000 7f32e0ff9700 1 -- 172.21.15.12:0/681257501 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f32d40105d0 con 0x7f32e4101f80 2023-12-11T20:27:57.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32fdbcdb80 1 Processor -- start 2023-12-11T20:27:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32fdbcdb80 1 -- start start 2023-12-11T20:27:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e48317e0 0x5622e4831c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4832a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4833030 0x5622e48334b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e4788b50 con 0x5622e4833030 2023-12-11T20:27:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e4786470 con 0x5622e4832140 2023-12-11T20:27:57.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e4781d60 con 0x5622e48317e0 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.785+0000 7f32e0ff9700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32cc0a1500 0x7f32cc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4832a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4832a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60210/0 (socket says 172.21.15.12:60210) 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e37fe700 1 -- 172.21.15.12:0/313712841 learned_addr learned my addr 172.21.15.12:0/313712841 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e0ff9700 1 -- 172.21.15.12:0/681257501 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32d40ccb90 con 0x7f32e4101f80 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e3fff700 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e48317e0 0x5622e4831c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4833030 0x5622e48334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e3fff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32cc0a1500 0x7f32cc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e37fe700 1 -- 172.21.15.12:0/313712841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e48317e0 msgr2=0x5622e4831c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e37fe700 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e48317e0 0x5622e4831c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e37fe700 1 -- 172.21.15.12:0/313712841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4833030 msgr2=0x5622e48334b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e37fe700 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4833030 0x5622e48334b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.786+0000 7f32e37fe700 1 -- 172.21.15.12:0/313712841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622e45fe630 con 0x5622e4832140 2023-12-11T20:27:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.787+0000 7f32e37fe700 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4832a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f32d4010b70 tx=0x7f32d406cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ffd54d2a1a342ee server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.787+0000 7f32c9ffb700 1 -- 172.21.15.12:0/313712841 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40108d0 con 0x5622e4832140 2023-12-11T20:27:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.787+0000 7f32e3fff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32cc0a1500 0x7f32cc0a39c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009fd0 tx=0x7f32dc00b700 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.787+0000 7f32c9ffb700 1 -- 172.21.15.12:0/313712841 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32d40656c0 con 0x5622e4832140 2023-12-11T20:27:57.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.787+0000 7f32c9ffb700 1 -- 172.21.15.12:0/313712841 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40a2190 con 0x5622e4832140 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/313712841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 msgr2=0x5622e4832a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4832a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f32d4010b70 tx=0x7f32d406cdc0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/313712841 shutdown_connections 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4833030 0x5622e48334b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e48317e0 0x5622e4831c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/313712841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4832a50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/313712841 >> 172.21.15.12:0/313712841 conn(0x5622e475c7e0 msgr2=0x5622e4829d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/313712841 shutdown_connections 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.788+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/313712841 wait complete. 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.789+0000 7f32fdbcdb80 1 -- start start 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.789+0000 7f32fdbcdb80 1 Processor -- start 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.789+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e483b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.789+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4832140 0x5622e483bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.789+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4833030 0x5622e4842ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.789+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e473b560 con 0x5622e48317e0 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.789+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e473b200 con 0x5622e4833030 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.789+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e4600920 con 0x5622e4832140 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32fdbcdb80 10 client.0 _ll_register_callbacks cb 0x5622e4666a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e483b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e483b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50442/0 (socket says 172.21.15.12:50442) 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e37fe700 1 -- 172.21.15.12:0/1695038019 learned_addr learned my addr 172.21.15.12:0/1695038019 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:57.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e3fff700 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4833030 0x5622e4842ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4832140 0x5622e483bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e37fe700 1 -- 172.21.15.12:0/1695038019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4832140 msgr2=0x5622e483bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e37fe700 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4832140 0x5622e483bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e37fe700 1 -- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4833030 msgr2=0x5622e4842ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e37fe700 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4833030 0x5622e4842ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e37fe700 1 -- 172.21.15.12:0/1695038019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e419f960 con 0x5622e48317e0 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.790+0000 7f32e3fff700 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4833030 0x5622e4842ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32e37fe700 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e483b620 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f32d4099d90 tx=0x7f32d4010980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3321a56c7f610e9c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32c2ffd700 1 -- 172.21.15.12:0/1695038019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d409c030 con 0x5622e48317e0 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32c2ffd700 1 -- 172.21.15.12:0/1695038019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32d409d070 con 0x5622e48317e0 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/1695038019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622e4820b40 con 0x5622e48317e0 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32c2ffd700 1 -- 172.21.15.12:0/1695038019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32d40a2190 con 0x5622e48317e0 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32fdbcdb80 10 client.18897 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/1695038019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5622e45aade0 con 0x5622e48317e0 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.791+0000 7f32c2ffd700 1 -- 172.21.15.12:0/1695038019 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32d40b1020 con 0x5622e48317e0 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.792+0000 7f32c2ffd700 1 -- 172.21.15.12:0/1695038019 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f32d40a1d00 con 0x5622e48317e0 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.792+0000 7f32fdbcdb80 10 client.18897 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.792+0000 7f32fdbcdb80 10 client.18897 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.792+0000 7f32fdbcdb80 20 client.18897 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:57.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.792+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5622e4846ee0 0x5622e4849300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.792+0000 7f32fdbcdb80 4 client.18897 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.792+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/1695038019 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622e47fcf40 con 0x5622e4846ee0 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.792+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5622e4846ee0 0x5622e4849300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.793+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5622e4846ee0 0x5622e4849300 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d9f558078d1d575 server_cookie=5d00dee0544eb464 in_seq=0 out_seq=0 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.793+0000 7f32c2ffd700 10 client.18897 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32c2ffd700 1 -- 172.21.15.12:0/1695038019 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5622e47fcf40 con 0x5622e4846ee0 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32c2ffd700 10 client.18897 handle_command_reply: tid=0 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 client.18897 shutdown 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/1695038019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 msgr2=0x5622e483b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e483b620 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f32d4099d90 tx=0x7f32d4010980 comp rx=0 tx=0).stop 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/1695038019 shutdown_connections 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5622e4846ee0 0x5622e4849300 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4833030 0x5622e4842ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e483b620 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/1695038019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4832140 0x5622e483bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32c2ffd700 0 client.18897 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:27:57.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/1695038019 >> 172.21.15.12:0/1695038019 conn(0x5622e475c7e0 msgr2=0x5622e4828a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:57.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/1695038019 shutdown_connections 2023-12-11T20:27:57.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/1695038019 wait complete. 2023-12-11T20:27:57.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.794+0000 7f32fdbcdb80 20 client.18897 trim_cache size 0 max 16384 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.811+0000 7f32fdbcdb80 1 Processor -- start 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32fdbcdb80 1 -- start start 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e48317e0 0x5622e4843250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4832140 0x5622e4842b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4833410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e4846cf0 con 0x5622e4832140 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e4836b40 con 0x5622e48317e0 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e48208d0 con 0x5622e4833030 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4832140 0x5622e4842b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4832140 0x5622e4842b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50458/0 (socket says 172.21.15.12:50458) 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32e2ffd700 1 -- 172.21.15.12:0/4226495230 learned_addr learned my addr 172.21.15.12:0/4226495230 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32e37fe700 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e48317e0 0x5622e4843250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.812+0000 7f32e3fff700 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4833410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32e2ffd700 1 -- 172.21.15.12:0/4226495230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 msgr2=0x5622e4833410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4833410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32e2ffd700 1 -- 172.21.15.12:0/4226495230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e48317e0 msgr2=0x5622e4843250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e48317e0 0x5622e4843250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32e2ffd700 1 -- 172.21.15.12:0/4226495230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622e4593c60 con 0x5622e4832140 2023-12-11T20:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32e3fff700 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4833410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4832140 0x5622e4842b60 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x5622e4849bf0 tx=0x7f32d8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d550f4841689a574 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32ca7fc700 1 -- 172.21.15.12:0/4226495230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8011e80 con 0x5622e4832140 2023-12-11T20:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32ca7fc700 1 -- 172.21.15.12:0/4226495230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32d8018040 con 0x5622e4832140 2023-12-11T20:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.813+0000 7f32ca7fc700 1 -- 172.21.15.12:0/4226495230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d801f050 con 0x5622e4832140 2023-12-11T20:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4226495230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4832140 msgr2=0x5622e4842b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4832140 0x5622e4842b60 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x5622e4849bf0 tx=0x7f32d8009260 comp rx=0 tx=0).stop 2023-12-11T20:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4226495230 shutdown_connections 2023-12-11T20:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e48317e0 0x5622e4843250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4833410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4226495230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e4832140 0x5622e4842b60 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4226495230 >> 172.21.15.12:0/4226495230 conn(0x5622e475c7e0 msgr2=0x5622e483a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4226495230 shutdown_connections 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.814+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4226495230 wait complete. 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.815+0000 7f32fdbcdb80 1 -- start start 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.815+0000 7f32fdbcdb80 1 Processor -- start 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e48404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4840a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32fdbcdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4841980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e4841ec0 con 0x5622e48317e0 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e4842030 con 0x5622e4832140 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32fdbcdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622e48421f0 con 0x5622e4833030 2023-12-11T20:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32fdbcdb80 10 client.0 _ll_register_callbacks cb 0x5622e4666a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4840a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4841980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e48404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4840a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60236/0 (socket says 172.21.15.12:60236) 2023-12-11T20:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.816+0000 7f32e2ffd700 1 -- 172.21.15.12:0/4289598118 learned_addr learned my addr 172.21.15.12:0/4289598118 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:57.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.817+0000 7f32e2ffd700 1 -- 172.21.15.12:0/4289598118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 msgr2=0x5622e4841980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:57.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.817+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4841980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.817+0000 7f32e2ffd700 1 -- 172.21.15.12:0/4289598118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 msgr2=0x5622e48404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.817+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e48404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.817+0000 7f32e2ffd700 1 -- 172.21.15.12:0/4289598118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622e45d1250 con 0x5622e4832140 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.817+0000 7f32e37fe700 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e48404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.817+0000 7f32e2ffd700 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4840a10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32d8005920 tx=0x7f32d8005160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d44888b0faed8067 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.817+0000 7f32c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.818+0000 7f32c2ffd700 1 -- 172.21.15.12:0/4289598118 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80049c0 con 0x5622e4832140 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.818+0000 7f32c2ffd700 1 -- 172.21.15.12:0/4289598118 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32d8004b20 con 0x5622e4832140 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.818+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4289598118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32d40656c0 con 0x5622e4832140 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.818+0000 7f32c2ffd700 1 -- 172.21.15.12:0/4289598118 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32d8004ce0 con 0x5622e4832140 2023-12-11T20:27:57.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.818+0000 7f32fdbcdb80 10 client.28490 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.818+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4289598118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5622e45a92b0 con 0x5622e4832140 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.818+0000 7f32c2ffd700 1 -- 172.21.15.12:0/4289598118 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32d40656c0 con 0x5622e4832140 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.819+0000 7f32c2ffd700 1 -- 172.21.15.12:0/4289598118 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f32d802d070 con 0x5622e4832140 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.819+0000 7f32fdbcdb80 10 client.28490 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.819+0000 7f32fdbcdb80 10 client.28490 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.819+0000 7f32fdbcdb80 20 client.28490 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.819+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5622e489dd50 0x5622e48a0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.819+0000 7f32fdbcdb80 4 client.28490 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.819+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4289598118 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5622e4747fd0 con 0x5622e489dd50 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.819+0000 7f32e37fe700 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5622e489dd50 0x5622e48a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32e37fe700 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5622e489dd50 0x5622e48a0170 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41d9a60d68e3f0e6 server_cookie=35acb7fce614607d in_seq=0 out_seq=0 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32c2ffd700 10 client.28490 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32c2ffd700 1 -- 172.21.15.12:0/4289598118 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5622e4747fd0 con 0x5622e489dd50 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32c2ffd700 10 client.28490 handle_command_reply: tid=0 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 client.28490 shutdown 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4289598118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 msgr2=0x5622e4840a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4840a10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32d8005920 tx=0x7f32d8005160 comp rx=0 tx=0).stop 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4289598118 shutdown_connections 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5622e489dd50 0x5622e48a0170 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5622e4833030 0x5622e4841980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e48317e0 0x5622e48404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 --2- 172.21.15.12:0/4289598118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5622e4832140 0x5622e4840a10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32c2ffd700 0 client.28490 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4289598118 >> 172.21.15.12:0/4289598118 conn(0x5622e475c7e0 msgr2=0x5622e484dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4289598118 shutdown_connections 2023-12-11T20:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.820+0000 7f32fdbcdb80 1 -- 172.21.15.12:0/4289598118 wait complete. 2023-12-11T20:27:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32fdbcdb80 20 client.28490 trim_cache size 0 max 16384 2023-12-11T20:27:57.825 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 -- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32cc0a1500 msgr2=0x7f32cc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32cc0a1500 0x7f32cc0a39c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009fd0 tx=0x7f32dc00b700 comp rx=0 tx=0).stop 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 -- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e4101f80 msgr2=0x7f32e41973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e4101f80 0x7f32e41973c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f32d400d950 tx=0x7f32d400dc60 comp rx=0 tx=0).stop 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 -- 172.21.15.12:0/681257501 shutdown_connections 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f32cc0a1500 0x7f32cc0a39c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32e41071e0 0x7f32e419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32e4101f80 0x7f32e41973c0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 --2- 172.21.15.12:0/681257501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e41048b0 0x7f32e4197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.821+0000 7f32ea1ff700 1 -- 172.21.15.12:0/681257501 >> 172.21.15.12:0/681257501 conn(0x7f32e40fb930 msgr2=0x7f32e41029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.822+0000 7f32ea1ff700 1 -- 172.21.15.12:0/681257501 shutdown_connections 2023-12-11T20:27:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:57.822+0000 7f32ea1ff700 1 -- 172.21.15.12:0/681257501 wait complete. 2023-12-11T20:27:57.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:27:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 -- 172.21.15.12:0/3063958131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c1003f0 msgr2=0x7fbf7c100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 --2- 172.21.15.12:0/3063958131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c1003f0 0x7fbf7c100810 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0099c0 tx=0x7fbf6c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 -- 172.21.15.12:0/3063958131 shutdown_connections 2023-12-11T20:27:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 --2- 172.21.15.12:0/3063958131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf7c101f80 0x7fbf7c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 --2- 172.21.15.12:0/3063958131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c1003f0 0x7fbf7c100810 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 --2- 172.21.15.12:0/3063958131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf7c1015e0 0x7fbf7c101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 -- 172.21.15.12:0/3063958131 >> 172.21.15.12:0/3063958131 conn(0x7fbf7c0fb960 msgr2=0x7fbf7c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 -- 172.21.15.12:0/3063958131 shutdown_connections 2023-12-11T20:27:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.078+0000 7fbf827ff700 1 -- 172.21.15.12:0/3063958131 wait complete. 2023-12-11T20:27:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.080+0000 7fbf827ff700 1 Processor -- start 2023-12-11T20:27:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.080+0000 7fbf827ff700 1 -- start start 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.080+0000 7fbf827ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf7c1015e0 0x7fbf7c197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.080+0000 7fbf827ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf7c101f80 0x7fbf7c197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.080+0000 7fbf827ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c19cb60 0x7fbf7c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.080+0000 7fbf827ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c19f520 con 0x7fbf7c19cb60 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.080+0000 7fbf827ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c19f660 con 0x7fbf7c101f80 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.080+0000 7fbf827ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c19f7f0 con 0x7fbf7c1015e0 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf80d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c19cb60 0x7fbf7c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf80d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c19cb60 0x7fbf7c19ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50482/0 (socket says 172.21.15.12:50482) 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf80d9c700 1 -- 172.21.15.12:0/1583308312 learned_addr learned my addr 172.21.15.12:0/1583308312 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf7c101f80 0x7fbf7c197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf7c1015e0 0x7fbf7c197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf80d9c700 1 -- 172.21.15.12:0/1583308312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf7c1015e0 msgr2=0x7fbf7c197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf80d9c700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf7c1015e0 0x7fbf7c197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf80d9c700 1 -- 172.21.15.12:0/1583308312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf7c101f80 msgr2=0x7fbf7c197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf80d9c700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf7c101f80 0x7fbf7c197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.081+0000 7fbf80d9c700 1 -- 172.21.15.12:0/1583308312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c0095f0 con 0x7fbf7c19cb60 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.082+0000 7fbf80d9c700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c19cb60 0x7fbf7c19ef50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fbf74007ee0 tx=0x7fbf7400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.082+0000 7fbf797fa700 1 -- 172.21.15.12:0/1583308312 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400ddd0 con 0x7fbf7c19cb60 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.082+0000 7fbf797fa700 1 -- 172.21.15.12:0/1583308312 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf7400f040 con 0x7fbf7c19cb60 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.082+0000 7fbf797fa700 1 -- 172.21.15.12:0/1583308312 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740047d0 con 0x7fbf7c19cb60 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.082+0000 7fbf827ff700 1 -- 172.21.15.12:0/1583308312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c1092a0 con 0x7fbf7c19cb60 2023-12-11T20:27:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.082+0000 7fbf827ff700 1 -- 172.21.15.12:0/1583308312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c109760 con 0x7fbf7c19cb60 2023-12-11T20:27:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.087+0000 7fbf797fa700 1 -- 172.21.15.12:0/1583308312 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fbf74003a00 con 0x7fbf7c19cb60 2023-12-11T20:27:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.088+0000 7fbf96090b80 1 Processor -- start 2023-12-11T20:27:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.088+0000 7fbf96090b80 1 -- start start 2023-12-11T20:27:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593e8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf96090b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557459342b50 con 0x5574593e8c20 2023-12-11T20:27:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf96090b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557459340470 con 0x5574593e73d0 2023-12-11T20:27:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf96090b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745933bd60 con 0x5574593e7d30 2023-12-11T20:27:58.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50498/0 (socket says 172.21.15.12:50498) 2023-12-11T20:27:58.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/733380187 learned_addr learned my addr 172.21.15.12:0/733380187 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.089+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf797fa700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbf640a1550 0x7fbf640a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/733380187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 msgr2=0x5574593e8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593e8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/733380187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 msgr2=0x5574593e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/733380187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574591b8630 con 0x5574593e8c20 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf797fa700 1 -- 172.21.15.12:0/1583308312 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbf740cc560 con 0x7fbf7c19cb60 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf80d9c700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbf640a1550 0x7fbf640a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e90a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fbf70012840 tx=0x7fbf70007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d3e3b828c7512d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.090+0000 7fbf627fc700 1 -- 172.21.15.12:0/733380187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70012e60 con 0x5574593e8c20 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf627fc700 1 -- 172.21.15.12:0/733380187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf700044c0 con 0x5574593e8c20 2023-12-11T20:27:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf627fc700 1 -- 172.21.15.12:0/733380187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70005240 con 0x5574593e8c20 2023-12-11T20:27:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf96090b80 1 -- 172.21.15.12:0/733380187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 msgr2=0x5574593e90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf96090b80 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e90a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fbf70012840 tx=0x7fbf70007840 comp rx=0 tx=0).stop 2023-12-11T20:27:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf80d9c700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbf640a1550 0x7fbf640a3a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbf74095d30 tx=0x7fbf74004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf96090b80 1 -- 172.21.15.12:0/733380187 shutdown_connections 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf96090b80 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf96090b80 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e90a0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf96090b80 1 --2- 172.21.15.12:0/733380187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593e8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.091+0000 7fbf96090b80 1 -- 172.21.15.12:0/733380187 >> 172.21.15.12:0/733380187 conn(0x5574593167e0 msgr2=0x5574593e3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.092+0000 7fbf96090b80 1 -- 172.21.15.12:0/733380187 shutdown_connections 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.092+0000 7fbf96090b80 1 -- 172.21.15.12:0/733380187 wait complete. 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.092+0000 7fbf96090b80 1 -- start start 2023-12-11T20:27:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.092+0000 7fbf96090b80 1 Processor -- start 2023-12-11T20:27:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e7d30 0x5574593f1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e8c20 0x5574593f8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf96090b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574592f5560 con 0x5574593e7d30 2023-12-11T20:27:58.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf96090b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574592f5200 con 0x5574593e73d0 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf96090b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574591ba920 con 0x5574593e8c20 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf96090b80 10 client.0 _ll_register_callbacks cb 0x557459220a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf7bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e7d30 0x5574593f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60268/0 (socket says 172.21.15.12:60268) 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/333952792 learned_addr learned my addr 172.21.15.12:0/333952792 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.093+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e8c20 0x5574593f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.094+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/333952792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e8c20 msgr2=0x5574593f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.094+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e8c20 0x5574593f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.094+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/333952792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e7d30 msgr2=0x5574593f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.094+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e7d30 0x5574593f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.094+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/333952792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7001a040 con 0x5574593e73d0 2023-12-11T20:27:58.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.094+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e7d30 0x5574593f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.094+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f11e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbf70015040 tx=0x7fbf70017040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87dd0159dd958746 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.094+0000 7fbf5b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.095+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/333952792 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70004980 con 0x5574593e73d0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.095+0000 7fbf96090b80 1 -- 172.21.15.12:0/333952792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574593dab40 con 0x5574593e73d0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.095+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/333952792 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbf70000e40 con 0x5574593e73d0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.095+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/333952792 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf700050f0 con 0x5574593e73d0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.095+0000 7fbf96090b80 10 client.28502 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.095+0000 7fbf96090b80 1 -- 172.21.15.12:0/333952792 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557459164de0 con 0x5574593e73d0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.095+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/333952792 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf70033080 con 0x5574593e73d0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.095+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/333952792 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbf7002d030 con 0x5574593e73d0 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.096+0000 7fbf96090b80 10 client.28502 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.096+0000 7fbf96090b80 10 client.28502 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.096+0000 7fbf96090b80 20 client.28502 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.096+0000 7fbf96090b80 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5574593fcea0 0x5574593ff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.096+0000 7fbf96090b80 4 client.28502 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.096+0000 7fbf96090b80 1 -- 172.21.15.12:0/333952792 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574593b6f40 con 0x5574593fcea0 2023-12-11T20:27:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.096+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5574593fcea0 0x5574593ff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.097+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5574593fcea0 0x5574593ff2c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=68a376ade4fd0be0 server_cookie=fce42983db3661b2 in_seq=0 out_seq=0 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.097+0000 7fbf5b7fe700 10 client.28502 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.097+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/333952792 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5574593b6f40 con 0x5574593fcea0 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.097+0000 7fbf5b7fe700 10 client.28502 handle_command_reply: tid=0 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 client.28502 shutdown 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 -- 172.21.15.12:0/333952792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 msgr2=0x5574593f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f11e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbf70015040 tx=0x7fbf70017040 comp rx=0 tx=0).stop 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 -- 172.21.15.12:0/333952792 shutdown_connections 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5574593fcea0 0x5574593ff2c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f11e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e8c20 0x5574593f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf5b7fe700 0 client.28502 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 --2- 172.21.15.12:0/333952792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e7d30 0x5574593f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 -- 172.21.15.12:0/333952792 >> 172.21.15.12:0/333952792 conn(0x5574593167e0 msgr2=0x5574593e2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 -- 172.21.15.12:0/333952792 shutdown_connections 2023-12-11T20:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 1 -- 172.21.15.12:0/333952792 wait complete. 2023-12-11T20:27:58.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.098+0000 7fbf96090b80 20 client.28502 trim_cache size 0 max 16384 2023-12-11T20:27:58.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.112+0000 7fbf96090b80 1 Processor -- start 2023-12-11T20:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.112+0000 7fbf96090b80 1 -- start start 2023-12-11T20:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.112+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf96090b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574593deb50 con 0x5574593e8c20 2023-12-11T20:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf96090b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574593f2380 con 0x5574593e73d0 2023-12-11T20:27:58.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf96090b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574593eee70 con 0x5574593e7d30 2023-12-11T20:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50530/0 (socket says 172.21.15.12:50530) 2023-12-11T20:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/3715737171 learned_addr learned my addr 172.21.15.12:0/3715737171 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/3715737171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 msgr2=0x5574593f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/3715737171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 msgr2=0x5574593f06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.113+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/3715737171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55745914dc60 con 0x5574593e8c20 2023-12-11T20:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.114+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e9000 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fbf70012590 tx=0x7fbf70007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a4183df7d80d08 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.114+0000 7fbf62ffd700 1 -- 172.21.15.12:0/3715737171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70020e70 con 0x5574593e8c20 2023-12-11T20:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.114+0000 7fbf62ffd700 1 -- 172.21.15.12:0/3715737171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5574593dab40 con 0x5574593e8c20 2023-12-11T20:27:58.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.114+0000 7fbf62ffd700 1 -- 172.21.15.12:0/3715737171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf700077d0 con 0x5574593e8c20 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 -- 172.21.15.12:0/3715737171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 msgr2=0x5574593e9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e9000 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fbf70012590 tx=0x7fbf70007d70 comp rx=0 tx=0).stop 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 -- 172.21.15.12:0/3715737171 shutdown_connections 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593e9000 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 --2- 172.21.15.12:0/3715737171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 -- 172.21.15.12:0/3715737171 >> 172.21.15.12:0/3715737171 conn(0x5574593167e0 msgr2=0x5574593ef1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 -- 172.21.15.12:0/3715737171 shutdown_connections 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 -- 172.21.15.12:0/3715737171 wait complete. 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.115+0000 7fbf96090b80 1 -- start start 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.116+0000 7fbf96090b80 1 Processor -- start 2023-12-11T20:27:58.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.116+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.116+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593f6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.116+0000 7fbf96090b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593f7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.116+0000 7fbf96090b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574593f7750 con 0x5574593e8c20 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.116+0000 7fbf96090b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574593f78c0 con 0x5574593e73d0 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.116+0000 7fbf96090b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574593f7a80 con 0x5574593e7d30 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.116+0000 7fbf96090b80 10 client.0 _ll_register_callbacks cb 0x557459220a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60288/0 (socket says 172.21.15.12:60288) 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/2043194209 learned_addr learned my addr 172.21.15.12:0/2043194209 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/2043194209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 msgr2=0x5574593f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/2043194209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 msgr2=0x5574593f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593f7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.117+0000 7fbf7b7fe700 1 -- 172.21.15.12:0/2043194209 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557459164de0 con 0x5574593e73d0 2023-12-11T20:27:58.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.118+0000 7fbf7b7fe700 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f5cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf70004b40 tx=0x7fbf70022a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88812ea01035b1d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.118+0000 7fbf5b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:27:58.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.118+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/2043194209 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70020e70 con 0x5574593e73d0 2023-12-11T20:27:58.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.118+0000 7fbf96090b80 1 -- 172.21.15.12:0/2043194209 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf700044c0 con 0x5574593e73d0 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.118+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/2043194209 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbf70036030 con 0x5574593e73d0 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/2043194209 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf70022630 con 0x5574593e73d0 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf96090b80 10 client.28508 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf96090b80 1 -- 172.21.15.12:0/2043194209 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55745918b250 con 0x5574593e73d0 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/2043194209 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf700044c0 con 0x5574593e73d0 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/2043194209 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbf7002d050 con 0x5574593e73d0 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf96090b80 10 client.28508 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf96090b80 10 client.28508 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf96090b80 20 client.28508 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf96090b80 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5574594536c0 0x557459455ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf96090b80 4 client.28508 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:27:58.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.119+0000 7fbf96090b80 1 -- 172.21.15.12:0/2043194209 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557459301fd0 con 0x5574594536c0 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.120+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5574594536c0 0x557459455ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.120+0000 7fbf5b7fe700 10 client.28508 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.120+0000 7fbf7bfff700 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5574594536c0 0x557459455ab0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=61309863f608a332 server_cookie=c59b52459a02b3c6 in_seq=0 out_seq=0 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf5b7fe700 1 -- 172.21.15.12:0/2043194209 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557459301fd0 con 0x5574594536c0 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf5b7fe700 10 client.28508 handle_command_reply: tid=0 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 client.28508 shutdown 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 -- 172.21.15.12:0/2043194209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 msgr2=0x5574593f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f5cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf70004b40 tx=0x7fbf70022a60 comp rx=0 tx=0).stop 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 -- 172.21.15.12:0/2043194209 shutdown_connections 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5574594536c0 0x557459455ab0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5574593e73d0 0x5574593f5cc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574593e8c20 0x5574593f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf5b7fe700 0 client.28508 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 --2- 172.21.15.12:0/2043194209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5574593e7d30 0x5574593f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 -- 172.21.15.12:0/2043194209 >> 172.21.15.12:0/2043194209 conn(0x5574593167e0 msgr2=0x5574593e3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 -- 172.21.15.12:0/2043194209 shutdown_connections 2023-12-11T20:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 1 -- 172.21.15.12:0/2043194209 wait complete. 2023-12-11T20:27:58.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.121+0000 7fbf96090b80 20 client.28508 trim_cache size 0 max 16384 2023-12-11T20:27:58.123 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 -- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbf640a1550 msgr2=0x7fbf640a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbf640a1550 0x7fbf640a3a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbf74095d30 tx=0x7fbf74004ad0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 -- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c19cb60 msgr2=0x7fbf7c19ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c19cb60 0x7fbf7c19ef50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fbf74007ee0 tx=0x7fbf7400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 -- 172.21.15.12:0/1583308312 shutdown_connections 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fbf640a1550 0x7fbf640a3a10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf7c19cb60 0x7fbf7c19ef50 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf7c1015e0 0x7fbf7c197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 --2- 172.21.15.12:0/1583308312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf7c101f80 0x7fbf7c197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 -- 172.21.15.12:0/1583308312 >> 172.21.15.12:0/1583308312 conn(0x7fbf7c0fb960 msgr2=0x7fbf7c104af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 -- 172.21.15.12:0/1583308312 shutdown_connections 2023-12-11T20:27:58.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.122+0000 7fbf827ff700 1 -- 172.21.15.12:0/1583308312 wait complete. 2023-12-11T20:27:58.139 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:57 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1731827186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:27:58.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:27:58.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:57 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1731827186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:27:58.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:57 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1731827186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:27:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.365+0000 7ff3a05ff700 1 -- 172.21.15.12:0/2160076302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981048b0 msgr2=0x7ff398106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.365+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/2160076302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981048b0 0x7ff398106ca0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7ff388009990 tx=0x7ff388009ca0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.366+0000 7ff3a05ff700 1 -- 172.21.15.12:0/2160076302 shutdown_connections 2023-12-11T20:27:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.366+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/2160076302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff398101f80 0x7ff398104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.366+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/2160076302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981071e0 0x7ff398109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.366+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/2160076302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981048b0 0x7ff398106ca0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.366+0000 7ff3a05ff700 1 -- 172.21.15.12:0/2160076302 >> 172.21.15.12:0/2160076302 conn(0x7ff3980fb930 msgr2=0x7ff3980fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.366+0000 7ff3a05ff700 1 -- 172.21.15.12:0/2160076302 shutdown_connections 2023-12-11T20:27:58.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.366+0000 7ff3a05ff700 1 -- 172.21.15.12:0/2160076302 wait complete. 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.367+0000 7ff3a05ff700 1 Processor -- start 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.367+0000 7ff3a05ff700 1 -- start start 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.367+0000 7ff3a05ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff398101f80 0x7ff398199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.367+0000 7ff3a05ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981048b0 0x7ff398199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.367+0000 7ff3a05ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981071e0 0x7ff3981a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.367+0000 7ff3a05ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981a1050 con 0x7ff3981071e0 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.367+0000 7ff3a05ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981a1190 con 0x7ff398101f80 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.367+0000 7ff3a05ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981a1320 con 0x7ff3981048b0 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39e39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff398101f80 0x7ff398199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39eb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981071e0 0x7ff3981a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39e39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff398101f80 0x7ff398199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60308/0 (socket says 172.21.15.12:60308) 2023-12-11T20:27:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39e39b700 1 -- 172.21.15.12:0/1202787101 learned_addr learned my addr 172.21.15.12:0/1202787101 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39db9a700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981048b0 0x7ff398199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39eb9c700 1 -- 172.21.15.12:0/1202787101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981048b0 msgr2=0x7ff398199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981048b0 0x7ff398199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39eb9c700 1 -- 172.21.15.12:0/1202787101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff398101f80 msgr2=0x7ff398199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff398101f80 0x7ff398199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39eb9c700 1 -- 172.21.15.12:0/1202787101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880095f0 con 0x7ff3981071e0 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.368+0000 7ff39e39b700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff398101f80 0x7ff398199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.369+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981071e0 0x7ff3981a0a80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7ff39000efc0 tx=0x7ff39000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.369+0000 7ff38f7fe700 1 -- 172.21.15.12:0/1202787101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390018070 con 0x7ff3981071e0 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.369+0000 7ff38f7fe700 1 -- 172.21.15.12:0/1202787101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff39000f040 con 0x7ff3981071e0 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.369+0000 7ff38f7fe700 1 -- 172.21.15.12:0/1202787101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000cc50 con 0x7ff3981071e0 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.369+0000 7ff3a05ff700 1 -- 172.21.15.12:0/1202787101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3981a15a0 con 0x7ff3981071e0 2023-12-11T20:27:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.369+0000 7ff3a05ff700 1 -- 172.21.15.12:0/1202787101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3981a1a60 con 0x7ff3981071e0 2023-12-11T20:27:58.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.375+0000 7ff38f7fe700 1 -- 172.21.15.12:0/1202787101 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff390003a00 con 0x7ff3981071e0 2023-12-11T20:27:58.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.376+0000 7ff38f7fe700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3840a1500 0x7ff3840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.377+0000 7ff38f7fe700 1 -- 172.21.15.12:0/1202787101 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff3900cc870 con 0x7ff3981071e0 2023-12-11T20:27:58.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.377+0000 7ff3b3fe1b80 1 Processor -- start 2023-12-11T20:27:58.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.377+0000 7ff39e39b700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3840a1500 0x7ff3840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.377+0000 7ff3b3fe1b80 1 -- start start 2023-12-11T20:27:58.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.377+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb287f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 0x55bf8fb29640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb2a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fa83b50 con 0x55bf8fb283d0 2023-12-11T20:27:58.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fa81470 con 0x55bf8fb29c20 2023-12-11T20:27:58.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fa7cd60 con 0x55bf8fb28d30 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39eb9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb2a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39db9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 0x55bf8fb29640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39eb9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb2a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:60320/0 (socket says 172.21.15.12:60320) 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39eb9c700 1 -- 172.21.15.12:0/178250865 learned_addr learned my addr 172.21.15.12:0/178250865 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39e39b700 1 --2- 172.21.15.12:0/178250865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39e39b700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3840a1500 0x7ff3840a39c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff3940115c0 tx=0x7ff394011980 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39eb9c700 1 -- 172.21.15.12:0/178250865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 msgr2=0x55bf8fb29640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/178250865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 0x55bf8fb29640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39eb9c700 1 -- 172.21.15.12:0/178250865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 msgr2=0x55bf8fb287f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/178250865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb287f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.378+0000 7ff39eb9c700 1 -- 172.21.15.12:0/178250865 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf8f8f9630 con 0x55bf8fb29c20 2023-12-11T20:27:58.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.379+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/178250865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb2a0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff3900090a0 tx=0x7ff3900999a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8887691cc1f04f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.379+0000 7ff38cbfe700 1 -- 172.21.15.12:0/178250865 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3900092e0 con 0x55bf8fb29c20 2023-12-11T20:27:58.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.379+0000 7ff38cbfe700 1 -- 172.21.15.12:0/178250865 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff39001b320 con 0x55bf8fb29c20 2023-12-11T20:27:58.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.379+0000 7ff38cbfe700 1 -- 172.21.15.12:0/178250865 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390099e30 con 0x55bf8fb29c20 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/178250865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 msgr2=0x55bf8fb2a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/178250865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb2a0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff3900090a0 tx=0x7ff3900999a0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/178250865 shutdown_connections 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/178250865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb2a0a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/178250865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb287f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/178250865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 0x55bf8fb29640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/178250865 >> 172.21.15.12:0/178250865 conn(0x55bf8fa577e0 msgr2=0x55bf8fb24d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/178250865 shutdown_connections 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.380+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/178250865 wait complete. 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.381+0000 7ff3b3fe1b80 1 -- start start 2023-12-11T20:27:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.381+0000 7ff3b3fe1b80 1 Processor -- start 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb32240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 0x55bf8fb32780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb397c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fa36560 con 0x55bf8fb283d0 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fa36200 con 0x55bf8fb29c20 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8f8fb920 con 0x55bf8fb28d30 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff3b3fe1b80 10 client.0 _ll_register_callbacks cb 0x55bf8f961a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff39e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb32240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff39e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb32240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50580/0 (socket says 172.21.15.12:50580) 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff39e39b700 1 -- 172.21.15.12:0/3225180623 learned_addr learned my addr 172.21.15.12:0/3225180623 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff39db9a700 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 0x55bf8fb32780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.382+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff39e39b700 1 -- 172.21.15.12:0/3225180623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 msgr2=0x55bf8fb32780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff39e39b700 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 0x55bf8fb32780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff39e39b700 1 -- 172.21.15.12:0/3225180623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 msgr2=0x55bf8fb397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff39e39b700 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff39e39b700 1 -- 172.21.15.12:0/3225180623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3981a1a60 con 0x55bf8fb283d0 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff39e39b700 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb32240 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7ff39401dd70 tx=0x7ff394016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51deb2aa9fce3f5c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff381ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff381ffb700 1 -- 172.21.15.12:0/3225180623 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394022070 con 0x55bf8fb283d0 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff381ffb700 1 -- 172.21.15.12:0/3225180623 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff394026410 con 0x55bf8fb283d0 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.383+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/3225180623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf8fb1bb40 con 0x55bf8fb283d0 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff381ffb700 1 -- 172.21.15.12:0/3225180623 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff39400fe60 con 0x55bf8fb283d0 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff3b3fe1b80 10 client.18933 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/3225180623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bf8f8a5de0 con 0x55bf8fb283d0 2023-12-11T20:27:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff381ffb700 1 -- 172.21.15.12:0/3225180623 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bf8fb1bb40 con 0x55bf8fb283d0 2023-12-11T20:27:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff381ffb700 1 -- 172.21.15.12:0/3225180623 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff394031660 con 0x55bf8fb283d0 2023-12-11T20:27:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff3b3fe1b80 10 client.18933 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff3b3fe1b80 10 client.18933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff3b3fe1b80 20 client.18933 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bf8fb3e100 0x55bf8fb40520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff3b3fe1b80 4 client.18933 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.384+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/3225180623 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf8faf7f40 con 0x55bf8fb3e100 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.385+0000 7ff39db9a700 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bf8fb3e100 0x55bf8fb40520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.385+0000 7ff39db9a700 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bf8fb3e100 0x55bf8fb40520 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6339badf397c1f8 server_cookie=cb738b306fa36eb3 in_seq=0 out_seq=0 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.385+0000 7ff381ffb700 10 client.18933 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.386+0000 7ff381ffb700 1 -- 172.21.15.12:0/3225180623 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bf8faf7f40 con 0x55bf8fb3e100 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.386+0000 7ff381ffb700 10 client.18933 handle_command_reply: tid=0 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.386+0000 7ff3b3fe1b80 1 client.18933 shutdown 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.386+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/3225180623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 msgr2=0x55bf8fb32240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.386+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb32240 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7ff39401dd70 tx=0x7ff394016000 comp rx=0 tx=0).stop 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/3225180623 shutdown_connections 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bf8fb3e100 0x55bf8fb40520 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb29c20 0x55bf8fb397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb32240 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/3225180623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb28d30 0x55bf8fb32780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/3225180623 >> 172.21.15.12:0/3225180623 conn(0x55bf8fa577e0 msgr2=0x55bf8fb23a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff381ffb700 0 client.18933 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/3225180623 shutdown_connections 2023-12-11T20:27:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/3225180623 wait complete. 2023-12-11T20:27:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.387+0000 7ff3b3fe1b80 20 client.18933 trim_cache size 0 max 16384 2023-12-11T20:27:58.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.401+0000 7ff3b3fe1b80 1 Processor -- start 2023-12-11T20:27:58.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.401+0000 7ff3b3fe1b80 1 -- start start 2023-12-11T20:27:58.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.401+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb283d0 0x55bf8fb404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.401+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb39780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.401+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb29c20 0x55bf8fb44ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.401+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fb1fb50 con 0x55bf8fb29c20 2023-12-11T20:27:58.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.401+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fb25200 con 0x55bf8fb28d30 2023-12-11T20:27:58.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.401+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fb29430 con 0x55bf8fb283d0 2023-12-11T20:27:58.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39eb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb29c20 0x55bf8fb44ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39eb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb29c20 0x55bf8fb44ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50594/0 (socket says 172.21.15.12:50594) 2023-12-11T20:27:58.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39db9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb39780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39eb9c700 1 -- 172.21.15.12:0/2722756621 learned_addr learned my addr 172.21.15.12:0/2722756621 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39e39b700 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb283d0 0x55bf8fb404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39db9a700 1 -- 172.21.15.12:0/2722756621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb283d0 msgr2=0x55bf8fb404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39db9a700 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb283d0 0x55bf8fb404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39db9a700 1 -- 172.21.15.12:0/2722756621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb29c20 msgr2=0x55bf8fb44ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39db9a700 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb29c20 0x55bf8fb44ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39db9a700 1 -- 172.21.15.12:0/2722756621 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf8f88ec60 con 0x55bf8fb28d30 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.402+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb29c20 0x55bf8fb44ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.403+0000 7ff39db9a700 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb39780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff388005910 tx=0x7ff388005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=babbce8114f88105 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.403+0000 7ff38d3ff700 1 -- 172.21.15.12:0/2722756621 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3880052c0 con 0x55bf8fb28d30 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.403+0000 7ff38d3ff700 1 -- 172.21.15.12:0/2722756621 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff38801e040 con 0x55bf8fb28d30 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.403+0000 7ff38d3ff700 1 -- 172.21.15.12:0/2722756621 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38800b970 con 0x55bf8fb28d30 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/2722756621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 msgr2=0x55bf8fb39780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb39780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff388005910 tx=0x7ff388005960 comp rx=0 tx=0).stop 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/2722756621 shutdown_connections 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb29c20 0x55bf8fb44ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb283d0 0x55bf8fb404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/2722756621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb39780 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/2722756621 >> 172.21.15.12:0/2722756621 conn(0x55bf8fa577e0 msgr2=0x55bf8fb30240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/2722756621 shutdown_connections 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/2722756621 wait complete. 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.404+0000 7ff3b3fe1b80 1 -- start start 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff3b3fe1b80 1 Processor -- start 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb36f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb37440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff3b3fe1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb29c20 0x55bf8fb38400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fb38940 con 0x55bf8fb283d0 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fb38ab0 con 0x55bf8fb28d30 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff3b3fe1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf8fb38c70 con 0x55bf8fb29c20 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff3b3fe1b80 10 client.0 _ll_register_callbacks cb 0x55bf8f961a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff39e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb36f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff39e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb36f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50604/0 (socket says 172.21.15.12:50604) 2023-12-11T20:27:58.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff39e39b700 1 -- 172.21.15.12:0/1149516097 learned_addr learned my addr 172.21.15.12:0/1149516097 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.405+0000 7ff39eb9c700 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb29c20 0x55bf8fb38400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff39db9a700 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb37440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff39e39b700 1 -- 172.21.15.12:0/1149516097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb29c20 msgr2=0x55bf8fb38400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff39e39b700 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb29c20 0x55bf8fb38400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff39e39b700 1 -- 172.21.15.12:0/1149516097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 msgr2=0x55bf8fb37440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff39e39b700 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb37440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff39e39b700 1 -- 172.21.15.12:0/1149516097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf8f8f9630 con 0x55bf8fb283d0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff39e39b700 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb36f00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7ff39400a010 tx=0x7ff394031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550936afcba73cb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff381ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff381ffb700 1 -- 172.21.15.12:0/1149516097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394022040 con 0x55bf8fb283d0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff381ffb700 1 -- 172.21.15.12:0/1149516097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff394031640 con 0x55bf8fb283d0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.406+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/1149516097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff39001b320 con 0x55bf8fb283d0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff381ffb700 1 -- 172.21.15.12:0/1149516097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff394015040 con 0x55bf8fb283d0 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff3b3fe1b80 10 client.18939 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:58.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/1149516097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7ff39810a240 con 0x55bf8fb283d0 2023-12-11T20:27:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff381ffb700 1 -- 172.21.15.12:0/1149516097 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff39001b320 con 0x55bf8fb283d0 2023-12-11T20:27:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff381ffb700 1 -- 172.21.15.12:0/1149516097 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff394004780 con 0x55bf8fb283d0 2023-12-11T20:27:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff3b3fe1b80 10 client.18939 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff3b3fe1b80 10 client.18939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff3b3fe1b80 20 client.18939 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bf8fb95030 0x55bf8fb97450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff3b3fe1b80 4 client.18939 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:27:58.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.407+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/1149516097 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bf8fa42fd0 con 0x55bf8fb95030 2023-12-11T20:27:58.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.408+0000 7ff39db9a700 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bf8fb95030 0x55bf8fb97450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:58.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.408+0000 7ff39db9a700 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bf8fb95030 0x55bf8fb97450 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c97af0be26d230b server_cookie=3720cafdb75be6a in_seq=0 out_seq=0 2023-12-11T20:27:58.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.408+0000 7ff381ffb700 10 client.18939 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:58.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff381ffb700 1 -- 172.21.15.12:0/1149516097 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bf8fa42fd0 con 0x55bf8fb95030 2023-12-11T20:27:58.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff381ffb700 10 client.18939 handle_command_reply: tid=0 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 client.18939 shutdown 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/1149516097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 msgr2=0x55bf8fb36f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb36f00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7ff39400a010 tx=0x7ff394031e60 comp rx=0 tx=0).stop 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/1149516097 shutdown_connections 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bf8fb95030 0x55bf8fb97450 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf8fb29c20 0x55bf8fb38400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bf8fb283d0 0x55bf8fb36f00 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 --2- 172.21.15.12:0/1149516097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bf8fb28d30 0x55bf8fb37440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/1149516097 >> 172.21.15.12:0/1149516097 conn(0x55bf8fa577e0 msgr2=0x55bf8fb44ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff381ffb700 0 client.18939 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/1149516097 shutdown_connections 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 1 -- 172.21.15.12:0/1149516097 wait complete. 2023-12-11T20:27:58.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.409+0000 7ff3b3fe1b80 20 client.18939 trim_cache size 0 max 16384 2023-12-11T20:27:58.413 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:27:58.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 -- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3840a1500 msgr2=0x7ff3840a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3840a1500 0x7ff3840a39c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff3940115c0 tx=0x7ff394011980 comp rx=0 tx=0).stop 2023-12-11T20:27:58.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 -- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981071e0 msgr2=0x7ff3981a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981071e0 0x7ff3981a0a80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7ff39000efc0 tx=0x7ff39000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 -- 172.21.15.12:0/1202787101 shutdown_connections 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff3840a1500 0x7ff3840a39c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff398101f80 0x7ff398199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3981071e0 0x7ff3981a0a80 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 --2- 172.21.15.12:0/1202787101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981048b0 0x7ff398199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 -- 172.21.15.12:0/1202787101 >> 172.21.15.12:0/1202787101 conn(0x7ff3980fb930 msgr2=0x7ff398101860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 -- 172.21.15.12:0/1202787101 shutdown_connections 2023-12-11T20:27:58.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:58.410+0000 7ff3a05ff700 1 -- 172.21.15.12:0/1202787101 wait complete. 2023-12-11T20:27:59.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:27:58 smithi039 ceph-mon[102205]: pgmap v736: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:27:59.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:27:58 smithi012 ceph-mon[128787]: pgmap v736: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:27:59.430 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:27:59.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:27:59.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:27:58 smithi032 ceph-mon[132488]: pgmap v736: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.655+0000 7fd5575ff700 1 -- 172.21.15.12:0/3715040085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 msgr2=0x7fd550109870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.655+0000 7fd5575ff700 1 --2- 172.21.15.12:0/3715040085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 0x7fd550109870 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd54800b0d0 tx=0x7fd54800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.655+0000 7fd5575ff700 1 -- 172.21.15.12:0/3715040085 shutdown_connections 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.655+0000 7fd5575ff700 1 --2- 172.21.15.12:0/3715040085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 0x7fd550109870 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.655+0000 7fd5575ff700 1 --2- 172.21.15.12:0/3715040085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd550101430 0x7fd550101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.655+0000 7fd5575ff700 1 --2- 172.21.15.12:0/3715040085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd550102620 0x7fd550102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.655+0000 7fd5575ff700 1 -- 172.21.15.12:0/3715040085 >> 172.21.15.12:0/3715040085 conn(0x7fd5500fc9a0 msgr2=0x7fd5500fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.656+0000 7fd5575ff700 1 -- 172.21.15.12:0/3715040085 shutdown_connections 2023-12-11T20:27:59.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.656+0000 7fd5575ff700 1 -- 172.21.15.12:0/3715040085 wait complete. 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.657+0000 7fd5575ff700 1 Processor -- start 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.657+0000 7fd5575ff700 1 -- start start 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.657+0000 7fd5575ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd550101430 0x7fd550075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.657+0000 7fd5575ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd550102620 0x7fd5500739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.657+0000 7fd5575ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 0x7fd550073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.657+0000 7fd5575ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500746a0 con 0x7fd550102fc0 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.657+0000 7fd5575ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550074810 con 0x7fd550101430 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.657+0000 7fd5575ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5501a1410 con 0x7fd550102620 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 0x7fd550073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 0x7fd550073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34738/0 (socket says 172.21.15.12:34738) 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 -- 172.21.15.12:0/2275922060 learned_addr learned my addr 172.21.15.12:0/2275922060 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd55539b700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd550101430 0x7fd550075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd554b9a700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd550102620 0x7fd5500739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 -- 172.21.15.12:0/2275922060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd550102620 msgr2=0x7fd5500739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd550102620 0x7fd5500739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 -- 172.21.15.12:0/2275922060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd550101430 msgr2=0x7fd550075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd550101430 0x7fd550075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 -- 172.21.15.12:0/2275922060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548009d00 con 0x7fd550102fc0 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd554b9a700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd550102620 0x7fd5500739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.658+0000 7fd555b9c700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 0x7fd550073f00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd5480079c0 tx=0x7fd54800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.659+0000 7fd5467fc700 1 -- 172.21.15.12:0/2275922060 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54800e040 con 0x7fd550102fc0 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.659+0000 7fd5467fc700 1 -- 172.21.15.12:0/2275922060 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd548004c50 con 0x7fd550102fc0 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.659+0000 7fd5467fc700 1 -- 172.21.15.12:0/2275922060 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54801b6b0 con 0x7fd550102fc0 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.659+0000 7fd5575ff700 1 -- 172.21.15.12:0/2275922060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5501a1640 con 0x7fd550102fc0 2023-12-11T20:27:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.659+0000 7fd5575ff700 1 -- 172.21.15.12:0/2275922060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5501a1a10 con 0x7fd550102fc0 2023-12-11T20:27:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.662+0000 7fd5467fc700 1 -- 172.21.15.12:0/2275922060 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd54801d480 con 0x7fd550102fc0 2023-12-11T20:27:59.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd56b021b80 1 Processor -- start 2023-12-11T20:27:59.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd5467fc700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd53c0a1500 0x7fd53c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd56b021b80 1 -- start start 2023-12-11T20:27:59.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd5467fc700 1 -- 172.21.15.12:0/2275922060 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd5480ce5c0 con 0x7fd550102fc0 2023-12-11T20:27:59.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143e3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd554b9a700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd53c0a1500 0x7fd53c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3db0 0x55eb143e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e4ca0 0x55eb143e5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd56b021b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb1433ebd0 con 0x55eb143e4ca0 2023-12-11T20:27:59.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd56b021b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb1433c4f0 con 0x55eb143e3db0 2023-12-11T20:27:59.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.665+0000 7fd56b021b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb14337de0 con 0x55eb143e3450 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd555b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e4ca0 0x55eb143e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd555b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e4ca0 0x55eb143e5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34742/0 (socket says 172.21.15.12:34742) 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd555b9c700 1 -- 172.21.15.12:0/2219479361 learned_addr learned my addr 172.21.15.12:0/2219479361 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd55539b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd554b9a700 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3db0 0x55eb143e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd55539b700 1 -- 172.21.15.12:0/2219479361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3db0 msgr2=0x55eb143e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd55539b700 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3db0 0x55eb143e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd55539b700 1 -- 172.21.15.12:0/2219479361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e4ca0 msgr2=0x55eb143e5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd55539b700 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e4ca0 0x55eb143e5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd55539b700 1 -- 172.21.15.12:0/2219479361 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb141b46b0 con 0x55eb143e3450 2023-12-11T20:27:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd555b9c700 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e4ca0 0x55eb143e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.666+0000 7fd554b9a700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd53c0a1500 0x7fd53c0a39c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd540009fd0 tx=0x7fd5400138a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.667+0000 7fd55539b700 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143e3870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009c80 tx=0x7fd54c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f889df5e652bbde4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.667+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2219479361 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c011c30 con 0x55eb143e3450 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.667+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2219479361 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd54c0044c0 con 0x55eb143e3450 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.667+0000 7fd53b7fe700 1 -- 172.21.15.12:0/2219479361 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c005020 con 0x55eb143e3450 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 -- 172.21.15.12:0/2219479361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 msgr2=0x55eb143e3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143e3870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009c80 tx=0x7fd54c009f90 comp rx=0 tx=0).stop 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 -- 172.21.15.12:0/2219479361 shutdown_connections 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e4ca0 0x55eb143e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143e3870 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 --2- 172.21.15.12:0/2219479361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3db0 0x55eb143e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 -- 172.21.15.12:0/2219479361 >> 172.21.15.12:0/2219479361 conn(0x55eb14312860 msgr2=0x55eb143dfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 -- 172.21.15.12:0/2219479361 shutdown_connections 2023-12-11T20:27:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.668+0000 7fd56b021b80 1 -- 172.21.15.12:0/2219479361 wait complete. 2023-12-11T20:27:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.669+0000 7fd56b021b80 1 -- start start 2023-12-11T20:27:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.669+0000 7fd56b021b80 1 Processor -- start 2023-12-11T20:27:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.669+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.669+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143ed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.669+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 0x55eb143f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.669+0000 7fd56b021b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb142f15e0 con 0x55eb143e3db0 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd56b021b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb142f1280 con 0x55eb143e4ca0 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd56b021b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb141b69a0 con 0x55eb143e3450 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd56b021b80 10 client.0 _ll_register_callbacks cb 0x55eb1421cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd554b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd554b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34756/0 (socket says 172.21.15.12:34756) 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd554b9a700 1 -- 172.21.15.12:0/300646713 learned_addr learned my addr 172.21.15.12:0/300646713 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd55539b700 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd555b9c700 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 0x55eb143f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd554b9a700 1 -- 172.21.15.12:0/300646713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 msgr2=0x55eb143ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd554b9a700 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143ed1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd554b9a700 1 -- 172.21.15.12:0/300646713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 msgr2=0x55eb143f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd554b9a700 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 0x55eb143f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.670+0000 7fd554b9a700 1 -- 172.21.15.12:0/300646713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5501a1a10 con 0x55eb143e3db0 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.671+0000 7fd554b9a700 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143ed710 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fd540003930 tx=0x7fd5400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c588f7f9307f7416 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.671+0000 7fd538ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.671+0000 7fd538ff9700 1 -- 172.21.15.12:0/300646713 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540018050 con 0x55eb143e3db0 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.671+0000 7fd56b021b80 1 -- 172.21.15.12:0/300646713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb143d6bc0 con 0x55eb143e3db0 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.671+0000 7fd538ff9700 1 -- 172.21.15.12:0/300646713 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd5400208f0 con 0x55eb143e3db0 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.671+0000 7fd538ff9700 1 -- 172.21.15.12:0/300646713 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd540020ab0 con 0x55eb143e3db0 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.671+0000 7fd56b021b80 10 client.18951 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.671+0000 7fd56b021b80 1 -- 172.21.15.12:0/300646713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7fd54c0098e0 con 0x55eb143e3db0 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd538ff9700 1 -- 172.21.15.12:0/300646713 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eb143d6bc0 con 0x55eb143e3db0 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd538ff9700 1 -- 172.21.15.12:0/300646713 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd540029c00 con 0x55eb143e3db0 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd56b021b80 10 client.18951 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd56b021b80 10 client.18951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd56b021b80 20 client.18951 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd56b021b80 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55eb143f9050 0x55eb143fb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd56b021b80 4 client.18951 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd56b021b80 1 -- 172.21.15.12:0/300646713 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb143b2fc0 con 0x55eb143f9050 2023-12-11T20:27:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.672+0000 7fd55539b700 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55eb143f9050 0x55eb143fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.673+0000 7fd55539b700 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55eb143f9050 0x55eb143fb470 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6b5263e82f1d22b server_cookie=e09d7c62042fd2dd in_seq=0 out_seq=0 2023-12-11T20:27:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.673+0000 7fd538ff9700 10 client.18951 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd538ff9700 1 -- 172.21.15.12:0/300646713 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eb143b2fc0 con 0x55eb143f9050 2023-12-11T20:27:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd538ff9700 10 client.18951 handle_command_reply: tid=0 2023-12-11T20:27:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 client.18951 shutdown 2023-12-11T20:27:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 -- 172.21.15.12:0/300646713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 msgr2=0x55eb143ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143ed710 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fd540003930 tx=0x7fd5400047c0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 -- 172.21.15.12:0/300646713 shutdown_connections 2023-12-11T20:27:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55eb143f9050 0x55eb143fb470 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 0x55eb143f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd538ff9700 0 client.18951 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3450 0x55eb143ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 --2- 172.21.15.12:0/300646713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143ed710 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 -- 172.21.15.12:0/300646713 >> 172.21.15.12:0/300646713 conn(0x55eb14312860 msgr2=0x55eb143deac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 -- 172.21.15.12:0/300646713 shutdown_connections 2023-12-11T20:27:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.674+0000 7fd56b021b80 1 -- 172.21.15.12:0/300646713 wait complete. 2023-12-11T20:27:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.675+0000 7fd56b021b80 20 client.18951 trim_cache size 0 max 16384 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.696+0000 7fd56b021b80 1 Processor -- start 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.696+0000 7fd56b021b80 1 -- start start 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.696+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3450 0x55eb143df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143f4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e4ca0 0x55eb143dff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd56b021b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb143f5900 con 0x55eb143e3db0 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd56b021b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb143ecd70 con 0x55eb143e3450 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd56b021b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb143e3040 con 0x55eb143e4ca0 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd554b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd554b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34764/0 (socket says 172.21.15.12:34764) 2023-12-11T20:27:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd554b9a700 1 -- 172.21.15.12:0/3527874947 learned_addr learned my addr 172.21.15.12:0/3527874947 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd55539b700 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3450 0x55eb143df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd555b9c700 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e4ca0 0x55eb143dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd554b9a700 1 -- 172.21.15.12:0/3527874947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e4ca0 msgr2=0x55eb143dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd554b9a700 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e4ca0 0x55eb143dff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd554b9a700 1 -- 172.21.15.12:0/3527874947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3450 msgr2=0x55eb143df9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd554b9a700 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3450 0x55eb143df9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd554b9a700 1 -- 172.21.15.12:0/3527874947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb14160e60 con 0x55eb143e3db0 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd55539b700 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3450 0x55eb143df9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.697+0000 7fd555b9c700 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e4ca0 0x55eb143dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.698+0000 7fd554b9a700 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143f4710 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fd540003f20 tx=0x7fd540009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796494ba0f2ff087 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.698+0000 7fd53bfff700 1 -- 172.21.15.12:0/3527874947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540038070 con 0x55eb143e3db0 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.698+0000 7fd53bfff700 1 -- 172.21.15.12:0/3527874947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd54002e020 con 0x55eb143e3db0 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.698+0000 7fd53bfff700 1 -- 172.21.15.12:0/3527874947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540018040 con 0x55eb143e3db0 2023-12-11T20:27:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 -- 172.21.15.12:0/3527874947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 msgr2=0x55eb143f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143f4710 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fd540003f20 tx=0x7fd540009ae0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 -- 172.21.15.12:0/3527874947 shutdown_connections 2023-12-11T20:27:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e3450 0x55eb143df9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e4ca0 0x55eb143dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 --2- 172.21.15.12:0/3527874947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3db0 0x55eb143f4710 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 -- 172.21.15.12:0/3527874947 >> 172.21.15.12:0/3527874947 conn(0x55eb14312860 msgr2=0x55eb143e7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 -- 172.21.15.12:0/3527874947 shutdown_connections 2023-12-11T20:27:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 -- 172.21.15.12:0/3527874947 wait complete. 2023-12-11T20:27:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 -- start start 2023-12-11T20:27:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.699+0000 7fd56b021b80 1 Processor -- start 2023-12-11T20:27:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3450 0x55eb143f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3db0 0x55eb143f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd56b021b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 0x55eb1444f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd56b021b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb143f49f0 con 0x55eb143e3450 2023-12-11T20:27:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd56b021b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb143f4b60 con 0x55eb143e4ca0 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd56b021b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb1444fa40 con 0x55eb143e3db0 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd56b021b80 10 client.0 _ll_register_callbacks cb 0x55eb1421cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd55539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3450 0x55eb143f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd55539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3450 0x55eb143f14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34770/0 (socket says 172.21.15.12:34770) 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd55539b700 1 -- 172.21.15.12:0/1460422515 learned_addr learned my addr 172.21.15.12:0/1460422515 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd554b9a700 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3db0 0x55eb143f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.700+0000 7fd555b9c700 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 0x55eb1444f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd55539b700 1 -- 172.21.15.12:0/1460422515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3db0 msgr2=0x55eb143f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd55539b700 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3db0 0x55eb143f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd55539b700 1 -- 172.21.15.12:0/1460422515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 msgr2=0x55eb1444f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd55539b700 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 0x55eb1444f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd55539b700 1 -- 172.21.15.12:0/1460422515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb141b46b0 con 0x55eb143e3450 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd55539b700 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3450 0x55eb143f14e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fd54c004fd0 tx=0x7fd54c005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ab8df2613defc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd538ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd538ff9700 1 -- 172.21.15.12:0/1460422515 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c004be0 con 0x55eb143e3450 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd56b021b80 1 -- 172.21.15.12:0/1460422515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd54c0044c0 con 0x55eb143e3450 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.701+0000 7fd538ff9700 1 -- 172.21.15.12:0/1460422515 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd54c011a30 con 0x55eb143e3450 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd538ff9700 1 -- 172.21.15.12:0/1460422515 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd54c011bf0 con 0x55eb143e3450 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd56b021b80 10 client.18957 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd56b021b80 1 -- 172.21.15.12:0/1460422515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7fd54c0098e0 con 0x55eb143e3450 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd538ff9700 1 -- 172.21.15.12:0/1460422515 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd54c0044c0 con 0x55eb143e3450 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd538ff9700 1 -- 172.21.15.12:0/1460422515 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd54c02a2f0 con 0x55eb143e3450 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd56b021b80 10 client.18957 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd56b021b80 10 client.18957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd56b021b80 20 client.18957 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd56b021b80 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55eb14451480 0x55eb144538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd56b021b80 4 client.18957 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:27:59.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.702+0000 7fd56b021b80 1 -- 172.21.15.12:0/1460422515 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55eb142fe050 con 0x55eb14451480 2023-12-11T20:27:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.703+0000 7fd554b9a700 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55eb14451480 0x55eb144538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.703+0000 7fd554b9a700 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55eb14451480 0x55eb144538a0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f4cbde9f15f5e0d server_cookie=2961917463a356ec in_seq=0 out_seq=0 2023-12-11T20:27:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.703+0000 7fd538ff9700 10 client.18957 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd538ff9700 1 -- 172.21.15.12:0/1460422515 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55eb142fe050 con 0x55eb14451480 2023-12-11T20:27:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd538ff9700 10 client.18957 handle_command_reply: tid=0 2023-12-11T20:27:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 client.18957 shutdown 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 -- 172.21.15.12:0/1460422515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3450 msgr2=0x55eb143f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3450 0x55eb143f14e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fd54c004fd0 tx=0x7fd54c005d70 comp rx=0 tx=0).stop 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 -- 172.21.15.12:0/1460422515 shutdown_connections 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55eb14451480 0x55eb144538a0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd538ff9700 0 client.18957 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55eb143e4ca0 0x55eb1444f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb143e3450 0x55eb143f14e0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 --2- 172.21.15.12:0/1460422515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eb143e3db0 0x55eb143f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 -- 172.21.15.12:0/1460422515 >> 172.21.15.12:0/1460422515 conn(0x55eb14312860 msgr2=0x55eb143ecf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:59.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.704+0000 7fd56b021b80 1 -- 172.21.15.12:0/1460422515 shutdown_connections 2023-12-11T20:27:59.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd56b021b80 1 -- 172.21.15.12:0/1460422515 wait complete. 2023-12-11T20:27:59.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd56b021b80 20 client.18957 trim_cache size 0 max 16384 2023-12-11T20:27:59.708 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:27:59.708 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:27:59.708 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "6d03cbba-741a-40fb-9f14-1e0c04a1dca4", 2023-12-11T20:27:59.708 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:27:59.709 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:27:59.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 -- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd53c0a1500 msgr2=0x7fd53c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd53c0a1500 0x7fd53c0a39c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd540009fd0 tx=0x7fd5400138a0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 -- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 msgr2=0x7fd550073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 0x7fd550073f00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd5480079c0 tx=0x7fd54800cab0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 -- 172.21.15.12:0/2275922060 shutdown_connections 2023-12-11T20:27:59.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd53c0a1500 0x7fd53c0a39c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd550101430 0x7fd550075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd550102fc0 0x7fd550073f00 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 --2- 172.21.15.12:0/2275922060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd550102620 0x7fd5500739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.705+0000 7fd5575ff700 1 -- 172.21.15.12:0/2275922060 >> 172.21.15.12:0/2275922060 conn(0x7fd5500fc9a0 msgr2=0x7fd550105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:59.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.706+0000 7fd5575ff700 1 -- 172.21.15.12:0/2275922060 shutdown_connections 2023-12-11T20:27:59.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.706+0000 7fd5575ff700 1 -- 172.21.15.12:0/2275922060 wait complete. 2023-12-11T20:27:59.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:27:59.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 -- 172.21.15.12:0/377333537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 msgr2=0x7f27dc103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 --2- 172.21.15.12:0/377333537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 0x7f27dc103b10 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f27d80099c0 tx=0x7f27d8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 -- 172.21.15.12:0/377333537 shutdown_connections 2023-12-11T20:27:59.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 --2- 172.21.15.12:0/377333537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27dc105280 0x7f27dc10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 --2- 172.21.15.12:0/377333537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 0x7f27dc103b10 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 --2- 172.21.15.12:0/377333537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27dc1048e0 0x7f27dc104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 -- 172.21.15.12:0/377333537 >> 172.21.15.12:0/377333537 conn(0x7f27dc0fec80 msgr2=0x7f27dc1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:59.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 -- 172.21.15.12:0/377333537 shutdown_connections 2023-12-11T20:27:59.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.980+0000 7f27e33ff700 1 -- 172.21.15.12:0/377333537 wait complete. 2023-12-11T20:27:59.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.981+0000 7f27e33ff700 1 Processor -- start 2023-12-11T20:27:59.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e33ff700 1 -- start start 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e33ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 0x7f27dc199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e33ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27dc1048e0 0x7f27dc199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e33ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27dc105280 0x7f27dc1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e33ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc1a1080 con 0x7f27dc1036f0 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e33ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc1a11c0 con 0x7f27dc1048e0 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e33ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc1a1350 con 0x7f27dc105280 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 0x7f27dc199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 0x7f27dc199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34780/0 (socket says 172.21.15.12:34780) 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e119b700 1 -- 172.21.15.12:0/2767388839 learned_addr learned my addr 172.21.15.12:0/2767388839 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e199c700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27dc105280 0x7f27dc1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.982+0000 7f27e099a700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27dc1048e0 0x7f27dc199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27e119b700 1 -- 172.21.15.12:0/2767388839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27dc105280 msgr2=0x7f27dc1a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27e119b700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27dc105280 0x7f27dc1a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27e119b700 1 -- 172.21.15.12:0/2767388839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27dc1048e0 msgr2=0x7f27dc199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27e119b700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27dc1048e0 0x7f27dc199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27e119b700 1 -- 172.21.15.12:0/2767388839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80095f0 con 0x7f27dc1036f0 2023-12-11T20:27:59.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27e099a700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27dc1048e0 0x7f27dc199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:27:59.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27e119b700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 0x7f27dc199550 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f27d800bee0 tx=0x7f27d8004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27d27fc700 1 -- 172.21.15.12:0/2767388839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d801d070 con 0x7f27dc1036f0 2023-12-11T20:27:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27d27fc700 1 -- 172.21.15.12:0/2767388839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27d8003e20 con 0x7f27dc1036f0 2023-12-11T20:27:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27e33ff700 1 -- 172.21.15.12:0/2767388839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc1a15d0 con 0x7f27dc1036f0 2023-12-11T20:27:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.983+0000 7f27d27fc700 1 -- 172.21.15.12:0/2767388839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d800fbf0 con 0x7f27dc1036f0 2023-12-11T20:27:59.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.984+0000 7f27e33ff700 1 -- 172.21.15.12:0/2767388839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc1a1a50 con 0x7f27dc1036f0 2023-12-11T20:27:59.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.987+0000 7f27d27fc700 1 -- 172.21.15.12:0/2767388839 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f27d800f460 con 0x7f27dc1036f0 2023-12-11T20:27:59.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.988+0000 7f27d27fc700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f27c80a1500 0x7f27c80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.988+0000 7f27d27fc700 1 -- 172.21.15.12:0/2767388839 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f27d80cdc20 con 0x7f27dc1036f0 2023-12-11T20:27:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.988+0000 7f27f6d20b80 1 Processor -- start 2023-12-11T20:27:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.988+0000 7f27e099a700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f27c80a1500 0x7f27c80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.989+0000 7f27f6d20b80 1 -- start start 2023-12-11T20:27:59.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.989+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb54000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.989+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 0x560dddb54e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.989+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.989+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dddaa6b50 con 0x560dddb55430 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.989+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dddaa4470 con 0x560dddb54540 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.989+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ddda9fd60 con 0x560dddb53be0 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.989+0000 7f27e099a700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f27c80a1500 0x7f27c80a39c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009cb0 tx=0x7f27cc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb54000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e199c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb54000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:35794/0 (socket says 172.21.15.12:35794) 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 -- 172.21.15.12:0/3930322840 learned_addr learned my addr 172.21.15.12:0/3930322840 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e099a700 1 --2- 172.21.15.12:0/3930322840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 0x560dddb54e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 -- 172.21.15.12:0/3930322840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 msgr2=0x560dddb54e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 --2- 172.21.15.12:0/3930322840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 0x560dddb54e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 -- 172.21.15.12:0/3930322840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 msgr2=0x560dddb558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 --2- 172.21.15.12:0/3930322840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 -- 172.21.15.12:0/3930322840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ddd91c630 con 0x560dddb53be0 2023-12-11T20:27:59.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27e119b700 1 --2- 172.21.15.12:0/3930322840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb54000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f27d80a2cf0 tx=0x7f27d800bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae0ebbfbda770a93 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27c77fe700 1 -- 172.21.15.12:0/3930322840 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d809b620 con 0x560dddb53be0 2023-12-11T20:27:59.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27c77fe700 1 -- 172.21.15.12:0/3930322840 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27d809af20 con 0x560dddb53be0 2023-12-11T20:27:59.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.990+0000 7f27c77fe700 1 -- 172.21.15.12:0/3930322840 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d809a670 con 0x560dddb53be0 2023-12-11T20:27:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3930322840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 msgr2=0x560dddb54000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:27:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3930322840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb54000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f27d80a2cf0 tx=0x7f27d800bdd0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3930322840 shutdown_connections 2023-12-11T20:27:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3930322840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3930322840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb54000 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3930322840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 0x560dddb54e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3930322840 >> 172.21.15.12:0/3930322840 conn(0x560ddda7a7e0 msgr2=0x560dddb47d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:27:59.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3930322840 shutdown_connections 2023-12-11T20:27:59.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.991+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3930322840 wait complete. 2023-12-11T20:27:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.992+0000 7f27f6d20b80 1 -- start start 2023-12-11T20:27:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.992+0000 7f27f6d20b80 1 Processor -- start 2023-12-11T20:27:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb5d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb54540 0x560dddb5dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb64c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:27:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ddda59560 con 0x560dddb54540 2023-12-11T20:27:59.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ddda59200 con 0x560dddb55430 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ddd91e920 con 0x560dddb53be0 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27f6d20b80 10 client.0 _ll_register_callbacks cb 0x560ddd984a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27e119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb5d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27e099a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb54540 0x560dddb5dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27e119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb5d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:35804/0 (socket says 172.21.15.12:35804) 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27e119b700 1 -- 172.21.15.12:0/2161333783 learned_addr learned my addr 172.21.15.12:0/2161333783 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.993+0000 7f27e199c700 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb64c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27e119b700 1 -- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 msgr2=0x560dddb64c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27e119b700 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb64c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27e119b700 1 -- 172.21.15.12:0/2161333783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb54540 msgr2=0x560dddb5dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27e119b700 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb54540 0x560dddb5dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27e119b700 1 -- 172.21.15.12:0/2161333783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc1a1a50 con 0x560dddb53be0 2023-12-11T20:27:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27e199c700 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb64c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27e119b700 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb5d6d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f27d8097420 tx=0x7f27d800bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b76b51a2f011fc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27c4ff9700 1 -- 172.21.15.12:0/2161333783 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80a2f90 con 0x560dddb53be0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27c4ff9700 1 -- 172.21.15.12:0/2161333783 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f27d80a3220 con 0x560dddb53be0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27f6d20b80 1 -- 172.21.15.12:0/2161333783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560dddb3eb40 con 0x560dddb53be0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27c4ff9700 1 -- 172.21.15.12:0/2161333783 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27d809f070 con 0x560dddb53be0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27f6d20b80 10 client.28567 fetch_fsmap learned FSMap version 28 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.994+0000 7f27f6d20b80 1 -- 172.21.15.12:0/2161333783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560ddd8c8de0 con 0x560dddb53be0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27c4ff9700 1 -- 172.21.15.12:0/2161333783 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27d807f080 con 0x560dddb53be0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27c4ff9700 1 -- 172.21.15.12:0/2161333783 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f27d8095b30 con 0x560dddb53be0 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27f6d20b80 10 client.28567 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27f6d20b80 10 client.28567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27f6d20b80 20 client.28567 populate_metadata read hostname 'smithi012' 2023-12-11T20:27:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560dddb69060 0x560dddb6b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27f6d20b80 4 client.28567 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27f6d20b80 1 -- 172.21.15.12:0/2161333783 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560dddb1af40 con 0x560dddb69060 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.995+0000 7f27e099a700 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560dddb69060 0x560dddb6b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.996+0000 7f27e099a700 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560dddb69060 0x560dddb6b480 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c283f435c40d53 server_cookie=bb24d109efa05eb in_seq=0 out_seq=0 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.996+0000 7f27c4ff9700 10 client.28567 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27c4ff9700 1 -- 172.21.15.12:0/2161333783 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560dddb1af40 con 0x560dddb69060 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27c4ff9700 10 client.28567 handle_command_reply: tid=0 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 client.28567 shutdown 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 -- 172.21.15.12:0/2161333783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 msgr2=0x560dddb5d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb5d6d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f27d8097420 tx=0x7f27d800bfd0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 -- 172.21.15.12:0/2161333783 shutdown_connections 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560dddb69060 0x560dddb6b480 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb64c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb5d6d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27c4ff9700 0 client.28567 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/2161333783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb54540 0x560dddb5dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.997+0000 7f27f6d20b80 1 -- 172.21.15.12:0/2161333783 >> 172.21.15.12:0/2161333783 conn(0x560ddda7a7e0 msgr2=0x560dddb46a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.998+0000 7f27f6d20b80 1 -- 172.21.15.12:0/2161333783 shutdown_connections 2023-12-11T20:28:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.998+0000 7f27f6d20b80 1 -- 172.21.15.12:0/2161333783 wait complete. 2023-12-11T20:28:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:27:59.998+0000 7f27f6d20b80 20 client.28567 trim_cache size 0 max 16384 2023-12-11T20:28:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27f6d20b80 1 Processor -- start 2023-12-11T20:28:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27f6d20b80 1 -- start start 2023-12-11T20:28:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb53be0 0x560dddb47970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb54540 0x560dddb64c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb47eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dddb5d280 con 0x560dddb53be0 2023-12-11T20:28:00.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dddb54950 con 0x560dddb55430 2023-12-11T20:28:00.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dddb5e8f0 con 0x560dddb54540 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27e119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb53be0 0x560dddb47970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27e119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb53be0 0x560dddb47970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34822/0 (socket says 172.21.15.12:34822) 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27e119b700 1 -- 172.21.15.12:0/4168465696 learned_addr learned my addr 172.21.15.12:0/4168465696 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.020+0000 7f27e099a700 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb54540 0x560dddb64c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27e199c700 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb47eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27e119b700 1 -- 172.21.15.12:0/4168465696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb54540 msgr2=0x560dddb64c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27e119b700 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb54540 0x560dddb64c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27e119b700 1 -- 172.21.15.12:0/4168465696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 msgr2=0x560dddb47eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27e119b700 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb47eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27e119b700 1 -- 172.21.15.12:0/4168465696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ddd8b1c60 con 0x560dddb53be0 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27e099a700 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb54540 0x560dddb64c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27e119b700 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb53be0 0x560dddb47970 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f27d809ac20 tx=0x7f27d80b92a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295cf540065f523a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27c7fff700 1 -- 172.21.15.12:0/4168465696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d809f070 con 0x560dddb53be0 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27c7fff700 1 -- 172.21.15.12:0/4168465696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560dddb3eb40 con 0x560dddb53be0 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.021+0000 7f27c7fff700 1 -- 172.21.15.12:0/4168465696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80cbb30 con 0x560dddb53be0 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 -- 172.21.15.12:0/4168465696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb53be0 msgr2=0x560dddb47970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb53be0 0x560dddb47970 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f27d809ac20 tx=0x7f27d80b92a0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 -- 172.21.15.12:0/4168465696 shutdown_connections 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb55430 0x560dddb47eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb53be0 0x560dddb47970 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/4168465696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb54540 0x560dddb64c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 -- 172.21.15.12:0/4168465696 >> 172.21.15.12:0/4168465696 conn(0x560ddda7a7e0 msgr2=0x560dddb583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 -- 172.21.15.12:0/4168465696 shutdown_connections 2023-12-11T20:28:00.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.022+0000 7f27f6d20b80 1 -- 172.21.15.12:0/4168465696 wait complete. 2023-12-11T20:28:00.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.023+0000 7f27f6d20b80 1 -- start start 2023-12-11T20:28:00.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.023+0000 7f27f6d20b80 1 Processor -- start 2023-12-11T20:28:00.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.023+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb62bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:00.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.023+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 0x560dddb63130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:00.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.023+0000 7f27f6d20b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb64140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.023+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dddb64680 con 0x560dddb55430 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dddb647f0 con 0x560dddb54540 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27f6d20b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dddb649b0 con 0x560dddb53be0 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27f6d20b80 10 client.0 _ll_register_callbacks cb 0x560ddd984a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e199c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb64140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e119b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb62bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e199c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb64140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34834/0 (socket says 172.21.15.12:34834) 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e199c700 1 -- 172.21.15.12:0/3395256294 learned_addr learned my addr 172.21.15.12:0/3395256294 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e099a700 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 0x560dddb63130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e119b700 1 -- 172.21.15.12:0/3395256294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 msgr2=0x560dddb63130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e119b700 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 0x560dddb63130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e119b700 1 -- 172.21.15.12:0/3395256294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 msgr2=0x560dddb64140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:00.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e119b700 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb64140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.024+0000 7f27e119b700 1 -- 172.21.15.12:0/3395256294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc011df0 con 0x560dddb53be0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27e119b700 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb62bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x560dddb42840 tx=0x7f27d800bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e0d817b992a4253 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27c4ff9700 1 -- 172.21.15.12:0/3395256294 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8003b90 con 0x560dddb53be0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27c4ff9700 1 -- 172.21.15.12:0/3395256294 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f27d8096e90 con 0x560dddb53be0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3395256294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27d809af20 con 0x560dddb53be0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27c4ff9700 1 -- 172.21.15.12:0/3395256294 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27d809f070 con 0x560dddb53be0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27f6d20b80 10 client.28573 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3395256294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560ddd8c8de0 con 0x560dddb53be0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27c4ff9700 1 -- 172.21.15.12:0/3395256294 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27d809af20 con 0x560dddb53be0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.025+0000 7f27c4ff9700 1 -- 172.21.15.12:0/3395256294 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f27d809a010 con 0x560dddb53be0 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.026+0000 7f27f6d20b80 10 client.28573 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:00.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.026+0000 7f27f6d20b80 10 client.28573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:00.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.026+0000 7f27f6d20b80 20 client.28573 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:00.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.026+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560dddbc0170 0x560dddbc2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:00.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.026+0000 7f27f6d20b80 4 client.28573 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:28:00.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.026+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3395256294 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560ddda65fd0 con 0x560dddbc0170 2023-12-11T20:28:00.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.026+0000 7f27e099a700 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560dddbc0170 0x560dddbc2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:00.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27e099a700 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560dddbc0170 0x560dddbc2560 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f335a81ec2a69e3 server_cookie=b5e841e5eede8644 in_seq=0 out_seq=0 2023-12-11T20:28:00.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27c4ff9700 10 client.28573 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:00.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27c4ff9700 1 -- 172.21.15.12:0/3395256294 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560ddda65fd0 con 0x560dddbc0170 2023-12-11T20:28:00.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27c4ff9700 10 client.28573 handle_command_reply: tid=0 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 client.28573 shutdown 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3395256294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 msgr2=0x560dddb62bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb62bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x560dddb42840 tx=0x7f27d800bdd0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3395256294 shutdown_connections 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560dddbc0170 0x560dddbc2560 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560dddb55430 0x560dddb64140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dddb53be0 0x560dddb62bf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27c4ff9700 0 client.28573 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 --2- 172.21.15.12:0/3395256294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560dddb54540 0x560dddb63130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.027+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3395256294 >> 172.21.15.12:0/3395256294 conn(0x560ddda7a7e0 msgr2=0x560dddb47970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3395256294 shutdown_connections 2023-12-11T20:28:00.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27f6d20b80 1 -- 172.21.15.12:0/3395256294 wait complete. 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27f6d20b80 20 client.28573 trim_cache size 0 max 16384 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "6d03cbba-741a-40fb-9f14-1e0c04a1dca4": { 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "6d03cbba-741a-40fb-9f14-1e0c04a1dca4", 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:28:00.033 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:28:00.034 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:28:00.034 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:28:00.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27e33ff700 1 -- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f27c80a1500 msgr2=0x7f27c80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:00.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27e33ff700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f27c80a1500 0x7f27c80a39c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009cb0 tx=0x7f27cc009260 comp rx=0 tx=0).stop 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27e33ff700 1 -- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 msgr2=0x7f27dc199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27e33ff700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 0x7f27dc199550 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f27d800bee0 tx=0x7f27d8004690 comp rx=0 tx=0).stop 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27e33ff700 1 -- 172.21.15.12:0/2767388839 shutdown_connections 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27e33ff700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f27c80a1500 0x7f27c80a39c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.028+0000 7f27e33ff700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27dc105280 0x7f27dc1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.029+0000 7f27e33ff700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27dc1036f0 0x7f27dc199550 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.029+0000 7f27e33ff700 1 --2- 172.21.15.12:0/2767388839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27dc1048e0 0x7f27dc199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.029+0000 7f27e33ff700 1 -- 172.21.15.12:0/2767388839 >> 172.21.15.12:0/2767388839 conn(0x7f27dc0fec80 msgr2=0x7f27dc107d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.029+0000 7f27e33ff700 1 -- 172.21.15.12:0/2767388839 shutdown_connections 2023-12-11T20:28:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:00.029+0000 7f27e33ff700 1 -- 172.21.15.12:0/2767388839 wait complete. 2023-12-11T20:28:00.046 INFO:tasks.cephfs.filesystem:scrub status for tag:6d03cbba-741a-40fb-9f14-1e0c04a1dca4 - {'path': '/', 'tag': '6d03cbba-741a-40fb-9f14-1e0c04a1dca4', 'options': 'recursive,force'} 2023-12-11T20:28:00.213 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:27:59 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-h[168779]: 2023-12-11T20:27:59.716+0000 7f1549a98700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{0=1,1=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@1} | lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x561976698100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3500>,<0x10000000005/tmp v229>,<0x10000000003/client.0 v228>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:28:01.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: pgmap v737: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:28:01.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.h log and `damage ls` output for details 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:00 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: pgmap v737: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:28:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:28:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.h log and `damage ls` output for details 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:00 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: pgmap v737: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.h log and `damage ls` output for details 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:01.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:01.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:00 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:03.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:02 smithi039 ceph-mon[102205]: pgmap v738: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 17 op/s 2023-12-11T20:28:03.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:02 smithi012 ceph-mon[128787]: pgmap v738: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 17 op/s 2023-12-11T20:28:03.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:02 smithi032 ceph-mon[132488]: pgmap v738: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 17 op/s 2023-12-11T20:28:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.103+0000 7f45595ff700 1 -- 172.21.15.12:0/625543786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 msgr2=0x7f4554109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.103+0000 7f45595ff700 1 --2- 172.21.15.12:0/625543786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 0x7f4554109610 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f454c00b0a0 tx=0x7f454c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.104+0000 7f45595ff700 1 -- 172.21.15.12:0/625543786 shutdown_connections 2023-12-11T20:28:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.104+0000 7f45595ff700 1 --2- 172.21.15.12:0/625543786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 0x7f4554109610 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.104+0000 7f45595ff700 1 --2- 172.21.15.12:0/625543786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4554101f40 0x7f4554104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.104+0000 7f45595ff700 1 --2- 172.21.15.12:0/625543786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4554104870 0x7f4554106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.104+0000 7f45595ff700 1 -- 172.21.15.12:0/625543786 >> 172.21.15.12:0/625543786 conn(0x7f45540fb930 msgr2=0x7f45540fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.104+0000 7f45595ff700 1 -- 172.21.15.12:0/625543786 shutdown_connections 2023-12-11T20:28:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.104+0000 7f45595ff700 1 -- 172.21.15.12:0/625543786 wait complete. 2023-12-11T20:28:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.105+0000 7f45595ff700 1 Processor -- start 2023-12-11T20:28:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.105+0000 7f45595ff700 1 -- start start 2023-12-11T20:28:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.105+0000 7f45595ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4554101f40 0x7f45541995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.105+0000 7f45595ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4554104870 0x7f4554199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.105+0000 7f45595ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 0x7f45541a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.105+0000 7f45595ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45541a1120 con 0x7f45541071a0 2023-12-11T20:28:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.105+0000 7f45595ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45541a1260 con 0x7f4554101f40 2023-12-11T20:28:05.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.105+0000 7f45595ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45541a13f0 con 0x7f4554104870 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4554101f40 0x7f45541995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4554101f40 0x7f45541995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50638/0 (socket says 172.21.15.12:50638) 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f4552ffd700 1 -- 172.21.15.12:0/980155074 learned_addr learned my addr 172.21.15.12:0/980155074 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f45537fe700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 0x7f45541a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f45527fc700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4554104870 0x7f4554199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f45537fe700 1 -- 172.21.15.12:0/980155074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4554104870 msgr2=0x7f4554199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f45537fe700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4554104870 0x7f4554199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f45537fe700 1 -- 172.21.15.12:0/980155074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4554101f40 msgr2=0x7f45541995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f45537fe700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4554101f40 0x7f45541995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f45537fe700 1 -- 172.21.15.12:0/980155074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548009520 con 0x7f45541071a0 2023-12-11T20:28:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f4552ffd700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4554101f40 0x7f45541995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.106+0000 7f45537fe700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 0x7f45541a0b50 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f454c00b070 tx=0x7f454c007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.107+0000 7f453bfff700 1 -- 172.21.15.12:0/980155074 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c00e040 con 0x7f45541071a0 2023-12-11T20:28:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.107+0000 7f453bfff700 1 -- 172.21.15.12:0/980155074 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f454c003c00 con 0x7f45541071a0 2023-12-11T20:28:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.107+0000 7f45595ff700 1 -- 172.21.15.12:0/980155074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c009d00 con 0x7f45541071a0 2023-12-11T20:28:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.107+0000 7f453bfff700 1 -- 172.21.15.12:0/980155074 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c005040 con 0x7f45541071a0 2023-12-11T20:28:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.107+0000 7f45595ff700 1 -- 172.21.15.12:0/980155074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45541a18b0 con 0x7f45541071a0 2023-12-11T20:28:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.110+0000 7f453bfff700 1 -- 172.21.15.12:0/980155074 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f454c01d480 con 0x7f45541071a0 2023-12-11T20:28:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.112+0000 7f453bfff700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f453c0a1470 0x7f453c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.112+0000 7f453bfff700 1 -- 172.21.15.12:0/980155074 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f454c0cdd60 con 0x7f45541071a0 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.112+0000 7f4552ffd700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f453c0a1470 0x7f453c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.112+0000 7f456cf76b80 1 Processor -- start 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f456cf76b80 1 -- start start 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f4552ffd700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f453c0a1470 0x7f453c0a3930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4544011550 tx=0x7f4544009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x5639809472f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980948140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980948ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f456cf76b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639808a2af0 con 0x563980946ed0 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f456cf76b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639808a0410 con 0x563980947830 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f456cf76b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398089bd00 con 0x563980948720 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x5639809472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x5639809472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34874/0 (socket says 172.21.15.12:34874) 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f4552ffd700 1 -- 172.21.15.12:0/2209231445 learned_addr learned my addr 172.21.15.12:0/2209231445 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.113+0000 7f45537fe700 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980948ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.114+0000 7f45527fc700 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980948140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.114+0000 7f4552ffd700 1 -- 172.21.15.12:0/2209231445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 msgr2=0x563980948ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.114+0000 7f4552ffd700 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980948ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.114+0000 7f4552ffd700 1 -- 172.21.15.12:0/2209231445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 msgr2=0x563980948140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.114+0000 7f4552ffd700 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980948140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.114+0000 7f4552ffd700 1 -- 172.21.15.12:0/2209231445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639807185d0 con 0x563980946ed0 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.114+0000 7f45527fc700 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980948140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.114+0000 7f4552ffd700 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x5639809472f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f4544009880 tx=0x7f4544014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce18e972d2acb823 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.115+0000 7f45397fa700 1 -- 172.21.15.12:0/2209231445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544026630 con 0x563980946ed0 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.115+0000 7f45397fa700 1 -- 172.21.15.12:0/2209231445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4544021070 con 0x563980946ed0 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.115+0000 7f45397fa700 1 -- 172.21.15.12:0/2209231445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454401d670 con 0x563980946ed0 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.115+0000 7f456cf76b80 1 -- 172.21.15.12:0/2209231445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 msgr2=0x5639809472f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.115+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x5639809472f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f4544009880 tx=0x7f4544014000 comp rx=0 tx=0).stop 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 -- 172.21.15.12:0/2209231445 shutdown_connections 2023-12-11T20:28:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980948ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x5639809472f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2209231445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980948140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 -- 172.21.15.12:0/2209231445 >> 172.21.15.12:0/2209231445 conn(0x563980876780 msgr2=0x563980943880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 -- 172.21.15.12:0/2209231445 shutdown_connections 2023-12-11T20:28:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 -- 172.21.15.12:0/2209231445 wait complete. 2023-12-11T20:28:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 -- start start 2023-12-11T20:28:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.116+0000 7f456cf76b80 1 Processor -- start 2023-12-11T20:28:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980950f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980951450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980958280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f456cf76b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563980855500 con 0x563980946ed0 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f456cf76b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639808551a0 con 0x563980947830 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f456cf76b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398071a8c0 con 0x563980948720 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f456cf76b80 10 client.0 _ll_register_callbacks cb 0x563980780a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980950f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980950f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34876/0 (socket says 172.21.15.12:34876) 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.117+0000 7f4552ffd700 1 -- 172.21.15.12:0/3249972924 learned_addr learned my addr 172.21.15.12:0/3249972924 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f45527fc700 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980951450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f45537fe700 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980958280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4552ffd700 1 -- 172.21.15.12:0/3249972924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 msgr2=0x563980958280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4552ffd700 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980958280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4552ffd700 1 -- 172.21.15.12:0/3249972924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 msgr2=0x563980951450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4552ffd700 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980951450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4552ffd700 1 -- 172.21.15.12:0/3249972924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4544017070 con 0x563980946ed0 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4552ffd700 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980950f10 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f4544009cf0 tx=0x7f454400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912e6291b3db5305 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4536ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4536ff5700 1 -- 172.21.15.12:0/3249972924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454401c720 con 0x563980946ed0 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f456cf76b80 1 -- 172.21.15.12:0/3249972924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56398093a730 con 0x563980946ed0 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.118+0000 7f4536ff5700 1 -- 172.21.15.12:0/3249972924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f454401c880 con 0x563980946ed0 2023-12-11T20:28:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f4536ff5700 1 -- 172.21.15.12:0/3249972924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4544005040 con 0x563980946ed0 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f456cf76b80 10 client.18987 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f456cf76b80 1 -- 172.21.15.12:0/3249972924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5639806c4d80 con 0x563980946ed0 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f4536ff5700 1 -- 172.21.15.12:0/3249972924 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f454403e080 con 0x563980946ed0 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f4536ff5700 1 -- 172.21.15.12:0/3249972924 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4544004ca0 con 0x563980946ed0 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f456cf76b80 10 client.18987 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f456cf76b80 10 client.18987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f456cf76b80 20 client.18987 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f456cf76b80 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56398095cca0 0x56398095f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f456cf76b80 4 client.18987 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.119+0000 7f456cf76b80 1 -- 172.21.15.12:0/3249972924 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563980916ee0 con 0x56398095cca0 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.120+0000 7f45527fc700 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56398095cca0 0x56398095f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.120+0000 7f45527fc700 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56398095cca0 0x56398095f0c0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9e8cd7e7e79d72 server_cookie=e5e25076429b620c in_seq=0 out_seq=0 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.120+0000 7f4536ff5700 10 client.18987 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f4536ff5700 1 -- 172.21.15.12:0/3249972924 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563980916ee0 con 0x56398095cca0 2023-12-11T20:28:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f4536ff5700 10 client.18987 handle_command_reply: tid=0 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 client.18987 shutdown 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 -- 172.21.15.12:0/3249972924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 msgr2=0x563980950f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980950f10 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f4544009cf0 tx=0x7f454400ee40 comp rx=0 tx=0).stop 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 -- 172.21.15.12:0/3249972924 shutdown_connections 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56398095cca0 0x56398095f0c0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980958280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980950f10 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 --2- 172.21.15.12:0/3249972924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980951450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.121+0000 7f456cf76b80 1 -- 172.21.15.12:0/3249972924 >> 172.21.15.12:0/3249972924 conn(0x563980876780 msgr2=0x563980941ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.122+0000 7f4536ff5700 0 client.18987 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.122+0000 7f456cf76b80 1 -- 172.21.15.12:0/3249972924 shutdown_connections 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.122+0000 7f456cf76b80 1 -- 172.21.15.12:0/3249972924 wait complete. 2023-12-11T20:28:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.122+0000 7f456cf76b80 20 client.18987 trim_cache size 0 max 16384 2023-12-11T20:28:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f456cf76b80 1 Processor -- start 2023-12-11T20:28:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f456cf76b80 1 -- start start 2023-12-11T20:28:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980946ed0 0x563980948b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980947830 0x563980958240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x56398095ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f456cf76b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563980958fe0 con 0x563980947830 2023-12-11T20:28:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f456cf76b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398094c290 con 0x563980946ed0 2023-12-11T20:28:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f456cf76b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398093e860 con 0x563980948720 2023-12-11T20:28:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.142+0000 7f45527fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980947830 0x563980958240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45527fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980947830 0x563980958240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34892/0 (socket says 172.21.15.12:34892) 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45527fc700 1 -- 172.21.15.12:0/160883003 learned_addr learned my addr 172.21.15.12:0/160883003 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f4552ffd700 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980946ed0 0x563980948b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45537fe700 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x56398095ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45527fc700 1 -- 172.21.15.12:0/160883003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 msgr2=0x56398095ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45527fc700 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x56398095ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45527fc700 1 -- 172.21.15.12:0/160883003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980946ed0 msgr2=0x563980948b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45527fc700 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980946ed0 0x563980948b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45527fc700 1 -- 172.21.15.12:0/160883003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639806adc00 con 0x563980947830 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f45527fc700 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980947830 0x563980958240 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f4548009de0 tx=0x7f4548014750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1259d47d45dbfa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.143+0000 7f4539ffb700 1 -- 172.21.15.12:0/160883003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548022070 con 0x563980947830 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f4539ffb700 1 -- 172.21.15.12:0/160883003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f454801d8b0 con 0x563980947830 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f4539ffb700 1 -- 172.21.15.12:0/160883003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548018040 con 0x563980947830 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 -- 172.21.15.12:0/160883003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980947830 msgr2=0x563980958240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980947830 0x563980958240 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f4548009de0 tx=0x7f4548014750 comp rx=0 tx=0).stop 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 -- 172.21.15.12:0/160883003 shutdown_connections 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980946ed0 0x563980948b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x56398095ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 --2- 172.21.15.12:0/160883003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980947830 0x563980958240 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 -- 172.21.15.12:0/160883003 >> 172.21.15.12:0/160883003 conn(0x563980876780 msgr2=0x56398094ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 -- 172.21.15.12:0/160883003 shutdown_connections 2023-12-11T20:28:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.144+0000 7f456cf76b80 1 -- 172.21.15.12:0/160883003 wait complete. 2023-12-11T20:28:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.145+0000 7f456cf76b80 1 -- start start 2023-12-11T20:28:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.145+0000 7f456cf76b80 1 Processor -- start 2023-12-11T20:28:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980955d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980956260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f456cf76b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980957220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f456cf76b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563980957760 con 0x563980946ed0 2023-12-11T20:28:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f456cf76b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639809578d0 con 0x563980947830 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f456cf76b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563980957a90 con 0x563980948720 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f456cf76b80 10 client.0 _ll_register_callbacks cb 0x563980780a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980955d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980955d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34894/0 (socket says 172.21.15.12:34894) 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f4552ffd700 1 -- 172.21.15.12:0/2424315016 learned_addr learned my addr 172.21.15.12:0/2424315016 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f45537fe700 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980957220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f45527fc700 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980956260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.146+0000 7f4552ffd700 1 -- 172.21.15.12:0/2424315016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 msgr2=0x563980957220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f4552ffd700 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980957220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f4552ffd700 1 -- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 msgr2=0x563980956260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f4552ffd700 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980956260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f4552ffd700 1 -- 172.21.15.12:0/2424315016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4548009b90 con 0x563980946ed0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f45527fc700 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980956260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f4552ffd700 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980955d20 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4544009ee0 tx=0x7f454401c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23115ddc060d5cdd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f4536ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f4536ff5700 1 -- 172.21.15.12:0/2424315016 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454403a880 con 0x563980946ed0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f456cf76b80 1 -- 172.21.15.12:0/2424315016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4544021070 con 0x563980946ed0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.147+0000 7f4536ff5700 1 -- 172.21.15.12:0/2424315016 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f454403a9e0 con 0x563980946ed0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f4536ff5700 1 -- 172.21.15.12:0/2424315016 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f454403abc0 con 0x563980946ed0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f456cf76b80 10 client.18993 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f456cf76b80 1 -- 172.21.15.12:0/2424315016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5639806eb1f0 con 0x563980946ed0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f4536ff5700 1 -- 172.21.15.12:0/2424315016 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4544021070 con 0x563980946ed0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f4536ff5700 1 -- 172.21.15.12:0/2424315016 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f45440046b0 con 0x563980946ed0 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f456cf76b80 10 client.18993 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f456cf76b80 10 client.18993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f456cf76b80 20 client.18993 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5639809b3b50 0x5639809b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f456cf76b80 4 client.18993 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:28:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.148+0000 7f456cf76b80 1 -- 172.21.15.12:0/2424315016 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563980861f70 con 0x5639809b3b50 2023-12-11T20:28:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.149+0000 7f45527fc700 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5639809b3b50 0x5639809b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.149+0000 7f45527fc700 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5639809b3b50 0x5639809b5f70 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=194d025ab8779ae9 server_cookie=70e54f06f9bb2912 in_seq=0 out_seq=0 2023-12-11T20:28:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.149+0000 7f4536ff5700 10 client.18993 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.158+0000 7f4536ff5700 1 -- 172.21.15.12:0/2424315016 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563980861f70 con 0x5639809b3b50 2023-12-11T20:28:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.158+0000 7f4536ff5700 10 client.18993 handle_command_reply: tid=0 2023-12-11T20:28:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.158+0000 7f456cf76b80 1 client.18993 shutdown 2023-12-11T20:28:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 -- 172.21.15.12:0/2424315016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 msgr2=0x563980955d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980955d20 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4544009ee0 tx=0x7f454401c7d0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 -- 172.21.15.12:0/2424315016 shutdown_connections 2023-12-11T20:28:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5639809b3b50 0x5639809b5f70 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563980948720 0x563980957220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563980946ed0 0x563980955d20 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 --2- 172.21.15.12:0/2424315016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563980947830 0x563980956260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 -- 172.21.15.12:0/2424315016 >> 172.21.15.12:0/2424315016 conn(0x563980876780 msgr2=0x56398095ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f4536ff5700 0 client.18993 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 -- 172.21.15.12:0/2424315016 shutdown_connections 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 1 -- 172.21.15.12:0/2424315016 wait complete. 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.159+0000 7f456cf76b80 20 client.18993 trim_cache size 0 max 16384 2023-12-11T20:28:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:28:05.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:28:05.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:28:05.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:28:05.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 -- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f453c0a1470 msgr2=0x7f453c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f453c0a1470 0x7f453c0a3930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4544011550 tx=0x7f4544009260 comp rx=0 tx=0).stop 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 -- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 msgr2=0x7f45541a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 0x7f45541a0b50 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f454c00b070 tx=0x7f454c007840 comp rx=0 tx=0).stop 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 -- 172.21.15.12:0/980155074 shutdown_connections 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f453c0a1470 0x7f453c0a3930 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4554101f40 0x7f45541995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45541071a0 0x7f45541a0b50 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 --2- 172.21.15.12:0/980155074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4554104870 0x7f4554199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 -- 172.21.15.12:0/980155074 >> 172.21.15.12:0/980155074 conn(0x7f45540fb930 msgr2=0x7f4554101660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 -- 172.21.15.12:0/980155074 shutdown_connections 2023-12-11T20:28:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:05.160+0000 7f45595ff700 1 -- 172.21.15.12:0/980155074 wait complete. 2023-12-11T20:28:05.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:04 smithi039 ceph-mon[102205]: pgmap v739: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:28:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:04 smithi012 ceph-mon[128787]: pgmap v739: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:28:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:04 smithi032 ceph-mon[132488]: pgmap v739: 97 pgs: 97 active+clean; 9.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:28:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:06 smithi039 ceph-mon[102205]: pgmap v740: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:06 smithi012 ceph-mon[128787]: pgmap v740: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:06 smithi032 ceph-mon[132488]: pgmap v740: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:09.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:08 smithi039 ceph-mon[102205]: pgmap v741: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:08 smithi012 ceph-mon[128787]: pgmap v741: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:08 smithi032 ceph-mon[132488]: pgmap v741: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:11.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:10 smithi039 ceph-mon[102205]: pgmap v742: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:28:11.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:10 smithi012 ceph-mon[128787]: pgmap v742: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:28:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:10 smithi032 ceph-mon[132488]: pgmap v742: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:28:12.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:12 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:28:12.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:12 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:28:12.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:12 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:28:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:11 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:28:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:11 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:28:12.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:11 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:28:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:12 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:28:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:12 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:28:12.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:12 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:28:13.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:13 smithi039 ceph-mon[102205]: pgmap v743: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:28:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:13 smithi012 ceph-mon[128787]: pgmap v743: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:28:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:13 smithi032 ceph-mon[132488]: pgmap v743: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:28:15.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:15 smithi039 ceph-mon[102205]: pgmap v744: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:28:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:15 smithi012 ceph-mon[128787]: pgmap v744: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:28:15.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:15 smithi032 ceph-mon[132488]: pgmap v744: 97 pgs: 97 active+clean; 9.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 29 op/s 2023-12-11T20:28:17.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:17 smithi039 ceph-mon[102205]: pgmap v745: 97 pgs: 97 active+clean; 9.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 20 op/s 2023-12-11T20:28:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:17 smithi012 ceph-mon[128787]: pgmap v745: 97 pgs: 97 active+clean; 9.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 20 op/s 2023-12-11T20:28:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:17 smithi032 ceph-mon[132488]: pgmap v745: 97 pgs: 97 active+clean; 9.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 20 op/s 2023-12-11T20:28:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.324+0000 7f8012fff700 1 -- 172.21.15.12:0/3288873699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c103060 msgr2=0x7f800c109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.324+0000 7f8012fff700 1 --2- 172.21.15.12:0/3288873699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c103060 0x7f800c109910 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f800400b0d0 tx=0x7f800400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.324+0000 7f8012fff700 1 -- 172.21.15.12:0/3288873699 shutdown_connections 2023-12-11T20:28:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.324+0000 7f8012fff700 1 --2- 172.21.15.12:0/3288873699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c103060 0x7f800c109910 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.324+0000 7f8012fff700 1 --2- 172.21.15.12:0/3288873699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f800c1014d0 0x7f800c1018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.324+0000 7f8012fff700 1 --2- 172.21.15.12:0/3288873699 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f800c1026c0 0x7f800c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.324+0000 7f8012fff700 1 -- 172.21.15.12:0/3288873699 >> 172.21.15.12:0/3288873699 conn(0x7f800c0fca60 msgr2=0x7f800c0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.324+0000 7f8012fff700 1 -- 172.21.15.12:0/3288873699 shutdown_connections 2023-12-11T20:28:18.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.325+0000 7f8012fff700 1 -- 172.21.15.12:0/3288873699 wait complete. 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.325+0000 7f8012fff700 1 Processor -- start 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8012fff700 1 -- start start 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8012fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c1014d0 0x7f800c075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8012fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f800c1026c0 0x7f800c0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8012fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f800c103060 0x7f800c073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8012fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0746a0 con 0x7f800c1014d0 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8012fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c074810 con 0x7f800c1026c0 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8012fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c1a1460 con 0x7f800c103060 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c1014d0 0x7f800c075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c1014d0 0x7f800c075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42030/0 (socket says 172.21.15.12:42030) 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8010d9b700 1 -- 172.21.15.12:0/4084472183 learned_addr learned my addr 172.21.15.12:0/4084472183 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.326+0000 7f8003fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f800c1026c0 0x7f800c0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f801159c700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f800c103060 0x7f800c073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8010d9b700 1 -- 172.21.15.12:0/4084472183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f800c103060 msgr2=0x7f800c073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8010d9b700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f800c103060 0x7f800c073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8010d9b700 1 -- 172.21.15.12:0/4084472183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f800c1026c0 msgr2=0x7f800c0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8010d9b700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f800c1026c0 0x7f800c0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8010d9b700 1 -- 172.21.15.12:0/4084472183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004009d00 con 0x7f800c1014d0 2023-12-11T20:28:18.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8010d9b700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c1014d0 0x7f800c075330 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f800800e970 tx=0x7f800800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8001ffb700 1 -- 172.21.15.12:0/4084472183 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008009790 con 0x7f800c1014d0 2023-12-11T20:28:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8001ffb700 1 -- 172.21.15.12:0/4084472183 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f800800eec0 con 0x7f800c1014d0 2023-12-11T20:28:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8001ffb700 1 -- 172.21.15.12:0/4084472183 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008003c10 con 0x7f800c1014d0 2023-12-11T20:28:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8012fff700 1 -- 172.21.15.12:0/4084472183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c1a16f0 con 0x7f800c1014d0 2023-12-11T20:28:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.327+0000 7f8012fff700 1 -- 172.21.15.12:0/4084472183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c1a1bb0 con 0x7f800c1014d0 2023-12-11T20:28:18.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.331+0000 7f8001ffb700 1 -- 172.21.15.12:0/4084472183 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f800800cb70 con 0x7f800c1014d0 2023-12-11T20:28:18.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.332+0000 7f8001ffb700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff40a14f0 0x7f7ff40a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.332+0000 7f8001ffb700 1 -- 172.21.15.12:0/4084472183 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8008014070 con 0x7f800c1014d0 2023-12-11T20:28:18.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.332+0000 7f8003fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff40a14f0 0x7f7ff40a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.332+0000 7f8026922b80 1 Processor -- start 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8026922b80 1 -- start start 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8026922b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6aed0 0x55b490d6b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8026922b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 0x55b490d6c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8026922b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6c720 0x55b490d6cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8026922b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490cc6af0 con 0x55b490d6c720 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8026922b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490cc4410 con 0x55b490d6aed0 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8026922b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490cbfd00 con 0x55b490d6b830 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8003fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff40a14f0 0x7f7ff40a39b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc005950 tx=0x7f7ffc00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f801159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6c720 0x55b490d6cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.333+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6aed0 0x55b490d6b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6aed0 0x55b490d6b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37804/0 (socket says 172.21.15.12:37804) 2023-12-11T20:28:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f8010d9b700 1 -- 172.21.15.12:0/3204893301 learned_addr learned my addr 172.21.15.12:0/3204893301 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f8003fff700 1 --2- 172.21.15.12:0/3204893301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 0x55b490d6c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f801159c700 1 -- 172.21.15.12:0/3204893301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 msgr2=0x55b490d6c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f801159c700 1 --2- 172.21.15.12:0/3204893301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 0x55b490d6c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f801159c700 1 -- 172.21.15.12:0/3204893301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6aed0 msgr2=0x55b490d6b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f801159c700 1 --2- 172.21.15.12:0/3204893301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6aed0 0x55b490d6b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f801159c700 1 -- 172.21.15.12:0/3204893301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b490b3c5d0 con 0x55b490d6c720 2023-12-11T20:28:18.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.334+0000 7f801159c700 1 --2- 172.21.15.12:0/3204893301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6c720 0x55b490d6cba0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f8004009fd0 tx=0x7f8004009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fe6bd474b9a7b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:18.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.335+0000 7f7ff2ffd700 1 -- 172.21.15.12:0/3204893301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400e050 con 0x55b490d6c720 2023-12-11T20:28:18.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.335+0000 7f7ff2ffd700 1 -- 172.21.15.12:0/3204893301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8004007b90 con 0x55b490d6c720 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.335+0000 7f7ff2ffd700 1 -- 172.21.15.12:0/3204893301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004004e00 con 0x55b490d6c720 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.335+0000 7f8026922b80 1 -- 172.21.15.12:0/3204893301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6c720 msgr2=0x55b490d6cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.335+0000 7f8026922b80 1 --2- 172.21.15.12:0/3204893301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6c720 0x55b490d6cba0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f8004009fd0 tx=0x7f8004009c50 comp rx=0 tx=0).stop 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 -- 172.21.15.12:0/3204893301 shutdown_connections 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 --2- 172.21.15.12:0/3204893301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6aed0 0x55b490d6b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 --2- 172.21.15.12:0/3204893301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6c720 0x55b490d6cba0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 --2- 172.21.15.12:0/3204893301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 0x55b490d6c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 -- 172.21.15.12:0/3204893301 >> 172.21.15.12:0/3204893301 conn(0x55b490c9a780 msgr2=0x55b490d67880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 -- 172.21.15.12:0/3204893301 shutdown_connections 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 -- 172.21.15.12:0/3204893301 wait complete. 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 -- start start 2023-12-11T20:28:18.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.336+0000 7f8026922b80 1 Processor -- start 2023-12-11T20:28:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8026922b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8026922b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 0x55b490d75360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8026922b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6c720 0x55b490d7c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8026922b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490c79500 con 0x55b490d6aed0 2023-12-11T20:28:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8026922b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490c791a0 con 0x55b490d6c720 2023-12-11T20:28:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8026922b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490b3e8c0 con 0x55b490d6b830 2023-12-11T20:28:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8026922b80 10 client.0 _ll_register_callbacks cb 0x55b490ba4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42060/0 (socket says 172.21.15.12:42060) 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8010d9b700 1 -- 172.21.15.12:0/3684644690 learned_addr learned my addr 172.21.15.12:0/3684644690 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f8003fff700 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 0x55b490d75360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.337+0000 7f801159c700 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6c720 0x55b490d7c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f8010d9b700 1 -- 172.21.15.12:0/3684644690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 msgr2=0x55b490d75360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f8010d9b700 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 0x55b490d75360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f8010d9b700 1 -- 172.21.15.12:0/3684644690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6c720 msgr2=0x55b490d7c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f8010d9b700 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6c720 0x55b490d7c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f8010d9b700 1 -- 172.21.15.12:0/3684644690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c10a260 con 0x55b490d6aed0 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f8010d9b700 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74e20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f8008009230 tx=0x7f8008099c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc55127df93487a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f7febfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f7febfff700 1 -- 172.21.15.12:0/3684644690 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800809e160 con 0x55b490d6aed0 2023-12-11T20:28:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f7febfff700 1 -- 172.21.15.12:0/3684644690 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f800809a8e0 con 0x55b490d6aed0 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.338+0000 7f8026922b80 1 -- 172.21.15.12:0/3684644690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b490d5e730 con 0x55b490d6aed0 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f7febfff700 1 -- 172.21.15.12:0/3684644690 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f800809a1e0 con 0x55b490d6aed0 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f8026922b80 10 client.19005 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f8026922b80 1 -- 172.21.15.12:0/3684644690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b490ae8d80 con 0x55b490d6aed0 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f7febfff700 1 -- 172.21.15.12:0/3684644690 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f800807b030 con 0x55b490d6aed0 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f7febfff700 1 -- 172.21.15.12:0/3684644690 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f80080b8350 con 0x55b490d6aed0 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f8026922b80 10 client.19005 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f8026922b80 10 client.19005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f8026922b80 20 client.19005 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f8026922b80 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b490d80d20 0x55b490d83140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f8026922b80 4 client.19005 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.339+0000 7f8026922b80 1 -- 172.21.15.12:0/3684644690 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b490d3aee0 con 0x55b490d80d20 2023-12-11T20:28:18.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.340+0000 7f8003fff700 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b490d80d20 0x55b490d83140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.340+0000 7f8003fff700 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b490d80d20 0x55b490d83140 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc6251e56470e23 server_cookie=22e918f25f25b30f in_seq=0 out_seq=0 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.340+0000 7f7febfff700 10 client.19005 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.341+0000 7f7febfff700 1 -- 172.21.15.12:0/3684644690 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b490d3aee0 con 0x55b490d80d20 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.341+0000 7f7febfff700 10 client.19005 handle_command_reply: tid=0 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.341+0000 7f8026922b80 1 client.19005 shutdown 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.341+0000 7f8026922b80 1 -- 172.21.15.12:0/3684644690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 msgr2=0x55b490d74e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.341+0000 7f8026922b80 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74e20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f8008009230 tx=0x7f8008099c30 comp rx=0 tx=0).stop 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 1 -- 172.21.15.12:0/3684644690 shutdown_connections 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b490d80d20 0x55b490d83140 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6c720 0x55b490d7c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f7febfff700 0 client.19005 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74e20 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 1 --2- 172.21.15.12:0/3684644690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6b830 0x55b490d75360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 1 -- 172.21.15.12:0/3684644690 >> 172.21.15.12:0/3684644690 conn(0x55b490c9a780 msgr2=0x55b490d65ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 1 -- 172.21.15.12:0/3684644690 shutdown_connections 2023-12-11T20:28:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 1 -- 172.21.15.12:0/3684644690 wait complete. 2023-12-11T20:28:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.342+0000 7f8026922b80 20 client.19005 trim_cache size 0 max 16384 2023-12-11T20:28:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.365+0000 7f8026922b80 1 Processor -- start 2023-12-11T20:28:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.365+0000 7f8026922b80 1 -- start start 2023-12-11T20:28:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.365+0000 7f8026922b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.365+0000 7f8026922b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8026922b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 0x55b490d6cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8026922b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490d837a0 con 0x55b490d6aed0 2023-12-11T20:28:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8026922b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490d6bf30 con 0x55b490d6b830 2023-12-11T20:28:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8026922b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490d728a0 con 0x55b490d6c720 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42072/0 (socket says 172.21.15.12:42072) 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8010d9b700 1 -- 172.21.15.12:0/4021015106 learned_addr learned my addr 172.21.15.12:0/4021015106 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8003fff700 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f801159c700 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 0x55b490d6cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8010d9b700 1 -- 172.21.15.12:0/4021015106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 msgr2=0x55b490d6cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8010d9b700 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 0x55b490d6cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8010d9b700 1 -- 172.21.15.12:0/4021015106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 msgr2=0x55b490d7c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8010d9b700 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.366+0000 7f8010d9b700 1 -- 172.21.15.12:0/4021015106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b490ad1c00 con 0x55b490d6aed0 2023-12-11T20:28:18.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.367+0000 7f8010d9b700 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74120 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f800800c5b0 tx=0x7f8008003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e61add824672e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.367+0000 7f7ff37fe700 1 -- 172.21.15.12:0/4021015106 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800809e160 con 0x55b490d6aed0 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.367+0000 7f7ff37fe700 1 -- 172.21.15.12:0/4021015106 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f800807b070 con 0x55b490d6aed0 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.367+0000 7f7ff37fe700 1 -- 172.21.15.12:0/4021015106 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080a2330 con 0x55b490d6aed0 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 -- 172.21.15.12:0/4021015106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 msgr2=0x55b490d74120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74120 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f800800c5b0 tx=0x7f8008003680 comp rx=0 tx=0).stop 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 -- 172.21.15.12:0/4021015106 shutdown_connections 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 0x55b490d6cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d74120 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 --2- 172.21.15.12:0/4021015106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 -- 172.21.15.12:0/4021015106 >> 172.21.15.12:0/4021015106 conn(0x55b490c9a780 msgr2=0x55b490d67460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 -- 172.21.15.12:0/4021015106 shutdown_connections 2023-12-11T20:28:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 -- 172.21.15.12:0/4021015106 wait complete. 2023-12-11T20:28:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.368+0000 7f8026922b80 1 -- start start 2023-12-11T20:28:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.369+0000 7f8026922b80 1 Processor -- start 2023-12-11T20:28:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.369+0000 7f8026922b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d7a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.369+0000 7f8026922b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.369+0000 7f8026922b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 0x55b490d7b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.369+0000 7f8026922b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490d7b890 con 0x55b490d6aed0 2023-12-11T20:28:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.369+0000 7f8026922b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490d7ba00 con 0x55b490d6b830 2023-12-11T20:28:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.369+0000 7f8026922b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b490d7bbc0 con 0x55b490d6c720 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.369+0000 7f8026922b80 10 client.0 _ll_register_callbacks cb 0x55b490ba4a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d7a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d7a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42076/0 (socket says 172.21.15.12:42076) 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8003fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 -- 172.21.15.12:0/1498523534 learned_addr learned my addr 172.21.15.12:0/1498523534 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f801159c700 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 0x55b490d7b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 -- 172.21.15.12:0/1498523534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 msgr2=0x55b490d7b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 0x55b490d7b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 -- 172.21.15.12:0/1498523534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 msgr2=0x55b490d7abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 -- 172.21.15.12:0/1498523534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b490ae8d80 con 0x55b490d6aed0 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8003fff700 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f8010d9b700 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d7a6a0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f80080a2040 tx=0x7f8008004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d0e8062d1ec9b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.370+0000 7f7febfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f7febfff700 1 -- 172.21.15.12:0/1498523534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800809e160 con 0x55b490d6aed0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f7febfff700 1 -- 172.21.15.12:0/1498523534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8008099720 con 0x55b490d6aed0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 1 -- 172.21.15.12:0/1498523534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8004007b90 con 0x55b490d6aed0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f7febfff700 1 -- 172.21.15.12:0/1498523534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8008099990 con 0x55b490d6aed0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 10 client.19011 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 1 -- 172.21.15.12:0/1498523534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b490b0f1f0 con 0x55b490d6aed0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f7febfff700 1 -- 172.21.15.12:0/1498523534 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8004007b90 con 0x55b490d6aed0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f7febfff700 1 -- 172.21.15.12:0/1498523534 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f800809f070 con 0x55b490d6aed0 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 10 client.19011 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 10 client.19011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 20 client.19011 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b490dd7a00 0x55b490dd9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 4 client.19011 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:28:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.371+0000 7f8026922b80 1 -- 172.21.15.12:0/1498523534 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b490c85f70 con 0x55b490dd7a00 2023-12-11T20:28:18.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.372+0000 7f8003fff700 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b490dd7a00 0x55b490dd9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:18.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.373+0000 7f8003fff700 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b490dd7a00 0x55b490dd9df0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47fa9b440be5fe16 server_cookie=c050c4e96c1f7c1b in_seq=0 out_seq=0 2023-12-11T20:28:18.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.373+0000 7f7febfff700 10 client.19011 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f7febfff700 1 -- 172.21.15.12:0/1498523534 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b490c85f70 con 0x55b490dd7a00 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f7febfff700 10 client.19011 handle_command_reply: tid=0 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 client.19011 shutdown 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 -- 172.21.15.12:0/1498523534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 msgr2=0x55b490d7a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d7a6a0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f80080a2040 tx=0x7f8008004620 comp rx=0 tx=0).stop 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 -- 172.21.15.12:0/1498523534 shutdown_connections 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b490dd7a00 0x55b490dd9df0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b490d6c720 0x55b490d7b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b490d6aed0 0x55b490d7a6a0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 --2- 172.21.15.12:0/1498523534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b490d6b830 0x55b490d7abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f8026922b80 1 -- 172.21.15.12:0/1498523534 >> 172.21.15.12:0/1498523534 conn(0x55b490c9a780 msgr2=0x55b490d65c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.383+0000 7f7febfff700 0 client.19011 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.384+0000 7f8026922b80 1 -- 172.21.15.12:0/1498523534 shutdown_connections 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.384+0000 7f8026922b80 1 -- 172.21.15.12:0/1498523534 wait complete. 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.384+0000 7f8026922b80 20 client.19011 trim_cache size 0 max 16384 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:28:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:28:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.384+0000 7f8012fff700 1 -- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff40a14f0 msgr2=0x7f7ff40a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.384+0000 7f8012fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff40a14f0 0x7f7ff40a39b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc005950 tx=0x7f7ffc00b410 comp rx=0 tx=0).stop 2023-12-11T20:28:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.384+0000 7f8012fff700 1 -- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c1014d0 msgr2=0x7f800c075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.384+0000 7f8012fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c1014d0 0x7f800c075330 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f800800e970 tx=0x7f800800ec80 comp rx=0 tx=0).stop 2023-12-11T20:28:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.385+0000 7f8012fff700 1 -- 172.21.15.12:0/4084472183 shutdown_connections 2023-12-11T20:28:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.385+0000 7f8012fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7ff40a14f0 0x7f7ff40a39b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.385+0000 7f8012fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f800c103060 0x7f800c073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.385+0000 7f8012fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f800c1014d0 0x7f800c075330 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.385+0000 7f8012fff700 1 --2- 172.21.15.12:0/4084472183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f800c1026c0 0x7f800c0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.385+0000 7f8012fff700 1 -- 172.21.15.12:0/4084472183 >> 172.21.15.12:0/4084472183 conn(0x7f800c0fca60 msgr2=0x7f800c105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.385+0000 7f8012fff700 1 -- 172.21.15.12:0/4084472183 shutdown_connections 2023-12-11T20:28:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:18.385+0000 7f8012fff700 1 -- 172.21.15.12:0/4084472183 wait complete. 2023-12-11T20:28:19.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:19 smithi039 ceph-mon[102205]: pgmap v746: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:28:19.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:19 smithi012 ceph-mon[128787]: pgmap v746: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:28:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:19 smithi032 ceph-mon[132488]: pgmap v746: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:28:21.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:21 smithi039 ceph-mon[102205]: pgmap v747: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:28:21.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:21 smithi012 ceph-mon[128787]: pgmap v747: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:28:21.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:21 smithi032 ceph-mon[132488]: pgmap v747: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:28:23.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:23 smithi039 ceph-mon[102205]: pgmap v748: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:28:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:23 smithi012 ceph-mon[128787]: pgmap v748: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:28:23.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:23 smithi032 ceph-mon[132488]: pgmap v748: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 15 MiB/s wr, 12 op/s 2023-12-11T20:28:25.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:25 smithi039 ceph-mon[102205]: pgmap v749: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:28:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:25 smithi012 ceph-mon[128787]: pgmap v749: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:28:25.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:25 smithi032 ceph-mon[132488]: pgmap v749: 97 pgs: 97 active+clean; 9.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:28:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:27 smithi039 ceph-mon[102205]: pgmap v750: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:28:27.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:27 smithi012 ceph-mon[128787]: pgmap v750: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:28:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:27 smithi032 ceph-mon[132488]: pgmap v750: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:28:29.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:29 smithi039 ceph-mon[102205]: pgmap v751: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:28:29.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:29 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:28:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:29 smithi012 ceph-mon[128787]: pgmap v751: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:28:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:28:29.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:29 smithi032 ceph-mon[132488]: pgmap v751: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:28:29.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:29 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:28:30.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:28:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 -- 172.21.15.12:0/246135980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62201026a0 msgr2=0x7f6220102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 --2- 172.21.15.12:0/246135980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62201026a0 0x7f6220102b00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f620c0099c0 tx=0x7f620c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 -- 172.21.15.12:0/246135980 shutdown_connections 2023-12-11T20:28:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 --2- 172.21.15.12:0/246135980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6220103040 0x7f62201098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 --2- 172.21.15.12:0/246135980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62201014b0 0x7f62201018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 --2- 172.21.15.12:0/246135980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62201026a0 0x7f6220102b00 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 -- 172.21.15.12:0/246135980 >> 172.21.15.12:0/246135980 conn(0x7f62200fca00 msgr2=0x7f62200fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 -- 172.21.15.12:0/246135980 shutdown_connections 2023-12-11T20:28:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.291+0000 7f6226fff700 1 -- 172.21.15.12:0/246135980 wait complete. 2023-12-11T20:28:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.293+0000 7f6226fff700 1 Processor -- start 2023-12-11T20:28:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.293+0000 7f6226fff700 1 -- start start 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.293+0000 7f6226fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62201014b0 0x7f6220199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.293+0000 7f6226fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62201026a0 0x7f6220199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f6226fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6220103040 0x7f62201a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f6226fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62201a1070 con 0x7f6220103040 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f6226fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62201a11b0 con 0x7f62201014b0 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f6226fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62201a1340 con 0x7f62201026a0 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f622559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6220103040 0x7f62201a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f622559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6220103040 0x7f62201a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48808/0 (socket says 172.21.15.12:48808) 2023-12-11T20:28:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f622559c700 1 -- 172.21.15.12:0/3685264345 learned_addr learned my addr 172.21.15.12:0/3685264345 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:30.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f621ffff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62201026a0 0x7f6220199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f6224d9b700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62201014b0 0x7f6220199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f622559c700 1 -- 172.21.15.12:0/3685264345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62201026a0 msgr2=0x7f6220199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f622559c700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62201026a0 0x7f6220199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f622559c700 1 -- 172.21.15.12:0/3685264345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62201014b0 msgr2=0x7f6220199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f622559c700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62201014b0 0x7f6220199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.294+0000 7f622559c700 1 -- 172.21.15.12:0/3685264345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c0095f0 con 0x7f6220103040 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.295+0000 7f622559c700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6220103040 0x7f62201a0aa0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6218007ee0 tx=0x7f621800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.295+0000 7f621dffb700 1 -- 172.21.15.12:0/3685264345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218017070 con 0x7f6220103040 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.295+0000 7f621dffb700 1 -- 172.21.15.12:0/3685264345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f621800f040 con 0x7f6220103040 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.295+0000 7f621dffb700 1 -- 172.21.15.12:0/3685264345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218005570 con 0x7f6220103040 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.295+0000 7f6226fff700 1 -- 172.21.15.12:0/3685264345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62201a1620 con 0x7f6220103040 2023-12-11T20:28:30.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.295+0000 7f6226fff700 1 -- 172.21.15.12:0/3685264345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62201a1ae0 con 0x7f6220103040 2023-12-11T20:28:30.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.299+0000 7f621dffb700 1 -- 172.21.15.12:0/3685264345 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f621800db20 con 0x7f6220103040 2023-12-11T20:28:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.301+0000 7f623a9dcb80 1 Processor -- start 2023-12-11T20:28:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.301+0000 7f621dffb700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62100a1480 0x7f62100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.301+0000 7f623a9dcb80 1 -- start start 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f621ffff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62100a1480 0x7f62100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f621dffb700 1 -- 172.21.15.12:0/3685264345 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f62180cc540 con 0x7f6220103040 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cf98000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 0x55868cf98e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 0x55868cf998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868ceeab50 con 0x55868cf97be0 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cee8470 con 0x55868cf98540 2023-12-11T20:28:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cee3d60 con 0x55868cf99430 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f6224d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cf98000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f6224d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cf98000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48822/0 (socket says 172.21.15.12:48822) 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f6224d9b700 1 -- 172.21.15.12:0/359806374 learned_addr learned my addr 172.21.15.12:0/359806374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.302+0000 7f621ffff700 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 0x55868cf98e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f622559c700 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 0x55868cf998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f621ffff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62100a1480 0x7f62100a3940 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f620c00b580 tx=0x7f620c005e80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f6224d9b700 1 -- 172.21.15.12:0/359806374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 msgr2=0x55868cf998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f6224d9b700 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 0x55868cf998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f6224d9b700 1 -- 172.21.15.12:0/359806374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 msgr2=0x55868cf98e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f6224d9b700 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 0x55868cf98e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f6224d9b700 1 -- 172.21.15.12:0/359806374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55868cd60630 con 0x55868cf97be0 2023-12-11T20:28:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f6224d9b700 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cf98000 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f621400bd40 tx=0x7f62140106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb7433e6a631bb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:30.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:28:30.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:28:30.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:30 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f620affd700 1 -- 172.21.15.12:0/359806374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214010e10 con 0x55868cf97be0 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.303+0000 7f620affd700 1 -- 172.21.15.12:0/359806374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6214015070 con 0x55868cf97be0 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f620affd700 1 -- 172.21.15.12:0/359806374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214005020 con 0x55868cf97be0 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f623a9dcb80 1 -- 172.21.15.12:0/359806374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 msgr2=0x55868cf98000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cf98000 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f621400bd40 tx=0x7f62140106b0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f623a9dcb80 1 -- 172.21.15.12:0/359806374 shutdown_connections 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 0x55868cf998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cf98000 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/359806374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 0x55868cf98e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f623a9dcb80 1 -- 172.21.15.12:0/359806374 >> 172.21.15.12:0/359806374 conn(0x55868cebe7e0 msgr2=0x55868cf8bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.304+0000 7f623a9dcb80 1 -- 172.21.15.12:0/359806374 shutdown_connections 2023-12-11T20:28:30.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.305+0000 7f623a9dcb80 1 -- 172.21.15.12:0/359806374 wait complete. 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.305+0000 7f623a9dcb80 1 -- start start 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.305+0000 7f623a9dcb80 1 Processor -- start 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cfa19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 0x55868cfa1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cfa8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868ce9d560 con 0x55868cf99430 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868ce9d200 con 0x55868cf97be0 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cd62920 con 0x55868cf98540 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f623a9dcb80 10 client.0 _ll_register_callbacks cb 0x55868cdc8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f622559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cfa8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f622559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cfa8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48828/0 (socket says 172.21.15.12:48828) 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f622559c700 1 -- 172.21.15.12:0/3383622734 learned_addr learned my addr 172.21.15.12:0/3383622734 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.306+0000 7f6224d9b700 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cfa19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f621ffff700 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 0x55868cfa1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f622559c700 1 -- 172.21.15.12:0/3383622734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 msgr2=0x55868cfa1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f622559c700 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 0x55868cfa1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f622559c700 1 -- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 msgr2=0x55868cfa19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f622559c700 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cfa19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f622559c700 1 -- 172.21.15.12:0/3383622734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621400b9a0 con 0x55868cf99430 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f6224d9b700 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cfa19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f622559c700 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cfa8f50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f621800d700 tx=0x7f6218099370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1da9d73a7c65119 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f61fffff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f61fffff700 1 -- 172.21.15.12:0/3383622734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218004c40 con 0x55868cf99430 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f61fffff700 1 -- 172.21.15.12:0/3383622734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6218022250 con 0x55868cf99430 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.307+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3383622734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55868cf82b40 con 0x55868cf99430 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f61fffff700 1 -- 172.21.15.12:0/3383622734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f621800ddd0 con 0x55868cf99430 2023-12-11T20:28:30.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f623a9dcb80 10 client.19023 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3383622734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55868cd0cde0 con 0x55868cf99430 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f61fffff700 1 -- 172.21.15.12:0/3383622734 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55868cf82b40 con 0x55868cf99430 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f61fffff700 1 -- 172.21.15.12:0/3383622734 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f62180cc110 con 0x55868cf99430 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f623a9dcb80 10 client.19023 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f623a9dcb80 10 client.19023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f623a9dcb80 20 client.19023 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55868cfad820 0x55868cfafc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f623a9dcb80 4 client.19023 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.308+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3383622734 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55868cf5ef40 con 0x55868cfad820 2023-12-11T20:28:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.309+0000 7f6224d9b700 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55868cfad820 0x55868cfafc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.309+0000 7f61fffff700 10 client.19023 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.309+0000 7f6224d9b700 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55868cfad820 0x55868cfafc40 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5800aa11c73bcd5 server_cookie=e0396096ad06a723 in_seq=0 out_seq=0 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f61fffff700 1 -- 172.21.15.12:0/3383622734 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55868cf5ef40 con 0x55868cfad820 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f61fffff700 10 client.19023 handle_command_reply: tid=0 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 client.19023 shutdown 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3383622734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 msgr2=0x55868cfa8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cfa8f50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f621800d700 tx=0x7f6218099370 comp rx=0 tx=0).stop 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3383622734 shutdown_connections 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55868cfad820 0x55868cfafc40 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cfa19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f61fffff700 0 client.19023 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cfa8f50 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3383622734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 0x55868cfa1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.310+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3383622734 >> 172.21.15.12:0/3383622734 conn(0x55868cebe7e0 msgr2=0x55868cf8aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.311+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3383622734 shutdown_connections 2023-12-11T20:28:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.311+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3383622734 wait complete. 2023-12-11T20:28:30.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.311+0000 7f623a9dcb80 20 client.19023 trim_cache size 0 max 16384 2023-12-11T20:28:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:28:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:28:30.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:30 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:28:30.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.336+0000 7f623a9dcb80 1 Processor -- start 2023-12-11T20:28:30.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f623a9dcb80 1 -- start start 2023-12-11T20:28:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cf99810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 0x55868cfa8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cf9c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cf8c250 con 0x55868cf99430 2023-12-11T20:28:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cf86b50 con 0x55868cf97be0 2023-12-11T20:28:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cfb4e50 con 0x55868cf98540 2023-12-11T20:28:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f622559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cf9c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f622559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cf9c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48832/0 (socket says 172.21.15.12:48832) 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f622559c700 1 -- 172.21.15.12:0/3911151746 learned_addr learned my addr 172.21.15.12:0/3911151746 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f6224d9b700 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cf99810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.337+0000 7f621ffff700 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 0x55868cfa8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f622559c700 1 -- 172.21.15.12:0/3911151746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 msgr2=0x55868cfa8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f622559c700 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 0x55868cfa8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f622559c700 1 -- 172.21.15.12:0/3911151746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 msgr2=0x55868cf99810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f622559c700 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cf99810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f622559c700 1 -- 172.21.15.12:0/3911151746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55868ccf5c60 con 0x55868cf99430 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f622559c700 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cf9c410 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f6218095cb0 tx=0x7f62180843d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32045aceafec200 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f620b7fe700 1 -- 172.21.15.12:0/3911151746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218004c40 con 0x55868cf99430 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f620b7fe700 1 -- 172.21.15.12:0/3911151746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6218022250 con 0x55868cf99430 2023-12-11T20:28:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.338+0000 7f620b7fe700 1 -- 172.21.15.12:0/3911151746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621809d900 con 0x55868cf99430 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3911151746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 msgr2=0x55868cf9c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cf9c410 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f6218095cb0 tx=0x7f62180843d0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3911151746 shutdown_connections 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf97be0 0x55868cf99810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf99430 0x55868cf9c410 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/3911151746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf98540 0x55868cfa8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3911151746 >> 172.21.15.12:0/3911151746 conn(0x55868cebe7e0 msgr2=0x55868cf9f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3911151746 shutdown_connections 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.339+0000 7f623a9dcb80 1 -- 172.21.15.12:0/3911151746 wait complete. 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 1 -- start start 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 1 Processor -- start 2023-12-11T20:28:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cfa6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 0x55868cfa7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 0x55868cfa8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cfa88d0 con 0x55868cf97be0 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cfa8a40 con 0x55868cf98540 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55868cfa8c00 con 0x55868cf99430 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.340+0000 7f623a9dcb80 10 client.0 _ll_register_callbacks cb 0x55868cdc8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cfa6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cfa6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48840/0 (socket says 172.21.15.12:48840) 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 -- 172.21.15.12:0/2459199885 learned_addr learned my addr 172.21.15.12:0/2459199885 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f621ffff700 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 0x55868cfa7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f622559c700 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 0x55868cfa8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 -- 172.21.15.12:0/2459199885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 msgr2=0x55868cfa8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 0x55868cfa8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 -- 172.21.15.12:0/2459199885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 msgr2=0x55868cfa7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 0x55868cfa7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 -- 172.21.15.12:0/2459199885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55868cd0cde0 con 0x55868cf97be0 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f6224d9b700 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cfa6e40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f6214010a00 tx=0x7f6214010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd3308344e0b967 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.341+0000 7f61fffff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f61fffff700 1 -- 172.21.15.12:0/2459199885 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214021040 con 0x55868cf97be0 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f61fffff700 1 -- 172.21.15.12:0/2459199885 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6214017070 con 0x55868cf97be0 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f623a9dcb80 1 -- 172.21.15.12:0/2459199885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6214015070 con 0x55868cf97be0 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f61fffff700 1 -- 172.21.15.12:0/2459199885 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6214028460 con 0x55868cf97be0 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f623a9dcb80 10 client.19029 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:30.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f623a9dcb80 1 -- 172.21.15.12:0/2459199885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55868cd33250 con 0x55868cf97be0 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f61fffff700 1 -- 172.21.15.12:0/2459199885 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6214015070 con 0x55868cf97be0 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f61fffff700 1 -- 172.21.15.12:0/2459199885 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6214011970 con 0x55868cf97be0 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f623a9dcb80 10 client.19029 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f623a9dcb80 10 client.19029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.342+0000 7f623a9dcb80 20 client.19029 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.343+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55868d004f70 0x55868d007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.343+0000 7f623a9dcb80 4 client.19029 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.343+0000 7f623a9dcb80 1 -- 172.21.15.12:0/2459199885 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55868cea9fd0 con 0x55868d004f70 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.343+0000 7f621ffff700 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55868d004f70 0x55868d007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f621ffff700 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55868d004f70 0x55868d007390 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcdb8ebb3184a7bc server_cookie=68425f801a12a06 in_seq=0 out_seq=0 2023-12-11T20:28:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f61fffff700 10 client.19029 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f61fffff700 1 -- 172.21.15.12:0/2459199885 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55868cea9fd0 con 0x55868d004f70 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f61fffff700 10 client.19029 handle_command_reply: tid=0 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 client.19029 shutdown 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 -- 172.21.15.12:0/2459199885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 msgr2=0x55868cfa6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cfa6e40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f6214010a00 tx=0x7f6214010d00 comp rx=0 tx=0).stop 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 -- 172.21.15.12:0/2459199885 shutdown_connections 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55868d004f70 0x55868d007390 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55868cf99430 0x55868cfa8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55868cf97be0 0x55868cfa6e40 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 --2- 172.21.15.12:0/2459199885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55868cf98540 0x55868cfa7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f61fffff700 0 client.19029 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 -- 172.21.15.12:0/2459199885 >> 172.21.15.12:0/2459199885 conn(0x55868cebe7e0 msgr2=0x55868cf9c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 -- 172.21.15.12:0/2459199885 shutdown_connections 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.344+0000 7f623a9dcb80 1 -- 172.21.15.12:0/2459199885 wait complete. 2023-12-11T20:28:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f623a9dcb80 20 client.19029 trim_cache size 0 max 16384 2023-12-11T20:28:30.346 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:28:30.346 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:28:30.346 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:28:30.346 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 -- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62100a1480 msgr2=0x7f62100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62100a1480 0x7f62100a3940 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f620c00b580 tx=0x7f620c005e80 comp rx=0 tx=0).stop 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 -- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6220103040 msgr2=0x7f62201a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6220103040 0x7f62201a0aa0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6218007ee0 tx=0x7f621800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 -- 172.21.15.12:0/3685264345 shutdown_connections 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f62100a1480 0x7f62100a3940 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62201014b0 0x7f6220199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6220103040 0x7f62201a0aa0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 --2- 172.21.15.12:0/3685264345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62201026a0 0x7f6220199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 -- 172.21.15.12:0/3685264345 >> 172.21.15.12:0/3685264345 conn(0x7f62200fca00 msgr2=0x7f6220107f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 -- 172.21.15.12:0/3685264345 shutdown_connections 2023-12-11T20:28:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.345+0000 7f6226fff700 1 -- 172.21.15.12:0/3685264345 wait complete. 2023-12-11T20:28:30.364 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:28:30.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:28:30.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:28:30.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:28:30.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:30 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:28:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/1334952242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e88100e40 msgr2=0x7f5e881012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/1334952242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e88100e40 0x7f5e881012c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000b0a0 tx=0x7f5e8000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/1334952242 shutdown_connections 2023-12-11T20:28:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/1334952242 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e880ffb20 0x7f5e880fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/1334952242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e88100e40 0x7f5e881012c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/1334952242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e88100480 0x7f5e88100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/1334952242 >> 172.21.15.12:0/1334952242 conn(0x7f5e880fb760 msgr2=0x7f5e880fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/1334952242 shutdown_connections 2023-12-11T20:28:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.607+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/1334952242 wait complete. 2023-12-11T20:28:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.608+0000 7f5e8c9fe700 1 Processor -- start 2023-12-11T20:28:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.608+0000 7f5e8c9fe700 1 -- start start 2023-12-11T20:28:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.608+0000 7f5e8c9fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880ffb20 0x7f5e88199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.608+0000 7f5e8c9fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e88100480 0x7f5e88199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.608+0000 7f5e8c9fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e88100e40 0x7f5e881a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.608+0000 7f5e8c9fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e881a0f40 con 0x7f5e88100e40 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.608+0000 7f5e8c9fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e881a1080 con 0x7f5e88100480 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.608+0000 7f5e8c9fe700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e881a1210 con 0x7f5e880ffb20 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e88100480 0x7f5e88199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e88100480 0x7f5e88199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44280/0 (socket says 172.21.15.12:44280) 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8659c700 1 -- 172.21.15.12:0/2946491521 learned_addr learned my addr 172.21.15.12:0/2946491521 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e86d9d700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880ffb20 0x7f5e88199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8759e700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e88100e40 0x7f5e881a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8659c700 1 -- 172.21.15.12:0/2946491521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880ffb20 msgr2=0x7f5e88199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8659c700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880ffb20 0x7f5e88199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8659c700 1 -- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e88100e40 msgr2=0x7f5e881a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8659c700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e88100e40 0x7f5e881a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e8659c700 1 -- 172.21.15.12:0/2946491521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80009d00 con 0x7f5e88100480 2023-12-11T20:28:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.609+0000 7f5e86d9d700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880ffb20 0x7f5e88199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.610+0000 7f5e8659c700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e88100480 0x7f5e88199950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00e9a0 tx=0x7f5e7c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.610+0000 7f5e6ffff700 1 -- 172.21.15.12:0/2946491521 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c009790 con 0x7f5e88100480 2023-12-11T20:28:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.610+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e881a14f0 con 0x7f5e88100480 2023-12-11T20:28:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.610+0000 7f5e6ffff700 1 -- 172.21.15.12:0/2946491521 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e7c010430 con 0x7f5e88100480 2023-12-11T20:28:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.610+0000 7f5e6ffff700 1 -- 172.21.15.12:0/2946491521 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00cea0 con 0x7f5e88100480 2023-12-11T20:28:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.610+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e881a1a50 con 0x7f5e88100480 2023-12-11T20:28:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.611+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8810a900 con 0x7f5e88100480 2023-12-11T20:28:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.613+0000 7f5e6ffff700 1 -- 172.21.15.12:0/2946491521 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5e7c0105a0 con 0x7f5e88100480 2023-12-11T20:28:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.615+0000 7f5e6ffff700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e700a1480 0x7f5e700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.615+0000 7f5e6ffff700 1 -- 172.21.15.12:0/2946491521 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5e7c014070 con 0x7f5e88100480 2023-12-11T20:28:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.615+0000 7f5e86d9d700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e700a1480 0x7f5e700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.616+0000 7f5e86d9d700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e700a1480 0x7f5e700a3940 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5e78011490 tx=0x7f5e78009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:30.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.618+0000 7f5e6ffff700 1 -- 172.21.15.12:0/2946491521 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5e7c096700 con 0x7f5e88100480 2023-12-11T20:28:30.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.946+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e8804f300 con 0x7f5e88100480 2023-12-11T20:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.947+0000 7f5e6ffff700 1 -- 172.21.15.12:0/2946491521 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f5e7c099d20 con 0x7f5e88100480 2023-12-11T20:28:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:28:30.945 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:27:36.118534+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:28:30.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e700a1480 msgr2=0x7f5e700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e700a1480 0x7f5e700a3940 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5e78011490 tx=0x7f5e78009260 comp rx=0 tx=0).stop 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e88100480 msgr2=0x7f5e88199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e88100480 0x7f5e88199950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00e9a0 tx=0x7f5e7c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 shutdown_connections 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e700a1480 0x7f5e700a3940 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e88100e40 0x7f5e881a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e880ffb20 0x7f5e88199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 --2- 172.21.15.12:0/2946491521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e88100480 0x7f5e88199950 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.949+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 >> 172.21.15.12:0/2946491521 conn(0x7f5e880fb760 msgr2=0x7f5e880fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.950+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 shutdown_connections 2023-12-11T20:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:30.950+0000 7f5e8c9fe700 1 -- 172.21.15.12:0/2946491521 wait complete. 2023-12-11T20:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2023-12-11T20:28:30.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:28:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 -- 172.21.15.12:0/4258780665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df8102e80 msgr2=0x7f1df8109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 --2- 172.21.15.12:0/4258780665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df8102e80 0x7f1df8109730 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f1df000b0d0 tx=0x7f1df000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 -- 172.21.15.12:0/4258780665 shutdown_connections 2023-12-11T20:28:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 --2- 172.21.15.12:0/4258780665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df8102e80 0x7f1df8109730 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 --2- 172.21.15.12:0/4258780665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1df81012f0 0x7f1df8101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 --2- 172.21.15.12:0/4258780665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1df81024e0 0x7f1df8102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 -- 172.21.15.12:0/4258780665 >> 172.21.15.12:0/4258780665 conn(0x7f1df80fc860 msgr2=0x7f1df80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 -- 172.21.15.12:0/4258780665 shutdown_connections 2023-12-11T20:28:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.219+0000 7f1dff59d700 1 -- 172.21.15.12:0/4258780665 wait complete. 2023-12-11T20:28:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.220+0000 7f1dff59d700 1 Processor -- start 2023-12-11T20:28:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.220+0000 7f1dff59d700 1 -- start start 2023-12-11T20:28:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dff59d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1df81012f0 0x7f1df8197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dff59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df81024e0 0x7f1df81976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dff59d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1df8102e80 0x7f1df819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dff59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819eca0 con 0x7f1df81024e0 2023-12-11T20:28:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dff59d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819ede0 con 0x7f1df81012f0 2023-12-11T20:28:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dff59d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819ef70 con 0x7f1df8102e80 2023-12-11T20:28:31.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dfdd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df81024e0 0x7f1df81976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dfdd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df81024e0 0x7f1df81976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48878/0 (socket says 172.21.15.12:48878) 2023-12-11T20:28:31.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dfdd9a700 1 -- 172.21.15.12:0/2579606836 learned_addr learned my addr 172.21.15.12:0/2579606836 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1df81012f0 0x7f1df8197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.221+0000 7f1dfed9c700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1df8102e80 0x7f1df819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.222+0000 7f1dfdd9a700 1 -- 172.21.15.12:0/2579606836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1df8102e80 msgr2=0x7f1df819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.222+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1df8102e80 0x7f1df819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.222+0000 7f1dfdd9a700 1 -- 172.21.15.12:0/2579606836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1df81012f0 msgr2=0x7f1df8197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.222+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1df81012f0 0x7f1df8197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.222+0000 7f1dfdd9a700 1 -- 172.21.15.12:0/2579606836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df0009d00 con 0x7f1df81024e0 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.222+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1df81012f0 0x7f1df8197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.222+0000 7f1dfed9c700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1df8102e80 0x7f1df819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.222+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df81024e0 0x7f1df81976b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1de800d950 tx=0x7f1de800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.223+0000 7f1def7fe700 1 -- 172.21.15.12:0/2579606836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8009940 con 0x7f1df81024e0 2023-12-11T20:28:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.223+0000 7f1def7fe700 1 -- 172.21.15.12:0/2579606836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1de8010460 con 0x7f1df81024e0 2023-12-11T20:28:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.223+0000 7f1dff59d700 1 -- 172.21.15.12:0/2579606836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df819f250 con 0x7f1df81024e0 2023-12-11T20:28:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.223+0000 7f1def7fe700 1 -- 172.21.15.12:0/2579606836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de800f620 con 0x7f1df81024e0 2023-12-11T20:28:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.223+0000 7f1dff59d700 1 -- 172.21.15.12:0/2579606836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df819f7b0 con 0x7f1df81024e0 2023-12-11T20:28:31.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.226+0000 7f1def7fe700 1 -- 172.21.15.12:0/2579606836 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1de80105d0 con 0x7f1df81024e0 2023-12-11T20:28:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.227+0000 7f1e14038b80 1 Processor -- start 2023-12-11T20:28:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.228+0000 7f1e14038b80 1 -- start start 2023-12-11T20:28:31.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.228+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f85a60 0x55b6b3f85e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.228+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.228+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f87240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.228+0000 7f1e14038b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3ee0b50 con 0x55b6b3f86de0 2023-12-11T20:28:31.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.228+0000 7f1e14038b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3ede470 con 0x55b6b3f863c0 2023-12-11T20:28:31.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.228+0000 7f1e14038b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3ed9d60 con 0x55b6b3f85a60 2023-12-11T20:28:31.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.228+0000 7f1dfe59b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfe59b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f868a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44306/0 (socket says 172.21.15.12:44306) 2023-12-11T20:28:31.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfe59b700 1 -- 172.21.15.12:0/2106763562 learned_addr learned my addr 172.21.15.12:0/2106763562 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfed9c700 1 --2- 172.21.15.12:0/2106763562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f85a60 0x55b6b3f85e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfdd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f87240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1def7fe700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1de40a15a0 0x7f1de40a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1def7fe700 1 -- 172.21.15.12:0/2579606836 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1de80ccb90 con 0x7f1df81024e0 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfe59b700 1 -- 172.21.15.12:0/2106763562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f85a60 msgr2=0x55b6b3f85e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/2106763562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f85a60 0x55b6b3f85e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfe59b700 1 -- 172.21.15.12:0/2106763562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 msgr2=0x55b6b3f87240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/2106763562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f87240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfed9c700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1de40a15a0 0x7f1de40a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.229+0000 7f1dfe59b700 1 -- 172.21.15.12:0/2106763562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6b3d56630 con 0x55b6b3f863c0 2023-12-11T20:28:31.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.230+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/2106763562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f868a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1df40138d0 tx=0x7f1df4013be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa606b20b6b4ad80 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.230+0000 7f1decff9700 1 -- 172.21.15.12:0/2106763562 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4018070 con 0x55b6b3f863c0 2023-12-11T20:28:31.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.230+0000 7f1decff9700 1 -- 172.21.15.12:0/2106763562 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1df4004cc0 con 0x55b6b3f863c0 2023-12-11T20:28:31.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.230+0000 7f1decff9700 1 -- 172.21.15.12:0/2106763562 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400e7b0 con 0x55b6b3f863c0 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 -- 172.21.15.12:0/2106763562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 msgr2=0x55b6b3f868a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1dfed9c700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1de40a15a0 0x7f1de40a3a60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1df0007af0 tx=0x7f1df00099e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 --2- 172.21.15.12:0/2106763562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f868a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1df40138d0 tx=0x7f1df4013be0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 -- 172.21.15.12:0/2106763562 shutdown_connections 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 --2- 172.21.15.12:0/2106763562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f87240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 --2- 172.21.15.12:0/2106763562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f85a60 0x55b6b3f85e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 --2- 172.21.15.12:0/2106763562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f868a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 -- 172.21.15.12:0/2106763562 >> 172.21.15.12:0/2106763562 conn(0x55b6b3eb47e0 msgr2=0x55b6b3f803d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 -- 172.21.15.12:0/2106763562 shutdown_connections 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 -- 172.21.15.12:0/2106763562 wait complete. 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.231+0000 7f1e14038b80 1 -- start start 2023-12-11T20:28:31.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1e14038b80 1 Processor -- start 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f85a60 0x55b6b3f8f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f8f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 0x55b6b3f96870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1e14038b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3e93560 con 0x55b6b3f85a60 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1e14038b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3e93200 con 0x55b6b3f863c0 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1e14038b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3d58920 con 0x55b6b3f86de0 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1e14038b80 10 client.0 _ll_register_callbacks cb 0x55b6b3dbea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.232+0000 7f1dfe59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f85a60 0x55b6b3f8f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfe59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f85a60 0x55b6b3f8f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48892/0 (socket says 172.21.15.12:48892) 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfe59b700 1 -- 172.21.15.12:0/3692997637 learned_addr learned my addr 172.21.15.12:0/3692997637 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f8f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfe59b700 1 -- 172.21.15.12:0/3692997637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 msgr2=0x55b6b3f96870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfed9c700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 0x55b6b3f96870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 0x55b6b3f96870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfe59b700 1 -- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 msgr2=0x55b6b3f8f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f8f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfe59b700 1 -- 172.21.15.12:0/3692997637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df4009d50 con 0x55b6b3f85a60 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f8f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfed9c700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 0x55b6b3f96870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f85a60 0x55b6b3f8f2f0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009370 tx=0x7f1df4005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664bfef9f5735371 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.233+0000 7f1de1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.234+0000 7f1de1ffb700 1 -- 172.21.15.12:0/3692997637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4018040 con 0x55b6b3f85a60 2023-12-11T20:28:31.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.234+0000 7f1e14038b80 1 -- 172.21.15.12:0/3692997637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6b3f789e0 con 0x55b6b3f85a60 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.234+0000 7f1de1ffb700 1 -- 172.21.15.12:0/3692997637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1df400e7c0 con 0x55b6b3f85a60 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.234+0000 7f1de1ffb700 1 -- 172.21.15.12:0/3692997637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1df40050c0 con 0x55b6b3f85a60 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.234+0000 7f1e14038b80 10 client.19047 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.234+0000 7f1e14038b80 1 -- 172.21.15.12:0/3692997637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b6b3d02de0 con 0x55b6b3f85a60 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.234+0000 7f1de1ffb700 1 -- 172.21.15.12:0/3692997637 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b6b3f789e0 con 0x55b6b3f85a60 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.234+0000 7f1de1ffb700 1 -- 172.21.15.12:0/3692997637 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1df4024070 con 0x55b6b3f85a60 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1e14038b80 10 client.19047 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1e14038b80 10 client.19047 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1e14038b80 20 client.19047 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1e14038b80 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b6b3f9b110 0x55b6b3f9d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1e14038b80 4 client.19047 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1e14038b80 1 -- 172.21.15.12:0/3692997637 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6b3f54f40 con 0x55b6b3f9b110 2023-12-11T20:28:31.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b6b3f9b110 0x55b6b3f9d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b6b3f9b110 0x55b6b3f9d530 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67caf8895ddba54f server_cookie=ba272db15bb7d5f2 in_seq=0 out_seq=0 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.235+0000 7f1de1ffb700 10 client.19047 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.236+0000 7f1de1ffb700 1 -- 172.21.15.12:0/3692997637 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b6b3f54f40 con 0x55b6b3f9b110 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.236+0000 7f1de1ffb700 10 client.19047 handle_command_reply: tid=0 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.236+0000 7f1e14038b80 1 client.19047 shutdown 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 -- 172.21.15.12:0/3692997637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f85a60 msgr2=0x55b6b3f8f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f85a60 0x55b6b3f8f2f0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1df4009370 tx=0x7f1df4005330 comp rx=0 tx=0).stop 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 -- 172.21.15.12:0/3692997637 shutdown_connections 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b6b3f9b110 0x55b6b3f9d530 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 0x55b6b3f96870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f85a60 0x55b6b3f8f2f0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1de1ffb700 0 client.19047 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 --2- 172.21.15.12:0/3692997637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f863c0 0x55b6b3f8f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 -- 172.21.15.12:0/3692997637 >> 172.21.15.12:0/3692997637 conn(0x55b6b3eb47e0 msgr2=0x55b6b3f84820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 -- 172.21.15.12:0/3692997637 shutdown_connections 2023-12-11T20:28:31.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 1 -- 172.21.15.12:0/3692997637 wait complete. 2023-12-11T20:28:31.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.237+0000 7f1e14038b80 20 client.19047 trim_cache size 0 max 16384 2023-12-11T20:28:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.255+0000 7f1e14038b80 1 Processor -- start 2023-12-11T20:28:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.255+0000 7f1e14038b80 1 -- start start 2023-12-11T20:28:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3f871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f863c0 0x55b6b3f96830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f80320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1e14038b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3f97a20 con 0x55b6b3f86de0 2023-12-11T20:28:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1e14038b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3f87730 con 0x55b6b3f85a60 2023-12-11T20:28:31.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1e14038b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3f7cbb0 con 0x55b6b3f863c0 2023-12-11T20:28:31.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1dfed9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f80320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1dfe59b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3f871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1dfed9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f80320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48906/0 (socket says 172.21.15.12:48906) 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1dfed9c700 1 -- 172.21.15.12:0/2226514341 learned_addr learned my addr 172.21.15.12:0/2226514341 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f863c0 0x55b6b3f96830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1dfe59b700 1 -- 172.21.15.12:0/2226514341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f863c0 msgr2=0x55b6b3f96830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.256+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f863c0 0x55b6b3f96830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.257+0000 7f1dfe59b700 1 -- 172.21.15.12:0/2226514341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 msgr2=0x55b6b3f80320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.257+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f80320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.257+0000 7f1dfe59b700 1 -- 172.21.15.12:0/2226514341 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6b3cebc60 con 0x55b6b3f85a60 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.257+0000 7f1dfed9c700 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f80320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.257+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3f871c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1df401c830 tx=0x7f1df4013be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d35470014e1879 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.257+0000 7f1ded7fa700 1 -- 172.21.15.12:0/2226514341 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df40093a0 con 0x55b6b3f85a60 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.257+0000 7f1ded7fa700 1 -- 172.21.15.12:0/2226514341 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1df40054a0 con 0x55b6b3f85a60 2023-12-11T20:28:31.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.257+0000 7f1ded7fa700 1 -- 172.21.15.12:0/2226514341 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400ec50 con 0x55b6b3f85a60 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 -- 172.21.15.12:0/2226514341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 msgr2=0x55b6b3f871c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3f871c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1df401c830 tx=0x7f1df4013be0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 -- 172.21.15.12:0/2226514341 shutdown_connections 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3f871c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f86de0 0x55b6b3f80320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 --2- 172.21.15.12:0/2226514341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f863c0 0x55b6b3f96830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 -- 172.21.15.12:0/2226514341 >> 172.21.15.12:0/2226514341 conn(0x55b6b3eb47e0 msgr2=0x55b6b3f80cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 -- 172.21.15.12:0/2226514341 shutdown_connections 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.258+0000 7f1e14038b80 1 -- 172.21.15.12:0/2226514341 wait complete. 2023-12-11T20:28:31.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 1 -- start start 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 1 Processor -- start 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3feb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f863c0 0x55b6b3fedb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 0x55b6b3ff00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3ff05f0 con 0x55b6b3f863c0 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3ff0730 con 0x55b6b3f85a60 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b3ff08f0 con 0x55b6b3f86de0 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.259+0000 7f1e14038b80 10 client.0 _ll_register_callbacks cb 0x55b6b3dbea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f863c0 0x55b6b3fedb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfe59b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3feb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f863c0 0x55b6b3fedb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48922/0 (socket says 172.21.15.12:48922) 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 -- 172.21.15.12:0/912020360 learned_addr learned my addr 172.21.15.12:0/912020360 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfe59b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3feb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44330/0 (socket says 172.21.15.12:44330) 2023-12-11T20:28:31.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 -- 172.21.15.12:0/912020360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 msgr2=0x55b6b3ff00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 0x55b6b3ff00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 -- 172.21.15.12:0/912020360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 msgr2=0x55b6b3feb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3feb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 -- 172.21.15.12:0/912020360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df810a080 con 0x55b6b3f863c0 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3feb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1dfdd9a700 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f863c0 0x55b6b3fedb60 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f1de8096870 tx=0x7f1de8010ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b616c95c4bb89b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.260+0000 7f1de1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1de1ffb700 1 -- 172.21.15.12:0/912020360 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de809c030 con 0x55b6b3f863c0 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1de1ffb700 1 -- 172.21.15.12:0/912020360 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1de809d070 con 0x55b6b3f863c0 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 1 -- 172.21.15.12:0/912020360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1df4004cc0 con 0x55b6b3f863c0 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1de1ffb700 1 -- 172.21.15.12:0/912020360 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1de8099e00 con 0x55b6b3f863c0 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 10 client.19053 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 1 -- 172.21.15.12:0/912020360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b6b3d02de0 con 0x55b6b3f863c0 2023-12-11T20:28:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1de1ffb700 1 -- 172.21.15.12:0/912020360 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1de807c080 con 0x55b6b3f863c0 2023-12-11T20:28:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1de1ffb700 1 -- 172.21.15.12:0/912020360 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1de80add00 con 0x55b6b3f863c0 2023-12-11T20:28:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 10 client.19053 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 10 client.19053 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:28:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 20 client.19053 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b6b3ff2240 0x55b6b3ff4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 4 client.19053 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:28:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.261+0000 7f1e14038b80 1 -- 172.21.15.12:0/912020360 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b6b3e9ffd0 con 0x55b6b3ff2240 2023-12-11T20:28:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.262+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b6b3ff2240 0x55b6b3ff4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.262+0000 7f1dfe59b700 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b6b3ff2240 0x55b6b3ff4660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=176f5126bcb4c3f7 server_cookie=2752b2852f425514 in_seq=0 out_seq=0 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.262+0000 7f1de1ffb700 10 client.19053 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1de1ffb700 1 -- 172.21.15.12:0/912020360 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b6b3e9ffd0 con 0x55b6b3ff2240 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1de1ffb700 10 client.19053 handle_command_reply: tid=0 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 client.19053 shutdown 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 -- 172.21.15.12:0/912020360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f863c0 msgr2=0x55b6b3fedb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f863c0 0x55b6b3fedb60 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f1de8096870 tx=0x7f1de8010ac0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 -- 172.21.15.12:0/912020360 shutdown_connections 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55b6b3ff2240 0x55b6b3ff4660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b6b3f85a60 0x55b6b3feb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b6b3f86de0 0x55b6b3ff00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 --2- 172.21.15.12:0/912020360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b3f863c0 0x55b6b3fedb60 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1de1ffb700 0 client.19053 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 -- 172.21.15.12:0/912020360 >> 172.21.15.12:0/912020360 conn(0x55b6b3eb47e0 msgr2=0x55b6b3f80320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 -- 172.21.15.12:0/912020360 shutdown_connections 2023-12-11T20:28:31.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 1 -- 172.21.15.12:0/912020360 wait complete. 2023-12-11T20:28:31.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.263+0000 7f1e14038b80 20 client.19053 trim_cache size 0 max 16384 2023-12-11T20:28:31.265 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 -- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1de40a15a0 msgr2=0x7f1de40a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1de40a15a0 0x7f1de40a3a60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1df0007af0 tx=0x7f1df00099e0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 -- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df81024e0 msgr2=0x7f1df81976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df81024e0 0x7f1df81976b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1de800d950 tx=0x7f1de800dc60 comp rx=0 tx=0).stop 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 -- 172.21.15.12:0/2579606836 shutdown_connections 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1de40a15a0 0x7f1de40a3a60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1df81012f0 0x7f1df8197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1df8102e80 0x7f1df819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 --2- 172.21.15.12:0/2579606836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1df81024e0 0x7f1df81976b0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 -- 172.21.15.12:0/2579606836 >> 172.21.15.12:0/2579606836 conn(0x7f1df80fc860 msgr2=0x7f1df81057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 -- 172.21.15.12:0/2579606836 shutdown_connections 2023-12-11T20:28:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.264+0000 7f1dff59d700 1 -- 172.21.15.12:0/2579606836 wait complete. 2023-12-11T20:28:31.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:31 smithi012 ceph-mon[128787]: pgmap v752: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:28:31.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:31 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2946491521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:28:31.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:28:31.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:31 smithi032 ceph-mon[132488]: pgmap v752: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:28:31.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:31 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2946491521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:28:31.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.508+0000 7f818d5ff700 1 -- 172.21.15.12:0/3796875832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8188101090 msgr2=0x7f8188101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.508+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3796875832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8188101090 0x7f8188101510 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f818000b0a0 tx=0x7f818000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.509+0000 7f818d5ff700 1 -- 172.21.15.12:0/3796875832 shutdown_connections 2023-12-11T20:28:31.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.509+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3796875832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81880ffd70 0x7f8188100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.509+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3796875832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8188101090 0x7f8188101510 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.509+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3796875832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81881006d0 0x7f8188100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.509+0000 7f818d5ff700 1 -- 172.21.15.12:0/3796875832 >> 172.21.15.12:0/3796875832 conn(0x7f81880fb930 msgr2=0x7f81880fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.509+0000 7f818d5ff700 1 -- 172.21.15.12:0/3796875832 shutdown_connections 2023-12-11T20:28:31.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.509+0000 7f818d5ff700 1 -- 172.21.15.12:0/3796875832 wait complete. 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.510+0000 7f818d5ff700 1 Processor -- start 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.510+0000 7f818d5ff700 1 -- start start 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.510+0000 7f818d5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81880ffd70 0x7f81881995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.510+0000 7f818d5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81881006d0 0x7f8188199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.510+0000 7f818d5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8188101090 0x7f81881a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f818d5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81881a10f0 con 0x7f81881006d0 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f818d5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81881a1230 con 0x7f8188101090 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f818d5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81881a13c0 con 0x7f81880ffd70 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f81867fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81881006d0 0x7f8188199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81880ffd70 0x7f81881995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81880ffd70 0x7f81881995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:37598/0 (socket says 172.21.15.12:37598) 2023-12-11T20:28:31.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f8186ffd700 1 -- 172.21.15.12:0/3901637703 learned_addr learned my addr 172.21.15.12:0/3901637703 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f81867fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81881006d0 0x7f8188199b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48934/0 (socket says 172.21.15.12:48934) 2023-12-11T20:28:31.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f81877fe700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8188101090 0x7f81881a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f81867fc700 1 -- 172.21.15.12:0/3901637703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81880ffd70 msgr2=0x7f81881995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f81867fc700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81880ffd70 0x7f81881995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f81867fc700 1 -- 172.21.15.12:0/3901637703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8188101090 msgr2=0x7f81881a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f81867fc700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8188101090 0x7f81881a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.511+0000 7f81867fc700 1 -- 172.21.15.12:0/3901637703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009d00 con 0x7f81881006d0 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.512+0000 7f81867fc700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81881006d0 0x7f8188199b00 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f817c00e9f0 tx=0x7f817c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.512+0000 7f816ffff700 1 -- 172.21.15.12:0/3901637703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c00c9c0 con 0x7f81881006d0 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.512+0000 7f816ffff700 1 -- 172.21.15.12:0/3901637703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f817c010430 con 0x7f81881006d0 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.512+0000 7f818d5ff700 1 -- 172.21.15.12:0/3901637703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81881a16a0 con 0x7f81881006d0 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.512+0000 7f816ffff700 1 -- 172.21.15.12:0/3901637703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c018680 con 0x7f81881006d0 2023-12-11T20:28:31.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.512+0000 7f818d5ff700 1 -- 172.21.15.12:0/3901637703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81881a1bb0 con 0x7f81881006d0 2023-12-11T20:28:31.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.516+0000 7f816ffff700 1 -- 172.21.15.12:0/3901637703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f817c0105a0 con 0x7f81881006d0 2023-12-11T20:28:31.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.518+0000 7f816ffff700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81700a1480 0x7f81700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.518+0000 7f816ffff700 1 -- 172.21.15.12:0/3901637703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f817c014070 con 0x7f81881006d0 2023-12-11T20:28:31.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.518+0000 7f8186ffd700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81700a1480 0x7f81700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.519+0000 7f8186ffd700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81700a1480 0x7f81700a3940 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8178009d20 tx=0x7f8178009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.519+0000 7f81a0ef7b80 1 Processor -- start 2023-12-11T20:28:31.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.519+0000 7f81a0ef7b80 1 -- start start 2023-12-11T20:28:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.520+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89dbe0 0x56462d89e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.520+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89e540 0x56462d89ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.520+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d89f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.520+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d7f0b50 con 0x56462d89f430 2023-12-11T20:28:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.520+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d7ee470 con 0x56462d89e540 2023-12-11T20:28:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.520+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d7e9d60 con 0x56462d89dbe0 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.520+0000 7f81877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d89f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89dbe0 0x56462d89e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d89f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48948/0 (socket says 172.21.15.12:48948) 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81877fe700 1 -- 172.21.15.12:0/3354746645 learned_addr learned my addr 172.21.15.12:0/3354746645 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81867fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89e540 0x56462d89ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81877fe700 1 -- 172.21.15.12:0/3354746645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89dbe0 msgr2=0x56462d89e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81877fe700 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89dbe0 0x56462d89e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81877fe700 1 -- 172.21.15.12:0/3354746645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89e540 msgr2=0x56462d89ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81877fe700 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89e540 0x56462d89ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81877fe700 1 -- 172.21.15.12:0/3354746645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56462d666630 con 0x56462d89f430 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f8186ffd700 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89dbe0 0x56462d89e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81867fc700 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89e540 0x56462d89ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.521+0000 7f81877fe700 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d89f8b0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f818000b0a0 tx=0x7f8180009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3de879a1dba6a54 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.522+0000 7f816d7fa700 1 -- 172.21.15.12:0/3354746645 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000e040 con 0x56462d89f430 2023-12-11T20:28:31.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.522+0000 7f816d7fa700 1 -- 172.21.15.12:0/3354746645 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81800074e0 con 0x56462d89f430 2023-12-11T20:28:31.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.522+0000 7f816d7fa700 1 -- 172.21.15.12:0/3354746645 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180003d30 con 0x56462d89f430 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3354746645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 msgr2=0x56462d89f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d89f8b0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f818000b0a0 tx=0x7f8180009c00 comp rx=0 tx=0).stop 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3354746645 shutdown_connections 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d89f8b0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89dbe0 0x56462d89e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3354746645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89e540 0x56462d89ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3354746645 >> 172.21.15.12:0/3354746645 conn(0x56462d7c47e0 msgr2=0x56462d891d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3354746645 shutdown_connections 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.523+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3354746645 wait complete. 2023-12-11T20:28:31.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.524+0000 7f81a0ef7b80 1 -- start start 2023-12-11T20:28:31.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.524+0000 7f81a0ef7b80 1 Processor -- start 2023-12-11T20:28:31.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.525+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8a7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.525+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.525+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.525+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d7a3560 con 0x56462d89f430 2023-12-11T20:28:31.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.525+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d7a3200 con 0x56462d89dbe0 2023-12-11T20:28:31.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.525+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d668920 con 0x56462d89e540 2023-12-11T20:28:31.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.525+0000 7f81a0ef7b80 10 client.0 _ll_register_callbacks cb 0x56462d6cea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:31.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f81877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8a7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44374/0 (socket says 172.21.15.12:44374) 2023-12-11T20:28:31.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 -- 172.21.15.12:0/668116081 learned_addr learned my addr 172.21.15.12:0/668116081 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f81877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48954/0 (socket says 172.21.15.12:48954) 2023-12-11T20:28:31.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f81867fc700 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 -- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 msgr2=0x56462d8a7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8a7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 -- 172.21.15.12:0/668116081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 msgr2=0x56462d8aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 -- 172.21.15.12:0/668116081 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81881a1bb0 con 0x56462d89dbe0 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f81867fc700 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8a7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f81877fe700 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f8186ffd700 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8a7930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f817801dd10 tx=0x7f81780047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ee9c0a90d2adc0c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.526+0000 7f816aff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.527+0000 7f816aff5700 1 -- 172.21.15.12:0/668116081 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178022070 con 0x56462d89dbe0 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.527+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/668116081 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56462d888b40 con 0x56462d89dbe0 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.527+0000 7f816aff5700 1 -- 172.21.15.12:0/668116081 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f817800ed00 con 0x56462d89dbe0 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.527+0000 7f816aff5700 1 -- 172.21.15.12:0/668116081 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8178027420 con 0x56462d89dbe0 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.527+0000 7f81a0ef7b80 10 client.28646 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:31.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.527+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/668116081 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f818810c500 con 0x56462d89dbe0 2023-12-11T20:28:31.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.528+0000 7f816aff5700 1 -- 172.21.15.12:0/668116081 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56462d888b40 con 0x56462d89dbe0 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.528+0000 7f816aff5700 1 -- 172.21.15.12:0/668116081 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8178031670 con 0x56462d89dbe0 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.528+0000 7f81a0ef7b80 10 client.28646 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.528+0000 7f81a0ef7b80 10 client.28646 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.528+0000 7f81a0ef7b80 20 client.28646 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.528+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56462d8b37a0 0x56462d8b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.528+0000 7f81a0ef7b80 4 client.28646 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.528+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/668116081 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56462d864f40 con 0x56462d8b37a0 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.529+0000 7f81867fc700 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56462d8b37a0 0x56462d8b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.529+0000 7f816aff5700 10 client.28646 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:28:31.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.529+0000 7f81867fc700 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56462d8b37a0 0x56462d8b5bc0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92572133632f550a server_cookie=34845bc5693950c2 in_seq=0 out_seq=0 2023-12-11T20:28:31.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.530+0000 7f816aff5700 1 -- 172.21.15.12:0/668116081 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56462d864f40 con 0x56462d8b37a0 2023-12-11T20:28:31.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.530+0000 7f816aff5700 10 client.28646 handle_command_reply: tid=0 2023-12-11T20:28:31.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.530+0000 7f81a0ef7b80 1 client.28646 shutdown 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.530+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/668116081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 msgr2=0x56462d8a7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.530+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8a7930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f817801dd10 tx=0x7f81780047c0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/668116081 shutdown_connections 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56462d8b37a0 0x56462d8b5bc0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8a7930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f816aff5700 0 client.28646 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/668116081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8a7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/668116081 >> 172.21.15.12:0/668116081 conn(0x56462d7c47e0 msgr2=0x56462d890a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/668116081 shutdown_connections 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/668116081 wait complete. 2023-12-11T20:28:31.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.531+0000 7f81a0ef7b80 20 client.28646 trim_cache size 0 max 16384 2023-12-11T20:28:31.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:31 smithi039 ceph-mon[102205]: pgmap v752: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:28:31.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:31 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2946491521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.558+0000 7f81a0ef7b80 1 Processor -- start 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.558+0000 7f81a0ef7b80 1 -- start start 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.558+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d89f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.558+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89e540 0x56462d8aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.558+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89f430 0x56462d891970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.558+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d8b0030 con 0x56462d89e540 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.558+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d8a74a0 con 0x56462d89dbe0 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.558+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d89ecb0 con 0x56462d89f430 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d89f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f81867fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89e540 0x56462d8aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d89f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44382/0 (socket says 172.21.15.12:44382) 2023-12-11T20:28:31.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f8186ffd700 1 -- 172.21.15.12:0/614768222 learned_addr learned my addr 172.21.15.12:0/614768222 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f81877fe700 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89f430 0x56462d891970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f81867fc700 1 -- 172.21.15.12:0/614768222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89f430 msgr2=0x56462d891970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f81867fc700 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89f430 0x56462d891970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f81867fc700 1 -- 172.21.15.12:0/614768222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 msgr2=0x56462d89f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f81867fc700 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d89f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f81867fc700 1 -- 172.21.15.12:0/614768222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56462d612de0 con 0x56462d89e540 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f8186ffd700 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d89f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.559+0000 7f81877fe700 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89f430 0x56462d891970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.560+0000 7f81867fc700 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89e540 0x56462d8aee40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f817c0ca950 tx=0x7f817c0964b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1afae6d430d379b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.560+0000 7f816dffb700 1 -- 172.21.15.12:0/614768222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c09a870 con 0x56462d89e540 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.560+0000 7f816dffb700 1 -- 172.21.15.12:0/614768222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f817c09a170 con 0x56462d89e540 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.560+0000 7f816dffb700 1 -- 172.21.15.12:0/614768222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c098510 con 0x56462d89e540 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/614768222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89e540 msgr2=0x56462d8aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89e540 0x56462d8aee40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f817c0ca950 tx=0x7f817c0964b0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/614768222 shutdown_connections 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d89f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89f430 0x56462d891970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/614768222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89e540 0x56462d8aee40 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/614768222 >> 172.21.15.12:0/614768222 conn(0x56462d7c47e0 msgr2=0x56462d8a2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/614768222 shutdown_connections 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.561+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/614768222 wait complete. 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 1 -- start start 2023-12-11T20:28:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 1 Processor -- start 2023-12-11T20:28:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d8ae1a0 con 0x56462d89f430 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d8ae310 con 0x56462d89dbe0 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56462d8ae4d0 con 0x56462d89e540 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.562+0000 7f81a0ef7b80 10 client.0 _ll_register_callbacks cb 0x56462d6cea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f81877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8aa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44390/0 (socket says 172.21.15.12:44390) 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f8186ffd700 1 -- 172.21.15.12:0/3562954153 learned_addr learned my addr 172.21.15.12:0/3562954153 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f81877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48972/0 (socket says 172.21.15.12:48972) 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f81867fc700 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f8186ffd700 1 -- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 msgr2=0x56462d8aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f8186ffd700 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f8186ffd700 1 -- 172.21.15.12:0/3562954153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 msgr2=0x56462d8adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f8186ffd700 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f8186ffd700 1 -- 172.21.15.12:0/3562954153 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818810c500 con 0x56462d89dbe0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.563+0000 7f81867fc700 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.564+0000 7f8186ffd700 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8aa700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8178031a20 tx=0x7f81780093d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e00a8156235f3eb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.564+0000 7f816aff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.564+0000 7f816aff5700 1 -- 172.21.15.12:0/3562954153 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178037050 con 0x56462d89dbe0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.564+0000 7f816aff5700 1 -- 172.21.15.12:0/3562954153 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8178031450 con 0x56462d89dbe0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.564+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3562954153 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81800074e0 con 0x56462d89dbe0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.564+0000 7f816aff5700 1 -- 172.21.15.12:0/3562954153 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8178022040 con 0x56462d89dbe0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.564+0000 7f81a0ef7b80 10 client.28652 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.564+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3562954153 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56462d666630 con 0x56462d89dbe0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f816aff5700 1 -- 172.21.15.12:0/3562954153 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f817804a080 con 0x56462d89dbe0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f816aff5700 1 -- 172.21.15.12:0/3562954153 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8178046bf0 con 0x56462d89dbe0 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f81a0ef7b80 10 client.28652 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f81a0ef7b80 10 client.28652 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f81a0ef7b80 20 client.28652 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56462d90a6b0 0x56462d90cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f81a0ef7b80 4 client.28652 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3562954153 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56462d7affd0 con 0x56462d90a6b0 2023-12-11T20:28:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.565+0000 7f81867fc700 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56462d90a6b0 0x56462d90cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.566+0000 7f81867fc700 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56462d90a6b0 0x56462d90cad0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70845c24c16b4d5b server_cookie=646f4a3a7b2913ad in_seq=0 out_seq=0 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.566+0000 7f816aff5700 10 client.28652 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.566+0000 7f816aff5700 1 -- 172.21.15.12:0/3562954153 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56462d7affd0 con 0x56462d90a6b0 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.566+0000 7f816aff5700 10 client.28652 handle_command_reply: tid=0 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.566+0000 7f81a0ef7b80 1 client.28652 shutdown 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.566+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3562954153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 msgr2=0x56462d8aa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8aa700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8178031a20 tx=0x7f81780093d0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3562954153 shutdown_connections 2023-12-11T20:28:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x56462d90a6b0 0x56462d90cad0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56462d89dbe0 0x56462d8aa700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56462d89f430 0x56462d8adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 --2- 172.21.15.12:0/3562954153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56462d89e540 0x56462d8aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f816aff5700 0 client.28652 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3562954153 >> 172.21.15.12:0/3562954153 conn(0x56462d7c47e0 msgr2=0x56462d891970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3562954153 shutdown_connections 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 1 -- 172.21.15.12:0/3562954153 wait complete. 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.567+0000 7f81a0ef7b80 20 client.28652 trim_cache size 0 max 16384 2023-12-11T20:28:31.568 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:28:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 -- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81700a1480 msgr2=0x7f81700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81700a1480 0x7f81700a3940 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8178009d20 tx=0x7f8178009260 comp rx=0 tx=0).stop 2023-12-11T20:28:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 -- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81881006d0 msgr2=0x7f8188199b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81881006d0 0x7f8188199b00 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f817c00e9f0 tx=0x7f817c00ed00 comp rx=0 tx=0).stop 2023-12-11T20:28:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 -- 172.21.15.12:0/3901637703 shutdown_connections 2023-12-11T20:28:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81700a1480 0x7f81700a3940 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8188101090 0x7f81881a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81880ffd70 0x7f81881995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 --2- 172.21.15.12:0/3901637703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81881006d0 0x7f8188199b00 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 -- 172.21.15.12:0/3901637703 >> 172.21.15.12:0/3901637703 conn(0x7f81880fb930 msgr2=0x7f81880fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 -- 172.21.15.12:0/3901637703 shutdown_connections 2023-12-11T20:28:31.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.568+0000 7f818d5ff700 1 -- 172.21.15.12:0/3901637703 wait complete. 2023-12-11T20:28:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 -- 172.21.15.12:0/2910363533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9638101f40 msgr2=0x7f9638104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 --2- 172.21.15.12:0/2910363533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9638101f40 0x7f9638104330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9634009990 tx=0x7f9634009ca0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 -- 172.21.15.12:0/2910363533 shutdown_connections 2023-12-11T20:28:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 --2- 172.21.15.12:0/2910363533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9638101f40 0x7f9638104330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 --2- 172.21.15.12:0/2910363533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96381071a0 0x7f9638109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 --2- 172.21.15.12:0/2910363533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9638104870 0x7f9638106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 -- 172.21.15.12:0/2910363533 >> 172.21.15.12:0/2910363533 conn(0x7f96380fb930 msgr2=0x7f96380fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 -- 172.21.15.12:0/2910363533 shutdown_connections 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.572+0000 7f96407ff700 1 -- 172.21.15.12:0/2910363533 wait complete. 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.573+0000 7f96407ff700 1 Processor -- start 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.573+0000 7f96407ff700 1 -- start start 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f96407ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9638101f40 0x7f9638199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f96407ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9638104870 0x7f9638199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f96407ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96381071a0 0x7f96381a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f96407ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96381a1090 con 0x7f9638104870 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f96407ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96381a11d0 con 0x7f9638101f40 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f96407ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96381a1360 con 0x7f96381071a0 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f963dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9638104870 0x7f9638199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f963dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9638104870 0x7f9638199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48998/0 (socket says 172.21.15.12:48998) 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.574+0000 7f963dd9a700 1 -- 172.21.15.12:0/3271709143 learned_addr learned my addr 172.21.15.12:0/3271709143 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.575+0000 7f963e59b700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9638101f40 0x7f9638199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.575+0000 7f963ed9c700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96381071a0 0x7f96381a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.575+0000 7f963dd9a700 1 -- 172.21.15.12:0/3271709143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96381071a0 msgr2=0x7f96381a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.575+0000 7f963dd9a700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96381071a0 0x7f96381a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.575+0000 7f963dd9a700 1 -- 172.21.15.12:0/3271709143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9638101f40 msgr2=0x7f9638199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.575+0000 7f963dd9a700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9638101f40 0x7f9638199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.575+0000 7f963dd9a700 1 -- 172.21.15.12:0/3271709143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340095f0 con 0x7f9638104870 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.575+0000 7f963dd9a700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9638104870 0x7f9638199aa0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f962800d980 tx=0x7f962800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.576+0000 7f962f7fe700 1 -- 172.21.15.12:0/3271709143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628004220 con 0x7f9638104870 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.576+0000 7f96407ff700 1 -- 172.21.15.12:0/3271709143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96381a1640 con 0x7f9638104870 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.576+0000 7f962f7fe700 1 -- 172.21.15.12:0/3271709143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9628007640 con 0x7f9638104870 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.576+0000 7f962f7fe700 1 -- 172.21.15.12:0/3271709143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628005660 con 0x7f9638104870 2023-12-11T20:28:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.576+0000 7f96407ff700 1 -- 172.21.15.12:0/3271709143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96381a1ba0 con 0x7f9638104870 2023-12-11T20:28:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.581+0000 7f962f7fe700 1 -- 172.21.15.12:0/3271709143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f9628004750 con 0x7f9638104870 2023-12-11T20:28:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.581+0000 7f96540dcb80 1 Processor -- start 2023-12-11T20:28:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.581+0000 7f96540dcb80 1 -- start start 2023-12-11T20:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.582+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbceded0 0x55a3dbcee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.582+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbcee830 0x55a3dbcef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.582+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcefba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.582+0000 7f96540dcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbc49af0 con 0x55a3dbceded0 2023-12-11T20:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.582+0000 7f96540dcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbc47410 con 0x55a3dbcef720 2023-12-11T20:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.582+0000 7f96540dcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbc42d00 con 0x55a3dbcee830 2023-12-11T20:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.582+0000 7f963ed9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbceded0 0x55a3dbcee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.582+0000 7f963ed9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbceded0 0x55a3dbcee2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49004/0 (socket says 172.21.15.12:49004) 2023-12-11T20:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f963ed9c700 1 -- 172.21.15.12:0/3722215186 learned_addr learned my addr 172.21.15.12:0/3722215186 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f963e59b700 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbcee830 0x55a3dbcef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f963dd9a700 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcefba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f963e59b700 1 -- 172.21.15.12:0/3722215186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 msgr2=0x55a3dbcefba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f963e59b700 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcefba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f963e59b700 1 -- 172.21.15.12:0/3722215186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbceded0 msgr2=0x55a3dbcee2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f963e59b700 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbceded0 0x55a3dbcee2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f963e59b700 1 -- 172.21.15.12:0/3722215186 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3dbabf5d0 con 0x55a3dbcee830 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.583+0000 7f962f7fe700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96240a1470 0x7f96240a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.584+0000 7f963e59b700 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbcee830 0x55a3dbcef140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9634003f60 tx=0x7f9634005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff55c0d4b08ed6e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.584+0000 7f962f7fe700 1 -- 172.21.15.12:0/3271709143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96280ccaf0 con 0x7f9638104870 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.584+0000 7f963ed9c700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96240a1470 0x7f96240a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.584+0000 7f962cff9700 1 -- 172.21.15.12:0/3722215186 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963401d070 con 0x55a3dbcee830 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.584+0000 7f962cff9700 1 -- 172.21.15.12:0/3722215186 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f963401e040 con 0x55a3dbcee830 2023-12-11T20:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.584+0000 7f962cff9700 1 -- 172.21.15.12:0/3722215186 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400b710 con 0x55a3dbcee830 2023-12-11T20:28:31.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 -- 172.21.15.12:0/3722215186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbcee830 msgr2=0x55a3dbcef140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbcee830 0x55a3dbcef140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9634003f60 tx=0x7f9634005bc0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f963ed9c700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96240a1470 0x7f96240a3930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f96300075c0 tx=0x7f963000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 -- 172.21.15.12:0/3722215186 shutdown_connections 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcefba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbceded0 0x55a3dbcee2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3722215186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbcee830 0x55a3dbcef140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 -- 172.21.15.12:0/3722215186 >> 172.21.15.12:0/3722215186 conn(0x55a3dbc1d780 msgr2=0x55a3dbcea880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 -- 172.21.15.12:0/3722215186 shutdown_connections 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.585+0000 7f96540dcb80 1 -- 172.21.15.12:0/3722215186 wait complete. 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.586+0000 7f96540dcb80 1 -- start start 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.586+0000 7f96540dcb80 1 Processor -- start 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcf7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcf8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcff140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f96540dcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbbfc500 con 0x55a3dbcee830 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f96540dcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbbfc1a0 con 0x55a3dbcef720 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f96540dcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbac18c0 con 0x55a3dbceded0 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f96540dcb80 10 client.0 _ll_register_callbacks cb 0x55a3dbb27a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcf8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcf8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49018/0 (socket says 172.21.15.12:49018) 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963dd9a700 1 -- 172.21.15.12:0/3976995751 learned_addr learned my addr 172.21.15.12:0/3976995751 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963e59b700 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcf7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963ed9c700 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963dd9a700 1 -- 172.21.15.12:0/3976995751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 msgr2=0x55a3dbcf7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963dd9a700 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcf7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963dd9a700 1 -- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 msgr2=0x55a3dbcff140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963dd9a700 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcff140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963dd9a700 1 -- 172.21.15.12:0/3976995751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963810a200 con 0x55a3dbcee830 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.587+0000 7f963ed9c700 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.588+0000 7f963dd9a700 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcf8310 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9628000c00 tx=0x7f96280058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16d31bb0a06ca6c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.588+0000 7f9621ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.588+0000 7f9621ffb700 1 -- 172.21.15.12:0/3976995751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280d4040 con 0x55a3dbcee830 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.588+0000 7f9621ffb700 1 -- 172.21.15.12:0/3976995751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9628019e60 con 0x55a3dbcee830 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.588+0000 7f96540dcb80 1 -- 172.21.15.12:0/3976995751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3dbce1730 con 0x55a3dbcee830 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.588+0000 7f9621ffb700 1 -- 172.21.15.12:0/3976995751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9628099b90 con 0x55a3dbcee830 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.588+0000 7f96540dcb80 10 client.19083 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.588+0000 7f96540dcb80 1 -- 172.21.15.12:0/3976995751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a3dba6bd80 con 0x55a3dbcee830 2023-12-11T20:28:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f9621ffb700 1 -- 172.21.15.12:0/3976995751 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96280b1070 con 0x55a3dbcee830 2023-12-11T20:28:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f9621ffb700 1 -- 172.21.15.12:0/3976995751 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f96280a1cc0 con 0x55a3dbcee830 2023-12-11T20:28:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f96540dcb80 10 client.19083 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f96540dcb80 10 client.19083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f96540dcb80 20 client.19083 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a3dbd03cb0 0x55a3dbd060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f96540dcb80 4 client.19083 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f96540dcb80 1 -- 172.21.15.12:0/3976995751 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3dbcbdee0 con 0x55a3dbd03cb0 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.589+0000 7f963e59b700 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a3dbd03cb0 0x55a3dbd060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.590+0000 7f963e59b700 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a3dbd03cb0 0x55a3dbd060d0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5774eec11dfb2718 server_cookie=69171bd6b3ee838b in_seq=0 out_seq=0 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.590+0000 7f9621ffb700 10 client.19083 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.591+0000 7f9621ffb700 1 -- 172.21.15.12:0/3976995751 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a3dbcbdee0 con 0x55a3dbd03cb0 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.591+0000 7f9621ffb700 10 client.19083 handle_command_reply: tid=0 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.591+0000 7f96540dcb80 1 client.19083 shutdown 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.591+0000 7f96540dcb80 1 -- 172.21.15.12:0/3976995751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 msgr2=0x55a3dbcf8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.591+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcf8310 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9628000c00 tx=0x7f96280058b0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 1 -- 172.21.15.12:0/3976995751 shutdown_connections 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a3dbd03cb0 0x55a3dbd060d0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcf7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3976995751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcf8310 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 1 -- 172.21.15.12:0/3976995751 >> 172.21.15.12:0/3976995751 conn(0x55a3dbc1d780 msgr2=0x55a3dbce8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f9621ffb700 0 client.19083 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 1 -- 172.21.15.12:0/3976995751 shutdown_connections 2023-12-11T20:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 1 -- 172.21.15.12:0/3976995751 wait complete. 2023-12-11T20:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.592+0000 7f96540dcb80 20 client.19083 trim_cache size 0 max 16384 2023-12-11T20:28:31.594 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:28:31.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.612+0000 7f96540dcb80 1 Processor -- start 2023-12-11T20:28:31.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.612+0000 7f96540dcb80 1 -- start start 2023-12-11T20:28:31.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.612+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcefb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.612+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcff100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.612+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcea460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.612+0000 7f96540dcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbd03b20 con 0x55a3dbcee830 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.612+0000 7f96540dcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbcf66e0 con 0x55a3dbcef720 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.612+0000 7f96540dcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbcf6ba0 con 0x55a3dbceded0 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcefb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcefb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:37680/0 (socket says 172.21.15.12:37680) 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 -- 172.21.15.12:0/1531044137 learned_addr learned my addr 172.21.15.12:0/1531044137 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963ed9c700 1 --2- 172.21.15.12:0/1531044137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 -- 172.21.15.12:0/1531044137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 msgr2=0x55a3dbcea460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 --2- 172.21.15.12:0/1531044137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcea460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 -- 172.21.15.12:0/1531044137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 msgr2=0x55a3dbcff100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 --2- 172.21.15.12:0/1531044137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcff100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 -- 172.21.15.12:0/1531044137 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3dba54c00 con 0x55a3dbceded0 2023-12-11T20:28:31.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.613+0000 7f963e59b700 1 --2- 172.21.15.12:0/1531044137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcefb00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9634009990 tx=0x7f963400b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e664d982b47865af server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.614+0000 7f962d7fa700 1 -- 172.21.15.12:0/1531044137 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963401d040 con 0x55a3dbceded0 2023-12-11T20:28:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.614+0000 7f962d7fa700 1 -- 172.21.15.12:0/1531044137 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9634003ce0 con 0x55a3dbceded0 2023-12-11T20:28:31.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.614+0000 7f962d7fa700 1 -- 172.21.15.12:0/1531044137 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340346e0 con 0x55a3dbceded0 2023-12-11T20:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 -- 172.21.15.12:0/1531044137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 msgr2=0x55a3dbcefb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 --2- 172.21.15.12:0/1531044137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcefb00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9634009990 tx=0x7f963400b610 comp rx=0 tx=0).stop 2023-12-11T20:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 -- 172.21.15.12:0/1531044137 shutdown_connections 2023-12-11T20:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 --2- 172.21.15.12:0/1531044137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbcea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 --2- 172.21.15.12:0/1531044137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbcefb00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 --2- 172.21.15.12:0/1531044137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbcff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 -- 172.21.15.12:0/1531044137 >> 172.21.15.12:0/1531044137 conn(0x55a3dbc1d780 msgr2=0x55a3dbcf70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 -- 172.21.15.12:0/1531044137 shutdown_connections 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 -- 172.21.15.12:0/1531044137 wait complete. 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.615+0000 7f96540dcb80 1 -- start start 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f96540dcb80 1 Processor -- start 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbd54170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbd566c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f96540dcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbd58c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f96540dcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbcf5150 con 0x55a3dbcee830 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f96540dcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbcf5290 con 0x55a3dbcef720 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f96540dcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3dbcf5450 con 0x55a3dbceded0 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f96540dcb80 10 client.0 _ll_register_callbacks cb 0x55a3dbb27a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f963dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbd566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.616+0000 7f963ed9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbd58c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963ed9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbd58c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44468/0 (socket says 172.21.15.12:44468) 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963ed9c700 1 -- 172.21.15.12:0/3494572278 learned_addr learned my addr 172.21.15.12:0/3494572278 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963e59b700 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbd54170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963ed9c700 1 -- 172.21.15.12:0/3494572278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 msgr2=0x55a3dbd54170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963ed9c700 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbd54170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963ed9c700 1 -- 172.21.15.12:0/3494572278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 msgr2=0x55a3dbd566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963ed9c700 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbd566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963ed9c700 1 -- 172.21.15.12:0/3494572278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3dbabf5d0 con 0x55a3dbcef720 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f963ed9c700 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbd58c10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9630016e70 tx=0x7f9630004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955c40d961ddfa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.617+0000 7f9621ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.618+0000 7f9621ffb700 1 -- 172.21.15.12:0/3494572278 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963000e040 con 0x55a3dbcef720 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.618+0000 7f9621ffb700 1 -- 172.21.15.12:0/3494572278 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f963001c040 con 0x55a3dbcef720 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.618+0000 7f96540dcb80 1 -- 172.21.15.12:0/3494572278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f963401e040 con 0x55a3dbcef720 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.618+0000 7f9621ffb700 1 -- 172.21.15.12:0/3494572278 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9630024af0 con 0x55a3dbcef720 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.618+0000 7f96540dcb80 10 client.28670 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.618+0000 7f96540dcb80 1 -- 172.21.15.12:0/3494572278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a3dba921f0 con 0x55a3dbcef720 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f9621ffb700 1 -- 172.21.15.12:0/3494572278 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f963401e040 con 0x55a3dbcef720 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f9621ffb700 1 -- 172.21.15.12:0/3494572278 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f963002ec30 con 0x55a3dbcef720 2023-12-11T20:28:31.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f96540dcb80 10 client.28670 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f96540dcb80 10 client.28670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f96540dcb80 20 client.28670 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a3dbd5ab50 0x55a3dbd5cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f96540dcb80 4 client.28670 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:28:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f96540dcb80 1 -- 172.21.15.12:0/3494572278 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a3dbc08f70 con 0x55a3dbd5ab50 2023-12-11T20:28:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.619+0000 7f963e59b700 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a3dbd5ab50 0x55a3dbd5cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.620+0000 7f963e59b700 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a3dbd5ab50 0x55a3dbd5cf70 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46c5a17f96c63c8c server_cookie=72d388c3f02392af in_seq=0 out_seq=0 2023-12-11T20:28:31.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.620+0000 7f9621ffb700 10 client.28670 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.629+0000 7f9621ffb700 1 -- 172.21.15.12:0/3494572278 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a3dbc08f70 con 0x55a3dbd5ab50 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.629+0000 7f9621ffb700 10 client.28670 handle_command_reply: tid=0 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.629+0000 7f96540dcb80 1 client.28670 shutdown 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.629+0000 7f96540dcb80 1 -- 172.21.15.12:0/3494572278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 msgr2=0x55a3dbd58c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.629+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbd58c10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9630016e70 tx=0x7f9630004b40 comp rx=0 tx=0).stop 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 1 -- 172.21.15.12:0/3494572278 shutdown_connections 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a3dbd5ab50 0x55a3dbd5cf70 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3dbcef720 0x55a3dbd58c10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3dbceded0 0x55a3dbd54170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f9621ffb700 0 client.28670 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 1 --2- 172.21.15.12:0/3494572278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3dbcee830 0x55a3dbd566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 1 -- 172.21.15.12:0/3494572278 >> 172.21.15.12:0/3494572278 conn(0x55a3dbc1d780 msgr2=0x55a3dbcea460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 1 -- 172.21.15.12:0/3494572278 shutdown_connections 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 1 -- 172.21.15.12:0/3494572278 wait complete. 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.630+0000 7f96540dcb80 20 client.28670 trim_cache size 0 max 16384 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:28:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:28:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 -- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96240a1470 msgr2=0x7f96240a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96240a1470 0x7f96240a3930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f96300075c0 tx=0x7f963000b040 comp rx=0 tx=0).stop 2023-12-11T20:28:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 -- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9638104870 msgr2=0x7f9638199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9638104870 0x7f9638199aa0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f962800d980 tx=0x7f962800dc90 comp rx=0 tx=0).stop 2023-12-11T20:28:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 -- 172.21.15.12:0/3271709143 shutdown_connections 2023-12-11T20:28:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f96240a1470 0x7f96240a3930 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9638101f40 0x7f9638199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96381071a0 0x7f96381a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 --2- 172.21.15.12:0/3271709143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9638104870 0x7f9638199aa0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 -- 172.21.15.12:0/3271709143 >> 172.21.15.12:0/3271709143 conn(0x7f96380fb930 msgr2=0x7f96380ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 -- 172.21.15.12:0/3271709143 shutdown_connections 2023-12-11T20:28:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:31.631+0000 7f96407ff700 1 -- 172.21.15.12:0/3271709143 wait complete. 2023-12-11T20:28:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.833+0000 7f70221ff700 1 -- 172.21.15.12:0/1878413627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c1003b0 msgr2=0x7f701c1007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.833+0000 7f70221ff700 1 --2- 172.21.15.12:0/1878413627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c1003b0 0x7f701c1007d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f700c0099c0 tx=0x7f700c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.833+0000 7f70221ff700 1 -- 172.21.15.12:0/1878413627 shutdown_connections 2023-12-11T20:28:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.833+0000 7f70221ff700 1 --2- 172.21.15.12:0/1878413627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f701c101f40 0x7f701c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.833+0000 7f70221ff700 1 --2- 172.21.15.12:0/1878413627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c1003b0 0x7f701c1007d0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.833+0000 7f70221ff700 1 --2- 172.21.15.12:0/1878413627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f701c1015a0 0x7f701c101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.834+0000 7f70221ff700 1 -- 172.21.15.12:0/1878413627 >> 172.21.15.12:0/1878413627 conn(0x7f701c0fb920 msgr2=0x7f701c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.834+0000 7f70221ff700 1 -- 172.21.15.12:0/1878413627 shutdown_connections 2023-12-11T20:28:31.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.834+0000 7f70221ff700 1 -- 172.21.15.12:0/1878413627 wait complete. 2023-12-11T20:28:31.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.835+0000 7f70221ff700 1 Processor -- start 2023-12-11T20:28:31.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.835+0000 7f70221ff700 1 -- start start 2023-12-11T20:28:31.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.835+0000 7f70221ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f701c1003b0 0x7f701c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.835+0000 7f70221ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f701c1015a0 0x7f701c199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f70221ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c101f40 0x7f701c1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f70221ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c1a1130 con 0x7f701c101f40 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f70221ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c1a1270 con 0x7f701c1003b0 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f70221ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c1a1400 con 0x7f701c1015a0 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c101f40 0x7f701c1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f701c1003b0 0x7f701c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c101f40 0x7f701c1a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49052/0 (socket says 172.21.15.12:49052) 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f701c1003b0 0x7f701c199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44480/0 (socket says 172.21.15.12:44480) 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701bfff700 1 -- 172.21.15.12:0/1241374409 learned_addr learned my addr 172.21.15.12:0/1241374409 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701affd700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f701c1015a0 0x7f701c199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701bfff700 1 -- 172.21.15.12:0/1241374409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f701c1015a0 msgr2=0x7f701c199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701bfff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f701c1015a0 0x7f701c199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701bfff700 1 -- 172.21.15.12:0/1241374409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f701c1003b0 msgr2=0x7f701c199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701bfff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f701c1003b0 0x7f701c199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.836+0000 7f701bfff700 1 -- 172.21.15.12:0/1241374409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c0095f0 con 0x7f701c101f40 2023-12-11T20:28:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.837+0000 7f701bfff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c101f40 0x7f701c1a0b60 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7014007ee0 tx=0x7f701400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.837+0000 7f7018ff9700 1 -- 172.21.15.12:0/1241374409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701400ddd0 con 0x7f701c101f40 2023-12-11T20:28:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.837+0000 7f7018ff9700 1 -- 172.21.15.12:0/1241374409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f701400f040 con 0x7f701c101f40 2023-12-11T20:28:31.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.837+0000 7f7018ff9700 1 -- 172.21.15.12:0/1241374409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70140047d0 con 0x7f701c101f40 2023-12-11T20:28:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.837+0000 7f70221ff700 1 -- 172.21.15.12:0/1241374409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c1a16e0 con 0x7f701c101f40 2023-12-11T20:28:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.837+0000 7f70221ff700 1 -- 172.21.15.12:0/1241374409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c1a1ba0 con 0x7f701c101f40 2023-12-11T20:28:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.841+0000 7f7018ff9700 1 -- 172.21.15.12:0/1241374409 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7014003a00 con 0x7f701c101f40 2023-12-11T20:28:31.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.842+0000 7f7018ff9700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70040a1480 0x7f70040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.842+0000 7f7035b16b80 1 Processor -- start 2023-12-11T20:28:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.842+0000 7f7018ff9700 1 -- 172.21.15.12:0/1241374409 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f70140cc6e0 con 0x7f701c101f40 2023-12-11T20:28:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f7035b16b80 1 -- start start 2023-12-11T20:28:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f701b7fe700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70040a1480 0x7f70040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75dc3d0 0x5594e75dc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75dd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75ddc20 0x5594e75de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f7035b16b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e7537b50 con 0x5594e75dc3d0 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f7035b16b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e7535470 con 0x5594e75ddc20 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f7035b16b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e7530d60 con 0x5594e75dcd30 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f701b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75dc3d0 0x5594e75dc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f701affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75dd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f701b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75dc3d0 0x5594e75dc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49066/0 (socket says 172.21.15.12:49066) 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f701b7fe700 1 -- 172.21.15.12:0/2967588221 learned_addr learned my addr 172.21.15.12:0/2967588221 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.843+0000 7f701affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75dd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:37716/0 (socket says 172.21.15.12:37716) 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701bfff700 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75ddc20 0x5594e75de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701affd700 1 -- 172.21.15.12:0/2967588221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75ddc20 msgr2=0x5594e75de0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701affd700 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75ddc20 0x5594e75de0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701affd700 1 -- 172.21.15.12:0/2967588221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75dc3d0 msgr2=0x5594e75dc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701affd700 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75dc3d0 0x5594e75dc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701affd700 1 -- 172.21.15.12:0/2967588221 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e73ad630 con 0x5594e75dcd30 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701bfff700 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75ddc20 0x5594e75de0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701b7fe700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70040a1480 0x7f70040a3940 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f700c0099c0 tx=0x7f700c00b9b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.844+0000 7f701affd700 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75dd640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f701000bc70 tx=0x7f701000bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d25ed5c2d6cffba5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.845+0000 7f7001ffb700 1 -- 172.21.15.12:0/2967588221 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000fb10 con 0x5594e75dcd30 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.845+0000 7f7001ffb700 1 -- 172.21.15.12:0/2967588221 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f701000fc70 con 0x5594e75dcd30 2023-12-11T20:28:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.845+0000 7f7001ffb700 1 -- 172.21.15.12:0/2967588221 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010010630 con 0x5594e75dcd30 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.845+0000 7f7035b16b80 1 -- 172.21.15.12:0/2967588221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 msgr2=0x5594e75dd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.845+0000 7f7035b16b80 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75dd640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f701000bc70 tx=0x7f701000bf80 comp rx=0 tx=0).stop 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.846+0000 7f7035b16b80 1 -- 172.21.15.12:0/2967588221 shutdown_connections 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.846+0000 7f7035b16b80 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75ddc20 0x5594e75de0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.846+0000 7f7035b16b80 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75dc3d0 0x5594e75dc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.846+0000 7f7035b16b80 1 --2- 172.21.15.12:0/2967588221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75dd640 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.846+0000 7f7035b16b80 1 -- 172.21.15.12:0/2967588221 >> 172.21.15.12:0/2967588221 conn(0x5594e750b7e0 msgr2=0x5594e75d8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.846+0000 7f7035b16b80 1 -- 172.21.15.12:0/2967588221 shutdown_connections 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.846+0000 7f7035b16b80 1 -- 172.21.15.12:0/2967588221 wait complete. 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.846+0000 7f7035b16b80 1 -- start start 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.847+0000 7f7035b16b80 1 Processor -- start 2023-12-11T20:28:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.847+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dc3d0 0x5594e75e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.847+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.847+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ed730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.847+0000 7f7035b16b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e74ea560 con 0x5594e75ddc20 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.847+0000 7f7035b16b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e74ea200 con 0x5594e75dc3d0 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.847+0000 7f7035b16b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e73af920 con 0x5594e75dcd30 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.847+0000 7f7035b16b80 10 client.0 _ll_register_callbacks cb 0x5594e7415a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dc3d0 0x5594e75e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ed730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49080/0 (socket says 172.21.15.12:49080) 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701bfff700 1 -- 172.21.15.12:0/458550960 learned_addr learned my addr 172.21.15.12:0/458550960 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701affd700 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701b7fe700 1 -- 172.21.15.12:0/458550960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 msgr2=0x5594e75e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701b7fe700 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701b7fe700 1 -- 172.21.15.12:0/458550960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 msgr2=0x5594e75ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701b7fe700 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ed730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701b7fe700 1 -- 172.21.15.12:0/458550960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c1a1ba0 con 0x5594e75dc3d0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701bfff700 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f701b7fe700 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dc3d0 0x5594e75e61b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f700c005b40 tx=0x7f700c009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd131533eb76585 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.848+0000 7f6ffaffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.849+0000 7f6ffaffd700 1 -- 172.21.15.12:0/458550960 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c034070 con 0x5594e75dc3d0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.849+0000 7f6ffaffd700 1 -- 172.21.15.12:0/458550960 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f700c00bd60 con 0x5594e75dc3d0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.849+0000 7f7035b16b80 1 -- 172.21.15.12:0/458550960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594e75cfb40 con 0x5594e75dc3d0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.849+0000 7f6ffaffd700 1 -- 172.21.15.12:0/458550960 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f700c01d040 con 0x5594e75dc3d0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.849+0000 7f7035b16b80 10 client.28682 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.849+0000 7f7035b16b80 1 -- 172.21.15.12:0/458550960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f701000b8a0 con 0x5594e75dc3d0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.849+0000 7f6ffaffd700 1 -- 172.21.15.12:0/458550960 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5594e75cfb40 con 0x5594e75dc3d0 2023-12-11T20:28:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.849+0000 7f6ffaffd700 1 -- 172.21.15.12:0/458550960 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f700c003bc0 con 0x5594e75dc3d0 2023-12-11T20:28:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.850+0000 7f7035b16b80 10 client.28682 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.850+0000 7f7035b16b80 10 client.28682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.850+0000 7f7035b16b80 20 client.28682 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.850+0000 7f7035b16b80 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5594e75f1e80 0x5594e75f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.850+0000 7f7035b16b80 4 client.28682 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.850+0000 7f7035b16b80 1 -- 172.21.15.12:0/458550960 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594e75abf40 con 0x5594e75f1e80 2023-12-11T20:28:31.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.850+0000 7f701affd700 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5594e75f1e80 0x5594e75f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.851+0000 7f701affd700 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5594e75f1e80 0x5594e75f42a0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace35702cf406e66 server_cookie=41dd3a523ecc1bdc in_seq=0 out_seq=0 2023-12-11T20:28:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.851+0000 7f6ffaffd700 10 client.28682 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.851+0000 7f6ffaffd700 1 -- 172.21.15.12:0/458550960 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5594e75abf40 con 0x5594e75f1e80 2023-12-11T20:28:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.851+0000 7f6ffaffd700 10 client.28682 handle_command_reply: tid=0 2023-12-11T20:28:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.851+0000 7f7035b16b80 1 client.28682 shutdown 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 -- 172.21.15.12:0/458550960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dc3d0 msgr2=0x5594e75e61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dc3d0 0x5594e75e61b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f700c005b40 tx=0x7f700c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 -- 172.21.15.12:0/458550960 shutdown_connections 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5594e75f1e80 0x5594e75f42a0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dc3d0 0x5594e75e61b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f6ffaffd700 0 client.28682 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 --2- 172.21.15.12:0/458550960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dcd30 0x5594e75e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 -- 172.21.15.12:0/458550960 >> 172.21.15.12:0/458550960 conn(0x5594e750b7e0 msgr2=0x5594e75d7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 -- 172.21.15.12:0/458550960 shutdown_connections 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 1 -- 172.21.15.12:0/458550960 wait complete. 2023-12-11T20:28:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.852+0000 7f7035b16b80 20 client.28682 trim_cache size 0 max 16384 2023-12-11T20:28:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.871+0000 7f7035b16b80 1 Processor -- start 2023-12-11T20:28:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.871+0000 7f7035b16b80 1 -- start start 2023-12-11T20:28:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.871+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75edde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.871+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.871+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75de000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.871+0000 7f7035b16b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e75e5d20 con 0x5594e75ddc20 2023-12-11T20:28:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f7035b16b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e75e73a0 con 0x5594e75dcd30 2023-12-11T20:28:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f7035b16b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e75f9490 con 0x5594e75dc3d0 2023-12-11T20:28:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75ed6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44504/0 (socket says 172.21.15.12:44504) 2023-12-11T20:28:31.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701affd700 1 -- 172.21.15.12:0/2304666351 learned_addr learned my addr 172.21.15.12:0/2304666351 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75de000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49082/0 (socket says 172.21.15.12:49082) 2023-12-11T20:28:31.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701b7fe700 1 -- 172.21.15.12:0/2304666351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 msgr2=0x5594e75ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701b7fe700 1 --2- 172.21.15.12:0/2304666351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701b7fe700 1 -- 172.21.15.12:0/2304666351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 msgr2=0x5594e75de000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701b7fe700 1 --2- 172.21.15.12:0/2304666351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75de000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701b7fe700 1 -- 172.21.15.12:0/2304666351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e7359de0 con 0x5594e75dc3d0 2023-12-11T20:28:31.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.872+0000 7f701bfff700 1 --2- 172.21.15.12:0/2304666351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75de000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.873+0000 7f701b7fe700 1 --2- 172.21.15.12:0/2304666351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75edde0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f700c003780 tx=0x7f700c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d2753374d19240 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.873+0000 7f70027fc700 1 -- 172.21.15.12:0/2304666351 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c034070 con 0x5594e75dc3d0 2023-12-11T20:28:31.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.873+0000 7f70027fc700 1 -- 172.21.15.12:0/2304666351 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f700c004140 con 0x5594e75dc3d0 2023-12-11T20:28:31.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.873+0000 7f70027fc700 1 -- 172.21.15.12:0/2304666351 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c004890 con 0x5594e75dc3d0 2023-12-11T20:28:31.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 -- 172.21.15.12:0/2304666351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 msgr2=0x5594e75edde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 --2- 172.21.15.12:0/2304666351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75edde0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f700c003780 tx=0x7f700c000bc0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 -- 172.21.15.12:0/2304666351 shutdown_connections 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 --2- 172.21.15.12:0/2304666351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75de000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 --2- 172.21.15.12:0/2304666351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75edde0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 --2- 172.21.15.12:0/2304666351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 -- 172.21.15.12:0/2304666351 >> 172.21.15.12:0/2304666351 conn(0x5594e750b7e0 msgr2=0x5594e75e0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 -- 172.21.15.12:0/2304666351 shutdown_connections 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 -- 172.21.15.12:0/2304666351 wait complete. 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.874+0000 7f7035b16b80 1 -- start start 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.875+0000 7f7035b16b80 1 Processor -- start 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.875+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75eaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.875+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.875+0000 7f7035b16b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.875+0000 7f7035b16b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e75ec950 con 0x5594e75ddc20 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.875+0000 7f7035b16b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e75ecac0 con 0x5594e75dcd30 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.875+0000 7f7035b16b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e75ecc80 con 0x5594e75dc3d0 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.875+0000 7f7035b16b80 10 client.0 _ll_register_callbacks cb 0x5594e7415a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75eaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75eb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44520/0 (socket says 172.21.15.12:44520) 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75eaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:37754/0 (socket says 172.21.15.12:37754) 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 -- 172.21.15.12:0/259699565 learned_addr learned my addr 172.21.15.12:0/259699565 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701bfff700 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 -- 172.21.15.12:0/259699565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 msgr2=0x5594e75eaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75eaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 -- 172.21.15.12:0/259699565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 msgr2=0x5594e75ec410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:31.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ec410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 -- 172.21.15.12:0/259699565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c1a16e0 con 0x5594e75dcd30 2023-12-11T20:28:31.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701b7fe700 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75eaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.876+0000 7f701affd700 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75eb4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f701000bc40 tx=0x7f7010005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e79045b4c3634356 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.877+0000 7f6ffaffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.877+0000 7f6ffaffd700 1 -- 172.21.15.12:0/259699565 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010020070 con 0x5594e75dcd30 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.877+0000 7f7035b16b80 1 -- 172.21.15.12:0/259699565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f701000fc70 con 0x5594e75dcd30 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.877+0000 7f6ffaffd700 1 -- 172.21.15.12:0/259699565 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f701002e030 con 0x5594e75dcd30 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.877+0000 7f6ffaffd700 1 -- 172.21.15.12:0/259699565 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7010004230 con 0x5594e75dcd30 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.877+0000 7f7035b16b80 10 client.28688 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.877+0000 7f7035b16b80 1 -- 172.21.15.12:0/259699565 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f701000b8a0 con 0x5594e75dcd30 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f6ffaffd700 1 -- 172.21.15.12:0/259699565 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f701000fc70 con 0x5594e75dcd30 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f6ffaffd700 1 -- 172.21.15.12:0/259699565 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7010004830 con 0x5594e75dcd30 2023-12-11T20:28:31.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f7035b16b80 10 client.28688 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f7035b16b80 10 client.28688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f7035b16b80 20 client.28688 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f7035b16b80 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5594e7648e50 0x5594e764b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f7035b16b80 4 client.28688 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f7035b16b80 1 -- 172.21.15.12:0/259699565 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5594e74f6fd0 con 0x5594e7648e50 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.878+0000 7f701b7fe700 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5594e7648e50 0x5594e764b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f701b7fe700 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5594e7648e50 0x5594e764b270 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d956ab6cacc9c3ef server_cookie=db875026b32491f2 in_seq=0 out_seq=0 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f6ffaffd700 10 client.28688 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f6ffaffd700 1 -- 172.21.15.12:0/259699565 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5594e74f6fd0 con 0x5594e7648e50 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f6ffaffd700 10 client.28688 handle_command_reply: tid=0 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 client.28688 shutdown 2023-12-11T20:28:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 -- 172.21.15.12:0/259699565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 msgr2=0x5594e75eb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75eb4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f701000bc40 tx=0x7f7010005fd0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 -- 172.21.15.12:0/259699565 shutdown_connections 2023-12-11T20:28:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5594e7648e50 0x5594e764b270 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594e75ddc20 0x5594e75ec410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5594e75dc3d0 0x5594e75eaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 --2- 172.21.15.12:0/259699565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5594e75dcd30 0x5594e75eb4a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f6ffaffd700 0 client.28688 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:31.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 -- 172.21.15.12:0/259699565 >> 172.21.15.12:0/259699565 conn(0x5594e750b7e0 msgr2=0x5594e75d8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 -- 172.21.15.12:0/259699565 shutdown_connections 2023-12-11T20:28:31.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.879+0000 7f7035b16b80 1 -- 172.21.15.12:0/259699565 wait complete. 2023-12-11T20:28:31.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f7035b16b80 20 client.28688 trim_cache size 0 max 16384 2023-12-11T20:28:31.888 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:28:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 -- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70040a1480 msgr2=0x7f70040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70040a1480 0x7f70040a3940 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f700c0099c0 tx=0x7f700c00b9b0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 -- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c101f40 msgr2=0x7f701c1a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c101f40 0x7f701c1a0b60 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7014007ee0 tx=0x7f701400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 -- 172.21.15.12:0/1241374409 shutdown_connections 2023-12-11T20:28:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f70040a1480 0x7f70040a3940 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f701c1003b0 0x7f701c199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f701c101f40 0x7f701c1a0b60 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 --2- 172.21.15.12:0/1241374409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f701c1015a0 0x7f701c199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.880+0000 7f70221ff700 1 -- 172.21.15.12:0/1241374409 >> 172.21.15.12:0/1241374409 conn(0x7f701c0fb920 msgr2=0x7f701c069620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.881+0000 7f70221ff700 1 -- 172.21.15.12:0/1241374409 shutdown_connections 2023-12-11T20:28:31.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:31.881+0000 7f70221ff700 1 -- 172.21.15.12:0/1241374409 wait complete. 2023-12-11T20:28:32.899 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:28:32.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:28:33.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 -- 172.21.15.12:0/4030349406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95901036f0 msgr2=0x7f9590103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 --2- 172.21.15.12:0/4030349406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95901036f0 0x7f9590103b10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f95800099c0 tx=0x7f9580009cd0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 -- 172.21.15.12:0/4030349406 shutdown_connections 2023-12-11T20:28:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 --2- 172.21.15.12:0/4030349406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9590105280 0x7f959010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 --2- 172.21.15.12:0/4030349406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95901036f0 0x7f9590103b10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 --2- 172.21.15.12:0/4030349406 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95901048e0 0x7f9590104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 -- 172.21.15.12:0/4030349406 >> 172.21.15.12:0/4030349406 conn(0x7f95900fec80 msgr2=0x7f95901010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 -- 172.21.15.12:0/4030349406 shutdown_connections 2023-12-11T20:28:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.151+0000 7f95953ff700 1 -- 172.21.15.12:0/4030349406 wait complete. 2023-12-11T20:28:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.152+0000 7f95953ff700 1 Processor -- start 2023-12-11T20:28:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.152+0000 7f95953ff700 1 -- start start 2023-12-11T20:28:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f95953ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95901036f0 0x7f9590199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f95953ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95901048e0 0x7f9590199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f95953ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9590105280 0x7f95901a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f95953ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95901a1080 con 0x7f9590105280 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f95953ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95901a11c0 con 0x7f95901036f0 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f95953ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95901a1350 con 0x7f95901048e0 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95901048e0 0x7f9590199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9590105280 0x7f95901a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95901048e0 0x7f9590199a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:37774/0 (socket says 172.21.15.12:37774) 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958e7fc700 1 -- 172.21.15.12:0/3530020254 learned_addr learned my addr 172.21.15.12:0/3530020254 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958effd700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95901036f0 0x7f9590199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958e7fc700 1 -- 172.21.15.12:0/3530020254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95901036f0 msgr2=0x7f9590199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958e7fc700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95901036f0 0x7f9590199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958e7fc700 1 -- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9590105280 msgr2=0x7f95901a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958e7fc700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9590105280 0x7f95901a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958e7fc700 1 -- 172.21.15.12:0/3530020254 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800095f0 con 0x7f95901048e0 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.153+0000 7f958effd700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95901036f0 0x7f9590199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.154+0000 7f958e7fc700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95901048e0 0x7f9590199a90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f958400e9a0 tx=0x7f958400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.154+0000 7f9577fff700 1 -- 172.21.15.12:0/3530020254 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584009790 con 0x7f95901048e0 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.154+0000 7f95953ff700 1 -- 172.21.15.12:0/3530020254 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95901a1630 con 0x7f95901048e0 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.154+0000 7f9577fff700 1 -- 172.21.15.12:0/3530020254 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f958400cbd0 con 0x7f95901048e0 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.154+0000 7f9577fff700 1 -- 172.21.15.12:0/3530020254 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584018680 con 0x7f95901048e0 2023-12-11T20:28:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.154+0000 7f95953ff700 1 -- 172.21.15.12:0/3530020254 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95901a1b90 con 0x7f95901048e0 2023-12-11T20:28:33.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.158+0000 7f9577fff700 1 -- 172.21.15.12:0/3530020254 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f958400cd40 con 0x7f95901048e0 2023-12-11T20:28:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.160+0000 7f95a8d7bb80 1 Processor -- start 2023-12-11T20:28:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.160+0000 7f9577fff700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95780a1500 0x7f95780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.160+0000 7f95a8d7bb80 1 -- start start 2023-12-11T20:28:33.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f9577fff700 1 -- 172.21.15.12:0/3530020254 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9584014070 con 0x7f95901048e0 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f958f7fe700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95780a1500 0x7f95780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35450 0x55fdd6f35870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35db0 0x55fdd6f366c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f37120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6e90bd0 con 0x55fdd6f36ca0 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6e8e4f0 con 0x55fdd6f35450 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6e89de0 con 0x55fdd6f35db0 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f958f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f37120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f958f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f37120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49102/0 (socket says 172.21.15.12:49102) 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.161+0000 7f958f7fe700 1 -- 172.21.15.12:0/856737928 learned_addr learned my addr 172.21.15.12:0/856737928 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958effd700 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35450 0x55fdd6f35870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958e7fc700 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35db0 0x55fdd6f366c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958f7fe700 1 -- 172.21.15.12:0/856737928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35db0 msgr2=0x55fdd6f366c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958f7fe700 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35db0 0x55fdd6f366c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958f7fe700 1 -- 172.21.15.12:0/856737928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35450 msgr2=0x55fdd6f35870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958f7fe700 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35450 0x55fdd6f35870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958f7fe700 1 -- 172.21.15.12:0/856737928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdd6d066b0 con 0x55fdd6f36ca0 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958e7fc700 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35db0 0x55fdd6f366c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958effd700 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35450 0x55fdd6f35870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958f7fe700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95780a1500 0x7f95780a39c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9588009d40 tx=0x7f9588004320 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.162+0000 7f958f7fe700 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f37120 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f9588004720 tx=0x7f958801c030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b65bbd41aa915b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.163+0000 7f95757fa700 1 -- 172.21.15.12:0/856737928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588004db0 con 0x55fdd6f36ca0 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.163+0000 7f95757fa700 1 -- 172.21.15.12:0/856737928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f958800f040 con 0x55fdd6f36ca0 2023-12-11T20:28:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.163+0000 7f95757fa700 1 -- 172.21.15.12:0/856737928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958801ae10 con 0x55fdd6f36ca0 2023-12-11T20:28:33.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/856737928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 msgr2=0x55fdd6f37120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f37120 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f9588004720 tx=0x7f958801c030 comp rx=0 tx=0).stop 2023-12-11T20:28:33.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/856737928 shutdown_connections 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35450 0x55fdd6f35870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f37120 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/856737928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35db0 0x55fdd6f366c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/856737928 >> 172.21.15.12:0/856737928 conn(0x55fdd6e64860 msgr2=0x55fdd6f31e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/856737928 shutdown_connections 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.164+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/856737928 wait complete. 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.165+0000 7f95a8d7bb80 1 -- start start 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.165+0000 7f95a8d7bb80 1 Processor -- start 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.165+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f3f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.165+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f3f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f46790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6e435e0 con 0x55fdd6f35450 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6e43280 con 0x55fdd6f35db0 2023-12-11T20:28:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6d089a0 con 0x55fdd6f36ca0 2023-12-11T20:28:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f95a8d7bb80 10 client.0 _ll_register_callbacks cb 0x55fdd6d6eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f3f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f3f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49112/0 (socket says 172.21.15.12:49112) 2023-12-11T20:28:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958effd700 1 -- 172.21.15.12:0/1265970065 learned_addr learned my addr 172.21.15.12:0/1265970065 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958e7fc700 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f3f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958f7fe700 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f46790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958effd700 1 -- 172.21.15.12:0/1265970065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 msgr2=0x55fdd6f46790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958effd700 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f46790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958effd700 1 -- 172.21.15.12:0/1265970065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 msgr2=0x55fdd6f3f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958effd700 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f3f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.166+0000 7f958effd700 1 -- 172.21.15.12:0/1265970065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95901a1b90 con 0x55fdd6f35450 2023-12-11T20:28:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.167+0000 7f958effd700 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f3f210 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f95800099c0 tx=0x7f9580005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3639fb4cd85bc62e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.167+0000 7f9572ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.167+0000 7f9572ff5700 1 -- 172.21.15.12:0/1265970065 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958001d040 con 0x55fdd6f35450 2023-12-11T20:28:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.167+0000 7f9572ff5700 1 -- 172.21.15.12:0/1265970065 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f958000bcb0 con 0x55fdd6f35450 2023-12-11T20:28:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.167+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/1265970065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fdd6f28bc0 con 0x55fdd6f35450 2023-12-11T20:28:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.167+0000 7f9572ff5700 1 -- 172.21.15.12:0/1265970065 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9580003960 con 0x55fdd6f35450 2023-12-11T20:28:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.167+0000 7f95a8d7bb80 10 client.19119 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.167+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/1265970065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f9588009e20 con 0x55fdd6f35450 2023-12-11T20:28:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.168+0000 7f9572ff5700 1 -- 172.21.15.12:0/1265970065 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9580032020 con 0x55fdd6f35450 2023-12-11T20:28:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.168+0000 7f9572ff5700 1 -- 172.21.15.12:0/1265970065 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9580023910 con 0x55fdd6f35450 2023-12-11T20:28:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.168+0000 7f95a8d7bb80 10 client.19119 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.168+0000 7f95a8d7bb80 10 client.19119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.168+0000 7f95a8d7bb80 20 client.19119 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.168+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fdd6f4b0b0 0x55fdd6f4d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.168+0000 7f95a8d7bb80 4 client.19119 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.168+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/1265970065 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fdd6f04fc0 con 0x55fdd6f4b0b0 2023-12-11T20:28:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.169+0000 7f958e7fc700 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fdd6f4b0b0 0x55fdd6f4d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.170+0000 7f958e7fc700 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fdd6f4b0b0 0x55fdd6f4d4d0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7483c00b995d2595 server_cookie=f267516ff08da528 in_seq=0 out_seq=0 2023-12-11T20:28:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.170+0000 7f9572ff5700 10 client.19119 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:33.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.171+0000 7f9572ff5700 1 -- 172.21.15.12:0/1265970065 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f958407ea90 con 0x55fdd6f4b0b0 2023-12-11T20:28:33.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.171+0000 7f9572ff5700 10 client.19119 handle_command_reply: tid=0 2023-12-11T20:28:33.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 client.19119 shutdown 2023-12-11T20:28:33.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/1265970065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 msgr2=0x55fdd6f3f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f3f210 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f95800099c0 tx=0x7f9580005360 comp rx=0 tx=0).stop 2023-12-11T20:28:33.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/1265970065 shutdown_connections 2023-12-11T20:28:33.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fdd6f4b0b0 0x55fdd6f4d4d0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f46790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f3f210 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/1265970065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f3f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/1265970065 >> 172.21.15.12:0/1265970065 conn(0x55fdd6e64860 msgr2=0x55fdd6f30ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f9572ff5700 0 client.19119 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:33.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/1265970065 shutdown_connections 2023-12-11T20:28:33.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.172+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/1265970065 wait complete. 2023-12-11T20:28:33.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.173+0000 7f95a8d7bb80 20 client.19119 trim_cache size 0 max 16384 2023-12-11T20:28:33.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f95a8d7bb80 1 Processor -- start 2023-12-11T20:28:33.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f95a8d7bb80 1 -- start start 2023-12-11T20:28:33.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35450 0x55fdd6f39d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f46750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f3a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6f3a8d0 con 0x55fdd6f36ca0 2023-12-11T20:28:33.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6f28950 con 0x55fdd6f35db0 2023-12-11T20:28:33.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6f4adc0 con 0x55fdd6f35450 2023-12-11T20:28:33.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f958f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f3a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f958f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f3a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49122/0 (socket says 172.21.15.12:49122) 2023-12-11T20:28:33.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f958f7fe700 1 -- 172.21.15.12:0/3970443712 learned_addr learned my addr 172.21.15.12:0/3970443712 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f958e7fc700 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f46750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.196+0000 7f958effd700 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35450 0x55fdd6f39d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.197+0000 7f958f7fe700 1 -- 172.21.15.12:0/3970443712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35450 msgr2=0x55fdd6f39d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.197+0000 7f958f7fe700 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35450 0x55fdd6f39d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.197+0000 7f958f7fe700 1 -- 172.21.15.12:0/3970443712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 msgr2=0x55fdd6f46750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.197+0000 7f958f7fe700 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f46750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.197+0000 7f958f7fe700 1 -- 172.21.15.12:0/3970443712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdd6cb2e60 con 0x55fdd6f36ca0 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.197+0000 7f958e7fc700 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f46750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.197+0000 7f958f7fe700 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f3a280 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f9588003c90 tx=0x7f9588007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1755d56dab3435e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f9575ffb700 1 -- 172.21.15.12:0/3970443712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588007bb0 con 0x55fdd6f36ca0 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f9575ffb700 1 -- 172.21.15.12:0/3970443712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9588007d10 con 0x55fdd6f36ca0 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f9575ffb700 1 -- 172.21.15.12:0/3970443712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588024420 con 0x55fdd6f36ca0 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/3970443712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 msgr2=0x55fdd6f3a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f3a280 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f9588003c90 tx=0x7f9588007f10 comp rx=0 tx=0).stop 2023-12-11T20:28:33.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/3970443712 shutdown_connections 2023-12-11T20:28:33.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f36ca0 0x55fdd6f3a280 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f35450 0x55fdd6f39d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/3970443712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f46750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.198+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/3970443712 >> 172.21.15.12:0/3970443712 conn(0x55fdd6e64860 msgr2=0x55fdd6f51e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.199+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/3970443712 shutdown_connections 2023-12-11T20:28:33.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.199+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/3970443712 wait complete. 2023-12-11T20:28:33.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.199+0000 7f95a8d7bb80 1 -- start start 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.199+0000 7f95a8d7bb80 1 Processor -- start 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f43390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f438d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f95a8d7bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 0x55fdd6fa15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6f468f0 con 0x55fdd6f35450 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6f46a60 con 0x55fdd6f35db0 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f95a8d7bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdd6fa1ae0 con 0x55fdd6f36ca0 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f95a8d7bb80 10 client.0 _ll_register_callbacks cb 0x55fdd6d6eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f958effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f43390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f958effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f43390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49132/0 (socket says 172.21.15.12:49132) 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f958effd700 1 -- 172.21.15.12:0/2042998199 learned_addr learned my addr 172.21.15.12:0/2042998199 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f958f7fe700 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 0x55fdd6fa15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.200+0000 7f958e7fc700 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f958effd700 1 -- 172.21.15.12:0/2042998199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 msgr2=0x55fdd6fa15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f958effd700 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 0x55fdd6fa15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f958effd700 1 -- 172.21.15.12:0/2042998199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 msgr2=0x55fdd6f438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f958effd700 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f958effd700 1 -- 172.21.15.12:0/2042998199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95901a1630 con 0x55fdd6f35450 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f958effd700 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f43390 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9580005a60 tx=0x7f95800092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb234b18a7a553f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f9572ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f9572ff5700 1 -- 172.21.15.12:0/2042998199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958001d040 con 0x55fdd6f35450 2023-12-11T20:28:33.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/2042998199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f958800f040 con 0x55fdd6f35450 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.201+0000 7f9572ff5700 1 -- 172.21.15.12:0/2042998199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9580000e40 con 0x55fdd6f35450 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f9572ff5700 1 -- 172.21.15.12:0/2042998199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95800053d0 con 0x55fdd6f35450 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f95a8d7bb80 10 client.19125 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/2042998199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f9588028040 con 0x55fdd6f35450 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f9572ff5700 1 -- 172.21.15.12:0/2042998199 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9580046080 con 0x55fdd6f35450 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f9572ff5700 1 -- 172.21.15.12:0/2042998199 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9580035040 con 0x55fdd6f35450 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f95a8d7bb80 10 client.19125 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f95a8d7bb80 10 client.19125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f95a8d7bb80 20 client.19125 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fdd6fa30a0 0x55fdd6fa54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f95a8d7bb80 4 client.19125 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.202+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/2042998199 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fdd6e50050 con 0x55fdd6fa30a0 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.203+0000 7f958e7fc700 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fdd6fa30a0 0x55fdd6fa54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.203+0000 7f958e7fc700 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fdd6fa30a0 0x55fdd6fa54c0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a51064411a1fee5 server_cookie=e676d2b7ec30cfb9 in_seq=0 out_seq=0 2023-12-11T20:28:33.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.203+0000 7f9572ff5700 10 client.19125 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.204+0000 7f9572ff5700 1 -- 172.21.15.12:0/2042998199 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fdd6e50050 con 0x55fdd6fa30a0 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.204+0000 7f9572ff5700 10 client.19125 handle_command_reply: tid=0 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.204+0000 7f95a8d7bb80 1 client.19125 shutdown 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/2042998199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 msgr2=0x55fdd6f43390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f43390 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9580005a60 tx=0x7f95800092b0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/2042998199 shutdown_connections 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55fdd6fa30a0 0x55fdd6fa54c0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fdd6f36ca0 0x55fdd6fa15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fdd6f35450 0x55fdd6f43390 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 --2- 172.21.15.12:0/2042998199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fdd6f35db0 0x55fdd6f438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/2042998199 >> 172.21.15.12:0/2042998199 conn(0x55fdd6e64860 msgr2=0x55fdd6f319f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f9572ff5700 0 client.19125 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/2042998199 shutdown_connections 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 1 -- 172.21.15.12:0/2042998199 wait complete. 2023-12-11T20:28:33.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.205+0000 7f95a8d7bb80 20 client.19125 trim_cache size 0 max 16384 2023-12-11T20:28:33.209 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:28:33.209 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:28:33.209 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "f13c1e3f-de6e-463b-9706-98abf3f82476", 2023-12-11T20:28:33.209 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:28:33.209 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 -- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95780a1500 msgr2=0x7f95780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95780a1500 0x7f95780a39c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9588009d40 tx=0x7f9588004320 comp rx=0 tx=0).stop 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 -- 172.21.15.12:0/3530020254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95901048e0 msgr2=0x7f9590199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95901048e0 0x7f9590199a90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f958400e9a0 tx=0x7f958400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 -- 172.21.15.12:0/3530020254 shutdown_connections 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f95780a1500 0x7f95780a39c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95901036f0 0x7f9590199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9590105280 0x7f95901a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 --2- 172.21.15.12:0/3530020254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95901048e0 0x7f9590199a90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 -- 172.21.15.12:0/3530020254 >> 172.21.15.12:0/3530020254 conn(0x7f95900fec80 msgr2=0x7f9590107d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 -- 172.21.15.12:0/3530020254 shutdown_connections 2023-12-11T20:28:33.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.206+0000 7f95953ff700 1 -- 172.21.15.12:0/3530020254 wait complete. 2023-12-11T20:28:33.223 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:33 smithi012 ceph-mon[128787]: pgmap v753: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:28:33.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:28:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 -- 172.21.15.12:0/1891295228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 msgr2=0x7f8e5c0739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1891295228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 0x7f8e5c0739e0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009990 tx=0x7f8e58009ca0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 -- 172.21.15.12:0/1891295228 shutdown_connections 2023-12-11T20:28:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1891295228 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e5c1093a0 0x7f8e5c10b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1891295228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 0x7f8e5c0739e0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1891295228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5c073fb0 0x7f8e5c074430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 -- 172.21.15.12:0/1891295228 >> 172.21.15.12:0/1891295228 conn(0x7f8e5c0fca20 msgr2=0x7f8e5c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 -- 172.21.15.12:0/1891295228 shutdown_connections 2023-12-11T20:28:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.447+0000 7f8e647ff700 1 -- 172.21.15.12:0/1891295228 wait complete. 2023-12-11T20:28:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.449+0000 7f8e647ff700 1 Processor -- start 2023-12-11T20:28:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.449+0000 7f8e647ff700 1 -- start start 2023-12-11T20:28:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.449+0000 7f8e647ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e5c073fb0 0x7f8e5c199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.449+0000 7f8e647ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 0x7f8e5c199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.449+0000 7f8e647ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5c1093a0 0x7f8e5c1a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.449+0000 7f8e647ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1a1000 con 0x7f8e5c075590 2023-12-11T20:28:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.449+0000 7f8e647ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1a1140 con 0x7f8e5c073fb0 2023-12-11T20:28:33.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.449+0000 7f8e647ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1a12d0 con 0x7f8e5c1093a0 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 0x7f8e5c199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 0x7f8e5c199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49152/0 (socket says 172.21.15.12:49152) 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 -- 172.21.15.12:0/1685321535 learned_addr learned my addr 172.21.15.12:0/1685321535 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5c1093a0 0x7f8e5c1a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e6259b700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e5c073fb0 0x7f8e5c199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 -- 172.21.15.12:0/1685321535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5c1093a0 msgr2=0x7f8e5c1a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5c1093a0 0x7f8e5c1a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 -- 172.21.15.12:0/1685321535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e5c073fb0 msgr2=0x7f8e5c199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e5c073fb0 0x7f8e5c199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 -- 172.21.15.12:0/1685321535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e580095f0 con 0x7f8e5c075590 2023-12-11T20:28:33.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.450+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 0x7f8e5c199a60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00d950 tx=0x7f8e4c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.451+0000 7f8e537fe700 1 -- 172.21.15.12:0/1685321535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c009940 con 0x7f8e5c075590 2023-12-11T20:28:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.451+0000 7f8e537fe700 1 -- 172.21.15.12:0/1685321535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e4c010460 con 0x7f8e5c075590 2023-12-11T20:28:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.451+0000 7f8e647ff700 1 -- 172.21.15.12:0/1685321535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c1a15b0 con 0x7f8e5c075590 2023-12-11T20:28:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.451+0000 7f8e537fe700 1 -- 172.21.15.12:0/1685321535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00f620 con 0x7f8e5c075590 2023-12-11T20:28:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.451+0000 7f8e647ff700 1 -- 172.21.15.12:0/1685321535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c1a1ac0 con 0x7f8e5c075590 2023-12-11T20:28:33.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.454+0000 7f8e537fe700 1 -- 172.21.15.12:0/1685321535 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8e4c0105d0 con 0x7f8e5c075590 2023-12-11T20:28:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.456+0000 7f8e537fe700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8e480a1480 0x7f8e480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.456+0000 7f8e537fe700 1 -- 172.21.15.12:0/1685321535 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8e4c0ccc10 con 0x7f8e5c075590 2023-12-11T20:28:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.456+0000 7f8e6259b700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8e480a1480 0x7f8e480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e7818db80 1 Processor -- start 2023-12-11T20:28:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e6259b700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8e480a1480 0x7f8e480a3940 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8e58003780 tx=0x7f8e58005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e7818db80 1 -- start start 2023-12-11T20:28:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 0x55aa996ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e7818db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa99628b50 con 0x55aa996cd3d0 2023-12-11T20:28:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e7818db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa99626470 con 0x55aa996cec20 2023-12-11T20:28:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.457+0000 7f8e7818db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa99621d60 con 0x55aa996cdd30 2023-12-11T20:28:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e6259b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e6259b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49160/0 (socket says 172.21.15.12:49160) 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e6259b700 1 -- 172.21.15.12:0/1501784424 learned_addr learned my addr 172.21.15.12:0/1501784424 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 0x55aa996ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e62d9c700 1 -- 172.21.15.12:0/1501784424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 msgr2=0x55aa996ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 0x55aa996ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e62d9c700 1 -- 172.21.15.12:0/1501784424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 msgr2=0x55aa996cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e62d9c700 1 -- 172.21.15.12:0/1501784424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa9949e630 con 0x55aa996cec20 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.458+0000 7f8e6259b700 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.459+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996cf0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8e54003e90 tx=0x7f8e54009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f046b523a329ed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.459+0000 7f8e50ff9700 1 -- 172.21.15.12:0/1501784424 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54019070 con 0x55aa996cec20 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.459+0000 7f8e50ff9700 1 -- 172.21.15.12:0/1501784424 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5400f040 con 0x55aa996cec20 2023-12-11T20:28:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.459+0000 7f8e50ff9700 1 -- 172.21.15.12:0/1501784424 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54007900 con 0x55aa996cec20 2023-12-11T20:28:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 -- 172.21.15.12:0/1501784424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 msgr2=0x55aa996cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996cf0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8e54003e90 tx=0x7f8e54009c20 comp rx=0 tx=0).stop 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 -- 172.21.15.12:0/1501784424 shutdown_connections 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996cf0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1501784424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 0x55aa996ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 -- 172.21.15.12:0/1501784424 >> 172.21.15.12:0/1501784424 conn(0x55aa995fc7e0 msgr2=0x55aa996c9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 -- 172.21.15.12:0/1501784424 shutdown_connections 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.460+0000 7f8e7818db80 1 -- 172.21.15.12:0/1501784424 wait complete. 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.461+0000 7f8e7818db80 1 -- start start 2023-12-11T20:28:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.461+0000 7f8e7818db80 1 Processor -- start 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996d7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 0x55aa996d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e7818db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa995db560 con 0x55aa996cd3d0 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e7818db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa995db200 con 0x55aa996cec20 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e7818db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa994a0920 con 0x55aa996cdd30 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e7818db80 10 client.0 _ll_register_callbacks cb 0x55aa99506a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e6259b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996d7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e62d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e6259b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996d7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49162/0 (socket says 172.21.15.12:49162) 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e6259b700 1 -- 172.21.15.12:0/1687870137 learned_addr learned my addr 172.21.15.12:0/1687870137 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e62d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996de6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44620/0 (socket says 172.21.15.12:44620) 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 0x55aa996d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e62d9c700 1 -- 172.21.15.12:0/1687870137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 msgr2=0x55aa996d76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 0x55aa996d76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.462+0000 7f8e62d9c700 1 -- 172.21.15.12:0/1687870137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 msgr2=0x55aa996d7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996d7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e62d9c700 1 -- 172.21.15.12:0/1687870137 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c10c420 con 0x55aa996cec20 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996de6f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009580 tx=0x7f8e540047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d9527886059ad8c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:28:33.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:33 smithi032 ceph-mon[132488]: pgmap v753: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:28:33.464 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:28:33 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-h[168779]: 2023-12-11T20:28:33.213+0000 7f1549a98700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps/ auth{0=1,1=1} v3788 ap=2 f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0) n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15345=pAsLsXs/-@1} | lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x561976698100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003c5:[<0x10000000007/.deps v3638>,<0x10000000006/ffsb v3191>,<0x10000000005/tmp v53>,<0x10000000003/client.0 v54>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v66>,<0x10000000001/sv_0 v87>,<0x10000000000/_nogroup v70>,<0x1/volumes v67>]//[]","memoryvalue":"(2)0x100000003c5:[<0x10000000007/.deps v3788>,<0x10000000006/ffsb v3500>,<0x10000000005/tmp v240>,<0x10000000003/client.0 v232>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-11T20:17:18.438224+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","memory_value.dirstat":"f(v36 m2023-12-11T20:17:18.474051+0000 18=18+0)","memory_value.rstat":"n(v2 rc2023-12-11T20:17:18.474051+0000 b116303 19=18+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-12-11T20:28:33.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e45ffb700 1 -- 172.21.15.12:0/1687870137 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54019040 con 0x55aa996cec20 2023-12-11T20:28:33.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e7818db80 1 -- 172.21.15.12:0/1687870137 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa996c0b40 con 0x55aa996cec20 2023-12-11T20:28:33.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e45ffb700 1 -- 172.21.15.12:0/1687870137 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8e54007b30 con 0x55aa996cec20 2023-12-11T20:28:33.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e45ffb700 1 -- 172.21.15.12:0/1687870137 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e54007cf0 con 0x55aa996cec20 2023-12-11T20:28:33.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e7818db80 10 client.28718 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:33.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.463+0000 7f8e7818db80 1 -- 172.21.15.12:0/1687870137 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f8e54003ac0 con 0x55aa996cec20 2023-12-11T20:28:33.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e45ffb700 1 -- 172.21.15.12:0/1687870137 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5402e020 con 0x55aa996cec20 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e45ffb700 1 -- 172.21.15.12:0/1687870137 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8e5401f450 con 0x55aa996cec20 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e7818db80 10 client.28718 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e7818db80 10 client.28718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e7818db80 20 client.28718 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa996e2f40 0x55aa996e5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e7818db80 4 client.28718 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e7818db80 1 -- 172.21.15.12:0/1687870137 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa9969cf40 con 0x55aa996e2f40 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.464+0000 7f8e6259b700 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa996e2f40 0x55aa996e5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.465+0000 7f8e6259b700 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa996e2f40 0x55aa996e5360 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b859eb78cd7fc644 server_cookie=13ea47c824746de4 in_seq=0 out_seq=0 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.465+0000 7f8e45ffb700 10 client.28718 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e45ffb700 1 -- 172.21.15.12:0/1687870137 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aa9969cf40 con 0x55aa996e2f40 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e45ffb700 10 client.28718 handle_command_reply: tid=0 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 client.28718 shutdown 2023-12-11T20:28:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 -- 172.21.15.12:0/1687870137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 msgr2=0x55aa996de6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996de6f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009580 tx=0x7f8e540047e0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 -- 172.21.15.12:0/1687870137 shutdown_connections 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa996e2f40 0x55aa996e5360 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cec20 0x55aa996de6f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996d7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1687870137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cdd30 0x55aa996d76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e45ffb700 0 client.28718 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 -- 172.21.15.12:0/1687870137 >> 172.21.15.12:0/1687870137 conn(0x55aa995fc7e0 msgr2=0x55aa996c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 -- 172.21.15.12:0/1687870137 shutdown_connections 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.466+0000 7f8e7818db80 1 -- 172.21.15.12:0/1687870137 wait complete. 2023-12-11T20:28:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.467+0000 7f8e7818db80 20 client.28718 trim_cache size 0 max 16384 2023-12-11T20:28:33.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.489+0000 7f8e7818db80 1 Processor -- start 2023-12-11T20:28:33.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.489+0000 7f8e7818db80 1 -- start start 2023-12-11T20:28:33.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.489+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cd3d0 0x55aa996cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.489+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996de6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.489+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cec20 0x55aa996d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.489+0000 7f8e7818db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa996d6d10 con 0x55aa996cec20 2023-12-11T20:28:33.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.489+0000 7f8e7818db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa996ca220 con 0x55aa996cdd30 2023-12-11T20:28:33.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.489+0000 7f8e7818db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa996d5be0 con 0x55aa996cd3d0 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e61d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996de6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e62d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cec20 0x55aa996d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e62d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cec20 0x55aa996d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49178/0 (socket says 172.21.15.12:49178) 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e61d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996de6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:44626/0 (socket says 172.21.15.12:44626) 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e62d9c700 1 -- 172.21.15.12:0/1447239213 learned_addr learned my addr 172.21.15.12:0/1447239213 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e6259b700 1 --2- 172.21.15.12:0/1447239213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cd3d0 0x55aa996cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e61d9a700 1 -- 172.21.15.12:0/1447239213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cd3d0 msgr2=0x55aa996cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/1447239213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cd3d0 0x55aa996cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e61d9a700 1 -- 172.21.15.12:0/1447239213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cec20 msgr2=0x55aa996d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/1447239213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cec20 0x55aa996d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e61d9a700 1 -- 172.21.15.12:0/1447239213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa9944ade0 con 0x55aa996cdd30 2023-12-11T20:28:33.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.490+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/1447239213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996de6b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c099b80 tx=0x7f8e4c00b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917330dd7d4fd944 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.491+0000 7f8e517fa700 1 -- 172.21.15.12:0/1447239213 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0108d0 con 0x55aa996cdd30 2023-12-11T20:28:33.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.491+0000 7f8e517fa700 1 -- 172.21.15.12:0/1447239213 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e4c09a580 con 0x55aa996cdd30 2023-12-11T20:28:33.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.491+0000 7f8e517fa700 1 -- 172.21.15.12:0/1447239213 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0995d0 con 0x55aa996cdd30 2023-12-11T20:28:33.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 -- 172.21.15.12:0/1447239213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 msgr2=0x55aa996de6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1447239213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996de6b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c099b80 tx=0x7f8e4c00b5d0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 -- 172.21.15.12:0/1447239213 shutdown_connections 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1447239213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cec20 0x55aa996d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1447239213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cd3d0 0x55aa996cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 --2- 172.21.15.12:0/1447239213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996de6b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 -- 172.21.15.12:0/1447239213 >> 172.21.15.12:0/1447239213 conn(0x55aa995fc7e0 msgr2=0x55aa996d5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 -- 172.21.15.12:0/1447239213 shutdown_connections 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 -- 172.21.15.12:0/1447239213 wait complete. 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 -- start start 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.492+0000 7f8e7818db80 1 Processor -- start 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996de2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e7818db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cec20 0x55aa996dce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e7818db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa996dd370 con 0x55aa996cd3d0 2023-12-11T20:28:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e7818db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa996dd4e0 con 0x55aa996cdd30 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e7818db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa996dd6a0 con 0x55aa996cec20 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e7818db80 10 client.0 _ll_register_callbacks cb 0x55aa99506a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e6259b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996de2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e6259b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996de2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49186/0 (socket says 172.21.15.12:49186) 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e6259b700 1 -- 172.21.15.12:0/3273049257 learned_addr learned my addr 172.21.15.12:0/3273049257 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.493+0000 7f8e62d9c700 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cec20 0x55aa996dce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e6259b700 1 -- 172.21.15.12:0/3273049257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cec20 msgr2=0x55aa996dce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e6259b700 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cec20 0x55aa996dce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e6259b700 1 -- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 msgr2=0x55aa996dc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e6259b700 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996dc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e6259b700 1 -- 172.21.15.12:0/3273049257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c1a1ac0 con 0x55aa996cd3d0 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996dc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:28:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e6259b700 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996de2e0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009990 tx=0x7f8e58009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7213f678b0e6a597 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e45ffb700 1 -- 172.21.15.12:0/3273049257 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5802b040 con 0x55aa996cd3d0 2023-12-11T20:28:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e7818db80 1 -- 172.21.15.12:0/3273049257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e5400f040 con 0x55aa996cd3d0 2023-12-11T20:28:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.494+0000 7f8e45ffb700 1 -- 172.21.15.12:0/3273049257 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8e580352e0 con 0x55aa996cd3d0 2023-12-11T20:28:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e45ffb700 1 -- 172.21.15.12:0/3273049257 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e580354a0 con 0x55aa996cd3d0 2023-12-11T20:28:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e7818db80 10 client.19143 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e7818db80 1 -- 172.21.15.12:0/3273049257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55aa99433c60 con 0x55aa996cd3d0 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e45ffb700 1 -- 172.21.15.12:0/3273049257 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5400f040 con 0x55aa996cd3d0 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e45ffb700 1 -- 172.21.15.12:0/3273049257 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8e58004c10 con 0x55aa996cd3d0 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e7818db80 10 client.19143 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e7818db80 10 client.19143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e7818db80 20 client.19143 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e7818db80 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa9973abf0 0x55aa9973d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e7818db80 4 client.19143 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.495+0000 7f8e7818db80 1 -- 172.21.15.12:0/3273049257 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aa995e7fd0 con 0x55aa9973abf0 2023-12-11T20:28:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.496+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa9973abf0 0x55aa9973d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.496+0000 7f8e61d9a700 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa9973abf0 0x55aa9973d010 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e39b67a651021a0 server_cookie=9931589d889e9eb5 in_seq=0 out_seq=0 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.496+0000 7f8e45ffb700 10 client.19143 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e45ffb700 1 -- 172.21.15.12:0/3273049257 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55aa995e7fd0 con 0x55aa9973abf0 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e45ffb700 10 client.19143 handle_command_reply: tid=0 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 client.19143 shutdown 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 -- 172.21.15.12:0/3273049257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 msgr2=0x55aa996de2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996de2e0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009990 tx=0x7f8e58009ca0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 -- 172.21.15.12:0/3273049257 shutdown_connections 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55aa9973abf0 0x55aa9973d010 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aa996cec20 0x55aa996dce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aa996cd3d0 0x55aa996de2e0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 --2- 172.21.15.12:0/3273049257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aa996cdd30 0x55aa996dc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 -- 172.21.15.12:0/3273049257 >> 172.21.15.12:0/3273049257 conn(0x55aa995fc7e0 msgr2=0x55aa996d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e45ffb700 0 client.19143 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 -- 172.21.15.12:0/3273049257 shutdown_connections 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 1 -- 172.21.15.12:0/3273049257 wait complete. 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.497+0000 7f8e7818db80 20 client.19143 trim_cache size 0 max 16384 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "f13c1e3f-de6e-463b-9706-98abf3f82476": { 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "f13c1e3f-de6e-463b-9706-98abf3f82476", 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:28:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:28:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:28:33.500 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:28:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 -- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8e480a1480 msgr2=0x7f8e480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8e480a1480 0x7f8e480a3940 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8e58003780 tx=0x7f8e58005fb0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 -- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 msgr2=0x7f8e5c199a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 0x7f8e5c199a60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00d950 tx=0x7f8e4c00dc60 comp rx=0 tx=0).stop 2023-12-11T20:28:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 -- 172.21.15.12:0/1685321535 shutdown_connections 2023-12-11T20:28:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8e480a1480 0x7f8e480a3940 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e5c073fb0 0x7f8e5c199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e5c1093a0 0x7f8e5c1a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 --2- 172.21.15.12:0/1685321535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e5c075590 0x7f8e5c199a60 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 -- 172.21.15.12:0/1685321535 >> 172.21.15.12:0/1685321535 conn(0x7f8e5c0fca20 msgr2=0x7f8e5c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 -- 172.21.15.12:0/1685321535 shutdown_connections 2023-12-11T20:28:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:28:33.498+0000 7f8e647ff700 1 -- 172.21.15.12:0/1685321535 wait complete. 2023-12-11T20:28:33.515 INFO:tasks.cephfs.filesystem:scrub status for tag:f13c1e3f-de6e-463b-9706-98abf3f82476 - {'path': '/', 'tag': 'f13c1e3f-de6e-463b-9706-98abf3f82476', 'options': 'recursive,force'} 2023-12-11T20:28:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:33 smithi039 ceph-mon[102205]: pgmap v753: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:28:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:28:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:34.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.h log and `damage ls` output for details 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:28:34.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.465 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:34 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.h log and `damage ls` output for details 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:34.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:28:34.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.553 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:34 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:28:34.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:34.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/ffsb/.deps) see mds.h log and `damage ls` output for details 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:34.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:34 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:28:35.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:35 smithi032 ceph-mon[132488]: pgmap v754: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:28:35.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:35 smithi039 ceph-mon[102205]: pgmap v754: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:28:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:35 smithi012 ceph-mon[128787]: pgmap v754: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:28:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:37 smithi032 ceph-mon[132488]: pgmap v755: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 21 op/s 2023-12-11T20:28:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:37 smithi039 ceph-mon[102205]: pgmap v755: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 21 op/s 2023-12-11T20:28:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:37 smithi012 ceph-mon[128787]: pgmap v755: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 21 op/s 2023-12-11T20:28:39.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:39 smithi032 ceph-mon[132488]: pgmap v756: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:28:39.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:39 smithi039 ceph-mon[102205]: pgmap v756: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:28:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:39 smithi012 ceph-mon[128787]: pgmap v756: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 32 op/s 2023-12-11T20:28:41.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:41 smithi032 ceph-mon[132488]: pgmap v757: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:41.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:41 smithi039 ceph-mon[102205]: pgmap v757: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:41 smithi012 ceph-mon[128787]: pgmap v757: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:43.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:43 smithi032 ceph-mon[132488]: pgmap v758: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:28:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:43 smithi039 ceph-mon[102205]: pgmap v758: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:28:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:43 smithi012 ceph-mon[128787]: pgmap v758: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.793+0000 7f3aca9ff700 1 -- 172.21.15.12:0/4061757446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 msgr2=0x7f3ac4109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.793+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/4061757446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 0x7f3ac4109610 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b0a0 tx=0x7f3abc00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.794+0000 7f3aca9ff700 1 -- 172.21.15.12:0/4061757446 shutdown_connections 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.794+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/4061757446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 0x7f3ac4109610 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.794+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/4061757446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac4101fc0 0x7f3ac41043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.794+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/4061757446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ac41048f0 0x7f3ac4106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.794+0000 7f3aca9ff700 1 -- 172.21.15.12:0/4061757446 >> 172.21.15.12:0/4061757446 conn(0x7f3ac40fb930 msgr2=0x7f3ac40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.794+0000 7f3aca9ff700 1 -- 172.21.15.12:0/4061757446 shutdown_connections 2023-12-11T20:28:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.794+0000 7f3aca9ff700 1 -- 172.21.15.12:0/4061757446 wait complete. 2023-12-11T20:28:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.795+0000 7f3aca9ff700 1 Processor -- start 2023-12-11T20:28:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.795+0000 7f3aca9ff700 1 -- start start 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3aca9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac4101fc0 0x7f3ac4197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3aca9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ac41048f0 0x7f3ac41979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3aca9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 0x7f3ac419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3aca9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac419ef40 con 0x7f3ac4107220 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3aca9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac419f080 con 0x7f3ac41048f0 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3aca9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac419f210 con 0x7f3ac4101fc0 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3ac8f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 0x7f3ac419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3ac8f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 0x7f3ac419e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54510/0 (socket says 172.21.15.12:54510) 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3ac3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac4101fc0 0x7f3ac4197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3ac8f9c700 1 -- 172.21.15.12:0/2998078966 learned_addr learned my addr 172.21.15.12:0/2998078966 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.796+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ac41048f0 0x7f3ac41979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac8f9c700 1 -- 172.21.15.12:0/2998078966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac4101fc0 msgr2=0x7f3ac4197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac8f9c700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac4101fc0 0x7f3ac4197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac8f9c700 1 -- 172.21.15.12:0/2998078966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ac41048f0 msgr2=0x7f3ac41979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac8f9c700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ac41048f0 0x7f3ac41979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac8f9c700 1 -- 172.21.15.12:0/2998078966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc009d00 con 0x7f3ac4107220 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac8f9c700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 0x7f3ac419e970 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b780 tx=0x7f3abc00bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac17fa700 1 -- 172.21.15.12:0/2998078966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00e040 con 0x7f3ac4107220 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac17fa700 1 -- 172.21.15.12:0/2998078966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3abc009480 con 0x7f3ac4107220 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3aca9ff700 1 -- 172.21.15.12:0/2998078966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac419f490 con 0x7f3ac4107220 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3ac17fa700 1 -- 172.21.15.12:0/2998078966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0052c0 con 0x7f3ac4107220 2023-12-11T20:28:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.797+0000 7f3aca9ff700 1 -- 172.21.15.12:0/2998078966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac419f8b0 con 0x7f3ac4107220 2023-12-11T20:28:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.801+0000 7f3ac17fa700 1 -- 172.21.15.12:0/2998078966 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3abc005420 con 0x7f3ac4107220 2023-12-11T20:28:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.802+0000 7f3ade2a3b80 1 Processor -- start 2023-12-11T20:28:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.802+0000 7f3ade2a3b80 1 -- start start 2023-12-11T20:28:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 0x55dfab0b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab00baf0 con 0x55dfab0b4c40 2023-12-11T20:28:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab009410 con 0x55dfab0b5b30 2023-12-11T20:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab004d00 con 0x55dfab0b42e0 2023-12-11T20:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ac3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47764/0 (socket says 172.21.15.12:47764) 2023-12-11T20:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ac37fe700 1 -- 172.21.15.12:0/1210139929 learned_addr learned my addr 172.21.15.12:0/1210139929 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 0x55dfab0b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.803+0000 7f3ac17fa700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3aac0a1470 0x7f3aac0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac17fa700 1 -- 172.21.15.12:0/2998078966 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3abc0cded0 con 0x7f3ac4107220 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac8f9c700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3aac0a1470 0x7f3aac0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac3fff700 1 -- 172.21.15.12:0/1210139929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 msgr2=0x55dfab0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac3fff700 1 -- 172.21.15.12:0/1210139929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 msgr2=0x55dfab0b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 0x55dfab0b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac3fff700 1 -- 172.21.15.12:0/1210139929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfaae815d0 con 0x55dfab0b4c40 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0b5550 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009cb0 tx=0x7f3ab4011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a4126f6ede719b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.804+0000 7f3ac8f9c700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3aac0a1470 0x7f3aac0a3930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0a2fa0 tx=0x7f3abc009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.805+0000 7f3aaa7fc700 1 -- 172.21.15.12:0/1210139929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4011d20 con 0x55dfab0b4c40 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.805+0000 7f3aaa7fc700 1 -- 172.21.15.12:0/1210139929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ab4011e80 con 0x55dfab0b4c40 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.805+0000 7f3aaa7fc700 1 -- 172.21.15.12:0/1210139929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4005280 con 0x55dfab0b4c40 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.805+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/1210139929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 msgr2=0x55dfab0b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.805+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0b5550 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009cb0 tx=0x7f3ab4011440 comp rx=0 tx=0).stop 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/1210139929 shutdown_connections 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 0x55dfab0b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/1210139929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0b5550 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/1210139929 >> 172.21.15.12:0/1210139929 conn(0x55dfaafdf780 msgr2=0x55dfab0ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/1210139929 shutdown_connections 2023-12-11T20:28:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/1210139929 wait complete. 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 -- start start 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.806+0000 7f3ade2a3b80 1 Processor -- start 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 0x55dfab0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaafbe500 con 0x55dfab0b4c40 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaafbe1a0 con 0x55dfab0b5b30 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaae838c0 con 0x55dfab0b42e0 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ade2a3b80 10 client.0 _ll_register_callbacks cb 0x55dfaaee9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ac3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ac3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54522/0 (socket says 172.21.15.12:54522) 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ac3fff700 1 -- 172.21.15.12:0/948992337 learned_addr learned my addr 172.21.15.12:0/948992337 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.807+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 0x55dfab0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3ac3fff700 1 -- 172.21.15.12:0/948992337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 msgr2=0x55dfab0be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0be2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3ac3fff700 1 -- 172.21.15.12:0/948992337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 msgr2=0x55dfab0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 0x55dfab0c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3ac3fff700 1 -- 172.21.15.12:0/948992337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab8014680 con 0x55dfab0b4c40 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0be2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0be810 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4005c50 tx=0x7f3ab4011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f5bfc1a82acc13 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3aa37fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3aa37fe700 1 -- 172.21.15.12:0/948992337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4004260 con 0x55dfab0b4c40 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3aa37fe700 1 -- 172.21.15.12:0/948992337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3ab40043c0 con 0x55dfab0b4c40 2023-12-11T20:28:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.808+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/948992337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfab07fee0 con 0x55dfab0b4c40 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3aa37fe700 1 -- 172.21.15.12:0/948992337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ab4004580 con 0x55dfab0b4c40 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3ade2a3b80 10 client.19155 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/948992337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f3ab40098e0 con 0x55dfab0b4c40 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3aa37fe700 1 -- 172.21.15.12:0/948992337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ab4031020 con 0x55dfab0b4c40 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3aa37fe700 1 -- 172.21.15.12:0/948992337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3ab40052c0 con 0x55dfab0b4c40 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3ade2a3b80 10 client.19155 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3ade2a3b80 10 client.19155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3ade2a3b80 20 client.19155 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.809+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dfab0ca0c0 0x55dfab0cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.810+0000 7f3ade2a3b80 4 client.19155 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.810+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/948992337 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dfaafcaf70 con 0x55dfab0ca0c0 2023-12-11T20:28:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.810+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dfab0ca0c0 0x55dfab0cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.811+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dfab0ca0c0 0x55dfab0cc4e0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80101f1044907987 server_cookie=b1382257f3cfb869 in_seq=0 out_seq=0 2023-12-11T20:28:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.811+0000 7f3aa37fe700 10 client.19155 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.811+0000 7f3aa37fe700 1 -- 172.21.15.12:0/948992337 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dfaafcaf70 con 0x55dfab0ca0c0 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.811+0000 7f3aa37fe700 10 client.19155 handle_command_reply: tid=0 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 client.19155 shutdown 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/948992337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 msgr2=0x55dfab0be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0be810 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4005c50 tx=0x7f3ab4011c40 comp rx=0 tx=0).stop 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/948992337 shutdown_connections 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dfab0ca0c0 0x55dfab0cc4e0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b5b30 0x55dfab0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3aa37fe700 0 client.19155 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b42e0 0x55dfab0be2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/948992337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b4c40 0x55dfab0be810 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/948992337 >> 172.21.15.12:0/948992337 conn(0x55dfaafdf780 msgr2=0x55dfab0aaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/948992337 shutdown_connections 2023-12-11T20:28:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/948992337 wait complete. 2023-12-11T20:28:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.812+0000 7f3ade2a3b80 20 client.19155 trim_cache size 0 max 16384 2023-12-11T20:28:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ade2a3b80 1 Processor -- start 2023-12-11T20:28:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ade2a3b80 1 -- start start 2023-12-11T20:28:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b42e0 0x55dfab0b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b4c40 0x55dfab0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b5b30 0x55dfab0be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab0bdc80 con 0x55dfab0b5b30 2023-12-11T20:28:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab0c6a20 con 0x55dfab0b42e0 2023-12-11T20:28:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab0c5c20 con 0x55dfab0b4c40 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b5b30 0x55dfab0be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b5b30 0x55dfab0be2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54538/0 (socket says 172.21.15.12:54538) 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.830+0000 7f3ac37fe700 1 -- 172.21.15.12:0/3777541115 learned_addr learned my addr 172.21.15.12:0/3777541115 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b42e0 0x55dfab0b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b4c40 0x55dfab0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3ac37fe700 1 -- 172.21.15.12:0/3777541115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b4c40 msgr2=0x55dfab0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b4c40 0x55dfab0c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3ac37fe700 1 -- 172.21.15.12:0/3777541115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b42e0 msgr2=0x55dfab0b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b42e0 0x55dfab0b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3ac37fe700 1 -- 172.21.15.12:0/3777541115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfaae2dd80 con 0x55dfab0b5b30 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b5b30 0x55dfab0be2d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8004790 tx=0x7f3ab800c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28055a644efb9eb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3aaaffd700 1 -- 172.21.15.12:0/3777541115 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8004020 con 0x55dfab0b5b30 2023-12-11T20:28:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3aaaffd700 1 -- 172.21.15.12:0/3777541115 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ab801a040 con 0x55dfab0b5b30 2023-12-11T20:28:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.831+0000 7f3aaaffd700 1 -- 172.21.15.12:0/3777541115 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8004a90 con 0x55dfab0b5b30 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/3777541115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b5b30 msgr2=0x55dfab0be2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b5b30 0x55dfab0be2d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8004790 tx=0x7f3ab800c4d0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/3777541115 shutdown_connections 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b42e0 0x55dfab0b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b5b30 0x55dfab0be2d0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/3777541115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b4c40 0x55dfab0c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/3777541115 >> 172.21.15.12:0/3777541115 conn(0x55dfaafdf780 msgr2=0x55dfab0d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/3777541115 shutdown_connections 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.832+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/3777541115 wait complete. 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.833+0000 7f3ade2a3b80 1 -- start start 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.833+0000 7f3ade2a3b80 1 Processor -- start 2023-12-11T20:28:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b42e0 0x55dfab0c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b4c40 0x55dfab0c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ade2a3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b5b30 0x55dfab0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab0c4d60 con 0x55dfab0b42e0 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab0c4ed0 con 0x55dfab0b4c40 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ade2a3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab0c5090 con 0x55dfab0b5b30 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ade2a3b80 10 client.0 _ll_register_callbacks cb 0x55dfaaee9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b42e0 0x55dfab0c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b42e0 0x55dfab0c32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54540/0 (socket says 172.21.15.12:54540) 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac37fe700 1 -- 172.21.15.12:0/2084090438 learned_addr learned my addr 172.21.15.12:0/2084090438 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b4c40 0x55dfab0c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac37fe700 1 -- 172.21.15.12:0/2084090438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b5b30 msgr2=0x55dfab0c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b5b30 0x55dfab0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac37fe700 1 -- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b4c40 msgr2=0x55dfab0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b4c40 0x55dfab0c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac37fe700 1 -- 172.21.15.12:0/2084090438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab8029040 con 0x55dfab0b42e0 2023-12-11T20:28:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.834+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b4c40 0x55dfab0c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:28:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.835+0000 7f3ac37fe700 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b42e0 0x55dfab0c32d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8014620 tx=0x7f3ab80057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b827857f74d985f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.835+0000 7f3aa37fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.835+0000 7f3aa37fe700 1 -- 172.21.15.12:0/2084090438 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab80148d0 con 0x55dfab0b42e0 2023-12-11T20:28:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.835+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/2084090438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfab0a3730 con 0x55dfab0b42e0 2023-12-11T20:28:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.835+0000 7f3aa37fe700 1 -- 172.21.15.12:0/2084090438 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3ab8014a30 con 0x55dfab0b42e0 2023-12-11T20:28:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.835+0000 7f3aa37fe700 1 -- 172.21.15.12:0/2084090438 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ab8004030 con 0x55dfab0b42e0 2023-12-11T20:28:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.835+0000 7f3ade2a3b80 10 client.19161 fetch_fsmap learned FSMap version 28 2023-12-11T20:28:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.835+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/2084090438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55dfaae16c00 con 0x55dfab0b42e0 2023-12-11T20:28:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3aa37fe700 1 -- 172.21.15.12:0/2084090438 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ab803d020 con 0x55dfab0b42e0 2023-12-11T20:28:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3aa37fe700 1 -- 172.21.15.12:0/2084090438 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3ab8012450 con 0x55dfab0b42e0 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3ade2a3b80 10 client.19161 fetch_fsmap finished waiting for FSMap version 28 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3ade2a3b80 10 client.19161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3ade2a3b80 20 client.19161 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dfab121430 0x55dfab123850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3ade2a3b80 4 client.19161 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/2084090438 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dfaafbd430 con 0x55dfab121430 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.836+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dfab121430 0x55dfab123850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.837+0000 7f3ac3fff700 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dfab121430 0x55dfab123850 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c52783f9b5f82d57 server_cookie=8557574ebceebc82 in_seq=0 out_seq=0 2023-12-11T20:28:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.837+0000 7f3aa37fe700 10 client.19161 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.847+0000 7f3aa37fe700 1 -- 172.21.15.12:0/2084090438 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dfaafbd430 con 0x55dfab121430 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.847+0000 7f3aa37fe700 10 client.19161 handle_command_reply: tid=0 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.847+0000 7f3ade2a3b80 1 client.19161 shutdown 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/2084090438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b42e0 msgr2=0x55dfab0c32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b42e0 0x55dfab0c32d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8014620 tx=0x7f3ab80057d0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/2084090438 shutdown_connections 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55dfab121430 0x55dfab123850 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfab0b5b30 0x55dfab0c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfab0b42e0 0x55dfab0c32d0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 --2- 172.21.15.12:0/2084090438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55dfab0b4c40 0x55dfab0c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3aa37fe700 0 client.19161 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/2084090438 >> 172.21.15.12:0/2084090438 conn(0x55dfaafdf780 msgr2=0x55dfab0ac460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/2084090438 shutdown_connections 2023-12-11T20:28:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 1 -- 172.21.15.12:0/2084090438 wait complete. 2023-12-11T20:28:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.848+0000 7f3ade2a3b80 20 client.19161 trim_cache size 0 max 16384 2023-12-11T20:28:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:28:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:28:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:28:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 -- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3aac0a1470 msgr2=0x7f3aac0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3aac0a1470 0x7f3aac0a3930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0a2fa0 tx=0x7f3abc009040 comp rx=0 tx=0).stop 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 -- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 msgr2=0x7f3ac419e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 0x7f3ac419e970 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b780 tx=0x7f3abc00bcc0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 -- 172.21.15.12:0/2998078966 shutdown_connections 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3aac0a1470 0x7f3aac0a3930 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ac4107220 0x7f3ac419e970 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac4101fc0 0x7f3ac4197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 --2- 172.21.15.12:0/2998078966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ac41048f0 0x7f3ac41979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 -- 172.21.15.12:0/2998078966 >> 172.21.15.12:0/2998078966 conn(0x7f3ac40fb930 msgr2=0x7f3ac4102920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 -- 172.21.15.12:0/2998078966 shutdown_connections 2023-12-11T20:28:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:44.849+0000 7f3aca9ff700 1 -- 172.21.15.12:0/2998078966 wait complete. 2023-12-11T20:28:45.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:45 smithi032 ceph-mon[132488]: pgmap v759: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:28:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:45 smithi039 ceph-mon[102205]: pgmap v759: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:28:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:45 smithi012 ceph-mon[128787]: pgmap v759: 97 pgs: 97 active+clean; 9.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:28:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:47 smithi039 ceph-mon[102205]: pgmap v760: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:47 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:28:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:47 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:28:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:47 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:28:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:47 smithi012 ceph-mon[128787]: pgmap v760: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:47 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:28:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:47 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:28:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:47 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:28:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:47 smithi032 ceph-mon[132488]: pgmap v760: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 34 op/s 2023-12-11T20:28:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:47 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:28:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:47 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:28:47.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:47 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:28:49.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:49 smithi039 ceph-mon[102205]: pgmap v761: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 25 op/s 2023-12-11T20:28:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:49 smithi012 ceph-mon[128787]: pgmap v761: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 25 op/s 2023-12-11T20:28:49.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:49 smithi032 ceph-mon[132488]: pgmap v761: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 25 op/s 2023-12-11T20:28:51.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:51 smithi039 ceph-mon[102205]: pgmap v762: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:28:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:51 smithi012 ceph-mon[128787]: pgmap v762: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:28:51.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:51 smithi032 ceph-mon[132488]: pgmap v762: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 16 op/s 2023-12-11T20:28:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:53 smithi039 ceph-mon[102205]: pgmap v763: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:28:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:53 smithi012 ceph-mon[128787]: pgmap v763: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:28:53.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:53 smithi032 ceph-mon[132488]: pgmap v763: 97 pgs: 97 active+clean; 9.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 13 op/s 2023-12-11T20:28:54.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:54 smithi039 ceph-mon[102205]: pgmap v764: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 MiB/s wr, 16 op/s 2023-12-11T20:28:54.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:54 smithi012 ceph-mon[128787]: pgmap v764: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 MiB/s wr, 16 op/s 2023-12-11T20:28:54.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:54 smithi032 ceph-mon[132488]: pgmap v764: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 MiB/s wr, 16 op/s 2023-12-11T20:28:56.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:56 smithi039 ceph-mon[102205]: pgmap v765: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:28:56.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:56 smithi012 ceph-mon[128787]: pgmap v765: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:28:56.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:56 smithi032 ceph-mon[132488]: pgmap v765: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:28:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.021+0000 7fe3d09fe700 1 -- 172.21.15.12:0/1086797419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1013e0 msgr2=0x7fe3cc101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.021+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/1086797419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1013e0 0x7fe3cc101840 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00099c0 tx=0x7fe3c0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.022+0000 7fe3d09fe700 1 -- 172.21.15.12:0/1086797419 shutdown_connections 2023-12-11T20:28:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.022+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/1086797419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3cc1001f0 0x7fe3cc100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.022+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/1086797419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3cc101d80 0x7fe3cc108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.022+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/1086797419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1013e0 0x7fe3cc101840 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.022+0000 7fe3d09fe700 1 -- 172.21.15.12:0/1086797419 >> 172.21.15.12:0/1086797419 conn(0x7fe3cc0fb780 msgr2=0x7fe3cc0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.022+0000 7fe3d09fe700 1 -- 172.21.15.12:0/1086797419 shutdown_connections 2023-12-11T20:28:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.022+0000 7fe3d09fe700 1 -- 172.21.15.12:0/1086797419 wait complete. 2023-12-11T20:28:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.023+0000 7fe3d09fe700 1 Processor -- start 2023-12-11T20:28:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.023+0000 7fe3d09fe700 1 -- start start 2023-12-11T20:28:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.023+0000 7fe3d09fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1001f0 0x7fe3cc199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.023+0000 7fe3d09fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3cc1013e0 0x7fe3cc1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.023+0000 7fe3d09fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3cc101d80 0x7fe3cc1a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.023+0000 7fe3d09fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1a0e60 con 0x7fe3cc1001f0 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.023+0000 7fe3d09fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1a0fa0 con 0x7fe3cc101d80 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.023+0000 7fe3d09fe700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1a1130 con 0x7fe3cc1013e0 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1001f0 0x7fe3cc199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1001f0 0x7fe3cc199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46552/0 (socket says 172.21.15.12:46552) 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2456243764 learned_addr learned my addr 172.21.15.12:0/2456243764 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3cc101d80 0x7fe3cc1a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3cc1013e0 0x7fe3cc1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2456243764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3cc1013e0 msgr2=0x7fe3cc1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3cc1013e0 0x7fe3cc1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2456243764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3cc101d80 msgr2=0x7fe3cc1a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3cc101d80 0x7fe3cc1a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2456243764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c00095f0 con 0x7fe3cc1001f0 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.024+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1001f0 0x7fe3cc199380 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00e970 tx=0x7fe3bc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.025+0000 7fe3b3fff700 1 -- 172.21.15.12:0/2456243764 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc009790 con 0x7fe3cc1001f0 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.025+0000 7fe3b3fff700 1 -- 172.21.15.12:0/2456243764 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3bc00c7e0 con 0x7fe3cc1001f0 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.025+0000 7fe3d09fe700 1 -- 172.21.15.12:0/2456243764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc1a1410 con 0x7fe3cc1001f0 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.025+0000 7fe3b3fff700 1 -- 172.21.15.12:0/2456243764 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc003bd0 con 0x7fe3cc1001f0 2023-12-11T20:28:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.025+0000 7fe3d09fe700 1 -- 172.21.15.12:0/2456243764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc1a1970 con 0x7fe3cc1001f0 2023-12-11T20:28:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.029+0000 7fe3b3fff700 1 -- 172.21.15.12:0/2456243764 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe3bc00c950 con 0x7fe3cc1001f0 2023-12-11T20:28:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.030+0000 7fe3e4b5cb80 1 Processor -- start 2023-12-11T20:28:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.030+0000 7fe3b3fff700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe3b40a14f0 0x7fe3b40a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3e4b5cb80 1 -- start start 2023-12-11T20:28:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3b3fff700 1 -- 172.21.15.12:0/2456243764 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe3bc014070 con 0x7fe3cc1001f0 2023-12-11T20:28:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe3b40a14f0 0x7fe3b40a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672614db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 0x556726152640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x556726154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567260a8af0 con 0x55672614d770 2023-12-11T20:28:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567260a6410 con 0x556726152b80 2023-12-11T20:28:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567260a1d00 con 0x55672614e0d0 2023-12-11T20:28:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672614db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672614db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46556/0 (socket says 172.21.15.12:46556) 2023-12-11T20:28:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3cad9d700 1 -- 172.21.15.12:0/4198148795 learned_addr learned my addr 172.21.15.12:0/4198148795 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.031+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 0x556726152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x556726154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cad9d700 1 -- 172.21.15.12:0/4198148795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 msgr2=0x556726152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 0x556726152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cad9d700 1 -- 172.21.15.12:0/4198148795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 msgr2=0x556726154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x556726154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cad9d700 1 -- 172.21.15.12:0/4198148795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556725f1e5d0 con 0x55672614d770 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x556726154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672614db90 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc096bf0 tx=0x7fe3bc003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3769a48f156c3f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe3b40a14f0 0x7fe3b40a39b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400f540 tx=0x7fe3c4009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3b17fa700 1 -- 172.21.15.12:0/4198148795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b1070 con 0x55672614d770 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3b17fa700 1 -- 172.21.15.12:0/4198148795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3bc09a180 con 0x55672614d770 2023-12-11T20:28:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.032+0000 7fe3b17fa700 1 -- 172.21.15.12:0/4198148795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc098520 con 0x55672614d770 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/4198148795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 msgr2=0x55672614db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672614db90 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc096bf0 tx=0x7fe3bc003680 comp rx=0 tx=0).stop 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/4198148795 shutdown_connections 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x556726154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672614db90 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/4198148795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 0x556726152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/4198148795 >> 172.21.15.12:0/4198148795 conn(0x55672607c780 msgr2=0x556726149b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/4198148795 shutdown_connections 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.033+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/4198148795 wait complete. 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.034+0000 7fe3e4b5cb80 1 -- start start 2023-12-11T20:28:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.034+0000 7fe3e4b5cb80 1 Processor -- start 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x556726156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 0x556726157420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x55672615e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55672605b500 con 0x55672614d770 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55672605b1a0 con 0x556726152b80 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556725f208c0 con 0x55672614e0d0 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3e4b5cb80 10 client.0 _ll_register_callbacks cb 0x556725f86a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x556726156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x556726156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46564/0 (socket says 172.21.15.12:46564) 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2929533384 learned_addr learned my addr 172.21.15.12:0/2929533384 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 0x556726157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x55672615e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2929533384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 msgr2=0x556726157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 0x556726157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 msgr2=0x55672615e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x55672615e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2929533384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc1a1970 con 0x55672614d770 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.035+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x55672615e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x556726156ee0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc096680 tx=0x7fe3bc09a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806e8fb5b381ba3f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2929533384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b1030 con 0x55672614d770 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2929533384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe3bc0b2070 con 0x55672614d770 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2929533384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556726140730 con 0x55672614d770 2023-12-11T20:28:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2929533384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3bc09e2d0 con 0x55672614d770 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3e4b5cb80 10 client.19173 fetch_fsmap learned FSMap version 29 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2929533384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556725ecad80 con 0x55672614d770 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.036+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2929533384 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556726140730 con 0x55672614d770 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.037+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2929533384 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe3bc095f70 con 0x55672614d770 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.037+0000 7fe3e4b5cb80 10 client.19173 fetch_fsmap finished waiting for FSMap version 29 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.037+0000 7fe3e4b5cb80 10 client.19173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.037+0000 7fe3e4b5cb80 20 client.19173 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.037+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556726162a00 0x556726164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.037+0000 7fe3e4b5cb80 4 client.19173 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.037+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2929533384 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55672611cee0 con 0x556726162a00 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.037+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556726162a00 0x556726164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.038+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556726162a00 0x556726164e20 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a02f3b2b78f0cced server_cookie=612f4edf4d0deae in_seq=0 out_seq=0 2023-12-11T20:28:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.038+0000 7fe3aeff5700 10 client.19173 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.038+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2929533384 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55672611cee0 con 0x556726162a00 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.038+0000 7fe3aeff5700 10 client.19173 handle_command_reply: tid=0 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.038+0000 7fe3e4b5cb80 1 client.19173 shutdown 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2929533384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 msgr2=0x556726156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x556726156ee0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc096680 tx=0x7fe3bc09a9f0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2929533384 shutdown_connections 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556726162a00 0x556726164e20 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556726152b80 0x55672615e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x556726156ee0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2929533384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55672614e0d0 0x556726157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3aeff5700 0 client.19173 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2929533384 >> 172.21.15.12:0/2929533384 conn(0x55672607c780 msgr2=0x55672614a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2929533384 shutdown_connections 2023-12-11T20:28:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2929533384 wait complete. 2023-12-11T20:28:58.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.039+0000 7fe3e4b5cb80 20 client.19173 trim_cache size 0 max 16384 2023-12-11T20:28:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.059+0000 7fe3e4b5cb80 1 Processor -- start 2023-12-11T20:28:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.059+0000 7fe3e4b5cb80 1 -- start start 2023-12-11T20:28:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x5567261523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 0x5567261560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556726144620 con 0x55672614d770 2023-12-11T20:28:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55672615f5e0 con 0x55672614e0d0 2023-12-11T20:28:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556726157f80 con 0x556726152b80 2023-12-11T20:28:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x5567261523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x5567261523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46570/0 (socket says 172.21.15.12:46570) 2023-12-11T20:28:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2721631978 learned_addr learned my addr 172.21.15.12:0/2721631978 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 0x5567261560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2721631978 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 msgr2=0x5567261560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 0x5567261560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2721631978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 msgr2=0x55672615e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2721631978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556725eb3c00 con 0x55672614d770 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.060+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.061+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x5567261523b0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc096bf0 tx=0x7fe3bc098730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6d32edaca2f0d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.061+0000 7fe3b1ffb700 1 -- 172.21.15.12:0/2721631978 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b1070 con 0x55672614d770 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.061+0000 7fe3b1ffb700 1 -- 172.21.15.12:0/2721631978 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3bc09e2d0 con 0x55672614d770 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.061+0000 7fe3b1ffb700 1 -- 172.21.15.12:0/2721631978 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0a22e0 con 0x55672614d770 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2721631978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 msgr2=0x5567261523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x5567261523b0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc096bf0 tx=0x7fe3bc098730 comp rx=0 tx=0).stop 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2721631978 shutdown_connections 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 0x5567261560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x5567261523b0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2721631978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2721631978 >> 172.21.15.12:0/2721631978 conn(0x55672607c780 msgr2=0x556726154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2721631978 shutdown_connections 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2721631978 wait complete. 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.062+0000 7fe3e4b5cb80 1 -- start start 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3e4b5cb80 1 Processor -- start 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672615bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3e4b5cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 0x55672615d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55672615d890 con 0x55672614d770 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55672615da00 con 0x55672614e0d0 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3e4b5cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55672615dbc0 con 0x556726152b80 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3e4b5cb80 10 client.0 _ll_register_callbacks cb 0x556725f86a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672615bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3cad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672615bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46586/0 (socket says 172.21.15.12:46586) 2023-12-11T20:28:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2360865468 learned_addr learned my addr 172.21.15.12:0/2360865468 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:28:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3cb59e700 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 0x55672615d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.063+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2360865468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 msgr2=0x55672615d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 0x55672615d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2360865468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 msgr2=0x55672615c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:28:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3cad9d700 1 -- 172.21.15.12:0/2360865468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556725ecad80 con 0x55672614d770 2023-12-11T20:28:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3cad9d700 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672615bef0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00cc00 tx=0x7fe3bc0982c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b7630c3eb5833c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:28:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:28:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2360865468 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b1030 con 0x55672614d770 2023-12-11T20:28:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2360865468 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe3bc0b2070 con 0x55672614d770 2023-12-11T20:28:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.064+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2360865468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3bc09a180 con 0x55672614d770 2023-12-11T20:28:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2360865468 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3bc099670 con 0x55672614d770 2023-12-11T20:28:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3e4b5cb80 10 client.19179 fetch_fsmap learned FSMap version 29 2023-12-11T20:28:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2360865468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556725ef11f0 con 0x55672614d770 2023-12-11T20:28:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2360865468 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3bc09a180 con 0x55672614d770 2023-12-11T20:28:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2360865468 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe3bc0aa080 con 0x55672614d770 2023-12-11T20:28:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3e4b5cb80 10 client.19179 fetch_fsmap finished waiting for FSMap version 29 2023-12-11T20:28:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3e4b5cb80 10 client.19179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:28:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3e4b5cb80 20 client.19179 populate_metadata read hostname 'smithi012' 2023-12-11T20:28:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567261b94d0 0x5567261bb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:28:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3e4b5cb80 4 client.19179 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:28:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.065+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2360865468 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556726067f70 con 0x5567261b94d0 2023-12-11T20:28:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.066+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567261b94d0 0x5567261bb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:28:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.066+0000 7fe3ca59c700 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567261b94d0 0x5567261bb8f0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfbabc61fa636c2f server_cookie=edb64b23ff28ea60 in_seq=0 out_seq=0 2023-12-11T20:28:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.066+0000 7fe3aeff5700 10 client.19179 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.076+0000 7fe3aeff5700 1 -- 172.21.15.12:0/2360865468 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556726067f70 con 0x5567261b94d0 2023-12-11T20:28:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.076+0000 7fe3aeff5700 10 client.19179 handle_command_reply: tid=0 2023-12-11T20:28:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.076+0000 7fe3e4b5cb80 1 client.19179 shutdown 2023-12-11T20:28:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.076+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2360865468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 msgr2=0x55672615bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.076+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672615bef0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00cc00 tx=0x7fe3bc0982c0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2360865468 shutdown_connections 2023-12-11T20:28:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5567261b94d0 0x5567261bb8f0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556726152b80 0x55672615d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55672614d770 0x55672615bef0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 1 --2- 172.21.15.12:0/2360865468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55672614e0d0 0x55672615c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3aeff5700 0 client.19179 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:28:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2360865468 >> 172.21.15.12:0/2360865468 conn(0x55672607c780 msgr2=0x5567261522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:58.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2360865468 shutdown_connections 2023-12-11T20:28:58.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 1 -- 172.21.15.12:0/2360865468 wait complete. 2023-12-11T20:28:58.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.077+0000 7fe3e4b5cb80 20 client.19179 trim_cache size 0 max 16384 2023-12-11T20:28:58.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:28:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:28:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:28:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:28:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 -- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe3b40a14f0 msgr2=0x7fe3b40a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe3b40a14f0 0x7fe3b40a39b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400f540 tx=0x7fe3c4009920 comp rx=0 tx=0).stop 2023-12-11T20:28:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 -- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1001f0 msgr2=0x7fe3cc199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:28:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1001f0 0x7fe3cc199380 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00e970 tx=0x7fe3bc00ec80 comp rx=0 tx=0).stop 2023-12-11T20:28:58.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 -- 172.21.15.12:0/2456243764 shutdown_connections 2023-12-11T20:28:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe3b40a14f0 0x7fe3b40a39b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3cc101d80 0x7fe3cc1a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc1001f0 0x7fe3cc199380 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 --2- 172.21.15.12:0/2456243764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3cc1013e0 0x7fe3cc1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:28:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 -- 172.21.15.12:0/2456243764 >> 172.21.15.12:0/2456243764 conn(0x7fe3cc0fb780 msgr2=0x7fe3cc068a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:28:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 -- 172.21.15.12:0/2456243764 shutdown_connections 2023-12-11T20:28:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:28:58.078+0000 7fe3d09fe700 1 -- 172.21.15.12:0/2456243764 wait complete. 2023-12-11T20:28:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:58 smithi039 ceph-mon[102205]: pgmap v766: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:28:58.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:28:58 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:28:58.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:58 smithi012 ceph-mon[128787]: pgmap v766: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:28:58.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:28:58 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:28:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:58 smithi032 ceph-mon[132488]: pgmap v766: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:28:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:28:58 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:00.803 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:00 smithi039 ceph-mon[102205]: pgmap v767: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 17 op/s 2023-12-11T20:29:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:00 smithi012 ceph-mon[128787]: pgmap v767: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 17 op/s 2023-12-11T20:29:00.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:00 smithi032 ceph-mon[132488]: pgmap v767: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 17 op/s 2023-12-11T20:29:02.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:02 smithi039 ceph-mon[102205]: pgmap v768: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:29:02.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:02 smithi012 ceph-mon[128787]: pgmap v768: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:29:02.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:02 smithi032 ceph-mon[132488]: pgmap v768: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:29:03.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:29:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 -- 172.21.15.12:0/525875979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 msgr2=0x7f0394101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 --2- 172.21.15.12:0/525875979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 0x7f0394101380 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f038c00b0a0 tx=0x7f038c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 -- 172.21.15.12:0/525875979 shutdown_connections 2023-12-11T20:29:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 --2- 172.21.15.12:0/525875979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03940ffbe0 0x7f0394100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 --2- 172.21.15.12:0/525875979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 0x7f0394101380 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 --2- 172.21.15.12:0/525875979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0394100540 0x7f03941009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 -- 172.21.15.12:0/525875979 >> 172.21.15.12:0/525875979 conn(0x7f03940fb740 msgr2=0x7f03940fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 -- 172.21.15.12:0/525875979 shutdown_connections 2023-12-11T20:29:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.752+0000 7f039359e700 1 -- 172.21.15.12:0/525875979 wait complete. 2023-12-11T20:29:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.754+0000 7f039359e700 1 Processor -- start 2023-12-11T20:29:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.754+0000 7f039359e700 1 -- start start 2023-12-11T20:29:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.754+0000 7f039359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03940ffbe0 0x7f0394199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.754+0000 7f039359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0394100540 0x7f03941998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.754+0000 7f039359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 0x7f03941a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.754+0000 7f039359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03941a0ea0 con 0x7f0394100f00 2023-12-11T20:29:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.754+0000 7f039359e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03941a0fe0 con 0x7f03940ffbe0 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.754+0000 7f039359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03941a1170 con 0x7f0394100540 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 0x7f03941a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 0x7f03941a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33868/0 (socket says 172.21.15.12:33868) 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 -- 172.21.15.12:0/1603044209 learned_addr learned my addr 172.21.15.12:0/1603044209 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0391d9b700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0394100540 0x7f03941998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f039259c700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03940ffbe0 0x7f0394199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 -- 172.21.15.12:0/1603044209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0394100540 msgr2=0x7f03941998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0394100540 0x7f03941998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 -- 172.21.15.12:0/1603044209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03940ffbe0 msgr2=0x7f0394199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03940ffbe0 0x7f0394199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 -- 172.21.15.12:0/1603044209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c009d00 con 0x7f0394100f00 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f039259c700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03940ffbe0 0x7f0394199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.755+0000 7f0392d9d700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 0x7f03941a08d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f038c009840 tx=0x7f038c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.756+0000 7f03837fe700 1 -- 172.21.15.12:0/1603044209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00e040 con 0x7f0394100f00 2023-12-11T20:29:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.756+0000 7f03837fe700 1 -- 172.21.15.12:0/1603044209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f038c004c50 con 0x7f0394100f00 2023-12-11T20:29:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.756+0000 7f039359e700 1 -- 172.21.15.12:0/1603044209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03941a13f0 con 0x7f0394100f00 2023-12-11T20:29:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.756+0000 7f03837fe700 1 -- 172.21.15.12:0/1603044209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0052a0 con 0x7f0394100f00 2023-12-11T20:29:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.756+0000 7f039359e700 1 -- 172.21.15.12:0/1603044209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03941a18c0 con 0x7f0394100f00 2023-12-11T20:29:03.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.759+0000 7f03837fe700 1 -- 172.21.15.12:0/1603044209 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f038c01d470 con 0x7f0394100f00 2023-12-11T20:29:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.761+0000 7f03837fe700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a15a0 0x7f037c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.761+0000 7f03837fe700 1 -- 172.21.15.12:0/1603044209 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f038c0ce2d0 con 0x7f0394100f00 2023-12-11T20:29:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.761+0000 7f03ac70fb80 1 Processor -- start 2023-12-11T20:29:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.761+0000 7f039259c700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a15a0 0x7f037c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f03ac70fb80 1 -- start start 2023-12-11T20:29:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91d4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91d6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c912fb50 con 0x55e3c91d53c0 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c912d470 con 0x55e3c91d5de0 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c9128d60 con 0x55e3c91d4a60 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f039259c700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a15a0 0x7f037c0a3a60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0384005fd0 tx=0x7f0384005f60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f0391d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f0391d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91d58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33884/0 (socket says 172.21.15.12:33884) 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f0391d9b700 1 -- 172.21.15.12:0/3129657706 learned_addr learned my addr 172.21.15.12:0/3129657706 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.762+0000 7f039259c700 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91d4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.763+0000 7f0392d9d700 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.763+0000 7f0391d9b700 1 -- 172.21.15.12:0/3129657706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 msgr2=0x55e3c91d4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.763+0000 7f0391d9b700 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91d4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.763+0000 7f0391d9b700 1 -- 172.21.15.12:0/3129657706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 msgr2=0x55e3c91d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.763+0000 7f0391d9b700 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91d6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.763+0000 7f0391d9b700 1 -- 172.21.15.12:0/3129657706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3c8fa5630 con 0x55e3c91d53c0 2023-12-11T20:29:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.763+0000 7f0391d9b700 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91d58a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0388009d00 tx=0x7f0388011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a161e2b3bd7129d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.763+0000 7f0380ff9700 1 -- 172.21.15.12:0/3129657706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388004230 con 0x55e3c91d53c0 2023-12-11T20:29:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f0380ff9700 1 -- 172.21.15.12:0/3129657706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0388004390 con 0x55e3c91d53c0 2023-12-11T20:29:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f0380ff9700 1 -- 172.21.15.12:0/3129657706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388019680 con 0x55e3c91d53c0 2023-12-11T20:29:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f03ac70fb80 1 -- 172.21.15.12:0/3129657706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 msgr2=0x55e3c91d58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91d58a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0388009d00 tx=0x7f0388011720 comp rx=0 tx=0).stop 2023-12-11T20:29:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f03ac70fb80 1 -- 172.21.15.12:0/3129657706 shutdown_connections 2023-12-11T20:29:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91d6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91d4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/3129657706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91d58a0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.764+0000 7f03ac70fb80 1 -- 172.21.15.12:0/3129657706 >> 172.21.15.12:0/3129657706 conn(0x55e3c91037e0 msgr2=0x55e3c91cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.765+0000 7f03ac70fb80 1 -- 172.21.15.12:0/3129657706 shutdown_connections 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.765+0000 7f03ac70fb80 1 -- 172.21.15.12:0/3129657706 wait complete. 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.765+0000 7f03ac70fb80 1 -- start start 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.765+0000 7f03ac70fb80 1 Processor -- start 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 0x55e3c91de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c90e2560 con 0x55e3c91d5de0 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c90e2200 con 0x55e3c91d53c0 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c8fa7920 con 0x55e3c91d4a60 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f03ac70fb80 10 client.0 _ll_register_callbacks cb 0x55e3c900da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f0392d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f0392d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33896/0 (socket says 172.21.15.12:33896) 2023-12-11T20:29:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f0392d9d700 1 -- 172.21.15.12:0/4274866927 learned_addr learned my addr 172.21.15.12:0/4274866927 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f039259c700 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.766+0000 7f0391d9b700 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 0x55e3c91de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0392d9d700 1 -- 172.21.15.12:0/4274866927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 msgr2=0x55e3c91de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0392d9d700 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0392d9d700 1 -- 172.21.15.12:0/4274866927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 msgr2=0x55e3c91de8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0392d9d700 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 0x55e3c91de8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0392d9d700 1 -- 172.21.15.12:0/4274866927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0388009960 con 0x55e3c91d5de0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0392d9d700 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e5920 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f038c006070 tx=0x7f038c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e12c82e2e05b89 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0379ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0379ffb700 1 -- 172.21.15.12:0/4274866927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0a38d0 con 0x55e3c91d5de0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0379ffb700 1 -- 172.21.15.12:0/4274866927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f038c011df0 con 0x55e3c91d5de0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4274866927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3c91c79e0 con 0x55e3c91d5de0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f0379ffb700 1 -- 172.21.15.12:0/4274866927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f038c099710 con 0x55e3c91d5de0 2023-12-11T20:29:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f03ac70fb80 10 client.19191 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.767+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4274866927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e3c8f51de0 con 0x55e3c91d5de0 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f0379ffb700 1 -- 172.21.15.12:0/4274866927 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f038c07e080 con 0x55e3c91d5de0 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f0379ffb700 1 -- 172.21.15.12:0/4274866927 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f038c09aac0 con 0x55e3c91d5de0 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f03ac70fb80 10 client.19191 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f03ac70fb80 10 client.19191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f03ac70fb80 20 client.19191 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e3c91e9fd0 0x55e3c91ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f03ac70fb80 4 client.19191 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4274866927 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3c91a3f40 con 0x55e3c91e9fd0 2023-12-11T20:29:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.768+0000 7f039259c700 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e3c91e9fd0 0x55e3c91ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.769+0000 7f039259c700 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e3c91e9fd0 0x55e3c91ec3f0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77cf5db3bee5f52c server_cookie=b84dec27a66185ce in_seq=0 out_seq=0 2023-12-11T20:29:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.769+0000 7f0379ffb700 10 client.19191 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f0379ffb700 1 -- 172.21.15.12:0/4274866927 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e3c91a3f40 con 0x55e3c91e9fd0 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f0379ffb700 10 client.19191 handle_command_reply: tid=0 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 client.19191 shutdown 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4274866927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 msgr2=0x55e3c91e5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e5920 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f038c006070 tx=0x7f038c00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4274866927 shutdown_connections 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e3c91e9fd0 0x55e3c91ec3f0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e5920 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f0379ffb700 0 client.19191 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4274866927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 0x55e3c91de8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4274866927 >> 172.21.15.12:0/4274866927 conn(0x55e3c91037e0 msgr2=0x55e3c91d3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4274866927 shutdown_connections 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4274866927 wait complete. 2023-12-11T20:29:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.770+0000 7f03ac70fb80 20 client.19191 trim_cache size 0 max 16384 2023-12-11T20:29:03.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f03ac70fb80 1 Processor -- start 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f03ac70fb80 1 -- start start 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91d61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91dd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c91cb880 con 0x55e3c91d53c0 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c91cfcd0 con 0x55e3c91d5de0 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c91ddf10 con 0x55e3c91d4a60 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f0391d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f0391d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91e58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33902/0 (socket says 172.21.15.12:33902) 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.795+0000 7f0391d9b700 1 -- 172.21.15.12:0/2969211295 learned_addr learned my addr 172.21.15.12:0/2969211295 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f0392d9d700 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f039259c700 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91d61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f0392d9d700 1 -- 172.21.15.12:0/2969211295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 msgr2=0x55e3c91d61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f0392d9d700 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91d61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f0392d9d700 1 -- 172.21.15.12:0/2969211295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 msgr2=0x55e3c91e58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f0392d9d700 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91e58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f0392d9d700 1 -- 172.21.15.12:0/2969211295 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3c8f3ac60 con 0x55e3c91d5de0 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f0391d9b700 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f0392d9d700 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91dd070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f038c097ff0 tx=0x7f038c0cbc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3516682f4fcb25fc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.796+0000 7f03817fa700 1 -- 172.21.15.12:0/2969211295 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c01de60 con 0x55e3c91d5de0 2023-12-11T20:29:03.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03817fa700 1 -- 172.21.15.12:0/2969211295 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e3c91c79e0 con 0x55e3c91d5de0 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03817fa700 1 -- 172.21.15.12:0/2969211295 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c099970 con 0x55e3c91d5de0 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03ac70fb80 1 -- 172.21.15.12:0/2969211295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 msgr2=0x55e3c91dd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91dd070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f038c097ff0 tx=0x7f038c0cbc60 comp rx=0 tx=0).stop 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03ac70fb80 1 -- 172.21.15.12:0/2969211295 shutdown_connections 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d5de0 0x55e3c91dd070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91d61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/2969211295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d53c0 0x55e3c91e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03ac70fb80 1 -- 172.21.15.12:0/2969211295 >> 172.21.15.12:0/2969211295 conn(0x55e3c91037e0 msgr2=0x55e3c91dc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.797+0000 7f03ac70fb80 1 -- 172.21.15.12:0/2969211295 shutdown_connections 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.798+0000 7f03ac70fb80 1 -- 172.21.15.12:0/2969211295 wait complete. 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.798+0000 7f03ac70fb80 1 -- start start 2023-12-11T20:29:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.798+0000 7f03ac70fb80 1 Processor -- start 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91e38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 0x55e3c91e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f03ac70fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c91e52d0 con 0x55e3c91d5de0 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c91e5440 con 0x55e3c91d53c0 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f03ac70fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c91e5600 con 0x55e3c91d4a60 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f03ac70fb80 10 client.0 _ll_register_callbacks cb 0x55e3c900da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f039259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91e38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f0392d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f0391d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 0x55e3c91e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f039259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91e38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54756/0 (socket says 172.21.15.12:54756) 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.799+0000 7f039259c700 1 -- 172.21.15.12:0/4004251581 learned_addr learned my addr 172.21.15.12:0/4004251581 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:03.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f039259c700 1 -- 172.21.15.12:0/4004251581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 msgr2=0x55e3c91e3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f039259c700 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 0x55e3c91e3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f039259c700 1 -- 172.21.15.12:0/4004251581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 msgr2=0x55e3c91e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f039259c700 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f039259c700 1 -- 172.21.15.12:0/4004251581 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3c8fa5630 con 0x55e3c91d4a60 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f039259c700 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91e38e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f038400baa0 tx=0x7f03840047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59d96c6d3b56c2ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f0379ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f0379ffb700 1 -- 172.21.15.12:0/4004251581 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384025040 con 0x55e3c91d4a60 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4004251581 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0388004390 con 0x55e3c91d4a60 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.800+0000 7f0379ffb700 1 -- 172.21.15.12:0/4004251581 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0384004020 con 0x55e3c91d4a60 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f0379ffb700 1 -- 172.21.15.12:0/4004251581 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0384004220 con 0x55e3c91d4a60 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f03ac70fb80 10 client.28780 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4004251581 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e3c8f51de0 con 0x55e3c91d4a60 2023-12-11T20:29:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f0379ffb700 1 -- 172.21.15.12:0/4004251581 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0388004390 con 0x55e3c91d4a60 2023-12-11T20:29:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f0379ffb700 1 -- 172.21.15.12:0/4004251581 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0384011440 con 0x55e3c91d4a60 2023-12-11T20:29:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f03ac70fb80 10 client.28780 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f03ac70fb80 10 client.28780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f03ac70fb80 20 client.28780 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e3c9241740 0x55e3c9243b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f03ac70fb80 4 client.28780 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:29:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.801+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4004251581 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e3c90eefd0 con 0x55e3c9241740 2023-12-11T20:29:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.802+0000 7f0391d9b700 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e3c9241740 0x55e3c9243b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:03.804 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:03 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.802+0000 7f0379ffb700 10 client.28780 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.802+0000 7f0391d9b700 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e3c9241740 0x55e3c9243b60 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcdaff79a80d1cc5 server_cookie=f371aaaf8936f114 in_seq=0 out_seq=0 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f0379ffb700 1 -- 172.21.15.12:0/4004251581 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e3c90eefd0 con 0x55e3c9241740 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f0379ffb700 10 client.28780 handle_command_reply: tid=0 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 client.28780 shutdown 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4004251581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 msgr2=0x55e3c91e38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91e38e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f038400baa0 tx=0x7f03840047c0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4004251581 shutdown_connections 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e3c9241740 0x55e3c9243b60 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3c91d5de0 0x55e3c91e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e3c91d4a60 0x55e3c91e38e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 --2- 172.21.15.12:0/4004251581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e3c91d53c0 0x55e3c91e3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f0379ffb700 0 client.28780 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4004251581 >> 172.21.15.12:0/4004251581 conn(0x55e3c91037e0 msgr2=0x55e3c91cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4004251581 shutdown_connections 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 1 -- 172.21.15.12:0/4004251581 wait complete. 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.803+0000 7f03ac70fb80 20 client.28780 trim_cache size 0 max 16384 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:29:03.806 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:29:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 -- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a15a0 msgr2=0x7f037c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a15a0 0x7f037c0a3a60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0384005fd0 tx=0x7f0384005f60 comp rx=0 tx=0).stop 2023-12-11T20:29:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 -- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 msgr2=0x7f03941a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 0x7f03941a08d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f038c009840 tx=0x7f038c00ba50 comp rx=0 tx=0).stop 2023-12-11T20:29:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 -- 172.21.15.12:0/1603044209 shutdown_connections 2023-12-11T20:29:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a15a0 0x7f037c0a3a60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03940ffbe0 0x7f0394199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0394100f00 0x7f03941a08d0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 --2- 172.21.15.12:0/1603044209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0394100540 0x7f03941998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 -- 172.21.15.12:0/1603044209 >> 172.21.15.12:0/1603044209 conn(0x7f03940fb740 msgr2=0x7f03940fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 -- 172.21.15.12:0/1603044209 shutdown_connections 2023-12-11T20:29:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:03.804+0000 7f039359e700 1 -- 172.21.15.12:0/1603044209 wait complete. 2023-12-11T20:29:03.820 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:03 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:03.823 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:29:03.823 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:29:03.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:03 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 -- 172.21.15.12:0/1871047364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac103030 msgr2=0x7feeac1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 --2- 172.21.15.12:0/1871047364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac103030 0x7feeac1098e0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7feea400b0d0 tx=0x7feea400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 -- 172.21.15.12:0/1871047364 shutdown_connections 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 --2- 172.21.15.12:0/1871047364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac1014a0 0x7feeac1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 --2- 172.21.15.12:0/1871047364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac103030 0x7feeac1098e0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 --2- 172.21.15.12:0/1871047364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeac102690 0x7feeac102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 -- 172.21.15.12:0/1871047364 >> 172.21.15.12:0/1871047364 conn(0x7feeac0fca10 msgr2=0x7feeac0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 -- 172.21.15.12:0/1871047364 shutdown_connections 2023-12-11T20:29:04.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.052+0000 7feeb23ff700 1 -- 172.21.15.12:0/1871047364 wait complete. 2023-12-11T20:29:04.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.053+0000 7feeb23ff700 1 Processor -- start 2023-12-11T20:29:04.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.053+0000 7feeb23ff700 1 -- start start 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeb23ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac1014a0 0x7feeac075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeb23ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeac102690 0x7feeac0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeb23ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac103030 0x7feeac073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeb23ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0746a0 con 0x7feeac1014a0 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeb23ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac074810 con 0x7feeac103030 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeb23ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac1a1480 con 0x7feeac102690 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac1014a0 0x7feeac075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac1014a0 0x7feeac075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33940/0 (socket says 172.21.15.12:33940) 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeabfff700 1 -- 172.21.15.12:0/2405325416 learned_addr learned my addr 172.21.15.12:0/2405325416 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeb099c700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac103030 0x7feeac073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.054+0000 7feeab7fe700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeac102690 0x7feeac0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeabfff700 1 -- 172.21.15.12:0/2405325416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeac102690 msgr2=0x7feeac0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeabfff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeac102690 0x7feeac0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeabfff700 1 -- 172.21.15.12:0/2405325416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac103030 msgr2=0x7feeac073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeabfff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac103030 0x7feeac073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeabfff700 1 -- 172.21.15.12:0/2405325416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4009d00 con 0x7feeac1014a0 2023-12-11T20:29:04.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeb099c700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac103030 0x7feeac073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:04.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeab7fe700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeac102690 0x7feeac0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:04.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeabfff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac1014a0 0x7feeac075330 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00d980 tx=0x7fee9c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feea97fa700 1 -- 172.21.15.12:0/2405325416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00bb00 con 0x7feeac1014a0 2023-12-11T20:29:04.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feea97fa700 1 -- 172.21.15.12:0/2405325416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee9c007620 con 0x7feeac1014a0 2023-12-11T20:29:04.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feea97fa700 1 -- 172.21.15.12:0/2405325416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00f3c0 con 0x7feeac1014a0 2023-12-11T20:29:04.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac1a1710 con 0x7feeac1014a0 2023-12-11T20:29:04.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.055+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac1a1bd0 con 0x7feeac1014a0 2023-12-11T20:29:04.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.057+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac1088d0 con 0x7feeac1014a0 2023-12-11T20:29:04.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.059+0000 7feea97fa700 1 -- 172.21.15.12:0/2405325416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fee9c010460 con 0x7feeac1014a0 2023-12-11T20:29:04.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.061+0000 7feea97fa700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fee940a1480 0x7fee940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.061+0000 7feea97fa700 1 -- 172.21.15.12:0/2405325416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fee9c0ccd10 con 0x7feeac1014a0 2023-12-11T20:29:04.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.061+0000 7feeab7fe700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fee940a1480 0x7fee940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.062+0000 7feeab7fe700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fee940a1480 0x7fee940a3940 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7feea0009b50 tx=0x7feea0009550 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.066+0000 7feea97fa700 1 -- 172.21.15.12:0/2405325416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fee9c096320 con 0x7feeac1014a0 2023-12-11T20:29:04.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.345+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeac068330 con 0x7feeac1014a0 2023-12-11T20:29:04.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.345+0000 7feea97fa700 1 -- 172.21.15.12:0/2405325416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11309 (secure 0 0 0) 0x7fee9c099940 con 0x7feeac1014a0 2023-12-11T20:29:04.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:29:04.345 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:29:01.557241+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:29:04.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fee940a1480 msgr2=0x7fee940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fee940a1480 0x7fee940a3940 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7feea0009b50 tx=0x7feea0009550 comp rx=0 tx=0).stop 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac1014a0 msgr2=0x7feeac075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac1014a0 0x7feeac075330 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00d980 tx=0x7fee9c00dd40 comp rx=0 tx=0).stop 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 shutdown_connections 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fee940a1480 0x7fee940a3940 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac103030 0x7feeac073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feeac1014a0 0x7feeac075330 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 --2- 172.21.15.12:0/2405325416 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeac102690 0x7feeac0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.348+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 >> 172.21.15.12:0/2405325416 conn(0x7feeac0fca10 msgr2=0x7feeac105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.349+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 shutdown_connections 2023-12-11T20:29:04.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.349+0000 7feeb23ff700 1 -- 172.21.15.12:0/2405325416 wait complete. 2023-12-11T20:29:04.349 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 30 2023-12-11T20:29:04.367 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:29:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 -- 172.21.15.12:0/403618215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c102ea0 msgr2=0x7fa23c109750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 --2- 172.21.15.12:0/403618215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c102ea0 0x7fa23c109750 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa23400b0d0 tx=0x7fa23400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 -- 172.21.15.12:0/403618215 shutdown_connections 2023-12-11T20:29:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 --2- 172.21.15.12:0/403618215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa23c101310 0x7fa23c101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 --2- 172.21.15.12:0/403618215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c102ea0 0x7fa23c109750 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 --2- 172.21.15.12:0/403618215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa23c102500 0x7fa23c102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 -- 172.21.15.12:0/403618215 >> 172.21.15.12:0/403618215 conn(0x7fa23c0fc860 msgr2=0x7fa23c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 -- 172.21.15.12:0/403618215 shutdown_connections 2023-12-11T20:29:04.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.608+0000 7fa24279d700 1 -- 172.21.15.12:0/403618215 wait complete. 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.609+0000 7fa24279d700 1 Processor -- start 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24279d700 1 -- start start 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24279d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c101310 0x7fa23c075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24279d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa23c102500 0x7fa23c0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24279d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa23c102ea0 0x7fa23c073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24279d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0746a0 con 0x7fa23c101310 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24279d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c074810 con 0x7fa23c102ea0 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24279d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c1a11e0 con 0x7fa23c102500 2023-12-11T20:29:04.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c101310 0x7fa23c075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c101310 0x7fa23c075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33952/0 (socket says 172.21.15.12:33952) 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa24179b700 1 -- 172.21.15.12:0/2361420131 learned_addr learned my addr 172.21.15.12:0/2361420131 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.610+0000 7fa241f9c700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa23c102ea0 0x7fa23c073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa240f9a700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa23c102500 0x7fa23c0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa24179b700 1 -- 172.21.15.12:0/2361420131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa23c102500 msgr2=0x7fa23c0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa24179b700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa23c102500 0x7fa23c0739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa24179b700 1 -- 172.21.15.12:0/2361420131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa23c102ea0 msgr2=0x7fa23c073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa24179b700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa23c102ea0 0x7fa23c073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa24179b700 1 -- 172.21.15.12:0/2361420131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234009d00 con 0x7fa23c101310 2023-12-11T20:29:04.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa24179b700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c101310 0x7fa23c075330 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e970 tx=0x7fa23800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa2327fc700 1 -- 172.21.15.12:0/2361420131 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238009790 con 0x7fa23c101310 2023-12-11T20:29:04.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.611+0000 7fa2327fc700 1 -- 172.21.15.12:0/2361420131 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa23800c780 con 0x7fa23c101310 2023-12-11T20:29:04.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.612+0000 7fa24279d700 1 -- 172.21.15.12:0/2361420131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c1a1470 con 0x7fa23c101310 2023-12-11T20:29:04.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.612+0000 7fa2327fc700 1 -- 172.21.15.12:0/2361420131 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238003b40 con 0x7fa23c101310 2023-12-11T20:29:04.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.612+0000 7fa24279d700 1 -- 172.21.15.12:0/2361420131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c1a19d0 con 0x7fa23c101310 2023-12-11T20:29:04.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.616+0000 7fa2327fc700 1 -- 172.21.15.12:0/2361420131 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa23800cbf0 con 0x7fa23c101310 2023-12-11T20:29:04.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa257289b80 1 Processor -- start 2023-12-11T20:29:04.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa257289b80 1 -- start start 2023-12-11T20:29:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa257289b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 0x560214638e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa257289b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146398a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa257289b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 0x56021463a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa257289b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560214593b50 con 0x5602146393c0 2023-12-11T20:29:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa257289b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560214591470 con 0x560214639de0 2023-12-11T20:29:04.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa257289b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56021458cd60 con 0x560214638a60 2023-12-11T20:29:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.618+0000 7fa2327fc700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2280a15a0 0x7fa2280a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa24179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa24179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146398a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33964/0 (socket says 172.21.15.12:33964) 2023-12-11T20:29:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa24179b700 1 -- 172.21.15.12:0/3789427760 learned_addr learned my addr 172.21.15.12:0/3789427760 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa241f9c700 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 0x560214638e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa2327fc700 1 -- 172.21.15.12:0/2361420131 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa238014070 con 0x7fa23c101310 2023-12-11T20:29:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa240f9a700 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 0x56021463a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa241f9c700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2280a15a0 0x7fa2280a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa24179b700 1 -- 172.21.15.12:0/3789427760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 msgr2=0x560214638e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa24179b700 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 0x560214638e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa24179b700 1 -- 172.21.15.12:0/3789427760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 msgr2=0x56021463a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa24179b700 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 0x56021463a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.619+0000 7fa24179b700 1 -- 172.21.15.12:0/3789427760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560214409630 con 0x5602146393c0 2023-12-11T20:29:04.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.620+0000 7fa24179b700 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146398a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa23800efd0 tx=0x7fa238099f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1afcd29d2d19630 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.620+0000 7fa2277fe700 1 -- 172.21.15.12:0/3789427760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23809a7e0 con 0x5602146393c0 2023-12-11T20:29:04.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.620+0000 7fa241f9c700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2280a15a0 0x7fa2280a3a60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa234009cd0 tx=0x7fa2340099e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.620+0000 7fa2277fe700 1 -- 172.21.15.12:0/3789427760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa23800c8f0 con 0x5602146393c0 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.620+0000 7fa2277fe700 1 -- 172.21.15.12:0/3789427760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238003ca0 con 0x5602146393c0 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 -- 172.21.15.12:0/3789427760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 msgr2=0x5602146398a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146398a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa23800efd0 tx=0x7fa238099f30 comp rx=0 tx=0).stop 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 -- 172.21.15.12:0/3789427760 shutdown_connections 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 0x56021463a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 0x560214638e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 --2- 172.21.15.12:0/3789427760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146398a0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 -- 172.21.15.12:0/3789427760 >> 172.21.15.12:0/3789427760 conn(0x5602145677e0 msgr2=0x5602146333d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 -- 172.21.15.12:0/3789427760 shutdown_connections 2023-12-11T20:29:04.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 -- 172.21.15.12:0/3789427760 wait complete. 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.621+0000 7fa257289b80 1 -- start start 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.622+0000 7fa257289b80 1 Processor -- start 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.622+0000 7fa257289b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214642300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.622+0000 7fa257289b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5602146393c0 0x560214642840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.622+0000 7fa257289b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560214639de0 0x560214649880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.622+0000 7fa257289b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560214546560 con 0x560214639de0 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.622+0000 7fa257289b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560214546200 con 0x560214638a60 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.622+0000 7fa257289b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56021440b920 con 0x5602146393c0 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.622+0000 7fa257289b80 10 client.0 _ll_register_callbacks cb 0x560214471a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa241f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560214639de0 0x560214649880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa241f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560214639de0 0x560214649880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33972/0 (socket says 172.21.15.12:33972) 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa241f9c700 1 -- 172.21.15.12:0/2663665252 learned_addr learned my addr 172.21.15.12:0/2663665252 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa240f9a700 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5602146393c0 0x560214642840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa24179b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214642300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa240f9a700 1 -- 172.21.15.12:0/2663665252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 msgr2=0x560214642300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa240f9a700 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214642300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa240f9a700 1 -- 172.21.15.12:0/2663665252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560214639de0 msgr2=0x560214649880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa240f9a700 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560214639de0 0x560214649880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa240f9a700 1 -- 172.21.15.12:0/2663665252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c1a19d0 con 0x5602146393c0 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.623+0000 7fa241f9c700 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560214639de0 0x560214649880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.624+0000 7fa240f9a700 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5602146393c0 0x560214642840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa22c012700 tx=0x7fa22c012a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb0f14eeaa15dbb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.624+0000 7fa224ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.624+0000 7fa224ff9700 1 -- 172.21.15.12:0/2663665252 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c017070 con 0x5602146393c0 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.624+0000 7fa224ff9700 1 -- 172.21.15.12:0/2663665252 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa22c004050 con 0x5602146393c0 2023-12-11T20:29:04.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.624+0000 7fa257289b80 1 -- 172.21.15.12:0/2663665252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56021462b9e0 con 0x5602146393c0 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.624+0000 7fa224ff9700 1 -- 172.21.15.12:0/2663665252 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa22c004210 con 0x5602146393c0 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa257289b80 10 client.28795 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa257289b80 1 -- 172.21.15.12:0/2663665252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5602143b5de0 con 0x5602146393c0 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa224ff9700 1 -- 172.21.15.12:0/2663665252 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56021462b9e0 con 0x5602146393c0 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa224ff9700 1 -- 172.21.15.12:0/2663665252 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa22c010430 con 0x5602146393c0 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa257289b80 10 client.28795 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa257289b80 10 client.28795 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa257289b80 20 client.28795 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:04.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa257289b80 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56021464e0b0 0x5602146504d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa257289b80 4 client.28795 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.625+0000 7fa257289b80 1 -- 172.21.15.12:0/2663665252 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560214607f40 con 0x56021464e0b0 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.626+0000 7fa24179b700 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56021464e0b0 0x5602146504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.626+0000 7fa24179b700 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56021464e0b0 0x5602146504d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f3455dc4d131616 server_cookie=a08bcecaf33e17e7 in_seq=0 out_seq=0 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.626+0000 7fa224ff9700 10 client.28795 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.627+0000 7fa224ff9700 1 -- 172.21.15.12:0/2663665252 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560214607f40 con 0x56021464e0b0 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.627+0000 7fa224ff9700 10 client.28795 handle_command_reply: tid=0 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.627+0000 7fa257289b80 1 client.28795 shutdown 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.627+0000 7fa257289b80 1 -- 172.21.15.12:0/2663665252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5602146393c0 msgr2=0x560214642840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.627+0000 7fa257289b80 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5602146393c0 0x560214642840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa22c012700 tx=0x7fa22c012a10 comp rx=0 tx=0).stop 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 1 -- 172.21.15.12:0/2663665252 shutdown_connections 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x56021464e0b0 0x5602146504d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214642300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa224ff9700 0 client.28795 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560214639de0 0x560214649880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 1 --2- 172.21.15.12:0/2663665252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5602146393c0 0x560214642840 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 1 -- 172.21.15.12:0/2663665252 >> 172.21.15.12:0/2663665252 conn(0x5602145677e0 msgr2=0x560214637820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 1 -- 172.21.15.12:0/2663665252 shutdown_connections 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 1 -- 172.21.15.12:0/2663665252 wait complete. 2023-12-11T20:29:04.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.628+0000 7fa257289b80 20 client.28795 trim_cache size 0 max 16384 2023-12-11T20:29:04.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.645+0000 7fa257289b80 1 Processor -- start 2023-12-11T20:29:04.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.645+0000 7fa257289b80 1 -- start start 2023-12-11T20:29:04.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa257289b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 0x560214641810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa257289b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146497a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa257289b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 0x56021463a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa257289b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56021464b650 con 0x5602146393c0 2023-12-11T20:29:04.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa257289b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56021464aa30 con 0x560214639de0 2023-12-11T20:29:04.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa257289b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56021463a700 con 0x560214638a60 2023-12-11T20:29:04.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa240f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa240f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33976/0 (socket says 172.21.15.12:33976) 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa24179b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 0x560214641810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa240f9a700 1 -- 172.21.15.12:0/3507474486 learned_addr learned my addr 172.21.15.12:0/3507474486 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.646+0000 7fa241f9c700 1 --2- 172.21.15.12:0/3507474486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 0x56021463a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa240f9a700 1 -- 172.21.15.12:0/3507474486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 msgr2=0x560214641810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa240f9a700 1 --2- 172.21.15.12:0/3507474486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 0x560214641810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa240f9a700 1 -- 172.21.15.12:0/3507474486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 msgr2=0x56021463a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa240f9a700 1 --2- 172.21.15.12:0/3507474486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 0x56021463a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa240f9a700 1 -- 172.21.15.12:0/3507474486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56021439ec60 con 0x5602146393c0 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa240f9a700 1 --2- 172.21.15.12:0/3507474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146497a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fa22c012d60 tx=0x7fa22c012d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968a1b7d2fff90bd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa227fff700 1 -- 172.21.15.12:0/3507474486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c017040 con 0x5602146393c0 2023-12-11T20:29:04.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa227fff700 1 -- 172.21.15.12:0/3507474486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa22c021020 con 0x5602146393c0 2023-12-11T20:29:04.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.647+0000 7fa227fff700 1 -- 172.21.15.12:0/3507474486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0039b0 con 0x5602146393c0 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 -- 172.21.15.12:0/3507474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 msgr2=0x5602146497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 --2- 172.21.15.12:0/3507474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146497a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fa22c012d60 tx=0x7fa22c012d90 comp rx=0 tx=0).stop 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 -- 172.21.15.12:0/3507474486 shutdown_connections 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 --2- 172.21.15.12:0/3507474486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214639de0 0x56021463a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 --2- 172.21.15.12:0/3507474486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214638a60 0x560214641810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 --2- 172.21.15.12:0/3507474486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x5602146497a0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 -- 172.21.15.12:0/3507474486 >> 172.21.15.12:0/3507474486 conn(0x5602145677e0 msgr2=0x5602146402a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 -- 172.21.15.12:0/3507474486 shutdown_connections 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.648+0000 7fa257289b80 1 -- 172.21.15.12:0/3507474486 wait complete. 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.649+0000 7fa257289b80 1 -- start start 2023-12-11T20:29:04.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.649+0000 7fa257289b80 1 Processor -- start 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.649+0000 7fa257289b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214647010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.649+0000 7fa257289b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x560214647550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.649+0000 7fa257289b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214639de0 0x560214648560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.649+0000 7fa257289b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560214648aa0 con 0x5602146393c0 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.649+0000 7fa257289b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560214648c10 con 0x560214638a60 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.649+0000 7fa257289b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560214648dd0 con 0x560214639de0 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa257289b80 10 client.0 _ll_register_callbacks cb 0x560214471a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa240f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x560214647550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa24179b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214647010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa240f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x560214647550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33990/0 (socket says 172.21.15.12:33990) 2023-12-11T20:29:04.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa240f9a700 1 -- 172.21.15.12:0/2876443962 learned_addr learned my addr 172.21.15.12:0/2876443962 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa241f9c700 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214639de0 0x560214648560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa240f9a700 1 -- 172.21.15.12:0/2876443962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214639de0 msgr2=0x560214648560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa240f9a700 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214639de0 0x560214648560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa240f9a700 1 -- 172.21.15.12:0/2876443962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 msgr2=0x560214647010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa240f9a700 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214647010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa240f9a700 1 -- 172.21.15.12:0/2876443962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602143b5de0 con 0x5602146393c0 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.650+0000 7fa24179b700 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214647010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa240f9a700 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x560214647550 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fa22c000c00 tx=0x7fa22c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194d9c93878f18be server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa224ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa224ff9700 1 -- 172.21.15.12:0/2876443962 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c005520 con 0x5602146393c0 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa257289b80 1 -- 172.21.15.12:0/2876443962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa23800c8f0 con 0x5602146393c0 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa224ff9700 1 -- 172.21.15.12:0/2876443962 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa22c000e40 con 0x5602146393c0 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa224ff9700 1 -- 172.21.15.12:0/2876443962 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa22c0105f0 con 0x5602146393c0 2023-12-11T20:29:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa257289b80 10 client.19221 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa257289b80 1 -- 172.21.15.12:0/2876443962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5602143dc250 con 0x5602146393c0 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.651+0000 7fa224ff9700 1 -- 172.21.15.12:0/2876443962 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa23800c8f0 con 0x5602146393c0 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.652+0000 7fa224ff9700 1 -- 172.21.15.12:0/2876443962 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa22c02e070 con 0x5602146393c0 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.652+0000 7fa257289b80 10 client.19221 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.652+0000 7fa257289b80 10 client.19221 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.652+0000 7fa257289b80 20 client.19221 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.652+0000 7fa257289b80 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5602146a4d00 0x5602146a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.652+0000 7fa257289b80 4 client.19221 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:29:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.652+0000 7fa257289b80 1 -- 172.21.15.12:0/2876443962 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560214552fd0 con 0x5602146a4d00 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.652+0000 7fa24179b700 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5602146a4d00 0x5602146a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa24179b700 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5602146a4d00 0x5602146a7120 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=363c3b757fd70b65 server_cookie=c461c6cdcd01f9d4 in_seq=0 out_seq=0 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa224ff9700 10 client.19221 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa224ff9700 1 -- 172.21.15.12:0/2876443962 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560214552fd0 con 0x5602146a4d00 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa224ff9700 10 client.19221 handle_command_reply: tid=0 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 client.19221 shutdown 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 -- 172.21.15.12:0/2876443962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 msgr2=0x560214647550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x560214647550 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fa22c000c00 tx=0x7fa22c010d50 comp rx=0 tx=0).stop 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 -- 172.21.15.12:0/2876443962 shutdown_connections 2023-12-11T20:29:04.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5602146a4d00 0x5602146a7120 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560214638a60 0x560214647010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560214639de0 0x560214648560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 --2- 172.21.15.12:0/2876443962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602146393c0 0x560214647550 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa257289b80 1 -- 172.21.15.12:0/2876443962 >> 172.21.15.12:0/2876443962 conn(0x5602145677e0 msgr2=0x5602146422a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.653+0000 7fa224ff9700 0 client.19221 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.654+0000 7fa257289b80 1 -- 172.21.15.12:0/2876443962 shutdown_connections 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.654+0000 7fa257289b80 1 -- 172.21.15.12:0/2876443962 wait complete. 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.654+0000 7fa257289b80 20 client.19221 trim_cache size 0 max 16384 2023-12-11T20:29:04.657 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:29:04.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.654+0000 7fa24279d700 1 -- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2280a15a0 msgr2=0x7fa2280a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.654+0000 7fa24279d700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2280a15a0 0x7fa2280a3a60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa234009cd0 tx=0x7fa2340099e0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.654+0000 7fa24279d700 1 -- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c101310 msgr2=0x7fa23c075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.654+0000 7fa24279d700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c101310 0x7fa23c075330 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e970 tx=0x7fa23800ec80 comp rx=0 tx=0).stop 2023-12-11T20:29:04.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.655+0000 7fa24279d700 1 -- 172.21.15.12:0/2361420131 shutdown_connections 2023-12-11T20:29:04.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.655+0000 7fa24279d700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa2280a15a0 0x7fa2280a3a60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.655+0000 7fa24279d700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa23c102ea0 0x7fa23c073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.655+0000 7fa24279d700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa23c101310 0x7fa23c075330 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.655+0000 7fa24279d700 1 --2- 172.21.15.12:0/2361420131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa23c102500 0x7fa23c0739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.655+0000 7fa24279d700 1 -- 172.21.15.12:0/2361420131 >> 172.21.15.12:0/2361420131 conn(0x7fa23c0fc860 msgr2=0x7fa23c105800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.655+0000 7fa24279d700 1 -- 172.21.15.12:0/2361420131 shutdown_connections 2023-12-11T20:29:04.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.655+0000 7fa24279d700 1 -- 172.21.15.12:0/2361420131 wait complete. 2023-12-11T20:29:04.670 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:04 smithi012 ceph-mon[128787]: pgmap v769: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:29:04.670 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:04 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2405325416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:29:04.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:29:04.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:04 smithi039 ceph-mon[102205]: pgmap v769: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:29:04.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:04 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2405325416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:29:04.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/754846712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc81091b0 msgr2=0x7f1cc810b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/754846712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc81091b0 0x7f1cc810b640 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000b0a0 tx=0x7f1cc000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/754846712 shutdown_connections 2023-12-11T20:29:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/754846712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc81091b0 0x7f1cc810b640 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/754846712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1cc8075610 0x7f1cc8073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/754846712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cc8074030 0x7f1cc80744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/754846712 >> 172.21.15.12:0/754846712 conn(0x7f1cc80fc860 msgr2=0x7f1cc80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/754846712 shutdown_connections 2023-12-11T20:29:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.909+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/754846712 wait complete. 2023-12-11T20:29:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.910+0000 7f1ccdd9d700 1 Processor -- start 2023-12-11T20:29:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.910+0000 7f1ccdd9d700 1 -- start start 2023-12-11T20:29:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.910+0000 7f1ccdd9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cc8074030 0x7f1cc8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.910+0000 7f1ccdd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc8075610 0x7f1cc8199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.910+0000 7f1ccdd9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1cc81091b0 0x7f1cc81a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1ccdd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc81a0f30 con 0x7f1cc8075610 2023-12-11T20:29:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1ccdd9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc81a1070 con 0x7f1cc8074030 2023-12-11T20:29:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1ccdd9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc81a1200 con 0x7f1cc81091b0 2023-12-11T20:29:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc8075610 0x7f1cc8199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc8075610 0x7f1cc8199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34000/0 (socket says 172.21.15.12:34000) 2023-12-11T20:29:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cc7fff700 1 -- 172.21.15.12:0/3353209207 learned_addr learned my addr 172.21.15.12:0/3353209207 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cc8074030 0x7f1cc8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1ccd59c700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1cc81091b0 0x7f1cc81a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cc7fff700 1 -- 172.21.15.12:0/3353209207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1cc81091b0 msgr2=0x7f1cc81a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1cc81091b0 0x7f1cc81a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cc7fff700 1 -- 172.21.15.12:0/3353209207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cc8074030 msgr2=0x7f1cc8199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cc8074030 0x7f1cc8199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.911+0000 7f1cc7fff700 1 -- 172.21.15.12:0/3353209207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0009d00 con 0x7f1cc8075610 2023-12-11T20:29:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.912+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc8075610 0x7f1cc8199990 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400d980 tx=0x7f1cb400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.912+0000 7f1cc5ffb700 1 -- 172.21.15.12:0/3353209207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4004020 con 0x7f1cc8075610 2023-12-11T20:29:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.912+0000 7f1cc5ffb700 1 -- 172.21.15.12:0/3353209207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cb400f690 con 0x7f1cc8075610 2023-12-11T20:29:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.912+0000 7f1cc5ffb700 1 -- 172.21.15.12:0/3353209207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40039e0 con 0x7f1cc8075610 2023-12-11T20:29:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.912+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/3353209207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc81a14e0 con 0x7f1cc8075610 2023-12-11T20:29:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.912+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/3353209207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc81a19a0 con 0x7f1cc8075610 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.916+0000 7f1cc5ffb700 1 -- 172.21.15.12:0/3353209207 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1cb400f800 con 0x7f1cc8075610 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.917+0000 7f1ce2835b80 1 Processor -- start 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1ce2835b80 1 -- start start 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1cc5ffb700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1cb80a15a0 0x7f1cb80a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1cc5ffb700 1 -- 172.21.15.12:0/3353209207 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1cb40cc910 con 0x7f1cc8075610 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d057a60 0x55ed1d057e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d0588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d059240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1cfb2b50 con 0x55ed1d058de0 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1cfb0470 con 0x55ed1d0583c0 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1cfabd60 con 0x55ed1d057a60 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.918+0000 7f1ccd59c700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1cb80a15a0 0x7f1cb80a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1ccd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d059240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1cccd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d057a60 0x55ed1d057e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1ccd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d059240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34012/0 (socket says 172.21.15.12:34012) 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1ccd59c700 1 -- 172.21.15.12:0/3806969100 learned_addr learned my addr 172.21.15.12:0/3806969100 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/3806969100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d0588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1cccd9b700 1 -- 172.21.15.12:0/3806969100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 msgr2=0x55ed1d0588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/3806969100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d0588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1cccd9b700 1 -- 172.21.15.12:0/3806969100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 msgr2=0x55ed1d059240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/3806969100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d059240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1cccd9b700 1 -- 172.21.15.12:0/3806969100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed1ce28630 con 0x55ed1d057a60 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1ccd59c700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1cb80a15a0 0x7f1cb80a3a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000b070 tx=0x7f1cc000cee0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.919+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/3806969100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d057a60 0x55ed1d057e80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00bc80 tx=0x7f1cbc00bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ac291c7ccd9e61a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.920+0000 7f1cb2ffd700 1 -- 172.21.15.12:0/3806969100 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc010c20 con 0x55ed1d057a60 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.920+0000 7f1cb2ffd700 1 -- 172.21.15.12:0/3806969100 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cbc015070 con 0x55ed1d057a60 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.920+0000 7f1cb2ffd700 1 -- 172.21.15.12:0/3806969100 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc004e90 con 0x55ed1d057a60 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.920+0000 7f1ce2835b80 1 -- 172.21.15.12:0/3806969100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d057a60 msgr2=0x55ed1d057e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.920+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/3806969100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d057a60 0x55ed1d057e80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00bc80 tx=0x7f1cbc00bf90 comp rx=0 tx=0).stop 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 -- 172.21.15.12:0/3806969100 shutdown_connections 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/3806969100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d059240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/3806969100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d057a60 0x55ed1d057e80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/3806969100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d0588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 -- 172.21.15.12:0/3806969100 >> 172.21.15.12:0/3806969100 conn(0x55ed1cf867e0 msgr2=0x55ed1d0523d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 -- 172.21.15.12:0/3806969100 shutdown_connections 2023-12-11T20:29:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 -- 172.21.15.12:0/3806969100 wait complete. 2023-12-11T20:29:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 -- start start 2023-12-11T20:29:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.921+0000 7f1ce2835b80 1 Processor -- start 2023-12-11T20:29:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d061310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d061850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d058de0 0x55ed1d068890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1cf65560 con 0x55ed1d057a60 2023-12-11T20:29:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1cf65200 con 0x55ed1d0583c0 2023-12-11T20:29:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1ce2a920 con 0x55ed1d058de0 2023-12-11T20:29:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1ce2835b80 10 client.0 _ll_register_callbacks cb 0x55ed1ce90a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1cccd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d061310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1cccd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d061310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34018/0 (socket says 172.21.15.12:34018) 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1ccd59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d058de0 0x55ed1d068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1cccd9b700 1 -- 172.21.15.12:0/649292786 learned_addr learned my addr 172.21.15.12:0/649292786 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.922+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d061850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1cccd9b700 1 -- 172.21.15.12:0/649292786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d058de0 msgr2=0x55ed1d068890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d058de0 0x55ed1d068890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1cccd9b700 1 -- 172.21.15.12:0/649292786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 msgr2=0x55ed1d061850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d061850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1cccd9b700 1 -- 172.21.15.12:0/649292786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc00b8e0 con 0x55ed1d057a60 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1ccd59c700 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d058de0 0x55ed1d068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d061310 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc005d90 tx=0x7f1cbc010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9545f58772dfb454 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1ca7fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:04.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1ca7fff700 1 -- 172.21.15.12:0/649292786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc020070 con 0x55ed1d057a60 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1ca7fff700 1 -- 172.21.15.12:0/649292786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1cbc017070 con 0x55ed1d057a60 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.923+0000 7f1ce2835b80 1 -- 172.21.15.12:0/649292786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed1d04a9e0 con 0x55ed1d057a60 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ca7fff700 1 -- 172.21.15.12:0/649292786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cbc004250 con 0x55ed1d057a60 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ce2835b80 10 client.19233 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ce2835b80 1 -- 172.21.15.12:0/649292786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ed1cdd4de0 con 0x55ed1d057a60 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ca7fff700 1 -- 172.21.15.12:0/649292786 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cbc033080 con 0x55ed1d057a60 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ca7fff700 1 -- 172.21.15.12:0/649292786 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1cbc011440 con 0x55ed1d057a60 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ce2835b80 10 client.19233 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ce2835b80 10 client.19233 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ce2835b80 20 client.19233 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ed1d06d050 0x55ed1d06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ce2835b80 4 client.19233 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.924+0000 7f1ce2835b80 1 -- 172.21.15.12:0/649292786 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed1d026f40 con 0x55ed1d06d050 2023-12-11T20:29:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.925+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ed1d06d050 0x55ed1d06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.925+0000 7f1ca7fff700 10 client.19233 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.925+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ed1d06d050 0x55ed1d06f470 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e109d8ae96bda6e9 server_cookie=e5b5801847070cb2 in_seq=0 out_seq=0 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.926+0000 7f1ca7fff700 1 -- 172.21.15.12:0/649292786 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ed1d026f40 con 0x55ed1d06d050 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.926+0000 7f1ca7fff700 10 client.19233 handle_command_reply: tid=0 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.926+0000 7f1ce2835b80 1 client.19233 shutdown 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.926+0000 7f1ce2835b80 1 -- 172.21.15.12:0/649292786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 msgr2=0x55ed1d061310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.926+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d061310 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc005d90 tx=0x7f1cbc010c50 comp rx=0 tx=0).stop 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 1 -- 172.21.15.12:0/649292786 shutdown_connections 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ed1d06d050 0x55ed1d06f470 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d058de0 0x55ed1d068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ca7fff700 0 client.19233 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:29:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d061310 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/649292786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d0583c0 0x55ed1d061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 1 -- 172.21.15.12:0/649292786 >> 172.21.15.12:0/649292786 conn(0x55ed1cf867e0 msgr2=0x55ed1d056820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 1 -- 172.21.15.12:0/649292786 shutdown_connections 2023-12-11T20:29:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 1 -- 172.21.15.12:0/649292786 wait complete. 2023-12-11T20:29:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.927+0000 7f1ce2835b80 20 client.19233 trim_cache size 0 max 16384 2023-12-11T20:29:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.947+0000 7f1ce2835b80 1 Processor -- start 2023-12-11T20:29:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.947+0000 7f1ce2835b80 1 -- start start 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.947+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d0591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.947+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d068850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.947+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d058de0 0x55ed1d052320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.947+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d0530d0 con 0x55ed1d057a60 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.947+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d04eb30 con 0x55ed1d058de0 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.947+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d04d1e0 con 0x55ed1d0583c0 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cccd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d0591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cccd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d0591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34026/0 (socket says 172.21.15.12:34026) 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cccd9b700 1 -- 172.21.15.12:0/18973967 learned_addr learned my addr 172.21.15.12:0/18973967 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1ccd59c700 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d058de0 0x55ed1d052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cc7fff700 1 -- 172.21.15.12:0/18973967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d058de0 msgr2=0x55ed1d052320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d058de0 0x55ed1d052320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cc7fff700 1 -- 172.21.15.12:0/18973967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 msgr2=0x55ed1d0591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d0591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cc7fff700 1 -- 172.21.15.12:0/18973967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed1cdbdc60 con 0x55ed1d0583c0 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d0591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d068850 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40ca360 tx=0x7f1cb40ca230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b8c91f0a56b299 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.948+0000 7f1cb37fe700 1 -- 172.21.15.12:0/18973967 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40b6070 con 0x55ed1d0583c0 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1cb37fe700 1 -- 172.21.15.12:0/18973967 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cb409a280 con 0x55ed1d0583c0 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1cb37fe700 1 -- 172.21.15.12:0/18973967 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40ca470 con 0x55ed1d0583c0 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 -- 172.21.15.12:0/18973967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 msgr2=0x55ed1d068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d068850 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40ca360 tx=0x7f1cb40ca230 comp rx=0 tx=0).stop 2023-12-11T20:29:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 -- 172.21.15.12:0/18973967 shutdown_connections 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d058de0 0x55ed1d052320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d057a60 0x55ed1d0591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/18973967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d068850 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 -- 172.21.15.12:0/18973967 >> 172.21.15.12:0/18973967 conn(0x55ed1cf867e0 msgr2=0x55ed1d060070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 -- 172.21.15.12:0/18973967 shutdown_connections 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.949+0000 7f1ce2835b80 1 -- 172.21.15.12:0/18973967 wait complete. 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.950+0000 7f1ce2835b80 1 -- start start 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.950+0000 7f1ce2835b80 1 Processor -- start 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d057a60 0x55ed1d0bd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d0bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1ce2835b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d0c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d0c26e0 con 0x55ed1d058de0 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d0c2850 con 0x55ed1d057a60 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1ce2835b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1d0c2a10 con 0x55ed1d0583c0 2023-12-11T20:29:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1ce2835b80 10 client.0 _ll_register_callbacks cb 0x55ed1ce90a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1ccd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d0c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d0bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cccd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d057a60 0x55ed1d0bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d0bfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54854/0 (socket says 172.21.15.12:54854) 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cccd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d057a60 0x55ed1d0bd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:34334/0 (socket says 172.21.15.12:34334) 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cc7fff700 1 -- 172.21.15.12:0/4063682690 learned_addr learned my addr 172.21.15.12:0/4063682690 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cc7fff700 1 -- 172.21.15.12:0/4063682690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d057a60 msgr2=0x55ed1d0bd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d057a60 0x55ed1d0bd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cc7fff700 1 -- 172.21.15.12:0/4063682690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 msgr2=0x55ed1d0c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d0c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.951+0000 7f1cc7fff700 1 -- 172.21.15.12:0/4063682690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed1cdd4de0 con 0x55ed1d0583c0 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1cc7fff700 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d0bfaa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4099880 tx=0x7f1cb40995e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b22a319117b5ae6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1ca7fff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1ca7fff700 1 -- 172.21.15.12:0/4063682690 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40b6030 con 0x55ed1d0583c0 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1ce2835b80 1 -- 172.21.15.12:0/4063682690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1cbc015070 con 0x55ed1d0583c0 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1ca7fff700 1 -- 172.21.15.12:0/4063682690 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1cb40b7070 con 0x55ed1d0583c0 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1ca7fff700 1 -- 172.21.15.12:0/4063682690 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cb4099de0 con 0x55ed1d0583c0 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1ce2835b80 10 client.28819 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1ce2835b80 1 -- 172.21.15.12:0/4063682690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f1cc81a19a0 con 0x55ed1d0583c0 2023-12-11T20:29:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.952+0000 7f1ca7fff700 1 -- 172.21.15.12:0/4063682690 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cbc015070 con 0x55ed1d0583c0 2023-12-11T20:29:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.953+0000 7f1ca7fff700 1 -- 172.21.15.12:0/4063682690 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1cb4080020 con 0x55ed1d0583c0 2023-12-11T20:29:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.953+0000 7f1ce2835b80 10 client.28819 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.953+0000 7f1ce2835b80 10 client.28819 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:29:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.953+0000 7f1ce2835b80 20 client.28819 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.953+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ed1d0c4160 0x55ed1d0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.953+0000 7f1ce2835b80 4 client.28819 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:29:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.953+0000 7f1ce2835b80 1 -- 172.21.15.12:0/4063682690 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ed1cf71fd0 con 0x55ed1d0c4160 2023-12-11T20:29:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.953+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ed1d0c4160 0x55ed1d0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ca7fff700 10 client.28819 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1cccd9b700 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ed1d0c4160 0x55ed1d0c6580 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53bb634697f9225d server_cookie=fb95aabfcfa76fb3 in_seq=0 out_seq=0 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ca7fff700 1 -- 172.21.15.12:0/4063682690 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ed1cf71fd0 con 0x55ed1d0c4160 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ca7fff700 10 client.28819 handle_command_reply: tid=0 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 client.28819 shutdown 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 -- 172.21.15.12:0/4063682690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 msgr2=0x55ed1d0bfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d0bfaa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4099880 tx=0x7f1cb40995e0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 -- 172.21.15.12:0/4063682690 shutdown_connections 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55ed1d0c4160 0x55ed1d0c6580 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ed1d057a60 0x55ed1d0bd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ca7fff700 0 client.28819 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:29:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ed1d058de0 0x55ed1d0c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 --2- 172.21.15.12:0/4063682690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed1d0583c0 0x55ed1d0bfaa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 -- 172.21.15.12:0/4063682690 >> 172.21.15.12:0/4063682690 conn(0x55ed1cf867e0 msgr2=0x55ed1d05f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 -- 172.21.15.12:0/4063682690 shutdown_connections 2023-12-11T20:29:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.954+0000 7f1ce2835b80 1 -- 172.21.15.12:0/4063682690 wait complete. 2023-12-11T20:29:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.955+0000 7f1ce2835b80 20 client.28819 trim_cache size 0 max 16384 2023-12-11T20:29:04.959 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:29:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.955+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1cb80a15a0 msgr2=0x7f1cb80a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.955+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1cb80a15a0 0x7f1cb80a3a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000b070 tx=0x7f1cc000cee0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.955+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc8075610 msgr2=0x7f1cc8199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.955+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc8075610 0x7f1cc8199990 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400d980 tx=0x7f1cb400dc90 comp rx=0 tx=0).stop 2023-12-11T20:29:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.956+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/3353209207 shutdown_connections 2023-12-11T20:29:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.956+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1cb80a15a0 0x7f1cb80a3a60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.956+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1cc8074030 0x7f1cc8199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.956+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1cc81091b0 0x7f1cc81a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.956+0000 7f1ccdd9d700 1 --2- 172.21.15.12:0/3353209207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cc8075610 0x7f1cc8199990 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.956+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/3353209207 >> 172.21.15.12:0/3353209207 conn(0x7f1cc80fc860 msgr2=0x7f1cc81050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.956+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/3353209207 shutdown_connections 2023-12-11T20:29:04.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:04.956+0000 7f1ccdd9d700 1 -- 172.21.15.12:0/3353209207 wait complete. 2023-12-11T20:29:04.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:04 smithi032 ceph-mon[132488]: pgmap v769: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:29:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:04 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2405325416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:29:04.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.221+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1347671790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a8104ea0 msgr2=0x7fe5a8105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.221+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1347671790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a8104ea0 0x7fe5a8105320 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000b0a0 tx=0x7fe5a000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.221+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1347671790 shutdown_connections 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.221+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1347671790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a80ffb60 0x7fe5a8101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.221+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1347671790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a8104ea0 0x7fe5a8105320 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.221+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1347671790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5a81024d0 0x7fe5a8104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.221+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1347671790 >> 172.21.15.12:0/1347671790 conn(0x7fe5a80fb740 msgr2=0x7fe5a80fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.221+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1347671790 shutdown_connections 2023-12-11T20:29:05.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.222+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1347671790 wait complete. 2023-12-11T20:29:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.223+0000 7fe5ad39d700 1 Processor -- start 2023-12-11T20:29:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.223+0000 7fe5ad39d700 1 -- start start 2023-12-11T20:29:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.223+0000 7fe5ad39d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a80ffb60 0x7fe5a819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.223+0000 7fe5ad39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a81024d0 0x7fe5a819dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.223+0000 7fe5ad39d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5a8104ea0 0x7fe5a81a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.223+0000 7fe5ad39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81a52d0 con 0x7fe5a81024d0 2023-12-11T20:29:05.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.223+0000 7fe5ad39d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81a5410 con 0x7fe5a80ffb60 2023-12-11T20:29:05.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.223+0000 7fe5ad39d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81a55a0 con 0x7fe5a8104ea0 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a81024d0 0x7fe5a819dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a81024d0 0x7fe5a819dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34050/0 (socket says 172.21.15.12:34050) 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 -- 172.21.15.12:0/1041561607 learned_addr learned my addr 172.21.15.12:0/1041561607 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a80ffb60 0x7fe5a819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5a8104ea0 0x7fe5a81a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 -- 172.21.15.12:0/1041561607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5a8104ea0 msgr2=0x7fe5a81a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5a8104ea0 0x7fe5a81a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 -- 172.21.15.12:0/1041561607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a80ffb60 msgr2=0x7fe5a819d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a80ffb60 0x7fe5a819d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 -- 172.21.15.12:0/1041561607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0009d00 con 0x7fe5a81024d0 2023-12-11T20:29:05.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.224+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a81024d0 0x7fe5a819dce0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00e9a0 tx=0x7fe59c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:05.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.225+0000 7fe5a57fa700 1 -- 172.21.15.12:0/1041561607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c009790 con 0x7fe5a81024d0 2023-12-11T20:29:05.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.225+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1041561607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a81a5880 con 0x7fe5a81024d0 2023-12-11T20:29:05.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.225+0000 7fe5a57fa700 1 -- 172.21.15.12:0/1041561607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe59c010430 con 0x7fe5a81024d0 2023-12-11T20:29:05.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.225+0000 7fe5a57fa700 1 -- 172.21.15.12:0/1041561607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00cea0 con 0x7fe5a81024d0 2023-12-11T20:29:05.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.225+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1041561607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a81a5de0 con 0x7fe5a81024d0 2023-12-11T20:29:05.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.228+0000 7fe5a57fa700 1 -- 172.21.15.12:0/1041561607 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe59c0105a0 con 0x7fe5a81024d0 2023-12-11T20:29:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.229+0000 7fe5c1ebfb80 1 Processor -- start 2023-12-11T20:29:05.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5c1ebfb80 1 -- start start 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5a57fa700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5900a15a0 0x7fe5900a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5a57fa700 1 -- 172.21.15.12:0/1041561607 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe59c014070 con 0x7fe5a81024d0 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d3a60 0x560e187d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 0x560e187d48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187d5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1872eb50 con 0x560e187d3a60 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e1872c470 con 0x560e187d4de0 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e18727d60 con 0x560e187d43c0 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5900a15a0 0x7fe5900a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.230+0000 7fe5a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d3a60 0x560e187d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d3a60 0x560e187d3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34062/0 (socket says 172.21.15.12:34062) 2023-12-11T20:29:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a7fff700 1 -- 172.21.15.12:0/741336441 learned_addr learned my addr 172.21.15.12:0/741336441 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 0x560e187d48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a7fff700 1 -- 172.21.15.12:0/741336441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 msgr2=0x560e187d48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:05.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 0x560e187d48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a7fff700 1 -- 172.21.15.12:0/741336441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 msgr2=0x560e187d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:05.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187d5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a7fff700 1 -- 172.21.15.12:0/741336441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e185a4630 con 0x560e187d3a60 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5900a15a0 0x7fe5900a3a60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009fd0 tx=0x7fe5a0007670 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.231+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d3a60 0x560e187d3e80 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fe59800bd70 tx=0x7fe5980106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727b03de0a8b75d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.232+0000 7fe58e7fc700 1 -- 172.21.15.12:0/741336441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598010d90 con 0x560e187d3a60 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.232+0000 7fe58e7fc700 1 -- 172.21.15.12:0/741336441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe598015070 con 0x560e187d3a60 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.232+0000 7fe58e7fc700 1 -- 172.21.15.12:0/741336441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5980116a0 con 0x560e187d3a60 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/741336441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d3a60 msgr2=0x560e187d3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d3a60 0x560e187d3e80 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fe59800bd70 tx=0x7fe5980106b0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/741336441 shutdown_connections 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d3a60 0x560e187d3e80 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/741336441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 0x560e187d48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/741336441 >> 172.21.15.12:0/741336441 conn(0x560e187027e0 msgr2=0x560e187ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:05.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/741336441 shutdown_connections 2023-12-11T20:29:05.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/741336441 wait complete. 2023-12-11T20:29:05.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.233+0000 7fe5c1ebfb80 1 -- start start 2023-12-11T20:29:05.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5c1ebfb80 1 Processor -- start 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187dd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d43c0 0x560e187dd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e186e1560 con 0x560e187d43c0 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e186e1200 con 0x560e187d4de0 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e185a6920 con 0x560e187d3a60 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5c1ebfb80 10 client.0 _ll_register_callbacks cb 0x560e1860ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d43c0 0x560e187dd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d43c0 0x560e187dd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34072/0 (socket says 172.21.15.12:34072) 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.234+0000 7fe5a77fe700 1 -- 172.21.15.12:0/1146444996 learned_addr learned my addr 172.21.15.12:0/1146444996 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187dd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5a77fe700 1 -- 172.21.15.12:0/1146444996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 msgr2=0x560e187dd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187dd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5a77fe700 1 -- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 msgr2=0x560e187e48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187e48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5a77fe700 1 -- 172.21.15.12:0/1146444996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59800b9a0 con 0x560e187d43c0 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187e48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187dd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d43c0 0x560e187dd8b0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe59c012020 tx=0x7fe59c09a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5085ba93352280af server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5877fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:05.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5877fe700 1 -- 172.21.15.12:0/1146444996 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0a2240 con 0x560e187d43c0 2023-12-11T20:29:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5877fe700 1 -- 172.21.15.12:0/1146444996 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe59c09e290 con 0x560e187d43c0 2023-12-11T20:29:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.235+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/1146444996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e187c69e0 con 0x560e187d43c0 2023-12-11T20:29:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5877fe700 1 -- 172.21.15.12:0/1146444996 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe59c0a24d0 con 0x560e187d43c0 2023-12-11T20:29:05.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5c1ebfb80 10 client.19251 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/1146444996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560e18550de0 con 0x560e187d43c0 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5877fe700 1 -- 172.21.15.12:0/1146444996 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e187c69e0 con 0x560e187d43c0 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5877fe700 1 -- 172.21.15.12:0/1146444996 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe59c096130 con 0x560e187d43c0 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5c1ebfb80 10 client.19251 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5c1ebfb80 10 client.19251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5c1ebfb80 20 client.19251 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e187e9140 0x560e187eb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5c1ebfb80 4 client.19251 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.236+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/1146444996 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e187a2f40 con 0x560e187e9140 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.237+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e187e9140 0x560e187eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.238+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e187e9140 0x560e187eb560 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af33c4c322a96a45 server_cookie=5960e4b2eb0b1705 in_seq=0 out_seq=0 2023-12-11T20:29:05.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.238+0000 7fe5877fe700 10 client.19251 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.238+0000 7fe5877fe700 1 -- 172.21.15.12:0/1146444996 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560e187a2f40 con 0x560e187e9140 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.238+0000 7fe5877fe700 10 client.19251 handle_command_reply: tid=0 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.238+0000 7fe5c1ebfb80 1 client.19251 shutdown 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/1146444996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d43c0 msgr2=0x560e187dd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d43c0 0x560e187dd8b0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe59c012020 tx=0x7fe59c09a680 comp rx=0 tx=0).stop 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/1146444996 shutdown_connections 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e187e9140 0x560e187eb560 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d4de0 0x560e187e48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187dd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5877fe700 0 client.19251 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/1146444996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d43c0 0x560e187dd8b0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/1146444996 >> 172.21.15.12:0/1146444996 conn(0x560e187027e0 msgr2=0x560e187d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:05.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/1146444996 shutdown_connections 2023-12-11T20:29:05.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/1146444996 wait complete. 2023-12-11T20:29:05.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.239+0000 7fe5c1ebfb80 20 client.19251 trim_cache size 0 max 16384 2023-12-11T20:29:05.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.257+0000 7fe5c1ebfb80 1 Processor -- start 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.257+0000 7fe5c1ebfb80 1 -- start start 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.257+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d3a60 0x560e187e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.257+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 0x560e187e48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.257+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187dc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.257+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e187e5a70 con 0x560e187d4de0 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.257+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e187cf750 con 0x560e187d3a60 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.257+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e187dcee0 con 0x560e187d43c0 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187dc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187dc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34082/0 (socket says 172.21.15.12:34082) 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 -- 172.21.15.12:0/2298350687 learned_addr learned my addr 172.21.15.12:0/2298350687 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 0x560e187e48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d3a60 0x560e187e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 -- 172.21.15.12:0/2298350687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 msgr2=0x560e187e48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 0x560e187e48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 -- 172.21.15.12:0/2298350687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d3a60 msgr2=0x560e187e4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d3a60 0x560e187e4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 -- 172.21.15.12:0/2298350687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e18539c60 con 0x560e187d4de0 2023-12-11T20:29:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.258+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187dc880 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0015000 tx=0x7fe5a0023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a95129d57d089b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.259+0000 7fe58effd700 1 -- 172.21.15.12:0/2298350687 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000e040 con 0x560e187d4de0 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.259+0000 7fe58effd700 1 -- 172.21.15.12:0/2298350687 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5a0003e90 con 0x560e187d4de0 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.259+0000 7fe58effd700 1 -- 172.21.15.12:0/2298350687 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a001fae0 con 0x560e187d4de0 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.259+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/2298350687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 msgr2=0x560e187dc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.259+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187dc880 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0015000 tx=0x7fe5a0023000 comp rx=0 tx=0).stop 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/2298350687 shutdown_connections 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d3a60 0x560e187e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187dc880 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/2298350687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d43c0 0x560e187e48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/2298350687 >> 172.21.15.12:0/2298350687 conn(0x560e187027e0 msgr2=0x560e187db2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/2298350687 shutdown_connections 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/2298350687 wait complete. 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 -- start start 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.260+0000 7fe5c1ebfb80 1 Processor -- start 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187e2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d43c0 0x560e187e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5c1ebfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e187e3f60 con 0x560e187d4de0 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e187e40d0 con 0x560e187d43c0 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5c1ebfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e187e4290 con 0x560e187d3a60 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5c1ebfb80 10 client.0 _ll_register_callbacks cb 0x560e1860ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5acb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5acb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187e3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34084/0 (socket says 172.21.15.12:34084) 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5acb9c700 1 -- 172.21.15.12:0/120586412 learned_addr learned my addr 172.21.15.12:0/120586412 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.261+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187e2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5a77fe700 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d43c0 0x560e187e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5acb9c700 1 -- 172.21.15.12:0/120586412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 msgr2=0x560e187e2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187e2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5acb9c700 1 -- 172.21.15.12:0/120586412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d43c0 msgr2=0x560e187e2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d43c0 0x560e187e2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5acb9c700 1 -- 172.21.15.12:0/120586412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a0026050 con 0x560e187d4de0 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187e2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5acb9c700 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187e3a20 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009ca0 tx=0x7fe5a0009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daaf604cf4fcae10 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.262+0000 7fe5877fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5877fe700 1 -- 172.21.15.12:0/120586412 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000bab0 con 0x560e187d4de0 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/120586412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e187c9260 con 0x560e187d4de0 2023-12-11T20:29:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5877fe700 1 -- 172.21.15.12:0/120586412 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe5a003a070 con 0x560e187d4de0 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5877fe700 1 -- 172.21.15.12:0/120586412 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5a000bc10 con 0x560e187d4de0 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5c1ebfb80 10 client.19257 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/120586412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560e18577250 con 0x560e187d4de0 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5877fe700 1 -- 172.21.15.12:0/120586412 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e187c9260 con 0x560e187d4de0 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5877fe700 1 -- 172.21.15.12:0/120586412 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe5a00205f0 con 0x560e187d4de0 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5c1ebfb80 10 client.19257 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.263+0000 7fe5c1ebfb80 10 client.19257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.264+0000 7fe5c1ebfb80 20 client.19257 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.264+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e188402e0 0x560e18842700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.264+0000 7fe5c1ebfb80 4 client.19257 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.264+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/120586412 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fe598015070 con 0x560e188402e0 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.264+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e188402e0 0x560e18842700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.264+0000 7fe5a7fff700 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e188402e0 0x560e18842700 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2806dec895fdabd0 server_cookie=bdb76628304d1100 in_seq=0 out_seq=0 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.264+0000 7fe5877fe700 10 client.19257 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5877fe700 1 -- 172.21.15.12:0/120586412 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fe598015070 con 0x560e188402e0 2023-12-11T20:29:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5877fe700 10 client.19257 handle_command_reply: tid=0 2023-12-11T20:29:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 client.19257 shutdown 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/120586412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 msgr2=0x560e187e3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187e3a20 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009ca0 tx=0x7fe5a0009a30 comp rx=0 tx=0).stop 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/120586412 shutdown_connections 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e188402e0 0x560e18842700 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e187d4de0 0x560e187e3a20 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e187d3a60 0x560e187e2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 --2- 172.21.15.12:0/120586412 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e187d43c0 0x560e187e2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/120586412 >> 172.21.15.12:0/120586412 conn(0x560e187027e0 msgr2=0x560e187ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5877fe700 0 client.19257 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/120586412 shutdown_connections 2023-12-11T20:29:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 1 -- 172.21.15.12:0/120586412 wait complete. 2023-12-11T20:29:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.265+0000 7fe5c1ebfb80 20 client.19257 trim_cache size 0 max 16384 2023-12-11T20:29:05.272 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5900a15a0 msgr2=0x7fe5900a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5900a15a0 0x7fe5900a3a60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009fd0 tx=0x7fe5a0007670 comp rx=0 tx=0).stop 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a81024d0 msgr2=0x7fe5a819dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a81024d0 0x7fe5a819dce0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00e9a0 tx=0x7fe59c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1041561607 shutdown_connections 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe5900a15a0 0x7fe5900a3a60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5a80ffb60 0x7fe5a819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5a8104ea0 0x7fe5a81a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 --2- 172.21.15.12:0/1041561607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a81024d0 0x7fe5a819dce0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1041561607 >> 172.21.15.12:0/1041561607 conn(0x7fe5a80fb740 msgr2=0x7fe5a8100810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1041561607 shutdown_connections 2023-12-11T20:29:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:05.266+0000 7fe5ad39d700 1 -- 172.21.15.12:0/1041561607 wait complete. 2023-12-11T20:29:06.288 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:29:06.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.515+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3936994983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a4101f80 msgr2=0x7f69a4104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.515+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3936994983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a4101f80 0x7f69a4104370 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009990 tx=0x7f69a0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.515+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3936994983 shutdown_connections 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.515+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3936994983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69a41071e0 0x7f69a4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.515+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3936994983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a4101f80 0x7f69a4104370 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.515+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3936994983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69a41048b0 0x7f69a4106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.515+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3936994983 >> 172.21.15.12:0/3936994983 conn(0x7f69a40fb930 msgr2=0x7f69a40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.515+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3936994983 shutdown_connections 2023-12-11T20:29:06.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.516+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3936994983 wait complete. 2023-12-11T20:29:06.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.517+0000 7f69ab5ff700 1 Processor -- start 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.517+0000 7f69ab5ff700 1 -- start start 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.517+0000 7f69ab5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69a4101f80 0x7f69a4199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.517+0000 7f69ab5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a41048b0 0x7f69a4199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.517+0000 7f69ab5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69a41071e0 0x7f69a41a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.517+0000 7f69ab5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41a1080 con 0x7f69a41048b0 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.517+0000 7f69ab5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41a11c0 con 0x7f69a4101f80 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.517+0000 7f69ab5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41a1350 con 0x7f69a41071e0 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a41048b0 0x7f69a4199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a41048b0 0x7f69a4199a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34108/0 (socket says 172.21.15.12:34108) 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 -- 172.21.15.12:0/3580738235 learned_addr learned my addr 172.21.15.12:0/3580738235 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a939b700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69a4101f80 0x7f69a4199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 -- 172.21.15.12:0/3580738235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69a41071e0 msgr2=0x7f69a41a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69a41071e0 0x7f69a41a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69a41071e0 0x7f69a41a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 -- 172.21.15.12:0/3580738235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69a4101f80 msgr2=0x7f69a4199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69a4101f80 0x7f69a4199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 -- 172.21.15.12:0/3580738235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a00095f0 con 0x7f69a41048b0 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a939b700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69a4101f80 0x7f69a4199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69a41071e0 0x7f69a41a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.518+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a41048b0 0x7f69a4199a90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f699400e9a0 tx=0x7f699400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.519+0000 7f699a7fc700 1 -- 172.21.15.12:0/3580738235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994009790 con 0x7f69a41048b0 2023-12-11T20:29:06.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.519+0000 7f699a7fc700 1 -- 172.21.15.12:0/3580738235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f699400cbd0 con 0x7f69a41048b0 2023-12-11T20:29:06.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.519+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3580738235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a41a1630 con 0x7f69a41048b0 2023-12-11T20:29:06.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.519+0000 7f699a7fc700 1 -- 172.21.15.12:0/3580738235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994018680 con 0x7f69a41048b0 2023-12-11T20:29:06.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.519+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3580738235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a41a1b40 con 0x7f69a41048b0 2023-12-11T20:29:06.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.523+0000 7f699a7fc700 1 -- 172.21.15.12:0/3580738235 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f699400cd40 con 0x7f69a41048b0 2023-12-11T20:29:06.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.524+0000 7f69bef11b80 1 Processor -- start 2023-12-11T20:29:06.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.524+0000 7f69bef11b80 1 -- start start 2023-12-11T20:29:06.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0f450 0x555b44d0f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0fdb0 0x555b44d106c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 0x555b44d11120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69bef11b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44c6abd0 con 0x555b44d0f450 2023-12-11T20:29:06.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69bef11b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44c684f0 con 0x555b44d10ca0 2023-12-11T20:29:06.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69bef11b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44c63de0 con 0x555b44d0fdb0 2023-12-11T20:29:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69a9b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0f450 0x555b44d0f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69a9b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0f450 0x555b44d0f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34116/0 (socket says 172.21.15.12:34116) 2023-12-11T20:29:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69a9b9c700 1 -- 172.21.15.12:0/93633702 learned_addr learned my addr 172.21.15.12:0/93633702 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69a939b700 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0fdb0 0x555b44d106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.525+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 0x555b44d11120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f699a7fc700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69900a1480 0x7f69900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f69a9b9c700 1 -- 172.21.15.12:0/93633702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0fdb0 msgr2=0x555b44d106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0fdb0 0x555b44d106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f69a9b9c700 1 -- 172.21.15.12:0/93633702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 msgr2=0x555b44d11120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 0x555b44d11120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f69a9b9c700 1 -- 172.21.15.12:0/93633702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b44ae06b0 con 0x555b44d0f450 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f699a7fc700 1 -- 172.21.15.12:0/3580738235 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6994014070 con 0x7f69a41048b0 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69900a1480 0x7f69900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.526+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0f450 0x555b44d0f870 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f699c009d50 tx=0x7f699c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b324269348336615 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.527+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69900a1480 0x7f69900a3940 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f699c007fd0 tx=0x7f699c01b000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.528+0000 7f698f7fe700 1 -- 172.21.15.12:0/93633702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c01a030 con 0x555b44d0f450 2023-12-11T20:29:06.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.528+0000 7f698f7fe700 1 -- 172.21.15.12:0/93633702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f699c015540 con 0x555b44d0f450 2023-12-11T20:29:06.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.528+0000 7f698f7fe700 1 -- 172.21.15.12:0/93633702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c013890 con 0x555b44d0f450 2023-12-11T20:29:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 -- 172.21.15.12:0/93633702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0f450 msgr2=0x555b44d0f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0f450 0x555b44d0f870 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f699c009d50 tx=0x7f699c0077e0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 -- 172.21.15.12:0/93633702 shutdown_connections 2023-12-11T20:29:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 0x555b44d11120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0f450 0x555b44d0f870 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 --2- 172.21.15.12:0/93633702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0fdb0 0x555b44d106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 -- 172.21.15.12:0/93633702 >> 172.21.15.12:0/93633702 conn(0x555b44c3e860 msgr2=0x555b44d0be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 -- 172.21.15.12:0/93633702 shutdown_connections 2023-12-11T20:29:06.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.529+0000 7f69bef11b80 1 -- 172.21.15.12:0/93633702 wait complete. 2023-12-11T20:29:06.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.530+0000 7f69bef11b80 1 -- start start 2023-12-11T20:29:06.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.530+0000 7f69bef11b80 1 Processor -- start 2023-12-11T20:29:06.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d19210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d19750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d20790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69bef11b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44c1d5e0 con 0x555b44d0fdb0 2023-12-11T20:29:06.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69bef11b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44c1d280 con 0x555b44d0f450 2023-12-11T20:29:06.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69bef11b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44ae29a0 con 0x555b44d10ca0 2023-12-11T20:29:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69bef11b80 10 client.0 _ll_register_callbacks cb 0x555b44b48b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69a8b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d19750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69a939b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d19210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69a8b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d19750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34128/0 (socket says 172.21.15.12:34128) 2023-12-11T20:29:06.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.531+0000 7f69a8b9a700 1 -- 172.21.15.12:0/73855816 learned_addr learned my addr 172.21.15.12:0/73855816 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d20790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a939b700 1 -- 172.21.15.12:0/73855816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 msgr2=0x555b44d20790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a939b700 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d20790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a939b700 1 -- 172.21.15.12:0/73855816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 msgr2=0x555b44d19750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a939b700 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d19750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a939b700 1 -- 172.21.15.12:0/73855816 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c009980 con 0x555b44d0f450 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d19750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d20790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f69a939b700 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d19210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f69a0003f60 tx=0x7f69a0005440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51948025128153f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.532+0000 7f698cff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.533+0000 7f698cff9700 1 -- 172.21.15.12:0/73855816 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0003b90 con 0x555b44d0f450 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.533+0000 7f69bef11b80 1 -- 172.21.15.12:0/73855816 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b44cdefc0 con 0x555b44d0f450 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.533+0000 7f698cff9700 1 -- 172.21.15.12:0/73855816 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f69a0003cf0 con 0x555b44d0f450 2023-12-11T20:29:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.533+0000 7f698cff9700 1 -- 172.21.15.12:0/73855816 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69a000b710 con 0x555b44d0f450 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.533+0000 7f69bef11b80 10 client.28838 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.533+0000 7f69bef11b80 1 -- 172.21.15.12:0/73855816 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555b44a8ce60 con 0x555b44d0f450 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.533+0000 7f698cff9700 1 -- 172.21.15.12:0/73855816 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69a0033080 con 0x555b44d0f450 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.534+0000 7f698cff9700 1 -- 172.21.15.12:0/73855816 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f69a0004a30 con 0x555b44d0f450 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.534+0000 7f69bef11b80 10 client.28838 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.534+0000 7f69bef11b80 10 client.28838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.534+0000 7f69bef11b80 20 client.28838 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.534+0000 7f69bef11b80 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555b44d25060 0x555b44d27480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.534+0000 7f69bef11b80 4 client.28838 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.534+0000 7f69bef11b80 1 -- 172.21.15.12:0/73855816 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b44c2a050 con 0x555b44d25060 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.534+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555b44d25060 0x555b44d27480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.535+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555b44d25060 0x555b44d27480 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b914b10316b3d54 server_cookie=d244cab87ba26b01 in_seq=0 out_seq=0 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.535+0000 7f698cff9700 10 client.28838 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f698cff9700 1 -- 172.21.15.12:0/73855816 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555b44c2a050 con 0x555b44d25060 2023-12-11T20:29:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f698cff9700 10 client.28838 handle_command_reply: tid=0 2023-12-11T20:29:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 client.28838 shutdown 2023-12-11T20:29:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 -- 172.21.15.12:0/73855816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 msgr2=0x555b44d19210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d19210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f69a0003f60 tx=0x7f69a0005440 comp rx=0 tx=0).stop 2023-12-11T20:29:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 -- 172.21.15.12:0/73855816 shutdown_connections 2023-12-11T20:29:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555b44d25060 0x555b44d27480 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d19210 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d20790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f698cff9700 0 client.28838 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 --2- 172.21.15.12:0/73855816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d19750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 -- 172.21.15.12:0/73855816 >> 172.21.15.12:0/73855816 conn(0x555b44c3e860 msgr2=0x555b44d0aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 -- 172.21.15.12:0/73855816 shutdown_connections 2023-12-11T20:29:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.536+0000 7f69bef11b80 1 -- 172.21.15.12:0/73855816 wait complete. 2023-12-11T20:29:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.537+0000 7f69bef11b80 20 client.28838 trim_cache size 0 max 16384 2023-12-11T20:29:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.557+0000 7f69bef11b80 1 Processor -- start 2023-12-11T20:29:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69bef11b80 1 -- start start 2023-12-11T20:29:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0f450 0x555b44d196d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 0x555b44d0a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69bef11b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44d185b0 con 0x555b44d0fdb0 2023-12-11T20:29:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69bef11b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44d06bd0 con 0x555b44d10ca0 2023-12-11T20:29:06.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69bef11b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44d0eff0 con 0x555b44d0f450 2023-12-11T20:29:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69a8b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69a8b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34138/0 (socket says 172.21.15.12:34138) 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69a8b9a700 1 -- 172.21.15.12:0/1909224139 learned_addr learned my addr 172.21.15.12:0/1909224139 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 0x555b44d0a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.558+0000 7f69a939b700 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0f450 0x555b44d196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f69a8b9a700 1 -- 172.21.15.12:0/1909224139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0f450 msgr2=0x555b44d196d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0f450 0x555b44d196d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f69a8b9a700 1 -- 172.21.15.12:0/1909224139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 msgr2=0x555b44d0a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 0x555b44d0a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f69a8b9a700 1 -- 172.21.15.12:0/1909224139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b44a75ce0 con 0x555b44d0fdb0 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20750 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f6994096820 tx=0x7f69940ca9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46758403008700bd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f698ffff700 1 -- 172.21.15.12:0/1909224139 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699409a0f0 con 0x555b44d0fdb0 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f698ffff700 1 -- 172.21.15.12:0/1909224139 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6994099e60 con 0x555b44d0fdb0 2023-12-11T20:29:06.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.559+0000 7f698ffff700 1 -- 172.21.15.12:0/1909224139 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940a26b0 con 0x555b44d0fdb0 2023-12-11T20:29:06.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 -- 172.21.15.12:0/1909224139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 msgr2=0x555b44d20750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20750 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f6994096820 tx=0x7f69940ca9d0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 -- 172.21.15.12:0/1909224139 shutdown_connections 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d10ca0 0x555b44d0a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d0f450 0x555b44d196d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 --2- 172.21.15.12:0/1909224139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20750 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 -- 172.21.15.12:0/1909224139 >> 172.21.15.12:0/1909224139 conn(0x555b44c3e860 msgr2=0x555b44d18fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 -- 172.21.15.12:0/1909224139 shutdown_connections 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.560+0000 7f69bef11b80 1 -- 172.21.15.12:0/1909224139 wait complete. 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.561+0000 7f69bef11b80 1 -- start start 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.561+0000 7f69bef11b80 1 Processor -- start 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.561+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d1fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.561+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.561+0000 7f69bef11b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d7ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.561+0000 7f69bef11b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44d7bfa0 con 0x555b44d0fdb0 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.561+0000 7f69bef11b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44d7c0e0 con 0x555b44d0f450 2023-12-11T20:29:06.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.561+0000 7f69bef11b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b44d7c2a0 con 0x555b44d10ca0 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69bef11b80 10 client.0 _ll_register_callbacks cb 0x555b44b48b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34140/0 (socket says 172.21.15.12:34140) 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 -- 172.21.15.12:0/339298059 learned_addr learned my addr 172.21.15.12:0/339298059 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a939b700 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d1fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a9b9c700 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d7ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 -- 172.21.15.12:0/339298059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 msgr2=0x555b44d7ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d7ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 -- 172.21.15.12:0/339298059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 msgr2=0x555b44d1fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d1fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 -- 172.21.15.12:0/339298059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a41a1b40 con 0x555b44d0fdb0 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f69a8b9a700 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20240 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f69940d0390 tx=0x7f699409e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c6e0b8e87bf45d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.562+0000 7f698cff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.563+0000 7f698cff9700 1 -- 172.21.15.12:0/339298059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994099c80 con 0x555b44d0fdb0 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.563+0000 7f698cff9700 1 -- 172.21.15.12:0/339298059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f699409aa20 con 0x555b44d0fdb0 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.563+0000 7f69bef11b80 1 -- 172.21.15.12:0/339298059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b44d02bc0 con 0x555b44d0fdb0 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.563+0000 7f698cff9700 1 -- 172.21.15.12:0/339298059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69940a26b0 con 0x555b44d0fdb0 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.563+0000 7f69bef11b80 10 client.19275 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.563+0000 7f69bef11b80 1 -- 172.21.15.12:0/339298059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555b44ab32d0 con 0x555b44d0fdb0 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.563+0000 7f698cff9700 1 -- 172.21.15.12:0/339298059 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555b44d02bc0 con 0x555b44d0fdb0 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.564+0000 7f698cff9700 1 -- 172.21.15.12:0/339298059 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6994099280 con 0x555b44d0fdb0 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.564+0000 7f69bef11b80 10 client.19275 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.564+0000 7f69bef11b80 10 client.19275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.564+0000 7f69bef11b80 20 client.19275 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.564+0000 7f69bef11b80 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555b44d7d930 0x555b44d7fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.564+0000 7f69bef11b80 4 client.19275 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.564+0000 7f69bef11b80 1 -- 172.21.15.12:0/339298059 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555b44c1c510 con 0x555b44d7d930 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.564+0000 7f69a939b700 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555b44d7d930 0x555b44d7fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.565+0000 7f69a939b700 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555b44d7d930 0x555b44d7fd50 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93d47755747da265 server_cookie=88282235651d9b2c in_seq=0 out_seq=0 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.565+0000 7f698cff9700 10 client.19275 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f698cff9700 1 -- 172.21.15.12:0/339298059 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555b44c1c510 con 0x555b44d7d930 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f698cff9700 10 client.19275 handle_command_reply: tid=0 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 client.19275 shutdown 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 -- 172.21.15.12:0/339298059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 msgr2=0x555b44d20240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20240 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f69940d0390 tx=0x7f699409e5e0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 -- 172.21.15.12:0/339298059 shutdown_connections 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555b44d7d930 0x555b44d7fd50 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555b44d0f450 0x555b44d1fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555b44d10ca0 0x555b44d7ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 --2- 172.21.15.12:0/339298059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b44d0fdb0 0x555b44d20240 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 -- 172.21.15.12:0/339298059 >> 172.21.15.12:0/339298059 conn(0x555b44c3e860 msgr2=0x555b44d04550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f698cff9700 0 client.19275 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.566+0000 7f69bef11b80 1 -- 172.21.15.12:0/339298059 shutdown_connections 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.567+0000 7f69bef11b80 1 -- 172.21.15.12:0/339298059 wait complete. 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.567+0000 7f69bef11b80 20 client.19275 trim_cache size 0 max 16384 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "549de5e1-5246-4f2e-b993-3fd4af79c4a4", 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:29:06.568 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:29:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.567+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69900a1480 msgr2=0x7f69900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.567+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69900a1480 0x7f69900a3940 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f699c007fd0 tx=0x7f699c01b000 comp rx=0 tx=0).stop 2023-12-11T20:29:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a41048b0 msgr2=0x7f69a4199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a41048b0 0x7f69a4199a90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f699400e9a0 tx=0x7f699400ed60 comp rx=0 tx=0).stop 2023-12-11T20:29:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3580738235 shutdown_connections 2023-12-11T20:29:06.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f69900a1480 0x7f69900a3940 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69a4101f80 0x7f69a4199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69a41071e0 0x7f69a41a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 --2- 172.21.15.12:0/3580738235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69a41048b0 0x7f69a4199a90 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3580738235 >> 172.21.15.12:0/3580738235 conn(0x7f69a40fb930 msgr2=0x7f69a4101650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3580738235 shutdown_connections 2023-12-11T20:29:06.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.568+0000 7f69ab5ff700 1 -- 172.21.15.12:0/3580738235 wait complete. 2023-12-11T20:29:06.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:29:06.660 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:06 smithi012 ceph-mon[128787]: pgmap v770: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:29:06.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:06 smithi039 ceph-mon[102205]: pgmap v770: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 -- 172.21.15.12:0/4016712755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 msgr2=0x7faadc10fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 --2- 172.21.15.12:0/4016712755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 0x7faadc10fe70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7faad400b0a0 tx=0x7faad400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 -- 172.21.15.12:0/4016712755 shutdown_connections 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 --2- 172.21.15.12:0/4016712755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 0x7faadc10fe70 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 --2- 172.21.15.12:0/4016712755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faadc075610 0x7faadc073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 --2- 172.21.15.12:0/4016712755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faadc074030 0x7faadc0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 -- 172.21.15.12:0/4016712755 >> 172.21.15.12:0/4016712755 conn(0x7faadc0fca00 msgr2=0x7faadc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 -- 172.21.15.12:0/4016712755 shutdown_connections 2023-12-11T20:29:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.838+0000 7faae1dff700 1 -- 172.21.15.12:0/4016712755 wait complete. 2023-12-11T20:29:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faae1dff700 1 Processor -- start 2023-12-11T20:29:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faae1dff700 1 -- start start 2023-12-11T20:29:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faae1dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faadc074030 0x7faadc19da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faae1dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faadc075610 0x7faadc19df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faae1dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 0x7faadc1a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faae1dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc1a5550 con 0x7faadc10da80 2023-12-11T20:29:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faae1dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc1a5690 con 0x7faadc075610 2023-12-11T20:29:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faae1dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc1a5820 con 0x7faadc074030 2023-12-11T20:29:06.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.840+0000 7faadbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 0x7faadc1a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 0x7faadc1a4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34168/0 (socket says 172.21.15.12:34168) 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadbfff700 1 -- 172.21.15.12:0/2399678355 learned_addr learned my addr 172.21.15.12:0/2399678355 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadb7fe700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faadc074030 0x7faadc19da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadaffd700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faadc075610 0x7faadc19df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadbfff700 1 -- 172.21.15.12:0/2399678355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faadc074030 msgr2=0x7faadc19da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadbfff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faadc074030 0x7faadc19da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadbfff700 1 -- 172.21.15.12:0/2399678355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faadc075610 msgr2=0x7faadc19df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadbfff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faadc075610 0x7faadc19df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadbfff700 1 -- 172.21.15.12:0/2399678355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4009d00 con 0x7faadc10da80 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadb7fe700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faadc074030 0x7faadc19da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.841+0000 7faadbfff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 0x7faadc1a4f80 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7faad400b780 tx=0x7faad400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.842+0000 7faad8ff9700 1 -- 172.21.15.12:0/2399678355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400e040 con 0x7faadc10da80 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.842+0000 7faad8ff9700 1 -- 172.21.15.12:0/2399678355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faad4003c00 con 0x7faadc10da80 2023-12-11T20:29:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.842+0000 7faae1dff700 1 -- 172.21.15.12:0/2399678355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc1a5aa0 con 0x7faadc10da80 2023-12-11T20:29:06.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.842+0000 7faad8ff9700 1 -- 172.21.15.12:0/2399678355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40052a0 con 0x7faadc10da80 2023-12-11T20:29:06.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.842+0000 7faae1dff700 1 -- 172.21.15.12:0/2399678355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc1a5ec0 con 0x7faadc10da80 2023-12-11T20:29:06.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.845+0000 7faad8ff9700 1 -- 172.21.15.12:0/2399678355 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7faad401d480 con 0x7faadc10da80 2023-12-11T20:29:06.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.847+0000 7faad8ff9700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faac40a1480 0x7faac40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.847+0000 7faaf56fcb80 1 Processor -- start 2023-12-11T20:29:06.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.847+0000 7faad8ff9700 1 -- 172.21.15.12:0/2399678355 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faad40cdda0 con 0x7faadc10da80 2023-12-11T20:29:06.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.847+0000 7faaf56fcb80 1 -- start start 2023-12-11T20:29:06.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faadb7fe700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faac40a1480 0x7faac40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 0x55f5ecdaf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 0x55f5ecdb00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecd09b50 con 0x55f5ecdae3d0 2023-12-11T20:29:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecd07470 con 0x55f5ecdafc20 2023-12-11T20:29:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecd02d60 con 0x55f5ecdaed30 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34180/0 (socket says 172.21.15.12:34180) 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faadb7fe700 1 -- 172.21.15.12:0/3803972928 learned_addr learned my addr 172.21.15.12:0/3803972928 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faadbfff700 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 0x55f5ecdb00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.848+0000 7faadaffd700 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 0x55f5ecdaf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faadbfff700 1 -- 172.21.15.12:0/3803972928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 msgr2=0x55f5ecdaf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faadbfff700 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 0x55f5ecdaf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faadbfff700 1 -- 172.21.15.12:0/3803972928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 msgr2=0x55f5ecdae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faadbfff700 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faadbfff700 1 -- 172.21.15.12:0/3803972928 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5ecb7f630 con 0x55f5ecdafc20 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faadb7fe700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faac40a1480 0x7faac40a3940 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faacc0139a0 tx=0x7faacc013d60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faadbfff700 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 0x55f5ecdb00a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faad4009fd0 tx=0x7faad4003f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ecdd02a7905b619 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faac1ffb700 1 -- 172.21.15.12:0/3803972928 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad408a6d0 con 0x55f5ecdafc20 2023-12-11T20:29:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faac1ffb700 1 -- 172.21.15.12:0/3803972928 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faad4003d70 con 0x55f5ecdafc20 2023-12-11T20:29:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.849+0000 7faac1ffb700 1 -- 172.21.15.12:0/3803972928 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad408aa50 con 0x55f5ecdafc20 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3803972928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 msgr2=0x55f5ecdb00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 0x55f5ecdb00a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faad4009fd0 tx=0x7faad4003f50 comp rx=0 tx=0).stop 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3803972928 shutdown_connections 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 0x55f5ecdb00a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3803972928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 0x55f5ecdaf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3803972928 >> 172.21.15.12:0/3803972928 conn(0x55f5eccdd7e0 msgr2=0x55f5ecdaad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3803972928 shutdown_connections 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.850+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3803972928 wait complete. 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.851+0000 7faaf56fcb80 1 -- start start 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.851+0000 7faaf56fcb80 1 Processor -- start 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5eccbc560 con 0x55f5ecdae3d0 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5eccbc200 con 0x55f5ecdafc20 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecb81920 con 0x55f5ecdaed30 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faaf56fcb80 10 client.0 _ll_register_callbacks cb 0x55f5ecbe7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34182/0 (socket says 172.21.15.12:34182) 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadb7fe700 1 -- 172.21.15.12:0/1322437542 learned_addr learned my addr 172.21.15.12:0/1322437542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadaffd700 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadb7fe700 1 -- 172.21.15.12:0/1322437542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 msgr2=0x55f5ecdb84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadb7fe700 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadb7fe700 1 -- 172.21.15.12:0/1322437542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 msgr2=0x55f5ecdbf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadb7fe700 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.852+0000 7faadb7fe700 1 -- 172.21.15.12:0/1322437542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc1a5ec0 con 0x55f5ecdae3d0 2023-12-11T20:29:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.853+0000 7faadb7fe700 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb7f90 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7faacc00fbe0 tx=0x7faacc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34348370f6718a83 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.853+0000 7faabaffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.853+0000 7faabaffd700 1 -- 172.21.15.12:0/1322437542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc018040 con 0x55f5ecdae3d0 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.853+0000 7faabaffd700 1 -- 172.21.15.12:0/1322437542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faacc010e40 con 0x55f5ecdae3d0 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.853+0000 7faaf56fcb80 1 -- 172.21.15.12:0/1322437542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5ecda1b40 con 0x55f5ecdae3d0 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.853+0000 7faabaffd700 1 -- 172.21.15.12:0/1322437542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7faacc004030 con 0x55f5ecdae3d0 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faaf56fcb80 10 client.19287 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faaf56fcb80 1 -- 172.21.15.12:0/1322437542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f5ecb2bde0 con 0x55f5ecdae3d0 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faabaffd700 1 -- 172.21.15.12:0/1322437542 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f5ecda1b40 con 0x55f5ecdae3d0 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faabaffd700 1 -- 172.21.15.12:0/1322437542 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faacc005020 con 0x55f5ecdae3d0 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faaf56fcb80 10 client.19287 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faaf56fcb80 10 client.19287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faaf56fcb80 20 client.19287 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5ecdc3e80 0x55f5ecdc62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faaf56fcb80 4 client.19287 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.854+0000 7faaf56fcb80 1 -- 172.21.15.12:0/1322437542 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5ecd7df40 con 0x55f5ecdc3e80 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.855+0000 7faadaffd700 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5ecdc3e80 0x55f5ecdc62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.855+0000 7faabaffd700 10 client.19287 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.855+0000 7faadaffd700 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5ecdc3e80 0x55f5ecdc62a0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdfeaaeebd18862a server_cookie=1ea3c9392b50f834 in_seq=0 out_seq=0 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faabaffd700 1 -- 172.21.15.12:0/1322437542 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f5ecd7df40 con 0x55f5ecdc3e80 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faabaffd700 10 client.19287 handle_command_reply: tid=0 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 client.19287 shutdown 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 -- 172.21.15.12:0/1322437542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 msgr2=0x55f5ecdb7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb7f90 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7faacc00fbe0 tx=0x7faacc0047c0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 -- 172.21.15.12:0/1322437542 shutdown_connections 2023-12-11T20:29:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5ecdc3e80 0x55f5ecdc62a0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb7f90 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/1322437542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faabaffd700 0 client.19287 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.856+0000 7faaf56fcb80 1 -- 172.21.15.12:0/1322437542 >> 172.21.15.12:0/1322437542 conn(0x55f5eccdd7e0 msgr2=0x55f5ecda9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.857+0000 7faaf56fcb80 1 -- 172.21.15.12:0/1322437542 shutdown_connections 2023-12-11T20:29:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.857+0000 7faaf56fcb80 1 -- 172.21.15.12:0/1322437542 wait complete. 2023-12-11T20:29:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.857+0000 7faaf56fcb80 20 client.19287 trim_cache size 0 max 16384 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.875+0000 7faaf56fcb80 1 Processor -- start 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.875+0000 7faaf56fcb80 1 -- start start 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.875+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.875+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.875+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.875+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecdc0690 con 0x55f5ecdae3d0 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecdb7b00 con 0x55f5ecdaed30 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecda5b70 con 0x55f5ecdafc20 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34188/0 (socket says 172.21.15.12:34188) 2023-12-11T20:29:06.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadb7fe700 1 -- 172.21.15.12:0/3161280306 learned_addr learned my addr 172.21.15.12:0/3161280306 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadaffd700 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadb7fe700 1 -- 172.21.15.12:0/3161280306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 msgr2=0x55f5ecdbf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadbfff700 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadb7fe700 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadb7fe700 1 -- 172.21.15.12:0/3161280306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 msgr2=0x55f5ecdb3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadb7fe700 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadb7fe700 1 -- 172.21.15.12:0/3161280306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5ecb14c60 con 0x55f5ecdae3d0 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadaffd700 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.876+0000 7faadbfff700 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.877+0000 7faadb7fe700 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb2bd0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7faacc009ec0 tx=0x7faacc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59100d7f758d874f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.877+0000 7faac27fc700 1 -- 172.21.15.12:0/3161280306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc038070 con 0x55f5ecdae3d0 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.877+0000 7faac27fc700 1 -- 172.21.15.12:0/3161280306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faacc02e020 con 0x55f5ecdae3d0 2023-12-11T20:29:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.877+0000 7faac27fc700 1 -- 172.21.15.12:0/3161280306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc018070 con 0x55f5ecdae3d0 2023-12-11T20:29:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3161280306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 msgr2=0x55f5ecdb2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb2bd0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7faacc009ec0 tx=0x7faacc009260 comp rx=0 tx=0).stop 2023-12-11T20:29:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3161280306 shutdown_connections 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdb2bd0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3161280306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdb3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3161280306 >> 172.21.15.12:0/3161280306 conn(0x55f5eccdd7e0 msgr2=0x55f5ecdcac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3161280306 shutdown_connections 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3161280306 wait complete. 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.878+0000 7faaf56fcb80 1 -- start start 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.879+0000 7faaf56fcb80 1 Processor -- start 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.879+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdbf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.879+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdbd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.879+0000 7faaf56fcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.879+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecdbe420 con 0x55f5ecdae3d0 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.879+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecdbe590 con 0x55f5ecdaed30 2023-12-11T20:29:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.879+0000 7faaf56fcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ecdbe750 con 0x55f5ecdafc20 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.879+0000 7faaf56fcb80 10 client.0 _ll_register_callbacks cb 0x55f5ecbe7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdbf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdbd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdbf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34202/0 (socket says 172.21.15.12:34202) 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadb7fe700 1 -- 172.21.15.12:0/3119600869 learned_addr learned my addr 172.21.15.12:0/3119600869 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadbfff700 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadaffd700 1 -- 172.21.15.12:0/3119600869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 msgr2=0x55f5ecdbdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadaffd700 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadaffd700 1 -- 172.21.15.12:0/3119600869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 msgr2=0x55f5ecdbf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadaffd700 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdbf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadaffd700 1 -- 172.21.15.12:0/3119600869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5ecb2bde0 con 0x55f5ecdaed30 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadb7fe700 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdbf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faadaffd700 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdbd9a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55f5ecdc6880 tx=0x7faad0010870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=850a3b64b15bec8f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.880+0000 7faabaffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faabaffd700 1 -- 172.21.15.12:0/3119600869 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0004240 con 0x55f5ecdaed30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3119600869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faad4003d70 con 0x55f5ecdaed30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faabaffd700 1 -- 172.21.15.12:0/3119600869 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faad00043a0 con 0x55f5ecdaed30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faabaffd700 1 -- 172.21.15.12:0/3119600869 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7faad0004560 con 0x55f5ecdaed30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faaf56fcb80 10 client.28859 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3119600869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f5ecb52250 con 0x55f5ecdaed30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faabaffd700 1 -- 172.21.15.12:0/3119600869 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faad4003d70 con 0x55f5ecdaed30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faabaffd700 1 -- 172.21.15.12:0/3119600869 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faad001f2c0 con 0x55f5ecdaed30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faaf56fcb80 10 client.28859 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faaf56fcb80 10 client.28859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.881+0000 7faaf56fcb80 20 client.28859 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.882+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5ece1bb90 0x55f5ece1dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.882+0000 7faaf56fcb80 4 client.28859 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:29:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.882+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3119600869 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f5eccc8fd0 con 0x55f5ece1bb90 2023-12-11T20:29:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.882+0000 7faadb7fe700 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5ece1bb90 0x55f5ece1dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.882+0000 7faadb7fe700 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5ece1bb90 0x55f5ece1dfb0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e941c1701324171 server_cookie=73a5589c0a252ff6 in_seq=0 out_seq=0 2023-12-11T20:29:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.882+0000 7faabaffd700 10 client.28859 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faabaffd700 1 -- 172.21.15.12:0/3119600869 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f5eccc8fd0 con 0x55f5ece1bb90 2023-12-11T20:29:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faabaffd700 10 client.28859 handle_command_reply: tid=0 2023-12-11T20:29:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 client.28859 shutdown 2023-12-11T20:29:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3119600869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 msgr2=0x55f5ecdbd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdbd9a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55f5ecdc6880 tx=0x7faad0010870 comp rx=0 tx=0).stop 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3119600869 shutdown_connections 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5ece1bb90 0x55f5ece1dfb0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5ecdafc20 0x55f5ecdbdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5ecdae3d0 0x55f5ecdbf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 --2- 172.21.15.12:0/3119600869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5ecdaed30 0x55f5ecdbd9a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faabaffd700 0 client.28859 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3119600869 >> 172.21.15.12:0/3119600869 conn(0x55f5eccdd7e0 msgr2=0x55f5ecdaa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3119600869 shutdown_connections 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 1 -- 172.21.15.12:0/3119600869 wait complete. 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.883+0000 7faaf56fcb80 20 client.28859 trim_cache size 0 max 16384 2023-12-11T20:29:06.886 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout: "549de5e1-5246-4f2e-b993-3fd4af79c4a4": { 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "549de5e1-5246-4f2e-b993-3fd4af79c4a4", 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:29:06.887 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 -- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faac40a1480 msgr2=0x7faac40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faac40a1480 0x7faac40a3940 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faacc0139a0 tx=0x7faacc013d60 comp rx=0 tx=0).stop 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 -- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 msgr2=0x7faadc1a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 0x7faadc1a4f80 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7faad400b780 tx=0x7faad400bab0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 -- 172.21.15.12:0/2399678355 shutdown_connections 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faac40a1480 0x7faac40a3940 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faadc10da80 0x7faadc1a4f80 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faadc074030 0x7faadc19da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 --2- 172.21.15.12:0/2399678355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faadc075610 0x7faadc19df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 -- 172.21.15.12:0/2399678355 >> 172.21.15.12:0/2399678355 conn(0x7faadc0fca00 msgr2=0x7faadc100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 -- 172.21.15.12:0/2399678355 shutdown_connections 2023-12-11T20:29:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:06.884+0000 7faae1dff700 1 -- 172.21.15.12:0/2399678355 wait complete. 2023-12-11T20:29:06.906 INFO:tasks.cephfs.filesystem:scrub status for tag:549de5e1-5246-4f2e-b993-3fd4af79c4a4 - {'path': '/', 'tag': '549de5e1-5246-4f2e-b993-3fd4af79c4a4', 'options': 'recursive,force'} 2023-12-11T20:29:06.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:06 smithi032 ceph-mon[132488]: pgmap v770: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 16 op/s 2023-12-11T20:29:07.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:07 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:29:07.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:07 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:29:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:07 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:29:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:07 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:29:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:07 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:07 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:29:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:07 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:29:07.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:07 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:29:07.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:07 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:29:07.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:07 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:07 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:29:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:07 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:29:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:07 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:29:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:07 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:29:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:07.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:07 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:08.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:08 smithi039 ceph-mon[102205]: pgmap v771: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:29:08.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:08 smithi012 ceph-mon[128787]: pgmap v771: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:29:08.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:08 smithi032 ceph-mon[132488]: pgmap v771: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 18 op/s 2023-12-11T20:29:10.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:10 smithi039 ceph-mon[102205]: pgmap v772: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 25 op/s 2023-12-11T20:29:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:10 smithi012 ceph-mon[128787]: pgmap v772: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 25 op/s 2023-12-11T20:29:10.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:10 smithi032 ceph-mon[132488]: pgmap v772: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 25 op/s 2023-12-11T20:29:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.242+0000 7f5732d9d700 1 -- 172.21.15.12:0/1248139380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 msgr2=0x7f572c100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.242+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1248139380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 0x7f572c100610 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f57280099c0 tx=0x7f5728009cd0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.242+0000 7f5732d9d700 1 -- 172.21.15.12:0/1248139380 shutdown_connections 2023-12-11T20:29:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.242+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1248139380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f572c101d80 0x7f572c108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.242+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1248139380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 0x7f572c100610 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.242+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1248139380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c1013e0 0x7f572c101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.242+0000 7f5732d9d700 1 -- 172.21.15.12:0/1248139380 >> 172.21.15.12:0/1248139380 conn(0x7f572c0fb780 msgr2=0x7f572c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.243+0000 7f5732d9d700 1 -- 172.21.15.12:0/1248139380 shutdown_connections 2023-12-11T20:29:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.243+0000 7f5732d9d700 1 -- 172.21.15.12:0/1248139380 wait complete. 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5732d9d700 1 Processor -- start 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5732d9d700 1 -- start start 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5732d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 0x7f572c197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5732d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c1013e0 0x7f572c197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5732d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f572c101d80 0x7f572c19e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5732d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c19ece0 con 0x7f572c1001f0 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5732d9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c19ee20 con 0x7f572c1013e0 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5732d9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c19efb0 con 0x7f572c101d80 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5731d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 0x7f572c197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5731d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 0x7f572c197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55300/0 (socket says 172.21.15.12:55300) 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.244+0000 7f5731d9b700 1 -- 172.21.15.12:0/1317703890 learned_addr learned my addr 172.21.15.12:0/1317703890 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.245+0000 7f573159a700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c1013e0 0x7f572c197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.245+0000 7f573259c700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f572c101d80 0x7f572c19e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.245+0000 7f5731d9b700 1 -- 172.21.15.12:0/1317703890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f572c101d80 msgr2=0x7f572c19e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.245+0000 7f5731d9b700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f572c101d80 0x7f572c19e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.245+0000 7f5731d9b700 1 -- 172.21.15.12:0/1317703890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c1013e0 msgr2=0x7f572c197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.245+0000 7f5731d9b700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c1013e0 0x7f572c197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.245+0000 7f5731d9b700 1 -- 172.21.15.12:0/1317703890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280095f0 con 0x7f572c1001f0 2023-12-11T20:29:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.245+0000 7f5731d9b700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 0x7f572c197200 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5728009f50 tx=0x7f5728003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.246+0000 7f5722ffd700 1 -- 172.21.15.12:0/1317703890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572801d070 con 0x7f572c1001f0 2023-12-11T20:29:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.246+0000 7f5722ffd700 1 -- 172.21.15.12:0/1317703890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f572800bda0 con 0x7f572c1001f0 2023-12-11T20:29:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.246+0000 7f5732d9d700 1 -- 172.21.15.12:0/1317703890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c19f230 con 0x7f572c1001f0 2023-12-11T20:29:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.246+0000 7f5722ffd700 1 -- 172.21.15.12:0/1317703890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728022d60 con 0x7f572c1001f0 2023-12-11T20:29:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.246+0000 7f5732d9d700 1 -- 172.21.15.12:0/1317703890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c19f6b0 con 0x7f572c1001f0 2023-12-11T20:29:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.249+0000 7f5722ffd700 1 -- 172.21.15.12:0/1317703890 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5728022500 con 0x7f572c1001f0 2023-12-11T20:29:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.251+0000 7f5722ffd700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57180a14f0 0x7f57180a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.251+0000 7f5722ffd700 1 -- 172.21.15.12:0/1317703890 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f57280cdfb0 con 0x7f572c1001f0 2023-12-11T20:29:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.251+0000 7f573159a700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57180a14f0 0x7f57180a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.251+0000 7f57479c6b80 1 Processor -- start 2023-12-11T20:29:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f57479c6b80 1 -- start start 2023-12-11T20:29:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f573159a700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57180a14f0 0x7f57180a39b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f571c007c60 tx=0x7f571c0073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bef4f0 0x560d15bef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 0x560d15bf0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bf11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f57479c6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15b46af0 con 0x560d15bf0d40 2023-12-11T20:29:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f57479c6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15b44410 con 0x560d15bef4f0 2023-12-11T20:29:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f57479c6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15b3fd00 con 0x560d15befe50 2023-12-11T20:29:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f573259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bf11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f573259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bf11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55302/0 (socket says 172.21.15.12:55302) 2023-12-11T20:29:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f573259c700 1 -- 172.21.15.12:0/3639868655 learned_addr learned my addr 172.21.15.12:0/3639868655 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.252+0000 7f573159a700 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 0x560d15bf0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f5731d9b700 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bef4f0 0x560d15bef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f573259c700 1 -- 172.21.15.12:0/3639868655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 msgr2=0x560d15bf0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:11.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f573259c700 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 0x560d15bf0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f573259c700 1 -- 172.21.15.12:0/3639868655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bef4f0 msgr2=0x560d15bef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f573259c700 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bef4f0 0x560d15bef910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f573259c700 1 -- 172.21.15.12:0/3639868655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d159bc5d0 con 0x560d15bf0d40 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f5731d9b700 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bef4f0 0x560d15bef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f573259c700 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bf11c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f5724009d20 tx=0x7f57240077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67af64b1393b60c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f5717fff700 1 -- 172.21.15.12:0/3639868655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724018070 con 0x560d15bf0d40 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f5717fff700 1 -- 172.21.15.12:0/3639868655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f572400f050 con 0x560d15bf0d40 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.253+0000 7f5717fff700 1 -- 172.21.15.12:0/3639868655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724005940 con 0x560d15bf0d40 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 -- 172.21.15.12:0/3639868655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 msgr2=0x560d15bf11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bf11c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f5724009d20 tx=0x7f57240077e0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 -- 172.21.15.12:0/3639868655 shutdown_connections 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bef4f0 0x560d15bef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bf11c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 --2- 172.21.15.12:0/3639868655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 0x560d15bf0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 -- 172.21.15.12:0/3639868655 >> 172.21.15.12:0/3639868655 conn(0x560d15b1a780 msgr2=0x560d15be7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 -- 172.21.15.12:0/3639868655 shutdown_connections 2023-12-11T20:29:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.254+0000 7f57479c6b80 1 -- 172.21.15.12:0/3639868655 wait complete. 2023-12-11T20:29:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.255+0000 7f57479c6b80 1 -- start start 2023-12-11T20:29:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.255+0000 7f57479c6b80 1 Processor -- start 2023-12-11T20:29:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15bf9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 0x560d15bf9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bf0d40 0x560d15c00890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f57479c6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15af9500 con 0x560d15bef4f0 2023-12-11T20:29:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f57479c6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15af91a0 con 0x560d15bf0d40 2023-12-11T20:29:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f57479c6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d159be8c0 con 0x560d15befe50 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f57479c6b80 10 client.0 _ll_register_callbacks cb 0x560d15a24a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f5731d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15bf9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f5731d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15bf9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55312/0 (socket says 172.21.15.12:55312) 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f5731d9b700 1 -- 172.21.15.12:0/2561730985 learned_addr learned my addr 172.21.15.12:0/2561730985 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f573159a700 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 0x560d15bf9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f573259c700 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bf0d40 0x560d15c00890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f5731d9b700 1 -- 172.21.15.12:0/2561730985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 msgr2=0x560d15bf9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f5731d9b700 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 0x560d15bf9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.256+0000 7f5731d9b700 1 -- 172.21.15.12:0/2561730985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bf0d40 msgr2=0x560d15c00890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f5731d9b700 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bf0d40 0x560d15c00890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f5731d9b700 1 -- 172.21.15.12:0/2561730985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5724009980 con 0x560d15bef4f0 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f5731d9b700 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15bf9310 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f5728097d20 tx=0x7f572809b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33462810b8c8ffcf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f57157fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f57157fa700 1 -- 172.21.15.12:0/2561730985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572809adf0 con 0x560d15bef4f0 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f57157fa700 1 -- 172.21.15.12:0/2561730985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f572809b9b0 con 0x560d15bef4f0 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f57479c6b80 1 -- 172.21.15.12:0/2561730985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d15bde730 con 0x560d15bef4f0 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f57157fa700 1 -- 172.21.15.12:0/2561730985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f572809ac10 con 0x560d15bef4f0 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f57479c6b80 10 client.19305 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.257+0000 7f57479c6b80 1 -- 172.21.15.12:0/2561730985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560d15968d80 con 0x560d15bef4f0 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.258+0000 7f57157fa700 1 -- 172.21.15.12:0/2561730985 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d15bde730 con 0x560d15bef4f0 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.258+0000 7f57157fa700 1 -- 172.21.15.12:0/2561730985 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f57280a31b0 con 0x560d15bef4f0 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.258+0000 7f57479c6b80 10 client.19305 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.258+0000 7f57479c6b80 10 client.19305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.258+0000 7f57479c6b80 20 client.19305 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.258+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560d15c04cc0 0x560d15c070e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.258+0000 7f57479c6b80 4 client.19305 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.258+0000 7f57479c6b80 1 -- 172.21.15.12:0/2561730985 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d15bbaee0 con 0x560d15c04cc0 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.259+0000 7f573159a700 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560d15c04cc0 0x560d15c070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.259+0000 7f573159a700 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560d15c04cc0 0x560d15c070e0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67a7ee36e572b378 server_cookie=bf62115b813da873 in_seq=0 out_seq=0 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.259+0000 7f57157fa700 10 client.19305 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.260+0000 7f57157fa700 1 -- 172.21.15.12:0/2561730985 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560d15bbaee0 con 0x560d15c04cc0 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.260+0000 7f57157fa700 10 client.19305 handle_command_reply: tid=0 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.260+0000 7f57479c6b80 1 client.19305 shutdown 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.260+0000 7f57479c6b80 1 -- 172.21.15.12:0/2561730985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 msgr2=0x560d15bf9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.260+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15bf9310 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f5728097d20 tx=0x7f572809b7f0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 1 -- 172.21.15.12:0/2561730985 shutdown_connections 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560d15c04cc0 0x560d15c070e0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15bf0d40 0x560d15c00890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15bf9310 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57157fa700 0 client.19305 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2561730985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15befe50 0x560d15bf9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 1 -- 172.21.15.12:0/2561730985 >> 172.21.15.12:0/2561730985 conn(0x560d15b1a780 msgr2=0x560d15be5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 1 -- 172.21.15.12:0/2561730985 shutdown_connections 2023-12-11T20:29:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 1 -- 172.21.15.12:0/2561730985 wait complete. 2023-12-11T20:29:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.261+0000 7f57479c6b80 20 client.19305 trim_cache size 0 max 16384 2023-12-11T20:29:11.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.279+0000 7f57479c6b80 1 Processor -- start 2023-12-11T20:29:11.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.279+0000 7f57479c6b80 1 -- start start 2023-12-11T20:29:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15be6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bf8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bf0d40 0x560d15c00850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f57479c6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15bf0b50 con 0x560d15bef4f0 2023-12-11T20:29:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f57479c6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15be0f30 con 0x560d15befe50 2023-12-11T20:29:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f57479c6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15bde4c0 con 0x560d15bf0d40 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f5731d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15be6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f5731d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15be6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55322/0 (socket says 172.21.15.12:55322) 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f5731d9b700 1 -- 172.21.15.12:0/2214289435 learned_addr learned my addr 172.21.15.12:0/2214289435 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f573159a700 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bf8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f573259c700 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bf0d40 0x560d15c00850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f5731d9b700 1 -- 172.21.15.12:0/2214289435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bf0d40 msgr2=0x560d15c00850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f5731d9b700 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bf0d40 0x560d15c00850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f5731d9b700 1 -- 172.21.15.12:0/2214289435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 msgr2=0x560d15bf8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f5731d9b700 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bf8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f5731d9b700 1 -- 172.21.15.12:0/2214289435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d15951c00 con 0x560d15bef4f0 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.280+0000 7f573159a700 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bf8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.281+0000 7f5731d9b700 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15be6a00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5728005c20 tx=0x7f5728099860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ded4647918f965a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.281+0000 7f5720ff9700 1 -- 172.21.15.12:0/2214289435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572809adf0 con 0x560d15bef4f0 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.281+0000 7f5720ff9700 1 -- 172.21.15.12:0/2214289435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57280a1040 con 0x560d15bef4f0 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.281+0000 7f5720ff9700 1 -- 172.21.15.12:0/2214289435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280a35b0 con 0x560d15bef4f0 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 -- 172.21.15.12:0/2214289435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 msgr2=0x560d15be6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15be6a00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5728005c20 tx=0x7f5728099860 comp rx=0 tx=0).stop 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 -- 172.21.15.12:0/2214289435 shutdown_connections 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bf0d40 0x560d15c00850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bef4f0 0x560d15be6a00 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 --2- 172.21.15.12:0/2214289435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bf8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 -- 172.21.15.12:0/2214289435 >> 172.21.15.12:0/2214289435 conn(0x560d15b1a780 msgr2=0x560d15bf7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 -- 172.21.15.12:0/2214289435 shutdown_connections 2023-12-11T20:29:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 -- 172.21.15.12:0/2214289435 wait complete. 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.282+0000 7f57479c6b80 1 -- start start 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f57479c6b80 1 Processor -- start 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bef4f0 0x560d15bfe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bfe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f57479c6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f57479c6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15bffcb0 con 0x560d15bf0d40 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f57479c6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15bffe20 con 0x560d15befe50 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f57479c6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d15bfffe0 con 0x560d15bef4f0 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f57479c6b80 10 client.0 _ll_register_callbacks cb 0x560d15a24a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f573259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f573259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bff770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55326/0 (socket says 172.21.15.12:55326) 2023-12-11T20:29:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.283+0000 7f573259c700 1 -- 172.21.15.12:0/880854552 learned_addr learned my addr 172.21.15.12:0/880854552 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f573159a700 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bfe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f5731d9b700 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bef4f0 0x560d15bfe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f573259c700 1 -- 172.21.15.12:0/880854552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bef4f0 msgr2=0x560d15bfe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f573259c700 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bef4f0 0x560d15bfe310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f573259c700 1 -- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 msgr2=0x560d15bfe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f573259c700 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bfe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f573259c700 1 -- 172.21.15.12:0/880854552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c011440 con 0x560d15bf0d40 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f573159a700 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bfe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f573259c700 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bff770 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f5724009cf0 tx=0x7f572401f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57108acea1d0e98 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.284+0000 7f57157fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.285+0000 7f57157fa700 1 -- 172.21.15.12:0/880854552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724018040 con 0x560d15bf0d40 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.285+0000 7f57479c6b80 1 -- 172.21.15.12:0/880854552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f572400f050 con 0x560d15bf0d40 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.285+0000 7f57157fa700 1 -- 172.21.15.12:0/880854552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f572401fbe0 con 0x560d15bf0d40 2023-12-11T20:29:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.285+0000 7f57157fa700 1 -- 172.21.15.12:0/880854552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f572401fdc0 con 0x560d15bf0d40 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.285+0000 7f57479c6b80 10 client.19311 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.285+0000 7f57479c6b80 1 -- 172.21.15.12:0/880854552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560d15968d80 con 0x560d15bf0d40 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.285+0000 7f57157fa700 1 -- 172.21.15.12:0/880854552 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f572400f050 con 0x560d15bf0d40 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.286+0000 7f57157fa700 1 -- 172.21.15.12:0/880854552 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5724032400 con 0x560d15bf0d40 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.286+0000 7f57479c6b80 10 client.19311 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.286+0000 7f57479c6b80 10 client.19311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.286+0000 7f57479c6b80 20 client.19311 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.286+0000 7f57479c6b80 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560d15c5bd40 0x560d15c5e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.286+0000 7f57479c6b80 4 client.19311 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:29:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.286+0000 7f57479c6b80 1 -- 172.21.15.12:0/880854552 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d15b05f70 con 0x560d15c5bd40 2023-12-11T20:29:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.286+0000 7f5731d9b700 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560d15c5bd40 0x560d15c5e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.287+0000 7f57157fa700 10 client.19311 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.287+0000 7f5731d9b700 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560d15c5bd40 0x560d15c5e160 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32a3e8770356cea4 server_cookie=21760624914319ac in_seq=0 out_seq=0 2023-12-11T20:29:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.297+0000 7f57157fa700 1 -- 172.21.15.12:0/880854552 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d15b05f70 con 0x560d15c5bd40 2023-12-11T20:29:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.297+0000 7f57157fa700 10 client.19311 handle_command_reply: tid=0 2023-12-11T20:29:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.297+0000 7f57479c6b80 1 client.19311 shutdown 2023-12-11T20:29:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.297+0000 7f57479c6b80 1 -- 172.21.15.12:0/880854552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 msgr2=0x560d15bff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.297+0000 7f57479c6b80 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bff770 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f5724009cf0 tx=0x7f572401f660 comp rx=0 tx=0).stop 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 1 -- 172.21.15.12:0/880854552 shutdown_connections 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560d15c5bd40 0x560d15c5e160 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560d15bf0d40 0x560d15bff770 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560d15bef4f0 0x560d15bfe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57157fa700 0 client.19311 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 1 --2- 172.21.15.12:0/880854552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560d15befe50 0x560d15bfe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 1 -- 172.21.15.12:0/880854552 >> 172.21.15.12:0/880854552 conn(0x560d15b1a780 msgr2=0x560d15bf72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 1 -- 172.21.15.12:0/880854552 shutdown_connections 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 1 -- 172.21.15.12:0/880854552 wait complete. 2023-12-11T20:29:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.298+0000 7f57479c6b80 20 client.19311 trim_cache size 0 max 16384 2023-12-11T20:29:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:29:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:29:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:29:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 -- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57180a14f0 msgr2=0x7f57180a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57180a14f0 0x7f57180a39b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f571c007c60 tx=0x7f571c0073d0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 -- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 msgr2=0x7f572c197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 0x7f572c197200 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5728009f50 tx=0x7f5728003a50 comp rx=0 tx=0).stop 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 -- 172.21.15.12:0/1317703890 shutdown_connections 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f57180a14f0 0x7f57180a39b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f572c101d80 0x7f572c19e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572c1001f0 0x7f572c197200 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 --2- 172.21.15.12:0/1317703890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c1013e0 0x7f572c197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 -- 172.21.15.12:0/1317703890 >> 172.21.15.12:0/1317703890 conn(0x7f572c0fb780 msgr2=0x7f572c104850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 -- 172.21.15.12:0/1317703890 shutdown_connections 2023-12-11T20:29:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:11.299+0000 7f5732d9d700 1 -- 172.21.15.12:0/1317703890 wait complete. 2023-12-11T20:29:12.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:12 smithi039 ceph-mon[102205]: pgmap v773: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:29:12.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:12 smithi012 ceph-mon[128787]: pgmap v773: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:29:12.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:12 smithi032 ceph-mon[132488]: pgmap v773: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 28 op/s 2023-12-11T20:29:14.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:14 smithi039 ceph-mon[102205]: pgmap v774: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 36 op/s 2023-12-11T20:29:14.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:14 smithi012 ceph-mon[128787]: pgmap v774: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 36 op/s 2023-12-11T20:29:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:14 smithi032 ceph-mon[132488]: pgmap v774: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 36 op/s 2023-12-11T20:29:16.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:16 smithi039 ceph-mon[102205]: pgmap v775: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 35 op/s 2023-12-11T20:29:16.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:16 smithi012 ceph-mon[128787]: pgmap v775: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 35 op/s 2023-12-11T20:29:16.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:16 smithi032 ceph-mon[132488]: pgmap v775: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 35 op/s 2023-12-11T20:29:18.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:18 smithi039 ceph-mon[102205]: pgmap v776: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 35 op/s 2023-12-11T20:29:18.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:18 smithi012 ceph-mon[128787]: pgmap v776: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 35 op/s 2023-12-11T20:29:18.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:18 smithi032 ceph-mon[132488]: pgmap v776: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 35 op/s 2023-12-11T20:29:20.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:20 smithi012 ceph-mon[128787]: pgmap v777: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:29:20.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:20 smithi032 ceph-mon[132488]: pgmap v777: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:29:21.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:20 smithi039 ceph-mon[102205]: pgmap v777: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:29:21.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:21 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:29:21.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:21 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:29:21.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:21 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:29:21.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:21 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:29:22.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:21 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:29:22.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:21 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:29:22.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:22 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:29:22.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:22 smithi012 ceph-mon[128787]: pgmap v778: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 25 op/s 2023-12-11T20:29:22.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:22 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:29:22.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:22 smithi032 ceph-mon[132488]: pgmap v778: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 25 op/s 2023-12-11T20:29:23.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:22 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:29:23.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:22 smithi039 ceph-mon[102205]: pgmap v778: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 25 op/s 2023-12-11T20:29:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 -- 172.21.15.12:0/3725259272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 msgr2=0x7f5e78106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/3725259272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 0x7f5e78106c60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009990 tx=0x7f5e68009ca0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 -- 172.21.15.12:0/3725259272 shutdown_connections 2023-12-11T20:29:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/3725259272 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e78101f40 0x7f5e78104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/3725259272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e781071a0 0x7f5e78109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/3725259272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 0x7f5e78106c60 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 -- 172.21.15.12:0/3725259272 >> 172.21.15.12:0/3725259272 conn(0x7f5e780fb930 msgr2=0x7f5e780fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 -- 172.21.15.12:0/3725259272 shutdown_connections 2023-12-11T20:29:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.729+0000 7f5e7fdff700 1 -- 172.21.15.12:0/3725259272 wait complete. 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.730+0000 7f5e7fdff700 1 Processor -- start 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.730+0000 7f5e7fdff700 1 -- start start 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7fdff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e78101f40 0x7f5e78101860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7fdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 0x7f5e780ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7fdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e781071a0 0x7f5e78100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7fdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78100bd0 con 0x7f5e78104870 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7fdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78100d40 con 0x7f5e781071a0 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7fdff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e781a1370 con 0x7f5e78101f40 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7d39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 0x7f5e780ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7d39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 0x7f5e780ffef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34482/0 (socket says 172.21.15.12:34482) 2023-12-11T20:29:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7d39a700 1 -- 172.21.15.12:0/312491280 learned_addr learned my addr 172.21.15.12:0/312491280 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e78101f40 0x7f5e78101860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7e39c700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e781071a0 0x7f5e78100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7d39a700 1 -- 172.21.15.12:0/312491280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e78101f40 msgr2=0x7f5e78101860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.731+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e78101f40 0x7f5e78101860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e7d39a700 1 -- 172.21.15.12:0/312491280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e781071a0 msgr2=0x7f5e78100430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e781071a0 0x7f5e78100430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e7d39a700 1 -- 172.21.15.12:0/312491280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680095f0 con 0x7f5e78104870 2023-12-11T20:29:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 0x7f5e780ffef0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f5e680098e0 tx=0x7f5e68005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e6effd700 1 -- 172.21.15.12:0/312491280 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6801d070 con 0x7f5e78104870 2023-12-11T20:29:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e6effd700 1 -- 172.21.15.12:0/312491280 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e68003f80 con 0x7f5e78104870 2023-12-11T20:29:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e7fdff700 1 -- 172.21.15.12:0/312491280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e781a15a0 con 0x7f5e78104870 2023-12-11T20:29:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e6effd700 1 -- 172.21.15.12:0/312491280 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68022bf0 con 0x7f5e78104870 2023-12-11T20:29:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.732+0000 7f5e7fdff700 1 -- 172.21.15.12:0/312491280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e781a1960 con 0x7f5e78104870 2023-12-11T20:29:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.736+0000 7f5e6effd700 1 -- 172.21.15.12:0/312491280 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5e68022d50 con 0x7f5e78104870 2023-12-11T20:29:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.737+0000 7f5e6effd700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e640a1470 0x7f5e640a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.737+0000 7f5e6effd700 1 -- 172.21.15.12:0/312491280 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5e680ce070 con 0x7f5e78104870 2023-12-11T20:29:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.737+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e640a1470 0x7f5e640a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.738+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e640a1470 0x7f5e640a3930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5e74005950 tx=0x7f5e7400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.761+0000 7f5e937b1b80 1 Processor -- start 2023-12-11T20:29:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.761+0000 7f5e937b1b80 1 -- start start 2023-12-11T20:29:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467d9ed0 0x55ea467da2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467dbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea46735af0 con 0x55ea467db720 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea46733410 con 0x55ea467d9ed0 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4672ed00 con 0x55ea467da830 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e7e39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467dbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e7e39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467dbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34486/0 (socket says 172.21.15.12:34486) 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e7e39c700 1 -- 172.21.15.12:0/2347315090 learned_addr learned my addr 172.21.15.12:0/2347315090 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.762+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467d9ed0 0x55ea467da2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e7e39c700 1 -- 172.21.15.12:0/2347315090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 msgr2=0x55ea467db140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e7e39c700 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467db140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e7e39c700 1 -- 172.21.15.12:0/2347315090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467d9ed0 msgr2=0x55ea467da2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e7e39c700 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467d9ed0 0x55ea467da2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e7e39c700 1 -- 172.21.15.12:0/2347315090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea465ab5d0 con 0x55ea467db720 2023-12-11T20:29:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467db140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e7e39c700 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467dbba0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f5e700098f0 tx=0x7f5e70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1cbedd1ffae40b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e63fff700 1 -- 172.21.15.12:0/2347315090 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70019070 con 0x55ea467db720 2023-12-11T20:29:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e63fff700 1 -- 172.21.15.12:0/2347315090 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e7000f040 con 0x55ea467db720 2023-12-11T20:29:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.763+0000 7f5e63fff700 1 -- 172.21.15.12:0/2347315090 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700079c0 con 0x55ea467db720 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 -- 172.21.15.12:0/2347315090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 msgr2=0x55ea467dbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467dbba0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f5e700098f0 tx=0x7f5e70009c00 comp rx=0 tx=0).stop 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 -- 172.21.15.12:0/2347315090 shutdown_connections 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467d9ed0 0x55ea467da2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467dbba0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/2347315090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467db140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 -- 172.21.15.12:0/2347315090 >> 172.21.15.12:0/2347315090 conn(0x55ea46709780 msgr2=0x55ea467d6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 -- 172.21.15.12:0/2347315090 shutdown_connections 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.764+0000 7f5e937b1b80 1 -- 172.21.15.12:0/2347315090 wait complete. 2023-12-11T20:29:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.765+0000 7f5e937b1b80 1 -- start start 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.765+0000 7f5e937b1b80 1 Processor -- start 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467da830 0x55ea467e4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467eb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea466e8500 con 0x55ea467db720 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea466e81a0 con 0x55ea467da830 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea465ad8c0 con 0x55ea467d9ed0 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e937b1b80 10 client.0 _ll_register_callbacks cb 0x55ea46613a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e7e39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e7d39a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467da830 0x55ea467e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e7e39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467eb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34502/0 (socket says 172.21.15.12:34502) 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e7e39c700 1 -- 172.21.15.12:0/508729534 learned_addr learned my addr 172.21.15.12:0/508729534 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e7d39a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467da830 0x55ea467e4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38676/0 (socket says 172.21.15.12:38676) 2023-12-11T20:29:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.766+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e7d39a700 1 -- 172.21.15.12:0/508729534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 msgr2=0x55ea467e3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e7d39a700 1 -- 172.21.15.12:0/508729534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 msgr2=0x55ea467eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e7d39a700 1 -- 172.21.15.12:0/508729534 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e781a1960 con 0x55ea467da830 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e7e39c700 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467da830 0x55ea467e4430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5e6809b070 tx=0x7f5e6809b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92b447cca90e053 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e617fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e617fa700 1 -- 172.21.15.12:0/508729534 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6809f4c0 con 0x55ea467da830 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e937b1b80 1 -- 172.21.15.12:0/508729534 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea467cd730 con 0x55ea467da830 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e617fa700 1 -- 172.21.15.12:0/508729534 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5e680a3670 con 0x55ea467da830 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e617fa700 1 -- 172.21.15.12:0/508729534 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e68022470 con 0x55ea467da830 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e937b1b80 10 client.28889 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.767+0000 7f5e937b1b80 1 -- 172.21.15.12:0/508729534 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f5e70003c50 con 0x55ea467da830 2023-12-11T20:29:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.768+0000 7f5e617fa700 1 -- 172.21.15.12:0/508729534 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ea467cd730 con 0x55ea467da830 2023-12-11T20:29:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.768+0000 7f5e617fa700 1 -- 172.21.15.12:0/508729534 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5e68065020 con 0x55ea467da830 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.768+0000 7f5e937b1b80 10 client.28889 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.768+0000 7f5e937b1b80 10 client.28889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.768+0000 7f5e937b1b80 20 client.28889 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.768+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ea467ef9e0 0x55ea467f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.768+0000 7f5e937b1b80 4 client.28889 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.768+0000 7f5e937b1b80 1 -- 172.21.15.12:0/508729534 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea467a9ee0 con 0x55ea467ef9e0 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.769+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ea467ef9e0 0x55ea467f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.770+0000 7f5e617fa700 10 client.28889 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.770+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ea467ef9e0 0x55ea467f1e00 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3388c501e259b0bd server_cookie=d1551fef91f630f1 in_seq=0 out_seq=0 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.770+0000 7f5e617fa700 1 -- 172.21.15.12:0/508729534 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ea467a9ee0 con 0x55ea467ef9e0 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.770+0000 7f5e617fa700 10 client.28889 handle_command_reply: tid=0 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 client.28889 shutdown 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 -- 172.21.15.12:0/508729534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467da830 msgr2=0x55ea467e4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467da830 0x55ea467e4430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5e6809b070 tx=0x7f5e6809b8b0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 -- 172.21.15.12:0/508729534 shutdown_connections 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ea467ef9e0 0x55ea467f1e00 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467db720 0x55ea467eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e617fa700 0 client.28889 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/508729534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467da830 0x55ea467e4430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 -- 172.21.15.12:0/508729534 >> 172.21.15.12:0/508729534 conn(0x55ea46709780 msgr2=0x55ea467d4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 -- 172.21.15.12:0/508729534 shutdown_connections 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 1 -- 172.21.15.12:0/508729534 wait complete. 2023-12-11T20:29:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.771+0000 7f5e937b1b80 20 client.28889 trim_cache size 0 max 16384 2023-12-11T20:29:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e937b1b80 1 Processor -- start 2023-12-11T20:29:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e937b1b80 1 -- start start 2023-12-11T20:29:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467d9ed0 0x55ea467f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467eb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 0x55ea467e1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea467f7010 con 0x55ea467d9ed0 2023-12-11T20:29:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea467cd6c0 con 0x55ea467db720 2023-12-11T20:29:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea467eb810 con 0x55ea467da830 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e7db9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467d9ed0 0x55ea467f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e7db9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467d9ed0 0x55ea467f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34506/0 (socket says 172.21.15.12:34506) 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e7db9b700 1 -- 172.21.15.12:0/4159651062 learned_addr learned my addr 172.21.15.12:0/4159651062 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.787+0000 7f5e7e39c700 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 0x55ea467e1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.788+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467eb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.788+0000 7f5e7db9b700 1 -- 172.21.15.12:0/4159651062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 msgr2=0x55ea467eb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.788+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467eb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.788+0000 7f5e7db9b700 1 -- 172.21.15.12:0/4159651062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 msgr2=0x55ea467e1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.788+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 0x55ea467e1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.788+0000 7f5e7db9b700 1 -- 172.21.15.12:0/4159651062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea46557d80 con 0x55ea467d9ed0 2023-12-11T20:29:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.788+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467d9ed0 0x55ea467f1e00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5e74011010 tx=0x7f5e74013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f925ebac6e7d87 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.788+0000 7f5e6cbff700 1 -- 172.21.15.12:0/4159651062 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7402b070 con 0x55ea467d9ed0 2023-12-11T20:29:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e6cbff700 1 -- 172.21.15.12:0/4159651062 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e74015070 con 0x55ea467d9ed0 2023-12-11T20:29:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e6cbff700 1 -- 172.21.15.12:0/4159651062 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74025070 con 0x55ea467d9ed0 2023-12-11T20:29:24.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e937b1b80 1 -- 172.21.15.12:0/4159651062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467d9ed0 msgr2=0x55ea467f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467d9ed0 0x55ea467f1e00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5e74011010 tx=0x7f5e74013000 comp rx=0 tx=0).stop 2023-12-11T20:29:24.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e937b1b80 1 -- 172.21.15.12:0/4159651062 shutdown_connections 2023-12-11T20:29:24.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 0x55ea467e1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467d9ed0 0x55ea467f1e00 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/4159651062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467da830 0x55ea467eb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e937b1b80 1 -- 172.21.15.12:0/4159651062 >> 172.21.15.12:0/4159651062 conn(0x55ea46709780 msgr2=0x55ea467e31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.789+0000 7f5e937b1b80 1 -- 172.21.15.12:0/4159651062 shutdown_connections 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.790+0000 7f5e937b1b80 1 -- 172.21.15.12:0/4159651062 wait complete. 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.790+0000 7f5e937b1b80 1 -- start start 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.790+0000 7f5e937b1b80 1 Processor -- start 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467da830 0x55ea467e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e937b1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 0x55ea467ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea467ea630 con 0x55ea467da830 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea467ea7a0 con 0x55ea467db720 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e937b1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea467ea960 con 0x55ea467d9ed0 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e937b1b80 10 client.0 _ll_register_callbacks cb 0x55ea46613a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:24.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7d39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467da830 0x55ea467e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7db9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7db9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:33708/0 (socket says 172.21.15.12:33708) 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7db9b700 1 -- 172.21.15.12:0/3254945133 learned_addr learned my addr 172.21.15.12:0/3254945133 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7e39c700 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 0x55ea467ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7d39a700 1 -- 172.21.15.12:0/3254945133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 msgr2=0x55ea467e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7d39a700 1 -- 172.21.15.12:0/3254945133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 msgr2=0x55ea467ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 0x55ea467ea0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.791+0000 7f5e7d39a700 1 -- 172.21.15.12:0/3254945133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e740204c0 con 0x55ea467da830 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.792+0000 7f5e7d39a700 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467da830 0x55ea467e9180 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f5e68097870 tx=0x7f5e680970b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333909067e1ba738 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.792+0000 7f5e617fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.792+0000 7f5e617fa700 1 -- 172.21.15.12:0/3254945133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e680a3480 con 0x55ea467da830 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.792+0000 7f5e617fa700 1 -- 172.21.15.12:0/3254945133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5e680b9030 con 0x55ea467da830 2023-12-11T20:29:24.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.792+0000 7f5e937b1b80 1 -- 172.21.15.12:0/3254945133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e7000f040 con 0x55ea467da830 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.792+0000 7f5e617fa700 1 -- 172.21.15.12:0/3254945133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e680a3670 con 0x55ea467da830 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.792+0000 7f5e937b1b80 10 client.19329 fetch_fsmap learned FSMap version 30 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.792+0000 7f5e937b1b80 1 -- 172.21.15.12:0/3254945133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ea46540c00 con 0x55ea467da830 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e617fa700 1 -- 172.21.15.12:0/3254945133 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e680a7080 con 0x55ea467da830 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e617fa700 1 -- 172.21.15.12:0/3254945133 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5e68065070 con 0x55ea467da830 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e937b1b80 10 client.19329 fetch_fsmap finished waiting for FSMap version 30 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e937b1b80 10 client.19329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e937b1b80 20 client.19329 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ea46846620 0x55ea46848a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e937b1b80 4 client.19329 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:29:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e937b1b80 1 -- 172.21.15.12:0/3254945133 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ea466f4f70 con 0x55ea46846620 2023-12-11T20:29:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.793+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ea46846620 0x55ea46848a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.794+0000 7f5e7db9b700 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ea46846620 0x55ea46848a10 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8cea8582be4bdd7 server_cookie=e665094f4cfbdc4c in_seq=0 out_seq=0 2023-12-11T20:29:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.794+0000 7f5e617fa700 10 client.19329 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e617fa700 1 -- 172.21.15.12:0/3254945133 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ea466f4f70 con 0x55ea46846620 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e617fa700 10 client.19329 handle_command_reply: tid=0 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 client.19329 shutdown 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 -- 172.21.15.12:0/3254945133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467da830 msgr2=0x55ea467e9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467da830 0x55ea467e9180 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f5e68097870 tx=0x7f5e680970b0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 -- 172.21.15.12:0/3254945133 shutdown_connections 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55ea46846620 0x55ea46848a10 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ea467db720 0x55ea467ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea467d9ed0 0x55ea467e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 --2- 172.21.15.12:0/3254945133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea467da830 0x55ea467e9180 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e617fa700 0 client.19329 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 -- 172.21.15.12:0/3254945133 >> 172.21.15.12:0/3254945133 conn(0x55ea46709780 msgr2=0x55ea467de940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 -- 172.21.15.12:0/3254945133 shutdown_connections 2023-12-11T20:29:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 1 -- 172.21.15.12:0/3254945133 wait complete. 2023-12-11T20:29:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.804+0000 7f5e937b1b80 20 client.19329 trim_cache size 0 max 16384 2023-12-11T20:29:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:29:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:29:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:29:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 -- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e640a1470 msgr2=0x7f5e640a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e640a1470 0x7f5e640a3930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5e74005950 tx=0x7f5e7400b410 comp rx=0 tx=0).stop 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 -- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 msgr2=0x7f5e780ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 0x7f5e780ffef0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f5e680098e0 tx=0x7f5e68005f10 comp rx=0 tx=0).stop 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 -- 172.21.15.12:0/312491280 shutdown_connections 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5e640a1470 0x7f5e640a3930 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e781071a0 0x7f5e78100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e78101f40 0x7f5e78101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 --2- 172.21.15.12:0/312491280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e78104870 0x7f5e780ffef0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 -- 172.21.15.12:0/312491280 >> 172.21.15.12:0/312491280 conn(0x7f5e780fb930 msgr2=0x7f5e78103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 -- 172.21.15.12:0/312491280 shutdown_connections 2023-12-11T20:29:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:24.805+0000 7f5e7fdff700 1 -- 172.21.15.12:0/312491280 wait complete. 2023-12-11T20:29:24.848 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:24 smithi012 ceph-mon[128787]: pgmap v779: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 20 op/s 2023-12-11T20:29:24.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:24 smithi032 ceph-mon[132488]: pgmap v779: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 20 op/s 2023-12-11T20:29:25.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:24 smithi039 ceph-mon[102205]: pgmap v779: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 20 op/s 2023-12-11T20:29:26.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:26 smithi012 ceph-mon[128787]: pgmap v780: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:29:26.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:26 smithi032 ceph-mon[132488]: pgmap v780: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:29:27.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:26 smithi039 ceph-mon[102205]: pgmap v780: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:29:27.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:27 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:27.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:27 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:28.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:27 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:28.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:28 smithi032 ceph-mon[132488]: pgmap v781: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:29:29.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:28 smithi039 ceph-mon[102205]: pgmap v781: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:29:29.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:28 smithi012 ceph-mon[128787]: pgmap v781: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 16 MiB/s wr, 13 op/s 2023-12-11T20:29:29.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:29 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:29:30.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:29 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:29:30.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:29 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:29:30.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:30 smithi032 ceph-mon[132488]: pgmap v782: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:29:31.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:30 smithi039 ceph-mon[102205]: pgmap v782: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:29:32.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:32 smithi032 ceph-mon[132488]: pgmap v783: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:29:33.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:32 smithi039 ceph-mon[102205]: pgmap v783: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:29:33.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:30 smithi012 ceph-mon[128787]: pgmap v782: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:29:33.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:32 smithi012 ceph-mon[128787]: pgmap v783: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 13 op/s 2023-12-11T20:29:34.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:34 smithi032 ceph-mon[132488]: pgmap v784: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:29:34.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:29:34.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:29:34.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:29:35.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:34 smithi039 ceph-mon[102205]: pgmap v784: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:29:35.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:29:35.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:29:35.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:29:35.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:34 smithi012 ceph-mon[128787]: pgmap v784: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:29:35.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:29:35.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:29:35.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:29:36.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:29:36.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:36 smithi032 ceph-mon[132488]: pgmap v785: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:29:37.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:36 smithi012 ceph-mon[128787]: pgmap v785: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:29:37.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:36 smithi039 ceph-mon[102205]: pgmap v785: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:29:37.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 -- 172.21.15.12:0/2496674122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 msgr2=0x7f03901098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 --2- 172.21.15.12:0/2496674122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 0x7f03901098f0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f038800b0d0 tx=0x7f038800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 -- 172.21.15.12:0/2496674122 shutdown_connections 2023-12-11T20:29:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 --2- 172.21.15.12:0/2496674122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03901014b0 0x7f03901018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 --2- 172.21.15.12:0/2496674122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 0x7f03901098f0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 --2- 172.21.15.12:0/2496674122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03901026a0 0x7f0390102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 -- 172.21.15.12:0/2496674122 >> 172.21.15.12:0/2496674122 conn(0x7f03900fca00 msgr2=0x7f03900fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 -- 172.21.15.12:0/2496674122 shutdown_connections 2023-12-11T20:29:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.313+0000 7f0397dff700 1 -- 172.21.15.12:0/2496674122 wait complete. 2023-12-11T20:29:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.314+0000 7f0397dff700 1 Processor -- start 2023-12-11T20:29:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.314+0000 7f0397dff700 1 -- start start 2023-12-11T20:29:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0397dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03901014b0 0x7f0390199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0397dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03901026a0 0x7f0390199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0397dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 0x7f03901a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0397dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03901a1170 con 0x7f0390103040 2023-12-11T20:29:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0397dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03901a12b0 con 0x7f03901026a0 2023-12-11T20:29:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0397dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03901a1440 con 0x7f03901014b0 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f039639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 0x7f03901a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0395b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03901014b0 0x7f0390199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0395b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03901014b0 0x7f0390199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48858/0 (socket says 172.21.15.12:48858) 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f0395b9b700 1 -- 172.21.15.12:0/221181649 learned_addr learned my addr 172.21.15.12:0/221181649 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f039539a700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03901026a0 0x7f0390199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f039639c700 1 -- 172.21.15.12:0/221181649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03901014b0 msgr2=0x7f0390199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f039639c700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03901014b0 0x7f0390199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f039639c700 1 -- 172.21.15.12:0/221181649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03901026a0 msgr2=0x7f0390199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f039639c700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03901026a0 0x7f0390199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.315+0000 7f039639c700 1 -- 172.21.15.12:0/221181649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0388009d00 con 0x7f0390103040 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.316+0000 7f039639c700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 0x7f03901a0ba0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f0388007af0 tx=0x7f0388007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.316+0000 7f0386ffd700 1 -- 172.21.15.12:0/221181649 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800e040 con 0x7f0390103040 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.316+0000 7f0386ffd700 1 -- 172.21.15.12:0/221181649 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0388003e90 con 0x7f0390103040 2023-12-11T20:29:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.316+0000 7f0397dff700 1 -- 172.21.15.12:0/221181649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03901a16c0 con 0x7f0390103040 2023-12-11T20:29:37.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.316+0000 7f0386ffd700 1 -- 172.21.15.12:0/221181649 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038801d6f0 con 0x7f0390103040 2023-12-11T20:29:37.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.316+0000 7f0397dff700 1 -- 172.21.15.12:0/221181649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03901a1ae0 con 0x7f0390103040 2023-12-11T20:29:37.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.320+0000 7f0386ffd700 1 -- 172.21.15.12:0/221181649 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f03880052e0 con 0x7f0390103040 2023-12-11T20:29:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.321+0000 7f0386ffd700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a1480 0x7f037c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.321+0000 7f0386ffd700 1 -- 172.21.15.12:0/221181649 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f03880cdc30 con 0x7f0390103040 2023-12-11T20:29:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.321+0000 7f0395b9b700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a1480 0x7f037c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f03ab81cb80 1 Processor -- start 2023-12-11T20:29:37.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f03ab81cb80 1 -- start start 2023-12-11T20:29:37.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f0395b9b700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a1480 0x7f037c0a3940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f038c005950 tx=0x7f038c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb338037f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb33804640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb338050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3375eb50 con 0x55cb33803d30 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3375c470 con 0x55cb338033d0 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb33757d60 con 0x55cb33804c20 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.322+0000 7f039539a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb33804640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039539a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb33804640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42740/0 (socket says 172.21.15.12:42740) 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039539a700 1 -- 172.21.15.12:0/125032627 learned_addr learned my addr 172.21.15.12:0/125032627 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f0395b9b700 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb338037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039639c700 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb338050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039539a700 1 -- 172.21.15.12:0/125032627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 msgr2=0x55cb338050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039539a700 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb338050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039539a700 1 -- 172.21.15.12:0/125032627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 msgr2=0x55cb338037f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039539a700 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb338037f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039539a700 1 -- 172.21.15.12:0/125032627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb335d4630 con 0x55cb33803d30 2023-12-11T20:29:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.323+0000 7f039539a700 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb33804640 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f038000bd70 tx=0x7f03800106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1394be27c64dc54d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f037bfff700 1 -- 172.21.15.12:0/125032627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380010e10 con 0x55cb33803d30 2023-12-11T20:29:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f037bfff700 1 -- 172.21.15.12:0/125032627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0380015070 con 0x55cb33803d30 2023-12-11T20:29:37.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f037bfff700 1 -- 172.21.15.12:0/125032627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800116a0 con 0x55cb33803d30 2023-12-11T20:29:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f03ab81cb80 1 -- 172.21.15.12:0/125032627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 msgr2=0x55cb33804640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb33804640 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f038000bd70 tx=0x7f03800106b0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f03ab81cb80 1 -- 172.21.15.12:0/125032627 shutdown_connections 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb338037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb338050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/125032627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb33804640 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.324+0000 7f03ab81cb80 1 -- 172.21.15.12:0/125032627 >> 172.21.15.12:0/125032627 conn(0x55cb337327e0 msgr2=0x55cb337ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.325+0000 7f03ab81cb80 1 -- 172.21.15.12:0/125032627 shutdown_connections 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.325+0000 7f03ab81cb80 1 -- 172.21.15.12:0/125032627 wait complete. 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.325+0000 7f03ab81cb80 1 -- start start 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.325+0000 7f03ab81cb80 1 Processor -- start 2023-12-11T20:29:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb3380d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb3380d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb33814720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb33711560 con 0x55cb33803d30 2023-12-11T20:29:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb33711200 con 0x55cb338033d0 2023-12-11T20:29:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb335d6920 con 0x55cb33804c20 2023-12-11T20:29:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f03ab81cb80 10 client.0 _ll_register_callbacks cb 0x55cb3363ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f039539a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb3380d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f039539a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb3380d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42748/0 (socket says 172.21.15.12:42748) 2023-12-11T20:29:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f039539a700 1 -- 172.21.15.12:0/4177937658 learned_addr learned my addr 172.21.15.12:0/4177937658 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.326+0000 7f0395b9b700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb3380d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f039539a700 1 -- 172.21.15.12:0/4177937658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 msgr2=0x55cb33814720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f039639c700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb33814720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f039539a700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb33814720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f039539a700 1 -- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 msgr2=0x55cb3380d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f039539a700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb3380d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f039539a700 1 -- 172.21.15.12:0/4177937658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038000b9a0 con 0x55cb33803d30 2023-12-11T20:29:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f0395b9b700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb3380d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f039639c700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb33814720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:37.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f039539a700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb3380d6e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f0380010e40 tx=0x7f0380010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac9920e840566a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:37.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f03797fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:37.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f03797fa700 1 -- 172.21.15.12:0/4177937658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038001c890 con 0x55cb33803d30 2023-12-11T20:29:37.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f03ab81cb80 1 -- 172.21.15.12:0/4177937658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb337f6b40 con 0x55cb33803d30 2023-12-11T20:29:37.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.327+0000 7f03797fa700 1 -- 172.21.15.12:0/4177937658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0380017070 con 0x55cb33803d30 2023-12-11T20:29:37.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03797fa700 1 -- 172.21.15.12:0/4177937658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f038001c9f0 con 0x55cb33803d30 2023-12-11T20:29:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03ab81cb80 10 client.19341 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03ab81cb80 1 -- 172.21.15.12:0/4177937658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55cb33580de0 con 0x55cb33803d30 2023-12-11T20:29:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03797fa700 1 -- 172.21.15.12:0/4177937658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cb337f6b40 con 0x55cb33803d30 2023-12-11T20:29:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03797fa700 1 -- 172.21.15.12:0/4177937658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0380003c60 con 0x55cb33803d30 2023-12-11T20:29:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03ab81cb80 10 client.19341 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03ab81cb80 10 client.19341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03ab81cb80 20 client.19341 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cb33818ee0 0x55cb3381b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03ab81cb80 4 client.19341 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.328+0000 7f03ab81cb80 1 -- 172.21.15.12:0/4177937658 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb337d2f40 con 0x55cb33818ee0 2023-12-11T20:29:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.329+0000 7f0395b9b700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cb33818ee0 0x55cb3381b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.330+0000 7f03797fa700 10 client.19341 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.330+0000 7f0395b9b700 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cb33818ee0 0x55cb3381b300 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86de8da0ded067c7 server_cookie=eee5ce53a70625d2 in_seq=0 out_seq=0 2023-12-11T20:29:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.330+0000 7f03797fa700 1 -- 172.21.15.12:0/4177937658 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cb337d2f40 con 0x55cb33818ee0 2023-12-11T20:29:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.330+0000 7f03797fa700 10 client.19341 handle_command_reply: tid=0 2023-12-11T20:29:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.330+0000 7f03ab81cb80 1 client.19341 shutdown 2023-12-11T20:29:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 -- 172.21.15.12:0/4177937658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 msgr2=0x55cb3380d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb3380d6e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f0380010e40 tx=0x7f0380010e70 comp rx=0 tx=0).stop 2023-12-11T20:29:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 -- 172.21.15.12:0/4177937658 shutdown_connections 2023-12-11T20:29:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cb33818ee0 0x55cb3381b300 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb338033d0 0x55cb3380d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb33814720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03797fa700 0 client.19341 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/4177937658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33803d30 0x55cb3380d6e0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 -- 172.21.15.12:0/4177937658 >> 172.21.15.12:0/4177937658 conn(0x55cb337327e0 msgr2=0x55cb337fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 -- 172.21.15.12:0/4177937658 shutdown_connections 2023-12-11T20:29:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 1 -- 172.21.15.12:0/4177937658 wait complete. 2023-12-11T20:29:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.331+0000 7f03ab81cb80 20 client.19341 trim_cache size 0 max 16384 2023-12-11T20:29:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.353+0000 7f03ab81cb80 1 Processor -- start 2023-12-11T20:29:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.353+0000 7f03ab81cb80 1 -- start start 2023-12-11T20:29:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb338033d0 0x55cb3380be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb338146e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb3380d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb337fab50 con 0x55cb338033d0 2023-12-11T20:29:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb338204b0 con 0x55cb33803d30 2023-12-11T20:29:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3381b960 con 0x55cb33804c20 2023-12-11T20:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f0395b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb338033d0 0x55cb3380be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f0395b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb338033d0 0x55cb3380be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42764/0 (socket says 172.21.15.12:42764) 2023-12-11T20:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f0395b9b700 1 -- 172.21.15.12:0/298521636 learned_addr learned my addr 172.21.15.12:0/298521636 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f039539a700 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb338146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f039639c700 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb3380d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f0395b9b700 1 -- 172.21.15.12:0/298521636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 msgr2=0x55cb3380d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f0395b9b700 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb3380d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f0395b9b700 1 -- 172.21.15.12:0/298521636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 msgr2=0x55cb338146e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.354+0000 7f0395b9b700 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb338146e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.355+0000 7f0395b9b700 1 -- 172.21.15.12:0/298521636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb33569c60 con 0x55cb338033d0 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.355+0000 7f039539a700 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb338146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.355+0000 7f0395b9b700 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb338033d0 0x55cb3380be80 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x55cb3381bba0 tx=0x7f038c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc38103a58a82f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.355+0000 7f0384bff700 1 -- 172.21.15.12:0/298521636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c023040 con 0x55cb338033d0 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.355+0000 7f0384bff700 1 -- 172.21.15.12:0/298521636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f038c01e320 con 0x55cb338033d0 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.355+0000 7f0384bff700 1 -- 172.21.15.12:0/298521636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c028730 con 0x55cb338033d0 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 -- 172.21.15.12:0/298521636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb338033d0 msgr2=0x55cb3380be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb338033d0 0x55cb3380be80 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x55cb3381bba0 tx=0x7f038c017000 comp rx=0 tx=0).stop 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 -- 172.21.15.12:0/298521636 shutdown_connections 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb33804c20 0x55cb3380d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb338033d0 0x55cb3380be80 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/298521636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb338146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 -- 172.21.15.12:0/298521636 >> 172.21.15.12:0/298521636 conn(0x55cb337327e0 msgr2=0x55cb3380c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 -- 172.21.15.12:0/298521636 shutdown_connections 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.356+0000 7f03ab81cb80 1 -- 172.21.15.12:0/298521636 wait complete. 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.357+0000 7f03ab81cb80 1 -- start start 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.357+0000 7f03ab81cb80 1 Processor -- start 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb338033d0 0x55cb338140d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb33814610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f03ab81cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33804c20 0x55cb338128d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb33812fe0 con 0x55cb33804c20 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb33813150 con 0x55cb33803d30 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f03ab81cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb33813310 con 0x55cb338033d0 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f03ab81cb80 10 client.0 _ll_register_callbacks cb 0x55cb3363ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f039639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33804c20 0x55cb338128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f039639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33804c20 0x55cb338128d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42774/0 (socket says 172.21.15.12:42774) 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f039639c700 1 -- 172.21.15.12:0/1848424737 learned_addr learned my addr 172.21.15.12:0/1848424737 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f0395b9b700 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb338033d0 0x55cb338140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.358+0000 7f039539a700 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb33814610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f039639c700 1 -- 172.21.15.12:0/1848424737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb338033d0 msgr2=0x55cb338140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f039639c700 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb338033d0 0x55cb338140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f039639c700 1 -- 172.21.15.12:0/1848424737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 msgr2=0x55cb33814610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f039639c700 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb33814610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f039639c700 1 -- 172.21.15.12:0/1848424737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb33580de0 con 0x55cb33804c20 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f0395b9b700 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb338033d0 0x55cb338140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f039639c700 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33804c20 0x55cb338128d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0388009fd0 tx=0x7f038809a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b268203adab15aa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f03797fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f03797fa700 1 -- 172.21.15.12:0/1848424737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038809f110 con 0x55cb33804c20 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f03ab81cb80 1 -- 172.21.15.12:0/1848424737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb3371dfd0 con 0x55cb33804c20 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f03797fa700 1 -- 172.21.15.12:0/1848424737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f03880a32c0 con 0x55cb33804c20 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f03797fa700 1 -- 172.21.15.12:0/1848424737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03880976d0 con 0x55cb33804c20 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f03ab81cb80 10 client.19347 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.359+0000 7f03ab81cb80 1 -- 172.21.15.12:0/1848424737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f038c017070 con 0x55cb33804c20 2023-12-11T20:29:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f03797fa700 1 -- 172.21.15.12:0/1848424737 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cb3371dfd0 con 0x55cb33804c20 2023-12-11T20:29:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f03797fa700 1 -- 172.21.15.12:0/1848424737 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f038809a4b0 con 0x55cb33804c20 2023-12-11T20:29:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f03ab81cb80 10 client.19347 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f03ab81cb80 10 client.19347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f03ab81cb80 20 client.19347 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cb33870530 0x55cb33872950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f03ab81cb80 4 client.19347 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:29:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f03ab81cb80 1 -- 172.21.15.12:0/1848424737 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cb33710490 con 0x55cb33870530 2023-12-11T20:29:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.360+0000 7f0395b9b700 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cb33870530 0x55cb33872950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.361+0000 7f0395b9b700 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cb33870530 0x55cb33872950 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ec3d46cda8797f server_cookie=bd91df567176a225 in_seq=0 out_seq=0 2023-12-11T20:29:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.361+0000 7f03797fa700 10 client.19347 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.361+0000 7f03797fa700 1 -- 172.21.15.12:0/1848424737 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55cb33710490 con 0x55cb33870530 2023-12-11T20:29:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.361+0000 7f03797fa700 10 client.19347 handle_command_reply: tid=0 2023-12-11T20:29:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.361+0000 7f03ab81cb80 1 client.19347 shutdown 2023-12-11T20:29:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.361+0000 7f03ab81cb80 1 -- 172.21.15.12:0/1848424737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33804c20 msgr2=0x55cb338128d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.361+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33804c20 0x55cb338128d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0388009fd0 tx=0x7f038809a920 comp rx=0 tx=0).stop 2023-12-11T20:29:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 1 -- 172.21.15.12:0/1848424737 shutdown_connections 2023-12-11T20:29:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55cb33870530 0x55cb33872950 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb33804c20 0x55cb338128d0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cb338033d0 0x55cb338140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 1 --2- 172.21.15.12:0/1848424737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cb33803d30 0x55cb33814610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 1 -- 172.21.15.12:0/1848424737 >> 172.21.15.12:0/1848424737 conn(0x55cb337327e0 msgr2=0x55cb3380be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03797fa700 0 client.19347 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 1 -- 172.21.15.12:0/1848424737 shutdown_connections 2023-12-11T20:29:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 1 -- 172.21.15.12:0/1848424737 wait complete. 2023-12-11T20:29:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.362+0000 7f03ab81cb80 20 client.19347 trim_cache size 0 max 16384 2023-12-11T20:29:37.371 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:29:37.372 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:29:37.372 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:29:37.372 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:29:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 -- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a1480 msgr2=0x7f037c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a1480 0x7f037c0a3940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f038c005950 tx=0x7f038c009260 comp rx=0 tx=0).stop 2023-12-11T20:29:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 -- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 msgr2=0x7f03901a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 0x7f03901a0ba0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f0388007af0 tx=0x7f0388007870 comp rx=0 tx=0).stop 2023-12-11T20:29:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 -- 172.21.15.12:0/221181649 shutdown_connections 2023-12-11T20:29:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f037c0a1480 0x7f037c0a3940 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0390103040 0x7f03901a0ba0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03901014b0 0x7f0390199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 --2- 172.21.15.12:0/221181649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03901026a0 0x7f0390199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 -- 172.21.15.12:0/221181649 >> 172.21.15.12:0/221181649 conn(0x7f03900fca00 msgr2=0x7f0390107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 -- 172.21.15.12:0/221181649 shutdown_connections 2023-12-11T20:29:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.363+0000 7f0397dff700 1 -- 172.21.15.12:0/221181649 wait complete. 2023-12-11T20:29:37.383 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:29:37.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:29:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 -- 172.21.15.12:0/308345930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c101440 msgr2=0x7f1b4c101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 --2- 172.21.15.12:0/308345930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c101440 0x7f1b4c101860 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f1b400099c0 tx=0x7f1b40009cd0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 -- 172.21.15.12:0/308345930 shutdown_connections 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 --2- 172.21.15.12:0/308345930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b4c102fd0 0x7f1b4c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 --2- 172.21.15.12:0/308345930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c101440 0x7f1b4c101860 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 --2- 172.21.15.12:0/308345930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c102630 0x7f1b4c102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 -- 172.21.15.12:0/308345930 >> 172.21.15.12:0/308345930 conn(0x7f1b4c0fc9b0 msgr2=0x7f1b4c0fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 -- 172.21.15.12:0/308345930 shutdown_connections 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.625+0000 7f1b52dff700 1 -- 172.21.15.12:0/308345930 wait complete. 2023-12-11T20:29:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.627+0000 7f1b52dff700 1 Processor -- start 2023-12-11T20:29:37.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.627+0000 7f1b52dff700 1 -- start start 2023-12-11T20:29:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b52dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c101440 0x7f1b4c199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b52dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b4c102630 0x7f1b4c199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b52dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c102fd0 0x7f1b4c1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b52dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1a1060 con 0x7f1b4c102fd0 2023-12-11T20:29:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b52dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1a11a0 con 0x7f1b4c102630 2023-12-11T20:29:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b52dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1a1330 con 0x7f1b4c101440 2023-12-11T20:29:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b50b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c101440 0x7f1b4c199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b50b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c101440 0x7f1b4c199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48924/0 (socket says 172.21.15.12:48924) 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b50b9b700 1 -- 172.21.15.12:0/588338630 learned_addr learned my addr 172.21.15.12:0/588338630 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b4bfff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b4c102630 0x7f1b4c199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.628+0000 7f1b5139c700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c102fd0 0x7f1b4c1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b50b9b700 1 -- 172.21.15.12:0/588338630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b4c102630 msgr2=0x7f1b4c199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b50b9b700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b4c102630 0x7f1b4c199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b50b9b700 1 -- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c102fd0 msgr2=0x7f1b4c1a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b50b9b700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c102fd0 0x7f1b4c1a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b50b9b700 1 -- 172.21.15.12:0/588338630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400095f0 con 0x7f1b4c101440 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b4bfff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b4c102630 0x7f1b4c199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b50b9b700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c101440 0x7f1b4c199530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009f50 tx=0x7f1b40003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b49ffb700 1 -- 172.21.15.12:0/588338630 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4001d070 con 0x7f1b4c101440 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c1a15b0 con 0x7f1b4c101440 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b49ffb700 1 -- 172.21.15.12:0/588338630 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b4000bda0 con 0x7f1b4c101440 2023-12-11T20:29:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.629+0000 7f1b49ffb700 1 -- 172.21.15.12:0/588338630 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40022cd0 con 0x7f1b4c101440 2023-12-11T20:29:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.630+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c1a19e0 con 0x7f1b4c101440 2023-12-11T20:29:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.631+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c068330 con 0x7f1b4c101440 2023-12-11T20:29:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.633+0000 7f1b49ffb700 1 -- 172.21.15.12:0/588338630 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1b40022470 con 0x7f1b4c101440 2023-12-11T20:29:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.635+0000 7f1b49ffb700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b3c0a1480 0x7f1b3c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.635+0000 7f1b49ffb700 1 -- 172.21.15.12:0/588338630 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1b400ce050 con 0x7f1b4c101440 2023-12-11T20:29:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.635+0000 7f1b4bfff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b3c0a1480 0x7f1b3c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.636+0000 7f1b4bfff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b3c0a1480 0x7f1b3c0a3940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1b38005950 tx=0x7f1b3800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.639+0000 7f1b49ffb700 1 -- 172.21.15.12:0/588338630 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1b40097850 con 0x7f1b4c101440 2023-12-11T20:29:37.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.993+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b4c10cd70 con 0x7f1b4c101440 2023-12-11T20:29:37.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.995+0000 7f1b49ffb700 1 -- 172.21.15.12:0/588338630 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+11307 (secure 0 0 0) 0x7f1b40027020 con 0x7f1b4c101440 2023-12-11T20:29:37.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:29:37.998 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:29:26.121174+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:29:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b3c0a1480 msgr2=0x7f1b3c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b3c0a1480 0x7f1b3c0a3940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1b38005950 tx=0x7f1b3800b410 comp rx=0 tx=0).stop 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c101440 msgr2=0x7f1b4c199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c101440 0x7f1b4c199530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009f50 tx=0x7f1b40003a50 comp rx=0 tx=0).stop 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 shutdown_connections 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b3c0a1480 0x7f1b3c0a3940 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c102fd0 0x7f1b4c1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c101440 0x7f1b4c199530 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 --2- 172.21.15.12:0/588338630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b4c102630 0x7f1b4c199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.998+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 >> 172.21.15.12:0/588338630 conn(0x7f1b4c0fc9b0 msgr2=0x7f1b4c107e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.999+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 shutdown_connections 2023-12-11T20:29:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:37.999+0000 7f1b52dff700 1 -- 172.21.15.12:0/588338630 wait complete. 2023-12-11T20:29:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2023-12-11T20:29:38.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.236+0000 7f60bd3ff700 1 -- 172.21.15.12:0/389853906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81026c0 msgr2=0x7f60b8102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.236+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/389853906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81026c0 0x7f60b8102b20 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0099c0 tx=0x7f60ac009cd0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.236+0000 7f60bd3ff700 1 -- 172.21.15.12:0/389853906 shutdown_connections 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.236+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/389853906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b8103060 0x7f60b8109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.236+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/389853906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60b81014d0 0x7f60b81018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.236+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/389853906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81026c0 0x7f60b8102b20 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.236+0000 7f60bd3ff700 1 -- 172.21.15.12:0/389853906 >> 172.21.15.12:0/389853906 conn(0x7f60b80fca60 msgr2=0x7f60b80fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.236+0000 7f60bd3ff700 1 -- 172.21.15.12:0/389853906 shutdown_connections 2023-12-11T20:29:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.237+0000 7f60bd3ff700 1 -- 172.21.15.12:0/389853906 wait complete. 2023-12-11T20:29:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.238+0000 7f60bd3ff700 1 Processor -- start 2023-12-11T20:29:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.238+0000 7f60bd3ff700 1 -- start start 2023-12-11T20:29:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.238+0000 7f60bd3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81014d0 0x7f60b8075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.238+0000 7f60bd3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b81026c0 0x7f60b80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.238+0000 7f60bd3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60b8103060 0x7f60b8073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.238+0000 7f60bd3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80746a0 con 0x7f60b81014d0 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.238+0000 7f60bd3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8074810 con 0x7f60b81026c0 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.238+0000 7f60bd3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81a13b0 con 0x7f60b8103060 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81014d0 0x7f60b8075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81014d0 0x7f60b8075330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42806/0 (socket says 172.21.15.12:42806) 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 -- 172.21.15.12:0/1494796749 learned_addr learned my addr 172.21.15.12:0/1494796749 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b67fc700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b81026c0 0x7f60b80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b77fe700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60b8103060 0x7f60b8073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 -- 172.21.15.12:0/1494796749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60b8103060 msgr2=0x7f60b8073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60b8103060 0x7f60b8073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 -- 172.21.15.12:0/1494796749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b81026c0 msgr2=0x7f60b80739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b81026c0 0x7f60b80739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 -- 172.21.15.12:0/1494796749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0095f0 con 0x7f60b81014d0 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b67fc700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b81026c0 0x7f60b80739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:38.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.239+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81014d0 0x7f60b8075330 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f60a800e970 tx=0x7f60a800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.240+0000 7f609ffff700 1 -- 172.21.15.12:0/1494796749 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8009790 con 0x7f60b81014d0 2023-12-11T20:29:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.240+0000 7f609ffff700 1 -- 172.21.15.12:0/1494796749 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60a800c780 con 0x7f60b81014d0 2023-12-11T20:29:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.240+0000 7f609ffff700 1 -- 172.21.15.12:0/1494796749 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8003b40 con 0x7f60b81014d0 2023-12-11T20:29:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.240+0000 7f60bd3ff700 1 -- 172.21.15.12:0/1494796749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b81a1640 con 0x7f60b81014d0 2023-12-11T20:29:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.240+0000 7f60bd3ff700 1 -- 172.21.15.12:0/1494796749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b81a1b00 con 0x7f60b81014d0 2023-12-11T20:29:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.244+0000 7f609ffff700 1 -- 172.21.15.12:0/1494796749 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f60a800cbf0 con 0x7f60b81014d0 2023-12-11T20:29:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.246+0000 7f609ffff700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60a00a14f0 0x7f60a00a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.246+0000 7f60d0d09b80 1 Processor -- start 2023-12-11T20:29:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.246+0000 7f609ffff700 1 -- 172.21.15.12:0/1494796749 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f60a8014070 con 0x7f60b81014d0 2023-12-11T20:29:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.246+0000 7f60d0d09b80 1 -- start start 2023-12-11T20:29:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.246+0000 7f60b67fc700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60a00a14f0 0x7f60a00a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efed72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efed8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efed8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efe32af0 con 0x55d8efed8720 2023-12-11T20:29:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efe30410 con 0x55d8efed7830 2023-12-11T20:29:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efe2bd00 con 0x55d8efed6ed0 2023-12-11T20:29:38.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efed8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60b6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efed72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60b6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efed72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:48942/0 (socket says 172.21.15.12:48942) 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60b6ffd700 1 -- 172.21.15.12:0/3095446077 learned_addr learned my addr 172.21.15.12:0/3095446077 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60b67fc700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60a00a14f0 0x7f60a00a39b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f60ac000c00 tx=0x7f60ac01a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.247+0000 7f60b67fc700 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efed8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f60b6ffd700 1 -- 172.21.15.12:0/3095446077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 msgr2=0x55d8efed8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efed8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f60b6ffd700 1 -- 172.21.15.12:0/3095446077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 msgr2=0x55d8efed8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efed8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f60b6ffd700 1 -- 172.21.15.12:0/3095446077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8efca85d0 con 0x55d8efed6ed0 2023-12-11T20:29:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f60b77fe700 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efed8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efed72f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60a8096c30 tx=0x7f60a8099b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e38e05dd74155d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f609d7fa700 1 -- 172.21.15.12:0/3095446077 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80b1070 con 0x55d8efed6ed0 2023-12-11T20:29:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f609d7fa700 1 -- 172.21.15.12:0/3095446077 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60a809a8c0 con 0x55d8efed6ed0 2023-12-11T20:29:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.248+0000 7f609d7fa700 1 -- 172.21.15.12:0/3095446077 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8003ca0 con 0x55d8efed6ed0 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.249+0000 7f60d0d09b80 1 -- 172.21.15.12:0/3095446077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 msgr2=0x55d8efed72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.249+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efed72f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60a8096c30 tx=0x7f60a8099b20 comp rx=0 tx=0).stop 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.249+0000 7f60d0d09b80 1 -- 172.21.15.12:0/3095446077 shutdown_connections 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.249+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efed8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.249+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efed72f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.249+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/3095446077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efed8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.249+0000 7f60d0d09b80 1 -- 172.21.15.12:0/3095446077 >> 172.21.15.12:0/3095446077 conn(0x55d8efe06780 msgr2=0x55d8efed3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.250+0000 7f60d0d09b80 1 -- 172.21.15.12:0/3095446077 shutdown_connections 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.250+0000 7f60d0d09b80 1 -- 172.21.15.12:0/3095446077 wait complete. 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.250+0000 7f60d0d09b80 1 -- start start 2023-12-11T20:29:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.251+0000 7f60d0d09b80 1 Processor -- start 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.251+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.251+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efee13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.251+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efee8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.251+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efde5500 con 0x55d8efed8720 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.251+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efde51a0 con 0x55d8efed7830 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.251+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efcaa8c0 con 0x55d8efed6ed0 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60d0d09b80 10 client.0 _ll_register_callbacks cb 0x55d8efd10a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b67fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efee13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b67fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efee13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37360/0 (socket says 172.21.15.12:37360) 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b67fc700 1 -- 172.21.15.12:0/2323836435 learned_addr learned my addr 172.21.15.12:0/2323836435 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b77fe700 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efee8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b6ffd700 1 -- 172.21.15.12:0/2323836435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 msgr2=0x55d8efee13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efee13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b6ffd700 1 -- 172.21.15.12:0/2323836435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 msgr2=0x55d8efee8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efee8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b6ffd700 1 -- 172.21.15.12:0/2323836435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b0003ac0 con 0x55d8efed6ed0 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.252+0000 7f60b77fe700 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efee8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.253+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60a8096c30 tx=0x7f60a8098640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa54d23624192184 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.253+0000 7f609aff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.253+0000 7f609aff5700 1 -- 172.21.15.12:0/2323836435 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80b1030 con 0x55d8efed6ed0 2023-12-11T20:29:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.253+0000 7f609aff5700 1 -- 172.21.15.12:0/2323836435 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f60a80b2070 con 0x55d8efed6ed0 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.253+0000 7f60d0d09b80 1 -- 172.21.15.12:0/2323836435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8efeca730 con 0x55d8efed6ed0 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.253+0000 7f609aff5700 1 -- 172.21.15.12:0/2323836435 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60a80b84c0 con 0x55d8efed6ed0 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.253+0000 7f60d0d09b80 10 client.28936 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.253+0000 7f60d0d09b80 1 -- 172.21.15.12:0/2323836435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f60b81a1b00 con 0x55d8efed6ed0 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.254+0000 7f609aff5700 1 -- 172.21.15.12:0/2323836435 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d8efeca730 con 0x55d8efed6ed0 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.254+0000 7f609aff5700 1 -- 172.21.15.12:0/2323836435 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f60a8099720 con 0x55d8efed6ed0 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.254+0000 7f60d0d09b80 10 client.28936 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.254+0000 7f60d0d09b80 10 client.28936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.254+0000 7f60d0d09b80 20 client.28936 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.254+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8efeec9f0 0x55d8efeeee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.254+0000 7f60d0d09b80 4 client.28936 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.254+0000 7f60d0d09b80 1 -- 172.21.15.12:0/2323836435 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8efea6ee0 con 0x55d8efeec9f0 2023-12-11T20:29:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.255+0000 7f60b67fc700 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8efeec9f0 0x55d8efeeee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.255+0000 7f60b67fc700 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8efeec9f0 0x55d8efeeee10 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10191a78ffcde424 server_cookie=a1a8390fcfd61ffd in_seq=0 out_seq=0 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.255+0000 7f609aff5700 10 client.28936 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f609aff5700 1 -- 172.21.15.12:0/2323836435 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d8efea6ee0 con 0x55d8efeec9f0 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f609aff5700 10 client.28936 handle_command_reply: tid=0 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 client.28936 shutdown 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 -- 172.21.15.12:0/2323836435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 msgr2=0x55d8efee0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60a8096c30 tx=0x7f60a8098640 comp rx=0 tx=0).stop 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 -- 172.21.15.12:0/2323836435 shutdown_connections 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8efeec9f0 0x55d8efeeee10 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed8720 0x55d8efee8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0ea0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/2323836435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed7830 0x55d8efee13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f60d0d09b80 1 -- 172.21.15.12:0/2323836435 >> 172.21.15.12:0/2323836435 conn(0x55d8efe06780 msgr2=0x55d8efed1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.256+0000 7f609aff5700 0 client.28936 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.257+0000 7f60d0d09b80 1 -- 172.21.15.12:0/2323836435 shutdown_connections 2023-12-11T20:29:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.257+0000 7f60d0d09b80 1 -- 172.21.15.12:0/2323836435 wait complete. 2023-12-11T20:29:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.257+0000 7f60d0d09b80 20 client.28936 trim_cache size 0 max 16384 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.280+0000 7f60d0d09b80 1 Processor -- start 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60d0d09b80 1 -- start start 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed8720 0x55d8efef3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efeca700 con 0x55d8efed7830 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efee0800 con 0x55d8efed8720 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efed2d70 con 0x55d8efed6ed0 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42838/0 (socket says 172.21.15.12:42838) 2023-12-11T20:29:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60b67fc700 1 -- 172.21.15.12:0/1472146747 learned_addr learned my addr 172.21.15.12:0/1472146747 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.281+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f60b77fe700 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed8720 0x55d8efef3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f60b6ffd700 1 -- 172.21.15.12:0/1472146747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed8720 msgr2=0x55d8efef3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed8720 0x55d8efef3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f60b6ffd700 1 -- 172.21.15.12:0/1472146747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 msgr2=0x55d8efee81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f60b6ffd700 1 -- 172.21.15.12:0/1472146747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8efc54d80 con 0x55d8efed6ed0 2023-12-11T20:29:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f60b67fc700 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f60a8004800 tx=0x7f60a8005910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f14e63a6e09ec7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f609dffb700 1 -- 172.21.15.12:0/1472146747 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80b1020 con 0x55d8efed6ed0 2023-12-11T20:29:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f609dffb700 1 -- 172.21.15.12:0/1472146747 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60a8064030 con 0x55d8efed6ed0 2023-12-11T20:29:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.282+0000 7f609dffb700 1 -- 172.21.15.12:0/1472146747 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a809e310 con 0x55d8efed6ed0 2023-12-11T20:29:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.283+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1472146747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 msgr2=0x55d8efee0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.283+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f60a8004800 tx=0x7f60a8005910 comp rx=0 tx=0).stop 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.283+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1472146747 shutdown_connections 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.283+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed8720 0x55d8efef3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.283+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed6ed0 0x55d8efee0210 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.283+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1472146747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.283+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1472146747 >> 172.21.15.12:0/1472146747 conn(0x55d8efe06780 msgr2=0x55d8efedeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.284+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1472146747 shutdown_connections 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.284+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1472146747 wait complete. 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.284+0000 7f60d0d09b80 1 -- start start 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.284+0000 7f60d0d09b80 1 Processor -- start 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed6ed0 0x55d8efee5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60d0d09b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed8720 0x55d8efee6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efee6e60 con 0x55d8efed7830 2023-12-11T20:29:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efee6fd0 con 0x55d8efed6ed0 2023-12-11T20:29:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60d0d09b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8efee7190 con 0x55d8efed8720 2023-12-11T20:29:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60d0d09b80 10 client.0 _ll_register_callbacks cb 0x55d8efd10a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60b67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42840/0 (socket says 172.21.15.12:42840) 2023-12-11T20:29:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.285+0000 7f60b67fc700 1 -- 172.21.15.12:0/1136559693 learned_addr learned my addr 172.21.15.12:0/1136559693 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b77fe700 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed8720 0x55d8efee6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed6ed0 0x55d8efee5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b67fc700 1 -- 172.21.15.12:0/1136559693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed8720 msgr2=0x55d8efee6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b67fc700 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed8720 0x55d8efee6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b67fc700 1 -- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed6ed0 msgr2=0x55d8efee5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b67fc700 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed6ed0 0x55d8efee5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b67fc700 1 -- 172.21.15.12:0/1136559693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b810a260 con 0x55d8efed7830 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed6ed0 0x55d8efee5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f60b67fc700 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee5940 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009fd0 tx=0x7f60ac009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1b03ea52d38323 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.286+0000 7f609aff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.287+0000 7f609aff5700 1 -- 172.21.15.12:0/1136559693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac02b070 con 0x55d8efed7830 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.287+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1136559693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60a809a8c0 con 0x55d8efed7830 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.287+0000 7f609aff5700 1 -- 172.21.15.12:0/1136559693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f60ac0327a0 con 0x55d8efed7830 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.287+0000 7f609aff5700 1 -- 172.21.15.12:0/1136559693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60ac003760 con 0x55d8efed7830 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.287+0000 7f60d0d09b80 10 client.19371 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.287+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1136559693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f60b81a1b00 con 0x55d8efed7830 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.287+0000 7f609aff5700 1 -- 172.21.15.12:0/1136559693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60a809a8c0 con 0x55d8efed7830 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.288+0000 7f609aff5700 1 -- 172.21.15.12:0/1136559693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f60ac00f7d0 con 0x55d8efed7830 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.288+0000 7f60d0d09b80 10 client.19371 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.288+0000 7f60d0d09b80 10 client.19371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.288+0000 7f60d0d09b80 20 client.19371 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.288+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8eff4bb50 0x55d8eff4df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.288+0000 7f60d0d09b80 4 client.19371 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.288+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1136559693 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8efdf1f70 con 0x55d8eff4bb50 2023-12-11T20:29:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.289+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8eff4bb50 0x55d8eff4df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.289+0000 7f60b6ffd700 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8eff4bb50 0x55d8eff4df70 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b7dcc8a7209b60a server_cookie=65081f21dc48d40f in_seq=0 out_seq=0 2023-12-11T20:29:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.289+0000 7f609aff5700 10 client.19371 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f609aff5700 1 -- 172.21.15.12:0/1136559693 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8efdf1f70 con 0x55d8eff4bb50 2023-12-11T20:29:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f609aff5700 10 client.19371 handle_command_reply: tid=0 2023-12-11T20:29:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 client.19371 shutdown 2023-12-11T20:29:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1136559693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 msgr2=0x55d8efee5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee5940 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009fd0 tx=0x7f60ac009310 comp rx=0 tx=0).stop 2023-12-11T20:29:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1136559693 shutdown_connections 2023-12-11T20:29:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8eff4bb50 0x55d8eff4df70 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d8efed6ed0 0x55d8efee5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8efed8720 0x55d8efee6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 --2- 172.21.15.12:0/1136559693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d8efed7830 0x55d8efee5940 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1136559693 >> 172.21.15.12:0/1136559693 conn(0x55d8efe06780 msgr2=0x55d8efef3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.299+0000 7f609aff5700 0 client.19371 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.300+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1136559693 shutdown_connections 2023-12-11T20:29:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.300+0000 7f60d0d09b80 1 -- 172.21.15.12:0/1136559693 wait complete. 2023-12-11T20:29:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.300+0000 7f60d0d09b80 20 client.19371 trim_cache size 0 max 16384 2023-12-11T20:29:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:29:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:29:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:29:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.300+0000 7f60bd3ff700 1 -- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60a00a14f0 msgr2=0x7f60a00a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.300+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60a00a14f0 0x7f60a00a39b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f60ac000c00 tx=0x7f60ac01a040 comp rx=0 tx=0).stop 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.300+0000 7f60bd3ff700 1 -- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81014d0 msgr2=0x7f60b8075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.300+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81014d0 0x7f60b8075330 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f60a800e970 tx=0x7f60a800ec80 comp rx=0 tx=0).stop 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.301+0000 7f60bd3ff700 1 -- 172.21.15.12:0/1494796749 shutdown_connections 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.301+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f60a00a14f0 0x7f60a00a39b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.301+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60b8103060 0x7f60b8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.301+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60b81014d0 0x7f60b8075330 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.301+0000 7f60bd3ff700 1 --2- 172.21.15.12:0/1494796749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b81026c0 0x7f60b80739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.301+0000 7f60bd3ff700 1 -- 172.21.15.12:0/1494796749 >> 172.21.15.12:0/1494796749 conn(0x7f60b80fca60 msgr2=0x7f60b8105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.301+0000 7f60bd3ff700 1 -- 172.21.15.12:0/1494796749 shutdown_connections 2023-12-11T20:29:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:38.301+0000 7f60bd3ff700 1 -- 172.21.15.12:0/1494796749 wait complete. 2023-12-11T20:29:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 -- 172.21.15.12:0/2733136674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c074030 msgr2=0x7f8a4c0744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 --2- 172.21.15.12:0/2733136674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c074030 0x7f8a4c0744b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009990 tx=0x7f8a40009ca0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 -- 172.21.15.12:0/2733136674 shutdown_connections 2023-12-11T20:29:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 --2- 172.21.15.12:0/2733136674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c109370 0x7f8a4c10b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 --2- 172.21.15.12:0/2733136674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a4c075610 0x7f8a4c073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 --2- 172.21.15.12:0/2733136674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c074030 0x7f8a4c0744b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 -- 172.21.15.12:0/2733136674 >> 172.21.15.12:0/2733136674 conn(0x7f8a4c0fca00 msgr2=0x7f8a4c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 -- 172.21.15.12:0/2733136674 shutdown_connections 2023-12-11T20:29:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.405+0000 7f8a525ff700 1 -- 172.21.15.12:0/2733136674 wait complete. 2023-12-11T20:29:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.406+0000 7f8a525ff700 1 Processor -- start 2023-12-11T20:29:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.406+0000 7f8a525ff700 1 -- start start 2023-12-11T20:29:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a525ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a4c074030 0x7f8a4c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a525ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c075610 0x7f8a4c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a525ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c109370 0x7f8a4c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a525ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c1a10c0 con 0x7f8a4c109370 2023-12-11T20:29:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a525ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c1a1200 con 0x7f8a4c075610 2023-12-11T20:29:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a525ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c1a1390 con 0x7f8a4c074030 2023-12-11T20:29:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a50b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c109370 0x7f8a4c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a4bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a4c074030 0x7f8a4c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a50b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c109370 0x7f8a4c1a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42844/0 (socket says 172.21.15.12:42844) 2023-12-11T20:29:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a50b9c700 1 -- 172.21.15.12:0/1775435674 learned_addr learned my addr 172.21.15.12:0/1775435674 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.407+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c075610 0x7f8a4c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a50b9c700 1 -- 172.21.15.12:0/1775435674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a4c074030 msgr2=0x7f8a4c199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a50b9c700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a4c074030 0x7f8a4c199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a50b9c700 1 -- 172.21.15.12:0/1775435674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c075610 msgr2=0x7f8a4c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a50b9c700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c075610 0x7f8a4c199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a50b9c700 1 -- 172.21.15.12:0/1775435674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400095f0 con 0x7f8a4c109370 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c075610 0x7f8a4c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a50b9c700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c109370 0x7f8a4c1a0af0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007ee0 tx=0x7f8a4400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a497fa700 1 -- 172.21.15.12:0/1775435674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44017070 con 0x7f8a4c109370 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a525ff700 1 -- 172.21.15.12:0/1775435674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c1a1670 con 0x7f8a4c109370 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a497fa700 1 -- 172.21.15.12:0/1775435674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a4400f040 con 0x7f8a4c109370 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a497fa700 1 -- 172.21.15.12:0/1775435674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44005710 con 0x7f8a4c109370 2023-12-11T20:29:38.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.408+0000 7f8a525ff700 1 -- 172.21.15.12:0/1775435674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c1a1b80 con 0x7f8a4c109370 2023-12-11T20:29:38.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.413+0000 7f8a497fa700 1 -- 172.21.15.12:0/1775435674 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8a44005870 con 0x7f8a4c109370 2023-12-11T20:29:38.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.414+0000 7f8a66007b80 1 Processor -- start 2023-12-11T20:29:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.414+0000 7f8a66007b80 1 -- start start 2023-12-11T20:29:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1aec20 0x55aaba1af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a66007b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba108b50 con 0x55aaba1add30 2023-12-11T20:29:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a66007b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba106470 con 0x55aaba1aec20 2023-12-11T20:29:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a66007b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba101d60 con 0x55aaba1ad3d0 2023-12-11T20:29:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a4bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49004/0 (socket says 172.21.15.12:49004) 2023-12-11T20:29:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a4b7fe700 1 -- 172.21.15.12:0/2781931787 learned_addr learned my addr 172.21.15.12:0/2781931787 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a497fa700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a340a1480 0x7f8a340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.415+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1aec20 0x55aaba1af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a497fa700 1 -- 172.21.15.12:0/1775435674 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a440cc4e0 con 0x7f8a4c109370 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a4bfff700 1 -- 172.21.15.12:0/2781931787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 msgr2=0x55aaba1ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a4bfff700 1 -- 172.21.15.12:0/2781931787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1aec20 msgr2=0x55aaba1af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1aec20 0x55aaba1af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a4bfff700 1 -- 172.21.15.12:0/2781931787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aab9f7e630 con 0x55aaba1add30 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a50b9c700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a340a1480 0x7f8a340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1ae640 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c007c70 tx=0x7f8a3c007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56b128bbb73c7c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a327fc700 1 -- 172.21.15.12:0/2781931787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c010ca0 con 0x55aaba1add30 2023-12-11T20:29:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.416+0000 7f8a327fc700 1 -- 172.21.15.12:0/2781931787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a3c0044e0 con 0x55aaba1add30 2023-12-11T20:29:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.417+0000 7f8a327fc700 1 -- 172.21.15.12:0/2781931787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c005020 con 0x55aaba1add30 2023-12-11T20:29:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.417+0000 7f8a50b9c700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a340a1480 0x7f8a340a3940 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8a44096220 tx=0x7f8a4400dbd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.417+0000 7f8a66007b80 1 -- 172.21.15.12:0/2781931787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 msgr2=0x55aaba1ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.417+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1ae640 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c007c70 tx=0x7f8a3c007f80 comp rx=0 tx=0).stop 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.418+0000 7f8a66007b80 1 -- 172.21.15.12:0/2781931787 shutdown_connections 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.418+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1aec20 0x55aaba1af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.418+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.418+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2781931787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1ae640 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.418+0000 7f8a66007b80 1 -- 172.21.15.12:0/2781931787 >> 172.21.15.12:0/2781931787 conn(0x55aaba0dc7e0 msgr2=0x55aaba1a9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.418+0000 7f8a66007b80 1 -- 172.21.15.12:0/2781931787 shutdown_connections 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.418+0000 7f8a66007b80 1 -- 172.21.15.12:0/2781931787 wait complete. 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.418+0000 7f8a66007b80 1 -- start start 2023-12-11T20:29:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.419+0000 7f8a66007b80 1 Processor -- start 2023-12-11T20:29:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.419+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.419+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1add30 0x55aaba1b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.419+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.419+0000 7f8a66007b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba0bb560 con 0x55aaba1aec20 2023-12-11T20:29:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.419+0000 7f8a66007b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba0bb200 con 0x55aaba1ad3d0 2023-12-11T20:29:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.419+0000 7f8a66007b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab9f80920 con 0x55aaba1add30 2023-12-11T20:29:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.419+0000 7f8a66007b80 10 client.0 _ll_register_callbacks cb 0x55aab9fe6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1add30 0x55aaba1b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1be760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42872/0 (socket says 172.21.15.12:42872) 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4b7fe700 1 -- 172.21.15.12:0/372536204 learned_addr learned my addr 172.21.15.12:0/372536204 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1add30 0x55aaba1b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49012/0 (socket says 172.21.15.12:49012) 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4bfff700 1 -- 172.21.15.12:0/372536204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 msgr2=0x55aaba1b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4bfff700 1 -- 172.21.15.12:0/372536204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 msgr2=0x55aaba1be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4bfff700 1 -- 172.21.15.12:0/372536204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c10c420 con 0x55aaba1add30 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1add30 0x55aaba1b7720 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c007c40 tx=0x7f8a3c004050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=408e43a875bfcf60 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.420+0000 7f8a2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.421+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/372536204 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c01f070 con 0x55aaba1add30 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.421+0000 7f8a66007b80 1 -- 172.21.15.12:0/372536204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aaba1a0b40 con 0x55aaba1add30 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.421+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/372536204 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a3c010aa0 con 0x55aaba1add30 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.421+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/372536204 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a3c010c60 con 0x55aaba1add30 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.421+0000 7f8a66007b80 10 client.28954 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.421+0000 7f8a66007b80 1 -- 172.21.15.12:0/372536204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f8a3c0078a0 con 0x55aaba1add30 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/372536204 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a3c032080 con 0x55aaba1add30 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/372536204 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f8a3c004d60 con 0x55aaba1add30 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a66007b80 10 client.28954 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a66007b80 10 client.28954 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a66007b80 20 client.28954 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a66007b80 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55aaba1c2f40 0x55aaba1c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a66007b80 4 client.28954 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a66007b80 1 -- 172.21.15.12:0/372536204 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aaba17cf40 con 0x55aaba1c2f40 2023-12-11T20:29:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.422+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55aaba1c2f40 0x55aaba1c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.423+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55aaba1c2f40 0x55aaba1c5360 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83c9c5d5d891c2f0 server_cookie=ffb228f7147a5676 in_seq=0 out_seq=0 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.423+0000 7f8a2b7fe700 10 client.28954 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/372536204 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aaba17cf40 con 0x55aaba1c2f40 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a2b7fe700 10 client.28954 handle_command_reply: tid=0 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 client.28954 shutdown 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 -- 172.21.15.12:0/372536204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1add30 msgr2=0x55aaba1b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1add30 0x55aaba1b7720 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c007c40 tx=0x7f8a3c004050 comp rx=0 tx=0).stop 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 -- 172.21.15.12:0/372536204 shutdown_connections 2023-12-11T20:29:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55aaba1c2f40 0x55aaba1c5360 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 --2- 172.21.15.12:0/372536204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1add30 0x55aaba1b7720 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 -- 172.21.15.12:0/372536204 >> 172.21.15.12:0/372536204 conn(0x55aaba0dc7e0 msgr2=0x55aaba1a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a2b7fe700 0 client.28954 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:29:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 -- 172.21.15.12:0/372536204 shutdown_connections 2023-12-11T20:29:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.424+0000 7f8a66007b80 1 -- 172.21.15.12:0/372536204 wait complete. 2023-12-11T20:29:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.425+0000 7f8a66007b80 20 client.28954 trim_cache size 0 max 16384 2023-12-11T20:29:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.441+0000 7f8a66007b80 1 Processor -- start 2023-12-11T20:29:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a66007b80 1 -- start start 2023-12-11T20:29:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1be720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1aec20 0x55aaba1b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a66007b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba1b2750 con 0x55aaba1add30 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a66007b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba1a08d0 con 0x55aaba1ad3d0 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a66007b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba1b5bb0 con 0x55aaba1aec20 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a4bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a4bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1be720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42876/0 (socket says 172.21.15.12:42876) 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a4bfff700 1 -- 172.21.15.12:0/4024942955 learned_addr learned my addr 172.21.15.12:0/4024942955 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.442+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1aec20 0x55aaba1b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a4bfff700 1 -- 172.21.15.12:0/4024942955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1aec20 msgr2=0x55aaba1b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1aec20 0x55aaba1b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a4bfff700 1 -- 172.21.15.12:0/4024942955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 msgr2=0x55aaba1bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a4bfff700 1 -- 172.21.15.12:0/4024942955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aab9f2ade0 con 0x55aaba1add30 2023-12-11T20:29:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1be720 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c007b90 tx=0x7f8a3c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f17fd7a83a5fa93 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a32ffd700 1 -- 172.21.15.12:0/4024942955 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c01f070 con 0x55aaba1add30 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a32ffd700 1 -- 172.21.15.12:0/4024942955 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aaba1a0b40 con 0x55aaba1add30 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.443+0000 7f8a32ffd700 1 -- 172.21.15.12:0/4024942955 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c010d00 con 0x55aaba1add30 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 -- 172.21.15.12:0/4024942955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 msgr2=0x55aaba1be720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1be720 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c007b90 tx=0x7f8a3c0040e0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 -- 172.21.15.12:0/4024942955 shutdown_connections 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1aec20 0x55aaba1b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 --2- 172.21.15.12:0/4024942955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1add30 0x55aaba1be720 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 -- 172.21.15.12:0/4024942955 >> 172.21.15.12:0/4024942955 conn(0x55aaba0dc7e0 msgr2=0x55aaba1b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 -- 172.21.15.12:0/4024942955 shutdown_connections 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 -- 172.21.15.12:0/4024942955 wait complete. 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.444+0000 7f8a66007b80 1 -- start start 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a66007b80 1 Processor -- start 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1add30 0x55aaba1bc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a66007b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1bd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a66007b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba1bdb50 con 0x55aaba1aec20 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a66007b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba1bdcc0 con 0x55aaba1add30 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a66007b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba1bde80 con 0x55aaba1ad3d0 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a66007b80 10 client.0 _ll_register_callbacks cb 0x55aab9fe6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.445+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1bd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49016/0 (socket says 172.21.15.12:49016) 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 -- 172.21.15.12:0/2735598661 learned_addr learned my addr 172.21.15.12:0/2735598661 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1add30 0x55aaba1bc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 -- 172.21.15.12:0/2735598661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1add30 msgr2=0x55aaba1bc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1add30 0x55aaba1bc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 -- 172.21.15.12:0/2735598661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 msgr2=0x55aaba1bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1bd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 -- 172.21.15.12:0/2735598661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c0078a0 con 0x55aaba1ad3d0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a4b7fe700 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bc200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8a40000c00 tx=0x7f8a4000b540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55a2916d716a7097 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.446+0000 7f8a2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/2735598661 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40003a20 con 0x55aaba1ad3d0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 1 -- 172.21.15.12:0/2735598661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a3c0044e0 con 0x55aaba1ad3d0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/2735598661 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a4001c040 con 0x55aaba1ad3d0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/2735598661 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a40003b80 con 0x55aaba1ad3d0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 10 client.28960 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 1 -- 172.21.15.12:0/2735598661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55aab9f13c60 con 0x55aaba1ad3d0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/2735598661 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a3c0044e0 con 0x55aaba1ad3d0 2023-12-11T20:29:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/2735598661 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f8a4000f7e0 con 0x55aaba1ad3d0 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 10 client.28960 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 10 client.28960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 20 client.28960 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55aaba219f90 0x55aaba21c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 4 client.28960 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.447+0000 7f8a66007b80 1 -- 172.21.15.12:0/2735598661 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55aaba0c7fd0 con 0x55aaba219f90 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.448+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55aaba219f90 0x55aaba21c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a2b7fe700 10 client.28960 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.448+0000 7f8a4bfff700 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55aaba219f90 0x55aaba21c3b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=752414a3530068d server_cookie=1f9e4332a022e7d4 in_seq=0 out_seq=0 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a2b7fe700 1 -- 172.21.15.12:0/2735598661 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55aaba0c7fd0 con 0x55aaba219f90 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a2b7fe700 10 client.28960 handle_command_reply: tid=0 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 client.28960 shutdown 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 -- 172.21.15.12:0/2735598661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 msgr2=0x55aaba1bc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bc200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8a40000c00 tx=0x7f8a4000b540 comp rx=0 tx=0).stop 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 -- 172.21.15.12:0/2735598661 shutdown_connections 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55aaba219f90 0x55aaba21c3b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55aaba1aec20 0x55aaba1bd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55aaba1ad3d0 0x55aaba1bc200 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a2b7fe700 0 client.28960 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 --2- 172.21.15.12:0/2735598661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55aaba1add30 0x55aaba1bc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 -- 172.21.15.12:0/2735598661 >> 172.21.15.12:0/2735598661 conn(0x55aaba0dc7e0 msgr2=0x55aaba1b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 -- 172.21.15.12:0/2735598661 shutdown_connections 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 1 -- 172.21.15.12:0/2735598661 wait complete. 2023-12-11T20:29:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.449+0000 7f8a66007b80 20 client.28960 trim_cache size 0 max 16384 2023-12-11T20:29:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:29:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 -- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a340a1480 msgr2=0x7f8a340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a340a1480 0x7f8a340a3940 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8a44096220 tx=0x7f8a4400dbd0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 -- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c109370 msgr2=0x7f8a4c1a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c109370 0x7f8a4c1a0af0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007ee0 tx=0x7f8a4400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 -- 172.21.15.12:0/1775435674 shutdown_connections 2023-12-11T20:29:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a340a1480 0x7f8a340a3940 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c109370 0x7f8a4c1a0af0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a4c074030 0x7f8a4c199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 --2- 172.21.15.12:0/1775435674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c075610 0x7f8a4c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 -- 172.21.15.12:0/1775435674 >> 172.21.15.12:0/1775435674 conn(0x7f8a4c0fca00 msgr2=0x7f8a4c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 -- 172.21.15.12:0/1775435674 shutdown_connections 2023-12-11T20:29:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.450+0000 7f8a525ff700 1 -- 172.21.15.12:0/1775435674 wait complete. 2023-12-11T20:29:38.469 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:29:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.706+0000 7f1d2edff700 1 -- 172.21.15.12:0/2591833709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d28101fd0 msgr2=0x7f1d281043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.706+0000 7f1d2edff700 1 --2- 172.21.15.12:0/2591833709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d28101fd0 0x7f1d281043c0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009990 tx=0x7f1d1c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.707+0000 7f1d2edff700 1 -- 172.21.15.12:0/2591833709 shutdown_connections 2023-12-11T20:29:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.707+0000 7f1d2edff700 1 --2- 172.21.15.12:0/2591833709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28107230 0x7f1d28109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.707+0000 7f1d2edff700 1 --2- 172.21.15.12:0/2591833709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d28101fd0 0x7f1d281043c0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.707+0000 7f1d2edff700 1 --2- 172.21.15.12:0/2591833709 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d28104900 0x7f1d28106cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.707+0000 7f1d2edff700 1 -- 172.21.15.12:0/2591833709 >> 172.21.15.12:0/2591833709 conn(0x7f1d280fb920 msgr2=0x7f1d280fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.707+0000 7f1d2edff700 1 -- 172.21.15.12:0/2591833709 shutdown_connections 2023-12-11T20:29:38.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.707+0000 7f1d2edff700 1 -- 172.21.15.12:0/2591833709 wait complete. 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.708+0000 7f1d2edff700 1 Processor -- start 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.708+0000 7f1d2edff700 1 -- start start 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.708+0000 7f1d2edff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28101fd0 0x7f1d28197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.708+0000 7f1d2edff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d28104900 0x7f1d28197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2edff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d28107230 0x7f1d2819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2edff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2819ee30 con 0x7f1d28104900 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2edff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2819ef70 con 0x7f1d28107230 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2edff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2819f100 con 0x7f1d28101fd0 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2cb9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28101fd0 0x7f1d28197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2cb9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28101fd0 0x7f1d28197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49044/0 (socket says 172.21.15.12:49044) 2023-12-11T20:29:38.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/496629346 learned_addr learned my addr 172.21.15.12:0/496629346 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d27fff700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d28104900 0x7f1d28197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2d39c700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d28107230 0x7f1d2819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/496629346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d28107230 msgr2=0x7f1d2819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d28107230 0x7f1d2819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d28104900 msgr2=0x7f1d28197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d28104900 0x7f1d28197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.709+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/496629346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0095f0 con 0x7f1d28101fd0 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.710+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28101fd0 0x7f1d28197350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c005770 tx=0x7f1d1c0057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.710+0000 7f1d25ffb700 1 -- 172.21.15.12:0/496629346 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c01d070 con 0x7f1d28101fd0 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.710+0000 7f1d25ffb700 1 -- 172.21.15.12:0/496629346 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d1c00be70 con 0x7f1d28101fd0 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.710+0000 7f1d25ffb700 1 -- 172.21.15.12:0/496629346 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c021410 con 0x7f1d28101fd0 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.710+0000 7f1d2edff700 1 -- 172.21.15.12:0/496629346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2819f380 con 0x7f1d28101fd0 2023-12-11T20:29:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.710+0000 7f1d2edff700 1 -- 172.21.15.12:0/496629346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2819f750 con 0x7f1d28101fd0 2023-12-11T20:29:38.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.715+0000 7f1d25ffb700 1 -- 172.21.15.12:0/496629346 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1d1c00f660 con 0x7f1d28101fd0 2023-12-11T20:29:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.716+0000 7f1d426b7b80 1 Processor -- start 2023-12-11T20:29:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.716+0000 7f1d426b7b80 1 -- start start 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.716+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e2713d0 0x55559e2717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.716+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e272640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.716+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e2730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.716+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e1ccb50 con 0x55559e271d30 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.716+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e1ca470 con 0x55559e2713d0 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.716+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e1c5d60 con 0x55559e272c20 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d2cb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e272640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d2d39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e2713d0 0x55559e2717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d2d39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e2713d0 0x55559e2717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37450/0 (socket says 172.21.15.12:37450) 2023-12-11T20:29:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d2d39c700 1 -- 172.21.15.12:0/1332853541 learned_addr learned my addr 172.21.15.12:0/1332853541 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e2730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d25ffb700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1d180a1480 0x7f1d180a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d27fff700 1 -- 172.21.15.12:0/1332853541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e2713d0 msgr2=0x55559e2717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e2713d0 0x55559e2717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d27fff700 1 -- 172.21.15.12:0/1332853541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 msgr2=0x55559e272640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e272640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d27fff700 1 -- 172.21.15.12:0/1332853541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55559e042630 con 0x55559e272c20 2023-12-11T20:29:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d25ffb700 1 -- 172.21.15.12:0/496629346 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1d1c0cdfa0 con 0x7f1d28101fd0 2023-12-11T20:29:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d2d39c700 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e2713d0 0x55559e2717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.717+0000 7f1d2d39c700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1d180a1480 0x7f1d180a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.718+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e2730a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009cb0 tx=0x7f1d14011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b9140ca4c5e294 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.718+0000 7f1d12ffd700 1 -- 172.21.15.12:0/1332853541 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14011d20 con 0x55559e272c20 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.718+0000 7f1d2d39c700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1d180a1480 0x7f1d180a3940 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1d200094b0 tx=0x7f1d20004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.718+0000 7f1d12ffd700 1 -- 172.21.15.12:0/1332853541 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d14011e80 con 0x55559e272c20 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.718+0000 7f1d12ffd700 1 -- 172.21.15.12:0/1332853541 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14005280 con 0x55559e272c20 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1332853541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 msgr2=0x55559e2730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e2730a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009cb0 tx=0x7f1d14011440 comp rx=0 tx=0).stop 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1332853541 shutdown_connections 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e2713d0 0x55559e2717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e2730a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1332853541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e272640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1332853541 >> 172.21.15.12:0/1332853541 conn(0x55559e1a07e0 msgr2=0x55559e26dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1332853541 shutdown_connections 2023-12-11T20:29:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.719+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1332853541 wait complete. 2023-12-11T20:29:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.720+0000 7f1d426b7b80 1 -- start start 2023-12-11T20:29:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.720+0000 7f1d426b7b80 1 Processor -- start 2023-12-11T20:29:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e27b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e27b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 0x55559e282760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e17f560 con 0x55559e271d30 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e17f200 con 0x55559e272c20 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e044920 con 0x55559e2713d0 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d426b7b80 10 client.0 _ll_register_callbacks cb 0x55559e0aaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d27fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e27b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d27fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e27b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42912/0 (socket says 172.21.15.12:42912) 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d27fff700 1 -- 172.21.15.12:0/1042921205 learned_addr learned my addr 172.21.15.12:0/1042921205 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e27b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.721+0000 7f1d2d39c700 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 0x55559e282760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1042921205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 msgr2=0x55559e282760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 0x55559e282760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1042921205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 msgr2=0x55559e27b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e27b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1042921205 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d20011380 con 0x55559e2713d0 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e27b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e27b1e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c09afa0 tx=0x7f1d1c005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80875788e8ec7656 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d07fff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d07fff700 1 -- 172.21.15.12:0/1042921205 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0a1040 con 0x55559e2713d0 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1042921205 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55559e240f40 con 0x55559e2713d0 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d07fff700 1 -- 172.21.15.12:0/1042921205 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1d1c09b9a0 con 0x55559e2713d0 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d07fff700 1 -- 172.21.15.12:0/1042921205 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d1c09b070 con 0x55559e2713d0 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d426b7b80 10 client.28972 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.722+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1042921205 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f1d140098e0 con 0x55559e2713d0 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.723+0000 7f1d07fff700 1 -- 172.21.15.12:0/1042921205 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d1c0b7020 con 0x55559e2713d0 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.723+0000 7f1d07fff700 1 -- 172.21.15.12:0/1042921205 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1d1c0a3110 con 0x55559e2713d0 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.723+0000 7f1d426b7b80 10 client.28972 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.723+0000 7f1d426b7b80 10 client.28972 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.723+0000 7f1d426b7b80 20 client.28972 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.723+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55559e286c60 0x55559e289080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.723+0000 7f1d426b7b80 4 client.28972 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.723+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1042921205 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55559e18bfd0 con 0x55559e286c60 2023-12-11T20:29:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.724+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55559e286c60 0x55559e289080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.724+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55559e286c60 0x55559e289080 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3c7273e20a97ba4 server_cookie=4db3143e1920ea38 in_seq=0 out_seq=0 2023-12-11T20:29:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.724+0000 7f1d07fff700 10 client.28972 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:29:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d07fff700 1 -- 172.21.15.12:0/1042921205 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55559e18bfd0 con 0x55559e286c60 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d07fff700 10 client.28972 handle_command_reply: tid=0 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 client.28972 shutdown 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 msgr2=0x55559e27b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e27b1e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c09afa0 tx=0x7f1d1c005a90 comp rx=0 tx=0).stop 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1042921205 shutdown_connections 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55559e286c60 0x55559e289080 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 0x55559e282760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e27b1e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1042921205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e27b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d07fff700 0 client.28972 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1042921205 >> 172.21.15.12:0/1042921205 conn(0x55559e1a07e0 msgr2=0x55559e26ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1042921205 shutdown_connections 2023-12-11T20:29:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.725+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1042921205 wait complete. 2023-12-11T20:29:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.726+0000 7f1d426b7b80 20 client.28972 trim_cache size 0 max 16384 2023-12-11T20:29:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.740+0000 7f1d426b7b80 1 Processor -- start 2023-12-11T20:29:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.740+0000 7f1d426b7b80 1 -- start start 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.740+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e2713d0 0x55559e282e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.740+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e271d30 0x55559e282720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.740+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e273000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.740+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e272aa0 con 0x55559e2713d0 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.740+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e27ad50 con 0x55559e271d30 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.740+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e272140 con 0x55559e272c20 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e2713d0 0x55559e282e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e2713d0 0x55559e282e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42926/0 (socket says 172.21.15.12:42926) 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1481850832 learned_addr learned my addr 172.21.15.12:0/1481850832 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2d39c700 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e273000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e271d30 0x55559e282720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1481850832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 msgr2=0x55559e273000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e273000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1481850832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e271d30 msgr2=0x55559e282720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e271d30 0x55559e282720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1481850832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55559dfeede0 con 0x55559e2713d0 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.741+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e2713d0 0x55559e282e10 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c097d10 tx=0x7f1d1c0ce220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d9b3e48bfcaa23 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d137fe700 1 -- 172.21.15.12:0/1481850832 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0a1050 con 0x55559e2713d0 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d137fe700 1 -- 172.21.15.12:0/1481850832 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d1c0b7070 con 0x55559e2713d0 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d137fe700 1 -- 172.21.15.12:0/1481850832 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c09b9a0 con 0x55559e2713d0 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1481850832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e2713d0 msgr2=0x55559e282e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e2713d0 0x55559e282e10 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c097d10 tx=0x7f1d1c0ce220 comp rx=0 tx=0).stop 2023-12-11T20:29:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1481850832 shutdown_connections 2023-12-11T20:29:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e272c20 0x55559e273000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e2713d0 0x55559e282e10 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1481850832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e271d30 0x55559e282720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.742+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1481850832 >> 172.21.15.12:0/1481850832 conn(0x55559e1a07e0 msgr2=0x55559e28da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.743+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1481850832 shutdown_connections 2023-12-11T20:29:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.743+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1481850832 wait complete. 2023-12-11T20:29:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.743+0000 7f1d426b7b80 1 -- start start 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.743+0000 7f1d426b7b80 1 Processor -- start 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e2d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e2d8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d426b7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 0x55559e2dfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e2e0060 con 0x55559e271d30 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e2e01a0 con 0x55559e272c20 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d426b7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559e2e0330 con 0x55559e2713d0 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d426b7b80 10 client.0 _ll_register_callbacks cb 0x55559e0aaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d2cb9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e2d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d2cb9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e2d85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49066/0 (socket says 172.21.15.12:49066) 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1149910634 learned_addr learned my addr 172.21.15.12:0/1149910634 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e2d8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.744+0000 7f1d2d39c700 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 0x55559e2dfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1149910634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 msgr2=0x55559e2dfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 0x55559e2dfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1149910634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 msgr2=0x55559e2d8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e2d8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d2cb9b700 1 -- 172.21.15.12:0/1149910634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d140098e0 con 0x55559e2713d0 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d2cb9b700 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e2d85a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00b2e0 tx=0x7f1d1c00f460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c8943e9bd6f2109 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d07fff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d07fff700 1 -- 172.21.15.12:0/1149910634 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0a1040 con 0x55559e2713d0 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d07fff700 1 -- 172.21.15.12:0/1149910634 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1d1c0b8080 con 0x55559e2713d0 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.745+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1149910634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55559e264b40 con 0x55559e2713d0 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d07fff700 1 -- 172.21.15.12:0/1149910634 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d1c09f440 con 0x55559e2713d0 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d426b7b80 10 client.28978 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1149910634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55559dfd7c60 con 0x55559e2713d0 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d07fff700 1 -- 172.21.15.12:0/1149910634 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55559e264b40 con 0x55559e2713d0 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d07fff700 1 -- 172.21.15.12:0/1149910634 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1d1c0a11a0 con 0x55559e2713d0 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d426b7b80 10 client.28978 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d426b7b80 10 client.28978 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d426b7b80 20 client.28978 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55559e2e1820 0x55559e2e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d426b7b80 4 client.28978 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:29:38.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1149910634 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55559e17e490 con 0x55559e2e1820 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.746+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55559e2e1820 0x55559e2e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.747+0000 7f1d27fff700 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55559e2e1820 0x55559e2e3c40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53c9bc2ef39dcf21 server_cookie=e2dcf85ca6fadb14 in_seq=0 out_seq=0 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.747+0000 7f1d07fff700 10 client.28978 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.747+0000 7f1d07fff700 1 -- 172.21.15.12:0/1149910634 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55559e17e490 con 0x55559e2e1820 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.747+0000 7f1d07fff700 10 client.28978 handle_command_reply: tid=0 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.747+0000 7f1d426b7b80 1 client.28978 shutdown 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1149910634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 msgr2=0x55559e2d85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e2d85a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00b2e0 tx=0x7f1d1c00f460 comp rx=0 tx=0).stop 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1149910634 shutdown_connections 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55559e2e1820 0x55559e2e3c40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55559e272c20 0x55559e2dfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55559e2713d0 0x55559e2d85a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 --2- 172.21.15.12:0/1149910634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55559e271d30 0x55559e2d8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1149910634 >> 172.21.15.12:0/1149910634 conn(0x55559e1a07e0 msgr2=0x55559e275b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d07fff700 0 client.28978 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:29:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1149910634 shutdown_connections 2023-12-11T20:29:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 1 -- 172.21.15.12:0/1149910634 wait complete. 2023-12-11T20:29:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.748+0000 7f1d426b7b80 20 client.28978 trim_cache size 0 max 16384 2023-12-11T20:29:38.750 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 -- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1d180a1480 msgr2=0x7f1d180a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1d180a1480 0x7f1d180a3940 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1d200094b0 tx=0x7f1d20004ad0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 -- 172.21.15.12:0/496629346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28101fd0 msgr2=0x7f1d28197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28101fd0 0x7f1d28197350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c005770 tx=0x7f1d1c0057a0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 -- 172.21.15.12:0/496629346 shutdown_connections 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1d180a1480 0x7f1d180a3940 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d28107230 0x7f1d2819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28101fd0 0x7f1d28197350 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 --2- 172.21.15.12:0/496629346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d28104900 0x7f1d28197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 -- 172.21.15.12:0/496629346 >> 172.21.15.12:0/496629346 conn(0x7f1d280fb920 msgr2=0x7f1d28103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 -- 172.21.15.12:0/496629346 shutdown_connections 2023-12-11T20:29:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:38.749+0000 7f1d2edff700 1 -- 172.21.15.12:0/496629346 wait complete. 2023-12-11T20:29:38.766 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:38 smithi012 ceph-mon[128787]: pgmap v786: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:29:38.766 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:38 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/588338630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:29:38.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:29:38.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:38 smithi032 ceph-mon[132488]: pgmap v786: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:29:38.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:38 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/588338630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:29:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.016+0000 7f772939d700 1 -- 172.21.15.12:0/4254362485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 msgr2=0x7f7724101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.016+0000 7f772939d700 1 --2- 172.21.15.12:0/4254362485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 0x7f7724101730 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f77140099c0 tx=0x7f7714009cd0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.016+0000 7f772939d700 1 -- 172.21.15.12:0/4254362485 shutdown_connections 2023-12-11T20:29:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.016+0000 7f772939d700 1 --2- 172.21.15.12:0/4254362485 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7724102ea0 0x7f7724109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.016+0000 7f772939d700 1 --2- 172.21.15.12:0/4254362485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 0x7f7724101730 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.016+0000 7f772939d700 1 --2- 172.21.15.12:0/4254362485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7724102500 0x7f7724102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.016+0000 7f772939d700 1 -- 172.21.15.12:0/4254362485 >> 172.21.15.12:0/4254362485 conn(0x7f77240fc8a0 msgr2=0x7f77240fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.016+0000 7f772939d700 1 -- 172.21.15.12:0/4254362485 shutdown_connections 2023-12-11T20:29:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.017+0000 7f772939d700 1 -- 172.21.15.12:0/4254362485 wait complete. 2023-12-11T20:29:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.018+0000 7f772939d700 1 Processor -- start 2023-12-11T20:29:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.018+0000 7f772939d700 1 -- start start 2023-12-11T20:29:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f772939d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 0x7f7724197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f772939d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7724102500 0x7f7724197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f772939d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7724102ea0 0x7f772419e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f772939d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772419ec40 con 0x7f7724101310 2023-12-11T20:29:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f772939d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772419ed80 con 0x7f7724102500 2023-12-11T20:29:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f772939d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772419ef10 con 0x7f7724102ea0 2023-12-11T20:29:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7723fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 0x7f7724197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7723fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 0x7f7724197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44304/0 (socket says 172.21.15.12:44304) 2023-12-11T20:29:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7723fff700 1 -- 172.21.15.12:0/264574411 learned_addr learned my addr 172.21.15.12:0/264574411 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f77237fe700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7724102500 0x7f7724197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7728b9c700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7724102ea0 0x7f772419e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7723fff700 1 -- 172.21.15.12:0/264574411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7724102ea0 msgr2=0x7f772419e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7723fff700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7724102ea0 0x7f772419e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7723fff700 1 -- 172.21.15.12:0/264574411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7724102500 msgr2=0x7f7724197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7723fff700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7724102500 0x7f7724197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.019+0000 7f7723fff700 1 -- 172.21.15.12:0/264574411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77140095f0 con 0x7f7724101310 2023-12-11T20:29:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.020+0000 7f7728b9c700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7724102ea0 0x7f772419e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.020+0000 7f7723fff700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 0x7f7724197110 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f7714009990 tx=0x7f771400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.020+0000 7f77217fa700 1 -- 172.21.15.12:0/264574411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771401d070 con 0x7f7724101310 2023-12-11T20:29:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.020+0000 7f77217fa700 1 -- 172.21.15.12:0/264574411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f771400bd10 con 0x7f7724101310 2023-12-11T20:29:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.020+0000 7f77217fa700 1 -- 172.21.15.12:0/264574411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714017650 con 0x7f7724101310 2023-12-11T20:29:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.020+0000 7f772939d700 1 -- 172.21.15.12:0/264574411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772419f190 con 0x7f7724101310 2023-12-11T20:29:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.020+0000 7f772939d700 1 -- 172.21.15.12:0/264574411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772419f560 con 0x7f7724101310 2023-12-11T20:29:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.024+0000 7f77217fa700 1 -- 172.21.15.12:0/264574411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7714022470 con 0x7f7724101310 2023-12-11T20:29:39.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.026+0000 7f773df82b80 1 Processor -- start 2023-12-11T20:29:39.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.026+0000 7f77217fa700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f770c0a1520 0x7f770c0a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.026+0000 7f773df82b80 1 -- start start 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f77217fa700 1 -- 172.21.15.12:0/264574411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f77140ce0d0 con 0x7f7724101310 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f7728b9c700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f770c0a1520 0x7f770c0a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f773df82b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f31c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f773df82b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 0x55f12f31b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f773df82b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f322ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f773df82b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f271b50 con 0x55f12f31bf80 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f773df82b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f26f470 con 0x55f12f31ac40 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f773df82b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f26ad60 con 0x55f12f31b600 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f7723fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f31c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f7723fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f31c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44316/0 (socket says 172.21.15.12:44316) 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f7723fff700 1 -- 172.21.15.12:0/185925957 learned_addr learned my addr 172.21.15.12:0/185925957 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.027+0000 7f77237fe700 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 0x55f12f31b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7728b9c700 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f322ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7723fff700 1 -- 172.21.15.12:0/185925957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 msgr2=0x55f12f322ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7723fff700 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f322ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7723fff700 1 -- 172.21.15.12:0/185925957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 msgr2=0x55f12f31b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7723fff700 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 0x55f12f31b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7723fff700 1 -- 172.21.15.12:0/185925957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f12f0e7630 con 0x55f12f31bf80 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7728b9c700 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f322ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7728b9c700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f770c0a1520 0x7f770c0a39e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f771c009550 tx=0x7f771c0077e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f7723fff700 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f31c3a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f771409b130 tx=0x7f771409b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba3ed77ffe8c358 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f770a7fc700 1 -- 172.21.15.12:0/185925957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771409bb30 con 0x55f12f31bf80 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f770a7fc700 1 -- 172.21.15.12:0/185925957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f771409b430 con 0x55f12f31bf80 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.028+0000 7f770a7fc700 1 -- 172.21.15.12:0/185925957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771409f380 con 0x55f12f31bf80 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 -- 172.21.15.12:0/185925957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 msgr2=0x55f12f31c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f31c3a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f771409b130 tx=0x7f771409b280 comp rx=0 tx=0).stop 2023-12-11T20:29:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 -- 172.21.15.12:0/185925957 shutdown_connections 2023-12-11T20:29:39.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f322ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f31c3a0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 --2- 172.21.15.12:0/185925957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 0x55f12f31b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 -- 172.21.15.12:0/185925957 >> 172.21.15.12:0/185925957 conn(0x55f12f2457e0 msgr2=0x55f12f3113d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:39.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 -- 172.21.15.12:0/185925957 shutdown_connections 2023-12-11T20:29:39.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.029+0000 7f773df82b80 1 -- 172.21.15.12:0/185925957 wait complete. 2023-12-11T20:29:39.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.030+0000 7f773df82b80 1 -- start start 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.030+0000 7f773df82b80 1 Processor -- start 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.030+0000 7f773df82b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 0x55f12f324420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.030+0000 7f773df82b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f324960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.030+0000 7f773df82b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f32b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f773df82b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f224560 con 0x55f12f31bf80 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f773df82b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f224200 con 0x55f12f31ac40 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f773df82b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f0e9920 con 0x55f12f31b600 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f773df82b80 10 client.0 _ll_register_callbacks cb 0x55f12f14fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:39.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7728b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f32b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7728b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f32b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44320/0 (socket says 172.21.15.12:44320) 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7728b9c700 1 -- 172.21.15.12:0/1762087018 learned_addr learned my addr 172.21.15.12:0/1762087018 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f77237fe700 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f324960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7723fff700 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 0x55f12f324420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7728b9c700 1 -- 172.21.15.12:0/1762087018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 msgr2=0x55f12f324960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7728b9c700 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f324960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7728b9c700 1 -- 172.21.15.12:0/1762087018 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 msgr2=0x55f12f324420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7728b9c700 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 0x55f12f324420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.031+0000 7f7728b9c700 1 -- 172.21.15.12:0/1762087018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772419f560 con 0x55f12f31bf80 2023-12-11T20:29:39.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.032+0000 7f7728b9c700 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f32b9a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f771c016d40 tx=0x7f771c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca791f84822749fa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.032+0000 7f77037fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.032+0000 7f77037fe700 1 -- 172.21.15.12:0/1762087018 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c01bbb0 con 0x55f12f31bf80 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.032+0000 7f773df82b80 1 -- 172.21.15.12:0/1762087018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f12f3099e0 con 0x55f12f31bf80 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.032+0000 7f77037fe700 1 -- 172.21.15.12:0/1762087018 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f771c01bd10 con 0x55f12f31bf80 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.032+0000 7f77037fe700 1 -- 172.21.15.12:0/1762087018 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f771c02e430 con 0x55f12f31bf80 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.032+0000 7f773df82b80 10 client.19419 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f773df82b80 1 -- 172.21.15.12:0/1762087018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f12f093de0 con 0x55f12f31bf80 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f77037fe700 1 -- 172.21.15.12:0/1762087018 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f771c032080 con 0x55f12f31bf80 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f77037fe700 1 -- 172.21.15.12:0/1762087018 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f771c0235d0 con 0x55f12f31bf80 2023-12-11T20:29:39.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f773df82b80 10 client.19419 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f773df82b80 10 client.19419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f773df82b80 20 client.19419 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f773df82b80 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f12f330190 0x55f12f3325b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f773df82b80 4 client.19419 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.033+0000 7f773df82b80 1 -- 172.21.15.12:0/1762087018 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f12f2e5f40 con 0x55f12f330190 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.034+0000 7f7723fff700 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f12f330190 0x55f12f3325b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.034+0000 7f7723fff700 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f12f330190 0x55f12f3325b0 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ea62d468534dd07 server_cookie=27e1a6e8ffa4268f in_seq=0 out_seq=0 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.034+0000 7f77037fe700 10 client.19419 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f77037fe700 1 -- 172.21.15.12:0/1762087018 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f12f2e5f40 con 0x55f12f330190 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f77037fe700 10 client.19419 handle_command_reply: tid=0 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 client.19419 shutdown 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 -- 172.21.15.12:0/1762087018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 msgr2=0x55f12f32b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f32b9a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f771c016d40 tx=0x7f771c004b40 comp rx=0 tx=0).stop 2023-12-11T20:29:39.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 -- 172.21.15.12:0/1762087018 shutdown_connections 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f12f330190 0x55f12f3325b0 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31ac40 0x55f12f324420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f32b9a0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 --2- 172.21.15.12:0/1762087018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31b600 0x55f12f324960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f77037fe700 0 client.19419 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.035+0000 7f773df82b80 1 -- 172.21.15.12:0/1762087018 >> 172.21.15.12:0/1762087018 conn(0x55f12f2457e0 msgr2=0x55f12f315820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.036+0000 7f773df82b80 1 -- 172.21.15.12:0/1762087018 shutdown_connections 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.036+0000 7f773df82b80 1 -- 172.21.15.12:0/1762087018 wait complete. 2023-12-11T20:29:39.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.036+0000 7f773df82b80 20 client.19419 trim_cache size 0 max 16384 2023-12-11T20:29:39.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.050+0000 7f773df82b80 1 Processor -- start 2023-12-11T20:29:39.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.050+0000 7f773df82b80 1 -- start start 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.050+0000 7f773df82b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31ac40 0x55f12f3243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.050+0000 7f773df82b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f324920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.050+0000 7f773df82b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31bf80 0x55f12f32b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.050+0000 7f773df82b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f3377c0 con 0x55f12f31ac40 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.050+0000 7f773df82b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f311f20 con 0x55f12f31b600 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.050+0000 7f773df82b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f31b9e0 con 0x55f12f31bf80 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f7723fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31ac40 0x55f12f3243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f7723fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31ac40 0x55f12f3243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44332/0 (socket says 172.21.15.12:44332) 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f7723fff700 1 -- 172.21.15.12:0/892326907 learned_addr learned my addr 172.21.15.12:0/892326907 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f77237fe700 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f324920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f7728b9c700 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31bf80 0x55f12f32b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f77237fe700 1 -- 172.21.15.12:0/892326907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31bf80 msgr2=0x55f12f32b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f77237fe700 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31bf80 0x55f12f32b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f77237fe700 1 -- 172.21.15.12:0/892326907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31ac40 msgr2=0x55f12f3243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f77237fe700 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31ac40 0x55f12f3243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f77237fe700 1 -- 172.21.15.12:0/892326907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f12f07cc60 con 0x55f12f31b600 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f7723fff700 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31ac40 0x55f12f3243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f7728b9c700 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31bf80 0x55f12f32b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.051+0000 7f77237fe700 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f324920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7718009e70 tx=0x7f7718004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bce308f2c73e691 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.052+0000 7f770affd700 1 -- 172.21.15.12:0/892326907 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771801f070 con 0x55f12f31b600 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.052+0000 7f770affd700 1 -- 172.21.15.12:0/892326907 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7718017040 con 0x55f12f31b600 2023-12-11T20:29:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.052+0000 7f770affd700 1 -- 172.21.15.12:0/892326907 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718016070 con 0x55f12f31b600 2023-12-11T20:29:39.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:38 smithi039 ceph-mon[102205]: pgmap v786: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:29:39.053 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:38 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/588338630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.052+0000 7f773df82b80 1 -- 172.21.15.12:0/892326907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 msgr2=0x55f12f324920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.052+0000 7f773df82b80 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f324920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7718009e70 tx=0x7f7718004320 comp rx=0 tx=0).stop 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 -- 172.21.15.12:0/892326907 shutdown_connections 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31bf80 0x55f12f32b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31ac40 0x55f12f3243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 --2- 172.21.15.12:0/892326907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f324920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 -- 172.21.15.12:0/892326907 >> 172.21.15.12:0/892326907 conn(0x55f12f2457e0 msgr2=0x55f12f310ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 -- 172.21.15.12:0/892326907 shutdown_connections 2023-12-11T20:29:39.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 -- 172.21.15.12:0/892326907 wait complete. 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 -- start start 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.053+0000 7f773df82b80 1 Processor -- start 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f773df82b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31ac40 0x55f12f32b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f773df82b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f32b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f773df82b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f329ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f773df82b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f32a240 con 0x55f12f31bf80 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f773df82b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f32a3b0 con 0x55f12f31b600 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f773df82b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f12f32a570 con 0x55f12f31ac40 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f773df82b80 10 client.0 _ll_register_callbacks cb 0x55f12f14fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f7728b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f329ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f7728b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f329ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44344/0 (socket says 172.21.15.12:44344) 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f7728b9c700 1 -- 172.21.15.12:0/3244803187 learned_addr learned my addr 172.21.15.12:0/3244803187 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f77237fe700 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f32b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.054+0000 7f7723fff700 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31ac40 0x55f12f32b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f7728b9c700 1 -- 172.21.15.12:0/3244803187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31ac40 msgr2=0x55f12f32b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f7728b9c700 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31ac40 0x55f12f32b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f7728b9c700 1 -- 172.21.15.12:0/3244803187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 msgr2=0x55f12f32b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f7728b9c700 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f32b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f7728b9c700 1 -- 172.21.15.12:0/3244803187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f12f0e7630 con 0x55f12f31bf80 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f7728b9c700 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f329ba0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f771c016d40 tx=0x7f771c009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870a110e2fa56e1b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f77037fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f77037fe700 1 -- 172.21.15.12:0/3244803187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c0236e0 con 0x55f12f31bf80 2023-12-11T20:29:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f773df82b80 1 -- 172.21.15.12:0/3244803187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f771409b430 con 0x55f12f31bf80 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.055+0000 7f77037fe700 1 -- 172.21.15.12:0/3244803187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f771c01bab0 con 0x55f12f31bf80 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f77037fe700 1 -- 172.21.15.12:0/3244803187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f771c01bc70 con 0x55f12f31bf80 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f773df82b80 10 client.19425 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f773df82b80 1 -- 172.21.15.12:0/3244803187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f7718009b20 con 0x55f12f31bf80 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f77037fe700 1 -- 172.21.15.12:0/3244803187 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f771409b430 con 0x55f12f31bf80 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f77037fe700 1 -- 172.21.15.12:0/3244803187 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f771c037c60 con 0x55f12f31bf80 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f773df82b80 10 client.19425 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f773df82b80 10 client.19425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f773df82b80 20 client.19425 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:39.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f773df82b80 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f12f387b30 0x55f12f389f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:39.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f773df82b80 4 client.19425 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:29:39.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.056+0000 7f773df82b80 1 -- 172.21.15.12:0/3244803187 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f12f230fd0 con 0x55f12f387b30 2023-12-11T20:29:39.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.057+0000 7f7723fff700 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f12f387b30 0x55f12f389f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.057+0000 7f7723fff700 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f12f387b30 0x55f12f389f50 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3162ff5bef4c248 server_cookie=59d42bfe89d955ce in_seq=0 out_seq=0 2023-12-11T20:29:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.057+0000 7f77037fe700 10 client.19425 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f77037fe700 1 -- 172.21.15.12:0/3244803187 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f12f230fd0 con 0x55f12f387b30 2023-12-11T20:29:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f77037fe700 10 client.19425 handle_command_reply: tid=0 2023-12-11T20:29:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 client.19425 shutdown 2023-12-11T20:29:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 -- 172.21.15.12:0/3244803187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 msgr2=0x55f12f329ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f329ba0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f771c016d40 tx=0x7f771c009b00 comp rx=0 tx=0).stop 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 -- 172.21.15.12:0/3244803187 shutdown_connections 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f12f387b30 0x55f12f389f50 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f12f31bf80 0x55f12f329ba0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f12f31ac40 0x55f12f32b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 --2- 172.21.15.12:0/3244803187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f12f31b600 0x55f12f32b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 -- 172.21.15.12:0/3244803187 >> 172.21.15.12:0/3244803187 conn(0x55f12f2457e0 msgr2=0x55f12f3243c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f77037fe700 0 client.19425 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 -- 172.21.15.12:0/3244803187 shutdown_connections 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 1 -- 172.21.15.12:0/3244803187 wait complete. 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.058+0000 7f773df82b80 20 client.19425 trim_cache size 0 max 16384 2023-12-11T20:29:39.062 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:29:39.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 -- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f770c0a1520 msgr2=0x7f770c0a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f770c0a1520 0x7f770c0a39e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f771c009550 tx=0x7f771c0077e0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 -- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 msgr2=0x7f7724197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:39.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 0x7f7724197110 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f7714009990 tx=0x7f771400fa00 comp rx=0 tx=0).stop 2023-12-11T20:29:39.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 -- 172.21.15.12:0/264574411 shutdown_connections 2023-12-11T20:29:39.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f770c0a1520 0x7f770c0a39e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7724102ea0 0x7f772419e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7724101310 0x7f7724197110 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 --2- 172.21.15.12:0/264574411 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7724102500 0x7f7724197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:39.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 -- 172.21.15.12:0/264574411 >> 172.21.15.12:0/264574411 conn(0x7f77240fc8a0 msgr2=0x7f7724105820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:39.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 -- 172.21.15.12:0/264574411 shutdown_connections 2023-12-11T20:29:39.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:39.059+0000 7f772939d700 1 -- 172.21.15.12:0/264574411 wait complete. 2023-12-11T20:29:40.081 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:29:40.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:29:40.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 -- 172.21.15.12:0/1967195350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 msgr2=0x7f1bd0104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/1967195350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 0x7f1bd0104d40 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00099c0 tx=0x7f1bc0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 -- 172.21.15.12:0/1967195350 shutdown_connections 2023-12-11T20:29:40.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/1967195350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bd0105280 0x7f1bd010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/1967195350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd01036f0 0x7f1bd0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/1967195350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 0x7f1bd0104d40 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 -- 172.21.15.12:0/1967195350 >> 172.21.15.12:0/1967195350 conn(0x7f1bd00fec80 msgr2=0x7f1bd01010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 -- 172.21.15.12:0/1967195350 shutdown_connections 2023-12-11T20:29:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.333+0000 7f1bd81ff700 1 -- 172.21.15.12:0/1967195350 wait complete. 2023-12-11T20:29:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.334+0000 7f1bd81ff700 1 Processor -- start 2023-12-11T20:29:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.334+0000 7f1bd81ff700 1 -- start start 2023-12-11T20:29:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd81ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bd01036f0 0x7f1bd0199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd81ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 0x7f1bd0199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd81ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd0105280 0x7f1bd01a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd81ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd01a1090 con 0x7f1bd01048e0 2023-12-11T20:29:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd81ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd01a11d0 con 0x7f1bd01036f0 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd81ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd01a1360 con 0x7f1bd0105280 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 0x7f1bd0199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 0x7f1bd0199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44364/0 (socket says 172.21.15.12:44364) 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd579a700 1 -- 172.21.15.12:0/4178278649 learned_addr learned my addr 172.21.15.12:0/4178278649 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.335+0000 7f1bd679c700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd0105280 0x7f1bd01a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bd01036f0 0x7f1bd0199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd579a700 1 -- 172.21.15.12:0/4178278649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd0105280 msgr2=0x7f1bd01a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd579a700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd0105280 0x7f1bd01a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd579a700 1 -- 172.21.15.12:0/4178278649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bd01036f0 msgr2=0x7f1bd0199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd579a700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bd01036f0 0x7f1bd0199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd579a700 1 -- 172.21.15.12:0/4178278649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00095f0 con 0x7f1bd01048e0 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd679c700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd0105280 0x7f1bd01a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd579a700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 0x7f1bd0199aa0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009fd0 tx=0x7f1bc000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bc6ffd700 1 -- 172.21.15.12:0/4178278649 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc001d070 con 0x7f1bd01048e0 2023-12-11T20:29:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bc6ffd700 1 -- 172.21.15.12:0/4178278649 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bc000bd10 con 0x7f1bd01048e0 2023-12-11T20:29:40.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd81ff700 1 -- 172.21.15.12:0/4178278649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd01a15e0 con 0x7f1bd01048e0 2023-12-11T20:29:40.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bc6ffd700 1 -- 172.21.15.12:0/4178278649 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0004cd0 con 0x7f1bd01048e0 2023-12-11T20:29:40.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.336+0000 7f1bd81ff700 1 -- 172.21.15.12:0/4178278649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd01a1a00 con 0x7f1bd01048e0 2023-12-11T20:29:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.340+0000 7f1bc6ffd700 1 -- 172.21.15.12:0/4178278649 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1bc0005050 con 0x7f1bd01048e0 2023-12-11T20:29:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.341+0000 7f1bebaf9b80 1 Processor -- start 2023-12-11T20:29:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.341+0000 7f1bebaf9b80 1 -- start start 2023-12-11T20:29:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.341+0000 7f1bc6ffd700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1bbc0a1480 0x7f1bbc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bc6ffd700 1 -- 172.21.15.12:0/4178278649 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1bc00cdc00 con 0x7f1bd01048e0 2023-12-11T20:29:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2a5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec1febd0 con 0x55d4ec2a3450 2023-12-11T20:29:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec1fc4f0 con 0x55d4ec2a4ca0 2023-12-11T20:29:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec1f7de0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bd679c700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1bbc0a1480 0x7f1bbc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bd5f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bd5f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44370/0 (socket says 172.21.15.12:44370) 2023-12-11T20:29:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bd5f9b700 1 -- 172.21.15.12:0/296817219 learned_addr learned my addr 172.21.15.12:0/296817219 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.342+0000 7f1bd579a700 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd679c700 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd579a700 1 -- 172.21.15.12:0/296817219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 msgr2=0x55d4ec2a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd579a700 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd579a700 1 -- 172.21.15.12:0/296817219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 msgr2=0x55d4ec2a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd579a700 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd579a700 1 -- 172.21.15.12:0/296817219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ec0746b0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd679c700 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd579a700 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a46c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0097400 tx=0x7f1bc009ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d104585da47cca6a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bd679c700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1bbc0a1480 0x7f1bbc0a3940 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x55d4ec2a4480 tx=0x7f1bc8009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bbbfff700 1 -- 172.21.15.12:0/296817219 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc009b600 con 0x55d4ec2a3db0 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bbbfff700 1 -- 172.21.15.12:0/296817219 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bc009af00 con 0x55d4ec2a3db0 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.343+0000 7f1bbbfff700 1 -- 172.21.15.12:0/296817219 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00992a0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/296817219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 msgr2=0x55d4ec2a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a46c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0097400 tx=0x7f1bc009ad50 comp rx=0 tx=0).stop 2023-12-11T20:29:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/296817219 shutdown_connections 2023-12-11T20:29:40.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/296817219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a46c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/296817219 >> 172.21.15.12:0/296817219 conn(0x55d4ec1d2860 msgr2=0x55d4ec29fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/296817219 shutdown_connections 2023-12-11T20:29:40.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.344+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/296817219 wait complete. 2023-12-11T20:29:40.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.345+0000 7f1bebaf9b80 1 -- start start 2023-12-11T20:29:40.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.345+0000 7f1bebaf9b80 1 Processor -- start 2023-12-11T20:29:40.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec1b15e0 con 0x55d4ec2a3450 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec1b1280 con 0x55d4ec2a4ca0 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec0769a0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bebaf9b80 10 client.0 _ll_register_callbacks cb 0x55d4ec0dcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bd5f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bd679c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bd5f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44380/0 (socket says 172.21.15.12:44380) 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bd5f9b700 1 -- 172.21.15.12:0/1326075730 learned_addr learned my addr 172.21.15.12:0/1326075730 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.346+0000 7f1bd579a700 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bd5f9b700 1 -- 172.21.15.12:0/1326075730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 msgr2=0x55d4ec2ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bd5f9b700 1 -- 172.21.15.12:0/1326075730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 msgr2=0x55d4ec2b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bd5f9b700 1 -- 172.21.15.12:0/1326075730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc00b920 con 0x55d4ec2a3450 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bd679c700 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2aced0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0126d0 tx=0x7f1bcc0129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb145f8180c5ad05 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1326075730 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc004a30 con 0x55d4ec2a3450 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1326075730 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1bcc004b90 con 0x55d4ec2a3450 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.347+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1326075730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4ec296bc0 con 0x55d4ec2a3450 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1326075730 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bcc004d50 con 0x55d4ec2a3450 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bebaf9b80 10 client.19437 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1326075730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f1bd01a1a00 con 0x55d4ec2a3450 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1326075730 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d4ec296bc0 con 0x55d4ec2a3450 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1326075730 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1bcc0108f0 con 0x55d4ec2a3450 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bebaf9b80 10 client.19437 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bebaf9b80 10 client.19437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bebaf9b80 20 client.19437 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d4ec2b8cf0 0x55d4ec2bb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bebaf9b80 4 client.19437 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.348+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1326075730 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4ec272fc0 con 0x55d4ec2b8cf0 2023-12-11T20:29:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.349+0000 7f1bd579a700 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d4ec2b8cf0 0x55d4ec2bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.349+0000 7f1bd579a700 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d4ec2b8cf0 0x55d4ec2bb110 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bc12bf9bf5b05d server_cookie=4726cf206d36d07a in_seq=0 out_seq=0 2023-12-11T20:29:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.349+0000 7f1bb97fa700 10 client.19437 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.350+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1326075730 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d4ec272fc0 con 0x55d4ec2b8cf0 2023-12-11T20:29:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.350+0000 7f1bb97fa700 10 client.19437 handle_command_reply: tid=0 2023-12-11T20:29:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.350+0000 7f1bebaf9b80 1 client.19437 shutdown 2023-12-11T20:29:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.350+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1326075730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 msgr2=0x55d4ec2aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.350+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2aced0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0126d0 tx=0x7f1bcc0129e0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.350+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1326075730 shutdown_connections 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d4ec2b8cf0 0x55d4ec2bb110 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3450 0x55d4ec2aced0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1326075730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1326075730 >> 172.21.15.12:0/1326075730 conn(0x55d4ec1d2860 msgr2=0x55d4ec29eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bb97fa700 0 client.19437 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1326075730 shutdown_connections 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1326075730 wait complete. 2023-12-11T20:29:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.351+0000 7f1bebaf9b80 20 client.19437 trim_cache size 0 max 16384 2023-12-11T20:29:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bebaf9b80 1 Processor -- start 2023-12-11T20:29:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bebaf9b80 1 -- start start 2023-12-11T20:29:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec2ab850 con 0x55d4ec2a3db0 2023-12-11T20:29:40.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec2b55d0 con 0x55d4ec2a3450 2023-12-11T20:29:40.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec2a44b0 con 0x55d4ec2a4ca0 2023-12-11T20:29:40.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bd579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bd579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44388/0 (socket says 172.21.15.12:44388) 2023-12-11T20:29:40.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.371+0000 7f1bd579a700 1 -- 172.21.15.12:0/3576871673 learned_addr learned my addr 172.21.15.12:0/3576871673 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd679c700 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd579a700 1 -- 172.21.15.12:0/3576871673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a4ca0 msgr2=0x55d4ec2b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd579a700 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd579a700 1 -- 172.21.15.12:0/3576871673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 msgr2=0x55d4ec2a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd579a700 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd579a700 1 -- 172.21.15.12:0/3576871673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ec020e60 con 0x55d4ec2a3db0 2023-12-11T20:29:40.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd679c700 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:40.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bd579a700 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a8140 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1bc009ac00 tx=0x7f1bc000b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83a2fea475a4792 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bc4ff9700 1 -- 172.21.15.12:0/3576871673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc009f0d0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bc4ff9700 1 -- 172.21.15.12:0/3576871673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bc0004e30 con 0x55d4ec2a3db0 2023-12-11T20:29:40.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.372+0000 7f1bc4ff9700 1 -- 172.21.15.12:0/3576871673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc009a650 con 0x55d4ec2a3db0 2023-12-11T20:29:40.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/3576871673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3db0 msgr2=0x55d4ec2a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a8140 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1bc009ac00 tx=0x7f1bc000b540 comp rx=0 tx=0).stop 2023-12-11T20:29:40.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/3576871673 shutdown_connections 2023-12-11T20:29:40.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 0x55d4ec2a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/3576871673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2a8140 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/3576871673 >> 172.21.15.12:0/3576871673 conn(0x55d4ec1d2860 msgr2=0x55d4ec2bfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/3576871673 shutdown_connections 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.373+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/3576871673 wait complete. 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.374+0000 7f1bebaf9b80 1 -- start start 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.374+0000 7f1bebaf9b80 1 Processor -- start 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.374+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 0x55d4ec2b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bebaf9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec2b2ba0 con 0x55d4ec2a4ca0 2023-12-11T20:29:40.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec2b2d10 con 0x55d4ec2a3450 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bebaf9b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ec2b2ed0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bebaf9b80 10 client.0 _ll_register_callbacks cb 0x55d4ec0dcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd579a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd579a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50750/0 (socket says 172.21.15.12:50750) 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd579a700 1 -- 172.21.15.12:0/1418706222 learned_addr learned my addr 172.21.15.12:0/1418706222 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44400/0 (socket says 172.21.15.12:44400) 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 0x55d4ec2b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd579a700 1 -- 172.21.15.12:0/1418706222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 msgr2=0x55d4ec2b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd579a700 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 0x55d4ec2b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd579a700 1 -- 172.21.15.12:0/1418706222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a4ca0 msgr2=0x55d4ec2b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd579a700 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.375+0000 7f1bd579a700 1 -- 172.21.15.12:0/1418706222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4ec0746b0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.376+0000 7f1bd579a700 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2b4330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b5d0 tx=0x7f1bc009b440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb3cb4e2301efe39 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.376+0000 7f1bb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.376+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1418706222 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0099040 con 0x55d4ec2a3db0 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.376+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1418706222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1bc009af00 con 0x55d4ec2a3db0 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.376+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1418706222 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1bc00a10b0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.376+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1418706222 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bc009f050 con 0x55d4ec2a3db0 2023-12-11T20:29:40.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.376+0000 7f1bebaf9b80 10 client.29011 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.376+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1418706222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d4ec009ce0 con 0x55d4ec2a3db0 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1418706222 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bc009af00 con 0x55d4ec2a3db0 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1418706222 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1bc00a2d70 con 0x55d4ec2a3db0 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bebaf9b80 10 client.29011 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bebaf9b80 10 client.29011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bebaf9b80 20 client.29011 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d4ec310310 0x55d4ec312730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bebaf9b80 4 client.29011 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:29:40.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1418706222 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d4ec1be050 con 0x55d4ec310310 2023-12-11T20:29:40.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.377+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d4ec310310 0x55d4ec312730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.378+0000 7f1bd5f9b700 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d4ec310310 0x55d4ec312730 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c159c8e2d5c34fca server_cookie=9a7d7724dc3ec9b5 in_seq=0 out_seq=0 2023-12-11T20:29:40.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.378+0000 7f1bb97fa700 10 client.29011 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:40.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bb97fa700 1 -- 172.21.15.12:0/1418706222 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d4ec1be050 con 0x55d4ec310310 2023-12-11T20:29:40.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bb97fa700 10 client.29011 handle_command_reply: tid=0 2023-12-11T20:29:40.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 client.29011 shutdown 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1418706222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 msgr2=0x55d4ec2b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2b4330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b5d0 tx=0x7f1bc009b440 comp rx=0 tx=0).stop 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1418706222 shutdown_connections 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d4ec310310 0x55d4ec312730 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d4ec2a3450 0x55d4ec2b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4ec2a4ca0 0x55d4ec2b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bb97fa700 0 client.29011 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 --2- 172.21.15.12:0/1418706222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d4ec2a3db0 0x55d4ec2b4330 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1418706222 >> 172.21.15.12:0/1418706222 conn(0x55d4ec1d2860 msgr2=0x55d4ec2a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1418706222 shutdown_connections 2023-12-11T20:29:40.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.380+0000 7f1bebaf9b80 1 -- 172.21.15.12:0/1418706222 wait complete. 2023-12-11T20:29:40.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.381+0000 7f1bebaf9b80 20 client.29011 trim_cache size 0 max 16384 2023-12-11T20:29:40.390 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:29:40.390 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:29:40.390 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "1059c268-980f-47bf-b62a-83a2f0b6003b", 2023-12-11T20:29:40.391 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:29:40.391 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:29:40.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.381+0000 7f1bd81ff700 1 -- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1bbc0a1480 msgr2=0x7f1bbc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.381+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1bbc0a1480 0x7f1bbc0a3940 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x55d4ec2a4480 tx=0x7f1bc8009920 comp rx=0 tx=0).stop 2023-12-11T20:29:40.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.381+0000 7f1bd81ff700 1 -- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 msgr2=0x7f1bd0199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.381+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 0x7f1bd0199aa0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009fd0 tx=0x7f1bc000fab0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.382+0000 7f1bd81ff700 1 -- 172.21.15.12:0/4178278649 shutdown_connections 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.382+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1bbc0a1480 0x7f1bbc0a3940 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.382+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bd01036f0 0x7f1bd0199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.382+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd0105280 0x7f1bd01a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.382+0000 7f1bd81ff700 1 --2- 172.21.15.12:0/4178278649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bd01048e0 0x7f1bd0199aa0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.382+0000 7f1bd81ff700 1 -- 172.21.15.12:0/4178278649 >> 172.21.15.12:0/4178278649 conn(0x7f1bd00fec80 msgr2=0x7f1bd0107d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.382+0000 7f1bd81ff700 1 -- 172.21.15.12:0/4178278649 shutdown_connections 2023-12-11T20:29:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.382+0000 7f1bd81ff700 1 -- 172.21.15.12:0/4178278649 wait complete. 2023-12-11T20:29:40.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:29:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 -- 172.21.15.12:0/825679678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f646c101110 msgr2=0x7f646c101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 --2- 172.21.15.12:0/825679678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f646c101110 0x7f646c101590 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f646400b0a0 tx=0x7f646400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 -- 172.21.15.12:0/825679678 shutdown_connections 2023-12-11T20:29:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 --2- 172.21.15.12:0/825679678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f646c0ffdf0 0x7f646c100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 --2- 172.21.15.12:0/825679678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f646c101110 0x7f646c101590 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 --2- 172.21.15.12:0/825679678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f646c100750 0x7f646c100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 -- 172.21.15.12:0/825679678 >> 172.21.15.12:0/825679678 conn(0x7f646c0fb930 msgr2=0x7f646c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 -- 172.21.15.12:0/825679678 shutdown_connections 2023-12-11T20:29:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.649+0000 7f64743ff700 1 -- 172.21.15.12:0/825679678 wait complete. 2023-12-11T20:29:40.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.650+0000 7f64743ff700 1 Processor -- start 2023-12-11T20:29:40.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.650+0000 7f64743ff700 1 -- start start 2023-12-11T20:29:40.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.650+0000 7f64743ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f646c0ffdf0 0x7f646c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.650+0000 7f64743ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f646c100750 0x7f646c199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f64743ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f646c101110 0x7f646c1a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f64743ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1a11f0 con 0x7f646c101110 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f64743ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1a1330 con 0x7f646c0ffdf0 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f64743ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1a14c0 con 0x7f646c100750 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647219b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f646c0ffdf0 0x7f646c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647219b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f646c0ffdf0 0x7f646c199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42648/0 (socket says 172.21.15.12:42648) 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647219b700 1 -- 172.21.15.12:0/2892777898 learned_addr learned my addr 172.21.15.12:0/2892777898 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647299c700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f646c101110 0x7f646c1a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647199a700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f646c100750 0x7f646c199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647219b700 1 -- 172.21.15.12:0/2892777898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f646c100750 msgr2=0x7f646c199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647219b700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f646c100750 0x7f646c199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647219b700 1 -- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f646c101110 msgr2=0x7f646c1a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647219b700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f646c101110 0x7f646c1a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.651+0000 7f647219b700 1 -- 172.21.15.12:0/2892777898 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468009520 con 0x7f646c0ffdf0 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.652+0000 7f647219b700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f646c0ffdf0 0x7f646c199710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f646800eb30 tx=0x7f646800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.652+0000 7f64637fe700 1 -- 172.21.15.12:0/2892777898 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468009880 con 0x7f646c0ffdf0 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.652+0000 7f64743ff700 1 -- 172.21.15.12:0/2892777898 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6464009d00 con 0x7f646c0ffdf0 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.652+0000 7f64637fe700 1 -- 172.21.15.12:0/2892777898 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64680044b0 con 0x7f646c0ffdf0 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.652+0000 7f64637fe700 1 -- 172.21.15.12:0/2892777898 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468003ce0 con 0x7f646c0ffdf0 2023-12-11T20:29:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.652+0000 7f64743ff700 1 -- 172.21.15.12:0/2892777898 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c1a1b70 con 0x7f646c0ffdf0 2023-12-11T20:29:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.655+0000 7f64637fe700 1 -- 172.21.15.12:0/2892777898 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6468003e40 con 0x7f646c0ffdf0 2023-12-11T20:29:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.656+0000 7f64637fe700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f64580a1500 0x7f64580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f64637fe700 1 -- 172.21.15.12:0/2892777898 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6468014070 con 0x7f646c0ffdf0 2023-12-11T20:29:40.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f6487c35b80 1 Processor -- start 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f647199a700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f64580a1500 0x7f64580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f6487c35b80 1 -- start start 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde69640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 0x562ffde6a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f6487c35b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffddc3b50 con 0x562ffde683d0 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f6487c35b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffddc1470 con 0x562ffde68d30 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.657+0000 7f6487c35b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffddbcd60 con 0x562ffde69c20 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde687f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44432/0 (socket says 172.21.15.12:44432) 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647219b700 1 -- 172.21.15.12:0/262365069 learned_addr learned my addr 172.21.15.12:0/262365069 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647299c700 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 0x562ffde6a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647199a700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f64580a1500 0x7f64580a39c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f645c009be0 tx=0x7f645c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647199a700 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde69640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647219b700 1 -- 172.21.15.12:0/262365069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 msgr2=0x562ffde6a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647219b700 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 0x562ffde6a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647219b700 1 -- 172.21.15.12:0/262365069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 msgr2=0x562ffde69640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647219b700 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde69640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647219b700 1 -- 172.21.15.12:0/262365069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ffdc39630 con 0x562ffde683d0 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.658+0000 7f647199a700 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde69640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.659+0000 7f647219b700 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde687f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f64680a22c0 tx=0x7f646809a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b2d3c9f015062f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.659+0000 7f6460bfe700 1 -- 172.21.15.12:0/262365069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646809ab60 con 0x562ffde683d0 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.659+0000 7f6460bfe700 1 -- 172.21.15.12:0/262365069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f646800cbd0 con 0x562ffde683d0 2023-12-11T20:29:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.659+0000 7f6460bfe700 1 -- 172.21.15.12:0/262365069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646801fde0 con 0x562ffde683d0 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.659+0000 7f6487c35b80 1 -- 172.21.15.12:0/262365069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 msgr2=0x562ffde687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.659+0000 7f6487c35b80 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde687f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f64680a22c0 tx=0x7f646809a0a0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 -- 172.21.15.12:0/262365069 shutdown_connections 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 0x562ffde6a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde687f0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 --2- 172.21.15.12:0/262365069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde69640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 -- 172.21.15.12:0/262365069 >> 172.21.15.12:0/262365069 conn(0x562ffdd977e0 msgr2=0x562ffde64d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 -- 172.21.15.12:0/262365069 shutdown_connections 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 -- 172.21.15.12:0/262365069 wait complete. 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 -- start start 2023-12-11T20:29:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.660+0000 7f6487c35b80 1 Processor -- start 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 0x562ffde72210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde72750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde69c20 0x562ffde79790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f6487c35b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffdd76560 con 0x562ffde69c20 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f6487c35b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffdd76200 con 0x562ffde68d30 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f6487c35b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffdc3b920 con 0x562ffde683d0 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f6487c35b80 10 client.0 _ll_register_callbacks cb 0x562ffdca1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f647299c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde69c20 0x562ffde79790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f647299c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde69c20 0x562ffde79790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44446/0 (socket says 172.21.15.12:44446) 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f647299c700 1 -- 172.21.15.12:0/4210861510 learned_addr learned my addr 172.21.15.12:0/4210861510 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f647199a700 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde72750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.661+0000 7f647219b700 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 0x562ffde72210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f647299c700 1 -- 172.21.15.12:0/4210861510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 msgr2=0x562ffde72210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f647299c700 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 0x562ffde72210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f647299c700 1 -- 172.21.15.12:0/4210861510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 msgr2=0x562ffde72750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f647299c700 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde72750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f647299c700 1 -- 172.21.15.12:0/4210861510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c1a1b70 con 0x562ffde69c20 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f647299c700 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde69c20 0x562ffde79790 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f646400b0a0 tx=0x7f6464007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4233169447538d48 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f6455ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f6455ffb700 1 -- 172.21.15.12:0/4210861510 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400e040 con 0x562ffde69c20 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f6487c35b80 1 -- 172.21.15.12:0/4210861510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ffde5bb40 con 0x562ffde69c20 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.662+0000 7f6455ffb700 1 -- 172.21.15.12:0/4210861510 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6464003a00 con 0x562ffde69c20 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6455ffb700 1 -- 172.21.15.12:0/4210861510 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6464007760 con 0x562ffde69c20 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6487c35b80 10 client.19455 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6487c35b80 1 -- 172.21.15.12:0/4210861510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x562ffdbe5de0 con 0x562ffde69c20 2023-12-11T20:29:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6455ffb700 1 -- 172.21.15.12:0/4210861510 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562ffde5bb40 con 0x562ffde69c20 2023-12-11T20:29:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6455ffb700 1 -- 172.21.15.12:0/4210861510 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6464023020 con 0x562ffde69c20 2023-12-11T20:29:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6487c35b80 10 client.19455 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6487c35b80 10 client.19455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6487c35b80 20 client.19455 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:40.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6487c35b80 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562ffde7e030 0x562ffde80450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6487c35b80 4 client.19455 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:40.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.663+0000 7f6487c35b80 1 -- 172.21.15.12:0/4210861510 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ffde37f40 con 0x562ffde7e030 2023-12-11T20:29:40.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.664+0000 7f647219b700 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562ffde7e030 0x562ffde80450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.664+0000 7f647219b700 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562ffde7e030 0x562ffde80450 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a698868334eea2f1 server_cookie=531880b00ef09eb5 in_seq=0 out_seq=0 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.664+0000 7f6455ffb700 10 client.19455 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.665+0000 7f6455ffb700 1 -- 172.21.15.12:0/4210861510 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562ffde37f40 con 0x562ffde7e030 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.665+0000 7f6455ffb700 10 client.19455 handle_command_reply: tid=0 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.665+0000 7f6487c35b80 1 client.19455 shutdown 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.665+0000 7f6487c35b80 1 -- 172.21.15.12:0/4210861510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde69c20 msgr2=0x562ffde79790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.665+0000 7f6487c35b80 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde69c20 0x562ffde79790 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f646400b0a0 tx=0x7f6464007d50 comp rx=0 tx=0).stop 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.665+0000 7f6487c35b80 1 -- 172.21.15.12:0/4210861510 shutdown_connections 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.665+0000 7f6487c35b80 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562ffde7e030 0x562ffde80450 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.666+0000 7f6487c35b80 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde69c20 0x562ffde79790 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.666+0000 7f6455ffb700 0 client.19455 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.666+0000 7f6487c35b80 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 0x562ffde72210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.666+0000 7f6487c35b80 1 --2- 172.21.15.12:0/4210861510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde72750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.666+0000 7f6487c35b80 1 -- 172.21.15.12:0/4210861510 >> 172.21.15.12:0/4210861510 conn(0x562ffdd977e0 msgr2=0x562ffde63a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.666+0000 7f6487c35b80 1 -- 172.21.15.12:0/4210861510 shutdown_connections 2023-12-11T20:29:40.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.666+0000 7f6487c35b80 1 -- 172.21.15.12:0/4210861510 wait complete. 2023-12-11T20:29:40.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.666+0000 7f6487c35b80 20 client.19455 trim_cache size 0 max 16384 2023-12-11T20:29:40.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.687+0000 7f6487c35b80 1 Processor -- start 2023-12-11T20:29:40.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f6487c35b80 1 -- start start 2023-12-11T20:29:40.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde6a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde796b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 0x562ffde72210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f6487c35b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffde5fb50 con 0x562ffde683d0 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f6487c35b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffde67f70 con 0x562ffde68d30 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f6487c35b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffde72e90 con 0x562ffde69c20 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f647219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde6a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f647219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde6a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44452/0 (socket says 172.21.15.12:44452) 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f647219b700 1 -- 172.21.15.12:0/1536305862 learned_addr learned my addr 172.21.15.12:0/1536305862 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.688+0000 7f647299c700 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 0x562ffde72210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f647199a700 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde796b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f647219b700 1 -- 172.21.15.12:0/1536305862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 msgr2=0x562ffde72210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f647219b700 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 0x562ffde72210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f647219b700 1 -- 172.21.15.12:0/1536305862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 msgr2=0x562ffde796b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f647219b700 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde796b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f647219b700 1 -- 172.21.15.12:0/1536305862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ffdbcec60 con 0x562ffde683d0 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f647219b700 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde6a000 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f6468096ed0 tx=0x7f646809a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595c58c996222901 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f64613ff700 1 -- 172.21.15.12:0/1536305862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646807e070 con 0x562ffde683d0 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f64613ff700 1 -- 172.21.15.12:0/1536305862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6468082070 con 0x562ffde683d0 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.689+0000 7f64613ff700 1 -- 172.21.15.12:0/1536305862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646809e170 con 0x562ffde683d0 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 -- 172.21.15.12:0/1536305862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 msgr2=0x562ffde6a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde6a000 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f6468096ed0 tx=0x7f646809a230 comp rx=0 tx=0).stop 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 -- 172.21.15.12:0/1536305862 shutdown_connections 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde69c20 0x562ffde72210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde683d0 0x562ffde6a000 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 --2- 172.21.15.12:0/1536305862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde68d30 0x562ffde796b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 -- 172.21.15.12:0/1536305862 >> 172.21.15.12:0/1536305862 conn(0x562ffdd977e0 msgr2=0x562ffde701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 -- 172.21.15.12:0/1536305862 shutdown_connections 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.690+0000 7f6487c35b80 1 -- 172.21.15.12:0/1536305862 wait complete. 2023-12-11T20:29:40.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.691+0000 7f6487c35b80 1 -- start start 2023-12-11T20:29:40.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.691+0000 7f6487c35b80 1 Processor -- start 2023-12-11T20:29:40.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.691+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 0x562ffde790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.691+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde68d30 0x562ffde79600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.691+0000 7f6487c35b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde69c20 0x562ffde77710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.691+0000 7f6487c35b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffde77e20 con 0x562ffde68d30 2023-12-11T20:29:40.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.691+0000 7f6487c35b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffde77f90 con 0x562ffde69c20 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.691+0000 7f6487c35b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffde78150 con 0x562ffde683d0 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f6487c35b80 10 client.0 _ll_register_callbacks cb 0x562ffdca1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647199a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde68d30 0x562ffde79600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647199a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde68d30 0x562ffde79600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44454/0 (socket says 172.21.15.12:44454) 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647199a700 1 -- 172.21.15.12:0/2819638143 learned_addr learned my addr 172.21.15.12:0/2819638143 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647299c700 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde69c20 0x562ffde77710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647219b700 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 0x562ffde790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647199a700 1 -- 172.21.15.12:0/2819638143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 msgr2=0x562ffde790c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647199a700 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 0x562ffde790c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647199a700 1 -- 172.21.15.12:0/2819638143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde69c20 msgr2=0x562ffde77710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647199a700 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde69c20 0x562ffde77710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.692+0000 7f647199a700 1 -- 172.21.15.12:0/2819638143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ffdc39630 con 0x562ffde68d30 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.693+0000 7f647199a700 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde68d30 0x562ffde79600 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f645c01f880 tx=0x7f645c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f723b748b9ab39 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:40.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.693+0000 7f6455ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.693+0000 7f6455ffb700 1 -- 172.21.15.12:0/2819638143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c004320 con 0x562ffde68d30 2023-12-11T20:29:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.693+0000 7f6487c35b80 1 -- 172.21.15.12:0/2819638143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f646800cbd0 con 0x562ffde68d30 2023-12-11T20:29:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.693+0000 7f6455ffb700 1 -- 172.21.15.12:0/2819638143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f645c004480 con 0x562ffde68d30 2023-12-11T20:29:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.693+0000 7f6455ffb700 1 -- 172.21.15.12:0/2819638143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f645c003680 con 0x562ffde68d30 2023-12-11T20:29:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.693+0000 7f6487c35b80 10 client.19461 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.693+0000 7f6487c35b80 1 -- 172.21.15.12:0/2819638143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x562ffdc0c250 con 0x562ffde68d30 2023-12-11T20:29:40.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f6455ffb700 1 -- 172.21.15.12:0/2819638143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f645c038080 con 0x562ffde68d30 2023-12-11T20:29:40.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f6455ffb700 1 -- 172.21.15.12:0/2819638143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f645c0347d0 con 0x562ffde68d30 2023-12-11T20:29:40.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f6487c35b80 10 client.19461 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f6487c35b80 10 client.19461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f6487c35b80 20 client.19461 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f6487c35b80 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562ffded5a90 0x562ffded7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f6487c35b80 4 client.19461 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f6487c35b80 1 -- 172.21.15.12:0/2819638143 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562ffdd82fd0 con 0x562ffded5a90 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.694+0000 7f647219b700 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562ffded5a90 0x562ffded7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.695+0000 7f647219b700 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562ffded5a90 0x562ffded7eb0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e18a674d0506a88 server_cookie=24444ca46ef6fd8d in_seq=0 out_seq=0 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.695+0000 7f6455ffb700 10 client.19461 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.695+0000 7f6455ffb700 1 -- 172.21.15.12:0/2819638143 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562ffdd82fd0 con 0x562ffded5a90 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.695+0000 7f6455ffb700 10 client.19461 handle_command_reply: tid=0 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.695+0000 7f6487c35b80 1 client.19461 shutdown 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.695+0000 7f6487c35b80 1 -- 172.21.15.12:0/2819638143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde68d30 msgr2=0x562ffde79600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.695+0000 7f6487c35b80 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde68d30 0x562ffde79600 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f645c01f880 tx=0x7f645c0047c0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 1 -- 172.21.15.12:0/2819638143 shutdown_connections 2023-12-11T20:29:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562ffded5a90 0x562ffded7eb0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562ffde69c20 0x562ffde77710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ffde683d0 0x562ffde790c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 1 --2- 172.21.15.12:0/2819638143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562ffde68d30 0x562ffde79600 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 1 -- 172.21.15.12:0/2819638143 >> 172.21.15.12:0/2819638143 conn(0x562ffdd977e0 msgr2=0x562ffde721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6455ffb700 0 client.19461 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 1 -- 172.21.15.12:0/2819638143 shutdown_connections 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 1 -- 172.21.15.12:0/2819638143 wait complete. 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f6487c35b80 20 client.19461 trim_cache size 0 max 16384 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:29:40.697 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:29:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "1059c268-980f-47bf-b62a-83a2f0b6003b": { 2023-12-11T20:29:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:29:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "1059c268-980f-47bf-b62a-83a2f0b6003b", 2023-12-11T20:29:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:29:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:29:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:29:40.698 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f64743ff700 1 -- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f64580a1500 msgr2=0x7f64580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.696+0000 7f64743ff700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f64580a1500 0x7f64580a39c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f645c009be0 tx=0x7f645c009260 comp rx=0 tx=0).stop 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 -- 172.21.15.12:0/2892777898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f646c0ffdf0 msgr2=0x7f646c199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f646c0ffdf0 0x7f646c199710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f646800eb30 tx=0x7f646800ee40 comp rx=0 tx=0).stop 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 -- 172.21.15.12:0/2892777898 shutdown_connections 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f64580a1500 0x7f64580a39c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f646c0ffdf0 0x7f646c199710 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f646c101110 0x7f646c1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 --2- 172.21.15.12:0/2892777898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f646c100750 0x7f646c199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 -- 172.21.15.12:0/2892777898 >> 172.21.15.12:0/2892777898 conn(0x7f646c0fb930 msgr2=0x7f646c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 -- 172.21.15.12:0/2892777898 shutdown_connections 2023-12-11T20:29:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:29:40.697+0000 7f64743ff700 1 -- 172.21.15.12:0/2892777898 wait complete. 2023-12-11T20:29:40.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:40 smithi012 ceph-mon[128787]: pgmap v787: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:29:40.716 INFO:tasks.cephfs.filesystem:scrub status for tag:1059c268-980f-47bf-b62a-83a2f0b6003b - {'path': '/', 'tag': '1059c268-980f-47bf-b62a-83a2f0b6003b', 'options': 'recursive,force'} 2023-12-11T20:29:40.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:40 smithi032 ceph-mon[132488]: pgmap v787: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:29:41.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:40 smithi039 ceph-mon[102205]: pgmap v787: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:29:41.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:41 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:29:41.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:41 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:41.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:41 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:29:41.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:41 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:29:41.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:41 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:29:41.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:41 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:41.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:41 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:41.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:41 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:41 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:29:42.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:41 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:41 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:29:42.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:41 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:29:42.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:41 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:29:42.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:41 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:41 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:41 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:41 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:29:42.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:41 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:41 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:29:42.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:41 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:29:42.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:41 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:29:42.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:41 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:41 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:41 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:29:42.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:42 smithi032 ceph-mon[132488]: pgmap v788: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:29:43.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:42 smithi039 ceph-mon[102205]: pgmap v788: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:29:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:42 smithi012 ceph-mon[128787]: pgmap v788: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 14 MiB/s wr, 15 op/s 2023-12-11T20:29:44.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:44 smithi032 ceph-mon[132488]: pgmap v789: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 26 op/s 2023-12-11T20:29:45.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:44 smithi039 ceph-mon[102205]: pgmap v789: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 26 op/s 2023-12-11T20:29:45.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:44 smithi012 ceph-mon[128787]: pgmap v789: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 26 op/s 2023-12-11T20:29:46.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:46 smithi032 ceph-mon[132488]: pgmap v790: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:29:47.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:46 smithi039 ceph-mon[102205]: pgmap v790: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:29:47.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:46 smithi012 ceph-mon[128787]: pgmap v790: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:29:48.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:48 smithi032 ceph-mon[132488]: pgmap v791: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:29:49.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:48 smithi039 ceph-mon[102205]: pgmap v791: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:29:49.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:48 smithi012 ceph-mon[128787]: pgmap v791: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:29:50.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:50 smithi032 ceph-mon[132488]: pgmap v792: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 35 op/s 2023-12-11T20:29:51.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:50 smithi039 ceph-mon[102205]: pgmap v792: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 35 op/s 2023-12-11T20:29:51.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:50 smithi012 ceph-mon[128787]: pgmap v792: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 35 op/s 2023-12-11T20:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.498+0000 7f7a72f9d700 1 -- 172.21.15.12:0/1180542044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c1046b0 msgr2=0x7f7a6c106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.498+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/1180542044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c1046b0 0x7f7a6c106aa0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009990 tx=0x7f7a5c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.499+0000 7f7a72f9d700 1 -- 172.21.15.12:0/1180542044 shutdown_connections 2023-12-11T20:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.499+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/1180542044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6c101d80 0x7f7a6c104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.499+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/1180542044 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a6c106fe0 0x7f7a6c109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.499+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/1180542044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c1046b0 0x7f7a6c106aa0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.499+0000 7f7a72f9d700 1 -- 172.21.15.12:0/1180542044 >> 172.21.15.12:0/1180542044 conn(0x7f7a6c0fb790 msgr2=0x7f7a6c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.499+0000 7f7a72f9d700 1 -- 172.21.15.12:0/1180542044 shutdown_connections 2023-12-11T20:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.499+0000 7f7a72f9d700 1 -- 172.21.15.12:0/1180542044 wait complete. 2023-12-11T20:29:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.500+0000 7f7a72f9d700 1 Processor -- start 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.500+0000 7f7a72f9d700 1 -- start start 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.500+0000 7f7a72f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c101d80 0x7f7a6c1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.500+0000 7f7a72f9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6c1046b0 0x7f7a6c1976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.500+0000 7f7a72f9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a6c106fe0 0x7f7a6c19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a72f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c19ecd0 con 0x7f7a6c101d80 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a72f9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c19ee10 con 0x7f7a6c1046b0 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a72f9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c19efa0 con 0x7f7a6c106fe0 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a71f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c101d80 0x7f7a6c1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a71f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c101d80 0x7f7a6c1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40144/0 (socket says 172.21.15.12:40144) 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a71f9b700 1 -- 172.21.15.12:0/4268706063 learned_addr learned my addr 172.21.15.12:0/4268706063 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a7279c700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a6c106fe0 0x7f7a6c19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a7179a700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6c1046b0 0x7f7a6c1976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a71f9b700 1 -- 172.21.15.12:0/4268706063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a6c106fe0 msgr2=0x7f7a6c19e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a6c106fe0 0x7f7a6c19e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a71f9b700 1 -- 172.21.15.12:0/4268706063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6c1046b0 msgr2=0x7f7a6c1976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6c1046b0 0x7f7a6c1976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.501+0000 7f7a71f9b700 1 -- 172.21.15.12:0/4268706063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0095f0 con 0x7f7a6c101d80 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.502+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c101d80 0x7f7a6c1971a0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800e9a0 tx=0x7f7a6800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.502+0000 7f7a62ffd700 1 -- 172.21.15.12:0/4268706063 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68009790 con 0x7f7a6c101d80 2023-12-11T20:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.502+0000 7f7a62ffd700 1 -- 172.21.15.12:0/4268706063 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a6800cbd0 con 0x7f7a6c101d80 2023-12-11T20:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.502+0000 7f7a62ffd700 1 -- 172.21.15.12:0/4268706063 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68018680 con 0x7f7a6c101d80 2023-12-11T20:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.502+0000 7f7a72f9d700 1 -- 172.21.15.12:0/4268706063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6c19f280 con 0x7f7a6c101d80 2023-12-11T20:29:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.502+0000 7f7a72f9d700 1 -- 172.21.15.12:0/4268706063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6c19f740 con 0x7f7a6c101d80 2023-12-11T20:29:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.506+0000 7f7a62ffd700 1 -- 172.21.15.12:0/4268706063 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7a6800cd40 con 0x7f7a6c101d80 2023-12-11T20:29:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.507+0000 7f7a87af2b80 1 Processor -- start 2023-12-11T20:29:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a87af2b80 1 -- start start 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a62ffd700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a580a1470 0x7f7a580a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ff91fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff924e0 0x55c06ff96a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ff993a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a62ffd700 1 -- 172.21.15.12:0/4268706063 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a68014070 con 0x7f7a6c101d80 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fee8af0 con 0x55c06ff924e0 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fee6410 con 0x55c06ff91b80 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fee1d00 con 0x55c06ff96f90 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a7279c700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a580a1470 0x7f7a580a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a7279c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ff993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a7179a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff924e0 0x55c06ff96a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a7279c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ff993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44574/0 (socket says 172.21.15.12:44574) 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.508+0000 7f7a7279c700 1 -- 172.21.15.12:0/3526660391 learned_addr learned my addr 172.21.15.12:0/3526660391 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ff91fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a7179a700 1 -- 172.21.15.12:0/3526660391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 msgr2=0x55c06ff993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:51.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ff993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a7179a700 1 -- 172.21.15.12:0/3526660391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 msgr2=0x55c06ff91fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:51.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ff91fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a7179a700 1 -- 172.21.15.12:0/3526660391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c06fd5e5d0 con 0x55c06ff924e0 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ff91fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a7279c700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a580a1470 0x7f7a580a3930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7a640042b0 tx=0x7f7a64003f20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.509+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff924e0 0x55c06ff96a50 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0098e0 tx=0x7f7a5c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ec12d201e04883 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.510+0000 7f7a57fff700 1 -- 172.21.15.12:0/3526660391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c005240 con 0x55c06ff924e0 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.510+0000 7f7a57fff700 1 -- 172.21.15.12:0/3526660391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a5c01e040 con 0x55c06ff924e0 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.510+0000 7f7a57fff700 1 -- 172.21.15.12:0/3526660391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00b710 con 0x55c06ff924e0 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.510+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3526660391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff924e0 msgr2=0x55c06ff96a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.510+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff924e0 0x55c06ff96a50 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0098e0 tx=0x7f7a5c005e80 comp rx=0 tx=0).stop 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3526660391 shutdown_connections 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ff91fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ff993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3526660391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff924e0 0x55c06ff96a50 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3526660391 >> 172.21.15.12:0/3526660391 conn(0x55c06febc780 msgr2=0x55c06ff89b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:51.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3526660391 shutdown_connections 2023-12-11T20:29:51.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3526660391 wait complete. 2023-12-11T20:29:51.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 -- start start 2023-12-11T20:29:51.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.511+0000 7f7a87af2b80 1 Processor -- start 2023-12-11T20:29:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ff9b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff924e0 0x55c06ff9b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ffa27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fe9b500 con 0x55c06ff91b80 2023-12-11T20:29:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fe9b1a0 con 0x55c06ff924e0 2023-12-11T20:29:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fd608c0 con 0x55c06ff96f90 2023-12-11T20:29:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a87af2b80 10 client.0 _ll_register_callbacks cb 0x55c06fdc6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a71f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ff9b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a71f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ff9b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40172/0 (socket says 172.21.15.12:40172) 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a71f9b700 1 -- 172.21.15.12:0/3655786645 learned_addr learned my addr 172.21.15.12:0/3655786645 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.512+0000 7f7a7279c700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ffa27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a71f9b700 1 -- 172.21.15.12:0/3655786645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 msgr2=0x55c06ffa27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ffa27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff924e0 0x55c06ff9b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a71f9b700 1 -- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff924e0 msgr2=0x55c06ff9b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff924e0 0x55c06ff9b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a71f9b700 1 -- 172.21.15.12:0/3655786645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6c19f740 con 0x55c06ff91b80 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a7279c700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ffa27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff924e0 0x55c06ff9b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:29:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ff9b220 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800e970 tx=0x7f7a6809a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4607add62d0579 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a557fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a557fa700 1 -- 172.21.15.12:0/3655786645 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6809e3f0 con 0x55c06ff91b80 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a557fa700 1 -- 172.21.15.12:0/3655786645 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a680a2630 con 0x55c06ff91b80 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3655786645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c06ff80730 con 0x55c06ff91b80 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a557fa700 1 -- 172.21.15.12:0/3655786645 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a6809e0d0 con 0x55c06ff91b80 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a87af2b80 10 client.19473 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.513+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3655786645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f7a6c10a040 con 0x55c06ff91b80 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.514+0000 7f7a557fa700 1 -- 172.21.15.12:0/3655786645 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c06ff80730 con 0x55c06ff91b80 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.514+0000 7f7a557fa700 1 -- 172.21.15.12:0/3655786645 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7a68010430 con 0x55c06ff91b80 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.514+0000 7f7a87af2b80 10 client.19473 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.514+0000 7f7a87af2b80 10 client.19473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.514+0000 7f7a87af2b80 20 client.19473 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.514+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c06ffa7060 0x55c06ffa9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.514+0000 7f7a87af2b80 4 client.19473 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.514+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3655786645 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c06ff5cee0 con 0x55c06ffa7060 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.515+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c06ffa7060 0x55c06ffa9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.515+0000 7f7a557fa700 10 client.19473 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.515+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c06ffa7060 0x55c06ffa9480 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c34b0f7ddca30b96 server_cookie=1719ee63f27c6e41 in_seq=0 out_seq=0 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.516+0000 7f7a557fa700 1 -- 172.21.15.12:0/3655786645 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c06ff5cee0 con 0x55c06ffa7060 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.516+0000 7f7a557fa700 10 client.19473 handle_command_reply: tid=0 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.516+0000 7f7a87af2b80 1 client.19473 shutdown 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.516+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3655786645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 msgr2=0x55c06ff9b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.516+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ff9b220 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800e970 tx=0x7f7a6809a7e0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.516+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3655786645 shutdown_connections 2023-12-11T20:29:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.516+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c06ffa7060 0x55c06ffa9480 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.517+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff96f90 0x55c06ffa27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.517+0000 7f7a557fa700 0 client.19473 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.517+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ff9b220 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.517+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3655786645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff924e0 0x55c06ff9b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.517+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3655786645 >> 172.21.15.12:0/3655786645 conn(0x55c06febc780 msgr2=0x55c06ff8a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.517+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3655786645 shutdown_connections 2023-12-11T20:29:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.517+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3655786645 wait complete. 2023-12-11T20:29:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.517+0000 7f7a87af2b80 20 client.19473 trim_cache size 0 max 16384 2023-12-11T20:29:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a87af2b80 1 Processor -- start 2023-12-11T20:29:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a87af2b80 1 -- start start 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ffa2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff96f90 0x55c06ff9a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06ffa4500 con 0x55c06ff91b80 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06ff87db0 con 0x55c06ff96f90 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06ffa6e50 con 0x55c06ff924e0 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.536+0000 7f7a71f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ffa2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a7179a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a71f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ffa2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40182/0 (socket says 172.21.15.12:40182) 2023-12-11T20:29:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a71f9b700 1 -- 172.21.15.12:0/2706503520 learned_addr learned my addr 172.21.15.12:0/2706503520 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a7279c700 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff96f90 0x55c06ff9a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a7179a700 1 -- 172.21.15.12:0/2706503520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff96f90 msgr2=0x55c06ff9a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a7179a700 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff96f90 0x55c06ff9a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a7179a700 1 -- 172.21.15.12:0/2706503520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 msgr2=0x55c06ffa2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a7179a700 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ffa2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a7179a700 1 -- 172.21.15.12:0/2706503520 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c06fd0ad80 con 0x55c06ff924e0 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ffa2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.537+0000 7f7a7179a700 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa2760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c006010 tx=0x7f7a5c009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bab1fa5f0ab72cb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:51.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a60ff9700 1 -- 172.21.15.12:0/2706503520 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c01b070 con 0x55c06ff924e0 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a60ff9700 1 -- 172.21.15.12:0/2706503520 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a5c005910 con 0x55c06ff924e0 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a60ff9700 1 -- 172.21.15.12:0/2706503520 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00b970 con 0x55c06ff924e0 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a87af2b80 1 -- 172.21.15.12:0/2706503520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 msgr2=0x55c06ffa2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa2760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c006010 tx=0x7f7a5c009570 comp rx=0 tx=0).stop 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a87af2b80 1 -- 172.21.15.12:0/2706503520 shutdown_connections 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff96f90 0x55c06ff9a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff91b80 0x55c06ffa2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/2706503520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa2760 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.538+0000 7f7a87af2b80 1 -- 172.21.15.12:0/2706503520 >> 172.21.15.12:0/2706503520 conn(0x55c06febc780 msgr2=0x55c06ff967b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.539+0000 7f7a87af2b80 1 -- 172.21.15.12:0/2706503520 shutdown_connections 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.539+0000 7f7a87af2b80 1 -- 172.21.15.12:0/2706503520 wait complete. 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.539+0000 7f7a87af2b80 1 -- start start 2023-12-11T20:29:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.539+0000 7f7a87af2b80 1 Processor -- start 2023-12-11T20:29:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ffa0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a87af2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff96f90 0x55c06ffa1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06ffa1a90 con 0x55c06ff96f90 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06ffa1c00 con 0x55c06ff91b80 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a87af2b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06ffa1dc0 con 0x55c06ff924e0 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a87af2b80 10 client.0 _ll_register_callbacks cb 0x55c06fdc6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a7179a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a7279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff96f90 0x55c06ffa1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a7179a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44592/0 (socket says 172.21.15.12:44592) 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a7179a700 1 -- 172.21.15.12:0/3737439562 learned_addr learned my addr 172.21.15.12:0/3737439562 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ffa0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a7179a700 1 -- 172.21.15.12:0/3737439562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 msgr2=0x55c06ffa0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ffa0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.540+0000 7f7a7179a700 1 -- 172.21.15.12:0/3737439562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff96f90 msgr2=0x55c06ffa1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.541+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff96f90 0x55c06ffa1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.541+0000 7f7a7179a700 1 -- 172.21.15.12:0/3737439562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6c10a040 con 0x55c06ff924e0 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.541+0000 7f7a7279c700 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff96f90 0x55c06ffa1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.541+0000 7f7a7179a700 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa0680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c003d30 tx=0x7f7a5c003d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd34fd12ced4afc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.541+0000 7f7a557fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.541+0000 7f7a557fa700 1 -- 172.21.15.12:0/3737439562 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c01b040 con 0x55c06ff924e0 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.541+0000 7f7a557fa700 1 -- 172.21.15.12:0/3737439562 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a5c005240 con 0x55c06ff924e0 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.541+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3737439562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c06ff82fb0 con 0x55c06ff924e0 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a557fa700 1 -- 172.21.15.12:0/3737439562 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a5c005400 con 0x55c06ff924e0 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a87af2b80 10 client.29047 fetch_fsmap learned FSMap version 31 2023-12-11T20:29:51.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3737439562 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55c06fd5e5d0 con 0x55c06ff924e0 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a557fa700 1 -- 172.21.15.12:0/3737439562 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a5c048080 con 0x55c06ff924e0 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a557fa700 1 -- 172.21.15.12:0/3737439562 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7a5c037040 con 0x55c06ff924e0 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a87af2b80 10 client.29047 fetch_fsmap finished waiting for FSMap version 31 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a87af2b80 10 client.29047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a87af2b80 20 client.29047 populate_metadata read hostname 'smithi012' 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c06fffdb80 0x55c06fffffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a87af2b80 4 client.29047 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.542+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3737439562 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f7a5c01e040 con 0x55c06fffdb80 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.543+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c06fffdb80 0x55c06fffffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.543+0000 7f7a71f9b700 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c06fffdb80 0x55c06fffffa0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672780e48861e19b server_cookie=ec72b2398a5eb5cb in_seq=0 out_seq=0 2023-12-11T20:29:51.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.543+0000 7f7a557fa700 10 client.29047 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.552+0000 7f7a557fa700 1 -- 172.21.15.12:0/3737439562 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f7a5c01e040 con 0x55c06fffdb80 2023-12-11T20:29:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.552+0000 7f7a557fa700 10 client.29047 handle_command_reply: tid=0 2023-12-11T20:29:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.552+0000 7f7a87af2b80 1 client.29047 shutdown 2023-12-11T20:29:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.552+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3737439562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 msgr2=0x55c06ffa0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.552+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa0680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c003d30 tx=0x7f7a5c003d60 comp rx=0 tx=0).stop 2023-12-11T20:29:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3737439562 shutdown_connections 2023-12-11T20:29:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c06fffdb80 0x55c06fffffa0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c06ff91b80 0x55c06ffa0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ff96f90 0x55c06ffa1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a557fa700 0 client.29047 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 1 --2- 172.21.15.12:0/3737439562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c06ff924e0 0x55c06ffa0680 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3737439562 >> 172.21.15.12:0/3737439562 conn(0x55c06febc780 msgr2=0x55c06ffade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3737439562 shutdown_connections 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 1 -- 172.21.15.12:0/3737439562 wait complete. 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a87af2b80 20 client.29047 trim_cache size 0 max 16384 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:29:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:29:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:29:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a72f9d700 1 -- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a580a1470 msgr2=0x7f7a580a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a580a1470 0x7f7a580a3930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7a640042b0 tx=0x7f7a64003f20 comp rx=0 tx=0).stop 2023-12-11T20:29:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.553+0000 7f7a72f9d700 1 -- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c101d80 msgr2=0x7f7a6c1971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c101d80 0x7f7a6c1971a0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800e9a0 tx=0x7f7a6800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 -- 172.21.15.12:0/4268706063 shutdown_connections 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a580a1470 0x7f7a580a3930 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a6c106fe0 0x7f7a6c19e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a6c101d80 0x7f7a6c1971a0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 --2- 172.21.15.12:0/4268706063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6c1046b0 0x7f7a6c1976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 -- 172.21.15.12:0/4268706063 >> 172.21.15.12:0/4268706063 conn(0x7f7a6c0fb790 msgr2=0x7f7a6c102800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 -- 172.21.15.12:0/4268706063 shutdown_connections 2023-12-11T20:29:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:29:51.554+0000 7f7a72f9d700 1 -- 172.21.15.12:0/4268706063 wait complete. 2023-12-11T20:29:51.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:51 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:29:51.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:51 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:29:52.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:51 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:29:52.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:51 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:29:52.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:51 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:29:52.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:51 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:29:52.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:52 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:29:52.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:52 smithi032 ceph-mon[132488]: pgmap v793: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:29:53.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:52 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:29:53.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:52 smithi039 ceph-mon[102205]: pgmap v793: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:29:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:52 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:29:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:52 smithi012 ceph-mon[128787]: pgmap v793: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 32 op/s 2023-12-11T20:29:54.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:54 smithi032 ceph-mon[132488]: pgmap v794: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:29:55.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:54 smithi039 ceph-mon[102205]: pgmap v794: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:29:55.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:54 smithi012 ceph-mon[128787]: pgmap v794: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 30 op/s 2023-12-11T20:29:56.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:56 smithi032 ceph-mon[132488]: pgmap v795: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 21 op/s 2023-12-11T20:29:57.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:56 smithi039 ceph-mon[102205]: pgmap v795: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 21 op/s 2023-12-11T20:29:57.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:56 smithi012 ceph-mon[128787]: pgmap v795: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 21 op/s 2023-12-11T20:29:57.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:57 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:58.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:57 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:58.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:57 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:29:58.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:29:58 smithi032 ceph-mon[132488]: pgmap v796: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:29:59.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:29:58 smithi039 ceph-mon[102205]: pgmap v796: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:29:59.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:29:58 smithi012 ceph-mon[128787]: pgmap v796: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:30:00.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:00 smithi032 ceph-mon[132488]: pgmap v797: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:30:00.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:00 smithi032 ceph-mon[132488]: overall HEALTH_OK 2023-12-11T20:30:01.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:00 smithi039 ceph-mon[102205]: pgmap v797: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:30:01.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:00 smithi039 ceph-mon[102205]: overall HEALTH_OK 2023-12-11T20:30:01.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:00 smithi012 ceph-mon[128787]: pgmap v797: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:30:01.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:00 smithi012 ceph-mon[128787]: overall HEALTH_OK 2023-12-11T20:30:02.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:02 smithi032 ceph-mon[132488]: pgmap v798: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:30:03.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:02 smithi039 ceph-mon[102205]: pgmap v798: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:30:03.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:02 smithi012 ceph-mon[128787]: pgmap v798: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:30:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.729+0000 7f5011d9d700 1 -- 172.21.15.12:0/3303105335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c104700 msgr2=0x7f500c106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.729+0000 7f5011d9d700 1 --2- 172.21.15.12:0/3303105335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c104700 0x7f500c106af0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009990 tx=0x7f4ff8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.730+0000 7f5011d9d700 1 -- 172.21.15.12:0/3303105335 shutdown_connections 2023-12-11T20:30:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.730+0000 7f5011d9d700 1 --2- 172.21.15.12:0/3303105335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f500c101dd0 0x7f500c1041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.730+0000 7f5011d9d700 1 --2- 172.21.15.12:0/3303105335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f500c107030 0x7f500c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.730+0000 7f5011d9d700 1 --2- 172.21.15.12:0/3303105335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c104700 0x7f500c106af0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.730+0000 7f5011d9d700 1 -- 172.21.15.12:0/3303105335 >> 172.21.15.12:0/3303105335 conn(0x7f500c0fb780 msgr2=0x7f500c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.730+0000 7f5011d9d700 1 -- 172.21.15.12:0/3303105335 shutdown_connections 2023-12-11T20:30:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.730+0000 7f5011d9d700 1 -- 172.21.15.12:0/3303105335 wait complete. 2023-12-11T20:30:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.731+0000 7f5011d9d700 1 Processor -- start 2023-12-11T20:30:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.731+0000 7f5011d9d700 1 -- start start 2023-12-11T20:30:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.731+0000 7f5011d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f500c101dd0 0x7f500c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.731+0000 7f5011d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f500c104700 0x7f500c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.731+0000 7f5011d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c107030 0x7f500c1a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.731+0000 7f5011d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c1a0e70 con 0x7f500c107030 2023-12-11T20:30:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.731+0000 7f5011d9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c1a0fb0 con 0x7f500c101dd0 2023-12-11T20:30:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.731+0000 7f5011d9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c1a1140 con 0x7f500c104700 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c107030 0x7f500c1a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c107030 0x7f500c1a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53192/0 (socket says 172.21.15.12:53192) 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 -- 172.21.15.12:0/4025215169 learned_addr learned my addr 172.21.15.12:0/4025215169 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f500bfff700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f500c104700 0x7f500c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f5010d9b700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f500c101dd0 0x7f500c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 -- 172.21.15.12:0/4025215169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f500c104700 msgr2=0x7f500c199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f500c104700 0x7f500c199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 -- 172.21.15.12:0/4025215169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f500c101dd0 msgr2=0x7f500c199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f500c101dd0 0x7f500c199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 -- 172.21.15.12:0/4025215169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80095f0 con 0x7f500c107030 2023-12-11T20:30:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.732+0000 7f501159c700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c107030 0x7f500c1a08a0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f5004007ee0 tx=0x7f500400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.733+0000 7f5009ffb700 1 -- 172.21.15.12:0/4025215169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004017070 con 0x7f500c107030 2023-12-11T20:30:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.733+0000 7f5009ffb700 1 -- 172.21.15.12:0/4025215169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f500400f040 con 0x7f500c107030 2023-12-11T20:30:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.733+0000 7f5011d9d700 1 -- 172.21.15.12:0/4025215169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c1a1420 con 0x7f500c107030 2023-12-11T20:30:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.733+0000 7f5009ffb700 1 -- 172.21.15.12:0/4025215169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004005570 con 0x7f500c107030 2023-12-11T20:30:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.733+0000 7f5011d9d700 1 -- 172.21.15.12:0/4025215169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c1a1930 con 0x7f500c107030 2023-12-11T20:30:04.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.736+0000 7f5009ffb700 1 -- 172.21.15.12:0/4025215169 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f500400db20 con 0x7f500c107030 2023-12-11T20:30:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.738+0000 7f5009ffb700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ffc0a14f0 0x7f4ffc0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.738+0000 7f50269e5b80 1 Processor -- start 2023-12-11T20:30:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.738+0000 7f5009ffb700 1 -- 172.21.15.12:0/4025215169 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50040cc4e0 con 0x7f500c107030 2023-12-11T20:30:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.738+0000 7f50269e5b80 1 -- start start 2023-12-11T20:30:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f5010d9b700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ffc0a14f0 0x7f4ffc0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x556875362b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x556875367640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875369f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f50269e5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568752bdaf0 con 0x5568753630d0 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f50269e5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568752bb410 con 0x556875362770 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f50269e5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568752b6d00 con 0x556875367b80 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f500bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x556875367640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f500bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x556875367640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53198/0 (socket says 172.21.15.12:53198) 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f500bfff700 1 -- 172.21.15.12:0/66724656 learned_addr learned my addr 172.21.15.12:0/66724656 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f5010d9b700 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x556875362b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.739+0000 7f501159c700 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875369f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f5010d9b700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ffc0a14f0 0x7f4ffc0a39b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5000009cb0 tx=0x7f5000011720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f500bfff700 1 -- 172.21.15.12:0/66724656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 msgr2=0x556875369f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f500bfff700 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875369f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f500bfff700 1 -- 172.21.15.12:0/66724656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 msgr2=0x556875362b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f500bfff700 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x556875362b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f500bfff700 1 -- 172.21.15.12:0/66724656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568751335d0 con 0x5568753630d0 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f501159c700 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875369f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f5010d9b700 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x556875362b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f500bfff700 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x556875367640 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80098e0 tx=0x7f4ff8005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f55827850c34f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.740+0000 7f4ff6ffd700 1 -- 172.21.15.12:0/66724656 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff801d070 con 0x5568753630d0 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.741+0000 7f4ff6ffd700 1 -- 172.21.15.12:0/66724656 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ff801e040 con 0x5568753630d0 2023-12-11T20:30:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.741+0000 7f4ff6ffd700 1 -- 172.21.15.12:0/66724656 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800b710 con 0x5568753630d0 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.741+0000 7f50269e5b80 1 -- 172.21.15.12:0/66724656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 msgr2=0x556875367640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.741+0000 7f50269e5b80 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x556875367640 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80098e0 tx=0x7f4ff8005bc0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.741+0000 7f50269e5b80 1 -- 172.21.15.12:0/66724656 shutdown_connections 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.741+0000 7f50269e5b80 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x556875362b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.741+0000 7f50269e5b80 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875369f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.742+0000 7f50269e5b80 1 --2- 172.21.15.12:0/66724656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x556875367640 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.742+0000 7f50269e5b80 1 -- 172.21.15.12:0/66724656 >> 172.21.15.12:0/66724656 conn(0x556875291780 msgr2=0x55687535eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.742+0000 7f50269e5b80 1 -- 172.21.15.12:0/66724656 shutdown_connections 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.742+0000 7f50269e5b80 1 -- 172.21.15.12:0/66724656 wait complete. 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.742+0000 7f50269e5b80 1 -- start start 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.743+0000 7f50269e5b80 1 Processor -- start 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.743+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.743+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x55687536c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.743+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x5568753733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.743+0000 7f50269e5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556875270500 con 0x5568753630d0 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.743+0000 7f50269e5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568752701a0 con 0x556875362770 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.743+0000 7f50269e5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568751358c0 con 0x556875367b80 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f50269e5b80 10 client.0 _ll_register_callbacks cb 0x55687519ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f5010d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f500bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x55687536c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f5010d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38976/0 (socket says 172.21.15.12:38976) 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f5010d9b700 1 -- 172.21.15.12:0/3043427035 learned_addr learned my addr 172.21.15.12:0/3043427035 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f501159c700 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x5568753733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f5010d9b700 1 -- 172.21.15.12:0/3043427035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 msgr2=0x5568753733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f5010d9b700 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x5568753733d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f5010d9b700 1 -- 172.21.15.12:0/3043427035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 msgr2=0x55687536c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f5010d9b700 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x55687536c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.744+0000 7f5010d9b700 1 -- 172.21.15.12:0/3043427035 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c1a1930 con 0x556875362770 2023-12-11T20:30:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f5010d9b700 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536be50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f500001e9a0 tx=0x7f50000047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=954ebfdff4f57b72 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f4febfff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:30:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f4febfff700 1 -- 172.21.15.12:0/3043427035 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000fbe0 con 0x556875362770 2023-12-11T20:30:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f50269e5b80 1 -- 172.21.15.12:0/3043427035 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556875355730 con 0x556875362770 2023-12-11T20:30:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f4febfff700 1 -- 172.21.15.12:0/3043427035 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f500000fd40 con 0x556875362770 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f4febfff700 1 -- 172.21.15.12:0/3043427035 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5000031430 con 0x556875362770 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f50269e5b80 10 client.29045 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f50269e5b80 1 -- 172.21.15.12:0/3043427035 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f500c10a030 con 0x556875362770 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.745+0000 7f4febfff700 1 -- 172.21.15.12:0/3043427035 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5000035080 con 0x556875362770 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.746+0000 7f4febfff700 1 -- 172.21.15.12:0/3043427035 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5000026480 con 0x556875362770 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.746+0000 7f50269e5b80 10 client.29045 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.746+0000 7f50269e5b80 10 client.29045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.746+0000 7f50269e5b80 20 client.29045 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.746+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556875377cc0 0x55687537a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.746+0000 7f50269e5b80 4 client.29045 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:04.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.746+0000 7f50269e5b80 1 -- 172.21.15.12:0/3043427035 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556875331ee0 con 0x556875377cc0 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.746+0000 7f500bfff700 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556875377cc0 0x55687537a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.747+0000 7f500bfff700 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556875377cc0 0x55687537a0e0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ee35791c387678a server_cookie=baadbc57dd9c461d in_seq=0 out_seq=0 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.747+0000 7f4febfff700 10 client.29045 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f4febfff700 1 -- 172.21.15.12:0/3043427035 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556875331ee0 con 0x556875377cc0 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f4febfff700 10 client.29045 handle_command_reply: tid=0 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 client.29045 shutdown 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 -- 172.21.15.12:0/3043427035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 msgr2=0x55687536be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536be50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f500001e9a0 tx=0x7f50000047c0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 -- 172.21.15.12:0/3043427035 shutdown_connections 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x556875377cc0 0x55687537a0e0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536be50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x5568753733d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3043427035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568753630d0 0x55687536c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f4febfff700 0 client.29045 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 -- 172.21.15.12:0/3043427035 >> 172.21.15.12:0/3043427035 conn(0x556875291780 msgr2=0x55687535f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 -- 172.21.15.12:0/3043427035 shutdown_connections 2023-12-11T20:30:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 1 -- 172.21.15.12:0/3043427035 wait complete. 2023-12-11T20:30:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.748+0000 7f50269e5b80 20 client.29045 trim_cache size 0 max 16384 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.769+0000 7f50269e5b80 1 Processor -- start 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.769+0000 7f50269e5b80 1 -- start start 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568753630d0 0x556875373390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875367b80 0x5568753634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f50269e5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55687537f310 con 0x556875367b80 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f50269e5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55687535d590 con 0x556875362770 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f50269e5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55687536a8b0 con 0x5568753630d0 2023-12-11T20:30:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f501159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875367b80 0x5568753634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f500bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568753630d0 0x556875373390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f501159c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875367b80 0x5568753634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53208/0 (socket says 172.21.15.12:53208) 2023-12-11T20:30:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f501159c700 1 -- 172.21.15.12:0/2772370906 learned_addr learned my addr 172.21.15.12:0/2772370906 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f5010d9b700 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f501159c700 1 -- 172.21.15.12:0/2772370906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568753630d0 msgr2=0x556875373390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f501159c700 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568753630d0 0x556875373390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f501159c700 1 -- 172.21.15.12:0/2772370906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 msgr2=0x55687536b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f501159c700 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.770+0000 7f501159c700 1 -- 172.21.15.12:0/2772370906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568750dfd80 con 0x556875367b80 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.771+0000 7f500bfff700 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568753630d0 0x556875373390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.771+0000 7f501159c700 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875367b80 0x5568753634b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f500400d700 tx=0x7f50040cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83080eb4ffdd3145 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.771+0000 7f4ff77fe700 1 -- 172.21.15.12:0/2772370906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500400ddd0 con 0x556875367b80 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.771+0000 7f4ff77fe700 1 -- 172.21.15.12:0/2772370906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5004099e50 con 0x556875367b80 2023-12-11T20:30:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.771+0000 7f4ff77fe700 1 -- 172.21.15.12:0/2772370906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004097af0 con 0x556875367b80 2023-12-11T20:30:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 -- 172.21.15.12:0/2772370906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875367b80 msgr2=0x5568753634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875367b80 0x5568753634b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f500400d700 tx=0x7f50040cc040 comp rx=0 tx=0).stop 2023-12-11T20:30:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 -- 172.21.15.12:0/2772370906 shutdown_connections 2023-12-11T20:30:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556875362770 0x55687536b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875367b80 0x5568753634b0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 --2- 172.21.15.12:0/2772370906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568753630d0 0x556875373390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 -- 172.21.15.12:0/2772370906 >> 172.21.15.12:0/2772370906 conn(0x556875291780 msgr2=0x556875369f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 -- 172.21.15.12:0/2772370906 shutdown_connections 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.772+0000 7f50269e5b80 1 -- 172.21.15.12:0/2772370906 wait complete. 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.773+0000 7f50269e5b80 1 -- start start 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.773+0000 7f50269e5b80 1 Processor -- start 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.773+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875362770 0x556875370ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5568753630d0 0x556875371530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f50269e5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875372540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f50269e5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556875372a80 con 0x556875362770 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f50269e5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556875372bf0 con 0x5568753630d0 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f50269e5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556875372db0 con 0x556875367b80 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f50269e5b80 10 client.0 _ll_register_callbacks cb 0x55687519ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f5010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875362770 0x556875370ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f5010d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875362770 0x556875370ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53214/0 (socket says 172.21.15.12:53214) 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f5010d9b700 1 -- 172.21.15.12:0/3446716231 learned_addr learned my addr 172.21.15.12:0/3446716231 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f500bfff700 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5568753630d0 0x556875371530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f501159c700 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875372540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f5010d9b700 1 -- 172.21.15.12:0/3446716231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 msgr2=0x556875372540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f5010d9b700 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875372540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f5010d9b700 1 -- 172.21.15.12:0/3446716231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5568753630d0 msgr2=0x556875371530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f5010d9b700 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5568753630d0 0x556875371530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f5010d9b700 1 -- 172.21.15.12:0/3446716231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568751335d0 con 0x556875362770 2023-12-11T20:30:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.774+0000 7f501159c700 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875372540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.775+0000 7f5010d9b700 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875362770 0x556875370ff0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f5000005950 tx=0x7f50000266a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803610953a1f5920 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.775+0000 7f4febfff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.775+0000 7f4febfff700 1 -- 172.21.15.12:0/3446716231 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000026c60 con 0x556875362770 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.775+0000 7f50269e5b80 1 -- 172.21.15.12:0/3446716231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ff801e040 con 0x556875362770 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.775+0000 7f4febfff700 1 -- 172.21.15.12:0/3446716231 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5000026dc0 con 0x556875362770 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.775+0000 7f4febfff700 1 -- 172.21.15.12:0/3446716231 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f500000f9e0 con 0x556875362770 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.775+0000 7f50269e5b80 10 client.19497 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.775+0000 7f50269e5b80 1 -- 172.21.15.12:0/3446716231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f5004021070 con 0x556875362770 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f4febfff700 1 -- 172.21.15.12:0/3446716231 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ff801e040 con 0x556875362770 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f4febfff700 1 -- 172.21.15.12:0/3446716231 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5000031a10 con 0x556875362770 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f50269e5b80 10 client.19497 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f50269e5b80 10 client.19497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f50269e5b80 20 client.19497 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5568753cf000 0x5568753d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f50269e5b80 4 client.19497 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:30:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f50269e5b80 1 -- 172.21.15.12:0/3446716231 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55687527cf70 con 0x5568753cf000 2023-12-11T20:30:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.776+0000 7f500bfff700 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5568753cf000 0x5568753d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.777+0000 7f500bfff700 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5568753cf000 0x5568753d1420 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efea7660545d61a0 server_cookie=eaa4a7b4156d58da in_seq=0 out_seq=0 2023-12-11T20:30:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.777+0000 7f4febfff700 10 client.19497 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f4febfff700 1 -- 172.21.15.12:0/3446716231 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55687527cf70 con 0x5568753cf000 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f4febfff700 10 client.19497 handle_command_reply: tid=0 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 client.19497 shutdown 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 -- 172.21.15.12:0/3446716231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875362770 msgr2=0x556875370ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875362770 0x556875370ff0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f5000005950 tx=0x7f50000266a0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 -- 172.21.15.12:0/3446716231 shutdown_connections 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5568753cf000 0x5568753d1420 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556875367b80 0x556875372540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f4febfff700 0 client.19497 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556875362770 0x556875370ff0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 --2- 172.21.15.12:0/3446716231 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5568753630d0 0x556875371530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 -- 172.21.15.12:0/3446716231 >> 172.21.15.12:0/3446716231 conn(0x556875291780 msgr2=0x556875367340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 -- 172.21.15.12:0/3446716231 shutdown_connections 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.787+0000 7f50269e5b80 1 -- 172.21.15.12:0/3446716231 wait complete. 2023-12-11T20:30:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f50269e5b80 20 client.19497 trim_cache size 0 max 16384 2023-12-11T20:30:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:30:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:30:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:30:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 -- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ffc0a14f0 msgr2=0x7f4ffc0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ffc0a14f0 0x7f4ffc0a39b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5000009cb0 tx=0x7f5000011720 comp rx=0 tx=0).stop 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 -- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c107030 msgr2=0x7f500c1a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c107030 0x7f500c1a08a0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f5004007ee0 tx=0x7f500400d3b0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 -- 172.21.15.12:0/4025215169 shutdown_connections 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4ffc0a14f0 0x7f4ffc0a39b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f500c101dd0 0x7f500c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c107030 0x7f500c1a08a0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 --2- 172.21.15.12:0/4025215169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f500c104700 0x7f500c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 -- 172.21.15.12:0/4025215169 >> 172.21.15.12:0/4025215169 conn(0x7f500c0fb780 msgr2=0x7f500c1014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 -- 172.21.15.12:0/4025215169 shutdown_connections 2023-12-11T20:30:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:04.788+0000 7f5011d9d700 1 -- 172.21.15.12:0/4025215169 wait complete. 2023-12-11T20:30:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:04 smithi032 ceph-mon[132488]: pgmap v799: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:30:05.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:04 smithi039 ceph-mon[102205]: pgmap v799: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:30:05.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:04 smithi012 ceph-mon[128787]: pgmap v799: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:30:06.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:06 smithi032 ceph-mon[132488]: pgmap v800: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:30:07.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:06 smithi039 ceph-mon[102205]: pgmap v800: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:30:07.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:06 smithi012 ceph-mon[128787]: pgmap v800: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-12-11T20:30:08.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:08 smithi032 ceph-mon[132488]: pgmap v801: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 17 MiB/s wr, 14 op/s 2023-12-11T20:30:09.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:08 smithi039 ceph-mon[102205]: pgmap v801: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 17 MiB/s wr, 14 op/s 2023-12-11T20:30:09.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:08 smithi012 ceph-mon[128787]: pgmap v801: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 17 MiB/s wr, 14 op/s 2023-12-11T20:30:10.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:30:10.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:10 smithi032 ceph-mon[132488]: pgmap v802: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:11.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:10 smithi039 ceph-mon[102205]: pgmap v802: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:10 smithi012 ceph-mon[128787]: pgmap v802: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:11.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 -- 172.21.15.12:0/591643968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41071e0 msgr2=0x7f43b4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 --2- 172.21.15.12:0/591643968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41071e0 0x7f43b4109650 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00b0a0 tx=0x7f43ac00b3b0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 -- 172.21.15.12:0/591643968 shutdown_connections 2023-12-11T20:30:11.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 --2- 172.21.15.12:0/591643968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41071e0 0x7f43b4109650 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 --2- 172.21.15.12:0/591643968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b4101f80 0x7f43b4104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 --2- 172.21.15.12:0/591643968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43b41048b0 0x7f43b4106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 -- 172.21.15.12:0/591643968 >> 172.21.15.12:0/591643968 conn(0x7f43b40fb930 msgr2=0x7f43b40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:11.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 -- 172.21.15.12:0/591643968 shutdown_connections 2023-12-11T20:30:11.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.120+0000 7f43bbfff700 1 -- 172.21.15.12:0/591643968 wait complete. 2023-12-11T20:30:11.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.121+0000 7f43bbfff700 1 Processor -- start 2023-12-11T20:30:11.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.121+0000 7f43bbfff700 1 -- start start 2023-12-11T20:30:11.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.121+0000 7f43bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43b4101f80 0x7f43b4199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.121+0000 7f43bbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41048b0 0x7f43b4199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.121+0000 7f43bbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b41071e0 0x7f43b41a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.121+0000 7f43bbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41a1130 con 0x7f43b41048b0 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.121+0000 7f43bbfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41a1270 con 0x7f43b4101f80 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.121+0000 7f43bbfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41a1400 con 0x7f43b41071e0 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41048b0 0x7f43b4199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41048b0 0x7f43b4199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47610/0 (socket says 172.21.15.12:47610) 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 -- 172.21.15.12:0/2764587387 learned_addr learned my addr 172.21.15.12:0/2764587387 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43b4101f80 0x7f43b4199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43ba59c700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b41071e0 0x7f43b41a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 -- 172.21.15.12:0/2764587387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b41071e0 msgr2=0x7f43b41a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b41071e0 0x7f43b41a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 -- 172.21.15.12:0/2764587387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43b4101f80 msgr2=0x7f43b4199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43b4101f80 0x7f43b4199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 -- 172.21.15.12:0/2764587387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac009d00 con 0x7f43b41048b0 2023-12-11T20:30:11.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.122+0000 7f43b959a700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41048b0 0x7f43b4199b40 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f43a400e9a0 tx=0x7f43a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:11.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.123+0000 7f43aaffd700 1 -- 172.21.15.12:0/2764587387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4009790 con 0x7f43b41048b0 2023-12-11T20:30:11.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.123+0000 7f43aaffd700 1 -- 172.21.15.12:0/2764587387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43a4010430 con 0x7f43b41048b0 2023-12-11T20:30:11.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.123+0000 7f43bbfff700 1 -- 172.21.15.12:0/2764587387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b41a16e0 con 0x7f43b41048b0 2023-12-11T20:30:11.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.123+0000 7f43aaffd700 1 -- 172.21.15.12:0/2764587387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400cea0 con 0x7f43b41048b0 2023-12-11T20:30:11.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.123+0000 7f43bbfff700 1 -- 172.21.15.12:0/2764587387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b41a1bf0 con 0x7f43b41048b0 2023-12-11T20:30:11.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.126+0000 7f43aaffd700 1 -- 172.21.15.12:0/2764587387 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f43a40105a0 con 0x7f43b41048b0 2023-12-11T20:30:11.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.128+0000 7f43aaffd700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43a00a1480 0x7f43a00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.128+0000 7f43aaffd700 1 -- 172.21.15.12:0/2764587387 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43a4014070 con 0x7f43b41048b0 2023-12-11T20:30:11.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.128+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43a00a1480 0x7f43a00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.128+0000 7f43cf871b80 1 Processor -- start 2023-12-11T20:30:11.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43cf871b80 1 -- start start 2023-12-11T20:30:11.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 0x5571b79aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b79ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43cf871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b78fcb50 con 0x5571b79aa540 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43cf871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b78fa470 con 0x5571b79ab430 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43cf871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b78f5d60 con 0x5571b79a9be0 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43a00a1480 0x7f43a00a3940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009c60 tx=0x7f43b0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.129+0000 7f43b959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47626/0 (socket says 172.21.15.12:47626) 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b959a700 1 -- 172.21.15.12:0/693970364 learned_addr learned my addr 172.21.15.12:0/693970364 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 0x5571b79aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43ba59c700 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b79ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b959a700 1 -- 172.21.15.12:0/693970364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 msgr2=0x5571b79aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b959a700 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 0x5571b79aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b959a700 1 -- 172.21.15.12:0/693970364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 msgr2=0x5571b79ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b959a700 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b79ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b959a700 1 -- 172.21.15.12:0/693970364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571b7772630 con 0x5571b79aa540 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43ba59c700 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b79ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f43b959a700 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79aae50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f43a409a170 tx=0x7f43a4099c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8114bdd3ed246995 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.130+0000 7f439ffff700 1 -- 172.21.15.12:0/693970364 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a409e120 con 0x5571b79aa540 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f439ffff700 1 -- 172.21.15.12:0/693970364 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43a409a8e0 con 0x5571b79aa540 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f439ffff700 1 -- 172.21.15.12:0/693970364 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40996d0 con 0x5571b79aa540 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f43cf871b80 1 -- 172.21.15.12:0/693970364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 msgr2=0x5571b79aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f43cf871b80 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79aae50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f43a409a170 tx=0x7f43a4099c10 comp rx=0 tx=0).stop 2023-12-11T20:30:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f43cf871b80 1 -- 172.21.15.12:0/693970364 shutdown_connections 2023-12-11T20:30:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f43cf871b80 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b79ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f43cf871b80 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 0x5571b79aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f43cf871b80 1 --2- 172.21.15.12:0/693970364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79aae50 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.131+0000 7f43cf871b80 1 -- 172.21.15.12:0/693970364 >> 172.21.15.12:0/693970364 conn(0x5571b78d07e0 msgr2=0x5571b799dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.132+0000 7f43cf871b80 1 -- 172.21.15.12:0/693970364 shutdown_connections 2023-12-11T20:30:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.132+0000 7f43cf871b80 1 -- 172.21.15.12:0/693970364 wait complete. 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.132+0000 7f43cf871b80 1 -- start start 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43cf871b80 1 Processor -- start 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 0x5571b79baf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43cf871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b78af560 con 0x5571b79a9be0 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43cf871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b78af200 con 0x5571b79aa540 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43cf871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7774920 con 0x5571b79ab430 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43cf871b80 10 client.0 _ll_register_callbacks cb 0x5571b77daa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47638/0 (socket says 172.21.15.12:47638) 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.133+0000 7f43b9d9b700 1 -- 172.21.15.12:0/4092137421 learned_addr learned my addr 172.21.15.12:0/4092137421 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f43b959a700 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f43b9d9b700 1 -- 172.21.15.12:0/4092137421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 msgr2=0x5571b79baf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 0x5571b79baf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f43b9d9b700 1 -- 172.21.15.12:0/4092137421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 msgr2=0x5571b79b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f43b9d9b700 1 -- 172.21.15.12:0/4092137421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b41a1bf0 con 0x5571b79a9be0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b39f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f43b0003900 tx=0x7f43b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b628931d6b056711 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f439d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f439d7fa700 1 -- 172.21.15.12:0/4092137421 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0022070 con 0x5571b79a9be0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f439d7fa700 1 -- 172.21.15.12:0/4092137421 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43b001d820 con 0x5571b79a9be0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.134+0000 7f43cf871b80 1 -- 172.21.15.12:0/4092137421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571b7994b40 con 0x5571b79a9be0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f439d7fa700 1 -- 172.21.15.12:0/4092137421 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43b00045a0 con 0x5571b79a9be0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f43cf871b80 10 client.19509 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f43cf871b80 1 -- 172.21.15.12:0/4092137421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5571b771ede0 con 0x5571b79a9be0 2023-12-11T20:30:11.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f439d7fa700 1 -- 172.21.15.12:0/4092137421 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5571b7994b40 con 0x5571b79a9be0 2023-12-11T20:30:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f439d7fa700 1 -- 172.21.15.12:0/4092137421 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43b0031a90 con 0x5571b79a9be0 2023-12-11T20:30:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f43cf871b80 10 client.19509 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f43cf871b80 10 client.19509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f43cf871b80 20 client.19509 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f43cf871b80 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571b79bf890 0x5571b79c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f43cf871b80 4 client.19509 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.135+0000 7f43cf871b80 1 -- 172.21.15.12:0/4092137421 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571b7970f40 con 0x5571b79bf890 2023-12-11T20:30:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.136+0000 7f43b959a700 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571b79bf890 0x5571b79c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.136+0000 7f43b959a700 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571b79bf890 0x5571b79c1cb0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d05b27905f9bc77b server_cookie=ad298047caa669fa in_seq=0 out_seq=0 2023-12-11T20:30:11.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.136+0000 7f439d7fa700 10 client.19509 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:11.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f439d7fa700 1 -- 172.21.15.12:0/4092137421 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571b7970f40 con 0x5571b79bf890 2023-12-11T20:30:11.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f439d7fa700 10 client.19509 handle_command_reply: tid=0 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f43cf871b80 1 client.19509 shutdown 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f43cf871b80 1 -- 172.21.15.12:0/4092137421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 msgr2=0x5571b79b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f43cf871b80 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b39f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f43b0003900 tx=0x7f43b00047c0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f43cf871b80 1 -- 172.21.15.12:0/4092137421 shutdown_connections 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f43cf871b80 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571b79bf890 0x5571b79c1cb0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f43cf871b80 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 0x5571b79baf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.137+0000 7f43cf871b80 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b39f0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.138+0000 7f43cf871b80 1 --2- 172.21.15.12:0/4092137421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.138+0000 7f43cf871b80 1 -- 172.21.15.12:0/4092137421 >> 172.21.15.12:0/4092137421 conn(0x5571b78d07e0 msgr2=0x5571b799ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.138+0000 7f439d7fa700 0 client.19509 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.138+0000 7f43cf871b80 1 -- 172.21.15.12:0/4092137421 shutdown_connections 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.138+0000 7f43cf871b80 1 -- 172.21.15.12:0/4092137421 wait complete. 2023-12-11T20:30:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.138+0000 7f43cf871b80 20 client.19509 trim_cache size 0 max 16384 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.167+0000 7f43cf871b80 1 Processor -- start 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.167+0000 7f43cf871b80 1 -- start start 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.167+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 0x5571b799d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.167+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79baf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.167+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b799deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43cf871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b79c6f70 con 0x5571b79aa540 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43cf871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b7994900 con 0x5571b79ab430 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43cf871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b79bf5a0 con 0x5571b79a9be0 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79baf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79baf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47644/0 (socket says 172.21.15.12:47644) 2023-12-11T20:30:11.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b959a700 1 -- 172.21.15.12:0/368980801 learned_addr learned my addr 172.21.15.12:0/368980801 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:11.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43ba59c700 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b799deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 0x5571b799d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b959a700 1 -- 172.21.15.12:0/368980801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 msgr2=0x5571b799d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:11.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b959a700 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 0x5571b799d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b959a700 1 -- 172.21.15.12:0/368980801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 msgr2=0x5571b799deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:11.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b959a700 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b799deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.168+0000 7f43b959a700 1 -- 172.21.15.12:0/368980801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571b7707c60 con 0x5571b79aa540 2023-12-11T20:30:11.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.169+0000 7f43b959a700 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79baf30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f43a4099ee0 tx=0x7f43a409a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0c54d4eafcf6c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:11.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.169+0000 7f43a8ff9700 1 -- 172.21.15.12:0/368980801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a409a1e0 con 0x5571b79aa540 2023-12-11T20:30:11.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.169+0000 7f43a8ff9700 1 -- 172.21.15.12:0/368980801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43a409e330 con 0x5571b79aa540 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.169+0000 7f43a8ff9700 1 -- 172.21.15.12:0/368980801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4099910 con 0x5571b79aa540 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 -- 172.21.15.12:0/368980801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 msgr2=0x5571b79baf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79baf30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f43a4099ee0 tx=0x7f43a409a0e0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 -- 172.21.15.12:0/368980801 shutdown_connections 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79ab430 0x5571b799deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79a9be0 0x5571b799d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 --2- 172.21.15.12:0/368980801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79aa540 0x5571b79baf30 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 -- 172.21.15.12:0/368980801 >> 172.21.15.12:0/368980801 conn(0x5571b78d07e0 msgr2=0x5571b79ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 -- 172.21.15.12:0/368980801 shutdown_connections 2023-12-11T20:30:11.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 -- 172.21.15.12:0/368980801 wait complete. 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.170+0000 7f43cf871b80 1 -- start start 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.171+0000 7f43cf871b80 1 Processor -- start 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.171+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.171+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.171+0000 7f43cf871b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 0x5571b79ba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.171+0000 7f43cf871b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b79ba960 con 0x5571b79a9be0 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.171+0000 7f43cf871b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b79baad0 con 0x5571b79aa540 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.171+0000 7f43cf871b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571b79bac90 con 0x5571b79ab430 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.171+0000 7f43cf871b80 10 client.0 _ll_register_callbacks cb 0x5571b77daa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47660/0 (socket says 172.21.15.12:47660) 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b9d9b700 1 -- 172.21.15.12:0/3247372792 learned_addr learned my addr 172.21.15.12:0/3247372792 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b959a700 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43ba59c700 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 0x5571b79ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b9d9b700 1 -- 172.21.15.12:0/3247372792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 msgr2=0x5571b79ba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 0x5571b79ba420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b9d9b700 1 -- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 msgr2=0x5571b79b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b9d9b700 1 -- 172.21.15.12:0/3247372792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571b7772630 con 0x5571b79a9be0 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.172+0000 7f43b959a700 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.173+0000 7f43b9d9b700 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b8f70 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f43b0031e70 tx=0x7f43b0009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b7f6940c5d64e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.173+0000 7f439d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.173+0000 7f439d7fa700 1 -- 172.21.15.12:0/3247372792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0037070 con 0x5571b79a9be0 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.173+0000 7f439d7fa700 1 -- 172.21.15.12:0/3247372792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43b0027820 con 0x5571b79a9be0 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.173+0000 7f43cf871b80 1 -- 172.21.15.12:0/3247372792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43a409a8e0 con 0x5571b79a9be0 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.173+0000 7f439d7fa700 1 -- 172.21.15.12:0/3247372792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43b0022040 con 0x5571b79a9be0 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.173+0000 7f43cf871b80 10 client.19515 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:11.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.173+0000 7f43cf871b80 1 -- 172.21.15.12:0/3247372792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5571b7745250 con 0x5571b79a9be0 2023-12-11T20:30:11.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f439d7fa700 1 -- 172.21.15.12:0/3247372792 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43a409a8e0 con 0x5571b79a9be0 2023-12-11T20:30:11.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f439d7fa700 1 -- 172.21.15.12:0/3247372792 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43b001dcd0 con 0x5571b79a9be0 2023-12-11T20:30:11.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f43cf871b80 10 client.19515 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:11.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f43cf871b80 10 client.19515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:11.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f43cf871b80 20 client.19515 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:11.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f43cf871b80 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571b7a16fb0 0x5571b7a193d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f43cf871b80 4 client.19515 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:30:11.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f43cf871b80 1 -- 172.21.15.12:0/3247372792 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5571b78bbfd0 con 0x5571b7a16fb0 2023-12-11T20:30:11.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.174+0000 7f43b959a700 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571b7a16fb0 0x5571b7a193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43b959a700 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571b7a16fb0 0x5571b7a193d0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef2e6989636fa5b9 server_cookie=2ecd17937a59fe71 in_seq=0 out_seq=0 2023-12-11T20:30:11.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f439d7fa700 10 client.19515 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:11.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f439d7fa700 1 -- 172.21.15.12:0/3247372792 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5571b78bbfd0 con 0x5571b7a16fb0 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f439d7fa700 10 client.19515 handle_command_reply: tid=0 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 client.19515 shutdown 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 -- 172.21.15.12:0/3247372792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 msgr2=0x5571b79b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b8f70 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f43b0031e70 tx=0x7f43b0009fc0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 -- 172.21.15.12:0/3247372792 shutdown_connections 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571b7a16fb0 0x5571b7a193d0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571b79ab430 0x5571b79ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571b79a9be0 0x5571b79b8f70 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 --2- 172.21.15.12:0/3247372792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571b79aa540 0x5571b79b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f43cf871b80 1 -- 172.21.15.12:0/3247372792 >> 172.21.15.12:0/3247372792 conn(0x5571b78d07e0 msgr2=0x5571b799d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.175+0000 7f439d7fa700 0 client.19515 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43cf871b80 1 -- 172.21.15.12:0/3247372792 shutdown_connections 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43cf871b80 1 -- 172.21.15.12:0/3247372792 wait complete. 2023-12-11T20:30:11.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43cf871b80 20 client.19515 trim_cache size 0 max 16384 2023-12-11T20:30:11.178 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:30:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:30:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:30:11.178 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:30:11.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 -- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43a00a1480 msgr2=0x7f43a00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43a00a1480 0x7f43a00a3940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009c60 tx=0x7f43b0009260 comp rx=0 tx=0).stop 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 -- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41048b0 msgr2=0x7f43b4199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41048b0 0x7f43b4199b40 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f43a400e9a0 tx=0x7f43a400ecb0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 -- 172.21.15.12:0/2764587387 shutdown_connections 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f43a00a1480 0x7f43a00a3940 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43b4101f80 0x7f43b4199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b41071e0 0x7f43b41a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 --2- 172.21.15.12:0/2764587387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43b41048b0 0x7f43b4199b40 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.176+0000 7f43bbfff700 1 -- 172.21.15.12:0/2764587387 >> 172.21.15.12:0/2764587387 conn(0x7f43b40fb930 msgr2=0x7f43b4101760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.177+0000 7f43bbfff700 1 -- 172.21.15.12:0/2764587387 shutdown_connections 2023-12-11T20:30:11.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.177+0000 7f43bbfff700 1 -- 172.21.15.12:0/2764587387 wait complete. 2023-12-11T20:30:11.198 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:30:11.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:30:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 -- 172.21.15.12:0/250893313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1012d0 msgr2=0x7f360c1016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 --2- 172.21.15.12:0/250893313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1012d0 0x7f360c1016f0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f36080099c0 tx=0x7f3608009cd0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 -- 172.21.15.12:0/250893313 shutdown_connections 2023-12-11T20:30:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 --2- 172.21.15.12:0/250893313 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c102e60 0x7f360c109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 --2- 172.21.15.12:0/250893313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1012d0 0x7f360c1016f0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 --2- 172.21.15.12:0/250893313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f360c1024c0 0x7f360c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 -- 172.21.15.12:0/250893313 >> 172.21.15.12:0/250893313 conn(0x7f360c0fc840 msgr2=0x7f360c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 -- 172.21.15.12:0/250893313 shutdown_connections 2023-12-11T20:30:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.424+0000 7f361239d700 1 -- 172.21.15.12:0/250893313 wait complete. 2023-12-11T20:30:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.425+0000 7f361239d700 1 Processor -- start 2023-12-11T20:30:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f361239d700 1 -- start start 2023-12-11T20:30:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f361239d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c1012d0 0x7f360c1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f361239d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1024c0 0x7f360c1976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f361239d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f360c102e60 0x7f360c19e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f361239d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c19ece0 con 0x7f360c1024c0 2023-12-11T20:30:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f361239d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c19ee20 con 0x7f360c102e60 2023-12-11T20:30:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f361239d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c19efb0 con 0x7f360c1012d0 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f3610b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1024c0 0x7f360c1976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f3610b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1024c0 0x7f360c1976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47668/0 (socket says 172.21.15.12:47668) 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f3610b9a700 1 -- 172.21.15.12:0/2779457550 learned_addr learned my addr 172.21.15.12:0/2779457550 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f3611b9c700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f360c102e60 0x7f360c19e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.426+0000 7f361139b700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c1012d0 0x7f360c1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f3610b9a700 1 -- 172.21.15.12:0/2779457550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c1012d0 msgr2=0x7f360c1971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f3610b9a700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c1012d0 0x7f360c1971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f3610b9a700 1 -- 172.21.15.12:0/2779457550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f360c102e60 msgr2=0x7f360c19e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f3610b9a700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f360c102e60 0x7f360c19e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f3610b9a700 1 -- 172.21.15.12:0/2779457550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc009520 con 0x7f360c1024c0 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f3611b9c700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f360c102e60 0x7f360c19e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f3610b9a700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1024c0 0x7f360c1976f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00eb30 tx=0x7f35fc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f36027fc700 1 -- 172.21.15.12:0/2779457550 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc009880 con 0x7f360c1024c0 2023-12-11T20:30:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f36027fc700 1 -- 172.21.15.12:0/2779457550 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35fc0044b0 con 0x7f360c1024c0 2023-12-11T20:30:11.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.427+0000 7f36027fc700 1 -- 172.21.15.12:0/2779457550 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc003ce0 con 0x7f360c1024c0 2023-12-11T20:30:11.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.428+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36080095f0 con 0x7f360c1024c0 2023-12-11T20:30:11.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.428+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c19f610 con 0x7f360c1024c0 2023-12-11T20:30:11.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.429+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c108840 con 0x7f360c1024c0 2023-12-11T20:30:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.431+0000 7f36027fc700 1 -- 172.21.15.12:0/2779457550 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f35fc003e40 con 0x7f360c1024c0 2023-12-11T20:30:11.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.434+0000 7f36027fc700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f35f80a1500 0x7f35f80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:11.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.434+0000 7f36027fc700 1 -- 172.21.15.12:0/2779457550 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f35fc014070 con 0x7f360c1024c0 2023-12-11T20:30:11.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.434+0000 7f361139b700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f35f80a1500 0x7f35f80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:11.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.435+0000 7f361139b700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f35f80a1500 0x7f35f80a39c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3608009990 tx=0x7f3608003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:11.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.436+0000 7f36027fc700 1 -- 172.21.15.12:0/2779457550 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f35fc096920 con 0x7f360c1024c0 2023-12-11T20:30:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.747+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f360c04f300 con 0x7f360c1024c0 2023-12-11T20:30:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.747+0000 7f36027fc700 1 -- 172.21.15.12:0/2779457550 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f35fc099f40 con 0x7f360c1024c0 2023-12-11T20:30:11.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:30:11.747 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:29:56.121839+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:30:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f35f80a1500 msgr2=0x7f35f80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f35f80a1500 0x7f35f80a39c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3608009990 tx=0x7f3608003680 comp rx=0 tx=0).stop 2023-12-11T20:30:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1024c0 msgr2=0x7f360c1976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1024c0 0x7f360c1976f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00eb30 tx=0x7f35fc00ee40 comp rx=0 tx=0).stop 2023-12-11T20:30:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 shutdown_connections 2023-12-11T20:30:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f35f80a1500 0x7f35f80a39c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f360c102e60 0x7f360c19e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c1012d0 0x7f360c1971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 --2- 172.21.15.12:0/2779457550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c1024c0 0x7f360c1976f0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 >> 172.21.15.12:0/2779457550 conn(0x7f360c0fc840 msgr2=0x7f360c105980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 shutdown_connections 2023-12-11T20:30:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:11.750+0000 7f361239d700 1 -- 172.21.15.12:0/2779457550 wait complete. 2023-12-11T20:30:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 32 2023-12-11T20:30:11.770 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:30:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.005+0000 7f8fe85ff700 1 -- 172.21.15.12:0/3548074724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe0105280 msgr2=0x7f8fe010bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.005+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/3548074724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe0105280 0x7f8fe010bb30 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800b0d0 tx=0x7f8fd800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.006+0000 7f8fe85ff700 1 -- 172.21.15.12:0/3548074724 shutdown_connections 2023-12-11T20:30:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.006+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/3548074724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe0105280 0x7f8fe010bb30 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.006+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/3548074724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fe01036f0 0x7f8fe0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.006+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/3548074724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe01048e0 0x7f8fe0104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.006+0000 7f8fe85ff700 1 -- 172.21.15.12:0/3548074724 >> 172.21.15.12:0/3548074724 conn(0x7f8fe00fec80 msgr2=0x7f8fe01010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.006+0000 7f8fe85ff700 1 -- 172.21.15.12:0/3548074724 shutdown_connections 2023-12-11T20:30:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.006+0000 7f8fe85ff700 1 -- 172.21.15.12:0/3548074724 wait complete. 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.007+0000 7f8fe85ff700 1 Processor -- start 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.007+0000 7f8fe85ff700 1 -- start start 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.007+0000 7f8fe85ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe01036f0 0x7f8fe01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.007+0000 7f8fe85ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe01048e0 0x7f8fe0199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.007+0000 7f8fe85ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fe0105280 0x7f8fe01a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.007+0000 7f8fe85ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01a1140 con 0x7f8fe01048e0 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.007+0000 7f8fe85ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01a1280 con 0x7f8fe01036f0 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.007+0000 7f8fe85ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01a1410 con 0x7f8fe0105280 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe01048e0 0x7f8fe0199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe01048e0 0x7f8fe0199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47682/0 (socket says 172.21.15.12:47682) 2023-12-11T20:30:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 -- 172.21.15.12:0/1574658761 learned_addr learned my addr 172.21.15.12:0/1574658761 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe639b700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe01036f0 0x7f8fe01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fe0105280 0x7f8fe01a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 -- 172.21.15.12:0/1574658761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fe0105280 msgr2=0x7f8fe01a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fe0105280 0x7f8fe01a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 -- 172.21.15.12:0/1574658761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe01036f0 msgr2=0x7f8fe01996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe01036f0 0x7f8fe01996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 -- 172.21.15.12:0/1574658761 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd8009d00 con 0x7f8fe01048e0 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.008+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe01048e0 0x7f8fe0199bf0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000d950 tx=0x7f8fd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.009+0000 7f8fd77fe700 1 -- 172.21.15.12:0/1574658761 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0009940 con 0x7f8fe01048e0 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.009+0000 7f8fd77fe700 1 -- 172.21.15.12:0/1574658761 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fd0010460 con 0x7f8fe01048e0 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.009+0000 7f8fe85ff700 1 -- 172.21.15.12:0/1574658761 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe01a16f0 con 0x7f8fe01048e0 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.009+0000 7f8fd77fe700 1 -- 172.21.15.12:0/1574658761 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000f620 con 0x7f8fe01048e0 2023-12-11T20:30:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.009+0000 7f8fe85ff700 1 -- 172.21.15.12:0/1574658761 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe01a1c00 con 0x7f8fe01048e0 2023-12-11T20:30:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.013+0000 7f8fd77fe700 1 -- 172.21.15.12:0/1574658761 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8fd00105d0 con 0x7f8fe01048e0 2023-12-11T20:30:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.014+0000 7f8ffbf3cb80 1 Processor -- start 2023-12-11T20:30:12.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.014+0000 7f8ffbf3cb80 1 -- start start 2023-12-11T20:30:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.014+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc6c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.014+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc6d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.014+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.014+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cbc7b50 con 0x55ce0cc6cd30 2023-12-11T20:30:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.014+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cbc5470 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.014+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cbc0d60 con 0x55ce0cc6dc20 2023-12-11T20:30:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc6d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc6d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47686/0 (socket says 172.21.15.12:47686) 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe639b700 1 -- 172.21.15.12:0/55340105 learned_addr learned my addr 172.21.15.12:0/55340105 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc6c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe639b700 1 -- 172.21.15.12:0/55340105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 msgr2=0x55ce0cc6e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe639b700 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc6e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe639b700 1 -- 172.21.15.12:0/55340105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 msgr2=0x55ce0cc6c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe639b700 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc6c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fe639b700 1 -- 172.21.15.12:0/55340105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce0ca3d630 con 0x55ce0cc6cd30 2023-12-11T20:30:12.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.015+0000 7f8fd77fe700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.016+0000 7f8fe639b700 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc6d640 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009d30 tx=0x7f8fdc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911d960b9657a238 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.016+0000 7f8fd77fe700 1 -- 172.21.15.12:0/1574658761 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8fd00ccc10 con 0x7f8fe01048e0 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.016+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.016+0000 7f8fd4bfe700 1 -- 172.21.15.12:0/55340105 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc004220 con 0x55ce0cc6cd30 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.016+0000 7f8fd4bfe700 1 -- 172.21.15.12:0/55340105 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fdc004380 con 0x55ce0cc6cd30 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.016+0000 7f8fd4bfe700 1 -- 172.21.15.12:0/55340105 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0197a0 con 0x55ce0cc6cd30 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/55340105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6cd30 msgr2=0x55ce0cc6d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc6d640 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009d30 tx=0x7f8fdc011720 comp rx=0 tx=0).stop 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009fd0 tx=0x7f8fd800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/55340105 shutdown_connections 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc6c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc6e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/55340105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc6d640 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/55340105 >> 172.21.15.12:0/55340105 conn(0x55ce0cb9b7e0 msgr2=0x55ce0cc68d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/55340105 shutdown_connections 2023-12-11T20:30:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.017+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/55340105 wait complete. 2023-12-11T20:30:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.018+0000 7f8ffbf3cb80 1 -- start start 2023-12-11T20:30:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.018+0000 7f8ffbf3cb80 1 Processor -- start 2023-12-11T20:30:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.018+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc76190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.018+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc7d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cb7a560 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cb7a200 con 0x55ce0cc6cd30 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0ca3f920 con 0x55ce0cc6dc20 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8ffbf3cb80 10 client.0 _ll_register_callbacks cb 0x55ce0caa5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc76190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc76190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47696/0 (socket says 172.21.15.12:47696) 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe639b700 1 -- 172.21.15.12:0/2819170896 learned_addr learned my addr 172.21.15.12:0/2819170896 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc7d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe5b9a700 1 -- 172.21.15.12:0/2819170896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 msgr2=0x55ce0cc7d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc7d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe5b9a700 1 -- 172.21.15.12:0/2819170896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 msgr2=0x55ce0cc76190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc76190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe5b9a700 1 -- 172.21.15.12:0/2819170896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc009960 con 0x55ce0cc6cd30 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.019+0000 7f8fe639b700 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc76190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.020+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc766d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ce0cc6d400 tx=0x7f8fd00961c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef3da5b7b3a29514 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.020+0000 7f8fc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.020+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/2819170896 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00999c0 con 0x55ce0cc6cd30 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.020+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2819170896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce0cc5fb40 con 0x55ce0cc6cd30 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.020+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/2819170896 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8fd00108d0 con 0x55ce0cc6cd30 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.020+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/2819170896 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fd00997e0 con 0x55ce0cc6cd30 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8ffbf3cb80 10 client.29087 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2819170896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ce0c9e9de0 con 0x55ce0cc6cd30 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/2819170896 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ce0cc5fb40 con 0x55ce0cc6cd30 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/2819170896 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8fd0099370 con 0x55ce0cc6cd30 2023-12-11T20:30:12.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8ffbf3cb80 10 client.29087 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:12.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8ffbf3cb80 10 client.29087 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:30:12.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8ffbf3cb80 20 client.29087 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:12.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ce0cc81f10 0x55ce0cc84330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8ffbf3cb80 4 client.29087 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:12.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.021+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2819170896 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce0cc3bf40 con 0x55ce0cc81f10 2023-12-11T20:30:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.022+0000 7f8fe639b700 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ce0cc81f10 0x55ce0cc84330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.023+0000 7f8fe639b700 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ce0cc81f10 0x55ce0cc84330 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59063ff4ee8a3dbc server_cookie=14022203e0063755 in_seq=0 out_seq=0 2023-12-11T20:30:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.023+0000 7f8fc9ffb700 10 client.29087 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:30:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.023+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/2819170896 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ce0cc3bf40 con 0x55ce0cc81f10 2023-12-11T20:30:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.023+0000 7f8fc9ffb700 10 client.29087 handle_command_reply: tid=0 2023-12-11T20:30:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.023+0000 7f8ffbf3cb80 1 client.29087 shutdown 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 msgr2=0x55ce0cc766d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc766d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ce0cc6d400 tx=0x7f8fd00961c0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2819170896 shutdown_connections 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ce0cc81f10 0x55ce0cc84330 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc7d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc76190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8fc9ffb700 0 client.29087 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2819170896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc766d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2819170896 >> 172.21.15.12:0/2819170896 conn(0x55ce0cb9b7e0 msgr2=0x55ce0cc67a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2819170896 shutdown_connections 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2819170896 wait complete. 2023-12-11T20:30:12.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.024+0000 7f8ffbf3cb80 20 client.29087 trim_cache size 0 max 16384 2023-12-11T20:30:12.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8ffbf3cb80 1 Processor -- start 2023-12-11T20:30:12.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8ffbf3cb80 1 -- start start 2023-12-11T20:30:12.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc75710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc7d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc70bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cc75d00 con 0x55ce0cc6dc20 2023-12-11T20:30:12.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cc6d110 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cc69220 con 0x55ce0cc6cd30 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8fe6b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc70bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8fe6b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc70bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47698/0 (socket says 172.21.15.12:47698) 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.039+0000 7f8fe6b9c700 1 -- 172.21.15.12:0/2517965856 learned_addr learned my addr 172.21.15.12:0/2517965856 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.040+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc7d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.040+0000 7f8fe639b700 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc75710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.040+0000 7f8fe6b9c700 1 -- 172.21.15.12:0/2517965856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6cd30 msgr2=0x55ce0cc7d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.040+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc7d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.040+0000 7f8fe6b9c700 1 -- 172.21.15.12:0/2517965856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 msgr2=0x55ce0cc75710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.040+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc75710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.040+0000 7f8fe6b9c700 1 -- 172.21.15.12:0/2517965856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce0c9d2c60 con 0x55ce0cc6dc20 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.040+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc70bd0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8015000 tx=0x7f8fd801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be34c8267db05eec server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8fd53ff700 1 -- 172.21.15.12:0/2517965856 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800e040 con 0x55ce0cc6dc20 2023-12-11T20:30:12.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8fd53ff700 1 -- 172.21.15.12:0/2517965856 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fd800bca0 con 0x55ce0cc6dc20 2023-12-11T20:30:12.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8fd53ff700 1 -- 172.21.15.12:0/2517965856 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8034b20 con 0x55ce0cc6dc20 2023-12-11T20:30:12.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2517965856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6dc20 msgr2=0x55ce0cc70bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc70bd0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8015000 tx=0x7f8fd801e000 comp rx=0 tx=0).stop 2023-12-11T20:30:12.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2517965856 shutdown_connections 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc75710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc70bd0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/2517965856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc7d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.041+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2517965856 >> 172.21.15.12:0/2517965856 conn(0x55ce0cb9b7e0 msgr2=0x55ce0cc741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.042+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2517965856 shutdown_connections 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.042+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/2517965856 wait complete. 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.042+0000 7f8ffbf3cb80 1 -- start start 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.042+0000 7f8ffbf3cb80 1 Processor -- start 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc7b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc7b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8ffbf3cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc7c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cc7cbd0 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cc7cd40 con 0x55ce0cc6cd30 2023-12-11T20:30:12.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8ffbf3cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce0cc7cf00 con 0x55ce0cc6dc20 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8ffbf3cb80 10 client.0 _ll_register_callbacks cb 0x55ce0caa5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc7b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc7b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47700/0 (socket says 172.21.15.12:47700) 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe639b700 1 -- 172.21.15.12:0/861111278 learned_addr learned my addr 172.21.15.12:0/861111278 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe6b9c700 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc7c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc7b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe639b700 1 -- 172.21.15.12:0/861111278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 msgr2=0x55ce0cc7c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe639b700 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc7c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe639b700 1 -- 172.21.15.12:0/861111278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 msgr2=0x55ce0cc7b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe639b700 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc7b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.043+0000 7f8fe639b700 1 -- 172.21.15.12:0/861111278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe010c480 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.044+0000 7f8fe639b700 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc7b140 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009d30 tx=0x7f8fdc009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9f4178648c5497 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.044+0000 7f8fc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.044+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/861111278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc003a20 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.044+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/861111278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fdc004380 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.044+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/861111278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8fdc02ab00 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.044+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/861111278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fdc003b80 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.044+0000 7f8ffbf3cb80 10 client.19539 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.044+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/861111278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ce0ca10250 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.045+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/861111278 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fdc004380 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.045+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/861111278 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8fdc011440 con 0x55ce0cc6c3d0 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.045+0000 7f8ffbf3cb80 10 client.19539 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.045+0000 7f8ffbf3cb80 10 client.19539 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.045+0000 7f8ffbf3cb80 20 client.19539 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.045+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ce0ccd9060 0x55ce0ccdb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.045+0000 7f8ffbf3cb80 4 client.19539 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.045+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/861111278 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ce0cb86fd0 con 0x55ce0ccd9060 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.046+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ce0ccd9060 0x55ce0ccdb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.046+0000 7f8fe5b9a700 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ce0ccd9060 0x55ce0ccdb480 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e007575883ecd8b server_cookie=34ffab64269c7091 in_seq=0 out_seq=0 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.046+0000 7f8fc9ffb700 10 client.19539 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.046+0000 7f8fc9ffb700 1 -- 172.21.15.12:0/861111278 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ce0cb86fd0 con 0x55ce0ccd9060 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.046+0000 7f8fc9ffb700 10 client.19539 handle_command_reply: tid=0 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.046+0000 7f8ffbf3cb80 1 client.19539 shutdown 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/861111278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 msgr2=0x55ce0cc7b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc7b140 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009d30 tx=0x7f8fdc009fa0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/861111278 shutdown_connections 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55ce0ccd9060 0x55ce0ccdb480 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ce0cc6dc20 0x55ce0cc7c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce0cc6c3d0 0x55ce0cc7b140 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 --2- 172.21.15.12:0/861111278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55ce0cc6cd30 0x55ce0cc7b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/861111278 >> 172.21.15.12:0/861111278 conn(0x55ce0cb9b7e0 msgr2=0x55ce0cc70bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8fc9ffb700 0 client.19539 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:30:12.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/861111278 shutdown_connections 2023-12-11T20:30:12.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 1 -- 172.21.15.12:0/861111278 wait complete. 2023-12-11T20:30:12.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.047+0000 7f8ffbf3cb80 20 client.19539 trim_cache size 0 max 16384 2023-12-11T20:30:12.049 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 -- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fcc0a1480 msgr2=0x7f8fcc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009fd0 tx=0x7f8fd800b040 comp rx=0 tx=0).stop 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 -- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe01048e0 msgr2=0x7f8fe0199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe01048e0 0x7f8fe0199bf0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000d950 tx=0x7f8fd000dc60 comp rx=0 tx=0).stop 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 -- 172.21.15.12:0/1574658761 shutdown_connections 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe01036f0 0x7f8fe01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fe0105280 0x7f8fe01a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 --2- 172.21.15.12:0/1574658761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fe01048e0 0x7f8fe0199bf0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 -- 172.21.15.12:0/1574658761 >> 172.21.15.12:0/1574658761 conn(0x7f8fe00fec80 msgr2=0x7f8fe0107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 -- 172.21.15.12:0/1574658761 shutdown_connections 2023-12-11T20:30:12.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.048+0000 7f8fe85ff700 1 -- 172.21.15.12:0/1574658761 wait complete. 2023-12-11T20:30:12.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.306+0000 7f8865dff700 1 -- 172.21.15.12:0/2584908313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88601014b0 msgr2=0x7f88601018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.306+0000 7f8865dff700 1 --2- 172.21.15.12:0/2584908313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88601014b0 0x7f88601018d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f88500099c0 tx=0x7f8850009cd0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.307+0000 7f8865dff700 1 -- 172.21.15.12:0/2584908313 shutdown_connections 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.307+0000 7f8865dff700 1 --2- 172.21.15.12:0/2584908313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8860103040 0x7f88601098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.307+0000 7f8865dff700 1 --2- 172.21.15.12:0/2584908313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88601014b0 0x7f88601018d0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.307+0000 7f8865dff700 1 --2- 172.21.15.12:0/2584908313 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88601026a0 0x7f8860102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.307+0000 7f8865dff700 1 -- 172.21.15.12:0/2584908313 >> 172.21.15.12:0/2584908313 conn(0x7f88600fca00 msgr2=0x7f88600fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.307+0000 7f8865dff700 1 -- 172.21.15.12:0/2584908313 shutdown_connections 2023-12-11T20:30:12.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.307+0000 7f8865dff700 1 -- 172.21.15.12:0/2584908313 wait complete. 2023-12-11T20:30:12.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.308+0000 7f8865dff700 1 Processor -- start 2023-12-11T20:30:12.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.308+0000 7f8865dff700 1 -- start start 2023-12-11T20:30:12.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.308+0000 7f8865dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88601014b0 0x7f88601995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.308+0000 7f8865dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88601026a0 0x7f8860199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f8865dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8860103040 0x7f88601a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f8865dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88601a1120 con 0x7f8860103040 2023-12-11T20:30:12.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f8865dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88601a1260 con 0x7f88601014b0 2023-12-11T20:30:12.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f8865dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88601a13f0 con 0x7f88601026a0 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8860103040 0x7f88601a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8860103040 0x7f88601a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47718/0 (socket says 172.21.15.12:47718) 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885ffff700 1 -- 172.21.15.12:0/762152614 learned_addr learned my addr 172.21.15.12:0/762152614 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885effd700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88601026a0 0x7f8860199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885f7fe700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88601014b0 0x7f88601995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885ffff700 1 -- 172.21.15.12:0/762152614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88601026a0 msgr2=0x7f8860199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885ffff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88601026a0 0x7f8860199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885ffff700 1 -- 172.21.15.12:0/762152614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88601014b0 msgr2=0x7f88601995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885ffff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88601014b0 0x7f88601995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.309+0000 7f885ffff700 1 -- 172.21.15.12:0/762152614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88500095f0 con 0x7f8860103040 2023-12-11T20:30:12.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.310+0000 7f885ffff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8860103040 0x7f88601a0b50 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f8858007ee0 tx=0x7f885800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.310+0000 7f885cff9700 1 -- 172.21.15.12:0/762152614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800dd20 con 0x7f8860103040 2023-12-11T20:30:12.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.310+0000 7f885cff9700 1 -- 172.21.15.12:0/762152614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f885800f040 con 0x7f8860103040 2023-12-11T20:30:12.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.310+0000 7f8865dff700 1 -- 172.21.15.12:0/762152614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88601a16d0 con 0x7f8860103040 2023-12-11T20:30:12.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.310+0000 7f885cff9700 1 -- 172.21.15.12:0/762152614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858004750 con 0x7f8860103040 2023-12-11T20:30:12.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.310+0000 7f8865dff700 1 -- 172.21.15.12:0/762152614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88601a1b90 con 0x7f8860103040 2023-12-11T20:30:12.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.314+0000 7f885cff9700 1 -- 172.21.15.12:0/762152614 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8858003a00 con 0x7f8860103040 2023-12-11T20:30:12.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.315+0000 7f8879783b80 1 Processor -- start 2023-12-11T20:30:12.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.315+0000 7f8879783b80 1 -- start start 2023-12-11T20:30:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.315+0000 7f8879783b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.315+0000 7f8879783b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c1d30 0x5575ab5c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.315+0000 7f8879783b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c2c20 0x5575ab5c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.315+0000 7f8879783b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab51cb50 con 0x5575ab5c13d0 2023-12-11T20:30:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.315+0000 7f8879783b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab51a470 con 0x5575ab5c2c20 2023-12-11T20:30:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.315+0000 7f8879783b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab515d60 con 0x5575ab5c1d30 2023-12-11T20:30:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5c17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47734/0 (socket says 172.21.15.12:47734) 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 -- 172.21.15.12:0/2965781008 learned_addr learned my addr 172.21.15.12:0/2965781008 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885f7fe700 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c1d30 0x5575ab5c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c2c20 0x5575ab5c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 -- 172.21.15.12:0/2965781008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c1d30 msgr2=0x5575ab5c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c1d30 0x5575ab5c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 -- 172.21.15.12:0/2965781008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c2c20 msgr2=0x5575ab5c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c2c20 0x5575ab5c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885effd700 1 -- 172.21.15.12:0/2965781008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575ab392630 con 0x5575ab5c13d0 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.316+0000 7f885f7fe700 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c1d30 0x5575ab5c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.317+0000 7f885effd700 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5c17f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f88540046e0 tx=0x7f8854009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817253966bd43bae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.317+0000 7f885cff9700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88480a1480 0x7f88480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.317+0000 7f885cff9700 1 -- 172.21.15.12:0/762152614 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f88580cc670 con 0x7f8860103040 2023-12-11T20:30:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.317+0000 7f8845ffb700 1 -- 172.21.15.12:0/2965781008 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854010430 con 0x5575ab5c13d0 2023-12-11T20:30:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.317+0000 7f8845ffb700 1 -- 172.21.15.12:0/2965781008 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8854010a20 con 0x5575ab5c13d0 2023-12-11T20:30:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.317+0000 7f885f7fe700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88480a1480 0x7f88480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.317+0000 7f8845ffb700 1 -- 172.21.15.12:0/2965781008 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885400e6e0 con 0x5575ab5c13d0 2023-12-11T20:30:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 -- 172.21.15.12:0/2965781008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 msgr2=0x5575ab5c17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f885f7fe700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88480a1480 0x7f88480a3940 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8850009990 tx=0x7f8850003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5c17f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f88540046e0 tx=0x7f8854009920 comp rx=0 tx=0).stop 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 -- 172.21.15.12:0/2965781008 shutdown_connections 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c2c20 0x5575ab5c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5c17f0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 --2- 172.21.15.12:0/2965781008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c1d30 0x5575ab5c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 -- 172.21.15.12:0/2965781008 >> 172.21.15.12:0/2965781008 conn(0x5575ab4f07e0 msgr2=0x5575ab5bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 -- 172.21.15.12:0/2965781008 shutdown_connections 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.318+0000 7f8879783b80 1 -- 172.21.15.12:0/2965781008 wait complete. 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.319+0000 7f8879783b80 1 -- start start 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.319+0000 7f8879783b80 1 Processor -- start 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.319+0000 7f8879783b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c13d0 0x5575ab5cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.319+0000 7f8879783b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c1d30 0x5575ab5cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f8879783b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 0x5575ab5d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f8879783b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab4cf560 con 0x5575ab5c1d30 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f8879783b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab4cf200 con 0x5575ab5c13d0 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f8879783b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab394920 con 0x5575ab5c2c20 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f8879783b80 10 client.0 _ll_register_callbacks cb 0x5575ab3faa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c1d30 0x5575ab5cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c1d30 0x5575ab5cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47738/0 (socket says 172.21.15.12:47738) 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885effd700 1 -- 172.21.15.12:0/1665739909 learned_addr learned my addr 172.21.15.12:0/1665739909 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885f7fe700 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c13d0 0x5575ab5cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885ffff700 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 0x5575ab5d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885effd700 1 -- 172.21.15.12:0/1665739909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 msgr2=0x5575ab5d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885effd700 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 0x5575ab5d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885effd700 1 -- 172.21.15.12:0/1665739909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c13d0 msgr2=0x5575ab5cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885effd700 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c13d0 0x5575ab5cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.320+0000 7f885effd700 1 -- 172.21.15.12:0/1665739909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886010a240 con 0x5575ab5c1d30 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.321+0000 7f885effd700 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c1d30 0x5575ab5cb750 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f88540099c0 tx=0x7f8854010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1872f7d1e60c736f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.321+0000 7f883effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:12.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.321+0000 7f883effd700 1 -- 172.21.15.12:0/1665739909 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854024070 con 0x5575ab5c1d30 2023-12-11T20:30:12.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.321+0000 7f8879783b80 1 -- 172.21.15.12:0/1665739909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575ab5b4b40 con 0x5575ab5c1d30 2023-12-11T20:30:12.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.321+0000 7f883effd700 1 -- 172.21.15.12:0/1665739909 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8854010850 con 0x5575ab5c1d30 2023-12-11T20:30:12.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.321+0000 7f883effd700 1 -- 172.21.15.12:0/1665739909 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88540131e0 con 0x5575ab5c1d30 2023-12-11T20:30:12.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.321+0000 7f8879783b80 10 client.19551 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:12.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.321+0000 7f8879783b80 1 -- 172.21.15.12:0/1665739909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5575ab33ede0 con 0x5575ab5c1d30 2023-12-11T20:30:12.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f883effd700 1 -- 172.21.15.12:0/1665739909 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575ab5b4b40 con 0x5575ab5c1d30 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f883effd700 1 -- 172.21.15.12:0/1665739909 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f885401f430 con 0x5575ab5c1d30 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f8879783b80 10 client.19551 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f8879783b80 10 client.19551 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f8879783b80 20 client.19551 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f8879783b80 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575ab5d7040 0x5575ab5d9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f8879783b80 4 client.19551 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f8879783b80 1 -- 172.21.15.12:0/1665739909 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575ab590f40 con 0x5575ab5d7040 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.322+0000 7f885f7fe700 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575ab5d7040 0x5575ab5d9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.323+0000 7f885f7fe700 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575ab5d7040 0x5575ab5d9460 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b47f05f92cca754 server_cookie=3da9a79fa3d216cd in_seq=0 out_seq=0 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.323+0000 7f883effd700 10 client.19551 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f883effd700 1 -- 172.21.15.12:0/1665739909 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575ab590f40 con 0x5575ab5d7040 2023-12-11T20:30:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f883effd700 10 client.19551 handle_command_reply: tid=0 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 client.19551 shutdown 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 -- 172.21.15.12:0/1665739909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c1d30 msgr2=0x5575ab5cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c1d30 0x5575ab5cb750 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f88540099c0 tx=0x7f8854010660 comp rx=0 tx=0).stop 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 -- 172.21.15.12:0/1665739909 shutdown_connections 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575ab5d7040 0x5575ab5d9460 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c13d0 0x5575ab5cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 0x5575ab5d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 --2- 172.21.15.12:0/1665739909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c1d30 0x5575ab5cb750 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 -- 172.21.15.12:0/1665739909 >> 172.21.15.12:0/1665739909 conn(0x5575ab4f07e0 msgr2=0x5575ab5bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f883effd700 0 client.19551 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 -- 172.21.15.12:0/1665739909 shutdown_connections 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 1 -- 172.21.15.12:0/1665739909 wait complete. 2023-12-11T20:30:12.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.324+0000 7f8879783b80 20 client.19551 trim_cache size 0 max 16384 2023-12-11T20:30:12.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.341+0000 7f8879783b80 1 Processor -- start 2023-12-11T20:30:12.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.341+0000 7f8879783b80 1 -- start start 2023-12-11T20:30:12.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.341+0000 7f8879783b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c13d0 0x5575ab5d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.341+0000 7f8879783b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.341+0000 7f8879783b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c2c20 0x5575ab5c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.341+0000 7f8879783b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab5b8b50 con 0x5575ab5c2c20 2023-12-11T20:30:12.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.341+0000 7f8879783b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab5cbe90 con 0x5575ab5c1d30 2023-12-11T20:30:12.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.341+0000 7f8879783b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab5c8e10 con 0x5575ab5c13d0 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c2c20 0x5575ab5c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:48886/0 (socket says 172.21.15.12:48886) 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 -- 172.21.15.12:0/117243627 learned_addr learned my addr 172.21.15.12:0/117243627 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885f7fe700 1 --2- 172.21.15.12:0/117243627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c13d0 0x5575ab5d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 -- 172.21.15.12:0/117243627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c13d0 msgr2=0x5575ab5d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 --2- 172.21.15.12:0/117243627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c13d0 0x5575ab5d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 -- 172.21.15.12:0/117243627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c2c20 msgr2=0x5575ab5c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 --2- 172.21.15.12:0/117243627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c2c20 0x5575ab5c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 -- 172.21.15.12:0/117243627 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575ab327c60 con 0x5575ab5c1d30 2023-12-11T20:30:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.342+0000 7f885effd700 1 --2- 172.21.15.12:0/117243627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d2750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8854013ce0 tx=0x7f88540099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3adc76dfd4c4901 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f88467fc700 1 -- 172.21.15.12:0/117243627 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854024040 con 0x5575ab5c1d30 2023-12-11T20:30:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f88467fc700 1 -- 172.21.15.12:0/117243627 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f885402e020 con 0x5575ab5c1d30 2023-12-11T20:30:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f88467fc700 1 -- 172.21.15.12:0/117243627 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854003680 con 0x5575ab5c1d30 2023-12-11T20:30:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f8879783b80 1 -- 172.21.15.12:0/117243627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 msgr2=0x5575ab5d2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f8879783b80 1 --2- 172.21.15.12:0/117243627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d2750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8854013ce0 tx=0x7f88540099f0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f8879783b80 1 -- 172.21.15.12:0/117243627 shutdown_connections 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f8879783b80 1 --2- 172.21.15.12:0/117243627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c2c20 0x5575ab5c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f8879783b80 1 --2- 172.21.15.12:0/117243627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c13d0 0x5575ab5d2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f8879783b80 1 --2- 172.21.15.12:0/117243627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d2750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.343+0000 7f8879783b80 1 -- 172.21.15.12:0/117243627 >> 172.21.15.12:0/117243627 conn(0x5575ab4f07e0 msgr2=0x5575ab5ddd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.344+0000 7f8879783b80 1 -- 172.21.15.12:0/117243627 shutdown_connections 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.344+0000 7f8879783b80 1 -- 172.21.15.12:0/117243627 wait complete. 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.344+0000 7f8879783b80 1 -- start start 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.344+0000 7f8879783b80 1 Processor -- start 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f8879783b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f8879783b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f8879783b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 0x5575ab5d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f8879783b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab5d1620 con 0x5575ab5c13d0 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f8879783b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab5d1790 con 0x5575ab5c1d30 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f8879783b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab5d1950 con 0x5575ab5c2c20 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f8879783b80 10 client.0 _ll_register_callbacks cb 0x5575ab3faa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f885f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f885f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5cfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47746/0 (socket says 172.21.15.12:47746) 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f885f7fe700 1 -- 172.21.15.12:0/93283805 learned_addr learned my addr 172.21.15.12:0/93283805 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.345+0000 7f885effd700 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f885ffff700 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 0x5575ab5d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f885f7fe700 1 -- 172.21.15.12:0/93283805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 msgr2=0x5575ab5d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f885f7fe700 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 0x5575ab5d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f885f7fe700 1 -- 172.21.15.12:0/93283805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 msgr2=0x5575ab5d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f885f7fe700 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f885f7fe700 1 -- 172.21.15.12:0/93283805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575ab33ede0 con 0x5575ab5c13d0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f885f7fe700 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5cfb90 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f88500099c0 tx=0x7f8850009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79de234de685273 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f883effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f883effd700 1 -- 172.21.15.12:0/93283805 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850003a40 con 0x5575ab5c13d0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f883effd700 1 -- 172.21.15.12:0/93283805 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8850003ba0 con 0x5575ab5c13d0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.346+0000 7f8879783b80 1 -- 172.21.15.12:0/93283805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8854010a20 con 0x5575ab5c13d0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f883effd700 1 -- 172.21.15.12:0/93283805 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8850003d60 con 0x5575ab5c13d0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f8879783b80 10 client.19557 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f8879783b80 1 -- 172.21.15.12:0/93283805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5575ab365250 con 0x5575ab5c13d0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f883effd700 1 -- 172.21.15.12:0/93283805 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8854010a20 con 0x5575ab5c13d0 2023-12-11T20:30:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f883effd700 1 -- 172.21.15.12:0/93283805 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f885000f460 con 0x5575ab5c13d0 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f8879783b80 10 client.19557 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f8879783b80 10 client.19557 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f8879783b80 20 client.19557 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f8879783b80 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575ab62dbb0 0x5575ab62ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f8879783b80 4 client.19557 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.347+0000 7f8879783b80 1 -- 172.21.15.12:0/93283805 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5575ab4dbfd0 con 0x5575ab62dbb0 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.348+0000 7f885effd700 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575ab62dbb0 0x5575ab62ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f885effd700 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575ab62dbb0 0x5575ab62ffd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9324d544e1ca576c server_cookie=d1a64b22b287c702 in_seq=0 out_seq=0 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f883effd700 10 client.19557 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f883effd700 1 -- 172.21.15.12:0/93283805 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5575ab4dbfd0 con 0x5575ab62dbb0 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f883effd700 10 client.19557 handle_command_reply: tid=0 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 client.19557 shutdown 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 -- 172.21.15.12:0/93283805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 msgr2=0x5575ab5cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5cfb90 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f88500099c0 tx=0x7f8850009310 comp rx=0 tx=0).stop 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 -- 172.21.15.12:0/93283805 shutdown_connections 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5575ab62dbb0 0x5575ab62ffd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5575ab5c2c20 0x5575ab5d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575ab5c13d0 0x5575ab5cfb90 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 --2- 172.21.15.12:0/93283805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5575ab5c1d30 0x5575ab5d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f883effd700 0 client.19557 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 -- 172.21.15.12:0/93283805 >> 172.21.15.12:0/93283805 conn(0x5575ab4f07e0 msgr2=0x5575ab5c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 -- 172.21.15.12:0/93283805 shutdown_connections 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 1 -- 172.21.15.12:0/93283805 wait complete. 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.349+0000 7f8879783b80 20 client.19557 trim_cache size 0 max 16384 2023-12-11T20:30:12.351 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:30:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 -- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88480a1480 msgr2=0x7f88480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88480a1480 0x7f88480a3940 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8850009990 tx=0x7f8850003680 comp rx=0 tx=0).stop 2023-12-11T20:30:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 -- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8860103040 msgr2=0x7f88601a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8860103040 0x7f88601a0b50 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f8858007ee0 tx=0x7f885800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 -- 172.21.15.12:0/762152614 shutdown_connections 2023-12-11T20:30:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88480a1480 0x7f88480a3940 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88601014b0 0x7f88601995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8860103040 0x7f88601a0b50 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 --2- 172.21.15.12:0/762152614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88601026a0 0x7f8860199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 -- 172.21.15.12:0/762152614 >> 172.21.15.12:0/762152614 conn(0x7f88600fca00 msgr2=0x7f8860107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 -- 172.21.15.12:0/762152614 shutdown_connections 2023-12-11T20:30:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.350+0000 7f8865dff700 1 -- 172.21.15.12:0/762152614 wait complete. 2023-12-11T20:30:12.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:30:12.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 -- 172.21.15.12:0/432075882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89001091e0 msgr2=0x7f890010b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 --2- 172.21.15.12:0/432075882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89001091e0 0x7f890010b650 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b0a0 tx=0x7f88f800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 -- 172.21.15.12:0/432075882 shutdown_connections 2023-12-11T20:30:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 --2- 172.21.15.12:0/432075882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89000755b0 0x7f8900073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 --2- 172.21.15.12:0/432075882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89001091e0 0x7f890010b650 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 --2- 172.21.15.12:0/432075882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8900073fd0 0x7f8900074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 -- 172.21.15.12:0/432075882 >> 172.21.15.12:0/432075882 conn(0x7f89000fc860 msgr2=0x7f89000fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 -- 172.21.15.12:0/432075882 shutdown_connections 2023-12-11T20:30:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.602+0000 7f890559d700 1 -- 172.21.15.12:0/432075882 wait complete. 2023-12-11T20:30:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.603+0000 7f890559d700 1 Processor -- start 2023-12-11T20:30:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.603+0000 7f890559d700 1 -- start start 2023-12-11T20:30:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f890559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8900073fd0 0x7f89001992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f890559d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89000755b0 0x7f8900199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f890559d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89001091e0 0x7f89001a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f890559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89001a0e20 con 0x7f8900073fd0 2023-12-11T20:30:12.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f890559d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89001a0f60 con 0x7f89001091e0 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f890559d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89001a10f0 con 0x7f89000755b0 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8900073fd0 0x7f89001992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88ff7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89000755b0 0x7f8900199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8900073fd0 0x7f89001992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47766/0 (socket says 172.21.15.12:47766) 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88fffff700 1 -- 172.21.15.12:0/447630016 learned_addr learned my addr 172.21.15.12:0/447630016 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f8904d9c700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89001091e0 0x7f89001a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88ff7fe700 1 -- 172.21.15.12:0/447630016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89001091e0 msgr2=0x7f89001a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89001091e0 0x7f89001a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88ff7fe700 1 -- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8900073fd0 msgr2=0x7f89001992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8900073fd0 0x7f89001992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.604+0000 7f88ff7fe700 1 -- 172.21.15.12:0/447630016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f8009d00 con 0x7f89000755b0 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.605+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89000755b0 0x7f8900199830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9f0 tx=0x7f88f400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.605+0000 7f88fd7fa700 1 -- 172.21.15.12:0/447630016 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400c9c0 con 0x7f89000755b0 2023-12-11T20:30:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.605+0000 7f88fd7fa700 1 -- 172.21.15.12:0/447630016 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88f4010430 con 0x7f89000755b0 2023-12-11T20:30:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.605+0000 7f890559d700 1 -- 172.21.15.12:0/447630016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89001a13d0 con 0x7f89000755b0 2023-12-11T20:30:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.605+0000 7f88fd7fa700 1 -- 172.21.15.12:0/447630016 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4018680 con 0x7f89000755b0 2023-12-11T20:30:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.605+0000 7f890559d700 1 -- 172.21.15.12:0/447630016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89001a18e0 con 0x7f89000755b0 2023-12-11T20:30:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.609+0000 7f88fd7fa700 1 -- 172.21.15.12:0/447630016 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f88f40105a0 con 0x7f89000755b0 2023-12-11T20:30:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.610+0000 7f891a0f7b80 1 Processor -- start 2023-12-11T20:30:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f891a0f7b80 1 -- start start 2023-12-11T20:30:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f88fd7fa700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88e80a1520 0x7f88e80a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f88fd7fa700 1 -- 172.21.15.12:0/447630016 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f88f4014070 con 0x7f89000755b0 2023-12-11T20:30:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b130db50 con 0x5648b13b3de0 2023-12-11T20:30:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b130b470 con 0x5648b13b2a60 2023-12-11T20:30:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b1306d60 con 0x5648b13b33c0 2023-12-11T20:30:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f8904d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f8904d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47768/0 (socket says 172.21.15.12:47768) 2023-12-11T20:30:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f88ff7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f88fffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.611+0000 7f8904d9c700 1 -- 172.21.15.12:0/3596081484 learned_addr learned my addr 172.21.15.12:0/3596081484 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f8904d9c700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88e80a1520 0x7f88e80a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f88fffff700 1 -- 172.21.15.12:0/3596081484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 msgr2=0x5648b13b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f88fffff700 1 --2- 172.21.15.12:0/3596081484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f88fffff700 1 -- 172.21.15.12:0/3596081484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 msgr2=0x5648b13b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f88fffff700 1 --2- 172.21.15.12:0/3596081484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f88fffff700 1 -- 172.21.15.12:0/3596081484 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648b1183630 con 0x5648b13b2a60 2023-12-11T20:30:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f88fffff700 1 --2- 172.21.15.12:0/3596081484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b2e80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009d10 tx=0x7f88f0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dda33d8e99cc0a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f8904d9c700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88e80a1520 0x7f88e80a39e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f88f8007920 tx=0x7f88f800b700 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.612+0000 7f88e67fc700 1 -- 172.21.15.12:0/3596081484 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0004250 con 0x5648b13b2a60 2023-12-11T20:30:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f88e67fc700 1 -- 172.21.15.12:0/3596081484 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88f0004cc0 con 0x5648b13b2a60 2023-12-11T20:30:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f88e67fc700 1 -- 172.21.15.12:0/3596081484 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0005410 con 0x5648b13b2a60 2023-12-11T20:30:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f891a0f7b80 1 -- 172.21.15.12:0/3596081484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 msgr2=0x5648b13b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/3596081484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b2e80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009d10 tx=0x7f88f0011720 comp rx=0 tx=0).stop 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f891a0f7b80 1 -- 172.21.15.12:0/3596081484 shutdown_connections 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/3596081484 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b2e80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/3596081484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/3596081484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f891a0f7b80 1 -- 172.21.15.12:0/3596081484 >> 172.21.15.12:0/3596081484 conn(0x5648b12e17e0 msgr2=0x5648b13ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.613+0000 7f891a0f7b80 1 -- 172.21.15.12:0/3596081484 shutdown_connections 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.614+0000 7f891a0f7b80 1 -- 172.21.15.12:0/3596081484 wait complete. 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.614+0000 7f891a0f7b80 1 -- start start 2023-12-11T20:30:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.614+0000 7f891a0f7b80 1 Processor -- start 2023-12-11T20:30:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b2a60 0x5648b13bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b33c0 0x5648b13bc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b3de0 0x5648b13c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b12c0560 con 0x5648b13b33c0 2023-12-11T20:30:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b12c0200 con 0x5648b13b3de0 2023-12-11T20:30:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b1185920 con 0x5648b13b2a60 2023-12-11T20:30:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f891a0f7b80 10 client.0 _ll_register_callbacks cb 0x5648b11eba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f88ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b33c0 0x5648b13bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f88ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b33c0 0x5648b13bc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47780/0 (socket says 172.21.15.12:47780) 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f88ff7fe700 1 -- 172.21.15.12:0/146406782 learned_addr learned my addr 172.21.15.12:0/146406782 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f88fffff700 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b2a60 0x5648b13bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.615+0000 7f8904d9c700 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b3de0 0x5648b13c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88ff7fe700 1 -- 172.21.15.12:0/146406782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b2a60 msgr2=0x5648b13bc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b2a60 0x5648b13bc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88ff7fe700 1 -- 172.21.15.12:0/146406782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b3de0 msgr2=0x5648b13c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b3de0 0x5648b13c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88ff7fe700 1 -- 172.21.15.12:0/146406782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f0009970 con 0x5648b13b33c0 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b33c0 0x5648b13bc870 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f88f4000c00 tx=0x7f88f409a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70476a6d004dc42 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88df7fe700 1 -- 172.21.15.12:0/146406782 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40b1070 con 0x5648b13b33c0 2023-12-11T20:30:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f88df7fe700 1 -- 172.21.15.12:0/146406782 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f88f409a870 con 0x5648b13b33c0 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.616+0000 7f891a0f7b80 1 -- 172.21.15.12:0/146406782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648b13a59e0 con 0x5648b13b33c0 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f88df7fe700 1 -- 172.21.15.12:0/146406782 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88f409e0d0 con 0x5648b13b33c0 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f891a0f7b80 10 client.19569 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f891a0f7b80 1 -- 172.21.15.12:0/146406782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5648b112fde0 con 0x5648b13b33c0 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f88df7fe700 1 -- 172.21.15.12:0/146406782 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88f4063080 con 0x5648b13b33c0 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f88df7fe700 1 -- 172.21.15.12:0/146406782 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f88f40b8170 con 0x5648b13b33c0 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f891a0f7b80 10 client.19569 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f891a0f7b80 10 client.19569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f891a0f7b80 20 client.19569 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5648b13c8100 0x5648b13ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f891a0f7b80 4 client.19569 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.617+0000 7f891a0f7b80 1 -- 172.21.15.12:0/146406782 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648b1381f40 con 0x5648b13c8100 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.618+0000 7f88fffff700 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5648b13c8100 0x5648b13ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.618+0000 7f88fffff700 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5648b13c8100 0x5648b13ca520 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=953ed7104c3a00e7 server_cookie=26353cf9c997f71c in_seq=0 out_seq=0 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.618+0000 7f88df7fe700 10 client.19569 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f88df7fe700 1 -- 172.21.15.12:0/146406782 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5648b1381f40 con 0x5648b13c8100 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f88df7fe700 10 client.19569 handle_command_reply: tid=0 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 client.19569 shutdown 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 -- 172.21.15.12:0/146406782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b33c0 msgr2=0x5648b13bc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b33c0 0x5648b13bc870 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f88f4000c00 tx=0x7f88f409a6b0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 -- 172.21.15.12:0/146406782 shutdown_connections 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5648b13c8100 0x5648b13ca520 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b3de0 0x5648b13c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b2a60 0x5648b13bc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/146406782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b33c0 0x5648b13bc870 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f88df7fe700 0 client.19569 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.619+0000 7f891a0f7b80 1 -- 172.21.15.12:0/146406782 >> 172.21.15.12:0/146406782 conn(0x5648b12e17e0 msgr2=0x5648b13b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.620+0000 7f891a0f7b80 1 -- 172.21.15.12:0/146406782 shutdown_connections 2023-12-11T20:30:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.620+0000 7f891a0f7b80 1 -- 172.21.15.12:0/146406782 wait complete. 2023-12-11T20:30:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.620+0000 7f891a0f7b80 20 client.19569 trim_cache size 0 max 16384 2023-12-11T20:30:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f891a0f7b80 1 Processor -- start 2023-12-11T20:30:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f891a0f7b80 1 -- start start 2023-12-11T20:30:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13c3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13bb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b13cf730 con 0x5648b13b3de0 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b13adcd0 con 0x5648b13b2a60 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b13a9b30 con 0x5648b13b33c0 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f8904d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f8904d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13bb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47790/0 (socket says 172.21.15.12:47790) 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f8904d9c700 1 -- 172.21.15.12:0/2519937515 learned_addr learned my addr 172.21.15.12:0/2519937515 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.638+0000 7f88fffff700 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f8904d9c700 1 -- 172.21.15.12:0/2519937515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 msgr2=0x5648b13c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f8904d9c700 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f8904d9c700 1 -- 172.21.15.12:0/2519937515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 msgr2=0x5648b13b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f8904d9c700 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f8904d9c700 1 -- 172.21.15.12:0/2519937515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648b1118c60 con 0x5648b13b3de0 2023-12-11T20:30:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f88fffff700 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f8904d9c700 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13bb070 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009cd0 tx=0x7f88f8006020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380aa139a394058d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.639+0000 7f88e6ffd700 1 -- 172.21.15.12:0/2519937515 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f800e040 con 0x5648b13b3de0 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f88e6ffd700 1 -- 172.21.15.12:0/2519937515 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88f8027070 con 0x5648b13b3de0 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f88e6ffd700 1 -- 172.21.15.12:0/2519937515 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f802dc60 con 0x5648b13b3de0 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f891a0f7b80 1 -- 172.21.15.12:0/2519937515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 msgr2=0x5648b13bb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13bb070 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009cd0 tx=0x7f88f8006020 comp rx=0 tx=0).stop 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f891a0f7b80 1 -- 172.21.15.12:0/2519937515 shutdown_connections 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13bb070 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/2519937515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f891a0f7b80 1 -- 172.21.15.12:0/2519937515 >> 172.21.15.12:0/2519937515 conn(0x5648b12e17e0 msgr2=0x5648b13ad3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.640+0000 7f891a0f7b80 1 -- 172.21.15.12:0/2519937515 shutdown_connections 2023-12-11T20:30:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.641+0000 7f891a0f7b80 1 -- 172.21.15.12:0/2519937515 wait complete. 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.641+0000 7f891a0f7b80 1 -- start start 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.641+0000 7f891a0f7b80 1 Processor -- start 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f891a0f7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b13c2160 con 0x5648b13b3de0 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b13c22d0 con 0x5648b13b2a60 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f891a0f7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b13c2490 con 0x5648b13b33c0 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f891a0f7b80 10 client.0 _ll_register_callbacks cb 0x5648b11eba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f8904d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88fffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88fffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13c31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:48954/0 (socket says 172.21.15.12:48954) 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f8904d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13c1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47802/0 (socket says 172.21.15.12:47802) 2023-12-11T20:30:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88fffff700 1 -- 172.21.15.12:0/905627647 learned_addr learned my addr 172.21.15.12:0/905627647 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88fffff700 1 -- 172.21.15.12:0/905627647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 msgr2=0x5648b13c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88fffff700 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88fffff700 1 -- 172.21.15.12:0/905627647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 msgr2=0x5648b13c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88fffff700 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13c1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.642+0000 7f88fffff700 1 -- 172.21.15.12:0/905627647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f001d040 con 0x5648b13b2a60 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.643+0000 7f8904d9c700 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.643+0000 7f88fffff700 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13c31a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f88f0000c00 tx=0x7f88f00097b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc5964e6b0b6646 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.643+0000 7f88df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.643+0000 7f88df7fe700 1 -- 172.21.15.12:0/905627647 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f002b040 con 0x5648b13b2a60 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.643+0000 7f891a0f7b80 1 -- 172.21.15.12:0/905627647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88f0004cc0 con 0x5648b13b2a60 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.643+0000 7f88df7fe700 1 -- 172.21.15.12:0/905627647 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f88f0004230 con 0x5648b13b2a60 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f88df7fe700 1 -- 172.21.15.12:0/905627647 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88f0004540 con 0x5648b13b2a60 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f891a0f7b80 10 client.29129 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f891a0f7b80 1 -- 172.21.15.12:0/905627647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f890010c270 con 0x5648b13b2a60 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f88df7fe700 1 -- 172.21.15.12:0/905627647 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88f0004cc0 con 0x5648b13b2a60 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f88df7fe700 1 -- 172.21.15.12:0/905627647 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f88f0003c80 con 0x5648b13b2a60 2023-12-11T20:30:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f891a0f7b80 10 client.29129 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f891a0f7b80 10 client.29129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f891a0f7b80 20 client.29129 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5648b141f920 0x5648b1421d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f891a0f7b80 4 client.29129 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.644+0000 7f891a0f7b80 1 -- 172.21.15.12:0/905627647 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5648b12ccfd0 con 0x5648b141f920 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.645+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5648b141f920 0x5648b1421d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.645+0000 7f88ff7fe700 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5648b141f920 0x5648b1421d40 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe23634a120da9db server_cookie=cc093fc1b64fd436 in_seq=0 out_seq=0 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.645+0000 7f88df7fe700 10 client.29129 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.645+0000 7f88df7fe700 1 -- 172.21.15.12:0/905627647 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5648b12ccfd0 con 0x5648b141f920 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.645+0000 7f88df7fe700 10 client.29129 handle_command_reply: tid=0 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.645+0000 7f891a0f7b80 1 client.29129 shutdown 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 -- 172.21.15.12:0/905627647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 msgr2=0x5648b13c31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13c31a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f88f0000c00 tx=0x7f88f00097b0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 -- 172.21.15.12:0/905627647 shutdown_connections 2023-12-11T20:30:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5648b141f920 0x5648b1421d40 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5648b13b2a60 0x5648b13c31a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648b13b3de0 0x5648b13c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f88df7fe700 0 client.29129 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 --2- 172.21.15.12:0/905627647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5648b13b33c0 0x5648b13c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 -- 172.21.15.12:0/905627647 >> 172.21.15.12:0/905627647 conn(0x5648b12e17e0 msgr2=0x5648b13ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 -- 172.21.15.12:0/905627647 shutdown_connections 2023-12-11T20:30:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 1 -- 172.21.15.12:0/905627647 wait complete. 2023-12-11T20:30:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.646+0000 7f891a0f7b80 20 client.29129 trim_cache size 0 max 16384 2023-12-11T20:30:12.651 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:30:12.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 -- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88e80a1520 msgr2=0x7f88e80a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88e80a1520 0x7f88e80a39e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f88f8007920 tx=0x7f88f800b700 comp rx=0 tx=0).stop 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 -- 172.21.15.12:0/447630016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89000755b0 msgr2=0x7f8900199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89000755b0 0x7f8900199830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9f0 tx=0x7f88f400ed00 comp rx=0 tx=0).stop 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 -- 172.21.15.12:0/447630016 shutdown_connections 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f88e80a1520 0x7f88e80a39e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89001091e0 0x7f89001a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8900073fd0 0x7f89001992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 --2- 172.21.15.12:0/447630016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89000755b0 0x7f8900199830 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 -- 172.21.15.12:0/447630016 >> 172.21.15.12:0/447630016 conn(0x7f89000fc860 msgr2=0x7f8900105130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 -- 172.21.15.12:0/447630016 shutdown_connections 2023-12-11T20:30:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:12.647+0000 7f890559d700 1 -- 172.21.15.12:0/447630016 wait complete. 2023-12-11T20:30:12.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:12 smithi032 ceph-mon[132488]: pgmap v803: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:30:12.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:12 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2779457550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:30:13.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:12 smithi039 ceph-mon[102205]: pgmap v803: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:30:13.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:12 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2779457550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:30:13.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:12 smithi012 ceph-mon[128787]: pgmap v803: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:30:13.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:12 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2779457550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:30:13.667 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:30:13.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:30:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.914+0000 7f79715ff700 1 -- 172.21.15.12:0/3571626026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 msgr2=0x7f796c103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.915+0000 7f79715ff700 1 --2- 172.21.15.12:0/3571626026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 0x7f796c103af0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f795c0099c0 tx=0x7f795c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.915+0000 7f79715ff700 1 -- 172.21.15.12:0/3571626026 shutdown_connections 2023-12-11T20:30:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.915+0000 7f79715ff700 1 --2- 172.21.15.12:0/3571626026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 0x7f796c103af0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.915+0000 7f79715ff700 1 --2- 172.21.15.12:0/3571626026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f796c105260 0x7f796c10bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.915+0000 7f79715ff700 1 --2- 172.21.15.12:0/3571626026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f796c1048c0 0x7f796c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.915+0000 7f79715ff700 1 -- 172.21.15.12:0/3571626026 >> 172.21.15.12:0/3571626026 conn(0x7f796c0fec80 msgr2=0x7f796c1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.915+0000 7f79715ff700 1 -- 172.21.15.12:0/3571626026 shutdown_connections 2023-12-11T20:30:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.915+0000 7f79715ff700 1 -- 172.21.15.12:0/3571626026 wait complete. 2023-12-11T20:30:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.916+0000 7f79715ff700 1 Processor -- start 2023-12-11T20:30:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.916+0000 7f79715ff700 1 -- start start 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f79715ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 0x7f796c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f79715ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f796c1048c0 0x7f796c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f79715ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f796c105260 0x7f796c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f79715ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a10c0 con 0x7f796c1048c0 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f79715ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a1200 con 0x7f796c1036d0 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f79715ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a1390 con 0x7f796c105260 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f796c1048c0 0x7f796c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f796c1048c0 0x7f796c199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47830/0 (socket says 172.21.15.12:47830) 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796a7fc700 1 -- 172.21.15.12:0/3869371030 learned_addr learned my addr 172.21.15.12:0/3869371030 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796affd700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 0x7f796c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796a7fc700 1 -- 172.21.15.12:0/3869371030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f796c105260 msgr2=0x7f796c1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f796c105260 0x7f796c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796a7fc700 1 -- 172.21.15.12:0/3869371030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 msgr2=0x7f796c199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 0x7f796c199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796a7fc700 1 -- 172.21.15.12:0/3869371030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009c40 con 0x7f796c1048c0 2023-12-11T20:30:13.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.917+0000 7f796affd700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 0x7f796c199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:13.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.918+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f796c1048c0 0x7f796c199ad0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f796000e9c0 tx=0x7f796000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:13.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.918+0000 7f7953fff700 1 -- 172.21.15.12:0/3869371030 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600097b0 con 0x7f796c1048c0 2023-12-11T20:30:13.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.918+0000 7f79715ff700 1 -- 172.21.15.12:0/3869371030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c0095f0 con 0x7f796c1048c0 2023-12-11T20:30:13.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.918+0000 7f7953fff700 1 -- 172.21.15.12:0/3869371030 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7960004830 con 0x7f796c1048c0 2023-12-11T20:30:13.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.918+0000 7f7953fff700 1 -- 172.21.15.12:0/3869371030 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960005520 con 0x7f796c1048c0 2023-12-11T20:30:13.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.918+0000 7f79715ff700 1 -- 172.21.15.12:0/3869371030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1a19f0 con 0x7f796c1048c0 2023-12-11T20:30:13.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.922+0000 7f7953fff700 1 -- 172.21.15.12:0/3869371030 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f79600049a0 con 0x7f796c1048c0 2023-12-11T20:30:13.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.923+0000 7f7984ee0b80 1 Processor -- start 2023-12-11T20:30:13.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7984ee0b80 1 -- start start 2023-12-11T20:30:13.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7953fff700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79540a1500 0x7f79540a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7953fff700 1 -- 172.21.15.12:0/3869371030 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7960014070 con 0x7f796c1048c0 2023-12-11T20:30:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 0x5653938ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 0x5653938cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x565393825bd0 con 0x5653938cadb0 2023-12-11T20:30:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653938234f0 con 0x5653938ca450 2023-12-11T20:30:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539381ede0 con 0x5653938cbca0 2023-12-11T20:30:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f796b7fe700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79540a1500 0x7f79540a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.924+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47834/0 (socket says 172.21.15.12:47834) 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796a7fc700 1 -- 172.21.15.12:0/1126919962 learned_addr learned my addr 172.21.15.12:0/1126919962 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796affd700 1 --2- 172.21.15.12:0/1126919962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 0x5653938ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796a7fc700 1 -- 172.21.15.12:0/1126919962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 msgr2=0x5653938cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796a7fc700 1 --2- 172.21.15.12:0/1126919962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 0x5653938cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796a7fc700 1 -- 172.21.15.12:0/1126919962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 msgr2=0x5653938ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796a7fc700 1 --2- 172.21.15.12:0/1126919962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 0x5653938ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796a7fc700 1 -- 172.21.15.12:0/1126919962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56539369b6b0 con 0x5653938cadb0 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796a7fc700 1 --2- 172.21.15.12:0/1126919962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938cb6c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f796009a310 tx=0x7f7960004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be0f7a5adc3f36c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f796b7fe700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79540a1500 0x7f79540a39c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f796400c4b0 tx=0x7f796400c870 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.925+0000 7f79517fa700 1 -- 172.21.15.12:0/1126919962 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796009e4d0 con 0x5653938cadb0 2023-12-11T20:30:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f79517fa700 1 -- 172.21.15.12:0/1126919962 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79600a2710 con 0x5653938cadb0 2023-12-11T20:30:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f79517fa700 1 -- 172.21.15.12:0/1126919962 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796009a5e0 con 0x5653938cadb0 2023-12-11T20:30:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f7984ee0b80 1 -- 172.21.15.12:0/1126919962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 msgr2=0x5653938cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/1126919962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938cb6c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f796009a310 tx=0x7f7960004c80 comp rx=0 tx=0).stop 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f7984ee0b80 1 -- 172.21.15.12:0/1126919962 shutdown_connections 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/1126919962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 0x5653938ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/1126919962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 0x5653938cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/1126919962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938cb6c0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.926+0000 7f7984ee0b80 1 -- 172.21.15.12:0/1126919962 >> 172.21.15.12:0/1126919962 conn(0x5653937f9860 msgr2=0x5653938c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.927+0000 7f7984ee0b80 1 -- 172.21.15.12:0/1126919962 shutdown_connections 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.927+0000 7f7984ee0b80 1 -- 172.21.15.12:0/1126919962 wait complete. 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.927+0000 7f7984ee0b80 1 -- start start 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.927+0000 7f7984ee0b80 1 Processor -- start 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938ca450 0x5653938dcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cadb0 0x5653938dd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cbca0 0x5653938e4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653937d85e0 con 0x5653938cbca0 2023-12-11T20:30:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653937d8280 con 0x5653938cadb0 2023-12-11T20:30:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539369d9a0 con 0x5653938ca450 2023-12-11T20:30:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f7984ee0b80 10 client.0 _ll_register_callbacks cb 0x565393703b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cadb0 0x5653938dd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f796b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cbca0 0x5653938e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f796affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938ca450 0x5653938dcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cadb0 0x5653938dd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:48990/0 (socket says 172.21.15.12:48990) 2023-12-11T20:30:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.928+0000 7f796a7fc700 1 -- 172.21.15.12:0/3047217834 learned_addr learned my addr 172.21.15.12:0/3047217834 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f796a7fc700 1 -- 172.21.15.12:0/3047217834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938ca450 msgr2=0x5653938dcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938ca450 0x5653938dcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f796a7fc700 1 -- 172.21.15.12:0/3047217834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cbca0 msgr2=0x5653938e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cbca0 0x5653938e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f796a7fc700 1 -- 172.21.15.12:0/3047217834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1a19f0 con 0x5653938cadb0 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f796b7fe700 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cbca0 0x5653938e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cadb0 0x5653938dd030 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f796009a2c0 tx=0x7f7960004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b75c42b436d06ef3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f794eff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f794eff5700 1 -- 172.21.15.12:0/3047217834 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796009e220 con 0x5653938cadb0 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3047217834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653938bdbc0 con 0x5653938cadb0 2023-12-11T20:30:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.929+0000 7f794eff5700 1 -- 172.21.15.12:0/3047217834 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f79600b2e40 con 0x5653938cadb0 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f794eff5700 1 -- 172.21.15.12:0/3047217834 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f796009a5e0 con 0x5653938cadb0 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f7984ee0b80 10 client.29141 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3047217834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x565393647e60 con 0x5653938cadb0 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f794eff5700 1 -- 172.21.15.12:0/3047217834 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653938bdbc0 con 0x5653938cadb0 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f794eff5700 1 -- 172.21.15.12:0/3047217834 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7960096170 con 0x5653938cadb0 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f7984ee0b80 10 client.29141 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f7984ee0b80 10 client.29141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f7984ee0b80 20 client.29141 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5653938e83a0 0x5653938ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f7984ee0b80 4 client.29141 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.930+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3047217834 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565393899fc0 con 0x5653938e83a0 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.931+0000 7f796affd700 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5653938e83a0 0x5653938ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.931+0000 7f796affd700 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5653938e83a0 0x5653938ea7c0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9198a0b73427a server_cookie=54fbf23b7dc9d578 in_seq=0 out_seq=0 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.931+0000 7f794eff5700 10 client.29141 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f794eff5700 1 -- 172.21.15.12:0/3047217834 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565393899fc0 con 0x5653938e83a0 2023-12-11T20:30:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f794eff5700 10 client.29141 handle_command_reply: tid=0 2023-12-11T20:30:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 client.29141 shutdown 2023-12-11T20:30:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3047217834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cadb0 msgr2=0x5653938dd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cadb0 0x5653938dd030 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f796009a2c0 tx=0x7f7960004750 comp rx=0 tx=0).stop 2023-12-11T20:30:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3047217834 shutdown_connections 2023-12-11T20:30:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5653938e83a0 0x5653938ea7c0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cbca0 0x5653938e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938ca450 0x5653938dcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f794eff5700 0 client.29141 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3047217834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cadb0 0x5653938dd030 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.932+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3047217834 >> 172.21.15.12:0/3047217834 conn(0x5653937f9860 msgr2=0x5653938c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.933+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3047217834 shutdown_connections 2023-12-11T20:30:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.933+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3047217834 wait complete. 2023-12-11T20:30:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.933+0000 7f7984ee0b80 20 client.29141 trim_cache size 0 max 16384 2023-12-11T20:30:13.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.955+0000 7f7984ee0b80 1 Processor -- start 2023-12-11T20:30:13.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.955+0000 7f7984ee0b80 1 -- start start 2023-12-11T20:30:13.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 0x5653938c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938e4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 0x5653938c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x565393899fc0 con 0x5653938cadb0 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653938bdbc0 con 0x5653938ca450 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653938c1810 con 0x5653938cbca0 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938e4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938e4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47852/0 (socket says 172.21.15.12:47852) 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796a7fc700 1 -- 172.21.15.12:0/3751247282 learned_addr learned my addr 172.21.15.12:0/3751247282 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796affd700 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 0x5653938c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796b7fe700 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 0x5653938c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796a7fc700 1 -- 172.21.15.12:0/3751247282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 msgr2=0x5653938c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 0x5653938c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796a7fc700 1 -- 172.21.15.12:0/3751247282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 msgr2=0x5653938c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 0x5653938c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.956+0000 7f796a7fc700 1 -- 172.21.15.12:0/3751247282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565393630ce0 con 0x5653938cadb0 2023-12-11T20:30:13.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.957+0000 7f796a7fc700 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938e4030 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f79600058b0 tx=0x7f7960004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126745c32a8d47e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.957+0000 7f7951ffb700 1 -- 172.21.15.12:0/3751247282 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796009e4d0 con 0x5653938cadb0 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.957+0000 7f7951ffb700 1 -- 172.21.15.12:0/3751247282 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79600987a0 con 0x5653938cadb0 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.957+0000 7f7951ffb700 1 -- 172.21.15.12:0/3751247282 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796009e2c0 con 0x5653938cadb0 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3751247282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 msgr2=0x5653938e4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938e4030 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f79600058b0 tx=0x7f7960004c80 comp rx=0 tx=0).stop 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3751247282 shutdown_connections 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938ca450 0x5653938c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cbca0 0x5653938c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/3751247282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938cadb0 0x5653938e4030 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3751247282 >> 172.21.15.12:0/3751247282 conn(0x5653937f9860 msgr2=0x5653938cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3751247282 shutdown_connections 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 -- 172.21.15.12:0/3751247282 wait complete. 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.958+0000 7f7984ee0b80 1 -- start start 2023-12-11T20:30:13.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f7984ee0b80 1 Processor -- start 2023-12-11T20:30:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938ca450 0x5653938e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cadb0 0x5653938e3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f7984ee0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cbca0 0x5653938e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539393e890 con 0x5653938ca450 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539393ea00 con 0x5653938cbca0 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f7984ee0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539393ebc0 con 0x5653938cadb0 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f7984ee0b80 10 client.0 _ll_register_callbacks cb 0x565393703b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f796affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938ca450 0x5653938e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f796affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938ca450 0x5653938e2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47860/0 (socket says 172.21.15.12:47860) 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.959+0000 7f796affd700 1 -- 172.21.15.12:0/127061274 learned_addr learned my addr 172.21.15.12:0/127061274 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796a7fc700 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cadb0 0x5653938e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796b7fe700 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cbca0 0x5653938e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796affd700 1 -- 172.21.15.12:0/127061274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cadb0 msgr2=0x5653938e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796affd700 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cadb0 0x5653938e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796affd700 1 -- 172.21.15.12:0/127061274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cbca0 msgr2=0x5653938e35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796affd700 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cbca0 0x5653938e35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796affd700 1 -- 172.21.15.12:0/127061274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565393647e60 con 0x5653938ca450 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796a7fc700 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cadb0 0x5653938e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f796affd700 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938ca450 0x5653938e2b40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f795c009990 tx=0x7f795c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e651cb21ee9adc37 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.960+0000 7f794eff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f794eff5700 1 -- 172.21.15.12:0/127061274 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c01d040 con 0x5653938ca450 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 1 -- 172.21.15.12:0/127061274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79600a2710 con 0x5653938ca450 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f794eff5700 1 -- 172.21.15.12:0/127061274 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f795c028e40 con 0x5653938ca450 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f794eff5700 1 -- 172.21.15.12:0/127061274 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f795c0054c0 con 0x5653938ca450 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 10 client.19593 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 1 -- 172.21.15.12:0/127061274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56539366e2d0 con 0x5653938ca450 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f794eff5700 1 -- 172.21.15.12:0/127061274 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79600a2710 con 0x5653938ca450 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f794eff5700 1 -- 172.21.15.12:0/127061274 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f795c0280c0 con 0x5653938ca450 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 10 client.19593 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 10 client.19593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:13.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 20 client.19593 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x565393940570 0x565393942990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 4 client.19593 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:30:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.961+0000 7f7984ee0b80 1 -- 172.21.15.12:0/127061274 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5653937e5050 con 0x565393940570 2023-12-11T20:30:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.962+0000 7f796a7fc700 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x565393940570 0x565393942990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.962+0000 7f796a7fc700 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x565393940570 0x565393942990 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54ae88adca65e9d server_cookie=a32754b049b73f6b in_seq=0 out_seq=0 2023-12-11T20:30:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.962+0000 7f794eff5700 10 client.19593 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f794eff5700 1 -- 172.21.15.12:0/127061274 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5653937e5050 con 0x565393940570 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f794eff5700 10 client.19593 handle_command_reply: tid=0 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 client.19593 shutdown 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 -- 172.21.15.12:0/127061274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938ca450 msgr2=0x5653938e2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938ca450 0x5653938e2b40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f795c009990 tx=0x7f795c00bbb0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 -- 172.21.15.12:0/127061274 shutdown_connections 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x565393940570 0x565393942990 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5653938cbca0 0x5653938e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653938ca450 0x5653938e2b40 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 --2- 172.21.15.12:0/127061274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5653938cadb0 0x5653938e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f794eff5700 0 client.19593 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.964+0000 7f7984ee0b80 1 -- 172.21.15.12:0/127061274 >> 172.21.15.12:0/127061274 conn(0x5653937f9860 msgr2=0x5653938bf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.965+0000 7f7984ee0b80 1 -- 172.21.15.12:0/127061274 shutdown_connections 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.965+0000 7f7984ee0b80 1 -- 172.21.15.12:0/127061274 wait complete. 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.965+0000 7f7984ee0b80 20 client.19593 trim_cache size 0 max 16384 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "65964235-4075-4cea-87c9-3a93f755dfcc", 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:30:13.966 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:30:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.965+0000 7f79715ff700 1 -- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79540a1500 msgr2=0x7f79540a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.965+0000 7f79715ff700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79540a1500 0x7f79540a39c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f796400c4b0 tx=0x7f796400c870 comp rx=0 tx=0).stop 2023-12-11T20:30:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.965+0000 7f79715ff700 1 -- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f796c1048c0 msgr2=0x7f796c199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.965+0000 7f79715ff700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f796c1048c0 0x7f796c199ad0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f796000e9c0 tx=0x7f796000ed80 comp rx=0 tx=0).stop 2023-12-11T20:30:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.966+0000 7f79715ff700 1 -- 172.21.15.12:0/3869371030 shutdown_connections 2023-12-11T20:30:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.966+0000 7f79715ff700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f79540a1500 0x7f79540a39c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.966+0000 7f79715ff700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f796c1036d0 0x7f796c199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.966+0000 7f79715ff700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f796c105260 0x7f796c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.966+0000 7f79715ff700 1 --2- 172.21.15.12:0/3869371030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f796c1048c0 0x7f796c199ad0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.966+0000 7f79715ff700 1 -- 172.21.15.12:0/3869371030 >> 172.21.15.12:0/3869371030 conn(0x7f796c0fec80 msgr2=0x7f796c107d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.966+0000 7f79715ff700 1 -- 172.21.15.12:0/3869371030 shutdown_connections 2023-12-11T20:30:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:13.966+0000 7f79715ff700 1 -- 172.21.15.12:0/3869371030 wait complete. 2023-12-11T20:30:13.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:30:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 -- 172.21.15.12:0/82695026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a81048e0 msgr2=0x7f12a8104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/82695026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a81048e0 0x7f12a8104d40 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f129c0099c0 tx=0x7f129c009cd0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 -- 172.21.15.12:0/82695026 shutdown_connections 2023-12-11T20:30:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/82695026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a8105280 0x7f12a810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/82695026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12a81036f0 0x7f12a8103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/82695026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a81048e0 0x7f12a8104d40 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 -- 172.21.15.12:0/82695026 >> 172.21.15.12:0/82695026 conn(0x7f12a80fec80 msgr2=0x7f12a81010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:14.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 -- 172.21.15.12:0/82695026 shutdown_connections 2023-12-11T20:30:14.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.226+0000 7f12ae7ff700 1 -- 172.21.15.12:0/82695026 wait complete. 2023-12-11T20:30:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.227+0000 7f12ae7ff700 1 Processor -- start 2023-12-11T20:30:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.227+0000 7f12ae7ff700 1 -- start start 2023-12-11T20:30:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12ae7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a81036f0 0x7f12a81994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12ae7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12a81048e0 0x7f12a8199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12ae7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a8105280 0x7f12a81a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12ae7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a81a1010 con 0x7f12a8105280 2023-12-11T20:30:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12ae7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a81a1150 con 0x7f12a81036f0 2023-12-11T20:30:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12ae7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a81a12e0 con 0x7f12a81048e0 2023-12-11T20:30:14.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12acd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a8105280 0x7f12a81a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12a81048e0 0x7f12a8199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a81036f0 0x7f12a81994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12a81048e0 0x7f12a8199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55892/0 (socket says 172.21.15.12:55892) 2023-12-11T20:30:14.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.228+0000 7f12a77fe700 1 -- 172.21.15.12:0/1621011647 learned_addr learned my addr 172.21.15.12:0/1621011647 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a77fe700 1 -- 172.21.15.12:0/1621011647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a81036f0 msgr2=0x7f12a81994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a81036f0 0x7f12a81994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a77fe700 1 -- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a8105280 msgr2=0x7f12a81a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a8105280 0x7f12a81a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a77fe700 1 -- 172.21.15.12:0/1621011647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0095f0 con 0x7f12a81048e0 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a81036f0 0x7f12a81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12acd9c700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a8105280 0x7f12a81a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12a81048e0 0x7f12a8199a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f129c00bf10 tx=0x7f129c00fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a57fa700 1 -- 172.21.15.12:0/1621011647 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c01d070 con 0x7f12a81048e0 2023-12-11T20:30:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12ae7ff700 1 -- 172.21.15.12:0/1621011647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a81a1560 con 0x7f12a81048e0 2023-12-11T20:30:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a57fa700 1 -- 172.21.15.12:0/1621011647 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f129c00fe40 con 0x7f12a81048e0 2023-12-11T20:30:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12a57fa700 1 -- 172.21.15.12:0/1621011647 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c004a00 con 0x7f12a81048e0 2023-12-11T20:30:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.229+0000 7f12ae7ff700 1 -- 172.21.15.12:0/1621011647 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a81a1a10 con 0x7f12a81048e0 2023-12-11T20:30:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12a57fa700 1 -- 172.21.15.12:0/1621011647 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f129c004bc0 con 0x7f12a81048e0 2023-12-11T20:30:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12c20f3b80 1 Processor -- start 2023-12-11T20:30:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12c20f3b80 1 -- start start 2023-12-11T20:30:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba840640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba8410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba79ab50 con 0x5633ba840c20 2023-12-11T20:30:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba798470 con 0x5633ba83f3d0 2023-12-11T20:30:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.234+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba793d60 con 0x5633ba83fd30 2023-12-11T20:30:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba8410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12acd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12acd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49036/0 (socket says 172.21.15.12:49036) 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12acd9c700 1 -- 172.21.15.12:0/239480321 learned_addr learned my addr 172.21.15.12:0/239480321 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba840640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12acd9c700 1 -- 172.21.15.12:0/239480321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 msgr2=0x5633ba840640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12acd9c700 1 --2- 172.21.15.12:0/239480321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba840640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12acd9c700 1 -- 172.21.15.12:0/239480321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 msgr2=0x5633ba8410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12acd9c700 1 --2- 172.21.15.12:0/239480321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba8410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.235+0000 7f12acd9c700 1 -- 172.21.15.12:0/239480321 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ba610630 con 0x5633ba83f3d0 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.236+0000 7f12acd9c700 1 --2- 172.21.15.12:0/239480321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83f7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f12a00078d0 tx=0x7f12a0007be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f669533d23447d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.236+0000 7f12a57fa700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12900a1480 0x7f12900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.236+0000 7f12a57fa700 1 -- 172.21.15.12:0/1621011647 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f129c0cdb10 con 0x7f12a81048e0 2023-12-11T20:30:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.236+0000 7f128e7fc700 1 -- 172.21.15.12:0/239480321 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0004bb0 con 0x5633ba83f3d0 2023-12-11T20:30:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.236+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12900a1480 0x7f12900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.236+0000 7f128e7fc700 1 -- 172.21.15.12:0/239480321 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12a000f040 con 0x5633ba83f3d0 2023-12-11T20:30:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.236+0000 7f128e7fc700 1 -- 172.21.15.12:0/239480321 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0005260 con 0x5633ba83f3d0 2023-12-11T20:30:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12900a1480 0x7f12900a3940 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f12a8104740 tx=0x7f1298009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 -- 172.21.15.12:0/239480321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 msgr2=0x5633ba83f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/239480321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83f7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f12a00078d0 tx=0x7f12a0007be0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 -- 172.21.15.12:0/239480321 shutdown_connections 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/239480321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83f7f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/239480321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba8410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/239480321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba840640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 -- 172.21.15.12:0/239480321 >> 172.21.15.12:0/239480321 conn(0x5633ba76e7e0 msgr2=0x5633ba83bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 -- 172.21.15.12:0/239480321 shutdown_connections 2023-12-11T20:30:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.237+0000 7f12c20f3b80 1 -- 172.21.15.12:0/239480321 wait complete. 2023-12-11T20:30:14.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.238+0000 7f12c20f3b80 1 -- start start 2023-12-11T20:30:14.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.238+0000 7f12c20f3b80 1 Processor -- start 2023-12-11T20:30:14.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.238+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba849250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.238+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba849790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.238+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba850780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.238+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba74d560 con 0x5633ba840c20 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba74d200 con 0x5633ba83f3d0 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba612920 con 0x5633ba83fd30 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12c20f3b80 10 client.0 _ll_register_callbacks cb 0x5633ba678a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba849250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba849250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49048/0 (socket says 172.21.15.12:49048) 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a7fff700 1 -- 172.21.15.12:0/1138382094 learned_addr learned my addr 172.21.15.12:0/1138382094 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12acd9c700 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba850780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba849790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a7fff700 1 -- 172.21.15.12:0/1138382094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 msgr2=0x5633ba849790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba849790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a7fff700 1 -- 172.21.15.12:0/1138382094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 msgr2=0x5633ba850780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:14.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba850780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.239+0000 7f12a7fff700 1 -- 172.21.15.12:0/1138382094 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a0007500 con 0x5633ba83f3d0 2023-12-11T20:30:14.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.240+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba849250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12980036f0 tx=0x7f12980047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6123d1076b608f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:14.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.240+0000 7f12877fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:30:14.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.240+0000 7f12877fe700 1 -- 172.21.15.12:0/1138382094 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298017070 con 0x5633ba83f3d0 2023-12-11T20:30:14.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.240+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1138382094 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633ba832b40 con 0x5633ba83f3d0 2023-12-11T20:30:14.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.240+0000 7f12877fe700 1 -- 172.21.15.12:0/1138382094 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1298003e10 con 0x5633ba83f3d0 2023-12-11T20:30:14.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.240+0000 7f12877fe700 1 -- 172.21.15.12:0/1138382094 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f129801d650 con 0x5633ba83f3d0 2023-12-11T20:30:14.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.240+0000 7f12c20f3b80 10 client.29159 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.240+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1138382094 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5633ba5bcde0 con 0x5633ba83f3d0 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.241+0000 7f12877fe700 1 -- 172.21.15.12:0/1138382094 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1298036080 con 0x5633ba83f3d0 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.241+0000 7f12877fe700 1 -- 172.21.15.12:0/1138382094 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1298032910 con 0x5633ba83f3d0 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.241+0000 7f12c20f3b80 10 client.29159 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.241+0000 7f12c20f3b80 10 client.29159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.241+0000 7f12c20f3b80 20 client.29159 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.241+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633ba854fd0 0x5633ba8573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.241+0000 7f12c20f3b80 4 client.29159 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.241+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1138382094 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633ba80ef40 con 0x5633ba854fd0 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.242+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633ba854fd0 0x5633ba8573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.242+0000 7f12877fe700 10 client.29159 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:14.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.242+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633ba854fd0 0x5633ba8573f0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a87c91ce72ab8b8 server_cookie=81335aa4203c6f7a in_seq=0 out_seq=0 2023-12-11T20:30:14.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12877fe700 1 -- 172.21.15.12:0/1138382094 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5633ba80ef40 con 0x5633ba854fd0 2023-12-11T20:30:14.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12877fe700 10 client.29159 handle_command_reply: tid=0 2023-12-11T20:30:14.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 client.29159 shutdown 2023-12-11T20:30:14.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1138382094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 msgr2=0x5633ba849250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba849250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12980036f0 tx=0x7f12980047c0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1138382094 shutdown_connections 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633ba854fd0 0x5633ba8573f0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba849250 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba850780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12877fe700 0 client.29159 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1138382094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba849790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.243+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1138382094 >> 172.21.15.12:0/1138382094 conn(0x5633ba76e7e0 msgr2=0x5633ba83aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.244+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1138382094 shutdown_connections 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.244+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1138382094 wait complete. 2023-12-11T20:30:14.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.244+0000 7f12c20f3b80 20 client.29159 trim_cache size 0 max 16384 2023-12-11T20:30:14.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.267+0000 7f12c20f3b80 1 Processor -- start 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.267+0000 7f12c20f3b80 1 -- start start 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.267+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.267+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba850740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.267+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba849000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.267+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba840180 con 0x5633ba840c20 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.267+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba83ef70 con 0x5633ba83f3d0 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.267+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba846f70 con 0x5633ba83fd30 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba849000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba849000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47908/0 (socket says 172.21.15.12:47908) 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 -- 172.21.15.12:0/2496065956 learned_addr learned my addr 172.21.15.12:0/2496065956 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12a77fe700 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba850740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12a7fff700 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 -- 172.21.15.12:0/2496065956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 msgr2=0x5633ba850740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba850740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 -- 172.21.15.12:0/2496065956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 msgr2=0x5633ba83c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 -- 172.21.15.12:0/2496065956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ba5a5c60 con 0x5633ba840c20 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12a7fff700 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.268+0000 7f12acd9c700 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba849000 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009e50 tx=0x7f12a0016ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f858c4ef39e3ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.269+0000 7f128effd700 1 -- 172.21.15.12:0/2496065956 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0016ec0 con 0x5633ba840c20 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.269+0000 7f128effd700 1 -- 172.21.15.12:0/2496065956 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12a0009520 con 0x5633ba840c20 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.269+0000 7f128effd700 1 -- 172.21.15.12:0/2496065956 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0005350 con 0x5633ba840c20 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 -- 172.21.15.12:0/2496065956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 msgr2=0x5633ba849000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba849000 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009e50 tx=0x7f12a0016ca0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 -- 172.21.15.12:0/2496065956 shutdown_connections 2023-12-11T20:30:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba83f3d0 0x5633ba83c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba840c20 0x5633ba849000 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/2496065956 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba850740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 -- 172.21.15.12:0/2496065956 >> 172.21.15.12:0/2496065956 conn(0x5633ba76e7e0 msgr2=0x5633ba83b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 -- 172.21.15.12:0/2496065956 shutdown_connections 2023-12-11T20:30:14.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 -- 172.21.15.12:0/2496065956 wait complete. 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 -- start start 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.270+0000 7f12c20f3b80 1 Processor -- start 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba83f3d0 0x5633ba84d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba84d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12c20f3b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba840c20 0x5633ba8ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba850760 con 0x5633ba83f3d0 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba8508d0 con 0x5633ba840c20 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12c20f3b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ba850a90 con 0x5633ba83fd30 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12c20f3b80 10 client.0 _ll_register_callbacks cb 0x7f1298004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba83f3d0 0x5633ba84d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba83f3d0 0x5633ba84d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47920/0 (socket says 172.21.15.12:47920) 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12a7fff700 1 -- 172.21.15.12:0/1747511555 learned_addr learned my addr 172.21.15.12:0/1747511555 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba84d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.271+0000 7f12acd9c700 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba840c20 0x5633ba8ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.272+0000 7f12a7fff700 1 -- 172.21.15.12:0/1747511555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 msgr2=0x5633ba84d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.272+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba84d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.272+0000 7f12a7fff700 1 -- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba840c20 msgr2=0x5633ba8ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.272+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba840c20 0x5633ba8ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.272+0000 7f12a7fff700 1 -- 172.21.15.12:0/1747511555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633ba610630 con 0x5633ba83f3d0 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.272+0000 7f12acd9c700 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba840c20 0x5633ba8ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.272+0000 7f12a7fff700 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba83f3d0 0x5633ba84d2f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f1298012da0 tx=0x7f1298005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57504d4a54c4d732 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.272+0000 7f12877fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.273+0000 7f12877fe700 1 -- 172.21.15.12:0/1747511555 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298012410 con 0x5633ba83f3d0 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.273+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1747511555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12a000f040 con 0x5633ba83f3d0 2023-12-11T20:30:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.273+0000 7f12877fe700 1 -- 172.21.15.12:0/1747511555 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1298004a30 con 0x5633ba83f3d0 2023-12-11T20:30:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.273+0000 7f12877fe700 1 -- 172.21.15.12:0/1747511555 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1298004bf0 con 0x5633ba83f3d0 2023-12-11T20:30:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.273+0000 7f12c20f3b80 10 client.19611 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.273+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1747511555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5633ba5e3250 con 0x5633ba83f3d0 2023-12-11T20:30:14.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.273+0000 7f12877fe700 1 -- 172.21.15.12:0/1747511555 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12a000f040 con 0x5633ba83f3d0 2023-12-11T20:30:14.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.274+0000 7f12877fe700 1 -- 172.21.15.12:0/1747511555 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1298005220 con 0x5633ba83f3d0 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.274+0000 7f12c20f3b80 10 client.19611 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.274+0000 7f12c20f3b80 10 client.19611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.274+0000 7f12c20f3b80 20 client.19611 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.274+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633ba8ad210 0x5633ba8af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.274+0000 7f12c20f3b80 4 client.19611 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.274+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1747511555 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5633ba759fd0 con 0x5633ba8ad210 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.274+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633ba8ad210 0x5633ba8af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12877fe700 10 client.19611 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12a77fe700 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633ba8ad210 0x5633ba8af630 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aef1a16e3780f66 server_cookie=44cccbdb2f854b79 in_seq=0 out_seq=0 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12877fe700 1 -- 172.21.15.12:0/1747511555 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5633ba759fd0 con 0x5633ba8ad210 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12877fe700 10 client.19611 handle_command_reply: tid=0 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12c20f3b80 1 client.19611 shutdown 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1747511555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba83f3d0 msgr2=0x5633ba84d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba83f3d0 0x5633ba84d2f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f1298012da0 tx=0x7f1298005c20 comp rx=0 tx=0).stop 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1747511555 shutdown_connections 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.275+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5633ba8ad210 0x5633ba8af630 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.276+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5633ba840c20 0x5633ba8ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.276+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633ba83f3d0 0x5633ba84d2f0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.276+0000 7f12c20f3b80 1 --2- 172.21.15.12:0/1747511555 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5633ba83fd30 0x5633ba84d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.276+0000 7f12877fe700 0 client.19611 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.276+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1747511555 >> 172.21.15.12:0/1747511555 conn(0x5633ba76e7e0 msgr2=0x5633ba849000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.276+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1747511555 shutdown_connections 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.276+0000 7f12c20f3b80 1 -- 172.21.15.12:0/1747511555 wait complete. 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.276+0000 7f12c20f3b80 20 client.19611 trim_cache size 0 max 16384 2023-12-11T20:30:14.277 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: "65964235-4075-4cea-87c9-3a93f755dfcc": { 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "65964235-4075-4cea-87c9-3a93f755dfcc", 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:30:14.278 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 -- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12900a1480 msgr2=0x7f12900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12900a1480 0x7f12900a3940 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f12a8104740 tx=0x7f1298009260 comp rx=0 tx=0).stop 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 -- 172.21.15.12:0/1621011647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12a81048e0 msgr2=0x7f12a8199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12a81048e0 0x7f12a8199a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f129c00bf10 tx=0x7f129c00fa00 comp rx=0 tx=0).stop 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 -- 172.21.15.12:0/1621011647 shutdown_connections 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f12900a1480 0x7f12900a3940 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a81036f0 0x7f12a81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12a8105280 0x7f12a81a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 --2- 172.21.15.12:0/1621011647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12a81048e0 0x7f12a8199a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 -- 172.21.15.12:0/1621011647 >> 172.21.15.12:0/1621011647 conn(0x7f12a80fec80 msgr2=0x7f12a8107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 -- 172.21.15.12:0/1621011647 shutdown_connections 2023-12-11T20:30:14.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:14.277+0000 7f12ae7ff700 1 -- 172.21.15.12:0/1621011647 wait complete. 2023-12-11T20:30:14.302 INFO:tasks.cephfs.filesystem:scrub status for tag:65964235-4075-4cea-87c9-3a93f755dfcc - {'path': '/', 'tag': '65964235-4075-4cea-87c9-3a93f755dfcc', 'options': 'recursive,force'} 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: pgmap v804: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:14 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: pgmap v804: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:15.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:14 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: pgmap v804: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:14 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:17.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:16 smithi032 ceph-mon[132488]: pgmap v805: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:30:17.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:16 smithi039 ceph-mon[102205]: pgmap v805: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:30:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:16 smithi012 ceph-mon[128787]: pgmap v805: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 21 op/s 2023-12-11T20:30:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.968+0000 7f189cdff700 1 -- 172.21.15.12:0/867963073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981036f0 msgr2=0x7f1898103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.968+0000 7f189cdff700 1 --2- 172.21.15.12:0/867963073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981036f0 0x7f1898103b10 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f18880099c0 tx=0x7f1888009cd0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.969+0000 7f189cdff700 1 -- 172.21.15.12:0/867963073 shutdown_connections 2023-12-11T20:30:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.969+0000 7f189cdff700 1 --2- 172.21.15.12:0/867963073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1898105280 0x7f189810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.969+0000 7f189cdff700 1 --2- 172.21.15.12:0/867963073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981036f0 0x7f1898103b10 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.969+0000 7f189cdff700 1 --2- 172.21.15.12:0/867963073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18981048e0 0x7f1898104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.969+0000 7f189cdff700 1 -- 172.21.15.12:0/867963073 >> 172.21.15.12:0/867963073 conn(0x7f18980fec80 msgr2=0x7f18981010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.969+0000 7f189cdff700 1 -- 172.21.15.12:0/867963073 shutdown_connections 2023-12-11T20:30:17.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.969+0000 7f189cdff700 1 -- 172.21.15.12:0/867963073 wait complete. 2023-12-11T20:30:17.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.970+0000 7f189cdff700 1 Processor -- start 2023-12-11T20:30:17.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.970+0000 7f189cdff700 1 -- start start 2023-12-11T20:30:17.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.970+0000 7f189cdff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18981036f0 0x7f1898199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.970+0000 7f189cdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981048e0 0x7f1898199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.970+0000 7f189cdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1898105280 0x7f18981a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.970+0000 7f189cdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18981a10e0 con 0x7f18981048e0 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.970+0000 7f189cdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18981a1220 con 0x7f1898105280 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.970+0000 7f189cdff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18981a13b0 con 0x7f18981036f0 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981048e0 0x7f1898199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981048e0 0x7f1898199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47940/0 (socket says 172.21.15.12:47940) 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f189659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18981036f0 0x7f1898199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 -- 172.21.15.12:0/3970872580 learned_addr learned my addr 172.21.15.12:0/3970872580 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1896d9d700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1898105280 0x7f18981a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 -- 172.21.15.12:0/3970872580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18981036f0 msgr2=0x7f1898199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:17.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18981036f0 0x7f1898199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 -- 172.21.15.12:0/3970872580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1898105280 msgr2=0x7f18981a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1898105280 0x7f18981a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 -- 172.21.15.12:0/3970872580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890009c40 con 0x7f18981048e0 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.971+0000 7f1895d9b700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981048e0 0x7f1898199b40 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e9a0 tx=0x7f188c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.972+0000 7f18877fe700 1 -- 172.21.15.12:0/3970872580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c009790 con 0x7f18981048e0 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.972+0000 7f189cdff700 1 -- 172.21.15.12:0/3970872580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18880095f0 con 0x7f18981048e0 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.972+0000 7f18877fe700 1 -- 172.21.15.12:0/3970872580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f188c00ce50 con 0x7f18981048e0 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.972+0000 7f18877fe700 1 -- 172.21.15.12:0/3970872580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c018420 con 0x7f18981048e0 2023-12-11T20:30:17.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.972+0000 7f189cdff700 1 -- 172.21.15.12:0/3970872580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18981a1a10 con 0x7f18981048e0 2023-12-11T20:30:17.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.976+0000 7f18877fe700 1 -- 172.21.15.12:0/3970872580 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f188c010430 con 0x7f18981048e0 2023-12-11T20:30:17.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18b0817b80 1 Processor -- start 2023-12-11T20:30:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18b0817b80 1 -- start start 2023-12-11T20:30:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fac830 0x562c14fad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fad720 0x562c14fadba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18b0817b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14f07af0 con 0x562c14fac830 2023-12-11T20:30:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18b0817b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14f05410 con 0x562c14fabed0 2023-12-11T20:30:17.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18b0817b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14f00d00 con 0x562c14fad720 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.977+0000 7f18877fe700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18800a1470 0x7f18800a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f189659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fac830 0x562c14fad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1895d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fad720 0x562c14fadba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f189659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fac830 0x562c14fad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47952/0 (socket says 172.21.15.12:47952) 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f189659c700 1 -- 172.21.15.12:0/2961291764 learned_addr learned my addr 172.21.15.12:0/2961291764 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1896d9d700 1 --2- 172.21.15.12:0/2961291764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f18877fe700 1 -- 172.21.15.12:0/3970872580 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f188c014070 con 0x7f18981048e0 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1896d9d700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18800a1470 0x7f18800a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1895d9b700 1 -- 172.21.15.12:0/2961291764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 msgr2=0x562c14fac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1895d9b700 1 --2- 172.21.15.12:0/2961291764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1895d9b700 1 -- 172.21.15.12:0/2961291764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fac830 msgr2=0x562c14fad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:17.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1895d9b700 1 --2- 172.21.15.12:0/2961291764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fac830 0x562c14fad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1895d9b700 1 -- 172.21.15.12:0/2961291764 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c14d7d5d0 con 0x562c14fad720 2023-12-11T20:30:17.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.978+0000 7f1895d9b700 1 --2- 172.21.15.12:0/2961291764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fad720 0x562c14fadba0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f188c09a160 tx=0x7f188c06d190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33f6c65bccd72332 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:17.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.979+0000 7f1896d9d700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18800a1470 0x7f18800a3930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1890009fd0 tx=0x7f189000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:17.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.979+0000 7f1884ff9700 1 -- 172.21.15.12:0/2961291764 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c010710 con 0x562c14fad720 2023-12-11T20:30:17.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.979+0000 7f1884ff9700 1 -- 172.21.15.12:0/2961291764 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f188c065a90 con 0x562c14fad720 2023-12-11T20:30:17.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.979+0000 7f1884ff9700 1 -- 172.21.15.12:0/2961291764 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0655f0 con 0x562c14fad720 2023-12-11T20:30:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 -- 172.21.15.12:0/2961291764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fad720 msgr2=0x562c14fadba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:17.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 --2- 172.21.15.12:0/2961291764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fad720 0x562c14fadba0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f188c09a160 tx=0x7f188c06d190 comp rx=0 tx=0).stop 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 -- 172.21.15.12:0/2961291764 shutdown_connections 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 --2- 172.21.15.12:0/2961291764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 --2- 172.21.15.12:0/2961291764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fad720 0x562c14fadba0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 --2- 172.21.15.12:0/2961291764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fac830 0x562c14fad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 -- 172.21.15.12:0/2961291764 >> 172.21.15.12:0/2961291764 conn(0x562c14edb780 msgr2=0x562c14fa8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 -- 172.21.15.12:0/2961291764 shutdown_connections 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 -- 172.21.15.12:0/2961291764 wait complete. 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.980+0000 7f18b0817b80 1 -- start start 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f18b0817b80 1 Processor -- start 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fabed0 0x562c14fb5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fb6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fad720 0x562c14fbd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f18b0817b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14eba500 con 0x562c14fabed0 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f18b0817b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14eba1a0 con 0x562c14fad720 2023-12-11T20:30:17.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f18b0817b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14d7f8c0 con 0x562c14fac830 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f18b0817b80 10 client.0 _ll_register_callbacks cb 0x562c14de5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.981+0000 7f189659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fabed0 0x562c14fb5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f189659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fabed0 0x562c14fb5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47954/0 (socket says 172.21.15.12:47954) 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f189659c700 1 -- 172.21.15.12:0/4116911632 learned_addr learned my addr 172.21.15.12:0/4116911632 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f1896d9d700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fad720 0x562c14fbd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f1895d9b700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fb6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f189659c700 1 -- 172.21.15.12:0/4116911632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 msgr2=0x562c14fb6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f189659c700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fb6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f189659c700 1 -- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fad720 msgr2=0x562c14fbd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f189659c700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fad720 0x562c14fbd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f189659c700 1 -- 172.21.15.12:0/4116911632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18981a1a10 con 0x562c14fabed0 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f1895d9b700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fb6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.982+0000 7f1896d9d700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fad720 0x562c14fbd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:17.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.983+0000 7f189659c700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fabed0 0x562c14fb5f40 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1888000c00 tx=0x7f1888005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f933709d5dc810 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.983+0000 7f187dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.983+0000 7f187dffb700 1 -- 172.21.15.12:0/4116911632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188800bd20 con 0x562c14fabed0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.983+0000 7f18b0817b80 1 -- 172.21.15.12:0/4116911632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c14f9f730 con 0x562c14fabed0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.983+0000 7f187dffb700 1 -- 172.21.15.12:0/4116911632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1888003760 con 0x562c14fabed0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.983+0000 7f187dffb700 1 -- 172.21.15.12:0/4116911632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1888003920 con 0x562c14fabed0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.983+0000 7f18b0817b80 10 client.19623 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.983+0000 7f18b0817b80 1 -- 172.21.15.12:0/4116911632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562c14d29d80 con 0x562c14fabed0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.984+0000 7f187dffb700 1 -- 172.21.15.12:0/4116911632 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1888033080 con 0x562c14fabed0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.984+0000 7f187dffb700 1 -- 172.21.15.12:0/4116911632 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f188800fa60 con 0x562c14fabed0 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.984+0000 7f18b0817b80 10 client.19623 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.984+0000 7f18b0817b80 10 client.19623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:17.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.984+0000 7f18b0817b80 20 client.19623 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.984+0000 7f18b0817b80 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c14fc1cd0 0x562c14fc40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.984+0000 7f18b0817b80 4 client.19623 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.984+0000 7f18b0817b80 1 -- 172.21.15.12:0/4116911632 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c14f7bee0 con 0x562c14fc1cd0 2023-12-11T20:30:17.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.985+0000 7f1895d9b700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c14fc1cd0 0x562c14fc40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:17.988 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.985+0000 7f1895d9b700 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c14fc1cd0 0x562c14fc40f0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e49de196e01902e server_cookie=f9889ce709cb61de in_seq=0 out_seq=0 2023-12-11T20:30:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.985+0000 7f187dffb700 10 client.19623 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f187dffb700 1 -- 172.21.15.12:0/4116911632 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562c14f7bee0 con 0x562c14fc1cd0 2023-12-11T20:30:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f187dffb700 10 client.19623 handle_command_reply: tid=0 2023-12-11T20:30:17.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 client.19623 shutdown 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 -- 172.21.15.12:0/4116911632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fabed0 msgr2=0x562c14fb5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fabed0 0x562c14fb5f40 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1888000c00 tx=0x7f1888005270 comp rx=0 tx=0).stop 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 -- 172.21.15.12:0/4116911632 shutdown_connections 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c14fc1cd0 0x562c14fc40f0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fad720 0x562c14fbd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fabed0 0x562c14fb5f40 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 --2- 172.21.15.12:0/4116911632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fb6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 -- 172.21.15.12:0/4116911632 >> 172.21.15.12:0/4116911632 conn(0x562c14edb780 msgr2=0x562c14fa6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f187dffb700 0 client.19623 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.986+0000 7f18b0817b80 1 -- 172.21.15.12:0/4116911632 shutdown_connections 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.987+0000 7f18b0817b80 1 -- 172.21.15.12:0/4116911632 wait complete. 2023-12-11T20:30:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:17.987+0000 7f18b0817b80 20 client.19623 trim_cache size 0 max 16384 2023-12-11T20:30:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.004+0000 7f18b0817b80 1 Processor -- start 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.004+0000 7f18b0817b80 1 -- start start 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.004+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fadb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.004+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.004+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fb3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.004+0000 7f18b0817b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14fbe5c0 con 0x562c14fad720 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.004+0000 7f18b0817b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14fbd810 con 0x562c14fabed0 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.004+0000 7f18b0817b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14f9f4c0 con 0x562c14fac830 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fb3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fb3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47956/0 (socket says 172.21.15.12:47956) 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 -- 172.21.15.12:0/1235007693 learned_addr learned my addr 172.21.15.12:0/1235007693 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1895d9b700 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f189659c700 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fadb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 -- 172.21.15.12:0/1235007693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 msgr2=0x562c14fbd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 -- 172.21.15.12:0/1235007693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 msgr2=0x562c14fadb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fadb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 -- 172.21.15.12:0/1235007693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c14d12c00 con 0x562c14fad720 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.005+0000 7f1896d9d700 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fb3d30 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f1890008440 tx=0x7f1890009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa4f453bcb71045 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18857fa700 1 -- 172.21.15.12:0/1235007693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000e070 con 0x562c14fad720 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18857fa700 1 -- 172.21.15.12:0/1235007693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f189000f040 con 0x562c14fad720 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18857fa700 1 -- 172.21.15.12:0/1235007693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890024440 con 0x562c14fad720 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18b0817b80 1 -- 172.21.15.12:0/1235007693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 msgr2=0x562c14fb3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18b0817b80 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fb3d30 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f1890008440 tx=0x7f1890009920 comp rx=0 tx=0).stop 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18b0817b80 1 -- 172.21.15.12:0/1235007693 shutdown_connections 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18b0817b80 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fadb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18b0817b80 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fb3d30 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18b0817b80 1 --2- 172.21.15.12:0/1235007693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.006+0000 7f18b0817b80 1 -- 172.21.15.12:0/1235007693 >> 172.21.15.12:0/1235007693 conn(0x562c14edb780 msgr2=0x562c14fb5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.007+0000 7f18b0817b80 1 -- 172.21.15.12:0/1235007693 shutdown_connections 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.007+0000 7f18b0817b80 1 -- 172.21.15.12:0/1235007693 wait complete. 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.007+0000 7f18b0817b80 1 -- start start 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.007+0000 7f18b0817b80 1 Processor -- start 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fbacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f18b0817b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fbc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f18b0817b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14fbc730 con 0x562c14fad720 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f18b0817b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14fbc8a0 con 0x562c14fabed0 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f18b0817b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c14fbca60 con 0x562c14fac830 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f18b0817b80 10 client.0 _ll_register_callbacks cb 0x562c14de5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f1896d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fbc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f1896d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fbc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47958/0 (socket says 172.21.15.12:47958) 2023-12-11T20:30:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.008+0000 7f1896d9d700 1 -- 172.21.15.12:0/486526303 learned_addr learned my addr 172.21.15.12:0/486526303 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f189659c700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fbacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f1895d9b700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f1896d9d700 1 -- 172.21.15.12:0/486526303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 msgr2=0x562c14fbb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f1896d9d700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f1896d9d700 1 -- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 msgr2=0x562c14fbacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f1896d9d700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fbacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f1896d9d700 1 -- 172.21.15.12:0/486526303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1890008120 con 0x562c14fad720 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f189659c700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fbacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f1895d9b700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f1896d9d700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fbc1f0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f1890008f70 tx=0x7f1890018e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24dea9f8998c867 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f187dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f187dffb700 1 -- 172.21.15.12:0/486526303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000e040 con 0x562c14fad720 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f18b0817b80 1 -- 172.21.15.12:0/486526303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f188c065a90 con 0x562c14fad720 2023-12-11T20:30:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.009+0000 7f187dffb700 1 -- 172.21.15.12:0/486526303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1890035480 con 0x562c14fad720 2023-12-11T20:30:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f187dffb700 1 -- 172.21.15.12:0/486526303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18900189f0 con 0x562c14fad720 2023-12-11T20:30:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f18b0817b80 10 client.19629 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f18b0817b80 1 -- 172.21.15.12:0/486526303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562c14d501f0 con 0x562c14fad720 2023-12-11T20:30:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f187dffb700 1 -- 172.21.15.12:0/486526303 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f188c065a90 con 0x562c14fad720 2023-12-11T20:30:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f187dffb700 1 -- 172.21.15.12:0/486526303 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f189002a020 con 0x562c14fad720 2023-12-11T20:30:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f18b0817b80 10 client.19629 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f18b0817b80 10 client.19629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f18b0817b80 20 client.19629 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f18b0817b80 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c150216d0 0x562c15023af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f18b0817b80 4 client.19629 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:30:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.010+0000 7f18b0817b80 1 -- 172.21.15.12:0/486526303 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562c14ec6f70 con 0x562c150216d0 2023-12-11T20:30:18.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.011+0000 7f189659c700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c150216d0 0x562c15023af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:18.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.011+0000 7f189659c700 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c150216d0 0x562c15023af0 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6481a40064671756 server_cookie=7fc2befe96097e02 in_seq=0 out_seq=0 2023-12-11T20:30:18.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.011+0000 7f187dffb700 10 client.19629 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f187dffb700 1 -- 172.21.15.12:0/486526303 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562c14ec6f70 con 0x562c150216d0 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f187dffb700 10 client.19629 handle_command_reply: tid=0 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 client.19629 shutdown 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 -- 172.21.15.12:0/486526303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 msgr2=0x562c14fbc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fbc1f0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f1890008f70 tx=0x7f1890018e00 comp rx=0 tx=0).stop 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 -- 172.21.15.12:0/486526303 shutdown_connections 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562c150216d0 0x562c15023af0 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562c14fabed0 0x562c14fbacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562c14fad720 0x562c14fbc1f0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 --2- 172.21.15.12:0/486526303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562c14fac830 0x562c14fbb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f18b0817b80 1 -- 172.21.15.12:0/486526303 >> 172.21.15.12:0/486526303 conn(0x562c14edb780 msgr2=0x562c14fc8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.021+0000 7f187dffb700 0 client.19629 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f18b0817b80 1 -- 172.21.15.12:0/486526303 shutdown_connections 2023-12-11T20:30:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f18b0817b80 1 -- 172.21.15.12:0/486526303 wait complete. 2023-12-11T20:30:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f18b0817b80 20 client.19629 trim_cache size 0 max 16384 2023-12-11T20:30:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:30:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:30:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:30:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 -- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18800a1470 msgr2=0x7f18800a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18800a1470 0x7f18800a3930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1890009fd0 tx=0x7f189000b040 comp rx=0 tx=0).stop 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 -- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981048e0 msgr2=0x7f1898199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981048e0 0x7f1898199b40 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e9a0 tx=0x7f188c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 -- 172.21.15.12:0/3970872580 shutdown_connections 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f18800a1470 0x7f18800a3930 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1898105280 0x7f18981a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18981036f0 0x7f1898199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.022+0000 7f189cdff700 1 --2- 172.21.15.12:0/3970872580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18981048e0 0x7f1898199b40 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.023+0000 7f189cdff700 1 -- 172.21.15.12:0/3970872580 >> 172.21.15.12:0/3970872580 conn(0x7f18980fec80 msgr2=0x7f1898107d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.023+0000 7f189cdff700 1 -- 172.21.15.12:0/3970872580 shutdown_connections 2023-12-11T20:30:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:18.023+0000 7f189cdff700 1 -- 172.21.15.12:0/3970872580 wait complete. 2023-12-11T20:30:19.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:18 smithi032 ceph-mon[132488]: pgmap v806: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:30:19.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:18 smithi039 ceph-mon[102205]: pgmap v806: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:30:19.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:18 smithi012 ceph-mon[128787]: pgmap v806: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:30:21.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:20 smithi032 ceph-mon[132488]: pgmap v807: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:30:21.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:20 smithi039 ceph-mon[102205]: pgmap v807: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:30:21.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:20 smithi012 ceph-mon[128787]: pgmap v807: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 33 op/s 2023-12-11T20:30:23.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:22 smithi032 ceph-mon[132488]: pgmap v808: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:30:23.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:22 smithi039 ceph-mon[102205]: pgmap v808: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:30:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:22 smithi012 ceph-mon[128787]: pgmap v808: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 30 op/s 2023-12-11T20:30:25.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:24 smithi032 ceph-mon[132488]: pgmap v809: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:30:25.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:24 smithi039 ceph-mon[102205]: pgmap v809: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:30:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:24 smithi012 ceph-mon[128787]: pgmap v809: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 33 op/s 2023-12-11T20:30:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:26 smithi032 ceph-mon[132488]: pgmap v810: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:30:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:26 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:30:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:26 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:30:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:26 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:30:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:26 smithi039 ceph-mon[102205]: pgmap v810: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:30:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:26 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:30:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:26 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:30:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:26 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:30:27.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:26 smithi012 ceph-mon[128787]: pgmap v810: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:30:27.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:26 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:30:27.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:26 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:30:27.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:26 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:30:29.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:28 smithi032 ceph-mon[132488]: pgmap v811: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:30:29.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:28 smithi039 ceph-mon[102205]: pgmap v811: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:30:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:28 smithi012 ceph-mon[128787]: pgmap v811: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 27 op/s 2023-12-11T20:30:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 -- 172.21.15.12:0/2916604265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 msgr2=0x7fe7b010bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/2916604265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 0x7fe7b010bb10 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800b0d0 tx=0x7fe7a800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 -- 172.21.15.12:0/2916604265 shutdown_connections 2023-12-11T20:30:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/2916604265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 0x7fe7b010bb10 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/2916604265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7b01036d0 0x7fe7b0103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/2916604265 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7b01048c0 0x7fe7b0104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 -- 172.21.15.12:0/2916604265 >> 172.21.15.12:0/2916604265 conn(0x7fe7b00fec80 msgr2=0x7fe7b01010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 -- 172.21.15.12:0/2916604265 shutdown_connections 2023-12-11T20:30:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.197+0000 7fe7b69ff700 1 -- 172.21.15.12:0/2916604265 wait complete. 2023-12-11T20:30:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.198+0000 7fe7b69ff700 1 Processor -- start 2023-12-11T20:30:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.198+0000 7fe7b69ff700 1 -- start start 2023-12-11T20:30:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b69ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7b01036d0 0x7fe7b0199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b69ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7b01048c0 0x7fe7b0199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b69ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 0x7fe7b01a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b69ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01a1140 con 0x7fe7b0105260 2023-12-11T20:30:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b69ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01a1280 con 0x7fe7b01048c0 2023-12-11T20:30:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b69ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01a1410 con 0x7fe7b01036d0 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 0x7fe7b01a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7b01048c0 0x7fe7b0199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 0x7fe7b01a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50028/0 (socket says 172.21.15.12:50028) 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/3945144666 learned_addr learned my addr 172.21.15.12:0/3945144666 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.199+0000 7fe7affff700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7b01036d0 0x7fe7b0199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/3945144666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7b01036d0 msgr2=0x7fe7b0199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7b01036d0 0x7fe7b0199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/3945144666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7b01048c0 msgr2=0x7fe7b0199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7b01048c0 0x7fe7b0199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/3945144666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8009d00 con 0x7fe7b0105260 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7b01048c0 0x7fe7b0199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 0x7fe7b01a0b70 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80079c0 tx=0x7fe7a800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7ad7fa700 1 -- 172.21.15.12:0/3945144666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800e040 con 0x7fe7b0105260 2023-12-11T20:30:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7b69ff700 1 -- 172.21.15.12:0/3945144666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b01a1690 con 0x7fe7b0105260 2023-12-11T20:30:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7ad7fa700 1 -- 172.21.15.12:0/3945144666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a800ceb0 con 0x7fe7b0105260 2023-12-11T20:30:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.200+0000 7fe7ad7fa700 1 -- 172.21.15.12:0/3945144666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a801b6b0 con 0x7fe7b0105260 2023-12-11T20:30:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.201+0000 7fe7b69ff700 1 -- 172.21.15.12:0/3945144666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b01a1b60 con 0x7fe7b0105260 2023-12-11T20:30:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.204+0000 7fe7ad7fa700 1 -- 172.21.15.12:0/3945144666 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe7a801d480 con 0x7fe7b0105260 2023-12-11T20:30:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.205+0000 7fe7ca273b80 1 Processor -- start 2023-12-11T20:30:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.206+0000 7fe7ca273b80 1 -- start start 2023-12-11T20:30:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.206+0000 7fe7ad7fa700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7980a1470 0x7fe7980a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.206+0000 7fe7ad7fa700 1 -- 172.21.15.12:0/3945144666 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe7a80ce600 con 0x7fe7b0105260 2023-12-11T20:30:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.206+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb6ed0 0x5572adeb72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.206+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7980a1470 0x7fe7980a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.206+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adeb8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.206+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb8720 0x5572adeb8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb6ed0 0x5572adeb72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572ade12af0 con 0x5572adeb6ed0 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572ade10410 con 0x5572adeb8720 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb6ed0 0x5572adeb72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50044/0 (socket says 172.21.15.12:50044) 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572ade0bd00 con 0x5572adeb7830 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 -- 172.21.15.12:0/2482656069 learned_addr learned my addr 172.21.15.12:0/2482656069 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adeb8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb8720 0x5572adeb8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7980a1470 0x7fe7980a3930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4011550 tx=0x7fe7a4011860 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 -- 172.21.15.12:0/2482656069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 msgr2=0x5572adeb8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adeb8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 -- 172.21.15.12:0/2482656069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb8720 msgr2=0x5572adeb8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb8720 0x5572adeb8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 -- 172.21.15.12:0/2482656069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572adc885d0 con 0x5572adeb6ed0 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb8720 0x5572adeb8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adeb8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.207+0000 7fe7affff700 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb6ed0 0x5572adeb72f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009d30 tx=0x7fe7a0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f2a03b0a22444f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.208+0000 7fe7967fc700 1 -- 172.21.15.12:0/2482656069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0004220 con 0x5572adeb6ed0 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.208+0000 7fe7967fc700 1 -- 172.21.15.12:0/2482656069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a0004380 con 0x5572adeb6ed0 2023-12-11T20:30:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.208+0000 7fe7967fc700 1 -- 172.21.15.12:0/2482656069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00197a0 con 0x5572adeb6ed0 2023-12-11T20:30:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.208+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2482656069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb6ed0 msgr2=0x5572adeb72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.208+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb6ed0 0x5572adeb72f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009d30 tx=0x7fe7a0011720 comp rx=0 tx=0).stop 2023-12-11T20:30:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.209+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2482656069 shutdown_connections 2023-12-11T20:30:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.209+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb8720 0x5572adeb8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.209+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb6ed0 0x5572adeb72f0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.209+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2482656069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adeb8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.209+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2482656069 >> 172.21.15.12:0/2482656069 conn(0x5572adde6780 msgr2=0x5572adeb3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.209+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2482656069 shutdown_connections 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.209+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2482656069 wait complete. 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.209+0000 7fe7ca273b80 1 -- start start 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.210+0000 7fe7ca273b80 1 Processor -- start 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.210+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb6ed0 0x5572adec0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.210+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb7830 0x5572adec13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.210+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.210+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572addc5500 con 0x5572adeb8720 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.210+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572addc51a0 con 0x5572adeb7830 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.210+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572adc8a8c0 con 0x5572adeb6ed0 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.210+0000 7fe7ca273b80 10 client.0 _ll_register_callbacks cb 0x5572adcf0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb7830 0x5572adec13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7b4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb7830 0x5572adec13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:48500/0 (socket says 172.21.15.12:48500) 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7af7fe700 1 -- 172.21.15.12:0/725259213 learned_addr learned my addr 172.21.15.12:0/725259213 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7affff700 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb6ed0 0x5572adec0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/725259213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb6ed0 msgr2=0x5572adec0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb6ed0 0x5572adec0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/725259213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb7830 msgr2=0x5572adec13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb7830 0x5572adec13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/725259213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a401d440 con 0x5572adeb8720 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec8220 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80cc050 tx=0x7fe7a8026f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9375410fa034b05 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.211+0000 7fe78f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe78f7fe700 1 -- 172.21.15.12:0/725259213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a809b900 con 0x5572adeb8720 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe78f7fe700 1 -- 172.21.15.12:0/725259213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe7a809fa50 con 0x5572adeb8720 2023-12-11T20:30:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe7ca273b80 1 -- 172.21.15.12:0/725259213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572adeaa730 con 0x5572adeb8720 2023-12-11T20:30:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe78f7fe700 1 -- 172.21.15.12:0/725259213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a80a3c00 con 0x5572adeb8720 2023-12-11T20:30:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe7ca273b80 10 client.19641 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe7ca273b80 1 -- 172.21.15.12:0/725259213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fe7a0009960 con 0x5572adeb8720 2023-12-11T20:30:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe78f7fe700 1 -- 172.21.15.12:0/725259213 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5572adeaa730 con 0x5572adeb8720 2023-12-11T20:30:31.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:30 smithi032 ceph-mon[132488]: pgmap v812: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe78f7fe700 1 -- 172.21.15.12:0/725259213 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe7a809adf0 con 0x5572adeb8720 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.212+0000 7fe7ca273b80 10 client.19641 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.213+0000 7fe7ca273b80 10 client.19641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.213+0000 7fe7ca273b80 20 client.19641 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.213+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5572adeccae0 0x5572adeceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.213+0000 7fe7ca273b80 4 client.19641 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.213+0000 7fe7ca273b80 1 -- 172.21.15.12:0/725259213 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572ade86ee0 con 0x5572adeccae0 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.213+0000 7fe7affff700 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5572adeccae0 0x5572adeceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.214+0000 7fe7affff700 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5572adeccae0 0x5572adeceed0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f7e00c514d2b224 server_cookie=dc4e2b602ece5ddd in_seq=0 out_seq=0 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.214+0000 7fe78f7fe700 10 client.19641 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe78f7fe700 1 -- 172.21.15.12:0/725259213 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5572ade86ee0 con 0x5572adeccae0 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe78f7fe700 10 client.19641 handle_command_reply: tid=0 2023-12-11T20:30:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 client.19641 shutdown 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 -- 172.21.15.12:0/725259213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 msgr2=0x5572adec8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec8220 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80cc050 tx=0x7fe7a8026f90 comp rx=0 tx=0).stop 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 -- 172.21.15.12:0/725259213 shutdown_connections 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5572adeccae0 0x5572adeceed0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec8220 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb6ed0 0x5572adec0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/725259213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb7830 0x5572adec13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 -- 172.21.15.12:0/725259213 >> 172.21.15.12:0/725259213 conn(0x5572adde6780 msgr2=0x5572adeb1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe78f7fe700 0 client.19641 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 -- 172.21.15.12:0/725259213 shutdown_connections 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 1 -- 172.21.15.12:0/725259213 wait complete. 2023-12-11T20:30:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.215+0000 7fe7ca273b80 20 client.19641 trim_cache size 0 max 16384 2023-12-11T20:30:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.234+0000 7fe7ca273b80 1 Processor -- start 2023-12-11T20:30:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.234+0000 7fe7ca273b80 1 -- start start 2023-12-11T20:30:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.234+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.234+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb7830 0x5572adec81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.234+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb8720 0x5572adec01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.234+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572adec1e90 con 0x5572adeb7830 2023-12-11T20:30:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.234+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572adebe910 con 0x5572adeb6ed0 2023-12-11T20:30:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.234+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572adebc200 con 0x5572adeb8720 2023-12-11T20:30:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb7830 0x5572adec81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb7830 0x5572adec81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50066/0 (socket says 172.21.15.12:50066) 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 -- 172.21.15.12:0/1579059170 learned_addr learned my addr 172.21.15.12:0/1579059170 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb8720 0x5572adec01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7affff700 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 -- 172.21.15.12:0/1579059170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb8720 msgr2=0x5572adec01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb8720 0x5572adec01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 -- 172.21.15.12:0/1579059170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 msgr2=0x5572adec8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 -- 172.21.15.12:0/1579059170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572adc34d80 con 0x5572adeb7830 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7affff700 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb8720 0x5572adec01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.235+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb7830 0x5572adec81e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4004570 tx=0x7fe7a401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6974ca9fbf73e505 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.236+0000 7fe796ffd700 1 -- 172.21.15.12:0/1579059170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4023070 con 0x5572adeb7830 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.236+0000 7fe796ffd700 1 -- 172.21.15.12:0/1579059170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a40045a0 con 0x5572adeb7830 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.236+0000 7fe796ffd700 1 -- 172.21.15.12:0/1579059170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400f7b0 con 0x5572adeb7830 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 -- 172.21.15.12:0/1579059170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb7830 msgr2=0x5572adec81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb7830 0x5572adec81e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4004570 tx=0x7fe7a401c000 comp rx=0 tx=0).stop 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 -- 172.21.15.12:0/1579059170 shutdown_connections 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb8720 0x5572adec01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/1579059170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb7830 0x5572adec81e0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 -- 172.21.15.12:0/1579059170 >> 172.21.15.12:0/1579059170 conn(0x5572adde6780 msgr2=0x5572adebec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 -- 172.21.15.12:0/1579059170 shutdown_connections 2023-12-11T20:30:31.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 -- 172.21.15.12:0/1579059170 wait complete. 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.237+0000 7fe7ca273b80 1 -- start start 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7ca273b80 1 Processor -- start 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adec6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7ca273b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572adec79a0 con 0x5572adeb8720 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572adec7b10 con 0x5572adeb6ed0 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7ca273b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572adec7cd0 con 0x5572adeb7830 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7ca273b80 10 client.0 _ll_register_callbacks cb 0x5572adcf0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.238+0000 7fe7b4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7b4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50072/0 (socket says 172.21.15.12:50072) 2023-12-11T20:30:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/2340762670 learned_addr learned my addr 172.21.15.12:0/2340762670 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7affff700 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7af7fe700 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adec6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/2340762670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 msgr2=0x5572adec6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adec6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/2340762670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 msgr2=0x5572adec5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7b4f9c700 1 -- 172.21.15.12:0/2340762670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572adc885d0 con 0x5572adeb8720 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7b4f9c700 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec7460 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009fd0 tx=0x7fe7a80cbfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94e1d0a697485fc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe78f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe78f7fe700 1 -- 172.21.15.12:0/2340762670 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a809fa50 con 0x5572adeb8720 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe78f7fe700 1 -- 172.21.15.12:0/2340762670 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe7a80b4020 con 0x5572adeb8720 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.239+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2340762670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7a0004380 con 0x5572adeb8720 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe78f7fe700 1 -- 172.21.15.12:0/2340762670 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a809b900 con 0x5572adeb8720 2023-12-11T20:30:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe7ca273b80 10 client.19647 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2340762670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fe7a0009960 con 0x5572adeb8720 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe78f7fe700 1 -- 172.21.15.12:0/2340762670 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a0004380 con 0x5572adeb8720 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe78f7fe700 1 -- 172.21.15.12:0/2340762670 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe7a809bb60 con 0x5572adeb8720 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe7ca273b80 10 client.19647 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe7ca273b80 10 client.19647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe7ca273b80 20 client.19647 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5572adf23b50 0x5572adf25f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe7ca273b80 4 client.19647 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.240+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2340762670 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5572addd1f70 con 0x5572adf23b50 2023-12-11T20:30:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.241+0000 7fe7affff700 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5572adf23b50 0x5572adf25f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.241+0000 7fe7affff700 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5572adf23b50 0x5572adf25f70 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a35b69af7f840ffc server_cookie=7f703cd3c593dc3f in_seq=0 out_seq=0 2023-12-11T20:30:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.241+0000 7fe78f7fe700 10 client.19647 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.251+0000 7fe78f7fe700 1 -- 172.21.15.12:0/2340762670 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5572addd1f70 con 0x5572adf23b50 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.251+0000 7fe78f7fe700 10 client.19647 handle_command_reply: tid=0 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.251+0000 7fe7ca273b80 1 client.19647 shutdown 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2340762670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 msgr2=0x5572adec7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec7460 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009fd0 tx=0x7fe7a80cbfd0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2340762670 shutdown_connections 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5572adf23b50 0x5572adf25f70 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5572adeb6ed0 0x5572adec5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572adeb8720 0x5572adec7460 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 --2- 172.21.15.12:0/2340762670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5572adeb7830 0x5572adec6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2340762670 >> 172.21.15.12:0/2340762670 conn(0x5572adde6780 msgr2=0x5572adec01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe78f7fe700 0 client.19647 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2340762670 shutdown_connections 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 1 -- 172.21.15.12:0/2340762670 wait complete. 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.252+0000 7fe7ca273b80 20 client.19647 trim_cache size 0 max 16384 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:30:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:30:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:30:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 -- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7980a1470 msgr2=0x7fe7980a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7980a1470 0x7fe7980a3930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4011550 tx=0x7fe7a4011860 comp rx=0 tx=0).stop 2023-12-11T20:30:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 -- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 msgr2=0x7fe7b01a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 0x7fe7b01a0b70 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80079c0 tx=0x7fe7a800cab0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 -- 172.21.15.12:0/3945144666 shutdown_connections 2023-12-11T20:30:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe7980a1470 0x7fe7980a3930 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7b0105260 0x7fe7b01a0b70 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7b01036d0 0x7fe7b0199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 --2- 172.21.15.12:0/3945144666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7b01048c0 0x7fe7b0199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 -- 172.21.15.12:0/3945144666 >> 172.21.15.12:0/3945144666 conn(0x7fe7b00fec80 msgr2=0x7fe7b0107c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 -- 172.21.15.12:0/3945144666 shutdown_connections 2023-12-11T20:30:31.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:31.253+0000 7fe7b69ff700 1 -- 172.21.15.12:0/3945144666 wait complete. 2023-12-11T20:30:31.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:30 smithi039 ceph-mon[102205]: pgmap v812: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:30:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:30 smithi012 ceph-mon[128787]: pgmap v812: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 17 op/s 2023-12-11T20:30:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:32 smithi032 ceph-mon[132488]: pgmap v813: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 11 op/s 2023-12-11T20:30:33.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:32 smithi039 ceph-mon[102205]: pgmap v813: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 11 op/s 2023-12-11T20:30:33.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:32 smithi012 ceph-mon[128787]: pgmap v813: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 MiB/s wr, 11 op/s 2023-12-11T20:30:35.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:34 smithi032 ceph-mon[132488]: pgmap v814: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:30:35.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:34 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:30:35.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:34 smithi039 ceph-mon[102205]: pgmap v814: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:30:35.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:34 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:30:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:34 smithi012 ceph-mon[128787]: pgmap v814: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:30:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:34 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:30:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:36 smithi032 ceph-mon[132488]: pgmap v815: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:30:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:36 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:30:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:36 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:30:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:36 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:30:37.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:36 smithi039 ceph-mon[102205]: pgmap v815: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:30:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:36 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:30:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:36 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:30:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:36 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:30:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:36 smithi012 ceph-mon[128787]: pgmap v815: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:30:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:36 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:30:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:36 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:30:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:36 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:30:39.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:38 smithi032 ceph-mon[132488]: pgmap v816: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:30:39.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:38 smithi039 ceph-mon[102205]: pgmap v816: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:30:39.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:38 smithi012 ceph-mon[128787]: pgmap v816: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:30:41.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:40 smithi039 ceph-mon[102205]: pgmap v817: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:30:41.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:40 smithi012 ceph-mon[128787]: pgmap v817: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:30:41.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:40 smithi032 ceph-mon[132488]: pgmap v817: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:30:43.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:42 smithi039 ceph-mon[102205]: pgmap v818: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:30:43.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:42 smithi012 ceph-mon[128787]: pgmap v818: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:30:43.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:42 smithi032 ceph-mon[132488]: pgmap v818: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:30:44.303 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:30:44.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 -- 172.21.15.12:0/3508099365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550101f40 msgr2=0x7fc550104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 --2- 172.21.15.12:0/3508099365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550101f40 0x7fc550104330 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc540009990 tx=0x7fc540009ca0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 -- 172.21.15.12:0/3508099365 shutdown_connections 2023-12-11T20:30:44.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 --2- 172.21.15.12:0/3508099365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5501071a0 0x7fc550109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.436 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 --2- 172.21.15.12:0/3508099365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550101f40 0x7fc550104330 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 --2- 172.21.15.12:0/3508099365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc550104870 0x7fc550106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 -- 172.21.15.12:0/3508099365 >> 172.21.15.12:0/3508099365 conn(0x7fc5500fb930 msgr2=0x7fc5500fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 -- 172.21.15.12:0/3508099365 shutdown_connections 2023-12-11T20:30:44.437 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.437+0000 7fc554fff700 1 -- 172.21.15.12:0/3508099365 wait complete. 2023-12-11T20:30:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.439+0000 7fc554fff700 1 Processor -- start 2023-12-11T20:30:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.439+0000 7fc554fff700 1 -- start start 2023-12-11T20:30:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc554fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc550101f40 0x7fc5501994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc554fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550104870 0x7fc550199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc554fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5501071a0 0x7fc5501a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc554fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5501a1020 con 0x7fc550104870 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc554fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5501a1160 con 0x7fc5501071a0 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc554fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5501a12f0 con 0x7fc550101f40 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc54e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc550101f40 0x7fc5501994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc54dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550104870 0x7fc550199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc54e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc550101f40 0x7fc5501994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:37654/0 (socket says 172.21.15.12:37654) 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc54e59c700 1 -- 172.21.15.12:0/1393580824 learned_addr learned my addr 172.21.15.12:0/1393580824 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.440+0000 7fc54ed9d700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5501071a0 0x7fc5501a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc54e59c700 1 -- 172.21.15.12:0/1393580824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5501071a0 msgr2=0x7fc5501a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc54e59c700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5501071a0 0x7fc5501a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc54e59c700 1 -- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550104870 msgr2=0x7fc550199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc54e59c700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550104870 0x7fc550199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc54e59c700 1 -- 172.21.15.12:0/1393580824 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400095f0 con 0x7fc550101f40 2023-12-11T20:30:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550104870 0x7fc550199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc54e59c700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc550101f40 0x7fc5501994f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc54000b2e0 tx=0x7fc540004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc53f7fe700 1 -- 172.21.15.12:0/1393580824 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54001d070 con 0x7fc550101f40 2023-12-11T20:30:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.441+0000 7fc53f7fe700 1 -- 172.21.15.12:0/1393580824 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc54000beb0 con 0x7fc550101f40 2023-12-11T20:30:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.442+0000 7fc554fff700 1 -- 172.21.15.12:0/1393580824 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5501a1570 con 0x7fc550101f40 2023-12-11T20:30:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.442+0000 7fc53f7fe700 1 -- 172.21.15.12:0/1393580824 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540021410 con 0x7fc550101f40 2023-12-11T20:30:44.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.442+0000 7fc554fff700 1 -- 172.21.15.12:0/1393580824 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5501a19f0 con 0x7fc550101f40 2023-12-11T20:30:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.446+0000 7fc53f7fe700 1 -- 172.21.15.12:0/1393580824 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc54000f640 con 0x7fc550101f40 2023-12-11T20:30:44.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.446+0000 7fc568890b80 1 Processor -- start 2023-12-11T20:30:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.447+0000 7fc568890b80 1 -- start start 2023-12-11T20:30:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.447+0000 7fc568890b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 0x56445070a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.447+0000 7fc568890b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445070b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.447+0000 7fc568890b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070b720 0x56445070bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.447+0000 7fc568890b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564450665af0 con 0x56445070a830 2023-12-11T20:30:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.447+0000 7fc568890b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564450663410 con 0x56445070b720 2023-12-11T20:30:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.447+0000 7fc568890b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445065ed00 con 0x564450709ed0 2023-12-11T20:30:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.448+0000 7fc54ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 0x56445070a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.448+0000 7fc54e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445070b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.448+0000 7fc54dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070b720 0x56445070bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.448+0000 7fc54dd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070b720 0x56445070bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37016/0 (socket says 172.21.15.12:37016) 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.448+0000 7fc54dd9b700 1 -- 172.21.15.12:0/2347224665 learned_addr learned my addr 172.21.15.12:0/2347224665 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc54dd9b700 1 -- 172.21.15.12:0/2347224665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 msgr2=0x56445070a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/2347224665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 0x56445070a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc54dd9b700 1 -- 172.21.15.12:0/2347224665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 msgr2=0x56445070b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/2347224665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445070b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc54dd9b700 1 -- 172.21.15.12:0/2347224665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644504db5d0 con 0x56445070b720 2023-12-11T20:30:44.449 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc53f7fe700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5380a14f0 0x7fc5380a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc53f7fe700 1 -- 172.21.15.12:0/1393580824 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc5400ce0c0 con 0x7fc550101f40 2023-12-11T20:30:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/2347224665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070b720 0x56445070bba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc5440115f0 tx=0x7fc544011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a7565c2591b808 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.449+0000 7fc54ed9d700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5380a14f0 0x7fc5380a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.450+0000 7fc53cff9700 1 -- 172.21.15.12:0/2347224665 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544019630 con 0x56445070b720 2023-12-11T20:30:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.450+0000 7fc53cff9700 1 -- 172.21.15.12:0/2347224665 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc544019c20 con 0x56445070b720 2023-12-11T20:30:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.450+0000 7fc53cff9700 1 -- 172.21.15.12:0/2347224665 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400eb40 con 0x56445070b720 2023-12-11T20:30:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 -- 172.21.15.12:0/2347224665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070b720 msgr2=0x56445070bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc54ed9d700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5380a14f0 0x7fc5380a39b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc548009e10 tx=0x7fc548009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 --2- 172.21.15.12:0/2347224665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070b720 0x56445070bba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc5440115f0 tx=0x7fc544011900 comp rx=0 tx=0).stop 2023-12-11T20:30:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 -- 172.21.15.12:0/2347224665 shutdown_connections 2023-12-11T20:30:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 --2- 172.21.15.12:0/2347224665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070b720 0x56445070bba0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 --2- 172.21.15.12:0/2347224665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 0x56445070a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 --2- 172.21.15.12:0/2347224665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445070b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 -- 172.21.15.12:0/2347224665 >> 172.21.15.12:0/2347224665 conn(0x564450639780 msgr2=0x564450706880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 -- 172.21.15.12:0/2347224665 shutdown_connections 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 -- 172.21.15.12:0/2347224665 wait complete. 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.451+0000 7fc568890b80 1 -- start start 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.452+0000 7fc568890b80 1 Processor -- start 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.452+0000 7fc568890b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 0x564450713e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.452+0000 7fc568890b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070a830 0x5644507143d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.452+0000 7fc568890b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070b720 0x56445071b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.452+0000 7fc568890b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564450618500 con 0x56445070b720 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.452+0000 7fc568890b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644506181a0 con 0x56445070a830 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.452+0000 7fc568890b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644504dd8c0 con 0x564450709ed0 2023-12-11T20:30:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.452+0000 7fc568890b80 10 client.0 _ll_register_callbacks cb 0x564450543a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070b720 0x56445071b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070b720 0x56445071b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50844/0 (socket says 172.21.15.12:50844) 2023-12-11T20:30:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54ed9d700 1 -- 172.21.15.12:0/3614170799 learned_addr learned my addr 172.21.15.12:0/3614170799 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54e59c700 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 0x564450713e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070a830 0x5644507143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54ed9d700 1 -- 172.21.15.12:0/3614170799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 msgr2=0x564450713e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54ed9d700 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 0x564450713e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54ed9d700 1 -- 172.21.15.12:0/3614170799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070a830 msgr2=0x5644507143d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54ed9d700 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070a830 0x5644507143d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.453+0000 7fc54ed9d700 1 -- 172.21.15.12:0/3614170799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc544009dd0 con 0x56445070b720 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.454+0000 7fc54ed9d700 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070b720 0x56445071b200 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fc548018e70 tx=0x7fc548004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e67079e22c4ce6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.454+0000 7fc535ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.454+0000 7fc535ffb700 1 -- 172.21.15.12:0/3614170799 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548016ab0 con 0x56445070b720 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.454+0000 7fc568890b80 1 -- 172.21.15.12:0/3614170799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644506fd730 con 0x56445070b720 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.454+0000 7fc535ffb700 1 -- 172.21.15.12:0/3614170799 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc548016c10 con 0x56445070b720 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.454+0000 7fc535ffb700 1 -- 172.21.15.12:0/3614170799 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc548016dd0 con 0x56445070b720 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.454+0000 7fc568890b80 10 client.19659 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.454+0000 7fc568890b80 1 -- 172.21.15.12:0/3614170799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x564450487d80 con 0x56445070b720 2023-12-11T20:30:44.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.455+0000 7fc535ffb700 1 -- 172.21.15.12:0/3614170799 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc548032020 con 0x56445070b720 2023-12-11T20:30:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.455+0000 7fc535ffb700 1 -- 172.21.15.12:0/3614170799 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc54802c400 con 0x56445070b720 2023-12-11T20:30:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.455+0000 7fc568890b80 10 client.19659 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.455+0000 7fc568890b80 10 client.19659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.455+0000 7fc568890b80 20 client.19659 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.455+0000 7fc568890b80 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56445071fe30 0x564450722250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.455+0000 7fc568890b80 4 client.19659 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.455+0000 7fc568890b80 1 -- 172.21.15.12:0/3614170799 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644506d9ee0 con 0x56445071fe30 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.456+0000 7fc54e59c700 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56445071fe30 0x564450722250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.456+0000 7fc535ffb700 10 client.19659 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.456+0000 7fc54e59c700 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56445071fe30 0x564450722250 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be4559da7d099905 server_cookie=156fda69ef19b848 in_seq=0 out_seq=0 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc535ffb700 1 -- 172.21.15.12:0/3614170799 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5644506d9ee0 con 0x56445071fe30 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc535ffb700 10 client.19659 handle_command_reply: tid=0 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 client.19659 shutdown 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 -- 172.21.15.12:0/3614170799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070b720 msgr2=0x56445071b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070b720 0x56445071b200 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fc548018e70 tx=0x7fc548004ad0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 -- 172.21.15.12:0/3614170799 shutdown_connections 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56445071fe30 0x564450722250 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070b720 0x56445071b200 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564450709ed0 0x564450713e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 --2- 172.21.15.12:0/3614170799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56445070a830 0x5644507143d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.457+0000 7fc568890b80 1 -- 172.21.15.12:0/3614170799 >> 172.21.15.12:0/3614170799 conn(0x564450639780 msgr2=0x564450704ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.458+0000 7fc535ffb700 0 client.19659 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.458+0000 7fc568890b80 1 -- 172.21.15.12:0/3614170799 shutdown_connections 2023-12-11T20:30:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.458+0000 7fc568890b80 1 -- 172.21.15.12:0/3614170799 wait complete. 2023-12-11T20:30:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.458+0000 7fc568890b80 20 client.19659 trim_cache size 0 max 16384 2023-12-11T20:30:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.480+0000 7fc568890b80 1 Processor -- start 2023-12-11T20:30:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.480+0000 7fc568890b80 1 -- start start 2023-12-11T20:30:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc568890b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 0x56445071bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc568890b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445071b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc568890b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 0x56445070e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc568890b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644507018d0 con 0x56445070a830 2023-12-11T20:30:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc568890b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445070f1d0 con 0x564450709ed0 2023-12-11T20:30:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc568890b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644506fd4c0 con 0x56445070b720 2023-12-11T20:30:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc54dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445071b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc54dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445071b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50852/0 (socket says 172.21.15.12:50852) 2023-12-11T20:30:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc54dd9b700 1 -- 172.21.15.12:0/1529428933 learned_addr learned my addr 172.21.15.12:0/1529428933 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc54e59c700 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 0x56445071bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.481+0000 7fc54ed9d700 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 0x56445070e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc54dd9b700 1 -- 172.21.15.12:0/1529428933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 msgr2=0x56445070e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 0x56445070e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc54dd9b700 1 -- 172.21.15.12:0/1529428933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 msgr2=0x56445071bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 0x56445071bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc54dd9b700 1 -- 172.21.15.12:0/1529428933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564450470c00 con 0x56445070a830 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445071b120 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fc54401c040 tx=0x7fc544005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4418d62de4c87e19 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc53d7fa700 1 -- 172.21.15.12:0/1529428933 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544019630 con 0x56445070a830 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc53d7fa700 1 -- 172.21.15.12:0/1529428933 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc54400e4f0 con 0x56445070a830 2023-12-11T20:30:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.482+0000 7fc53d7fa700 1 -- 172.21.15.12:0/1529428933 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544004950 con 0x56445070a830 2023-12-11T20:30:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 -- 172.21.15.12:0/1529428933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 msgr2=0x56445071b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445071b120 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fc54401c040 tx=0x7fc544005d80 comp rx=0 tx=0).stop 2023-12-11T20:30:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 -- 172.21.15.12:0/1529428933 shutdown_connections 2023-12-11T20:30:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 0x56445071bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 0x56445070e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 --2- 172.21.15.12:0/1529428933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x56445071b120 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 -- 172.21.15.12:0/1529428933 >> 172.21.15.12:0/1529428933 conn(0x564450639780 msgr2=0x564450713190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 -- 172.21.15.12:0/1529428933 shutdown_connections 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.483+0000 7fc568890b80 1 -- 172.21.15.12:0/1529428933 wait complete. 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.484+0000 7fc568890b80 1 -- start start 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.484+0000 7fc568890b80 1 Processor -- start 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.484+0000 7fc568890b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 0x564450718a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.484+0000 7fc568890b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x564450718f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.484+0000 7fc568890b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 0x564450719f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.484+0000 7fc568890b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445071a4d0 con 0x56445070a830 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.484+0000 7fc568890b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445071a640 con 0x564450709ed0 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.484+0000 7fc568890b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445071a800 con 0x56445070b720 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc568890b80 10 client.0 _ll_register_callbacks cb 0x564450543a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x564450718f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x564450718f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50868/0 (socket says 172.21.15.12:50868) 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54dd9b700 1 -- 172.21.15.12:0/247811839 learned_addr learned my addr 172.21.15.12:0/247811839 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54e59c700 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 0x564450718a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54ed9d700 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 0x564450719f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54dd9b700 1 -- 172.21.15.12:0/247811839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 msgr2=0x564450719f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 0x564450719f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54dd9b700 1 -- 172.21.15.12:0/247811839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 msgr2=0x564450718a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 0x564450718a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.485+0000 7fc54dd9b700 1 -- 172.21.15.12:0/247811839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644504db5d0 con 0x56445070a830 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.486+0000 7fc54dd9b700 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x564450718f80 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fc5440094e0 tx=0x7fc544005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd1dc821681ee1c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.486+0000 7fc535ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.486+0000 7fc535ffb700 1 -- 172.21.15.12:0/247811839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544019a00 con 0x56445070a830 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.486+0000 7fc535ffb700 1 -- 172.21.15.12:0/247811839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc544032070 con 0x56445070a830 2023-12-11T20:30:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.486+0000 7fc568890b80 1 -- 172.21.15.12:0/247811839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564450712cb0 con 0x56445070a830 2023-12-11T20:30:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.486+0000 7fc535ffb700 1 -- 172.21.15.12:0/247811839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc544003680 con 0x56445070a830 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.486+0000 7fc568890b80 10 client.19665 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.486+0000 7fc568890b80 1 -- 172.21.15.12:0/247811839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5644504ae1f0 con 0x56445070a830 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc535ffb700 1 -- 172.21.15.12:0/247811839 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564450712cb0 con 0x56445070a830 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc535ffb700 1 -- 172.21.15.12:0/247811839 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc54400ea30 con 0x56445070a830 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc568890b80 10 client.19665 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc568890b80 10 client.19665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc568890b80 20 client.19665 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc568890b80 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5644507769e0 0x564450778e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc568890b80 4 client.19665 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc568890b80 1 -- 172.21.15.12:0/247811839 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fc544019c20 con 0x5644507769e0 2023-12-11T20:30:44.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.487+0000 7fc54e59c700 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5644507769e0 0x564450778e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.488+0000 7fc535ffb700 10 client.19665 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:44.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.488+0000 7fc54e59c700 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5644507769e0 0x564450778e00 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d2b8c91b785b7c7 server_cookie=34e3d8f1e1e14581 in_seq=0 out_seq=0 2023-12-11T20:30:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.499+0000 7fc535ffb700 1 -- 172.21.15.12:0/247811839 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fc544019c20 con 0x5644507769e0 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.499+0000 7fc535ffb700 10 client.19665 handle_command_reply: tid=0 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.499+0000 7fc568890b80 1 client.19665 shutdown 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.499+0000 7fc568890b80 1 -- 172.21.15.12:0/247811839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 msgr2=0x564450718f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.499+0000 7fc568890b80 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x564450718f80 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fc5440094e0 tx=0x7fc544005760 comp rx=0 tx=0).stop 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 1 -- 172.21.15.12:0/247811839 shutdown_connections 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5644507769e0 0x564450778e00 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x564450709ed0 0x564450718a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56445070b720 0x564450719f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 1 --2- 172.21.15.12:0/247811839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56445070a830 0x564450718f80 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 1 -- 172.21.15.12:0/247811839 >> 172.21.15.12:0/247811839 conn(0x564450639780 msgr2=0x56445070e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc535ffb700 0 client.19665 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 1 -- 172.21.15.12:0/247811839 shutdown_connections 2023-12-11T20:30:44.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 1 -- 172.21.15.12:0/247811839 wait complete. 2023-12-11T20:30:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.500+0000 7fc568890b80 20 client.19665 trim_cache size 0 max 16384 2023-12-11T20:30:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:30:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:30:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:30:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:30:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 -- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5380a14f0 msgr2=0x7fc5380a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5380a14f0 0x7fc5380a39b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc548009e10 tx=0x7fc548009040 comp rx=0 tx=0).stop 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 -- 172.21.15.12:0/1393580824 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc550101f40 msgr2=0x7fc5501994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc550101f40 0x7fc5501994f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc54000b2e0 tx=0x7fc540004730 comp rx=0 tx=0).stop 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 -- 172.21.15.12:0/1393580824 shutdown_connections 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5380a14f0 0x7fc5380a39b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5501071a0 0x7fc5501a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc550101f40 0x7fc5501994f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 --2- 172.21.15.12:0/1393580824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc550104870 0x7fc550199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 -- 172.21.15.12:0/1393580824 >> 172.21.15.12:0/1393580824 conn(0x7fc5500fb930 msgr2=0x7fc5501014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 -- 172.21.15.12:0/1393580824 shutdown_connections 2023-12-11T20:30:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:44.501+0000 7fc554fff700 1 -- 172.21.15.12:0/1393580824 wait complete. 2023-12-11T20:30:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 -- 172.21.15.12:0/1140917722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc104930 msgr2=0x7feadc106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 --2- 172.21.15.12:0/1140917722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc104930 0x7feadc106d20 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fead0009990 tx=0x7fead0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 -- 172.21.15.12:0/1140917722 shutdown_connections 2023-12-11T20:30:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 --2- 172.21.15.12:0/1140917722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feadc102000 0x7feadc1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 --2- 172.21.15.12:0/1140917722 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc107260 0x7feadc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 --2- 172.21.15.12:0/1140917722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc104930 0x7feadc106d20 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 -- 172.21.15.12:0/1140917722 >> 172.21.15.12:0/1140917722 conn(0x7feadc0fb930 msgr2=0x7feadc0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 -- 172.21.15.12:0/1140917722 shutdown_connections 2023-12-11T20:30:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.574+0000 7feae15ff700 1 -- 172.21.15.12:0/1140917722 wait complete. 2023-12-11T20:30:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feae15ff700 1 Processor -- start 2023-12-11T20:30:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feae15ff700 1 -- start start 2023-12-11T20:30:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feae15ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc102000 0x7feadc101920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feae15ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feadc104930 0x7feadc0fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feae15ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc107260 0x7feadc1004f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feae15ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc100c90 con 0x7feadc102000 2023-12-11T20:30:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feae15ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc100e00 con 0x7feadc104930 2023-12-11T20:30:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feae15ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc1a13e0 con 0x7feadc107260 2023-12-11T20:30:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feadaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc102000 0x7feadc101920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.576+0000 7feadaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc102000 0x7feadc101920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50878/0 (socket says 172.21.15.12:50878) 2023-12-11T20:30:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feadaffd700 1 -- 172.21.15.12:0/2521635501 learned_addr learned my addr 172.21.15.12:0/2521635501 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feada7fc700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feadc104930 0x7feadc0fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feadaffd700 1 -- 172.21.15.12:0/2521635501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc107260 msgr2=0x7feadc1004f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feadaffd700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc107260 0x7feadc1004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feadaffd700 1 -- 172.21.15.12:0/2521635501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feadc104930 msgr2=0x7feadc0fffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feadaffd700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feadc104930 0x7feadc0fffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feadaffd700 1 -- 172.21.15.12:0/2521635501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00095f0 con 0x7feadc102000 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feadaffd700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc102000 0x7feadc101920 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7feacc00e9a0 tx=0x7feacc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.577+0000 7feac3fff700 1 -- 172.21.15.12:0/2521635501 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc009790 con 0x7feadc102000 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.578+0000 7feac3fff700 1 -- 172.21.15.12:0/2521635501 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feacc010430 con 0x7feadc102000 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.578+0000 7feae15ff700 1 -- 172.21.15.12:0/2521635501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc1a1670 con 0x7feadc102000 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.578+0000 7feac3fff700 1 -- 172.21.15.12:0/2521635501 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc018680 con 0x7feadc102000 2023-12-11T20:30:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.578+0000 7feae15ff700 1 -- 172.21.15.12:0/2521635501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc1a1b80 con 0x7feadc102000 2023-12-11T20:30:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.581+0000 7feac3fff700 1 -- 172.21.15.12:0/2521635501 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7feacc0105a0 con 0x7feadc102000 2023-12-11T20:30:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feaf4eb0b80 1 Processor -- start 2023-12-11T20:30:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feaf4eb0b80 1 -- start start 2023-12-11T20:30:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feac3fff700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7feac40a1480 0x7feac40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814db7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dbd30 0x560f814dc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f81436b50 con 0x560f814dcc20 2023-12-11T20:30:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f81434470 con 0x560f814dbd30 2023-12-11T20:30:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f8142fd60 con 0x560f814db3d0 2023-12-11T20:30:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.583+0000 7feac3fff700 1 -- 172.21.15.12:0/2521635501 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feacc014070 con 0x7feadc102000 2023-12-11T20:30:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadb7fe700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7feac40a1480 0x7feac40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feada7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dbd30 0x560f814dc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814db7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feada7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dbd30 0x560f814dc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37072/0 (socket says 172.21.15.12:37072) 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feada7fc700 1 -- 172.21.15.12:0/1297858935 learned_addr learned my addr 172.21.15.12:0/1297858935 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadaffd700 1 -- 172.21.15.12:0/1297858935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dbd30 msgr2=0x560f814dc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadaffd700 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dbd30 0x560f814dc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadaffd700 1 -- 172.21.15.12:0/1297858935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 msgr2=0x560f814dd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadaffd700 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814dd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadaffd700 1 -- 172.21.15.12:0/1297858935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f812ac630 con 0x560f814db3d0 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feada7fc700 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dbd30 0x560f814dc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.584+0000 7feadb7fe700 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814dd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.585+0000 7feadaffd700 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814db7f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feacc0caaa0 tx=0x7feacc096730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a828fafb1449b73c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.585+0000 7feadb7fe700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7feac40a1480 0x7feac40a3940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fead4009690 tx=0x7fead400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.585+0000 7feac17fa700 1 -- 172.21.15.12:0/1297858935 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc086230 con 0x560f814db3d0 2023-12-11T20:30:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.585+0000 7feac17fa700 1 -- 172.21.15.12:0/1297858935 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feacc010880 con 0x560f814db3d0 2023-12-11T20:30:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.585+0000 7feac17fa700 1 -- 172.21.15.12:0/1297858935 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc098400 con 0x560f814db3d0 2023-12-11T20:30:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/1297858935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 msgr2=0x560f814db7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814db7f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feacc0caaa0 tx=0x7feacc096730 comp rx=0 tx=0).stop 2023-12-11T20:30:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/1297858935 shutdown_connections 2023-12-11T20:30:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814dd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814db7f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/1297858935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dbd30 0x560f814dc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/1297858935 >> 172.21.15.12:0/1297858935 conn(0x560f8140a7e0 msgr2=0x560f814d7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/1297858935 shutdown_connections 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/1297858935 wait complete. 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.586+0000 7feaf4eb0b80 1 -- start start 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.587+0000 7feaf4eb0b80 1 Processor -- start 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.587+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814db3d0 0x560f814e5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.587+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814e5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.587+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.587+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f813e9560 con 0x560f814dcc20 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.587+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f813e9200 con 0x560f814db3d0 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.587+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f812ae920 con 0x560f814dbd30 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.587+0000 7feaf4eb0b80 10 client.0 _ll_register_callbacks cb 0x560f81314a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814db3d0 0x560f814e5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814ec7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50888/0 (socket says 172.21.15.12:50888) 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadb7fe700 1 -- 172.21.15.12:0/404423718 learned_addr learned my addr 172.21.15.12:0/404423718 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feada7fc700 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadb7fe700 1 -- 172.21.15.12:0/404423718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 msgr2=0x560f814e5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadb7fe700 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814e5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadb7fe700 1 -- 172.21.15.12:0/404423718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814db3d0 msgr2=0x560f814e5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadb7fe700 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814db3d0 0x560f814e5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadb7fe700 1 -- 172.21.15.12:0/404423718 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead4012a30 con 0x560f814dcc20 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feadaffd700 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814db3d0 0x560f814e5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.588+0000 7feada7fc700 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814e5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feadb7fe700 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814ec7b0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fead40093f0 tx=0x7fead4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc898957610c4860 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feabeff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feabeff5700 1 -- 172.21.15.12:0/404423718 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead401e070 con 0x560f814dcc20 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/404423718 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f814ceb40 con 0x560f814dcc20 2023-12-11T20:30:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feabeff5700 1 -- 172.21.15.12:0/404423718 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fead4004bb0 con 0x560f814dcc20 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feabeff5700 1 -- 172.21.15.12:0/404423718 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead4009ea0 con 0x560f814dcc20 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feaf4eb0b80 10 client.19677 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/404423718 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7feadc1a1b80 con 0x560f814dcc20 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.589+0000 7feabeff5700 1 -- 172.21.15.12:0/404423718 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560f814ceb40 con 0x560f814dcc20 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.590+0000 7feabeff5700 1 -- 172.21.15.12:0/404423718 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fead4023500 con 0x560f814dcc20 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.590+0000 7feaf4eb0b80 10 client.19677 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.590+0000 7feaf4eb0b80 10 client.19677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.590+0000 7feaf4eb0b80 20 client.19677 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.590+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560f814f1080 0x560f814f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.590+0000 7feaf4eb0b80 4 client.19677 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.590+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/404423718 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f814aaf40 con 0x560f814f1080 2023-12-11T20:30:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.590+0000 7feadaffd700 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560f814f1080 0x560f814f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.591+0000 7feadaffd700 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560f814f1080 0x560f814f34a0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=708d3574cb2e0e84 server_cookie=aa7a76ae72245600 in_seq=0 out_seq=0 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.591+0000 7feabeff5700 10 client.19677 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.591+0000 7feabeff5700 1 -- 172.21.15.12:0/404423718 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560f814aaf40 con 0x560f814f1080 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.591+0000 7feabeff5700 10 client.19677 handle_command_reply: tid=0 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 client.19677 shutdown 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/404423718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 msgr2=0x560f814ec7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814ec7b0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fead40093f0 tx=0x7fead4004ad0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/404423718 shutdown_connections 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560f814f1080 0x560f814f34a0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814db3d0 0x560f814e5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dcc20 0x560f814ec7b0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feabeff5700 0 client.19677 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/404423718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814e5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/404423718 >> 172.21.15.12:0/404423718 conn(0x560f8140a7e0 msgr2=0x560f814d6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/404423718 shutdown_connections 2023-12-11T20:30:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/404423718 wait complete. 2023-12-11T20:30:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.592+0000 7feaf4eb0b80 20 client.19677 trim_cache size 0 max 16384 2023-12-11T20:30:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feaf4eb0b80 1 Processor -- start 2023-12-11T20:30:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feaf4eb0b80 1 -- start start 2023-12-11T20:30:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814db3d0 0x560f814e4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814ec6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f814daf70 con 0x560f814db3d0 2023-12-11T20:30:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f814ed930 con 0x560f814dcc20 2023-12-11T20:30:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f814e4dd0 con 0x560f814dbd30 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feadaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814db3d0 0x560f814e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feadaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814db3d0 0x560f814e4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50898/0 (socket says 172.21.15.12:50898) 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.613+0000 7feadaffd700 1 -- 172.21.15.12:0/400827908 learned_addr learned my addr 172.21.15.12:0/400827908 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feadb7fe700 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814ec6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feada7fc700 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feadb7fe700 1 -- 172.21.15.12:0/400827908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 msgr2=0x560f814dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feadb7fe700 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814dd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feadb7fe700 1 -- 172.21.15.12:0/400827908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814db3d0 msgr2=0x560f814e4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feadb7fe700 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814db3d0 0x560f814e4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feadb7fe700 1 -- 172.21.15.12:0/400827908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f81258de0 con 0x560f814dcc20 2023-12-11T20:30:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feadaffd700 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814db3d0 0x560f814e4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.614+0000 7feadb7fe700 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814ec6d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fead40238b0 tx=0x7fead4009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd8693b3e67ebe8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.615+0000 7feac1ffb700 1 -- 172.21.15.12:0/400827908 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead401e030 con 0x560f814dcc20 2023-12-11T20:30:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.615+0000 7feac1ffb700 1 -- 172.21.15.12:0/400827908 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fead4012bc0 con 0x560f814dcc20 2023-12-11T20:30:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.615+0000 7feac1ffb700 1 -- 172.21.15.12:0/400827908 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400e050 con 0x560f814dcc20 2023-12-11T20:30:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.615+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/400827908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 msgr2=0x560f814ec6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.615+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814ec6d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fead40238b0 tx=0x7fead4009b00 comp rx=0 tx=0).stop 2023-12-11T20:30:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/400827908 shutdown_connections 2023-12-11T20:30:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814ec6d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814db3d0 0x560f814e4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/400827908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814dbd30 0x560f814dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/400827908 >> 172.21.15.12:0/400827908 conn(0x560f8140a7e0 msgr2=0x560f814e31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/400827908 shutdown_connections 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/400827908 wait complete. 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 -- start start 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.616+0000 7feaf4eb0b80 1 Processor -- start 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dbd30 0x560f814ea410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feaf4eb0b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814eb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f814eb8c0 con 0x560f814dbd30 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f814eba30 con 0x560f814dcc20 2023-12-11T20:30:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feaf4eb0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f814ebbf0 con 0x560f814db3d0 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feaf4eb0b80 10 client.0 _ll_register_callbacks cb 0x560f81314a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feada7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dbd30 0x560f814ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feada7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dbd30 0x560f814ea410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50904/0 (socket says 172.21.15.12:50904) 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feada7fc700 1 -- 172.21.15.12:0/2223653187 learned_addr learned my addr 172.21.15.12:0/2223653187 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feadaffd700 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814e9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.617+0000 7feadb7fe700 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814eb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feada7fc700 1 -- 172.21.15.12:0/2223653187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 msgr2=0x560f814e9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feada7fc700 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814e9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feada7fc700 1 -- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 msgr2=0x560f814eb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feada7fc700 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814eb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feada7fc700 1 -- 172.21.15.12:0/2223653187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f812ac630 con 0x560f814dbd30 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feadb7fe700 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814eb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feada7fc700 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dbd30 0x560f814ea410 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fead0000c00 tx=0x7fead00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95681f24780b12d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feabeff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feabeff5700 1 -- 172.21.15.12:0/2223653187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead001d070 con 0x560f814dbd30 2023-12-11T20:30:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/2223653187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f813f5fd0 con 0x560f814dbd30 2023-12-11T20:30:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feabeff5700 1 -- 172.21.15.12:0/2223653187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fead000b710 con 0x560f814dbd30 2023-12-11T20:30:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.618+0000 7feabeff5700 1 -- 172.21.15.12:0/2223653187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead0005980 con 0x560f814dbd30 2023-12-11T20:30:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feaf4eb0b80 10 client.19683 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/2223653187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7feadc1a1b80 con 0x560f814dbd30 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feabeff5700 1 -- 172.21.15.12:0/2223653187 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560f813f5fd0 con 0x560f814dbd30 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feabeff5700 1 -- 172.21.15.12:0/2223653187 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fead0004a60 con 0x560f814dbd30 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feaf4eb0b80 10 client.19683 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feaf4eb0b80 10 client.19683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feaf4eb0b80 20 client.19683 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560f81547e40 0x560f8154a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feaf4eb0b80 4 client.19683 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.619+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/2223653187 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560f813e8490 con 0x560f81547e40 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.620+0000 7feadaffd700 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560f81547e40 0x560f8154a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.620+0000 7feadaffd700 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560f81547e40 0x560f8154a260 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a9244ebc7c5570 server_cookie=9a07a6797068b529 in_seq=0 out_seq=0 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.620+0000 7feabeff5700 10 client.19683 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feabeff5700 1 -- 172.21.15.12:0/2223653187 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560f813e8490 con 0x560f81547e40 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feabeff5700 10 client.19683 handle_command_reply: tid=0 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 client.19683 shutdown 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/2223653187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dbd30 msgr2=0x560f814ea410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dbd30 0x560f814ea410 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fead0000c00 tx=0x7fead00057b0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/2223653187 shutdown_connections 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560f81547e40 0x560f8154a260 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560f814dcc20 0x560f814eb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560f814db3d0 0x560f814e9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 --2- 172.21.15.12:0/2223653187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f814dbd30 0x560f814ea410 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/2223653187 >> 172.21.15.12:0/2223653187 conn(0x560f8140a7e0 msgr2=0x560f814dfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feabeff5700 0 client.19683 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/2223653187 shutdown_connections 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 1 -- 172.21.15.12:0/2223653187 wait complete. 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.621+0000 7feaf4eb0b80 20 client.19683 trim_cache size 0 max 16384 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:30:44.623 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:30:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 -- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7feac40a1480 msgr2=0x7feac40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7feac40a1480 0x7feac40a3940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fead4009690 tx=0x7fead400b040 comp rx=0 tx=0).stop 2023-12-11T20:30:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 -- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc102000 msgr2=0x7feadc101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc102000 0x7feadc101920 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7feacc00e9a0 tx=0x7feacc00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 -- 172.21.15.12:0/2521635501 shutdown_connections 2023-12-11T20:30:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7feac40a1480 0x7feac40a3940 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc107260 0x7feadc1004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc102000 0x7feadc101920 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 --2- 172.21.15.12:0/2521635501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feadc104930 0x7feadc0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 -- 172.21.15.12:0/2521635501 >> 172.21.15.12:0/2521635501 conn(0x7feadc0fb930 msgr2=0x7feadc103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 -- 172.21.15.12:0/2521635501 shutdown_connections 2023-12-11T20:30:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.622+0000 7feae15ff700 1 -- 172.21.15.12:0/2521635501 wait complete. 2023-12-11T20:30:44.639 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:30:44.640 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 -- 172.21.15.12:0/3738258779 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f147c101120 msgr2=0x7f147c1015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 --2- 172.21.15.12:0/3738258779 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f147c101120 0x7f147c1015a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f147400b0a0 tx=0x7f147400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 -- 172.21.15.12:0/3738258779 shutdown_connections 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 --2- 172.21.15.12:0/3738258779 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f147c101120 0x7f147c1015a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 --2- 172.21.15.12:0/3738258779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147c0ffe00 0x7f147c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 --2- 172.21.15.12:0/3738258779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c100760 0x7f147c100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 -- 172.21.15.12:0/3738258779 >> 172.21.15.12:0/3738258779 conn(0x7f147c0fb980 msgr2=0x7f147c0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 -- 172.21.15.12:0/3738258779 shutdown_connections 2023-12-11T20:30:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.877+0000 7f1480fff700 1 -- 172.21.15.12:0/3738258779 wait complete. 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f1480fff700 1 Processor -- start 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f1480fff700 1 -- start start 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f1480fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147c0ffe00 0x7f147c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f1480fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f147c100760 0x7f147c199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f1480fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c101120 0x7f147c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f1480fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1a1160 con 0x7f147c0ffe00 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f1480fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1a12a0 con 0x7f147c100760 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f1480fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1a1430 con 0x7f147c101120 2023-12-11T20:30:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f147a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147c0ffe00 0x7f147c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f147a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147c0ffe00 0x7f147c199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50914/0 (socket says 172.21.15.12:50914) 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.879+0000 7f147a59c700 1 -- 172.21.15.12:0/1906730440 learned_addr learned my addr 172.21.15.12:0/1906730440 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.880+0000 7f147ad9d700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c101120 0x7f147c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.880+0000 7f1479d9b700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f147c100760 0x7f147c199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.880+0000 7f147a59c700 1 -- 172.21.15.12:0/1906730440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c101120 msgr2=0x7f147c1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.880+0000 7f147a59c700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c101120 0x7f147c1a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.880+0000 7f147a59c700 1 -- 172.21.15.12:0/1906730440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f147c100760 msgr2=0x7f147c199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.880+0000 7f147a59c700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f147c100760 0x7f147c199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.880+0000 7f147a59c700 1 -- 172.21.15.12:0/1906730440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009d00 con 0x7f147c0ffe00 2023-12-11T20:30:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.880+0000 7f147a59c700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147c0ffe00 0x7f147c199630 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e9a0 tx=0x7f146c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.881+0000 7f146b7fe700 1 -- 172.21.15.12:0/1906730440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c009790 con 0x7f147c0ffe00 2023-12-11T20:30:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.881+0000 7f146b7fe700 1 -- 172.21.15.12:0/1906730440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f146c010430 con 0x7f147c0ffe00 2023-12-11T20:30:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.881+0000 7f146b7fe700 1 -- 172.21.15.12:0/1906730440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00cea0 con 0x7f147c0ffe00 2023-12-11T20:30:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.881+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c1a1710 con 0x7f147c0ffe00 2023-12-11T20:30:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.881+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c1a1bd0 con 0x7f147c0ffe00 2023-12-11T20:30:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.882+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c10abe0 con 0x7f147c0ffe00 2023-12-11T20:30:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.885+0000 7f146b7fe700 1 -- 172.21.15.12:0/1906730440 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f146c0105a0 con 0x7f147c0ffe00 2023-12-11T20:30:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.886+0000 7f146b7fe700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14640a1500 0x7f14640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.886+0000 7f146b7fe700 1 -- 172.21.15.12:0/1906730440 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f146c014070 con 0x7f147c0ffe00 2023-12-11T20:30:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.887+0000 7f1479d9b700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14640a1500 0x7f14640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.887+0000 7f1479d9b700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14640a1500 0x7f14640a39c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1470009c60 tx=0x7f1470009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:44.892+0000 7f146b7fe700 1 -- 172.21.15.12:0/1906730440 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f146c0d2020 con 0x7f147c0ffe00 2023-12-11T20:30:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.226+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f147c10efd0 con 0x7f147c0ffe00 2023-12-11T20:30:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.227+0000 7f146b7fe700 1 -- 172.21.15.12:0/1906730440 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f146c096480 con 0x7f147c0ffe00 2023-12-11T20:30:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:30:45.225 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:29:56.121839+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:30:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14640a1500 msgr2=0x7f14640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14640a1500 0x7f14640a39c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1470009c60 tx=0x7f1470009260 comp rx=0 tx=0).stop 2023-12-11T20:30:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147c0ffe00 msgr2=0x7f147c199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147c0ffe00 0x7f147c199630 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e9a0 tx=0x7f146c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 shutdown_connections 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f14640a1500 0x7f14640a39c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f147c101120 0x7f147c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147c0ffe00 0x7f147c199630 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 --2- 172.21.15.12:0/1906730440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f147c100760 0x7f147c199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 >> 172.21.15.12:0/1906730440 conn(0x7f147c0fb980 msgr2=0x7f147c0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 shutdown_connections 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.230+0000 7f1480fff700 1 -- 172.21.15.12:0/1906730440 wait complete. 2023-12-11T20:30:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 32 2023-12-11T20:30:45.247 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:44 smithi012 ceph-mon[128787]: pgmap v819: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:45.250 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:30:45.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:44 smithi039 ceph-mon[102205]: pgmap v819: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:45.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:44 smithi032 ceph-mon[132488]: pgmap v819: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:30:45.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 -- 172.21.15.12:0/3323816279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 msgr2=0x7f9090109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 --2- 172.21.15.12:0/3323816279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 0x7f9090109440 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f908800b0a0 tx=0x7f908800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 -- 172.21.15.12:0/3323816279 shutdown_connections 2023-12-11T20:30:45.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 --2- 172.21.15.12:0/3323816279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 0x7f9090109440 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 --2- 172.21.15.12:0/3323816279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9090101d70 0x7f9090104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 --2- 172.21.15.12:0/3323816279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90901046a0 0x7f9090106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 -- 172.21.15.12:0/3323816279 >> 172.21.15.12:0/3323816279 conn(0x7f90900fb740 msgr2=0x7f90900fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 -- 172.21.15.12:0/3323816279 shutdown_connections 2023-12-11T20:30:45.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.489+0000 7f9096d9d700 1 -- 172.21.15.12:0/3323816279 wait complete. 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.490+0000 7f9096d9d700 1 Processor -- start 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.490+0000 7f9096d9d700 1 -- start start 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.490+0000 7f9096d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9090101d70 0x7f9090197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.490+0000 7f9096d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90901046a0 0x7f9090197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.490+0000 7f9096d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 0x7f909019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.490+0000 7f9096d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909019ec80 con 0x7f9090106fd0 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.490+0000 7f9096d9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909019edc0 con 0x7f9090101d70 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.490+0000 7f9096d9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909019ef50 con 0x7f90901046a0 2023-12-11T20:30:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 0x7f909019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 0x7f909019e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50924/0 (socket says 172.21.15.12:50924) 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909659c700 1 -- 172.21.15.12:0/834233332 learned_addr learned my addr 172.21.15.12:0/834233332 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909559a700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90901046a0 0x7f9090197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f9095d9b700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9090101d70 0x7f9090197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909659c700 1 -- 172.21.15.12:0/834233332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90901046a0 msgr2=0x7f9090197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909659c700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90901046a0 0x7f9090197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909659c700 1 -- 172.21.15.12:0/834233332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9090101d70 msgr2=0x7f9090197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909659c700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9090101d70 0x7f9090197150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.491+0000 7f909659c700 1 -- 172.21.15.12:0/834233332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088009d00 con 0x7f9090106fd0 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.492+0000 7f909659c700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 0x7f909019e6b0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f908800b780 tx=0x7f908800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.492+0000 7f9086ffd700 1 -- 172.21.15.12:0/834233332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800e040 con 0x7f9090106fd0 2023-12-11T20:30:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.492+0000 7f9086ffd700 1 -- 172.21.15.12:0/834233332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9088009480 con 0x7f9090106fd0 2023-12-11T20:30:45.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.492+0000 7f9086ffd700 1 -- 172.21.15.12:0/834233332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90880052c0 con 0x7f9090106fd0 2023-12-11T20:30:45.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.492+0000 7f9096d9d700 1 -- 172.21.15.12:0/834233332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909019f1d0 con 0x7f9090106fd0 2023-12-11T20:30:45.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.492+0000 7f9096d9d700 1 -- 172.21.15.12:0/834233332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909019f5a0 con 0x7f9090106fd0 2023-12-11T20:30:45.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.496+0000 7f9086ffd700 1 -- 172.21.15.12:0/834233332 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f908801d9a0 con 0x7f9090106fd0 2023-12-11T20:30:45.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.497+0000 7f9086ffd700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f907c0a15a0 0x7f907c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.497+0000 7f9086ffd700 1 -- 172.21.15.12:0/834233332 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f90880cdec0 con 0x7f9090106fd0 2023-12-11T20:30:45.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.497+0000 7f9095d9b700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f907c0a15a0 0x7f907c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.498+0000 7f9095d9b700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f907c0a15a0 0x7f907c0a3a60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f908c009c60 tx=0x7f908c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.498+0000 7f90ab85cb80 1 Processor -- start 2023-12-11T20:30:45.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.498+0000 7f90ab85cb80 1 -- start start 2023-12-11T20:30:45.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fd33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd1c40 0x5603e9fd20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2600 0x5603e9fd9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9f28b50 con 0x5603e9fd1c40 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9f26470 con 0x5603e9fd2f80 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9f21d60 con 0x5603e9fd2600 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f909559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd1c40 0x5603e9fd20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f909559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd1c40 0x5603e9fd20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50934/0 (socket says 172.21.15.12:50934) 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f9095d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fd33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f909559a700 1 -- 172.21.15.12:0/1099073544 learned_addr learned my addr 172.21.15.12:0/1099073544 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.499+0000 7f909659c700 1 --2- 172.21.15.12:0/1099073544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2600 0x5603e9fd9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f909559a700 1 -- 172.21.15.12:0/1099073544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2600 msgr2=0x5603e9fd9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f909559a700 1 --2- 172.21.15.12:0/1099073544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2600 0x5603e9fd9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f909559a700 1 -- 172.21.15.12:0/1099073544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 msgr2=0x5603e9fd33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f909559a700 1 --2- 172.21.15.12:0/1099073544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fd33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f909559a700 1 -- 172.21.15.12:0/1099073544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603e9d9e630 con 0x5603e9fd1c40 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f909559a700 1 --2- 172.21.15.12:0/1099073544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd1c40 0x5603e9fd20c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f908000bda0 tx=0x7f90800106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4437d5de4a95b8be server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f907bfff700 1 -- 172.21.15.12:0/1099073544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080010e10 con 0x5603e9fd1c40 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f907bfff700 1 -- 172.21.15.12:0/1099073544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9080015070 con 0x5603e9fd1c40 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.500+0000 7f907bfff700 1 -- 172.21.15.12:0/1099073544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800116a0 con 0x5603e9fd1c40 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.501+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1099073544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd1c40 msgr2=0x5603e9fd20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.501+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1099073544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd1c40 0x5603e9fd20c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f908000bda0 tx=0x7f90800106b0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.501+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1099073544 shutdown_connections 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.501+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1099073544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fd33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.501+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1099073544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2600 0x5603e9fd9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.501+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1099073544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd1c40 0x5603e9fd20c0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.501+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1099073544 >> 172.21.15.12:0/1099073544 conn(0x5603e9efc7e0 msgr2=0x5603e9fc83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.501+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1099073544 shutdown_connections 2023-12-11T20:30:45.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.502+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1099073544 wait complete. 2023-12-11T20:30:45.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.502+0000 7f90ab85cb80 1 -- start start 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.502+0000 7f90ab85cb80 1 Processor -- start 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.503+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd1c40 0x5603e9fdb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.503+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fdbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.503+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2f80 0x5603e9fe2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.503+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9edb560 con 0x5603e9fd2600 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.503+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9edb200 con 0x5603e9fd1c40 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.503+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9da0920 con 0x5603e9fd2f80 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.503+0000 7f90ab85cb80 10 client.0 _ll_register_callbacks cb 0x5603e9e06a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fdbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fdbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50948/0 (socket says 172.21.15.12:50948) 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 -- 172.21.15.12:0/1137541702 learned_addr learned my addr 172.21.15.12:0/1137541702 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f9095d9b700 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd1c40 0x5603e9fdb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909659c700 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2f80 0x5603e9fe2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 -- 172.21.15.12:0/1137541702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2f80 msgr2=0x5603e9fe2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2f80 0x5603e9fe2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 -- 172.21.15.12:0/1137541702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd1c40 msgr2=0x5603e9fdb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd1c40 0x5603e9fdb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 -- 172.21.15.12:0/1137541702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908000b9a0 con 0x5603e9fd2600 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f909559a700 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fdbd00 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f9080005d60 tx=0x7f9080010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9efb4fbc8e9beb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.504+0000 7f90797fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.505+0000 7f90797fa700 1 -- 172.21.15.12:0/1137541702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908001c690 con 0x5603e9fd2600 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.505+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1137541702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603e9fc09e0 con 0x5603e9fd2600 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.505+0000 7f90797fa700 1 -- 172.21.15.12:0/1137541702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9080017070 con 0x5603e9fd2600 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.505+0000 7f90797fa700 1 -- 172.21.15.12:0/1137541702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f908001c7f0 con 0x5603e9fd2600 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.505+0000 7f90ab85cb80 10 client.19701 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.505+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1137541702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5603e9d4ade0 con 0x5603e9fd2600 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.505+0000 7f90797fa700 1 -- 172.21.15.12:0/1137541702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5603e9fc09e0 con 0x5603e9fd2600 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.505+0000 7f90797fa700 1 -- 172.21.15.12:0/1137541702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9080003880 con 0x5603e9fd2600 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.506+0000 7f90ab85cb80 10 client.19701 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.506+0000 7f90ab85cb80 10 client.19701 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.506+0000 7f90ab85cb80 20 client.19701 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.506+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5603e9fe74e0 0x5603e9fe9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.506+0000 7f90ab85cb80 4 client.19701 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.506+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1137541702 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603e9f9cf40 con 0x5603e9fe74e0 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.506+0000 7f9095d9b700 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5603e9fe74e0 0x5603e9fe9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.507+0000 7f90797fa700 10 client.19701 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.507+0000 7f9095d9b700 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5603e9fe74e0 0x5603e9fe9900 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5578418cbe4f7807 server_cookie=c11ef23b28e98ca3 in_seq=0 out_seq=0 2023-12-11T20:30:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90797fa700 1 -- 172.21.15.12:0/1137541702 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5603e9f9cf40 con 0x5603e9fe74e0 2023-12-11T20:30:45.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90797fa700 10 client.19701 handle_command_reply: tid=0 2023-12-11T20:30:45.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 client.19701 shutdown 2023-12-11T20:30:45.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1137541702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 msgr2=0x5603e9fdbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fdbd00 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f9080005d60 tx=0x7f9080010e40 comp rx=0 tx=0).stop 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1137541702 shutdown_connections 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5603e9fe74e0 0x5603e9fe9900 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd1c40 0x5603e9fdb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd2f80 0x5603e9fe2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90797fa700 0 client.19701 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/1137541702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fdbd00 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.508+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1137541702 >> 172.21.15.12:0/1137541702 conn(0x5603e9efc7e0 msgr2=0x5603e9fcc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.509+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1137541702 shutdown_connections 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.509+0000 7f90ab85cb80 1 -- 172.21.15.12:0/1137541702 wait complete. 2023-12-11T20:30:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.509+0000 7f90ab85cb80 20 client.19701 trim_cache size 0 max 16384 2023-12-11T20:30:45.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f90ab85cb80 1 Processor -- start 2023-12-11T20:30:45.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f90ab85cb80 1 -- start start 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 0x5603e9fdacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fc8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9fd3ab0 con 0x5603e9fd2600 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9feeaf0 con 0x5603e9fd2f80 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9fc31e0 con 0x5603e9fd1c40 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f909559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f909559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50958/0 (socket says 172.21.15.12:50958) 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.528+0000 7f909559a700 1 -- 172.21.15.12:0/4162549008 learned_addr learned my addr 172.21.15.12:0/4162549008 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f9095d9b700 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 0x5603e9fdacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f909659c700 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fc8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f909559a700 1 -- 172.21.15.12:0/4162549008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 msgr2=0x5603e9fdacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f909559a700 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 0x5603e9fdacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f909559a700 1 -- 172.21.15.12:0/4162549008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 msgr2=0x5603e9fc8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f909559a700 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fc8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f909559a700 1 -- 172.21.15.12:0/4162549008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603e9d33c60 con 0x5603e9fd2600 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f909559a700 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe2d00 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f908000b450 tx=0x7f9080005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389983e4eadf0c8d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f9084ff9700 1 -- 172.21.15.12:0/4162549008 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080003880 con 0x5603e9fd2600 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f9084ff9700 1 -- 172.21.15.12:0/4162549008 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90800039e0 con 0x5603e9fd2600 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.529+0000 7f9084ff9700 1 -- 172.21.15.12:0/4162549008 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080011600 con 0x5603e9fd2600 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 -- 172.21.15.12:0/4162549008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 msgr2=0x5603e9fe2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe2d00 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f908000b450 tx=0x7f9080005950 comp rx=0 tx=0).stop 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 -- 172.21.15.12:0/4162549008 shutdown_connections 2023-12-11T20:30:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fc8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 0x5603e9fdacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/4162549008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe2d00 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 -- 172.21.15.12:0/4162549008 >> 172.21.15.12:0/4162549008 conn(0x5603e9efc7e0 msgr2=0x5603e9fd9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 -- 172.21.15.12:0/4162549008 shutdown_connections 2023-12-11T20:30:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.530+0000 7f90ab85cb80 1 -- 172.21.15.12:0/4162549008 wait complete. 2023-12-11T20:30:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.531+0000 7f90ab85cb80 1 -- start start 2023-12-11T20:30:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.531+0000 7f90ab85cb80 1 Processor -- start 2023-12-11T20:30:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.531+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 0x5603e9fe09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.531+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.531+0000 7f90ab85cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fe1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.531+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9fe23f0 con 0x5603e9fd2600 2023-12-11T20:30:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.531+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9fe2560 con 0x5603e9fd2f80 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.531+0000 7f90ab85cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e9fe2720 con 0x5603e9fd1c40 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f90ab85cb80 10 client.0 _ll_register_callbacks cb 0x5603e9e06a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50968/0 (socket says 172.21.15.12:50968) 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909559a700 1 -- 172.21.15.12:0/889522281 learned_addr learned my addr 172.21.15.12:0/889522281 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f9095d9b700 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 0x5603e9fe09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909659c700 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fe1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909559a700 1 -- 172.21.15.12:0/889522281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 msgr2=0x5603e9fe09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909559a700 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 0x5603e9fe09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909559a700 1 -- 172.21.15.12:0/889522281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 msgr2=0x5603e9fe1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909559a700 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fe1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.532+0000 7f909559a700 1 -- 172.21.15.12:0/889522281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603e9d4ade0 con 0x5603e9fd2600 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.533+0000 7f909559a700 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe0ef0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f908000bc90 tx=0x7f9080003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51e5fde65d958ca server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.533+0000 7f90797fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.533+0000 7f90797fa700 1 -- 172.21.15.12:0/889522281 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800050c0 con 0x5603e9fd2600 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.533+0000 7f90797fa700 1 -- 172.21.15.12:0/889522281 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9080000e40 con 0x5603e9fd2600 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.533+0000 7f90ab85cb80 1 -- 172.21.15.12:0/889522281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603e9ee7fd0 con 0x5603e9fd2600 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.533+0000 7f90797fa700 1 -- 172.21.15.12:0/889522281 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9080005220 con 0x5603e9fd2600 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.533+0000 7f90ab85cb80 10 client.19707 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.533+0000 7f90ab85cb80 1 -- 172.21.15.12:0/889522281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5603e9d71250 con 0x5603e9fd2600 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f90797fa700 1 -- 172.21.15.12:0/889522281 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9080047020 con 0x5603e9fd2600 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f90797fa700 1 -- 172.21.15.12:0/889522281 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9080011bf0 con 0x5603e9fd2600 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f90ab85cb80 10 client.19707 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f90ab85cb80 10 client.19707 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f90ab85cb80 20 client.19707 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5603ea03e420 0x5603ea040840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f90ab85cb80 4 client.19707 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f90ab85cb80 1 -- 172.21.15.12:0/889522281 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5603e9eda490 con 0x5603ea03e420 2023-12-11T20:30:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.534+0000 7f9095d9b700 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5603ea03e420 0x5603ea040840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.535+0000 7f90797fa700 10 client.19707 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:30:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.535+0000 7f9095d9b700 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5603ea03e420 0x5603ea040840 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8058a43cf5acbe2e server_cookie=fbaaacf095d924f3 in_seq=0 out_seq=0 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.535+0000 7f90797fa700 1 -- 172.21.15.12:0/889522281 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5603e9eda490 con 0x5603ea03e420 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.535+0000 7f90797fa700 10 client.19707 handle_command_reply: tid=0 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.535+0000 7f90ab85cb80 1 client.19707 shutdown 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.535+0000 7f90ab85cb80 1 -- 172.21.15.12:0/889522281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 msgr2=0x5603e9fe0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.535+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe0ef0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f908000bc90 tx=0x7f9080003b00 comp rx=0 tx=0).stop 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 1 -- 172.21.15.12:0/889522281 shutdown_connections 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x5603ea03e420 0x5603ea040840 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5603e9fd2f80 0x5603e9fe1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5603e9fd1c40 0x5603e9fe09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 1 --2- 172.21.15.12:0/889522281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603e9fd2600 0x5603e9fe0ef0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 1 -- 172.21.15.12:0/889522281 >> 172.21.15.12:0/889522281 conn(0x5603e9efc7e0 msgr2=0x5603e9fdb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90797fa700 0 client.19707 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 1 -- 172.21.15.12:0/889522281 shutdown_connections 2023-12-11T20:30:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 1 -- 172.21.15.12:0/889522281 wait complete. 2023-12-11T20:30:45.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f90ab85cb80 20 client.19707 trim_cache size 0 max 16384 2023-12-11T20:30:45.537 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:30:45.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f9096d9d700 1 -- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f907c0a15a0 msgr2=0x7f907c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f9096d9d700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f907c0a15a0 0x7f907c0a3a60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f908c009c60 tx=0x7f908c009260 comp rx=0 tx=0).stop 2023-12-11T20:30:45.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f9096d9d700 1 -- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 msgr2=0x7f909019e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.536+0000 7f9096d9d700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 0x7f909019e6b0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f908800b780 tx=0x7f908800bcc0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.537+0000 7f9096d9d700 1 -- 172.21.15.12:0/834233332 shutdown_connections 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.537+0000 7f9096d9d700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f907c0a15a0 0x7f907c0a3a60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.537+0000 7f9096d9d700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9090101d70 0x7f9090197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.537+0000 7f9096d9d700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9090106fd0 0x7f909019e6b0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.537+0000 7f9096d9d700 1 --2- 172.21.15.12:0/834233332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90901046a0 0x7f9090197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.537+0000 7f9096d9d700 1 -- 172.21.15.12:0/834233332 >> 172.21.15.12:0/834233332 conn(0x7f90900fb740 msgr2=0x7f90901026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.537+0000 7f9096d9d700 1 -- 172.21.15.12:0/834233332 shutdown_connections 2023-12-11T20:30:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.537+0000 7f9096d9d700 1 -- 172.21.15.12:0/834233332 wait complete. 2023-12-11T20:30:45.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:30:45.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 -- 172.21.15.12:0/1382377425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 msgr2=0x7fd89c104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/1382377425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 0x7fd89c104d40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd8900099c0 tx=0x7fd890009cd0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 -- 172.21.15.12:0/1382377425 shutdown_connections 2023-12-11T20:30:45.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/1382377425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c105280 0x7fd89c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/1382377425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c1036f0 0x7fd89c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/1382377425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 0x7fd89c104d40 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 -- 172.21.15.12:0/1382377425 >> 172.21.15.12:0/1382377425 conn(0x7fd89c0fec80 msgr2=0x7fd89c1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 -- 172.21.15.12:0/1382377425 shutdown_connections 2023-12-11T20:30:45.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.799+0000 7fd8a1fff700 1 -- 172.21.15.12:0/1382377425 wait complete. 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.800+0000 7fd8a1fff700 1 Processor -- start 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.800+0000 7fd8a1fff700 1 -- start start 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.800+0000 7fd8a1fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c1036f0 0x7fd89c199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.800+0000 7fd8a1fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 0x7fd89c199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.800+0000 7fd8a1fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c105280 0x7fd89c1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.800+0000 7fd8a1fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c1a10b0 con 0x7fd89c1048e0 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.800+0000 7fd8a1fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c1a11f0 con 0x7fd89c105280 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.800+0000 7fd8a1fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c1a1380 con 0x7fd89c1036f0 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 0x7fd89c199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 0x7fd89c199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50998/0 (socket says 172.21.15.12:50998) 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 -- 172.21.15.12:0/4259089330 learned_addr learned my addr 172.21.15.12:0/4259089330 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c1036f0 0x7fd89c199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89bfff700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c105280 0x7fd89c1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 -- 172.21.15.12:0/4259089330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c1036f0 msgr2=0x7fd89c199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c1036f0 0x7fd89c199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 -- 172.21.15.12:0/4259089330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c105280 msgr2=0x7fd89c1a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c105280 0x7fd89c1a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 -- 172.21.15.12:0/4259089330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8900095f0 con 0x7fd89c1048e0 2023-12-11T20:30:45.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89bfff700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c105280 0x7fd89c1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:30:45.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.801+0000 7fd89affd700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 0x7fd89c199ac0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fd890000c00 tx=0x7fd89000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.802+0000 7fd898ff9700 1 -- 172.21.15.12:0/4259089330 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89001d070 con 0x7fd89c1048e0 2023-12-11T20:30:45.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.802+0000 7fd898ff9700 1 -- 172.21.15.12:0/4259089330 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8900054c0 con 0x7fd89c1048e0 2023-12-11T20:30:45.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.802+0000 7fd8a1fff700 1 -- 172.21.15.12:0/4259089330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c1a1600 con 0x7fd89c1048e0 2023-12-11T20:30:45.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.802+0000 7fd898ff9700 1 -- 172.21.15.12:0/4259089330 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890004bd0 con 0x7fd89c1048e0 2023-12-11T20:30:45.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.802+0000 7fd8a1fff700 1 -- 172.21.15.12:0/4259089330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c1a1a20 con 0x7fd89c1048e0 2023-12-11T20:30:45.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.806+0000 7fd898ff9700 1 -- 172.21.15.12:0/4259089330 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd89000fc80 con 0x7fd89c1048e0 2023-12-11T20:30:45.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.808+0000 7fd898ff9700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8840a1480 0x7fd8840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.808+0000 7fd898ff9700 1 -- 172.21.15.12:0/4259089330 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd8900cdb10 con 0x7fd89c1048e0 2023-12-11T20:30:45.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.808+0000 7fd8b5979b80 1 Processor -- start 2023-12-11T20:30:45.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.808+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8840a1480 0x7fd8840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.808+0000 7fd8b5979b80 1 -- start start 2023-12-11T20:30:45.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a3d30 0x55a8f94a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a4c20 0x55a8f94a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f93feb50 con 0x55a8f94a33d0 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f93fc470 con 0x55a8f94a3d30 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f93f7d60 con 0x55a8f94a4c20 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94a37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51002/0 (socket says 172.21.15.12:51002) 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 -- 172.21.15.12:0/1563429639 learned_addr learned my addr 172.21.15.12:0/1563429639 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8840a1480 0x7fd8840a3940 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd89c104740 tx=0x7fd88c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89bfff700 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a4c20 0x55a8f94a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89affd700 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a3d30 0x55a8f94a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 -- 172.21.15.12:0/1563429639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a4c20 msgr2=0x55a8f94a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a4c20 0x55a8f94a50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 -- 172.21.15.12:0/1563429639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a3d30 msgr2=0x55a8f94a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a3d30 0x55a8f94a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.809+0000 7fd89b7fe700 1 -- 172.21.15.12:0/1563429639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8f9274630 con 0x55a8f94a33d0 2023-12-11T20:30:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.810+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94a37f0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fd88c011d10 tx=0x7fd88c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85faa1d37b44569c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.810+0000 7fd881ffb700 1 -- 172.21.15.12:0/1563429639 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00eb20 con 0x55a8f94a33d0 2023-12-11T20:30:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.810+0000 7fd881ffb700 1 -- 172.21.15.12:0/1563429639 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd88c021070 con 0x55a8f94a33d0 2023-12-11T20:30:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.810+0000 7fd881ffb700 1 -- 172.21.15.12:0/1563429639 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c003b70 con 0x55a8f94a33d0 2023-12-11T20:30:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1563429639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 msgr2=0x55a8f94a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94a37f0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fd88c011d10 tx=0x7fd88c014000 comp rx=0 tx=0).stop 2023-12-11T20:30:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1563429639 shutdown_connections 2023-12-11T20:30:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a4c20 0x55a8f94a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94a37f0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1563429639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a3d30 0x55a8f94a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1563429639 >> 172.21.15.12:0/1563429639 conn(0x55a8f93d27e0 msgr2=0x55a8f949fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1563429639 shutdown_connections 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.811+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1563429639 wait complete. 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.812+0000 7fd8b5979b80 1 -- start start 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.812+0000 7fd8b5979b80 1 Processor -- start 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 0x55a8f94b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f93b1560 con 0x55a8f94a33d0 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f93b1200 con 0x55a8f94a4c20 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f9276920 con 0x55a8f94a3d30 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd8b5979b80 10 client.0 _ll_register_callbacks cb 0x55a8f92dca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94ad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51016/0 (socket says 172.21.15.12:51016) 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.813+0000 7fd89b7fe700 1 -- 172.21.15.12:0/1132550623 learned_addr learned my addr 172.21.15.12:0/1132550623 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd89bfff700 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 0x55a8f94b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd89affd700 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd89b7fe700 1 -- 172.21.15.12:0/1132550623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 msgr2=0x55a8f94ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd89b7fe700 1 -- 172.21.15.12:0/1132550623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 msgr2=0x55a8f94b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 0x55a8f94b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd89b7fe700 1 -- 172.21.15.12:0/1132550623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c017070 con 0x55a8f94a33d0 2023-12-11T20:30:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94ad1e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009b20 tx=0x7fd88c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a443e92e3c78ed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd87affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.814+0000 7fd87affd700 1 -- 172.21.15.12:0/1132550623 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c005260 con 0x55a8f94a33d0 2023-12-11T20:30:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd87affd700 1 -- 172.21.15.12:0/1132550623 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd88c0053c0 con 0x55a8f94a33d0 2023-12-11T20:30:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1132550623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8f9496b40 con 0x55a8f94a33d0 2023-12-11T20:30:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd87affd700 1 -- 172.21.15.12:0/1132550623 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd88c005580 con 0x55a8f94a33d0 2023-12-11T20:30:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd8b5979b80 10 client.19719 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1132550623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a8f9220de0 con 0x55a8f94a33d0 2023-12-11T20:30:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd87affd700 1 -- 172.21.15.12:0/1132550623 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a8f9496b40 con 0x55a8f94a33d0 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd87affd700 1 -- 172.21.15.12:0/1132550623 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd88c0267f0 con 0x55a8f94a33d0 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd8b5979b80 10 client.19719 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd8b5979b80 10 client.19719 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.815+0000 7fd8b5979b80 20 client.19719 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.816+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55a8f94b8f70 0x55a8f94bb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.816+0000 7fd8b5979b80 4 client.19719 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.816+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1132550623 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8f9472f40 con 0x55a8f94b8f70 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.816+0000 7fd89affd700 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55a8f94b8f70 0x55a8f94bb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.816+0000 7fd89affd700 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55a8f94b8f70 0x55a8f94bb390 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e714b57864e92ca server_cookie=d81a4daded5dec74 in_seq=0 out_seq=0 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.816+0000 7fd87affd700 10 client.19719 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.817+0000 7fd87affd700 1 -- 172.21.15.12:0/1132550623 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a8f9472f40 con 0x55a8f94b8f70 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.817+0000 7fd87affd700 10 client.19719 handle_command_reply: tid=0 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.817+0000 7fd8b5979b80 1 client.19719 shutdown 2023-12-11T20:30:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.817+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1132550623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 msgr2=0x55a8f94ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.817+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94ad1e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009b20 tx=0x7fd88c00ebb0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1132550623 shutdown_connections 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55a8f94b8f70 0x55a8f94bb390 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd87affd700 0 client.19719 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 0x55a8f94b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94ad1e0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/1132550623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1132550623 >> 172.21.15.12:0/1132550623 conn(0x55a8f93d27e0 msgr2=0x55a8f949ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1132550623 shutdown_connections 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 1 -- 172.21.15.12:0/1132550623 wait complete. 2023-12-11T20:30:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.818+0000 7fd8b5979b80 20 client.19719 trim_cache size 0 max 16384 2023-12-11T20:30:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.835+0000 7fd8b5979b80 1 Processor -- start 2023-12-11T20:30:45.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.835+0000 7fd8b5979b80 1 -- start start 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a33d0 0x55a8f94b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a4c20 0x55a8f94a5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f94a0220 con 0x55a8f94a4c20 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f94c0580 con 0x55a8f94a33d0 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f94a4430 con 0x55a8f94a3d30 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd89bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a4c20 0x55a8f94a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd89bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a4c20 0x55a8f94a5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51018/0 (socket says 172.21.15.12:51018) 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd89bfff700 1 -- 172.21.15.12:0/3845997522 learned_addr learned my addr 172.21.15.12:0/3845997522 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd89affd700 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.836+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a33d0 0x55a8f94b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd89bfff700 1 -- 172.21.15.12:0/3845997522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 msgr2=0x55a8f94b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd89bfff700 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd89bfff700 1 -- 172.21.15.12:0/3845997522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a33d0 msgr2=0x55a8f94b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd89bfff700 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a33d0 0x55a8f94b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd89bfff700 1 -- 172.21.15.12:0/3845997522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8f9209c60 con 0x55a8f94a4c20 2023-12-11T20:30:45.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd89bfff700 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a4c20 0x55a8f94a5000 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd8940076a0 tx=0x7fd89400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c438fc51e1bb95d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd8827fc700 1 -- 172.21.15.12:0/3845997522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894009240 con 0x55a8f94a4c20 2023-12-11T20:30:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd8827fc700 1 -- 172.21.15.12:0/3845997522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd89400f070 con 0x55a8f94a4c20 2023-12-11T20:30:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.837+0000 7fd8827fc700 1 -- 172.21.15.12:0/3845997522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894005280 con 0x55a8f94a4c20 2023-12-11T20:30:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 -- 172.21.15.12:0/3845997522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a4c20 msgr2=0x55a8f94a5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a4c20 0x55a8f94a5000 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd8940076a0 tx=0x7fd89400b040 comp rx=0 tx=0).stop 2023-12-11T20:30:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 -- 172.21.15.12:0/3845997522 shutdown_connections 2023-12-11T20:30:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a33d0 0x55a8f94b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a4c20 0x55a8f94a5000 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/3845997522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 -- 172.21.15.12:0/3845997522 >> 172.21.15.12:0/3845997522 conn(0x55a8f93d27e0 msgr2=0x55a8f94ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 -- 172.21.15.12:0/3845997522 shutdown_connections 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.838+0000 7fd8b5979b80 1 -- 172.21.15.12:0/3845997522 wait complete. 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 1 -- start start 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 1 Processor -- start 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 0x55a8f94b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f94b3f70 con 0x55a8f94a33d0 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f94b40e0 con 0x55a8f94a4c20 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f94b42a0 con 0x55a8f94a3d30 2023-12-11T20:30:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.839+0000 7fd8b5979b80 10 client.0 _ll_register_callbacks cb 0x55a8f92dca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51032/0 (socket says 172.21.15.12:51032) 2023-12-11T20:30:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 -- 172.21.15.12:0/988810678 learned_addr learned my addr 172.21.15.12:0/988810678 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89affd700 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 -- 172.21.15.12:0/988810678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 msgr2=0x55a8f94b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 -- 172.21.15.12:0/988810678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 msgr2=0x55a8f94b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 0x55a8f94b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 -- 172.21.15.12:0/988810678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8940093a0 con 0x55a8f94a33d0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd89b7fe700 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94b24e0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd88c026b80 tx=0x7fd88c011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970b937815d16f2a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.840+0000 7fd87affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.841+0000 7fd87affd700 1 -- 172.21.15.12:0/988810678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c005470 con 0x55a8f94a33d0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.841+0000 7fd8b5979b80 1 -- 172.21.15.12:0/988810678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd88c021070 con 0x55a8f94a33d0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.841+0000 7fd87affd700 1 -- 172.21.15.12:0/988810678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd88c0055d0 con 0x55a8f94a33d0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.841+0000 7fd87affd700 1 -- 172.21.15.12:0/988810678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd88c004020 con 0x55a8f94a33d0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.841+0000 7fd8b5979b80 10 client.19725 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.841+0000 7fd8b5979b80 1 -- 172.21.15.12:0/988810678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a8f9247250 con 0x55a8f94a33d0 2023-12-11T20:30:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.841+0000 7fd87affd700 1 -- 172.21.15.12:0/988810678 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd88c021070 con 0x55a8f94a33d0 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.842+0000 7fd87affd700 1 -- 172.21.15.12:0/988810678 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd88c0046f0 con 0x55a8f94a33d0 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.842+0000 7fd8b5979b80 10 client.19725 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.842+0000 7fd8b5979b80 10 client.19725 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.842+0000 7fd8b5979b80 20 client.19725 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.842+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55a8f9510020 0x55a8f9512440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.842+0000 7fd8b5979b80 4 client.19725 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.842+0000 7fd8b5979b80 1 -- 172.21.15.12:0/988810678 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a8f93bdfd0 con 0x55a8f9510020 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.842+0000 7fd89affd700 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55a8f9510020 0x55a8f9512440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd87affd700 10 client.19725 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd89affd700 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55a8f9510020 0x55a8f9512440 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa61d006edbd89fd server_cookie=e8bef467fe479ef0 in_seq=0 out_seq=0 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd87affd700 1 -- 172.21.15.12:0/988810678 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a8f93bdfd0 con 0x55a8f9510020 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd87affd700 10 client.19725 handle_command_reply: tid=0 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 client.19725 shutdown 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 -- 172.21.15.12:0/988810678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 msgr2=0x55a8f94b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94b24e0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd88c026b80 tx=0x7fd88c011850 comp rx=0 tx=0).stop 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 -- 172.21.15.12:0/988810678 shutdown_connections 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x55a8f9510020 0x55a8f9512440 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a8f94a4c20 0x55a8f94b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f94a33d0 0x55a8f94b24e0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 --2- 172.21.15.12:0/988810678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a8f94a3d30 0x55a8f94b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd87affd700 0 client.19725 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 -- 172.21.15.12:0/988810678 >> 172.21.15.12:0/988810678 conn(0x55a8f93d27e0 msgr2=0x55a8f94a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 -- 172.21.15.12:0/988810678 shutdown_connections 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.843+0000 7fd8b5979b80 1 -- 172.21.15.12:0/988810678 wait complete. 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8b5979b80 20 client.19725 trim_cache size 0 max 16384 2023-12-11T20:30:45.844 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:30:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 -- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8840a1480 msgr2=0x7fd8840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8840a1480 0x7fd8840a3940 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd89c104740 tx=0x7fd88c009260 comp rx=0 tx=0).stop 2023-12-11T20:30:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 -- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 msgr2=0x7fd89c199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 0x7fd89c199ac0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fd890000c00 tx=0x7fd89000f690 comp rx=0 tx=0).stop 2023-12-11T20:30:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 -- 172.21.15.12:0/4259089330 shutdown_connections 2023-12-11T20:30:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd8840a1480 0x7fd8840a3940 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd89c105280 0x7fd89c1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c1036f0 0x7fd89c199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 --2- 172.21.15.12:0/4259089330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd89c1048e0 0x7fd89c199ac0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 -- 172.21.15.12:0/4259089330 >> 172.21.15.12:0/4259089330 conn(0x7fd89c0fec80 msgr2=0x7fd89c107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 -- 172.21.15.12:0/4259089330 shutdown_connections 2023-12-11T20:30:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:45.844+0000 7fd8a1fff700 1 -- 172.21.15.12:0/4259089330 wait complete. 2023-12-11T20:30:45.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:30:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 -- 172.21.15.12:0/1588908108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 msgr2=0x7fc018109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 --2- 172.21.15.12:0/1588908108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 0x7fc018109440 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fc01000b0a0 tx=0x7fc01000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 -- 172.21.15.12:0/1588908108 shutdown_connections 2023-12-11T20:30:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 --2- 172.21.15.12:0/1588908108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc018101dd0 0x7fc0181041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 --2- 172.21.15.12:0/1588908108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 0x7fc018109440 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 --2- 172.21.15.12:0/1588908108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018104700 0x7fc018106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 -- 172.21.15.12:0/1588908108 >> 172.21.15.12:0/1588908108 conn(0x7fc0180fb740 msgr2=0x7fc0180fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 -- 172.21.15.12:0/1588908108 shutdown_connections 2023-12-11T20:30:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.088+0000 7fc01d39d700 1 -- 172.21.15.12:0/1588908108 wait complete. 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.090+0000 7fc01d39d700 1 Processor -- start 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.090+0000 7fc01d39d700 1 -- start start 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01d39d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc018101dd0 0x7fc018197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01d39d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018104700 0x7fc018197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01d39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 0x7fc01819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01d39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01819ebf0 con 0x7fc018107030 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01d39d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01819ed30 con 0x7fc018101dd0 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01d39d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01819eec0 con 0x7fc018104700 2023-12-11T20:30:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01cb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 0x7fc01819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01cb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 0x7fc01819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51058/0 (socket says 172.21.15.12:51058) 2023-12-11T20:30:46.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01cb9c700 1 -- 172.21.15.12:0/3375805872 learned_addr learned my addr 172.21.15.12:0/3375805872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:46.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc017fff700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc018101dd0 0x7fc018197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018104700 0x7fc018197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01cb9c700 1 -- 172.21.15.12:0/3375805872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018104700 msgr2=0x7fc018197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01cb9c700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018104700 0x7fc018197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01cb9c700 1 -- 172.21.15.12:0/3375805872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc018101dd0 msgr2=0x7fc018197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.091+0000 7fc01cb9c700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc018101dd0 0x7fc018197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.092+0000 7fc01cb9c700 1 -- 172.21.15.12:0/3375805872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010009d00 con 0x7fc018107030 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.092+0000 7fc01cb9c700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 0x7fc01819e620 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fc010004d00 tx=0x7fc010004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.092+0000 7fc0157fa700 1 -- 172.21.15.12:0/3375805872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000e040 con 0x7fc018107030 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.092+0000 7fc0157fa700 1 -- 172.21.15.12:0/3375805872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc01000cec0 con 0x7fc018107030 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.092+0000 7fc0157fa700 1 -- 172.21.15.12:0/3375805872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01001ba30 con 0x7fc018107030 2023-12-11T20:30:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.092+0000 7fc01d39d700 1 -- 172.21.15.12:0/3375805872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01819f140 con 0x7fc018107030 2023-12-11T20:30:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.092+0000 7fc01d39d700 1 -- 172.21.15.12:0/3375805872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01819f570 con 0x7fc018107030 2023-12-11T20:30:46.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.097+0000 7fc0157fa700 1 -- 172.21.15.12:0/3375805872 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc01001bb90 con 0x7fc018107030 2023-12-11T20:30:46.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.098+0000 7fc031e37b80 1 Processor -- start 2023-12-11T20:30:46.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.098+0000 7fc031e37b80 1 -- start start 2023-12-11T20:30:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba64a60 0x56494ba64e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba658a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 0x56494ba66240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc031e37b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b9bfb50 con 0x56494ba64a60 2023-12-11T20:30:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc031e37b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b9bd470 con 0x56494ba653c0 2023-12-11T20:30:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc031e37b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b9b8d60 con 0x56494ba65de0 2023-12-11T20:30:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc0157fa700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0000a1520 0x7fc0000a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc0177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba64a60 0x56494ba64e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc0177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba64a60 0x56494ba64e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51072/0 (socket says 172.21.15.12:51072) 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc017fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc0177fe700 1 -- 172.21.15.12:0/630490414 learned_addr learned my addr 172.21.15.12:0/630490414 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc0157fa700 1 -- 172.21.15.12:0/3375805872 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc0100cea70 con 0x7fc018107030 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc01cb9c700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0000a1520 0x7fc0000a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.099+0000 7fc0177fe700 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 0x56494ba66240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fc017fff700 1 -- 172.21.15.12:0/630490414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 msgr2=0x56494ba66240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fc017fff700 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 0x56494ba66240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fc017fff700 1 -- 172.21.15.12:0/630490414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba64a60 msgr2=0x56494ba64e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fc017fff700 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba64a60 0x56494ba64e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fc017fff700 1 -- 172.21.15.12:0/630490414 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56494b835630 con 0x56494ba653c0 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fc0177fe700 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba64a60 0x56494ba64e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fc017fff700 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba658a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc00800bc80 tx=0x7fc00800bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee4001939f52b5a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fc01cb9c700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0000a1520 0x7fc0000a39e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc0100987e0 tx=0x7fc010004f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:46.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fbffe7fc700 1 -- 172.21.15.12:0/630490414 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008010d50 con 0x56494ba653c0 2023-12-11T20:30:46.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fbffe7fc700 1 -- 172.21.15.12:0/630490414 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc008015070 con 0x56494ba653c0 2023-12-11T20:30:46.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.100+0000 7fbffe7fc700 1 -- 172.21.15.12:0/630490414 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008004ea0 con 0x56494ba653c0 2023-12-11T20:30:46.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 -- 172.21.15.12:0/630490414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 msgr2=0x56494ba658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba658a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc00800bc80 tx=0x7fc00800bf90 comp rx=0 tx=0).stop 2023-12-11T20:30:46.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 -- 172.21.15.12:0/630490414 shutdown_connections 2023-12-11T20:30:46.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 0x56494ba66240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba64a60 0x56494ba64e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 --2- 172.21.15.12:0/630490414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba658a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 -- 172.21.15.12:0/630490414 >> 172.21.15.12:0/630490414 conn(0x56494b9937e0 msgr2=0x56494ba5f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 -- 172.21.15.12:0/630490414 shutdown_connections 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.101+0000 7fc031e37b80 1 -- 172.21.15.12:0/630490414 wait complete. 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.102+0000 7fc031e37b80 1 -- start start 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.102+0000 7fc031e37b80 1 Processor -- start 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba64a60 0x56494ba72720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba72c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 0x56494ba79ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc031e37b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b972560 con 0x56494ba653c0 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc031e37b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b972200 con 0x56494ba64a60 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc031e37b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b837920 con 0x56494ba65de0 2023-12-11T20:30:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc031e37b80 10 client.0 _ll_register_callbacks cb 0x56494b89da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc017fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba72c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc017fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba72c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51088/0 (socket says 172.21.15.12:51088) 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc017fff700 1 -- 172.21.15.12:0/3507535035 learned_addr learned my addr 172.21.15.12:0/3507535035 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba64a60 0x56494ba72720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.103+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 0x56494ba79ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fc017fff700 1 -- 172.21.15.12:0/3507535035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 msgr2=0x56494ba79ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fc017fff700 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 0x56494ba79ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fc017fff700 1 -- 172.21.15.12:0/3507535035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba64a60 msgr2=0x56494ba72720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fc017fff700 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba64a60 0x56494ba72720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fc017fff700 1 -- 172.21.15.12:0/3507535035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00800b8e0 con 0x56494ba653c0 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fc017fff700 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba72c60 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fc0080059d0 tx=0x7fc008010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1e4c146bb3eeba server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fbff77fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fbff77fe700 1 -- 172.21.15.12:0/3507535035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008020070 con 0x56494ba653c0 2023-12-11T20:30:46.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fc031e37b80 1 -- 172.21.15.12:0/3507535035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56494ba579e0 con 0x56494ba653c0 2023-12-11T20:30:46.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.104+0000 7fbff77fe700 1 -- 172.21.15.12:0/3507535035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc008017070 con 0x56494ba653c0 2023-12-11T20:30:46.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fbff77fe700 1 -- 172.21.15.12:0/3507535035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc008010e70 con 0x56494ba653c0 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fc031e37b80 10 client.19737 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fc031e37b80 1 -- 172.21.15.12:0/3507535035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56494b7e1de0 con 0x56494ba653c0 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fbff77fe700 1 -- 172.21.15.12:0/3507535035 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc008033080 con 0x56494ba653c0 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fbff77fe700 1 -- 172.21.15.12:0/3507535035 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc008011440 con 0x56494ba653c0 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fc031e37b80 10 client.19737 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fc031e37b80 10 client.19737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fc031e37b80 20 client.19737 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56494ba7e440 0x56494ba80860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fc031e37b80 4 client.19737 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.105+0000 7fc031e37b80 1 -- 172.21.15.12:0/3507535035 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56494ba33f40 con 0x56494ba7e440 2023-12-11T20:30:46.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.106+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56494ba7e440 0x56494ba80860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.106+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56494ba7e440 0x56494ba80860 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fdc7968a7dc4619 server_cookie=4c15dfc0afd383c9 in_seq=0 out_seq=0 2023-12-11T20:30:46.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.106+0000 7fbff77fe700 10 client.19737 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.107+0000 7fbff77fe700 1 -- 172.21.15.12:0/3507535035 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56494ba33f40 con 0x56494ba7e440 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.107+0000 7fbff77fe700 10 client.19737 handle_command_reply: tid=0 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.107+0000 7fc031e37b80 1 client.19737 shutdown 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.107+0000 7fc031e37b80 1 -- 172.21.15.12:0/3507535035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 msgr2=0x56494ba72c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.107+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba72c60 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fc0080059d0 tx=0x7fc008010d80 comp rx=0 tx=0).stop 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.107+0000 7fc031e37b80 1 -- 172.21.15.12:0/3507535035 shutdown_connections 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.107+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56494ba7e440 0x56494ba80860 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.108+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba64a60 0x56494ba72720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.108+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba65de0 0x56494ba79ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.108+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3507535035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba72c60 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.108+0000 7fbff77fe700 0 client.19737 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.108+0000 7fc031e37b80 1 -- 172.21.15.12:0/3507535035 >> 172.21.15.12:0/3507535035 conn(0x56494b9937e0 msgr2=0x56494ba63820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.108+0000 7fc031e37b80 1 -- 172.21.15.12:0/3507535035 shutdown_connections 2023-12-11T20:30:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.108+0000 7fc031e37b80 1 -- 172.21.15.12:0/3507535035 wait complete. 2023-12-11T20:30:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.108+0000 7fc031e37b80 20 client.19737 trim_cache size 0 max 16384 2023-12-11T20:30:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc031e37b80 1 Processor -- start 2023-12-11T20:30:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc031e37b80 1 -- start start 2023-12-11T20:30:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 0x56494ba80830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba79c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba65de0 0x56494ba661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc031e37b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494ba606f0 con 0x56494ba65de0 2023-12-11T20:30:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc031e37b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494ba716d0 con 0x56494ba653c0 2023-12-11T20:30:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc031e37b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494ba5a1e0 con 0x56494ba64a60 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.129+0000 7fc0177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba65de0 0x56494ba661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba65de0 0x56494ba661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51096/0 (socket says 172.21.15.12:51096) 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 -- 172.21.15.12:0/4171068009 learned_addr learned my addr 172.21.15.12:0/4171068009 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 0x56494ba80830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc017fff700 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba79c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 -- 172.21.15.12:0/4171068009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 msgr2=0x56494ba80830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 0x56494ba80830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 -- 172.21.15.12:0/4171068009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 msgr2=0x56494ba79c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba79c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 -- 172.21.15.12:0/4171068009 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56494b7cac60 con 0x56494ba65de0 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.130+0000 7fc0177fe700 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba65de0 0x56494ba661c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00a750 tx=0x7fc00c00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a5b4e3657a1bcc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fbffeffd700 1 -- 172.21.15.12:0/4171068009 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c011ae0 con 0x56494ba65de0 2023-12-11T20:30:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fbffeffd700 1 -- 172.21.15.12:0/4171068009 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc00c028030 con 0x56494ba65de0 2023-12-11T20:30:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fbffeffd700 1 -- 172.21.15.12:0/4171068009 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c004b20 con 0x56494ba65de0 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fc031e37b80 1 -- 172.21.15.12:0/4171068009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba65de0 msgr2=0x56494ba661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fc031e37b80 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba65de0 0x56494ba661c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00a750 tx=0x7fc00c00a8c0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fc031e37b80 1 -- 172.21.15.12:0/4171068009 shutdown_connections 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fc031e37b80 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba65de0 0x56494ba661c0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fc031e37b80 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 0x56494ba80830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fc031e37b80 1 --2- 172.21.15.12:0/4171068009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba653c0 0x56494ba79c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fc031e37b80 1 -- 172.21.15.12:0/4171068009 >> 172.21.15.12:0/4171068009 conn(0x56494b9937e0 msgr2=0x56494ba71c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.131+0000 7fc031e37b80 1 -- 172.21.15.12:0/4171068009 shutdown_connections 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.132+0000 7fc031e37b80 1 -- 172.21.15.12:0/4171068009 wait complete. 2023-12-11T20:30:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.132+0000 7fc031e37b80 1 -- start start 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.132+0000 7fc031e37b80 1 Processor -- start 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 0x56494ba775c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba77b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc031e37b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba65de0 0x56494ba78a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc031e37b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494ba78fb0 con 0x56494ba653c0 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc031e37b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494ba79120 con 0x56494ba65de0 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc031e37b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494ba792e0 con 0x56494ba64a60 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc031e37b80 10 client.0 _ll_register_callbacks cb 0x56494b89da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc017fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba77b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc017fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba77b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51098/0 (socket says 172.21.15.12:51098) 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc017fff700 1 -- 172.21.15.12:0/3626952103 learned_addr learned my addr 172.21.15.12:0/3626952103 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 0x56494ba775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba65de0 0x56494ba78a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc017fff700 1 -- 172.21.15.12:0/3626952103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 msgr2=0x56494ba775c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc017fff700 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 0x56494ba775c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc017fff700 1 -- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba65de0 msgr2=0x56494ba78a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc017fff700 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba65de0 0x56494ba78a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.133+0000 7fc017fff700 1 -- 172.21.15.12:0/3626952103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c022410 con 0x56494ba653c0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba65de0 0x56494ba78a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fc017fff700 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba77b00 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fc0080117a0 tx=0x7fc00800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ecc7fe68ccdd90 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fbff77fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fbff77fe700 1 -- 172.21.15.12:0/3626952103 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008036070 con 0x56494ba653c0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fc031e37b80 1 -- 172.21.15.12:0/3626952103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc008015070 con 0x56494ba653c0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fbff77fe700 1 -- 172.21.15.12:0/3626952103 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc008021070 con 0x56494ba653c0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fbff77fe700 1 -- 172.21.15.12:0/3626952103 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc008020030 con 0x56494ba653c0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fc031e37b80 10 client.19743 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.134+0000 7fc031e37b80 1 -- 172.21.15.12:0/3626952103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56494b808250 con 0x56494ba653c0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.135+0000 7fbff77fe700 1 -- 172.21.15.12:0/3626952103 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc008040020 con 0x56494ba653c0 2023-12-11T20:30:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.135+0000 7fbff77fe700 1 -- 172.21.15.12:0/3626952103 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc008039030 con 0x56494ba653c0 2023-12-11T20:30:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.135+0000 7fc031e37b80 10 client.19743 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.135+0000 7fc031e37b80 10 client.19743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.135+0000 7fc031e37b80 20 client.19743 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.135+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56494bad5120 0x56494bad7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.135+0000 7fc031e37b80 4 client.19743 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:30:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.135+0000 7fc031e37b80 1 -- 172.21.15.12:0/3626952103 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56494b97efd0 con 0x56494bad5120 2023-12-11T20:30:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.136+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56494bad5120 0x56494bad7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.136+0000 7fc0177fe700 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56494bad5120 0x56494bad7540 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5312a38d0d15c991 server_cookie=4e686fb29b59f81f in_seq=0 out_seq=0 2023-12-11T20:30:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.136+0000 7fbff77fe700 10 client.19743 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.136+0000 7fbff77fe700 1 -- 172.21.15.12:0/3626952103 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56494b97efd0 con 0x56494bad5120 2023-12-11T20:30:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.136+0000 7fbff77fe700 10 client.19743 handle_command_reply: tid=0 2023-12-11T20:30:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.136+0000 7fc031e37b80 1 client.19743 shutdown 2023-12-11T20:30:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.136+0000 7fc031e37b80 1 -- 172.21.15.12:0/3626952103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 msgr2=0x56494ba77b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.136+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba77b00 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fc0080117a0 tx=0x7fc00800b4c0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 1 -- 172.21.15.12:0/3626952103 shutdown_connections 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56494bad5120 0x56494bad7540 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56494ba65de0 0x56494ba78a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56494ba64a60 0x56494ba775c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 1 --2- 172.21.15.12:0/3626952103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56494ba653c0 0x56494ba77b00 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fbff77fe700 0 client.19743 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 1 -- 172.21.15.12:0/3626952103 >> 172.21.15.12:0/3626952103 conn(0x56494b9937e0 msgr2=0x56494ba85180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 1 -- 172.21.15.12:0/3626952103 shutdown_connections 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 1 -- 172.21.15.12:0/3626952103 wait complete. 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.137+0000 7fc031e37b80 20 client.19743 trim_cache size 0 max 16384 2023-12-11T20:30:46.138 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:30:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 -- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0000a1520 msgr2=0x7fc0000a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0000a1520 0x7fc0000a39e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc0100987e0 tx=0x7fc010004f90 comp rx=0 tx=0).stop 2023-12-11T20:30:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 -- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 msgr2=0x7fc01819e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 0x7fc01819e620 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fc010004d00 tx=0x7fc010004d30 comp rx=0 tx=0).stop 2023-12-11T20:30:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 -- 172.21.15.12:0/3375805872 shutdown_connections 2023-12-11T20:30:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc0000a1520 0x7fc0000a39e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc018101dd0 0x7fc018197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc018107030 0x7fc01819e620 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 --2- 172.21.15.12:0/3375805872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc018104700 0x7fc018197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 -- 172.21.15.12:0/3375805872 >> 172.21.15.12:0/3375805872 conn(0x7fc0180fb740 msgr2=0x7fc018102710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 -- 172.21.15.12:0/3375805872 shutdown_connections 2023-12-11T20:30:46.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:46.138+0000 7fc01d39d700 1 -- 172.21.15.12:0/3375805872 wait complete. 2023-12-11T20:30:46.160 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:45 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1906730440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:30:46.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:45 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1906730440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:30:46.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:45 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1906730440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:30:47.163 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:30:47.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:30:47.233 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:46 smithi012 ceph-mon[128787]: pgmap v820: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:30:47.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:46 smithi039 ceph-mon[102205]: pgmap v820: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:30:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 -- 172.21.15.12:0/1338500427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 msgr2=0x7f93f8106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1338500427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 0x7f93f8106b50 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009990 tx=0x7f93e8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 -- 172.21.15.12:0/1338500427 shutdown_connections 2023-12-11T20:30:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1338500427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f8107090 0x7f93f8109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1338500427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f8101e30 0x7f93f8104220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1338500427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 0x7f93f8106b50 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 -- 172.21.15.12:0/1338500427 >> 172.21.15.12:0/1338500427 conn(0x7f93f80fb740 msgr2=0x7f93f80fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 -- 172.21.15.12:0/1338500427 shutdown_connections 2023-12-11T20:30:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.394+0000 7f93fed9d700 1 -- 172.21.15.12:0/1338500427 wait complete. 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.395+0000 7f93fed9d700 1 Processor -- start 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fed9d700 1 -- start start 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f8101e30 0x7f93f81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 0x7f93f8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f8107090 0x7f93f81a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fed9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f81a0df0 con 0x7f93f8104760 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fed9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f81a0f30 con 0x7f93f8107090 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fed9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f81a10c0 con 0x7f93f8101e30 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fd59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 0x7f93f8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fd59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 0x7f93f8199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51112/0 (socket says 172.21.15.12:51112) 2023-12-11T20:30:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fd59a700 1 -- 172.21.15.12:0/1815635858 learned_addr learned my addr 172.21.15.12:0/1815635858 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.396+0000 7f93fe59c700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f8107090 0x7f93f81a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.397+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f8101e30 0x7f93f81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.397+0000 7f93fd59a700 1 -- 172.21.15.12:0/1815635858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f8101e30 msgr2=0x7f93f81992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.397+0000 7f93fd59a700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f8101e30 0x7f93f81992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.397+0000 7f93fd59a700 1 -- 172.21.15.12:0/1815635858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f8107090 msgr2=0x7f93f81a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.397+0000 7f93fd59a700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f8107090 0x7f93f81a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.397+0000 7f93fd59a700 1 -- 172.21.15.12:0/1815635858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80095f0 con 0x7f93f8104760 2023-12-11T20:30:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.397+0000 7f93fd59a700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 0x7f93f8199800 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006010 tx=0x7f93e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.398+0000 7f93eeffd700 1 -- 172.21.15.12:0/1815635858 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e801d070 con 0x7f93f8104760 2023-12-11T20:30:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.398+0000 7f93eeffd700 1 -- 172.21.15.12:0/1815635858 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93e800bdb0 con 0x7f93f8104760 2023-12-11T20:30:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.398+0000 7f93fed9d700 1 -- 172.21.15.12:0/1815635858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f81a1340 con 0x7f93f8104760 2023-12-11T20:30:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.398+0000 7f93eeffd700 1 -- 172.21.15.12:0/1815635858 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e800fda0 con 0x7f93f8104760 2023-12-11T20:30:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.398+0000 7f93fed9d700 1 -- 172.21.15.12:0/1815635858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f81a1760 con 0x7f93f8104760 2023-12-11T20:30:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.401+0000 7f93eeffd700 1 -- 172.21.15.12:0/1815635858 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f93e800f460 con 0x7f93f8104760 2023-12-11T20:30:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.402+0000 7f93eeffd700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93e40a1520 0x7f93e40a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.402+0000 7f93eeffd700 1 -- 172.21.15.12:0/1815635858 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f93e80ce0d0 con 0x7f93f8104760 2023-12-11T20:30:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.403+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93e40a1520 0x7f93e40a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.403+0000 7f9413970b80 1 Processor -- start 2023-12-11T20:30:47.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.403+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93e40a1520 0x7f93e40a39e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009c60 tx=0x7f93f4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.403+0000 7f9413970b80 1 -- start start 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f9413970b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c102ae0 0x56377c102f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f9413970b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c103920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f9413970b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c1042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f9413970b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c05dbd0 con 0x56377c102ae0 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f9413970b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c05b4f0 con 0x56377c103440 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f9413970b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c056de0 con 0x56377c103e60 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f93fdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c102ae0 0x56377c102f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f93fdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c102ae0 0x56377c102f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51114/0 (socket says 172.21.15.12:51114) 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f93fdd9b700 1 -- 172.21.15.12:0/98243531 learned_addr learned my addr 172.21.15.12:0/98243531 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f93fd59a700 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c103920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.404+0000 7f93fe59c700 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c1042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93fdd9b700 1 -- 172.21.15.12:0/98243531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 msgr2=0x56377c1042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c1042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93fdd9b700 1 -- 172.21.15.12:0/98243531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 msgr2=0x56377c103920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c103920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93fdd9b700 1 -- 172.21.15.12:0/98243531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56377bed36b0 con 0x56377c102ae0 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93fe59c700 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c1042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93fd59a700 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c102ae0 0x56377c102f00 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e4e0 tx=0x7f93f4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2152d6a507bdb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93e3fff700 1 -- 172.21.15.12:0/98243531 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4026430 con 0x56377c102ae0 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93e3fff700 1 -- 172.21.15.12:0/98243531 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93f4021070 con 0x56377c102ae0 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.405+0000 7f93e3fff700 1 -- 172.21.15.12:0/98243531 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f401d670 con 0x56377c102ae0 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 -- 172.21.15.12:0/98243531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c102ae0 msgr2=0x56377c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c102ae0 0x56377c102f00 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e4e0 tx=0x7f93f4014000 comp rx=0 tx=0).stop 2023-12-11T20:30:47.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 -- 172.21.15.12:0/98243531 shutdown_connections 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c1042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c102ae0 0x56377c102f00 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 --2- 172.21.15.12:0/98243531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 -- 172.21.15.12:0/98243531 >> 172.21.15.12:0/98243531 conn(0x56377c031860 msgr2=0x56377c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 -- 172.21.15.12:0/98243531 shutdown_connections 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.406+0000 7f9413970b80 1 -- 172.21.15.12:0/98243531 wait complete. 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.407+0000 7f9413970b80 1 -- start start 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.407+0000 7f9413970b80 1 Processor -- start 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f9413970b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c10c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f9413970b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c10c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f9413970b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103e60 0x56377c113970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f9413970b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c0105e0 con 0x56377c103440 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f9413970b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c010280 con 0x56377c103e60 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f9413970b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377bed59a0 con 0x56377c102ae0 2023-12-11T20:30:47.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f9413970b80 10 client.0 _ll_register_callbacks cb 0x56377bf3bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fd59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c10c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fd59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c10c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51124/0 (socket says 172.21.15.12:51124) 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fd59a700 1 -- 172.21.15.12:0/2398322903 learned_addr learned my addr 172.21.15.12:0/2398322903 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c10c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fe59c700 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103e60 0x56377c113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fd59a700 1 -- 172.21.15.12:0/2398322903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 msgr2=0x56377c10c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fd59a700 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c10c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fd59a700 1 -- 172.21.15.12:0/2398322903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103e60 msgr2=0x56377c113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fd59a700 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103e60 0x56377c113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.408+0000 7f93fd59a700 1 -- 172.21.15.12:0/2398322903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f4017070 con 0x56377c103440 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.409+0000 7f93fd59a700 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c10c930 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f93e80cbb20 tx=0x7f93e809b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7f0497661336fa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.409+0000 7f93e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.409+0000 7f93e17fa700 1 -- 172.21.15.12:0/2398322903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e809ad30 con 0x56377c103440 2023-12-11T20:30:47.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.409+0000 7f93e17fa700 1 -- 172.21.15.12:0/2398322903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f93e809bad0 con 0x56377c103440 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.409+0000 7f9413970b80 1 -- 172.21.15.12:0/2398322903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56377c0f5a60 con 0x56377c103440 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.409+0000 7f93e17fa700 1 -- 172.21.15.12:0/2398322903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93e809b3d0 con 0x56377c103440 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.409+0000 7f9413970b80 10 client.19755 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.409+0000 7f9413970b80 1 -- 172.21.15.12:0/2398322903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56377be7fe60 con 0x56377c103440 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.410+0000 7f93e17fa700 1 -- 172.21.15.12:0/2398322903 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56377c0f5a60 con 0x56377c103440 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.410+0000 7f93e17fa700 1 -- 172.21.15.12:0/2398322903 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f93e80a3240 con 0x56377c103440 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.410+0000 7f9413970b80 10 client.19755 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.410+0000 7f9413970b80 10 client.19755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.410+0000 7f9413970b80 20 client.19755 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.410+0000 7f9413970b80 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56377c117e60 0x56377c11a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.410+0000 7f9413970b80 4 client.19755 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.410+0000 7f9413970b80 1 -- 172.21.15.12:0/2398322903 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56377c0d1fc0 con 0x56377c117e60 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.411+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56377c117e60 0x56377c11a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.411+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56377c117e60 0x56377c11a280 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9820102de18e9ee2 server_cookie=e6da4cf1f07dd2e3 in_seq=0 out_seq=0 2023-12-11T20:30:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.411+0000 7f93e17fa700 10 client.19755 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f93e17fa700 1 -- 172.21.15.12:0/2398322903 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56377c0d1fc0 con 0x56377c117e60 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f93e17fa700 10 client.19755 handle_command_reply: tid=0 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 client.19755 shutdown 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 -- 172.21.15.12:0/2398322903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 msgr2=0x56377c10c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c10c930 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f93e80cbb20 tx=0x7f93e809b910 comp rx=0 tx=0).stop 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 -- 172.21.15.12:0/2398322903 shutdown_connections 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56377c117e60 0x56377c11a280 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103e60 0x56377c113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 --2- 172.21.15.12:0/2398322903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c10c930 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f93e17fa700 0 client.19755 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 -- 172.21.15.12:0/2398322903 >> 172.21.15.12:0/2398322903 conn(0x56377c031860 msgr2=0x56377c1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 -- 172.21.15.12:0/2398322903 shutdown_connections 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.412+0000 7f9413970b80 1 -- 172.21.15.12:0/2398322903 wait complete. 2023-12-11T20:30:47.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.413+0000 7f9413970b80 20 client.19755 trim_cache size 0 max 16384 2023-12-11T20:30:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.432+0000 7f9413970b80 1 Processor -- start 2023-12-11T20:30:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f9413970b80 1 -- start start 2023-12-11T20:30:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f9413970b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c102ae0 0x56377c104240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f9413970b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c113930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f9413970b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c11ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f9413970b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c11a610 con 0x56377c103440 2023-12-11T20:30:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f9413970b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c104780 con 0x56377c102ae0 2023-12-11T20:30:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f9413970b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c0f9bb0 con 0x56377c103e60 2023-12-11T20:30:47.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f93fd59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f93fd59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c113930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51130/0 (socket says 172.21.15.12:51130) 2023-12-11T20:30:47.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f93fd59a700 1 -- 172.21.15.12:0/1105873740 learned_addr learned my addr 172.21.15.12:0/1105873740 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c102ae0 0x56377c104240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.433+0000 7f93fe59c700 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c11ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93fd59a700 1 -- 172.21.15.12:0/1105873740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 msgr2=0x56377c11ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93fd59a700 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c11ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93fd59a700 1 -- 172.21.15.12:0/1105873740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c102ae0 msgr2=0x56377c104240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93fd59a700 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c102ae0 0x56377c104240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93fd59a700 1 -- 172.21.15.12:0/1105873740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56377be68ce0 con 0x56377c103440 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93fe59c700 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c11ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93fd59a700 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c113930 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f93e8099720 tx=0x7f93e8099980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be58c29a715776a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93ecff9700 1 -- 172.21.15.12:0/1105873740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e809ad30 con 0x56377c103440 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93ecff9700 1 -- 172.21.15.12:0/1105873740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93e80b8030 con 0x56377c103440 2023-12-11T20:30:47.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.434+0000 7f93ecff9700 1 -- 172.21.15.12:0/1105873740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e809f520 con 0x56377c103440 2023-12-11T20:30:47.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 -- 172.21.15.12:0/1105873740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 msgr2=0x56377c113930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c113930 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f93e8099720 tx=0x7f93e8099980 comp rx=0 tx=0).stop 2023-12-11T20:30:47.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 -- 172.21.15.12:0/1105873740 shutdown_connections 2023-12-11T20:30:47.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c102ae0 0x56377c104240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c103e60 0x56377c11ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 --2- 172.21.15.12:0/1105873740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103440 0x56377c113930 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 -- 172.21.15.12:0/1105873740 >> 172.21.15.12:0/1105873740 conn(0x56377c031860 msgr2=0x56377c0fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 -- 172.21.15.12:0/1105873740 shutdown_connections 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 -- 172.21.15.12:0/1105873740 wait complete. 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.435+0000 7f9413970b80 1 -- start start 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.436+0000 7f9413970b80 1 Processor -- start 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.436+0000 7f9413970b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c113640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.436+0000 7f9413970b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c111cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.436+0000 7f9413970b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103e60 0x56377c112230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.436+0000 7f9413970b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c112770 con 0x56377c103e60 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.436+0000 7f9413970b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c1128e0 con 0x56377c103440 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.436+0000 7f9413970b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c112aa0 con 0x56377c102ae0 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.436+0000 7f9413970b80 10 client.0 _ll_register_callbacks cb 0x56377bf3bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103e60 0x56377c112230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fdd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fdd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:38038/0 (socket says 172.21.15.12:38038) 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103e60 0x56377c112230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51142/0 (socket says 172.21.15.12:51142) 2023-12-11T20:30:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fdd9b700 1 -- 172.21.15.12:0/689189831 learned_addr learned my addr 172.21.15.12:0/689189831 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fd59a700 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c111cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fd59a700 1 -- 172.21.15.12:0/689189831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 msgr2=0x56377c113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fd59a700 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c113640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fd59a700 1 -- 172.21.15.12:0/689189831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103e60 msgr2=0x56377c112230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fd59a700 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103e60 0x56377c112230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fd59a700 1 -- 172.21.15.12:0/689189831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56377be7fe60 con 0x56377c103440 2023-12-11T20:30:47.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:47.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fe59c700 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103e60 0x56377c112230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:47.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93fd59a700 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c111cf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93e80a3890 tx=0x7f93e8005ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55af83279505d50 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.437+0000 7f93e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:30:47.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f93e17fa700 1 -- 172.21.15.12:0/689189831 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80a1520 con 0x56377c103440 2023-12-11T20:30:47.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f9413970b80 1 -- 172.21.15.12:0/689189831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56377c0f82e0 con 0x56377c103440 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f93e17fa700 1 -- 172.21.15.12:0/689189831 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f93e809bad0 con 0x56377c103440 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f93e17fa700 1 -- 172.21.15.12:0/689189831 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93e809f520 con 0x56377c103440 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f9413970b80 10 client.29306 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f9413970b80 1 -- 172.21.15.12:0/689189831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56377bea62d0 con 0x56377c103440 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f93e17fa700 1 -- 172.21.15.12:0/689189831 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93e8080080 con 0x56377c103440 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f93e17fa700 1 -- 172.21.15.12:0/689189831 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f93e8097310 con 0x56377c103440 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.438+0000 7f9413970b80 10 client.29306 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.439+0000 7f9413970b80 10 client.29306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.439+0000 7f9413970b80 20 client.29306 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.439+0000 7f9413970b80 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56377c16f4b0 0x56377c1718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.439+0000 7f9413970b80 4 client.29306 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.439+0000 7f9413970b80 1 -- 172.21.15.12:0/689189831 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f93f4021070 con 0x56377c16f4b0 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.439+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56377c16f4b0 0x56377c1718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.440+0000 7f93fdd9b700 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56377c16f4b0 0x56377c1718a0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4bf226d8de1c956 server_cookie=3c3d2599b3eb6d9b in_seq=0 out_seq=0 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.440+0000 7f93e17fa700 10 client.29306 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f93e17fa700 1 -- 172.21.15.12:0/689189831 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f93f4021070 con 0x56377c16f4b0 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f93e17fa700 10 client.29306 handle_command_reply: tid=0 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 client.29306 shutdown 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 -- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 msgr2=0x56377c111cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c111cf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f93e80a3890 tx=0x7f93e8005ac0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 -- 172.21.15.12:0/689189831 shutdown_connections 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56377c16f4b0 0x56377c1718a0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56377c103e60 0x56377c112230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56377c102ae0 0x56377c113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 --2- 172.21.15.12:0/689189831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56377c103440 0x56377c111cf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f93e17fa700 0 client.29306 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 -- 172.21.15.12:0/689189831 >> 172.21.15.12:0/689189831 conn(0x56377c031860 msgr2=0x56377c11ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 -- 172.21.15.12:0/689189831 shutdown_connections 2023-12-11T20:30:47.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.441+0000 7f9413970b80 1 -- 172.21.15.12:0/689189831 wait complete. 2023-12-11T20:30:47.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f9413970b80 20 client.29306 trim_cache size 0 max 16384 2023-12-11T20:30:47.442 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:30:47.442 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:30:47.442 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "166f0b96-4fe9-4e01-80d1-09d23da0bf23", 2023-12-11T20:30:47.442 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:30:47.442 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 -- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93e40a1520 msgr2=0x7f93e40a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93e40a1520 0x7f93e40a39e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009c60 tx=0x7f93f4009260 comp rx=0 tx=0).stop 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 -- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 msgr2=0x7f93f8199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 0x7f93f8199800 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006010 tx=0x7f93e8004730 comp rx=0 tx=0).stop 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 -- 172.21.15.12:0/1815635858 shutdown_connections 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f93e40a1520 0x7f93e40a39e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93f8107090 0x7f93f81a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93f8101e30 0x7f93f81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 --2- 172.21.15.12:0/1815635858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93f8104760 0x7f93f8199800 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 -- 172.21.15.12:0/1815635858 >> 172.21.15.12:0/1815635858 conn(0x7f93f80fb740 msgr2=0x7f93f81015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 -- 172.21.15.12:0/1815635858 shutdown_connections 2023-12-11T20:30:47.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.442+0000 7f93fed9d700 1 -- 172.21.15.12:0/1815635858 wait complete. 2023-12-11T20:30:47.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:30:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:46 smithi032 ceph-mon[132488]: pgmap v820: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 16 MiB/s wr, 14 op/s 2023-12-11T20:30:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 -- 172.21.15.12:0/4117687670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 msgr2=0x7f0f001018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 --2- 172.21.15.12:0/4117687670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 0x7f0f001018d0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00099c0 tx=0x7f0ef0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 -- 172.21.15.12:0/4117687670 shutdown_connections 2023-12-11T20:30:47.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 --2- 172.21.15.12:0/4117687670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f00103040 0x7f0f001098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 --2- 172.21.15.12:0/4117687670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 0x7f0f001018d0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 --2- 172.21.15.12:0/4117687670 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f001026a0 0x7f0f00102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 -- 172.21.15.12:0/4117687670 >> 172.21.15.12:0/4117687670 conn(0x7f0f000fca00 msgr2=0x7f0f000fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 -- 172.21.15.12:0/4117687670 shutdown_connections 2023-12-11T20:30:47.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.693+0000 7f0f051ff700 1 -- 172.21.15.12:0/4117687670 wait complete. 2023-12-11T20:30:47.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.694+0000 7f0f051ff700 1 Processor -- start 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.694+0000 7f0f051ff700 1 -- start start 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0f051ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 0x7f0f00199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0f051ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f001026a0 0x7f0f00199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0f051ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f00103040 0x7f0f001a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0f051ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f001a1050 con 0x7f0f001014b0 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0f051ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f001a1190 con 0x7f0f001026a0 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0f051ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f001a1320 con 0x7f0f00103040 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0efed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 0x7f0f00199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0efed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 0x7f0f00199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51158/0 (socket says 172.21.15.12:51158) 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0efed9d700 1 -- 172.21.15.12:0/595297746 learned_addr learned my addr 172.21.15.12:0/595297746 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0efe59c700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f001026a0 0x7f0f00199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.695+0000 7f0eff59e700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f00103040 0x7f0f001a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0efed9d700 1 -- 172.21.15.12:0/595297746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f00103040 msgr2=0x7f0f001a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0efed9d700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f00103040 0x7f0f001a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0efed9d700 1 -- 172.21.15.12:0/595297746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f001026a0 msgr2=0x7f0f00199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0efed9d700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f001026a0 0x7f0f00199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0efed9d700 1 -- 172.21.15.12:0/595297746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00095f0 con 0x7f0f001014b0 2023-12-11T20:30:47.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0eff59e700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f00103040 0x7f0f001a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:47.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0efed9d700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 0x7f0f00199520 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00098e0 tx=0x7f0ef0003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0ee7fff700 1 -- 172.21.15.12:0/595297746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef001d070 con 0x7f0f001014b0 2023-12-11T20:30:47.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0ee7fff700 1 -- 172.21.15.12:0/595297746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ef000bd50 con 0x7f0f001014b0 2023-12-11T20:30:47.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0f051ff700 1 -- 172.21.15.12:0/595297746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f001a15a0 con 0x7f0f001014b0 2023-12-11T20:30:47.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0ee7fff700 1 -- 172.21.15.12:0/595297746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0022c80 con 0x7f0f001014b0 2023-12-11T20:30:47.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.696+0000 7f0f051ff700 1 -- 172.21.15.12:0/595297746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f001a1a50 con 0x7f0f001014b0 2023-12-11T20:30:47.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.700+0000 7f0ee7fff700 1 -- 172.21.15.12:0/595297746 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0ef0022470 con 0x7f0f001014b0 2023-12-11T20:30:47.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.701+0000 7f0ee7fff700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ee80a1480 0x7f0ee80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.701+0000 7f0ee7fff700 1 -- 172.21.15.12:0/595297746 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0ef00ce190 con 0x7f0f001014b0 2023-12-11T20:30:47.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.702+0000 7f0efe59c700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ee80a1480 0x7f0ee80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.702+0000 7f0f18bd7b80 1 Processor -- start 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.702+0000 7f0f18bd7b80 1 -- start start 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.702+0000 7f0efe59c700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ee80a1480 0x7f0ee80a3940 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4005950 tx=0x7f0ef400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.702+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 0x558e5538b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.702+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e5538c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.702+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5538d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e552e6b50 con 0x558e5538cc20 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e552e4470 con 0x558e5538bd30 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e552dfd60 con 0x558e5538b3d0 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0efe59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e5538c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0eff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5538d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0efe59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e5538c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37358/0 (socket says 172.21.15.12:37358) 2023-12-11T20:30:47.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0efe59c700 1 -- 172.21.15.12:0/1981878391 learned_addr learned my addr 172.21.15.12:0/1981878391 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0efed9d700 1 --2- 172.21.15.12:0/1981878391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 0x558e5538b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0eff59e700 1 -- 172.21.15.12:0/1981878391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 msgr2=0x558e5538b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0eff59e700 1 --2- 172.21.15.12:0/1981878391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 0x558e5538b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0eff59e700 1 -- 172.21.15.12:0/1981878391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 msgr2=0x558e5538c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0eff59e700 1 --2- 172.21.15.12:0/1981878391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e5538c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.703+0000 7f0eff59e700 1 -- 172.21.15.12:0/1981878391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5515c630 con 0x558e5538cc20 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.704+0000 7f0eff59e700 1 --2- 172.21.15.12:0/1981878391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5538d0a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8007fd0 tx=0x7f0ef800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89bfa890e4d40be server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.704+0000 7f0ee57fa700 1 -- 172.21.15.12:0/1981878391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8018070 con 0x558e5538cc20 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.704+0000 7f0ee57fa700 1 -- 172.21.15.12:0/1981878391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ef800ecd0 con 0x558e5538cc20 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.704+0000 7f0ee57fa700 1 -- 172.21.15.12:0/1981878391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8014b70 con 0x558e5538cc20 2023-12-11T20:30:47.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/1981878391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 msgr2=0x558e5538d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/1981878391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5538d0a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8007fd0 tx=0x7f0ef800e440 comp rx=0 tx=0).stop 2023-12-11T20:30:47.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/1981878391 shutdown_connections 2023-12-11T20:30:47.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/1981878391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5538d0a0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/1981878391 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 0x558e5538b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/1981878391 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e5538c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/1981878391 >> 172.21.15.12:0/1981878391 conn(0x558e552ba7e0 msgr2=0x558e55387d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/1981878391 shutdown_connections 2023-12-11T20:30:47.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.705+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/1981878391 wait complete. 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 1 -- start start 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 1 Processor -- start 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 0x558e55395180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e553956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e55299560 con 0x558e5538cc20 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e55299200 con 0x558e5538bd30 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5515e920 con 0x558e5538b3d0 2023-12-11T20:30:47.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.706+0000 7f0f18bd7b80 10 client.0 _ll_register_callbacks cb 0x558e551c4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0eff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0eff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51170/0 (socket says 172.21.15.12:51170) 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0eff59e700 1 -- 172.21.15.12:0/3589987932 learned_addr learned my addr 172.21.15.12:0/3589987932 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0efed9d700 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 0x558e55395180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0efe59c700 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e553956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0eff59e700 1 -- 172.21.15.12:0/3589987932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 msgr2=0x558e55395180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 0x558e55395180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0eff59e700 1 -- 172.21.15.12:0/3589987932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 msgr2=0x558e553956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e553956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.707+0000 7f0eff59e700 1 -- 172.21.15.12:0/3589987932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef800f040 con 0x558e5538cc20 2023-12-11T20:30:47.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539c700 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8007fa0 tx=0x7f0ef8004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd70f67210c6a41c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0ee2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:47.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3589987932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8018040 con 0x558e5538cc20 2023-12-11T20:30:47.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3589987932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e5537eb40 con 0x558e5538cc20 2023-12-11T20:30:47.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3589987932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0ef8014ab0 con 0x558e5538cc20 2023-12-11T20:30:47.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3589987932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ef8014790 con 0x558e5538cc20 2023-12-11T20:30:47.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0f18bd7b80 10 client.19773 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:47.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3589987932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558e55108de0 con 0x558e5538cc20 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.708+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3589987932 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558e5537eb40 con 0x558e5538cc20 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.709+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3589987932 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0ef8004340 con 0x558e5538cc20 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.709+0000 7f0f18bd7b80 10 client.19773 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.709+0000 7f0f18bd7b80 10 client.19773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.709+0000 7f0f18bd7b80 20 client.19773 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.709+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e553a0f40 0x558e553a3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.709+0000 7f0f18bd7b80 4 client.19773 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.709+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3589987932 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e5535af40 con 0x558e553a0f40 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.709+0000 7f0efed9d700 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e553a0f40 0x558e553a3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.710+0000 7f0ee2ff5700 10 client.19773 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.710+0000 7f0efed9d700 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e553a0f40 0x558e553a3360 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b391cf6a854c39ab server_cookie=4bb1c772da74d47c in_seq=0 out_seq=0 2023-12-11T20:30:47.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3589987932 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558e5535af40 con 0x558e553a0f40 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0ee2ff5700 10 client.19773 handle_command_reply: tid=0 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 client.19773 shutdown 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3589987932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 msgr2=0x558e5539c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539c700 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8007fa0 tx=0x7f0ef8004d80 comp rx=0 tx=0).stop 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3589987932 shutdown_connections 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e553a0f40 0x558e553a3360 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539c700 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538b3d0 0x558e55395180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3589987932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538bd30 0x558e553956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0ee2ff5700 0 client.19773 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3589987932 >> 172.21.15.12:0/3589987932 conn(0x558e552ba7e0 msgr2=0x558e55386a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3589987932 shutdown_connections 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.711+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3589987932 wait complete. 2023-12-11T20:30:47.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.712+0000 7f0f18bd7b80 20 client.19773 trim_cache size 0 max 16384 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0f18bd7b80 1 Processor -- start 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0f18bd7b80 1 -- start start 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 0x558e55395180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e5539c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e553956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5538c110 con 0x558e5538cc20 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e553a8510 con 0x558e5538b3d0 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e55395e00 con 0x558e5538bd30 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.734+0000 7f0eff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e553956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0eff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e553956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51172/0 (socket says 172.21.15.12:51172) 2023-12-11T20:30:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0eff59e700 1 -- 172.21.15.12:0/3128167553 learned_addr learned my addr 172.21.15.12:0/3128167553 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0efe59c700 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e5539c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0efed9d700 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 0x558e55395180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0eff59e700 1 -- 172.21.15.12:0/3128167553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 msgr2=0x558e5539c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e5539c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0eff59e700 1 -- 172.21.15.12:0/3128167553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 msgr2=0x558e55395180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 0x558e55395180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0eff59e700 1 -- 172.21.15.12:0/3128167553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e550f1c60 con 0x558e5538cc20 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e553956c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80046d0 tx=0x7f0ef800e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65a1488ce8ed2d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0ee5ffb700 1 -- 172.21.15.12:0/3128167553 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8004df0 con 0x558e5538cc20 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.735+0000 7f0ee5ffb700 1 -- 172.21.15.12:0/3128167553 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ef8014c20 con 0x558e5538cc20 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0ee5ffb700 1 -- 172.21.15.12:0/3128167553 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef801dc60 con 0x558e5538cc20 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3128167553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 msgr2=0x558e553956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e553956c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80046d0 tx=0x7f0ef800e790 comp rx=0 tx=0).stop 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3128167553 shutdown_connections 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 0x558e55395180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e553956c0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3128167553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e5539c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3128167553 >> 172.21.15.12:0/3128167553 conn(0x558e552ba7e0 msgr2=0x558e5538fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.736+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3128167553 shutdown_connections 2023-12-11T20:30:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.737+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3128167553 wait complete. 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.737+0000 7f0f18bd7b80 1 -- start start 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.737+0000 7f0f18bd7b80 1 Processor -- start 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 0x558e553988d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e55398e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0f18bd7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5539c370 con 0x558e5538cc20 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5539c4e0 con 0x558e5538b3d0 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0f18bd7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5539c6a0 con 0x558e5538bd30 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0f18bd7b80 10 client.0 _ll_register_callbacks cb 0x558e551c4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0eff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0eff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51178/0 (socket says 172.21.15.12:51178) 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0eff59e700 1 -- 172.21.15.12:0/3120197398 learned_addr learned my addr 172.21.15.12:0/3120197398 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0efed9d700 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 0x558e553988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0efe59c700 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e55398e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0eff59e700 1 -- 172.21.15.12:0/3120197398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 msgr2=0x558e55398e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e55398e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0eff59e700 1 -- 172.21.15.12:0/3120197398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 msgr2=0x558e553988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:47.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 0x558e553988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0eff59e700 1 -- 172.21.15.12:0/3120197398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e55108de0 con 0x558e5538cc20 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.738+0000 7f0efe59c700 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e55398e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.739+0000 7f0eff59e700 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539be30 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8004890 tx=0x7f0ef8007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1b988cb50affb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.739+0000 7f0ee2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.739+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3120197398 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8018070 con 0x558e5538cc20 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.739+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3120197398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ef800ecd0 con 0x558e5538cc20 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.739+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3120197398 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0ef801d440 con 0x558e5538cc20 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.739+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3120197398 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ef8004d80 con 0x558e5538cc20 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.739+0000 7f0f18bd7b80 10 client.19779 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.739+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3120197398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558e5512f250 con 0x558e5538cc20 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3120197398 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ef800ecd0 con 0x558e5538cc20 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3120197398 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0ef8026c20 con 0x558e5538cc20 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0f18bd7b80 10 client.19779 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0f18bd7b80 10 client.19779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0f18bd7b80 20 client.19779 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e553f83f0 0x558e553fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0f18bd7b80 4 client.19779 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3120197398 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558e552a5fd0 con 0x558e553f83f0 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.740+0000 7f0efed9d700 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e553f83f0 0x558e553fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0efed9d700 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e553f83f0 0x558e553fa7e0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0994a1f7d415489 server_cookie=8989a2232fc31fbd in_seq=0 out_seq=0 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0ee2ff5700 10 client.19779 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0ee2ff5700 1 -- 172.21.15.12:0/3120197398 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558e552a5fd0 con 0x558e553f83f0 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0ee2ff5700 10 client.19779 handle_command_reply: tid=0 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 client.19779 shutdown 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3120197398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 msgr2=0x558e5539be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539be30 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8004890 tx=0x7f0ef8007ad0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3120197398 shutdown_connections 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558e553f83f0 0x558e553fa7e0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558e5538b3d0 0x558e553988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558e5538cc20 0x558e5539be30 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 --2- 172.21.15.12:0/3120197398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558e5538bd30 0x558e55398e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0ee2ff5700 0 client.19779 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.741+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3120197398 >> 172.21.15.12:0/3120197398 conn(0x558e552ba7e0 msgr2=0x558e55395120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.742+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3120197398 shutdown_connections 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.742+0000 7f0f18bd7b80 1 -- 172.21.15.12:0/3120197398 wait complete. 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.742+0000 7f0f18bd7b80 20 client.19779 trim_cache size 0 max 16384 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:30:47.743 INFO:teuthology.orchestra.run.smithi012.stdout: "166f0b96-4fe9-4e01-80d1-09d23da0bf23": { 2023-12-11T20:30:47.744 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:30:47.744 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "166f0b96-4fe9-4e01-80d1-09d23da0bf23", 2023-12-11T20:30:47.744 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:30:47.744 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:30:47.744 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:30:47.744 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:30:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.742+0000 7f0f051ff700 1 -- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ee80a1480 msgr2=0x7f0ee80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.742+0000 7f0f051ff700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ee80a1480 0x7f0ee80a3940 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4005950 tx=0x7f0ef400b410 comp rx=0 tx=0).stop 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.742+0000 7f0f051ff700 1 -- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 msgr2=0x7f0f00199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.742+0000 7f0f051ff700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 0x7f0f00199520 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00098e0 tx=0x7f0ef0003ad0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.743+0000 7f0f051ff700 1 -- 172.21.15.12:0/595297746 shutdown_connections 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.743+0000 7f0f051ff700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ee80a1480 0x7f0ee80a3940 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.743+0000 7f0f051ff700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f00103040 0x7f0f001a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.743+0000 7f0f051ff700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f001014b0 0x7f0f00199520 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.743+0000 7f0f051ff700 1 --2- 172.21.15.12:0/595297746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f001026a0 0x7f0f00199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.743+0000 7f0f051ff700 1 -- 172.21.15.12:0/595297746 >> 172.21.15.12:0/595297746 conn(0x7f0f000fca00 msgr2=0x7f0f00107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.743+0000 7f0f051ff700 1 -- 172.21.15.12:0/595297746 shutdown_connections 2023-12-11T20:30:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:30:47.743+0000 7f0f051ff700 1 -- 172.21.15.12:0/595297746 wait complete. 2023-12-11T20:30:47.761 INFO:tasks.cephfs.filesystem:scrub status for tag:166f0b96-4fe9-4e01-80d1-09d23da0bf23 - {'path': '/', 'tag': '166f0b96-4fe9-4e01-80d1-09d23da0bf23', 'options': 'recursive,force'} 2023-12-11T20:30:48.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:47 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:30:48.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:47 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:47 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:30:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:47 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:48.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:47 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:30:48.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:47 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:48 smithi039 ceph-mon[102205]: pgmap v821: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:30:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:48 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:30:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:48 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:48 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:30:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:48 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:30:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:48 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:48 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:48 smithi012 ceph-mon[128787]: pgmap v821: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:30:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:48 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:30:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:48 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:48 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:30:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:48 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:30:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:48 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:48 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:48 smithi032 ceph-mon[132488]: pgmap v821: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 14 MiB/s wr, 13 op/s 2023-12-11T20:30:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:48 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:30:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:48 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:48 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:30:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:48 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:30:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:48 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:48 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:30:51.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:50 smithi039 ceph-mon[102205]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 19 op/s 2023-12-11T20:30:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:50 smithi012 ceph-mon[128787]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 19 op/s 2023-12-11T20:30:51.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:50 smithi032 ceph-mon[132488]: pgmap v822: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 19 op/s 2023-12-11T20:30:53.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:53 smithi039 ceph-mon[102205]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:30:53.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:52 smithi012 ceph-mon[128787]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:30:53.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:53 smithi032 ceph-mon[132488]: pgmap v823: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 24 op/s 2023-12-11T20:30:55.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:55 smithi039 ceph-mon[102205]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:30:55.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:55 smithi012 ceph-mon[128787]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:30:55.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:55 smithi032 ceph-mon[132488]: pgmap v824: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:30:57.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:57 smithi039 ceph-mon[102205]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:30:57.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:57 smithi012 ceph-mon[128787]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:30:57.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:57 smithi032 ceph-mon[132488]: pgmap v825: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 34 op/s 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 -- 172.21.15.12:0/1894028049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141014f0 msgr2=0x7f8214101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 --2- 172.21.15.12:0/1894028049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141014f0 0x7f8214101910 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f82040099c0 tx=0x7f8204009cd0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 -- 172.21.15.12:0/1894028049 shutdown_connections 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 --2- 172.21.15.12:0/1894028049 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8214103080 0x7f8214109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 --2- 172.21.15.12:0/1894028049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141014f0 0x7f8214101910 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 --2- 172.21.15.12:0/1894028049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82141026e0 0x7f8214102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 -- 172.21.15.12:0/1894028049 >> 172.21.15.12:0/1894028049 conn(0x7f82140fca60 msgr2=0x7f82140feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 -- 172.21.15.12:0/1894028049 shutdown_connections 2023-12-11T20:30:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.727+0000 7f82191ff700 1 -- 172.21.15.12:0/1894028049 wait complete. 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.728+0000 7f82191ff700 1 Processor -- start 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f82191ff700 1 -- start start 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f82191ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82141014f0 0x7f8214199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f82191ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141026e0 0x7f8214199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f82191ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8214103080 0x7f82141a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f82191ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141a10f0 con 0x7f82141026e0 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f82191ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141a1230 con 0x7f8214103080 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f82191ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141a13c0 con 0x7f82141014f0 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f821259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141026e0 0x7f8214199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f821259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141026e0 0x7f8214199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53562/0 (socket says 172.21.15.12:53562) 2023-12-11T20:30:57.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.729+0000 7f821259c700 1 -- 172.21.15.12:0/1358499608 learned_addr learned my addr 172.21.15.12:0/1358499608 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f8212d9d700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82141014f0 0x7f8214199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f821359e700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8214103080 0x7f82141a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f821259c700 1 -- 172.21.15.12:0/1358499608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82141014f0 msgr2=0x7f8214199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f821259c700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82141014f0 0x7f8214199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f821259c700 1 -- 172.21.15.12:0/1358499608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8214103080 msgr2=0x7f82141a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f821259c700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8214103080 0x7f82141a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f821259c700 1 -- 172.21.15.12:0/1358499608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040095f0 con 0x7f82141026e0 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f821359e700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8214103080 0x7f82141a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.730+0000 7f821259c700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141026e0 0x7f8214199b50 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f820800d950 tx=0x7f820800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.731+0000 7f81fbfff700 1 -- 172.21.15.12:0/1358499608 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800f890 con 0x7f82141026e0 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.731+0000 7f81fbfff700 1 -- 172.21.15.12:0/1358499608 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f820800fe80 con 0x7f82141026e0 2023-12-11T20:30:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.731+0000 7f82191ff700 1 -- 172.21.15.12:0/1358499608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82141a16a0 con 0x7f82141026e0 2023-12-11T20:30:57.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.731+0000 7f81fbfff700 1 -- 172.21.15.12:0/1358499608 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800e3b0 con 0x7f82141026e0 2023-12-11T20:30:57.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.731+0000 7f82191ff700 1 -- 172.21.15.12:0/1358499608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82141a1bb0 con 0x7f82141026e0 2023-12-11T20:30:57.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.735+0000 7f81fbfff700 1 -- 172.21.15.12:0/1358499608 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8208010460 con 0x7f82141026e0 2023-12-11T20:30:57.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.736+0000 7f822cc15b80 1 Processor -- start 2023-12-11T20:30:57.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.736+0000 7f822cc15b80 1 -- start start 2023-12-11T20:30:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.736+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecebed0 0x55729ecec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.736+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729eced140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.736+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecedba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.736+0000 7f822cc15b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ec47af0 con 0x55729eced720 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.736+0000 7f822cc15b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ec45410 con 0x55729ecec830 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.736+0000 7f822cc15b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ec40d00 con 0x55729ecebed0 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f821259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecedba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f821359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecebed0 0x55729ecec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f821259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecedba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53576/0 (socket says 172.21.15.12:53576) 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f821259c700 1 -- 172.21.15.12:0/1118014656 learned_addr learned my addr 172.21.15.12:0/1118014656 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f8212d9d700 1 --2- 172.21.15.12:0/1118014656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729eced140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f81fbfff700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81fc0a1470 0x7f81fc0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f81fbfff700 1 -- 172.21.15.12:0/1358499608 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82080ccb90 con 0x7f82141026e0 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f8212d9d700 1 -- 172.21.15.12:0/1118014656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecebed0 msgr2=0x55729ecec2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f8212d9d700 1 --2- 172.21.15.12:0/1118014656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecebed0 0x55729ecec2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f8212d9d700 1 -- 172.21.15.12:0/1118014656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 msgr2=0x55729ecedba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f8212d9d700 1 --2- 172.21.15.12:0/1118014656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecedba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f8212d9d700 1 -- 172.21.15.12:0/1118014656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55729eabd5d0 con 0x55729ecec830 2023-12-11T20:30:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.737+0000 7f821359e700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81fc0a1470 0x7f81fc0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.738+0000 7f8212d9d700 1 --2- 172.21.15.12:0/1118014656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729eced140 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8204009990 tx=0x7f8204005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba316b0b9c12e1a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:57.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.738+0000 7f821359e700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81fc0a1470 0x7f81fc0a3930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f820c009550 tx=0x7f820c004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.738+0000 7f81f97fa700 1 -- 172.21.15.12:0/1118014656 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820401d070 con 0x55729ecec830 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.738+0000 7f81f97fa700 1 -- 172.21.15.12:0/1118014656 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f820401e040 con 0x55729ecec830 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.738+0000 7f81f97fa700 1 -- 172.21.15.12:0/1118014656 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204004500 con 0x55729ecec830 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 -- 172.21.15.12:0/1118014656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 msgr2=0x55729eced140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1118014656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729eced140 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8204009990 tx=0x7f8204005e80 comp rx=0 tx=0).stop 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 -- 172.21.15.12:0/1118014656 shutdown_connections 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1118014656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecedba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1118014656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecebed0 0x55729ecec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1118014656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729eced140 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 -- 172.21.15.12:0/1118014656 >> 172.21.15.12:0/1118014656 conn(0x55729ec1b780 msgr2=0x55729ece8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 -- 172.21.15.12:0/1118014656 shutdown_connections 2023-12-11T20:30:57.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.739+0000 7f822cc15b80 1 -- 172.21.15.12:0/1118014656 wait complete. 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.740+0000 7f822cc15b80 1 -- start start 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.740+0000 7f822cc15b80 1 Processor -- start 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecfd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f822cc15b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ebfa500 con 0x55729eced720 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f822cc15b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ebfa1a0 con 0x55729ecebed0 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f822cc15b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729eabf8c0 con 0x55729ecec830 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f822cc15b80 10 client.0 _ll_register_callbacks cb 0x55729eb25a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f821259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f821359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecfd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f8212d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f8212d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:39486/0 (socket says 172.21.15.12:39486) 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f8212d9d700 1 -- 172.21.15.12:0/1690444862 learned_addr learned my addr 172.21.15.12:0/1690444862 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f821259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:57118/0 (socket says 172.21.15.12:57118) 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f821359e700 1 -- 172.21.15.12:0/1690444862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecec830 msgr2=0x55729ecf62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f821359e700 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f821359e700 1 -- 172.21.15.12:0/1690444862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 msgr2=0x55729ecf5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.741+0000 7f821359e700 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f821359e700 1 -- 172.21.15.12:0/1690444862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821410a280 con 0x55729eced720 2023-12-11T20:30:57.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f8212d9d700 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f821259c700 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f821359e700 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecfd110 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f820c007960 tx=0x7f820c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d9479b8c73ed85 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:57.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f81f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f81f6ff5700 1 -- 172.21.15.12:0/1690444862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c023830 con 0x55729eced720 2023-12-11T20:30:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f822cc15b80 1 -- 172.21.15.12:0/1690444862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55729ecdf730 con 0x55729eced720 2023-12-11T20:30:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f81f6ff5700 1 -- 172.21.15.12:0/1690444862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f820c01e050 con 0x55729eced720 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.742+0000 7f81f6ff5700 1 -- 172.21.15.12:0/1690444862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820c023990 con 0x55729eced720 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f822cc15b80 10 client.19791 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f822cc15b80 1 -- 172.21.15.12:0/1690444862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55729ea69d80 con 0x55729eced720 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f81f6ff5700 1 -- 172.21.15.12:0/1690444862 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55729ecdf730 con 0x55729eced720 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f81f6ff5700 1 -- 172.21.15.12:0/1690444862 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f820c02b940 con 0x55729eced720 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f822cc15b80 10 client.19791 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f822cc15b80 10 client.19791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f822cc15b80 20 client.19791 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55729ed01d00 0x55729ed04120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f822cc15b80 4 client.19791 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.743+0000 7f822cc15b80 1 -- 172.21.15.12:0/1690444862 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55729ecbbee0 con 0x55729ed01d00 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.744+0000 7f8212d9d700 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55729ed01d00 0x55729ed04120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.744+0000 7f8212d9d700 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55729ed01d00 0x55729ed04120 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ec0c7a2a9f068c server_cookie=d00e66b982be0406 in_seq=0 out_seq=0 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.744+0000 7f81f6ff5700 10 client.19791 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.745+0000 7f81f6ff5700 1 -- 172.21.15.12:0/1690444862 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55729ecbbee0 con 0x55729ed01d00 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.745+0000 7f81f6ff5700 10 client.19791 handle_command_reply: tid=0 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.745+0000 7f822cc15b80 1 client.19791 shutdown 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.745+0000 7f822cc15b80 1 -- 172.21.15.12:0/1690444862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 msgr2=0x55729ecfd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.745+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecfd110 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f820c007960 tx=0x7f820c004ad0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.745+0000 7f822cc15b80 1 -- 172.21.15.12:0/1690444862 shutdown_connections 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.745+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55729ed01d00 0x55729ed04120 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.746+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.746+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729eced720 0x55729ecfd110 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.746+0000 7f822cc15b80 1 --2- 172.21.15.12:0/1690444862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.746+0000 7f822cc15b80 1 -- 172.21.15.12:0/1690444862 >> 172.21.15.12:0/1690444862 conn(0x55729ec1b780 msgr2=0x55729ece6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.746+0000 7f81f6ff5700 0 client.19791 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.746+0000 7f822cc15b80 1 -- 172.21.15.12:0/1690444862 shutdown_connections 2023-12-11T20:30:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.746+0000 7f822cc15b80 1 -- 172.21.15.12:0/1690444862 wait complete. 2023-12-11T20:30:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.746+0000 7f822cc15b80 20 client.19791 trim_cache size 0 max 16384 2023-12-11T20:30:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.769+0000 7f822cc15b80 1 Processor -- start 2023-12-11T20:30:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.769+0000 7f822cc15b80 1 -- start start 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ecfd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f822cc15b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ececc90 con 0x55729ecec830 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f822cc15b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ed01af0 con 0x55729ecebed0 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f822cc15b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ecf4ba0 con 0x55729eced720 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f821259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f8212d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f821259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53582/0 (socket says 172.21.15.12:53582) 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f821259c700 1 -- 172.21.15.12:0/676910954 learned_addr learned my addr 172.21.15.12:0/676910954 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f821359e700 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ecfd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f8212d9d700 1 -- 172.21.15.12:0/676910954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 msgr2=0x55729ecfd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f8212d9d700 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ecfd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f8212d9d700 1 -- 172.21.15.12:0/676910954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecec830 msgr2=0x55729ecf62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f8212d9d700 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f8212d9d700 1 -- 172.21.15.12:0/676910954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55729ea52c00 con 0x55729ecebed0 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f821359e700 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ecfd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.770+0000 7f821259c700 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.771+0000 7f8212d9d700 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8204009350 tx=0x7f8204003740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f67f214851fc09 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.771+0000 7f81f9ffb700 1 -- 172.21.15.12:0/676910954 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820401d040 con 0x55729ecebed0 2023-12-11T20:30:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.771+0000 7f81f9ffb700 1 -- 172.21.15.12:0/676910954 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8204005320 con 0x55729ecebed0 2023-12-11T20:30:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.771+0000 7f81f9ffb700 1 -- 172.21.15.12:0/676910954 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204034750 con 0x55729ecebed0 2023-12-11T20:30:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 -- 172.21.15.12:0/676910954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 msgr2=0x55729ecf5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8204009350 tx=0x7f8204003740 comp rx=0 tx=0).stop 2023-12-11T20:30:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 -- 172.21.15.12:0/676910954 shutdown_connections 2023-12-11T20:30:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecebed0 0x55729ecf5da0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ecfd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 --2- 172.21.15.12:0/676910954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecec830 0x55729ecf62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 -- 172.21.15.12:0/676910954 >> 172.21.15.12:0/676910954 conn(0x55729ec1b780 msgr2=0x55729ed08a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 -- 172.21.15.12:0/676910954 shutdown_connections 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.772+0000 7f822cc15b80 1 -- 172.21.15.12:0/676910954 wait complete. 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 1 -- start start 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 1 Processor -- start 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecebed0 0x55729ecf2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729ed54190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ed566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ecf32e0 con 0x55729ecebed0 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ecf3450 con 0x55729ecec830 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55729ed56c70 con 0x55729eced720 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.773+0000 7f822cc15b80 10 client.0 _ll_register_callbacks cb 0x55729eb25a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecebed0 0x55729ecf2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecebed0 0x55729ecf2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53588/0 (socket says 172.21.15.12:53588) 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 -- 172.21.15.12:0/2111635004 learned_addr learned my addr 172.21.15.12:0/2111635004 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:30:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f821359e700 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ed566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f821259c700 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729ed54190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 -- 172.21.15.12:0/2111635004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 msgr2=0x55729ed566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ed566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 -- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 msgr2=0x55729ed54190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729ed54190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 -- 172.21.15.12:0/2111635004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82141a1bb0 con 0x55729ecebed0 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f821259c700 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729ed54190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f8212d9d700 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecebed0 0x55729ecf2c90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f8204006010 tx=0x7f8204005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea61bfe3c5868b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.774+0000 7f81f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.775+0000 7f81f6ff5700 1 -- 172.21.15.12:0/2111635004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820401d070 con 0x55729ecebed0 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.775+0000 7f81f6ff5700 1 -- 172.21.15.12:0/2111635004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82040346d0 con 0x55729ecebed0 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.775+0000 7f822cc15b80 1 -- 172.21.15.12:0/2111635004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55729ecf5730 con 0x55729ecebed0 2023-12-11T20:30:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.775+0000 7f81f6ff5700 1 -- 172.21.15.12:0/2111635004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8204034890 con 0x55729ecebed0 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.775+0000 7f822cc15b80 10 client.19797 fetch_fsmap learned FSMap version 32 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.775+0000 7f822cc15b80 1 -- 172.21.15.12:0/2111635004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55729eabd5d0 con 0x55729ecebed0 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.775+0000 7f81f6ff5700 1 -- 172.21.15.12:0/2111635004 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55729ecf5730 con 0x55729ecebed0 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.775+0000 7f81f6ff5700 1 -- 172.21.15.12:0/2111635004 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8204003e30 con 0x55729ecebed0 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.776+0000 7f822cc15b80 10 client.19797 fetch_fsmap finished waiting for FSMap version 32 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.776+0000 7f822cc15b80 10 client.19797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.776+0000 7f822cc15b80 20 client.19797 populate_metadata read hostname 'smithi012' 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.776+0000 7f822cc15b80 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55729ed58130 0x55729ed5a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.776+0000 7f822cc15b80 4 client.19797 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.776+0000 7f822cc15b80 1 -- 172.21.15.12:0/2111635004 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f820401e040 con 0x55729ed58130 2023-12-11T20:30:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.776+0000 7f821259c700 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55729ed58130 0x55729ed5a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:30:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.777+0000 7f81f6ff5700 10 client.19797 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.777+0000 7f821259c700 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55729ed58130 0x55729ed5a550 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c50ff9ee239023 server_cookie=89ff01556166f91 in_seq=0 out_seq=0 2023-12-11T20:30:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f81f6ff5700 1 -- 172.21.15.12:0/2111635004 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f820401e040 con 0x55729ed58130 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f81f6ff5700 10 client.19797 handle_command_reply: tid=0 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 client.19797 shutdown 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 -- 172.21.15.12:0/2111635004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecebed0 msgr2=0x55729ecf2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecebed0 0x55729ecf2c90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f8204006010 tx=0x7f8204005e80 comp rx=0 tx=0).stop 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 -- 172.21.15.12:0/2111635004 shutdown_connections 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55729ed58130 0x55729ed5a550 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55729eced720 0x55729ed566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55729ecebed0 0x55729ecf2c90 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 --2- 172.21.15.12:0/2111635004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55729ecec830 0x55729ed54190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f81f6ff5700 0 client.19797 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:30:57.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 -- 172.21.15.12:0/2111635004 >> 172.21.15.12:0/2111635004 conn(0x55729ec1b780 msgr2=0x55729ece8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.787+0000 7f822cc15b80 1 -- 172.21.15.12:0/2111635004 shutdown_connections 2023-12-11T20:30:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.788+0000 7f822cc15b80 1 -- 172.21.15.12:0/2111635004 wait complete. 2023-12-11T20:30:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.788+0000 7f822cc15b80 20 client.19797 trim_cache size 0 max 16384 2023-12-11T20:30:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:30:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:30:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:30:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.788+0000 7f82191ff700 1 -- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81fc0a1470 msgr2=0x7f81fc0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.788+0000 7f82191ff700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81fc0a1470 0x7f81fc0a3930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f820c009550 tx=0x7f820c004b40 comp rx=0 tx=0).stop 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.788+0000 7f82191ff700 1 -- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141026e0 msgr2=0x7f8214199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.788+0000 7f82191ff700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141026e0 0x7f8214199b50 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f820800d950 tx=0x7f820800dc60 comp rx=0 tx=0).stop 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.789+0000 7f82191ff700 1 -- 172.21.15.12:0/1358499608 shutdown_connections 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.789+0000 7f82191ff700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f81fc0a1470 0x7f81fc0a3930 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.789+0000 7f82191ff700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8214103080 0x7f82141a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.789+0000 7f82191ff700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82141014f0 0x7f8214199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.789+0000 7f82191ff700 1 --2- 172.21.15.12:0/1358499608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82141026e0 0x7f8214199b50 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.789+0000 7f82191ff700 1 -- 172.21.15.12:0/1358499608 >> 172.21.15.12:0/1358499608 conn(0x7f82140fca60 msgr2=0x7f8214107fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:30:57.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.789+0000 7f82191ff700 1 -- 172.21.15.12:0/1358499608 shutdown_connections 2023-12-11T20:30:57.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:30:57.789+0000 7f82191ff700 1 -- 172.21.15.12:0/1358499608 wait complete. 2023-12-11T20:30:59.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:30:59 smithi039 ceph-mon[102205]: pgmap v826: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:30:59.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:30:59 smithi012 ceph-mon[128787]: pgmap v826: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:30:59.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:30:59 smithi032 ceph-mon[132488]: pgmap v826: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:31:01.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:01 smithi039 ceph-mon[102205]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:01 smithi012 ceph-mon[128787]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:01 smithi032 ceph-mon[132488]: pgmap v827: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:02.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:02 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:31:02.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:02 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:31:02.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:02 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:31:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:02 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:31:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:02 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:31:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:02 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:31:02.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:02 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:31:02.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:02 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:31:02.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:02 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:31:03.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:03 smithi039 ceph-mon[102205]: pgmap v828: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 26 op/s 2023-12-11T20:31:03.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:03 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:31:03.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:03 smithi012 ceph-mon[128787]: pgmap v828: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 26 op/s 2023-12-11T20:31:03.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:03 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:31:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:03 smithi032 ceph-mon[132488]: pgmap v828: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 26 op/s 2023-12-11T20:31:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:03 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:31:05.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:05 smithi039 ceph-mon[102205]: pgmap v829: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 23 op/s 2023-12-11T20:31:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:05 smithi012 ceph-mon[128787]: pgmap v829: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 23 op/s 2023-12-11T20:31:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:05 smithi032 ceph-mon[132488]: pgmap v829: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 23 op/s 2023-12-11T20:31:07.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:07 smithi039 ceph-mon[102205]: pgmap v830: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:31:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:07 smithi012 ceph-mon[128787]: pgmap v830: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:31:07.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:07 smithi032 ceph-mon[132488]: pgmap v830: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:31:09.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:09 smithi039 ceph-mon[102205]: pgmap v831: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:09 smithi012 ceph-mon[128787]: pgmap v831: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:09 smithi032 ceph-mon[132488]: pgmap v831: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 -- 172.21.15.12:0/2802841064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 msgr2=0x7f808c102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 --2- 172.21.15.12:0/2802841064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 0x7f808c102b20 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f80800099c0 tx=0x7f8080009cd0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 -- 172.21.15.12:0/2802841064 shutdown_connections 2023-12-11T20:31:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 --2- 172.21.15.12:0/2802841064 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f808c1014d0 0x7f808c1018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 --2- 172.21.15.12:0/2802841064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f808c103060 0x7f808c109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 --2- 172.21.15.12:0/2802841064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 0x7f808c102b20 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 -- 172.21.15.12:0/2802841064 >> 172.21.15.12:0/2802841064 conn(0x7f808c0fca60 msgr2=0x7f808c0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 -- 172.21.15.12:0/2802841064 shutdown_connections 2023-12-11T20:31:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.008+0000 7f80909ff700 1 -- 172.21.15.12:0/2802841064 wait complete. 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.009+0000 7f80909ff700 1 Processor -- start 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.009+0000 7f80909ff700 1 -- start start 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f80909ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f808c1014d0 0x7f808c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f80909ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 0x7f808c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f80909ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f808c103060 0x7f808c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f80909ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1a10c0 con 0x7f808c1026c0 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f80909ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1a1200 con 0x7f808c1014d0 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f80909ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1a1390 con 0x7f808c103060 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f8089d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 0x7f808c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f8089d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 0x7f808c199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41852/0 (socket says 172.21.15.12:41852) 2023-12-11T20:31:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f8089d9b700 1 -- 172.21.15.12:0/1533258451 learned_addr learned my addr 172.21.15.12:0/1533258451 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f808a59c700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f808c1014d0 0x7f808c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.010+0000 7f808ad9d700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f808c103060 0x7f808c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f8089d9b700 1 -- 172.21.15.12:0/1533258451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f808c103060 msgr2=0x7f808c1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f8089d9b700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f808c103060 0x7f808c1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f8089d9b700 1 -- 172.21.15.12:0/1533258451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f808c1014d0 msgr2=0x7f808c199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f8089d9b700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f808c1014d0 0x7f808c199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f8089d9b700 1 -- 172.21.15.12:0/1533258451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800095f0 con 0x7f808c1026c0 2023-12-11T20:31:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f8089d9b700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 0x7f808c199ad0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8080009fd0 tx=0x7f808000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f807b7fe700 1 -- 172.21.15.12:0/1533258451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808001d070 con 0x7f808c1026c0 2023-12-11T20:31:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f807b7fe700 1 -- 172.21.15.12:0/1533258451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f808000bd10 con 0x7f808c1026c0 2023-12-11T20:31:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f80909ff700 1 -- 172.21.15.12:0/1533258451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c1a1610 con 0x7f808c1026c0 2023-12-11T20:31:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f807b7fe700 1 -- 172.21.15.12:0/1533258451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080004bb0 con 0x7f808c1026c0 2023-12-11T20:31:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.011+0000 7f80909ff700 1 -- 172.21.15.12:0/1533258451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c1a1a90 con 0x7f808c1026c0 2023-12-11T20:31:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.015+0000 7f807b7fe700 1 -- 172.21.15.12:0/1533258451 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8080004d10 con 0x7f808c1026c0 2023-12-11T20:31:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.016+0000 7f80a4334b80 1 Processor -- start 2023-12-11T20:31:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.016+0000 7f80a4334b80 1 -- start start 2023-12-11T20:31:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f807b7fe700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80740a14f0 0x7f80740a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348ded0 0x5582c348e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348e830 0x5582c348f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c348fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f80a4334b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c33e9af0 con 0x5582c348ded0 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f80a4334b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c33e7410 con 0x5582c348e830 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f80a4334b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c33e2d00 con 0x5582c348f720 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f807b7fe700 1 -- 172.21.15.12:0/1533258451 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f80800cdad0 con 0x7f808c1026c0 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f808a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348ded0 0x5582c348e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f808ad9d700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80740a14f0 0x7f80740a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f808a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348ded0 0x5582c348e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41858/0 (socket says 172.21.15.12:41858) 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.017+0000 7f808a59c700 1 -- 172.21.15.12:0/517309908 learned_addr learned my addr 172.21.15.12:0/517309908 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f8089d9b700 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348e830 0x5582c348f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f808ad9d700 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c348fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f808a59c700 1 -- 172.21.15.12:0/517309908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 msgr2=0x5582c348fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f808a59c700 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c348fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f808a59c700 1 -- 172.21.15.12:0/517309908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348e830 msgr2=0x5582c348f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f808a59c700 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348e830 0x5582c348f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f808a59c700 1 -- 172.21.15.12:0/517309908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c325f5d0 con 0x5582c348ded0 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f8089d9b700 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348e830 0x5582c348f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f808a59c700 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348ded0 0x5582c348e2f0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f807c009d30 tx=0x7f807c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b742dc7830282d81 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.018+0000 7f808ad9d700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80740a14f0 0x7f80740a39b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x5582c348ef00 tx=0x7f80840090b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.019+0000 7f8078ff9700 1 -- 172.21.15.12:0/517309908 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c004220 con 0x5582c348ded0 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.019+0000 7f8078ff9700 1 -- 172.21.15.12:0/517309908 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f807c004380 con 0x5582c348ded0 2023-12-11T20:31:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.019+0000 7f8078ff9700 1 -- 172.21.15.12:0/517309908 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0197a0 con 0x5582c348ded0 2023-12-11T20:31:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.019+0000 7f80a4334b80 1 -- 172.21.15.12:0/517309908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348ded0 msgr2=0x5582c348e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.019+0000 7f80a4334b80 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348ded0 0x5582c348e2f0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f807c009d30 tx=0x7f807c011720 comp rx=0 tx=0).stop 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.020+0000 7f80a4334b80 1 -- 172.21.15.12:0/517309908 shutdown_connections 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.020+0000 7f80a4334b80 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c348fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.020+0000 7f80a4334b80 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348ded0 0x5582c348e2f0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.020+0000 7f80a4334b80 1 --2- 172.21.15.12:0/517309908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348e830 0x5582c348f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.020+0000 7f80a4334b80 1 -- 172.21.15.12:0/517309908 >> 172.21.15.12:0/517309908 conn(0x5582c33bd780 msgr2=0x5582c348a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.020+0000 7f80a4334b80 1 -- 172.21.15.12:0/517309908 shutdown_connections 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.020+0000 7f80a4334b80 1 -- 172.21.15.12:0/517309908 wait complete. 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.020+0000 7f80a4334b80 1 -- start start 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.021+0000 7f80a4334b80 1 Processor -- start 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.021+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c3497eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.021+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348e830 0x5582c34983f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.021+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348f720 0x5582c349f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.021+0000 7f80a4334b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c339c500 con 0x5582c348f720 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.021+0000 7f80a4334b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c339c1a0 con 0x5582c348ded0 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.021+0000 7f80a4334b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c32618c0 con 0x5582c348e830 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.021+0000 7f80a4334b80 10 client.0 _ll_register_callbacks cb 0x5582c32c7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348f720 0x5582c349f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f8089d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348e830 0x5582c34983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348f720 0x5582c349f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41870/0 (socket says 172.21.15.12:41870) 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 -- 172.21.15.12:0/2427834389 learned_addr learned my addr 172.21.15.12:0/2427834389 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808a59c700 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c3497eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 -- 172.21.15.12:0/2427834389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348e830 msgr2=0x5582c34983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348e830 0x5582c34983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 -- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 msgr2=0x5582c3497eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c3497eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 -- 172.21.15.12:0/2427834389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c1a1a90 con 0x5582c348f720 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808a59c700 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c3497eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f808ad9d700 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348f720 0x5582c349f220 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f8084016bf0 tx=0x7f8084004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7f16ee717b78ee server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.022+0000 7f8071ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.023+0000 7f8071ffb700 1 -- 172.21.15.12:0/2427834389 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808401f070 con 0x5582c348f720 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.023+0000 7f80a4334b80 1 -- 172.21.15.12:0/2427834389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582c3481730 con 0x5582c348f720 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.023+0000 7f8071ffb700 1 -- 172.21.15.12:0/2427834389 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8084003a00 con 0x5582c348f720 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.023+0000 7f8071ffb700 1 -- 172.21.15.12:0/2427834389 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8084003bc0 con 0x5582c348f720 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.023+0000 7f80a4334b80 10 client.19809 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.023+0000 7f80a4334b80 1 -- 172.21.15.12:0/2427834389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f807c009960 con 0x5582c348f720 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.023+0000 7f8071ffb700 1 -- 172.21.15.12:0/2427834389 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5582c3481730 con 0x5582c348f720 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.023+0000 7f8071ffb700 1 -- 172.21.15.12:0/2427834389 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f80840041c0 con 0x5582c348f720 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.024+0000 7f80a4334b80 10 client.19809 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.024+0000 7f80a4334b80 10 client.19809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.024+0000 7f80a4334b80 20 client.19809 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.024+0000 7f80a4334b80 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5582c34a3d10 0x5582c34a6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.024+0000 7f80a4334b80 4 client.19809 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.024+0000 7f80a4334b80 1 -- 172.21.15.12:0/2427834389 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582c345dee0 con 0x5582c34a3d10 2023-12-11T20:31:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.024+0000 7f808a59c700 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5582c34a3d10 0x5582c34a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.025+0000 7f808a59c700 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5582c34a3d10 0x5582c34a6130 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b4929f1d39f60c8 server_cookie=bac3c892ac3e0042 in_seq=0 out_seq=0 2023-12-11T20:31:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.025+0000 7f8071ffb700 10 client.19809 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.025+0000 7f8071ffb700 1 -- 172.21.15.12:0/2427834389 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5582c345dee0 con 0x5582c34a3d10 2023-12-11T20:31:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.025+0000 7f8071ffb700 10 client.19809 handle_command_reply: tid=0 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.025+0000 7f80a4334b80 1 client.19809 shutdown 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 -- 172.21.15.12:0/2427834389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348f720 msgr2=0x5582c349f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348f720 0x5582c349f220 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f8084016bf0 tx=0x7f8084004b40 comp rx=0 tx=0).stop 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 -- 172.21.15.12:0/2427834389 shutdown_connections 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5582c34a3d10 0x5582c34a6130 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c3497eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348f720 0x5582c349f220 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 --2- 172.21.15.12:0/2427834389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348e830 0x5582c34983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 -- 172.21.15.12:0/2427834389 >> 172.21.15.12:0/2427834389 conn(0x5582c33bd780 msgr2=0x5582c3488ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f8071ffb700 0 client.19809 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 -- 172.21.15.12:0/2427834389 shutdown_connections 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 1 -- 172.21.15.12:0/2427834389 wait complete. 2023-12-11T20:31:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.026+0000 7f80a4334b80 20 client.19809 trim_cache size 0 max 16384 2023-12-11T20:31:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.044+0000 7f80a4334b80 1 Processor -- start 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.044+0000 7f80a4334b80 1 -- start start 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.044+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c348a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.044+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.044+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c3492940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.044+0000 7f80a4334b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c34858d0 con 0x5582c348e830 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.044+0000 7f80a4334b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c34ab360 con 0x5582c348ded0 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.044+0000 7f80a4334b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c348daa0 con 0x5582c348f720 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41872/0 (socket says 172.21.15.12:41872) 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 -- 172.21.15.12:0/1553683137 learned_addr learned my addr 172.21.15.12:0/1553683137 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f808a59c700 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c348a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f808ad9d700 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c3492940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 -- 172.21.15.12:0/1553683137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 msgr2=0x5582c3492940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c3492940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 -- 172.21.15.12:0/1553683137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 msgr2=0x5582c348a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c348a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 -- 172.21.15.12:0/1553683137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c320bd80 con 0x5582c348e830 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.045+0000 7f8089d9b700 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349f1e0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f80800cb8f0 tx=0x7f808009a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d8800ee4222b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80797fa700 1 -- 172.21.15.12:0/1553683137 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808009a790 con 0x5582c348e830 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80797fa700 1 -- 172.21.15.12:0/1553683137 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f808009b530 con 0x5582c348e830 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80797fa700 1 -- 172.21.15.12:0/1553683137 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80800a3130 con 0x5582c348e830 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80a4334b80 1 -- 172.21.15.12:0/1553683137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 msgr2=0x5582c349f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80a4334b80 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349f1e0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f80800cb8f0 tx=0x7f808009a970 comp rx=0 tx=0).stop 2023-12-11T20:31:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80a4334b80 1 -- 172.21.15.12:0/1553683137 shutdown_connections 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80a4334b80 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c348a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80a4334b80 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c3492940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80a4334b80 1 --2- 172.21.15.12:0/1553683137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349f1e0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.046+0000 7f80a4334b80 1 -- 172.21.15.12:0/1553683137 >> 172.21.15.12:0/1553683137 conn(0x5582c33bd780 msgr2=0x5582c3496980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.047+0000 7f80a4334b80 1 -- 172.21.15.12:0/1553683137 shutdown_connections 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.047+0000 7f80a4334b80 1 -- 172.21.15.12:0/1553683137 wait complete. 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.047+0000 7f80a4334b80 1 -- start start 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.047+0000 7f80a4334b80 1 Processor -- start 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c349ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f80a4334b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c349e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f80a4334b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c349e910 con 0x5582c348e830 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f80a4334b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c349ea80 con 0x5582c348ded0 2023-12-11T20:31:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f80a4334b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c349ec40 con 0x5582c348f720 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f80a4334b80 10 client.0 _ll_register_callbacks cb 0x5582c32c7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f8089d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f8089d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41878/0 (socket says 172.21.15.12:41878) 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f8089d9b700 1 -- 172.21.15.12:0/118238268 learned_addr learned my addr 172.21.15.12:0/118238268 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f808a59c700 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c349ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f808ad9d700 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c349e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f8089d9b700 1 -- 172.21.15.12:0/118238268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 msgr2=0x5582c349e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f8089d9b700 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c349e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f8089d9b700 1 -- 172.21.15.12:0/118238268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 msgr2=0x5582c349ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f8089d9b700 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c349ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.048+0000 7f8089d9b700 1 -- 172.21.15.12:0/118238268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c1a1610 con 0x5582c348e830 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f8089d9b700 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349d3c0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f80800cb5d0 tx=0x7f808009aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fea1d5e86b47cda server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f8071ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f8071ffb700 1 -- 172.21.15.12:0/118238268 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808009a790 con 0x5582c348e830 2023-12-11T20:31:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f8071ffb700 1 -- 172.21.15.12:0/118238268 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8080066980 con 0x5582c348e830 2023-12-11T20:31:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f80a4334b80 1 -- 172.21.15.12:0/118238268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f807c004380 con 0x5582c348e830 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f8071ffb700 1 -- 172.21.15.12:0/118238268 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80800a3130 con 0x5582c348e830 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f80a4334b80 10 client.19815 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f80a4334b80 1 -- 172.21.15.12:0/118238268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5582c31f4c00 con 0x5582c348e830 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.049+0000 7f8071ffb700 1 -- 172.21.15.12:0/118238268 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f807c004380 con 0x5582c348e830 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.050+0000 7f8071ffb700 1 -- 172.21.15.12:0/118238268 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f80800a2d30 con 0x5582c348e830 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.050+0000 7f80a4334b80 10 client.19815 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.050+0000 7f80a4334b80 10 client.19815 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.050+0000 7f80a4334b80 20 client.19815 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.050+0000 7f80a4334b80 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5582c34fad20 0x5582c34fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.050+0000 7f80a4334b80 4 client.19815 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:31:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.050+0000 7f80a4334b80 1 -- 172.21.15.12:0/118238268 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5582c33a8f70 con 0x5582c34fad20 2023-12-11T20:31:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.050+0000 7f808a59c700 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5582c34fad20 0x5582c34fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.051+0000 7f8071ffb700 10 client.19815 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.051+0000 7f808a59c700 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5582c34fad20 0x5582c34fd140 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b72f35a59c1bfb6e server_cookie=abca5288b0ba725c in_seq=0 out_seq=0 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.061+0000 7f8071ffb700 1 -- 172.21.15.12:0/118238268 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5582c33a8f70 con 0x5582c34fad20 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.061+0000 7f8071ffb700 10 client.19815 handle_command_reply: tid=0 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 client.19815 shutdown 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 -- 172.21.15.12:0/118238268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 msgr2=0x5582c349d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349d3c0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f80800cb5d0 tx=0x7f808009aaa0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 -- 172.21.15.12:0/118238268 shutdown_connections 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5582c34fad20 0x5582c34fd140 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5582c348ded0 0x5582c349ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5582c348f720 0x5582c349e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 --2- 172.21.15.12:0/118238268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5582c348e830 0x5582c349d3c0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f8071ffb700 0 client.19815 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 -- 172.21.15.12:0/118238268 >> 172.21.15.12:0/118238268 conn(0x5582c33bd780 msgr2=0x5582c3492940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 -- 172.21.15.12:0/118238268 shutdown_connections 2023-12-11T20:31:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 1 -- 172.21.15.12:0/118238268 wait complete. 2023-12-11T20:31:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.062+0000 7f80a4334b80 20 client.19815 trim_cache size 0 max 16384 2023-12-11T20:31:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:31:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:31:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:31:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:31:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 -- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80740a14f0 msgr2=0x7f80740a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80740a14f0 0x7f80740a39b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x5582c348ef00 tx=0x7f80840090b0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 -- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 msgr2=0x7f808c199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 0x7f808c199ad0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8080009fd0 tx=0x7f808000fa00 comp rx=0 tx=0).stop 2023-12-11T20:31:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 -- 172.21.15.12:0/1533258451 shutdown_connections 2023-12-11T20:31:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f80740a14f0 0x7f80740a39b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f808c1014d0 0x7f808c199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f808c103060 0x7f808c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 --2- 172.21.15.12:0/1533258451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f808c1026c0 0x7f808c199ad0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.063+0000 7f80909ff700 1 -- 172.21.15.12:0/1533258451 >> 172.21.15.12:0/1533258451 conn(0x7f808c0fca60 msgr2=0x7f808c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.064+0000 7f80909ff700 1 -- 172.21.15.12:0/1533258451 shutdown_connections 2023-12-11T20:31:11.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:11.064+0000 7f80909ff700 1 -- 172.21.15.12:0/1533258451 wait complete. 2023-12-11T20:31:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:11 smithi039 ceph-mon[102205]: pgmap v832: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:31:11.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:11 smithi012 ceph-mon[128787]: pgmap v832: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:31:11.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:11 smithi032 ceph-mon[132488]: pgmap v832: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 15 op/s 2023-12-11T20:31:13.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:13 smithi039 ceph-mon[102205]: pgmap v833: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:31:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:13 smithi012 ceph-mon[128787]: pgmap v833: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:31:13.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:13 smithi032 ceph-mon[132488]: pgmap v833: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 MiB/s wr, 12 op/s 2023-12-11T20:31:15.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:15 smithi039 ceph-mon[102205]: pgmap v834: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 MiB/s wr, 13 op/s 2023-12-11T20:31:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:15 smithi012 ceph-mon[128787]: pgmap v834: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 MiB/s wr, 13 op/s 2023-12-11T20:31:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:15 smithi032 ceph-mon[132488]: pgmap v834: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 MiB/s wr, 13 op/s 2023-12-11T20:31:17.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:17 smithi039 ceph-mon[102205]: pgmap v835: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:17 smithi012 ceph-mon[128787]: pgmap v835: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:17.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:17 smithi032 ceph-mon[132488]: pgmap v835: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:17.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 -- 172.21.15.12:0/1691958982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c0101f80 msgr2=0x7f46c0104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 --2- 172.21.15.12:0/1691958982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c0101f80 0x7f46c0104370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009990 tx=0x7f46b4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 -- 172.21.15.12:0/1691958982 shutdown_connections 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 --2- 172.21.15.12:0/1691958982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c0101f80 0x7f46c0104370 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 --2- 172.21.15.12:0/1691958982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46c01071e0 0x7f46c0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 --2- 172.21.15.12:0/1691958982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46c01048b0 0x7f46c0106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 -- 172.21.15.12:0/1691958982 >> 172.21.15.12:0/1691958982 conn(0x7f46c00fb930 msgr2=0x7f46c00fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 -- 172.21.15.12:0/1691958982 shutdown_connections 2023-12-11T20:31:18.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.149+0000 7f46c6bff700 1 -- 172.21.15.12:0/1691958982 wait complete. 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.151+0000 7f46c6bff700 1 Processor -- start 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.151+0000 7f46c6bff700 1 -- start start 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.151+0000 7f46c6bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46c0101f80 0x7f46c0197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.151+0000 7f46c6bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46c01048b0 0x7f46c0197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.151+0000 7f46c6bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c01071e0 0x7f46c019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.151+0000 7f46c6bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c019ee50 con 0x7f46c0101f80 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.151+0000 7f46c6bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c019ef90 con 0x7f46c01071e0 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.151+0000 7f46c6bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c019f120 con 0x7f46c01048b0 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c519c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c01071e0 0x7f46c019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46c0101f80 0x7f46c0197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c519c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c01071e0 0x7f46c019e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49200/0 (socket says 172.21.15.12:49200) 2023-12-11T20:31:18.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c519c700 1 -- 172.21.15.12:0/3008217845 learned_addr learned my addr 172.21.15.12:0/3008217845 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:18.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46bffff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46c01048b0 0x7f46c0197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c519c700 1 -- 172.21.15.12:0/3008217845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46c01048b0 msgr2=0x7f46c0197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c519c700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46c01048b0 0x7f46c0197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c519c700 1 -- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46c0101f80 msgr2=0x7f46c0197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c519c700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46c0101f80 0x7f46c0197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c519c700 1 -- 172.21.15.12:0/3008217845 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40095f0 con 0x7f46c01071e0 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.152+0000 7f46c499b700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46c0101f80 0x7f46c0197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.153+0000 7f46c519c700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c01071e0 0x7f46c019e880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f46b800ef30 tx=0x7f46b800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.153+0000 7f46bdffb700 1 -- 172.21.15.12:0/3008217845 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8018070 con 0x7f46c01071e0 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.153+0000 7f46bdffb700 1 -- 172.21.15.12:0/3008217845 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46b800f040 con 0x7f46c01071e0 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.153+0000 7f46c6bff700 1 -- 172.21.15.12:0/3008217845 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c019f3a0 con 0x7f46c01071e0 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.153+0000 7f46bdffb700 1 -- 172.21.15.12:0/3008217845 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800cbc0 con 0x7f46c01071e0 2023-12-11T20:31:18.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.153+0000 7f46c6bff700 1 -- 172.21.15.12:0/3008217845 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c019f860 con 0x7f46c01071e0 2023-12-11T20:31:18.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.156+0000 7f46bdffb700 1 -- 172.21.15.12:0/3008217845 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f46b8007500 con 0x7f46c01071e0 2023-12-11T20:31:18.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46da573b80 1 Processor -- start 2023-12-11T20:31:18.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46da573b80 1 -- start start 2023-12-11T20:31:18.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46da573b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46da573b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5c6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46bdffb700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b00a1480 0x7f46b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46da573b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46da573b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf520b50 con 0x55c8cf5c5d30 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46da573b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf51e470 con 0x55c8cf5c6c20 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.158+0000 7f46da573b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf519d60 con 0x55c8cf5c53d0 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46bdffb700 1 -- 172.21.15.12:0/3008217845 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46b80cc870 con 0x7f46c01071e0 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46bffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41908/0 (socket says 172.21.15.12:41908) 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c499b700 1 -- 172.21.15.12:0/4155319515 learned_addr learned my addr 172.21.15.12:0/4155319515 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46bffff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b00a1480 0x7f46b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c519c700 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c519c700 1 -- 172.21.15.12:0/4155319515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 msgr2=0x55c8cf5c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c519c700 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c519c700 1 -- 172.21.15.12:0/4155319515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c5d30 msgr2=0x55c8cf5c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c519c700 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c519c700 1 -- 172.21.15.12:0/4155319515 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8cf396630 con 0x55c8cf5c6c20 2023-12-11T20:31:18.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.159+0000 7f46c499b700 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.160+0000 7f46c519c700 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c70a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f46b8099b00 tx=0x7f46b8095fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94280230ccb218ae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.160+0000 7f46bffff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b00a1480 0x7f46b00a3940 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0097c0 tx=0x7f46ac009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.160+0000 7f46aaffd700 1 -- 172.21.15.12:0/4155319515 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b809aea0 con 0x55c8cf5c6c20 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.160+0000 7f46aaffd700 1 -- 172.21.15.12:0/4155319515 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46b80ac2a0 con 0x55c8cf5c6c20 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.160+0000 7f46aaffd700 1 -- 172.21.15.12:0/4155319515 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8099b70 con 0x55c8cf5c6c20 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 -- 172.21.15.12:0/4155319515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c6c20 msgr2=0x55c8cf5c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c70a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f46b8099b00 tx=0x7f46b8095fe0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 -- 172.21.15.12:0/4155319515 shutdown_connections 2023-12-11T20:31:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c70a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 --2- 172.21.15.12:0/4155319515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 -- 172.21.15.12:0/4155319515 >> 172.21.15.12:0/4155319515 conn(0x55c8cf4f47e0 msgr2=0x55c8cf5c1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 -- 172.21.15.12:0/4155319515 shutdown_connections 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.161+0000 7f46da573b80 1 -- 172.21.15.12:0/4155319515 wait complete. 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.162+0000 7f46da573b80 1 -- start start 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.162+0000 7f46da573b80 1 Processor -- start 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.162+0000 7f46da573b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.162+0000 7f46da573b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.162+0000 7f46da573b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.162+0000 7f46da573b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf4d3560 con 0x55c8cf5c53d0 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.162+0000 7f46da573b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf4d3200 con 0x55c8cf5c5d30 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.162+0000 7f46da573b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf398920 con 0x55c8cf5c6c20 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46da573b80 10 client.0 _ll_register_callbacks cb 0x55c8cf3fea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46bffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46c499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46bffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49218/0 (socket says 172.21.15.12:49218) 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46bffff700 1 -- 172.21.15.12:0/1333167239 learned_addr learned my addr 172.21.15.12:0/1333167239 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46c519c700 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5dabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46bffff700 1 -- 172.21.15.12:0/1333167239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 msgr2=0x55c8cf5dabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46bffff700 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5dabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46bffff700 1 -- 172.21.15.12:0/1333167239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 msgr2=0x55c8cf5d3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46bffff700 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46bffff700 1 -- 172.21.15.12:0/1333167239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c010a240 con 0x55c8cf5c5d30 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46c519c700 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5dabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.163+0000 7f46c499b700 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.164+0000 7f46bffff700 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d3bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f46ac004570 tx=0x7f46ac0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1f63d59d29ba4f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.164+0000 7f469ffff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.164+0000 7f469ffff700 1 -- 172.21.15.12:0/1333167239 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac011ea0 con 0x55c8cf5c5d30 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.164+0000 7f46da573b80 1 -- 172.21.15.12:0/1333167239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8cf5b8b40 con 0x55c8cf5c5d30 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.164+0000 7f469ffff700 1 -- 172.21.15.12:0/1333167239 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46ac003890 con 0x55c8cf5c5d30 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.164+0000 7f469ffff700 1 -- 172.21.15.12:0/1333167239 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46ac0045a0 con 0x55c8cf5c5d30 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.164+0000 7f46da573b80 10 client.29372 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.164+0000 7f46da573b80 1 -- 172.21.15.12:0/1333167239 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f46c019f860 con 0x55c8cf5c5d30 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.165+0000 7f469ffff700 1 -- 172.21.15.12:0/1333167239 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c8cf5b8b40 con 0x55c8cf5c5d30 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.165+0000 7f469ffff700 1 -- 172.21.15.12:0/1333167239 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f46ac02aad0 con 0x55c8cf5c5d30 2023-12-11T20:31:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.165+0000 7f46da573b80 10 client.29372 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.165+0000 7f46da573b80 10 client.29372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.165+0000 7f46da573b80 20 client.29372 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.165+0000 7f46da573b80 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c8cf5df410 0x55c8cf5e1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.165+0000 7f46da573b80 4 client.29372 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.165+0000 7f46da573b80 1 -- 172.21.15.12:0/1333167239 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8cf594f40 con 0x55c8cf5df410 2023-12-11T20:31:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.166+0000 7f46c499b700 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c8cf5df410 0x55c8cf5e1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.166+0000 7f469ffff700 10 client.29372 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.166+0000 7f46c499b700 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c8cf5df410 0x55c8cf5e1830 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=876d5ef41d36e6b server_cookie=c2342039cf9214d0 in_seq=0 out_seq=0 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.167+0000 7f469ffff700 1 -- 172.21.15.12:0/1333167239 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c8cf594f40 con 0x55c8cf5df410 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.167+0000 7f469ffff700 10 client.29372 handle_command_reply: tid=0 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.167+0000 7f46da573b80 1 client.29372 shutdown 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 -- 172.21.15.12:0/1333167239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 msgr2=0x55c8cf5d3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d3bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f46ac004570 tx=0x7f46ac0047c0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 -- 172.21.15.12:0/1333167239 shutdown_connections 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c8cf5df410 0x55c8cf5e1830 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5dabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f469ffff700 0 client.29372 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 --2- 172.21.15.12:0/1333167239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d3bc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 -- 172.21.15.12:0/1333167239 >> 172.21.15.12:0/1333167239 conn(0x55c8cf4f47e0 msgr2=0x55c8cf5c0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 -- 172.21.15.12:0/1333167239 shutdown_connections 2023-12-11T20:31:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 1 -- 172.21.15.12:0/1333167239 wait complete. 2023-12-11T20:31:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.168+0000 7f46da573b80 20 client.29372 trim_cache size 0 max 16384 2023-12-11T20:31:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.186+0000 7f46da573b80 1 Processor -- start 2023-12-11T20:31:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.186+0000 7f46da573b80 1 -- start start 2023-12-11T20:31:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.186+0000 7f46da573b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.186+0000 7f46da573b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5dab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.186+0000 7f46da573b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.186+0000 7f46da573b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf5c6aa0 con 0x55c8cf5c53d0 2023-12-11T20:31:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.186+0000 7f46da573b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf5dbd30 con 0x55c8cf5c5d30 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.186+0000 7f46da573b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf5d31f0 con 0x55c8cf5c6c20 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41920/0 (socket says 172.21.15.12:41920) 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c499b700 1 -- 172.21.15.12:0/3550321386 learned_addr learned my addr 172.21.15.12:0/3550321386 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46bffff700 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5dab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c519c700 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c499b700 1 -- 172.21.15.12:0/3550321386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 msgr2=0x55c8cf5c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c499b700 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c499b700 1 -- 172.21.15.12:0/3550321386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 msgr2=0x55c8cf5dab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c499b700 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5dab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.187+0000 7f46c499b700 1 -- 172.21.15.12:0/3550321386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8cf342de0 con 0x55c8cf5c53d0 2023-12-11T20:31:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.188+0000 7f46c499b700 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d2b90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f46b4003f60 tx=0x7f46b400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ed6a76621cc35d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.188+0000 7f46ab7fe700 1 -- 172.21.15.12:0/3550321386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b401d040 con 0x55c8cf5c53d0 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.188+0000 7f46ab7fe700 1 -- 172.21.15.12:0/3550321386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46b401e040 con 0x55c8cf5c53d0 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.188+0000 7f46ab7fe700 1 -- 172.21.15.12:0/3550321386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400b710 con 0x55c8cf5c53d0 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 -- 172.21.15.12:0/3550321386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 msgr2=0x55c8cf5d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d2b90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f46b4003f60 tx=0x7f46b400b610 comp rx=0 tx=0).stop 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 -- 172.21.15.12:0/3550321386 shutdown_connections 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d2b90 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 --2- 172.21.15.12:0/3550321386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5dab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 -- 172.21.15.12:0/3550321386 >> 172.21.15.12:0/3550321386 conn(0x55c8cf4f47e0 msgr2=0x55c8cf5d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 -- 172.21.15.12:0/3550321386 shutdown_connections 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.189+0000 7f46da573b80 1 -- 172.21.15.12:0/3550321386 wait complete. 2023-12-11T20:31:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.190+0000 7f46da573b80 1 -- start start 2023-12-11T20:31:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.190+0000 7f46da573b80 1 Processor -- start 2023-12-11T20:31:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46da573b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46da573b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46da573b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5d9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46da573b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf5d9f70 con 0x55c8cf5c6c20 2023-12-11T20:31:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46da573b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf5da0e0 con 0x55c8cf5c5d30 2023-12-11T20:31:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46da573b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8cf5da2a0 con 0x55c8cf5c53d0 2023-12-11T20:31:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46da573b80 10 client.0 _ll_register_callbacks cb 0x55c8cf3fea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46c519c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5d9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46c499b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46c499b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47950/0 (socket says 172.21.15.12:47950) 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46c519c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5d9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41930/0 (socket says 172.21.15.12:41930) 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46c499b700 1 -- 172.21.15.12:0/3119839315 learned_addr learned my addr 172.21.15.12:0/3119839315 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.191+0000 7f46bffff700 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f46c499b700 1 -- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 msgr2=0x55c8cf5d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f46c499b700 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f46c499b700 1 -- 172.21.15.12:0/3119839315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c6c20 msgr2=0x55c8cf5d9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f46c499b700 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5d9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f46c499b700 1 -- 172.21.15.12:0/3119839315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8cf32bc60 con 0x55c8cf5c53d0 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f46c519c700 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5d9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f46bffff700 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f46c499b700 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d6520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f46b4005f50 tx=0x7f46b4029740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b10fdd364f6301 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:18.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.192+0000 7f469ffff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:31:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.193+0000 7f469ffff700 1 -- 172.21.15.12:0/3119839315 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b401d050 con 0x55c8cf5c53d0 2023-12-11T20:31:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.193+0000 7f469ffff700 1 -- 172.21.15.12:0/3119839315 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46b4005100 con 0x55c8cf5c53d0 2023-12-11T20:31:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.193+0000 7f46da573b80 1 -- 172.21.15.12:0/3119839315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46b80ac2a0 con 0x55c8cf5c53d0 2023-12-11T20:31:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.193+0000 7f469ffff700 1 -- 172.21.15.12:0/3119839315 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46b4029360 con 0x55c8cf5c53d0 2023-12-11T20:31:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.193+0000 7f46da573b80 10 client.29368 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.193+0000 7f46da573b80 1 -- 172.21.15.12:0/3119839315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55c8cf369250 con 0x55c8cf5c53d0 2023-12-11T20:31:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.193+0000 7f469ffff700 1 -- 172.21.15.12:0/3119839315 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46b80ac2a0 con 0x55c8cf5c53d0 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.193+0000 7f469ffff700 1 -- 172.21.15.12:0/3119839315 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f46b400bd40 con 0x55c8cf5c53d0 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.194+0000 7f46da573b80 10 client.29368 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.194+0000 7f46da573b80 10 client.29368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.194+0000 7f46da573b80 20 client.29368 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.194+0000 7f46da573b80 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c8cf636050 0x55c8cf638470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.194+0000 7f46da573b80 4 client.29368 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.194+0000 7f46da573b80 1 -- 172.21.15.12:0/3119839315 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c8cf4dffd0 con 0x55c8cf636050 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.194+0000 7f46bffff700 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c8cf636050 0x55c8cf638470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46bffff700 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c8cf636050 0x55c8cf638470 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92de4419311adc6b server_cookie=734497ec6b93ae58 in_seq=0 out_seq=0 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f469ffff700 10 client.29368 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f469ffff700 1 -- 172.21.15.12:0/3119839315 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c8cf4dffd0 con 0x55c8cf636050 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f469ffff700 10 client.29368 handle_command_reply: tid=0 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 client.29368 shutdown 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 -- 172.21.15.12:0/3119839315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 msgr2=0x55c8cf5d6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d6520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f46b4005f50 tx=0x7f46b4029740 comp rx=0 tx=0).stop 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 -- 172.21.15.12:0/3119839315 shutdown_connections 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c8cf636050 0x55c8cf638470 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8cf5c6c20 0x55c8cf5d9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8cf5c53d0 0x55c8cf5d6520 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 --2- 172.21.15.12:0/3119839315 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c8cf5c5d30 0x55c8cf5d6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f469ffff700 0 client.29368 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.195+0000 7f46da573b80 1 -- 172.21.15.12:0/3119839315 >> 172.21.15.12:0/3119839315 conn(0x55c8cf4f47e0 msgr2=0x55c8cf5d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.196+0000 7f46da573b80 1 -- 172.21.15.12:0/3119839315 shutdown_connections 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.196+0000 7f46da573b80 1 -- 172.21.15.12:0/3119839315 wait complete. 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.196+0000 7f46da573b80 20 client.29368 trim_cache size 0 max 16384 2023-12-11T20:31:18.196 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:31:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:31:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:31:18.197 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:31:18.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 -- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b00a1480 msgr2=0x7f46b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b00a1480 0x7f46b00a3940 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0097c0 tx=0x7f46ac009260 comp rx=0 tx=0).stop 2023-12-11T20:31:18.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 -- 172.21.15.12:0/3008217845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c01071e0 msgr2=0x7f46c019e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c01071e0 0x7f46c019e880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f46b800ef30 tx=0x7f46b800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 -- 172.21.15.12:0/3008217845 shutdown_connections 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f46b00a1480 0x7f46b00a3940 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46c01071e0 0x7f46c019e880 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46c0101f80 0x7f46c0197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 --2- 172.21.15.12:0/3008217845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46c01048b0 0x7f46c0197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 -- 172.21.15.12:0/3008217845 >> 172.21.15.12:0/3008217845 conn(0x7f46c00fb930 msgr2=0x7f46c0103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 -- 172.21.15.12:0/3008217845 shutdown_connections 2023-12-11T20:31:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.197+0000 7f46c6bff700 1 -- 172.21.15.12:0/3008217845 wait complete. 2023-12-11T20:31:18.219 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:31:18.219 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:31:18.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 -- 172.21.15.12:0/220440813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc1024b0 msgr2=0x7fcebc102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 --2- 172.21.15.12:0/220440813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc1024b0 0x7fcebc102910 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fceb00099c0 tx=0x7fceb0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 -- 172.21.15.12:0/220440813 shutdown_connections 2023-12-11T20:31:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 --2- 172.21.15.12:0/220440813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcebc102e50 0x7fcebc109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 --2- 172.21.15.12:0/220440813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcebc1012c0 0x7fcebc1016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 --2- 172.21.15.12:0/220440813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc1024b0 0x7fcebc102910 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 -- 172.21.15.12:0/220440813 >> 172.21.15.12:0/220440813 conn(0x7fcebc0fc810 msgr2=0x7fcebc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 -- 172.21.15.12:0/220440813 shutdown_connections 2023-12-11T20:31:18.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.461+0000 7fcebbfff700 1 -- 172.21.15.12:0/220440813 wait complete. 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.463+0000 7fcebbfff700 1 Processor -- start 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.463+0000 7fcebbfff700 1 -- start start 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.463+0000 7fcebbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcebc1012c0 0x7fcebc197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.463+0000 7fcebbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcebc1024b0 0x7fcebc1976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.463+0000 7fcebbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc102e50 0x7fcebc19e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.463+0000 7fcebbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc19eca0 con 0x7fcebc102e50 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.463+0000 7fcebbfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc19ede0 con 0x7fcebc1024b0 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebbfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc19ef70 con 0x7fcebc1012c0 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcebc1012c0 0x7fcebc197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcebc1012c0 0x7fcebc197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47970/0 (socket says 172.21.15.12:47970) 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc102e50 0x7fcebc19e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebaffd700 1 -- 172.21.15.12:0/3814349177 learned_addr learned my addr 172.21.15.12:0/3814349177 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:18.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fceba7fc700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcebc1024b0 0x7fcebc1976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebaffd700 1 -- 172.21.15.12:0/3814349177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcebc1024b0 msgr2=0x7fcebc1976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebaffd700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcebc1024b0 0x7fcebc1976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebaffd700 1 -- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc102e50 msgr2=0x7fcebc19e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebaffd700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc102e50 0x7fcebc19e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.464+0000 7fcebaffd700 1 -- 172.21.15.12:0/3814349177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00095f0 con 0x7fcebc1012c0 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.465+0000 7fcebaffd700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcebc1012c0 0x7fcebc197170 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fceac00e970 tx=0x7fceac00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.465+0000 7fcea3fff700 1 -- 172.21.15.12:0/3814349177 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac009790 con 0x7fcebc1012c0 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.465+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc19f250 con 0x7fcebc1012c0 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.465+0000 7fcea3fff700 1 -- 172.21.15.12:0/3814349177 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fceac00c7e0 con 0x7fcebc1012c0 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.465+0000 7fcea3fff700 1 -- 172.21.15.12:0/3814349177 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac003bd0 con 0x7fcebc1012c0 2023-12-11T20:31:18.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.465+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc19f7b0 con 0x7fcebc1012c0 2023-12-11T20:31:18.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.466+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc108830 con 0x7fcebc1012c0 2023-12-11T20:31:18.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.469+0000 7fcea3fff700 1 -- 172.21.15.12:0/3814349177 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fceac00c950 con 0x7fcebc1012c0 2023-12-11T20:31:18.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.470+0000 7fcea3fff700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcea40a1480 0x7fcea40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:18.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.470+0000 7fcea3fff700 1 -- 172.21.15.12:0/3814349177 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fceac014070 con 0x7fcebc1012c0 2023-12-11T20:31:18.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.471+0000 7fceba7fc700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcea40a1480 0x7fcea40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:18.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.471+0000 7fceba7fc700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcea40a1480 0x7fcea40a3940 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fceb0000c00 tx=0x7fceb0003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:18.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.473+0000 7fcea3fff700 1 -- 172.21.15.12:0/3814349177 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fceac096910 con 0x7fcebc1012c0 2023-12-11T20:31:18.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.807+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcebc10cc80 con 0x7fcebc1012c0 2023-12-11T20:31:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.808+0000 7fcea3fff700 1 -- 172.21.15.12:0/3814349177 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+11304 (secure 0 0 0) 0x7fceac099f30 con 0x7fcebc1012c0 2023-12-11T20:31:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:31:18.807 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:31:01.560123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:31:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcea40a1480 msgr2=0x7fcea40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcea40a1480 0x7fcea40a3940 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fceb0000c00 tx=0x7fceb0003680 comp rx=0 tx=0).stop 2023-12-11T20:31:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcebc1012c0 msgr2=0x7fcebc197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcebc1012c0 0x7fcebc197170 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fceac00e970 tx=0x7fceac00ec80 comp rx=0 tx=0).stop 2023-12-11T20:31:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 shutdown_connections 2023-12-11T20:31:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcea40a1480 0x7fcea40a3940 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcebc102e50 0x7fcebc19e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcebc1012c0 0x7fcebc197170 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 --2- 172.21.15.12:0/3814349177 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcebc1024b0 0x7fcebc1976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 >> 172.21.15.12:0/3814349177 conn(0x7fcebc0fc810 msgr2=0x7fcebc105970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 shutdown_connections 2023-12-11T20:31:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:18.811+0000 7fcebbfff700 1 -- 172.21.15.12:0/3814349177 wait complete. 2023-12-11T20:31:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 33 2023-12-11T20:31:18.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:31:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.055+0000 7f39e7fff700 1 -- 172.21.15.12:0/482707975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e81013e0 msgr2=0x7f39e8101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.055+0000 7f39e7fff700 1 --2- 172.21.15.12:0/482707975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e81013e0 0x7f39e8101840 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0099c0 tx=0x7f39dc009cd0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.056+0000 7f39e7fff700 1 -- 172.21.15.12:0/482707975 shutdown_connections 2023-12-11T20:31:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.056+0000 7f39e7fff700 1 --2- 172.21.15.12:0/482707975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39e81001f0 0x7f39e8100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.056+0000 7f39e7fff700 1 --2- 172.21.15.12:0/482707975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e8101d80 0x7f39e8108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.056+0000 7f39e7fff700 1 --2- 172.21.15.12:0/482707975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e81013e0 0x7f39e8101840 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.056+0000 7f39e7fff700 1 -- 172.21.15.12:0/482707975 >> 172.21.15.12:0/482707975 conn(0x7f39e80fb740 msgr2=0x7f39e80fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.056+0000 7f39e7fff700 1 -- 172.21.15.12:0/482707975 shutdown_connections 2023-12-11T20:31:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.056+0000 7f39e7fff700 1 -- 172.21.15.12:0/482707975 wait complete. 2023-12-11T20:31:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.057+0000 7f39e7fff700 1 Processor -- start 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.057+0000 7f39e7fff700 1 -- start start 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.057+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39e81001f0 0x7f39e81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.057+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e81013e0 0x7f39e81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.057+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8101d80 0x7f39e81a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.057+0000 7f39e7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e81a0dd0 con 0x7f39e8101d80 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.057+0000 7f39e7fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e81a0f10 con 0x7f39e81001f0 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.057+0000 7f39e7fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e81a10a0 con 0x7f39e81013e0 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39e81001f0 0x7f39e81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39e81001f0 0x7f39e81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37808/0 (socket says 172.21.15.12:37808) 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 -- 172.21.15.12:0/3622267596 learned_addr learned my addr 172.21.15.12:0/3622267596 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e77fe700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8101d80 0x7f39e81a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e67fc700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e81013e0 0x7f39e81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 -- 172.21.15.12:0/3622267596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e81013e0 msgr2=0x7f39e81997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e81013e0 0x7f39e81997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 -- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8101d80 msgr2=0x7f39e81a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8101d80 0x7f39e81a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 -- 172.21.15.12:0/3622267596 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc0095f0 con 0x7f39e81001f0 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.058+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39e81001f0 0x7f39e81992a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f39d800e970 tx=0x7f39d800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.059+0000 7f39cffff700 1 -- 172.21.15.12:0/3622267596 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8009790 con 0x7f39e81001f0 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.059+0000 7f39cffff700 1 -- 172.21.15.12:0/3622267596 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39d800c7e0 con 0x7f39e81001f0 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.059+0000 7f39cffff700 1 -- 172.21.15.12:0/3622267596 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8003bd0 con 0x7f39e81001f0 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.059+0000 7f39e7fff700 1 -- 172.21.15.12:0/3622267596 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e81a1380 con 0x7f39e81001f0 2023-12-11T20:31:19.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.059+0000 7f39e7fff700 1 -- 172.21.15.12:0/3622267596 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e81a1840 con 0x7f39e81001f0 2023-12-11T20:31:19.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.063+0000 7f39cffff700 1 -- 172.21.15.12:0/3622267596 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f39d800c950 con 0x7f39e81001f0 2023-12-11T20:31:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.064+0000 7f39cffff700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39d00a15a0 0x7f39d00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.065+0000 7f39cffff700 1 -- 172.21.15.12:0/3622267596 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39d8014070 con 0x7f39e81001f0 2023-12-11T20:31:19.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.065+0000 7f39e67fc700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39d00a15a0 0x7f39d00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.065+0000 7f39e67fc700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39d00a15a0 0x7f39d00a3a60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009990 tx=0x7f39dc003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.066+0000 7f3a00eaeb80 1 Processor -- start 2023-12-11T20:31:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.066+0000 7f3a00eaeb80 1 -- start start 2023-12-11T20:31:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.066+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1db8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db93c0 0x556ae1db98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1dba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1d13b50 con 0x556ae1db9de0 2023-12-11T20:31:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1d11470 con 0x556ae1db93c0 2023-12-11T20:31:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1d0cd60 con 0x556ae1db8a60 2023-12-11T20:31:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f39e67fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db93c0 0x556ae1db98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f39e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1dba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f39e67fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db93c0 0x556ae1db98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37824/0 (socket says 172.21.15.12:37824) 2023-12-11T20:31:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f39e67fc700 1 -- 172.21.15.12:0/2285483686 learned_addr learned my addr 172.21.15.12:0/2285483686 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.067+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1db8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39e6ffd700 1 -- 172.21.15.12:0/2285483686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db93c0 msgr2=0x556ae1db98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db93c0 0x556ae1db98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39e6ffd700 1 -- 172.21.15.12:0/2285483686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 msgr2=0x556ae1dba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1dba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39e6ffd700 1 -- 172.21.15.12:0/2285483686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ae1b89630 con 0x556ae1db8a60 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39e77fe700 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1dba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39e67fc700 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db93c0 0x556ae1db98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1db8e80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f39d800cc00 tx=0x7f39d8099ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b370475dd2fc806c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39cd7fa700 1 -- 172.21.15.12:0/2285483686 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d809a170 con 0x556ae1db8a60 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39cd7fa700 1 -- 172.21.15.12:0/2285483686 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39d809e2c0 con 0x556ae1db8a60 2023-12-11T20:31:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.068+0000 7f39cd7fa700 1 -- 172.21.15.12:0/2285483686 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80985f0 con 0x556ae1db8a60 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.069+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2285483686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 msgr2=0x556ae1db8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.069+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1db8e80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f39d800cc00 tx=0x7f39d8099ad0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.069+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2285483686 shutdown_connections 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.069+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1dba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.069+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1db8e80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.069+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2285483686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db93c0 0x556ae1db98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.069+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2285483686 >> 172.21.15.12:0/2285483686 conn(0x556ae1ce77e0 msgr2=0x556ae1db33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.070+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2285483686 shutdown_connections 2023-12-11T20:31:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.070+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2285483686 wait complete. 2023-12-11T20:31:19.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.071+0000 7f3a00eaeb80 1 -- start start 2023-12-11T20:31:19.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.071+0000 7f3a00eaeb80 1 Processor -- start 2023-12-11T20:31:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1dc2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db93c0 0x556ae1dc28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 0x556ae1dc98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1cc6560 con 0x556ae1db93c0 2023-12-11T20:31:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1cc6200 con 0x556ae1db9de0 2023-12-11T20:31:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1b8b920 con 0x556ae1db8a60 2023-12-11T20:31:19.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f3a00eaeb80 10 client.0 _ll_register_callbacks cb 0x556ae1bf1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f39e67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db93c0 0x556ae1dc28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f39e67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db93c0 0x556ae1dc28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39814/0 (socket says 172.21.15.12:39814) 2023-12-11T20:31:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.072+0000 7f39e67fc700 1 -- 172.21.15.12:0/4003464183 learned_addr learned my addr 172.21.15.12:0/4003464183 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.073+0000 7f39e77fe700 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 0x556ae1dc98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.073+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1dc2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.073+0000 7f39e67fc700 1 -- 172.21.15.12:0/4003464183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 msgr2=0x556ae1dc2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.073+0000 7f39e67fc700 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1dc2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.073+0000 7f39e67fc700 1 -- 172.21.15.12:0/4003464183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 msgr2=0x556ae1dc98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.073+0000 7f39e67fc700 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 0x556ae1dc98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.073+0000 7f39e67fc700 1 -- 172.21.15.12:0/4003464183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e0003b50 con 0x556ae1db93c0 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.074+0000 7f39e67fc700 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db93c0 0x556ae1dc28a0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f39dc000c00 tx=0x7f39dc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a3930b7d88b5f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.074+0000 7f39caff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.074+0000 7f39caff5700 1 -- 172.21.15.12:0/4003464183 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc02b040 con 0x556ae1db93c0 2023-12-11T20:31:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.074+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/4003464183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ae1dab9e0 con 0x556ae1db93c0 2023-12-11T20:31:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.074+0000 7f39caff5700 1 -- 172.21.15.12:0/4003464183 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39dc00f660 con 0x556ae1db93c0 2023-12-11T20:31:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.074+0000 7f39caff5700 1 -- 172.21.15.12:0/4003464183 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39dc00f820 con 0x556ae1db93c0 2023-12-11T20:31:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.074+0000 7f3a00eaeb80 10 client.19851 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.074+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/4003464183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f39e81a1840 con 0x556ae1db93c0 2023-12-11T20:31:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.075+0000 7f39caff5700 1 -- 172.21.15.12:0/4003464183 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39dc03e080 con 0x556ae1db93c0 2023-12-11T20:31:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.075+0000 7f39caff5700 1 -- 172.21.15.12:0/4003464183 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f39dc03a830 con 0x556ae1db93c0 2023-12-11T20:31:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.075+0000 7f3a00eaeb80 10 client.19851 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.075+0000 7f3a00eaeb80 10 client.19851 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:31:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.075+0000 7f3a00eaeb80 20 client.19851 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.075+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556ae1dce1d0 0x556ae1dd05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.075+0000 7f3a00eaeb80 4 client.19851 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.075+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/4003464183 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ae1d87f40 con 0x556ae1dce1d0 2023-12-11T20:31:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.076+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556ae1dce1d0 0x556ae1dd05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.076+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556ae1dce1d0 0x556ae1dd05f0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc63ca0d0540e3c8 server_cookie=a992f6afb8b9d85c in_seq=0 out_seq=0 2023-12-11T20:31:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.076+0000 7f39caff5700 10 client.19851 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:31:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.077+0000 7f39caff5700 1 -- 172.21.15.12:0/4003464183 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556ae1d87f40 con 0x556ae1dce1d0 2023-12-11T20:31:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.077+0000 7f39caff5700 10 client.19851 handle_command_reply: tid=0 2023-12-11T20:31:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.077+0000 7f3a00eaeb80 1 client.19851 shutdown 2023-12-11T20:31:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/4003464183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db93c0 msgr2=0x556ae1dc28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db93c0 0x556ae1dc28a0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f39dc000c00 tx=0x7f39dc01f000 comp rx=0 tx=0).stop 2023-12-11T20:31:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/4003464183 shutdown_connections 2023-12-11T20:31:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556ae1dce1d0 0x556ae1dd05f0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 0x556ae1dc98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db8a60 0x556ae1dc2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/4003464183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db93c0 0x556ae1dc28a0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/4003464183 >> 172.21.15.12:0/4003464183 conn(0x556ae1ce77e0 msgr2=0x556ae1db7820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f39caff5700 0 client.19851 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:31:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/4003464183 shutdown_connections 2023-12-11T20:31:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.078+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/4003464183 wait complete. 2023-12-11T20:31:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.079+0000 7f3a00eaeb80 20 client.19851 trim_cache size 0 max 16384 2023-12-11T20:31:19.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:19 smithi012 ceph-mon[128787]: pgmap v836: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:19.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:19 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3814349177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:31:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.097+0000 7f3a00eaeb80 1 Processor -- start 2023-12-11T20:31:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.097+0000 7f3a00eaeb80 1 -- start start 2023-12-11T20:31:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.097+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db8a60 0x556ae1db8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.097+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 0x556ae1dc98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.097+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 0x556ae1dc0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1db3ec0 con 0x556ae1db8a60 2023-12-11T20:31:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1db4700 con 0x556ae1db9de0 2023-12-11T20:31:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1dc0da0 con 0x556ae1db93c0 2023-12-11T20:31:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db8a60 0x556ae1db8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db8a60 0x556ae1db8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39820/0 (socket says 172.21.15.12:39820) 2023-12-11T20:31:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e6ffd700 1 -- 172.21.15.12:0/1342552020 learned_addr learned my addr 172.21.15.12:0/1342552020 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e77fe700 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 0x556ae1dc0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e67fc700 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 0x556ae1dc98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e6ffd700 1 -- 172.21.15.12:0/1342552020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 msgr2=0x556ae1dc98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 0x556ae1dc98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e6ffd700 1 -- 172.21.15.12:0/1342552020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 msgr2=0x556ae1dc0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 0x556ae1dc0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.098+0000 7f39e6ffd700 1 -- 172.21.15.12:0/1342552020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ae1b35de0 con 0x556ae1db8a60 2023-12-11T20:31:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.099+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db8a60 0x556ae1db8e40 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f39d800efd0 tx=0x7f39d8003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bbf7b57019ec68 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.099+0000 7f39cdffb700 1 -- 172.21.15.12:0/1342552020 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80964b0 con 0x556ae1db8a60 2023-12-11T20:31:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.099+0000 7f39cdffb700 1 -- 172.21.15.12:0/1342552020 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39d809a170 con 0x556ae1db8a60 2023-12-11T20:31:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.099+0000 7f39cdffb700 1 -- 172.21.15.12:0/1342552020 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80998c0 con 0x556ae1db8a60 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/1342552020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db8a60 msgr2=0x556ae1db8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db8a60 0x556ae1db8e40 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f39d800efd0 tx=0x7f39d8003680 comp rx=0 tx=0).stop 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/1342552020 shutdown_connections 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db9de0 0x556ae1dc0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db8a60 0x556ae1db8e40 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/1342552020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 0x556ae1dc98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/1342552020 >> 172.21.15.12:0/1342552020 conn(0x556ae1ce77e0 msgr2=0x556ae1db33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/1342552020 shutdown_connections 2023-12-11T20:31:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/1342552020 wait complete. 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.100+0000 7f3a00eaeb80 1 -- start start 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.101+0000 7f3a00eaeb80 1 Processor -- start 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.101+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db8a60 0x556ae1dbf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.101+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 0x556ae1e206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.101+0000 7f3a00eaeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1e22bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.101+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1e23130 con 0x556ae1db9de0 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.101+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1e23270 con 0x556ae1db8a60 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.101+0000 7f3a00eaeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ae1e233b0 con 0x556ae1db93c0 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.101+0000 7f3a00eaeb80 10 client.0 _ll_register_callbacks cb 0x556ae1bf1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1e22bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1e22bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39834/0 (socket says 172.21.15.12:39834) 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 -- 172.21.15.12:0/2250899374 learned_addr learned my addr 172.21.15.12:0/2250899374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db8a60 0x556ae1dbf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e67fc700 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 0x556ae1e206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 -- 172.21.15.12:0/2250899374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 msgr2=0x556ae1e206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 0x556ae1e206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 -- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db8a60 msgr2=0x556ae1dbf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db8a60 0x556ae1dbf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 -- 172.21.15.12:0/2250899374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ae1b89630 con 0x556ae1db9de0 2023-12-11T20:31:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db8a60 0x556ae1dbf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39e77fe700 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1e22bf0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f39e0017a50 tx=0x7f39e0017a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b9b19ec194d0ac server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.102+0000 7f39caff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.103+0000 7f39caff5700 1 -- 172.21.15.12:0/2250899374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e001c070 con 0x556ae1db9de0 2023-12-11T20:31:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.103+0000 7f39caff5700 1 -- 172.21.15.12:0/2250899374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39e00075f0 con 0x556ae1db9de0 2023-12-11T20:31:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.103+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2250899374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39d809e2c0 con 0x556ae1db9de0 2023-12-11T20:31:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.103+0000 7f39caff5700 1 -- 172.21.15.12:0/2250899374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39e00077b0 con 0x556ae1db9de0 2023-12-11T20:31:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.103+0000 7f3a00eaeb80 10 client.19857 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.103+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2250899374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x556ae1b1ec60 con 0x556ae1db9de0 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.103+0000 7f39caff5700 1 -- 172.21.15.12:0/2250899374 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39d809e2c0 con 0x556ae1db9de0 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.104+0000 7f39caff5700 1 -- 172.21.15.12:0/2250899374 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f39e002ba10 con 0x556ae1db9de0 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.104+0000 7f3a00eaeb80 10 client.19857 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.104+0000 7f3a00eaeb80 10 client.19857 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.104+0000 7f3a00eaeb80 20 client.19857 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.104+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556ae1e24e10 0x556ae1e27230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.104+0000 7f3a00eaeb80 4 client.19857 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.104+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2250899374 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556ae1cd2fd0 con 0x556ae1e24e10 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.104+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556ae1e24e10 0x556ae1e27230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f39e6ffd700 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556ae1e24e10 0x556ae1e27230 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=998cd9f476418739 server_cookie=abaf0810b1bb8390 in_seq=0 out_seq=0 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f39caff5700 10 client.19857 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:31:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f39caff5700 1 -- 172.21.15.12:0/2250899374 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556ae1cd2fd0 con 0x556ae1e24e10 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f39caff5700 10 client.19857 handle_command_reply: tid=0 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 client.19857 shutdown 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2250899374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 msgr2=0x556ae1e22bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1e22bf0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f39e0017a50 tx=0x7f39e0017a80 comp rx=0 tx=0).stop 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2250899374 shutdown_connections 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x556ae1e24e10 0x556ae1e27230 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556ae1db8a60 0x556ae1dbf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ae1db9de0 0x556ae1e22bf0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 --2- 172.21.15.12:0/2250899374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556ae1db93c0 0x556ae1e206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f39caff5700 0 client.19857 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2250899374 >> 172.21.15.12:0/2250899374 conn(0x556ae1ce77e0 msgr2=0x556ae1dc0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2250899374 shutdown_connections 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.105+0000 7f3a00eaeb80 1 -- 172.21.15.12:0/2250899374 wait complete. 2023-12-11T20:31:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f3a00eaeb80 20 client.19857 trim_cache size 0 max 16384 2023-12-11T20:31:19.109 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:31:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 -- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39d00a15a0 msgr2=0x7f39d00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39d00a15a0 0x7f39d00a3a60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009990 tx=0x7f39dc003680 comp rx=0 tx=0).stop 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 -- 172.21.15.12:0/3622267596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39e81001f0 msgr2=0x7f39e81992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39e81001f0 0x7f39e81992a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f39d800e970 tx=0x7f39d800ec80 comp rx=0 tx=0).stop 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 -- 172.21.15.12:0/3622267596 shutdown_connections 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f39d00a15a0 0x7f39d00a3a60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39e81001f0 0x7f39e81992a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8101d80 0x7f39e81a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 --2- 172.21.15.12:0/3622267596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39e81013e0 0x7f39e81997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.106+0000 7f39e7fff700 1 -- 172.21.15.12:0/3622267596 >> 172.21.15.12:0/3622267596 conn(0x7f39e80fb740 msgr2=0x7f39e8068780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.107+0000 7f39e7fff700 1 -- 172.21.15.12:0/3622267596 shutdown_connections 2023-12-11T20:31:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.107+0000 7f39e7fff700 1 -- 172.21.15.12:0/3622267596 wait complete. 2023-12-11T20:31:19.125 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:31:19.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:19 smithi039 ceph-mon[102205]: pgmap v836: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:19.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:19 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3814349177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:31:19.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3329213866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 msgr2=0x7fc59c102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3329213866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 0x7fc59c102b00 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc5900099c0 tx=0x7fc590009cd0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3329213866 shutdown_connections 2023-12-11T20:31:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3329213866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc59c103040 0x7fc59c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3329213866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc59c1014b0 0x7fc59c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3329213866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 0x7fc59c102b00 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3329213866 >> 172.21.15.12:0/3329213866 conn(0x7fc59c0fca00 msgr2=0x7fc59c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3329213866 shutdown_connections 2023-12-11T20:31:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.352+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3329213866 wait complete. 2023-12-11T20:31:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.353+0000 7fc5a1fff700 1 Processor -- start 2023-12-11T20:31:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc5a1fff700 1 -- start start 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc5a1fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc59c1014b0 0x7fc59c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc5a1fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 0x7fc59c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc5a1fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc59c103040 0x7fc59c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc5a1fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c19ee80 con 0x7fc59c1026a0 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc5a1fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c19efc0 con 0x7fc59c103040 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc5a1fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c19f150 con 0x7fc59c1014b0 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc59affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 0x7fc59c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc59affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 0x7fc59c197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39846/0 (socket says 172.21.15.12:39846) 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.354+0000 7fc59affd700 1 -- 172.21.15.12:0/3280982241 learned_addr learned my addr 172.21.15.12:0/3280982241 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.355+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc59c1014b0 0x7fc59c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.355+0000 7fc59bfff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc59c103040 0x7fc59c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.355+0000 7fc59affd700 1 -- 172.21.15.12:0/3280982241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc59c1014b0 msgr2=0x7fc59c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.355+0000 7fc59affd700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc59c1014b0 0x7fc59c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.355+0000 7fc59affd700 1 -- 172.21.15.12:0/3280982241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc59c103040 msgr2=0x7fc59c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.355+0000 7fc59affd700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc59c103040 0x7fc59c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.355+0000 7fc59affd700 1 -- 172.21.15.12:0/3280982241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900095f0 con 0x7fc59c1026a0 2023-12-11T20:31:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.355+0000 7fc59affd700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 0x7fc59c197890 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fc590009fd0 tx=0x7fc59000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.356+0000 7fc598ff9700 1 -- 172.21.15.12:0/3280982241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59001d070 con 0x7fc59c1026a0 2023-12-11T20:31:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.356+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3280982241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c19f3d0 con 0x7fc59c1026a0 2023-12-11T20:31:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.356+0000 7fc598ff9700 1 -- 172.21.15.12:0/3280982241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc59000bd10 con 0x7fc59c1026a0 2023-12-11T20:31:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.356+0000 7fc598ff9700 1 -- 172.21.15.12:0/3280982241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590004cd0 con 0x7fc59c1026a0 2023-12-11T20:31:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.356+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3280982241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c19f850 con 0x7fc59c1026a0 2023-12-11T20:31:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.359+0000 7fc598ff9700 1 -- 172.21.15.12:0/3280982241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc590005050 con 0x7fc59c1026a0 2023-12-11T20:31:19.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc5b5957b80 1 Processor -- start 2023-12-11T20:31:19.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc5b5957b80 1 -- start start 2023-12-11T20:31:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003e3d0 0x562bb003e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003ed30 0x562bb003f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003fc20 0x562bb00400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc598ff9700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5840a1480 0x7fc5840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baff99b50 con 0x562bb003fc20 2023-12-11T20:31:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baff97470 con 0x562bb003ed30 2023-12-11T20:31:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baff92d60 con 0x562bb003e3d0 2023-12-11T20:31:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.361+0000 7fc598ff9700 1 -- 172.21.15.12:0/3280982241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc5900cdb80 con 0x7fc59c1026a0 2023-12-11T20:31:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003ed30 0x562bb003f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59bfff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5840a1480 0x7fc5840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003ed30 0x562bb003f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37892/0 (socket says 172.21.15.12:37892) 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59b7fe700 1 -- 172.21.15.12:0/1962045369 learned_addr learned my addr 172.21.15.12:0/1962045369 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59affd700 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003fc20 0x562bb00400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59bfff700 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003e3d0 0x562bb003e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59affd700 1 -- 172.21.15.12:0/1962045369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003e3d0 msgr2=0x562bb003e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59affd700 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003e3d0 0x562bb003e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59affd700 1 -- 172.21.15.12:0/1962045369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003ed30 msgr2=0x562bb003f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59affd700 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003ed30 0x562bb003f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59affd700 1 -- 172.21.15.12:0/1962045369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bafe0f630 con 0x562bb003fc20 2023-12-11T20:31:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.362+0000 7fc59bfff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5840a1480 0x7fc5840a3940 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc594009fd0 tx=0x7fc594009c60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.363+0000 7fc59affd700 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003fc20 0x562bb00400a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fc59009ae10 tx=0x7fc590096bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc1117bb1c39b18 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.363+0000 7fc581ffb700 1 -- 172.21.15.12:0/1962045369 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59009a7e0 con 0x562bb003fc20 2023-12-11T20:31:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.363+0000 7fc581ffb700 1 -- 172.21.15.12:0/1962045369 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5900a10c0 con 0x562bb003fc20 2023-12-11T20:31:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.363+0000 7fc581ffb700 1 -- 172.21.15.12:0/1962045369 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900cb6e0 con 0x562bb003fc20 2023-12-11T20:31:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1962045369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003fc20 msgr2=0x562bb00400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003fc20 0x562bb00400a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fc59009ae10 tx=0x7fc590096bb0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1962045369 shutdown_connections 2023-12-11T20:31:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003fc20 0x562bb00400a0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003e3d0 0x562bb003e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1962045369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003ed30 0x562bb003f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1962045369 >> 172.21.15.12:0/1962045369 conn(0x562baff6d7e0 msgr2=0x562bb003ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1962045369 shutdown_connections 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1962045369 wait complete. 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.364+0000 7fc5b5957b80 1 -- start start 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc5b5957b80 1 Processor -- start 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb004c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb004c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 0x562bb0053810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baff4c560 con 0x562bb003ed30 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baff4c200 con 0x562bb003e3d0 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bafe11920 con 0x562bb003fc20 2023-12-11T20:31:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc5b5957b80 10 client.0 _ll_register_callbacks cb 0x562bafe77a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb004c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc59bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 0x562bb0053810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb004c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37904/0 (socket says 172.21.15.12:37904) 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.365+0000 7fc59b7fe700 1 -- 172.21.15.12:0/1344417858 learned_addr learned my addr 172.21.15.12:0/1344417858 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc59affd700 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb004c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc59b7fe700 1 -- 172.21.15.12:0/1344417858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 msgr2=0x562bb0053810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 0x562bb0053810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc59b7fe700 1 -- 172.21.15.12:0/1344417858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 msgr2=0x562bb004c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb004c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc59b7fe700 1 -- 172.21.15.12:0/1344417858 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c19f850 con 0x562bb003e3d0 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc59affd700 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb004c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb004c290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc58c012810 tx=0x7fc58c012b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aff2c008147a90c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.366+0000 7fc57affd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:31:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.367+0000 7fc57affd700 1 -- 172.21.15.12:0/1344417858 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c017070 con 0x562bb003e3d0 2023-12-11T20:31:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.367+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1344417858 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bb0031b40 con 0x562bb003e3d0 2023-12-11T20:31:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.367+0000 7fc57affd700 1 -- 172.21.15.12:0/1344417858 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc58c004830 con 0x562bb003e3d0 2023-12-11T20:31:19.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.367+0000 7fc57affd700 1 -- 172.21.15.12:0/1344417858 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc58c004a30 con 0x562bb003e3d0 2023-12-11T20:31:19.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.367+0000 7fc5b5957b80 10 client.29414 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:19.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.367+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1344417858 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562bafdbbde0 con 0x562bb003e3d0 2023-12-11T20:31:19.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.367+0000 7fc57affd700 1 -- 172.21.15.12:0/1344417858 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562bb0031b40 con 0x562bb003e3d0 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.367+0000 7fc57affd700 1 -- 172.21.15.12:0/1344417858 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fc58c01c890 con 0x562bb003e3d0 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc5b5957b80 10 client.29414 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc5b5957b80 10 client.29414 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc5b5957b80 20 client.29414 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562bb00580c0 0x562bb005a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc5b5957b80 4 client.29414 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1344417858 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bb000df40 con 0x562bb00580c0 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc59affd700 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562bb00580c0 0x562bb005a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc57affd700 10 client.29414 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.368+0000 7fc59affd700 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562bb00580c0 0x562bb005a4e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9cb807ed797f413 server_cookie=d03a756b1aff1802 in_seq=0 out_seq=0 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.369+0000 7fc57affd700 1 -- 172.21.15.12:0/1344417858 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562bb000df40 con 0x562bb00580c0 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.369+0000 7fc57affd700 10 client.29414 handle_command_reply: tid=0 2023-12-11T20:31:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.369+0000 7fc5b5957b80 1 client.29414 shutdown 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.369+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1344417858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 msgr2=0x562bb004c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.369+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb004c290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc58c012810 tx=0x7fc58c012b20 comp rx=0 tx=0).stop 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1344417858 shutdown_connections 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562bb00580c0 0x562bb005a4e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb004c290 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 0x562bb0053810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1344417858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb004c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc57affd700 0 client.29414 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1344417858 >> 172.21.15.12:0/1344417858 conn(0x562baff6d7e0 msgr2=0x562bb0039a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1344417858 shutdown_connections 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1344417858 wait complete. 2023-12-11T20:31:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.370+0000 7fc5b5957b80 20 client.29414 trim_cache size 0 max 16384 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc5b5957b80 1 Processor -- start 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc5b5957b80 1 -- start start 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb0053ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb00537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 0x562bb004b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bb0054990 con 0x562bb003ed30 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bb0055570 con 0x562bb003e3d0 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bb005f710 con 0x562bb003fc20 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc59affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb00537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc59affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb00537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39880/0 (socket says 172.21.15.12:39880) 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.391+0000 7fc59affd700 1 -- 172.21.15.12:0/1008478029 learned_addr learned my addr 172.21.15.12:0/1008478029 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb0053ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc59bfff700 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 0x562bb004b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc59affd700 1 -- 172.21.15.12:0/1008478029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 msgr2=0x562bb004b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc59affd700 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 0x562bb004b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc59affd700 1 -- 172.21.15.12:0/1008478029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 msgr2=0x562bb0053ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc59affd700 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb0053ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc59affd700 1 -- 172.21.15.12:0/1008478029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bafda4c60 con 0x562bb003ed30 2023-12-11T20:31:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc59affd700 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb00537d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x562bb004ad40 tx=0x7fc59009a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3a211af3c11e9b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc5827fc700 1 -- 172.21.15.12:0/1008478029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59009b580 con 0x562bb003ed30 2023-12-11T20:31:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.392+0000 7fc5827fc700 1 -- 172.21.15.12:0/1008478029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc59009ae80 con 0x562bb003ed30 2023-12-11T20:31:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5827fc700 1 -- 172.21.15.12:0/1008478029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59009a370 con 0x562bb003ed30 2023-12-11T20:31:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1008478029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 msgr2=0x562bb00537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb00537d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x562bb004ad40 tx=0x7fc59009a900 comp rx=0 tx=0).stop 2023-12-11T20:31:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1008478029 shutdown_connections 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003e3d0 0x562bb0053ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003fc20 0x562bb004b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/1008478029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003ed30 0x562bb00537d0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1008478029 >> 172.21.15.12:0/1008478029 conn(0x562baff6d7e0 msgr2=0x562bb0046150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1008478029 shutdown_connections 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.393+0000 7fc5b5957b80 1 -- 172.21.15.12:0/1008478029 wait complete. 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.394+0000 7fc5b5957b80 1 -- start start 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.394+0000 7fc5b5957b80 1 Processor -- start 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.394+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003e3d0 0x562bb004eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.394+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003ed30 0x562bb004f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.394+0000 7fc5b5957b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003fc20 0x562bb00523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.394+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bb0052930 con 0x562bb003e3d0 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.394+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bb0052aa0 con 0x562bb003fc20 2023-12-11T20:31:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.394+0000 7fc5b5957b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bb0052c60 con 0x562bb003ed30 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc5b5957b80 10 client.0 _ll_register_callbacks cb 0x562bafe77a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003e3d0 0x562bb004eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003e3d0 0x562bb004eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39894/0 (socket says 172.21.15.12:39894) 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59b7fe700 1 -- 172.21.15.12:0/3736449340 learned_addr learned my addr 172.21.15.12:0/3736449340 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59affd700 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003ed30 0x562bb004f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59bfff700 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003fc20 0x562bb00523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59b7fe700 1 -- 172.21.15.12:0/3736449340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003ed30 msgr2=0x562bb004f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003ed30 0x562bb004f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59b7fe700 1 -- 172.21.15.12:0/3736449340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003fc20 msgr2=0x562bb00523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003fc20 0x562bb00523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.395+0000 7fc59b7fe700 1 -- 172.21.15.12:0/3736449340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bafe0f630 con 0x562bb003e3d0 2023-12-11T20:31:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003e3d0 0x562bb004eee0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fc58c01cc20 tx=0x7fc58c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7e6cbdf833787c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc57affd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc57affd700 1 -- 172.21.15.12:0/3736449340 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c017070 con 0x562bb003e3d0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc5b5957b80 1 -- 172.21.15.12:0/3736449340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5900a10c0 con 0x562bb003e3d0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc57affd700 1 -- 172.21.15.12:0/3736449340 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc58c000e40 con 0x562bb003e3d0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc57affd700 1 -- 172.21.15.12:0/3736449340 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc58c0092d0 con 0x562bb003e3d0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc5b5957b80 10 client.19875 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc5b5957b80 1 -- 172.21.15.12:0/3736449340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562bafde2250 con 0x562bb003e3d0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.396+0000 7fc57affd700 1 -- 172.21.15.12:0/3736449340 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5900a10c0 con 0x562bb003e3d0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.397+0000 7fc57affd700 1 -- 172.21.15.12:0/3736449340 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fc58c011ba0 con 0x562bb003e3d0 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.397+0000 7fc5b5957b80 10 client.19875 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.397+0000 7fc5b5957b80 10 client.19875 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.397+0000 7fc5b5957b80 20 client.19875 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.397+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562bb00aef50 0x562bb00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.397+0000 7fc5b5957b80 4 client.19875 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.397+0000 7fc5b5957b80 1 -- 172.21.15.12:0/3736449340 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562baff58fd0 con 0x562bb00aef50 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.397+0000 7fc59affd700 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562bb00aef50 0x562bb00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc57affd700 10 client.19875 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc59affd700 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562bb00aef50 0x562bb00b1370 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd9e1b1ed798175d server_cookie=18db70c7fa254cf6 in_seq=0 out_seq=0 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc57affd700 1 -- 172.21.15.12:0/3736449340 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562baff58fd0 con 0x562bb00aef50 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc57affd700 10 client.19875 handle_command_reply: tid=0 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 client.19875 shutdown 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 -- 172.21.15.12:0/3736449340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003e3d0 msgr2=0x562bb004eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003e3d0 0x562bb004eee0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fc58c01cc20 tx=0x7fc58c01c680 comp rx=0 tx=0).stop 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 -- 172.21.15.12:0/3736449340 shutdown_connections 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562bb00aef50 0x562bb00b1370 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562bb003fc20 0x562bb00523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562bb003e3d0 0x562bb004eee0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc57affd700 0 client.19875 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:31:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 --2- 172.21.15.12:0/3736449340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562bb003ed30 0x562bb004f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.398+0000 7fc5b5957b80 1 -- 172.21.15.12:0/3736449340 >> 172.21.15.12:0/3736449340 conn(0x562baff6d7e0 msgr2=0x562bb004b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.399+0000 7fc5b5957b80 1 -- 172.21.15.12:0/3736449340 shutdown_connections 2023-12-11T20:31:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.399+0000 7fc5b5957b80 1 -- 172.21.15.12:0/3736449340 wait complete. 2023-12-11T20:31:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.399+0000 7fc5b5957b80 20 client.19875 trim_cache size 0 max 16384 2023-12-11T20:31:19.400 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.399+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5840a1480 msgr2=0x7fc5840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.399+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5840a1480 0x7fc5840a3940 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc594009fd0 tx=0x7fc594009c60 comp rx=0 tx=0).stop 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.399+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 msgr2=0x7fc59c197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.399+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 0x7fc59c197890 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fc590009fd0 tx=0x7fc59000fab0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.400+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3280982241 shutdown_connections 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.400+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc5840a1480 0x7fc5840a3940 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.400+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc59c103040 0x7fc59c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.400+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc59c1014b0 0x7fc59c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.400+0000 7fc5a1fff700 1 --2- 172.21.15.12:0/3280982241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c1026a0 0x7fc59c197890 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.400+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3280982241 >> 172.21.15.12:0/3280982241 conn(0x7fc59c0fca00 msgr2=0x7fc59c105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.400+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3280982241 shutdown_connections 2023-12-11T20:31:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.400+0000 7fc5a1fff700 1 -- 172.21.15.12:0/3280982241 wait complete. 2023-12-11T20:31:19.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:31:19.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:19 smithi032 ceph-mon[132488]: pgmap v836: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:19 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3814349177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:31:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 -- 172.21.15.12:0/976556534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c109370 msgr2=0x7f494c10b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 --2- 172.21.15.12:0/976556534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c109370 0x7f494c10b800 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f494400b0a0 tx=0x7f494400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 -- 172.21.15.12:0/976556534 shutdown_connections 2023-12-11T20:31:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 --2- 172.21.15.12:0/976556534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c109370 0x7f494c10b800 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 --2- 172.21.15.12:0/976556534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f494c075610 0x7f494c073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 --2- 172.21.15.12:0/976556534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f494c074030 0x7f494c0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 -- 172.21.15.12:0/976556534 >> 172.21.15.12:0/976556534 conn(0x7f494c0fca00 msgr2=0x7f494c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 -- 172.21.15.12:0/976556534 shutdown_connections 2023-12-11T20:31:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.673+0000 7f49517ff700 1 -- 172.21.15.12:0/976556534 wait complete. 2023-12-11T20:31:19.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.674+0000 7f49517ff700 1 Processor -- start 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.674+0000 7f49517ff700 1 -- start start 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f49517ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f494c074030 0x7f494c199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f49517ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c075610 0x7f494c199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f49517ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f494c109370 0x7f494c1a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f49517ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1a1170 con 0x7f494c075610 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f49517ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1a12b0 con 0x7f494c109370 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f49517ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1a1440 con 0x7f494c074030 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c075610 0x7f494c199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f494affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f494c074030 0x7f494c199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c075610 0x7f494c199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39918/0 (socket says 172.21.15.12:39918) 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f494affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f494c074030 0x7f494c199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60052/0 (socket says 172.21.15.12:60052) 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f494a7fc700 1 -- 172.21.15.12:0/3153173294 learned_addr learned my addr 172.21.15.12:0/3153173294 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.675+0000 7f494b7fe700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f494c109370 0x7f494c1a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f494a7fc700 1 -- 172.21.15.12:0/3153173294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f494c074030 msgr2=0x7f494c199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f494a7fc700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f494c074030 0x7f494c199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f494a7fc700 1 -- 172.21.15.12:0/3153173294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f494c109370 msgr2=0x7f494c1a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f494a7fc700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f494c109370 0x7f494c1a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f494a7fc700 1 -- 172.21.15.12:0/3153173294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009d00 con 0x7f494c075610 2023-12-11T20:31:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f494a7fc700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c075610 0x7f494c199b80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f494000e970 tx=0x7f494000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f4933fff700 1 -- 172.21.15.12:0/3153173294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940009790 con 0x7f494c075610 2023-12-11T20:31:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f4933fff700 1 -- 172.21.15.12:0/3153173294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f494000c7e0 con 0x7f494c075610 2023-12-11T20:31:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f49517ff700 1 -- 172.21.15.12:0/3153173294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c1a1720 con 0x7f494c075610 2023-12-11T20:31:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f4933fff700 1 -- 172.21.15.12:0/3153173294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940003bd0 con 0x7f494c075610 2023-12-11T20:31:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.676+0000 7f49517ff700 1 -- 172.21.15.12:0/3153173294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c1a1c80 con 0x7f494c075610 2023-12-11T20:31:19.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.680+0000 7f4933fff700 1 -- 172.21.15.12:0/3153173294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f494000c950 con 0x7f494c075610 2023-12-11T20:31:19.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.681+0000 7f4933fff700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49340a1500 0x7f49340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.681+0000 7f4933fff700 1 -- 172.21.15.12:0/3153173294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4940014070 con 0x7f494c075610 2023-12-11T20:31:19.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f494affd700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49340a1500 0x7f49340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f496505cb80 1 Processor -- start 2023-12-11T20:31:19.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f496505cb80 1 -- start start 2023-12-11T20:31:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f496505cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f077f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f496505cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f08640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f496505cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f496505cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05e62b50 con 0x557d05f07d30 2023-12-11T20:31:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f496505cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05e60470 con 0x557d05f08c20 2023-12-11T20:31:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.682+0000 7f496505cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05e5bd60 con 0x557d05f073d0 2023-12-11T20:31:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494affd700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49340a1500 0x7f49340a39c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f493c009c60 tx=0x7f493c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f08640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f08640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39926/0 (socket says 172.21.15.12:39926) 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494a7fc700 1 -- 172.21.15.12:0/2196122098 learned_addr learned my addr 172.21.15.12:0/2196122098 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494affd700 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494a7fc700 1 -- 172.21.15.12:0/2196122098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 msgr2=0x557d05f077f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494a7fc700 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f077f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494a7fc700 1 -- 172.21.15.12:0/2196122098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 msgr2=0x557d05f090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494a7fc700 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494a7fc700 1 -- 172.21.15.12:0/2196122098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d05cd8630 con 0x557d05f07d30 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494affd700 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.683+0000 7f494b7fe700 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.684+0000 7f494a7fc700 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f08640 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4940096bf0 tx=0x7f4940003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715ee76d55ddaab0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.684+0000 7f49317fa700 1 -- 172.21.15.12:0/2196122098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400b1070 con 0x557d05f07d30 2023-12-11T20:31:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.684+0000 7f49317fa700 1 -- 172.21.15.12:0/2196122098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f494009a180 con 0x557d05f07d30 2023-12-11T20:31:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.684+0000 7f49317fa700 1 -- 172.21.15.12:0/2196122098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940098520 con 0x557d05f07d30 2023-12-11T20:31:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 -- 172.21.15.12:0/2196122098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 msgr2=0x557d05f08640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f08640 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4940096bf0 tx=0x7f4940003680 comp rx=0 tx=0).stop 2023-12-11T20:31:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 -- 172.21.15.12:0/2196122098 shutdown_connections 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 --2- 172.21.15.12:0/2196122098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f08640 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 -- 172.21.15.12:0/2196122098 >> 172.21.15.12:0/2196122098 conn(0x557d05e367e0 msgr2=0x557d05f03d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 -- 172.21.15.12:0/2196122098 shutdown_connections 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 -- 172.21.15.12:0/2196122098 wait complete. 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.685+0000 7f496505cb80 1 -- start start 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f496505cb80 1 Processor -- start 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f496505cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f11200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f496505cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 0x557d05f11740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f496505cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f18780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f496505cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05e15560 con 0x557d05f08c20 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f496505cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05e15200 con 0x557d05f073d0 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f496505cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05cda920 con 0x557d05f07d30 2023-12-11T20:31:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f496505cb80 10 client.0 _ll_register_callbacks cb 0x557d05d40a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.686+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f18780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f11200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f11200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37956/0 (socket says 172.21.15.12:37956) 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 0x557d05f11740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f18780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39932/0 (socket says 172.21.15.12:39932) 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 -- 172.21.15.12:0/2533533779 learned_addr learned my addr 172.21.15.12:0/2533533779 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 -- 172.21.15.12:0/2533533779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 msgr2=0x557d05f11740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 0x557d05f11740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 -- 172.21.15.12:0/2533533779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 msgr2=0x557d05f18780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f18780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 -- 172.21.15.12:0/2533533779 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c10c420 con 0x557d05f073d0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f494affd700 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f11200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f493c003980 tx=0x7f493c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f28e1634d296fa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.687+0000 7f492eff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.688+0000 7f492eff5700 1 -- 172.21.15.12:0/2533533779 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c01d820 con 0x557d05f073d0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.688+0000 7f496505cb80 1 -- 172.21.15.12:0/2533533779 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d05efab40 con 0x557d05f073d0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.688+0000 7f492eff5700 1 -- 172.21.15.12:0/2533533779 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f493c01d980 con 0x557d05f073d0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.688+0000 7f492eff5700 1 -- 172.21.15.12:0/2533533779 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f493c01db80 con 0x557d05f073d0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.688+0000 7f496505cb80 10 client.29432 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.688+0000 7f496505cb80 1 -- 172.21.15.12:0/2533533779 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f494c1a1c80 con 0x557d05f073d0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.689+0000 7f492eff5700 1 -- 172.21.15.12:0/2533533779 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557d05efab40 con 0x557d05f073d0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.689+0000 7f492eff5700 1 -- 172.21.15.12:0/2533533779 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f493c030c80 con 0x557d05f073d0 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.689+0000 7f496505cb80 10 client.29432 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.689+0000 7f496505cb80 10 client.29432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.689+0000 7f496505cb80 20 client.29432 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.689+0000 7f496505cb80 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557d05f1d0b0 0x557d05f1f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.689+0000 7f496505cb80 4 client.29432 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.689+0000 7f496505cb80 1 -- 172.21.15.12:0/2533533779 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d05ed6f40 con 0x557d05f1d0b0 2023-12-11T20:31:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.690+0000 7f494a7fc700 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557d05f1d0b0 0x557d05f1f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.690+0000 7f494a7fc700 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557d05f1d0b0 0x557d05f1f4d0 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8ad04534b3d79cb server_cookie=5e2b3740d5c5a2fb in_seq=0 out_seq=0 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.690+0000 7f492eff5700 10 client.29432 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.691+0000 7f492eff5700 1 -- 172.21.15.12:0/2533533779 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557d05ed6f40 con 0x557d05f1d0b0 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.691+0000 7f492eff5700 10 client.29432 handle_command_reply: tid=0 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.691+0000 7f496505cb80 1 client.29432 shutdown 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 -- 172.21.15.12:0/2533533779 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 msgr2=0x557d05f11200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f11200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f493c003980 tx=0x7f493c0047c0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 -- 172.21.15.12:0/2533533779 shutdown_connections 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557d05f1d0b0 0x557d05f1f4d0 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f11200 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f18780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 --2- 172.21.15.12:0/2533533779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 0x557d05f11740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 -- 172.21.15.12:0/2533533779 >> 172.21.15.12:0/2533533779 conn(0x557d05e367e0 msgr2=0x557d05f02a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f492eff5700 0 client.29432 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 -- 172.21.15.12:0/2533533779 shutdown_connections 2023-12-11T20:31:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 1 -- 172.21.15.12:0/2533533779 wait complete. 2023-12-11T20:31:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.692+0000 7f496505cb80 20 client.29432 trim_cache size 0 max 16384 2023-12-11T20:31:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f496505cb80 1 Processor -- start 2023-12-11T20:31:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f496505cb80 1 -- start start 2023-12-11T20:31:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f496505cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f18e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f496505cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f18710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f496505cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f09000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f496505cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05f10da0 con 0x557d05f07d30 2023-12-11T20:31:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f496505cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05f246e0 con 0x557d05f08c20 2023-12-11T20:31:19.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f496505cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05f1a510 con 0x557d05f073d0 2023-12-11T20:31:19.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f18710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f494a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f18710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39946/0 (socket says 172.21.15.12:39946) 2023-12-11T20:31:19.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.708+0000 7f494a7fc700 1 -- 172.21.15.12:0/180512864 learned_addr learned my addr 172.21.15.12:0/180512864 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f494affd700 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f18e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f494b7fe700 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f09000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f494a7fc700 1 -- 172.21.15.12:0/180512864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 msgr2=0x557d05f18e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f494a7fc700 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f18e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f494a7fc700 1 -- 172.21.15.12:0/180512864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 msgr2=0x557d05f09000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f494a7fc700 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f09000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f494a7fc700 1 -- 172.21.15.12:0/180512864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d05c84de0 con 0x557d05f07d30 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f494a7fc700 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f18710 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f494009a110 tx=0x7f49400965f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e410df9c92ad0b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f4931ffb700 1 -- 172.21.15.12:0/180512864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400b1040 con 0x557d05f07d30 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f4931ffb700 1 -- 172.21.15.12:0/180512864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4940099ae0 con 0x557d05f07d30 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.709+0000 7f4931ffb700 1 -- 172.21.15.12:0/180512864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940098520 con 0x557d05f07d30 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 -- 172.21.15.12:0/180512864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 msgr2=0x557d05f18710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f18710 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f494009a110 tx=0x7f49400965f0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 -- 172.21.15.12:0/180512864 shutdown_connections 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f08c20 0x557d05f09000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f073d0 0x557d05f18e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 --2- 172.21.15.12:0/180512864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f07d30 0x557d05f18710 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 -- 172.21.15.12:0/180512864 >> 172.21.15.12:0/180512864 conn(0x557d05e367e0 msgr2=0x557d05f0f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 -- 172.21.15.12:0/180512864 shutdown_connections 2023-12-11T20:31:19.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.710+0000 7f496505cb80 1 -- 172.21.15.12:0/180512864 wait complete. 2023-12-11T20:31:19.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 1 -- start start 2023-12-11T20:31:19.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 1 Processor -- start 2023-12-11T20:31:19.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f14000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 0x557d05f14540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f17560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05f17aa0 con 0x557d05f08c20 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05f17c10 con 0x557d05f073d0 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d05f17dd0 con 0x557d05f07d30 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.711+0000 7f496505cb80 10 client.0 _ll_register_callbacks cb 0x557d05d40a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f14000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f17560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f14000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37970/0 (socket says 172.21.15.12:37970) 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 -- 172.21.15.12:0/2688343671 learned_addr learned my addr 172.21.15.12:0/2688343671 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494a7fc700 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 0x557d05f14540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 -- 172.21.15.12:0/2688343671 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 msgr2=0x557d05f14540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 0x557d05f14540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 -- 172.21.15.12:0/2688343671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 msgr2=0x557d05f17560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:19.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f17560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 -- 172.21.15.12:0/2688343671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d05cd8630 con 0x557d05f073d0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f494affd700 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f14000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f493c030fb0 tx=0x7f493c01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a995756b004c6d12 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.712+0000 7f492eff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.713+0000 7f492eff5700 1 -- 172.21.15.12:0/2688343671 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c01ce20 con 0x557d05f073d0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.713+0000 7f496505cb80 1 -- 172.21.15.12:0/2688343671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f494009a180 con 0x557d05f073d0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.713+0000 7f492eff5700 1 -- 172.21.15.12:0/2688343671 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f493c01d620 con 0x557d05f073d0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.713+0000 7f492eff5700 1 -- 172.21.15.12:0/2688343671 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f493c01d840 con 0x557d05f073d0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.713+0000 7f496505cb80 10 client.29438 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.713+0000 7f496505cb80 1 -- 172.21.15.12:0/2688343671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x557d05c6dc60 con 0x557d05f073d0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f492eff5700 1 -- 172.21.15.12:0/2688343671 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f494009a180 con 0x557d05f073d0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f492eff5700 1 -- 172.21.15.12:0/2688343671 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f493c031740 con 0x557d05f073d0 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f496505cb80 10 client.29438 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:19.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f496505cb80 10 client.29438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:19.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f496505cb80 20 client.29438 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:19.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f496505cb80 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557d05f74100 0x557d05f76520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:19.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f496505cb80 4 client.29438 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:31:19.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f496505cb80 1 -- 172.21.15.12:0/2688343671 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557d05e21fd0 con 0x557d05f74100 2023-12-11T20:31:19.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.714+0000 7f494a7fc700 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557d05f74100 0x557d05f76520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f492eff5700 10 client.29438 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f494a7fc700 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557d05f74100 0x557d05f76520 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33303ae77a163539 server_cookie=83cf662c3b3e5f77 in_seq=0 out_seq=0 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f492eff5700 1 -- 172.21.15.12:0/2688343671 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557d05e21fd0 con 0x557d05f74100 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f492eff5700 10 client.29438 handle_command_reply: tid=0 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 client.29438 shutdown 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 -- 172.21.15.12:0/2688343671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 msgr2=0x557d05f14000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f14000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f493c030fb0 tx=0x7f493c01c830 comp rx=0 tx=0).stop 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 -- 172.21.15.12:0/2688343671 shutdown_connections 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557d05f74100 0x557d05f76520 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557d05f073d0 0x557d05f14000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f492eff5700 0 client.29438 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:19.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d05f08c20 0x557d05f17560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 --2- 172.21.15.12:0/2688343671 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557d05f07d30 0x557d05f14540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.715+0000 7f496505cb80 1 -- 172.21.15.12:0/2688343671 >> 172.21.15.12:0/2688343671 conn(0x557d05e367e0 msgr2=0x557d05f03970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.716+0000 7f496505cb80 1 -- 172.21.15.12:0/2688343671 shutdown_connections 2023-12-11T20:31:19.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.716+0000 7f496505cb80 1 -- 172.21.15.12:0/2688343671 wait complete. 2023-12-11T20:31:19.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.716+0000 7f496505cb80 20 client.29438 trim_cache size 0 max 16384 2023-12-11T20:31:19.717 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:31:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.716+0000 7f49517ff700 1 -- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49340a1500 msgr2=0x7f49340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.716+0000 7f49517ff700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49340a1500 0x7f49340a39c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f493c009c60 tx=0x7f493c009260 comp rx=0 tx=0).stop 2023-12-11T20:31:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.716+0000 7f49517ff700 1 -- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c075610 msgr2=0x7f494c199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.716+0000 7f49517ff700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c075610 0x7f494c199b80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f494000e970 tx=0x7f494000ec80 comp rx=0 tx=0).stop 2023-12-11T20:31:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.717+0000 7f49517ff700 1 -- 172.21.15.12:0/3153173294 shutdown_connections 2023-12-11T20:31:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.717+0000 7f49517ff700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f49340a1500 0x7f49340a39c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.717+0000 7f49517ff700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f494c109370 0x7f494c1a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.717+0000 7f49517ff700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f494c074030 0x7f494c199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.717+0000 7f49517ff700 1 --2- 172.21.15.12:0/3153173294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c075610 0x7f494c199b80 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.717+0000 7f49517ff700 1 -- 172.21.15.12:0/3153173294 >> 172.21.15.12:0/3153173294 conn(0x7f494c0fca00 msgr2=0x7f494c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.717+0000 7f49517ff700 1 -- 172.21.15.12:0/3153173294 shutdown_connections 2023-12-11T20:31:19.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:19.717+0000 7f49517ff700 1 -- 172.21.15.12:0/3153173294 wait complete. 2023-12-11T20:31:20.735 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:31:20.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:31:20.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 -- 172.21.15.12:0/4205531072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 msgr2=0x7efbe8109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:20.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/4205531072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 0x7efbe8109730 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7efbe000b0d0 tx=0x7efbe000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 -- 172.21.15.12:0/4205531072 shutdown_connections 2023-12-11T20:31:20.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/4205531072 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbe81012f0 0x7efbe8101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/4205531072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 0x7efbe8109730 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/4205531072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbe81024e0 0x7efbe8102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 -- 172.21.15.12:0/4205531072 >> 172.21.15.12:0/4205531072 conn(0x7efbe80fc860 msgr2=0x7efbe80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 -- 172.21.15.12:0/4205531072 shutdown_connections 2023-12-11T20:31:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.974+0000 7efbeeb9d700 1 -- 172.21.15.12:0/4205531072 wait complete. 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.975+0000 7efbeeb9d700 1 Processor -- start 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.975+0000 7efbeeb9d700 1 -- start start 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbeeb9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbe81012f0 0x7efbe8199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbeeb9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbe81024e0 0x7efbe81998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbeeb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 0x7efbe81a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbeeb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe81a0ea0 con 0x7efbe8102e80 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbeeb9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe81a0fe0 con 0x7efbe81024e0 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbeeb9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe81a1170 con 0x7efbe81012f0 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbee39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 0x7efbe81a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbee39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 0x7efbe81a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39990/0 (socket says 172.21.15.12:39990) 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbee39c700 1 -- 172.21.15.12:0/1272426186 learned_addr learned my addr 172.21.15.12:0/1272426186 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.976+0000 7efbedb9b700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbe81012f0 0x7efbe8199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbed39a700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbe81024e0 0x7efbe81998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbee39c700 1 -- 172.21.15.12:0/1272426186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbe81012f0 msgr2=0x7efbe8199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbee39c700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbe81012f0 0x7efbe8199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbee39c700 1 -- 172.21.15.12:0/1272426186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbe81024e0 msgr2=0x7efbe81998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbee39c700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbe81024e0 0x7efbe81998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbee39c700 1 -- 172.21.15.12:0/1272426186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe0009d00 con 0x7efbe8102e80 2023-12-11T20:31:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbee39c700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 0x7efbe81a08d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7efbe00079c0 tx=0x7efbe000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbdeffd700 1 -- 172.21.15.12:0/1272426186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe000e040 con 0x7efbe8102e80 2023-12-11T20:31:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.977+0000 7efbeeb9d700 1 -- 172.21.15.12:0/1272426186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe81a13f0 con 0x7efbe8102e80 2023-12-11T20:31:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.978+0000 7efbdeffd700 1 -- 172.21.15.12:0/1272426186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbe0004e60 con 0x7efbe8102e80 2023-12-11T20:31:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.978+0000 7efbdeffd700 1 -- 172.21.15.12:0/1272426186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe001b6b0 con 0x7efbe8102e80 2023-12-11T20:31:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.978+0000 7efbeeb9d700 1 -- 172.21.15.12:0/1272426186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbe81a18c0 con 0x7efbe8102e80 2023-12-11T20:31:20.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.982+0000 7efbdeffd700 1 -- 172.21.15.12:0/1272426186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7efbe001da10 con 0x7efbe8102e80 2023-12-11T20:31:20.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.983+0000 7efc036c6b80 1 Processor -- start 2023-12-11T20:31:20.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.983+0000 7efc036c6b80 1 -- start start 2023-12-11T20:31:20.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efbdeffd700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd40a15a0 0x7efbd40a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x558494913f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914440 0x558494914920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x5584949152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efc036c6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849486ebd0 con 0x558494913ae0 2023-12-11T20:31:20.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efc036c6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849486c4f0 con 0x558494914e60 2023-12-11T20:31:20.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efc036c6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558494867de0 con 0x558494914440 2023-12-11T20:31:20.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efbdeffd700 1 -- 172.21.15.12:0/1272426186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efbe00ce780 con 0x7efbe8102e80 2023-12-11T20:31:20.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efbed39a700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd40a15a0 0x7efbd40a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efbee39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x5584949152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efbee39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x5584949152c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37992/0 (socket says 172.21.15.12:37992) 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efbee39c700 1 -- 172.21.15.12:0/961215082 learned_addr learned my addr 172.21.15.12:0/961215082 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.984+0000 7efbed39a700 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914440 0x558494914920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbedb9b700 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x558494913f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbed39a700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd40a15a0 0x7efbd40a3a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7efbd80123f0 tx=0x7efbd80127b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbee39c700 1 -- 172.21.15.12:0/961215082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914440 msgr2=0x558494914920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbee39c700 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914440 0x558494914920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbee39c700 1 -- 172.21.15.12:0/961215082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 msgr2=0x558494913f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbee39c700 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x558494913f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbee39c700 1 -- 172.21.15.12:0/961215082 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584946e46b0 con 0x558494914e60 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbedb9b700 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x558494913f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:20.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.985+0000 7efbee39c700 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x5584949152c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efbe0022000 tx=0x7efbe0006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd573ec4605a884d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:20.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.986+0000 7efbd3fff700 1 -- 172.21.15.12:0/961215082 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0001d20 con 0x558494914e60 2023-12-11T20:31:20.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.986+0000 7efbd3fff700 1 -- 172.21.15.12:0/961215082 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbe0001b40 con 0x558494914e60 2023-12-11T20:31:20.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.986+0000 7efbd3fff700 1 -- 172.21.15.12:0/961215082 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe00a3e10 con 0x558494914e60 2023-12-11T20:31:20.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 -- 172.21.15.12:0/961215082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 msgr2=0x5584949152c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:20.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x5584949152c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efbe0022000 tx=0x7efbe0006000 comp rx=0 tx=0).stop 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 -- 172.21.15.12:0/961215082 shutdown_connections 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x5584949152c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x558494913f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 --2- 172.21.15.12:0/961215082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914440 0x558494914920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 -- 172.21.15.12:0/961215082 >> 172.21.15.12:0/961215082 conn(0x558494842860 msgr2=0x55849490e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 -- 172.21.15.12:0/961215082 shutdown_connections 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.987+0000 7efc036c6b80 1 -- 172.21.15.12:0/961215082 wait complete. 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 1 -- start start 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 1 Processor -- start 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x55849491d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494924730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584948215e0 con 0x558494913ae0 2023-12-11T20:31:20.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558494821280 con 0x558494914440 2023-12-11T20:31:20.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584946e69a0 con 0x558494914e60 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.988+0000 7efc036c6b80 10 client.0 _ll_register_callbacks cb 0x55849474cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbedb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbed39a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x55849491d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbed39a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x55849491d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37994/0 (socket says 172.21.15.12:37994) 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbed39a700 1 -- 172.21.15.12:0/2149945886 learned_addr learned my addr 172.21.15.12:0/2149945886 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbee39c700 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494924730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbedb9b700 1 -- 172.21.15.12:0/2149945886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 msgr2=0x558494924730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbedb9b700 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494924730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbedb9b700 1 -- 172.21.15.12:0/2149945886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 msgr2=0x55849491d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbedb9b700 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x55849491d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbedb9b700 1 -- 172.21.15.12:0/2149945886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbe400d860 con 0x558494913ae0 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.989+0000 7efbed39a700 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x55849491d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efbedb9b700 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d1b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7efbe40126d0 tx=0x7efbe40129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea7229f0308121d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efbd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efbd17fa700 1 -- 172.21.15.12:0/2149945886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe4004220 con 0x558494913ae0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efbd17fa700 1 -- 172.21.15.12:0/2149945886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efbe4004380 con 0x558494913ae0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efc036c6b80 1 -- 172.21.15.12:0/2149945886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558494906a60 con 0x558494913ae0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efbd17fa700 1 -- 172.21.15.12:0/2149945886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbe4004830 con 0x558494913ae0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efc036c6b80 10 client.19905 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efc036c6b80 1 -- 172.21.15.12:0/2149945886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7efbe81a18c0 con 0x558494913ae0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.990+0000 7efbd17fa700 1 -- 172.21.15.12:0/2149945886 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558494906a60 con 0x558494913ae0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.991+0000 7efbd17fa700 1 -- 172.21.15.12:0/2149945886 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7efbe400f770 con 0x558494913ae0 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.991+0000 7efc036c6b80 10 client.19905 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.991+0000 7efc036c6b80 10 client.19905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.991+0000 7efc036c6b80 20 client.19905 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.991+0000 7efc036c6b80 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558494929010 0x55849492b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.991+0000 7efc036c6b80 4 client.19905 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:20.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.991+0000 7efc036c6b80 1 -- 172.21.15.12:0/2149945886 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584948e2fc0 con 0x558494929010 2023-12-11T20:31:20.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.992+0000 7efbed39a700 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558494929010 0x55849492b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.992+0000 7efbd17fa700 10 client.19905 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.992+0000 7efbed39a700 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558494929010 0x55849492b430 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f41c8da92cc23a62 server_cookie=1302b96963aaea26 in_seq=0 out_seq=0 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.993+0000 7efbd17fa700 1 -- 172.21.15.12:0/2149945886 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5584948e2fc0 con 0x558494929010 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.993+0000 7efbd17fa700 10 client.19905 handle_command_reply: tid=0 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.993+0000 7efc036c6b80 1 client.19905 shutdown 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.993+0000 7efc036c6b80 1 -- 172.21.15.12:0/2149945886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 msgr2=0x55849491d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.993+0000 7efc036c6b80 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d1b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7efbe40126d0 tx=0x7efbe40129e0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.993+0000 7efc036c6b80 1 -- 172.21.15.12:0/2149945886 shutdown_connections 2023-12-11T20:31:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efc036c6b80 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558494929010 0x55849492b430 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efc036c6b80 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494924730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efc036c6b80 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d1b0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efbd17fa700 0 client.19905 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efc036c6b80 1 --2- 172.21.15.12:0/2149945886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x55849491d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efc036c6b80 1 -- 172.21.15.12:0/2149945886 >> 172.21.15.12:0/2149945886 conn(0x558494842860 msgr2=0x5584949128a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efc036c6b80 1 -- 172.21.15.12:0/2149945886 shutdown_connections 2023-12-11T20:31:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efc036c6b80 1 -- 172.21.15.12:0/2149945886 wait complete. 2023-12-11T20:31:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:20.994+0000 7efc036c6b80 20 client.19905 trim_cache size 0 max 16384 2023-12-11T20:31:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.019+0000 7efc036c6b80 1 Processor -- start 2023-12-11T20:31:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.019+0000 7efc036c6b80 1 -- start start 2023-12-11T20:31:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.019+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.019+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x5584949246f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.019+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494917b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.019+0000 7efc036c6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558494914b30 con 0x558494913ae0 2023-12-11T20:31:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.019+0000 7efc036c6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849490f0e0 con 0x558494914440 2023-12-11T20:31:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.019+0000 7efc036c6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558494906a60 con 0x558494914e60 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbedb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbedb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40032/0 (socket says 172.21.15.12:40032) 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbedb9b700 1 -- 172.21.15.12:0/819706397 learned_addr learned my addr 172.21.15.12:0/819706397 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbee39c700 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494917b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbed39a700 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x5584949246f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbedb9b700 1 -- 172.21.15.12:0/819706397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 msgr2=0x558494917b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbedb9b700 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494917b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbedb9b700 1 -- 172.21.15.12:0/819706397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 msgr2=0x5584949246f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbedb9b700 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x5584949246f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbedb9b700 1 -- 172.21.15.12:0/819706397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558494690e60 con 0x558494913ae0 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.020+0000 7efbee39c700 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494917b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.021+0000 7efbedb9b700 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d670 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7efbe4005a60 tx=0x7efbe4005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0065c2102fe35e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.021+0000 7efbdcbff700 1 -- 172.21.15.12:0/819706397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe400f5e0 con 0x558494913ae0 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.021+0000 7efbdcbff700 1 -- 172.21.15.12:0/819706397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbe40044b0 con 0x558494913ae0 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.021+0000 7efbdcbff700 1 -- 172.21.15.12:0/819706397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe4003b40 con 0x558494913ae0 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 -- 172.21.15.12:0/819706397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 msgr2=0x55849491d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d670 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7efbe4005a60 tx=0x7efbe4005700 comp rx=0 tx=0).stop 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 -- 172.21.15.12:0/819706397 shutdown_connections 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494914e60 0x558494917b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494913ae0 0x55849491d670 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 --2- 172.21.15.12:0/819706397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914440 0x5584949246f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 -- 172.21.15.12:0/819706397 >> 172.21.15.12:0/819706397 conn(0x558494842860 msgr2=0x55849491cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 -- 172.21.15.12:0/819706397 shutdown_connections 2023-12-11T20:31:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 -- 172.21.15.12:0/819706397 wait complete. 2023-12-11T20:31:21.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.022+0000 7efc036c6b80 1 -- start start 2023-12-11T20:31:21.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efc036c6b80 1 Processor -- start 2023-12-11T20:31:21.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494913ae0 0x5584949238a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494914440 0x558494923de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efc036c6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x55849497f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efc036c6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849497fb20 con 0x558494914440 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efc036c6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849497fc60 con 0x558494914e60 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efc036c6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849497fdf0 con 0x558494913ae0 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efc036c6b80 10 client.0 _ll_register_callbacks cb 0x55849474cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efbed39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494914440 0x558494923de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efbed39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494914440 0x558494923de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40034/0 (socket says 172.21.15.12:40034) 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.023+0000 7efbed39a700 1 -- 172.21.15.12:0/3028095651 learned_addr learned my addr 172.21.15.12:0/3028095651 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbee39c700 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x55849497f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbedb9b700 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494913ae0 0x5584949238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbed39a700 1 -- 172.21.15.12:0/3028095651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494913ae0 msgr2=0x5584949238a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbed39a700 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494913ae0 0x5584949238a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbed39a700 1 -- 172.21.15.12:0/3028095651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 msgr2=0x55849497f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbed39a700 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x55849497f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbed39a700 1 -- 172.21.15.12:0/3028095651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584946e46b0 con 0x558494914440 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbedb9b700 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494913ae0 0x5584949238a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbed39a700 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494914440 0x558494923de0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7efbd80094f0 tx=0x7efbd801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d165ddd5aa1f55 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.024+0000 7efbd17fa700 1 -- 172.21.15.12:0/3028095651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbd8024040 con 0x558494914440 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efbd17fa700 1 -- 172.21.15.12:0/3028095651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efbd8010e20 con 0x558494914440 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 1 -- 172.21.15.12:0/3028095651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbe0001b40 con 0x558494914440 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efbd17fa700 1 -- 172.21.15.12:0/3028095651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbd802b7c0 con 0x558494914440 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 10 client.19911 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 1 -- 172.21.15.12:0/3028095651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7efbe81a18c0 con 0x558494914440 2023-12-11T20:31:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efbd17fa700 1 -- 172.21.15.12:0/3028095651 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbe0001b40 con 0x558494914440 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efbd17fa700 1 -- 172.21.15.12:0/3028095651 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7efbd80365e0 con 0x558494914440 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 10 client.19911 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 10 client.19911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 20 client.19911 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558494981920 0x558494983d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 4 client.19911 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.025+0000 7efc036c6b80 1 -- 172.21.15.12:0/3028095651 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55849482e050 con 0x558494981920 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.026+0000 7efbedb9b700 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558494981920 0x558494983d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.026+0000 7efbedb9b700 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558494981920 0x558494983d40 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22aa5da8332cb16b server_cookie=8b05b5761b843041 in_seq=0 out_seq=0 2023-12-11T20:31:21.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.026+0000 7efbd17fa700 10 client.19911 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:21.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efbd17fa700 1 -- 172.21.15.12:0/3028095651 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55849482e050 con 0x558494981920 2023-12-11T20:31:21.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efbd17fa700 10 client.19911 handle_command_reply: tid=0 2023-12-11T20:31:21.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 client.19911 shutdown 2023-12-11T20:31:21.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 -- 172.21.15.12:0/3028095651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494914440 msgr2=0x558494923de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494914440 0x558494923de0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7efbd80094f0 tx=0x7efbd801a000 comp rx=0 tx=0).stop 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 -- 172.21.15.12:0/3028095651 shutdown_connections 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558494981920 0x558494983d40 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558494914e60 0x55849497f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558494913ae0 0x5584949238a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 --2- 172.21.15.12:0/3028095651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558494914440 0x558494923de0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efbd17fa700 0 client.19911 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 -- 172.21.15.12:0/3028095651 >> 172.21.15.12:0/3028095651 conn(0x558494842860 msgr2=0x558494917b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 -- 172.21.15.12:0/3028095651 shutdown_connections 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 1 -- 172.21.15.12:0/3028095651 wait complete. 2023-12-11T20:31:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.028+0000 7efc036c6b80 20 client.19911 trim_cache size 0 max 16384 2023-12-11T20:31:21.031 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:31:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:31:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "ca407570-a82e-45a4-bb6d-32e194ae60ea", 2023-12-11T20:31:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:31:21.031 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:31:21.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 -- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd40a15a0 msgr2=0x7efbd40a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd40a15a0 0x7efbd40a3a60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7efbd80123f0 tx=0x7efbd80127b0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 -- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 msgr2=0x7efbe81a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 0x7efbe81a08d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7efbe00079c0 tx=0x7efbe000cd70 comp rx=0 tx=0).stop 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 -- 172.21.15.12:0/1272426186 shutdown_connections 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd40a15a0 0x7efbd40a3a60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbe8102e80 0x7efbe81a08d0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbe81012f0 0x7efbe8199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 --2- 172.21.15.12:0/1272426186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbe81024e0 0x7efbe81998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 -- 172.21.15.12:0/1272426186 >> 172.21.15.12:0/1272426186 conn(0x7efbe80fc860 msgr2=0x7efbe8073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 -- 172.21.15.12:0/1272426186 shutdown_connections 2023-12-11T20:31:21.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.029+0000 7efbeeb9d700 1 -- 172.21.15.12:0/1272426186 wait complete. 2023-12-11T20:31:21.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:31:21.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 -- 172.21.15.12:0/2231019111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 msgr2=0x7f312c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 --2- 172.21.15.12:0/2231019111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 0x7f312c1098f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f312400b0d0 tx=0x7f312400b3e0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 -- 172.21.15.12:0/2231019111 shutdown_connections 2023-12-11T20:31:21.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 --2- 172.21.15.12:0/2231019111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f312c1014b0 0x7f312c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 --2- 172.21.15.12:0/2231019111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 0x7f312c1098f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 --2- 172.21.15.12:0/2231019111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f312c1026a0 0x7f312c102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 -- 172.21.15.12:0/2231019111 >> 172.21.15.12:0/2231019111 conn(0x7f312c0fca00 msgr2=0x7f312c0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 -- 172.21.15.12:0/2231019111 shutdown_connections 2023-12-11T20:31:21.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.301+0000 7f31323ff700 1 -- 172.21.15.12:0/2231019111 wait complete. 2023-12-11T20:31:21.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.303+0000 7f31323ff700 1 Processor -- start 2023-12-11T20:31:21.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.303+0000 7f31323ff700 1 -- start start 2023-12-11T20:31:21.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.303+0000 7f31323ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f312c1014b0 0x7f312c197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.303+0000 7f31323ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f312c1026a0 0x7f312c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f31323ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 0x7f312c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f31323ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c19ef50 con 0x7f312c103040 2023-12-11T20:31:21.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f31323ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c19f090 con 0x7f312c1014b0 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f31323ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c19f220 con 0x7f312c1026a0 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f313099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 0x7f312c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f313099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 0x7f312c19e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40060/0 (socket says 172.21.15.12:40060) 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f313099c700 1 -- 172.21.15.12:0/1362317192 learned_addr learned my addr 172.21.15.12:0/1362317192 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f312bfff700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f312c1014b0 0x7f312c197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f312b7fe700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f312c1026a0 0x7f312c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f313099c700 1 -- 172.21.15.12:0/1362317192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f312c1026a0 msgr2=0x7f312c197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f313099c700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f312c1026a0 0x7f312c197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f313099c700 1 -- 172.21.15.12:0/1362317192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f312c1014b0 msgr2=0x7f312c197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f313099c700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f312c1014b0 0x7f312c197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.304+0000 7f313099c700 1 -- 172.21.15.12:0/1362317192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124009d00 con 0x7f312c103040 2023-12-11T20:31:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.305+0000 7f313099c700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 0x7f312c19e980 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f3124007af0 tx=0x7f3124007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.305+0000 7f31297fa700 1 -- 172.21.15.12:0/1362317192 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400e040 con 0x7f312c103040 2023-12-11T20:31:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.305+0000 7f31297fa700 1 -- 172.21.15.12:0/1362317192 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f312400be30 con 0x7f312c103040 2023-12-11T20:31:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.305+0000 7f31297fa700 1 -- 172.21.15.12:0/1362317192 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312401b930 con 0x7f312c103040 2023-12-11T20:31:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.305+0000 7f31323ff700 1 -- 172.21.15.12:0/1362317192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c19f4a0 con 0x7f312c103040 2023-12-11T20:31:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.305+0000 7f31323ff700 1 -- 172.21.15.12:0/1362317192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c19f920 con 0x7f312c103040 2023-12-11T20:31:21.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.310+0000 7f31297fa700 1 -- 172.21.15.12:0/1362317192 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f312401d670 con 0x7f312c103040 2023-12-11T20:31:21.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.311+0000 7f3145d0db80 1 Processor -- start 2023-12-11T20:31:21.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.311+0000 7f3145d0db80 1 -- start start 2023-12-11T20:31:21.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.311+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a1477e0 0x56207a147c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.311+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a148a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.311+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a149030 0x56207a1494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.311+0000 7f3145d0db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a09eb50 con 0x56207a149030 2023-12-11T20:31:21.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f3145d0db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a09c470 con 0x56207a1477e0 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f3145d0db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a097d60 con 0x56207a148140 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f31297fa700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31140a1500 0x7f31140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f31297fa700 1 -- 172.21.15.12:0/1362317192 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31240ce1e0 con 0x7f312c103040 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60202/0 (socket says 172.21.15.12:60202) 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312bfff700 1 -- 172.21.15.12:0/4152224211 learned_addr learned my addr 172.21.15.12:0/4152224211 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312b7fe700 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a1477e0 0x56207a147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f313099c700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31140a1500 0x7f31140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312b7fe700 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a149030 0x56207a1494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312bfff700 1 -- 172.21.15.12:0/4152224211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a1477e0 msgr2=0x56207a147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312bfff700 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a1477e0 0x56207a147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312bfff700 1 -- 172.21.15.12:0/4152224211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a149030 msgr2=0x56207a1494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312bfff700 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a149030 0x56207a1494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.312+0000 7f312bfff700 1 -- 172.21.15.12:0/4152224211 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562079f14630 con 0x56207a148140 2023-12-11T20:31:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.313+0000 7f313099c700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31140a1500 0x7f31140a39c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3124097a40 tx=0x7f31240078e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.313+0000 7f312bfff700 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a148a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f311c009d30 tx=0x7f311c011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c819f99d259858 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.313+0000 7f31127fc700 1 -- 172.21.15.12:0/4152224211 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c004220 con 0x56207a148140 2023-12-11T20:31:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.313+0000 7f31127fc700 1 -- 172.21.15.12:0/4152224211 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f311c004380 con 0x56207a148140 2023-12-11T20:31:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.313+0000 7f31127fc700 1 -- 172.21.15.12:0/4152224211 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c0197a0 con 0x56207a148140 2023-12-11T20:31:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.314+0000 7f3145d0db80 1 -- 172.21.15.12:0/4152224211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 msgr2=0x56207a148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.314+0000 7f3145d0db80 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a148a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f311c009d30 tx=0x7f311c011720 comp rx=0 tx=0).stop 2023-12-11T20:31:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.314+0000 7f3145d0db80 1 -- 172.21.15.12:0/4152224211 shutdown_connections 2023-12-11T20:31:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.314+0000 7f3145d0db80 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a1477e0 0x56207a147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.314+0000 7f3145d0db80 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a149030 0x56207a1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.314+0000 7f3145d0db80 1 --2- 172.21.15.12:0/4152224211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a148a50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.314+0000 7f3145d0db80 1 -- 172.21.15.12:0/4152224211 >> 172.21.15.12:0/4152224211 conn(0x56207a0727e0 msgr2=0x56207a13fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.314+0000 7f3145d0db80 1 -- 172.21.15.12:0/4152224211 shutdown_connections 2023-12-11T20:31:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.315+0000 7f3145d0db80 1 -- 172.21.15.12:0/4152224211 wait complete. 2023-12-11T20:31:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.315+0000 7f3145d0db80 1 -- start start 2023-12-11T20:31:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.315+0000 7f3145d0db80 1 Processor -- start 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a151530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a148140 0x56207a151a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a149030 0x56207a158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f3145d0db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a051560 con 0x56207a1477e0 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f3145d0db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a051200 con 0x56207a148140 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f3145d0db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562079f16920 con 0x56207a149030 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f3145d0db80 10 client.0 _ll_register_callbacks cb 0x562079f7ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40082/0 (socket says 172.21.15.12:40082) 2023-12-11T20:31:21.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.316+0000 7f312b7fe700 1 -- 172.21.15.12:0/1527738692 learned_addr learned my addr 172.21.15.12:0/1527738692 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312b7fe700 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a149030 0x56207a158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312bfff700 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a148140 0x56207a151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312b7fe700 1 -- 172.21.15.12:0/1527738692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a149030 msgr2=0x56207a158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312b7fe700 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a149030 0x56207a158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312b7fe700 1 -- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a148140 msgr2=0x56207a151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312b7fe700 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a148140 0x56207a151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312b7fe700 1 -- 172.21.15.12:0/1527738692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c009960 con 0x56207a1477e0 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312bfff700 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a148140 0x56207a151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f312b7fe700 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a151530 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f3120009f40 tx=0x7f31200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c4c178cfe13f58 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.317+0000 7f310b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.318+0000 7f310b7fe700 1 -- 172.21.15.12:0/1527738692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3120004460 con 0x56207a1477e0 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.318+0000 7f310b7fe700 1 -- 172.21.15.12:0/1527738692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3120010920 con 0x56207a1477e0 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.318+0000 7f3145d0db80 1 -- 172.21.15.12:0/1527738692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56207a136b40 con 0x56207a1477e0 2023-12-11T20:31:21.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.318+0000 7f310b7fe700 1 -- 172.21.15.12:0/1527738692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3120010ae0 con 0x56207a1477e0 2023-12-11T20:31:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.318+0000 7f3145d0db80 10 client.19923 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.318+0000 7f3145d0db80 1 -- 172.21.15.12:0/1527738692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562079ec0de0 con 0x56207a1477e0 2023-12-11T20:31:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.318+0000 7f310b7fe700 1 -- 172.21.15.12:0/1527738692 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56207a136b40 con 0x56207a1477e0 2023-12-11T20:31:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.319+0000 7f310b7fe700 1 -- 172.21.15.12:0/1527738692 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f3120003cd0 con 0x56207a1477e0 2023-12-11T20:31:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.319+0000 7f3145d0db80 10 client.19923 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.319+0000 7f3145d0db80 10 client.19923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.319+0000 7f3145d0db80 20 client.19923 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.319+0000 7f3145d0db80 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56207a15d2e0 0x56207a15f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.319+0000 7f3145d0db80 4 client.19923 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.319+0000 7f3145d0db80 1 -- 172.21.15.12:0/1527738692 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56207a112f40 con 0x56207a15d2e0 2023-12-11T20:31:21.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.319+0000 7f312bfff700 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56207a15d2e0 0x56207a15f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.320+0000 7f310b7fe700 10 client.19923 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:21.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.320+0000 7f312bfff700 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56207a15d2e0 0x56207a15f700 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1abd30c58aa586ab server_cookie=20aabbfd4f8d72f0 in_seq=0 out_seq=0 2023-12-11T20:31:21.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.321+0000 7f310b7fe700 1 -- 172.21.15.12:0/1527738692 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56207a112f40 con 0x56207a15d2e0 2023-12-11T20:31:21.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.321+0000 7f310b7fe700 10 client.19923 handle_command_reply: tid=0 2023-12-11T20:31:21.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.321+0000 7f3145d0db80 1 client.19923 shutdown 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 -- 172.21.15.12:0/1527738692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 msgr2=0x56207a151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a151530 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f3120009f40 tx=0x7f31200047c0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 -- 172.21.15.12:0/1527738692 shutdown_connections 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56207a15d2e0 0x56207a15f700 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a149030 0x56207a158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a151530 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 --2- 172.21.15.12:0/1527738692 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a148140 0x56207a151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 -- 172.21.15.12:0/1527738692 >> 172.21.15.12:0/1527738692 conn(0x56207a0727e0 msgr2=0x56207a13ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f310b7fe700 0 client.19923 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 -- 172.21.15.12:0/1527738692 shutdown_connections 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 1 -- 172.21.15.12:0/1527738692 wait complete. 2023-12-11T20:31:21.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.322+0000 7f3145d0db80 20 client.19923 trim_cache size 0 max 16384 2023-12-11T20:31:21.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:21 smithi012 ceph-mon[128787]: pgmap v837: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.342+0000 7f3145d0db80 1 Processor -- start 2023-12-11T20:31:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.342+0000 7f3145d0db80 1 -- start start 2023-12-11T20:31:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a13f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 0x56207a13feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f3145d0db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a1510a0 con 0x56207a1477e0 2023-12-11T20:31:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f3145d0db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a148520 con 0x56207a149030 2023-12-11T20:31:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f3145d0db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a164930 con 0x56207a148140 2023-12-11T20:31:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a13f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a13f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40098/0 (socket says 172.21.15.12:40098) 2023-12-11T20:31:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f312b7fe700 1 -- 172.21.15.12:0/2636932646 learned_addr learned my addr 172.21.15.12:0/2636932646 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f312bfff700 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f312b7fe700 1 -- 172.21.15.12:0/2636932646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 msgr2=0x56207a158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.343+0000 7f312b7fe700 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.344+0000 7f312b7fe700 1 -- 172.21.15.12:0/2636932646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 msgr2=0x56207a13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.344+0000 7f312b7fe700 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 0x56207a13feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.344+0000 7f312b7fe700 1 -- 172.21.15.12:0/2636932646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562079ea9c60 con 0x56207a1477e0 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.344+0000 7f312bfff700 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.344+0000 7f312b7fe700 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a13f970 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f3120005950 tx=0x7f31200099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aab8ea97fa191e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.344+0000 7f3112ffd700 1 -- 172.21.15.12:0/2636932646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3120009260 con 0x56207a1477e0 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.344+0000 7f3112ffd700 1 -- 172.21.15.12:0/2636932646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3120025030 con 0x56207a1477e0 2023-12-11T20:31:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.344+0000 7f3112ffd700 1 -- 172.21.15.12:0/2636932646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3120010b80 con 0x56207a1477e0 2023-12-11T20:31:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 -- 172.21.15.12:0/2636932646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 msgr2=0x56207a13f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a13f970 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f3120005950 tx=0x7f31200099a0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 -- 172.21.15.12:0/2636932646 shutdown_connections 2023-12-11T20:31:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 0x56207a13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a1477e0 0x56207a13f970 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 --2- 172.21.15.12:0/2636932646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a148140 0x56207a158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 -- 172.21.15.12:0/2636932646 >> 172.21.15.12:0/2636932646 conn(0x56207a0727e0 msgr2=0x56207a14bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 -- 172.21.15.12:0/2636932646 shutdown_connections 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.345+0000 7f3145d0db80 1 -- 172.21.15.12:0/2636932646 wait complete. 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.346+0000 7f3145d0db80 1 -- start start 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.346+0000 7f3145d0db80 1 Processor -- start 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.346+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a1477e0 0x56207a154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.346+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a148140 0x56207a155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.346+0000 7f3145d0db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 0x56207a1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.346+0000 7f3145d0db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a158710 con 0x56207a148140 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.346+0000 7f3145d0db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a158880 con 0x56207a149030 2023-12-11T20:31:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.346+0000 7f3145d0db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207a158a40 con 0x56207a1477e0 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f3145d0db80 10 client.0 _ll_register_callbacks cb 0x562079f7ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a148140 0x56207a155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a148140 0x56207a155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40108/0 (socket says 172.21.15.12:40108) 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 -- 172.21.15.12:0/3560903120 learned_addr learned my addr 172.21.15.12:0/3560903120 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312b7fe700 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a1477e0 0x56207a154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312b7fe700 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 0x56207a1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 -- 172.21.15.12:0/3560903120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a1477e0 msgr2=0x56207a154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a1477e0 0x56207a154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 -- 172.21.15.12:0/3560903120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 msgr2=0x56207a1581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 0x56207a1581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 -- 172.21.15.12:0/3560903120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562079ec0de0 con 0x56207a148140 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312b7fe700 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a1477e0 0x56207a154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f312bfff700 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a148140 0x56207a155250 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f311c014040 tx=0x7f311c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d587eaec47e578 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:21.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.347+0000 7f310b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.348+0000 7f310b7fe700 1 -- 172.21.15.12:0/3560903120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c02a040 con 0x56207a148140 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.348+0000 7f3145d0db80 1 -- 172.21.15.12:0/3560903120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f311c004380 con 0x56207a148140 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.348+0000 7f310b7fe700 1 -- 172.21.15.12:0/3560903120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f311c005040 con 0x56207a148140 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.348+0000 7f310b7fe700 1 -- 172.21.15.12:0/3560903120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f311c005200 con 0x56207a148140 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.348+0000 7f3145d0db80 10 client.19929 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.348+0000 7f3145d0db80 1 -- 172.21.15.12:0/3560903120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562079ee7250 con 0x56207a148140 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.348+0000 7f310b7fe700 1 -- 172.21.15.12:0/3560903120 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f311c004380 con 0x56207a148140 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.348+0000 7f310b7fe700 1 -- 172.21.15.12:0/3560903120 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f311c02b730 con 0x56207a148140 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.349+0000 7f3145d0db80 10 client.19929 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.349+0000 7f3145d0db80 10 client.19929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.349+0000 7f3145d0db80 20 client.19929 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:21.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.349+0000 7f3145d0db80 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56207a1b4c40 0x56207a1b7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.349+0000 7f3145d0db80 4 client.19929 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.349+0000 7f3145d0db80 1 -- 172.21.15.12:0/3560903120 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56207a05dfd0 con 0x56207a1b4c40 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.349+0000 7f312b7fe700 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56207a1b4c40 0x56207a1b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f310b7fe700 10 client.19929 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f312b7fe700 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56207a1b4c40 0x56207a1b7060 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7bdd3d4804866b6 server_cookie=a81b6d0720bad2a6 in_seq=0 out_seq=0 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f310b7fe700 1 -- 172.21.15.12:0/3560903120 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56207a05dfd0 con 0x56207a1b4c40 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f310b7fe700 10 client.19929 handle_command_reply: tid=0 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 client.19929 shutdown 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 -- 172.21.15.12:0/3560903120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a148140 msgr2=0x56207a155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a148140 0x56207a155250 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f311c014040 tx=0x7f311c005e50 comp rx=0 tx=0).stop 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 -- 172.21.15.12:0/3560903120 shutdown_connections 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56207a1b4c40 0x56207a1b7060 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56207a149030 0x56207a1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56207a1477e0 0x56207a154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f310b7fe700 0 client.19929 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 --2- 172.21.15.12:0/3560903120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56207a148140 0x56207a155250 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.350+0000 7f3145d0db80 1 -- 172.21.15.12:0/3560903120 >> 172.21.15.12:0/3560903120 conn(0x56207a0727e0 msgr2=0x56207a13f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f3145d0db80 1 -- 172.21.15.12:0/3560903120 shutdown_connections 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f3145d0db80 1 -- 172.21.15.12:0/3560903120 wait complete. 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f3145d0db80 20 client.19929 trim_cache size 0 max 16384 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stdout: "ca407570-a82e-45a4-bb6d-32e194ae60ea": { 2023-12-11T20:31:21.353 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:31:21.354 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "ca407570-a82e-45a4-bb6d-32e194ae60ea", 2023-12-11T20:31:21.354 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:31:21.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:31:21.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:31:21.354 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:31:21.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f31323ff700 1 -- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31140a1500 msgr2=0x7f31140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f31323ff700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31140a1500 0x7f31140a39c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3124097a40 tx=0x7f31240078e0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f31323ff700 1 -- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 msgr2=0x7f312c19e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f31323ff700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 0x7f312c19e980 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f3124007af0 tx=0x7f3124007870 comp rx=0 tx=0).stop 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f31323ff700 1 -- 172.21.15.12:0/1362317192 shutdown_connections 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f31323ff700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f31140a1500 0x7f31140a39c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f31323ff700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f312c1014b0 0x7f312c197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.351+0000 7f31323ff700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312c103040 0x7f312c19e980 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.352+0000 7f31323ff700 1 --2- 172.21.15.12:0/1362317192 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f312c1026a0 0x7f312c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.352+0000 7f31323ff700 1 -- 172.21.15.12:0/1362317192 >> 172.21.15.12:0/1362317192 conn(0x7f312c0fca00 msgr2=0x7f312c105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.352+0000 7f31323ff700 1 -- 172.21.15.12:0/1362317192 shutdown_connections 2023-12-11T20:31:21.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:21.352+0000 7f31323ff700 1 -- 172.21.15.12:0/1362317192 wait complete. 2023-12-11T20:31:21.370 INFO:tasks.cephfs.filesystem:scrub status for tag:ca407570-a82e-45a4-bb6d-32e194ae60ea - {'path': '/', 'tag': 'ca407570-a82e-45a4-bb6d-32e194ae60ea', 'options': 'recursive,force'} 2023-12-11T20:31:21.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:21 smithi032 ceph-mon[132488]: pgmap v837: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:21.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:21 smithi039 ceph-mon[102205]: pgmap v837: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:22 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:31:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:22 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:22 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:31:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:22 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:31:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:22 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:31:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:22 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:22 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:22 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:22 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:31:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:22 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:22 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:31:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:22 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:31:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:22 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:31:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:22 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:22 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:22 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:22 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:31:22.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:22 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:22 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:31:22.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:22 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:31:22.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:22 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:31:22.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:22 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:22 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:22.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:22 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:23 smithi012 ceph-mon[128787]: pgmap v838: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:31:23.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:23 smithi032 ceph-mon[132488]: pgmap v838: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:31:23.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:23 smithi039 ceph-mon[102205]: pgmap v838: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 -- 172.21.15.12:0/2880343800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 msgr2=0x7f2b700744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 --2- 172.21.15.12:0/2880343800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 0x7f2b700744b0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009990 tx=0x7f2b64009ca0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 -- 172.21.15.12:0/2880343800 shutdown_connections 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 --2- 172.21.15.12:0/2880343800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b701091d0 0x7f2b7010b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 --2- 172.21.15.12:0/2880343800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b70075610 0x7f2b70073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 --2- 172.21.15.12:0/2880343800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 0x7f2b700744b0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 -- 172.21.15.12:0/2880343800 >> 172.21.15.12:0/2880343800 conn(0x7f2b700fc8a0 msgr2=0x7f2b700fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 -- 172.21.15.12:0/2880343800 shutdown_connections 2023-12-11T20:31:24.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.246+0000 7f2b7539d700 1 -- 172.21.15.12:0/2880343800 wait complete. 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b7539d700 1 Processor -- start 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b7539d700 1 -- start start 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b7539d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 0x7f2b701993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b7539d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b70075610 0x7f2b70199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b7539d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b701091d0 0x7f2b701a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b7539d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701a0ef0 con 0x7f2b70074030 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b7539d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701a1030 con 0x7f2b70075610 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b7539d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701a11c0 con 0x7f2b701091d0 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b6ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 0x7f2b701993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b6ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 0x7f2b701993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40132/0 (socket says 172.21.15.12:40132) 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.248+0000 7f2b6ffff700 1 -- 172.21.15.12:0/1427063739 learned_addr learned my addr 172.21.15.12:0/1427063739 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b701091d0 0x7f2b701a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b70075610 0x7f2b70199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6ffff700 1 -- 172.21.15.12:0/1427063739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b701091d0 msgr2=0x7f2b701a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6ffff700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b701091d0 0x7f2b701a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6ffff700 1 -- 172.21.15.12:0/1427063739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b70075610 msgr2=0x7f2b70199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6ffff700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b70075610 0x7f2b70199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6ffff700 1 -- 172.21.15.12:0/1427063739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640095f0 con 0x7f2b70074030 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b70075610 0x7f2b70199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:24.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6ffff700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 0x7f2b701993c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000d950 tx=0x7f2b6000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6d7fa700 1 -- 172.21.15.12:0/1427063739 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60009940 con 0x7f2b70074030 2023-12-11T20:31:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6d7fa700 1 -- 172.21.15.12:0/1427063739 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b60010460 con 0x7f2b70074030 2023-12-11T20:31:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.249+0000 7f2b6d7fa700 1 -- 172.21.15.12:0/1427063739 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000f620 con 0x7f2b70074030 2023-12-11T20:31:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.250+0000 7f2b7539d700 1 -- 172.21.15.12:0/1427063739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b701a14a0 con 0x7f2b70074030 2023-12-11T20:31:24.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.250+0000 7f2b7539d700 1 -- 172.21.15.12:0/1427063739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b701a1960 con 0x7f2b70074030 2023-12-11T20:31:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.254+0000 7f2b6d7fa700 1 -- 172.21.15.12:0/1427063739 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2b600105d0 con 0x7f2b70074030 2023-12-11T20:31:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.254+0000 7f2b89ea1b80 1 Processor -- start 2023-12-11T20:31:24.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.254+0000 7f2b89ea1b80 1 -- start start 2023-12-11T20:31:24.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a1285770 0x5615a1285b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a12860d0 0x5615a128a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a128cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a11e0af0 con 0x5615a1285770 2023-12-11T20:31:24.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a11de410 con 0x5615a12860d0 2023-12-11T20:31:24.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a11d9d00 con 0x5615a128ab80 2023-12-11T20:31:24.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b74b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a1285770 0x5615a1285b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b74b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a1285770 0x5615a1285b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40146/0 (socket says 172.21.15.12:40146) 2023-12-11T20:31:24.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b74b9c700 1 -- 172.21.15.12:0/670710061 learned_addr learned my addr 172.21.15.12:0/670710061 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:24.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.255+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a128cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b6ffff700 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a12860d0 0x5615a128a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b74b9c700 1 -- 172.21.15.12:0/670710061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 msgr2=0x5615a128cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:24.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a128cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b74b9c700 1 -- 172.21.15.12:0/670710061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a12860d0 msgr2=0x5615a128a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a12860d0 0x5615a128a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b74b9c700 1 -- 172.21.15.12:0/670710061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615a10565d0 con 0x5615a1285770 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b6ffff700 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a12860d0 0x5615a128a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a128cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a1285770 0x5615a1285b90 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f2b68003f90 tx=0x7f2b68009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4a8909c5acd026 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b6d7fa700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b580a1470 0x7f2b580a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b567fc700 1 -- 172.21.15.12:0/670710061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68009e60 con 0x5615a1285770 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b6d7fa700 1 -- 172.21.15.12:0/1427063739 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2b600ccc10 con 0x7f2b70074030 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b567fc700 1 -- 172.21.15.12:0/670710061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b6800f040 con 0x5615a1285770 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b567fc700 1 -- 172.21.15.12:0/670710061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68015750 con 0x5615a1285770 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.256+0000 7f2b6ffff700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b580a1470 0x7f2b580a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/670710061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a1285770 msgr2=0x5615a1285b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b6ffff700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b580a1470 0x7f2b580a3930 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2b600968f0 tx=0x7f2b60000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a1285770 0x5615a1285b90 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f2b68003f90 tx=0x7f2b68009c20 comp rx=0 tx=0).stop 2023-12-11T20:31:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/670710061 shutdown_connections 2023-12-11T20:31:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a128cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a1285770 0x5615a1285b90 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/670710061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a12860d0 0x5615a128a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/670710061 >> 172.21.15.12:0/670710061 conn(0x5615a11b4780 msgr2=0x5615a1281b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/670710061 shutdown_connections 2023-12-11T20:31:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.257+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/670710061 wait complete. 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.258+0000 7f2b89ea1b80 1 -- start start 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.258+0000 7f2b89ea1b80 1 Processor -- start 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a12860d0 0x5615a128f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a128ab80 0x5615a1296420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a1193500 con 0x5615a128ab80 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a11931a0 con 0x5615a1285770 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a10588c0 con 0x5615a12860d0 2023-12-11T20:31:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b89ea1b80 10 client.0 _ll_register_callbacks cb 0x5615a10bea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a12860d0 0x5615a128f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a12860d0 0x5615a128f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:60250/0 (socket says 172.21.15.12:60250) 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/229596243 learned_addr learned my addr 172.21.15.12:0/229596243 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 msgr2=0x5615a128eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.259+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/229596243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a128ab80 msgr2=0x5615a1296420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a128ab80 0x5615a1296420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/229596243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b68003bf0 con 0x5615a12860d0 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a12860d0 0x5615a128f3e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b70075330 tx=0x7f2b64009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c9b3e0ad5a147d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:31:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/229596243 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640055d0 con 0x5615a12860d0 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/229596243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615a1278730 con 0x5615a12860d0 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.260+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/229596243 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2b64004500 con 0x5615a12860d0 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.261+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/229596243 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b640046c0 con 0x5615a12860d0 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.261+0000 7f2b89ea1b80 10 client.29476 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.261+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/229596243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5615a1002d80 con 0x5615a12860d0 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.261+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/229596243 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b64032020 con 0x5615a12860d0 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.261+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/229596243 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2b64003bf0 con 0x5615a12860d0 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.261+0000 7f2b89ea1b80 10 client.29476 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.261+0000 7f2b89ea1b80 10 client.29476 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.261+0000 7f2b89ea1b80 20 client.29476 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.262+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5615a129ac70 0x5615a129d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.262+0000 7f2b89ea1b80 4 client.29476 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.262+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/229596243 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615a1254ee0 con 0x5615a129ac70 2023-12-11T20:31:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.262+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5615a129ac70 0x5615a129d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.263+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5615a129ac70 0x5615a129d090 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3a2a3ca26d7826f server_cookie=be659e4e0964beaf in_seq=0 out_seq=0 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.263+0000 7f2b4f7fe700 10 client.29476 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.263+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/229596243 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5615a1254ee0 con 0x5615a129ac70 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.263+0000 7f2b4f7fe700 10 client.29476 handle_command_reply: tid=0 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.263+0000 7f2b89ea1b80 1 client.29476 shutdown 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/229596243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a12860d0 msgr2=0x5615a128f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a12860d0 0x5615a128f3e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b70075330 tx=0x7f2b64009ee0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/229596243 shutdown_connections 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5615a129ac70 0x5615a129d090 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a128ab80 0x5615a1296420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b4f7fe700 0 client.29476 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/229596243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a12860d0 0x5615a128f3e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/229596243 >> 172.21.15.12:0/229596243 conn(0x5615a11b4780 msgr2=0x5615a1282560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/229596243 shutdown_connections 2023-12-11T20:31:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/229596243 wait complete. 2023-12-11T20:31:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.264+0000 7f2b89ea1b80 20 client.29476 trim_cache size 0 max 16384 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b89ea1b80 1 Processor -- start 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b89ea1b80 1 -- start start 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a12963e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a12a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a1290090 con 0x5615a12860d0 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a127c3d0 con 0x5615a1285770 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a127af30 con 0x5615a128ab80 2023-12-11T20:31:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a12963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a12963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40164/0 (socket says 172.21.15.12:40164) 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.282+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/3410868963 learned_addr learned my addr 172.21.15.12:0/3410868963 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a12a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/3410868963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 msgr2=0x5615a12a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a12a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/3410868963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 msgr2=0x5615a128db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/3410868963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615a0febc00 con 0x5615a12860d0 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a12a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a12963e0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f2b64003f80 tx=0x7f2b64009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5238c0054eabad07 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b56ffd700 1 -- 172.21.15.12:0/3410868963 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64005000 con 0x5615a12860d0 2023-12-11T20:31:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b56ffd700 1 -- 172.21.15.12:0/3410868963 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b64032070 con 0x5615a12860d0 2023-12-11T20:31:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.283+0000 7f2b56ffd700 1 -- 172.21.15.12:0/3410868963 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400f850 con 0x5615a12860d0 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3410868963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 msgr2=0x5615a12963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a12963e0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f2b64003f80 tx=0x7f2b64009ca0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3410868963 shutdown_connections 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a1285770 0x5615a128db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a128ab80 0x5615a12a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3410868963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a12963e0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3410868963 >> 172.21.15.12:0/3410868963 conn(0x5615a11b4780 msgr2=0x5615a128e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3410868963 shutdown_connections 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.284+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3410868963 wait complete. 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.285+0000 7f2b89ea1b80 1 -- start start 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.285+0000 7f2b89ea1b80 1 Processor -- start 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a1285770 0x5615a1293d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a1294260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b89ea1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a128ab80 0x5615a1295220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a1295760 con 0x5615a12860d0 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a12958d0 con 0x5615a128ab80 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b89ea1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615a1295a90 con 0x5615a1285770 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b89ea1b80 10 client.0 _ll_register_callbacks cb 0x5615a10bea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a1294260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a1294260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40170/0 (socket says 172.21.15.12:40170) 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b74b9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a1285770 0x5615a1293d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/3190812608 learned_addr learned my addr 172.21.15.12:0/3190812608 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a128ab80 0x5615a1295220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/3190812608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a1285770 msgr2=0x5615a1293d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a1285770 0x5615a1293d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/3190812608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a128ab80 msgr2=0x5615a1295220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a128ab80 0x5615a1295220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.286+0000 7f2b6f7fe700 1 -- 172.21.15.12:0/3190812608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5615a1002d80 con 0x5615a12860d0 2023-12-11T20:31:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.287+0000 7f2b6f7fe700 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a1294260 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f2b64004020 tx=0x7f2b64003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16958be88dd2c386 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.287+0000 7f2b4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.287+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/3190812608 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400f5f0 con 0x5615a12860d0 2023-12-11T20:31:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.287+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3190812608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b6800f040 con 0x5615a12860d0 2023-12-11T20:31:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.287+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/3190812608 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2b64000e40 con 0x5615a12860d0 2023-12-11T20:31:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.287+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/3190812608 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b6400f750 con 0x5615a12860d0 2023-12-11T20:31:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.287+0000 7f2b89ea1b80 10 client.19944 fetch_fsmap learned FSMap version 33 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.287+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3190812608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5615a10291f0 con 0x5615a12860d0 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.288+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/3190812608 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b64050080 con 0x5615a12860d0 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.288+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/3190812608 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2b64035070 con 0x5615a12860d0 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.288+0000 7f2b89ea1b80 10 client.19944 fetch_fsmap finished waiting for FSMap version 33 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.288+0000 7f2b89ea1b80 10 client.19944 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.288+0000 7f2b89ea1b80 20 client.19944 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.288+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5615a12f1810 0x5615a12f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.288+0000 7f2b89ea1b80 4 client.19944 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.288+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3190812608 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5615a119ff70 con 0x5615a12f1810 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.289+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5615a12f1810 0x5615a12f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.289+0000 7f2b74b9c700 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5615a12f1810 0x5615a12f3c30 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96238d6b17a7077a server_cookie=97598f0c941925e7 in_seq=0 out_seq=0 2023-12-11T20:31:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.289+0000 7f2b4f7fe700 10 client.19944 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b4f7fe700 1 -- 172.21.15.12:0/3190812608 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5615a119ff70 con 0x5615a12f1810 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b4f7fe700 10 client.19944 handle_command_reply: tid=0 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 client.19944 shutdown 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3190812608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 msgr2=0x5615a1294260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a1294260 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f2b64004020 tx=0x7f2b64003e60 comp rx=0 tx=0).stop 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3190812608 shutdown_connections 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5615a12f1810 0x5615a12f3c30 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5615a128ab80 0x5615a1295220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5615a1285770 0x5615a1293d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 --2- 172.21.15.12:0/3190812608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615a12860d0 0x5615a1294260 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b4f7fe700 0 client.19944 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.299+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3190812608 >> 172.21.15.12:0/3190812608 conn(0x5615a11b4780 msgr2=0x5615a12a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.300+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3190812608 shutdown_connections 2023-12-11T20:31:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.300+0000 7f2b89ea1b80 1 -- 172.21.15.12:0/3190812608 wait complete. 2023-12-11T20:31:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.300+0000 7f2b89ea1b80 20 client.19944 trim_cache size 0 max 16384 2023-12-11T20:31:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:31:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:31:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:31:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.300+0000 7f2b7539d700 1 -- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b580a1470 msgr2=0x7f2b580a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.300+0000 7f2b7539d700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b580a1470 0x7f2b580a3930 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2b600968f0 tx=0x7f2b60000bc0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.300+0000 7f2b7539d700 1 -- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 msgr2=0x7f2b701993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.300+0000 7f2b7539d700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 0x7f2b701993c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000d950 tx=0x7f2b6000dc60 comp rx=0 tx=0).stop 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.301+0000 7f2b7539d700 1 -- 172.21.15.12:0/1427063739 shutdown_connections 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.301+0000 7f2b7539d700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2b580a1470 0x7f2b580a3930 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.301+0000 7f2b7539d700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2b701091d0 0x7f2b701a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.301+0000 7f2b7539d700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b70074030 0x7f2b701993c0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.301+0000 7f2b7539d700 1 --2- 172.21.15.12:0/1427063739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b70075610 0x7f2b70199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.301+0000 7f2b7539d700 1 -- 172.21.15.12:0/1427063739 >> 172.21.15.12:0/1427063739 conn(0x7f2b700fc8a0 msgr2=0x7f2b701050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.301+0000 7f2b7539d700 1 -- 172.21.15.12:0/1427063739 shutdown_connections 2023-12-11T20:31:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:24.301+0000 7f2b7539d700 1 -- 172.21.15.12:0/1427063739 wait complete. 2023-12-11T20:31:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:25 smithi012 ceph-mon[128787]: pgmap v839: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 23 op/s 2023-12-11T20:31:25.465 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:25 smithi032 ceph-mon[132488]: pgmap v839: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 23 op/s 2023-12-11T20:31:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:25 smithi039 ceph-mon[102205]: pgmap v839: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 23 op/s 2023-12-11T20:31:27.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:27 smithi012 ceph-mon[128787]: pgmap v840: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 30 op/s 2023-12-11T20:31:27.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:27 smithi032 ceph-mon[132488]: pgmap v840: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 30 op/s 2023-12-11T20:31:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:27 smithi039 ceph-mon[102205]: pgmap v840: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 MiB/s wr, 30 op/s 2023-12-11T20:31:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:29 smithi012 ceph-mon[128787]: pgmap v841: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:31:29.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:29 smithi032 ceph-mon[132488]: pgmap v841: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:31:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:29 smithi039 ceph-mon[102205]: pgmap v841: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 33 op/s 2023-12-11T20:31:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:31 smithi012 ceph-mon[128787]: pgmap v842: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:31.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:31 smithi032 ceph-mon[132488]: pgmap v842: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:31.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:31 smithi039 ceph-mon[102205]: pgmap v842: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:32 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:31:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:32 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:31:32.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:32 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:31:32.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:32 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:31:32.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:32 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:31:32.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:32 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:31:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:32 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:31:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:32 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:31:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:32 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:31:33.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:33 smithi032 ceph-mon[132488]: pgmap v843: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:31:33.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:33 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:31:33.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:33 smithi039 ceph-mon[102205]: pgmap v843: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:31:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:33 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:31:33.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:33 smithi012 ceph-mon[128787]: pgmap v843: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 32 op/s 2023-12-11T20:31:33.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:33 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:31:35.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:35 smithi032 ceph-mon[132488]: pgmap v844: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:35.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:35 smithi039 ceph-mon[102205]: pgmap v844: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:35 smithi012 ceph-mon[128787]: pgmap v844: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 34 op/s 2023-12-11T20:31:37.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:37 smithi032 ceph-mon[132488]: pgmap v845: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 26 op/s 2023-12-11T20:31:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:37 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:31:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 -- 172.21.15.12:0/2350954183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8301048d0 msgr2=0x7fc830106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 --2- 172.21.15.12:0/2350954183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8301048d0 0x7fc830106cc0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009990 tx=0x7fc81c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 -- 172.21.15.12:0/2350954183 shutdown_connections 2023-12-11T20:31:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 --2- 172.21.15.12:0/2350954183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc830107200 0x7fc830109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 --2- 172.21.15.12:0/2350954183 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc830101fa0 0x7fc830104390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 --2- 172.21.15.12:0/2350954183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8301048d0 0x7fc830106cc0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 -- 172.21.15.12:0/2350954183 >> 172.21.15.12:0/2350954183 conn(0x7fc8300fb930 msgr2=0x7fc8300fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 -- 172.21.15.12:0/2350954183 shutdown_connections 2023-12-11T20:31:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.482+0000 7fc836bff700 1 -- 172.21.15.12:0/2350954183 wait complete. 2023-12-11T20:31:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.484+0000 7fc836bff700 1 Processor -- start 2023-12-11T20:31:37.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.484+0000 7fc836bff700 1 -- start start 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.484+0000 7fc836bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc830101fa0 0x7fc830199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.484+0000 7fc836bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8301048d0 0x7fc830199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.484+0000 7fc836bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc830107200 0x7fc8301a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.484+0000 7fc836bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301a1080 con 0x7fc830107200 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.484+0000 7fc836bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301a11c0 con 0x7fc8301048d0 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.484+0000 7fc836bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301a1350 con 0x7fc830101fa0 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8301048d0 0x7fc830199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc83499b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc830101fa0 0x7fc830199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8301048d0 0x7fc830199a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37414/0 (socket says 172.21.15.12:37414) 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 -- 172.21.15.12:0/3500661767 learned_addr learned my addr 172.21.15.12:0/3500661767 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc83519c700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc830107200 0x7fc8301a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 -- 172.21.15.12:0/3500661767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc830101fa0 msgr2=0x7fc830199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc830101fa0 0x7fc830199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 -- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc830107200 msgr2=0x7fc8301a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc830107200 0x7fc8301a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 -- 172.21.15.12:0/3500661767 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0095f0 con 0x7fc8301048d0 2023-12-11T20:31:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.485+0000 7fc82ffff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8301048d0 0x7fc830199a90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc81c003ec0 tx=0x7fc81c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.486+0000 7fc82dffb700 1 -- 172.21.15.12:0/3500661767 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c01d070 con 0x7fc8301048d0 2023-12-11T20:31:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.486+0000 7fc82dffb700 1 -- 172.21.15.12:0/3500661767 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc81c00bdb0 con 0x7fc8301048d0 2023-12-11T20:31:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.486+0000 7fc836bff700 1 -- 172.21.15.12:0/3500661767 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8301a15d0 con 0x7fc8301048d0 2023-12-11T20:31:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.486+0000 7fc82dffb700 1 -- 172.21.15.12:0/3500661767 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c021410 con 0x7fc8301048d0 2023-12-11T20:31:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.486+0000 7fc836bff700 1 -- 172.21.15.12:0/3500661767 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8301a19f0 con 0x7fc8301048d0 2023-12-11T20:31:37.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.489+0000 7fc82dffb700 1 -- 172.21.15.12:0/3500661767 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc81c00f660 con 0x7fc8301048d0 2023-12-11T20:31:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.492+0000 7fc82dffb700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8200a1470 0x7fc8200a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.492+0000 7fc82dffb700 1 -- 172.21.15.12:0/3500661767 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc81c0ce0d0 con 0x7fc8301048d0 2023-12-11T20:31:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.492+0000 7fc83499b700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8200a1470 0x7fc8200a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc84a5edb80 1 Processor -- start 2023-12-11T20:31:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc83499b700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8200a1470 0x7fc8200a3930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc824009c60 tx=0x7fc824009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc84a5edb80 1 -- start start 2023-12-11T20:31:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e1d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1d830 0x560e39e1e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e1eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39d78af0 con 0x560e39e1e720 2023-12-11T20:31:37.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39d76410 con 0x560e39e1d830 2023-12-11T20:31:37.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.493+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39d71d00 con 0x560e39e1ced0 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83499b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e1d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83499b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e1d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53940/0 (socket says 172.21.15.12:53940) 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83499b700 1 -- 172.21.15.12:0/1886246141 learned_addr learned my addr 172.21.15.12:0/1886246141 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc82ffff700 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1d830 0x560e39e1e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83519c700 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e1eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83499b700 1 -- 172.21.15.12:0/1886246141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1d830 msgr2=0x560e39e1e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83499b700 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1d830 0x560e39e1e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83499b700 1 -- 172.21.15.12:0/1886246141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 msgr2=0x560e39e1eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83499b700 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e1eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83499b700 1 -- 172.21.15.12:0/1886246141 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e39bee5d0 con 0x560e39e1ced0 2023-12-11T20:31:37.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.494+0000 7fc83519c700 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e1eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:37.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.495+0000 7fc83499b700 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e1d2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc82400e4e0 tx=0x7fc824014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edfb94a107cb1fc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:37.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.495+0000 7fc81affd700 1 -- 172.21.15.12:0/1886246141 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82400ee00 con 0x560e39e1ced0 2023-12-11T20:31:37.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.495+0000 7fc81affd700 1 -- 172.21.15.12:0/1886246141 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc824021070 con 0x560e39e1ced0 2023-12-11T20:31:37.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.495+0000 7fc81affd700 1 -- 172.21.15.12:0/1886246141 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82401d720 con 0x560e39e1ced0 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1886246141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 msgr2=0x560e39e1d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e1d2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc82400e4e0 tx=0x7fc824014000 comp rx=0 tx=0).stop 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1886246141 shutdown_connections 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e1eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e1d2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1886246141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1d830 0x560e39e1e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1886246141 >> 172.21.15.12:0/1886246141 conn(0x560e39d4c780 msgr2=0x560e39e19880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1886246141 shutdown_connections 2023-12-11T20:31:37.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.496+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1886246141 wait complete. 2023-12-11T20:31:37.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.497+0000 7fc84a5edb80 1 -- start start 2023-12-11T20:31:37.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.497+0000 7fc84a5edb80 1 Processor -- start 2023-12-11T20:31:37.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e26ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1d830 0x560e39e27420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e2e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39d2b500 con 0x560e39e1e720 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39d2b1a0 con 0x560e39e1ced0 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39bf08c0 con 0x560e39e1d830 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc84a5edb80 10 client.0 _ll_register_callbacks cb 0x560e39c56a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc83499b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e26ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc83519c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e2e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc83499b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e26ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37434/0 (socket says 172.21.15.12:37434) 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc83499b700 1 -- 172.21.15.12:0/1665079891 learned_addr learned my addr 172.21.15.12:0/1665079891 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc82ffff700 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1d830 0x560e39e27420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc83499b700 1 -- 172.21.15.12:0/1665079891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1d830 msgr2=0x560e39e27420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.498+0000 7fc83499b700 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1d830 0x560e39e27420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc83499b700 1 -- 172.21.15.12:0/1665079891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 msgr2=0x560e39e2e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:37.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc83499b700 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e2e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc83499b700 1 -- 172.21.15.12:0/1665079891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc824017070 con 0x560e39e1ced0 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc83519c700 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e2e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc83499b700 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e26ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc82400ee60 tx=0x7fc82400ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f24b223a7c60722 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc80ffff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc80ffff700 1 -- 172.21.15.12:0/1665079891 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824005400 con 0x560e39e1ced0 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1665079891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e39e10730 con 0x560e39e1ced0 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.499+0000 7fc80ffff700 1 -- 172.21.15.12:0/1665079891 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc824005560 con 0x560e39e1ced0 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc80ffff700 1 -- 172.21.15.12:0/1665079891 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc824003680 con 0x560e39e1ced0 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc84a5edb80 10 client.29492 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1665079891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560e39b9ad80 con 0x560e39e1ced0 2023-12-11T20:31:37.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc80ffff700 1 -- 172.21.15.12:0/1665079891 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc82403d080 con 0x560e39e1ced0 2023-12-11T20:31:37.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc80ffff700 1 -- 172.21.15.12:0/1665079891 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc82401c970 con 0x560e39e1ced0 2023-12-11T20:31:37.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc84a5edb80 10 client.29492 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:37.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc84a5edb80 10 client.29492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:37.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc84a5edb80 20 client.29492 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:37.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e39e32c20 0x560e39e35040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc84a5edb80 4 client.29492 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:37.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.500+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1665079891 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e39decee0 con 0x560e39e32c20 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.501+0000 7fc82ffff700 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e39e32c20 0x560e39e35040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.501+0000 7fc80ffff700 10 client.29492 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.501+0000 7fc82ffff700 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e39e32c20 0x560e39e35040 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e6cfd63912cd25d server_cookie=edd55e40eeec47e2 in_seq=0 out_seq=0 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc80ffff700 1 -- 172.21.15.12:0/1665079891 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560e39decee0 con 0x560e39e32c20 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc80ffff700 10 client.29492 handle_command_reply: tid=0 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 client.29492 shutdown 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1665079891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 msgr2=0x560e39e26ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e26ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc82400ee60 tx=0x7fc82400ee90 comp rx=0 tx=0).stop 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1665079891 shutdown_connections 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e39e32c20 0x560e39e35040 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e26ee0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1e720 0x560e39e2e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc80ffff700 0 client.29492 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/1665079891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1d830 0x560e39e27420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.502+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1665079891 >> 172.21.15.12:0/1665079891 conn(0x560e39d4c780 msgr2=0x560e39e17ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.503+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1665079891 shutdown_connections 2023-12-11T20:31:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.503+0000 7fc84a5edb80 1 -- 172.21.15.12:0/1665079891 wait complete. 2023-12-11T20:31:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.503+0000 7fc84a5edb80 20 client.29492 trim_cache size 0 max 16384 2023-12-11T20:31:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.531+0000 7fc84a5edb80 1 Processor -- start 2023-12-11T20:31:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.531+0000 7fc84a5edb80 1 -- start start 2023-12-11T20:31:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1e720 0x560e39e1eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39e1df30 con 0x560e39e1d830 2023-12-11T20:31:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39e24920 con 0x560e39e1e720 2023-12-11T20:31:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39e329c0 con 0x560e39e1ced0 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc82ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc82ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43712/0 (socket says 172.21.15.12:43712) 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc82ffff700 1 -- 172.21.15.12:0/4216525283 learned_addr learned my addr 172.21.15.12:0/4216525283 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc83499b700 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.532+0000 7fc83519c700 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1e720 0x560e39e1eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc82ffff700 1 -- 172.21.15.12:0/4216525283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 msgr2=0x560e39e261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc82ffff700 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc82ffff700 1 -- 172.21.15.12:0/4216525283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1e720 msgr2=0x560e39e1eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc82ffff700 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1e720 0x560e39e1eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc82ffff700 1 -- 172.21.15.12:0/4216525283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e39b83c00 con 0x560e39e1d830 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc83519c700 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1e720 0x560e39e1eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc82ffff700 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2e210 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00bfd0 tx=0x7fc81c0cb9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ffb9996fe848b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc81b7fe700 1 -- 172.21.15.12:0/4216525283 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0b2050 con 0x560e39e1d830 2023-12-11T20:31:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc81b7fe700 1 -- 172.21.15.12:0/4216525283 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc81c09b3d0 con 0x560e39e1d830 2023-12-11T20:31:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.533+0000 7fc81b7fe700 1 -- 172.21.15.12:0/4216525283 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0cbc30 con 0x560e39e1d830 2023-12-11T20:31:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4216525283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 msgr2=0x560e39e2e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2e210 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00bfd0 tx=0x7fc81c0cb9f0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4216525283 shutdown_connections 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1e720 0x560e39e1eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1ced0 0x560e39e261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4216525283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2e210 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4216525283 >> 172.21.15.12:0/4216525283 conn(0x560e39d4c780 msgr2=0x560e39e399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4216525283 shutdown_connections 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.534+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4216525283 wait complete. 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.535+0000 7fc84a5edb80 1 -- start start 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.535+0000 7fc84a5edb80 1 Processor -- start 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e2bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc84a5edb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1e720 0x560e39e2d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39e2d540 con 0x560e39e1d830 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39e2d6b0 con 0x560e39e1ced0 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc84a5edb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39e2d870 con 0x560e39e1e720 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc84a5edb80 10 client.0 _ll_register_callbacks cb 0x560e39c56a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc82ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc83519c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1e720 0x560e39e2d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc82ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43714/0 (socket says 172.21.15.12:43714) 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc83499b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e2bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc82ffff700 1 -- 172.21.15.12:0/4112503145 learned_addr learned my addr 172.21.15.12:0/4112503145 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc82ffff700 1 -- 172.21.15.12:0/4112503145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1e720 msgr2=0x560e39e2d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc82ffff700 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1e720 0x560e39e2d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc82ffff700 1 -- 172.21.15.12:0/4112503145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 msgr2=0x560e39e2bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc82ffff700 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e2bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.536+0000 7fc82ffff700 1 -- 172.21.15.12:0/4112503145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8301a19f0 con 0x560e39e1d830 2023-12-11T20:31:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc83499b700 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e2bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc82ffff700 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2c090 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fc81c003f60 tx=0x7fc81c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b49ac1d166143dc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:37.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc80ffff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc80ffff700 1 -- 172.21.15.12:0/4112503145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c099770 con 0x560e39e1d830 2023-12-11T20:31:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4112503145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc824021070 con 0x560e39e1d830 2023-12-11T20:31:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc80ffff700 1 -- 172.21.15.12:0/4112503145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc81c09b630 con 0x560e39e1d830 2023-12-11T20:31:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc80ffff700 1 -- 172.21.15.12:0/4112503145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc81c09b7f0 con 0x560e39e1d830 2023-12-11T20:31:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc84a5edb80 10 client.19962 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.537+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4112503145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560e39bc11f0 con 0x560e39e1d830 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc80ffff700 1 -- 172.21.15.12:0/4112503145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc824021070 con 0x560e39e1d830 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc80ffff700 1 -- 172.21.15.12:0/4112503145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc81c0a12d0 con 0x560e39e1d830 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc84a5edb80 10 client.19962 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc84a5edb80 10 client.19962 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc84a5edb80 20 client.19962 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e39e89770 0x560e39e8bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc84a5edb80 4 client.19962 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4112503145 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560e39d37f70 con 0x560e39e89770 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.538+0000 7fc83499b700 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e39e89770 0x560e39e8bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.539+0000 7fc80ffff700 10 client.19962 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.539+0000 7fc83499b700 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e39e89770 0x560e39e8bb90 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c99165662aede0bb server_cookie=7d4f16abb1785a80 in_seq=0 out_seq=0 2023-12-11T20:31:37.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc80ffff700 1 -- 172.21.15.12:0/4112503145 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560e39d37f70 con 0x560e39e89770 2023-12-11T20:31:37.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc80ffff700 10 client.19962 handle_command_reply: tid=0 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 client.19962 shutdown 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4112503145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 msgr2=0x560e39e2c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2c090 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fc81c003f60 tx=0x7fc81c005c30 comp rx=0 tx=0).stop 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4112503145 shutdown_connections 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560e39e89770 0x560e39e8bb90 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560e39e1ced0 0x560e39e2bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560e39e1e720 0x560e39e2d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 --2- 172.21.15.12:0/4112503145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e39e1d830 0x560e39e2c090 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4112503145 >> 172.21.15.12:0/4112503145 conn(0x560e39d4c780 msgr2=0x560e39e19460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc80ffff700 0 client.19962 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4112503145 shutdown_connections 2023-12-11T20:31:37.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.547+0000 7fc84a5edb80 1 -- 172.21.15.12:0/4112503145 wait complete. 2023-12-11T20:31:37.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc84a5edb80 20 client.19962 trim_cache size 0 max 16384 2023-12-11T20:31:37.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:31:37.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:31:37.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:31:37.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 -- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8200a1470 msgr2=0x7fc8200a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8200a1470 0x7fc8200a3930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc824009c60 tx=0x7fc824009260 comp rx=0 tx=0).stop 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 -- 172.21.15.12:0/3500661767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8301048d0 msgr2=0x7fc830199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8301048d0 0x7fc830199a90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc81c003ec0 tx=0x7fc81c005740 comp rx=0 tx=0).stop 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 -- 172.21.15.12:0/3500661767 shutdown_connections 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc8200a1470 0x7fc8200a3930 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc830107200 0x7fc8301a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc830101fa0 0x7fc830199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 --2- 172.21.15.12:0/3500661767 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8301048d0 0x7fc830199a90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:37.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 -- 172.21.15.12:0/3500661767 >> 172.21.15.12:0/3500661767 conn(0x7fc8300fb930 msgr2=0x7fc830101890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:37.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 -- 172.21.15.12:0/3500661767 shutdown_connections 2023-12-11T20:31:37.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:37.548+0000 7fc836bff700 1 -- 172.21.15.12:0/3500661767 wait complete. 2023-12-11T20:31:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:37 smithi039 ceph-mon[102205]: pgmap v845: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 26 op/s 2023-12-11T20:31:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:37 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:31:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:37 smithi012 ceph-mon[128787]: pgmap v845: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 26 op/s 2023-12-11T20:31:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:37 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:31:39.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:39 smithi032 ceph-mon[132488]: pgmap v846: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 18 op/s 2023-12-11T20:31:39.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:31:39.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:31:39.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:31:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:39 smithi039 ceph-mon[102205]: pgmap v846: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 18 op/s 2023-12-11T20:31:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:31:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:31:39.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:31:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:39 smithi012 ceph-mon[128787]: pgmap v846: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 18 op/s 2023-12-11T20:31:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:31:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:31:39.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:31:41.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:41 smithi032 ceph-mon[132488]: pgmap v847: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:41 smithi039 ceph-mon[102205]: pgmap v847: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:41 smithi012 ceph-mon[128787]: pgmap v847: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:43.464 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:43 smithi032 ceph-mon[132488]: pgmap v848: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:31:43.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:43 smithi039 ceph-mon[102205]: pgmap v848: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:31:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:43 smithi012 ceph-mon[128787]: pgmap v848: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 14 MiB/s wr, 12 op/s 2023-12-11T20:31:45.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:45 smithi032 ceph-mon[132488]: pgmap v849: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:31:45.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:45 smithi039 ceph-mon[102205]: pgmap v849: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:31:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:45 smithi012 ceph-mon[128787]: pgmap v849: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 13 MiB/s wr, 14 op/s 2023-12-11T20:31:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:47 smithi032 ceph-mon[132488]: pgmap v850: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:47.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:47 smithi039 ceph-mon[102205]: pgmap v850: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:47 smithi012 ceph-mon[128787]: pgmap v850: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:49.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:49 smithi032 ceph-mon[132488]: pgmap v851: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:49.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:49 smithi039 ceph-mon[102205]: pgmap v851: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:49 smithi012 ceph-mon[128787]: pgmap v851: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/2157249950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64103080 msgr2=0x7f3b64109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/2157249950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64103080 0x7f3b64109930 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b0d0 tx=0x7f3b5c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/2157249950 shutdown_connections 2023-12-11T20:31:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/2157249950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64103080 0x7f3b64109930 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/2157249950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b641014f0 0x7f3b64101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/2157249950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b641026e0 0x7f3b64102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/2157249950 >> 172.21.15.12:0/2157249950 conn(0x7f3b640fca60 msgr2=0x7f3b640feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/2157249950 shutdown_connections 2023-12-11T20:31:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.738+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/2157249950 wait complete. 2023-12-11T20:31:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.739+0000 7f3b6a3ff700 1 Processor -- start 2023-12-11T20:31:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.739+0000 7f3b6a3ff700 1 -- start start 2023-12-11T20:31:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b6a3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b641014f0 0x7f3b64075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b6a3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641026e0 0x7f3b640739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b6a3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b64103080 0x7f3b64073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b6a3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b640746a0 con 0x7f3b641026e0 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b6a3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64074810 con 0x7f3b641014f0 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b6a3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641a1480 con 0x7f3b64103080 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641026e0 0x7f3b640739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641026e0 0x7f3b640739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38942/0 (socket says 172.21.15.12:38942) 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b637fe700 1 -- 172.21.15.12:0/409932057 learned_addr learned my addr 172.21.15.12:0/409932057 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b63fff700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b641014f0 0x7f3b64075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b6899c700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b64103080 0x7f3b64073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b637fe700 1 -- 172.21.15.12:0/409932057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b64103080 msgr2=0x7f3b64073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b637fe700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b64103080 0x7f3b64073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b637fe700 1 -- 172.21.15.12:0/409932057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b641014f0 msgr2=0x7f3b64075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b637fe700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b641014f0 0x7f3b64075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.740+0000 7f3b637fe700 1 -- 172.21.15.12:0/409932057 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c009d00 con 0x7f3b641026e0 2023-12-11T20:31:50.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.741+0000 7f3b637fe700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641026e0 0x7f3b640739c0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800d980 tx=0x7f3b5800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:50.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.741+0000 7f3b617fa700 1 -- 172.21.15.12:0/409932057 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58004220 con 0x7f3b641026e0 2023-12-11T20:31:50.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.741+0000 7f3b617fa700 1 -- 172.21.15.12:0/409932057 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b58007640 con 0x7f3b641026e0 2023-12-11T20:31:50.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.741+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/409932057 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b641a1710 con 0x7f3b641026e0 2023-12-11T20:31:50.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.741+0000 7f3b617fa700 1 -- 172.21.15.12:0/409932057 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58005660 con 0x7f3b641026e0 2023-12-11T20:31:50.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.741+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/409932057 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b641a1c20 con 0x7f3b641026e0 2023-12-11T20:31:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.746+0000 7f3b617fa700 1 -- 172.21.15.12:0/409932057 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3b58004750 con 0x7f3b641026e0 2023-12-11T20:31:50.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.747+0000 7f3b7dce8b80 1 Processor -- start 2023-12-11T20:31:50.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.747+0000 7f3b7dce8b80 1 -- start start 2023-12-11T20:31:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.747+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 0x55e02a5df2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.747+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.747+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5e0720 0x55e02a5e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.747+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a53aaf0 con 0x55e02a5e0720 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.747+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a538410 con 0x55e02a5df830 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.747+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a533d00 con 0x55e02a5deed0 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b617fa700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b4c0a1470 0x7f3b4c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5e0720 0x55e02a5e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5e0720 0x55e02a5e0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38952/0 (socket says 172.21.15.12:38952) 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b63fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b637fe700 1 -- 172.21.15.12:0/1053512694 learned_addr learned my addr 172.21.15.12:0/1053512694 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b6899c700 1 --2- 172.21.15.12:0/1053512694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 0x55e02a5df2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b617fa700 1 -- 172.21.15.12:0/409932057 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b580cca50 con 0x7f3b641026e0 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b63fff700 1 -- 172.21.15.12:0/1053512694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 msgr2=0x55e02a5df2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b6899c700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b4c0a1470 0x7f3b4c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b63fff700 1 --2- 172.21.15.12:0/1053512694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 0x55e02a5df2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b63fff700 1 -- 172.21.15.12:0/1053512694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5e0720 msgr2=0x55e02a5e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b63fff700 1 --2- 172.21.15.12:0/1053512694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5e0720 0x55e02a5e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.748+0000 7f3b63fff700 1 -- 172.21.15.12:0/1053512694 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e02a3b05d0 con 0x55e02a5df830 2023-12-11T20:31:50.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.749+0000 7f3b63fff700 1 --2- 172.21.15.12:0/1053512694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e0140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009c80 tx=0x7f3b54009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0f3b8e15e129efa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.749+0000 7f3b6899c700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b4c0a1470 0x7f3b4c0a3930 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009cd0 tx=0x7f3b5c0099e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.749+0000 7f3b4a7fc700 1 -- 172.21.15.12:0/1053512694 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54011cb0 con 0x55e02a5df830 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.749+0000 7f3b4a7fc700 1 -- 172.21.15.12:0/1053512694 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b54011e10 con 0x55e02a5df830 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.749+0000 7f3b4a7fc700 1 -- 172.21.15.12:0/1053512694 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54005020 con 0x55e02a5df830 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/1053512694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 msgr2=0x55e02a5e0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/1053512694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e0140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009c80 tx=0x7f3b54009f90 comp rx=0 tx=0).stop 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/1053512694 shutdown_connections 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/1053512694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5e0720 0x55e02a5e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/1053512694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 0x55e02a5df2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/1053512694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e0140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/1053512694 >> 172.21.15.12:0/1053512694 conn(0x55e02a50e780 msgr2=0x55e02a5db880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/1053512694 shutdown_connections 2023-12-11T20:31:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.750+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/1053512694 wait complete. 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.751+0000 7f3b7dce8b80 1 -- start start 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.751+0000 7f3b7dce8b80 1 Processor -- start 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.751+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.751+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.751+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5e0720 0x55e02a5f0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.751+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a4ed500 con 0x55e02a5deed0 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.751+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a4ed1a0 con 0x55e02a5df830 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.751+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a3b28c0 con 0x55e02a5e0720 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b7dce8b80 10 client.0 _ll_register_callbacks cb 0x55e02a418a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b63fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b63fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5e8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38966/0 (socket says 172.21.15.12:38966) 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b63fff700 1 -- 172.21.15.12:0/2309010507 learned_addr learned my addr 172.21.15.12:0/2309010507 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b637fe700 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b6899c700 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5e0720 0x55e02a5f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b637fe700 1 -- 172.21.15.12:0/2309010507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5e0720 msgr2=0x55e02a5f0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b637fe700 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5e0720 0x55e02a5f0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b637fe700 1 -- 172.21.15.12:0/2309010507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 msgr2=0x55e02a5e8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b637fe700 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5e8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b637fe700 1 -- 172.21.15.12:0/2309010507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540098e0 con 0x55e02a5df830 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.752+0000 7f3b63fff700 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b637fe700 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e9360 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b580ca550 tx=0x7f3b58005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd5e181e63b878b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b437fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b437fe700 1 -- 172.21.15.12:0/2309010507 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58099410 con 0x55e02a5df830 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b437fe700 1 -- 172.21.15.12:0/2309010507 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b58004380 con 0x55e02a5df830 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2309010507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e02a5d2730 con 0x55e02a5df830 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b437fe700 1 -- 172.21.15.12:0/2309010507 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b58099680 con 0x55e02a5df830 2023-12-11T20:31:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b7dce8b80 10 client.29510 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2309010507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e02a35cd80 con 0x55e02a5df830 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.753+0000 7f3b437fe700 1 -- 172.21.15.12:0/2309010507 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e02a5d2730 con 0x55e02a5df830 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.754+0000 7f3b437fe700 1 -- 172.21.15.12:0/2309010507 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b580a1c20 con 0x55e02a5df830 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.754+0000 7f3b7dce8b80 10 client.29510 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.754+0000 7f3b7dce8b80 10 client.29510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.754+0000 7f3b7dce8b80 20 client.29510 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.754+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e02a5f4b30 0x55e02a5f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.754+0000 7f3b7dce8b80 4 client.29510 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.754+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2309010507 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e02a5aeee0 con 0x55e02a5f4b30 2023-12-11T20:31:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.754+0000 7f3b63fff700 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e02a5f4b30 0x55e02a5f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.755+0000 7f3b63fff700 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e02a5f4b30 0x55e02a5f6f50 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5809622c3ff48744 server_cookie=60b419341cf69078 in_seq=0 out_seq=0 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.755+0000 7f3b437fe700 10 client.29510 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.755+0000 7f3b437fe700 1 -- 172.21.15.12:0/2309010507 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e02a5aeee0 con 0x55e02a5f4b30 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.755+0000 7f3b437fe700 10 client.29510 handle_command_reply: tid=0 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 client.29510 shutdown 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 msgr2=0x55e02a5e9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e9360 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b580ca550 tx=0x7f3b58005880 comp rx=0 tx=0).stop 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2309010507 shutdown_connections 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e02a5f4b30 0x55e02a5f6f50 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5e0720 0x55e02a5f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b437fe700 0 client.29510 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:50.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2309010507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5df830 0x55e02a5e9360 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2309010507 >> 172.21.15.12:0/2309010507 conn(0x55e02a50e780 msgr2=0x55e02a5d9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2309010507 shutdown_connections 2023-12-11T20:31:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2309010507 wait complete. 2023-12-11T20:31:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.756+0000 7f3b7dce8b80 20 client.29510 trim_cache size 0 max 16384 2023-12-11T20:31:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.777+0000 7f3b7dce8b80 1 Processor -- start 2023-12-11T20:31:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.777+0000 7f3b7dce8b80 1 -- start start 2023-12-11T20:31:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.777+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.777+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5df830 0x55e02a5f0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.777+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 0x55e02a5e0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.777+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a5fc190 con 0x55e02a5deed0 2023-12-11T20:31:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.777+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a5e7bd0 con 0x55e02a5e0720 2023-12-11T20:31:50.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.777+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a5dff70 con 0x55e02a5df830 2023-12-11T20:31:50.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38968/0 (socket says 172.21.15.12:38968) 2023-12-11T20:31:50.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 -- 172.21.15.12:0/3922671078 learned_addr learned my addr 172.21.15.12:0/3922671078 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b6899c700 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 0x55e02a5e0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b637fe700 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5df830 0x55e02a5f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 -- 172.21.15.12:0/3922671078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5df830 msgr2=0x55e02a5f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5df830 0x55e02a5f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 -- 172.21.15.12:0/3922671078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 msgr2=0x55e02a5e0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 0x55e02a5e0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 -- 172.21.15.12:0/3922671078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e02a345c00 con 0x55e02a5deed0 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.778+0000 7f3b63fff700 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5f0a70 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f3b54004690 tx=0x7f3b54005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1f6242b05b0ede server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b4affd700 1 -- 172.21.15.12:0/3922671078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54011ab0 con 0x55e02a5deed0 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b4affd700 1 -- 172.21.15.12:0/3922671078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b54004bd0 con 0x55e02a5deed0 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b4affd700 1 -- 172.21.15.12:0/3922671078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54026830 con 0x55e02a5deed0 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/3922671078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 msgr2=0x55e02a5f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5f0a70 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f3b54004690 tx=0x7f3b54005dc0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/3922671078 shutdown_connections 2023-12-11T20:31:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 0x55e02a5e0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5deed0 0x55e02a5f0a70 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/3922671078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5df830 0x55e02a5f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/3922671078 >> 172.21.15.12:0/3922671078 conn(0x55e02a50e780 msgr2=0x55e02a5db460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.779+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/3922671078 shutdown_connections 2023-12-11T20:31:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.780+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/3922671078 wait complete. 2023-12-11T20:31:50.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.780+0000 7f3b7dce8b80 1 -- start start 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.780+0000 7f3b7dce8b80 1 Processor -- start 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 0x55e02a5edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5df830 0x55e02a5edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b7dce8b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 0x55e02a5eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a5ef4e0 con 0x55e02a5df830 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a5ef650 con 0x55e02a5e0720 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b7dce8b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e02a5ef810 con 0x55e02a5deed0 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b7dce8b80 10 client.0 _ll_register_callbacks cb 0x55e02a418a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5df830 0x55e02a5edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5df830 0x55e02a5edfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38972/0 (socket says 172.21.15.12:38972) 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b637fe700 1 -- 172.21.15.12:0/2531569275 learned_addr learned my addr 172.21.15.12:0/2531569275 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.781+0000 7f3b63fff700 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 0x55e02a5edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b6899c700 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 0x55e02a5eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b637fe700 1 -- 172.21.15.12:0/2531569275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 msgr2=0x55e02a5edaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b637fe700 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 0x55e02a5edaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b637fe700 1 -- 172.21.15.12:0/2531569275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 msgr2=0x55e02a5eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b637fe700 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 0x55e02a5eefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b637fe700 1 -- 172.21.15.12:0/2531569275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5401d040 con 0x55e02a5df830 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b637fe700 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5df830 0x55e02a5edfe0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f3b58099a20 tx=0x7f3b58096060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fb355926eab165 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b437fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b437fe700 1 -- 172.21.15.12:0/2531569275 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58065540 con 0x55e02a5df830 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b437fe700 1 -- 172.21.15.12:0/2531569275 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b58004380 con 0x55e02a5df830 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.782+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2531569275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b54011e10 con 0x55e02a5df830 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b437fe700 1 -- 172.21.15.12:0/2531569275 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b58099680 con 0x55e02a5df830 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b7dce8b80 10 client.19980 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2531569275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e02a3831f0 con 0x55e02a5df830 2023-12-11T20:31:50.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b437fe700 1 -- 172.21.15.12:0/2531569275 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b54011e10 con 0x55e02a5df830 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b437fe700 1 -- 172.21.15.12:0/2531569275 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b58065060 con 0x55e02a5df830 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b7dce8b80 10 client.19980 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b7dce8b80 10 client.19980 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b7dce8b80 20 client.19980 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e02a64b770 0x55e02a64db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b7dce8b80 4 client.19980 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.783+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2531569275 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e02a4f9f70 con 0x55e02a64b770 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.784+0000 7f3b63fff700 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e02a64b770 0x55e02a64db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.784+0000 7f3b63fff700 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e02a64b770 0x55e02a64db90 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a810c6d12a9924ff server_cookie=b8a154286cb5d7c8 in_seq=0 out_seq=0 2023-12-11T20:31:50.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.784+0000 7f3b437fe700 10 client.19980 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.794+0000 7f3b437fe700 1 -- 172.21.15.12:0/2531569275 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e02a4f9f70 con 0x55e02a64b770 2023-12-11T20:31:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.794+0000 7f3b437fe700 10 client.19980 handle_command_reply: tid=0 2023-12-11T20:31:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.794+0000 7f3b7dce8b80 1 client.19980 shutdown 2023-12-11T20:31:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.794+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2531569275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5df830 msgr2=0x55e02a5edfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.794+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5df830 0x55e02a5edfe0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f3b58099a20 tx=0x7f3b58096060 comp rx=0 tx=0).stop 2023-12-11T20:31:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2531569275 shutdown_connections 2023-12-11T20:31:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e02a64b770 0x55e02a64db90 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e02a5e0720 0x55e02a5eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e02a5deed0 0x55e02a5edaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 1 --2- 172.21.15.12:0/2531569275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e02a5df830 0x55e02a5edfe0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b437fe700 0 client.19980 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2531569275 >> 172.21.15.12:0/2531569275 conn(0x55e02a50e780 msgr2=0x55e02a5e3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2531569275 shutdown_connections 2023-12-11T20:31:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 1 -- 172.21.15.12:0/2531569275 wait complete. 2023-12-11T20:31:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b7dce8b80 20 client.19980 trim_cache size 0 max 16384 2023-12-11T20:31:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:31:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:31:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:31:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:31:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.795+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b4c0a1470 msgr2=0x7f3b4c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b4c0a1470 0x7f3b4c0a3930 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009cd0 tx=0x7f3b5c0099e0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641026e0 msgr2=0x7f3b640739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641026e0 0x7f3b640739c0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800d980 tx=0x7f3b5800dc90 comp rx=0 tx=0).stop 2023-12-11T20:31:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/409932057 shutdown_connections 2023-12-11T20:31:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3b4c0a1470 0x7f3b4c0a3930 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b641014f0 0x7f3b64075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b64103080 0x7f3b64073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 --2- 172.21.15.12:0/409932057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641026e0 0x7f3b640739c0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/409932057 >> 172.21.15.12:0/409932057 conn(0x7f3b640fca60 msgr2=0x7f3b64105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/409932057 shutdown_connections 2023-12-11T20:31:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:31:50.796+0000 7f3b6a3ff700 1 -- 172.21.15.12:0/409932057 wait complete. 2023-12-11T20:31:51.371 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:31:51.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:51 smithi032 ceph-mon[132488]: pgmap v852: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:51 smithi039 ceph-mon[102205]: pgmap v852: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:51 smithi012 ceph-mon[128787]: pgmap v852: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 14 op/s 2023-12-11T20:31:52.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 -- 172.21.15.12:0/3684683491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901024c0 msgr2=0x7fb490102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 --2- 172.21.15.12:0/3684683491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901024c0 0x7fb490102920 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fb4840099c0 tx=0x7fb484009cd0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 -- 172.21.15.12:0/3684683491 shutdown_connections 2023-12-11T20:31:52.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 --2- 172.21.15.12:0/3684683491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb490102e60 0x7fb490109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 --2- 172.21.15.12:0/3684683491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4901012d0 0x7fb4901016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 --2- 172.21.15.12:0/3684683491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901024c0 0x7fb490102920 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 -- 172.21.15.12:0/3684683491 >> 172.21.15.12:0/3684683491 conn(0x7fb4900fc860 msgr2=0x7fb4900fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 -- 172.21.15.12:0/3684683491 shutdown_connections 2023-12-11T20:31:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.491+0000 7fb49499d700 1 -- 172.21.15.12:0/3684683491 wait complete. 2023-12-11T20:31:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb49499d700 1 Processor -- start 2023-12-11T20:31:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb49499d700 1 -- start start 2023-12-11T20:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb49499d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901012d0 0x7fb4901992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb49499d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4901024c0 0x7fb4901997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb49499d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb490102e60 0x7fb4901a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb49499d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901a0dd0 con 0x7fb4901012d0 2023-12-11T20:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb49499d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901a0f10 con 0x7fb490102e60 2023-12-11T20:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb49499d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901a10a0 con 0x7fb4901024c0 2023-12-11T20:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.493+0000 7fb48f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901012d0 0x7fb4901992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901012d0 0x7fb4901992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39000/0 (socket says 172.21.15.12:39000) 2023-12-11T20:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48f7fe700 1 -- 172.21.15.12:0/770801111 learned_addr learned my addr 172.21.15.12:0/770801111 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48ffff700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb490102e60 0x7fb4901a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48effd700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4901024c0 0x7fb4901997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48f7fe700 1 -- 172.21.15.12:0/770801111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4901024c0 msgr2=0x7fb4901997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4901024c0 0x7fb4901997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48f7fe700 1 -- 172.21.15.12:0/770801111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb490102e60 msgr2=0x7fb4901a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb490102e60 0x7fb4901a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48f7fe700 1 -- 172.21.15.12:0/770801111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840095f0 con 0x7fb4901012d0 2023-12-11T20:31:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.494+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901012d0 0x7fb4901992a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fb48000d980 tx=0x7fb48000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.495+0000 7fb48cff9700 1 -- 172.21.15.12:0/770801111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480004020 con 0x7fb4901012d0 2023-12-11T20:31:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.495+0000 7fb48cff9700 1 -- 172.21.15.12:0/770801111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb48000f690 con 0x7fb4901012d0 2023-12-11T20:31:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.495+0000 7fb48cff9700 1 -- 172.21.15.12:0/770801111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800039e0 con 0x7fb4901012d0 2023-12-11T20:31:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.495+0000 7fb49499d700 1 -- 172.21.15.12:0/770801111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4901a1380 con 0x7fb4901012d0 2023-12-11T20:31:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.495+0000 7fb49499d700 1 -- 172.21.15.12:0/770801111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4901a1890 con 0x7fb4901012d0 2023-12-11T20:31:52.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.498+0000 7fb48cff9700 1 -- 172.21.15.12:0/770801111 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb48000f800 con 0x7fb4901012d0 2023-12-11T20:31:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.499+0000 7fb4a94a5b80 1 Processor -- start 2023-12-11T20:31:52.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.500+0000 7fb4a94a5b80 1 -- start start 2023-12-11T20:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.500+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a838de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.500+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a838e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.500+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a838f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.500+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a82e8b50 con 0x55f5a838e3c0 2023-12-11T20:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.500+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a82e6470 con 0x55f5a838ede0 2023-12-11T20:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.500+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a82e1d60 con 0x55f5a838da60 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48cff9700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4780a15a0 0x7fb4780a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a838e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a838f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a838f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49362/0 (socket says 172.21.15.12:49362) 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48effd700 1 -- 172.21.15.12:0/880341589 learned_addr learned my addr 172.21.15.12:0/880341589 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48ffff700 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a838de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48cff9700 1 -- 172.21.15.12:0/770801111 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb4800cc910 con 0x7fb4901012d0 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48ffff700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4780a15a0 0x7fb4780a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48f7fe700 1 -- 172.21.15.12:0/880341589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 msgr2=0x55f5a838de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a838de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48f7fe700 1 -- 172.21.15.12:0/880341589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 msgr2=0x55f5a838f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a838f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48f7fe700 1 -- 172.21.15.12:0/880341589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5a815e630 con 0x55f5a838e3c0 2023-12-11T20:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.501+0000 7fb48effd700 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a838f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.502+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a838e8a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fb4800046a0 tx=0x7fb48008f340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78d8df27e90e911 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.502+0000 7fb48ffff700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4780a15a0 0x7fb4780a3a60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb488009fd0 tx=0x7fb488009100 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.502+0000 7fb475ffb700 1 -- 172.21.15.12:0/880341589 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800994e0 con 0x55f5a838e3c0 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.502+0000 7fb475ffb700 1 -- 172.21.15.12:0/880341589 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb48000fb00 con 0x55f5a838e3c0 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.502+0000 7fb475ffb700 1 -- 172.21.15.12:0/880341589 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800a1f10 con 0x55f5a838e3c0 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/880341589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 msgr2=0x55f5a838e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a838e8a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fb4800046a0 tx=0x7fb48008f340 comp rx=0 tx=0).stop 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/880341589 shutdown_connections 2023-12-11T20:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a838f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a838de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/880341589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a838e8a0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/880341589 >> 172.21.15.12:0/880341589 conn(0x55f5a82bc7e0 msgr2=0x55f5a83883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/880341589 shutdown_connections 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/880341589 wait complete. 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.503+0000 7fb4a94a5b80 1 -- start start 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb4a94a5b80 1 Processor -- start 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a8397430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a8397970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a839e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a829b560 con 0x55f5a838e3c0 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a829b200 con 0x55f5a838ede0 2023-12-11T20:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a8160920 con 0x55f5a838da60 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb4a94a5b80 10 client.0 _ll_register_callbacks cb 0x55f5a81c6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.504+0000 7fb48effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a8397970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a8397970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39026/0 (socket says 172.21.15.12:39026) 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48effd700 1 -- 172.21.15.12:0/1193279706 learned_addr learned my addr 172.21.15.12:0/1193279706 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a8397430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48ffff700 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a839e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48f7fe700 1 -- 172.21.15.12:0/1193279706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 msgr2=0x55f5a839e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a839e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48f7fe700 1 -- 172.21.15.12:0/1193279706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 msgr2=0x55f5a8397970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a8397970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48f7fe700 1 -- 172.21.15.12:0/1193279706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49010a060 con 0x55f5a838da60 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a8397430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb48000be80 tx=0x7fb480000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3729cf9e578c80f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.505+0000 7fb46effd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb46effd700 1 -- 172.21.15.12:0/1193279706 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800b1070 con 0x55f5a838da60 2023-12-11T20:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/1193279706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5a83809e0 con 0x55f5a838da60 2023-12-11T20:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb46effd700 1 -- 172.21.15.12:0/1193279706 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb48009a280 con 0x55f5a838da60 2023-12-11T20:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb46effd700 1 -- 172.21.15.12:0/1193279706 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4800a1f10 con 0x55f5a838da60 2023-12-11T20:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb4a94a5b80 10 client.29530 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/1193279706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fb4901a1890 con 0x55f5a838da60 2023-12-11T20:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb46effd700 1 -- 172.21.15.12:0/1193279706 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f5a83809e0 con 0x55f5a838da60 2023-12-11T20:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb46effd700 1 -- 172.21.15.12:0/1193279706 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb480099070 con 0x55f5a838da60 2023-12-11T20:31:52.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb4a94a5b80 10 client.29530 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.506+0000 7fb4a94a5b80 10 client.29530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.507+0000 7fb4a94a5b80 20 client.29530 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.507+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5a83a2d60 0x55f5a83a5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.507+0000 7fb4a94a5b80 4 client.29530 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.507+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/1193279706 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5a835cf40 con 0x55f5a83a2d60 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.507+0000 7fb48effd700 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5a83a2d60 0x55f5a83a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.508+0000 7fb46effd700 10 client.29530 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.508+0000 7fb48effd700 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5a83a2d60 0x55f5a83a5150 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f370ece928051a3 server_cookie=8c9faece5c9e8efb in_seq=0 out_seq=0 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.508+0000 7fb46effd700 1 -- 172.21.15.12:0/1193279706 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f5a835cf40 con 0x55f5a83a2d60 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.508+0000 7fb46effd700 10 client.29530 handle_command_reply: tid=0 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.508+0000 7fb4a94a5b80 1 client.29530 shutdown 2023-12-11T20:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/1193279706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 msgr2=0x55f5a8397430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a8397430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb48000be80 tx=0x7fb480000bc0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/1193279706 shutdown_connections 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5a83a2d60 0x55f5a83a5150 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a839e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb46effd700 0 client.29530 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838da60 0x55f5a8397430 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/1193279706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838e3c0 0x55f5a8397970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/1193279706 >> 172.21.15.12:0/1193279706 conn(0x55f5a82bc7e0 msgr2=0x55f5a838c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/1193279706 shutdown_connections 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/1193279706 wait complete. 2023-12-11T20:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.509+0000 7fb4a94a5b80 20 client.29530 trim_cache size 0 max 16384 2023-12-11T20:31:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.528+0000 7fb4a94a5b80 1 Processor -- start 2023-12-11T20:31:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.528+0000 7fb4a94a5b80 1 -- start start 2023-12-11T20:31:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a838f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 0x55f5a839e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a8396070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a838f730 con 0x55f5a838da60 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a83984c0 con 0x55f5a838ede0 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a8395000 con 0x55f5a838e3c0 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a838f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a838f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39042/0 (socket says 172.21.15.12:39042) 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48f7fe700 1 -- 172.21.15.12:0/975190714 learned_addr learned my addr 172.21.15.12:0/975190714 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48effd700 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 0x55f5a839e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48ffff700 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a8396070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48f7fe700 1 -- 172.21.15.12:0/975190714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 msgr2=0x55f5a839e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 0x55f5a839e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48f7fe700 1 -- 172.21.15.12:0/975190714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 msgr2=0x55f5a8396070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a8396070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.529+0000 7fb48f7fe700 1 -- 172.21.15.12:0/975190714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5a810ade0 con 0x55f5a838da60 2023-12-11T20:31:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.530+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a838f1c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb48000d950 tx=0x7fb480099c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf030dab66e41ae8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.530+0000 7fb4767fc700 1 -- 172.21.15.12:0/975190714 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800b1070 con 0x55f5a838da60 2023-12-11T20:31:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.530+0000 7fb4767fc700 1 -- 172.21.15.12:0/975190714 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4800b2470 con 0x55f5a838da60 2023-12-11T20:31:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.530+0000 7fb4767fc700 1 -- 172.21.15.12:0/975190714 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480099ff0 con 0x55f5a838da60 2023-12-11T20:31:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/975190714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 msgr2=0x55f5a838f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a838f1c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb48000d950 tx=0x7fb480099c60 comp rx=0 tx=0).stop 2023-12-11T20:31:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/975190714 shutdown_connections 2023-12-11T20:31:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a8396070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a838f1c0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/975190714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 0x55f5a839e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/975190714 >> 172.21.15.12:0/975190714 conn(0x55f5a82bc7e0 msgr2=0x55f5a8388320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/975190714 shutdown_connections 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/975190714 wait complete. 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.531+0000 7fb4a94a5b80 1 -- start start 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb4a94a5b80 1 Processor -- start 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a839e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 0x55f5a839e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb4a94a5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a839c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a839cce0 con 0x55f5a838da60 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a839ce50 con 0x55f5a838ede0 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb4a94a5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5a839d010 con 0x55f5a838e3c0 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb4a94a5b80 10 client.0 _ll_register_callbacks cb 0x55f5a81c6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb48f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a839e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb48f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a839e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39046/0 (socket says 172.21.15.12:39046) 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb48f7fe700 1 -- 172.21.15.12:0/3931409723 learned_addr learned my addr 172.21.15.12:0/3931409723 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb48effd700 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 0x55f5a839e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.532+0000 7fb48ffff700 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a839c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb48f7fe700 1 -- 172.21.15.12:0/3931409723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 msgr2=0x55f5a839e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 0x55f5a839e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb48f7fe700 1 -- 172.21.15.12:0/3931409723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 msgr2=0x55f5a839c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a839c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb48f7fe700 1 -- 172.21.15.12:0/3931409723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4901a1890 con 0x55f5a838da60 2023-12-11T20:31:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb48f7fe700 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a839e140 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb480099b10 tx=0x7fb4800047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56edc26f4b3aa27f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb46effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb46effd700 1 -- 172.21.15.12:0/3931409723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800b1070 con 0x55f5a838da60 2023-12-11T20:31:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb46effd700 1 -- 172.21.15.12:0/3931409723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb48009a280 con 0x55f5a838da60 2023-12-11T20:31:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.533+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/3931409723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb48000fb00 con 0x55f5a838da60 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb46effd700 1 -- 172.21.15.12:0/3931409723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4800ccb50 con 0x55f5a838da60 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb4a94a5b80 10 client.19998 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/3931409723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f5a80f3c60 con 0x55f5a838da60 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb46effd700 1 -- 172.21.15.12:0/3931409723 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb48000fb00 con 0x55f5a838da60 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb46effd700 1 -- 172.21.15.12:0/3931409723 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb480095ba0 con 0x55f5a838da60 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb4a94a5b80 10 client.19998 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb4a94a5b80 10 client.19998 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb4a94a5b80 20 client.19998 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5a83fa010 0x55f5a83fc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb4a94a5b80 4 client.19998 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.534+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/3931409723 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f5a82a7fd0 con 0x55f5a83fa010 2023-12-11T20:31:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.535+0000 7fb48effd700 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5a83fa010 0x55f5a83fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.535+0000 7fb48effd700 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5a83fa010 0x55f5a83fc430 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6875d88b7fe1ae38 server_cookie=9f2fd54c7dfc3c71 in_seq=0 out_seq=0 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.535+0000 7fb46effd700 10 client.19998 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb46effd700 1 -- 172.21.15.12:0/3931409723 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f5a82a7fd0 con 0x55f5a83fa010 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb46effd700 10 client.19998 handle_command_reply: tid=0 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 client.19998 shutdown 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/3931409723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 msgr2=0x55f5a839e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a839e140 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb480099b10 tx=0x7fb4800047e0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/3931409723 shutdown_connections 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f5a83fa010 0x55f5a83fc430 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f5a838ede0 0x55f5a839c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f5a838da60 0x55f5a839e140 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb46effd700 0 client.19998 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 --2- 172.21.15.12:0/3931409723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f5a838e3c0 0x55f5a839e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/3931409723 >> 172.21.15.12:0/3931409723 conn(0x55f5a82bc7e0 msgr2=0x55f5a8396070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/3931409723 shutdown_connections 2023-12-11T20:31:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 1 -- 172.21.15.12:0/3931409723 wait complete. 2023-12-11T20:31:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.536+0000 7fb4a94a5b80 20 client.19998 trim_cache size 0 max 16384 2023-12-11T20:31:52.539 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:31:52.539 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:31:52.539 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:31:52.539 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:31:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 -- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4780a15a0 msgr2=0x7fb4780a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4780a15a0 0x7fb4780a3a60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb488009fd0 tx=0x7fb488009100 comp rx=0 tx=0).stop 2023-12-11T20:31:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 -- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901012d0 msgr2=0x7fb4901992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901012d0 0x7fb4901992a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fb48000d980 tx=0x7fb48000dc90 comp rx=0 tx=0).stop 2023-12-11T20:31:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 -- 172.21.15.12:0/770801111 shutdown_connections 2023-12-11T20:31:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb4780a15a0 0x7fb4780a3a60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb490102e60 0x7fb4901a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4901012d0 0x7fb4901992a0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 --2- 172.21.15.12:0/770801111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4901024c0 0x7fb4901997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 -- 172.21.15.12:0/770801111 >> 172.21.15.12:0/770801111 conn(0x7fb4900fc860 msgr2=0x7fb490073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 -- 172.21.15.12:0/770801111 shutdown_connections 2023-12-11T20:31:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.537+0000 7fb49499d700 1 -- 172.21.15.12:0/770801111 wait complete. 2023-12-11T20:31:52.556 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:31:52.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:31:52.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 -- 172.21.15.12:0/653301518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 msgr2=0x7fd1a010b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/653301518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 0x7fd1a010b7e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fd19800b0a0 tx=0x7fd19800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 -- 172.21.15.12:0/653301518 shutdown_connections 2023-12-11T20:31:52.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/653301518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a00755d0 0x7fd1a0073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/653301518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 0x7fd1a010b7e0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/653301518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1a0073ff0 0x7fd1a0074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 -- 172.21.15.12:0/653301518 >> 172.21.15.12:0/653301518 conn(0x7fd1a00fca10 msgr2=0x7fd1a00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 -- 172.21.15.12:0/653301518 shutdown_connections 2023-12-11T20:31:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.799+0000 7fd1a5dff700 1 -- 172.21.15.12:0/653301518 wait complete. 2023-12-11T20:31:52.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.800+0000 7fd1a5dff700 1 Processor -- start 2023-12-11T20:31:52.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.800+0000 7fd1a5dff700 1 -- start start 2023-12-11T20:31:52.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd1a5dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1a0073ff0 0x7fd1a01995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd1a5dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a00755d0 0x7fd1a0199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd1a5dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 0x7fd1a01a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd1a5dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a01a1120 con 0x7fd1a0109350 2023-12-11T20:31:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd1a5dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a01a1260 con 0x7fd1a00755d0 2023-12-11T20:31:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd1a5dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a01a13f0 con 0x7fd1a0073ff0 2023-12-11T20:31:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 0x7fd1a01a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1a0073ff0 0x7fd1a01995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 0x7fd1a01a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39058/0 (socket says 172.21.15.12:39058) 2023-12-11T20:31:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1a0073ff0 0x7fd1a01995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40698/0 (socket says 172.21.15.12:40698) 2023-12-11T20:31:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19ffff700 1 -- 172.21.15.12:0/3098477622 learned_addr learned my addr 172.21.15.12:0/3098477622 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19effd700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a00755d0 0x7fd1a0199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19ffff700 1 -- 172.21.15.12:0/3098477622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1a0073ff0 msgr2=0x7fd1a01995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19ffff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1a0073ff0 0x7fd1a01995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19ffff700 1 -- 172.21.15.12:0/3098477622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a00755d0 msgr2=0x7fd1a0199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19ffff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a00755d0 0x7fd1a0199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19ffff700 1 -- 172.21.15.12:0/3098477622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd198009d00 con 0x7fd1a0109350 2023-12-11T20:31:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19effd700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a00755d0 0x7fd1a0199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.801+0000 7fd19f7fe700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1a0073ff0 0x7fd1a01995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.802+0000 7fd19ffff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 0x7fd1a01a0b50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fd19800b780 tx=0x7fd19800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.802+0000 7fd19cff9700 1 -- 172.21.15.12:0/3098477622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800e040 con 0x7fd1a0109350 2023-12-11T20:31:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.802+0000 7fd19cff9700 1 -- 172.21.15.12:0/3098477622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd198003c00 con 0x7fd1a0109350 2023-12-11T20:31:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.802+0000 7fd19cff9700 1 -- 172.21.15.12:0/3098477622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980052a0 con 0x7fd1a0109350 2023-12-11T20:31:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.802+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a01a1670 con 0x7fd1a0109350 2023-12-11T20:31:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.802+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a01a1a40 con 0x7fd1a0109350 2023-12-11T20:31:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.803+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a0108160 con 0x7fd1a0109350 2023-12-11T20:31:52.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.806+0000 7fd19cff9700 1 -- 172.21.15.12:0/3098477622 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd198005400 con 0x7fd1a0109350 2023-12-11T20:31:52.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.809+0000 7fd19cff9700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd1880a1480 0x7fd1880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:52.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.809+0000 7fd19cff9700 1 -- 172.21.15.12:0/3098477622 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1980ce170 con 0x7fd1a0109350 2023-12-11T20:31:52.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.809+0000 7fd19f7fe700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd1880a1480 0x7fd1880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:52.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.810+0000 7fd19f7fe700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd1880a1480 0x7fd1880a3940 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd190011490 tx=0x7fd190009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:52.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:52.810+0000 7fd19cff9700 1 -- 172.21.15.12:0/3098477622 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd1980977b0 con 0x7fd1a0109350 2023-12-11T20:31:53.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.120+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1a0068330 con 0x7fd1a0109350 2023-12-11T20:31:53.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.121+0000 7fd19cff9700 1 -- 172.21.15.12:0/3098477622 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11303 (secure 0 0 0) 0x7fd19809add0 con 0x7fd1a0109350 2023-12-11T20:31:53.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:31:53.120 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:31:31.560744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd1880a1480 msgr2=0x7fd1880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd1880a1480 0x7fd1880a3940 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd190011490 tx=0x7fd190009260 comp rx=0 tx=0).stop 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 msgr2=0x7fd1a01a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 0x7fd1a01a0b50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fd19800b780 tx=0x7fd19800bab0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 shutdown_connections 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd1880a1480 0x7fd1880a3940 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1a0109350 0x7fd1a01a0b50 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1a0073ff0 0x7fd1a01995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.123+0000 7fd1a5dff700 1 --2- 172.21.15.12:0/3098477622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a00755d0 0x7fd1a0199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.124+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 >> 172.21.15.12:0/3098477622 conn(0x7fd1a00fca10 msgr2=0x7fd1a01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.124+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 shutdown_connections 2023-12-11T20:31:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.124+0000 7fd1a5dff700 1 -- 172.21.15.12:0/3098477622 wait complete. 2023-12-11T20:31:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2023-12-11T20:31:53.145 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.383+0000 7f370afff700 1 -- 172.21.15.12:0/25467339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37041071e0 msgr2=0x7f3704109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.383+0000 7f370afff700 1 --2- 172.21.15.12:0/25467339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37041071e0 0x7f3704109650 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009f90 tx=0x7f36fc00b330 comp rx=0 tx=0).stop 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.383+0000 7f370afff700 1 -- 172.21.15.12:0/25467339 shutdown_connections 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.383+0000 7f370afff700 1 --2- 172.21.15.12:0/25467339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37041071e0 0x7f3704109650 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.383+0000 7f370afff700 1 --2- 172.21.15.12:0/25467339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3704101f80 0x7f3704104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.383+0000 7f370afff700 1 --2- 172.21.15.12:0/25467339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37041048b0 0x7f3704106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.383+0000 7f370afff700 1 -- 172.21.15.12:0/25467339 >> 172.21.15.12:0/25467339 conn(0x7f37040fb930 msgr2=0x7f37040fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.384+0000 7f370afff700 1 -- 172.21.15.12:0/25467339 shutdown_connections 2023-12-11T20:31:53.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.384+0000 7f370afff700 1 -- 172.21.15.12:0/25467339 wait complete. 2023-12-11T20:31:53.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.385+0000 7f370afff700 1 Processor -- start 2023-12-11T20:31:53.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.385+0000 7f370afff700 1 -- start start 2023-12-11T20:31:53.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.385+0000 7f370afff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3704101f80 0x7f3704197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.385+0000 7f370afff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37041048b0 0x7f37041979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.385+0000 7f370afff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37041071e0 0x7f370419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.385+0000 7f370afff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370419ef90 con 0x7f37041048b0 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.385+0000 7f370afff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370419f0d0 con 0x7f3704101f80 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.385+0000 7f370afff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370419f260 con 0x7f37041071e0 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f3703fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37041048b0 0x7f37041979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f370959c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37041071e0 0x7f370419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f370959c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37041071e0 0x7f370419e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40718/0 (socket says 172.21.15.12:40718) 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f370959c700 1 -- 172.21.15.12:0/193482349 learned_addr learned my addr 172.21.15.12:0/193482349 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f3708d9b700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3704101f80 0x7f3704197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f370959c700 1 -- 172.21.15.12:0/193482349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3704101f80 msgr2=0x7f3704197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f370959c700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3704101f80 0x7f3704197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f370959c700 1 -- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37041048b0 msgr2=0x7f37041979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f370959c700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37041048b0 0x7f37041979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.386+0000 7f370959c700 1 -- 172.21.15.12:0/193482349 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009c40 con 0x7f37041071e0 2023-12-11T20:31:53.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.387+0000 7f370959c700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37041071e0 0x7f370419e9c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009f60 tx=0x7f36fc008c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.387+0000 7f3701ffb700 1 -- 172.21.15.12:0/193482349 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00e040 con 0x7f37041071e0 2023-12-11T20:31:53.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.387+0000 7f3701ffb700 1 -- 172.21.15.12:0/193482349 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36fc00bc00 con 0x7f37041071e0 2023-12-11T20:31:53.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.387+0000 7f3701ffb700 1 -- 172.21.15.12:0/193482349 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc005040 con 0x7f37041071e0 2023-12-11T20:31:53.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.387+0000 7f370afff700 1 -- 172.21.15.12:0/193482349 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370419f4e0 con 0x7f37041071e0 2023-12-11T20:31:53.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.387+0000 7f370afff700 1 -- 172.21.15.12:0/193482349 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370419f960 con 0x7f37041071e0 2023-12-11T20:31:53.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.390+0000 7f3701ffb700 1 -- 172.21.15.12:0/193482349 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f36fc01d470 con 0x7f37041071e0 2023-12-11T20:31:53.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f371e8cfb80 1 Processor -- start 2023-12-11T20:31:53.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f371e8cfb80 1 -- start start 2023-12-11T20:31:53.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f3701ffb700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36f40a1500 0x7f36f40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a947e0 0x55fac5a94c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a95140 0x55fac5a95a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a96030 0x55fac5a964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac59ebb50 con 0x55fac5a947e0 2023-12-11T20:31:53.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac59e9470 con 0x55fac5a96030 2023-12-11T20:31:53.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.392+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac59e4d60 con 0x55fac5a95140 2023-12-11T20:31:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.393+0000 7f3701ffb700 1 -- 172.21.15.12:0/193482349 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f36fc0ce070 con 0x7f37041071e0 2023-12-11T20:31:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.393+0000 7f3703fff700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36f40a1500 0x7f36f40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.393+0000 7f3708d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a947e0 0x55fac5a94c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.393+0000 7f370959c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a96030 0x55fac5a964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.393+0000 7f3708d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a947e0 0x55fac5a94c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39080/0 (socket says 172.21.15.12:39080) 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.393+0000 7f370959c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a96030 0x55fac5a964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49436/0 (socket says 172.21.15.12:49436) 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.393+0000 7f3708d9b700 1 -- 172.21.15.12:0/3082529694 learned_addr learned my addr 172.21.15.12:0/3082529694 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.393+0000 7f3703fff700 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a95140 0x55fac5a95a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f370959c700 1 -- 172.21.15.12:0/3082529694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a95140 msgr2=0x55fac5a95a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f370959c700 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a95140 0x55fac5a95a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f370959c700 1 -- 172.21.15.12:0/3082529694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a947e0 msgr2=0x55fac5a94c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f370959c700 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a947e0 0x55fac5a94c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f370959c700 1 -- 172.21.15.12:0/3082529694 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fac5861630 con 0x55fac5a96030 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f3703fff700 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a95140 0x55fac5a95a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f3703fff700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36f40a1500 0x7f36f40a39c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f36f0013570 tx=0x7f36f0009940 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f370959c700 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a96030 0x55fac5a964b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0cbb20 tx=0x7f36fc006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a9815e6832caba7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f36eeffd700 1 -- 172.21.15.12:0/3082529694 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc09ad30 con 0x55fac5a96030 2023-12-11T20:31:53.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f36eeffd700 1 -- 172.21.15.12:0/3082529694 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36fc09bad0 con 0x55fac5a96030 2023-12-11T20:31:53.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.394+0000 7f36eeffd700 1 -- 172.21.15.12:0/3082529694 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc09f320 con 0x55fac5a96030 2023-12-11T20:31:53.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3082529694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a96030 msgr2=0x55fac5a964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a96030 0x55fac5a964b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0cbb20 tx=0x7f36fc006000 comp rx=0 tx=0).stop 2023-12-11T20:31:53.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3082529694 shutdown_connections 2023-12-11T20:31:53.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a96030 0x55fac5a964b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a947e0 0x55fac5a94c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3082529694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a95140 0x55fac5a95a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3082529694 >> 172.21.15.12:0/3082529694 conn(0x55fac59bf7e0 msgr2=0x55fac5a8cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3082529694 shutdown_connections 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.395+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3082529694 wait complete. 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.396+0000 7f371e8cfb80 1 -- start start 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.396+0000 7f371e8cfb80 1 Processor -- start 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.396+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 0x55fac5a9e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.396+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5a9e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.396+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5aa58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.396+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac599e560 con 0x55fac5a96030 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.396+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac599e200 con 0x55fac5a95140 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.396+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5863920 con 0x55fac5a947e0 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f371e8cfb80 10 client.0 _ll_register_callbacks cb 0x55fac58c9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3703fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5a9e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3703fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5a9e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:49448/0 (socket says 172.21.15.12:49448) 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3703fff700 1 -- 172.21.15.12:0/3314347490 learned_addr learned my addr 172.21.15.12:0/3314347490 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f370959c700 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5aa58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3708d9b700 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 0x55fac5a9e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3703fff700 1 -- 172.21.15.12:0/3314347490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 msgr2=0x55fac5a9e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3703fff700 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 0x55fac5a9e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3703fff700 1 -- 172.21.15.12:0/3314347490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 msgr2=0x55fac5aa58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3703fff700 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5aa58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.397+0000 7f3703fff700 1 -- 172.21.15.12:0/3314347490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370419f960 con 0x55fac5a95140 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.398+0000 7f3703fff700 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5a9e8b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009be0 tx=0x7f36f00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46df32f9b39bb7ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.398+0000 7f36e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.398+0000 7f36e3fff700 1 -- 172.21.15.12:0/3314347490 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0020610 con 0x55fac5a95140 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.398+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3314347490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fac5a83b40 con 0x55fac5a95140 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.398+0000 7f36e3fff700 1 -- 172.21.15.12:0/3314347490 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f36f0020770 con 0x55fac5a95140 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.398+0000 7f36e3fff700 1 -- 172.21.15.12:0/3314347490 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f0020930 con 0x55fac5a95140 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.398+0000 7f371e8cfb80 10 client.29552 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:53.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.398+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3314347490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55fac580dde0 con 0x55fac5a95140 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f36e3fff700 1 -- 172.21.15.12:0/3314347490 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fac5a83b40 con 0x55fac5a95140 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f36e3fff700 1 -- 172.21.15.12:0/3314347490 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f36f0028030 con 0x55fac5a95140 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f371e8cfb80 10 client.29552 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f371e8cfb80 10 client.29552 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f371e8cfb80 20 client.29552 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55fac5aaa220 0x55fac5aac640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f371e8cfb80 4 client.29552 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3314347490 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fac5a5ff40 con 0x55fac5aaa220 2023-12-11T20:31:53.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.399+0000 7f3708d9b700 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55fac5aaa220 0x55fac5aac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.400+0000 7f3708d9b700 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55fac5aaa220 0x55fac5aac640 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce9b9ecadb412c19 server_cookie=d92cc17dadf6d7ae in_seq=0 out_seq=0 2023-12-11T20:31:53.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.400+0000 7f36e3fff700 10 client.29552 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f36e3fff700 1 -- 172.21.15.12:0/3314347490 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fac5a5ff40 con 0x55fac5aaa220 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f36e3fff700 10 client.29552 handle_command_reply: tid=0 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 client.29552 shutdown 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3314347490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 msgr2=0x55fac5a9e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5a9e8b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009be0 tx=0x7f36f00047c0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3314347490 shutdown_connections 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55fac5aaa220 0x55fac5aac640 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5aa58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 0x55fac5a9e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/3314347490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5a9e8b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3314347490 >> 172.21.15.12:0/3314347490 conn(0x55fac59bf7e0 msgr2=0x55fac5a8ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f36e3fff700 0 client.29552 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:31:53.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.401+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3314347490 shutdown_connections 2023-12-11T20:31:53.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.402+0000 7f371e8cfb80 1 -- 172.21.15.12:0/3314347490 wait complete. 2023-12-11T20:31:53.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.402+0000 7f371e8cfb80 20 client.29552 trim_cache size 0 max 16384 2023-12-11T20:31:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.415+0000 7f371e8cfb80 1 Processor -- start 2023-12-11T20:31:53.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f371e8cfb80 1 -- start start 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 0x55fac5aa5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5aa58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5a9c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5a8b050 con 0x55fac5a96030 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5aa6aa0 con 0x55fac5a95140 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5a95520 con 0x55fac5a947e0 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f370959c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5a9c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f3708d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 0x55fac5aa5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f370959c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5a9c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39094/0 (socket says 172.21.15.12:39094) 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f370959c700 1 -- 172.21.15.12:0/6242928 learned_addr learned my addr 172.21.15.12:0/6242928 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.416+0000 7f3703fff700 1 --2- 172.21.15.12:0/6242928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5aa58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.417+0000 7f370959c700 1 -- 172.21.15.12:0/6242928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 msgr2=0x55fac5aa5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.417+0000 7f370959c700 1 --2- 172.21.15.12:0/6242928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 0x55fac5aa5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.417+0000 7f370959c700 1 -- 172.21.15.12:0/6242928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 msgr2=0x55fac5aa58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.417+0000 7f370959c700 1 --2- 172.21.15.12:0/6242928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5aa58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.417+0000 7f370959c700 1 -- 172.21.15.12:0/6242928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fac57f6c60 con 0x55fac5a96030 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.417+0000 7f370959c700 1 --2- 172.21.15.12:0/6242928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5a9c590 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0978d0 tx=0x7f36fc09bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60f38388a2e857b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.417+0000 7f36ef7fe700 1 -- 172.21.15.12:0/6242928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0b7070 con 0x55fac5a96030 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.418+0000 7f36ef7fe700 1 -- 172.21.15.12:0/6242928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36fc09f520 con 0x55fac5a96030 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.418+0000 7f36ef7fe700 1 -- 172.21.15.12:0/6242928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0b2070 con 0x55fac5a96030 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.418+0000 7f371e8cfb80 1 -- 172.21.15.12:0/6242928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 msgr2=0x55fac5a9c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.418+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/6242928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5a9c590 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0978d0 tx=0x7f36fc09bc40 comp rx=0 tx=0).stop 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.419+0000 7f371e8cfb80 1 -- 172.21.15.12:0/6242928 shutdown_connections 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.419+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/6242928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a96030 0x55fac5a9c590 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.419+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/6242928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a947e0 0x55fac5aa5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.419+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/6242928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a95140 0x55fac5aa58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.419+0000 7f371e8cfb80 1 -- 172.21.15.12:0/6242928 >> 172.21.15.12:0/6242928 conn(0x55fac59bf7e0 msgr2=0x55fac5a9d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.419+0000 7f371e8cfb80 1 -- 172.21.15.12:0/6242928 shutdown_connections 2023-12-11T20:31:53.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.419+0000 7f371e8cfb80 1 -- 172.21.15.12:0/6242928 wait complete. 2023-12-11T20:31:53.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.419+0000 7f371e8cfb80 1 -- start start 2023-12-11T20:31:53.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.420+0000 7f371e8cfb80 1 Processor -- start 2023-12-11T20:31:53.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.420+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a947e0 0x55fac5aa2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.420+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a95140 0x55fac5aa2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.420+0000 7f371e8cfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a96030 0x55fac5aa3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.420+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5aa4510 con 0x55fac5a95140 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.420+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5aa4680 con 0x55fac5a947e0 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.420+0000 7f371e8cfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5aa4840 con 0x55fac5a96030 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.420+0000 7f371e8cfb80 10 client.0 _ll_register_callbacks cb 0x55fac58c9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a95140 0x55fac5aa2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3708d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a947e0 0x55fac5aa2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a95140 0x55fac5aa2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39104/0 (socket says 172.21.15.12:39104) 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 -- 172.21.15.12:0/1862459038 learned_addr learned my addr 172.21.15.12:0/1862459038 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f370959c700 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a96030 0x55fac5aa3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 -- 172.21.15.12:0/1862459038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a96030 msgr2=0x55fac5aa3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a96030 0x55fac5aa3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 -- 172.21.15.12:0/1862459038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a947e0 msgr2=0x55fac5aa2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a947e0 0x55fac5aa2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 -- 172.21.15.12:0/1862459038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fac5861630 con 0x55fac5a95140 2023-12-11T20:31:53.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f370959c700 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a96030 0x55fac5aa3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:53.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f3703fff700 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a95140 0x55fac5aa2fc0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f36f0013430 tx=0x7f36f0004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a5a072e0fea8f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.421+0000 7f36e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:53.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f36e3fff700 1 -- 172.21.15.12:0/1862459038 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0005040 con 0x55fac5a95140 2023-12-11T20:31:53.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f371e8cfb80 1 -- 172.21.15.12:0/1862459038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f36fc09bad0 con 0x55fac5a95140 2023-12-11T20:31:53.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f36e3fff700 1 -- 172.21.15.12:0/1862459038 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f36f00051a0 con 0x55fac5a95140 2023-12-11T20:31:53.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f36e3fff700 1 -- 172.21.15.12:0/1862459038 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f0005360 con 0x55fac5a95140 2023-12-11T20:31:53.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f371e8cfb80 10 client.20022 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:53.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f371e8cfb80 1 -- 172.21.15.12:0/1862459038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55fac5834250 con 0x55fac5a95140 2023-12-11T20:31:53.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f36e3fff700 1 -- 172.21.15.12:0/1862459038 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36f004b020 con 0x55fac5a95140 2023-12-11T20:31:53.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f36e3fff700 1 -- 172.21.15.12:0/1862459038 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f36f00116c0 con 0x55fac5a95140 2023-12-11T20:31:53.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f371e8cfb80 10 client.20022 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f371e8cfb80 10 client.20022 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.422+0000 7f371e8cfb80 20 client.20022 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.423+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55fac5b00bb0 0x55fac5b02fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.423+0000 7f371e8cfb80 4 client.20022 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.423+0000 7f371e8cfb80 1 -- 172.21.15.12:0/1862459038 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fac59aafd0 con 0x55fac5b00bb0 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.423+0000 7f3708d9b700 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55fac5b00bb0 0x55fac5b02fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f3708d9b700 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55fac5b00bb0 0x55fac5b02fd0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17cdd758b6b324cc server_cookie=c1b24069347fb086 in_seq=0 out_seq=0 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f36e3fff700 10 client.20022 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f36e3fff700 1 -- 172.21.15.12:0/1862459038 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fac59aafd0 con 0x55fac5b00bb0 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f36e3fff700 10 client.20022 handle_command_reply: tid=0 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 client.20022 shutdown 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 -- 172.21.15.12:0/1862459038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a95140 msgr2=0x55fac5aa2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a95140 0x55fac5aa2fc0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f36f0013430 tx=0x7f36f0004ae0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 -- 172.21.15.12:0/1862459038 shutdown_connections 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55fac5b00bb0 0x55fac5b02fd0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fac5a947e0 0x55fac5aa2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fac5a96030 0x55fac5aa3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f36e3fff700 0 client.20022 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 --2- 172.21.15.12:0/1862459038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fac5a95140 0x55fac5aa2fc0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 -- 172.21.15.12:0/1862459038 >> 172.21.15.12:0/1862459038 conn(0x55fac59bf7e0 msgr2=0x55fac5a8c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 -- 172.21.15.12:0/1862459038 shutdown_connections 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.424+0000 7f371e8cfb80 1 -- 172.21.15.12:0/1862459038 wait complete. 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f371e8cfb80 20 client.20022 trim_cache size 0 max 16384 2023-12-11T20:31:53.426 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:31:53.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 -- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36f40a1500 msgr2=0x7f36f40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36f40a1500 0x7f36f40a39c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f36f0013570 tx=0x7f36f0009940 comp rx=0 tx=0).stop 2023-12-11T20:31:53.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 -- 172.21.15.12:0/193482349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37041071e0 msgr2=0x7f370419e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37041071e0 0x7f370419e9c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009f60 tx=0x7f36fc008c80 comp rx=0 tx=0).stop 2023-12-11T20:31:53.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 -- 172.21.15.12:0/193482349 shutdown_connections 2023-12-11T20:31:53.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f36f40a1500 0x7f36f40a39c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3704101f80 0x7f3704197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37041071e0 0x7f370419e9c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 --2- 172.21.15.12:0/193482349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37041048b0 0x7f37041979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 -- 172.21.15.12:0/193482349 >> 172.21.15.12:0/193482349 conn(0x7f37040fb930 msgr2=0x7f3704103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 -- 172.21.15.12:0/193482349 shutdown_connections 2023-12-11T20:31:53.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.425+0000 7f370afff700 1 -- 172.21.15.12:0/193482349 wait complete. 2023-12-11T20:31:53.443 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:53 smithi012 ceph-mon[128787]: pgmap v853: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 16 MiB/s wr, 12 op/s 2023-12-11T20:31:53.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:31:53.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:53 smithi032 ceph-mon[132488]: pgmap v853: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 16 MiB/s wr, 12 op/s 2023-12-11T20:31:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:53 smithi039 ceph-mon[102205]: pgmap v853: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 16 MiB/s wr, 12 op/s 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 -- 172.21.15.12:0/963512898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 msgr2=0x7f8a10109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 --2- 172.21.15.12:0/963512898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 0x7f8a10109650 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800b0a0 tx=0x7f8a0800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 -- 172.21.15.12:0/963512898 shutdown_connections 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 --2- 172.21.15.12:0/963512898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a10101f80 0x7f8a10104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 --2- 172.21.15.12:0/963512898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 0x7f8a10109650 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 --2- 172.21.15.12:0/963512898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a101048b0 0x7f8a10106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 -- 172.21.15.12:0/963512898 >> 172.21.15.12:0/963512898 conn(0x7f8a100fb930 msgr2=0x7f8a100fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 -- 172.21.15.12:0/963512898 shutdown_connections 2023-12-11T20:31:53.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.675+0000 7f8a171ff700 1 -- 172.21.15.12:0/963512898 wait complete. 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.676+0000 7f8a171ff700 1 Processor -- start 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a171ff700 1 -- start start 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a171ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a10101f80 0x7f8a10199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a171ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a101048b0 0x7f8a10199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a171ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 0x7f8a101a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a171ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101a1150 con 0x7f8a101071e0 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a171ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101a1290 con 0x7f8a101048b0 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a171ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101a1420 con 0x7f8a10101f80 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a10101f80 0x7f8a10199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a1579c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 0x7f8a101a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a10101f80 0x7f8a10199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40770/0 (socket says 172.21.15.12:40770) 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.677+0000 7f8a14f9b700 1 -- 172.21.15.12:0/3048808015 learned_addr learned my addr 172.21.15.12:0/3048808015 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.678+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a101048b0 0x7f8a10199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.678+0000 7f8a1579c700 1 -- 172.21.15.12:0/3048808015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a10101f80 msgr2=0x7f8a10199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.678+0000 7f8a1579c700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a10101f80 0x7f8a10199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.678+0000 7f8a1579c700 1 -- 172.21.15.12:0/3048808015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a101048b0 msgr2=0x7f8a10199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.678+0000 7f8a1579c700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a101048b0 0x7f8a10199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.678+0000 7f8a1579c700 1 -- 172.21.15.12:0/3048808015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08009d00 con 0x7f8a101071e0 2023-12-11T20:31:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.678+0000 7f8a1579c700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 0x7f8a101a0b80 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800b070 tx=0x7f8a0800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.679+0000 7f8a0dffb700 1 -- 172.21.15.12:0/3048808015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800e040 con 0x7f8a101071e0 2023-12-11T20:31:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.679+0000 7f8a171ff700 1 -- 172.21.15.12:0/3048808015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a101a16a0 con 0x7f8a101071e0 2023-12-11T20:31:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.679+0000 7f8a0dffb700 1 -- 172.21.15.12:0/3048808015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a08003c00 con 0x7f8a101071e0 2023-12-11T20:31:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.679+0000 7f8a0dffb700 1 -- 172.21.15.12:0/3048808015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08005040 con 0x7f8a101071e0 2023-12-11T20:31:53.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.679+0000 7f8a171ff700 1 -- 172.21.15.12:0/3048808015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a101a1b20 con 0x7f8a101071e0 2023-12-11T20:31:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.682+0000 7f8a0dffb700 1 -- 172.21.15.12:0/3048808015 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8a0801d480 con 0x7f8a101071e0 2023-12-11T20:31:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.684+0000 7f8a0dffb700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a000a1500 0x7f8a000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.684+0000 7f8a0dffb700 1 -- 172.21.15.12:0/3048808015 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a080cdca0 con 0x7f8a101071e0 2023-12-11T20:31:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.684+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a000a1500 0x7f8a000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.684+0000 7f8a2aa68b80 1 Processor -- start 2023-12-11T20:31:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.685+0000 7f8a2aa68b80 1 -- start start 2023-12-11T20:31:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.685+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a000a1500 0x7f8a000a39c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009d20 tx=0x7f8a04009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.685+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.685+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50a5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.685+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a5c20 0x5610b50a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.685+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b4fffb50 con 0x5610b50a5c20 2023-12-11T20:31:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.685+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b4ffd470 con 0x5610b50a4d30 2023-12-11T20:31:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.685+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b4ff8d60 con 0x5610b50a43d0 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a1579c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a5c20 0x5610b50a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a0ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a1579c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a5c20 0x5610b50a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39132/0 (socket says 172.21.15.12:39132) 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50a47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40774/0 (socket says 172.21.15.12:40774) 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a1579c700 1 -- 172.21.15.12:0/197234436 learned_addr learned my addr 172.21.15.12:0/197234436 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a0ffff700 1 -- 172.21.15.12:0/197234436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 msgr2=0x5610b50a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/197234436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a0ffff700 1 -- 172.21.15.12:0/197234436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a5c20 msgr2=0x5610b50a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/197234436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a5c20 0x5610b50a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a0ffff700 1 -- 172.21.15.12:0/197234436 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b4e75630 con 0x5610b50a4d30 2023-12-11T20:31:53.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a1579c700 1 --2- 172.21.15.12:0/197234436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a5c20 0x5610b50a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:53.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.686+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/197234436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50a5640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00bc80 tx=0x7f89fc00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a04c48725f21f891 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.687+0000 7f89faffd700 1 -- 172.21.15.12:0/197234436 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010ca0 con 0x5610b50a4d30 2023-12-11T20:31:53.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.687+0000 7f89faffd700 1 -- 172.21.15.12:0/197234436 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89fc015070 con 0x5610b50a4d30 2023-12-11T20:31:53.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.687+0000 7f89faffd700 1 -- 172.21.15.12:0/197234436 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc004e60 con 0x5610b50a4d30 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/197234436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 msgr2=0x5610b50a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/197234436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50a5640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00bc80 tx=0x7f89fc00bf90 comp rx=0 tx=0).stop 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/197234436 shutdown_connections 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/197234436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a5c20 0x5610b50a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/197234436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/197234436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50a5640 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/197234436 >> 172.21.15.12:0/197234436 conn(0x5610b4fd37e0 msgr2=0x5610b50a0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/197234436 shutdown_connections 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/197234436 wait complete. 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.688+0000 7f8a2aa68b80 1 -- start start 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.689+0000 7f8a2aa68b80 1 Processor -- start 2023-12-11T20:31:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.689+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.689+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.689+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a5c20 0x5610b50b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.689+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b4fb2560 con 0x5610b50a43d0 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.689+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b4fb2200 con 0x5610b50a4d30 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.689+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b4e77920 con 0x5610b50a5c20 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.689+0000 7f8a2aa68b80 10 client.0 _ll_register_callbacks cb 0x5610b4edda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a0ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50ae1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39136/0 (socket says 172.21.15.12:39136) 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a14f9b700 1 -- 172.21.15.12:0/3878635374 learned_addr learned my addr 172.21.15.12:0/3878635374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a1579c700 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a5c20 0x5610b50b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a14f9b700 1 -- 172.21.15.12:0/3878635374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a5c20 msgr2=0x5610b50b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a5c20 0x5610b50b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a14f9b700 1 -- 172.21.15.12:0/3878635374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 msgr2=0x5610b50ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a14f9b700 1 -- 172.21.15.12:0/3878635374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a101a1b20 con 0x5610b50a43d0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.690+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.691+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50ae1b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f8a0401dd40 tx=0x7f8a040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e487ff72270ae981 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.691+0000 7f89effff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.691+0000 7f89effff700 1 -- 172.21.15.12:0/3878635374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04022070 con 0x5610b50a43d0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.691+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3878635374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610b5097b40 con 0x5610b50a43d0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.691+0000 7f89effff700 1 -- 172.21.15.12:0/3878635374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a0401cdb0 con 0x5610b50a43d0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.691+0000 7f89effff700 1 -- 172.21.15.12:0/3878635374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a04031430 con 0x5610b50a43d0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.691+0000 7f8a2aa68b80 10 client.20034 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.691+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3878635374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f89fc00b8e0 con 0x5610b50a43d0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.692+0000 7f89effff700 1 -- 172.21.15.12:0/3878635374 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a04035080 con 0x5610b50a43d0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.692+0000 7f89effff700 1 -- 172.21.15.12:0/3878635374 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a040265d0 con 0x5610b50a43d0 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.692+0000 7f8a2aa68b80 10 client.20034 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.692+0000 7f8a2aa68b80 10 client.20034 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:31:53.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.692+0000 7f8a2aa68b80 20 client.20034 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.692+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5610b50b9fd0 0x5610b50bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.692+0000 7f8a2aa68b80 4 client.20034 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.692+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3878635374 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610b5073f40 con 0x5610b50b9fd0 2023-12-11T20:31:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.693+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5610b50b9fd0 0x5610b50bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.693+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5610b50b9fd0 0x5610b50bc3f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c9c20c029e45825 server_cookie=e3e50fd01751be06 in_seq=0 out_seq=0 2023-12-11T20:31:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.693+0000 7f89effff700 10 client.20034 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:31:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.694+0000 7f89effff700 1 -- 172.21.15.12:0/3878635374 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5610b5073f40 con 0x5610b50b9fd0 2023-12-11T20:31:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.694+0000 7f89effff700 10 client.20034 handle_command_reply: tid=0 2023-12-11T20:31:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.694+0000 7f8a2aa68b80 1 client.20034 shutdown 2023-12-11T20:31:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.694+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3878635374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 msgr2=0x5610b50ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.694+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50ae1b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f8a0401dd40 tx=0x7f8a040047c0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3878635374 shutdown_connections 2023-12-11T20:31:53.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5610b50b9fd0 0x5610b50bc3f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a5c20 0x5610b50b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50ae1b0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3878635374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a4d30 0x5610b50ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3878635374 >> 172.21.15.12:0/3878635374 conn(0x5610b4fd37e0 msgr2=0x5610b509fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f89effff700 0 client.20034 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:31:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3878635374 shutdown_connections 2023-12-11T20:31:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3878635374 wait complete. 2023-12-11T20:31:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.695+0000 7f8a2aa68b80 20 client.20034 trim_cache size 0 max 16384 2023-12-11T20:31:53.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.714+0000 7f8a2aa68b80 1 Processor -- start 2023-12-11T20:31:53.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a2aa68b80 1 -- start start 2023-12-11T20:31:53.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a4d30 0x5610b50a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b50a96d0 con 0x5610b50a43d0 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b50a5850 con 0x5610b50a5c20 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b50978d0 con 0x5610b50a4d30 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50a8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39152/0 (socket says 172.21.15.12:39152) 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a14f9b700 1 -- 172.21.15.12:0/3013951700 learned_addr learned my addr 172.21.15.12:0/3013951700 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a4d30 0x5610b50a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.715+0000 7f8a1579c700 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f8a0ffff700 1 -- 172.21.15.12:0/3013951700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 msgr2=0x5610b50b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f8a0ffff700 1 -- 172.21.15.12:0/3013951700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 msgr2=0x5610b50a8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50a8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f8a0ffff700 1 -- 172.21.15.12:0/3013951700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b4e21de0 con 0x5610b50a4d30 2023-12-11T20:31:53.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f8a1579c700 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:53.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a4d30 0x5610b50a90d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000c00 tx=0x7f89fc005990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6206007768304cc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f89fb7fe700 1 -- 172.21.15.12:0/3013951700 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc020040 con 0x5610b50a4d30 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f89fb7fe700 1 -- 172.21.15.12:0/3013951700 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89fc021040 con 0x5610b50a4d30 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.716+0000 7f89fb7fe700 1 -- 172.21.15.12:0/3013951700 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc028870 con 0x5610b50a4d30 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3013951700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a4d30 msgr2=0x5610b50a90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a4d30 0x5610b50a90d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000c00 tx=0x7f89fc005990 comp rx=0 tx=0).stop 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3013951700 shutdown_connections 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a43d0 0x5610b50a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/3013951700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a4d30 0x5610b50a90d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3013951700 >> 172.21.15.12:0/3013951700 conn(0x5610b4fd37e0 msgr2=0x5610b50c0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3013951700 shutdown_connections 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.717+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/3013951700 wait complete. 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.718+0000 7f8a2aa68b80 1 -- start start 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.718+0000 7f8a2aa68b80 1 Processor -- start 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.718+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.718+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a4d30 0x5610b50b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.718+0000 7f8a2aa68b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.718+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b50b4e60 con 0x5610b50a4d30 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.718+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b50b4fd0 con 0x5610b50a5c20 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.718+0000 7f8a2aa68b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b50b5190 con 0x5610b50a43d0 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a2aa68b80 10 client.0 _ll_register_callbacks cb 0x5610b4edda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a0ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a4d30 0x5610b50b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a0ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a4d30 0x5610b50b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39154/0 (socket says 172.21.15.12:39154) 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a14f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a0ffff700 1 -- 172.21.15.12:0/1723817132 learned_addr learned my addr 172.21.15.12:0/1723817132 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a1579c700 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a0ffff700 1 -- 172.21.15.12:0/1723817132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 msgr2=0x5610b50b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a0ffff700 1 -- 172.21.15.12:0/1723817132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 msgr2=0x5610b50b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a0ffff700 1 -- 172.21.15.12:0/1723817132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc00b8e0 con 0x5610b50a4d30 2023-12-11T20:31:53.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.719+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:53.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.720+0000 7f8a0ffff700 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a4d30 0x5610b50b3a50 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00bfd0 tx=0x7f89fc010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28433b480ac5a769 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.720+0000 7f89effff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.720+0000 7f89effff700 1 -- 172.21.15.12:0/1723817132 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc004810 con 0x5610b50a4d30 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.720+0000 7f89effff700 1 -- 172.21.15.12:0/1723817132 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f89fc037070 con 0x5610b50a4d30 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.720+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/1723817132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89fc015070 con 0x5610b50a4d30 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.720+0000 7f89effff700 1 -- 172.21.15.12:0/1723817132 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89fc028570 con 0x5610b50a4d30 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.720+0000 7f8a2aa68b80 10 client.20040 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.720+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/1723817132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5610b4e75630 con 0x5610b50a4d30 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f89effff700 1 -- 172.21.15.12:0/1723817132 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89fc015070 con 0x5610b50a4d30 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f89effff700 1 -- 172.21.15.12:0/1723817132 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f89fc031c80 con 0x5610b50a4d30 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f8a2aa68b80 10 client.20040 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f8a2aa68b80 10 client.20040 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f8a2aa68b80 20 client.20040 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5610b5110e70 0x5610b5113290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f8a2aa68b80 4 client.20040 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/1723817132 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5610b4fbefd0 con 0x5610b5110e70 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.721+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5610b5110e70 0x5610b5113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a14f9b700 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5610b5110e70 0x5610b5113290 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=462adafa367288d6 server_cookie=a19f2f10ad1bbf3e in_seq=0 out_seq=0 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f89effff700 10 client.20040 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f89effff700 1 -- 172.21.15.12:0/1723817132 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5610b4fbefd0 con 0x5610b5110e70 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f89effff700 10 client.20040 handle_command_reply: tid=0 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 client.20040 shutdown 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/1723817132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a4d30 msgr2=0x5610b50b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a4d30 0x5610b50b3a50 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00bfd0 tx=0x7f89fc010d30 comp rx=0 tx=0).stop 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/1723817132 shutdown_connections 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5610b5110e70 0x5610b5113290 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5610b50a5c20 0x5610b50b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5610b50a43d0 0x5610b50b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 --2- 172.21.15.12:0/1723817132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610b50a4d30 0x5610b50b3a50 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f89effff700 0 client.20040 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:31:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.722+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/1723817132 >> 172.21.15.12:0/1723817132 conn(0x5610b4fd37e0 msgr2=0x5610b50a8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/1723817132 shutdown_connections 2023-12-11T20:31:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a2aa68b80 1 -- 172.21.15.12:0/1723817132 wait complete. 2023-12-11T20:31:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a2aa68b80 20 client.20040 trim_cache size 0 max 16384 2023-12-11T20:31:53.725 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a171ff700 1 -- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a000a1500 msgr2=0x7f8a000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a171ff700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a000a1500 0x7f8a000a39c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009d20 tx=0x7f8a04009260 comp rx=0 tx=0).stop 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a171ff700 1 -- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 msgr2=0x7f8a101a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a171ff700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 0x7f8a101a0b80 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800b070 tx=0x7f8a0800bab0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a171ff700 1 -- 172.21.15.12:0/3048808015 shutdown_connections 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a171ff700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a000a1500 0x7f8a000a39c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.723+0000 7f8a171ff700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a101071e0 0x7f8a101a0b80 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.724+0000 7f8a171ff700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a10101f80 0x7f8a10199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.724+0000 7f8a171ff700 1 --2- 172.21.15.12:0/3048808015 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a101048b0 0x7f8a10199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.724+0000 7f8a171ff700 1 -- 172.21.15.12:0/3048808015 >> 172.21.15.12:0/3048808015 conn(0x7f8a100fb930 msgr2=0x7f8a10101760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.724+0000 7f8a171ff700 1 -- 172.21.15.12:0/3048808015 shutdown_connections 2023-12-11T20:31:53.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.724+0000 7f8a171ff700 1 -- 172.21.15.12:0/3048808015 wait complete. 2023-12-11T20:31:53.742 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:31:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.978+0000 7f45db39d700 1 -- 172.21.15.12:0/1781545896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d4101d70 msgr2=0x7f45d4104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.978+0000 7f45db39d700 1 --2- 172.21.15.12:0/1781545896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d4101d70 0x7f45d4104160 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009990 tx=0x7f45d0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.979+0000 7f45db39d700 1 -- 172.21.15.12:0/1781545896 shutdown_connections 2023-12-11T20:31:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.979+0000 7f45db39d700 1 --2- 172.21.15.12:0/1781545896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45d4106fd0 0x7f45d4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.979+0000 7f45db39d700 1 --2- 172.21.15.12:0/1781545896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d4101d70 0x7f45d4104160 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.979+0000 7f45db39d700 1 --2- 172.21.15.12:0/1781545896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45d41046a0 0x7f45d4106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.979+0000 7f45db39d700 1 -- 172.21.15.12:0/1781545896 >> 172.21.15.12:0/1781545896 conn(0x7f45d40fb740 msgr2=0x7f45d40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.979+0000 7f45db39d700 1 -- 172.21.15.12:0/1781545896 shutdown_connections 2023-12-11T20:31:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.979+0000 7f45db39d700 1 -- 172.21.15.12:0/1781545896 wait complete. 2023-12-11T20:31:53.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.980+0000 7f45db39d700 1 Processor -- start 2023-12-11T20:31:53.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.980+0000 7f45db39d700 1 -- start start 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45db39d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45d4101d70 0x7f45d4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45db39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d41046a0 0x7f45d41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45db39d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45d4106fd0 0x7f45d41a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45db39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d41a0dc0 con 0x7f45d41046a0 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45db39d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d41a0f00 con 0x7f45d4101d70 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45db39d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d41a1090 con 0x7f45d4106fd0 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45d9b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d41046a0 0x7f45d41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45da39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45d4101d70 0x7f45d4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45d9b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d41046a0 0x7f45d41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39168/0 (socket says 172.21.15.12:39168) 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45d9b9a700 1 -- 172.21.15.12:0/469627251 learned_addr learned my addr 172.21.15.12:0/469627251 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.981+0000 7f45dab9c700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45d4106fd0 0x7f45d41a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45d9b9a700 1 -- 172.21.15.12:0/469627251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45d4106fd0 msgr2=0x7f45d41a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45d4106fd0 0x7f45d41a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45d9b9a700 1 -- 172.21.15.12:0/469627251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45d4101d70 msgr2=0x7f45d4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45d4101d70 0x7f45d4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45d9b9a700 1 -- 172.21.15.12:0/469627251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4009520 con 0x7f45d41046a0 2023-12-11T20:31:53.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45da39b700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45d4101d70 0x7f45d4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:53.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d41046a0 0x7f45d41997d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f45c400eb30 tx=0x7f45c400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45cb7fe700 1 -- 172.21.15.12:0/469627251 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4009880 con 0x7f45d41046a0 2023-12-11T20:31:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45cb7fe700 1 -- 172.21.15.12:0/469627251 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45c40044b0 con 0x7f45d41046a0 2023-12-11T20:31:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45cb7fe700 1 -- 172.21.15.12:0/469627251 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4003ce0 con 0x7f45d41046a0 2023-12-11T20:31:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.982+0000 7f45db39d700 1 -- 172.21.15.12:0/469627251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d00095f0 con 0x7f45d41046a0 2023-12-11T20:31:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.983+0000 7f45db39d700 1 -- 172.21.15.12:0/469627251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d41a16a0 con 0x7f45d41046a0 2023-12-11T20:31:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.986+0000 7f45cb7fe700 1 -- 172.21.15.12:0/469627251 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f45c4003e40 con 0x7f45d41046a0 2023-12-11T20:31:53.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.987+0000 7f45efe96b80 1 Processor -- start 2023-12-11T20:31:53.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.987+0000 7f45efe96b80 1 -- start start 2023-12-11T20:31:53.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5501a60 0x55e1a5501e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a55028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a5503240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45efe96b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a545cb50 con 0x55e1a5502de0 2023-12-11T20:31:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45efe96b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a545a470 con 0x55e1a5501a60 2023-12-11T20:31:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45efe96b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a5455d60 con 0x55e1a55023c0 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45d9b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a5503240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45dab9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5501a60 0x55e1a5501e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45d9b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a5503240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39176/0 (socket says 172.21.15.12:39176) 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45d9b9a700 1 -- 172.21.15.12:0/2997846655 learned_addr learned my addr 172.21.15.12:0/2997846655 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45cb7fe700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45c00a15a0 0x7f45c00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.988+0000 7f45da39b700 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a55028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45cb7fe700 1 -- 172.21.15.12:0/469627251 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f45c4014070 con 0x7f45d41046a0 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45dab9c700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45c00a15a0 0x7f45c00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45da39b700 1 -- 172.21.15.12:0/2997846655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5501a60 msgr2=0x55e1a5501e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45da39b700 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5501a60 0x55e1a5501e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45da39b700 1 -- 172.21.15.12:0/2997846655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 msgr2=0x55e1a5503240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45da39b700 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a5503240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45da39b700 1 -- 172.21.15.12:0/2997846655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1a52d2630 con 0x55e1a55023c0 2023-12-11T20:31:53.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a5503240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:53.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45da39b700 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a55028a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f45d0003f60 tx=0x7f45d0005ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94f8770034ba0bff server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45dab9c700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45c00a15a0 0x7f45c00a3a60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009ec0 tx=0x7f45cc004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.989+0000 7f45c8bfe700 1 -- 172.21.15.12:0/2997846655 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0028070 con 0x55e1a55023c0 2023-12-11T20:31:53.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45c8bfe700 1 -- 172.21.15.12:0/2997846655 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45d00238d0 con 0x55e1a55023c0 2023-12-11T20:31:53.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45c8bfe700 1 -- 172.21.15.12:0/2997846655 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00052a0 con 0x55e1a55023c0 2023-12-11T20:31:53.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45efe96b80 1 -- 172.21.15.12:0/2997846655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 msgr2=0x55e1a55028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45efe96b80 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a55028a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f45d0003f60 tx=0x7f45d0005ea0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45efe96b80 1 -- 172.21.15.12:0/2997846655 shutdown_connections 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45efe96b80 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5501a60 0x55e1a5501e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45efe96b80 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a5503240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45efe96b80 1 --2- 172.21.15.12:0/2997846655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a55028a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.990+0000 7f45efe96b80 1 -- 172.21.15.12:0/2997846655 >> 172.21.15.12:0/2997846655 conn(0x55e1a54307e0 msgr2=0x55e1a54fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.991+0000 7f45efe96b80 1 -- 172.21.15.12:0/2997846655 shutdown_connections 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.991+0000 7f45efe96b80 1 -- 172.21.15.12:0/2997846655 wait complete. 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.991+0000 7f45efe96b80 1 -- start start 2023-12-11T20:31:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.991+0000 7f45efe96b80 1 Processor -- start 2023-12-11T20:31:53.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a550b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a550b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5502de0 0x55e1a5512830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45efe96b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a540f560 con 0x55e1a5501a60 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45efe96b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a540f200 con 0x55e1a5502de0 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45efe96b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a52d4920 con 0x55e1a55023c0 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45efe96b80 10 client.0 _ll_register_callbacks cb 0x55e1a533aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45da39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a550b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45da39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a550b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39180/0 (socket says 172.21.15.12:39180) 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45da39b700 1 -- 172.21.15.12:0/282108428 learned_addr learned my addr 172.21.15.12:0/282108428 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a550b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.992+0000 7f45dab9c700 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5502de0 0x55e1a5512830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45da39b700 1 -- 172.21.15.12:0/282108428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 msgr2=0x55e1a550b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45da39b700 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a550b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45da39b700 1 -- 172.21.15.12:0/282108428 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5502de0 msgr2=0x55e1a5512830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45da39b700 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5502de0 0x55e1a5512830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45da39b700 1 -- 172.21.15.12:0/282108428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d41a16a0 con 0x55e1a5501a60 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45da39b700 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a550b2b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009350 tx=0x7f45d0003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22cb76822caa423 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45bdffb700 1 -- 172.21.15.12:0/282108428 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0028040 con 0x55e1a5501a60 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45bdffb700 1 -- 172.21.15.12:0/282108428 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f45d000b710 con 0x55e1a5501a60 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.993+0000 7f45efe96b80 1 -- 172.21.15.12:0/282108428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1a54f49e0 con 0x55e1a5501a60 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45bdffb700 1 -- 172.21.15.12:0/282108428 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45d0003d50 con 0x55e1a5501a60 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45efe96b80 10 client.20052 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45efe96b80 1 -- 172.21.15.12:0/282108428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f45d410a030 con 0x55e1a5501a60 2023-12-11T20:31:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45bdffb700 1 -- 172.21.15.12:0/282108428 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e1a54f49e0 con 0x55e1a5501a60 2023-12-11T20:31:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45bdffb700 1 -- 172.21.15.12:0/282108428 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f45d0004960 con 0x55e1a5501a60 2023-12-11T20:31:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45efe96b80 10 client.20052 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45efe96b80 10 client.20052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45efe96b80 20 client.20052 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45efe96b80 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a5516bd0 0x55e1a5518fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45efe96b80 4 client.20052 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.994+0000 7f45efe96b80 1 -- 172.21.15.12:0/282108428 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1a54d0f40 con 0x55e1a5516bd0 2023-12-11T20:31:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.995+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a5516bd0 0x55e1a5518fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.996+0000 7f45bdffb700 10 client.20052 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.996+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a5516bd0 0x55e1a5518fc0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f51ce6b3246c164d server_cookie=4755de238f7fb088 in_seq=0 out_seq=0 2023-12-11T20:31:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.996+0000 7f45bdffb700 1 -- 172.21.15.12:0/282108428 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e1a54d0f40 con 0x55e1a5516bd0 2023-12-11T20:31:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.996+0000 7f45bdffb700 10 client.20052 handle_command_reply: tid=0 2023-12-11T20:31:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.996+0000 7f45efe96b80 1 client.20052 shutdown 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 -- 172.21.15.12:0/282108428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 msgr2=0x55e1a550b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a550b2b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009350 tx=0x7f45d0003ab0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 -- 172.21.15.12:0/282108428 shutdown_connections 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a5516bd0 0x55e1a5518fc0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a5502de0 0x55e1a5512830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a550b2b0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45bdffb700 0 client.20052 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 --2- 172.21.15.12:0/282108428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a55023c0 0x55e1a550b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 -- 172.21.15.12:0/282108428 >> 172.21.15.12:0/282108428 conn(0x55e1a54307e0 msgr2=0x55e1a5500820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 -- 172.21.15.12:0/282108428 shutdown_connections 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 1 -- 172.21.15.12:0/282108428 wait complete. 2023-12-11T20:31:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:53.997+0000 7f45efe96b80 20 client.20052 trim_cache size 0 max 16384 2023-12-11T20:31:54.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.011+0000 7f45efe96b80 1 Processor -- start 2023-12-11T20:31:54.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.011+0000 7f45efe96b80 1 -- start start 2023-12-11T20:31:54.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.011+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5501a60 0x55e1a5512ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:54.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.011+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 0x55e1a55127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:54.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a550a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:54.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45efe96b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a54f71e0 con 0x55e1a5502de0 2023-12-11T20:31:54.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45efe96b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a550c340 con 0x55e1a55023c0 2023-12-11T20:31:54.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45efe96b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a54f8b30 con 0x55e1a5501a60 2023-12-11T20:31:54.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45dab9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a550a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:54.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45dab9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a550a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39194/0 (socket says 172.21.15.12:39194) 2023-12-11T20:31:54.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45dab9c700 1 -- 172.21.15.12:0/1883920861 learned_addr learned my addr 172.21.15.12:0/1883920861 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:54.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45da39b700 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5501a60 0x55e1a5512ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 0x55e1a55127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45dab9c700 1 -- 172.21.15.12:0/1883920861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5501a60 msgr2=0x55e1a5512ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45dab9c700 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5501a60 0x55e1a5512ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45dab9c700 1 -- 172.21.15.12:0/1883920861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 msgr2=0x55e1a55127f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45dab9c700 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 0x55e1a55127f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.012+0000 7f45dab9c700 1 -- 172.21.15.12:0/1883920861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1a527ede0 con 0x55e1a5502de0 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.013+0000 7f45dab9c700 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a550a7c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f45cc018740 tx=0x7f45cc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db7f289784a4172 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.013+0000 7f45c93ff700 1 -- 172.21.15.12:0/1883920861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00e040 con 0x55e1a5502de0 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.013+0000 7f45c93ff700 1 -- 172.21.15.12:0/1883920861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45cc00f040 con 0x55e1a5502de0 2023-12-11T20:31:54.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.013+0000 7f45c93ff700 1 -- 172.21.15.12:0/1883920861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc026840 con 0x55e1a5502de0 2023-12-11T20:31:54.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 -- 172.21.15.12:0/1883920861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 msgr2=0x55e1a550a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:54.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a550a7c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f45cc018740 tx=0x7f45cc009920 comp rx=0 tx=0).stop 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 -- 172.21.15.12:0/1883920861 shutdown_connections 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5502de0 0x55e1a550a7c0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5501a60 0x55e1a5512ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 --2- 172.21.15.12:0/1883920861 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 0x55e1a55127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 -- 172.21.15.12:0/1883920861 >> 172.21.15.12:0/1883920861 conn(0x55e1a54307e0 msgr2=0x55e1a54fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 -- 172.21.15.12:0/1883920861 shutdown_connections 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.014+0000 7f45efe96b80 1 -- 172.21.15.12:0/1883920861 wait complete. 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.015+0000 7f45efe96b80 1 -- start start 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.015+0000 7f45efe96b80 1 Processor -- start 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a5510700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 0x55e1a5510c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:54.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45efe96b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5502de0 0x55e1a5511bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:54.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45efe96b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a55120f0 con 0x55e1a5501a60 2023-12-11T20:31:54.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45efe96b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a5512260 con 0x55e1a55023c0 2023-12-11T20:31:54.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45efe96b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a5512420 con 0x55e1a5502de0 2023-12-11T20:31:54.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45efe96b80 10 client.0 _ll_register_callbacks cb 0x55e1a533aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45da39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a5510700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45da39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a5510700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39200/0 (socket says 172.21.15.12:39200) 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45da39b700 1 -- 172.21.15.12:0/3505160337 learned_addr learned my addr 172.21.15.12:0/3505160337 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 0x55e1a5510c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45dab9c700 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5502de0 0x55e1a5511bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45da39b700 1 -- 172.21.15.12:0/3505160337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5502de0 msgr2=0x55e1a5511bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45da39b700 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5502de0 0x55e1a5511bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45da39b700 1 -- 172.21.15.12:0/3505160337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 msgr2=0x55e1a5510c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45da39b700 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 0x55e1a5510c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.016+0000 7f45da39b700 1 -- 172.21.15.12:0/3505160337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc009310 con 0x55e1a5501a60 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.017+0000 7f45da39b700 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a5510700 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f45d0003f60 tx=0x7f45d0005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886dd92a25e39ba0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.017+0000 7f45bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.017+0000 7f45bdffb700 1 -- 172.21.15.12:0/3505160337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0044070 con 0x55e1a5501a60 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.017+0000 7f45efe96b80 1 -- 172.21.15.12:0/3505160337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45d00238d0 con 0x55e1a5501a60 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.017+0000 7f45bdffb700 1 -- 172.21.15.12:0/3505160337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f45d0000e40 con 0x55e1a5501a60 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.017+0000 7f45bdffb700 1 -- 172.21.15.12:0/3505160337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45d0028070 con 0x55e1a5501a60 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45efe96b80 10 client.20058 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45efe96b80 1 -- 172.21.15.12:0/3505160337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e1a5267c60 con 0x55e1a5501a60 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45bdffb700 1 -- 172.21.15.12:0/3505160337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45d004e020 con 0x55e1a5501a60 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45bdffb700 1 -- 172.21.15.12:0/3505160337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f45d0047030 con 0x55e1a5501a60 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45efe96b80 10 client.20058 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45efe96b80 10 client.20058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45efe96b80 20 client.20058 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45efe96b80 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a556dce0 0x55e1a5570100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45efe96b80 4 client.20058 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:31:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.018+0000 7f45efe96b80 1 -- 172.21.15.12:0/3505160337 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e1a541bfd0 con 0x55e1a556dce0 2023-12-11T20:31:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.019+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a556dce0 0x55e1a5570100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.019+0000 7f45d9b9a700 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a556dce0 0x55e1a5570100 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b481df0722add35e server_cookie=fbbfc3766677f81f in_seq=0 out_seq=0 2023-12-11T20:31:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.019+0000 7f45bdffb700 10 client.20058 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.019+0000 7f45bdffb700 1 -- 172.21.15.12:0/3505160337 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e1a541bfd0 con 0x55e1a556dce0 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.019+0000 7f45bdffb700 10 client.20058 handle_command_reply: tid=0 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.019+0000 7f45efe96b80 1 client.20058 shutdown 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 -- 172.21.15.12:0/3505160337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 msgr2=0x55e1a5510700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a5510700 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f45d0003f60 tx=0x7f45d0005490 comp rx=0 tx=0).stop 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 -- 172.21.15.12:0/3505160337 shutdown_connections 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e1a556dce0 0x55e1a5570100 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1a5502de0 0x55e1a5511bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1a5501a60 0x55e1a5510700 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45bdffb700 0 client.20058 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 --2- 172.21.15.12:0/3505160337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e1a55023c0 0x55e1a5510c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 -- 172.21.15.12:0/3505160337 >> 172.21.15.12:0/3505160337 conn(0x55e1a54307e0 msgr2=0x55e1a54fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 -- 172.21.15.12:0/3505160337 shutdown_connections 2023-12-11T20:31:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 1 -- 172.21.15.12:0/3505160337 wait complete. 2023-12-11T20:31:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.020+0000 7f45efe96b80 20 client.20058 trim_cache size 0 max 16384 2023-12-11T20:31:54.022 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 -- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45c00a15a0 msgr2=0x7f45c00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45c00a15a0 0x7f45c00a3a60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009ec0 tx=0x7f45cc004b40 comp rx=0 tx=0).stop 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 -- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d41046a0 msgr2=0x7f45d41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d41046a0 0x7f45d41997d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f45c400eb30 tx=0x7f45c400ee40 comp rx=0 tx=0).stop 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 -- 172.21.15.12:0/469627251 shutdown_connections 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f45c00a15a0 0x7f45c00a3a60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45d4101d70 0x7f45d4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45d4106fd0 0x7f45d41a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 --2- 172.21.15.12:0/469627251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45d41046a0 0x7f45d41997d0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 -- 172.21.15.12:0/469627251 >> 172.21.15.12:0/469627251 conn(0x7f45d40fb740 msgr2=0x7f45d41014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:54.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 -- 172.21.15.12:0/469627251 shutdown_connections 2023-12-11T20:31:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:54.021+0000 7f45db39d700 1 -- 172.21.15.12:0/469627251 wait complete. 2023-12-11T20:31:54.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:54 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3098477622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:31:54.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:54 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3098477622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:31:54.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:54 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3098477622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:31:55.039 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:31:55.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:31:55.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/4245776064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b641026a0 msgr2=0x7f7b64102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/4245776064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b641026a0 0x7f7b64102b00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7b540099c0 tx=0x7f7b54009cd0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/4245776064 shutdown_connections 2023-12-11T20:31:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/4245776064 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b64103040 0x7f7b641098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/4245776064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641014b0 0x7f7b641018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/4245776064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b641026a0 0x7f7b64102b00 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/4245776064 >> 172.21.15.12:0/4245776064 conn(0x7f7b640fca00 msgr2=0x7f7b640fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/4245776064 shutdown_connections 2023-12-11T20:31:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.283+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/4245776064 wait complete. 2023-12-11T20:31:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.284+0000 7f7b6c3ff700 1 Processor -- start 2023-12-11T20:31:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.284+0000 7f7b6c3ff700 1 -- start start 2023-12-11T20:31:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6c3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641014b0 0x7f7b64199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6c3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b641026a0 0x7f7b64199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6c3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b64103040 0x7f7b641a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6c3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641a1080 con 0x7f7b64103040 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6c3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641a11c0 con 0x7f7b641026a0 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6c3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641a1350 con 0x7f7b641014b0 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641014b0 0x7f7b64199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b64103040 0x7f7b641a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641014b0 0x7f7b64199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40850/0 (socket says 172.21.15.12:40850) 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6a19b700 1 -- 172.21.15.12:0/3831666453 learned_addr learned my addr 172.21.15.12:0/3831666453 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.285+0000 7f7b6999a700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b641026a0 0x7f7b64199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b6a99c700 1 -- 172.21.15.12:0/3831666453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641014b0 msgr2=0x7f7b64199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641014b0 0x7f7b64199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b6a99c700 1 -- 172.21.15.12:0/3831666453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b641026a0 msgr2=0x7f7b64199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b641026a0 0x7f7b64199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b6a99c700 1 -- 172.21.15.12:0/3831666453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b540095f0 con 0x7f7b64103040 2023-12-11T20:31:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641014b0 0x7f7b64199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b64103040 0x7f7b641a0ab0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00efc0 tx=0x7f7b5c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b5b7fe700 1 -- 172.21.15.12:0/3831666453 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c018070 con 0x7f7b64103040 2023-12-11T20:31:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b5b7fe700 1 -- 172.21.15.12:0/3831666453 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b5c00f040 con 0x7f7b64103040 2023-12-11T20:31:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/3831666453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b641a15d0 con 0x7f7b64103040 2023-12-11T20:31:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.286+0000 7f7b5b7fe700 1 -- 172.21.15.12:0/3831666453 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00cba0 con 0x7f7b64103040 2023-12-11T20:31:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.287+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/3831666453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b641a1a90 con 0x7f7b64103040 2023-12-11T20:31:55.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.290+0000 7f7b5b7fe700 1 -- 172.21.15.12:0/3831666453 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7b5c003a00 con 0x7f7b64103040 2023-12-11T20:31:55.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.291+0000 7f7b7fd3ab80 1 Processor -- start 2023-12-11T20:31:55.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.291+0000 7f7b7fd3ab80 1 -- start start 2023-12-11T20:31:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe4023bd0 con 0x560fe40c9ca0 2023-12-11T20:31:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe40214f0 con 0x560fe40c8db0 2023-12-11T20:31:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe401cde0 con 0x560fe40c8450 2023-12-11T20:31:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b6999a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b6999a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40866/0 (socket says 172.21.15.12:40866) 2023-12-11T20:31:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b6999a700 1 -- 172.21.15.12:0/2377209240 learned_addr learned my addr 172.21.15.12:0/2377209240 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.292+0000 7f7b6999a700 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6999a700 1 -- 172.21.15.12:0/2377209240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 msgr2=0x560fe40c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6999a700 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6999a700 1 -- 172.21.15.12:0/2377209240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 msgr2=0x560fe40ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6999a700 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6999a700 1 -- 172.21.15.12:0/2377209240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fe3e996b0 con 0x560fe40c8450 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b5b7fe700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7b500a1480 0x7f7b500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b5b7fe700 1 -- 172.21.15.12:0/3831666453 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7b5c0cc850 con 0x7f7b64103040 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6999a700 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c8870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7b54005cd0 tx=0x7f7b54009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d478385bef9ac906 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.293+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7b500a1480 0x7f7b500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.294+0000 7f7b58bfe700 1 -- 172.21.15.12:0/2377209240 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54005110 con 0x560fe40c8450 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.294+0000 7f7b58bfe700 1 -- 172.21.15.12:0/2377209240 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b5401e070 con 0x560fe40c8450 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.294+0000 7f7b58bfe700 1 -- 172.21.15.12:0/2377209240 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54003db0 con 0x560fe40c8450 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.294+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2377209240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 msgr2=0x560fe40c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.294+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7b500a1480 0x7f7b500a3940 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009fd0 tx=0x7f7b60009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.294+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c8870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7b54005cd0 tx=0x7f7b54009310 comp rx=0 tx=0).stop 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.295+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2377209240 shutdown_connections 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.295+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.295+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c8870 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.295+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2377209240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.295+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2377209240 >> 172.21.15.12:0/2377209240 conn(0x560fe3ff7860 msgr2=0x560fe40c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.295+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2377209240 shutdown_connections 2023-12-11T20:31:55.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.295+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2377209240 wait complete. 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.295+0000 7f7b7fd3ab80 1 -- start start 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.296+0000 7f7b7fd3ab80 1 Processor -- start 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.296+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.296+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.296+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40d97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.296+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe3fd65e0 con 0x560fe40c9ca0 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.296+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe3fd6280 con 0x560fe40c8db0 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.296+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe3e9b9a0 con 0x560fe40c8450 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.296+0000 7f7b7fd3ab80 10 client.0 _ll_register_callbacks cb 0x560fe3f01b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40d97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40d97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39220/0 (socket says 172.21.15.12:39220) 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 -- 172.21.15.12:0/438085444 learned_addr learned my addr 172.21.15.12:0/438085444 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6999a700 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 -- 172.21.15.12:0/438085444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 msgr2=0x560fe40d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 -- 172.21.15.12:0/438085444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 msgr2=0x560fe40d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 -- 172.21.15.12:0/438085444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6410a240 con 0x560fe40c9ca0 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40d97b0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0090a0 tx=0x7f7b5c099600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd23d58c02a63443 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.297+0000 7f7b4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.298+0000 7f7b4dffb700 1 -- 172.21.15.12:0/438085444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c01b320 con 0x560fe40c9ca0 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.298+0000 7f7b4dffb700 1 -- 172.21.15.12:0/438085444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7b5c09a2b0 con 0x560fe40c9ca0 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.298+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/438085444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fe40bbbc0 con 0x560fe40c9ca0 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.298+0000 7f7b4dffb700 1 -- 172.21.15.12:0/438085444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b5c099bb0 con 0x560fe40c9ca0 2023-12-11T20:31:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.298+0000 7f7b7fd3ab80 10 client.20070 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.298+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/438085444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560fe3e45e60 con 0x560fe40c9ca0 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.298+0000 7f7b4dffb700 1 -- 172.21.15.12:0/438085444 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b5c0b6080 con 0x560fe40c9ca0 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.299+0000 7f7b4dffb700 1 -- 172.21.15.12:0/438085444 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7b5c0b2240 con 0x560fe40c9ca0 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.299+0000 7f7b7fd3ab80 10 client.20070 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.299+0000 7f7b7fd3ab80 10 client.20070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.299+0000 7f7b7fd3ab80 20 client.20070 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.299+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560fe40ddfd0 0x560fe40e03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.299+0000 7f7b7fd3ab80 4 client.20070 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.299+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/438085444 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fe4097fc0 con 0x560fe40ddfd0 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.299+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560fe40ddfd0 0x560fe40e03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.300+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560fe40ddfd0 0x560fe40e03f0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7ebd4f8385d817 server_cookie=cfa9126f8b5393d in_seq=0 out_seq=0 2023-12-11T20:31:55.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.300+0000 7f7b4dffb700 10 client.20070 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:55.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.300+0000 7f7b4dffb700 1 -- 172.21.15.12:0/438085444 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560fe4097fc0 con 0x560fe40ddfd0 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b4dffb700 10 client.20070 handle_command_reply: tid=0 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 client.20070 shutdown 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/438085444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 msgr2=0x560fe40d97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40d97b0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0090a0 tx=0x7f7b5c099600 comp rx=0 tx=0).stop 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/438085444 shutdown_connections 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560fe40ddfd0 0x560fe40e03f0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40d97b0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/438085444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/438085444 >> 172.21.15.12:0/438085444 conn(0x560fe3ff7860 msgr2=0x560fe40c3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b4dffb700 0 client.20070 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/438085444 shutdown_connections 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/438085444 wait complete. 2023-12-11T20:31:55.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.301+0000 7f7b7fd3ab80 20 client.20070 trim_cache size 0 max 16384 2023-12-11T20:31:55.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.319+0000 7f7b7fd3ab80 1 Processor -- start 2023-12-11T20:31:55.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.319+0000 7f7b7fd3ab80 1 -- start start 2023-12-11T20:31:55.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe40d1e00 con 0x560fe40c9ca0 2023-12-11T20:31:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe40d3260 con 0x560fe40c8db0 2023-12-11T20:31:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe40da960 con 0x560fe40c8450 2023-12-11T20:31:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b6a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b6a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b6a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40888/0 (socket says 172.21.15.12:40888) 2023-12-11T20:31:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b6a19b700 1 -- 172.21.15.12:0/3187079794 learned_addr learned my addr 172.21.15.12:0/3187079794 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.320+0000 7f7b6999a700 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b6a99c700 1 -- 172.21.15.12:0/3187079794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 msgr2=0x560fe40c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b6a99c700 1 -- 172.21.15.12:0/3187079794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 msgr2=0x560fe40d9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b6a99c700 1 -- 172.21.15.12:0/3187079794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fe3e2ece0 con 0x560fe40c9ca0 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b6999a700 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40c3230 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0990f0 tx=0x7f7b5c0094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44108d38a50e083f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b593ff700 1 -- 172.21.15.12:0/3187079794 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c09a2b0 con 0x560fe40c9ca0 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b593ff700 1 -- 172.21.15.12:0/3187079794 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560fe40bbbc0 con 0x560fe40c9ca0 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.321+0000 7f7b593ff700 1 -- 172.21.15.12:0/3187079794 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c099bb0 con 0x560fe40c9ca0 2023-12-11T20:31:55.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/3187079794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 msgr2=0x560fe40c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40c3230 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0990f0 tx=0x7f7b5c0094d0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/3187079794 shutdown_connections 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe40c3230 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8450 0x560fe40c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/3187079794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8db0 0x560fe40d9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/3187079794 >> 172.21.15.12:0/3187079794 conn(0x560fe3ff7860 msgr2=0x560fe40c49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/3187079794 shutdown_connections 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.322+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/3187079794 wait complete. 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.323+0000 7f7b7fd3ab80 1 -- start start 2023-12-11T20:31:55.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.323+0000 7f7b7fd3ab80 1 Processor -- start 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.323+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8450 0x560fe40d8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.323+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8db0 0x560fe40d9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.323+0000 7f7b7fd3ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe41347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.323+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe4134ce0 con 0x560fe40c9ca0 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.323+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe4134e50 con 0x560fe40c8450 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.323+0000 7f7b7fd3ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe4135010 con 0x560fe40c8db0 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b7fd3ab80 10 client.0 _ll_register_callbacks cb 0x560fe3f01b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe41347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe41347a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39250/0 (socket says 172.21.15.12:39250) 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a99c700 1 -- 172.21.15.12:0/2780973259 learned_addr learned my addr 172.21.15.12:0/2780973259 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6999a700 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8db0 0x560fe40d9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8450 0x560fe40d8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a99c700 1 -- 172.21.15.12:0/2780973259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8db0 msgr2=0x560fe40d9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8db0 0x560fe40d9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a99c700 1 -- 172.21.15.12:0/2780973259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8450 msgr2=0x560fe40d8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8450 0x560fe40d8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.324+0000 7f7b6a99c700 1 -- 172.21.15.12:0/2780973259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b60019070 con 0x560fe40c9ca0 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b6a99c700 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe41347a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0998b0 tx=0x7f7b5c09a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89786ab15b6a045d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:55.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b4dffb700 1 -- 172.21.15.12:0/2780973259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c065370 con 0x560fe40c9ca0 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2780973259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b5401e070 con 0x560fe40c9ca0 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b4dffb700 1 -- 172.21.15.12:0/2780973259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7b5c01b320 con 0x560fe40c9ca0 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b4dffb700 1 -- 172.21.15.12:0/2780973259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b5c0654d0 con 0x560fe40c9ca0 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b7fd3ab80 10 client.20076 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2780973259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560fe3e45e60 con 0x560fe40c9ca0 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b4dffb700 1 -- 172.21.15.12:0/2780973259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b5401e070 con 0x560fe40c9ca0 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b4dffb700 1 -- 172.21.15.12:0/2780973259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7b5c098b10 con 0x560fe40c9ca0 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.325+0000 7f7b7fd3ab80 10 client.20076 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.326+0000 7f7b7fd3ab80 10 client.20076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.326+0000 7f7b7fd3ab80 20 client.20076 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.326+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560fe4136540 0x560fe4138930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.326+0000 7f7b7fd3ab80 4 client.20076 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:31:55.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.326+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2780973259 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560fe3fe3050 con 0x560fe4136540 2023-12-11T20:31:55.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.326+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560fe4136540 0x560fe4138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.327+0000 7f7b6a19b700 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560fe4136540 0x560fe4138930 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=628fd51897a0cfed server_cookie=76f6a11817bb9b35 in_seq=0 out_seq=0 2023-12-11T20:31:55.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.327+0000 7f7b4dffb700 10 client.20076 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b4dffb700 1 -- 172.21.15.12:0/2780973259 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560fe3fe3050 con 0x560fe4136540 2023-12-11T20:31:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b4dffb700 10 client.20076 handle_command_reply: tid=0 2023-12-11T20:31:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 client.20076 shutdown 2023-12-11T20:31:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2780973259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 msgr2=0x560fe41347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe41347a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0998b0 tx=0x7f7b5c09a160 comp rx=0 tx=0).stop 2023-12-11T20:31:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2780973259 shutdown_connections 2023-12-11T20:31:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560fe4136540 0x560fe4138930 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560fe40c8450 0x560fe40d8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560fe40c9ca0 0x560fe41347a0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 --2- 172.21.15.12:0/2780973259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560fe40c8db0 0x560fe40d9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2780973259 >> 172.21.15.12:0/2780973259 conn(0x560fe3ff7860 msgr2=0x560fe40bd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b4dffb700 0 client.20076 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.328+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2780973259 shutdown_connections 2023-12-11T20:31:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.329+0000 7f7b7fd3ab80 1 -- 172.21.15.12:0/2780973259 wait complete. 2023-12-11T20:31:55.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.329+0000 7f7b7fd3ab80 20 client.20076 trim_cache size 0 max 16384 2023-12-11T20:31:55.331 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:31:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:31:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "e886cd1a-d657-4052-9af5-735d16125a53", 2023-12-11T20:31:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:31:55.332 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:31:55.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.329+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7b500a1480 msgr2=0x7f7b500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.329+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7b500a1480 0x7f7b500a3940 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009fd0 tx=0x7f7b60009260 comp rx=0 tx=0).stop 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.329+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b64103040 msgr2=0x7f7b641a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.329+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b64103040 0x7f7b641a0ab0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00efc0 tx=0x7f7b5c00c3a0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.329+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/3831666453 shutdown_connections 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.330+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7b500a1480 0x7f7b500a3940 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.330+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b64103040 0x7f7b641a0ab0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.330+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b641014b0 0x7f7b64199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.330+0000 7f7b6c3ff700 1 --2- 172.21.15.12:0/3831666453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b641026a0 0x7f7b64199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.330+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/3831666453 >> 172.21.15.12:0/3831666453 conn(0x7f7b640fca00 msgr2=0x7f7b64107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.330+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/3831666453 shutdown_connections 2023-12-11T20:31:55.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.330+0000 7f7b6c3ff700 1 -- 172.21.15.12:0/3831666453 wait complete. 2023-12-11T20:31:55.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:31:55.421 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:55 smithi012 ceph-mon[128787]: pgmap v854: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:55.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:55 smithi032 ceph-mon[132488]: pgmap v854: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:55.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:55 smithi039 ceph-mon[102205]: pgmap v854: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:55.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/1366404771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb41024d0 msgr2=0x7f0eb4104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/1366404771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb41024d0 0x7f0eb4104960 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009990 tx=0x7f0ea4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/1366404771 shutdown_connections 2023-12-11T20:31:55.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/1366404771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0eb40ffb60 0x7f0eb4101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/1366404771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0eb4104ea0 0x7f0eb4105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/1366404771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb41024d0 0x7f0eb4104960 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/1366404771 >> 172.21.15.12:0/1366404771 conn(0x7f0eb40fb740 msgr2=0x7f0eb40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/1366404771 shutdown_connections 2023-12-11T20:31:55.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.584+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/1366404771 wait complete. 2023-12-11T20:31:55.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.585+0000 7f0ebaf9d700 1 Processor -- start 2023-12-11T20:31:55.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0ebaf9d700 1 -- start start 2023-12-11T20:31:55.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0ebaf9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb40ffb60 0x7f0eb419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0ebaf9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0eb41024d0 0x7f0eb419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0ebaf9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0eb4104ea0 0x7f0eb41a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0ebaf9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb41a51c0 con 0x7f0eb40ffb60 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0ebaf9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb41a5300 con 0x7f0eb41024d0 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0ebaf9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb41a5490 con 0x7f0eb4104ea0 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0eb9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb40ffb60 0x7f0eb419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0eb9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb40ffb60 0x7f0eb419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39264/0 (socket says 172.21.15.12:39264) 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/3568712130 learned_addr learned my addr 172.21.15.12:0/3568712130 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0eba79c700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0eb4104ea0 0x7f0eb41a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.586+0000 7f0eb979a700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0eb41024d0 0x7f0eb419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/3568712130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0eb4104ea0 msgr2=0x7f0eb41a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0eb4104ea0 0x7f0eb41a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/3568712130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0eb41024d0 msgr2=0x7f0eb419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0eb41024d0 0x7f0eb419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/3568712130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea40095f0 con 0x7f0eb40ffb60 2023-12-11T20:31:55.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eb979a700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0eb41024d0 0x7f0eb419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:55.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb40ffb60 0x7f0eb419d690 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000d950 tx=0x7f0eb000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eaaffd700 1 -- 172.21.15.12:0/3568712130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0009940 con 0x7f0eb40ffb60 2023-12-11T20:31:55.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eaaffd700 1 -- 172.21.15.12:0/3568712130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eb0010460 con 0x7f0eb40ffb60 2023-12-11T20:31:55.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/3568712130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb41a5770 con 0x7f0eb40ffb60 2023-12-11T20:31:55.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.587+0000 7f0eaaffd700 1 -- 172.21.15.12:0/3568712130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000f620 con 0x7f0eb40ffb60 2023-12-11T20:31:55.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.588+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/3568712130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb41a5cd0 con 0x7f0eb40ffb60 2023-12-11T20:31:55.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.591+0000 7f0eaaffd700 1 -- 172.21.15.12:0/3568712130 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0eb00105d0 con 0x7f0eb40ffb60 2023-12-11T20:31:55.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.593+0000 7f0eaaffd700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ea00a15a0 0x7f0ea00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.593+0000 7f0ecfc17b80 1 Processor -- start 2023-12-11T20:31:55.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.593+0000 7f0eaaffd700 1 -- 172.21.15.12:0/3568712130 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0eb00ccb90 con 0x7f0eb40ffb60 2023-12-11T20:31:55.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.593+0000 7f0eb979a700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ea00a15a0 0x7f0ea00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.593+0000 7f0ecfc17b80 1 -- start start 2023-12-11T20:31:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.593+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f933e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.593+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f9348a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f934de0 0x55920f935240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f88eb50 con 0x55920f933a60 2023-12-11T20:31:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f88c470 con 0x55920f934de0 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f887d60 con 0x55920f9343c0 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f933e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f933e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39270/0 (socket says 172.21.15.12:39270) 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/2053914869 learned_addr learned my addr 172.21.15.12:0/2053914869 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb979a700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ea00a15a0 0x7f0ea00a3a60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4003780 tx=0x7f0ea4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eba79c700 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f934de0 0x55920f935240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb979a700 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f9348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/2053914869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 msgr2=0x55920f9348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f9348a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/2053914869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f934de0 msgr2=0x55920f935240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f934de0 0x55920f935240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/2053914869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55920f704630 con 0x55920f933a60 2023-12-11T20:31:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.594+0000 7f0eba79c700 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f934de0 0x55920f935240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:31:55.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.595+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f933e80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0096300 tx=0x7f0eb0099760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f014ade7fb0d774 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.595+0000 7f0e9ffff700 1 -- 172.21.15.12:0/2053914869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb009c030 con 0x55920f933a60 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.595+0000 7f0e9ffff700 1 -- 172.21.15.12:0/2053914869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eb009a500 con 0x55920f933a60 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.595+0000 7f0e9ffff700 1 -- 172.21.15.12:0/2053914869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00982c0 con 0x55920f933a60 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2053914869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 msgr2=0x55920f933e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f933e80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0096300 tx=0x7f0eb0099760 comp rx=0 tx=0).stop 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2053914869 shutdown_connections 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f934de0 0x55920f935240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f933e80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/2053914869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f9348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2053914869 >> 172.21.15.12:0/2053914869 conn(0x55920f8627e0 msgr2=0x55920f92e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2053914869 shutdown_connections 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.596+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2053914869 wait complete. 2023-12-11T20:31:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.597+0000 7f0ecfc17b80 1 -- start start 2023-12-11T20:31:55.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.597+0000 7f0ecfc17b80 1 Processor -- start 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.597+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f93d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.597+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f93d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.597+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f944950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.597+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f841560 con 0x55920f934de0 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.597+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f841200 con 0x55920f933a60 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.597+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f706920 con 0x55920f9343c0 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0ecfc17b80 10 client.0 _ll_register_callbacks cb 0x55920f76ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eba79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f944950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eba79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f944950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39282/0 (socket says 172.21.15.12:39282) 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eb9f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f93d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eba79c700 1 -- 172.21.15.12:0/1709099016 learned_addr learned my addr 172.21.15.12:0/1709099016 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eb979a700 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f93d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eba79c700 1 -- 172.21.15.12:0/1709099016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 msgr2=0x55920f93d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eba79c700 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f93d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eba79c700 1 -- 172.21.15.12:0/1709099016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 msgr2=0x55920f93d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eba79c700 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f93d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eba79c700 1 -- 172.21.15.12:0/1709099016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb41a5cd0 con 0x55920f934de0 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.598+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f93d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.599+0000 7f0eba79c700 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f944950 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0eac004320 tx=0x7f0eac004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4b31d7bc3e512a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.599+0000 7f0e9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.599+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/1709099016 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac003bb0 con 0x55920f934de0 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.599+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/1709099016 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0eac0079d0 con 0x55920f934de0 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.599+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/1709099016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55920f9269e0 con 0x55920f934de0 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.599+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/1709099016 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eac007b90 con 0x55920f934de0 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.599+0000 7f0ecfc17b80 10 client.20088 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.599+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/1709099016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55920f6b0de0 con 0x55920f934de0 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.600+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/1709099016 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55920f9269e0 con 0x55920f934de0 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.600+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/1709099016 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0eac014040 con 0x55920f934de0 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.600+0000 7f0ecfc17b80 10 client.20088 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.600+0000 7f0ecfc17b80 10 client.20088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.600+0000 7f0ecfc17b80 20 client.20088 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.600+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55920f949270 0x55920f94b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.600+0000 7f0ecfc17b80 4 client.20088 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:31:55.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.600+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/1709099016 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55920f902f40 con 0x55920f949270 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.601+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55920f949270 0x55920f94b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.601+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55920f949270 0x55920f94b690 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3552fd6ee1ea4e2 server_cookie=3f218b88ea1a34a8 in_seq=0 out_seq=0 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.601+0000 7f0e9d7fa700 10 client.20088 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/1709099016 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55920f902f40 con 0x55920f949270 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0e9d7fa700 10 client.20088 handle_command_reply: tid=0 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 client.20088 shutdown 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/1709099016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 msgr2=0x55920f944950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f944950 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0eac004320 tx=0x7f0eac004630 comp rx=0 tx=0).stop 2023-12-11T20:31:55.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/1709099016 shutdown_connections 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55920f949270 0x55920f94b690 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f93d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f944950 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/1709099016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f93d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/1709099016 >> 172.21.15.12:0/1709099016 conn(0x55920f8627e0 msgr2=0x55920f932820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0e9d7fa700 0 client.20088 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/1709099016 shutdown_connections 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.602+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/1709099016 wait complete. 2023-12-11T20:31:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.603+0000 7f0ecfc17b80 20 client.20088 trim_cache size 0 max 16384 2023-12-11T20:31:55.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.625+0000 7f0ecfc17b80 1 Processor -- start 2023-12-11T20:31:55.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.625+0000 7f0ecfc17b80 1 -- start start 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.625+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f9351c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.625+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f9343c0 0x55920f944870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.625+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f934de0 0x55920f92e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.625+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f945ad0 con 0x55920f933a60 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.625+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f93cf40 con 0x55920f9343c0 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.625+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f935700 con 0x55920f934de0 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f9351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f9351c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39290/0 (socket says 172.21.15.12:39290) 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/2821394983 learned_addr learned my addr 172.21.15.12:0/2821394983 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb979a700 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f9343c0 0x55920f944870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eba79c700 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f934de0 0x55920f92e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/2821394983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f934de0 msgr2=0x55920f92e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f934de0 0x55920f92e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/2821394983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f9343c0 msgr2=0x55920f944870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f9343c0 0x55920f944870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 -- 172.21.15.12:0/2821394983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55920f699c60 con 0x55920f933a60 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.626+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f9351c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0099d90 tx=0x7f0eb00a2190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c957d88c273c393 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ea8ff9700 1 -- 172.21.15.12:0/2821394983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb009c040 con 0x55920f933a60 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ea8ff9700 1 -- 172.21.15.12:0/2821394983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eb00a2200 con 0x55920f933a60 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ea8ff9700 1 -- 172.21.15.12:0/2821394983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0099550 con 0x55920f933a60 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2821394983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 msgr2=0x55920f9351c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f9351c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0099d90 tx=0x7f0eb00a2190 comp rx=0 tx=0).stop 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2821394983 shutdown_connections 2023-12-11T20:31:55.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f934de0 0x55920f92e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f933a60 0x55920f9351c0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/2821394983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f9343c0 0x55920f944870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2821394983 >> 172.21.15.12:0/2821394983 conn(0x55920f8627e0 msgr2=0x55920f93b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2821394983 shutdown_connections 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.627+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/2821394983 wait complete. 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.628+0000 7f0ecfc17b80 1 -- start start 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.628+0000 7f0ecfc17b80 1 Processor -- start 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f941cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f942210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0ecfc17b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f943170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f9436b0 con 0x55920f934de0 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f943820 con 0x55920f933a60 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0ecfc17b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920f9439e0 con 0x55920f9343c0 2023-12-11T20:31:55.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0ecfc17b80 10 client.0 _ll_register_callbacks cb 0x55920f76ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0eba79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f943170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0eba79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f943170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39302/0 (socket says 172.21.15.12:39302) 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0eba79c700 1 -- 172.21.15.12:0/3464131800 learned_addr learned my addr 172.21.15.12:0/3464131800 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0eb979a700 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f942210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.629+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f941cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0eba79c700 1 -- 172.21.15.12:0/3464131800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 msgr2=0x55920f942210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0eba79c700 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f942210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0eba79c700 1 -- 172.21.15.12:0/3464131800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 msgr2=0x55920f941cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0eba79c700 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f941cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0eba79c700 1 -- 172.21.15.12:0/3464131800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55920f704630 con 0x55920f934de0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0eba79c700 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f943170 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0042f0 tx=0x7f0eac007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e393d3f071a745 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0e9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/3464131800 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac003b90 con 0x55920f934de0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/3464131800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55920f84dfd0 con 0x55920f934de0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.630+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/3464131800 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0eac004a90 con 0x55920f934de0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/3464131800 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eac009540 con 0x55920f934de0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0ecfc17b80 10 client.20094 fetch_fsmap learned FSMap version 34 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/3464131800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55920f6d7250 con 0x55920f934de0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/3464131800 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55920f84dfd0 con 0x55920f934de0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/3464131800 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0eac004350 con 0x55920f934de0 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0ecfc17b80 10 client.20094 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0ecfc17b80 10 client.20094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0ecfc17b80 20 client.20094 populate_metadata read hostname 'smithi012' 2023-12-11T20:31:55.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55920f99fdb0 0x55920f9a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0ecfc17b80 4 client.20094 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.631+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/3464131800 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55920f840490 con 0x55920f99fdb0 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.632+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55920f99fdb0 0x55920f9a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.632+0000 7f0eb9f9b700 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55920f99fdb0 0x55920f9a21d0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a03a838b423cd8b9 server_cookie=7c89bfd3fcfcb745 in_seq=0 out_seq=0 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.632+0000 7f0e9d7fa700 10 client.20094 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.632+0000 7f0e9d7fa700 1 -- 172.21.15.12:0/3464131800 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55920f840490 con 0x55920f99fdb0 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.632+0000 7f0e9d7fa700 10 client.20094 handle_command_reply: tid=0 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 client.20094 shutdown 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/3464131800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 msgr2=0x55920f943170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f943170 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0042f0 tx=0x7f0eac007a00 comp rx=0 tx=0).stop 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/3464131800 shutdown_connections 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55920f99fdb0 0x55920f9a21d0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55920f933a60 0x55920f941cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55920f934de0 0x55920f943170 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 --2- 172.21.15.12:0/3464131800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55920f9343c0 0x55920f942210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/3464131800 >> 172.21.15.12:0/3464131800 conn(0x55920f8627e0 msgr2=0x55920f93b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0e9d7fa700 0 client.20094 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/3464131800 shutdown_connections 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 1 -- 172.21.15.12:0/3464131800 wait complete. 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.633+0000 7f0ecfc17b80 20 client.20094 trim_cache size 0 max 16384 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "e886cd1a-d657-4052-9af5-735d16125a53": { 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "e886cd1a-d657-4052-9af5-735d16125a53", 2023-12-11T20:31:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:31:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:31:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:31:55.638 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:31:55.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ea00a15a0 msgr2=0x7f0ea00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ea00a15a0 0x7f0ea00a3a60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4003780 tx=0x7f0ea4005fb0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb40ffb60 msgr2=0x7f0eb419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb40ffb60 0x7f0eb419d690 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000d950 tx=0x7f0eb000dc60 comp rx=0 tx=0).stop 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/3568712130 shutdown_connections 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0ea00a15a0 0x7f0ea00a3a60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0eb4104ea0 0x7f0eb41a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb40ffb60 0x7f0eb419d690 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 --2- 172.21.15.12:0/3568712130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0eb41024d0 0x7f0eb419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/3568712130 >> 172.21.15.12:0/3568712130 conn(0x7f0eb40fb740 msgr2=0x7f0eb4100890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/3568712130 shutdown_connections 2023-12-11T20:31:55.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:31:55.634+0000 7f0ebaf9d700 1 -- 172.21.15.12:0/3568712130 wait complete. 2023-12-11T20:31:55.652 INFO:tasks.cephfs.filesystem:scrub status for tag:e886cd1a-d657-4052-9af5-735d16125a53 - {'path': '/', 'tag': 'e886cd1a-d657-4052-9af5-735d16125a53', 'options': 'recursive,force'} 2023-12-11T20:31:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:56 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:31:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:56 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:31:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:56 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:56.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:56 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:56.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:56 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:31:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:56 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:31:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:56 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:56.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:56 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:56 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:31:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:56 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:31:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:56 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:56.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:56 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:56.589 INFO:tasks.workunit.client.0.smithi012.stdout:fs setup took 877 secs 2023-12-11T20:31:57.066 INFO:tasks.workunit.client.0.smithi012.stdout:Syncing()...0 sec 2023-12-11T20:31:57.066 INFO:tasks.workunit.client.0.smithi012.stdout:Starting Actual Benchmark At: Mon Dec 11 20:31:57 2023 2023-12-11T20:31:57.066 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:31:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:57 smithi032 ceph-mon[132488]: pgmap v855: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:57 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:31:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:57 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:57 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:31:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:57 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:57 smithi039 ceph-mon[102205]: pgmap v855: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:57 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:31:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:57 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:57 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:31:57.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:57 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:57 smithi012 ceph-mon[128787]: pgmap v855: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 15 MiB/s wr, 14 op/s 2023-12-11T20:31:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:57 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:31:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:57 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:57 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:31:57.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:57 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:31:59.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:31:59 smithi032 ceph-mon[132488]: pgmap v856: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 24 op/s 2023-12-11T20:31:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:31:59 smithi039 ceph-mon[102205]: pgmap v856: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 24 op/s 2023-12-11T20:31:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:31:59 smithi012 ceph-mon[128787]: pgmap v856: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 24 op/s 2023-12-11T20:32:01.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:01 smithi032 ceph-mon[132488]: pgmap v857: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 13 MiB/s wr, 195 op/s 2023-12-11T20:32:01.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:01 smithi039 ceph-mon[102205]: pgmap v857: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 13 MiB/s wr, 195 op/s 2023-12-11T20:32:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:01 smithi012 ceph-mon[128787]: pgmap v857: 97 pgs: 97 active+clean; 12 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 13 MiB/s wr, 195 op/s 2023-12-11T20:32:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:03 smithi032 ceph-mon[132488]: pgmap v858: 97 pgs: 97 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 623 op/s 2023-12-11T20:32:03.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:03 smithi039 ceph-mon[102205]: pgmap v858: 97 pgs: 97 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 623 op/s 2023-12-11T20:32:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:03 smithi012 ceph-mon[128787]: pgmap v858: 97 pgs: 97 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 623 op/s 2023-12-11T20:32:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.163+0000 7fddee7ff700 1 -- 172.21.15.12:0/2098834511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8105220 msgr2=0x7fdde810bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.163+0000 7fddee7ff700 1 --2- 172.21.15.12:0/2098834511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8105220 0x7fdde810bad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdde000b0d0 tx=0x7fdde000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.164+0000 7fddee7ff700 1 -- 172.21.15.12:0/2098834511 shutdown_connections 2023-12-11T20:32:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.164+0000 7fddee7ff700 1 --2- 172.21.15.12:0/2098834511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8105220 0x7fdde810bad0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.164+0000 7fddee7ff700 1 --2- 172.21.15.12:0/2098834511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8103690 0x7fdde8103ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.164+0000 7fddee7ff700 1 --2- 172.21.15.12:0/2098834511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde8104880 0x7fdde8104ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.164+0000 7fddee7ff700 1 -- 172.21.15.12:0/2098834511 >> 172.21.15.12:0/2098834511 conn(0x7fdde80fec00 msgr2=0x7fdde8101040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.164+0000 7fddee7ff700 1 -- 172.21.15.12:0/2098834511 shutdown_connections 2023-12-11T20:32:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.164+0000 7fddee7ff700 1 -- 172.21.15.12:0/2098834511 wait complete. 2023-12-11T20:32:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.165+0000 7fddee7ff700 1 Processor -- start 2023-12-11T20:32:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.165+0000 7fddee7ff700 1 -- start start 2023-12-11T20:32:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.166+0000 7fddee7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8103690 0x7fdde819d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.166+0000 7fddee7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8104880 0x7fdde819df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.166+0000 7fddee7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde8105220 0x7fdde81a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.166+0000 7fddee7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde81a5500 con 0x7fdde8105220 2023-12-11T20:32:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.166+0000 7fddee7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde810de70 con 0x7fdde8104880 2023-12-11T20:32:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.166+0000 7fddee7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde810e000 con 0x7fdde8103690 2023-12-11T20:32:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.167+0000 7fdde77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8104880 0x7fdde819df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.168+0000 7fdde77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8104880 0x7fdde819df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40012/0 (socket says 172.21.15.12:40012) 2023-12-11T20:32:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.168+0000 7fdde77fe700 1 -- 172.21.15.12:0/729576434 learned_addr learned my addr 172.21.15.12:0/729576434 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.167+0000 7fdde7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8103690 0x7fdde819d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.168+0000 7fddecd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde8105220 0x7fdde81a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.168+0000 7fdde77fe700 1 -- 172.21.15.12:0/729576434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8103690 msgr2=0x7fdde819d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.168+0000 7fdde77fe700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8103690 0x7fdde819d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.168+0000 7fdde77fe700 1 -- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde8105220 msgr2=0x7fdde81a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.168+0000 7fdde77fe700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde8105220 0x7fdde81a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.168+0000 7fdde77fe700 1 -- 172.21.15.12:0/729576434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0009d00 con 0x7fdde8104880 2023-12-11T20:32:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.169+0000 7fddecd9c700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde8105220 0x7fdde81a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.169+0000 7fdde7fff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8103690 0x7fdde819d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.169+0000 7fdde77fe700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8104880 0x7fdde819df10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00e9a0 tx=0x7fdddc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.169+0000 7fdde57fa700 1 -- 172.21.15.12:0/729576434 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00cbd0 con 0x7fdde8104880 2023-12-11T20:32:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.169+0000 7fdde57fa700 1 -- 172.21.15.12:0/729576434 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdddc00cd30 con 0x7fdde8104880 2023-12-11T20:32:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.169+0000 7fdde57fa700 1 -- 172.21.15.12:0/729576434 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc018680 con 0x7fdde8104880 2023-12-11T20:32:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.169+0000 7fddee7ff700 1 -- 172.21.15.12:0/729576434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde810e2e0 con 0x7fdde8104880 2023-12-11T20:32:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.170+0000 7fddee7ff700 1 -- 172.21.15.12:0/729576434 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde810e7a0 con 0x7fdde8104880 2023-12-11T20:32:04.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.175+0000 7fdde57fa700 1 -- 172.21.15.12:0/729576434 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fdddc010430 con 0x7fdde8104880 2023-12-11T20:32:04.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.176+0000 7fdde57fa700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd00a1530 0x7fddd00a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.177+0000 7fdde57fa700 1 -- 172.21.15.12:0/729576434 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdddc014070 con 0x7fdde8104880 2023-12-11T20:32:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.177+0000 7fde02100b80 1 Processor -- start 2023-12-11T20:32:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.177+0000 7fdde7fff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd00a1530 0x7fddd00a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.178+0000 7fde02100b80 1 -- start start 2023-12-11T20:32:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.178+0000 7fde02100b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 0x5636b309d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.178+0000 7fde02100b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b309e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.178+0000 7fde02100b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309e720 0x5636b309eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.179+0000 7fde02100b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b2ff8af0 con 0x5636b309e720 2023-12-11T20:32:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.179+0000 7fde02100b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b2ff6410 con 0x5636b309d830 2023-12-11T20:32:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.179+0000 7fde02100b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b2ff1d00 con 0x5636b309ced0 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.179+0000 7fdde77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b309e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.179+0000 7fdde77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b309e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40014/0 (socket says 172.21.15.12:40014) 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.179+0000 7fdde77fe700 1 -- 172.21.15.12:0/3298397494 learned_addr learned my addr 172.21.15.12:0/3298397494 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.179+0000 7fddecd9c700 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309e720 0x5636b309eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fdde77fe700 1 -- 172.21.15.12:0/3298397494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 msgr2=0x5636b309d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fdde77fe700 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 0x5636b309d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fdde77fe700 1 -- 172.21.15.12:0/3298397494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309e720 msgr2=0x5636b309eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fdde77fe700 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309e720 0x5636b309eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fdde77fe700 1 -- 172.21.15.12:0/3298397494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636b2e6e5d0 con 0x5636b309d830 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fdde7fff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd00a1530 0x7fddd00a39f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdde81046e0 tx=0x7fddd8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fddecd9c700 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309e720 0x5636b309eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fdde77fe700 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b309e140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdddc096890 tx=0x7fdddc099ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ea573c70613f5da server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.180+0000 7fddce7fc700 1 -- 172.21.15.12:0/3298397494 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc09aa90 con 0x5636b309d830 2023-12-11T20:32:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.181+0000 7fddce7fc700 1 -- 172.21.15.12:0/3298397494 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdddc09a390 con 0x5636b309d830 2023-12-11T20:32:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.181+0000 7fddce7fc700 1 -- 172.21.15.12:0/3298397494 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc09e170 con 0x5636b309d830 2023-12-11T20:32:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.181+0000 7fde02100b80 1 -- 172.21.15.12:0/3298397494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 msgr2=0x5636b309e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.181+0000 7fde02100b80 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b309e140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdddc096890 tx=0x7fdddc099ed0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.182+0000 7fde02100b80 1 -- 172.21.15.12:0/3298397494 shutdown_connections 2023-12-11T20:32:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.182+0000 7fde02100b80 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309e720 0x5636b309eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.182+0000 7fde02100b80 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 0x5636b309d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.182+0000 7fde02100b80 1 --2- 172.21.15.12:0/3298397494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b309e140 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.182+0000 7fde02100b80 1 -- 172.21.15.12:0/3298397494 >> 172.21.15.12:0/3298397494 conn(0x5636b2fcc780 msgr2=0x5636b3099880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.182+0000 7fde02100b80 1 -- 172.21.15.12:0/3298397494 shutdown_connections 2023-12-11T20:32:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.182+0000 7fde02100b80 1 -- 172.21.15.12:0/3298397494 wait complete. 2023-12-11T20:32:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.184+0000 7fde02100b80 1 -- start start 2023-12-11T20:32:04.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.185+0000 7fde02100b80 1 Processor -- start 2023-12-11T20:32:04.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.187+0000 7fde02100b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.187+0000 7fde02100b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309d830 0x5636b30a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fdde7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fde02100b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ae230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fde02100b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b2fab500 con 0x5636b309ced0 2023-12-11T20:32:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fde02100b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b2fab1a0 con 0x5636b309e720 2023-12-11T20:32:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fde02100b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b2e708c0 con 0x5636b309d830 2023-12-11T20:32:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fdde7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30a6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44802/0 (socket says 172.21.15.12:44802) 2023-12-11T20:32:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fdde7fff700 1 -- 172.21.15.12:0/196441116 learned_addr learned my addr 172.21.15.12:0/196441116 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fde02100b80 10 client.0 _ll_register_callbacks cb 0x5636b2ed6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.188+0000 7fdde77fe700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309d830 0x5636b30a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fddecd9c700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fdde77fe700 1 -- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 msgr2=0x5636b30ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fdde77fe700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fdde77fe700 1 -- 172.21.15.12:0/196441116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 msgr2=0x5636b30a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fdde77fe700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fdde77fe700 1 -- 172.21.15.12:0/196441116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde810e7a0 con 0x5636b309d830 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fdde7fff700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fddecd9c700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fdde77fe700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309d830 0x5636b30a7400 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5636b30a54b0 tx=0x7fdddc010c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdbafc9807519bbe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fddc77fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fddc77fe700 1 -- 172.21.15.12:0/196441116 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc099a80 con 0x5636b309d830 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.189+0000 7fddc77fe700 1 -- 172.21.15.12:0/196441116 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdddc09e4e0 con 0x5636b309d830 2023-12-11T20:32:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.190+0000 7fde02100b80 1 -- 172.21.15.12:0/196441116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636b3090730 con 0x5636b309d830 2023-12-11T20:32:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.190+0000 7fddc77fe700 1 -- 172.21.15.12:0/196441116 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdddc0a2290 con 0x5636b309d830 2023-12-11T20:32:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.190+0000 7fde02100b80 10 client.29641 fetch_fsmap learned FSMap version 34 2023-12-11T20:32:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.190+0000 7fde02100b80 1 -- 172.21.15.12:0/196441116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5636b2e1ad80 con 0x5636b309d830 2023-12-11T20:32:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.190+0000 7fddc77fe700 1 -- 172.21.15.12:0/196441116 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5636b3090730 con 0x5636b309d830 2023-12-11T20:32:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.191+0000 7fddc77fe700 1 -- 172.21.15.12:0/196441116 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdddc09f220 con 0x5636b309d830 2023-12-11T20:32:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.191+0000 7fde02100b80 10 client.29641 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:32:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.191+0000 7fde02100b80 10 client.29641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.191+0000 7fde02100b80 20 client.29641 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.191+0000 7fde02100b80 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5636b30b29a0 0x5636b30b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.191+0000 7fde02100b80 4 client.29641 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.191+0000 7fde02100b80 1 -- 172.21.15.12:0/196441116 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636b306cee0 con 0x5636b30b29a0 2023-12-11T20:32:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.192+0000 7fdde7fff700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5636b30b29a0 0x5636b30b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.193+0000 7fdde7fff700 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5636b30b29a0 0x5636b30b4d90 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3564002b9aff0923 server_cookie=e173fcff860323b in_seq=0 out_seq=0 2023-12-11T20:32:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.193+0000 7fddc77fe700 10 client.29641 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.193+0000 7fddc77fe700 1 -- 172.21.15.12:0/196441116 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5636b306cee0 con 0x5636b30b29a0 2023-12-11T20:32:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.193+0000 7fddc77fe700 10 client.29641 handle_command_reply: tid=0 2023-12-11T20:32:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.193+0000 7fde02100b80 1 client.29641 shutdown 2023-12-11T20:32:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fde02100b80 1 -- 172.21.15.12:0/196441116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309d830 msgr2=0x5636b30a7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fde02100b80 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309d830 0x5636b30a7400 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5636b30a54b0 tx=0x7fdddc010c50 comp rx=0 tx=0).stop 2023-12-11T20:32:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fde02100b80 1 -- 172.21.15.12:0/196441116 shutdown_connections 2023-12-11T20:32:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fde02100b80 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5636b30b29a0 0x5636b30b4d90 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fde02100b80 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fde02100b80 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fde02100b80 1 --2- 172.21.15.12:0/196441116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309d830 0x5636b30a7400 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fddc77fe700 0 client.29641 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.194+0000 7fde02100b80 1 -- 172.21.15.12:0/196441116 >> 172.21.15.12:0/196441116 conn(0x5636b2fcc780 msgr2=0x5636b3097ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.195+0000 7fde02100b80 1 -- 172.21.15.12:0/196441116 shutdown_connections 2023-12-11T20:32:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.195+0000 7fde02100b80 1 -- 172.21.15.12:0/196441116 wait complete. 2023-12-11T20:32:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.195+0000 7fde02100b80 20 client.29641 trim_cache size 0 max 16384 2023-12-11T20:32:04.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.228+0000 7fde02100b80 1 Processor -- start 2023-12-11T20:32:04.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.229+0000 7fde02100b80 1 -- start start 2023-12-11T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.229+0000 7fde02100b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.229+0000 7fde02100b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b30ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.229+0000 7fde02100b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309e720 0x5636b30a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.229+0000 7fde02100b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b30af5e0 con 0x5636b309ced0 2023-12-11T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.229+0000 7fde02100b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b3090700 con 0x5636b309d830 2023-12-11T20:32:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.229+0000 7fde02100b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b30a6820 con 0x5636b309e720 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.230+0000 7fddecd9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309e720 0x5636b30a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.230+0000 7fddecd9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309e720 0x5636b30a61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34338/0 (socket says 172.21.15.12:34338) 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.230+0000 7fddecd9c700 1 -- 172.21.15.12:0/4229480402 learned_addr learned my addr 172.21.15.12:0/4229480402 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.230+0000 7fdde7fff700 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.230+0000 7fdde77fe700 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b30ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.231+0000 7fddecd9c700 1 -- 172.21.15.12:0/4229480402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 msgr2=0x5636b30ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.231+0000 7fddecd9c700 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b30ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.231+0000 7fddecd9c700 1 -- 172.21.15.12:0/4229480402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 msgr2=0x5636b30aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.231+0000 7fddecd9c700 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.231+0000 7fddecd9c700 1 -- 172.21.15.12:0/4229480402 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636b2e03c00 con 0x5636b309e720 2023-12-11T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.231+0000 7fdde77fe700 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b30ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.231+0000 7fdde7fff700 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.231+0000 7fddecd9c700 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309e720 0x5636b30a61c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdde000b0d0 tx=0x7fdde0009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=705fb774f68da255 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.232+0000 7fddceffd700 1 -- 172.21.15.12:0/4229480402 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde000e070 con 0x5636b309e720 2023-12-11T20:32:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.232+0000 7fddceffd700 1 -- 172.21.15.12:0/4229480402 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdde0007b90 con 0x5636b309e720 2023-12-11T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.232+0000 7fddceffd700 1 -- 172.21.15.12:0/4229480402 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0004c90 con 0x5636b309e720 2023-12-11T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 -- 172.21.15.12:0/4229480402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309e720 msgr2=0x5636b30a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309e720 0x5636b30a61c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdde000b0d0 tx=0x7fdde0009be0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 -- 172.21.15.12:0/4229480402 shutdown_connections 2023-12-11T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309e720 0x5636b30a61c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309ced0 0x5636b30aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 --2- 172.21.15.12:0/4229480402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309d830 0x5636b30ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 -- 172.21.15.12:0/4229480402 >> 172.21.15.12:0/4229480402 conn(0x5636b2fcc780 msgr2=0x5636b30a4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 -- 172.21.15.12:0/4229480402 shutdown_connections 2023-12-11T20:32:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.233+0000 7fde02100b80 1 -- 172.21.15.12:0/4229480402 wait complete. 2023-12-11T20:32:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.234+0000 7fde02100b80 1 -- start start 2023-12-11T20:32:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.234+0000 7fde02100b80 1 Processor -- start 2023-12-11T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.236+0000 7fde02100b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 0x5636b30a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.236+0000 7fde02100b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309d830 0x5636b30aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.236+0000 7fde02100b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.236+0000 7fde02100b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b30ad600 con 0x5636b309d830 2023-12-11T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.236+0000 7fde02100b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b30ad770 con 0x5636b309e720 2023-12-11T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.236+0000 7fde02100b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636b30ad930 con 0x5636b309ced0 2023-12-11T20:32:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.236+0000 7fde02100b80 10 client.0 _ll_register_callbacks cb 0x5636b2ed6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.237+0000 7fddecd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.237+0000 7fdde7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 0x5636b30a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.237+0000 7fddecd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40040/0 (socket says 172.21.15.12:40040) 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.237+0000 7fddecd9c700 1 -- 172.21.15.12:0/1773705703 learned_addr learned my addr 172.21.15.12:0/1773705703 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.237+0000 7fdde77fe700 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309d830 0x5636b30aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.237+0000 7fddecd9c700 1 -- 172.21.15.12:0/1773705703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 msgr2=0x5636b30a9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.237+0000 7fddecd9c700 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 0x5636b30a9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.238+0000 7fddecd9c700 1 -- 172.21.15.12:0/1773705703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309d830 msgr2=0x5636b30aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.238+0000 7fddecd9c700 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309d830 0x5636b30aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.238+0000 7fddecd9c700 1 -- 172.21.15.12:0/1773705703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd8009dc0 con 0x5636b309e720 2023-12-11T20:32:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.238+0000 7fdde77fe700 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309d830 0x5636b30aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.238+0000 7fddecd9c700 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ad0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdde000b420 tx=0x7fdde0007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=446b0d0b0e9fb2f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.238+0000 7fddc77fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.238+0000 7fddc77fe700 1 -- 172.21.15.12:0/1773705703 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde000e040 con 0x5636b309e720 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.239+0000 7fddc77fe700 1 -- 172.21.15.12:0/1773705703 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdde0004c50 con 0x5636b309e720 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.239+0000 7fde02100b80 1 -- 172.21.15.12:0/1773705703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdddc09a390 con 0x5636b309e720 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.239+0000 7fddc77fe700 1 -- 172.21.15.12:0/1773705703 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdde0004e10 con 0x5636b309e720 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.239+0000 7fde02100b80 10 client.29642 fetch_fsmap learned FSMap version 34 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.239+0000 7fde02100b80 1 -- 172.21.15.12:0/1773705703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5636b2e1ad80 con 0x5636b309e720 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.239+0000 7fddc77fe700 1 -- 172.21.15.12:0/1773705703 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdddc09a390 con 0x5636b309e720 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.240+0000 7fddc77fe700 1 -- 172.21.15.12:0/1773705703 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdde002b030 con 0x5636b309e720 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.240+0000 7fde02100b80 10 client.29642 fetch_fsmap finished waiting for FSMap version 34 2023-12-11T20:32:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.240+0000 7fde02100b80 10 client.29642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.240+0000 7fde02100b80 20 client.29642 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.240+0000 7fde02100b80 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5636b311a920 0x5636b311cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.240+0000 7fde02100b80 4 client.29642 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.240+0000 7fde02100b80 1 -- 172.21.15.12:0/1773705703 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5636b2fb7f70 con 0x5636b311a920 2023-12-11T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.240+0000 7fdde7fff700 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5636b311a920 0x5636b311cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.241+0000 7fdde7fff700 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5636b311a920 0x5636b311cd40 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4901c3bd01ad9d1e server_cookie=e94655d5ec451347 in_seq=0 out_seq=0 2023-12-11T20:32:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.241+0000 7fddc77fe700 10 client.29642 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:04.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.254+0000 7fddc77fe700 1 -- 172.21.15.12:0/1773705703 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5636b2fb7f70 con 0x5636b311a920 2023-12-11T20:32:04.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.254+0000 7fddc77fe700 10 client.29642 handle_command_reply: tid=0 2023-12-11T20:32:04.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.254+0000 7fde02100b80 1 client.29642 shutdown 2023-12-11T20:32:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.254+0000 7fde02100b80 1 -- 172.21.15.12:0/1773705703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 msgr2=0x5636b30ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.254+0000 7fde02100b80 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ad0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdde000b420 tx=0x7fdde0007f30 comp rx=0 tx=0).stop 2023-12-11T20:32:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 1 -- 172.21.15.12:0/1773705703 shutdown_connections 2023-12-11T20:32:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5636b311a920 0x5636b311cd40 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fddc77fe700 0 client.29642 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5636b309e720 0x5636b30ad0c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5636b309ced0 0x5636b30a9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 1 --2- 172.21.15.12:0/1773705703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636b309d830 0x5636b30aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 1 -- 172.21.15.12:0/1773705703 >> 172.21.15.12:0/1773705703 conn(0x5636b2fcc780 msgr2=0x5636b30a4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 1 -- 172.21.15.12:0/1773705703 shutdown_connections 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 1 -- 172.21.15.12:0/1773705703 wait complete. 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.255+0000 7fde02100b80 20 client.29642 trim_cache size 0 max 16384 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:32:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:32:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:32:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:32:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 -- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd00a1530 msgr2=0x7fddd00a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd00a1530 0x7fddd00a39f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdde81046e0 tx=0x7fddd8009260 comp rx=0 tx=0).stop 2023-12-11T20:32:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 -- 172.21.15.12:0/729576434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8104880 msgr2=0x7fdde819df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8104880 0x7fdde819df10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00e9a0 tx=0x7fdddc00ed60 comp rx=0 tx=0).stop 2023-12-11T20:32:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 -- 172.21.15.12:0/729576434 shutdown_connections 2023-12-11T20:32:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fddd00a1530 0x7fddd00a39f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdde8105220 0x7fdde81a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8103690 0x7fdde819d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 --2- 172.21.15.12:0/729576434 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdde8104880 0x7fdde819df10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 -- 172.21.15.12:0/729576434 >> 172.21.15.12:0/729576434 conn(0x7fdde80fec00 msgr2=0x7fdde80795b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 -- 172.21.15.12:0/729576434 shutdown_connections 2023-12-11T20:32:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:04.257+0000 7fddee7ff700 1 -- 172.21.15.12:0/729576434 wait complete. 2023-12-11T20:32:05.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:05 smithi032 ceph-mon[132488]: pgmap v859: 97 pgs: 97 active+clean; 13 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 1.10k op/s 2023-12-11T20:32:05.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:05 smithi039 ceph-mon[102205]: pgmap v859: 97 pgs: 97 active+clean; 13 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 1.10k op/s 2023-12-11T20:32:05.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:05 smithi012 ceph-mon[128787]: pgmap v859: 97 pgs: 97 active+clean; 13 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 1.10k op/s 2023-12-11T20:32:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:07 smithi032 ceph-mon[132488]: pgmap v860: 97 pgs: 97 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 2.00k op/s 2023-12-11T20:32:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:07 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:32:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:07 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:32:07.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:07 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:32:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:07 smithi039 ceph-mon[102205]: pgmap v860: 97 pgs: 97 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 2.00k op/s 2023-12-11T20:32:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:07 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:32:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:07 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:32:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:07 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:32:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:07 smithi012 ceph-mon[128787]: pgmap v860: 97 pgs: 97 active+clean; 13 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 2.00k op/s 2023-12-11T20:32:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:07 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:32:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:07 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:32:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:07 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:32:08.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:08 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:32:08.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:08 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:32:08.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:08 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:32:09.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:09 smithi032 ceph-mon[132488]: pgmap v861: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 3.04k op/s 2023-12-11T20:32:09.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:09 smithi039 ceph-mon[102205]: pgmap v861: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 3.04k op/s 2023-12-11T20:32:09.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:09 smithi012 ceph-mon[128787]: pgmap v861: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 3.04k op/s 2023-12-11T20:32:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:11 smithi032 ceph-mon[132488]: pgmap v862: 97 pgs: 97 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 3.67k op/s 2023-12-11T20:32:11.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:11 smithi039 ceph-mon[102205]: pgmap v862: 97 pgs: 97 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 3.67k op/s 2023-12-11T20:32:11.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:11 smithi012 ceph-mon[128787]: pgmap v862: 97 pgs: 97 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 3.67k op/s 2023-12-11T20:32:13.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:13 smithi032 ceph-mon[132488]: pgmap v863: 97 pgs: 97 active+clean; 13 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.43k op/s 2023-12-11T20:32:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:13 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:32:13.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:13 smithi039 ceph-mon[102205]: pgmap v863: 97 pgs: 97 active+clean; 13 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.43k op/s 2023-12-11T20:32:13.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:13 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:32:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:13 smithi012 ceph-mon[128787]: pgmap v863: 97 pgs: 97 active+clean; 13 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.43k op/s 2023-12-11T20:32:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:13 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:32:15.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:15 smithi032 ceph-mon[132488]: pgmap v864: 97 pgs: 97 active+clean; 13 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 4.65k op/s 2023-12-11T20:32:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:15 smithi039 ceph-mon[102205]: pgmap v864: 97 pgs: 97 active+clean; 13 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 4.65k op/s 2023-12-11T20:32:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:15 smithi012 ceph-mon[128787]: pgmap v864: 97 pgs: 97 active+clean; 13 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 4.65k op/s 2023-12-11T20:32:17.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:17 smithi032 ceph-mon[132488]: pgmap v865: 97 pgs: 97 active+clean; 13 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 5.13k op/s 2023-12-11T20:32:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:17 smithi039 ceph-mon[102205]: pgmap v865: 97 pgs: 97 active+clean; 13 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 5.13k op/s 2023-12-11T20:32:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:17 smithi012 ceph-mon[128787]: pgmap v865: 97 pgs: 97 active+clean; 13 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 5.13k op/s 2023-12-11T20:32:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.637+0000 7f2c03bff700 1 -- 172.21.15.12:0/3189088963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc1026e0 msgr2=0x7f2bfc102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.637+0000 7f2c03bff700 1 --2- 172.21.15.12:0/3189088963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc1026e0 0x7f2bfc102b40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009990 tx=0x7f2bec009ca0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.637+0000 7f2c03bff700 1 -- 172.21.15.12:0/3189088963 shutdown_connections 2023-12-11T20:32:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.637+0000 7f2c03bff700 1 --2- 172.21.15.12:0/3189088963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc103080 0x7f2bfc109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.637+0000 7f2c03bff700 1 --2- 172.21.15.12:0/3189088963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bfc1014f0 0x7f2bfc101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.637+0000 7f2c03bff700 1 --2- 172.21.15.12:0/3189088963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc1026e0 0x7f2bfc102b40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.637+0000 7f2c03bff700 1 -- 172.21.15.12:0/3189088963 >> 172.21.15.12:0/3189088963 conn(0x7f2bfc0fca60 msgr2=0x7f2bfc0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.638+0000 7f2c03bff700 1 -- 172.21.15.12:0/3189088963 shutdown_connections 2023-12-11T20:32:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.638+0000 7f2c03bff700 1 -- 172.21.15.12:0/3189088963 wait complete. 2023-12-11T20:32:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.639+0000 7f2c03bff700 1 Processor -- start 2023-12-11T20:32:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.640+0000 7f2c03bff700 1 -- start start 2023-12-11T20:32:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.641+0000 7f2c03bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bfc1014f0 0x7f2bfc1951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.641+0000 7f2c03bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc1026e0 0x7f2bfc195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.641+0000 7f2c03bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc103080 0x7f2bfc19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.641+0000 7f2c03bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc19cd20 con 0x7f2bfc1014f0 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.641+0000 7f2c03bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc19ce60 con 0x7f2bfc1026e0 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.641+0000 7f2c03bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc19cff0 con 0x7f2bfc103080 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0219c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc103080 0x7f2bfc19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0219c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc103080 0x7f2bfc19c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:35550/0 (socket says 172.21.15.12:35550) 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0219c700 1 -- 172.21.15.12:0/2377269006 learned_addr learned my addr 172.21.15.12:0/2377269006 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0119a700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc1026e0 0x7f2bfc195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0119a700 1 -- 172.21.15.12:0/2377269006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc103080 msgr2=0x7f2bfc19c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0199b700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bfc1014f0 0x7f2bfc1951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0119a700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc103080 0x7f2bfc19c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0119a700 1 -- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bfc1014f0 msgr2=0x7f2bfc1951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0119a700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bfc1014f0 0x7f2bfc1951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0119a700 1 -- 172.21.15.12:0/2377269006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec0095f0 con 0x7f2bfc1026e0 2023-12-11T20:32:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.642+0000 7f2c0199b700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bfc1014f0 0x7f2bfc1951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.643+0000 7f2c0119a700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc1026e0 0x7f2bfc195730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b710 tx=0x7f2bec00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.643+0000 7f2bf2ffd700 1 -- 172.21.15.12:0/2377269006 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec01d070 con 0x7f2bfc1026e0 2023-12-11T20:32:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.643+0000 7f2bf2ffd700 1 -- 172.21.15.12:0/2377269006 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bec00f460 con 0x7f2bfc1026e0 2023-12-11T20:32:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.643+0000 7f2bf2ffd700 1 -- 172.21.15.12:0/2377269006 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec003de0 con 0x7f2bfc1026e0 2023-12-11T20:32:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.644+0000 7f2c03bff700 1 -- 172.21.15.12:0/2377269006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc19d270 con 0x7f2bfc1026e0 2023-12-11T20:32:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.644+0000 7f2c03bff700 1 -- 172.21.15.12:0/2377269006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc19d6c0 con 0x7f2bfc1026e0 2023-12-11T20:32:17.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.654+0000 7f2bf2ffd700 1 -- 172.21.15.12:0/2377269006 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2bec003950 con 0x7f2bfc1026e0 2023-12-11T20:32:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.656+0000 7f2c1752bb80 1 Processor -- start 2023-12-11T20:32:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.656+0000 7f2bf2ffd700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2be80a59c0 0x7f2be80a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2bf2ffd700 1 -- 172.21.15.12:0/2377269006 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2bec0cdf20 con 0x7f2bfc1026e0 2023-12-11T20:32:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2c1752bb80 1 -- start start 2023-12-11T20:32:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 0x559b2d2d52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2c0219c700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2be80a59c0 0x7f2be80a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d5830 0x559b2d2d6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d230af0 con 0x559b2d2d6720 2023-12-11T20:32:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d22e410 con 0x559b2d2d5830 2023-12-11T20:32:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.657+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d229d00 con 0x559b2d2d4ed0 2023-12-11T20:32:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0119a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d5830 0x559b2d2d6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2d6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54038/0 (socket says 172.21.15.12:54038) 2023-12-11T20:32:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0219c700 1 -- 172.21.15.12:0/361492493 learned_addr learned my addr 172.21.15.12:0/361492493 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0199b700 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 0x559b2d2d52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0119a700 1 -- 172.21.15.12:0/361492493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 msgr2=0x559b2d2d52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0119a700 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 0x559b2d2d52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0119a700 1 -- 172.21.15.12:0/361492493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 msgr2=0x559b2d2d6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0119a700 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2d6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0119a700 1 -- 172.21.15.12:0/361492493 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b2d0a65d0 con 0x559b2d2d5830 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0219c700 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.658+0000 7f2c0199b700 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 0x559b2d2d52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.659+0000 7f2c0219c700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2be80a59c0 0x7f2be80a7e80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2bf401fdd0 tx=0x7f2bf40126a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.659+0000 7f2c0119a700 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d5830 0x559b2d2d6140 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0095c0 tx=0x7f2bec09ab80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ef7188984fd2e50 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.659+0000 7f2be7fff700 1 -- 172.21.15.12:0/361492493 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec09b920 con 0x559b2d2d5830 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.659+0000 7f2be7fff700 1 -- 172.21.15.12:0/361492493 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bec09b220 con 0x559b2d2d5830 2023-12-11T20:32:17.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.659+0000 7f2be7fff700 1 -- 172.21.15.12:0/361492493 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec09f1b0 con 0x559b2d2d5830 2023-12-11T20:32:17.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.661+0000 7f2c1752bb80 1 -- 172.21.15.12:0/361492493 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d5830 msgr2=0x559b2d2d6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.661+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d5830 0x559b2d2d6140 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0095c0 tx=0x7f2bec09ab80 comp rx=0 tx=0).stop 2023-12-11T20:32:17.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.662+0000 7f2c1752bb80 1 -- 172.21.15.12:0/361492493 shutdown_connections 2023-12-11T20:32:17.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.662+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.662+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 0x559b2d2d52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.662+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/361492493 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d5830 0x559b2d2d6140 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.662+0000 7f2c1752bb80 1 -- 172.21.15.12:0/361492493 >> 172.21.15.12:0/361492493 conn(0x559b2d204780 msgr2=0x559b2d2d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:17.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.662+0000 7f2c1752bb80 1 -- 172.21.15.12:0/361492493 shutdown_connections 2023-12-11T20:32:17.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.662+0000 7f2c1752bb80 1 -- 172.21.15.12:0/361492493 wait complete. 2023-12-11T20:32:17.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.663+0000 7f2c1752bb80 1 -- start start 2023-12-11T20:32:17.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.663+0000 7f2c1752bb80 1 Processor -- start 2023-12-11T20:32:17.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.664+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d4ed0 0x559b2d2deaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.665+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2defe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.665+0000 7f2c0199b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d4ed0 0x559b2d2deaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.665+0000 7f2c0119a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2defe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.665+0000 7f2c0199b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d4ed0 0x559b2d2deaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46054/0 (socket says 172.21.15.12:46054) 2023-12-11T20:32:17.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.665+0000 7f2c0119a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2defe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:35566/0 (socket says 172.21.15.12:35566) 2023-12-11T20:32:17.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.665+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d1e3500 con 0x559b2d2d6720 2023-12-11T20:32:17.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d1e31a0 con 0x559b2d2d4ed0 2023-12-11T20:32:17.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d0a88c0 con 0x559b2d2d5830 2023-12-11T20:32:17.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c1752bb80 10 client.0 _ll_register_callbacks cb 0x559b2d10ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:17.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c0199b700 1 -- 172.21.15.12:0/2337101252 learned_addr learned my addr 172.21.15.12:0/2337101252 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:17.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c0219c700 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c0119a700 1 -- 172.21.15.12:0/2337101252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d4ed0 msgr2=0x559b2d2deaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c0119a700 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d4ed0 0x559b2d2deaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c0119a700 1 -- 172.21.15.12:0/2337101252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 msgr2=0x559b2d2e5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c0119a700 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2e5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c0119a700 1 -- 172.21.15.12:0/2337101252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf4025050 con 0x559b2d2d5830 2023-12-11T20:32:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.666+0000 7f2c0219c700 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.667+0000 7f2c0119a700 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2defe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2bec000c00 tx=0x7f2bec00b490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=978663f99203f997 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.667+0000 7f2be57fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:32:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.667+0000 7f2be57fa700 1 -- 172.21.15.12:0/2337101252 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec09b920 con 0x559b2d2d5830 2023-12-11T20:32:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.667+0000 7f2be57fa700 1 -- 172.21.15.12:0/2337101252 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2bec09f370 con 0x559b2d2d5830 2023-12-11T20:32:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.668+0000 7f2c1752bb80 1 -- 172.21.15.12:0/2337101252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b2d2c8730 con 0x559b2d2d5830 2023-12-11T20:32:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.668+0000 7f2be57fa700 1 -- 172.21.15.12:0/2337101252 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bec07b070 con 0x559b2d2d5830 2023-12-11T20:32:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.668+0000 7f2c1752bb80 10 client.29656 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.668+0000 7f2c1752bb80 1 -- 172.21.15.12:0/2337101252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f2bfc19d6c0 con 0x559b2d2d5830 2023-12-11T20:32:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.668+0000 7f2be57fa700 1 -- 172.21.15.12:0/2337101252 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559b2d2c8730 con 0x559b2d2d5830 2023-12-11T20:32:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.669+0000 7f2be57fa700 1 -- 172.21.15.12:0/2337101252 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2bec097010 con 0x559b2d2d5830 2023-12-11T20:32:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.669+0000 7f2c1752bb80 10 client.29656 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.669+0000 7f2c1752bb80 10 client.29656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.669+0000 7f2c1752bb80 20 client.29656 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.669+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559b2d2ea5c0 0x559b2d2ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.669+0000 7f2c1752bb80 4 client.29656 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.669+0000 7f2c1752bb80 1 -- 172.21.15.12:0/2337101252 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b2d2a4ee0 con 0x559b2d2ea5c0 2023-12-11T20:32:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.669+0000 7f2c0199b700 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559b2d2ea5c0 0x559b2d2ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.670+0000 7f2be57fa700 10 client.29656 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.671+0000 7f2c0199b700 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559b2d2ea5c0 0x559b2d2ec9e0 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e08be1067cb2bcb server_cookie=de7a3eff5d96690d in_seq=0 out_seq=0 2023-12-11T20:32:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.672+0000 7f2be57fa700 1 -- 172.21.15.12:0/2337101252 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559b2d2a4ee0 con 0x559b2d2ea5c0 2023-12-11T20:32:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.672+0000 7f2be57fa700 10 client.29656 handle_command_reply: tid=0 2023-12-11T20:32:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.672+0000 7f2c1752bb80 1 client.29656 shutdown 2023-12-11T20:32:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2c1752bb80 1 -- 172.21.15.12:0/2337101252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 msgr2=0x559b2d2defe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2defe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2bec000c00 tx=0x7f2bec00b490 comp rx=0 tx=0).stop 2023-12-11T20:32:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2c1752bb80 1 -- 172.21.15.12:0/2337101252 shutdown_connections 2023-12-11T20:32:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559b2d2ea5c0 0x559b2d2ec9e0 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d4ed0 0x559b2d2deaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d6720 0x559b2d2e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/2337101252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2defe0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2c1752bb80 1 -- 172.21.15.12:0/2337101252 >> 172.21.15.12:0/2337101252 conn(0x559b2d204780 msgr2=0x559b2d2cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.673+0000 7f2be57fa700 0 client.29656 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.674+0000 7f2c1752bb80 1 -- 172.21.15.12:0/2337101252 shutdown_connections 2023-12-11T20:32:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.674+0000 7f2c1752bb80 1 -- 172.21.15.12:0/2337101252 wait complete. 2023-12-11T20:32:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.677+0000 7f2c1752bb80 20 client.29656 trim_cache size 0 max 16384 2023-12-11T20:32:17.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.721+0000 7f2c1752bb80 1 Processor -- start 2023-12-11T20:32:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.721+0000 7f2c1752bb80 1 -- start start 2023-12-11T20:32:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.721+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 0x559b2d2e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.721+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d5830 0x559b2d2e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.721+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2d9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.721+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d2e6410 con 0x559b2d2d5830 2023-12-11T20:32:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.721+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d2de400 con 0x559b2d2d6720 2023-12-11T20:32:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.721+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d2f1bb0 con 0x559b2d2d4ed0 2023-12-11T20:32:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.722+0000 7f2c0119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d5830 0x559b2d2e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.722+0000 7f2c0219c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2d9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.722+0000 7f2c0219c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2d9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46062/0 (socket says 172.21.15.12:46062) 2023-12-11T20:32:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.722+0000 7f2c0219c700 1 -- 172.21.15.12:0/4169126982 learned_addr learned my addr 172.21.15.12:0/4169126982 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.722+0000 7f2c0219c700 1 -- 172.21.15.12:0/4169126982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 msgr2=0x559b2d2e66f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:32:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.722+0000 7f2c0219c700 1 --2- 172.21.15.12:0/4169126982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 0x559b2d2e66f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.722+0000 7f2c0219c700 1 -- 172.21.15.12:0/4169126982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d5830 msgr2=0x559b2d2e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.722+0000 7f2c0219c700 1 --2- 172.21.15.12:0/4169126982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d5830 0x559b2d2e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.723+0000 7f2c0219c700 1 -- 172.21.15.12:0/4169126982 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b2d052d80 con 0x559b2d2d6720 2023-12-11T20:32:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.723+0000 7f2c0219c700 1 --2- 172.21.15.12:0/4169126982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2d9940 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4012f50 tx=0x7f2bf4022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f36b6eb456c26b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.723+0000 7f2c0119a700 1 --2- 172.21.15.12:0/4169126982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d5830 0x559b2d2e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.725+0000 7f2bf0bff700 1 -- 172.21.15.12:0/4169126982 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400e070 con 0x559b2d2d6720 2023-12-11T20:32:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.725+0000 7f2bf0bff700 1 -- 172.21.15.12:0/4169126982 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bf401fa50 con 0x559b2d2d6720 2023-12-11T20:32:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.725+0000 7f2bf0bff700 1 -- 172.21.15.12:0/4169126982 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf40046d0 con 0x559b2d2d6720 2023-12-11T20:32:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.726+0000 7f2c1752bb80 1 -- 172.21.15.12:0/4169126982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 msgr2=0x559b2d2d9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.726+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/4169126982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2d9940 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4012f50 tx=0x7f2bf4022000 comp rx=0 tx=0).stop 2023-12-11T20:32:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.726+0000 7f2c1752bb80 1 -- 172.21.15.12:0/4169126982 shutdown_connections 2023-12-11T20:32:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.726+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/4169126982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2d9940 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.726+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/4169126982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d4ed0 0x559b2d2e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.726+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/4169126982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d5830 0x559b2d2e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.726+0000 7f2c1752bb80 1 -- 172.21.15.12:0/4169126982 >> 172.21.15.12:0/4169126982 conn(0x559b2d204780 msgr2=0x559b2d2dcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.727+0000 7f2c1752bb80 1 -- 172.21.15.12:0/4169126982 shutdown_connections 2023-12-11T20:32:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.727+0000 7f2c1752bb80 1 -- 172.21.15.12:0/4169126982 wait complete. 2023-12-11T20:32:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.727+0000 7f2c1752bb80 1 -- start start 2023-12-11T20:32:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.728+0000 7f2c1752bb80 1 Processor -- start 2023-12-11T20:32:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.730+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d4ed0 0x559b2d2e3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.730+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.730+0000 7f2c1752bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2e48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.730+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d2e4e10 con 0x559b2d2d4ed0 2023-12-11T20:32:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.730+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d2e4f80 con 0x559b2d2d6720 2023-12-11T20:32:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.730+0000 7f2c1752bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b2d2e5140 con 0x559b2d2d5830 2023-12-11T20:32:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.730+0000 7f2c1752bb80 10 client.0 _ll_register_callbacks cb 0x559b2d10ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.731+0000 7f2c0219c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2e48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.731+0000 7f2c0219c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2e48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46066/0 (socket says 172.21.15.12:46066) 2023-12-11T20:32:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.731+0000 7f2c0219c700 1 -- 172.21.15.12:0/942428850 learned_addr learned my addr 172.21.15.12:0/942428850 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.731+0000 7f2c0199b700 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d4ed0 0x559b2d2e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.731+0000 7f2c0119a700 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.732+0000 7f2c0219c700 1 -- 172.21.15.12:0/942428850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 msgr2=0x559b2d2e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.732+0000 7f2c0219c700 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2e38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.732+0000 7f2c0219c700 1 -- 172.21.15.12:0/942428850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d4ed0 msgr2=0x559b2d2e3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.732+0000 7f2c0219c700 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d4ed0 0x559b2d2e3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.732+0000 7f2c0219c700 1 -- 172.21.15.12:0/942428850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf4011040 con 0x559b2d2d6720 2023-12-11T20:32:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.733+0000 7f2c0219c700 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2e48d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2bf402b040 tx=0x7f2bf4004930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efe6a85ce0d80a19 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.733+0000 7f2be57fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.734+0000 7f2be57fa700 1 -- 172.21.15.12:0/942428850 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400e040 con 0x559b2d2d6720 2023-12-11T20:32:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.734+0000 7f2be57fa700 1 -- 172.21.15.12:0/942428850 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2bf4012330 con 0x559b2d2d6720 2023-12-11T20:32:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.734+0000 7f2c1752bb80 1 -- 172.21.15.12:0/942428850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2bec09b220 con 0x559b2d2d6720 2023-12-11T20:32:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.735+0000 7f2be57fa700 1 -- 172.21.15.12:0/942428850 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bf4003aa0 con 0x559b2d2d6720 2023-12-11T20:32:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.735+0000 7f2c1752bb80 10 client.29657 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.735+0000 7f2c1752bb80 1 -- 172.21.15.12:0/942428850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559b2d03bc00 con 0x559b2d2d6720 2023-12-11T20:32:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.735+0000 7f2be57fa700 1 -- 172.21.15.12:0/942428850 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bec09b220 con 0x559b2d2d6720 2023-12-11T20:32:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.735+0000 7f2be57fa700 1 -- 172.21.15.12:0/942428850 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2bf40198a0 con 0x559b2d2d6720 2023-12-11T20:32:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.736+0000 7f2c1752bb80 10 client.29657 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.736+0000 7f2c1752bb80 10 client.29657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.736+0000 7f2c1752bb80 20 client.29657 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.736+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559b2d341160 0x559b2d343580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.736+0000 7f2c1752bb80 4 client.29657 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:32:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.736+0000 7f2c1752bb80 1 -- 172.21.15.12:0/942428850 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559b2d1eff70 con 0x559b2d341160 2023-12-11T20:32:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.736+0000 7f2c0199b700 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559b2d341160 0x559b2d343580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.737+0000 7f2c0199b700 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559b2d341160 0x559b2d343580 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbb563a8b4a3ee7 server_cookie=66a78eca6a829794 in_seq=0 out_seq=0 2023-12-11T20:32:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.737+0000 7f2be57fa700 10 client.29657 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.768+0000 7f2be57fa700 1 -- 172.21.15.12:0/942428850 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559b2d1eff70 con 0x559b2d341160 2023-12-11T20:32:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.768+0000 7f2be57fa700 10 client.29657 handle_command_reply: tid=0 2023-12-11T20:32:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.768+0000 7f2c1752bb80 1 client.29657 shutdown 2023-12-11T20:32:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.769+0000 7f2c1752bb80 1 -- 172.21.15.12:0/942428850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 msgr2=0x559b2d2e48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.769+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2e48d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2bf402b040 tx=0x7f2bf4004930 comp rx=0 tx=0).stop 2023-12-11T20:32:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.770+0000 7f2c1752bb80 1 -- 172.21.15.12:0/942428850 shutdown_connections 2023-12-11T20:32:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.770+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559b2d341160 0x559b2d343580 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.770+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559b2d2d6720 0x559b2d2e48d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.770+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2d2d4ed0 0x559b2d2e3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.770+0000 7f2c1752bb80 1 --2- 172.21.15.12:0/942428850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559b2d2d5830 0x559b2d2e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.770+0000 7f2c1752bb80 1 -- 172.21.15.12:0/942428850 >> 172.21.15.12:0/942428850 conn(0x559b2d204780 msgr2=0x559b2d2d9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.770+0000 7f2be57fa700 0 client.29657 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.771+0000 7f2c1752bb80 1 -- 172.21.15.12:0/942428850 shutdown_connections 2023-12-11T20:32:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.771+0000 7f2c1752bb80 1 -- 172.21.15.12:0/942428850 wait complete. 2023-12-11T20:32:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.771+0000 7f2c1752bb80 20 client.29657 trim_cache size 0 max 16384 2023-12-11T20:32:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:32:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:32:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:32:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.772+0000 7f2c03bff700 1 -- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2be80a59c0 msgr2=0x7f2be80a7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.772+0000 7f2c03bff700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2be80a59c0 0x7f2be80a7e80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2bf401fdd0 tx=0x7f2bf40126a0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.773+0000 7f2c03bff700 1 -- 172.21.15.12:0/2377269006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc1026e0 msgr2=0x7f2bfc195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.773+0000 7f2c03bff700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc1026e0 0x7f2bfc195730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b710 tx=0x7f2bec00bb20 comp rx=0 tx=0).stop 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.773+0000 7f2c03bff700 1 -- 172.21.15.12:0/2377269006 shutdown_connections 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.773+0000 7f2c03bff700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2be80a59c0 0x7f2be80a7e80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.773+0000 7f2c03bff700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bfc103080 0x7f2bfc19c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.773+0000 7f2c03bff700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2bfc1014f0 0x7f2bfc1951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.773+0000 7f2c03bff700 1 --2- 172.21.15.12:0/2377269006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bfc1026e0 0x7f2bfc195730 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.773+0000 7f2c03bff700 1 -- 172.21.15.12:0/2377269006 >> 172.21.15.12:0/2377269006 conn(0x7f2bfc0fca60 msgr2=0x7f2bfc105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.774+0000 7f2c03bff700 1 -- 172.21.15.12:0/2377269006 shutdown_connections 2023-12-11T20:32:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:17.774+0000 7f2c03bff700 1 -- 172.21.15.12:0/2377269006 wait complete. 2023-12-11T20:32:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:19 smithi032 ceph-mon[132488]: pgmap v866: 97 pgs: 97 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 MiB/s wr, 5.39k op/s 2023-12-11T20:32:19.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:19 smithi039 ceph-mon[102205]: pgmap v866: 97 pgs: 97 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 MiB/s wr, 5.39k op/s 2023-12-11T20:32:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:19 smithi012 ceph-mon[128787]: pgmap v866: 97 pgs: 97 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 MiB/s wr, 5.39k op/s 2023-12-11T20:32:21.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:21 smithi032 ceph-mon[132488]: pgmap v867: 97 pgs: 97 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2023-12-11T20:32:21.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:21 smithi039 ceph-mon[102205]: pgmap v867: 97 pgs: 97 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2023-12-11T20:32:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:21 smithi012 ceph-mon[128787]: pgmap v867: 97 pgs: 97 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2023-12-11T20:32:23.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:23 smithi032 ceph-mon[132488]: pgmap v868: 97 pgs: 97 active+clean; 13 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 MiB/s wr, 5.25k op/s 2023-12-11T20:32:23.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:23 smithi039 ceph-mon[102205]: pgmap v868: 97 pgs: 97 active+clean; 13 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 MiB/s wr, 5.25k op/s 2023-12-11T20:32:23.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:23 smithi012 ceph-mon[128787]: pgmap v868: 97 pgs: 97 active+clean; 13 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 MiB/s wr, 5.25k op/s 2023-12-11T20:32:25.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:25 smithi032 ceph-mon[132488]: pgmap v869: 97 pgs: 97 active+clean; 13 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.84k op/s 2023-12-11T20:32:25.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:25 smithi039 ceph-mon[102205]: pgmap v869: 97 pgs: 97 active+clean; 13 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.84k op/s 2023-12-11T20:32:25.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:25 smithi012 ceph-mon[128787]: pgmap v869: 97 pgs: 97 active+clean; 13 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 MiB/s wr, 4.84k op/s 2023-12-11T20:32:25.653 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:32:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.125+0000 7fcae4bff700 1 -- 172.21.15.12:0/1131556573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0102690 msgr2=0x7fcae0102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.125+0000 7fcae4bff700 1 --2- 172.21.15.12:0/1131556573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0102690 0x7fcae0102af0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcad40098f0 tx=0x7fcad4009c00 comp rx=0 tx=0).stop 2023-12-11T20:32:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.126+0000 7fcae4bff700 1 -- 172.21.15.12:0/1131556573 shutdown_connections 2023-12-11T20:32:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.126+0000 7fcae4bff700 1 --2- 172.21.15.12:0/1131556573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae01014a0 0x7fcae01018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.126+0000 7fcae4bff700 1 --2- 172.21.15.12:0/1131556573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0103030 0x7fcae01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.126+0000 7fcae4bff700 1 --2- 172.21.15.12:0/1131556573 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae0102690 0x7fcae0102af0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.126+0000 7fcae4bff700 1 -- 172.21.15.12:0/1131556573 >> 172.21.15.12:0/1131556573 conn(0x7fcae00fca30 msgr2=0x7fcae00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:27.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.127+0000 7fcae4bff700 1 -- 172.21.15.12:0/1131556573 shutdown_connections 2023-12-11T20:32:27.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.127+0000 7fcae4bff700 1 -- 172.21.15.12:0/1131556573 wait complete. 2023-12-11T20:32:27.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.129+0000 7fcae4bff700 1 Processor -- start 2023-12-11T20:32:27.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.129+0000 7fcae4bff700 1 -- start start 2023-12-11T20:32:27.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.130+0000 7fcae4bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae01014a0 0x7fcae0195150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.130+0000 7fcae4bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0102690 0x7fcae0195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.130+0000 7fcae4bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0103030 0x7fcae01adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.130+0000 7fcae4bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae019a730 con 0x7fcae0103030 2023-12-11T20:32:27.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.130+0000 7fcae4bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae019a8a0 con 0x7fcae0102690 2023-12-11T20:32:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.130+0000 7fcae4bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae019aa60 con 0x7fcae01014a0 2023-12-11T20:32:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcade59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae01014a0 0x7fcae0195150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcade59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae01014a0 0x7fcae0195150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40140/0 (socket says 172.21.15.12:40140) 2023-12-11T20:32:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcade59c700 1 -- 172.21.15.12:0/2411892008 learned_addr learned my addr 172.21.15.12:0/2411892008 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:27.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0102690 0x7fcae0195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcade59c700 1 -- 172.21.15.12:0/2411892008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0102690 msgr2=0x7fcae0195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcade59c700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0102690 0x7fcae0195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcade59c700 1 -- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0103030 msgr2=0x7fcae01adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcade59c700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0103030 0x7fcae01adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.131+0000 7fcade59c700 1 -- 172.21.15.12:0/2411892008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4009520 con 0x7fcae01014a0 2023-12-11T20:32:27.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.132+0000 7fcade59c700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae01014a0 0x7fcae0195150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcad000efb0 tx=0x7fcad000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.133+0000 7fcacf7fe700 1 -- 172.21.15.12:0/2411892008 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0018070 con 0x7fcae01014a0 2023-12-11T20:32:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.133+0000 7fcacf7fe700 1 -- 172.21.15.12:0/2411892008 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcad000f040 con 0x7fcae01014a0 2023-12-11T20:32:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.133+0000 7fcacf7fe700 1 -- 172.21.15.12:0/2411892008 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0004280 con 0x7fcae01014a0 2023-12-11T20:32:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.134+0000 7fcae4bff700 1 -- 172.21.15.12:0/2411892008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae006b0b0 con 0x7fcae01014a0 2023-12-11T20:32:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.134+0000 7fcae4bff700 1 -- 172.21.15.12:0/2411892008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae006b510 con 0x7fcae01014a0 2023-12-11T20:32:27.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.142+0000 7fcacf7fe700 1 -- 172.21.15.12:0/2411892008 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcad00043e0 con 0x7fcae01014a0 2023-12-11T20:32:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.144+0000 7fcaf854ab80 1 Processor -- start 2023-12-11T20:32:27.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.145+0000 7fcaf854ab80 1 -- start start 2023-12-11T20:32:27.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.145+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c3023d0 0x562d8c3027f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.145+0000 7fcacf7fe700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a15d0 0x7fcac80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c303640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c303c20 0x562d8c3040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c25db50 con 0x562d8c3023d0 2023-12-11T20:32:27.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c25b470 con 0x562d8c302d30 2023-12-11T20:32:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c256d60 con 0x562d8c303c20 2023-12-11T20:32:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcacf7fe700 1 -- 172.21.15.12:0/2411892008 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcad00ccb60 con 0x7fcae01014a0 2023-12-11T20:32:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaddd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c303640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaded9d700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a15d0 0x7fcac80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaddd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c303640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38712/0 (socket says 172.21.15.12:38712) 2023-12-11T20:32:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcaddd9b700 1 -- 172.21.15.12:0/3623250938 learned_addr learned my addr 172.21.15.12:0/3623250938 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.146+0000 7fcade59c700 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c3023d0 0x562d8c3027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.147+0000 7fcaded9d700 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c303c20 0x562d8c3040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.147+0000 7fcaddd9b700 1 -- 172.21.15.12:0/3623250938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c303c20 msgr2=0x562d8c3040a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.147+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c303c20 0x562d8c3040a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.147+0000 7fcaddd9b700 1 -- 172.21.15.12:0/3623250938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c3023d0 msgr2=0x562d8c3027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.147+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c3023d0 0x562d8c3027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.147+0000 7fcaddd9b700 1 -- 172.21.15.12:0/3623250938 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d8c0d3630 con 0x562d8c302d30 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.147+0000 7fcade59c700 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c3023d0 0x562d8c3027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.147+0000 7fcaded9d700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a15d0 0x7fcac80a3a90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcad80094f0 tx=0x7fcad80126d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.148+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c303640 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcad4000c00 tx=0x7fcad4009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbb3dd790c5661d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.148+0000 7fcaccff9700 1 -- 172.21.15.12:0/3623250938 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad401d040 con 0x562d8c302d30 2023-12-11T20:32:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.149+0000 7fcaccff9700 1 -- 172.21.15.12:0/3623250938 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcad40050a0 con 0x562d8c302d30 2023-12-11T20:32:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.149+0000 7fcaccff9700 1 -- 172.21.15.12:0/3623250938 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400fe50 con 0x562d8c302d30 2023-12-11T20:32:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.150+0000 7fcaf854ab80 1 -- 172.21.15.12:0/3623250938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 msgr2=0x562d8c303640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.150+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c303640 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcad4000c00 tx=0x7fcad4009f50 comp rx=0 tx=0).stop 2023-12-11T20:32:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.150+0000 7fcaf854ab80 1 -- 172.21.15.12:0/3623250938 shutdown_connections 2023-12-11T20:32:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.150+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c303c20 0x562d8c3040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.150+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c3023d0 0x562d8c3027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.150+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/3623250938 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c303640 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.150+0000 7fcaf854ab80 1 -- 172.21.15.12:0/3623250938 >> 172.21.15.12:0/3623250938 conn(0x562d8c2317e0 msgr2=0x562d8c2fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.150+0000 7fcaf854ab80 1 -- 172.21.15.12:0/3623250938 shutdown_connections 2023-12-11T20:32:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.151+0000 7fcaf854ab80 1 -- 172.21.15.12:0/3623250938 wait complete. 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.151+0000 7fcaf854ab80 1 -- start start 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.152+0000 7fcaf854ab80 1 Processor -- start 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.152+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.152+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c302d30 0x562d8c30c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.152+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c303c20 0x562d8c3136c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.152+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c210560 con 0x562d8c302d30 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.152+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c210200 con 0x562d8c303c20 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.152+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c0d5920 con 0x562d8c3023d0 2023-12-11T20:32:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.153+0000 7fcaf854ab80 10 client.0 _ll_register_callbacks cb 0x562d8c13ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.153+0000 7fcade59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.154+0000 7fcaddd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c302d30 0x562d8c30c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.154+0000 7fcade59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40150/0 (socket says 172.21.15.12:40150) 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.154+0000 7fcade59c700 1 -- 172.21.15.12:0/2435526476 learned_addr learned my addr 172.21.15.12:0/2435526476 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.154+0000 7fcaded9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c303c20 0x562d8c3136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcaddd9b700 1 -- 172.21.15.12:0/2435526476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 msgr2=0x562d8c30c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcaddd9b700 1 -- 172.21.15.12:0/2435526476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c303c20 msgr2=0x562d8c3136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c303c20 0x562d8c3136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcaddd9b700 1 -- 172.21.15.12:0/2435526476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae006b510 con 0x562d8c302d30 2023-12-11T20:32:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcaded9d700 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c303c20 0x562d8c3136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcade59c700 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c302d30 0x562d8c30c680 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c010 tx=0x7fcad400fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a254a1503e9a4c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.155+0000 7fcac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:32:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.156+0000 7fcac5ffb700 1 -- 172.21.15.12:0/2435526476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad401d040 con 0x562d8c302d30 2023-12-11T20:32:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.156+0000 7fcac5ffb700 1 -- 172.21.15.12:0/2435526476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcad4005410 con 0x562d8c302d30 2023-12-11T20:32:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.156+0000 7fcaf854ab80 1 -- 172.21.15.12:0/2435526476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d8c2f5b40 con 0x562d8c302d30 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.156+0000 7fcac5ffb700 1 -- 172.21.15.12:0/2435526476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcad40055f0 con 0x562d8c302d30 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.156+0000 7fcaf854ab80 10 client.20130 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.156+0000 7fcaf854ab80 1 -- 172.21.15.12:0/2435526476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7fcae010a230 con 0x562d8c302d30 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.157+0000 7fcac5ffb700 1 -- 172.21.15.12:0/2435526476 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562d8c2f5b40 con 0x562d8c302d30 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.157+0000 7fcac5ffb700 1 -- 172.21.15.12:0/2435526476 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcad4015020 con 0x562d8c302d30 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.157+0000 7fcaf854ab80 10 client.20130 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.157+0000 7fcaf854ab80 10 client.20130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.157+0000 7fcaf854ab80 20 client.20130 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.157+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562d8c317a90 0x562d8c319e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.157+0000 7fcaf854ab80 4 client.20130 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.157+0000 7fcaf854ab80 1 -- 172.21.15.12:0/2435526476 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d8c2d1f40 con 0x562d8c317a90 2023-12-11T20:32:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.158+0000 7fcade59c700 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562d8c317a90 0x562d8c319e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.159+0000 7fcac5ffb700 10 client.20130 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:27.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.159+0000 7fcade59c700 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562d8c317a90 0x562d8c319e80 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca837c09d27e1776 server_cookie=5a15c109ac134de5 in_seq=0 out_seq=0 2023-12-11T20:32:27.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.159+0000 7fcac5ffb700 1 -- 172.21.15.12:0/2435526476 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562d8c2d1f40 con 0x562d8c317a90 2023-12-11T20:32:27.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.159+0000 7fcac5ffb700 10 client.20130 handle_command_reply: tid=0 2023-12-11T20:32:27.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 client.20130 shutdown 2023-12-11T20:32:27.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 -- 172.21.15.12:0/2435526476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c302d30 msgr2=0x562d8c30c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c302d30 0x562d8c30c680 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c010 tx=0x7fcad400fe80 comp rx=0 tx=0).stop 2023-12-11T20:32:27.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 -- 172.21.15.12:0/2435526476 shutdown_connections 2023-12-11T20:32:27.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562d8c317a90 0x562d8c319e80 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c303c20 0x562d8c3136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/2435526476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c302d30 0x562d8c30c680 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 -- 172.21.15.12:0/2435526476 >> 172.21.15.12:0/2435526476 conn(0x562d8c2317e0 msgr2=0x562d8c2fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:27.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcac5ffb700 0 client.20130 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:27.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.160+0000 7fcaf854ab80 1 -- 172.21.15.12:0/2435526476 shutdown_connections 2023-12-11T20:32:27.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.161+0000 7fcaf854ab80 1 -- 172.21.15.12:0/2435526476 wait complete. 2023-12-11T20:32:27.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.162+0000 7fcaf854ab80 20 client.20130 trim_cache size 0 max 16384 2023-12-11T20:32:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.196+0000 7fcaf854ab80 1 Processor -- start 2023-12-11T20:32:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaf854ab80 1 -- start start 2023-12-11T20:32:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c313680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c306b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c303aa0 con 0x562d8c303c20 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c30bcb0 con 0x562d8c302d30 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c30d330 con 0x562d8c3023d0 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaddd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c313680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.197+0000 7fcaded9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c306b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcaddd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c313680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38722/0 (socket says 172.21.15.12:38722) 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcaddd9b700 1 -- 172.21.15.12:0/1267214155 learned_addr learned my addr 172.21.15.12:0/1267214155 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcaddd9b700 1 -- 172.21.15.12:0/1267214155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 msgr2=0x562d8c30ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcade59c700 1 --2- 172.21.15.12:0/1267214155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/1267214155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcaddd9b700 1 -- 172.21.15.12:0/1267214155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 msgr2=0x562d8c306b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:27.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/1267214155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c306b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcaddd9b700 1 -- 172.21.15.12:0/1267214155 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d8c07fde0 con 0x562d8c302d30 2023-12-11T20:32:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/1267214155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c313680 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005970 tx=0x7fcad4005a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fbee2d1db406f83 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcacd7fa700 1 -- 172.21.15.12:0/1267214155 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400f830 con 0x562d8c302d30 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.198+0000 7fcacd7fa700 1 -- 172.21.15.12:0/1267214155 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcad4003e90 con 0x562d8c302d30 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.199+0000 7fcacd7fa700 1 -- 172.21.15.12:0/1267214155 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400baa0 con 0x562d8c302d30 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.199+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1267214155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 msgr2=0x562d8c313680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.199+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1267214155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c313680 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005970 tx=0x7fcad4005a40 comp rx=0 tx=0).stop 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.199+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1267214155 shutdown_connections 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.199+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1267214155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c306b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.199+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1267214155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c30ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.199+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1267214155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c313680 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.199+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1267214155 >> 172.21.15.12:0/1267214155 conn(0x562d8c2317e0 msgr2=0x562d8c30a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:27.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.200+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1267214155 shutdown_connections 2023-12-11T20:32:27.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.201+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1267214155 wait complete. 2023-12-11T20:32:27.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.202+0000 7fcaf854ab80 1 -- start start 2023-12-11T20:32:27.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.203+0000 7fcaf854ab80 1 Processor -- start 2023-12-11T20:32:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c311160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c3116a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaf854ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c312660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c312ba0 con 0x562d8c303c20 2023-12-11T20:32:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c312d10 con 0x562d8c302d30 2023-12-11T20:32:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaf854ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8c312ed0 con 0x562d8c3023d0 2023-12-11T20:32:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaf854ab80 10 client.0 _ll_register_callbacks cb 0x562d8c13ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:27.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaddd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c3116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaddd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c3116a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38728/0 (socket says 172.21.15.12:38728) 2023-12-11T20:32:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaddd9b700 1 -- 172.21.15.12:0/1266251968 learned_addr learned my addr 172.21.15.12:0/1266251968 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.206+0000 7fcaded9d700 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c312660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.207+0000 7fcaddd9b700 1 -- 172.21.15.12:0/1266251968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 msgr2=0x562d8c311160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.208+0000 7fcade59c700 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c311160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.208+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c311160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.208+0000 7fcaddd9b700 1 -- 172.21.15.12:0/1266251968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 msgr2=0x562d8c312660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.208+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c312660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.208+0000 7fcaddd9b700 1 -- 172.21.15.12:0/1266251968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae010a230 con 0x562d8c302d30 2023-12-11T20:32:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.208+0000 7fcaded9d700 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c312660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:27.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.209+0000 7fcaddd9b700 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c3116a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcad400fb30 tx=0x7fcad400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30389fd66a29ac44 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:27.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.209+0000 7fcac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:27.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.210+0000 7fcac5ffb700 1 -- 172.21.15.12:0/1266251968 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad401d030 con 0x562d8c302d30 2023-12-11T20:32:27.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.210+0000 7fcac5ffb700 1 -- 172.21.15.12:0/1266251968 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcad4000e40 con 0x562d8c302d30 2023-12-11T20:32:27.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.210+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1266251968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcad40050a0 con 0x562d8c302d30 2023-12-11T20:32:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.211+0000 7fcac5ffb700 1 -- 172.21.15.12:0/1266251968 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcad400f830 con 0x562d8c302d30 2023-12-11T20:32:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.211+0000 7fcaf854ab80 10 client.29675 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.211+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1266251968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562d8c068c60 con 0x562d8c302d30 2023-12-11T20:32:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.212+0000 7fcac5ffb700 1 -- 172.21.15.12:0/1266251968 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcad40050a0 con 0x562d8c302d30 2023-12-11T20:32:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.212+0000 7fcac5ffb700 1 -- 172.21.15.12:0/1266251968 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcad4015070 con 0x562d8c302d30 2023-12-11T20:32:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.212+0000 7fcaf854ab80 10 client.29675 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.212+0000 7fcaf854ab80 10 client.29675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.212+0000 7fcaf854ab80 20 client.29675 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.212+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562d8c36e7e0 0x562d8c370c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.212+0000 7fcaf854ab80 4 client.29675 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:32:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.212+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1266251968 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562d8c21cfd0 con 0x562d8c36e7e0 2023-12-11T20:32:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.213+0000 7fcade59c700 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562d8c36e7e0 0x562d8c370c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.213+0000 7fcade59c700 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562d8c36e7e0 0x562d8c370c00 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8309cc29e48a870 server_cookie=fdca48addfade2c2 in_seq=0 out_seq=0 2023-12-11T20:32:27.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.214+0000 7fcac5ffb700 10 client.29675 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:27.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.214+0000 7fcac5ffb700 1 -- 172.21.15.12:0/1266251968 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562d8c21cfd0 con 0x562d8c36e7e0 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.214+0000 7fcac5ffb700 10 client.29675 handle_command_reply: tid=0 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.214+0000 7fcaf854ab80 1 client.29675 shutdown 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.214+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1266251968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 msgr2=0x562d8c3116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.214+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c3116a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcad400fb30 tx=0x7fcad400bab0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1266251968 shutdown_connections 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x562d8c36e7e0 0x562d8c370c00 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d8c303c20 0x562d8c312660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562d8c3023d0 0x562d8c311160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 1 --2- 172.21.15.12:0/1266251968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562d8c302d30 0x562d8c3116a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1266251968 >> 172.21.15.12:0/1266251968 conn(0x562d8c2317e0 msgr2=0x562d8c30a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:27.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcac5ffb700 0 client.29675 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:27.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1266251968 shutdown_connections 2023-12-11T20:32:27.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 1 -- 172.21.15.12:0/1266251968 wait complete. 2023-12-11T20:32:27.215 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:32:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:32:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:32:27.215 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:32:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.215+0000 7fcaf854ab80 20 client.29675 trim_cache size 0 max 16384 2023-12-11T20:32:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 -- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a15d0 msgr2=0x7fcac80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a15d0 0x7fcac80a3a90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcad80094f0 tx=0x7fcad80126d0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 -- 172.21.15.12:0/2411892008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae01014a0 msgr2=0x7fcae0195150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae01014a0 0x7fcae0195150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcad000efb0 tx=0x7fcad000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 -- 172.21.15.12:0/2411892008 shutdown_connections 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcac80a15d0 0x7fcac80a3a90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae0103030 0x7fcae01adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcae01014a0 0x7fcae0195150 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 --2- 172.21.15.12:0/2411892008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae0102690 0x7fcae0195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 -- 172.21.15.12:0/2411892008 >> 172.21.15.12:0/2411892008 conn(0x7fcae00fca30 msgr2=0x7fcae01038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 -- 172.21.15.12:0/2411892008 shutdown_connections 2023-12-11T20:32:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.216+0000 7fcae4bff700 1 -- 172.21.15.12:0/2411892008 wait complete. 2023-12-11T20:32:27.257 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:32:27.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:32:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:27 smithi039 ceph-mon[102205]: pgmap v870: 97 pgs: 97 active+clean; 13 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 MiB/s wr, 5.08k op/s 2023-12-11T20:32:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:27 smithi012 ceph-mon[128787]: pgmap v870: 97 pgs: 97 active+clean; 13 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 MiB/s wr, 5.08k op/s 2023-12-11T20:32:27.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:27 smithi032 ceph-mon[132488]: pgmap v870: 97 pgs: 97 active+clean; 13 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 MiB/s wr, 5.08k op/s 2023-12-11T20:32:27.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.841+0000 7f4ecfdff700 1 -- 172.21.15.12:0/3637315278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8108ca0 msgr2=0x7f4ec8109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.841+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/3637315278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8108ca0 0x7f4ec8109100 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80099c0 tx=0x7f4eb8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.841+0000 7f4ecfdff700 1 -- 172.21.15.12:0/3637315278 shutdown_connections 2023-12-11T20:32:27.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.841+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/3637315278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ec8109640 0x7f4ec810fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.841+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/3637315278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ec8107ab0 0x7f4ec8107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.841+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/3637315278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8108ca0 0x7f4ec8109100 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.841+0000 7f4ecfdff700 1 -- 172.21.15.12:0/3637315278 >> 172.21.15.12:0/3637315278 conn(0x7f4ec8076a70 msgr2=0x7f4ec8078e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:27.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.841+0000 7f4ecfdff700 1 -- 172.21.15.12:0/3637315278 shutdown_connections 2023-12-11T20:32:27.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.842+0000 7f4ecfdff700 1 -- 172.21.15.12:0/3637315278 wait complete. 2023-12-11T20:32:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.843+0000 7f4ecfdff700 1 Processor -- start 2023-12-11T20:32:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.844+0000 7f4ecfdff700 1 -- start start 2023-12-11T20:32:27.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.846+0000 7f4ecfdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ec8107ab0 0x7f4ec819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.846+0000 7f4ecfdff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ec8108ca0 0x7f4ec819ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.847+0000 7f4ecdb9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ec8107ab0 0x7f4ec819d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.847+0000 7f4ecdb9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ec8107ab0 0x7f4ec819d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38746/0 (socket says 172.21.15.12:38746) 2023-12-11T20:32:27.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.847+0000 7f4ecfdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8109640 0x7f4ec81a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.848+0000 7f4ece39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8109640 0x7f4ec81a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.848+0000 7f4ece39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8109640 0x7f4ec81a4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41332/0 (socket says 172.21.15.12:41332) 2023-12-11T20:32:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.848+0000 7f4ecfdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81a54c0 con 0x7f4ec8109640 2023-12-11T20:32:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.848+0000 7f4ecfdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81a5600 con 0x7f4ec8107ab0 2023-12-11T20:32:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.848+0000 7f4ecfdff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81a5790 con 0x7f4ec8108ca0 2023-12-11T20:32:27.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.849+0000 7f4ecdb9b700 1 -- 172.21.15.12:0/1102226648 learned_addr learned my addr 172.21.15.12:0/1102226648 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:27.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.849+0000 7f4ecd39a700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ec8108ca0 0x7f4ec819ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.849+0000 7f4ecdb9b700 1 -- 172.21.15.12:0/1102226648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ec8108ca0 msgr2=0x7f4ec819ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.849+0000 7f4ecdb9b700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ec8108ca0 0x7f4ec819ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.849+0000 7f4ecdb9b700 1 -- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8109640 msgr2=0x7f4ec81a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.849+0000 7f4ecdb9b700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8109640 0x7f4ec81a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.849+0000 7f4ecdb9b700 1 -- 172.21.15.12:0/1102226648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80095f0 con 0x7f4ec8107ab0 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.849+0000 7f4ece39c700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8109640 0x7f4ec81a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.850+0000 7f4ecdb9b700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ec8107ab0 0x7f4ec819d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400e970 tx=0x7f4ec400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.850+0000 7f4ebeffd700 1 -- 172.21.15.12:0/1102226648 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4009790 con 0x7f4ec8107ab0 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.850+0000 7f4ebeffd700 1 -- 172.21.15.12:0/1102226648 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ec400c7e0 con 0x7f4ec8107ab0 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.850+0000 7f4ebeffd700 1 -- 172.21.15.12:0/1102226648 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4003b60 con 0x7f4ec8107ab0 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.850+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec806b050 con 0x7f4ec8107ab0 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.851+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec806b510 con 0x7f4ec8107ab0 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.852+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec810ef80 con 0x7f4ec8107ab0 2023-12-11T20:32:27.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.854+0000 7f4ebeffd700 1 -- 172.21.15.12:0/1102226648 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f4ec4003d00 con 0x7f4ec8107ab0 2023-12-11T20:32:27.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.856+0000 7f4ebeffd700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4eb40a15d0 0x7f4eb40a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:27.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.856+0000 7f4ebeffd700 1 -- 172.21.15.12:0/1102226648 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4ec4014070 con 0x7f4ec8107ab0 2023-12-11T20:32:27.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.857+0000 7f4ecd39a700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4eb40a15d0 0x7f4eb40a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:27.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.858+0000 7f4ecd39a700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4eb40a15d0 0x7f4eb40a3a90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009990 tx=0x7f4eb8003680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:27.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:27.859+0000 7f4ebeffd700 1 -- 172.21.15.12:0/1102226648 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4ec4096940 con 0x7f4ec8107ab0 2023-12-11T20:32:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.352+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ec8113450 con 0x7f4ec8107ab0 2023-12-11T20:32:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.353+0000 7f4ebeffd700 1 -- 172.21.15.12:0/1102226648 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f4ec4099f60 con 0x7f4ec8107ab0 2023-12-11T20:32:28.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:32:28.353 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:32:11.561579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:32:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.358+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4eb40a15d0 msgr2=0x7f4eb40a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.358+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4eb40a15d0 0x7f4eb40a3a90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009990 tx=0x7f4eb8003680 comp rx=0 tx=0).stop 2023-12-11T20:32:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.358+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ec8107ab0 msgr2=0x7f4ec819d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.358+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ec8107ab0 0x7f4ec819d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400e970 tx=0x7f4ec400ec80 comp rx=0 tx=0).stop 2023-12-11T20:32:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.359+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 shutdown_connections 2023-12-11T20:32:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.359+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f4eb40a15d0 0x7f4eb40a3a90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.359+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ec8107ab0 0x7f4ec819d990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.359+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ec8109640 0x7f4ec81a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.359+0000 7f4ecfdff700 1 --2- 172.21.15.12:0/1102226648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ec8108ca0 0x7f4ec819ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.359+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 >> 172.21.15.12:0/1102226648 conn(0x7f4ec8076a70 msgr2=0x7f4ec810c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.359+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 shutdown_connections 2023-12-11T20:32:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.359+0000 7f4ecfdff700 1 -- 172.21.15.12:0/1102226648 wait complete. 2023-12-11T20:32:28.361 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 36 2023-12-11T20:32:28.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:32:28.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.830+0000 7f678cbff700 1 -- 172.21.15.12:0/528923048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 msgr2=0x7f67880ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.830+0000 7f678cbff700 1 --2- 172.21.15.12:0/528923048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 0x7f67880ff760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6778009990 tx=0x7f6778009ca0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.831+0000 7f678cbff700 1 -- 172.21.15.12:0/528923048 shutdown_connections 2023-12-11T20:32:28.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.831+0000 7f678cbff700 1 --2- 172.21.15.12:0/528923048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6788100e30 0x7f67881056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.831+0000 7f678cbff700 1 --2- 172.21.15.12:0/528923048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 0x7f67880ff760 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.831+0000 7f678cbff700 1 --2- 172.21.15.12:0/528923048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6788100470 0x7f67881008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.831+0000 7f678cbff700 1 -- 172.21.15.12:0/528923048 >> 172.21.15.12:0/528923048 conn(0x7f67880fac40 msgr2=0x7f67880fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.831+0000 7f678cbff700 1 -- 172.21.15.12:0/528923048 shutdown_connections 2023-12-11T20:32:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.832+0000 7f678cbff700 1 -- 172.21.15.12:0/528923048 wait complete. 2023-12-11T20:32:28.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.834+0000 7f678cbff700 1 Processor -- start 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.834+0000 7f678cbff700 1 -- start start 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.834+0000 7f678cbff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 0x7f6788107980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.834+0000 7f678cbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6788100470 0x7f6788107ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.834+0000 7f678cbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6788100e30 0x7f678810eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.836+0000 7f678cbff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678810f4b0 con 0x7f6788100470 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.836+0000 7f678cbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678810f620 con 0x7f6788100e30 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.836+0000 7f678cbff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678819cfc0 con 0x7f67880ff340 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.836+0000 7f6786d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6788100e30 0x7f678810eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.836+0000 7f6786d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6788100e30 0x7f678810eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50018/0 (socket says 172.21.15.12:50018) 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.836+0000 7f6786d9d700 1 -- 172.21.15.12:0/3777234335 learned_addr learned my addr 172.21.15.12:0/3777234335 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.835+0000 7f678659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 0x7f6788107980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.836+0000 7f6785d9b700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6788100470 0x7f6788107ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.837+0000 7f6786d9d700 1 -- 172.21.15.12:0/3777234335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 msgr2=0x7f6788107980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.837+0000 7f6786d9d700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 0x7f6788107980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.837+0000 7f6786d9d700 1 -- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6788100470 msgr2=0x7f6788107ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.837+0000 7f6786d9d700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6788100470 0x7f6788107ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.837+0000 7f6786d9d700 1 -- 172.21.15.12:0/3777234335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780095f0 con 0x7f6788100e30 2023-12-11T20:32:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.837+0000 7f678659c700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 0x7f6788107980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.837+0000 7f6785d9b700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6788100470 0x7f6788107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.837+0000 7f6786d9d700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6788100e30 0x7f678810eee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6780007ee0 tx=0x7f678000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:28.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.838+0000 7f67777fe700 1 -- 172.21.15.12:0/3777234335 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780017070 con 0x7f6788100e30 2023-12-11T20:32:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.838+0000 7f678cbff700 1 -- 172.21.15.12:0/3777234335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678819d240 con 0x7f6788100e30 2023-12-11T20:32:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.839+0000 7f678cbff700 1 -- 172.21.15.12:0/3777234335 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678819d6f0 con 0x7f6788100e30 2023-12-11T20:32:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.839+0000 7f67777fe700 1 -- 172.21.15.12:0/3777234335 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f678000f040 con 0x7f6788100e30 2023-12-11T20:32:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.839+0000 7f67777fe700 1 -- 172.21.15.12:0/3777234335 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780005710 con 0x7f6788100e30 2023-12-11T20:32:28.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.842+0000 7f67777fe700 1 -- 172.21.15.12:0/3777234335 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6780005870 con 0x7f6788100e30 2023-12-11T20:32:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.846+0000 7f67777fe700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67700a1500 0x7f67700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.846+0000 7f67777fe700 1 -- 172.21.15.12:0/3777234335 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f67800cc570 con 0x7f6788100e30 2023-12-11T20:32:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.846+0000 7f678659c700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67700a1500 0x7f67700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.848+0000 7f67a0489b80 1 Processor -- start 2023-12-11T20:32:28.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.848+0000 7f678659c700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67700a1500 0x7f67700a39c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6778000c00 tx=0x7f67780037c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:28.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.849+0000 7f67a0489b80 1 -- start start 2023-12-11T20:32:28.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.849+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c6c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.849+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c6d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.849+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6dc20 0x55e789c6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.849+0000 7f67a0489b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789bc7b50 con 0x55e789c6c3d0 2023-12-11T20:32:28.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.849+0000 7f67a0489b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789bc5470 con 0x55e789c6dc20 2023-12-11T20:32:28.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.849+0000 7f67a0489b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789bc0d60 con 0x55e789c6cd30 2023-12-11T20:32:28.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.850+0000 7f6785d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c6d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.850+0000 7f6785d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c6d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53528/0 (socket says 172.21.15.12:53528) 2023-12-11T20:32:28.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.850+0000 7f6785d9b700 1 -- 172.21.15.12:0/2493571093 learned_addr learned my addr 172.21.15.12:0/2493571093 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:28.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.851+0000 7f6785d9b700 1 -- 172.21.15.12:0/2493571093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6dc20 msgr2=0x55e789c6e0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:32:28.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.851+0000 7f6785d9b700 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6dc20 0x55e789c6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.851+0000 7f6785d9b700 1 -- 172.21.15.12:0/2493571093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 msgr2=0x55e789c6c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:28.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.851+0000 7f678659c700 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c6c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.851+0000 7f6785d9b700 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c6c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.851+0000 7f6785d9b700 1 -- 172.21.15.12:0/2493571093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e789a3d630 con 0x55e789c6cd30 2023-12-11T20:32:28.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.852+0000 7f678659c700 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c6c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:28.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.852+0000 7f6785d9b700 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c6d640 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f677c009ce0 tx=0x7f677c00e2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfec34c7194cce59 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:28.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.853+0000 7f6774ff9700 1 -- 172.21.15.12:0/2493571093 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c00ec20 con 0x55e789c6cd30 2023-12-11T20:32:28.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.853+0000 7f6774ff9700 1 -- 172.21.15.12:0/2493571093 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f677c00ed80 con 0x55e789c6cd30 2023-12-11T20:32:28.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.853+0000 7f6774ff9700 1 -- 172.21.15.12:0/2493571093 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c010630 con 0x55e789c6cd30 2023-12-11T20:32:28.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.854+0000 7f67a0489b80 1 -- 172.21.15.12:0/2493571093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 msgr2=0x55e789c6d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.854+0000 7f67a0489b80 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c6d640 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f677c009ce0 tx=0x7f677c00e2f0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.855+0000 7f67a0489b80 1 -- 172.21.15.12:0/2493571093 shutdown_connections 2023-12-11T20:32:28.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.855+0000 7f67a0489b80 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6dc20 0x55e789c6e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.855+0000 7f67a0489b80 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c6c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.855+0000 7f67a0489b80 1 --2- 172.21.15.12:0/2493571093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c6d640 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.855+0000 7f67a0489b80 1 -- 172.21.15.12:0/2493571093 >> 172.21.15.12:0/2493571093 conn(0x55e789b9b7e0 msgr2=0x55e789c68d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:28.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.855+0000 7f67a0489b80 1 -- 172.21.15.12:0/2493571093 shutdown_connections 2023-12-11T20:32:28.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.855+0000 7f67a0489b80 1 -- 172.21.15.12:0/2493571093 wait complete. 2023-12-11T20:32:28.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.855+0000 7f67a0489b80 1 -- start start 2023-12-11T20:32:28.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.856+0000 7f67a0489b80 1 Processor -- start 2023-12-11T20:32:28.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.856+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c76800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f67a0489b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789b7a560 con 0x55e789c6c3d0 2023-12-11T20:32:28.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f67a0489b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789b7a200 con 0x55e789c6cd30 2023-12-11T20:32:28.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f67a0489b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789a3f920 con 0x55e789c6dc20 2023-12-11T20:32:28.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f67a0489b80 10 client.0 _ll_register_callbacks cb 0x55e789aa5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:28.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f6786d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f6786d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53540/0 (socket says 172.21.15.12:53540) 2023-12-11T20:32:28.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f6786d9d700 1 -- 172.21.15.12:0/1307504505 learned_addr learned my addr 172.21.15.12:0/1307504505 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:28.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f6785d9b700 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c76800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.857+0000 7f678659c700 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.858+0000 7f6785d9b700 1 -- 172.21.15.12:0/1307504505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 msgr2=0x55e789c7d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:28.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.858+0000 7f6785d9b700 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.858+0000 7f6785d9b700 1 -- 172.21.15.12:0/1307504505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 msgr2=0x55e789c762c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:28.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.858+0000 7f6785d9b700 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c762c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.858+0000 7f6785d9b700 1 -- 172.21.15.12:0/1307504505 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c009940 con 0x55e789c6cd30 2023-12-11T20:32:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.859+0000 7f6785d9b700 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c76800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f677c000c00 tx=0x7f677c0116a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=402974f0c2d4276e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.859+0000 7f676dffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.859+0000 7f676dffb700 1 -- 172.21.15.12:0/1307504505 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c020070 con 0x55e789c6cd30 2023-12-11T20:32:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.859+0000 7f676dffb700 1 -- 172.21.15.12:0/1307504505 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f677c004020 con 0x55e789c6cd30 2023-12-11T20:32:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.859+0000 7f67a0489b80 1 -- 172.21.15.12:0/1307504505 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e789c5fb40 con 0x55e789c6cd30 2023-12-11T20:32:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.860+0000 7f676dffb700 1 -- 172.21.15.12:0/1307504505 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f677c004200 con 0x55e789c6cd30 2023-12-11T20:32:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.860+0000 7f67a0489b80 10 client.29690 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.860+0000 7f67a0489b80 1 -- 172.21.15.12:0/1307504505 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e7899e9de0 con 0x55e789c6cd30 2023-12-11T20:32:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.862+0000 7f676dffb700 1 -- 172.21.15.12:0/1307504505 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e789c5fb40 con 0x55e789c6cd30 2023-12-11T20:32:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.862+0000 7f676dffb700 1 -- 172.21.15.12:0/1307504505 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f677c004830 con 0x55e789c6cd30 2023-12-11T20:32:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.862+0000 7f67a0489b80 10 client.29690 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.862+0000 7f67a0489b80 10 client.29690 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:32:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.862+0000 7f67a0489b80 20 client.29690 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.862+0000 7f67a0489b80 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55e789c81fe0 0x55e789c84400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.862+0000 7f67a0489b80 4 client.29690 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.862+0000 7f67a0489b80 1 -- 172.21.15.12:0/1307504505 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e789c3bf40 con 0x55e789c81fe0 2023-12-11T20:32:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.863+0000 7f678659c700 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55e789c81fe0 0x55e789c84400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.864+0000 7f678659c700 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55e789c81fe0 0x55e789c84400 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=488f2d533d95e404 server_cookie=546027f718404f8b in_seq=0 out_seq=0 2023-12-11T20:32:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.864+0000 7f676dffb700 10 client.29690 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:32:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.864+0000 7f676dffb700 1 -- 172.21.15.12:0/1307504505 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e789c3bf40 con 0x55e789c81fe0 2023-12-11T20:32:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.865+0000 7f676dffb700 10 client.29690 handle_command_reply: tid=0 2023-12-11T20:32:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.865+0000 7f67a0489b80 1 client.29690 shutdown 2023-12-11T20:32:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.865+0000 7f67a0489b80 1 -- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 msgr2=0x55e789c76800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.865+0000 7f67a0489b80 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c76800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f677c000c00 tx=0x7f677c0116a0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.867+0000 7f67a0489b80 1 -- 172.21.15.12:0/1307504505 shutdown_connections 2023-12-11T20:32:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.867+0000 7f67a0489b80 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55e789c81fe0 0x55e789c84400 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.867+0000 7f67a0489b80 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.867+0000 7f676dffb700 0 client.29690 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:32:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.867+0000 7f67a0489b80 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c762c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.867+0000 7f67a0489b80 1 --2- 172.21.15.12:0/1307504505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c76800 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.867+0000 7f67a0489b80 1 -- 172.21.15.12:0/1307504505 >> 172.21.15.12:0/1307504505 conn(0x55e789b9b7e0 msgr2=0x55e789c67a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.868+0000 7f67a0489b80 1 -- 172.21.15.12:0/1307504505 shutdown_connections 2023-12-11T20:32:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.869+0000 7f67a0489b80 1 -- 172.21.15.12:0/1307504505 wait complete. 2023-12-11T20:32:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.869+0000 7f67a0489b80 20 client.29690 trim_cache size 0 max 16384 2023-12-11T20:32:28.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.922+0000 7f67a0489b80 1 Processor -- start 2023-12-11T20:32:28.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.922+0000 7f67a0489b80 1 -- start start 2023-12-11T20:32:28.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.923+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6c3d0 0x55e789c757d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.923+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c7d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.923+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6dc20 0x55e789c70bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.923+0000 7f678659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6c3d0 0x55e789c757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.923+0000 7f678659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6c3d0 0x55e789c757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50032/0 (socket says 172.21.15.12:50032) 2023-12-11T20:32:28.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.923+0000 7f678659c700 1 -- 172.21.15.12:0/2707486802 learned_addr learned my addr 172.21.15.12:0/2707486802 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.924+0000 7f67a0489b80 1 -- 172.21.15.12:0/2707486802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789c7dcd0 con 0x55e789c6dc20 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.924+0000 7f67a0489b80 1 -- 172.21.15.12:0/2707486802 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789c63b50 con 0x55e789c6c3d0 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.924+0000 7f67a0489b80 1 -- 172.21.15.12:0/2707486802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789c774b0 con 0x55e789c6cd30 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.924+0000 7f6785d9b700 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c7d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.924+0000 7f6785d9b700 1 -- 172.21.15.12:0/2707486802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6c3d0 msgr2=0x55e789c757d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.924+0000 7f6785d9b700 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6c3d0 0x55e789c757d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.924+0000 7f6786d9d700 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6dc20 0x55e789c70bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.924+0000 7f6785d9b700 1 -- 172.21.15.12:0/2707486802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6dc20 msgr2=0x55e789c70bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.925+0000 7f6785d9b700 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6dc20 0x55e789c70bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.925+0000 7f6785d9b700 1 -- 172.21.15.12:0/2707486802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7899d2c60 con 0x55e789c6cd30 2023-12-11T20:32:28.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.925+0000 7f6786d9d700 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6dc20 0x55e789c70bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.925+0000 7f6785d9b700 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c7d760 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f677c00e6f0 tx=0x7f677c004e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10f6513872c3b6e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.925+0000 7f67757fa700 1 -- 172.21.15.12:0/2707486802 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c004200 con 0x55e789c6cd30 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.925+0000 7f67757fa700 1 -- 172.21.15.12:0/2707486802 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f677c021020 con 0x55e789c6cd30 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.925+0000 7f67757fa700 1 -- 172.21.15.12:0/2707486802 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c005630 con 0x55e789c6cd30 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.926+0000 7f67a0489b80 1 -- 172.21.15.12:0/2707486802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 msgr2=0x55e789c7d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.926+0000 7f67a0489b80 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c7d760 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f677c00e6f0 tx=0x7f677c004e50 comp rx=0 tx=0).stop 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.926+0000 7f67a0489b80 1 -- 172.21.15.12:0/2707486802 shutdown_connections 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.926+0000 7f67a0489b80 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6c3d0 0x55e789c757d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.927+0000 7f67a0489b80 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6dc20 0x55e789c70bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.927+0000 7f67a0489b80 1 --2- 172.21.15.12:0/2707486802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6cd30 0x55e789c7d760 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.927+0000 7f67a0489b80 1 -- 172.21.15.12:0/2707486802 >> 172.21.15.12:0/2707486802 conn(0x55e789b9b7e0 msgr2=0x55e789c88d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.927+0000 7f67a0489b80 1 -- 172.21.15.12:0/2707486802 shutdown_connections 2023-12-11T20:32:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.927+0000 7f67a0489b80 1 -- 172.21.15.12:0/2707486802 wait complete. 2023-12-11T20:32:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.928+0000 7f67a0489b80 1 -- start start 2023-12-11T20:32:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.928+0000 7f67a0489b80 1 Processor -- start 2023-12-11T20:32:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.930+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c7af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.931+0000 7f678659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c7af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f678659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c7af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52368/0 (socket says 172.21.15.12:52368) 2023-12-11T20:32:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f67a0489b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c7b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f678659c700 1 -- 172.21.15.12:0/208722888 learned_addr learned my addr 172.21.15.12:0/208722888 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f67a0489b80 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789c7c9b0 con 0x55e789c6c3d0 2023-12-11T20:32:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789c7cb20 con 0x55e789c6cd30 2023-12-11T20:32:28.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e789c7cce0 con 0x55e789c6dc20 2023-12-11T20:32:28.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f6785d9b700 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c7b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.932+0000 7f67a0489b80 10 client.0 _ll_register_callbacks cb 0x55e789aa5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:28.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f6786d9d700 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f6785d9b700 1 -- 172.21.15.12:0/208722888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 msgr2=0x55e789c7c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:28.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f6785d9b700 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f6785d9b700 1 -- 172.21.15.12:0/208722888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 msgr2=0x55e789c7af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:28.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f6785d9b700 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c7af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f6785d9b700 1 -- 172.21.15.12:0/208722888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7899e9de0 con 0x55e789c6cd30 2023-12-11T20:32:28.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f677c00ed80 con 0x55e789c6cd30 2023-12-11T20:32:28.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f6785d9b700 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c7b460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f677c00e6f0 tx=0x7f677c0057a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=199196d2e443eddf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:28.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.933+0000 7f676dffb700 10 client.29696 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:28.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.934+0000 7f676dffb700 1 -- 172.21.15.12:0/208722888 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c020070 con 0x55e789c6cd30 2023-12-11T20:32:28.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.934+0000 7f676dffb700 1 -- 172.21.15.12:0/208722888 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f677c000e40 con 0x55e789c6cd30 2023-12-11T20:32:28.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.934+0000 7f676dffb700 1 -- 172.21.15.12:0/208722888 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f677c004710 con 0x55e789c6cd30 2023-12-11T20:32:28.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.934+0000 7f67a0489b80 10 client.29696 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:28.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.934+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({fsmap=36}) v3 -- 0x55e789a10250 con 0x55e789c6cd30 2023-12-11T20:32:28.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.934+0000 7f676dffb700 1 -- 172.21.15.12:0/208722888 <== mon.2 v2:172.21.15.32:3300/0 4 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f677c01b650 con 0x55e789c6cd30 2023-12-11T20:32:28.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.935+0000 7f67a0489b80 10 client.29696 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.935+0000 7f67a0489b80 10 client.29696 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:32:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.935+0000 7f67a0489b80 20 client.29696 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.935+0000 7f67a0489b80 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55e789cd8640 0x55e789cdaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.935+0000 7f67a0489b80 4 client.29696 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:32:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.935+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e789b86fd0 con 0x55e789cd8640 2023-12-11T20:32:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.935+0000 7f678659c700 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55e789cd8640 0x55e789cdaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.936+0000 7f678659c700 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55e789cd8640 0x55e789cdaa30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a0a07122885e5ce server_cookie=cd04266e62e10a3a in_seq=0 out_seq=0 2023-12-11T20:32:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.936+0000 7f676dffb700 10 client.29696 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:32:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.936+0000 7f676dffb700 1 -- 172.21.15.12:0/208722888 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e789b86fd0 con 0x55e789cd8640 2023-12-11T20:32:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.936+0000 7f676dffb700 10 client.29696 handle_command_reply: tid=0 2023-12-11T20:32:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.936+0000 7f67a0489b80 1 client.29696 shutdown 2023-12-11T20:32:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.936+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 msgr2=0x55e789c7b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.936+0000 7f67a0489b80 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c7b460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f677c00e6f0 tx=0x7f677c0057a0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 shutdown_connections 2023-12-11T20:32:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f67a0489b80 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55e789cd8640 0x55e789cdaa30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f676dffb700 0 client.29696 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:32:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f67a0489b80 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e789c6dc20 0x55e789c7c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f67a0489b80 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e789c6c3d0 0x55e789c7af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f67a0489b80 1 --2- 172.21.15.12:0/208722888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e789c6cd30 0x55e789c7b460 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 >> 172.21.15.12:0/208722888 conn(0x55e789b9b7e0 msgr2=0x55e789c88d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 shutdown_connections 2023-12-11T20:32:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.937+0000 7f67a0489b80 1 -- 172.21.15.12:0/208722888 wait complete. 2023-12-11T20:32:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.938+0000 7f67a0489b80 20 client.29696 trim_cache size 0 max 16384 2023-12-11T20:32:28.942 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:32:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.938+0000 7f678cbff700 1 -- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67700a1500 msgr2=0x7f67700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67700a1500 0x7f67700a39c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6778000c00 tx=0x7f67780037c0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 -- 172.21.15.12:0/3777234335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6788100e30 msgr2=0x7f678810eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6788100e30 0x7f678810eee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6780007ee0 tx=0x7f678000d3b0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 -- 172.21.15.12:0/3777234335 shutdown_connections 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f67700a1500 0x7f67700a39c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6788100e30 0x7f678810eee0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67880ff340 0x7f6788107980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 --2- 172.21.15.12:0/3777234335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6788100470 0x7f6788107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 -- 172.21.15.12:0/3777234335 >> 172.21.15.12:0/3777234335 conn(0x7f67880fac40 msgr2=0x7f67881016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 -- 172.21.15.12:0/3777234335 shutdown_connections 2023-12-11T20:32:28.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:28.939+0000 7f678cbff700 1 -- 172.21.15.12:0/3777234335 wait complete. 2023-12-11T20:32:28.981 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:32:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:29 smithi012 ceph-mon[128787]: pgmap v871: 97 pgs: 97 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 5.19k op/s 2023-12-11T20:32:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:29 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1102226648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:32:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.419+0000 7f3fb0dff700 1 -- 172.21.15.12:0/1468668160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac1015f0 msgr2=0x7f3fac101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.419+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/1468668160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac1015f0 0x7f3fac101a50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009990 tx=0x7f3fa0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.420+0000 7f3fb0dff700 1 -- 172.21.15.12:0/1468668160 shutdown_connections 2023-12-11T20:32:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.420+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/1468668160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac101f90 0x7f3fac068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.420+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/1468668160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fac100400 0x7f3fac100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.420+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/1468668160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac1015f0 0x7f3fac101a50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.420+0000 7f3fb0dff700 1 -- 172.21.15.12:0/1468668160 >> 172.21.15.12:0/1468668160 conn(0x7f3fac0fb930 msgr2=0x7f3fac0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.420+0000 7f3fb0dff700 1 -- 172.21.15.12:0/1468668160 shutdown_connections 2023-12-11T20:32:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.420+0000 7f3fb0dff700 1 -- 172.21.15.12:0/1468668160 wait complete. 2023-12-11T20:32:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.422+0000 7f3fb0dff700 1 Processor -- start 2023-12-11T20:32:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.423+0000 7f3fb0dff700 1 -- start start 2023-12-11T20:32:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.425+0000 7f3fb0dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac100400 0x7f3fac06c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.425+0000 7f3fb0dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac1015f0 0x7f3fac06cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.425+0000 7f3fb0dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fac101f90 0x7f3fac071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.425+0000 7f3fb0dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac072220 con 0x7f3fac101f90 2023-12-11T20:32:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.425+0000 7f3fb0dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac072390 con 0x7f3fac1015f0 2023-12-11T20:32:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.425+0000 7f3fb0dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac072550 con 0x7f3fac100400 2023-12-11T20:32:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.425+0000 7f3fa9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac1015f0 0x7f3fac06cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3fa9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac1015f0 0x7f3fac06cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50052/0 (socket says 172.21.15.12:50052) 2023-12-11T20:32:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3fa9d9b700 1 -- 172.21.15.12:0/897592588 learned_addr learned my addr 172.21.15.12:0/897592588 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3faa59c700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac100400 0x7f3fac06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3faad9d700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fac101f90 0x7f3fac071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3fa9d9b700 1 -- 172.21.15.12:0/897592588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac100400 msgr2=0x7f3fac06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac100400 0x7f3fac06c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3fa9d9b700 1 -- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fac101f90 msgr2=0x7f3fac071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fac101f90 0x7f3fac071c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3fa9d9b700 1 -- 172.21.15.12:0/897592588 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00095f0 con 0x7f3fac1015f0 2023-12-11T20:32:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3faad9d700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fac101f90 0x7f3fac071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3faa59c700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac100400 0x7f3fac06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:29.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.426+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac1015f0 0x7f3fac06cc40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0003ab0 tx=0x7f3fa0003ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.427+0000 7f3f9b7fe700 1 -- 172.21.15.12:0/897592588 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa001d070 con 0x7f3fac1015f0 2023-12-11T20:32:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.427+0000 7f3fb0dff700 1 -- 172.21.15.12:0/897592588 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac072770 con 0x7f3fac1015f0 2023-12-11T20:32:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.427+0000 7f3fb0dff700 1 -- 172.21.15.12:0/897592588 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac072c70 con 0x7f3fac1015f0 2023-12-11T20:32:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.427+0000 7f3f9b7fe700 1 -- 172.21.15.12:0/897592588 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fa000bd50 con 0x7f3fac1015f0 2023-12-11T20:32:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.427+0000 7f3f9b7fe700 1 -- 172.21.15.12:0/897592588 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000fd50 con 0x7f3fac1015f0 2023-12-11T20:32:29.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.432+0000 7f3f9b7fe700 1 -- 172.21.15.12:0/897592588 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3fa0003fc0 con 0x7f3fac1015f0 2023-12-11T20:32:29.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.435+0000 7f3f9b7fe700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f940a1500 0x7f3f940a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.435+0000 7f3f9b7fe700 1 -- 172.21.15.12:0/897592588 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3fa00cdd60 con 0x7f3fac1015f0 2023-12-11T20:32:29.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.435+0000 7f3faa59c700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f940a1500 0x7f3f940a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.440+0000 7f3faa59c700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f940a1500 0x7f3f940a39c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3fac101450 tx=0x7f3f9c00a3b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.442+0000 7f3fc46e5b80 1 Processor -- start 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.444+0000 7f3fc46e5b80 1 -- start start 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.444+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621657733d0 0x5621657737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.444+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x562165774640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.444+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x5621657750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.444+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621656ceb50 con 0x562165774c20 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.444+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621656cc470 con 0x5621657733d0 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.444+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621656c7d60 con 0x562165773d30 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.445+0000 7f3faa59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621657733d0 0x5621657737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.445+0000 7f3faa59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621657733d0 0x5621657737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50056/0 (socket says 172.21.15.12:50056) 2023-12-11T20:32:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.445+0000 7f3faa59c700 1 -- 172.21.15.12:0/3405430059 learned_addr learned my addr 172.21.15.12:0/3405430059 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.445+0000 7f3faad9d700 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x5621657750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.445+0000 7f3faa59c700 1 -- 172.21.15.12:0/3405430059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 msgr2=0x562165774640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:32:29.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.446+0000 7f3faa59c700 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x562165774640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.446+0000 7f3faa59c700 1 -- 172.21.15.12:0/3405430059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 msgr2=0x5621657750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.446+0000 7f3faa59c700 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x5621657750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.446+0000 7f3faa59c700 1 -- 172.21.15.12:0/3405430059 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562165544630 con 0x5621657733d0 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.446+0000 7f3faad9d700 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x5621657750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.446+0000 7f3faa59c700 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621657733d0 0x5621657737f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004280 tx=0x7f3f9c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3d32b648a41be32 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.446+0000 7f3f98ff9700 1 -- 172.21.15.12:0/3405430059 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c010430 con 0x5621657733d0 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.447+0000 7f3f98ff9700 1 -- 172.21.15.12:0/3405430059 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f9c014070 con 0x5621657733d0 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.447+0000 7f3f98ff9700 1 -- 172.21.15.12:0/3405430059 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c01d7b0 con 0x5621657733d0 2023-12-11T20:32:29.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3405430059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621657733d0 msgr2=0x5621657737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621657733d0 0x5621657737f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004280 tx=0x7f3f9c012000 comp rx=0 tx=0).stop 2023-12-11T20:32:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3405430059 shutdown_connections 2023-12-11T20:32:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5621657733d0 0x5621657737f0 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004280 tx=0x7f3f9c012000 comp rx=0 tx=0).stop 2023-12-11T20:32:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x5621657750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3405430059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x562165774640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3405430059 >> 172.21.15.12:0/3405430059 conn(0x5621656a27e0 msgr2=0x56216576fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:29.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3405430059 shutdown_connections 2023-12-11T20:32:29.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.448+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3405430059 wait complete. 2023-12-11T20:32:29.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.449+0000 7f3fc46e5b80 1 -- start start 2023-12-11T20:32:29.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.450+0000 7f3fc46e5b80 1 Processor -- start 2023-12-11T20:32:29.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.451+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216577d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.451+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x56216577d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.451+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165782990 0x562165784d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.451+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562165681560 con 0x562165774c20 2023-12-11T20:32:29.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.451+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562165681200 con 0x562165782990 2023-12-11T20:32:29.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.451+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562165546920 con 0x562165773d30 2023-12-11T20:32:29.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.451+0000 7f3fc46e5b80 10 client.0 _ll_register_callbacks cb 0x5621655aca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:29.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.452+0000 7f3faa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216577d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.452+0000 7f3faa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216577d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53606/0 (socket says 172.21.15.12:53606) 2023-12-11T20:32:29.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.452+0000 7f3faa59c700 1 -- 172.21.15.12:0/2156975051 learned_addr learned my addr 172.21.15.12:0/2156975051 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:29.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.452+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x56216577d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.453+0000 7f3faa59c700 1 -- 172.21.15.12:0/2156975051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165782990 msgr2=0x562165784d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:29.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.453+0000 7f3faa59c700 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165782990 0x562165784d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.453+0000 7f3faa59c700 1 -- 172.21.15.12:0/2156975051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 msgr2=0x56216577d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:29.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.453+0000 7f3faa59c700 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x56216577d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.453+0000 7f3faa59c700 1 -- 172.21.15.12:0/2156975051 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c004040 con 0x562165773d30 2023-12-11T20:32:29.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.453+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x56216577d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:29.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.454+0000 7f3faa59c700 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216577d420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00fbf0 tx=0x7f3f9c010710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c199e52936c38fed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:29.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.454+0000 7f3f91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:32:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.455+0000 7f3f91ffb700 1 -- 172.21.15.12:0/2156975051 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c02a070 con 0x562165773d30 2023-12-11T20:32:29.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.456+0000 7f3f91ffb700 1 -- 172.21.15.12:0/2156975051 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3f9c00ad80 con 0x562165773d30 2023-12-11T20:32:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.456+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/2156975051 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562165766b40 con 0x562165773d30 2023-12-11T20:32:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.456+0000 7f3f91ffb700 1 -- 172.21.15.12:0/2156975051 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f9c0109b0 con 0x562165773d30 2023-12-11T20:32:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.456+0000 7f3fc46e5b80 10 client.29698 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.456+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/2156975051 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5621654f0de0 con 0x562165773d30 2023-12-11T20:32:29.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.457+0000 7f3f91ffb700 1 -- 172.21.15.12:0/2156975051 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562165766b40 con 0x562165773d30 2023-12-11T20:32:29.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.458+0000 7f3f91ffb700 1 -- 172.21.15.12:0/2156975051 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3f9c038070 con 0x562165773d30 2023-12-11T20:32:29.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.458+0000 7f3fc46e5b80 10 client.29698 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:29.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.458+0000 7f3fc46e5b80 10 client.29698 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:32:29.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.458+0000 7f3fc46e5b80 20 client.29698 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:29.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.458+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562165789580 0x56216578b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.458+0000 7f3fc46e5b80 4 client.29698 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:29.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.458+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/2156975051 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562165742f40 con 0x562165789580 2023-12-11T20:32:29.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.458+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562165789580 0x56216578b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.459+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562165789580 0x56216578b9a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f85ea9aa3c48a63 server_cookie=c5577d7fd085e044 in_seq=0 out_seq=0 2023-12-11T20:32:29.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.459+0000 7f3f91ffb700 10 client.29698 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:32:29.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.459+0000 7f3f91ffb700 1 -- 172.21.15.12:0/2156975051 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562165742f40 con 0x562165789580 2023-12-11T20:32:29.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.459+0000 7f3f91ffb700 10 client.29698 handle_command_reply: tid=0 2023-12-11T20:32:29.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 client.29698 shutdown 2023-12-11T20:32:29.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/2156975051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 msgr2=0x56216577d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216577d420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00fbf0 tx=0x7f3f9c010710 comp rx=0 tx=0).stop 2023-12-11T20:32:29.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/2156975051 shutdown_connections 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x562165789580 0x56216578b9a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165782990 0x562165784d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216577d420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/2156975051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165774c20 0x56216577d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/2156975051 >> 172.21.15.12:0/2156975051 conn(0x5621656a27e0 msgr2=0x56216576ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.460+0000 7f3f91ffb700 0 client.29698 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.461+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/2156975051 shutdown_connections 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.461+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/2156975051 wait complete. 2023-12-11T20:32:29.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.461+0000 7f3fc46e5b80 20 client.29698 trim_cache size 0 max 16384 2023-12-11T20:32:29.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.494+0000 7f3fc46e5b80 1 Processor -- start 2023-12-11T20:32:29.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.495+0000 7f3fc46e5b80 1 -- start start 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.496+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216578b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.496+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 0x562165784d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.496+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165775000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.496+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562165774aa0 con 0x562165782990 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.496+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562165785f10 con 0x562165774c20 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.496+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216577cfc0 con 0x562165773d30 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216578b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216578b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53622/0 (socket says 172.21.15.12:53622) 2023-12-11T20:32:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 -- 172.21.15.12:0/141400386 learned_addr learned my addr 172.21.15.12:0/141400386 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 0x562165784d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faad9d700 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165775000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 -- 172.21.15.12:0/141400386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 msgr2=0x562165784d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 0x562165784d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 -- 172.21.15.12:0/141400386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 msgr2=0x562165775000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165775000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 -- 172.21.15.12:0/141400386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621654d9c60 con 0x562165773d30 2023-12-11T20:32:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.497+0000 7f3faa59c700 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216578b970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c012fd0 tx=0x7f3f9c0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5edc402ea084027d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.498+0000 7f3f997fa700 1 -- 172.21.15.12:0/141400386 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c02a030 con 0x562165773d30 2023-12-11T20:32:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.498+0000 7f3f997fa700 1 -- 172.21.15.12:0/141400386 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f9c01d8c0 con 0x562165773d30 2023-12-11T20:32:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.498+0000 7f3f997fa700 1 -- 172.21.15.12:0/141400386 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0308c0 con 0x562165773d30 2023-12-11T20:32:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.499+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/141400386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 msgr2=0x56216578b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.499+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216578b970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c012fd0 tx=0x7f3f9c0047b0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.500+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/141400386 shutdown_connections 2023-12-11T20:32:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.500+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165775000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.500+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x56216578b970 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.500+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/141400386 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 0x562165784d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.500+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/141400386 >> 172.21.15.12:0/141400386 conn(0x5621656a27e0 msgr2=0x5621657771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:29.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.501+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/141400386 shutdown_connections 2023-12-11T20:32:29.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.501+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/141400386 wait complete. 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.502+0000 7f3fc46e5b80 1 -- start start 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.502+0000 7f3fc46e5b80 1 Processor -- start 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x562165799c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 0x562165796730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3fc46e5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165796c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621657973a0 con 0x562165782990 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621657de530 con 0x562165774c20 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3fc46e5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621657de6f0 con 0x562165773d30 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3fc46e5b80 10 client.0 _ll_register_callbacks cb 0x5621655aca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3faa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x562165799c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3faa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x562165799c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53624/0 (socket says 172.21.15.12:53624) 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3faa59c700 1 -- 172.21.15.12:0/3625811677 learned_addr learned my addr 172.21.15.12:0/3625811677 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:29.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3faad9d700 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165796c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.503+0000 7f3fa9d9b700 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 0x562165796730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.504+0000 7f3faad9d700 1 -- 172.21.15.12:0/3625811677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 msgr2=0x562165799c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:29.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.504+0000 7f3faad9d700 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x562165799c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.504+0000 7f3faad9d700 1 -- 172.21.15.12:0/3625811677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 msgr2=0x562165796730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:29.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.504+0000 7f3faad9d700 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 0x562165796730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.504+0000 7f3faad9d700 1 -- 172.21.15.12:0/3625811677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621654f0de0 con 0x562165782990 2023-12-11T20:32:29.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.505+0000 7f3faad9d700 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165796c90 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009440 tx=0x7f3fa400a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25591ecde686b982 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:29.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.505+0000 7f3f91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:32:29.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.506+0000 7f3f91ffb700 1 -- 172.21.15.12:0/3625811677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40177f0 con 0x562165782990 2023-12-11T20:32:29.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.506+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3625811677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f9c014070 con 0x562165782990 2023-12-11T20:32:29.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.506+0000 7f3f91ffb700 1 -- 172.21.15.12:0/3625811677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3fa4017950 con 0x562165782990 2023-12-11T20:32:29.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.507+0000 7f3f91ffb700 1 -- 172.21.15.12:0/3625811677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fa40177f0 con 0x562165782990 2023-12-11T20:32:29.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.508+0000 7f3fc46e5b80 10 client.20166 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:29.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.508+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3625811677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562165517250 con 0x562165782990 2023-12-11T20:32:29.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.508+0000 7f3f91ffb700 1 -- 172.21.15.12:0/3625811677 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f9c014070 con 0x562165782990 2023-12-11T20:32:29.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.508+0000 7f3f91ffb700 1 -- 172.21.15.12:0/3625811677 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3fa4018c20 con 0x562165782990 2023-12-11T20:32:29.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.509+0000 7f3fc46e5b80 10 client.20166 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:29.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.509+0000 7f3fc46e5b80 10 client.20166 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:32:29.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.509+0000 7f3fc46e5b80 20 client.20166 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:29.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.509+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5621657e01e0 0x5621657e2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.509+0000 7f3fc46e5b80 4 client.20166 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:32:29.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.509+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3625811677 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56216568dfd0 con 0x5621657e01e0 2023-12-11T20:32:29.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.509+0000 7f3faa59c700 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5621657e01e0 0x5621657e2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.510+0000 7f3faa59c700 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5621657e01e0 0x5621657e2600 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf04222c54b1777d server_cookie=ce52b6fff7914a20 in_seq=0 out_seq=0 2023-12-11T20:32:29.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.510+0000 7f3f91ffb700 10 client.20166 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:32:29.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.510+0000 7f3f91ffb700 1 -- 172.21.15.12:0/3625811677 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56216568dfd0 con 0x5621657e01e0 2023-12-11T20:32:29.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.510+0000 7f3f91ffb700 10 client.20166 handle_command_reply: tid=0 2023-12-11T20:32:29.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.510+0000 7f3fc46e5b80 1 client.20166 shutdown 2023-12-11T20:32:29.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.511+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3625811677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 msgr2=0x562165796c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.511+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165796c90 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009440 tx=0x7f3fa400a8b0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.512+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3625811677 shutdown_connections 2023-12-11T20:32:29.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.512+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5621657e01e0 0x5621657e2600 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.512+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562165782990 0x562165796c90 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.512+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562165773d30 0x562165799c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.512+0000 7f3fc46e5b80 1 --2- 172.21.15.12:0/3625811677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562165774c20 0x562165796730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.512+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3625811677 >> 172.21.15.12:0/3625811677 conn(0x5621656a27e0 msgr2=0x56216576f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:29.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.512+0000 7f3f91ffb700 0 client.20166 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:32:29.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.513+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3625811677 shutdown_connections 2023-12-11T20:32:29.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.513+0000 7f3fc46e5b80 1 -- 172.21.15.12:0/3625811677 wait complete. 2023-12-11T20:32:29.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.514+0000 7f3fc46e5b80 20 client.20166 trim_cache size 0 max 16384 2023-12-11T20:32:29.513 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:32:29.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 -- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f940a1500 msgr2=0x7f3f940a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f940a1500 0x7f3f940a39c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3fac101450 tx=0x7f3f9c00a3b0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 -- 172.21.15.12:0/897592588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac1015f0 msgr2=0x7f3fac06cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac1015f0 0x7f3fac06cc40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0003ab0 tx=0x7f3fa0003ae0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 -- 172.21.15.12:0/897592588 shutdown_connections 2023-12-11T20:32:29.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3f940a1500 0x7f3f940a39c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fac101f90 0x7f3fac071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fac100400 0x7f3fac06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 --2- 172.21.15.12:0/897592588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac1015f0 0x7f3fac06cc40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.515+0000 7f3fb0dff700 1 -- 172.21.15.12:0/897592588 >> 172.21.15.12:0/897592588 conn(0x7f3fac0fb930 msgr2=0x7f3fac0fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:29.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.516+0000 7f3fb0dff700 1 -- 172.21.15.12:0/897592588 shutdown_connections 2023-12-11T20:32:29.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.516+0000 7f3fb0dff700 1 -- 172.21.15.12:0/897592588 wait complete. 2023-12-11T20:32:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:29 smithi039 ceph-mon[102205]: pgmap v871: 97 pgs: 97 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 5.19k op/s 2023-12-11T20:32:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:29 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1102226648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:32:29.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:32:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:29 smithi032 ceph-mon[132488]: pgmap v871: 97 pgs: 97 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 5.19k op/s 2023-12-11T20:32:29.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:29 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1102226648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:32:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.972+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3445759927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b81026e0 msgr2=0x7f61b8104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.972+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3445759927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b81026e0 0x7f61b8104b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009990 tx=0x7f61a8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.973+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3445759927 shutdown_connections 2023-12-11T20:32:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.973+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3445759927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b81050b0 0x7f61b8105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.973+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3445759927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61b80ffd70 0x7f61b81021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.973+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3445759927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b81026e0 0x7f61b8104b70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.973+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3445759927 >> 172.21.15.12:0/3445759927 conn(0x7f61b80fb930 msgr2=0x7f61b80fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:29.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.973+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3445759927 shutdown_connections 2023-12-11T20:32:29.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.973+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3445759927 wait complete. 2023-12-11T20:32:29.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.976+0000 7f61bf3ff700 1 Processor -- start 2023-12-11T20:32:29.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.977+0000 7f61bf3ff700 1 -- start start 2023-12-11T20:32:29.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bf3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b80ffd70 0x7f61b819d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bf3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61b81026e0 0x7f61b819dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bf3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b81050b0 0x7f61b81a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bf3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b81a5490 con 0x7f61b81026e0 2023-12-11T20:32:29.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bf3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b806aff0 con 0x7f61b81050b0 2023-12-11T20:32:29.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bf3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b806b180 con 0x7f61b80ffd70 2023-12-11T20:32:29.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bc99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61b81026e0 0x7f61b819dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bd99c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b81050b0 0x7f61b81a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bc99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61b81026e0 0x7f61b819dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52414/0 (socket says 172.21.15.12:52414) 2023-12-11T20:32:29.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bc99a700 1 -- 172.21.15.12:0/3823176543 learned_addr learned my addr 172.21.15.12:0/3823176543 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:29.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.978+0000 7f61bd19b700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b80ffd70 0x7f61b819d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.979+0000 7f61bc99a700 1 -- 172.21.15.12:0/3823176543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b80ffd70 msgr2=0x7f61b819d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.979+0000 7f61bc99a700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b80ffd70 0x7f61b819d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.979+0000 7f61bc99a700 1 -- 172.21.15.12:0/3823176543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b81050b0 msgr2=0x7f61b81a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.979+0000 7f61bc99a700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b81050b0 0x7f61b81a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.979+0000 7f61bc99a700 1 -- 172.21.15.12:0/3823176543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a80095f0 con 0x7f61b81026e0 2023-12-11T20:32:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.979+0000 7f61bc99a700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61b81026e0 0x7f61b819dea0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f61a800b2e0 tx=0x7f61a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.980+0000 7f61ae7fc700 1 -- 172.21.15.12:0/3823176543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a801d070 con 0x7f61b81026e0 2023-12-11T20:32:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.980+0000 7f61ae7fc700 1 -- 172.21.15.12:0/3823176543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61a800bdb0 con 0x7f61b81026e0 2023-12-11T20:32:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.980+0000 7f61ae7fc700 1 -- 172.21.15.12:0/3823176543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800fdc0 con 0x7f61b81026e0 2023-12-11T20:32:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.981+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3823176543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b806b400 con 0x7f61b81026e0 2023-12-11T20:32:29.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.981+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3823176543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b806b830 con 0x7f61b81026e0 2023-12-11T20:32:29.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.990+0000 7f61ae7fc700 1 -- 172.21.15.12:0/3823176543 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f61a800f560 con 0x7f61b81026e0 2023-12-11T20:32:29.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.993+0000 7f61d2ca4b80 1 Processor -- start 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.996+0000 7f61d2ca4b80 1 -- start start 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.997+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 0x56018eef97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.997+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018eefa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.997+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018eefb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.997+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ee54b50 con 0x56018eefac20 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.997+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ee52470 con 0x56018eef9d30 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.997+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ee4dd60 con 0x56018eef93d0 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.998+0000 7f61bc99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018eefb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.998+0000 7f61bc99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018eefb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52422/0 (socket says 172.21.15.12:52422) 2023-12-11T20:32:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.998+0000 7f61bc99a700 1 -- 172.21.15.12:0/1670325329 learned_addr learned my addr 172.21.15.12:0/1670325329 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:29.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.998+0000 7f61bd19b700 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018eefa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.998+0000 7f61bd99c700 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 0x56018eef97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:29.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.999+0000 7f61ae7fc700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61a40a1580 0x7f61a40a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:29.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:29.999+0000 7f61ae7fc700 1 -- 172.21.15.12:0/3823176543 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f61a80cdcb0 con 0x7f61b81026e0 2023-12-11T20:32:30.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.000+0000 7f61bd99c700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61a40a1580 0x7f61a40a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.001+0000 7f61bc99a700 1 -- 172.21.15.12:0/1670325329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 msgr2=0x56018eef97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:30.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.001+0000 7f61bc99a700 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 0x56018eef97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.001+0000 7f61bc99a700 1 -- 172.21.15.12:0/1670325329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 msgr2=0x56018eefa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:30.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.001+0000 7f61bc99a700 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018eefa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.001+0000 7f61bc99a700 1 -- 172.21.15.12:0/1670325329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56018ecca630 con 0x56018eefac20 2023-12-11T20:32:30.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.002+0000 7f61bc99a700 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018eefb0a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f61a800ffd0 tx=0x7f61a8004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c69ea54a989036f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:30.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.002+0000 7f61bd99c700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61a40a1580 0x7f61a40a3a40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009ec0 tx=0x7f61b0004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:30.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.002+0000 7f61a37fe700 1 -- 172.21.15.12:0/1670325329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a809ad80 con 0x56018eefac20 2023-12-11T20:32:30.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.002+0000 7f61a37fe700 1 -- 172.21.15.12:0/1670325329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61a809aaf0 con 0x56018eefac20 2023-12-11T20:32:30.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.003+0000 7f61a37fe700 1 -- 172.21.15.12:0/1670325329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80a32b0 con 0x56018eefac20 2023-12-11T20:32:30.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.003+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/1670325329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 msgr2=0x56018eefb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:30.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.003+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018eefb0a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f61a800ffd0 tx=0x7f61a8004320 comp rx=0 tx=0).stop 2023-12-11T20:32:30.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.004+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/1670325329 shutdown_connections 2023-12-11T20:32:30.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.004+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018eefb0a0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.004+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 0x56018eef97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.004+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/1670325329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018eefa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.004+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/1670325329 >> 172.21.15.12:0/1670325329 conn(0x56018ee287e0 msgr2=0x56018eef5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:30.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.004+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/1670325329 shutdown_connections 2023-12-11T20:32:30.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.004+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/1670325329 wait complete. 2023-12-11T20:32:30.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.005+0000 7f61d2ca4b80 1 -- start start 2023-12-11T20:32:30.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.005+0000 7f61d2ca4b80 1 Processor -- start 2023-12-11T20:32:30.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.006+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef93d0 0x56018ef02ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.006+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef9d30 0x56018ef03400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.006+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef0a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.006+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ee07560 con 0x56018eefac20 2023-12-11T20:32:30.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.006+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ee07200 con 0x56018eef93d0 2023-12-11T20:32:30.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.006+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018eccc920 con 0x56018eef9d30 2023-12-11T20:32:30.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.006+0000 7f61d2ca4b80 10 client.0 _ll_register_callbacks cb 0x56018ed32a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:30.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef93d0 0x56018ef02ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef93d0 0x56018ef02ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50124/0 (socket says 172.21.15.12:50124) 2023-12-11T20:32:30.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef0a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 -- 172.21.15.12:0/2685348962 learned_addr learned my addr 172.21.15.12:0/2685348962 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:30.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 -- 172.21.15.12:0/2685348962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef9d30 msgr2=0x56018ef03400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef9d30 0x56018ef03400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 -- 172.21.15.12:0/2685348962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 msgr2=0x56018ef0a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef0a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 -- 172.21.15.12:0/2685348962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a80d2040 con 0x56018eef93d0 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61bd19b700 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef93d0 0x56018ef02ec0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f61b400bb70 tx=0x7f61b400bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eaf7ec06c9b7fe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.007+0000 7f61a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.008+0000 7f61a0ff9700 1 -- 172.21.15.12:0/2685348962 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4016070 con 0x56018eef93d0 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.008+0000 7f61a0ff9700 1 -- 172.21.15.12:0/2685348962 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f61b4003c80 con 0x56018eef93d0 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.008+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2685348962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56018eeecb40 con 0x56018eef93d0 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.008+0000 7f61a0ff9700 1 -- 172.21.15.12:0/2685348962 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61b4003e40 con 0x56018eef93d0 2023-12-11T20:32:30.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.008+0000 7f61d2ca4b80 10 client.29720 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:30.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.008+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2685348962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56018ec76de0 con 0x56018eef93d0 2023-12-11T20:32:30.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.009+0000 7f61a0ff9700 1 -- 172.21.15.12:0/2685348962 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56018eeecb40 con 0x56018eef93d0 2023-12-11T20:32:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.009+0000 7f61a0ff9700 1 -- 172.21.15.12:0/2685348962 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f61b40115e0 con 0x56018eef93d0 2023-12-11T20:32:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.010+0000 7f61d2ca4b80 10 client.29720 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.010+0000 7f61d2ca4b80 10 client.29720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.010+0000 7f61d2ca4b80 20 client.29720 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.010+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56018ef0ed10 0x56018ef11130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.010+0000 7f61d2ca4b80 4 client.29720 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.010+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2685348962 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56018eec8f40 con 0x56018ef0ed10 2023-12-11T20:32:30.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.011+0000 7f61bc99a700 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56018ef0ed10 0x56018ef11130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.011+0000 7f61a0ff9700 10 client.29720 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.011+0000 7f61bc99a700 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56018ef0ed10 0x56018ef11130 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11c8e55b717072d8 server_cookie=91649e95043e76c0 in_seq=0 out_seq=0 2023-12-11T20:32:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.012+0000 7f61a0ff9700 1 -- 172.21.15.12:0/2685348962 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56018eec8f40 con 0x56018ef0ed10 2023-12-11T20:32:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.012+0000 7f61a0ff9700 10 client.29720 handle_command_reply: tid=0 2023-12-11T20:32:30.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.012+0000 7f61d2ca4b80 1 client.29720 shutdown 2023-12-11T20:32:30.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2685348962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef93d0 msgr2=0x56018ef02ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:30.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef93d0 0x56018ef02ec0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f61b400bb70 tx=0x7f61b400bf30 comp rx=0 tx=0).stop 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2685348962 shutdown_connections 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56018ef0ed10 0x56018ef11130 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61a0ff9700 0 client.29720 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef93d0 0x56018ef02ec0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef0a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2685348962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef9d30 0x56018ef03400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2685348962 >> 172.21.15.12:0/2685348962 conn(0x56018ee287e0 msgr2=0x56018eef4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2685348962 shutdown_connections 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.013+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2685348962 wait complete. 2023-12-11T20:32:30.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.014+0000 7f61d2ca4b80 20 client.29720 trim_cache size 0 max 16384 2023-12-11T20:32:30.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.047+0000 7f61d2ca4b80 1 Processor -- start 2023-12-11T20:32:30.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.047+0000 7f61d2ca4b80 1 -- start start 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.047+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eef93d0 0x56018ef0aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.047+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef0a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.048+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eefac20 0x56018eef5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.048+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018eef4020 con 0x56018eef93d0 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.048+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ef02230 con 0x56018eef9d30 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.048+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ef0b610 con 0x56018eefac20 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.048+0000 7f61bd19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eef93d0 0x56018ef0aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.048+0000 7f61bd19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eef93d0 0x56018ef0aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52446/0 (socket says 172.21.15.12:52446) 2023-12-11T20:32:30.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.048+0000 7f61bd19b700 1 -- 172.21.15.12:0/2323695029 learned_addr learned my addr 172.21.15.12:0/2323695029 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.048+0000 7f61bc99a700 1 --2- 172.21.15.12:0/2323695029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef0a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.049+0000 7f61bd19b700 1 -- 172.21.15.12:0/2323695029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eefac20 msgr2=0x56018eef5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.049+0000 7f61bd19b700 1 --2- 172.21.15.12:0/2323695029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eefac20 0x56018eef5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.049+0000 7f61bd19b700 1 -- 172.21.15.12:0/2323695029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 msgr2=0x56018ef0a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:30.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.049+0000 7f61bd19b700 1 --2- 172.21.15.12:0/2323695029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef0a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.049+0000 7f61bd19b700 1 -- 172.21.15.12:0/2323695029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56018ec5fc60 con 0x56018eef93d0 2023-12-11T20:32:30.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.051+0000 7f61bd19b700 1 --2- 172.21.15.12:0/2323695029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eef93d0 0x56018ef0aaf0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f61b400b4f0 tx=0x7f61b4003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc7d6b094a4151f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:30.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.052+0000 7f61a3fff700 1 -- 172.21.15.12:0/2323695029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4016070 con 0x56018eef93d0 2023-12-11T20:32:30.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.052+0000 7f61a3fff700 1 -- 172.21.15.12:0/2323695029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61b4017040 con 0x56018eef93d0 2023-12-11T20:32:30.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.052+0000 7f61a3fff700 1 -- 172.21.15.12:0/2323695029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4005590 con 0x56018eef93d0 2023-12-11T20:32:30.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.054+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2323695029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eef93d0 msgr2=0x56018ef0aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:30.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.054+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2323695029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eef93d0 0x56018ef0aaf0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f61b400b4f0 tx=0x7f61b4003a00 comp rx=0 tx=0).stop 2023-12-11T20:32:30.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.054+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2323695029 shutdown_connections 2023-12-11T20:32:30.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.054+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2323695029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eefac20 0x56018eef5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.054+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2323695029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eef93d0 0x56018ef0aaf0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.054+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/2323695029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef0a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.054+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2323695029 >> 172.21.15.12:0/2323695029 conn(0x56018ee287e0 msgr2=0x56018ef023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:30.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.055+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2323695029 shutdown_connections 2023-12-11T20:32:30.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.055+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/2323695029 wait complete. 2023-12-11T20:32:30.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.055+0000 7f61d2ca4b80 1 -- start start 2023-12-11T20:32:30.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.055+0000 7f61d2ca4b80 1 Processor -- start 2023-12-11T20:32:30.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.056+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 0x56018ef08470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.056+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61d2ca4b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef09970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61bd19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 0x56018ef08470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ef09eb0 con 0x56018eefac20 2023-12-11T20:32:30.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ef0a020 con 0x56018eef9d30 2023-12-11T20:32:30.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61d2ca4b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018ef0a1e0 con 0x56018eef93d0 2023-12-11T20:32:30.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61d2ca4b80 10 client.0 _ll_register_callbacks cb 0x56018ed32a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:30.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61bd99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef09970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61bd99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef09970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52450/0 (socket says 172.21.15.12:52450) 2023-12-11T20:32:30.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61bd99c700 1 -- 172.21.15.12:0/3300489418 learned_addr learned my addr 172.21.15.12:0/3300489418 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:30.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.057+0000 7f61bc99a700 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.058+0000 7f61bd99c700 1 -- 172.21.15.12:0/3300489418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 msgr2=0x56018ef08470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:30.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.058+0000 7f61bd99c700 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 0x56018ef08470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.058+0000 7f61bd99c700 1 -- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 msgr2=0x56018ef089b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:30.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.058+0000 7f61bd99c700 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef089b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.058+0000 7f61bd99c700 1 -- 172.21.15.12:0/3300489418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56018ec76de0 con 0x56018eefac20 2023-12-11T20:32:30.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.058+0000 7f61bc99a700 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.059+0000 7f61bd99c700 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef09970 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f61b0007b40 tx=0x7f61b0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529b75afee2a7035 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.059+0000 7f61a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:32:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.059+0000 7f61a0ff9700 1 -- 172.21.15.12:0/3300489418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0029070 con 0x56018eefac20 2023-12-11T20:32:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.059+0000 7f61a0ff9700 1 -- 172.21.15.12:0/3300489418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f61b00093b0 con 0x56018eefac20 2023-12-11T20:32:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.059+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/3300489418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61a809aaf0 con 0x56018eefac20 2023-12-11T20:32:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.060+0000 7f61a0ff9700 1 -- 172.21.15.12:0/3300489418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61b000e040 con 0x56018eefac20 2023-12-11T20:32:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.060+0000 7f61d2ca4b80 10 client.20184 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.060+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/3300489418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56018ec9d250 con 0x56018eefac20 2023-12-11T20:32:30.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.061+0000 7f61a0ff9700 1 -- 172.21.15.12:0/3300489418 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61b0033020 con 0x56018eefac20 2023-12-11T20:32:30.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.061+0000 7f61a0ff9700 1 -- 172.21.15.12:0/3300489418 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f61b002c030 con 0x56018eefac20 2023-12-11T20:32:30.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.061+0000 7f61d2ca4b80 10 client.20184 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:30.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.061+0000 7f61d2ca4b80 10 client.20184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:30.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.061+0000 7f61d2ca4b80 20 client.20184 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:30.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.061+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56018ef0ed10 0x56018ef685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:30.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.061+0000 7f61d2ca4b80 4 client.20184 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:32:30.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.061+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/3300489418 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56018ee13fd0 con 0x56018ef0ed10 2023-12-11T20:32:30.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.062+0000 7f61bd19b700 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56018ef0ed10 0x56018ef685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:30.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.063+0000 7f61bd19b700 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56018ef0ed10 0x56018ef685f0 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=899243df1d05141e server_cookie=95b87e633003d862 in_seq=0 out_seq=0 2023-12-11T20:32:30.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.063+0000 7f61a0ff9700 10 client.20184 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:30.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.064+0000 7f61a0ff9700 1 -- 172.21.15.12:0/3300489418 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56018ee13fd0 con 0x56018ef0ed10 2023-12-11T20:32:30.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.064+0000 7f61a0ff9700 10 client.20184 handle_command_reply: tid=0 2023-12-11T20:32:30.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.064+0000 7f61d2ca4b80 1 client.20184 shutdown 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.064+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/3300489418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 msgr2=0x56018ef09970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.064+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef09970 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f61b0007b40 tx=0x7f61b0009f30 comp rx=0 tx=0).stop 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/3300489418 shutdown_connections 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56018ef0ed10 0x56018ef685f0 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56018eefac20 0x56018ef09970 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56018eef93d0 0x56018ef08470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61d2ca4b80 1 --2- 172.21.15.12:0/3300489418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56018eef9d30 0x56018ef089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/3300489418 >> 172.21.15.12:0/3300489418 conn(0x56018ee287e0 msgr2=0x56018eef5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:30.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61a0ff9700 0 client.20184 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:30.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/3300489418 shutdown_connections 2023-12-11T20:32:30.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.065+0000 7f61d2ca4b80 1 -- 172.21.15.12:0/3300489418 wait complete. 2023-12-11T20:32:30.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.066+0000 7f61d2ca4b80 20 client.20184 trim_cache size 0 max 16384 2023-12-11T20:32:30.066 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:32:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.067+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61a40a1580 msgr2=0x7f61a40a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.067+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61a40a1580 0x7f61a40a3a40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009ec0 tx=0x7f61b0004b40 comp rx=0 tx=0).stop 2023-12-11T20:32:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.068+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61b81026e0 msgr2=0x7f61b819dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.068+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61b81026e0 0x7f61b819dea0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f61a800b2e0 tx=0x7f61a8004730 comp rx=0 tx=0).stop 2023-12-11T20:32:30.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.069+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3823176543 shutdown_connections 2023-12-11T20:32:30.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.070+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f61a40a1580 0x7f61a40a3a40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.070+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61b81050b0 0x7f61b81a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.070+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b80ffd70 0x7f61b819d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.070+0000 7f61bf3ff700 1 --2- 172.21.15.12:0/3823176543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61b81026e0 0x7f61b819dea0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:30.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.070+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3823176543 >> 172.21.15.12:0/3823176543 conn(0x7f61b80fb930 msgr2=0x7f61b8101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:30.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.070+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3823176543 shutdown_connections 2023-12-11T20:32:30.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:30.070+0000 7f61bf3ff700 1 -- 172.21.15.12:0/3823176543 wait complete. 2023-12-11T20:32:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.077+0000 7fe8e9dff700 1 -- 172.21.15.12:0/3906452532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e4105070 msgr2=0x7fe8e41054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.077+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/3906452532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e4105070 0x7fe8e41054f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098f0 tx=0x7fe8d4009c00 comp rx=0 tx=0).stop 2023-12-11T20:32:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.078+0000 7fe8e9dff700 1 -- 172.21.15.12:0/3906452532 shutdown_connections 2023-12-11T20:32:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.078+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/3906452532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e4105070 0x7fe8e41054f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.078+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/3906452532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8e40ffd30 0x7fe8e4102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.078+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/3906452532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e41026a0 0x7fe8e4104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.078+0000 7fe8e9dff700 1 -- 172.21.15.12:0/3906452532 >> 172.21.15.12:0/3906452532 conn(0x7fe8e40fb930 msgr2=0x7fe8e40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.078+0000 7fe8e9dff700 1 -- 172.21.15.12:0/3906452532 shutdown_connections 2023-12-11T20:32:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.078+0000 7fe8e9dff700 1 -- 172.21.15.12:0/3906452532 wait complete. 2023-12-11T20:32:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.079+0000 7fe8e9dff700 1 Processor -- start 2023-12-11T20:32:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.079+0000 7fe8e9dff700 1 -- start start 2023-12-11T20:32:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e9dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40ffd30 0x7fe8e419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e9dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e41026a0 0x7fe8e419de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e9dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8e4105070 0x7fe8e41a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e9dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41a5440 con 0x7fe8e41026a0 2023-12-11T20:32:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e9dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41a5580 con 0x7fe8e40ffd30 2023-12-11T20:32:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e9dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41a5710 con 0x7fe8e4105070 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e41026a0 0x7fe8e419de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8e4105070 0x7fe8e41a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8e4105070 0x7fe8e41a4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53696/0 (socket says 172.21.15.12:53696) 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.080+0000 7fe8e3fff700 1 -- 172.21.15.12:0/1653143235 learned_addr learned my addr 172.21.15.12:0/1653143235 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.081+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40ffd30 0x7fe8e419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.081+0000 7fe8e3fff700 1 -- 172.21.15.12:0/1653143235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40ffd30 msgr2=0x7fe8e419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.081+0000 7fe8e3fff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40ffd30 0x7fe8e419d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.081+0000 7fe8e3fff700 1 -- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e41026a0 msgr2=0x7fe8e419de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.081+0000 7fe8e3fff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e41026a0 0x7fe8e419de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.081+0000 7fe8e3fff700 1 -- 172.21.15.12:0/1653143235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009520 con 0x7fe8e4105070 2023-12-11T20:32:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.081+0000 7fe8e3fff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8e4105070 0x7fe8e41a4e70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400fb90 tx=0x7fe8d400b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.082+0000 7fe8e0ff9700 1 -- 172.21.15.12:0/1653143235 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d401c070 con 0x7fe8e4105070 2023-12-11T20:32:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.082+0000 7fe8e0ff9700 1 -- 172.21.15.12:0/1653143235 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8d400b9d0 con 0x7fe8e4105070 2023-12-11T20:32:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.082+0000 7fe8e0ff9700 1 -- 172.21.15.12:0/1653143235 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4017400 con 0x7fe8e4105070 2023-12-11T20:32:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.082+0000 7fe8e9dff700 1 -- 172.21.15.12:0/1653143235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e41a5990 con 0x7fe8e4105070 2023-12-11T20:32:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.082+0000 7fe8e9dff700 1 -- 172.21.15.12:0/1653143235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e41a5d60 con 0x7fe8e4105070 2023-12-11T20:32:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.087+0000 7fe8e0ff9700 1 -- 172.21.15.12:0/1653143235 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe8d4020070 con 0x7fe8e4105070 2023-12-11T20:32:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.089+0000 7fe8fd698b80 1 Processor -- start 2023-12-11T20:32:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.090+0000 7fe8fd698b80 1 -- start start 2023-12-11T20:32:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.090+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceaee0 0x560253ceb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.090+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cec150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.091+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cec730 0x560253cecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.091+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253c35af0 con 0x560253ceb840 2023-12-11T20:32:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.091+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253c33410 con 0x560253cec730 2023-12-11T20:32:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.091+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253c2ed00 con 0x560253ceaee0 2023-12-11T20:32:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.091+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cec730 0x560253cecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.091+0000 7fe8e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.091+0000 7fe8e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cec150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52476/0 (socket says 172.21.15.12:52476) 2023-12-11T20:32:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.091+0000 7fe8e37fe700 1 -- 172.21.15.12:0/756853254 learned_addr learned my addr 172.21.15.12:0/756853254 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.092+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/756853254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceaee0 0x560253ceb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.092+0000 7fe8e37fe700 1 -- 172.21.15.12:0/756853254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceaee0 msgr2=0x560253ceb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.092+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/756853254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceaee0 0x560253ceb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.093+0000 7fe8e37fe700 1 -- 172.21.15.12:0/756853254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cec730 msgr2=0x560253cecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.093+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/756853254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cec730 0x560253cecbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.093+0000 7fe8e37fe700 1 -- 172.21.15.12:0/756853254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560253aab5d0 con 0x560253ceb840 2023-12-11T20:32:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.093+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/756853254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cec150 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0060b0 tx=0x7fe8dc009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2084295d079173b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.094+0000 7fe8c9ffb700 1 -- 172.21.15.12:0/756853254 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc014400 con 0x560253ceb840 2023-12-11T20:32:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.094+0000 7fe8c9ffb700 1 -- 172.21.15.12:0/756853254 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8dc0149f0 con 0x560253ceb840 2023-12-11T20:32:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.094+0000 7fe8c9ffb700 1 -- 172.21.15.12:0/756853254 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0139a0 con 0x560253ceb840 2023-12-11T20:32:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.095+0000 7fe8fd698b80 1 -- 172.21.15.12:0/756853254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 msgr2=0x560253cec150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.095+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/756853254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cec150 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0060b0 tx=0x7fe8dc009f40 comp rx=0 tx=0).stop 2023-12-11T20:32:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.095+0000 7fe8e0ff9700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8cc0a14f0 0x7fe8cc0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.095+0000 7fe8fd698b80 1 -- 172.21.15.12:0/756853254 shutdown_connections 2023-12-11T20:32:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.095+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/756853254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cec730 0x560253cecbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.095+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/756853254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceaee0 0x560253ceb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.095+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/756853254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cec150 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.095+0000 7fe8fd698b80 1 -- 172.21.15.12:0/756853254 >> 172.21.15.12:0/756853254 conn(0x560253c09780 msgr2=0x560253cd6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.096+0000 7fe8e0ff9700 1 -- 172.21.15.12:0/1653143235 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe8d40cde80 con 0x7fe8e4105070 2023-12-11T20:32:31.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.096+0000 7fe8fd698b80 1 -- 172.21.15.12:0/756853254 shutdown_connections 2023-12-11T20:32:31.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.096+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8cc0a14f0 0x7fe8cc0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.097+0000 7fe8fd698b80 1 -- 172.21.15.12:0/756853254 wait complete. 2023-12-11T20:32:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.098+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8cc0a14f0 0x7fe8cc0a39b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x560253ced0f0 tx=0x7fe8d800c4f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.099+0000 7fe8fd698b80 1 -- start start 2023-12-11T20:32:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.100+0000 7fe8fd698b80 1 Processor -- start 2023-12-11T20:32:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.100+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cf5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.100+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cf56b0 0x560253cfa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cfa9c0 0x560253cfcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253be8500 con 0x560253ceb840 2023-12-11T20:32:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253be81a0 con 0x560253cfa9c0 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253aad8c0 con 0x560253cf56b0 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8fd698b80 10 client.0 _ll_register_callbacks cb 0x560253b13a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cf56b0 0x560253cfa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cf56b0 0x560253cfa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53712/0 (socket says 172.21.15.12:53712) 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8e2ffd700 1 -- 172.21.15.12:0/187741613 learned_addr learned my addr 172.21.15.12:0/187741613 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.101+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cf5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8e2ffd700 1 -- 172.21.15.12:0/187741613 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cfa9c0 msgr2=0x560253cfcdb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cfa9c0 0x560253cfcdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8e2ffd700 1 -- 172.21.15.12:0/187741613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 msgr2=0x560253cf5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cf5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8e2ffd700 1 -- 172.21.15.12:0/187741613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc0098a0 con 0x560253cf56b0 2023-12-11T20:32:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cf56b0 0x560253cfa480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8011580 tx=0x7fe8d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33a1fb68d07a1f9d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:32:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/187741613 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8004440 con 0x560253cf56b0 2023-12-11T20:32:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/187741613 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe8d8003680 con 0x560253cf56b0 2023-12-11T20:32:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.102+0000 7fe8fd698b80 1 -- 172.21.15.12:0/187741613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560253ccd730 con 0x560253cf56b0 2023-12-11T20:32:31.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.106+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/187741613 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8d8003840 con 0x560253cf56b0 2023-12-11T20:32:31.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.106+0000 7fe8fd698b80 10 client.29728 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:31.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.106+0000 7fe8fd698b80 1 -- 172.21.15.12:0/187741613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560253a57d80 con 0x560253cf56b0 2023-12-11T20:32:31.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.106+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/187741613 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560253ccd730 con 0x560253cf56b0 2023-12-11T20:32:31.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.108+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/187741613 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe8d80039a0 con 0x560253cf56b0 2023-12-11T20:32:31.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.108+0000 7fe8fd698b80 10 client.29728 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:31.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.108+0000 7fe8fd698b80 10 client.29728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:31.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.108+0000 7fe8fd698b80 20 client.29728 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:31.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.108+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560253d01810 0x560253d03c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.108+0000 7fe8fd698b80 4 client.29728 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:31.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.108+0000 7fe8fd698b80 1 -- 172.21.15.12:0/187741613 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560253ca9ee0 con 0x560253d01810 2023-12-11T20:32:31.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.109+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560253d01810 0x560253d03c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.110+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560253d01810 0x560253d03c30 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0c084a77b8b85f2 server_cookie=cb12900933159e64 in_seq=0 out_seq=0 2023-12-11T20:32:31.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.110+0000 7fe8c2ffd700 10 client.29728 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:31.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.110+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/187741613 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560253ca9ee0 con 0x560253d01810 2023-12-11T20:32:31.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.110+0000 7fe8c2ffd700 10 client.29728 handle_command_reply: tid=0 2023-12-11T20:32:31.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.110+0000 7fe8fd698b80 1 client.29728 shutdown 2023-12-11T20:32:31.110 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:32:31.110 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 -- 172.21.15.12:0/187741613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cf56b0 msgr2=0x560253cfa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cf56b0 0x560253cfa480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8011580 tx=0x7fe8d8004750 comp rx=0 tx=0).stop 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 -- 172.21.15.12:0/187741613 shutdown_connections 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560253d01810 0x560253d03c30 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cfa9c0 0x560253cfcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253ceb840 0x560253cf5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/187741613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cf56b0 0x560253cfa480 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 -- 172.21.15.12:0/187741613 >> 172.21.15.12:0/187741613 conn(0x560253c09780 msgr2=0x560253cd4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8c2ffd700 0 client.29728 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.111+0000 7fe8fd698b80 1 -- 172.21.15.12:0/187741613 shutdown_connections 2023-12-11T20:32:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.112+0000 7fe8fd698b80 1 -- 172.21.15.12:0/187741613 wait complete. 2023-12-11T20:32:31.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.112+0000 7fe8fd698b80 20 client.29728 trim_cache size 0 max 16384 2023-12-11T20:32:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.148+0000 7fe8fd698b80 1 Processor -- start 2023-12-11T20:32:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.149+0000 7fe8fd698b80 1 -- start start 2023-12-11T20:32:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.150+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceb840 0x560253cecb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.150+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cf56b0 0x560253cefc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.150+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cfa9c0 0x560253cf2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.150+0000 7fe8e37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceb840 0x560253cecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.150+0000 7fe8e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cfa9c0 0x560253cf2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.150+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cf56b0 0x560253cefc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.151+0000 7fe8e37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceb840 0x560253cecb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53726/0 (socket says 172.21.15.12:53726) 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.151+0000 7fe8e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cfa9c0 0x560253cf2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52492/0 (socket says 172.21.15.12:52492) 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.151+0000 7fe8fd698b80 1 -- 172.21.15.12:0/2810435852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253cd5d70 con 0x560253cfa9c0 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.151+0000 7fe8fd698b80 1 -- 172.21.15.12:0/2810435852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253d08e80 con 0x560253cf56b0 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.151+0000 7fe8fd698b80 1 -- 172.21.15.12:0/2810435852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253cd18d0 con 0x560253ceb840 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.151+0000 7fe8e37fe700 1 -- 172.21.15.12:0/2810435852 learned_addr learned my addr 172.21.15.12:0/2810435852 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.152+0000 7fe8e2ffd700 1 -- 172.21.15.12:0/2810435852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceb840 msgr2=0x560253cecb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.152+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/2810435852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceb840 0x560253cecb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.152+0000 7fe8e2ffd700 1 -- 172.21.15.12:0/2810435852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cfa9c0 msgr2=0x560253cf2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.152+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/2810435852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cfa9c0 0x560253cf2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.153+0000 7fe8e2ffd700 1 -- 172.21.15.12:0/2810435852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560253a40c00 con 0x560253cf56b0 2023-12-11T20:32:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.153+0000 7fe8e3fff700 1 --2- 172.21.15.12:0/2810435852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cfa9c0 0x560253cf2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.154+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/2810435852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cf56b0 0x560253cefc10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8029f70 tx=0x7fe8d801e760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6ee1a2e985ffc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.156+0000 7fe8ca7fc700 1 -- 172.21.15.12:0/2810435852 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8020eb0 con 0x560253cf56b0 2023-12-11T20:32:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.156+0000 7fe8ca7fc700 1 -- 172.21.15.12:0/2810435852 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560253ccd730 con 0x560253cf56b0 2023-12-11T20:32:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.156+0000 7fe8ca7fc700 1 -- 172.21.15.12:0/2810435852 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80293d0 con 0x560253cf56b0 2023-12-11T20:32:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.157+0000 7fe8fd698b80 1 -- 172.21.15.12:0/2810435852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cf56b0 msgr2=0x560253cefc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.157+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/2810435852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cf56b0 0x560253cefc10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8029f70 tx=0x7fe8d801e760 comp rx=0 tx=0).stop 2023-12-11T20:32:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.157+0000 7fe8fd698b80 1 -- 172.21.15.12:0/2810435852 shutdown_connections 2023-12-11T20:32:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.157+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/2810435852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cfa9c0 0x560253cf2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.157+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/2810435852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253ceb840 0x560253cecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.157+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/2810435852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253cf56b0 0x560253cefc10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.157+0000 7fe8fd698b80 1 -- 172.21.15.12:0/2810435852 >> 172.21.15.12:0/2810435852 conn(0x560253c09780 msgr2=0x560253cf4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.158+0000 7fe8fd698b80 1 -- 172.21.15.12:0/2810435852 shutdown_connections 2023-12-11T20:32:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.158+0000 7fe8fd698b80 1 -- 172.21.15.12:0/2810435852 wait complete. 2023-12-11T20:32:31.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.158+0000 7fe8fd698b80 1 -- start start 2023-12-11T20:32:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.159+0000 7fe8fd698b80 1 Processor -- start 2023-12-11T20:32:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253ceb840 0x560253cf1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cf56b0 0x560253cf1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8fd698b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cfa9c0 0x560253d567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253d56df0 con 0x560253cf56b0 2023-12-11T20:32:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253d56f60 con 0x560253ceb840 2023-12-11T20:32:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8fd698b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253d57120 con 0x560253cfa9c0 2023-12-11T20:32:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8fd698b80 10 client.0 _ll_register_callbacks cb 0x560253b13a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cf56b0 0x560253cf1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cfa9c0 0x560253d567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cf56b0 0x560253cf1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52504/0 (socket says 172.21.15.12:52504) 2023-12-11T20:32:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.160+0000 7fe8e2ffd700 1 -- 172.21.15.12:0/4038253261 learned_addr learned my addr 172.21.15.12:0/4038253261 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.161+0000 7fe8e3fff700 1 -- 172.21.15.12:0/4038253261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253ceb840 msgr2=0x560253cf1a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:32:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.161+0000 7fe8e3fff700 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253ceb840 0x560253cf1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.161+0000 7fe8e3fff700 1 -- 172.21.15.12:0/4038253261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cf56b0 msgr2=0x560253cf1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.161+0000 7fe8e3fff700 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cf56b0 0x560253cf1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.161+0000 7fe8e3fff700 1 -- 172.21.15.12:0/4038253261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560253a57d80 con 0x560253cfa9c0 2023-12-11T20:32:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.161+0000 7fe8e2ffd700 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cf56b0 0x560253cf1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.162+0000 7fe8e3fff700 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cfa9c0 0x560253d567d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x560253cf5fc0 tx=0x7fe8d409ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1ae393fa3ab6203 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.162+0000 7fe8c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:32:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.162+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/4038253261 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d409f2d0 con 0x560253cfa9c0 2023-12-11T20:32:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.162+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/4038253261 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe8d40a3480 con 0x560253cfa9c0 2023-12-11T20:32:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.162+0000 7fe8fd698b80 1 -- 172.21.15.12:0/4038253261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8dc0149f0 con 0x560253cfa9c0 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.163+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/4038253261 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8d409a670 con 0x560253cfa9c0 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.163+0000 7fe8fd698b80 10 client.29734 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.163+0000 7fe8fd698b80 1 -- 172.21.15.12:0/4038253261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560253a7e1f0 con 0x560253cfa9c0 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.164+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/4038253261 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8dc0149f0 con 0x560253cfa9c0 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.164+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/4038253261 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe8d40a2ff0 con 0x560253cfa9c0 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.164+0000 7fe8fd698b80 10 client.29734 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.164+0000 7fe8fd698b80 10 client.29734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.164+0000 7fe8fd698b80 20 client.29734 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.164+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560253d58810 0x560253d5ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.164+0000 7fe8fd698b80 4 client.29734 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:32:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.164+0000 7fe8fd698b80 1 -- 172.21.15.12:0/4038253261 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560253bf4f70 con 0x560253d58810 2023-12-11T20:32:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.166+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560253d58810 0x560253d5ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.167+0000 7fe8e37fe700 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560253d58810 0x560253d5ac30 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76c27829d7ee26 server_cookie=2ef8d6ab69c8838e in_seq=0 out_seq=0 2023-12-11T20:32:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.167+0000 7fe8c2ffd700 10 client.29734 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.189+0000 7fe8c2ffd700 1 -- 172.21.15.12:0/4038253261 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560253bf4f70 con 0x560253d58810 2023-12-11T20:32:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.190+0000 7fe8c2ffd700 10 client.29734 handle_command_reply: tid=0 2023-12-11T20:32:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.190+0000 7fe8fd698b80 1 client.29734 shutdown 2023-12-11T20:32:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.190+0000 7fe8fd698b80 1 -- 172.21.15.12:0/4038253261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cfa9c0 msgr2=0x560253d567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.190+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cfa9c0 0x560253d567d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x560253cf5fc0 tx=0x7fe8d409ac10 comp rx=0 tx=0).stop 2023-12-11T20:32:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.190+0000 7fe8fd698b80 1 -- 172.21.15.12:0/4038253261 shutdown_connections 2023-12-11T20:32:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x560253d58810 0x560253d5ac30 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x560253ceb840 0x560253cf1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560253cfa9c0 0x560253d567d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8fd698b80 1 --2- 172.21.15.12:0/4038253261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560253cf56b0 0x560253cf1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8c2ffd700 0 client.29734 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8fd698b80 1 -- 172.21.15.12:0/4038253261 >> 172.21.15.12:0/4038253261 conn(0x560253c09780 msgr2=0x560253cf4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8fd698b80 1 -- 172.21.15.12:0/4038253261 shutdown_connections 2023-12-11T20:32:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8fd698b80 1 -- 172.21.15.12:0/4038253261 wait complete. 2023-12-11T20:32:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.191+0000 7fe8fd698b80 20 client.29734 trim_cache size 0 max 16384 2023-12-11T20:32:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:32:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:32:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:32:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:32:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.193+0000 7fe8e9dff700 1 -- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8cc0a14f0 msgr2=0x7fe8cc0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.193+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8cc0a14f0 0x7fe8cc0a39b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x560253ced0f0 tx=0x7fe8d800c4f0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.195+0000 7fe8e9dff700 1 -- 172.21.15.12:0/1653143235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8e4105070 msgr2=0x7fe8e41a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.195+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8e4105070 0x7fe8e41a4e70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400fb90 tx=0x7fe8d400b6c0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.196+0000 7fe8e9dff700 1 -- 172.21.15.12:0/1653143235 shutdown_connections 2023-12-11T20:32:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.196+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8cc0a14f0 0x7fe8cc0a39b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.196+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8e40ffd30 0x7fe8e419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.196+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8e4105070 0x7fe8e41a4e70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.196+0000 7fe8e9dff700 1 --2- 172.21.15.12:0/1653143235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e41026a0 0x7fe8e419de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.196+0000 7fe8e9dff700 1 -- 172.21.15.12:0/1653143235 >> 172.21.15.12:0/1653143235 conn(0x7fe8e40fb930 msgr2=0x7fe8e4100610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.197+0000 7fe8e9dff700 1 -- 172.21.15.12:0/1653143235 shutdown_connections 2023-12-11T20:32:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:31.197+0000 7fe8e9dff700 1 -- 172.21.15.12:0/1653143235 wait complete. 2023-12-11T20:32:31.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.533+0000 7f7a5d59d700 1 -- 172.21.15.12:0/148528117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a58108ad0 msgr2=0x7f7a58108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.533+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/148528117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a58108ad0 0x7f7a58108f50 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0098f0 tx=0x7f7a4c009c00 comp rx=0 tx=0).stop 2023-12-11T20:32:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.533+0000 7f7a5d59d700 1 -- 172.21.15.12:0/148528117 shutdown_connections 2023-12-11T20:32:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.533+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/148528117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a58072800 0x7f7a58072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.533+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/148528117 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a58109490 0x7f7a5810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.533+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/148528117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a58108ad0 0x7f7a58108f50 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.533+0000 7f7a5d59d700 1 -- 172.21.15.12:0/148528117 >> 172.21.15.12:0/148528117 conn(0x7f7a5806e2d0 msgr2=0x7f7a58070710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.533+0000 7f7a5d59d700 1 -- 172.21.15.12:0/148528117 shutdown_connections 2023-12-11T20:32:31.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.534+0000 7f7a5d59d700 1 -- 172.21.15.12:0/148528117 wait complete. 2023-12-11T20:32:31.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.537+0000 7f7a5d59d700 1 Processor -- start 2023-12-11T20:32:31.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.538+0000 7f7a5d59d700 1 -- start start 2023-12-11T20:32:31.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.540+0000 7f7a5d59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a58072800 0x7f7a581a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.540+0000 7f7a5d59d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a58108ad0 0x7f7a581a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.541+0000 7f7a5d59d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a58109490 0x7f7a581ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.541+0000 7f7a5d59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581ada60 con 0x7f7a58072800 2023-12-11T20:32:31.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.541+0000 7f7a5d59d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581adba0 con 0x7f7a58109490 2023-12-11T20:32:31.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.541+0000 7f7a5d59d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581add30 con 0x7f7a58108ad0 2023-12-11T20:32:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.541+0000 7f7a577fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a58108ad0 0x7f7a581a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.541+0000 7f7a577fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a58108ad0 0x7f7a581a6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53750/0 (socket says 172.21.15.12:53750) 2023-12-11T20:32:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.541+0000 7f7a577fe700 1 -- 172.21.15.12:0/243481967 learned_addr learned my addr 172.21.15.12:0/243481967 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.542+0000 7f7a57fff700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a58072800 0x7f7a581a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.542+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a58109490 0x7f7a581ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.543+0000 7f7a577fe700 1 -- 172.21.15.12:0/243481967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a58109490 msgr2=0x7f7a581ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.543+0000 7f7a577fe700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a58109490 0x7f7a581ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.543+0000 7f7a577fe700 1 -- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a58072800 msgr2=0x7f7a581a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.543+0000 7f7a577fe700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a58072800 0x7f7a581a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.543+0000 7f7a577fe700 1 -- 172.21.15.12:0/243481967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c009520 con 0x7f7a58108ad0 2023-12-11T20:32:31.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.543+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a58109490 0x7f7a581ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:31.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.544+0000 7f7a577fe700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a58108ad0 0x7f7a581a6470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009810 tx=0x7f7a4c00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.545+0000 7f7a557fa700 1 -- 172.21.15.12:0/243481967 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c01c070 con 0x7f7a58108ad0 2023-12-11T20:32:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.545+0000 7f7a557fa700 1 -- 172.21.15.12:0/243481967 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a4c00f7d0 con 0x7f7a58108ad0 2023-12-11T20:32:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.545+0000 7f7a557fa700 1 -- 172.21.15.12:0/243481967 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c003970 con 0x7f7a58108ad0 2023-12-11T20:32:31.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.545+0000 7f7a5d59d700 1 -- 172.21.15.12:0/243481967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a581adfb0 con 0x7f7a58108ad0 2023-12-11T20:32:31.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.545+0000 7f7a5d59d700 1 -- 172.21.15.12:0/243481967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a581ae320 con 0x7f7a58108ad0 2023-12-11T20:32:31.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:31 smithi039 ceph-mon[102205]: pgmap v872: 97 pgs: 97 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2023-12-11T20:32:31.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.557+0000 7f7a557fa700 1 -- 172.21.15.12:0/243481967 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7a4c020030 con 0x7f7a58108ad0 2023-12-11T20:32:31.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.560+0000 7f7a557fa700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a400a1710 0x7f7a400a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.560+0000 7f7a557fa700 1 -- 172.21.15.12:0/243481967 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a4c0cdd60 con 0x7f7a58108ad0 2023-12-11T20:32:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.562+0000 7f7a72209b80 1 Processor -- start 2023-12-11T20:32:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.561+0000 7f7a57fff700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a400a1710 0x7f7a400a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.564+0000 7f7a57fff700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a400a1710 0x7f7a400a3bd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7a58073550 tx=0x7f7a48009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.564+0000 7f7a72209b80 1 -- start start 2023-12-11T20:32:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.566+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e56f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.566+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e57920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.566+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.567+0000 7f7a577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e57920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.567+0000 7f7a72209b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622db1bd0 con 0x55f622e57440 2023-12-11T20:32:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.567+0000 7f7a72209b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622daf4f0 con 0x55f622e57e60 2023-12-11T20:32:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.567+0000 7f7a72209b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622daade0 con 0x55f622e56ae0 2023-12-11T20:32:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.567+0000 7f7a5cd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.567+0000 7f7a577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e57920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52532/0 (socket says 172.21.15.12:52532) 2023-12-11T20:32:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.567+0000 7f7a577fe700 1 -- 172.21.15.12:0/2349753929 learned_addr learned my addr 172.21.15.12:0/2349753929 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.568+0000 7f7a57fff700 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e56f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.568+0000 7f7a57fff700 1 -- 172.21.15.12:0/2349753929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 msgr2=0x55f622e582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.568+0000 7f7a57fff700 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.568+0000 7f7a57fff700 1 -- 172.21.15.12:0/2349753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 msgr2=0x55f622e57920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.568+0000 7f7a57fff700 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e57920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.568+0000 7f7a57fff700 1 -- 172.21.15.12:0/2349753929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f622c276b0 con 0x55f622e56ae0 2023-12-11T20:32:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.568+0000 7f7a577fe700 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e57920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.569+0000 7f7a57fff700 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e56f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800e3b0 tx=0x7f7a48014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab7f139399c321f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.570+0000 7f7a3e7fc700 1 -- 172.21.15.12:0/2349753929 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800ed50 con 0x55f622e56ae0 2023-12-11T20:32:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.570+0000 7f7a3e7fc700 1 -- 172.21.15.12:0/2349753929 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a48021070 con 0x55f622e56ae0 2023-12-11T20:32:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.570+0000 7f7a3e7fc700 1 -- 172.21.15.12:0/2349753929 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4801d670 con 0x55f622e56ae0 2023-12-11T20:32:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 -- 172.21.15.12:0/2349753929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 msgr2=0x55f622e56f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e56f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800e3b0 tx=0x7f7a48014000 comp rx=0 tx=0).stop 2023-12-11T20:32:31.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 -- 172.21.15.12:0/2349753929 shutdown_connections 2023-12-11T20:32:31.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e56f00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2349753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e57920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 -- 172.21.15.12:0/2349753929 >> 172.21.15.12:0/2349753929 conn(0x55f622d85860 msgr2=0x55f622e51450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 -- 172.21.15.12:0/2349753929 shutdown_connections 2023-12-11T20:32:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.571+0000 7f7a72209b80 1 -- 172.21.15.12:0/2349753929 wait complete. 2023-12-11T20:32:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.572+0000 7f7a72209b80 1 -- start start 2023-12-11T20:32:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.573+0000 7f7a72209b80 1 Processor -- start 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.573+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e56ae0 0x55f622e603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.574+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 0x55f622e60920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.574+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e67960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.574+0000 7f7a72209b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622d645e0 con 0x55f622e56ae0 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.574+0000 7f7a72209b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622d64280 con 0x55f622e57e60 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.574+0000 7f7a72209b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622c299a0 con 0x55f622e57440 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.574+0000 7f7a57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e56ae0 0x55f622e603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.574+0000 7f7a57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e56ae0 0x55f622e603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52536/0 (socket says 172.21.15.12:52536) 2023-12-11T20:32:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.574+0000 7f7a57fff700 1 -- 172.21.15.12:0/2720884119 learned_addr learned my addr 172.21.15.12:0/2720884119 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e67960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a72209b80 10 client.0 _ll_register_callbacks cb 0x55f622c8fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a577fe700 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 0x55f622e60920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a5cd9c700 1 -- 172.21.15.12:0/2720884119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 msgr2=0x55f622e60920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 0x55f622e60920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a5cd9c700 1 -- 172.21.15.12:0/2720884119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e56ae0 msgr2=0x55f622e603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e56ae0 0x55f622e603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a5cd9c700 1 -- 172.21.15.12:0/2720884119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a581ae320 con 0x55f622e57e60 2023-12-11T20:32:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e67960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7a50007ba0 tx=0x7f7a50007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58bcc64a400c9e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.575+0000 7f7a377fe700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.576+0000 7f7a377fe700 1 -- 172.21.15.12:0/2720884119 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500118a0 con 0x55f622e57e60 2023-12-11T20:32:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.576+0000 7f7a377fe700 1 -- 172.21.15.12:0/2720884119 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a50011a00 con 0x55f622e57e60 2023-12-11T20:32:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.576+0000 7f7a72209b80 1 -- 172.21.15.12:0/2720884119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f622e49a60 con 0x55f622e57e60 2023-12-11T20:32:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.576+0000 7f7a377fe700 1 -- 172.21.15.12:0/2720884119 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a50011bc0 con 0x55f622e57e60 2023-12-11T20:32:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.576+0000 7f7a72209b80 10 client.29747 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.576+0000 7f7a72209b80 1 -- 172.21.15.12:0/2720884119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f7a48017070 con 0x55f622e57e60 2023-12-11T20:32:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.577+0000 7f7a377fe700 1 -- 172.21.15.12:0/2720884119 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f622e49a60 con 0x55f622e57e60 2023-12-11T20:32:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.577+0000 7f7a377fe700 1 -- 172.21.15.12:0/2720884119 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7a50014070 con 0x55f622e57e60 2023-12-11T20:32:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.577+0000 7f7a72209b80 10 client.29747 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.577+0000 7f7a72209b80 10 client.29747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.577+0000 7f7a72209b80 20 client.29747 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.577+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f622e6c210 0x55f622e6e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.577+0000 7f7a72209b80 4 client.29747 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:31.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.577+0000 7f7a72209b80 1 -- 172.21.15.12:0/2720884119 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f622e25fc0 con 0x55f622e6c210 2023-12-11T20:32:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.578+0000 7f7a57fff700 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f622e6c210 0x55f622e6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.578+0000 7f7a57fff700 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f622e6c210 0x55f622e6e630 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6d13b9a69ff1978 server_cookie=89f766667aec6631 in_seq=0 out_seq=0 2023-12-11T20:32:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.578+0000 7f7a377fe700 10 client.29747 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a377fe700 1 -- 172.21.15.12:0/2720884119 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f622e25fc0 con 0x55f622e6c210 2023-12-11T20:32:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a377fe700 10 client.29747 handle_command_reply: tid=0 2023-12-11T20:32:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 client.29747 shutdown 2023-12-11T20:32:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 -- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 msgr2=0x55f622e67960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e67960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7a50007ba0 tx=0x7f7a50007eb0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 -- 172.21.15.12:0/2720884119 shutdown_connections 2023-12-11T20:32:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f622e6c210 0x55f622e6e630 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622e67960 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e56ae0 0x55f622e603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2720884119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 0x55f622e60920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a72209b80 1 -- 172.21.15.12:0/2720884119 >> 172.21.15.12:0/2720884119 conn(0x55f622d85860 msgr2=0x55f622e558a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.579+0000 7f7a377fe700 0 client.29747 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:31.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.580+0000 7f7a72209b80 1 -- 172.21.15.12:0/2720884119 shutdown_connections 2023-12-11T20:32:31.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.580+0000 7f7a72209b80 1 -- 172.21.15.12:0/2720884119 wait complete. 2023-12-11T20:32:31.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.580+0000 7f7a72209b80 20 client.29747 trim_cache size 0 max 16384 2023-12-11T20:32:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:31 smithi012 ceph-mon[128787]: pgmap v872: 97 pgs: 97 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2023-12-11T20:32:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.613+0000 7f7a72209b80 1 Processor -- start 2023-12-11T20:32:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.613+0000 7f7a72209b80 1 -- start start 2023-12-11T20:32:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.613+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e56ae0 0x55f622e603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.613+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 0x55f622e67920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.613+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57e60 0x55f622e608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.613+0000 7f7a72209b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622e68ae0 con 0x55f622e57e60 2023-12-11T20:32:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.613+0000 7f7a72209b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622e5ff50 con 0x55f622e56ae0 2023-12-11T20:32:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.613+0000 7f7a72209b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622e696d0 con 0x55f622e57440 2023-12-11T20:32:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.614+0000 7f7a5cd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57e60 0x55f622e608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.614+0000 7f7a5cd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57e60 0x55f622e608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52542/0 (socket says 172.21.15.12:52542) 2023-12-11T20:32:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.614+0000 7f7a5cd9c700 1 -- 172.21.15.12:0/2320754627 learned_addr learned my addr 172.21.15.12:0/2320754627 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.614+0000 7f7a5cd9c700 1 -- 172.21.15.12:0/2320754627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 msgr2=0x55f622e67920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:32:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.614+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/2320754627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 0x55f622e67920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.614+0000 7f7a5cd9c700 1 -- 172.21.15.12:0/2320754627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e56ae0 msgr2=0x55f622e603a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:32:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.614+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/2320754627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e56ae0 0x55f622e603a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.614+0000 7f7a5cd9c700 1 -- 172.21.15.12:0/2320754627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f622bd3e60 con 0x55f622e57e60 2023-12-11T20:32:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.615+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/2320754627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57e60 0x55f622e608e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f7a50000f80 tx=0x7f7a50011530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73013310db7c3420 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.615+0000 7f7a3effd700 1 -- 172.21.15.12:0/2320754627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50004a90 con 0x55f622e57e60 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.615+0000 7f7a3effd700 1 -- 172.21.15.12:0/2320754627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a5000f050 con 0x55f622e57e60 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.615+0000 7f7a3effd700 1 -- 172.21.15.12:0/2320754627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50015c40 con 0x55f622e57e60 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 -- 172.21.15.12:0/2320754627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57e60 msgr2=0x55f622e608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2320754627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57e60 0x55f622e608e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f7a50000f80 tx=0x7f7a50011530 comp rx=0 tx=0).stop 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 -- 172.21.15.12:0/2320754627 shutdown_connections 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2320754627 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e56ae0 0x55f622e603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2320754627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57e60 0x55f622e608e0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 --2- 172.21.15.12:0/2320754627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e57440 0x55f622e67920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 -- 172.21.15.12:0/2320754627 >> 172.21.15.12:0/2320754627 conn(0x55f622d85860 msgr2=0x55f622e72fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 -- 172.21.15.12:0/2320754627 shutdown_connections 2023-12-11T20:32:31.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.616+0000 7f7a72209b80 1 -- 172.21.15.12:0/2320754627 wait complete. 2023-12-11T20:32:31.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.617+0000 7f7a72209b80 1 -- start start 2023-12-11T20:32:31.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.617+0000 7f7a72209b80 1 Processor -- start 2023-12-11T20:32:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.617+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e66990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e66ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a72209b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622ec2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a72209b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622ec2c60 con 0x55f622e57440 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a72209b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622ec2da0 con 0x55f622e57e60 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a72209b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f622ec2ee0 con 0x55f622e56ae0 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a72209b80 10 client.0 _ll_register_callbacks cb 0x55f622c8fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e66ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e66ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52558/0 (socket says 172.21.15.12:52558) 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a577fe700 1 -- 172.21.15.12:0/3455147792 learned_addr learned my addr 172.21.15.12:0/3455147792 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622ec2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a57fff700 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e66990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a577fe700 1 -- 172.21.15.12:0/3455147792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 msgr2=0x55f622e66990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a577fe700 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e66990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.618+0000 7f7a577fe700 1 -- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 msgr2=0x55f622ec2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a577fe700 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622ec2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a577fe700 1 -- 172.21.15.12:0/3455147792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a48017070 con 0x55f622e57440 2023-12-11T20:32:31.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a5cd9c700 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622ec2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a577fe700 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e66ed0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00f9d0 tx=0x7f7a4c019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b7461d0ddccf0a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a377fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a377fe700 1 -- 172.21.15.12:0/3455147792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c09f1b0 con 0x55f622e57440 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a377fe700 1 -- 172.21.15.12:0/3455147792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a4c0a3360 con 0x55f622e57440 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a72209b80 1 -- 172.21.15.12:0/3455147792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a48021070 con 0x55f622e57440 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a377fe700 1 -- 172.21.15.12:0/3455147792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a4c0b9240 con 0x55f622e57440 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a72209b80 10 client.20220 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.619+0000 7f7a72209b80 1 -- 172.21.15.12:0/3455147792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f622bbcce0 con 0x55f622e57440 2023-12-11T20:32:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a377fe700 1 -- 172.21.15.12:0/3455147792 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a4c0a7020 con 0x55f622e57440 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a377fe700 1 -- 172.21.15.12:0/3455147792 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7a4c003ad0 con 0x55f622e57440 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a72209b80 10 client.20220 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a72209b80 10 client.20220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a72209b80 20 client.20220 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a72209b80 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f622ec45e0 0x55f622ec6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a72209b80 4 client.20220 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a72209b80 1 -- 172.21.15.12:0/3455147792 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f622d71050 con 0x55f622ec45e0 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.620+0000 7f7a57fff700 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f622ec45e0 0x55f622ec6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.621+0000 7f7a57fff700 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f622ec45e0 0x55f622ec6a00 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4feacd9e414effc server_cookie=f5a2ccb64fd45e5a in_seq=0 out_seq=0 2023-12-11T20:32:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.621+0000 7f7a377fe700 10 client.20220 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.622+0000 7f7a377fe700 1 -- 172.21.15.12:0/3455147792 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f622d71050 con 0x55f622ec45e0 2023-12-11T20:32:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.622+0000 7f7a377fe700 10 client.20220 handle_command_reply: tid=0 2023-12-11T20:32:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.622+0000 7f7a72209b80 1 client.20220 shutdown 2023-12-11T20:32:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.623+0000 7f7a72209b80 1 -- 172.21.15.12:0/3455147792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 msgr2=0x55f622e66ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.623+0000 7f7a72209b80 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e66ed0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00f9d0 tx=0x7f7a4c019040 comp rx=0 tx=0).stop 2023-12-11T20:32:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a72209b80 1 -- 172.21.15.12:0/3455147792 shutdown_connections 2023-12-11T20:32:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a72209b80 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f622ec45e0 0x55f622ec6a00 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a72209b80 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f622e57e60 0x55f622ec2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a72209b80 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f622e56ae0 0x55f622e66990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a72209b80 1 --2- 172.21.15.12:0/3455147792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f622e57440 0x55f622e66ed0 secure :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00f9d0 tx=0x7f7a4c019040 comp rx=0 tx=0).stop 2023-12-11T20:32:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a377fe700 0 client.20220 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a72209b80 1 -- 172.21.15.12:0/3455147792 >> 172.21.15.12:0/3455147792 conn(0x55f622d85860 msgr2=0x55f622e60380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a72209b80 1 -- 172.21.15.12:0/3455147792 shutdown_connections 2023-12-11T20:32:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.624+0000 7f7a72209b80 1 -- 172.21.15.12:0/3455147792 wait complete. 2023-12-11T20:32:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.625+0000 7f7a72209b80 20 client.20220 trim_cache size 0 max 16384 2023-12-11T20:32:31.624 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:32:31.624 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:32:31.624 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "33c03cf9-fd6b-458b-8cf0-3f5218cc615e", 2023-12-11T20:32:31.624 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:32:31.624 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.625+0000 7f7a5d59d700 1 -- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a400a1710 msgr2=0x7f7a400a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.625+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a400a1710 0x7f7a400a3bd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7a58073550 tx=0x7f7a48009310 comp rx=0 tx=0).stop 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.625+0000 7f7a5d59d700 1 -- 172.21.15.12:0/243481967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a58108ad0 msgr2=0x7f7a581a6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.625+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a58108ad0 0x7f7a581a6470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009810 tx=0x7f7a4c00b840 comp rx=0 tx=0).stop 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.626+0000 7f7a5d59d700 1 -- 172.21.15.12:0/243481967 shutdown_connections 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.626+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7a400a1710 0x7f7a400a3bd0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.626+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a58109490 0x7f7a581ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.626+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a58072800 0x7f7a581a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.626+0000 7f7a5d59d700 1 --2- 172.21.15.12:0/243481967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a58108ad0 0x7f7a581a6470 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.626+0000 7f7a5d59d700 1 -- 172.21.15.12:0/243481967 >> 172.21.15.12:0/243481967 conn(0x7f7a5806e2d0 msgr2=0x7f7a5806ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.626+0000 7f7a5d59d700 1 -- 172.21.15.12:0/243481967 shutdown_connections 2023-12-11T20:32:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:31.626+0000 7f7a5d59d700 1 -- 172.21.15.12:0/243481967 wait complete. 2023-12-11T20:32:31.651 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:32:31.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:31 smithi032 ceph-mon[132488]: pgmap v872: 97 pgs: 97 active+clean; 13 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2023-12-11T20:32:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.117+0000 7f27379ff700 1 -- 172.21.15.12:0/2960917900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27301096e0 msgr2=0x7f273010bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.117+0000 7f27379ff700 1 --2- 172.21.15.12:0/2960917900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27301096e0 0x7f273010bad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f272c009990 tx=0x7f272c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.117+0000 7f27379ff700 1 -- 172.21.15.12:0/2960917900 shutdown_connections 2023-12-11T20:32:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.117+0000 7f27379ff700 1 --2- 172.21.15.12:0/2960917900 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27301096e0 0x7f273010bad0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.117+0000 7f27379ff700 1 --2- 172.21.15.12:0/2960917900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f273010e940 0x7f2730110d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.117+0000 7f27379ff700 1 --2- 172.21.15.12:0/2960917900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f273010c010 0x7f273010e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.117+0000 7f27379ff700 1 -- 172.21.15.12:0/2960917900 >> 172.21.15.12:0/2960917900 conn(0x7f273006e2d0 msgr2=0x7f2730070710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.118+0000 7f27379ff700 1 -- 172.21.15.12:0/2960917900 shutdown_connections 2023-12-11T20:32:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.118+0000 7f27379ff700 1 -- 172.21.15.12:0/2960917900 wait complete. 2023-12-11T20:32:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.123+0000 7f27379ff700 1 Processor -- start 2023-12-11T20:32:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.125+0000 7f27379ff700 1 -- start start 2023-12-11T20:32:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.125+0000 7f27379ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27301096e0 0x7f27301a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.125+0000 7f27379ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f273010c010 0x7f27301a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.126+0000 7f27379ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f273010e940 0x7f273019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.126+0000 7f27379ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273019e130 con 0x7f273010e940 2023-12-11T20:32:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.126+0000 7f27379ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273019e2a0 con 0x7f273010c010 2023-12-11T20:32:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.126+0000 7f27379ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273019e460 con 0x7f27301096e0 2023-12-11T20:32:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.126+0000 7f2735f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f273010e940 0x7f273019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.126+0000 7f2735f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f273010e940 0x7f273019d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52582/0 (socket says 172.21.15.12:52582) 2023-12-11T20:32:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.126+0000 7f2735f9c700 1 -- 172.21.15.12:0/3340894452 learned_addr learned my addr 172.21.15.12:0/3340894452 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.126+0000 7f2734f9a700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f273010c010 0x7f27301a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.127+0000 7f273579b700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27301096e0 0x7f27301a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.127+0000 7f2735f9c700 1 -- 172.21.15.12:0/3340894452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27301096e0 msgr2=0x7f27301a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.127+0000 7f2735f9c700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27301096e0 0x7f27301a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.127+0000 7f2735f9c700 1 -- 172.21.15.12:0/3340894452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f273010c010 msgr2=0x7f27301a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.127+0000 7f2735f9c700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f273010c010 0x7f27301a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.127+0000 7f2735f9c700 1 -- 172.21.15.12:0/3340894452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0095f0 con 0x7f273010e940 2023-12-11T20:32:32.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.128+0000 7f273579b700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27301096e0 0x7f27301a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:32.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.128+0000 7f2734f9a700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f273010c010 0x7f27301a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:32.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.128+0000 7f2735f9c700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f273010e940 0x7f273019d990 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f2728007d70 tx=0x7f272800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:32.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.128+0000 7f27267fc700 1 -- 172.21.15.12:0/3340894452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800ad40 con 0x7f273010e940 2023-12-11T20:32:32.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.129+0000 7f27267fc700 1 -- 172.21.15.12:0/3340894452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27280128b0 con 0x7f273010e940 2023-12-11T20:32:32.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.129+0000 7f27267fc700 1 -- 172.21.15.12:0/3340894452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800ad40 con 0x7f273010e940 2023-12-11T20:32:32.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.129+0000 7f27379ff700 1 -- 172.21.15.12:0/3340894452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27301ae1e0 con 0x7f273010e940 2023-12-11T20:32:32.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.129+0000 7f27379ff700 1 -- 172.21.15.12:0/3340894452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27301ae670 con 0x7f273010e940 2023-12-11T20:32:32.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.136+0000 7f27267fc700 1 -- 172.21.15.12:0/3340894452 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2728012420 con 0x7f273010e940 2023-12-11T20:32:32.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.139+0000 7f27267fc700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f271c0a1610 0x7f271c0a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.139+0000 7f274b2fbb80 1 Processor -- start 2023-12-11T20:32:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.139+0000 7f27267fc700 1 -- 172.21.15.12:0/3340894452 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f27280ccb60 con 0x7f273010e940 2023-12-11T20:32:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.140+0000 7f274b2fbb80 1 -- start start 2023-12-11T20:32:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.140+0000 7f273579b700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f271c0a1610 0x7f271c0a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b9504067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950406d30 0x55b950407640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950407c20 0x55b9504080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b950361b50 con 0x55b950406d30 2023-12-11T20:32:32.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95035f470 con 0x55b9504063d0 2023-12-11T20:32:32.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95035ad60 con 0x55b950407c20 2023-12-11T20:32:32.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f273579b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b9504067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f273579b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b9504067f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50306/0 (socket says 172.21.15.12:50306) 2023-12-11T20:32:32.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f273579b700 1 -- 172.21.15.12:0/3499968257 learned_addr learned my addr 172.21.15.12:0/3499968257 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:32.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.141+0000 7f2735f9c700 1 --2- 172.21.15.12:0/3499968257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950407c20 0x55b9504080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.142+0000 7f273579b700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f271c0a1610 0x7f271c0a3ad0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f272c003710 tx=0x7f272c005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.142+0000 7f2735f9c700 1 -- 172.21.15.12:0/3499968257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 msgr2=0x55b9504067f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.142+0000 7f2735f9c700 1 --2- 172.21.15.12:0/3499968257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b9504067f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.142+0000 7f2735f9c700 1 -- 172.21.15.12:0/3499968257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950406d30 msgr2=0x55b950407640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.142+0000 7f2735f9c700 1 --2- 172.21.15.12:0/3499968257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950406d30 0x55b950407640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.142+0000 7f2735f9c700 1 -- 172.21.15.12:0/3499968257 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9501d7630 con 0x55b950407c20 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.142+0000 7f2735f9c700 1 --2- 172.21.15.12:0/3499968257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950407c20 0x55b9504080a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f272800afd0 tx=0x7f2728099cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d1716e0f9628200 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.142+0000 7f271b7fe700 1 -- 172.21.15.12:0/3499968257 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280126d0 con 0x55b950407c20 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.143+0000 7f271b7fe700 1 -- 172.21.15.12:0/3499968257 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f272809a4d0 con 0x55b950407c20 2023-12-11T20:32:32.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.143+0000 7f271b7fe700 1 -- 172.21.15.12:0/3499968257 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728012a20 con 0x55b950407c20 2023-12-11T20:32:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.143+0000 7f274b2fbb80 1 -- 172.21.15.12:0/3499968257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950407c20 msgr2=0x55b9504080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.143+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/3499968257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950407c20 0x55b9504080a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f272800afd0 tx=0x7f2728099cd0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.144+0000 7f274b2fbb80 1 -- 172.21.15.12:0/3499968257 shutdown_connections 2023-12-11T20:32:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.144+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/3499968257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b9504067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.144+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/3499968257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950407c20 0x55b9504080a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.144+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/3499968257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950406d30 0x55b950407640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.144+0000 7f274b2fbb80 1 -- 172.21.15.12:0/3499968257 >> 172.21.15.12:0/3499968257 conn(0x55b9503357e0 msgr2=0x55b950402d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.144+0000 7f274b2fbb80 1 -- 172.21.15.12:0/3499968257 shutdown_connections 2023-12-11T20:32:32.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.144+0000 7f274b2fbb80 1 -- 172.21.15.12:0/3499968257 wait complete. 2023-12-11T20:32:32.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.145+0000 7f274b2fbb80 1 -- start start 2023-12-11T20:32:32.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.145+0000 7f274b2fbb80 1 Processor -- start 2023-12-11T20:32:32.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.147+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b950410360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.147+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504108a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950417c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2734f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2734f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504108a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52586/0 (socket says 172.21.15.12:52586) 2023-12-11T20:32:32.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b950314560 con 0x55b950407c20 2023-12-11T20:32:32.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2734f9a700 1 -- 172.21.15.12:0/2536406149 learned_addr learned my addr 172.21.15.12:0/2536406149 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:32.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b950314200 con 0x55b9504063d0 2023-12-11T20:32:32.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9501d9920 con 0x55b950415880 2023-12-11T20:32:32.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2735f9c700 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950417c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f274b2fbb80 10 client.0 _ll_register_callbacks cb 0x55b95023fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2735f9c700 1 -- 172.21.15.12:0/2536406149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 msgr2=0x55b950410360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2735f9c700 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b950410360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2735f9c700 1 -- 172.21.15.12:0/2536406149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 msgr2=0x55b9504108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2735f9c700 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.148+0000 7f2735f9c700 1 -- 172.21.15.12:0/2536406149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27301ae670 con 0x55b950415880 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.149+0000 7f2734f9a700 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.149+0000 7f2735f9c700 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950417c70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2728012e90 tx=0x7f2728004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7232a70dee22316e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.149+0000 7f2718ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.149+0000 7f2718ff9700 1 -- 172.21.15.12:0/2536406149 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728099dd0 con 0x55b950415880 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.149+0000 7f2718ff9700 1 -- 172.21.15.12:0/2536406149 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f27280992c0 con 0x55b950415880 2023-12-11T20:32:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.149+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9503f9b40 con 0x55b950415880 2023-12-11T20:32:32.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.150+0000 7f2718ff9700 1 -- 172.21.15.12:0/2536406149 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2728099480 con 0x55b950415880 2023-12-11T20:32:32.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.150+0000 7f274b2fbb80 10 client.29758 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.150+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b950183de0 con 0x55b950415880 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.150+0000 7f2718ff9700 1 -- 172.21.15.12:0/2536406149 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b9503f9b40 con 0x55b950415880 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.151+0000 7f2718ff9700 1 -- 172.21.15.12:0/2536406149 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f27280a1db0 con 0x55b950415880 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.151+0000 7f274b2fbb80 10 client.29758 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.151+0000 7f274b2fbb80 10 client.29758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.151+0000 7f274b2fbb80 20 client.29758 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.151+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b95041c220 0x55b95041e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.151+0000 7f274b2fbb80 4 client.29758 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.151+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9503d5f40 con 0x55b95041c220 2023-12-11T20:32:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.152+0000 7f273579b700 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b95041c220 0x55b95041e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.153+0000 7f273579b700 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b95041c220 0x55b95041e610 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b1c3752a69ae5f server_cookie=ac8c6f593d9578e8 in_seq=0 out_seq=0 2023-12-11T20:32:32.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.153+0000 7f2718ff9700 10 client.29758 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:32.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.154+0000 7f2718ff9700 1 -- 172.21.15.12:0/2536406149 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b9503d5f40 con 0x55b95041c220 2023-12-11T20:32:32.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.154+0000 7f2718ff9700 10 client.29758 handle_command_reply: tid=0 2023-12-11T20:32:32.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.154+0000 7f274b2fbb80 1 client.29758 shutdown 2023-12-11T20:32:32.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 msgr2=0x55b950417c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950417c70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2728012e90 tx=0x7f2728004ad0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 shutdown_connections 2023-12-11T20:32:32.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b95041c220 0x55b95041e610 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b950410360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950417c70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2536406149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 >> 172.21.15.12:0/2536406149 conn(0x55b9503357e0 msgr2=0x55b9503fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:32.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.155+0000 7f2718ff9700 0 client.29758 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:32.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.156+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 shutdown_connections 2023-12-11T20:32:32.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.156+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2536406149 wait complete. 2023-12-11T20:32:32.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.156+0000 7f274b2fbb80 20 client.29758 trim_cache size 0 max 16384 2023-12-11T20:32:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.191+0000 7f274b2fbb80 1 Processor -- start 2023-12-11T20:32:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.191+0000 7f274b2fbb80 1 -- start start 2023-12-11T20:32:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b95040ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b95040a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9503fdbe0 con 0x55b950407c20 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95040ebe0 con 0x55b9504063d0 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9504237f0 con 0x55b950415880 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f2735f9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b95040a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f2735f9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b95040a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:53828/0 (socket says 172.21.15.12:53828) 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f2735f9c700 1 -- 172.21.15.12:0/2407221609 learned_addr learned my addr 172.21.15.12:0/2407221609 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.192+0000 7f273579b700 1 --2- 172.21.15.12:0/2407221609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b95040ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.193+0000 7f2735f9c700 1 -- 172.21.15.12:0/2407221609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 msgr2=0x55b95040ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.193+0000 7f2735f9c700 1 --2- 172.21.15.12:0/2407221609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b95040ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.193+0000 7f2735f9c700 1 -- 172.21.15.12:0/2407221609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 msgr2=0x55b9504073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.193+0000 7f2735f9c700 1 --2- 172.21.15.12:0/2407221609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.193+0000 7f2735f9c700 1 -- 172.21.15.12:0/2407221609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b95016cc60 con 0x55b950415880 2023-12-11T20:32:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.195+0000 7f2735f9c700 1 --2- 172.21.15.12:0/2407221609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b95040a1e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f272800a740 tx=0x7f2728019480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a06a36a2b8aba435 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.196+0000 7f271bfff700 1 -- 172.21.15.12:0/2407221609 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728096110 con 0x55b950415880 2023-12-11T20:32:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.196+0000 7f271bfff700 1 -- 172.21.15.12:0/2407221609 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2728099dd0 con 0x55b950415880 2023-12-11T20:32:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.196+0000 7f271bfff700 1 -- 172.21.15.12:0/2407221609 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728004e30 con 0x55b950415880 2023-12-11T20:32:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.197+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2407221609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 msgr2=0x55b95040a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.197+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2407221609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b95040a1e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f272800a740 tx=0x7f2728019480 comp rx=0 tx=0).stop 2023-12-11T20:32:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.197+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2407221609 shutdown_connections 2023-12-11T20:32:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.197+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2407221609 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b9504063d0 0x55b95040ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.197+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2407221609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b95040a1e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.197+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2407221609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b950407c20 0x55b9504073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.197+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2407221609 >> 172.21.15.12:0/2407221609 conn(0x55b9503357e0 msgr2=0x55b95040f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.198+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2407221609 shutdown_connections 2023-12-11T20:32:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.198+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2407221609 wait complete. 2023-12-11T20:32:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.198+0000 7f274b2fbb80 1 -- start start 2023-12-11T20:32:32.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.199+0000 7f274b2fbb80 1 Processor -- start 2023-12-11T20:32:32.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.199+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9504063d0 0x55b9504295c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.199+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b950407c20 0x55b950429b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.199+0000 7f274b2fbb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950471130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.199+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95042cad0 con 0x55b9504063d0 2023-12-11T20:32:32.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.199+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95042cc40 con 0x55b950407c20 2023-12-11T20:32:32.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.199+0000 7f274b2fbb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b950471670 con 0x55b950415880 2023-12-11T20:32:32.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.200+0000 7f274b2fbb80 10 client.0 _ll_register_callbacks cb 0x55b95023fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.200+0000 7f273579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9504063d0 0x55b9504295c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.200+0000 7f273579b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9504063d0 0x55b9504295c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52598/0 (socket says 172.21.15.12:52598) 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.200+0000 7f273579b700 1 -- 172.21.15.12:0/2521261865 learned_addr learned my addr 172.21.15.12:0/2521261865 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.200+0000 7f2735f9c700 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950471130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.200+0000 7f2734f9a700 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b950407c20 0x55b950429b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.201+0000 7f273579b700 1 -- 172.21.15.12:0/2521261865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 msgr2=0x55b950471130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.201+0000 7f273579b700 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950471130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.201+0000 7f273579b700 1 -- 172.21.15.12:0/2521261865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b950407c20 msgr2=0x55b950429b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.201+0000 7f273579b700 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b950407c20 0x55b950429b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.201+0000 7f273579b700 1 -- 172.21.15.12:0/2521261865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b950183de0 con 0x55b9504063d0 2023-12-11T20:32:32.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.201+0000 7f273579b700 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9504063d0 0x55b9504295c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f272c009990 tx=0x7f272c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af36b857a628d0b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:32.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.201+0000 7f2718ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:32:32.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.203+0000 7f2718ff9700 1 -- 172.21.15.12:0/2521261865 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c01e070 con 0x55b9504063d0 2023-12-11T20:32:32.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.203+0000 7f2718ff9700 1 -- 172.21.15.12:0/2521261865 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f272c031790 con 0x55b9504063d0 2023-12-11T20:32:32.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.204+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2521261865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f272809a4d0 con 0x55b9504063d0 2023-12-11T20:32:32.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.204+0000 7f2718ff9700 1 -- 172.21.15.12:0/2521261865 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f272c005040 con 0x55b9504063d0 2023-12-11T20:32:32.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.204+0000 7f274b2fbb80 10 client.20229 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:32.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.204+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2521261865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b9501aa250 con 0x55b9504063d0 2023-12-11T20:32:32.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.205+0000 7f2718ff9700 1 -- 172.21.15.12:0/2521261865 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f272809a4d0 con 0x55b9504063d0 2023-12-11T20:32:32.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.205+0000 7f2718ff9700 1 -- 172.21.15.12:0/2521261865 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f272c0049e0 con 0x55b9504063d0 2023-12-11T20:32:32.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.205+0000 7f274b2fbb80 10 client.20229 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:32.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.205+0000 7f274b2fbb80 10 client.20229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:32.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.205+0000 7f274b2fbb80 20 client.20229 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:32.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.206+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b950473010 0x55b950475430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:32.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.206+0000 7f274b2fbb80 4 client.20229 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:32:32.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.206+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2521261865 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b950320fd0 con 0x55b950473010 2023-12-11T20:32:32.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.206+0000 7f2734f9a700 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b950473010 0x55b950475430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:32.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.207+0000 7f2734f9a700 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b950473010 0x55b950475430 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b7e6f360577223d server_cookie=23a6a8859669aef5 in_seq=0 out_seq=0 2023-12-11T20:32:32.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.207+0000 7f2718ff9700 10 client.20229 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:32.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.207+0000 7f2718ff9700 1 -- 172.21.15.12:0/2521261865 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b950320fd0 con 0x55b950473010 2023-12-11T20:32:32.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f2718ff9700 10 client.20229 handle_command_reply: tid=0 2023-12-11T20:32:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 client.20229 shutdown 2023-12-11T20:32:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2521261865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9504063d0 msgr2=0x55b9504295c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9504063d0 0x55b9504295c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f272c009990 tx=0x7f272c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2521261865 shutdown_connections 2023-12-11T20:32:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b950473010 0x55b950475430 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b950415880 0x55b950471130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9504063d0 0x55b9504295c0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 --2- 172.21.15.12:0/2521261865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b950407c20 0x55b950429b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2521261865 >> 172.21.15.12:0/2521261865 conn(0x55b9503357e0 msgr2=0x55b95040f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.208+0000 7f2718ff9700 0 client.20229 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.209+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2521261865 shutdown_connections 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.209+0000 7f274b2fbb80 1 -- 172.21.15.12:0/2521261865 wait complete. 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.209+0000 7f274b2fbb80 20 client.20229 trim_cache size 0 max 16384 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:32:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: "33c03cf9-fd6b-458b-8cf0-3f5218cc615e": { 2023-12-11T20:32:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:32:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "33c03cf9-fd6b-458b-8cf0-3f5218cc615e", 2023-12-11T20:32:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:32:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:32:32.211 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:32:32.211 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 -- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f271c0a1610 msgr2=0x7f271c0a3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f271c0a1610 0x7f271c0a3ad0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f272c003710 tx=0x7f272c005fb0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 -- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f273010e940 msgr2=0x7f273019d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f273010e940 0x7f273019d990 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f2728007d70 tx=0x7f272800a340 comp rx=0 tx=0).stop 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 -- 172.21.15.12:0/3340894452 shutdown_connections 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f271c0a1610 0x7f271c0a3ad0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f273010e940 0x7f273019d990 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27301096e0 0x7f27301a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 --2- 172.21.15.12:0/3340894452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f273010c010 0x7f27301a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.210+0000 7f27379ff700 1 -- 172.21.15.12:0/3340894452 >> 172.21.15.12:0/3340894452 conn(0x7f273006e2d0 msgr2=0x7f2730109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.211+0000 7f27379ff700 1 -- 172.21.15.12:0/3340894452 shutdown_connections 2023-12-11T20:32:32.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:32:32.211+0000 7f27379ff700 1 -- 172.21.15.12:0/3340894452 wait complete. 2023-12-11T20:32:32.244 INFO:tasks.cephfs.filesystem:scrub status for tag:33c03cf9-fd6b-458b-8cf0-3f5218cc615e - {'path': '/', 'tag': '33c03cf9-fd6b-458b-8cf0-3f5218cc615e', 'options': 'recursive,force'} 2023-12-11T20:32:32.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:32 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:32:32.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:32 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:32 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:32:32.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:32 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:32.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:32 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:32:32.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:32 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:33 smithi039 ceph-mon[102205]: pgmap v873: 97 pgs: 97 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.88k op/s 2023-12-11T20:32:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:33 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:32:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:32:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:33 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:32:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:33 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:33 smithi012 ceph-mon[128787]: pgmap v873: 97 pgs: 97 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.88k op/s 2023-12-11T20:32:33.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:33 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:32:33.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:32:33.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:33 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:32:33.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:33 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:33 smithi032 ceph-mon[132488]: pgmap v873: 97 pgs: 97 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.88k op/s 2023-12-11T20:32:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:33 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:32:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:32:33.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:33 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:32:33.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:33.714 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:33 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:32:35.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:35 smithi039 ceph-mon[102205]: pgmap v874: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2023-12-11T20:32:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:35 smithi012 ceph-mon[128787]: pgmap v874: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2023-12-11T20:32:35.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:35 smithi032 ceph-mon[132488]: pgmap v874: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 4.44k op/s 2023-12-11T20:32:37.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:37 smithi039 ceph-mon[102205]: pgmap v875: 97 pgs: 97 active+clean; 13 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:32:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:37 smithi012 ceph-mon[128787]: pgmap v875: 97 pgs: 97 active+clean; 13 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:32:37.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:37 smithi032 ceph-mon[132488]: pgmap v875: 97 pgs: 97 active+clean; 13 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:32:39.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:39 smithi039 ceph-mon[102205]: pgmap v876: 97 pgs: 97 active+clean; 13 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2023-12-11T20:32:39.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:39 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:32:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:39 smithi012 ceph-mon[128787]: pgmap v876: 97 pgs: 97 active+clean; 13 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2023-12-11T20:32:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:39 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:32:39.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:39 smithi032 ceph-mon[132488]: pgmap v876: 97 pgs: 97 active+clean; 13 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 20 MiB/s wr, 5.01k op/s 2023-12-11T20:32:39.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:39 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:32:41.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:41 smithi039 ceph-mon[102205]: pgmap v877: 97 pgs: 97 active+clean; 13 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2023-12-11T20:32:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:32:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:32:41.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:32:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:41 smithi012 ceph-mon[128787]: pgmap v877: 97 pgs: 97 active+clean; 13 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2023-12-11T20:32:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:32:41.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:32:41.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:32:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:41 smithi032 ceph-mon[132488]: pgmap v877: 97 pgs: 97 active+clean; 13 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2023-12-11T20:32:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:32:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:32:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:32:41.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:32:42.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:42 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi012 to 223.0M 2023-12-11T20:32:42.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:42 smithi039 ceph-mon[102205]: Unable to set osd_memory_target on smithi012 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:32:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:42 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi012 to 223.0M 2023-12-11T20:32:42.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:42 smithi012 ceph-mon[128787]: Unable to set osd_memory_target on smithi012 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:32:42.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:42 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi012 to 223.0M 2023-12-11T20:32:42.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:42 smithi032 ceph-mon[132488]: Unable to set osd_memory_target on smithi012 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:32:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:43 smithi039 ceph-mon[102205]: pgmap v878: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:32:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:43 smithi012 ceph-mon[128787]: pgmap v878: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:32:43.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:43 smithi032 ceph-mon[132488]: pgmap v878: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:32:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.504+0000 7f586abff700 1 -- 172.21.15.12:0/998195202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58640ffd30 msgr2=0x7f5864100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.504+0000 7f586abff700 1 --2- 172.21.15.12:0/998195202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58640ffd30 0x7f5864100150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f585400b0a0 tx=0x7f585400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.505+0000 7f586abff700 1 -- 172.21.15.12:0/998195202 shutdown_connections 2023-12-11T20:32:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.505+0000 7f586abff700 1 --2- 172.21.15.12:0/998195202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58640ffd30 0x7f5864100150 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f585400b0a0 tx=0x7f585400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.505+0000 7f586abff700 1 --2- 172.21.15.12:0/998195202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5864101050 0x7f58641014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.505+0000 7f586abff700 1 --2- 172.21.15.12:0/998195202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5864100690 0x7f5864100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.505+0000 7f586abff700 1 -- 172.21.15.12:0/998195202 >> 172.21.15.12:0/998195202 conn(0x7f58640fb930 msgr2=0x7f58640fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.506+0000 7f586abff700 1 -- 172.21.15.12:0/998195202 shutdown_connections 2023-12-11T20:32:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.506+0000 7f586abff700 1 -- 172.21.15.12:0/998195202 wait complete. 2023-12-11T20:32:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.508+0000 7f586abff700 1 Processor -- start 2023-12-11T20:32:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.509+0000 7f586abff700 1 -- start start 2023-12-11T20:32:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.509+0000 7f586abff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5864100690 0x7f5864070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.510+0000 7f586abff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5864101050 0x7f58640706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.510+0000 7f586abff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5864103f50 0x7f58641043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.510+0000 7f586899b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5864100690 0x7f5864070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.510+0000 7f586899b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5864100690 0x7f5864070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35466/0 (socket says 172.21.15.12:35466) 2023-12-11T20:32:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.510+0000 7f586899b700 1 -- 172.21.15.12:0/3574901112 learned_addr learned my addr 172.21.15.12:0/3574901112 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.510+0000 7f585bfff700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5864101050 0x7f58640706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.510+0000 7f586919c700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5864103f50 0x7f58641043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.511+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864070d70 con 0x7f5864101050 2023-12-11T20:32:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.511+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864104910 con 0x7f5864100690 2023-12-11T20:32:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.511+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864104ad0 con 0x7f5864103f50 2023-12-11T20:32:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.511+0000 7f586919c700 1 -- 172.21.15.12:0/3574901112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5864100690 msgr2=0x7f5864070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.511+0000 7f586919c700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5864100690 0x7f5864070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.511+0000 7f586919c700 1 -- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5864101050 msgr2=0x7f58640706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.511+0000 7f586919c700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5864101050 0x7f58640706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.511+0000 7f586919c700 1 -- 172.21.15.12:0/3574901112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5854009d00 con 0x7f5864103f50 2023-12-11T20:32:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.512+0000 7f585bfff700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5864101050 0x7f58640706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.512+0000 7f586919c700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5864103f50 0x7f58641043d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f585c00c970 tx=0x7f585c00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.512+0000 7f58627fc700 1 -- 172.21.15.12:0/3574901112 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00e880 con 0x7f5864103f50 2023-12-11T20:32:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.512+0000 7f58627fc700 1 -- 172.21.15.12:0/3574901112 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f585c00ee70 con 0x7f5864103f50 2023-12-11T20:32:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.513+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5864104db0 con 0x7f5864103f50 2023-12-11T20:32:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.513+0000 7f58627fc700 1 -- 172.21.15.12:0/3574901112 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c018400 con 0x7f5864103f50 2023-12-11T20:32:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.513+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58641052c0 con 0x7f5864103f50 2023-12-11T20:32:44.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.518+0000 7f58627fc700 1 -- 172.21.15.12:0/3574901112 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f585c00e9e0 con 0x7f5864103f50 2023-12-11T20:32:44.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.521+0000 7f58627fc700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58500a14f0 0x7f58500a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.523+0000 7f586899b700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58500a14f0 0x7f58500a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.523+0000 7f58627fc700 1 -- 172.21.15.12:0/3574901112 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f585c00f450 con 0x7f5864103f50 2023-12-11T20:32:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.525+0000 7f586899b700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58500a14f0 0x7f58500a39b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5854007a90 tx=0x7f5854006000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.526+0000 7f587e4d6b80 1 Processor -- start 2023-12-11T20:32:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.526+0000 7f587e4d6b80 1 -- start start 2023-12-11T20:32:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.527+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.527+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f18140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.527+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.527+0000 7f586899b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.527+0000 7f586899b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f172f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34204/0 (socket says 172.21.15.12:34204) 2023-12-11T20:32:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.527+0000 7f586899b700 1 -- 172.21.15.12:0/3307743918 learned_addr learned my addr 172.21.15.12:0/3307743918 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.527+0000 7f587e4d6b80 1 -- 172.21.15.12:0/3307743918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927e72af0 con 0x559927f18720 2023-12-11T20:32:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.527+0000 7f586919c700 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f587e4d6b80 1 -- 172.21.15.12:0/3307743918 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927e70410 con 0x559927f17830 2023-12-11T20:32:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f587e4d6b80 1 -- 172.21.15.12:0/3307743918 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927e6bd00 con 0x559927f16ed0 2023-12-11T20:32:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f585bfff700 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f18140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f586899b700 1 -- 172.21.15.12:0/3307743918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 msgr2=0x559927f18140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f586899b700 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f18140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f586899b700 1 -- 172.21.15.12:0/3307743918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 msgr2=0x559927f18ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f586899b700 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f586899b700 1 -- 172.21.15.12:0/3307743918 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559927ce85d0 con 0x559927f16ed0 2023-12-11T20:32:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.528+0000 7f586919c700 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.529+0000 7f586899b700 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f172f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5854000f80 tx=0x7f585401d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad3956d66a18d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.529+0000 7f585affd700 1 -- 172.21.15.12:0/3307743918 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400e040 con 0x559927f16ed0 2023-12-11T20:32:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.529+0000 7f585affd700 1 -- 172.21.15.12:0/3307743918 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5854003e90 con 0x559927f16ed0 2023-12-11T20:32:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.529+0000 7f585affd700 1 -- 172.21.15.12:0/3307743918 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854029bb0 con 0x559927f16ed0 2023-12-11T20:32:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.530+0000 7f587e4d6b80 1 -- 172.21.15.12:0/3307743918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 msgr2=0x559927f172f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.530+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f172f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5854000f80 tx=0x7f585401d000 comp rx=0 tx=0).stop 2023-12-11T20:32:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.530+0000 7f587e4d6b80 1 -- 172.21.15.12:0/3307743918 shutdown_connections 2023-12-11T20:32:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.530+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.530+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f172f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.530+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/3307743918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f18140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.530+0000 7f587e4d6b80 1 -- 172.21.15.12:0/3307743918 >> 172.21.15.12:0/3307743918 conn(0x559927e46780 msgr2=0x559927f13880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.531+0000 7f587e4d6b80 1 -- 172.21.15.12:0/3307743918 shutdown_connections 2023-12-11T20:32:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.531+0000 7f587e4d6b80 1 -- 172.21.15.12:0/3307743918 wait complete. 2023-12-11T20:32:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.532+0000 7f587e4d6b80 1 -- start start 2023-12-11T20:32:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.532+0000 7f587e4d6b80 1 Processor -- start 2023-12-11T20:32:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.533+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f16ed0 0x559927f20e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.533+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f213d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586899b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f16ed0 0x559927f20e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586899b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f16ed0 0x559927f20e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35486/0 (socket says 172.21.15.12:35486) 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586899b700 1 -- 172.21.15.12:0/1309566263 learned_addr learned my addr 172.21.15.12:0/1309566263 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f18720 0x559927f28200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927e25500 con 0x559927f17830 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927e251a0 con 0x559927f16ed0 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927cea8c0 con 0x559927f18720 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f587e4d6b80 10 client.0 _ll_register_callbacks cb 0x559927d50a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586919c700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f18720 0x559927f28200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f585bfff700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586899b700 1 -- 172.21.15.12:0/1309566263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f18720 msgr2=0x559927f28200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586899b700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f18720 0x559927f28200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586899b700 1 -- 172.21.15.12:0/1309566263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 msgr2=0x559927f213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586899b700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586899b700 1 -- 172.21.15.12:0/1309566263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58641052c0 con 0x559927f16ed0 2023-12-11T20:32:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.534+0000 7f586919c700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f18720 0x559927f28200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.535+0000 7f585bfff700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.535+0000 7f586899b700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f16ed0 0x559927f20e90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5854009a20 tx=0x7f5854029480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2658cfc888005417 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.535+0000 7f5843fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.535+0000 7f5843fff700 1 -- 172.21.15.12:0/1309566263 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400bd30 con 0x559927f16ed0 2023-12-11T20:32:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.535+0000 7f5843fff700 1 -- 172.21.15.12:0/1309566263 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f58540298b0 con 0x559927f16ed0 2023-12-11T20:32:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.536+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559927f0a730 con 0x559927f16ed0 2023-12-11T20:32:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.537+0000 7f5843fff700 1 -- 172.21.15.12:0/1309566263 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f585400be90 con 0x559927f16ed0 2023-12-11T20:32:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.538+0000 7f587e4d6b80 10 client.29774 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.538+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f586410c4c0 con 0x559927f16ed0 2023-12-11T20:32:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.538+0000 7f5843fff700 1 -- 172.21.15.12:0/1309566263 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559927f0a730 con 0x559927f16ed0 2023-12-11T20:32:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.540+0000 7f5843fff700 1 -- 172.21.15.12:0/1309566263 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5854005860 con 0x559927f16ed0 2023-12-11T20:32:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.540+0000 7f587e4d6b80 10 client.29774 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.540+0000 7f587e4d6b80 10 client.29774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.540+0000 7f587e4d6b80 20 client.29774 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.541+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559927f2c830 0x559927f2ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.541+0000 7f587e4d6b80 4 client.29774 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.541+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559927ee6ee0 con 0x559927f2c830 2023-12-11T20:32:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.541+0000 7f585bfff700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559927f2c830 0x559927f2ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.542+0000 7f5843fff700 10 client.29774 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.542+0000 7f585bfff700 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559927f2c830 0x559927f2ec20 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f2dd66c97fa348e server_cookie=b494decb610d4fbf in_seq=0 out_seq=0 2023-12-11T20:32:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.543+0000 7f5843fff700 1 -- 172.21.15.12:0/1309566263 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559927ee6ee0 con 0x559927f2c830 2023-12-11T20:32:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.543+0000 7f5843fff700 10 client.29774 handle_command_reply: tid=0 2023-12-11T20:32:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.543+0000 7f587e4d6b80 1 client.29774 shutdown 2023-12-11T20:32:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f16ed0 msgr2=0x559927f20e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f16ed0 0x559927f20e90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5854009a20 tx=0x7f5854029480 comp rx=0 tx=0).stop 2023-12-11T20:32:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 shutdown_connections 2023-12-11T20:32:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559927f2c830 0x559927f2ec20 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f16ed0 0x559927f20e90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f18720 0x559927f28200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f5843fff700 0 client.29774 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/1309566263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.544+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 >> 172.21.15.12:0/1309566263 conn(0x559927e46780 msgr2=0x559927f11ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.545+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 shutdown_connections 2023-12-11T20:32:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.545+0000 7f587e4d6b80 1 -- 172.21.15.12:0/1309566263 wait complete. 2023-12-11T20:32:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.545+0000 7f587e4d6b80 20 client.29774 trim_cache size 0 max 16384 2023-12-11T20:32:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.580+0000 7f587e4d6b80 1 Processor -- start 2023-12-11T20:32:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.581+0000 7f587e4d6b80 1 -- start start 2023-12-11T20:32:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.582+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f28ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.582+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f281c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.582+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.583+0000 7f587e4d6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927f0a700 con 0x559927f18720 2023-12-11T20:32:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.583+0000 7f587e4d6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927f207f0 con 0x559927f17830 2023-12-11T20:32:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.583+0000 7f587e4d6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927f33df0 con 0x559927f16ed0 2023-12-11T20:32:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.583+0000 7f586899b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f28ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.583+0000 7f586919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.584+0000 7f586899b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f28ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34220/0 (socket says 172.21.15.12:34220) 2023-12-11T20:32:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.584+0000 7f586899b700 1 -- 172.21.15.12:0/717807797 learned_addr learned my addr 172.21.15.12:0/717807797 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.583+0000 7f585bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.584+0000 7f585bfff700 1 -- 172.21.15.12:0/717807797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 msgr2=0x559927f28ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.584+0000 7f585bfff700 1 --2- 172.21.15.12:0/717807797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f28ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.584+0000 7f585bfff700 1 -- 172.21.15.12:0/717807797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 msgr2=0x559927f18b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.585+0000 7f585bfff700 1 --2- 172.21.15.12:0/717807797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.585+0000 7f585bfff700 1 -- 172.21.15.12:0/717807797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559927c94d80 con 0x559927f17830 2023-12-11T20:32:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.585+0000 7f586919c700 1 --2- 172.21.15.12:0/717807797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.585+0000 7f585bfff700 1 --2- 172.21.15.12:0/717807797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f281c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x559927f21d30 tx=0x7f584c0138c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9054989f02c4efd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.586+0000 7f585b7fe700 1 -- 172.21.15.12:0/717807797 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c017040 con 0x559927f17830 2023-12-11T20:32:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.586+0000 7f585b7fe700 1 -- 172.21.15.12:0/717807797 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f584c022070 con 0x559927f17830 2023-12-11T20:32:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.586+0000 7f585b7fe700 1 -- 172.21.15.12:0/717807797 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c004550 con 0x559927f17830 2023-12-11T20:32:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.587+0000 7f587e4d6b80 1 -- 172.21.15.12:0/717807797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 msgr2=0x559927f281c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.588+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/717807797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f281c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x559927f21d30 tx=0x7f584c0138c0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.588+0000 7f587e4d6b80 1 -- 172.21.15.12:0/717807797 shutdown_connections 2023-12-11T20:32:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.588+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/717807797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f18720 0x559927f18b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.588+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/717807797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f28ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.588+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/717807797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f17830 0x559927f281c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.588+0000 7f587e4d6b80 1 -- 172.21.15.12:0/717807797 >> 172.21.15.12:0/717807797 conn(0x559927e46780 msgr2=0x559927f1b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.589+0000 7f587e4d6b80 1 -- 172.21.15.12:0/717807797 shutdown_connections 2023-12-11T20:32:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.589+0000 7f587e4d6b80 1 -- 172.21.15.12:0/717807797 wait complete. 2023-12-11T20:32:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.590+0000 7f587e4d6b80 1 -- start start 2023-12-11T20:32:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.590+0000 7f587e4d6b80 1 Processor -- start 2023-12-11T20:32:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.591+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f25cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.591+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f261f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.591+0000 7f587e4d6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f18720 0x559927f27200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.591+0000 7f587e4d6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927f27740 con 0x559927f17830 2023-12-11T20:32:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.591+0000 7f587e4d6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927f278b0 con 0x559927f18720 2023-12-11T20:32:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.591+0000 7f587e4d6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x559927f27a70 con 0x559927f16ed0 2023-12-11T20:32:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.591+0000 7f587e4d6b80 10 client.0 _ll_register_callbacks cb 0x559927d50a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.592+0000 7f586919c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f18720 0x559927f27200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.592+0000 7f586899b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f25cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.592+0000 7f586899b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f25cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:34230/0 (socket says 172.21.15.12:34230) 2023-12-11T20:32:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.592+0000 7f586899b700 1 -- 172.21.15.12:0/365585016 learned_addr learned my addr 172.21.15.12:0/365585016 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.592+0000 7f585bfff700 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f261f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.592+0000 7f586899b700 1 -- 172.21.15.12:0/365585016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f18720 msgr2=0x559927f27200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.592+0000 7f586899b700 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f18720 0x559927f27200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.592+0000 7f586899b700 1 -- 172.21.15.12:0/365585016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 msgr2=0x559927f261f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.593+0000 7f586899b700 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f261f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.593+0000 7f586899b700 1 -- 172.21.15.12:0/365585016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c012050 con 0x559927f16ed0 2023-12-11T20:32:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.593+0000 7f585bfff700 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f261f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.593+0000 7f5843fff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:32:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.593+0000 7f586899b700 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f25cb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5854003de0 tx=0x7f5854012d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eb5669833f11954 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.594+0000 7f5843fff700 1 -- 172.21.15.12:0/365585016 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400e040 con 0x559927f16ed0 2023-12-11T20:32:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.594+0000 7f5843fff700 1 -- 172.21.15.12:0/365585016 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5854012800 con 0x559927f16ed0 2023-12-11T20:32:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.594+0000 7f587e4d6b80 1 -- 172.21.15.12:0/365585016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5854003e90 con 0x559927f16ed0 2023-12-11T20:32:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.596+0000 7f5843fff700 1 -- 172.21.15.12:0/365585016 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f585400e040 con 0x559927f16ed0 2023-12-11T20:32:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.599+0000 7f587e4d6b80 10 client.29782 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.599+0000 7f587e4d6b80 1 -- 172.21.15.12:0/365585016 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559927c7dc00 con 0x559927f16ed0 2023-12-11T20:32:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.599+0000 7f5843fff700 1 -- 172.21.15.12:0/365585016 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5854003e90 con 0x559927f16ed0 2023-12-11T20:32:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.600+0000 7f5843fff700 1 -- 172.21.15.12:0/365585016 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5854029760 con 0x559927f16ed0 2023-12-11T20:32:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.600+0000 7f587e4d6b80 10 client.29782 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.600+0000 7f587e4d6b80 10 client.29782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.600+0000 7f587e4d6b80 20 client.29782 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.600+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559927f83600 0x559927f85a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.600+0000 7f587e4d6b80 4 client.29782 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:32:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.600+0000 7f587e4d6b80 1 -- 172.21.15.12:0/365585016 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559927e31f70 con 0x559927f83600 2023-12-11T20:32:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.601+0000 7f585bfff700 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559927f83600 0x559927f85a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.602+0000 7f585bfff700 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559927f83600 0x559927f85a20 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19a404fe57f80905 server_cookie=36ab8faf981f129b in_seq=0 out_seq=0 2023-12-11T20:32:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.602+0000 7f5843fff700 10 client.29782 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:44.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.620+0000 7f5843fff700 1 -- 172.21.15.12:0/365585016 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559927e31f70 con 0x559927f83600 2023-12-11T20:32:44.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.620+0000 7f5843fff700 10 client.29782 handle_command_reply: tid=0 2023-12-11T20:32:44.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.620+0000 7f587e4d6b80 1 client.29782 shutdown 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.620+0000 7f587e4d6b80 1 -- 172.21.15.12:0/365585016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 msgr2=0x559927f25cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f25cb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5854003de0 tx=0x7f5854012d30 comp rx=0 tx=0).stop 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 -- 172.21.15.12:0/365585016 shutdown_connections 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559927f83600 0x559927f85a20 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559927f18720 0x559927f27200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559927f16ed0 0x559927f25cb0 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5854003de0 tx=0x7f5854012d30 comp rx=0 tx=0).stop 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 --2- 172.21.15.12:0/365585016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559927f17830 0x559927f261f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 -- 172.21.15.12:0/365585016 >> 172.21.15.12:0/365585016 conn(0x559927e46780 msgr2=0x559927f1b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f5843fff700 0 client.29782 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 -- 172.21.15.12:0/365585016 shutdown_connections 2023-12-11T20:32:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.621+0000 7f587e4d6b80 1 -- 172.21.15.12:0/365585016 wait complete. 2023-12-11T20:32:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.622+0000 7f587e4d6b80 20 client.29782 trim_cache size 0 max 16384 2023-12-11T20:32:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:32:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:32:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:32:44.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:32:44.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58500a14f0 msgr2=0x7f58500a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58500a14f0 0x7f58500a39b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5854007a90 tx=0x7f5854006000 comp rx=0 tx=0).stop 2023-12-11T20:32:44.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5864103f50 msgr2=0x7f58641043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:44.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5864103f50 0x7f58641043d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f585c00c970 tx=0x7f585c00cc80 comp rx=0 tx=0).stop 2023-12-11T20:32:44.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 shutdown_connections 2023-12-11T20:32:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f58500a14f0 0x7f58500a39b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5864100690 0x7f5864070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5864103f50 0x7f58641043d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 --2- 172.21.15.12:0/3574901112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5864101050 0x7f58640706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 >> 172.21.15.12:0/3574901112 conn(0x7f58640fb930 msgr2=0x7f58640fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 shutdown_connections 2023-12-11T20:32:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:44.623+0000 7f586abff700 1 -- 172.21.15.12:0/3574901112 wait complete. 2023-12-11T20:32:44.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:44 smithi012 ceph-mon[128787]: pgmap v879: 97 pgs: 97 active+clean; 13 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:32:44.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:44 smithi032 ceph-mon[132488]: pgmap v879: 97 pgs: 97 active+clean; 13 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:32:45.054 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:44 smithi039 ceph-mon[102205]: pgmap v879: 97 pgs: 97 active+clean; 13 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:32:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:46 smithi012 ceph-mon[128787]: pgmap v880: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 19 MiB/s wr, 4.90k op/s 2023-12-11T20:32:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:46 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:32:46.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:46 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:32:46.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:46 smithi032 ceph-mon[132488]: pgmap v880: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 19 MiB/s wr, 4.90k op/s 2023-12-11T20:32:46.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:46 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:32:46.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:46 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:32:47.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:46 smithi039 ceph-mon[102205]: pgmap v880: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 19 MiB/s wr, 4.90k op/s 2023-12-11T20:32:47.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:46 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:32:47.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:46 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:32:47.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:47 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:32:47.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:47 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:32:48.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:47 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:32:48.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:48 smithi012 ceph-mon[128787]: pgmap v881: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 5.16k op/s 2023-12-11T20:32:48.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:48 smithi032 ceph-mon[132488]: pgmap v881: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 5.16k op/s 2023-12-11T20:32:49.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:48 smithi039 ceph-mon[102205]: pgmap v881: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 5.16k op/s 2023-12-11T20:32:50.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:50 smithi012 ceph-mon[128787]: pgmap v882: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.68k op/s 2023-12-11T20:32:50.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:50 smithi032 ceph-mon[132488]: pgmap v882: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.68k op/s 2023-12-11T20:32:51.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:50 smithi039 ceph-mon[102205]: pgmap v882: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.68k op/s 2023-12-11T20:32:52.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:52 smithi032 ceph-mon[132488]: pgmap v883: 97 pgs: 97 active+clean; 13 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2023-12-11T20:32:53.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:52 smithi039 ceph-mon[102205]: pgmap v883: 97 pgs: 97 active+clean; 13 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2023-12-11T20:32:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:52 smithi012 ceph-mon[128787]: pgmap v883: 97 pgs: 97 active+clean; 13 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 5.00k op/s 2023-12-11T20:32:54.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:54 smithi032 ceph-mon[132488]: pgmap v884: 97 pgs: 97 active+clean; 13 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.56k op/s 2023-12-11T20:32:55.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:54 smithi039 ceph-mon[102205]: pgmap v884: 97 pgs: 97 active+clean; 13 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.56k op/s 2023-12-11T20:32:55.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:54 smithi012 ceph-mon[128787]: pgmap v884: 97 pgs: 97 active+clean; 13 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.56k op/s 2023-12-11T20:32:56.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:56 smithi032 ceph-mon[132488]: pgmap v885: 97 pgs: 97 active+clean; 13 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:32:57.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:56 smithi039 ceph-mon[102205]: pgmap v885: 97 pgs: 97 active+clean; 13 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:32:57.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:56 smithi012 ceph-mon[128787]: pgmap v885: 97 pgs: 97 active+clean; 13 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:32:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.034+0000 7fc3f49fe700 1 -- 172.21.15.12:0/4094371389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e8096fc0 msgr2=0x7fc3e8097420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.034+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/4094371389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e8096fc0 0x7fc3e8097420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40098f0 tx=0x7fc3e4009c00 comp rx=0 tx=0).stop 2023-12-11T20:32:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.034+0000 7fc3f49fe700 1 -- 172.21.15.12:0/4094371389 shutdown_connections 2023-12-11T20:32:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.034+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/4094371389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3e8097960 0x7fc3e809e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.034+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/4094371389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8095dd0 0x7fc3e80961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.034+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/4094371389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e8096fc0 0x7fc3e8097420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.034+0000 7fc3f49fe700 1 -- 172.21.15.12:0/4094371389 >> 172.21.15.12:0/4094371389 conn(0x7fc3e8091340 msgr2=0x7fc3e8093780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.034+0000 7fc3f49fe700 1 -- 172.21.15.12:0/4094371389 shutdown_connections 2023-12-11T20:32:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.035+0000 7fc3f49fe700 1 -- 172.21.15.12:0/4094371389 wait complete. 2023-12-11T20:32:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.039+0000 7fc3f49fe700 1 Processor -- start 2023-12-11T20:32:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.039+0000 7fc3f49fe700 1 -- start start 2023-12-11T20:32:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.039+0000 7fc3f49fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8095dd0 0x7fc3e8132340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.039+0000 7fc3f49fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3e8096fc0 0x7fc3e8132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3f49fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e8097960 0x7fc3e81398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3f49fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8139e70 con 0x7fc3e8095dd0 2023-12-11T20:32:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3f49fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8139fb0 con 0x7fc3e8096fc0 2023-12-11T20:32:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3f49fe700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e813a140 con 0x7fc3e8097960 2023-12-11T20:32:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3e8096fc0 0x7fc3e8132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3e8096fc0 0x7fc3e8132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:55722/0 (socket says 172.21.15.12:55722) 2023-12-11T20:32:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3ee59c700 1 -- 172.21.15.12:0/2801724757 learned_addr learned my addr 172.21.15.12:0/2801724757 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e8097960 0x7fc3e81398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.040+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8095dd0 0x7fc3e8132340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.041+0000 7fc3eed9d700 1 -- 172.21.15.12:0/2801724757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e8097960 msgr2=0x7fc3e81398a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.041+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e8097960 0x7fc3e81398a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.041+0000 7fc3eed9d700 1 -- 172.21.15.12:0/2801724757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3e8096fc0 msgr2=0x7fc3e8132880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.041+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3e8096fc0 0x7fc3e8132880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.041+0000 7fc3eed9d700 1 -- 172.21.15.12:0/2801724757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4009520 con 0x7fc3e8095dd0 2023-12-11T20:32:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.042+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8095dd0 0x7fc3e8132340 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000d740 tx=0x7fc3e000da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.042+0000 7fc3d7fff700 1 -- 172.21.15.12:0/2801724757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0004440 con 0x7fc3e8095dd0 2023-12-11T20:32:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.042+0000 7fc3f49fe700 1 -- 172.21.15.12:0/2801724757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e813a420 con 0x7fc3e8095dd0 2023-12-11T20:32:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.043+0000 7fc3f49fe700 1 -- 172.21.15.12:0/2801724757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e813a980 con 0x7fc3e8095dd0 2023-12-11T20:32:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.043+0000 7fc3d7fff700 1 -- 172.21.15.12:0/2801724757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3e0003b10 con 0x7fc3e8095dd0 2023-12-11T20:32:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.043+0000 7fc3d7fff700 1 -- 172.21.15.12:0/2801724757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000fb90 con 0x7fc3e8095dd0 2023-12-11T20:32:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.048+0000 7fc3d7fff700 1 -- 172.21.15.12:0/2801724757 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc3e000fcf0 con 0x7fc3e8095dd0 2023-12-11T20:32:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.050+0000 7fc408a69b80 1 Processor -- start 2023-12-11T20:32:58.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.051+0000 7fc408a69b80 1 -- start start 2023-12-11T20:32:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.051+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cc9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.051+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.051+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cceb80 0x55e772cd0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.051+0000 7fc408a69b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772c24af0 con 0x55e772cc9770 2023-12-11T20:32:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.051+0000 7fc408a69b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772c22410 con 0x55e772cceb80 2023-12-11T20:32:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.051+0000 7fc408a69b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772c1dd00 con 0x55e772cca0d0 2023-12-11T20:32:58.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cceb80 0x55e772cd0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ef59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cc9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cceb80 0x55e772cd0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:55734/0 (socket says 172.21.15.12:55734) 2023-12-11T20:32:58.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 -- 172.21.15.12:0/735452758 learned_addr learned my addr 172.21.15.12:0/735452758 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/735452758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 -- 172.21.15.12:0/735452758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 msgr2=0x55e772cce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/735452758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 -- 172.21.15.12:0/735452758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 msgr2=0x55e772cc9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/735452758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cc9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 -- 172.21.15.12:0/735452758 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e772a9a5d0 con 0x55e772cceb80 2023-12-11T20:32:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.052+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/735452758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cceb80 0x55e772cd0f90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005c30 tx=0x7fc3e40056a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc7610f1850d268 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.053+0000 7fc3d7fff700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3d80a1500 0x7fc3d80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.053+0000 7fc3d57fa700 1 -- 172.21.15.12:0/735452758 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e401c070 con 0x55e772cceb80 2023-12-11T20:32:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.053+0000 7fc3d57fa700 1 -- 172.21.15.12:0/735452758 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3e4005110 con 0x55e772cceb80 2023-12-11T20:32:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.053+0000 7fc3d57fa700 1 -- 172.21.15.12:0/735452758 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400bad0 con 0x55e772cceb80 2023-12-11T20:32:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.053+0000 7fc3d7fff700 1 -- 172.21.15.12:0/2801724757 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc3e00cccb0 con 0x7fc3e8095dd0 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.053+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3d80a1500 0x7fc3d80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 -- 172.21.15.12:0/735452758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cceb80 msgr2=0x55e772cd0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 --2- 172.21.15.12:0/735452758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cceb80 0x55e772cd0f90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005c30 tx=0x7fc3e40056a0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3d80a1500 0x7fc3d80a39c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0050880 tx=0x7fc3f0069040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 -- 172.21.15.12:0/735452758 shutdown_connections 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 --2- 172.21.15.12:0/735452758 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cceb80 0x55e772cd0f90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 --2- 172.21.15.12:0/735452758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cc9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 --2- 172.21.15.12:0/735452758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 -- 172.21.15.12:0/735452758 >> 172.21.15.12:0/735452758 conn(0x55e772bf8780 msgr2=0x55e772cc5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:58.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 -- 172.21.15.12:0/735452758 shutdown_connections 2023-12-11T20:32:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.054+0000 7fc408a69b80 1 -- 172.21.15.12:0/735452758 wait complete. 2023-12-11T20:32:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.055+0000 7fc408a69b80 1 -- start start 2023-12-11T20:32:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.055+0000 7fc408a69b80 1 Processor -- start 2023-12-11T20:32:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.057+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cc9770 0x55e772cd2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.057+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.057+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cda390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.058+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.058+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:55744/0 (socket says 172.21.15.12:55744) 2023-12-11T20:32:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.058+0000 7fc3ef59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cda390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.058+0000 7fc3ef59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cda390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41754/0 (socket says 172.21.15.12:41754) 2023-12-11T20:32:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.059+0000 7fc3eed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cc9770 0x55e772cd2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.059+0000 7fc3ee59c700 1 -- 172.21.15.12:0/3986067359 learned_addr learned my addr 172.21.15.12:0/3986067359 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.059+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772bd7500 con 0x55e772cceb80 2023-12-11T20:32:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.059+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772bd71a0 con 0x55e772cca0d0 2023-12-11T20:32:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.060+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772a9c8c0 con 0x55e772cc9770 2023-12-11T20:32:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.060+0000 7fc408a69b80 10 client.0 _ll_register_callbacks cb 0x55e772b02a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.060+0000 7fc3ee59c700 1 -- 172.21.15.12:0/3986067359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cc9770 msgr2=0x55e772cd2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.060+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cc9770 0x55e772cd2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.060+0000 7fc3ee59c700 1 -- 172.21.15.12:0/3986067359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 msgr2=0x55e772cda390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.060+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cda390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.060+0000 7fc3ee59c700 1 -- 172.21.15.12:0/3986067359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e809eb60 con 0x55e772cca0d0 2023-12-11T20:32:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.061+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cc9770 0x55e772cd2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.061+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cda390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.061+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd3350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400f800 tx=0x7fc3e400f830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=619f557dc0cf9b28 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.061+0000 7fc3d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:32:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.061+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3986067359 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e401c030 con 0x55e772cca0d0 2023-12-11T20:32:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.062+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3986067359 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc3e4003880 con 0x55e772cca0d0 2023-12-11T20:32:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.062+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e772cbc730 con 0x55e772cca0d0 2023-12-11T20:32:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.062+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3986067359 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3e400bca0 con 0x55e772cca0d0 2023-12-11T20:32:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.062+0000 7fc408a69b80 10 client.29792 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.062+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e772a46d80 con 0x55e772cca0d0 2023-12-11T20:32:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.063+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3986067359 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3e4032080 con 0x55e772cca0d0 2023-12-11T20:32:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.063+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3986067359 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc3e4015020 con 0x55e772cca0d0 2023-12-11T20:32:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.063+0000 7fc408a69b80 10 client.29792 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.063+0000 7fc408a69b80 10 client.29792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.063+0000 7fc408a69b80 20 client.29792 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.064+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e772cde760 0x55e772ce0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.064+0000 7fc408a69b80 4 client.29792 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:32:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.064+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e772c98ee0 con 0x55e772cde760 2023-12-11T20:32:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.065+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e772cde760 0x55e772ce0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.065+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e772cde760 0x55e772ce0b50 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67323aec88ae435 server_cookie=2c72017aafb6cdcc in_seq=0 out_seq=0 2023-12-11T20:32:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.066+0000 7fc3d2ff5700 10 client.29792 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.066+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3986067359 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e772c98ee0 con 0x55e772cde760 2023-12-11T20:32:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.066+0000 7fc3d2ff5700 10 client.29792 handle_command_reply: tid=0 2023-12-11T20:32:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.066+0000 7fc408a69b80 1 client.29792 shutdown 2023-12-11T20:32:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.067+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 msgr2=0x55e772cd3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.067+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd3350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400f800 tx=0x7fc3e400f830 comp rx=0 tx=0).stop 2023-12-11T20:32:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.068+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 shutdown_connections 2023-12-11T20:32:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.068+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e772cde760 0x55e772ce0b50 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.068+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cda390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.068+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cc9770 0x55e772cd2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.068+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3986067359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd3350 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.068+0000 7fc3d2ff5700 0 client.29792 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.068+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 >> 172.21.15.12:0/3986067359 conn(0x55e772bf8780 msgr2=0x55e772cc6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.069+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 shutdown_connections 2023-12-11T20:32:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.070+0000 7fc408a69b80 1 -- 172.21.15.12:0/3986067359 wait complete. 2023-12-11T20:32:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.070+0000 7fc408a69b80 20 client.29792 trim_cache size 0 max 16384 2023-12-11T20:32:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.106+0000 7fc408a69b80 1 Processor -- start 2023-12-11T20:32:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.106+0000 7fc408a69b80 1 -- start start 2023-12-11T20:32:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cc9770 0x55e772cd0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cda350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc408a69b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772cd3cb0 con 0x55e772cceb80 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc408a69b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772cbef30 con 0x55e772cc9770 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc408a69b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772cd3a90 con 0x55e772cca0d0 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc3eed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cc9770 0x55e772cd0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cda350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc3ee59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cda350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:38624/0 (socket says 172.21.15.12:38624) 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc3ee59c700 1 -- 172.21.15.12:0/2288957488 learned_addr learned my addr 172.21.15.12:0/2288957488 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.107+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.108+0000 7fc3ee59c700 1 -- 172.21.15.12:0/2288957488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cc9770 msgr2=0x55e772cd0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.108+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cc9770 0x55e772cd0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.109+0000 7fc3ee59c700 1 -- 172.21.15.12:0/2288957488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 msgr2=0x55e772cce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.109+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.109+0000 7fc3ee59c700 1 -- 172.21.15.12:0/2288957488 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e772a2fc00 con 0x55e772cca0d0 2023-12-11T20:32:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.109+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:32:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.109+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cda350 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4021440 tx=0x7fc3e4005050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a9e107b9422e3b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.110+0000 7fc3d5ffb700 1 -- 172.21.15.12:0/2288957488 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e401c070 con 0x55e772cca0d0 2023-12-11T20:32:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.110+0000 7fc3d5ffb700 1 -- 172.21.15.12:0/2288957488 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3e4057070 con 0x55e772cca0d0 2023-12-11T20:32:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.111+0000 7fc3d5ffb700 1 -- 172.21.15.12:0/2288957488 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40218e0 con 0x55e772cca0d0 2023-12-11T20:32:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.111+0000 7fc408a69b80 1 -- 172.21.15.12:0/2288957488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 msgr2=0x55e772cda350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.111+0000 7fc408a69b80 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cda350 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4021440 tx=0x7fc3e4005050 comp rx=0 tx=0).stop 2023-12-11T20:32:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.112+0000 7fc408a69b80 1 -- 172.21.15.12:0/2288957488 shutdown_connections 2023-12-11T20:32:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.112+0000 7fc408a69b80 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cc9770 0x55e772cd0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.112+0000 7fc408a69b80 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cceb80 0x55e772cce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.112+0000 7fc408a69b80 1 --2- 172.21.15.12:0/2288957488 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cca0d0 0x55e772cda350 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.112+0000 7fc408a69b80 1 -- 172.21.15.12:0/2288957488 >> 172.21.15.12:0/2288957488 conn(0x55e772bf8780 msgr2=0x55e772cc4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.112+0000 7fc408a69b80 1 -- 172.21.15.12:0/2288957488 shutdown_connections 2023-12-11T20:32:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.113+0000 7fc408a69b80 1 -- 172.21.15.12:0/2288957488 wait complete. 2023-12-11T20:32:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.113+0000 7fc408a69b80 1 -- start start 2023-12-11T20:32:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.114+0000 7fc408a69b80 1 Processor -- start 2023-12-11T20:32:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.116+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cd79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.116+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.116+0000 7fc408a69b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cceb80 0x55e772cd8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc408a69b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772cd9460 con 0x55e772cc9770 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc408a69b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772cd95d0 con 0x55e772cca0d0 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc408a69b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e772cd9790 con 0x55e772cceb80 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc408a69b80 10 client.0 _ll_register_callbacks cb 0x55e772b02a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3ef59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cceb80 0x55e772cd8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3ef59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cceb80 0x55e772cd8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:38638/0 (socket says 172.21.15.12:38638) 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3ef59e700 1 -- 172.21.15.12:0/3650213802 learned_addr learned my addr 172.21.15.12:0/3650213802 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cd79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3ef59e700 1 -- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 msgr2=0x55e772cd7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3ef59e700 1 -- 172.21.15.12:0/3650213802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 msgr2=0x55e772cd79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.117+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cd79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.118+0000 7fc3ef59e700 1 -- 172.21.15.12:0/3650213802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f007f440 con 0x55e772cceb80 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.118+0000 7fc3ee59c700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.118+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cd79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.119+0000 7fc3ef59e700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cceb80 0x55e772cd8f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc3f004fd10 tx=0x7fc3f00678d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d7f4597e7a3aa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.118+0000 7fc3d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.119+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3650213802 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f007fe20 con 0x55e772cceb80 2023-12-11T20:32:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.119+0000 7fc408a69b80 1 -- 172.21.15.12:0/3650213802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3e4005110 con 0x55e772cceb80 2023-12-11T20:32:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.119+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3650213802 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc3f007de50 con 0x55e772cceb80 2023-12-11T20:32:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.120+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3650213802 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3f00733c0 con 0x55e772cceb80 2023-12-11T20:32:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.121+0000 7fc408a69b80 10 client.29800 fetch_fsmap learned FSMap version 36 2023-12-11T20:32:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.121+0000 7fc408a69b80 1 -- 172.21.15.12:0/3650213802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e772a46d80 con 0x55e772cceb80 2023-12-11T20:32:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.121+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3650213802 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3e4005110 con 0x55e772cceb80 2023-12-11T20:32:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.122+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3650213802 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc3f0072040 con 0x55e772cceb80 2023-12-11T20:32:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.122+0000 7fc408a69b80 10 client.29800 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:32:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.122+0000 7fc408a69b80 10 client.29800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:32:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.122+0000 7fc408a69b80 20 client.29800 populate_metadata read hostname 'smithi012' 2023-12-11T20:32:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.122+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e772d35570 0x55e772d37990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:32:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.122+0000 7fc408a69b80 4 client.29800 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:32:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.122+0000 7fc408a69b80 1 -- 172.21.15.12:0/3650213802 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e772be3f70 con 0x55e772d35570 2023-12-11T20:32:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.124+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e772d35570 0x55e772d37990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:32:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.125+0000 7fc3eed9d700 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e772d35570 0x55e772d37990 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1da6eeb6fe9fa52 server_cookie=c68003c8e2f40d8e in_seq=0 out_seq=0 2023-12-11T20:32:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.125+0000 7fc3d2ff5700 10 client.29800 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.143+0000 7fc3d2ff5700 1 -- 172.21.15.12:0/3650213802 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e772be3f70 con 0x55e772d35570 2023-12-11T20:32:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.143+0000 7fc3d2ff5700 10 client.29800 handle_command_reply: tid=0 2023-12-11T20:32:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.143+0000 7fc408a69b80 1 client.29800 shutdown 2023-12-11T20:32:58.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 -- 172.21.15.12:0/3650213802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cceb80 msgr2=0x55e772cd8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cceb80 0x55e772cd8f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc3f004fd10 tx=0x7fc3f00678d0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 -- 172.21.15.12:0/3650213802 shutdown_connections 2023-12-11T20:32:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55e772d35570 0x55e772d37990 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e772cceb80 0x55e772cd8f20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e772cc9770 0x55e772cd79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 --2- 172.21.15.12:0/3650213802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55e772cca0d0 0x55e772cd7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 -- 172.21.15.12:0/3650213802 >> 172.21.15.12:0/3650213802 conn(0x55e772bf8780 msgr2=0x55e772ccae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc3d2ff5700 0 client.29800 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:32:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.145+0000 7fc408a69b80 1 -- 172.21.15.12:0/3650213802 shutdown_connections 2023-12-11T20:32:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.146+0000 7fc408a69b80 1 -- 172.21.15.12:0/3650213802 wait complete. 2023-12-11T20:32:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.146+0000 7fc408a69b80 20 client.29800 trim_cache size 0 max 16384 2023-12-11T20:32:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:32:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:32:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:32:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:32:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.147+0000 7fc3f49fe700 1 -- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3d80a1500 msgr2=0x7fc3d80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.147+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3d80a1500 0x7fc3d80a39c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0050880 tx=0x7fc3f0069040 comp rx=0 tx=0).stop 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.147+0000 7fc3f49fe700 1 -- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8095dd0 msgr2=0x7fc3e8132340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.147+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8095dd0 0x7fc3e8132340 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000d740 tx=0x7fc3e000da50 comp rx=0 tx=0).stop 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.148+0000 7fc3f49fe700 1 -- 172.21.15.12:0/2801724757 shutdown_connections 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.148+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc3d80a1500 0x7fc3d80a39c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.148+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e8097960 0x7fc3e81398a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.148+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8095dd0 0x7fc3e8132340 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.148+0000 7fc3f49fe700 1 --2- 172.21.15.12:0/2801724757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3e8096fc0 0x7fc3e8132880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.148+0000 7fc3f49fe700 1 -- 172.21.15.12:0/2801724757 >> 172.21.15.12:0/2801724757 conn(0x7fc3e8091340 msgr2=0x7fc3e809c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:32:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.148+0000 7fc3f49fe700 1 -- 172.21.15.12:0/2801724757 shutdown_connections 2023-12-11T20:32:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:32:58.148+0000 7fc3f49fe700 1 -- 172.21.15.12:0/2801724757 wait complete. 2023-12-11T20:32:58.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:32:58 smithi032 ceph-mon[132488]: pgmap v886: 97 pgs: 97 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 5.25k op/s 2023-12-11T20:32:59.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:32:58 smithi039 ceph-mon[102205]: pgmap v886: 97 pgs: 97 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 5.25k op/s 2023-12-11T20:32:59.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:32:58 smithi012 ceph-mon[128787]: pgmap v886: 97 pgs: 97 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 5.25k op/s 2023-12-11T20:33:00.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:00 smithi032 ceph-mon[132488]: pgmap v887: 97 pgs: 97 active+clean; 13 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.78k op/s 2023-12-11T20:33:01.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:00 smithi039 ceph-mon[102205]: pgmap v887: 97 pgs: 97 active+clean; 13 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.78k op/s 2023-12-11T20:33:01.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:00 smithi012 ceph-mon[128787]: pgmap v887: 97 pgs: 97 active+clean; 13 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.78k op/s 2023-12-11T20:33:02.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:33:02.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:02 smithi032 ceph-mon[132488]: pgmap v888: 97 pgs: 97 active+clean; 13 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2023-12-11T20:33:03.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:02 smithi039 ceph-mon[102205]: pgmap v888: 97 pgs: 97 active+clean; 13 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2023-12-11T20:33:03.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:02 smithi012 ceph-mon[128787]: pgmap v888: 97 pgs: 97 active+clean; 13 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2023-12-11T20:33:04.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:04 smithi032 ceph-mon[132488]: pgmap v889: 97 pgs: 97 active+clean; 13 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.59k op/s 2023-12-11T20:33:05.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:04 smithi039 ceph-mon[102205]: pgmap v889: 97 pgs: 97 active+clean; 13 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.59k op/s 2023-12-11T20:33:05.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:04 smithi012 ceph-mon[128787]: pgmap v889: 97 pgs: 97 active+clean; 13 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.59k op/s 2023-12-11T20:33:06.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:06 smithi032 ceph-mon[132488]: pgmap v890: 97 pgs: 97 active+clean; 13 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.89k op/s 2023-12-11T20:33:07.054 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:06 smithi039 ceph-mon[102205]: pgmap v890: 97 pgs: 97 active+clean; 13 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.89k op/s 2023-12-11T20:33:07.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:06 smithi012 ceph-mon[128787]: pgmap v890: 97 pgs: 97 active+clean; 13 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.89k op/s 2023-12-11T20:33:08.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.101+0000 7f52d4fff700 1 -- 172.21.15.12:0/2386941163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d01006d0 msgr2=0x7f52d0100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.101+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2386941163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d01006d0 0x7f52d0100b50 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009990 tx=0x7f52b8009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.101+0000 7f52d4fff700 1 -- 172.21.15.12:0/2386941163 shutdown_connections 2023-12-11T20:33:08.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.101+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2386941163 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d0101090 0x7f52d0101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.101+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2386941163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d00ffd70 0x7f52d0100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.101+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2386941163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d01006d0 0x7f52d0100b50 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.101+0000 7f52d4fff700 1 -- 172.21.15.12:0/2386941163 >> 172.21.15.12:0/2386941163 conn(0x7f52d00fb930 msgr2=0x7f52d00fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:08.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.102+0000 7f52d4fff700 1 -- 172.21.15.12:0/2386941163 shutdown_connections 2023-12-11T20:33:08.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.102+0000 7f52d4fff700 1 -- 172.21.15.12:0/2386941163 wait complete. 2023-12-11T20:33:08.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.104+0000 7f52d4fff700 1 Processor -- start 2023-12-11T20:33:08.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.104+0000 7f52d4fff700 1 -- start start 2023-12-11T20:33:08.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52d4fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d00ffd70 0x7f52d019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52d4fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d01006d0 0x7f52d019dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52d4fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d0101090 0x7f52d01a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52d4fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d01a54b0 con 0x7f52d0101090 2023-12-11T20:33:08.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52d4fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d01a55f0 con 0x7f52d01006d0 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52d4fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d01a5780 con 0x7f52d00ffd70 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52ce59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d00ffd70 0x7f52d019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52ce59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d00ffd70 0x7f52d019d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50026/0 (socket says 172.21.15.12:50026) 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52ce59c700 1 -- 172.21.15.12:0/2089821797 learned_addr learned my addr 172.21.15.12:0/2089821797 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52c5d9b700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d01006d0 0x7f52d019dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.105+0000 7f52ced9d700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d0101090 0x7f52d01a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.106+0000 7f52ce59c700 1 -- 172.21.15.12:0/2089821797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d01006d0 msgr2=0x7f52d019dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.106+0000 7f52ce59c700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d01006d0 0x7f52d019dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.106+0000 7f52ce59c700 1 -- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d0101090 msgr2=0x7f52d01a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.106+0000 7f52ce59c700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d0101090 0x7f52d01a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.106+0000 7f52ce59c700 1 -- 172.21.15.12:0/2089821797 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b80095f0 con 0x7f52d00ffd70 2023-12-11T20:33:08.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.106+0000 7f52ce59c700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d00ffd70 0x7f52d019d980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52c000ef10 tx=0x7f52c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:08.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.106+0000 7f52c7fff700 1 -- 172.21.15.12:0/2089821797 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000ca70 con 0x7f52d00ffd70 2023-12-11T20:33:08.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.107+0000 7f52c7fff700 1 -- 172.21.15.12:0/2089821797 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52c000f040 con 0x7f52d00ffd70 2023-12-11T20:33:08.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.107+0000 7f52d4fff700 1 -- 172.21.15.12:0/2089821797 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d01a5a00 con 0x7f52d00ffd70 2023-12-11T20:33:08.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.107+0000 7f52c7fff700 1 -- 172.21.15.12:0/2089821797 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0014480 con 0x7f52d00ffd70 2023-12-11T20:33:08.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.107+0000 7f52d4fff700 1 -- 172.21.15.12:0/2089821797 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d01a5f60 con 0x7f52d00ffd70 2023-12-11T20:33:08.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.114+0000 7f52e88c7b80 1 Processor -- start 2023-12-11T20:33:08.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.114+0000 7f52e88c7b80 1 -- start start 2023-12-11T20:33:08.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.115+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622b3d0 0x56439622b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.115+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x56439622c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.115+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x56439622d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.115+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564396186b50 con 0x56439622cc20 2023-12-11T20:33:08.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.115+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564396184470 con 0x56439622bd30 2023-12-11T20:33:08.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.115+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56439617fd60 con 0x56439622b3d0 2023-12-11T20:33:08.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.115+0000 7f52ced9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622b3d0 0x56439622b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.116+0000 7f52ced9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622b3d0 0x56439622b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50028/0 (socket says 172.21.15.12:50028) 2023-12-11T20:33:08.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.116+0000 7f52ced9d700 1 -- 172.21.15.12:0/3847416465 learned_addr learned my addr 172.21.15.12:0/3847416465 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:08.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.116+0000 7f52c5d9b700 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x56439622d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.117+0000 7f52c7fff700 1 -- 172.21.15.12:0/2089821797 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f52c0007500 con 0x7f52d00ffd70 2023-12-11T20:33:08.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.117+0000 7f52ce59c700 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x56439622c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.117+0000 7f52ced9d700 1 -- 172.21.15.12:0/3847416465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 msgr2=0x56439622c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:08.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.117+0000 7f52ced9d700 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x56439622c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.117+0000 7f52ced9d700 1 -- 172.21.15.12:0/3847416465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 msgr2=0x56439622d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:08.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.117+0000 7f52ced9d700 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x56439622d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.117+0000 7f52ced9d700 1 -- 172.21.15.12:0/3847416465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564395ffc630 con 0x56439622b3d0 2023-12-11T20:33:08.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.118+0000 7f52ce59c700 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x56439622c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:08.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.118+0000 7f52c5d9b700 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x56439622d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:08.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.118+0000 7f52ced9d700 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622b3d0 0x56439622b7f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f52c800cbe0 tx=0x7f52c800cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13e11246eb69f391 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:08.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.118+0000 7f52c4d99700 1 -- 172.21.15.12:0/3847416465 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800ed10 con 0x56439622b3d0 2023-12-11T20:33:08.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.118+0000 7f52c4d99700 1 -- 172.21.15.12:0/3847416465 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52c800ee70 con 0x56439622b3d0 2023-12-11T20:33:08.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.118+0000 7f52c4d99700 1 -- 172.21.15.12:0/3847416465 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8010430 con 0x56439622b3d0 2023-12-11T20:33:08.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.119+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3847416465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622b3d0 msgr2=0x56439622b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.119+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622b3d0 0x56439622b7f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f52c800cbe0 tx=0x7f52c800cef0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.119+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3847416465 shutdown_connections 2023-12-11T20:33:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.120+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x56439622d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.120+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622b3d0 0x56439622b7f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.120+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3847416465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x56439622c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.120+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3847416465 >> 172.21.15.12:0/3847416465 conn(0x56439615a7e0 msgr2=0x564396227d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.120+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3847416465 shutdown_connections 2023-12-11T20:33:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.120+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3847416465 wait complete. 2023-12-11T20:33:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.121+0000 7f52e88c7b80 1 -- start start 2023-12-11T20:33:08.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.121+0000 7f52c7fff700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52bc0a1490 0x7f52bc0a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.121+0000 7f52c7fff700 1 -- 172.21.15.12:0/2089821797 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f52c00cd090 con 0x7f52d00ffd70 2023-12-11T20:33:08.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.122+0000 7f52e88c7b80 1 Processor -- start 2023-12-11T20:33:08.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.122+0000 7f52ced9d700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52bc0a1490 0x7f52bc0a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.124+0000 7f52ced9d700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52bc0a1490 0x7f52bc0a3950 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f52c8005f00 tx=0x7f52c8005d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.124+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x5643962351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.124+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x5643962356e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.124+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622cc20 0x56439623c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.125+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564396139560 con 0x56439622b3d0 2023-12-11T20:33:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.125+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564396139200 con 0x56439622bd30 2023-12-11T20:33:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.125+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564395ffe920 con 0x56439622cc20 2023-12-11T20:33:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.125+0000 7f52e88c7b80 10 client.0 _ll_register_callbacks cb 0x564396064a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.125+0000 7f52c5d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x5643962356e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.125+0000 7f52ced9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622cc20 0x56439623c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.126+0000 7f52ced9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622cc20 0x56439623c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50030/0 (socket says 172.21.15.12:50030) 2023-12-11T20:33:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.126+0000 7f52ced9d700 1 -- 172.21.15.12:0/3457358913 learned_addr learned my addr 172.21.15.12:0/3457358913 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:08.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.126+0000 7f52ce59c700 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x5643962351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.127+0000 7f52c5d9b700 1 -- 172.21.15.12:0/3457358913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622cc20 msgr2=0x56439623c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:08.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.127+0000 7f52c5d9b700 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622cc20 0x56439623c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.127+0000 7f52c5d9b700 1 -- 172.21.15.12:0/3457358913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 msgr2=0x5643962351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:08.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.127+0000 7f52c5d9b700 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x5643962351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.127+0000 7f52c5d9b700 1 -- 172.21.15.12:0/3457358913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d010c500 con 0x56439622bd30 2023-12-11T20:33:08.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.127+0000 7f52ce59c700 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x5643962351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.128+0000 7f52c5d9b700 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x5643962356e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f52b8006010 tx=0x7f52b8003b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a1c02b121a4277 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.128+0000 7f52b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.128+0000 7f52b5ffb700 1 -- 172.21.15.12:0/3457358913 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b801d070 con 0x56439622bd30 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.128+0000 7f52b5ffb700 1 -- 172.21.15.12:0/3457358913 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f52b8005620 con 0x56439622bd30 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.128+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3457358913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56439621eb40 con 0x56439622bd30 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.129+0000 7f52b5ffb700 1 -- 172.21.15.12:0/3457358913 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52b800b710 con 0x56439622bd30 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.129+0000 7f52e88c7b80 10 client.29801 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.129+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3457358913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f52c800c810 con 0x56439622bd30 2023-12-11T20:33:08.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.129+0000 7f52b5ffb700 1 -- 172.21.15.12:0/3457358913 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52b8033020 con 0x56439622bd30 2023-12-11T20:33:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.130+0000 7f52b5ffb700 1 -- 172.21.15.12:0/3457358913 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f52b8004a00 con 0x56439622bd30 2023-12-11T20:33:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.130+0000 7f52e88c7b80 10 client.29801 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.130+0000 7f52e88c7b80 10 client.29801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.130+0000 7f52e88c7b80 20 client.29801 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.130+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564396240ee0 0x564396243300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.130+0000 7f52e88c7b80 4 client.29801 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.130+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3457358913 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643961faf40 con 0x564396240ee0 2023-12-11T20:33:08.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.130+0000 7f52ce59c700 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564396240ee0 0x564396243300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.131+0000 7f52ce59c700 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564396240ee0 0x564396243300 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba208931f39f0a90 server_cookie=c9d070707fcd7185 in_seq=0 out_seq=0 2023-12-11T20:33:08.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.131+0000 7f52b5ffb700 10 client.29801 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:08.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.132+0000 7f52b5ffb700 1 -- 172.21.15.12:0/3457358913 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5643961faf40 con 0x564396240ee0 2023-12-11T20:33:08.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.132+0000 7f52b5ffb700 10 client.29801 handle_command_reply: tid=0 2023-12-11T20:33:08.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.132+0000 7f52e88c7b80 1 client.29801 shutdown 2023-12-11T20:33:08.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.132+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3457358913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 msgr2=0x5643962356e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.132+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x5643962356e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f52b8006010 tx=0x7f52b8003b30 comp rx=0 tx=0).stop 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3457358913 shutdown_connections 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x564396240ee0 0x564396243300 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622cc20 0x56439623c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x5643962351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/3457358913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622bd30 0x5643962356e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3457358913 >> 172.21.15.12:0/3457358913 conn(0x56439615a7e0 msgr2=0x564396226a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52b5ffb700 0 client.29801 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3457358913 shutdown_connections 2023-12-11T20:33:08.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 1 -- 172.21.15.12:0/3457358913 wait complete. 2023-12-11T20:33:08.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.133+0000 7f52e88c7b80 20 client.29801 trim_cache size 0 max 16384 2023-12-11T20:33:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.179+0000 7f52e88c7b80 1 Processor -- start 2023-12-11T20:33:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.179+0000 7f52e88c7b80 1 -- start start 2023-12-11T20:33:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.179+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622b3d0 0x5643962432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.179+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 0x56439623c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.179+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x564396227970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.179+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564396222b50 con 0x56439622cc20 2023-12-11T20:33:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.179+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x564396232db0 con 0x56439622b3d0 2023-12-11T20:33:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.179+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643962306a0 con 0x56439622bd30 2023-12-11T20:33:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.180+0000 7f52ce59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622b3d0 0x5643962432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.180+0000 7f52ce59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622b3d0 0x5643962432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:45730/0 (socket says 172.21.15.12:45730) 2023-12-11T20:33:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.180+0000 7f52ce59c700 1 -- 172.21.15.12:0/1623102156 learned_addr learned my addr 172.21.15.12:0/1623102156 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:08.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.180+0000 7f52ced9d700 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x564396227970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.181+0000 7f52ced9d700 1 -- 172.21.15.12:0/1623102156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 msgr2=0x56439623c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:08.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.181+0000 7f52ced9d700 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 0x56439623c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.181+0000 7f52ced9d700 1 -- 172.21.15.12:0/1623102156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622b3d0 msgr2=0x5643962432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:08.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.183+0000 7f52ced9d700 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622b3d0 0x5643962432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.183+0000 7f52ced9d700 1 -- 172.21.15.12:0/1623102156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564395fa8de0 con 0x56439622cc20 2023-12-11T20:33:08.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.183+0000 7f52ce59c700 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622b3d0 0x5643962432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:08.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.184+0000 7f52ced9d700 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x564396227970 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f52c80039b0 tx=0x7f52c8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee16dee486bb72 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:08.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.185+0000 7f52c559a700 1 -- 172.21.15.12:0/1623102156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8020070 con 0x56439622cc20 2023-12-11T20:33:08.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.185+0000 7f52c559a700 1 -- 172.21.15.12:0/1623102156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52c800ec10 con 0x56439622cc20 2023-12-11T20:33:08.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.185+0000 7f52c559a700 1 -- 172.21.15.12:0/1623102156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8011960 con 0x56439622cc20 2023-12-11T20:33:08.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.188+0000 7f52e88c7b80 1 -- 172.21.15.12:0/1623102156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 msgr2=0x564396227970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.188+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x564396227970 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f52c80039b0 tx=0x7f52c8020000 comp rx=0 tx=0).stop 2023-12-11T20:33:08.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.189+0000 7f52e88c7b80 1 -- 172.21.15.12:0/1623102156 shutdown_connections 2023-12-11T20:33:08.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.189+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622b3d0 0x5643962432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.189+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622cc20 0x564396227970 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.189+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/1623102156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 0x56439623c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.189+0000 7f52e88c7b80 1 -- 172.21.15.12:0/1623102156 >> 172.21.15.12:0/1623102156 conn(0x56439615a7e0 msgr2=0x564396233130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:08.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.189+0000 7f52e88c7b80 1 -- 172.21.15.12:0/1623102156 shutdown_connections 2023-12-11T20:33:08.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.189+0000 7f52e88c7b80 1 -- 172.21.15.12:0/1623102156 wait complete. 2023-12-11T20:33:08.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.190+0000 7f52e88c7b80 1 -- start start 2023-12-11T20:33:08.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.190+0000 7f52e88c7b80 1 Processor -- start 2023-12-11T20:33:08.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.191+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x564396238510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.191+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 0x564396238a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.191+0000 7f52e88c7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622cc20 0x56439623b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.191+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56439623bf10 con 0x56439622b3d0 2023-12-11T20:33:08.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.191+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56439623c080 con 0x56439622cc20 2023-12-11T20:33:08.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.191+0000 7f52e88c7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56439623c1f0 con 0x56439622bd30 2023-12-11T20:33:08.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.191+0000 7f52e88c7b80 10 client.0 _ll_register_callbacks cb 0x564396064a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:08.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.192+0000 7f52c5d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 0x564396238a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.192+0000 7f52ced9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622cc20 0x56439623b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.192+0000 7f52ced9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622cc20 0x56439623b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:45746/0 (socket says 172.21.15.12:45746) 2023-12-11T20:33:08.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.192+0000 7f52ced9d700 1 -- 172.21.15.12:0/490001103 learned_addr learned my addr 172.21.15.12:0/490001103 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:08.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.192+0000 7f52ce59c700 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x564396238510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.193+0000 7f52ced9d700 1 -- 172.21.15.12:0/490001103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 msgr2=0x564396238a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:08.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.193+0000 7f52ced9d700 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 0x564396238a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.194+0000 7f52ced9d700 1 -- 172.21.15.12:0/490001103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 msgr2=0x564396238510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:08.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.194+0000 7f52ced9d700 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x564396238510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.194+0000 7f52ced9d700 1 -- 172.21.15.12:0/490001103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564395ffc630 con 0x56439622cc20 2023-12-11T20:33:08.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.194+0000 7f52ce59c700 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x564396238510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:08.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.194+0000 7f52ced9d700 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622cc20 0x56439623b9d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52c8004c80 tx=0x7f52c8004cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f21f3acff82aaa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:08.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.194+0000 7f52b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.195+0000 7f52b5ffb700 1 -- 172.21.15.12:0/490001103 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8011af0 con 0x56439622cc20 2023-12-11T20:33:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.195+0000 7f52e88c7b80 1 -- 172.21.15.12:0/490001103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f52c800ee70 con 0x56439622cc20 2023-12-11T20:33:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.195+0000 7f52b5ffb700 1 -- 172.21.15.12:0/490001103 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f52c8004e50 con 0x56439622cc20 2023-12-11T20:33:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.196+0000 7f52b5ffb700 1 -- 172.21.15.12:0/490001103 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52c8034430 con 0x56439622cc20 2023-12-11T20:33:08.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.196+0000 7f52e88c7b80 10 client.29807 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:08.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.196+0000 7f52e88c7b80 1 -- 172.21.15.12:0/490001103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564395f91c60 con 0x56439622cc20 2023-12-11T20:33:08.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.197+0000 7f52b5ffb700 1 -- 172.21.15.12:0/490001103 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52c800ee70 con 0x56439622cc20 2023-12-11T20:33:08.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.197+0000 7f52b5ffb700 1 -- 172.21.15.12:0/490001103 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f52c802a530 con 0x56439622cc20 2023-12-11T20:33:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.198+0000 7f52e88c7b80 10 client.29807 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.198+0000 7f52e88c7b80 10 client.29807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:08.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.198+0000 7f52e88c7b80 20 client.29807 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.198+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5643962a8fe0 0x5643962ab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.198+0000 7f52e88c7b80 4 client.29807 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:33:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.198+0000 7f52e88c7b80 1 -- 172.21.15.12:0/490001103 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564396145fd0 con 0x5643962a8fe0 2023-12-11T20:33:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.198+0000 7f52ce59c700 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5643962a8fe0 0x5643962ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.199+0000 7f52ce59c700 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5643962a8fe0 0x5643962ab400 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=264843db8b9d9a84 server_cookie=e9bab272994bee7b in_seq=0 out_seq=0 2023-12-11T20:33:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.199+0000 7f52b5ffb700 10 client.29807 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.199+0000 7f52b5ffb700 1 -- 172.21.15.12:0/490001103 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564396145fd0 con 0x5643962a8fe0 2023-12-11T20:33:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.199+0000 7f52b5ffb700 10 client.29807 handle_command_reply: tid=0 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.199+0000 7f52e88c7b80 1 client.29807 shutdown 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 -- 172.21.15.12:0/490001103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622cc20 msgr2=0x56439623b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622cc20 0x56439623b9d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52c8004c80 tx=0x7f52c8004cb0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 -- 172.21.15.12:0/490001103 shutdown_connections 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5643962a8fe0 0x5643962ab400 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56439622cc20 0x56439623b9d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56439622b3d0 0x564396238510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52b5ffb700 0 client.29807 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 --2- 172.21.15.12:0/490001103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56439622bd30 0x564396238a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 -- 172.21.15.12:0/490001103 >> 172.21.15.12:0/490001103 conn(0x56439615a7e0 msgr2=0x564396227970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:08.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 -- 172.21.15.12:0/490001103 shutdown_connections 2023-12-11T20:33:08.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.200+0000 7f52e88c7b80 1 -- 172.21.15.12:0/490001103 wait complete. 2023-12-11T20:33:08.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.201+0000 7f52e88c7b80 20 client.29807 trim_cache size 0 max 16384 2023-12-11T20:33:08.201 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:33:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:33:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:33:08.202 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:33:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 -- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52bc0a1490 msgr2=0x7f52bc0a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52bc0a1490 0x7f52bc0a3950 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f52c8005f00 tx=0x7f52c8005d50 comp rx=0 tx=0).stop 2023-12-11T20:33:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 -- 172.21.15.12:0/2089821797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d00ffd70 msgr2=0x7f52d019d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d00ffd70 0x7f52d019d980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52c000ef10 tx=0x7f52c000c3a0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 -- 172.21.15.12:0/2089821797 shutdown_connections 2023-12-11T20:33:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f52bc0a1490 0x7f52bc0a3950 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d0101090 0x7f52d01a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52d00ffd70 0x7f52d019d980 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 --2- 172.21.15.12:0/2089821797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d01006d0 0x7f52d019dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 -- 172.21.15.12:0/2089821797 >> 172.21.15.12:0/2089821797 conn(0x7f52d00fb930 msgr2=0x7f52d00fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:08.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 -- 172.21.15.12:0/2089821797 shutdown_connections 2023-12-11T20:33:08.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.202+0000 7f52d4fff700 1 -- 172.21.15.12:0/2089821797 wait complete. 2023-12-11T20:33:08.232 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:33:08.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:33:08.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.652+0000 7f898d1ff700 1 -- 172.21.15.12:0/1050054120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 msgr2=0x7f898810bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.652+0000 7f898d1ff700 1 --2- 172.21.15.12:0/1050054120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 0x7f898810bae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8980009f90 tx=0x7f898000b330 comp rx=0 tx=0).stop 2023-12-11T20:33:08.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.652+0000 7f898d1ff700 1 -- 172.21.15.12:0/1050054120 shutdown_connections 2023-12-11T20:33:08.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.652+0000 7f898d1ff700 1 --2- 172.21.15.12:0/1050054120 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89881036a0 0x7f8988103ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.652+0000 7f898d1ff700 1 --2- 172.21.15.12:0/1050054120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 0x7f898810bae0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.652+0000 7f898d1ff700 1 --2- 172.21.15.12:0/1050054120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8988104890 0x7f8988104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.652+0000 7f898d1ff700 1 -- 172.21.15.12:0/1050054120 >> 172.21.15.12:0/1050054120 conn(0x7f89880fec10 msgr2=0x7f8988101050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:08.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.653+0000 7f898d1ff700 1 -- 172.21.15.12:0/1050054120 shutdown_connections 2023-12-11T20:33:08.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.653+0000 7f898d1ff700 1 -- 172.21.15.12:0/1050054120 wait complete. 2023-12-11T20:33:08.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.654+0000 7f898d1ff700 1 Processor -- start 2023-12-11T20:33:08.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.655+0000 7f898d1ff700 1 -- start start 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.655+0000 7f898d1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89881036a0 0x7f8988199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.655+0000 7f898d1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8988104890 0x7f8988199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.655+0000 7f898d1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 0x7f89881a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.655+0000 7f898d1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89881a1180 con 0x7f89881036a0 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.655+0000 7f898d1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89881a12c0 con 0x7f8988104890 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.655+0000 7f898d1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89881a1450 con 0x7f8988105230 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f8986d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89881036a0 0x7f8988199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f8986d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89881036a0 0x7f8988199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38778/0 (socket says 172.21.15.12:38778) 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f8986d9d700 1 -- 172.21.15.12:0/3833745410 learned_addr learned my addr 172.21.15.12:0/3833745410 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f897ffff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8988104890 0x7f8988199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f898759e700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 0x7f89881a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f8986d9d700 1 -- 172.21.15.12:0/3833745410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 msgr2=0x7f89881a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f8986d9d700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 0x7f89881a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f8986d9d700 1 -- 172.21.15.12:0/3833745410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8988104890 msgr2=0x7f8988199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f8986d9d700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8988104890 0x7f8988199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f8986d9d700 1 -- 172.21.15.12:0/3833745410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8980009c40 con 0x7f89881036a0 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f898759e700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 0x7f89881a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.656+0000 7f897ffff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8988104890 0x7f8988199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.657+0000 7f8986d9d700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89881036a0 0x7f8988199650 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f897800d980 tx=0x7f897800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.657+0000 7f8984d99700 1 -- 172.21.15.12:0/3833745410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800de60 con 0x7f89881036a0 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.657+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89881a1730 con 0x7f89881036a0 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.657+0000 7f8984d99700 1 -- 172.21.15.12:0/3833745410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89780044b0 con 0x7f89881036a0 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.657+0000 7f8984d99700 1 -- 172.21.15.12:0/3833745410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978003b40 con 0x7f89881036a0 2023-12-11T20:33:08.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.657+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89881a1c40 con 0x7f89881036a0 2023-12-11T20:33:08.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.660+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898810aaf0 con 0x7f89881036a0 2023-12-11T20:33:08.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.666+0000 7f8984d99700 1 -- 172.21.15.12:0/3833745410 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8978003ca0 con 0x7f89881036a0 2023-12-11T20:33:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.669+0000 7f8984d99700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89740a1550 0x7f89740a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.671+0000 7f8984d99700 1 -- 172.21.15.12:0/3833745410 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f89780cc4a0 con 0x7f89881036a0 2023-12-11T20:33:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.674+0000 7f897ffff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89740a1550 0x7f89740a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.676+0000 7f897ffff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89740a1550 0x7f89740a3a10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8970005fd0 tx=0x7f8970009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:08.676+0000 7f8984d99700 1 -- 172.21.15.12:0/3833745410 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8978095a50 con 0x7f89881036a0 2023-12-11T20:33:08.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:08 smithi032 ceph-mon[132488]: pgmap v891: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2023-12-11T20:33:09.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:08 smithi039 ceph-mon[102205]: pgmap v891: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2023-12-11T20:33:09.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:08 smithi012 ceph-mon[128787]: pgmap v891: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 5.05k op/s 2023-12-11T20:33:09.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.345+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f898810eff0 con 0x7f89881036a0 2023-12-11T20:33:09.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.349+0000 7f8984d99700 1 -- 172.21.15.12:0/3833745410 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f8978009940 con 0x7f89881036a0 2023-12-11T20:33:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:33:09.349 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:32:11.561579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:33:09.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.355+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89740a1550 msgr2=0x7f89740a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.355+0000 7f898d1ff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89740a1550 0x7f89740a3a10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8970005fd0 tx=0x7f8970009310 comp rx=0 tx=0).stop 2023-12-11T20:33:09.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.355+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89881036a0 msgr2=0x7f8988199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.355+0000 7f898d1ff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89881036a0 0x7f8988199650 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f897800d980 tx=0x7f897800dd40 comp rx=0 tx=0).stop 2023-12-11T20:33:09.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.356+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 shutdown_connections 2023-12-11T20:33:09.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.356+0000 7f898d1ff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f89740a1550 0x7f89740a3a10 secure :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8970005fd0 tx=0x7f8970009310 comp rx=0 tx=0).stop 2023-12-11T20:33:09.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.356+0000 7f898d1ff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988105230 0x7f89881a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.356+0000 7f898d1ff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89881036a0 0x7f8988199650 secure :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f897800d980 tx=0x7f897800dd40 comp rx=0 tx=0).stop 2023-12-11T20:33:09.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.356+0000 7f898d1ff700 1 --2- 172.21.15.12:0/3833745410 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8988104890 0x7f8988199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.356+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 >> 172.21.15.12:0/3833745410 conn(0x7f89880fec10 msgr2=0x7f8988107c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:09.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.356+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 shutdown_connections 2023-12-11T20:33:09.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.357+0000 7f898d1ff700 1 -- 172.21.15.12:0/3833745410 wait complete. 2023-12-11T20:33:09.358 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 36 2023-12-11T20:33:09.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:33:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.809+0000 7f30fa3ff700 1 -- 172.21.15.12:0/1297033139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 msgr2=0x7f30f4101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.809+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/1297033139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 0x7f30f4101910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f30e40099c0 tx=0x7f30e4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.811+0000 7f30fa3ff700 1 -- 172.21.15.12:0/1297033139 shutdown_connections 2023-12-11T20:33:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.811+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/1297033139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 0x7f30f4101910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.811+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/1297033139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30f4103080 0x7f30f4109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.811+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/1297033139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f41026e0 0x7f30f4102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.811+0000 7f30fa3ff700 1 -- 172.21.15.12:0/1297033139 >> 172.21.15.12:0/1297033139 conn(0x7f30f40fca60 msgr2=0x7f30f40feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.811+0000 7f30fa3ff700 1 -- 172.21.15.12:0/1297033139 shutdown_connections 2023-12-11T20:33:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.811+0000 7f30fa3ff700 1 -- 172.21.15.12:0/1297033139 wait complete. 2023-12-11T20:33:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.815+0000 7f30fa3ff700 1 Processor -- start 2023-12-11T20:33:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.815+0000 7f30fa3ff700 1 -- start start 2023-12-11T20:33:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.816+0000 7f30fa3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 0x7f30f419da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.816+0000 7f30fa3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30f41026e0 0x7f30f419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.816+0000 7f30fa3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4103080 0x7f30f41a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.816+0000 7f30fa3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41a5550 con 0x7f30f41026e0 2023-12-11T20:33:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.816+0000 7f30fa3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41a5690 con 0x7f30f41014f0 2023-12-11T20:33:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.816+0000 7f30fa3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41a5820 con 0x7f30f4103080 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.818+0000 7f30f3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 0x7f30f419da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.818+0000 7f30f3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 0x7f30f419da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46676/0 (socket says 172.21.15.12:46676) 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.818+0000 7f30f3fff700 1 -- 172.21.15.12:0/196027499 learned_addr learned my addr 172.21.15.12:0/196027499 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.818+0000 7f30f899c700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4103080 0x7f30f41a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.818+0000 7f30ebfff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30f41026e0 0x7f30f419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.819+0000 7f30f3fff700 1 -- 172.21.15.12:0/196027499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4103080 msgr2=0x7f30f41a4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.819+0000 7f30f3fff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4103080 0x7f30f41a4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.819+0000 7f30f3fff700 1 -- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30f41026e0 msgr2=0x7f30f419df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.819+0000 7f30f3fff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30f41026e0 0x7f30f419df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.819+0000 7f30f3fff700 1 -- 172.21.15.12:0/196027499 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40095f0 con 0x7f30f41014f0 2023-12-11T20:33:09.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.819+0000 7f30f899c700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4103080 0x7f30f41a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:09.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.819+0000 7f30f3fff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 0x7f30f419da20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009f50 tx=0x7f30e4005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:09.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.820+0000 7f30f1ffb700 1 -- 172.21.15.12:0/196027499 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e401d070 con 0x7f30f41014f0 2023-12-11T20:33:09.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.820+0000 7f30f1ffb700 1 -- 172.21.15.12:0/196027499 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30e400bda0 con 0x7f30f41014f0 2023-12-11T20:33:09.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.820+0000 7f30f1ffb700 1 -- 172.21.15.12:0/196027499 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4022e60 con 0x7f30f41014f0 2023-12-11T20:33:09.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.820+0000 7f30fa3ff700 1 -- 172.21.15.12:0/196027499 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f41a5aa0 con 0x7f30f41014f0 2023-12-11T20:33:09.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.820+0000 7f30fa3ff700 1 -- 172.21.15.12:0/196027499 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f41a5ec0 con 0x7f30f41014f0 2023-12-11T20:33:09.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.825+0000 7f30f1ffb700 1 -- 172.21.15.12:0/196027499 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f30e4022600 con 0x7f30f41014f0 2023-12-11T20:33:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.827+0000 7f30f1ffb700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f30e00a1580 0x7f30e00a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.827+0000 7f30f1ffb700 1 -- 172.21.15.12:0/196027499 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f30e40cdcf0 con 0x7f30f41014f0 2023-12-11T20:33:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.829+0000 7f310de1ab80 1 Processor -- start 2023-12-11T20:33:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.829+0000 7f30ebfff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f30e00a1580 0x7f30e00a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.830+0000 7f30ebfff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f30e00a1580 0x7f30e00a3a40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f30dc006fd0 tx=0x7f30dc008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.831+0000 7f310de1ab80 1 -- start start 2023-12-11T20:33:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.832+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d053d0 0x55f950d057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.832+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d05d30 0x55f950d06640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.832+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d06c20 0x55f950d070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.832+0000 7f310de1ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950c60b50 con 0x55f950d05d30 2023-12-11T20:33:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.832+0000 7f310de1ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950c5e470 con 0x55f950d053d0 2023-12-11T20:33:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.832+0000 7f310de1ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950c59d60 con 0x55f950d06c20 2023-12-11T20:33:09.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:09 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3833745410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.832+0000 7f30f3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d053d0 0x55f950d057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.832+0000 7f30ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d05d30 0x55f950d06640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.833+0000 7f30f899c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d06c20 0x55f950d070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.833+0000 7f30ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d05d30 0x55f950d06640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32982/0 (socket says 172.21.15.12:32982) 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.833+0000 7f30ebfff700 1 -- 172.21.15.12:0/679382608 learned_addr learned my addr 172.21.15.12:0/679382608 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.833+0000 7f30f3fff700 1 -- 172.21.15.12:0/679382608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d06c20 msgr2=0x55f950d070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.833+0000 7f30f3fff700 1 --2- 172.21.15.12:0/679382608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d06c20 0x55f950d070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.834+0000 7f30f3fff700 1 -- 172.21.15.12:0/679382608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d05d30 msgr2=0x55f950d06640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.834+0000 7f30f3fff700 1 --2- 172.21.15.12:0/679382608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d05d30 0x55f950d06640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.834+0000 7f30f3fff700 1 -- 172.21.15.12:0/679382608 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f950ad6630 con 0x55f950d053d0 2023-12-11T20:33:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.834+0000 7f30ebfff700 1 --2- 172.21.15.12:0/679382608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d05d30 0x55f950d06640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.835+0000 7f30f3fff700 1 --2- 172.21.15.12:0/679382608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d053d0 0x55f950d057f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f30e409acf0 tx=0x7f30e4009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eca7e258515e7bf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:09.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.836+0000 7f30ea7fc700 1 -- 172.21.15.12:0/679382608 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e409a950 con 0x55f950d053d0 2023-12-11T20:33:09.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.836+0000 7f30ea7fc700 1 -- 172.21.15.12:0/679382608 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30e409b6f0 con 0x55f950d053d0 2023-12-11T20:33:09.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.836+0000 7f30ea7fc700 1 -- 172.21.15.12:0/679382608 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40cb940 con 0x55f950d053d0 2023-12-11T20:33:09.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.837+0000 7f310de1ab80 1 -- 172.21.15.12:0/679382608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d053d0 msgr2=0x55f950d057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.837+0000 7f310de1ab80 1 --2- 172.21.15.12:0/679382608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d053d0 0x55f950d057f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f30e409acf0 tx=0x7f30e4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.837+0000 7f310de1ab80 1 -- 172.21.15.12:0/679382608 shutdown_connections 2023-12-11T20:33:09.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.837+0000 7f310de1ab80 1 --2- 172.21.15.12:0/679382608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d053d0 0x55f950d057f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.837+0000 7f310de1ab80 1 --2- 172.21.15.12:0/679382608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d06c20 0x55f950d070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.837+0000 7f310de1ab80 1 --2- 172.21.15.12:0/679382608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d05d30 0x55f950d06640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.837+0000 7f310de1ab80 1 -- 172.21.15.12:0/679382608 >> 172.21.15.12:0/679382608 conn(0x55f950c347e0 msgr2=0x55f950d01d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:09.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.837+0000 7f310de1ab80 1 -- 172.21.15.12:0/679382608 shutdown_connections 2023-12-11T20:33:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.838+0000 7f310de1ab80 1 -- 172.21.15.12:0/679382608 wait complete. 2023-12-11T20:33:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.838+0000 7f310de1ab80 1 -- start start 2023-12-11T20:33:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.839+0000 7f310de1ab80 1 Processor -- start 2023-12-11T20:33:09.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.841+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d0ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.841+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d0f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.841+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d163e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.841+0000 7f310de1ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950c13560 con 0x55f950d053d0 2023-12-11T20:33:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.841+0000 7f310de1ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950c13200 con 0x55f950d06c20 2023-12-11T20:33:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.841+0000 7f310de1ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950ad8920 con 0x55f950d05d30 2023-12-11T20:33:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.842+0000 7f30ebfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d0f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.842+0000 7f30ebfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d0f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49528/0 (socket says 172.21.15.12:49528) 2023-12-11T20:33:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.842+0000 7f310de1ab80 10 client.0 _ll_register_callbacks cb 0x55f950b3ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.842+0000 7f30ebfff700 1 -- 172.21.15.12:0/1788998727 learned_addr learned my addr 172.21.15.12:0/1788998727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.842+0000 7f30f3fff700 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d0ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.842+0000 7f30f899c700 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d163e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.843+0000 7f30f3fff700 1 -- 172.21.15.12:0/1788998727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 msgr2=0x55f950d0f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.843+0000 7f30f3fff700 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d0f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.843+0000 7f30f3fff700 1 -- 172.21.15.12:0/1788998727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 msgr2=0x55f950d163e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.843+0000 7f30f3fff700 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d163e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.843+0000 7f30f3fff700 1 -- 172.21.15.12:0/1788998727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc00e040 con 0x55f950d053d0 2023-12-11T20:33:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.843+0000 7f30ebfff700 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d0f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.843+0000 7f30f3fff700 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d0ee60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f30e409aca0 tx=0x7f30e409ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6173e1c5f808ffcb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.843+0000 7f30d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.844+0000 7f30d37fe700 1 -- 172.21.15.12:0/1788998727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e409f140 con 0x55f950d053d0 2023-12-11T20:33:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.844+0000 7f310de1ab80 1 -- 172.21.15.12:0/1788998727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f950cf8b40 con 0x55f950d053d0 2023-12-11T20:33:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.844+0000 7f30d37fe700 1 -- 172.21.15.12:0/1788998727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f30e409a6f0 con 0x55f950d053d0 2023-12-11T20:33:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.844+0000 7f30d37fe700 1 -- 172.21.15.12:0/1788998727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30e40b91f0 con 0x55f950d053d0 2023-12-11T20:33:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.845+0000 7f310de1ab80 10 client.20295 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.845+0000 7f310de1ab80 1 -- 172.21.15.12:0/1788998727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f30f41a5ec0 con 0x55f950d053d0 2023-12-11T20:33:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.847+0000 7f30d37fe700 1 -- 172.21.15.12:0/1788998727 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30e407d070 con 0x55f950d053d0 2023-12-11T20:33:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.847+0000 7f30d37fe700 1 -- 172.21.15.12:0/1788998727 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f30e4096ec0 con 0x55f950d053d0 2023-12-11T20:33:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.847+0000 7f310de1ab80 10 client.20295 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.847+0000 7f310de1ab80 10 client.20295 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:33:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.847+0000 7f310de1ab80 20 client.20295 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.847+0000 7f310de1ab80 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f950d1a740 0x55f950d1cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.847+0000 7f310de1ab80 4 client.20295 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.847+0000 7f310de1ab80 1 -- 172.21.15.12:0/1788998727 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f950cd4f40 con 0x55f950d1a740 2023-12-11T20:33:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.848+0000 7f30ebfff700 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f950d1a740 0x55f950d1cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.849+0000 7f30ebfff700 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f950d1a740 0x55f950d1cb60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6557e3f845117de2 server_cookie=f9d3ff7fb30a2d66 in_seq=0 out_seq=0 2023-12-11T20:33:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.849+0000 7f30d37fe700 10 client.20295 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:33:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.851+0000 7f30d37fe700 1 -- 172.21.15.12:0/1788998727 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f950cd4f40 con 0x55f950d1a740 2023-12-11T20:33:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.851+0000 7f30d37fe700 10 client.20295 handle_command_reply: tid=0 2023-12-11T20:33:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.852+0000 7f310de1ab80 1 client.20295 shutdown 2023-12-11T20:33:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 -- 172.21.15.12:0/1788998727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 msgr2=0x55f950d0ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d0ee60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f30e409aca0 tx=0x7f30e409ac30 comp rx=0 tx=0).stop 2023-12-11T20:33:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 -- 172.21.15.12:0/1788998727 shutdown_connections 2023-12-11T20:33:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f950d1a740 0x55f950d1cb60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d0ee60 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 --2- 172.21.15.12:0/1788998727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d0f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 -- 172.21.15.12:0/1788998727 >> 172.21.15.12:0/1788998727 conn(0x55f950c347e0 msgr2=0x55f950d00a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f30d37fe700 0 client.20295 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:33:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.853+0000 7f310de1ab80 1 -- 172.21.15.12:0/1788998727 shutdown_connections 2023-12-11T20:33:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.854+0000 7f310de1ab80 1 -- 172.21.15.12:0/1788998727 wait complete. 2023-12-11T20:33:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.854+0000 7f310de1ab80 20 client.20295 trim_cache size 0 max 16384 2023-12-11T20:33:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.883+0000 7f310de1ab80 1 Processor -- start 2023-12-11T20:33:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.883+0000 7f310de1ab80 1 -- start start 2023-12-11T20:33:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.884+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d16a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.884+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d163a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.884+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d07000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.884+0000 7f310de1ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950d0e9d0 con 0x55f950d053d0 2023-12-11T20:33:09.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.884+0000 7f310de1ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950cfcb50 con 0x55f950d06c20 2023-12-11T20:33:09.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.884+0000 7f310de1ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950d10050 con 0x55f950d05d30 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.885+0000 7f30f3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d16a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.885+0000 7f30f3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d16a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32994/0 (socket says 172.21.15.12:32994) 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.885+0000 7f30f3fff700 1 -- 172.21.15.12:0/4268569058 learned_addr learned my addr 172.21.15.12:0/4268569058 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.886+0000 7f30f3fff700 1 -- 172.21.15.12:0/4268569058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 msgr2=0x55f950d163a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.886+0000 7f30ebfff700 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d163a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.886+0000 7f30f3fff700 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d163a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.886+0000 7f30f3fff700 1 -- 172.21.15.12:0/4268569058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 msgr2=0x55f950d07000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.886+0000 7f30f899c700 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d07000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.886+0000 7f30f3fff700 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d07000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.886+0000 7f30f3fff700 1 -- 172.21.15.12:0/4268569058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f950a82de0 con 0x55f950d053d0 2023-12-11T20:33:09.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.886+0000 7f30f899c700 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d07000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.887+0000 7f30f3fff700 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d16a90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f30e409af80 tx=0x7f30e4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d3459f79b51eb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.887+0000 7f30eaffd700 1 -- 172.21.15.12:0/4268569058 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e409b070 con 0x55f950d053d0 2023-12-11T20:33:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.887+0000 7f30eaffd700 1 -- 172.21.15.12:0/4268569058 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30e407d070 con 0x55f950d053d0 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.887+0000 7f30eaffd700 1 -- 172.21.15.12:0/4268569058 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e409b980 con 0x55f950d053d0 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.888+0000 7f310de1ab80 1 -- 172.21.15.12:0/4268569058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 msgr2=0x55f950d16a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.888+0000 7f310de1ab80 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d16a90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f30e409af80 tx=0x7f30e4009310 comp rx=0 tx=0).stop 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.888+0000 7f310de1ab80 1 -- 172.21.15.12:0/4268569058 shutdown_connections 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.888+0000 7f310de1ab80 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d07000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.888+0000 7f310de1ab80 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d16a90 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.888+0000 7f310de1ab80 1 --2- 172.21.15.12:0/4268569058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d163a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.888+0000 7f310de1ab80 1 -- 172.21.15.12:0/4268569058 >> 172.21.15.12:0/4268569058 conn(0x55f950c347e0 msgr2=0x55f950d214c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.889+0000 7f310de1ab80 1 -- 172.21.15.12:0/4268569058 shutdown_connections 2023-12-11T20:33:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.889+0000 7f310de1ab80 1 -- 172.21.15.12:0/4268569058 wait complete. 2023-12-11T20:33:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.889+0000 7f310de1ab80 1 -- start start 2023-12-11T20:33:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.889+0000 7f310de1ab80 1 Processor -- start 2023-12-11T20:33:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.890+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d13ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.890+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d14220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.890+0000 7f310de1ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d15230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.890+0000 7f310de1ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950d15770 con 0x55f950d053d0 2023-12-11T20:33:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.890+0000 7f310de1ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950d158e0 con 0x55f950d06c20 2023-12-11T20:33:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.890+0000 7f310de1ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950d15aa0 con 0x55f950d05d30 2023-12-11T20:33:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.890+0000 7f310de1ab80 10 client.0 _ll_register_callbacks cb 0x55f950b3ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.890+0000 7f30ebfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d14220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30f3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d13ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30ebfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d14220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49550/0 (socket says 172.21.15.12:49550) 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30ebfff700 1 -- 172.21.15.12:0/627396629 learned_addr learned my addr 172.21.15.12:0/627396629 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30f899c700 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d15230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30f3fff700 1 -- 172.21.15.12:0/627396629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 msgr2=0x55f950d14220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30f3fff700 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d14220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30f3fff700 1 -- 172.21.15.12:0/627396629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 msgr2=0x55f950d15230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30f3fff700 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d15230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.891+0000 7f30f3fff700 1 -- 172.21.15.12:0/627396629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f41a5ec0 con 0x55f950d053d0 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.892+0000 7f30f3fff700 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d13ce0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f30e409acf0 tx=0x7f30e4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e31eacaa594d4d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.892+0000 7f30d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.892+0000 7f30d37fe700 1 -- 172.21.15.12:0/627396629 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40b9260 con 0x55f950d053d0 2023-12-11T20:33:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.892+0000 7f30d37fe700 1 -- 172.21.15.12:0/627396629 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f30e40b9030 con 0x55f950d053d0 2023-12-11T20:33:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.893+0000 7f310de1ab80 1 -- 172.21.15.12:0/627396629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30e409b6f0 con 0x55f950d053d0 2023-12-11T20:33:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.893+0000 7f30d37fe700 1 -- 172.21.15.12:0/627396629 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30e409aff0 con 0x55f950d053d0 2023-12-11T20:33:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.893+0000 7f310de1ab80 10 client.20301 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.893+0000 7f310de1ab80 1 -- 172.21.15.12:0/627396629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f950a6bc60 con 0x55f950d053d0 2023-12-11T20:33:09.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.894+0000 7f30d37fe700 1 -- 172.21.15.12:0/627396629 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30e40a7080 con 0x55f950d053d0 2023-12-11T20:33:09.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.894+0000 7f30d37fe700 1 -- 172.21.15.12:0/627396629 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f30e40841b0 con 0x55f950d053d0 2023-12-11T20:33:09.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.894+0000 7f310de1ab80 10 client.20301 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.894+0000 7f310de1ab80 10 client.20301 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:33:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.894+0000 7f310de1ab80 20 client.20301 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.894+0000 7f310de1ab80 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f950d820e0 0x55f950d844d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.895+0000 7f30ebfff700 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f950d820e0 0x55f950d844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.895+0000 7f310de1ab80 4 client.20301 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:33:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.895+0000 7f310de1ab80 1 -- 172.21.15.12:0/627396629 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f950c1ffd0 con 0x55f950d820e0 2023-12-11T20:33:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.898+0000 7f30ebfff700 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f950d820e0 0x55f950d844d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d8dd13e2d118578e server_cookie=2995484169211563 in_seq=0 out_seq=0 2023-12-11T20:33:09.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.898+0000 7f30d37fe700 10 client.20301 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:33:09.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.898+0000 7f30d37fe700 1 -- 172.21.15.12:0/627396629 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f950c1ffd0 con 0x55f950d820e0 2023-12-11T20:33:09.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.898+0000 7f30d37fe700 10 client.20301 handle_command_reply: tid=0 2023-12-11T20:33:09.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.898+0000 7f310de1ab80 1 client.20301 shutdown 2023-12-11T20:33:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f310de1ab80 1 -- 172.21.15.12:0/627396629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 msgr2=0x55f950d13ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f310de1ab80 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d13ce0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f30e409acf0 tx=0x7f30e4009cd0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f310de1ab80 1 -- 172.21.15.12:0/627396629 shutdown_connections 2023-12-11T20:33:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f310de1ab80 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f950d820e0 0x55f950d844d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f310de1ab80 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f950d06c20 0x55f950d15230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f310de1ab80 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f950d053d0 0x55f950d13ce0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f30d37fe700 0 client.20301 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:33:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f310de1ab80 1 --2- 172.21.15.12:0/627396629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f950d05d30 0x55f950d14220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.899+0000 7f310de1ab80 1 -- 172.21.15.12:0/627396629 >> 172.21.15.12:0/627396629 conn(0x55f950c347e0 msgr2=0x55f950d09b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.900+0000 7f310de1ab80 1 -- 172.21.15.12:0/627396629 shutdown_connections 2023-12-11T20:33:09.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.900+0000 7f310de1ab80 1 -- 172.21.15.12:0/627396629 wait complete. 2023-12-11T20:33:09.899 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:33:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.900+0000 7f310de1ab80 20 client.20301 trim_cache size 0 max 16384 2023-12-11T20:33:09.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.901+0000 7f30fa3ff700 1 -- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f30e00a1580 msgr2=0x7f30e00a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.901+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f30e00a1580 0x7f30e00a3a40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f30dc006fd0 tx=0x7f30dc008040 comp rx=0 tx=0).stop 2023-12-11T20:33:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.901+0000 7f30fa3ff700 1 -- 172.21.15.12:0/196027499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 msgr2=0x7f30f419da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.901+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 0x7f30f419da20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009f50 tx=0x7f30e4005b00 comp rx=0 tx=0).stop 2023-12-11T20:33:09.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.902+0000 7f30fa3ff700 1 -- 172.21.15.12:0/196027499 shutdown_connections 2023-12-11T20:33:09.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.902+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f30e00a1580 0x7f30e00a3a40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.902+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30f41014f0 0x7f30f419da20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.902+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4103080 0x7f30f41a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.902+0000 7f30fa3ff700 1 --2- 172.21.15.12:0/196027499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30f41026e0 0x7f30f419df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:09.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.902+0000 7f30fa3ff700 1 -- 172.21.15.12:0/196027499 >> 172.21.15.12:0/196027499 conn(0x7f30f40fca60 msgr2=0x7f30f4107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:09.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.902+0000 7f30fa3ff700 1 -- 172.21.15.12:0/196027499 shutdown_connections 2023-12-11T20:33:09.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:09.902+0000 7f30fa3ff700 1 -- 172.21.15.12:0/196027499 wait complete. 2023-12-11T20:33:09.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:33:09.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:09 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3833745410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:33:10.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:09 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3833745410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:33:10.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.365+0000 7f7c53dff700 1 -- 172.21.15.12:0/3465515872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c4c1026b0 msgr2=0x7f7c4c102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.365+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3465515872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c4c1026b0 0x7f7c4c102b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009990 tx=0x7f7c3c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.366+0000 7f7c53dff700 1 -- 172.21.15.12:0/3465515872 shutdown_connections 2023-12-11T20:33:10.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.366+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3465515872 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c4c103050 0x7f7c4c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.366+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3465515872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4c1014c0 0x7f7c4c1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.366+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3465515872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c4c1026b0 0x7f7c4c102b10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.366+0000 7f7c53dff700 1 -- 172.21.15.12:0/3465515872 >> 172.21.15.12:0/3465515872 conn(0x7f7c4c0fca30 msgr2=0x7f7c4c0fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.366+0000 7f7c53dff700 1 -- 172.21.15.12:0/3465515872 shutdown_connections 2023-12-11T20:33:10.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.366+0000 7f7c53dff700 1 -- 172.21.15.12:0/3465515872 wait complete. 2023-12-11T20:33:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.368+0000 7f7c53dff700 1 Processor -- start 2023-12-11T20:33:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.368+0000 7f7c53dff700 1 -- start start 2023-12-11T20:33:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.368+0000 7f7c53dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c4c1014c0 0x7f7c4c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.368+0000 7f7c53dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c4c1026b0 0x7f7c4c199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.368+0000 7f7c53dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4c103050 0x7f7c4c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.368+0000 7f7c53dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c1a10a0 con 0x7f7c4c103050 2023-12-11T20:33:10.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.368+0000 7f7c53dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c1a11e0 con 0x7f7c4c1014c0 2023-12-11T20:33:10.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.368+0000 7f7c53dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c1a1370 con 0x7f7c4c1026b0 2023-12-11T20:33:10.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c4c1014c0 0x7f7c4c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c4c1014c0 0x7f7c4c199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46726/0 (socket says 172.21.15.12:46726) 2023-12-11T20:33:10.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 -- 172.21.15.12:0/3223221763 learned_addr learned my addr 172.21.15.12:0/3223221763 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 -- 172.21.15.12:0/3223221763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c4c1026b0 msgr2=0x7f7c4c199ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-11T20:33:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c4c1026b0 0x7f7c4c199ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 -- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4c103050 msgr2=0x7f7c4c1a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4c103050 0x7f7c4c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 -- 172.21.15.12:0/3223221763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0095f0 con 0x7f7c4c1014c0 2023-12-11T20:33:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.369+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c4c1014c0 0x7f7c4c199570 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800e970 tx=0x7f7c4800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.370+0000 7f7c42ffd700 1 -- 172.21.15.12:0/3223221763 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48009790 con 0x7f7c4c1014c0 2023-12-11T20:33:10.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.370+0000 7f7c53dff700 1 -- 172.21.15.12:0/3223221763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c1a1650 con 0x7f7c4c1014c0 2023-12-11T20:33:10.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.370+0000 7f7c53dff700 1 -- 172.21.15.12:0/3223221763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c1a1bb0 con 0x7f7c4c1014c0 2023-12-11T20:33:10.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.370+0000 7f7c42ffd700 1 -- 172.21.15.12:0/3223221763 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c480044b0 con 0x7f7c4c1014c0 2023-12-11T20:33:10.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.370+0000 7f7c42ffd700 1 -- 172.21.15.12:0/3223221763 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48003d90 con 0x7f7c4c1014c0 2023-12-11T20:33:10.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.376+0000 7f7c6775bb80 1 Processor -- start 2023-12-11T20:33:10.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.376+0000 7f7c6775bb80 1 -- start start 2023-12-11T20:33:10.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.376+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a93000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.376+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7a93e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.376+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7a948b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.376+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd79e5b50 con 0x558fd7a94430 2023-12-11T20:33:10.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.376+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd79e3470 con 0x558fd7a92be0 2023-12-11T20:33:10.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.376+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd79ded60 con 0x558fd7a93540 2023-12-11T20:33:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.378+0000 7f7c5239c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a93000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.378+0000 7f7c5139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7a948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.378+0000 7f7c5239c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a93000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46734/0 (socket says 172.21.15.12:46734) 2023-12-11T20:33:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.378+0000 7f7c5239c700 1 -- 172.21.15.12:0/1028421331 learned_addr learned my addr 172.21.15.12:0/1028421331 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.379+0000 7f7c5239c700 1 -- 172.21.15.12:0/1028421331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 msgr2=0x558fd7a93e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:33:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.379+0000 7f7c5239c700 1 --2- 172.21.15.12:0/1028421331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7a93e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.379+0000 7f7c5239c700 1 -- 172.21.15.12:0/1028421331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 msgr2=0x558fd7a948b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.379+0000 7f7c5239c700 1 --2- 172.21.15.12:0/1028421331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7a948b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.379+0000 7f7c5239c700 1 -- 172.21.15.12:0/1028421331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fd785b630 con 0x558fd7a92be0 2023-12-11T20:33:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.379+0000 7f7c5139a700 1 --2- 172.21.15.12:0/1028421331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7a948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.379+0000 7f7c5239c700 1 --2- 172.21.15.12:0/1028421331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a93000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009c60 tx=0x7f7c44009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abdc4116e2fc5320 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.380+0000 7f7c42ffd700 1 -- 172.21.15.12:0/3223221763 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7c48018430 con 0x7f7c4c1014c0 2023-12-11T20:33:10.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.380+0000 7f7c37fff700 1 -- 172.21.15.12:0/1028421331 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44017070 con 0x558fd7a92be0 2023-12-11T20:33:10.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.380+0000 7f7c37fff700 1 -- 172.21.15.12:0/1028421331 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c4400f040 con 0x558fd7a92be0 2023-12-11T20:33:10.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.380+0000 7f7c37fff700 1 -- 172.21.15.12:0/1028421331 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44005810 con 0x558fd7a92be0 2023-12-11T20:33:10.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.381+0000 7f7c6775bb80 1 -- 172.21.15.12:0/1028421331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 msgr2=0x558fd7a93000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.381+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/1028421331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a93000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009c60 tx=0x7f7c44009f70 comp rx=0 tx=0).stop 2023-12-11T20:33:10.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.381+0000 7f7c6775bb80 1 -- 172.21.15.12:0/1028421331 shutdown_connections 2023-12-11T20:33:10.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.381+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/1028421331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a93000 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.381+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/1028421331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7a948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.381+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/1028421331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7a93e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.381+0000 7f7c6775bb80 1 -- 172.21.15.12:0/1028421331 >> 172.21.15.12:0/1028421331 conn(0x558fd79b97e0 msgr2=0x558fd7a86d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.383+0000 7f7c6775bb80 1 -- 172.21.15.12:0/1028421331 shutdown_connections 2023-12-11T20:33:10.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.383+0000 7f7c6775bb80 1 -- 172.21.15.12:0/1028421331 wait complete. 2023-12-11T20:33:10.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.384+0000 7f7c42ffd700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c380a1490 0x7f7c380a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.384+0000 7f7c6775bb80 1 -- start start 2023-12-11T20:33:10.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.384+0000 7f7c42ffd700 1 -- 172.21.15.12:0/3223221763 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c48014070 con 0x7f7c4c1014c0 2023-12-11T20:33:10.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.384+0000 7f7c6775bb80 1 Processor -- start 2023-12-11T20:33:10.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.386+0000 7f7c5239c700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c380a1490 0x7f7c380a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c5239c700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c380a1490 0x7f7c380a3950 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7c44004b10 tx=0x7f7c44004bb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a9ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7a9cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7aa3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd7998560 con 0x558fd7a94430 2023-12-11T20:33:10.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd7998200 con 0x558fd7a92be0 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd785d920 con 0x558fd7a93540 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c6775bb80 10 client.0 _ll_register_callbacks cb 0x558fd78c3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c5239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7aa3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c5239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7aa3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33032/0 (socket says 172.21.15.12:33032) 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.387+0000 7f7c5239c700 1 -- 172.21.15.12:0/729351440 learned_addr learned my addr 172.21.15.12:0/729351440 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.388+0000 7f7c5139a700 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7a9cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.388+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a9ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.388+0000 7f7c5239c700 1 -- 172.21.15.12:0/729351440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 msgr2=0x558fd7a9cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.388+0000 7f7c5239c700 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7a9cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.388+0000 7f7c5239c700 1 -- 172.21.15.12:0/729351440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 msgr2=0x558fd7a9ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.388+0000 7f7c5239c700 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a9ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.388+0000 7f7c5239c700 1 -- 172.21.15.12:0/729351440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c073b80 con 0x558fd7a94430 2023-12-11T20:33:10.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.388+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a9ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:10.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.389+0000 7f7c5239c700 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7aa3f90 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7c44016000 tx=0x7f7c44009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a50cfbe15cc8da server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.389+0000 7f7c357fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:10.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.390+0000 7f7c357fa700 1 -- 172.21.15.12:0/729351440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44017040 con 0x558fd7a94430 2023-12-11T20:33:10.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.390+0000 7f7c357fa700 1 -- 172.21.15.12:0/729351440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c44004050 con 0x558fd7a94430 2023-12-11T20:33:10.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.390+0000 7f7c6775bb80 1 -- 172.21.15.12:0/729351440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fd7a7db40 con 0x558fd7a94430 2023-12-11T20:33:10.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.391+0000 7f7c357fa700 1 -- 172.21.15.12:0/729351440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c44004210 con 0x558fd7a94430 2023-12-11T20:33:10.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.391+0000 7f7c6775bb80 10 client.20310 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:10.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.392+0000 7f7c6775bb80 1 -- 172.21.15.12:0/729351440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f7c440098c0 con 0x558fd7a94430 2023-12-11T20:33:10.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.392+0000 7f7c357fa700 1 -- 172.21.15.12:0/729351440 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558fd7a7db40 con 0x558fd7a94430 2023-12-11T20:33:10.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.392+0000 7f7c357fa700 1 -- 172.21.15.12:0/729351440 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7c4401c870 con 0x558fd7a94430 2023-12-11T20:33:10.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.392+0000 7f7c6775bb80 10 client.20310 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:10.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.392+0000 7f7c6775bb80 10 client.20310 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:33:10.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.392+0000 7f7c6775bb80 20 client.20310 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:10.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.392+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558fd7aa8810 0x558fd7aaac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.393+0000 7f7c6775bb80 4 client.20310 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:10.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.393+0000 7f7c6775bb80 1 -- 172.21.15.12:0/729351440 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fd7a59f40 con 0x558fd7aa8810 2023-12-11T20:33:10.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.393+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558fd7aa8810 0x558fd7aaac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.393+0000 7f7c357fa700 10 client.20310 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:33:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.394+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558fd7aa8810 0x558fd7aaac30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47c3f02002851976 server_cookie=878d995c246abf2e in_seq=0 out_seq=0 2023-12-11T20:33:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.394+0000 7f7c357fa700 1 -- 172.21.15.12:0/729351440 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558fd7a59f40 con 0x558fd7aa8810 2023-12-11T20:33:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.394+0000 7f7c357fa700 10 client.20310 handle_command_reply: tid=0 2023-12-11T20:33:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.394+0000 7f7c6775bb80 1 client.20310 shutdown 2023-12-11T20:33:10.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.395+0000 7f7c6775bb80 1 -- 172.21.15.12:0/729351440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 msgr2=0x558fd7aa3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.395+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7aa3f90 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7c44016000 tx=0x7f7c44009230 comp rx=0 tx=0).stop 2023-12-11T20:33:10.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.395+0000 7f7c6775bb80 1 -- 172.21.15.12:0/729351440 shutdown_connections 2023-12-11T20:33:10.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.395+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558fd7aa8810 0x558fd7aaac30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.395+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a92be0 0x558fd7a9ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.395+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a94430 0x558fd7aa3f90 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.395+0000 7f7c357fa700 0 client.20310 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:33:10.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.396+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/729351440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7a9cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.396+0000 7f7c6775bb80 1 -- 172.21.15.12:0/729351440 >> 172.21.15.12:0/729351440 conn(0x558fd79b97e0 msgr2=0x558fd7a85a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.396+0000 7f7c6775bb80 1 -- 172.21.15.12:0/729351440 shutdown_connections 2023-12-11T20:33:10.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.396+0000 7f7c6775bb80 1 -- 172.21.15.12:0/729351440 wait complete. 2023-12-11T20:33:10.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.396+0000 7f7c6775bb80 20 client.20310 trim_cache size 0 max 16384 2023-12-11T20:33:10.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.431+0000 7f7c6775bb80 1 Processor -- start 2023-12-11T20:33:10.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.431+0000 7f7c6775bb80 1 -- start start 2023-12-11T20:33:10.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.432+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a92be0 0x558fd7a94810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.432+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a93540 0x558fd7aa3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.432+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7a973d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.432+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd7aa8640 con 0x558fd7a93540 2023-12-11T20:33:10.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.432+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd7a7db20 con 0x558fd7a94430 2023-12-11T20:33:10.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.432+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd7a865b0 con 0x558fd7a92be0 2023-12-11T20:33:10.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.432+0000 7f7c51b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a92be0 0x558fd7a94810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.433+0000 7f7c51b9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a92be0 0x558fd7a94810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49592/0 (socket says 172.21.15.12:49592) 2023-12-11T20:33:10.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.433+0000 7f7c5239c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7a973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.433+0000 7f7c5239c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7a973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46762/0 (socket says 172.21.15.12:46762) 2023-12-11T20:33:10.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.433+0000 7f7c5239c700 1 -- 172.21.15.12:0/2080273419 learned_addr learned my addr 172.21.15.12:0/2080273419 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.433+0000 7f7c5139a700 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a93540 0x558fd7aa3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.433+0000 7f7c51b9b700 1 -- 172.21.15.12:0/2080273419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 msgr2=0x558fd7a973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.434+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7a973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.434+0000 7f7c51b9b700 1 -- 172.21.15.12:0/2080273419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a93540 msgr2=0x558fd7aa3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.434+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a93540 0x558fd7aa3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.434+0000 7f7c51b9b700 1 -- 172.21.15.12:0/2080273419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fd7807de0 con 0x558fd7a92be0 2023-12-11T20:33:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.435+0000 7f7c5239c700 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7a973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.435+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a92be0 0x558fd7a94810 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c480caa10 tx=0x7f7c480ca910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d41342ea28d27faa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.435+0000 7f7c40bff700 1 -- 172.21.15.12:0/2080273419 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800cdd0 con 0x558fd7a92be0 2023-12-11T20:33:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.436+0000 7f7c40bff700 1 -- 172.21.15.12:0/2080273419 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c4809a260 con 0x558fd7a92be0 2023-12-11T20:33:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.436+0000 7f7c40bff700 1 -- 172.21.15.12:0/2080273419 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48098600 con 0x558fd7a92be0 2023-12-11T20:33:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.437+0000 7f7c6775bb80 1 -- 172.21.15.12:0/2080273419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a92be0 msgr2=0x558fd7a94810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.437+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a92be0 0x558fd7a94810 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c480caa10 tx=0x7f7c480ca910 comp rx=0 tx=0).stop 2023-12-11T20:33:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.437+0000 7f7c6775bb80 1 -- 172.21.15.12:0/2080273419 shutdown_connections 2023-12-11T20:33:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.438+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7a973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.438+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a92be0 0x558fd7a94810 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.438+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/2080273419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a93540 0x558fd7aa3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.438+0000 7f7c6775bb80 1 -- 172.21.15.12:0/2080273419 >> 172.21.15.12:0/2080273419 conn(0x558fd79b97e0 msgr2=0x558fd7a9ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.438+0000 7f7c6775bb80 1 -- 172.21.15.12:0/2080273419 shutdown_connections 2023-12-11T20:33:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.439+0000 7f7c6775bb80 1 -- 172.21.15.12:0/2080273419 wait complete. 2023-12-11T20:33:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.440+0000 7f7c6775bb80 1 -- start start 2023-12-11T20:33:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.442+0000 7f7c6775bb80 1 Processor -- start 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.442+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a92be0 0x558fd7aa1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.442+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7aa21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.442+0000 7f7c6775bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7aa30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.442+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd7aa3600 con 0x558fd7a92be0 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.442+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd7aa3770 con 0x558fd7a94430 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.442+0000 7f7c6775bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fd7aa38e0 con 0x558fd7a93540 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.442+0000 7f7c6775bb80 10 client.0 _ll_register_callbacks cb 0x558fd78c3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.443+0000 7f7c5139a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7aa21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.443+0000 7f7c5239c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7aa30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.443+0000 7f7c5239c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7aa30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46778/0 (socket says 172.21.15.12:46778) 2023-12-11T20:33:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.443+0000 7f7c5239c700 1 -- 172.21.15.12:0/3137914143 learned_addr learned my addr 172.21.15.12:0/3137914143 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.443+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a92be0 0x558fd7aa1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.443+0000 7f7c5139a700 1 -- 172.21.15.12:0/3137914143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 msgr2=0x558fd7aa30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.444+0000 7f7c5139a700 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7aa30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.444+0000 7f7c5139a700 1 -- 172.21.15.12:0/3137914143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a92be0 msgr2=0x558fd7aa1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.444+0000 7f7c5139a700 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a92be0 0x558fd7aa1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.444+0000 7f7c5139a700 1 -- 172.21.15.12:0/3137914143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c440098c0 con 0x558fd7a93540 2023-12-11T20:33:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.444+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a92be0 0x558fd7aa1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.444+0000 7f7c5139a700 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7aa21a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0098e0 tx=0x7f7c3c0053b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8016baa4a83d6a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.444+0000 7f7c357fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:10.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.446+0000 7f7c357fa700 1 -- 172.21.15.12:0/3137914143 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c01f040 con 0x558fd7a93540 2023-12-11T20:33:10.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.447+0000 7f7c357fa700 1 -- 172.21.15.12:0/3137914143 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c3c003a90 con 0x558fd7a93540 2023-12-11T20:33:10.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.447+0000 7f7c6775bb80 1 -- 172.21.15.12:0/3137914143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c4400f040 con 0x558fd7a93540 2023-12-11T20:33:10.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.447+0000 7f7c357fa700 1 -- 172.21.15.12:0/3137914143 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c3c003c50 con 0x558fd7a93540 2023-12-11T20:33:10.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.447+0000 7f7c6775bb80 10 client.29845 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:10.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.447+0000 7f7c6775bb80 1 -- 172.21.15.12:0/3137914143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f7c48094e70 con 0x558fd7a93540 2023-12-11T20:33:10.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.448+0000 7f7c357fa700 1 -- 172.21.15.12:0/3137914143 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c3c034020 con 0x558fd7a93540 2023-12-11T20:33:10.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.448+0000 7f7c357fa700 1 -- 172.21.15.12:0/3137914143 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7c3c0048b0 con 0x558fd7a93540 2023-12-11T20:33:10.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.448+0000 7f7c6775bb80 10 client.29845 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:10.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.448+0000 7f7c6775bb80 10 client.29845 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:33:10.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.448+0000 7f7c6775bb80 20 client.29845 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:10.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.448+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558fd7aa8810 0x558fd7a8a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.448+0000 7f7c6775bb80 4 client.29845 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:33:10.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.448+0000 7f7c6775bb80 1 -- 172.21.15.12:0/3137914143 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558fd79a4fd0 con 0x558fd7aa8810 2023-12-11T20:33:10.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.449+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558fd7aa8810 0x558fd7a8a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.449+0000 7f7c357fa700 10 client.29845 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:33:10.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.449+0000 7f7c51b9b700 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558fd7aa8810 0x558fd7a8a940 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6414b5df876f06 server_cookie=e3c46272552886b8 in_seq=0 out_seq=0 2023-12-11T20:33:10.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c357fa700 1 -- 172.21.15.12:0/3137914143 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558fd79a4fd0 con 0x558fd7aa8810 2023-12-11T20:33:10.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c357fa700 10 client.29845 handle_command_reply: tid=0 2023-12-11T20:33:10.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 client.29845 shutdown 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 -- 172.21.15.12:0/3137914143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 msgr2=0x558fd7aa21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7aa21a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0098e0 tx=0x7f7c3c0053b0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 -- 172.21.15.12:0/3137914143 shutdown_connections 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x558fd7aa8810 0x558fd7a8a940 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558fd7a94430 0x558fd7aa30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558fd7a92be0 0x558fd7aa1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 --2- 172.21.15.12:0/3137914143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558fd7a93540 0x558fd7aa21a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c6775bb80 1 -- 172.21.15.12:0/3137914143 >> 172.21.15.12:0/3137914143 conn(0x558fd79b97e0 msgr2=0x558fd7a86970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.450+0000 7f7c357fa700 0 client.29845 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.451+0000 7f7c6775bb80 1 -- 172.21.15.12:0/3137914143 shutdown_connections 2023-12-11T20:33:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.451+0000 7f7c6775bb80 1 -- 172.21.15.12:0/3137914143 wait complete. 2023-12-11T20:33:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.451+0000 7f7c6775bb80 20 client.29845 trim_cache size 0 max 16384 2023-12-11T20:33:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:33:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.452+0000 7f7c53dff700 1 -- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c380a1490 msgr2=0x7f7c380a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.452+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c380a1490 0x7f7c380a3950 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7c44004b10 tx=0x7f7c44004bb0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.452+0000 7f7c53dff700 1 -- 172.21.15.12:0/3223221763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c4c1014c0 msgr2=0x7f7c4c199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.452+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c4c1014c0 0x7f7c4c199570 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800e970 tx=0x7f7c4800ed30 comp rx=0 tx=0).stop 2023-12-11T20:33:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.453+0000 7f7c53dff700 1 -- 172.21.15.12:0/3223221763 shutdown_connections 2023-12-11T20:33:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.453+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7c380a1490 0x7f7c380a3950 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.453+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c4c1014c0 0x7f7c4c199570 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.453+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4c103050 0x7f7c4c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.453+0000 7f7c53dff700 1 --2- 172.21.15.12:0/3223221763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c4c1026b0 0x7f7c4c199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.453+0000 7f7c53dff700 1 -- 172.21.15.12:0/3223221763 >> 172.21.15.12:0/3223221763 conn(0x7f7c4c0fca30 msgr2=0x7f7c4c105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.453+0000 7f7c53dff700 1 -- 172.21.15.12:0/3223221763 shutdown_connections 2023-12-11T20:33:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.453+0000 7f7c53dff700 1 -- 172.21.15.12:0/3223221763 wait complete. 2023-12-11T20:33:10.488 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:33:10.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:10 smithi012 ceph-mon[128787]: pgmap v892: 97 pgs: 97 active+clean; 13 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2023-12-11T20:33:10.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.894+0000 7f03ab5ff700 1 -- 172.21.15.12:0/3106739621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4075f90 msgr2=0x7f03a40763b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.894+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/3106739621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4075f90 0x7f03a40763b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009990 tx=0x7f03a0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.894+0000 7f03ab5ff700 1 -- 172.21.15.12:0/3106739621 shutdown_connections 2023-12-11T20:33:10.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.894+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/3106739621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4075f90 0x7f03a40763b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.894+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/3106739621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03a4077b90 0x7f03a4078410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.894+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/3106739621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03a40771d0 0x7f03a4077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.894+0000 7f03ab5ff700 1 -- 172.21.15.12:0/3106739621 >> 172.21.15.12:0/3106739621 conn(0x7f03a40fec80 msgr2=0x7f03a41010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.895+0000 7f03ab5ff700 1 -- 172.21.15.12:0/3106739621 shutdown_connections 2023-12-11T20:33:10.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.896+0000 7f03ab5ff700 1 -- 172.21.15.12:0/3106739621 wait complete. 2023-12-11T20:33:10.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.898+0000 7f03ab5ff700 1 Processor -- start 2023-12-11T20:33:10.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.898+0000 7f03ab5ff700 1 -- start start 2023-12-11T20:33:10.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.898+0000 7f03ab5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03a4075f90 0x7f03a410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.898+0000 7f03ab5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03a40771d0 0x7f03a410e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.898+0000 7f03ab5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4077b90 0x7f03a41adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.898+0000 7f03ab5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4111610 con 0x7f03a4075f90 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.898+0000 7f03ab5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4111780 con 0x7f03a4077b90 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.898+0000 7f03ab5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a41ae000 con 0x7f03a40771d0 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a8b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03a40771d0 0x7f03a410e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4077b90 0x7f03a41adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a939b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03a4075f90 0x7f03a410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4077b90 0x7f03a41adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46788/0 (socket says 172.21.15.12:46788) 2023-12-11T20:33:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 -- 172.21.15.12:0/2162836522 learned_addr learned my addr 172.21.15.12:0/2162836522 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 -- 172.21.15.12:0/2162836522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03a40771d0 msgr2=0x7f03a410e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03a40771d0 0x7f03a410e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 -- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03a4075f90 msgr2=0x7f03a410e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03a4075f90 0x7f03a410e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 -- 172.21.15.12:0/2162836522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c009c40 con 0x7f03a4077b90 2023-12-11T20:33:10.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.899+0000 7f03a9b9c700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4077b90 0x7f03a41adac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f039c00c370 tx=0x7f039c00c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.900+0000 7f039a7fc700 1 -- 172.21.15.12:0/2162836522 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c017070 con 0x7f03a4077b90 2023-12-11T20:33:10.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.900+0000 7f039a7fc700 1 -- 172.21.15.12:0/2162836522 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f039c00f040 con 0x7f03a4077b90 2023-12-11T20:33:10.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.900+0000 7f039a7fc700 1 -- 172.21.15.12:0/2162836522 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c00e050 con 0x7f03a4077b90 2023-12-11T20:33:10.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.900+0000 7f03ab5ff700 1 -- 172.21.15.12:0/2162836522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a00095f0 con 0x7f03a4077b90 2023-12-11T20:33:10.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.900+0000 7f03ab5ff700 1 -- 172.21.15.12:0/2162836522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a41ae560 con 0x7f03a4077b90 2023-12-11T20:33:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.909+0000 7f039a7fc700 1 -- 172.21.15.12:0/2162836522 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f039c00cb00 con 0x7f03a4077b90 2023-12-11T20:33:10.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.912+0000 7f039a7fc700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f03900a15d0 0x7f03900a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.913+0000 7f039a7fc700 1 -- 172.21.15.12:0/2162836522 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f039c0cc5b0 con 0x7f03a4077b90 2023-12-11T20:33:10.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.913+0000 7f03beea5b80 1 Processor -- start 2023-12-11T20:33:10.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.913+0000 7f03a939b700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f03900a15d0 0x7f03900a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.914+0000 7f03beea5b80 1 -- start start 2023-12-11T20:33:10.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c5493d0 0x56446c5497f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c549d30 0x56446c54a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c54b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03a939b700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f03900a15d0 0x7f03900a3a90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f03a0005910 tx=0x7f03a0005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03beea5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c4a4b50 con 0x56446c54ac20 2023-12-11T20:33:10.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03a8b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c549d30 0x56446c54a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03a9b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c54b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03a8b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c549d30 0x56446c54a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49630/0 (socket says 172.21.15.12:49630) 2023-12-11T20:33:10.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03a8b9a700 1 -- 172.21.15.12:0/3705068636 learned_addr learned my addr 172.21.15.12:0/3705068636 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03beea5b80 1 -- 172.21.15.12:0/3705068636 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c4a2470 con 0x56446c5493d0 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.915+0000 7f03beea5b80 1 -- 172.21.15.12:0/3705068636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c49dd60 con 0x56446c549d30 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.916+0000 7f03a939b700 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c5493d0 0x56446c5497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.916+0000 7f03a8b9a700 1 -- 172.21.15.12:0/3705068636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c5493d0 msgr2=0x56446c5497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.916+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c5493d0 0x56446c5497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.916+0000 7f03a8b9a700 1 -- 172.21.15.12:0/3705068636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 msgr2=0x56446c54b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.916+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c54b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.916+0000 7f03a8b9a700 1 -- 172.21.15.12:0/3705068636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56446c31a630 con 0x56446c549d30 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.916+0000 7f03a9b9c700 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c54b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.916+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c549d30 0x56446c54a640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f039400bd70 tx=0x7f03940106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbd19ac90ccf6d8a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.917+0000 7f038f7fe700 1 -- 172.21.15.12:0/3705068636 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394010e10 con 0x56446c549d30 2023-12-11T20:33:10.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.917+0000 7f038f7fe700 1 -- 172.21.15.12:0/3705068636 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0394015070 con 0x56446c549d30 2023-12-11T20:33:10.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.917+0000 7f038f7fe700 1 -- 172.21.15.12:0/3705068636 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940116a0 con 0x56446c549d30 2023-12-11T20:33:10.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.918+0000 7f03beea5b80 1 -- 172.21.15.12:0/3705068636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c549d30 msgr2=0x56446c54a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.918+0000 7f03beea5b80 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c549d30 0x56446c54a640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f039400bd70 tx=0x7f03940106b0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.919+0000 7f03beea5b80 1 -- 172.21.15.12:0/3705068636 shutdown_connections 2023-12-11T20:33:10.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.919+0000 7f03beea5b80 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c5493d0 0x56446c5497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.919+0000 7f03beea5b80 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c54b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.919+0000 7f03beea5b80 1 --2- 172.21.15.12:0/3705068636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c549d30 0x56446c54a640 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.919+0000 7f03beea5b80 1 -- 172.21.15.12:0/3705068636 >> 172.21.15.12:0/3705068636 conn(0x56446c4787e0 msgr2=0x56446c545d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.919+0000 7f03beea5b80 1 -- 172.21.15.12:0/3705068636 shutdown_connections 2023-12-11T20:33:10.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.919+0000 7f03beea5b80 1 -- 172.21.15.12:0/3705068636 wait complete. 2023-12-11T20:33:10.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.920+0000 7f03beea5b80 1 -- start start 2023-12-11T20:33:10.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.921+0000 7f03beea5b80 1 Processor -- start 2023-12-11T20:33:10.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c5531d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 0x56446c553710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c55a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03beea5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c457560 con 0x56446c549d30 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03beea5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c457200 con 0x56446c54ac20 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03beea5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c31c920 con 0x56446c5493d0 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03beea5b80 10 client.0 _ll_register_callbacks cb 0x56446c382a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03a939b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c5531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03a939b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c5531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49640/0 (socket says 172.21.15.12:49640) 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.922+0000 7f03a939b700 1 -- 172.21.15.12:0/2416804852 learned_addr learned my addr 172.21.15.12:0/2416804852 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.923+0000 7f03a9b9c700 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c55a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.923+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 0x56446c553710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.923+0000 7f03a8b9a700 1 -- 172.21.15.12:0/2416804852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 msgr2=0x56446c5531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.923+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c5531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.923+0000 7f03a8b9a700 1 -- 172.21.15.12:0/2416804852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 msgr2=0x56446c55a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.923+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c55a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.924+0000 7f03a8b9a700 1 -- 172.21.15.12:0/2416804852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a41ae560 con 0x56446c549d30 2023-12-11T20:33:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.924+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 0x56446c553710 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f039400bd40 tx=0x7f039401c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd14c808ca613cbe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.924+0000 7f038cff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.925+0000 7f038cff9700 1 -- 172.21.15.12:0/2416804852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394020070 con 0x56446c549d30 2023-12-11T20:33:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.926+0000 7f038cff9700 1 -- 172.21.15.12:0/2416804852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0394017070 con 0x56446c549d30 2023-12-11T20:33:10.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.926+0000 7f03beea5b80 1 -- 172.21.15.12:0/2416804852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56446c53cb40 con 0x56446c549d30 2023-12-11T20:33:10.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.927+0000 7f038cff9700 1 -- 172.21.15.12:0/2416804852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f039400bec0 con 0x56446c549d30 2023-12-11T20:33:10.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.928+0000 7f03beea5b80 10 client.20325 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:10.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.928+0000 7f03beea5b80 1 -- 172.21.15.12:0/2416804852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f039400b9a0 con 0x56446c549d30 2023-12-11T20:33:10.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.929+0000 7f038cff9700 1 -- 172.21.15.12:0/2416804852 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56446c53cb40 con 0x56446c549d30 2023-12-11T20:33:10.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.929+0000 7f038cff9700 1 -- 172.21.15.12:0/2416804852 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0394004750 con 0x56446c549d30 2023-12-11T20:33:10.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.930+0000 7f03beea5b80 10 client.20325 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:10.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.930+0000 7f03beea5b80 10 client.20325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:10.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.930+0000 7f03beea5b80 20 client.20325 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:10.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.930+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56446c55edb0 0x56446c5611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.930+0000 7f03beea5b80 4 client.20325 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:10.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.930+0000 7f03beea5b80 1 -- 172.21.15.12:0/2416804852 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56446c518f40 con 0x56446c55edb0 2023-12-11T20:33:10.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.931+0000 7f03a939b700 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56446c55edb0 0x56446c5611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.931+0000 7f038cff9700 10 client.20325 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:10.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.931+0000 7f03a939b700 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56446c55edb0 0x56446c5611d0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba5d23da8847f903 server_cookie=938d5218f7dee91f in_seq=0 out_seq=0 2023-12-11T20:33:10.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.932+0000 7f038cff9700 1 -- 172.21.15.12:0/2416804852 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56446c518f40 con 0x56446c55edb0 2023-12-11T20:33:10.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.933+0000 7f038cff9700 10 client.20325 handle_command_reply: tid=0 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.933+0000 7f03beea5b80 1 client.20325 shutdown 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.935+0000 7f03beea5b80 1 -- 172.21.15.12:0/2416804852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 msgr2=0x56446c553710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.935+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 0x56446c553710 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f039400bd40 tx=0x7f039401c6b0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.936+0000 7f03beea5b80 1 -- 172.21.15.12:0/2416804852 shutdown_connections 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.936+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56446c55edb0 0x56446c5611d0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.936+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c55a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.936+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c5531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.936+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2416804852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 0x56446c553710 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.936+0000 7f03beea5b80 1 -- 172.21.15.12:0/2416804852 >> 172.21.15.12:0/2416804852 conn(0x56446c4787e0 msgr2=0x56446c544a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.936+0000 7f038cff9700 0 client.20325 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:10.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.937+0000 7f03beea5b80 1 -- 172.21.15.12:0/2416804852 shutdown_connections 2023-12-11T20:33:10.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.937+0000 7f03beea5b80 1 -- 172.21.15.12:0/2416804852 wait complete. 2023-12-11T20:33:10.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.937+0000 7f03beea5b80 20 client.20325 trim_cache size 0 max 16384 2023-12-11T20:33:10.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:10 smithi032 ceph-mon[132488]: pgmap v892: 97 pgs: 97 active+clean; 13 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2023-12-11T20:33:10.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.972+0000 7f03beea5b80 1 Processor -- start 2023-12-11T20:33:10.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.973+0000 7f03beea5b80 1 -- start start 2023-12-11T20:33:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.973+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c54b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.973+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 0x56446c55a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.973+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c5531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.973+0000 7f03beea5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c554120 con 0x56446c549d30 2023-12-11T20:33:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.973+0000 7f03beea5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c55b900 con 0x56446c54ac20 2023-12-11T20:33:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.973+0000 7f03beea5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c5663e0 con 0x56446c5493d0 2023-12-11T20:33:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a9b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c5531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a9b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c5531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46812/0 (socket says 172.21.15.12:46812) 2023-12-11T20:33:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a9b9c700 1 -- 172.21.15.12:0/2948189971 learned_addr learned my addr 172.21.15.12:0/2948189971 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a939b700 1 --2- 172.21.15.12:0/2948189971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c54b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a939b700 1 -- 172.21.15.12:0/2948189971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 msgr2=0x56446c5531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a939b700 1 --2- 172.21.15.12:0/2948189971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c5531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a939b700 1 -- 172.21.15.12:0/2948189971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 msgr2=0x56446c55a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a939b700 1 --2- 172.21.15.12:0/2948189971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 0x56446c55a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.974+0000 7f03a939b700 1 -- 172.21.15.12:0/2948189971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56446c2c6de0 con 0x56446c5493d0 2023-12-11T20:33:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.975+0000 7f03a939b700 1 --2- 172.21.15.12:0/2948189971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c54b000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x56446c561ad0 tx=0x7f03a0020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f54d990b9dde1c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.975+0000 7f038ffff700 1 -- 172.21.15.12:0/2948189971 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0003ae0 con 0x56446c5493d0 2023-12-11T20:33:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.975+0000 7f038ffff700 1 -- 172.21.15.12:0/2948189971 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03a001e040 con 0x56446c5493d0 2023-12-11T20:33:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.975+0000 7f038ffff700 1 -- 172.21.15.12:0/2948189971 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00352a0 con 0x56446c5493d0 2023-12-11T20:33:10.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.976+0000 7f03beea5b80 1 -- 172.21.15.12:0/2948189971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 msgr2=0x56446c54b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.976+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2948189971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c54b000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x56446c561ad0 tx=0x7f03a0020000 comp rx=0 tx=0).stop 2023-12-11T20:33:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.976+0000 7f03beea5b80 1 -- 172.21.15.12:0/2948189971 shutdown_connections 2023-12-11T20:33:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.976+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2948189971 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c54ac20 0x56446c5531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.977+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2948189971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c54b000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.977+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2948189971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c549d30 0x56446c55a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.977+0000 7f03beea5b80 1 -- 172.21.15.12:0/2948189971 >> 172.21.15.12:0/2948189971 conn(0x56446c4787e0 msgr2=0x56446c551e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.977+0000 7f03beea5b80 1 -- 172.21.15.12:0/2948189971 shutdown_connections 2023-12-11T20:33:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.977+0000 7f03beea5b80 1 -- 172.21.15.12:0/2948189971 wait complete. 2023-12-11T20:33:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.978+0000 7f03beea5b80 1 -- start start 2023-12-11T20:33:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.978+0000 7f03beea5b80 1 Processor -- start 2023-12-11T20:33:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c556230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c549d30 0x56446c556770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03beea5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c559790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03beea5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c559cd0 con 0x56446c54ac20 2023-12-11T20:33:10.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03beea5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c559e40 con 0x56446c549d30 2023-12-11T20:33:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03beea5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56446c55a000 con 0x56446c5493d0 2023-12-11T20:33:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03beea5b80 10 client.0 _ll_register_callbacks cb 0x56446c382a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03a9b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c559790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03a9b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c559790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33100/0 (socket says 172.21.15.12:33100) 2023-12-11T20:33:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.981+0000 7f03a9b9c700 1 -- 172.21.15.12:0/2997862988 learned_addr learned my addr 172.21.15.12:0/2997862988 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.983+0000 7f03a939b700 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c556230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.983+0000 7f03a939b700 1 -- 172.21.15.12:0/2997862988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c549d30 msgr2=0x56446c556770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.983+0000 7f03a939b700 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c549d30 0x56446c556770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.983+0000 7f03a939b700 1 -- 172.21.15.12:0/2997862988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 msgr2=0x56446c559790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.983+0000 7f03a939b700 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c559790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.983+0000 7f03a939b700 1 -- 172.21.15.12:0/2997862988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a002c040 con 0x56446c5493d0 2023-12-11T20:33:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.984+0000 7f03a939b700 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c556230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f03a0004190 tx=0x7f03a0005810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2e7f76baaacf066 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.984+0000 7f038cff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.985+0000 7f038cff9700 1 -- 172.21.15.12:0/2997862988 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0029040 con 0x56446c5493d0 2023-12-11T20:33:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.985+0000 7f038cff9700 1 -- 172.21.15.12:0/2997862988 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f03a000b710 con 0x56446c5493d0 2023-12-11T20:33:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.985+0000 7f03beea5b80 1 -- 172.21.15.12:0/2997862988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0394015070 con 0x56446c5493d0 2023-12-11T20:33:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.986+0000 7f038cff9700 1 -- 172.21.15.12:0/2997862988 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03a0003d10 con 0x56446c5493d0 2023-12-11T20:33:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.986+0000 7f03beea5b80 10 client.29863 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.986+0000 7f03beea5b80 1 -- 172.21.15.12:0/2997862988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56446c2afc60 con 0x56446c5493d0 2023-12-11T20:33:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.986+0000 7f038cff9700 1 -- 172.21.15.12:0/2997862988 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0394015070 con 0x56446c5493d0 2023-12-11T20:33:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.986+0000 7f038cff9700 1 -- 172.21.15.12:0/2997862988 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f03a0004500 con 0x56446c5493d0 2023-12-11T20:33:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.987+0000 7f03beea5b80 10 client.29863 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.987+0000 7f03beea5b80 10 client.29863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.987+0000 7f03beea5b80 20 client.29863 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.987+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56446c5b5a10 0x56446c5b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.987+0000 7f03beea5b80 4 client.29863 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:33:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.987+0000 7f03beea5b80 1 -- 172.21.15.12:0/2997862988 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56446c463fd0 con 0x56446c5b5a10 2023-12-11T20:33:10.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.987+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56446c5b5a10 0x56446c5b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03a8b9a700 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56446c5b5a10 0x56446c5b7e30 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad3038153ca5b3e8 server_cookie=d7d2f903586c3362 in_seq=0 out_seq=0 2023-12-11T20:33:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f038cff9700 10 client.29863 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f038cff9700 1 -- 172.21.15.12:0/2997862988 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56446c463fd0 con 0x56446c5b5a10 2023-12-11T20:33:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f038cff9700 10 client.29863 handle_command_reply: tid=0 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 client.29863 shutdown 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 -- 172.21.15.12:0/2997862988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 msgr2=0x56446c556230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c556230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f03a0004190 tx=0x7f03a0005810 comp rx=0 tx=0).stop 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 -- 172.21.15.12:0/2997862988 shutdown_connections 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56446c5b5a10 0x56446c5b7e30 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f038cff9700 0 client.29863 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56446c54ac20 0x56446c559790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56446c5493d0 0x56446c556230 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 --2- 172.21.15.12:0/2997862988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56446c549d30 0x56446c556770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.988+0000 7f03beea5b80 1 -- 172.21.15.12:0/2997862988 >> 172.21.15.12:0/2997862988 conn(0x56446c4787e0 msgr2=0x56446c54db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.989+0000 7f03beea5b80 1 -- 172.21.15.12:0/2997862988 shutdown_connections 2023-12-11T20:33:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.989+0000 7f03beea5b80 1 -- 172.21.15.12:0/2997862988 wait complete. 2023-12-11T20:33:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.989+0000 7f03beea5b80 20 client.29863 trim_cache size 0 max 16384 2023-12-11T20:33:10.988 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 -- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f03900a15d0 msgr2=0x7f03900a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f03900a15d0 0x7f03900a3a90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f03a0005910 tx=0x7f03a0005fb0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 -- 172.21.15.12:0/2162836522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4077b90 msgr2=0x7f03a41adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4077b90 0x7f03a41adac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f039c00c370 tx=0x7f039c00c680 comp rx=0 tx=0).stop 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 -- 172.21.15.12:0/2162836522 shutdown_connections 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f03900a15d0 0x7f03900a3a90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03a4077b90 0x7f03a41adac0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03a4075f90 0x7f03a410e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 --2- 172.21.15.12:0/2162836522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03a40771d0 0x7f03a410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.990+0000 7f03ab5ff700 1 -- 172.21.15.12:0/2162836522 >> 172.21.15.12:0/2162836522 conn(0x7f03a40fec80 msgr2=0x7f03a4101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:10.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.991+0000 7f03ab5ff700 1 -- 172.21.15.12:0/2162836522 shutdown_connections 2023-12-11T20:33:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:10.991+0000 7f03ab5ff700 1 -- 172.21.15.12:0/2162836522 wait complete. 2023-12-11T20:33:11.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:10 smithi039 ceph-mon[102205]: pgmap v892: 97 pgs: 97 active+clean; 13 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2023-12-11T20:33:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.460+0000 7fa9575ff700 1 -- 172.21.15.12:0/2851775910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9501026a0 msgr2=0x7fa950104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.460+0000 7fa9575ff700 1 --2- 172.21.15.12:0/2851775910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9501026a0 0x7fa950104b30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa940009990 tx=0x7fa940009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.461+0000 7fa9575ff700 1 -- 172.21.15.12:0/2851775910 shutdown_connections 2023-12-11T20:33:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.461+0000 7fa9575ff700 1 --2- 172.21.15.12:0/2851775910 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9500ffd30 0x7fa950102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.461+0000 7fa9575ff700 1 --2- 172.21.15.12:0/2851775910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa950105070 0x7fa9501054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.461+0000 7fa9575ff700 1 --2- 172.21.15.12:0/2851775910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa9501026a0 0x7fa950104b30 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa940009990 tx=0x7fa940009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.461+0000 7fa9575ff700 1 -- 172.21.15.12:0/2851775910 >> 172.21.15.12:0/2851775910 conn(0x7fa9500fb930 msgr2=0x7fa9500fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.462+0000 7fa9575ff700 1 -- 172.21.15.12:0/2851775910 shutdown_connections 2023-12-11T20:33:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.462+0000 7fa9575ff700 1 -- 172.21.15.12:0/2851775910 wait complete. 2023-12-11T20:33:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.464+0000 7fa9575ff700 1 Processor -- start 2023-12-11T20:33:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.465+0000 7fa9575ff700 1 -- start start 2023-12-11T20:33:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.466+0000 7fa9575ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9500ffd30 0x7fa95019dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.466+0000 7fa9575ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa950105070 0x7fa95019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.466+0000 7fa9575ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9501a3030 0x7fa9501a5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.466+0000 7fa954b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa950105070 0x7fa95019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.466+0000 7fa95539b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9500ffd30 0x7fa95019dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.466+0000 7fa954b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa950105070 0x7fa95019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49692/0 (socket says 172.21.15.12:49692) 2023-12-11T20:33:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.466+0000 7fa95539b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9500ffd30 0x7fa95019dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46838/0 (socket says 172.21.15.12:46838) 2023-12-11T20:33:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.467+0000 7fa955b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9501a3030 0x7fa9501a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.467+0000 7fa9575ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a59f0 con 0x7fa9501a3030 2023-12-11T20:33:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.467+0000 7fa9575ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a5b30 con 0x7fa9500ffd30 2023-12-11T20:33:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.467+0000 7fa9575ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a5cc0 con 0x7fa950105070 2023-12-11T20:33:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.467+0000 7fa955b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9501a3030 0x7fa9501a5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33114/0 (socket says 172.21.15.12:33114) 2023-12-11T20:33:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.467+0000 7fa954b9a700 1 -- 172.21.15.12:0/1557160943 learned_addr learned my addr 172.21.15.12:0/1557160943 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.468+0000 7fa954b9a700 1 -- 172.21.15.12:0/1557160943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9500ffd30 msgr2=0x7fa95019dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.468+0000 7fa954b9a700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9500ffd30 0x7fa95019dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.468+0000 7fa954b9a700 1 -- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9501a3030 msgr2=0x7fa9501a5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.468+0000 7fa954b9a700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9501a3030 0x7fa9501a5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.468+0000 7fa954b9a700 1 -- 172.21.15.12:0/1557160943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9400095f0 con 0x7fa950105070 2023-12-11T20:33:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.468+0000 7fa955b9c700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9501a3030 0x7fa9501a5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.468+0000 7fa954b9a700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa950105070 0x7fa95019e020 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa9400098e0 tx=0x7fa940005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.469+0000 7fa9467fc700 1 -- 172.21.15.12:0/1557160943 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94001d070 con 0x7fa950105070 2023-12-11T20:33:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.469+0000 7fa9575ff700 1 -- 172.21.15.12:0/1557160943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9501a5f40 con 0x7fa950105070 2023-12-11T20:33:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.469+0000 7fa9467fc700 1 -- 172.21.15.12:0/1557160943 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa94000bde0 con 0x7fa950105070 2023-12-11T20:33:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.469+0000 7fa9467fc700 1 -- 172.21.15.12:0/1557160943 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000fdf0 con 0x7fa950105070 2023-12-11T20:33:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.469+0000 7fa9575ff700 1 -- 172.21.15.12:0/1557160943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9501a62b0 con 0x7fa950105070 2023-12-11T20:33:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.474+0000 7fa9467fc700 1 -- 172.21.15.12:0/1557160943 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa94000f5f0 con 0x7fa950105070 2023-12-11T20:33:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.477+0000 7fa9467fc700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa93c0a14f0 0x7fa93c0a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.477+0000 7fa9467fc700 1 -- 172.21.15.12:0/1557160943 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa9400cddd0 con 0x7fa950105070 2023-12-11T20:33:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.477+0000 7fa95539b700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa93c0a14f0 0x7fa93c0a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.477+0000 7fa96ae2bb80 1 Processor -- start 2023-12-11T20:33:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa96ae2bb80 1 -- start start 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d86925f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d869260140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d869260ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8691baaf0 con 0x55d86925eed0 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8691b8410 con 0x55d869260720 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8691b3d00 con 0x55d86925f830 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa95539b700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa93c0a14f0 0x7fa93c0a39b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00ac50 tx=0x7fa94c00a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa955b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d869260ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa955b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d869260ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46848/0 (socket says 172.21.15.12:46848) 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.478+0000 7fa955b9c700 1 -- 172.21.15.12:0/2247912936 learned_addr learned my addr 172.21.15.12:0/2247912936 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.479+0000 7fa95539b700 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d86925f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.479+0000 7fa954b9a700 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d869260140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.479+0000 7fa955b9c700 1 -- 172.21.15.12:0/2247912936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 msgr2=0x55d869260140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:11.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.479+0000 7fa955b9c700 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d869260140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.479+0000 7fa955b9c700 1 -- 172.21.15.12:0/2247912936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 msgr2=0x55d86925f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:11.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.479+0000 7fa955b9c700 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d86925f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.479+0000 7fa955b9c700 1 -- 172.21.15.12:0/2247912936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8690305d0 con 0x55d869260720 2023-12-11T20:33:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.480+0000 7fa955b9c700 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d869260ba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa948003eb0 tx=0x7fa948009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae96332553c409a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.480+0000 7fa93b7fe700 1 -- 172.21.15.12:0/2247912936 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9480092d0 con 0x55d869260720 2023-12-11T20:33:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.480+0000 7fa93b7fe700 1 -- 172.21.15.12:0/2247912936 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa94800f040 con 0x55d869260720 2023-12-11T20:33:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.480+0000 7fa93b7fe700 1 -- 172.21.15.12:0/2247912936 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800e750 con 0x55d869260720 2023-12-11T20:33:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/2247912936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 msgr2=0x55d869260ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d869260ba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa948003eb0 tx=0x7fa948009920 comp rx=0 tx=0).stop 2023-12-11T20:33:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/2247912936 shutdown_connections 2023-12-11T20:33:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d869260ba0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d86925f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/2247912936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d869260140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/2247912936 >> 172.21.15.12:0/2247912936 conn(0x55d86918e780 msgr2=0x55d86925b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/2247912936 shutdown_connections 2023-12-11T20:33:11.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.481+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/2247912936 wait complete. 2023-12-11T20:33:11.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.482+0000 7fa96ae2bb80 1 -- start start 2023-12-11T20:33:11.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.482+0000 7fa96ae2bb80 1 Processor -- start 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.485+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869279ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925f830 0x55d86927a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d869260720 0x55d869281250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86916d500 con 0x55d86925eed0 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86916d1a0 con 0x55d86925f830 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8690328c0 con 0x55d869260720 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa96ae2bb80 10 client.0 _ll_register_callbacks cb 0x55d869098a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa95539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869279ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa95539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869279ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33122/0 (socket says 172.21.15.12:33122) 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa95539b700 1 -- 172.21.15.12:0/3844562422 learned_addr learned my addr 172.21.15.12:0/3844562422 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa954b9a700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925f830 0x55d86927a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.486+0000 7fa955b9c700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d869260720 0x55d869281250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa95539b700 1 -- 172.21.15.12:0/3844562422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d869260720 msgr2=0x55d869281250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa95539b700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d869260720 0x55d869281250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa95539b700 1 -- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925f830 msgr2=0x55d86927a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa95539b700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925f830 0x55d86927a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa95539b700 1 -- 172.21.15.12:0/3844562422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa948003b90 con 0x55d86925eed0 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa955b9c700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d869260720 0x55d869281250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa954b9a700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925f830 0x55d86927a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa95539b700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869279ee0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fa94c003930 tx=0x7fa94c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e260bdecf12aa634 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa938ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa938ff9700 1 -- 172.21.15.12:0/3844562422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00fd10 con 0x55d86925eed0 2023-12-11T20:33:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa938ff9700 1 -- 172.21.15.12:0/3844562422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa94c010ac0 con 0x55d86925eed0 2023-12-11T20:33:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.487+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/3844562422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d869252730 con 0x55d86925eed0 2023-12-11T20:33:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.488+0000 7fa938ff9700 1 -- 172.21.15.12:0/3844562422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa94c010c80 con 0x55d86925eed0 2023-12-11T20:33:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.488+0000 7fa96ae2bb80 10 client.20340 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.488+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/3844562422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d868fdcd80 con 0x55d86925eed0 2023-12-11T20:33:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.488+0000 7fa938ff9700 1 -- 172.21.15.12:0/3844562422 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d869252730 con 0x55d86925eed0 2023-12-11T20:33:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.488+0000 7fa938ff9700 1 -- 172.21.15.12:0/3844562422 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa94c01e410 con 0x55d86925eed0 2023-12-11T20:33:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.488+0000 7fa96ae2bb80 10 client.20340 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.489+0000 7fa96ae2bb80 10 client.20340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.489+0000 7fa96ae2bb80 20 client.20340 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.489+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d869285e40 0x55d869288260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.489+0000 7fa96ae2bb80 4 client.20340 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.489+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/3844562422 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d86922eee0 con 0x55d869285e40 2023-12-11T20:33:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.489+0000 7fa954b9a700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d869285e40 0x55d869288260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.490+0000 7fa938ff9700 10 client.20340 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.490+0000 7fa954b9a700 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d869285e40 0x55d869288260 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce0ceaca2c113f1 server_cookie=94e3c0d39584df4 in_seq=0 out_seq=0 2023-12-11T20:33:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.491+0000 7fa938ff9700 1 -- 172.21.15.12:0/3844562422 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d86922eee0 con 0x55d869285e40 2023-12-11T20:33:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.491+0000 7fa938ff9700 10 client.20340 handle_command_reply: tid=0 2023-12-11T20:33:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.491+0000 7fa96ae2bb80 1 client.20340 shutdown 2023-12-11T20:33:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.491+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/3844562422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 msgr2=0x55d869279ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.491+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869279ee0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fa94c003930 tx=0x7fa94c0047c0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/3844562422 shutdown_connections 2023-12-11T20:33:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d869285e40 0x55d869288260 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d869260720 0x55d869281250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa938ff9700 0 client.20340 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869279ee0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/3844562422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925f830 0x55d86927a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/3844562422 >> 172.21.15.12:0/3844562422 conn(0x55d86918e780 msgr2=0x55d869259ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/3844562422 shutdown_connections 2023-12-11T20:33:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/3844562422 wait complete. 2023-12-11T20:33:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.492+0000 7fa96ae2bb80 20 client.20340 trim_cache size 0 max 16384 2023-12-11T20:33:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.525+0000 7fa96ae2bb80 1 Processor -- start 2023-12-11T20:33:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.525+0000 7fa96ae2bb80 1 -- start start 2023-12-11T20:33:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925eed0 0x55d86925a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d8692811e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d869260720 0x55d869260b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d869279840 con 0x55d869260720 2023-12-11T20:33:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d869281850 con 0x55d86925eed0 2023-12-11T20:33:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86928d470 con 0x55d86925f830 2023-12-11T20:33:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa955b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d869260720 0x55d869260b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa955b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d869260720 0x55d869260b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33132/0 (socket says 172.21.15.12:33132) 2023-12-11T20:33:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa955b9c700 1 -- 172.21.15.12:0/1040546340 learned_addr learned my addr 172.21.15.12:0/1040546340 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa95539b700 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925eed0 0x55d86925a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.526+0000 7fa954b9a700 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d8692811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.527+0000 7fa95539b700 1 -- 172.21.15.12:0/1040546340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 msgr2=0x55d8692811e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.527+0000 7fa95539b700 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d8692811e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.527+0000 7fa95539b700 1 -- 172.21.15.12:0/1040546340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d869260720 msgr2=0x55d869260b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.527+0000 7fa95539b700 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d869260720 0x55d869260b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.527+0000 7fa95539b700 1 -- 172.21.15.12:0/1040546340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d868fc5c00 con 0x55d86925eed0 2023-12-11T20:33:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.527+0000 7fa954b9a700 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d8692811e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.527+0000 7fa955b9c700 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d869260720 0x55d869260b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.528+0000 7fa95539b700 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925eed0 0x55d86925a3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa94c010710 tx=0x7fa94c00fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51d20a7922144c80 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.528+0000 7fa93bfff700 1 -- 172.21.15.12:0/1040546340 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00fd10 con 0x55d86925eed0 2023-12-11T20:33:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.528+0000 7fa93bfff700 1 -- 172.21.15.12:0/1040546340 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa94c02c030 con 0x55d86925eed0 2023-12-11T20:33:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.528+0000 7fa93bfff700 1 -- 172.21.15.12:0/1040546340 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c0276d0 con 0x55d86925eed0 2023-12-11T20:33:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.531+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/1040546340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925eed0 msgr2=0x55d86925a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.531+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925eed0 0x55d86925a3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa94c010710 tx=0x7fa94c00fa70 comp rx=0 tx=0).stop 2023-12-11T20:33:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.531+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/1040546340 shutdown_connections 2023-12-11T20:33:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.532+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d86925eed0 0x55d86925a3b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.532+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d869260720 0x55d869260b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.532+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/1040546340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d8692811e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.532+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/1040546340 >> 172.21.15.12:0/1040546340 conn(0x55d86918e780 msgr2=0x55d869259ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.532+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/1040546340 shutdown_connections 2023-12-11T20:33:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.533+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/1040546340 wait complete. 2023-12-11T20:33:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.533+0000 7fa96ae2bb80 1 -- start start 2023-12-11T20:33:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.534+0000 7fa96ae2bb80 1 Processor -- start 2023-12-11T20:33:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.537+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869280990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.537+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d869280ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.537+0000 7fa96ae2bb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d86927eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.537+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86927f530 con 0x55d86925eed0 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.537+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86927f670 con 0x55d869260720 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.537+0000 7fa96ae2bb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86927f830 con 0x55d86925f830 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.537+0000 7fa96ae2bb80 10 client.0 _ll_register_callbacks cb 0x55d869098a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa955b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d86927eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa955b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d86927eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46876/0 (socket says 172.21.15.12:46876) 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa955b9c700 1 -- 172.21.15.12:0/440932806 learned_addr learned my addr 172.21.15.12:0/440932806 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa954b9a700 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d869280ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa95539b700 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869280990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa955b9c700 1 -- 172.21.15.12:0/440932806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 msgr2=0x55d869280ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa955b9c700 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d869280ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa955b9c700 1 -- 172.21.15.12:0/440932806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 msgr2=0x55d869280990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa955b9c700 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869280990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.538+0000 7fa955b9c700 1 -- 172.21.15.12:0/440932806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8690305d0 con 0x55d869260720 2023-12-11T20:33:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.539+0000 7fa955b9c700 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d86927eff0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa948004bd0 tx=0x7fa948004cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4435c8323cfec104 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.539+0000 7fa938ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.540+0000 7fa938ff9700 1 -- 172.21.15.12:0/440932806 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948023070 con 0x55d869260720 2023-12-11T20:33:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.540+0000 7fa938ff9700 1 -- 172.21.15.12:0/440932806 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa948007710 con 0x55d869260720 2023-12-11T20:33:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.540+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/440932806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa94800f040 con 0x55d869260720 2023-12-11T20:33:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.540+0000 7fa938ff9700 1 -- 172.21.15.12:0/440932806 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa948004e80 con 0x55d869260720 2023-12-11T20:33:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.541+0000 7fa96ae2bb80 10 client.29876 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.541+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/440932806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d868fdcd80 con 0x55d869260720 2023-12-11T20:33:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.541+0000 7fa938ff9700 1 -- 172.21.15.12:0/440932806 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa948036080 con 0x55d869260720 2023-12-11T20:33:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.541+0000 7fa938ff9700 1 -- 172.21.15.12:0/440932806 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa94800ea50 con 0x55d869260720 2023-12-11T20:33:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.541+0000 7fa96ae2bb80 10 client.29876 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.542+0000 7fa96ae2bb80 10 client.29876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.542+0000 7fa96ae2bb80 20 client.29876 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.542+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8692dd580 0x55d8692df9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.542+0000 7fa96ae2bb80 4 client.29876 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:33:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.542+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/440932806 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d869179f70 con 0x55d8692dd580 2023-12-11T20:33:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.542+0000 7fa95539b700 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8692dd580 0x55d8692df9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.543+0000 7fa938ff9700 10 client.29876 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.543+0000 7fa95539b700 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8692dd580 0x55d8692df9a0 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d576e30b8cebda server_cookie=385880e5138b2e4a in_seq=0 out_seq=0 2023-12-11T20:33:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.557+0000 7fa938ff9700 1 -- 172.21.15.12:0/440932806 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d869179f70 con 0x55d8692dd580 2023-12-11T20:33:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.557+0000 7fa938ff9700 10 client.29876 handle_command_reply: tid=0 2023-12-11T20:33:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.557+0000 7fa96ae2bb80 1 client.29876 shutdown 2023-12-11T20:33:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.557+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/440932806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 msgr2=0x55d86927eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.557+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d86927eff0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa948004bd0 tx=0x7fa948004cb0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.558+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/440932806 shutdown_connections 2023-12-11T20:33:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.558+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55d8692dd580 0x55d8692df9a0 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.558+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55d869260720 0x55d86927eff0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.558+0000 7fa938ff9700 0 client.29876 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.558+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d86925eed0 0x55d869280990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.558+0000 7fa96ae2bb80 1 --2- 172.21.15.12:0/440932806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d86925f830 0x55d869280ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.558+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/440932806 >> 172.21.15.12:0/440932806 conn(0x55d86918e780 msgr2=0x55d869279c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.559+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/440932806 shutdown_connections 2023-12-11T20:33:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.559+0000 7fa96ae2bb80 1 -- 172.21.15.12:0/440932806 wait complete. 2023-12-11T20:33:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.559+0000 7fa96ae2bb80 20 client.29876 trim_cache size 0 max 16384 2023-12-11T20:33:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:33:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:33:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:33:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 -- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa93c0a14f0 msgr2=0x7fa93c0a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa93c0a14f0 0x7fa93c0a39b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00ac50 tx=0x7fa94c00a380 comp rx=0 tx=0).stop 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 -- 172.21.15.12:0/1557160943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa950105070 msgr2=0x7fa95019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa950105070 0x7fa95019e020 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa9400098e0 tx=0x7fa940005740 comp rx=0 tx=0).stop 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 -- 172.21.15.12:0/1557160943 shutdown_connections 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa93c0a14f0 0x7fa93c0a39b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9500ffd30 0x7fa95019dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9501a3030 0x7fa9501a5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 --2- 172.21.15.12:0/1557160943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa950105070 0x7fa95019e020 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.560+0000 7fa9575ff700 1 -- 172.21.15.12:0/1557160943 >> 172.21.15.12:0/1557160943 conn(0x7fa9500fb930 msgr2=0x7fa950100890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.561+0000 7fa9575ff700 1 -- 172.21.15.12:0/1557160943 shutdown_connections 2023-12-11T20:33:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:11.561+0000 7fa9575ff700 1 -- 172.21.15.12:0/1557160943 wait complete. 2023-12-11T20:33:12.024 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:33:12.025 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:33:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.478+0000 7f2d8efff700 1 -- 172.21.15.12:0/829926133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d881026e0 msgr2=0x7f2d88104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.478+0000 7f2d8efff700 1 --2- 172.21.15.12:0/829926133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d881026e0 0x7f2d88104b70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2d740098f0 tx=0x7f2d74009c00 comp rx=0 tx=0).stop 2023-12-11T20:33:12.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.479+0000 7f2d8efff700 1 -- 172.21.15.12:0/829926133 shutdown_connections 2023-12-11T20:33:12.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.479+0000 7f2d8efff700 1 --2- 172.21.15.12:0/829926133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d881050b0 0x7f2d88105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.479+0000 7f2d8efff700 1 --2- 172.21.15.12:0/829926133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d880ffd70 0x7f2d881021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.479+0000 7f2d8efff700 1 --2- 172.21.15.12:0/829926133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d881026e0 0x7f2d88104b70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.479+0000 7f2d8efff700 1 -- 172.21.15.12:0/829926133 >> 172.21.15.12:0/829926133 conn(0x7f2d880fb930 msgr2=0x7f2d880fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:12.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.480+0000 7f2d8efff700 1 -- 172.21.15.12:0/829926133 shutdown_connections 2023-12-11T20:33:12.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.480+0000 7f2d8efff700 1 -- 172.21.15.12:0/829926133 wait complete. 2023-12-11T20:33:12.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.481+0000 7f2d8efff700 1 Processor -- start 2023-12-11T20:33:12.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.482+0000 7f2d8efff700 1 -- start start 2023-12-11T20:33:12.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.483+0000 7f2d8efff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d880ffd70 0x7f2d88070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.483+0000 7f2d8efff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d881026e0 0x7f2d88070550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.483+0000 7f2d8efff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d881050b0 0x7f2d881ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.483+0000 7f2d8cd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d880ffd70 0x7f2d88070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.484+0000 7f2d8cd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d880ffd70 0x7f2d88070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49744/0 (socket says 172.21.15.12:49744) 2023-12-11T20:33:12.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.484+0000 7f2d87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d881026e0 0x7f2d88070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.484+0000 7f2d87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d881026e0 0x7f2d88070550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33158/0 (socket says 172.21.15.12:33158) 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.484+0000 7f2d8cd9b700 1 -- 172.21.15.12:0/3598824417 learned_addr learned my addr 172.21.15.12:0/3598824417 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.484+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88070b60 con 0x7f2d881026e0 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.484+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88070ca0 con 0x7f2d881050b0 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.484+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d881050b0 0x7f2d881ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.485+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d881adfd0 con 0x7f2d880ffd70 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.485+0000 7f2d87fff700 1 -- 172.21.15.12:0/3598824417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d880ffd70 msgr2=0x7f2d88070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.485+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d880ffd70 0x7f2d88070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.485+0000 7f2d87fff700 1 -- 172.21.15.12:0/3598824417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d881050b0 msgr2=0x7f2d881ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.485+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d881050b0 0x7f2d881ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.485+0000 7f2d87fff700 1 -- 172.21.15.12:0/3598824417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74009520 con 0x7f2d881026e0 2023-12-11T20:33:12.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.486+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d881026e0 0x7f2d88070550 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000c00 tx=0x7f2d7400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:12.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.486+0000 7f2d85ffb700 1 -- 172.21.15.12:0/3598824417 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7401c070 con 0x7f2d881026e0 2023-12-11T20:33:12.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.486+0000 7f2d85ffb700 1 -- 172.21.15.12:0/3598824417 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d7400f7d0 con 0x7f2d881026e0 2023-12-11T20:33:12.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.487+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d881ae250 con 0x7f2d881026e0 2023-12-11T20:33:12.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.487+0000 7f2d85ffb700 1 -- 172.21.15.12:0/3598824417 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74003900 con 0x7f2d881026e0 2023-12-11T20:33:12.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.487+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d881ae670 con 0x7f2d881026e0 2023-12-11T20:33:12.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.494+0000 7f2d85ffb700 1 -- 172.21.15.12:0/3598824417 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2d74020030 con 0x7f2d881026e0 2023-12-11T20:33:12.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.497+0000 7f2da28bcb80 1 Processor -- start 2023-12-11T20:33:12.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.499+0000 7f2d85ffb700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d780a1650 0x7f2d780a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.499+0000 7f2d85ffb700 1 -- 172.21.15.12:0/3598824417 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2d740cdba0 con 0x7f2d881026e0 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.499+0000 7f2da28bcb80 1 -- start start 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2450 0x558de7ff2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2db0 0x558de7ff36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de7ff4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de7f4dbd0 con 0x558de7ff2db0 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de7f4b4f0 con 0x558de7ff2450 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de7f46de0 con 0x558de7ff3ca0 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2d87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2db0 0x558de7ff36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2d87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2db0 0x558de7ff36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33162/0 (socket says 172.21.15.12:33162) 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2d87fff700 1 -- 172.21.15.12:0/3541046912 learned_addr learned my addr 172.21.15.12:0/3541046912 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:12.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.500+0000 7f2d8cd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2450 0x558de7ff2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.501+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d780a1650 0x7f2d780a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.501+0000 7f2d87fff700 1 -- 172.21.15.12:0/3541046912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 msgr2=0x558de7ff4120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:33:12.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.501+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3541046912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de7ff4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.501+0000 7f2d87fff700 1 -- 172.21.15.12:0/3541046912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2450 msgr2=0x558de7ff2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:12.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.501+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3541046912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2450 0x558de7ff2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.501+0000 7f2d87fff700 1 -- 172.21.15.12:0/3541046912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558de7dc36b0 con 0x558de7ff2db0 2023-12-11T20:33:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.501+0000 7f2d8cd9b700 1 --2- 172.21.15.12:0/3541046912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2450 0x558de7ff2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.502+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3541046912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2db0 0x558de7ff36c0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f2d740a2c70 tx=0x7f2d7409aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e566f44bfed3c30 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.502+0000 7f2d72ffd700 1 -- 172.21.15.12:0/3541046912 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b2070 con 0x558de7ff2db0 2023-12-11T20:33:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.502+0000 7f2d72ffd700 1 -- 172.21.15.12:0/3541046912 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d740a10c0 con 0x558de7ff2db0 2023-12-11T20:33:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.502+0000 7f2d72ffd700 1 -- 172.21.15.12:0/3541046912 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74099330 con 0x558de7ff2db0 2023-12-11T20:33:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.503+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d780a1650 0x7f2d780a3b10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x558de7ff3480 tx=0x7f2d8000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.504+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3541046912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2db0 msgr2=0x558de7ff36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.504+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3541046912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2db0 0x558de7ff36c0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f2d740a2c70 tx=0x7f2d7409aab0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.504+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3541046912 shutdown_connections 2023-12-11T20:33:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.504+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3541046912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2450 0x558de7ff2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.504+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3541046912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de7ff4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.504+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3541046912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2db0 0x558de7ff36c0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.504+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3541046912 >> 172.21.15.12:0/3541046912 conn(0x558de7f21860 msgr2=0x558de7feee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:12.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.505+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3541046912 shutdown_connections 2023-12-11T20:33:12.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.505+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3541046912 wait complete. 2023-12-11T20:33:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.506+0000 7f2da28bcb80 1 -- start start 2023-12-11T20:33:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.506+0000 7f2da28bcb80 1 Processor -- start 2023-12-11T20:33:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.507+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.507+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de800d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.507+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de80144f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.507+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de7f005e0 con 0x558de7ff2450 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.507+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de7f00280 con 0x558de7ff2db0 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.507+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de7dc59a0 con 0x558de7ff3ca0 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.507+0000 7f2da28bcb80 10 client.0 _ll_register_callbacks cb 0x558de7e2bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33166/0 (socket says 172.21.15.12:33166) 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8cd9b700 1 -- 172.21.15.12:0/3302462474 learned_addr learned my addr 172.21.15.12:0/3302462474 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de80144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de800d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8cd9b700 1 -- 172.21.15.12:0/3302462474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 msgr2=0x558de80144f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8cd9b700 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de80144f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8cd9b700 1 -- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 msgr2=0x558de800d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8cd9b700 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de800d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d8cd9b700 1 -- 172.21.15.12:0/3302462474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c007950 con 0x558de7ff2450 2023-12-11T20:33:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.508+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de800d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.509+0000 7f2d8cd9b700 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800cf70 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c011750 tx=0x7f2d7c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f489007ccadde81a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.509+0000 7f2d67fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.510+0000 7f2d67fff700 1 -- 172.21.15.12:0/3302462474 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c016070 con 0x558de7ff2450 2023-12-11T20:33:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.510+0000 7f2d67fff700 1 -- 172.21.15.12:0/3302462474 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2d7c010840 con 0x558de7ff2450 2023-12-11T20:33:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.510+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3302462474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558de7fe5bc0 con 0x558de7ff2450 2023-12-11T20:33:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.510+0000 7f2d67fff700 1 -- 172.21.15.12:0/3302462474 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d7c010a00 con 0x558de7ff2450 2023-12-11T20:33:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2da28bcb80 10 client.20355 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3302462474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f2d881ae670 con 0x558de7ff2450 2023-12-11T20:33:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2d67fff700 1 -- 172.21.15.12:0/3302462474 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558de7fe5bc0 con 0x558de7ff2450 2023-12-11T20:33:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2d67fff700 1 -- 172.21.15.12:0/3302462474 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2d7c01b420 con 0x558de7ff2450 2023-12-11T20:33:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2da28bcb80 10 client.20355 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2da28bcb80 10 client.20355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2da28bcb80 20 client.20355 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558de8018dd0 0x558de801b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.511+0000 7f2da28bcb80 4 client.20355 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.512+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3302462474 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558de7fc1fc0 con 0x558de8018dd0 2023-12-11T20:33:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.512+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558de8018dd0 0x558de801b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.512+0000 7f2d67fff700 10 client.20355 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.513+0000 7f2d87fff700 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558de8018dd0 0x558de801b1f0 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e42ba184c84739fb server_cookie=89d064157975c46 in_seq=0 out_seq=0 2023-12-11T20:33:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.513+0000 7f2d67fff700 1 -- 172.21.15.12:0/3302462474 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558de7fc1fc0 con 0x558de8018dd0 2023-12-11T20:33:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.513+0000 7f2d67fff700 10 client.20355 handle_command_reply: tid=0 2023-12-11T20:33:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.513+0000 7f2da28bcb80 1 client.20355 shutdown 2023-12-11T20:33:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3302462474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 msgr2=0x558de800cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800cf70 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c011750 tx=0x7f2d7c011b10 comp rx=0 tx=0).stop 2023-12-11T20:33:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3302462474 shutdown_connections 2023-12-11T20:33:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558de8018dd0 0x558de801b1f0 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de80144f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800cf70 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3302462474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de800d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2d67fff700 0 client.20355 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3302462474 >> 172.21.15.12:0/3302462474 conn(0x558de7f21860 msgr2=0x558de7fedac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3302462474 shutdown_connections 2023-12-11T20:33:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.514+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3302462474 wait complete. 2023-12-11T20:33:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.516+0000 7f2da28bcb80 20 client.20355 trim_cache size 0 max 16384 2023-12-11T20:33:12.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.552+0000 7f2da28bcb80 1 Processor -- start 2023-12-11T20:33:12.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.554+0000 7f2da28bcb80 1 -- start start 2023-12-11T20:33:12.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.554+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80144b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de7fed210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de800dfb0 con 0x558de7ff2450 2023-12-11T20:33:12.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de8015670 con 0x558de7ff2db0 2023-12-11T20:33:12.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de7fe9bd0 con 0x558de7ff3ca0 2023-12-11T20:33:12.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2d87fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2d87fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80144b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46928/0 (socket says 172.21.15.12:46928) 2023-12-11T20:33:12.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2d87fff700 1 -- 172.21.15.12:0/2561015770 learned_addr learned my addr 172.21.15.12:0/2561015770 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:12.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de7fed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.555+0000 7f2d8cd9b700 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.556+0000 7f2d87fff700 1 -- 172.21.15.12:0/2561015770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 msgr2=0x558de7fed210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.556+0000 7f2d87fff700 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de7fed210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.556+0000 7f2d87fff700 1 -- 172.21.15.12:0/2561015770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 msgr2=0x558de800c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.556+0000 7f2d87fff700 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.556+0000 7f2d87fff700 1 -- 172.21.15.12:0/2561015770 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558de7d6fe60 con 0x558de7ff2db0 2023-12-11T20:33:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.556+0000 7f2d87fff700 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80144b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2d7409ae30 tx=0x7f2d7409aab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e34fb94d80e1f434 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.557+0000 7f2d737fe700 1 -- 172.21.15.12:0/2561015770 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740a7070 con 0x558de7ff2db0 2023-12-11T20:33:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.557+0000 7f2d737fe700 1 -- 172.21.15.12:0/2561015770 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d7409aea0 con 0x558de7ff2db0 2023-12-11T20:33:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.557+0000 7f2d737fe700 1 -- 172.21.15.12:0/2561015770 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b2040 con 0x558de7ff2db0 2023-12-11T20:33:12.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.558+0000 7f2da28bcb80 1 -- 172.21.15.12:0/2561015770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 msgr2=0x558de80144b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.558+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80144b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2d7409ae30 tx=0x7f2d7409aab0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.558+0000 7f2da28bcb80 1 -- 172.21.15.12:0/2561015770 shutdown_connections 2023-12-11T20:33:12.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.558+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff3ca0 0x558de7fed210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.558+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff2450 0x558de800c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.558+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/2561015770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80144b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.558+0000 7f2da28bcb80 1 -- 172.21.15.12:0/2561015770 >> 172.21.15.12:0/2561015770 conn(0x558de7f21860 msgr2=0x558de800bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:12.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.559+0000 7f2da28bcb80 1 -- 172.21.15.12:0/2561015770 shutdown_connections 2023-12-11T20:33:12.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.559+0000 7f2da28bcb80 1 -- 172.21.15.12:0/2561015770 wait complete. 2023-12-11T20:33:12.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.560+0000 7f2da28bcb80 1 -- start start 2023-12-11T20:33:12.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.560+0000 7f2da28bcb80 1 Processor -- start 2023-12-11T20:33:12.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.561+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff2450 0x558de80112b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.561+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80117f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.562+0000 7f2da28bcb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff3ca0 0x558de806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.562+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de8011dc0 con 0x558de7ff3ca0 2023-12-11T20:33:12.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.562+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de8011f00 con 0x558de7ff2db0 2023-12-11T20:33:12.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.562+0000 7f2da28bcb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x558de806f830 con 0x558de7ff2450 2023-12-11T20:33:12.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.562+0000 7f2da28bcb80 10 client.0 _ll_register_callbacks cb 0x558de7e2bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:12.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.564+0000 7f2d87fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.564+0000 7f2d8cd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff2450 0x558de80112b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.564+0000 7f2d87fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80117f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46932/0 (socket says 172.21.15.12:46932) 2023-12-11T20:33:12.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.564+0000 7f2d87fff700 1 -- 172.21.15.12:0/3754174778 learned_addr learned my addr 172.21.15.12:0/3754174778 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:12.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.564+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff3ca0 0x558de806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.565+0000 7f2d8d59c700 1 -- 172.21.15.12:0/3754174778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff2450 msgr2=0x558de80112b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:12.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.565+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff2450 0x558de80112b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.565+0000 7f2d8d59c700 1 -- 172.21.15.12:0/3754174778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 msgr2=0x558de80117f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:12.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.565+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80117f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.565+0000 7f2d8d59c700 1 -- 172.21.15.12:0/3754174778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558de7dc36b0 con 0x558de7ff3ca0 2023-12-11T20:33:12.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.565+0000 7f2d8cd9b700 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff2450 0x558de80112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:12.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.565+0000 7f2d8d59c700 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff3ca0 0x558de806f2a0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000f4e0 tx=0x7f2d80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de41eee3fc50ab2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:12.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.566+0000 7f2d67fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:12.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.566+0000 7f2d67fff700 1 -- 172.21.15.12:0/3754174778 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8001c040 con 0x558de7ff3ca0 2023-12-11T20:33:12.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.567+0000 7f2d67fff700 1 -- 172.21.15.12:0/3754174778 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2d80017850 con 0x558de7ff3ca0 2023-12-11T20:33:12.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.567+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3754174778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d740a10c0 con 0x558de7ff3ca0 2023-12-11T20:33:12.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.569+0000 7f2d67fff700 1 -- 172.21.15.12:0/3754174778 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d8000e040 con 0x558de7ff3ca0 2023-12-11T20:33:12.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.569+0000 7f2da28bcb80 10 client.20361 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:12.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.569+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3754174778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x558de7d58ce0 con 0x558de7ff3ca0 2023-12-11T20:33:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.570+0000 7f2d67fff700 1 -- 172.21.15.12:0/3754174778 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d740a10c0 con 0x558de7ff3ca0 2023-12-11T20:33:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.570+0000 7f2d67fff700 1 -- 172.21.15.12:0/3754174778 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2d8002d970 con 0x558de7ff3ca0 2023-12-11T20:33:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.570+0000 7f2da28bcb80 10 client.20361 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.570+0000 7f2da28bcb80 10 client.20361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.570+0000 7f2da28bcb80 20 client.20361 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.570+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558de80713e0 0x558de8073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:12.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.570+0000 7f2da28bcb80 4 client.20361 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:33:12.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.570+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3754174778 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558de7f0d050 con 0x558de80713e0 2023-12-11T20:33:12.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.572+0000 7f2d8cd9b700 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558de80713e0 0x558de8073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:12.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.573+0000 7f2d8cd9b700 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558de80713e0 0x558de8073800 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b1347eb519a2bb server_cookie=1ca2f05628161b88 in_seq=0 out_seq=0 2023-12-11T20:33:12.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.573+0000 7f2d67fff700 10 client.20361 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:12.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.575+0000 7f2d67fff700 1 -- 172.21.15.12:0/3754174778 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558de7f0d050 con 0x558de80713e0 2023-12-11T20:33:12.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.575+0000 7f2d67fff700 10 client.20361 handle_command_reply: tid=0 2023-12-11T20:33:12.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.576+0000 7f2da28bcb80 1 client.20361 shutdown 2023-12-11T20:33:12.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.576+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3754174778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff3ca0 msgr2=0x558de806f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff3ca0 0x558de806f2a0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000f4e0 tx=0x7f2d80004ad0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3754174778 shutdown_connections 2023-12-11T20:33:12.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x558de80713e0 0x558de8073800 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558de7ff3ca0 0x558de806f2a0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x558de7ff2450 0x558de80112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 --2- 172.21.15.12:0/3754174778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x558de7ff2db0 0x558de80117f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2d67fff700 0 client.20361 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:12.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3754174778 >> 172.21.15.12:0/3754174778 conn(0x558de7f21860 msgr2=0x558de800d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:12.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3754174778 shutdown_connections 2023-12-11T20:33:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.577+0000 7f2da28bcb80 1 -- 172.21.15.12:0/3754174778 wait complete. 2023-12-11T20:33:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.578+0000 7f2da28bcb80 20 client.20361 trim_cache size 0 max 16384 2023-12-11T20:33:12.577 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:33:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:33:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "09fc8b69-3066-4248-9bd8-97e489243628", 2023-12-11T20:33:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:33:12.577 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:33:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.579+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d780a1650 msgr2=0x7f2d780a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.579+0000 7f2d8efff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d780a1650 0x7f2d780a3b10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x558de7ff3480 tx=0x7f2d8000b040 comp rx=0 tx=0).stop 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.579+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d881026e0 msgr2=0x7f2d88070550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.579+0000 7f2d8efff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d881026e0 0x7f2d88070550 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000c00 tx=0x7f2d7400b790 comp rx=0 tx=0).stop 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.580+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 shutdown_connections 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.580+0000 7f2d8efff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2d780a1650 0x7f2d780a3b10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.580+0000 7f2d8efff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d881050b0 0x7f2d881ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.580+0000 7f2d8efff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d880ffd70 0x7f2d88070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.580+0000 7f2d8efff700 1 --2- 172.21.15.12:0/3598824417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d881026e0 0x7f2d88070550 secure :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000c00 tx=0x7f2d7400b790 comp rx=0 tx=0).stop 2023-12-11T20:33:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.580+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 >> 172.21.15.12:0/3598824417 conn(0x7f2d880fb930 msgr2=0x7f2d88100790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.580+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 shutdown_connections 2023-12-11T20:33:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:12.581+0000 7f2d8efff700 1 -- 172.21.15.12:0/3598824417 wait complete. 2023-12-11T20:33:12.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:33:12.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:12 smithi032 ceph-mon[132488]: pgmap v893: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.67k op/s 2023-12-11T20:33:13.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:12 smithi039 ceph-mon[102205]: pgmap v893: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.67k op/s 2023-12-11T20:33:13.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:12 smithi012 ceph-mon[128787]: pgmap v893: 97 pgs: 97 active+clean; 13 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.67k op/s 2023-12-11T20:33:13.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.088+0000 7fc1a5dff700 1 -- 172.21.15.12:0/1230096290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 msgr2=0x7fc1a00744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.088+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/1230096290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 0x7fc1a00744b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fc194009990 tx=0x7fc194009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.088+0000 7fc1a5dff700 1 -- 172.21.15.12:0/1230096290 shutdown_connections 2023-12-11T20:33:13.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.088+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/1230096290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a010da60 0x7fc1a010fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.088+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/1230096290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1a0075610 0x7fc1a0073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.088+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/1230096290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 0x7fc1a00744b0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.088+0000 7fc1a5dff700 1 -- 172.21.15.12:0/1230096290 >> 172.21.15.12:0/1230096290 conn(0x7fc1a00fca20 msgr2=0x7fc1a00fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:13.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.089+0000 7fc1a5dff700 1 -- 172.21.15.12:0/1230096290 shutdown_connections 2023-12-11T20:33:13.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.089+0000 7fc1a5dff700 1 -- 172.21.15.12:0/1230096290 wait complete. 2023-12-11T20:33:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.091+0000 7fc1a5dff700 1 Processor -- start 2023-12-11T20:33:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.091+0000 7fc1a5dff700 1 -- start start 2023-12-11T20:33:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.092+0000 7fc1a5dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 0x7fc1a019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.092+0000 7fc1a5dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a0075610 0x7fc1a019df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.092+0000 7fc1a5dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1a010da60 0x7fc1a01a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.092+0000 7fc1a5dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a01a5520 con 0x7fc1a0074030 2023-12-11T20:33:13.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.092+0000 7fc1a5dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a01a5660 con 0x7fc1a0075610 2023-12-11T20:33:13.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.092+0000 7fc1a5dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a01a57f0 con 0x7fc1a010da60 2023-12-11T20:33:13.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 0x7fc1a019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 0x7fc1a019d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33204/0 (socket says 172.21.15.12:33204) 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19f7fe700 1 -- 172.21.15.12:0/530702867 learned_addr learned my addr 172.21.15.12:0/530702867 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19ffff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1a010da60 0x7fc1a01a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19effd700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a0075610 0x7fc1a019df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19ffff700 1 -- 172.21.15.12:0/530702867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a0075610 msgr2=0x7fc1a019df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19ffff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a0075610 0x7fc1a019df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19ffff700 1 -- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 msgr2=0x7fc1a019d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19ffff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 0x7fc1a019d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19ffff700 1 -- 172.21.15.12:0/530702867 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1940095f0 con 0x7fc1a010da60 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.093+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 0x7fc1a019d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.094+0000 7fc19ffff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1a010da60 0x7fc1a01a4f50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc198007f10 tx=0x7fc19800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.094+0000 7fc19cff9700 1 -- 172.21.15.12:0/530702867 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198004db0 con 0x7fc1a010da60 2023-12-11T20:33:13.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.094+0000 7fc19cff9700 1 -- 172.21.15.12:0/530702867 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc19800f040 con 0x7fc1a010da60 2023-12-11T20:33:13.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.094+0000 7fc19cff9700 1 -- 172.21.15.12:0/530702867 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198005960 con 0x7fc1a010da60 2023-12-11T20:33:13.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.095+0000 7fc1a5dff700 1 -- 172.21.15.12:0/530702867 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a01a5ad0 con 0x7fc1a010da60 2023-12-11T20:33:13.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.095+0000 7fc1a5dff700 1 -- 172.21.15.12:0/530702867 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a01a5f90 con 0x7fc1a010da60 2023-12-11T20:33:13.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.101+0000 7fc1b9809b80 1 Processor -- start 2023-12-11T20:33:13.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.104+0000 7fc19cff9700 1 -- 172.21.15.12:0/530702867 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc19800db20 con 0x7fc1a010da60 2023-12-11T20:33:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.104+0000 7fc1b9809b80 1 -- start start 2023-12-11T20:33:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.105+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.105+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6ddd30 0x5571cc6de640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.105+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6dec20 0x5571cc6df0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.105+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc638b50 con 0x5571cc6dd3d0 2023-12-11T20:33:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.105+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc636470 con 0x5571cc6dec20 2023-12-11T20:33:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.105+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc631d60 con 0x5571cc6ddd30 2023-12-11T20:33:13.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.106+0000 7fc19f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6ddd30 0x5571cc6de640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.107+0000 7fc19effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6dec20 0x5571cc6df0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.107+0000 7fc19cff9700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc1880a1480 0x7fc1880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.107+0000 7fc19effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6dec20 0x5571cc6df0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46962/0 (socket says 172.21.15.12:46962) 2023-12-11T20:33:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.107+0000 7fc19effd700 1 -- 172.21.15.12:0/1459375684 learned_addr learned my addr 172.21.15.12:0/1459375684 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.107+0000 7fc19effd700 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.107+0000 7fc19cff9700 1 -- 172.21.15.12:0/530702867 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc1980cc600 con 0x7fc1a010da60 2023-12-11T20:33:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.109+0000 7fc19ffff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc1880a1480 0x7fc1880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.110+0000 7fc19f7fe700 1 -- 172.21.15.12:0/1459375684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6dec20 msgr2=0x5571cc6df0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.110+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6dec20 0x5571cc6df0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.110+0000 7fc19f7fe700 1 -- 172.21.15.12:0/1459375684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 msgr2=0x5571cc6dd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.110+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6dd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.110+0000 7fc19f7fe700 1 -- 172.21.15.12:0/1459375684 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571cc4ae630 con 0x5571cc6ddd30 2023-12-11T20:33:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.110+0000 7fc19effd700 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:13.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.111+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6ddd30 0x5571cc6de640 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc190009eb0 tx=0x7fc19000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce44478f905e820c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:13.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.112+0000 7fc19ffff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc1880a1480 0x7fc1880a3940 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc198009fd0 tx=0x7fc198009580 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.113+0000 7fc185ffb700 1 -- 172.21.15.12:0/1459375684 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19000ecd0 con 0x5571cc6ddd30 2023-12-11T20:33:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.113+0000 7fc185ffb700 1 -- 172.21.15.12:0/1459375684 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc19000ee30 con 0x5571cc6ddd30 2023-12-11T20:33:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.113+0000 7fc185ffb700 1 -- 172.21.15.12:0/1459375684 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190012750 con 0x5571cc6ddd30 2023-12-11T20:33:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.114+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1459375684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6ddd30 msgr2=0x5571cc6de640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.115+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6ddd30 0x5571cc6de640 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc190009eb0 tx=0x7fc19000e4b0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.116+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1459375684 shutdown_connections 2023-12-11T20:33:13.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.116+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6dec20 0x5571cc6df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.116+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.116+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/1459375684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6ddd30 0x5571cc6de640 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.116+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1459375684 >> 172.21.15.12:0/1459375684 conn(0x5571cc60c7e0 msgr2=0x5571cc6d9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.116+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1459375684 shutdown_connections 2023-12-11T20:33:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.117+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1459375684 wait complete. 2023-12-11T20:33:13.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.118+0000 7fc1b9809b80 1 -- start start 2023-12-11T20:33:13.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.119+0000 7fc1b9809b80 1 Processor -- start 2023-12-11T20:33:13.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6e7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 0x5571cc6ee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc5eb560 con 0x5571cc6dd3d0 2023-12-11T20:33:13.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc5eb200 con 0x5571cc6ddd30 2023-12-11T20:33:13.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc4b0920 con 0x5571cc6dec20 2023-12-11T20:33:13.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc1b9809b80 10 client.0 _ll_register_callbacks cb 0x5571cc516a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:13.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc19effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc19effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33216/0 (socket says 172.21.15.12:33216) 2023-12-11T20:33:13.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.120+0000 7fc19effd700 1 -- 172.21.15.12:0/861584089 learned_addr learned my addr 172.21.15.12:0/861584089 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:13.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.121+0000 7fc19effd700 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 0x5571cc6ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.121+0000 7fc19effd700 1 -- 172.21.15.12:0/861584089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 msgr2=0x5571cc6ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:13.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.121+0000 7fc19effd700 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 0x5571cc6ee740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.121+0000 7fc19effd700 1 -- 172.21.15.12:0/861584089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 msgr2=0x5571cc6e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:13.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.121+0000 7fc19effd700 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.122+0000 7fc19effd700 1 -- 172.21.15.12:0/861584089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc190009ae0 con 0x5571cc6dd3d0 2023-12-11T20:33:13.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.122+0000 7fc19effd700 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e71c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fc194015000 tx=0x7fc194009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de53be8f9ebc3a2b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:13.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.122+0000 7fc17effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:13.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.122+0000 7fc17effd700 1 -- 172.21.15.12:0/861584089 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194005a00 con 0x5571cc6dd3d0 2023-12-11T20:33:13.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.122+0000 7fc17effd700 1 -- 172.21.15.12:0/861584089 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc19400bd60 con 0x5571cc6dd3d0 2023-12-11T20:33:13.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.123+0000 7fc1b9809b80 1 -- 172.21.15.12:0/861584089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571cc6d0b40 con 0x5571cc6dd3d0 2023-12-11T20:33:13.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.123+0000 7fc17effd700 1 -- 172.21.15.12:0/861584089 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc194004500 con 0x5571cc6dd3d0 2023-12-11T20:33:13.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.123+0000 7fc1b9809b80 10 client.20373 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:13.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.123+0000 7fc1b9809b80 1 -- 172.21.15.12:0/861584089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5571cc45ade0 con 0x5571cc6dd3d0 2023-12-11T20:33:13.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.124+0000 7fc17effd700 1 -- 172.21.15.12:0/861584089 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc194031030 con 0x5571cc6dd3d0 2023-12-11T20:33:13.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.124+0000 7fc17effd700 1 -- 172.21.15.12:0/861584089 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc194003a00 con 0x5571cc6dd3d0 2023-12-11T20:33:13.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.125+0000 7fc1b9809b80 10 client.20373 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:13.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.125+0000 7fc1b9809b80 10 client.20373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:13.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.125+0000 7fc1b9809b80 20 client.20373 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:13.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.125+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571cc6f3020 0x5571cc6f5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.125+0000 7fc1b9809b80 4 client.20373 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:13.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.125+0000 7fc1b9809b80 1 -- 172.21.15.12:0/861584089 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571cc6acf40 con 0x5571cc6f3020 2023-12-11T20:33:13.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.127+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571cc6f3020 0x5571cc6f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.128+0000 7fc17effd700 10 client.20373 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:13.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.128+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571cc6f3020 0x5571cc6f5440 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aefb24b398633710 server_cookie=3074ec48d6b65d1b in_seq=0 out_seq=0 2023-12-11T20:33:13.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.129+0000 7fc17effd700 1 -- 172.21.15.12:0/861584089 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571cc6acf40 con 0x5571cc6f3020 2023-12-11T20:33:13.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.129+0000 7fc17effd700 10 client.20373 handle_command_reply: tid=0 2023-12-11T20:33:13.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.129+0000 7fc1b9809b80 1 client.20373 shutdown 2023-12-11T20:33:13.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc1b9809b80 1 -- 172.21.15.12:0/861584089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 msgr2=0x5571cc6e71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e71c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fc194015000 tx=0x7fc194009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc1b9809b80 1 -- 172.21.15.12:0/861584089 shutdown_connections 2023-12-11T20:33:13.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571cc6f3020 0x5571cc6f5440 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 0x5571cc6ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e71c0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/861584089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc17effd700 0 client.20373 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:13.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.130+0000 7fc1b9809b80 1 -- 172.21.15.12:0/861584089 >> 172.21.15.12:0/861584089 conn(0x5571cc60c7e0 msgr2=0x5571cc6d8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:13.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.131+0000 7fc1b9809b80 1 -- 172.21.15.12:0/861584089 shutdown_connections 2023-12-11T20:33:13.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.131+0000 7fc1b9809b80 1 -- 172.21.15.12:0/861584089 wait complete. 2023-12-11T20:33:13.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.132+0000 7fc1b9809b80 20 client.20373 trim_cache size 0 max 16384 2023-12-11T20:33:13.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.167+0000 7fc1b9809b80 1 Processor -- start 2023-12-11T20:33:13.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.168+0000 7fc1b9809b80 1 -- start start 2023-12-11T20:33:13.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.168+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.168+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6ee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.168+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 0x5571cc6df000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.168+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc6e6220 con 0x5571cc6dd3d0 2023-12-11T20:33:13.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.168+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc6de110 con 0x5571cc6ddd30 2023-12-11T20:33:13.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.168+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc6dcf70 con 0x5571cc6dec20 2023-12-11T20:33:13.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.169+0000 7fc19f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.169+0000 7fc19f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6ee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46974/0 (socket says 172.21.15.12:46974) 2023-12-11T20:33:13.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.169+0000 7fc19f7fe700 1 -- 172.21.15.12:0/1884893502 learned_addr learned my addr 172.21.15.12:0/1884893502 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:13.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.169+0000 7fc19f7fe700 1 -- 172.21.15.12:0/1884893502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 msgr2=0x5571cc6df000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:33:13.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.169+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/1884893502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 0x5571cc6df000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.169+0000 7fc19f7fe700 1 -- 172.21.15.12:0/1884893502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 msgr2=0x5571cc6e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:13.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.170+0000 7fc19effd700 1 --2- 172.21.15.12:0/1884893502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.170+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/1884893502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.170+0000 7fc19f7fe700 1 -- 172.21.15.12:0/1884893502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571cc443c60 con 0x5571cc6ddd30 2023-12-11T20:33:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.170+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/1884893502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6ee700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc190009ab0 tx=0x7fc190009210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2616413e65d24049 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.170+0000 7fc1867fc700 1 -- 172.21.15.12:0/1884893502 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190024de0 con 0x5571cc6ddd30 2023-12-11T20:33:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.170+0000 7fc1867fc700 1 -- 172.21.15.12:0/1884893502 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc190013470 con 0x5571cc6ddd30 2023-12-11T20:33:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.170+0000 7fc1867fc700 1 -- 172.21.15.12:0/1884893502 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1900136b0 con 0x5571cc6ddd30 2023-12-11T20:33:13.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.171+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1884893502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 msgr2=0x5571cc6ee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.171+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/1884893502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6ee700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc190009ab0 tx=0x7fc190009210 comp rx=0 tx=0).stop 2023-12-11T20:33:13.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.171+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1884893502 shutdown_connections 2023-12-11T20:33:13.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.171+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/1884893502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dec20 0x5571cc6df000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.171+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/1884893502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dd3d0 0x5571cc6e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.171+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/1884893502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6ddd30 0x5571cc6ee700 secure :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc190009ab0 tx=0x7fc190009210 comp rx=0 tx=0).stop 2023-12-11T20:33:13.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.171+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1884893502 >> 172.21.15.12:0/1884893502 conn(0x5571cc60c7e0 msgr2=0x5571cc6f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:13.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.172+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1884893502 shutdown_connections 2023-12-11T20:33:13.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.176+0000 7fc1b9809b80 1 -- 172.21.15.12:0/1884893502 wait complete. 2023-12-11T20:33:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.177+0000 7fc1b9809b80 1 -- start start 2023-12-11T20:33:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.177+0000 7fc1b9809b80 1 Processor -- start 2023-12-11T20:33:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dd3d0 0x5571cc6edee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dec20 0x5571cc6ee420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc1b9809b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6eaac0 0x5571cc6eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc6eb480 con 0x5571cc6dec20 2023-12-11T20:33:13.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc6eb5f0 con 0x5571cc6eaac0 2023-12-11T20:33:13.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc1b9809b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571cc749550 con 0x5571cc6dd3d0 2023-12-11T20:33:13.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc1b9809b80 10 client.0 _ll_register_callbacks cb 0x5571cc516a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:13.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc19f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dec20 0x5571cc6ee420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc19effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dd3d0 0x5571cc6edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc19effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dd3d0 0x5571cc6edee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49824/0 (socket says 172.21.15.12:49824) 2023-12-11T20:33:13.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc19effd700 1 -- 172.21.15.12:0/4048394296 learned_addr learned my addr 172.21.15.12:0/4048394296 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:13.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.178+0000 7fc19effd700 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6eaac0 0x5571cc6eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.179+0000 7fc19f7fe700 1 -- 172.21.15.12:0/4048394296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dd3d0 msgr2=0x5571cc6edee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.179+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dd3d0 0x5571cc6edee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.179+0000 7fc19f7fe700 1 -- 172.21.15.12:0/4048394296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6eaac0 msgr2=0x5571cc6eaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.179+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6eaac0 0x5571cc6eaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.179+0000 7fc19f7fe700 1 -- 172.21.15.12:0/4048394296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571cc4ae630 con 0x5571cc6dec20 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.179+0000 7fc19effd700 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dd3d0 0x5571cc6edee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.180+0000 7fc19f7fe700 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dec20 0x5571cc6ee420 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fc190024000 tx=0x7fc190004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c3879f56ed44aa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.180+0000 7fc17effd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.180+0000 7fc17effd700 1 -- 172.21.15.12:0/4048394296 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190024de0 con 0x5571cc6dec20 2023-12-11T20:33:13.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.180+0000 7fc17effd700 1 -- 172.21.15.12:0/4048394296 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc190021040 con 0x5571cc6dec20 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.180+0000 7fc1b9809b80 1 -- 172.21.15.12:0/4048394296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc19000ee30 con 0x5571cc6dec20 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.181+0000 7fc17effd700 1 -- 172.21.15.12:0/4048394296 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1900243a0 con 0x5571cc6dec20 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.181+0000 7fc1b9809b80 10 client.20376 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.181+0000 7fc1b9809b80 1 -- 172.21.15.12:0/4048394296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5571cc481250 con 0x5571cc6dec20 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.181+0000 7fc17effd700 1 -- 172.21.15.12:0/4048394296 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc19003f020 con 0x5571cc6dec20 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.181+0000 7fc17effd700 1 -- 172.21.15.12:0/4048394296 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc19002c030 con 0x5571cc6dec20 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.182+0000 7fc1b9809b80 10 client.20376 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.182+0000 7fc1b9809b80 10 client.20376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.182+0000 7fc1b9809b80 20 client.20376 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.182+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571cc74a8d0 0x5571cc74ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.182+0000 7fc1b9809b80 4 client.20376 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:33:13.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.182+0000 7fc1b9809b80 1 -- 172.21.15.12:0/4048394296 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5571cc5f7fd0 con 0x5571cc74a8d0 2023-12-11T20:33:13.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.183+0000 7fc19effd700 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571cc74a8d0 0x5571cc74ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:13.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.183+0000 7fc19effd700 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571cc74a8d0 0x5571cc74ccc0 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc5de5183f63351d server_cookie=2f613c8974169025 in_seq=0 out_seq=0 2023-12-11T20:33:13.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.183+0000 7fc17effd700 10 client.20376 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:13.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.184+0000 7fc17effd700 1 -- 172.21.15.12:0/4048394296 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5571cc5f7fd0 con 0x5571cc74a8d0 2023-12-11T20:33:13.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.184+0000 7fc17effd700 10 client.20376 handle_command_reply: tid=0 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.184+0000 7fc1b9809b80 1 client.20376 shutdown 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc1b9809b80 1 -- 172.21.15.12:0/4048394296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dec20 msgr2=0x5571cc6ee420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dec20 0x5571cc6ee420 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fc190024000 tx=0x7fc190004690 comp rx=0 tx=0).stop 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc1b9809b80 1 -- 172.21.15.12:0/4048394296 shutdown_connections 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571cc74a8d0 0x5571cc74ccc0 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571cc6eaac0 0x5571cc6eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571cc6dd3d0 0x5571cc6edee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc1b9809b80 1 --2- 172.21.15.12:0/4048394296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571cc6dec20 0x5571cc6ee420 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc1b9809b80 1 -- 172.21.15.12:0/4048394296 >> 172.21.15.12:0/4048394296 conn(0x5571cc60c7e0 msgr2=0x5571cc6e1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.185+0000 7fc17effd700 0 client.20376 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.186+0000 7fc1b9809b80 1 -- 172.21.15.12:0/4048394296 shutdown_connections 2023-12-11T20:33:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.186+0000 7fc1b9809b80 1 -- 172.21.15.12:0/4048394296 wait complete. 2023-12-11T20:33:13.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.186+0000 7fc1b9809b80 20 client.20376 trim_cache size 0 max 16384 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout: "09fc8b69-3066-4248-9bd8-97e489243628": { 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "09fc8b69-3066-4248-9bd8-97e489243628", 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:33:13.185 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:33:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 -- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc1880a1480 msgr2=0x7fc1880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc1880a1480 0x7fc1880a3940 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc198009fd0 tx=0x7fc198009580 comp rx=0 tx=0).stop 2023-12-11T20:33:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 -- 172.21.15.12:0/530702867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1a010da60 msgr2=0x7fc1a01a4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1a010da60 0x7fc1a01a4f50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc198007f10 tx=0x7fc19800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 -- 172.21.15.12:0/530702867 shutdown_connections 2023-12-11T20:33:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc1880a1480 0x7fc1880a3940 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1a010da60 0x7fc1a01a4f50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1a0074030 0x7fc1a019d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 --2- 172.21.15.12:0/530702867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a0075610 0x7fc1a019df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:13.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 -- 172.21.15.12:0/530702867 >> 172.21.15.12:0/530702867 conn(0x7fc1a00fca20 msgr2=0x7fc1a0100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:13.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 -- 172.21.15.12:0/530702867 shutdown_connections 2023-12-11T20:33:13.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:13.187+0000 7fc1a5dff700 1 -- 172.21.15.12:0/530702867 wait complete. 2023-12-11T20:33:13.221 INFO:tasks.cephfs.filesystem:scrub status for tag:09fc8b69-3066-4248-9bd8-97e489243628 - {'path': '/', 'tag': '09fc8b69-3066-4248-9bd8-97e489243628', 'options': 'recursive,force'} 2023-12-11T20:33:13.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:13 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:33:13.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:13.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:13 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:33:13.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:13 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:33:13.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:13 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:33:13.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:13.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:13.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:13 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:13 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:33:14.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:13 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:33:14.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:13 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:33:14.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:13 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:33:14.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:13 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:13 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:33:14.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:13 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:33:14.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:13 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:33:14.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:13 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:33:14.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:13 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:14.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:14 smithi032 ceph-mon[132488]: pgmap v894: 97 pgs: 97 active+clean; 13 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2023-12-11T20:33:15.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:14 smithi039 ceph-mon[102205]: pgmap v894: 97 pgs: 97 active+clean; 13 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2023-12-11T20:33:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:14 smithi012 ceph-mon[128787]: pgmap v894: 97 pgs: 97 active+clean; 13 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2023-12-11T20:33:16.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:16 smithi032 ceph-mon[132488]: pgmap v895: 97 pgs: 97 active+clean; 13 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:33:17.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:16 smithi039 ceph-mon[102205]: pgmap v895: 97 pgs: 97 active+clean; 13 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:33:17.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:16 smithi012 ceph-mon[128787]: pgmap v895: 97 pgs: 97 active+clean; 13 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:33:18.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:18 smithi032 ceph-mon[132488]: pgmap v896: 97 pgs: 97 active+clean; 13 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 4.71k op/s 2023-12-11T20:33:19.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:18 smithi039 ceph-mon[102205]: pgmap v896: 97 pgs: 97 active+clean; 13 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 4.71k op/s 2023-12-11T20:33:19.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:18 smithi012 ceph-mon[128787]: pgmap v896: 97 pgs: 97 active+clean; 13 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 4.71k op/s 2023-12-11T20:33:20.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:20 smithi032 ceph-mon[132488]: pgmap v897: 97 pgs: 97 active+clean; 13 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:33:21.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:20 smithi039 ceph-mon[102205]: pgmap v897: 97 pgs: 97 active+clean; 13 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:33:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:20 smithi012 ceph-mon[128787]: pgmap v897: 97 pgs: 97 active+clean; 13 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:33:22.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:22 smithi032 ceph-mon[132488]: pgmap v898: 97 pgs: 97 active+clean; 13 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:33:23.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:22 smithi039 ceph-mon[102205]: pgmap v898: 97 pgs: 97 active+clean; 13 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:33:23.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:22 smithi012 ceph-mon[128787]: pgmap v898: 97 pgs: 97 active+clean; 13 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:33:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.884+0000 7fd4571ff700 1 -- 172.21.15.12:0/3465553554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450107af0 msgr2=0x7fd450107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.884+0000 7fd4571ff700 1 --2- 172.21.15.12:0/3465553554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450107af0 0x7fd450107f10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd444009990 tx=0x7fd444009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.885+0000 7fd4571ff700 1 -- 172.21.15.12:0/3465553554 shutdown_connections 2023-12-11T20:33:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.885+0000 7fd4571ff700 1 --2- 172.21.15.12:0/3465553554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd450109680 0x7fd45010ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.885+0000 7fd4571ff700 1 --2- 172.21.15.12:0/3465553554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450107af0 0x7fd450107f10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.885+0000 7fd4571ff700 1 --2- 172.21.15.12:0/3465553554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd450108ce0 0x7fd450109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.885+0000 7fd4571ff700 1 -- 172.21.15.12:0/3465553554 >> 172.21.15.12:0/3465553554 conn(0x7fd450076ac0 msgr2=0x7fd450078ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.885+0000 7fd4571ff700 1 -- 172.21.15.12:0/3465553554 shutdown_connections 2023-12-11T20:33:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.885+0000 7fd4571ff700 1 -- 172.21.15.12:0/3465553554 wait complete. 2023-12-11T20:33:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.887+0000 7fd4571ff700 1 Processor -- start 2023-12-11T20:33:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.887+0000 7fd4571ff700 1 -- start start 2023-12-11T20:33:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.887+0000 7fd4571ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd450107af0 0x7fd45019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.887+0000 7fd4571ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd450108ce0 0x7fd45019df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.887+0000 7fd4571ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450109680 0x7fd4501a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.887+0000 7fd4571ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501a54b0 con 0x7fd450107af0 2023-12-11T20:33:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.887+0000 7fd4571ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501a55f0 con 0x7fd450108ce0 2023-12-11T20:33:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.887+0000 7fd4571ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501a5780 con 0x7fd450109680 2023-12-11T20:33:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.888+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd450108ce0 0x7fd45019df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.888+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd450108ce0 0x7fd45019df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42956/0 (socket says 172.21.15.12:42956) 2023-12-11T20:33:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.888+0000 7fd44ffff700 1 -- 172.21.15.12:0/950592097 learned_addr learned my addr 172.21.15.12:0/950592097 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.888+0000 7fd45579c700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450109680 0x7fd4501a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.888+0000 7fd45579c700 1 -- 172.21.15.12:0/950592097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd450108ce0 msgr2=0x7fd45019df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.889+0000 7fd45579c700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd450108ce0 0x7fd45019df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.889+0000 7fd45579c700 1 -- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd450107af0 msgr2=0x7fd45019d9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T20:33:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.889+0000 7fd45579c700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd450107af0 0x7fd45019d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.889+0000 7fd45579c700 1 -- 172.21.15.12:0/950592097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440095f0 con 0x7fd450109680 2023-12-11T20:33:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.889+0000 7fd45579c700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450109680 0x7fd4501a4ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd44800efc0 tx=0x7fd44800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.890+0000 7fd44dffb700 1 -- 172.21.15.12:0/950592097 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448018070 con 0x7fd450109680 2023-12-11T20:33:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.890+0000 7fd44dffb700 1 -- 172.21.15.12:0/950592097 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd44800f040 con 0x7fd450109680 2023-12-11T20:33:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.890+0000 7fd44dffb700 1 -- 172.21.15.12:0/950592097 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448003e00 con 0x7fd450109680 2023-12-11T20:33:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.890+0000 7fd4571ff700 1 -- 172.21.15.12:0/950592097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4501a5a00 con 0x7fd450109680 2023-12-11T20:33:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.890+0000 7fd4571ff700 1 -- 172.21.15.12:0/950592097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4501a5ec0 con 0x7fd450109680 2023-12-11T20:33:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.902+0000 7fd44dffb700 1 -- 172.21.15.12:0/950592097 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fd44800ca50 con 0x7fd450109680 2023-12-11T20:33:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.905+0000 7fd44dffb700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd4400a15b0 0x7fd4400a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.906+0000 7fd46ac02b80 1 Processor -- start 2023-12-11T20:33:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.907+0000 7fd454f9b700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd4400a15b0 0x7fd4400a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.907+0000 7fd46ac02b80 1 -- start start 2023-12-11T20:33:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.907+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a692ed0 0x55f89a6932f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.908+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a694140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.908+0000 7fd454f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a692ed0 0x55f89a6932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.908+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a694720 0x55f89a694ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.908+0000 7fd454f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a692ed0 0x55f89a6932f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39162/0 (socket says 172.21.15.12:39162) 2023-12-11T20:33:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.908+0000 7fd454f9b700 1 -- 172.21.15.12:0/3999321789 learned_addr learned my addr 172.21.15.12:0/3999321789 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.908+0000 7fd46ac02b80 1 -- 172.21.15.12:0/3999321789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a5eeaf0 con 0x55f89a692ed0 2023-12-11T20:33:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.908+0000 7fd46ac02b80 1 -- 172.21.15.12:0/3999321789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a5ec410 con 0x55f89a693830 2023-12-11T20:33:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.908+0000 7fd46ac02b80 1 -- 172.21.15.12:0/3999321789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a5e7d00 con 0x55f89a694720 2023-12-11T20:33:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.905+0000 7fd44dffb700 1 -- 172.21.15.12:0/950592097 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd4480cc870 con 0x7fd450109680 2023-12-11T20:33:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd45579c700 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a694720 0x55f89a694ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd454f9b700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd4400a15b0 0x7fd4400a3a70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd4440098e0 tx=0x7fd444000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd44ffff700 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a694140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd454f9b700 1 -- 172.21.15.12:0/3999321789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a694720 msgr2=0x55f89a694ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd454f9b700 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a694720 0x55f89a694ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd454f9b700 1 -- 172.21.15.12:0/3999321789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 msgr2=0x55f89a694140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd454f9b700 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a694140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd454f9b700 1 -- 172.21.15.12:0/3999321789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f89a4645d0 con 0x55f89a692ed0 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd44ffff700 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a694140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.909+0000 7fd454f9b700 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a692ed0 0x55f89a6932f0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd450108b40 tx=0x7fd444025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416a69365c9a554e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.910+0000 7fd43affd700 1 -- 172.21.15.12:0/3999321789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44401d070 con 0x55f89a692ed0 2023-12-11T20:33:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.910+0000 7fd43affd700 1 -- 172.21.15.12:0/3999321789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd44400bcc0 con 0x55f89a692ed0 2023-12-11T20:33:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.910+0000 7fd43affd700 1 -- 172.21.15.12:0/3999321789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444004620 con 0x55f89a692ed0 2023-12-11T20:33:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.911+0000 7fd46ac02b80 1 -- 172.21.15.12:0/3999321789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a692ed0 msgr2=0x55f89a6932f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.911+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a692ed0 0x55f89a6932f0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd450108b40 tx=0x7fd444025000 comp rx=0 tx=0).stop 2023-12-11T20:33:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.911+0000 7fd46ac02b80 1 -- 172.21.15.12:0/3999321789 shutdown_connections 2023-12-11T20:33:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.911+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a694720 0x55f89a694ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.912+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a692ed0 0x55f89a6932f0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.912+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/3999321789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a694140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.912+0000 7fd46ac02b80 1 -- 172.21.15.12:0/3999321789 >> 172.21.15.12:0/3999321789 conn(0x55f89a5c2780 msgr2=0x55f89a68f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:24.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.913+0000 7fd46ac02b80 1 -- 172.21.15.12:0/3999321789 shutdown_connections 2023-12-11T20:33:24.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.913+0000 7fd46ac02b80 1 -- 172.21.15.12:0/3999321789 wait complete. 2023-12-11T20:33:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.915+0000 7fd46ac02b80 1 -- start start 2023-12-11T20:33:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.915+0000 7fd46ac02b80 1 Processor -- start 2023-12-11T20:33:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.918+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.918+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a693830 0x55f89a69d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.918+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a694720 0x55f89a6a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.918+0000 7fd46ac02b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a5a1500 con 0x55f89a693830 2023-12-11T20:33:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd46ac02b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a5a11a0 con 0x55f89a694720 2023-12-11T20:33:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd454f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd454f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40226/0 (socket says 172.21.15.12:40226) 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd454f9b700 1 -- 172.21.15.12:0/1395272612 learned_addr learned my addr 172.21.15.12:0/1395272612 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a4668c0 con 0x55f89a692ed0 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd46ac02b80 10 client.0 _ll_register_callbacks cb 0x55f89a4cca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd454f9b700 1 -- 172.21.15.12:0/1395272612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a694720 msgr2=0x55f89a6a41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd454f9b700 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a694720 0x55f89a6a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.919+0000 7fd454f9b700 1 -- 172.21.15.12:0/1395272612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a693830 msgr2=0x55f89a69d3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.920+0000 7fd44ffff700 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a693830 0x55f89a69d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.920+0000 7fd454f9b700 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a693830 0x55f89a69d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.920+0000 7fd454f9b700 1 -- 172.21.15.12:0/1395272612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd450110880 con 0x55f89a692ed0 2023-12-11T20:33:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.920+0000 7fd44ffff700 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a693830 0x55f89a69d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.920+0000 7fd454f9b700 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69ce80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd444005850 tx=0x7fd444003730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5eab89b928a87a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.920+0000 7fd42ffff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.920+0000 7fd42ffff700 1 -- 172.21.15.12:0/1395272612 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44401d040 con 0x55f89a692ed0 2023-12-11T20:33:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.921+0000 7fd42ffff700 1 -- 172.21.15.12:0/1395272612 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd44400ba30 con 0x55f89a692ed0 2023-12-11T20:33:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.921+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f89a686730 con 0x55f89a692ed0 2023-12-11T20:33:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.921+0000 7fd42ffff700 1 -- 172.21.15.12:0/1395272612 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd444004620 con 0x55f89a692ed0 2023-12-11T20:33:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.921+0000 7fd46ac02b80 10 client.29920 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.921+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f89a410d80 con 0x55f89a692ed0 2023-12-11T20:33:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.922+0000 7fd42ffff700 1 -- 172.21.15.12:0/1395272612 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f89a686730 con 0x55f89a692ed0 2023-12-11T20:33:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.922+0000 7fd42ffff700 1 -- 172.21.15.12:0/1395272612 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd44402f8a0 con 0x55f89a692ed0 2023-12-11T20:33:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.922+0000 7fd46ac02b80 10 client.29920 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.922+0000 7fd46ac02b80 10 client.29920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.923+0000 7fd46ac02b80 20 client.29920 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.923+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f89a6a86e0 0x55f89a6aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.923+0000 7fd46ac02b80 4 client.29920 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.923+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f89a662ee0 con 0x55f89a6a86e0 2023-12-11T20:33:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.923+0000 7fd44ffff700 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f89a6a86e0 0x55f89a6aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.924+0000 7fd44ffff700 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f89a6a86e0 0x55f89a6aaaf0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ea018f6873abd2 server_cookie=d8e7c9c74f44d926 in_seq=0 out_seq=0 2023-12-11T20:33:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.924+0000 7fd42ffff700 10 client.29920 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:24.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.926+0000 7fd42ffff700 1 -- 172.21.15.12:0/1395272612 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f89a662ee0 con 0x55f89a6a86e0 2023-12-11T20:33:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.926+0000 7fd42ffff700 10 client.29920 handle_command_reply: tid=0 2023-12-11T20:33:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.926+0000 7fd46ac02b80 1 client.29920 shutdown 2023-12-11T20:33:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.928+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 msgr2=0x55f89a69ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.928+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69ce80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd444005850 tx=0x7fd444003730 comp rx=0 tx=0).stop 2023-12-11T20:33:24.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 shutdown_connections 2023-12-11T20:33:24.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f89a6a86e0 0x55f89a6aaaf0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a694720 0x55f89a6a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69ce80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/1395272612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a693830 0x55f89a69d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 >> 172.21.15.12:0/1395272612 conn(0x55f89a5c2780 msgr2=0x55f89a68dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd42ffff700 0 client.29920 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 shutdown_connections 2023-12-11T20:33:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 1 -- 172.21.15.12:0/1395272612 wait complete. 2023-12-11T20:33:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.929+0000 7fd46ac02b80 20 client.29920 trim_cache size 0 max 16384 2023-12-11T20:33:24.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:24 smithi032 ceph-mon[132488]: pgmap v899: 97 pgs: 97 active+clean; 13 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2023-12-11T20:33:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.970+0000 7fd46ac02b80 1 Processor -- start 2023-12-11T20:33:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.971+0000 7fd46ac02b80 1 -- start start 2023-12-11T20:33:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.971+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a6a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.971+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.971+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.971+0000 7fd46ac02b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a6a47f0 con 0x55f89a694720 2023-12-11T20:33:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.971+0000 7fd46ac02b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a68ed70 con 0x55f89a693830 2023-12-11T20:33:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.971+0000 7fd46ac02b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a6981b0 con 0x55f89a692ed0 2023-12-11T20:33:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.972+0000 7fd45579c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.972+0000 7fd45579c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39186/0 (socket says 172.21.15.12:39186) 2023-12-11T20:33:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.972+0000 7fd45579c700 1 -- 172.21.15.12:0/2582844755 learned_addr learned my addr 172.21.15.12:0/2582844755 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.972+0000 7fd45579c700 1 -- 172.21.15.12:0/2582844755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 msgr2=0x55f89a6a4ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:33:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.972+0000 7fd44ffff700 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.972+0000 7fd45579c700 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a6a4ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.972+0000 7fd45579c700 1 -- 172.21.15.12:0/2582844755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 msgr2=0x55f89a6a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.973+0000 7fd45579c700 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.973+0000 7fd45579c700 1 -- 172.21.15.12:0/2582844755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f89a3f9c00 con 0x55f89a694720 2023-12-11T20:33:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.973+0000 7fd44ffff700 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.974+0000 7fd45579c700 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6af490 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fd448096070 tx=0x7fd4480996b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293c603ed0b47b29 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.975+0000 7fd43b7fe700 1 -- 172.21.15.12:0/2582844755 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44809aea0 con 0x55f89a694720 2023-12-11T20:33:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.975+0000 7fd43b7fe700 1 -- 172.21.15.12:0/2582844755 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd44801b320 con 0x55f89a694720 2023-12-11T20:33:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.976+0000 7fd43b7fe700 1 -- 172.21.15.12:0/2582844755 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480ca3d0 con 0x55f89a694720 2023-12-11T20:33:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.976+0000 7fd46ac02b80 1 -- 172.21.15.12:0/2582844755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 msgr2=0x55f89a6af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.976+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6af490 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fd448096070 tx=0x7fd4480996b0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.979+0000 7fd46ac02b80 1 -- 172.21.15.12:0/2582844755 shutdown_connections 2023-12-11T20:33:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.979+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6af490 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.979+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a6a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.979+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/2582844755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.979+0000 7fd46ac02b80 1 -- 172.21.15.12:0/2582844755 >> 172.21.15.12:0/2582844755 conn(0x55f89a5c2780 msgr2=0x55f89a68f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.979+0000 7fd46ac02b80 1 -- 172.21.15.12:0/2582844755 shutdown_connections 2023-12-11T20:33:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.980+0000 7fd46ac02b80 1 -- 172.21.15.12:0/2582844755 wait complete. 2023-12-11T20:33:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.980+0000 7fd46ac02b80 1 -- start start 2023-12-11T20:33:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.981+0000 7fd46ac02b80 1 Processor -- start 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.982+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.982+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.982+0000 7fd46ac02b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.982+0000 7fd46ac02b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a6fd750 con 0x55f89a694720 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.982+0000 7fd46ac02b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a6fd890 con 0x55f89a693830 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd46ac02b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f89a70ea60 con 0x55f89a692ed0 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd46ac02b80 10 client.0 _ll_register_callbacks cb 0x55f89a4cca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.982+0000 7fd454f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd454f9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:40242/0 (socket says 172.21.15.12:40242) 2023-12-11T20:33:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd454f9b700 1 -- 172.21.15.12:0/4182110218 learned_addr learned my addr 172.21.15.12:0/4182110218 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd45579c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd44ffff700 1 -- 172.21.15.12:0/4182110218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 msgr2=0x55f89a69a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd44ffff700 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd44ffff700 1 -- 172.21.15.12:0/4182110218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 msgr2=0x55f89a6fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd44ffff700 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.983+0000 7fd44ffff700 1 -- 172.21.15.12:0/4182110218 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4501a5ec0 con 0x55f89a693830 2023-12-11T20:33:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.984+0000 7fd44ffff700 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6fabe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55f89a68ef30 tx=0x7fd43c003ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2dfe66027b439 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.984+0000 7fd42ffff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.984+0000 7fd42ffff700 1 -- 172.21.15.12:0/4182110218 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c019750 con 0x55f89a693830 2023-12-11T20:33:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.984+0000 7fd42ffff700 1 -- 172.21.15.12:0/4182110218 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd43c0198b0 con 0x55f89a693830 2023-12-11T20:33:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.984+0000 7fd46ac02b80 1 -- 172.21.15.12:0/4182110218 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd44400bcc0 con 0x55f89a693830 2023-12-11T20:33:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.985+0000 7fd42ffff700 1 -- 172.21.15.12:0/4182110218 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd43c012450 con 0x55f89a693830 2023-12-11T20:33:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.985+0000 7fd46ac02b80 10 client.29918 fetch_fsmap learned FSMap version 36 2023-12-11T20:33:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.985+0000 7fd46ac02b80 1 -- 172.21.15.12:0/4182110218 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f89a4371f0 con 0x55f89a693830 2023-12-11T20:33:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.986+0000 7fd42ffff700 1 -- 172.21.15.12:0/4182110218 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd44400bcc0 con 0x55f89a693830 2023-12-11T20:33:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.987+0000 7fd42ffff700 1 -- 172.21.15.12:0/4182110218 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 36) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd43c02c5b0 con 0x55f89a693830 2023-12-11T20:33:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.987+0000 7fd46ac02b80 10 client.29918 fetch_fsmap finished waiting for FSMap version 36 2023-12-11T20:33:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.987+0000 7fd46ac02b80 10 client.29918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.987+0000 7fd46ac02b80 20 client.29918 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.987+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f89a7103c0 0x55f89a7127e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.987+0000 7fd46ac02b80 4 client.29918 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:33:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.987+0000 7fd46ac02b80 1 -- 172.21.15.12:0/4182110218 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f89a5adf70 con 0x55f89a7103c0 2023-12-11T20:33:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.987+0000 7fd454f9b700 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f89a7103c0 0x55f89a7127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.988+0000 7fd454f9b700 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f89a7103c0 0x55f89a7127e0 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2186bbefa34a615 server_cookie=2d240bfb7e8ddacd in_seq=0 out_seq=0 2023-12-11T20:33:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:24.988+0000 7fd42ffff700 10 client.29918 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.006+0000 7fd42ffff700 1 -- 172.21.15.12:0/4182110218 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f89a5adf70 con 0x55f89a7103c0 2023-12-11T20:33:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.006+0000 7fd42ffff700 10 client.29918 handle_command_reply: tid=0 2023-12-11T20:33:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.006+0000 7fd46ac02b80 1 client.29918 shutdown 2023-12-11T20:33:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd46ac02b80 1 -- 172.21.15.12:0/4182110218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 msgr2=0x55f89a6fabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6fabe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55f89a68ef30 tx=0x7fd43c003ee0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd46ac02b80 1 -- 172.21.15.12:0/4182110218 shutdown_connections 2023-12-11T20:33:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f89a7103c0 0x55f89a7127e0 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f89a694720 0x55f89a6fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f89a692ed0 0x55f89a69a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd46ac02b80 1 --2- 172.21.15.12:0/4182110218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f89a693830 0x55f89a6fabe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd46ac02b80 1 -- 172.21.15.12:0/4182110218 >> 172.21.15.12:0/4182110218 conn(0x55f89a5c2780 msgr2=0x55f89a6af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:25.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.007+0000 7fd42ffff700 0 client.29918 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.008+0000 7fd46ac02b80 1 -- 172.21.15.12:0/4182110218 shutdown_connections 2023-12-11T20:33:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.010+0000 7fd46ac02b80 1 -- 172.21.15.12:0/4182110218 wait complete. 2023-12-11T20:33:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.010+0000 7fd46ac02b80 20 client.29918 trim_cache size 0 max 16384 2023-12-11T20:33:25.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:33:25.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:33:25.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:33:25.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:33:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 -- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd4400a15b0 msgr2=0x7fd4400a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd4400a15b0 0x7fd4400a3a70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd4440098e0 tx=0x7fd444000bc0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 -- 172.21.15.12:0/950592097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450109680 msgr2=0x7fd4501a4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450109680 0x7fd4501a4ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd44800efc0 tx=0x7fd44800c3a0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 -- 172.21.15.12:0/950592097 shutdown_connections 2023-12-11T20:33:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fd4400a15b0 0x7fd4400a3a70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd450109680 0x7fd4501a4ee0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd450107af0 0x7fd45019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 --2- 172.21.15.12:0/950592097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd450108ce0 0x7fd45019df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.011+0000 7fd4571ff700 1 -- 172.21.15.12:0/950592097 >> 172.21.15.12:0/950592097 conn(0x7fd450076ac0 msgr2=0x7fd45010c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.012+0000 7fd4571ff700 1 -- 172.21.15.12:0/950592097 shutdown_connections 2023-12-11T20:33:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:25.012+0000 7fd4571ff700 1 -- 172.21.15.12:0/950592097 wait complete. 2023-12-11T20:33:25.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:24 smithi039 ceph-mon[102205]: pgmap v899: 97 pgs: 97 active+clean; 13 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2023-12-11T20:33:25.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:24 smithi012 ceph-mon[128787]: pgmap v899: 97 pgs: 97 active+clean; 13 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2023-12-11T20:33:26.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:26 smithi032 ceph-mon[132488]: pgmap v900: 97 pgs: 97 active+clean; 13 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:26.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:26 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:33:26.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:26 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:33:27.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:26 smithi039 ceph-mon[102205]: pgmap v900: 97 pgs: 97 active+clean; 13 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:27.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:26 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:33:27.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:26 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:33:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:26 smithi012 ceph-mon[128787]: pgmap v900: 97 pgs: 97 active+clean; 13 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:26 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:33:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:26 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:33:27.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:27 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:33:28.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:27 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:33:28.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:27 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:33:28.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:28 smithi032 ceph-mon[132488]: pgmap v901: 97 pgs: 97 active+clean; 13 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:33:29.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:28 smithi039 ceph-mon[102205]: pgmap v901: 97 pgs: 97 active+clean; 13 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:33:29.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:28 smithi012 ceph-mon[128787]: pgmap v901: 97 pgs: 97 active+clean; 13 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 MiB/s wr, 4.96k op/s 2023-12-11T20:33:31.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:30 smithi039 ceph-mon[102205]: pgmap v902: 97 pgs: 97 active+clean; 13 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2023-12-11T20:33:31.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:30 smithi012 ceph-mon[128787]: pgmap v902: 97 pgs: 97 active+clean; 13 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2023-12-11T20:33:31.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:30 smithi032 ceph-mon[132488]: pgmap v902: 97 pgs: 97 active+clean; 13 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.60k op/s 2023-12-11T20:33:33.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:32 smithi039 ceph-mon[102205]: pgmap v903: 97 pgs: 97 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.86k op/s 2023-12-11T20:33:33.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:32 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:33.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:32 smithi012 ceph-mon[128787]: pgmap v903: 97 pgs: 97 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.86k op/s 2023-12-11T20:33:33.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:32 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:33.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:32 smithi032 ceph-mon[132488]: pgmap v903: 97 pgs: 97 active+clean; 13 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 4.86k op/s 2023-12-11T20:33:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:32 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:35.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:34 smithi039 ceph-mon[102205]: pgmap v904: 97 pgs: 97 active+clean; 13 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2023-12-11T20:33:35.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:34 smithi012 ceph-mon[128787]: pgmap v904: 97 pgs: 97 active+clean; 13 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2023-12-11T20:33:35.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:34 smithi032 ceph-mon[132488]: pgmap v904: 97 pgs: 97 active+clean; 13 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.41k op/s 2023-12-11T20:33:37.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:36 smithi039 ceph-mon[102205]: pgmap v905: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:37.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:36 smithi012 ceph-mon[128787]: pgmap v905: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:37.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:36 smithi032 ceph-mon[132488]: pgmap v905: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:38.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:37 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:38.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:37 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:38.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:37 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.910+0000 7f1b3cdff700 1 -- 172.21.15.12:0/2653564836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b381048b0 msgr2=0x7f1b38106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.910+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/2653564836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b381048b0 0x7f1b38106ca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0098f0 tx=0x7f1b2c009c00 comp rx=0 tx=0).stop 2023-12-11T20:33:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.910+0000 7f1b3cdff700 1 -- 172.21.15.12:0/2653564836 shutdown_connections 2023-12-11T20:33:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.910+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/2653564836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b381071e0 0x7f1b38109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.910+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/2653564836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b38101f80 0x7f1b38104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.910+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/2653564836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b381048b0 0x7f1b38106ca0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.910+0000 7f1b3cdff700 1 -- 172.21.15.12:0/2653564836 >> 172.21.15.12:0/2653564836 conn(0x7f1b380fb930 msgr2=0x7f1b380fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.911+0000 7f1b3cdff700 1 -- 172.21.15.12:0/2653564836 shutdown_connections 2023-12-11T20:33:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.911+0000 7f1b3cdff700 1 -- 172.21.15.12:0/2653564836 wait complete. 2023-12-11T20:33:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.912+0000 7f1b3cdff700 1 Processor -- start 2023-12-11T20:33:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.912+0000 7f1b3cdff700 1 -- start start 2023-12-11T20:33:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.912+0000 7f1b3cdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b38101f80 0x7f1b381951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.913+0000 7f1b3cdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b381048b0 0x7f1b381956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.913+0000 7f1b3cdff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b381071e0 0x7f1b381a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.913+0000 7f1b3cdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b381a55b0 con 0x7f1b381048b0 2023-12-11T20:33:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.913+0000 7f1b3cdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b381a56f0 con 0x7f1b38101f80 2023-12-11T20:33:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.913+0000 7f1b3cdff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b381a5830 con 0x7f1b381071e0 2023-12-11T20:33:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.914+0000 7f1b36d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b381071e0 0x7f1b381a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.914+0000 7f1b36d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b381071e0 0x7f1b381a5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54890/0 (socket says 172.21.15.12:54890) 2023-12-11T20:33:38.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.914+0000 7f1b36d9d700 1 -- 172.21.15.12:0/773050879 learned_addr learned my addr 172.21.15.12:0/773050879 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.913+0000 7f1b3659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b38101f80 0x7f1b381951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.914+0000 7f1b36d9d700 1 -- 172.21.15.12:0/773050879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b38101f80 msgr2=0x7f1b381951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.914+0000 7f1b36d9d700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b38101f80 0x7f1b381951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.914+0000 7f1b36d9d700 1 -- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b381048b0 msgr2=0x7f1b381956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.914+0000 7f1b36d9d700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b381048b0 0x7f1b381956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.914+0000 7f1b36d9d700 1 -- 172.21.15.12:0/773050879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280095f0 con 0x7f1b381071e0 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.915+0000 7f1b36d9d700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b381071e0 0x7f1b381a5070 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b30007ee0 tx=0x7f1b3000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.915+0000 7f1b277fe700 1 -- 172.21.15.12:0/773050879 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30017070 con 0x7f1b381071e0 2023-12-11T20:33:38.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.915+0000 7f1b3cdff700 1 -- 172.21.15.12:0/773050879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c009520 con 0x7f1b381071e0 2023-12-11T20:33:38.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.915+0000 7f1b277fe700 1 -- 172.21.15.12:0/773050879 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b3000f040 con 0x7f1b381071e0 2023-12-11T20:33:38.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.915+0000 7f1b277fe700 1 -- 172.21.15.12:0/773050879 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30005710 con 0x7f1b381071e0 2023-12-11T20:33:38.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.917+0000 7f1b3cdff700 1 -- 172.21.15.12:0/773050879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b381a5d80 con 0x7f1b381071e0 2023-12-11T20:33:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.921+0000 7f1b277fe700 1 -- 172.21.15.12:0/773050879 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1b30005870 con 0x7f1b381071e0 2023-12-11T20:33:38.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.923+0000 7f1b277fe700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b200a1470 0x7f1b200a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.923+0000 7f1b277fe700 1 -- 172.21.15.12:0/773050879 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1b300ce220 con 0x7f1b381071e0 2023-12-11T20:33:38.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.924+0000 7f1b3659c700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b200a1470 0x7f1b200a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.925+0000 7f1b50818b80 1 Processor -- start 2023-12-11T20:33:38.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.925+0000 7f1b50818b80 1 -- start start 2023-12-11T20:33:38.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.926+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f07632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.927+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0764140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.927+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0764ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.927+0000 7f1b50818b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f06beaf0 con 0x5571f0762ed0 2023-12-11T20:33:38.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.927+0000 7f1b50818b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f06bc410 con 0x5571f0763830 2023-12-11T20:33:38.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.927+0000 7f1b50818b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f06b7d00 con 0x5571f0764720 2023-12-11T20:33:38.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.927+0000 7f1b3659c700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b200a1470 0x7f1b200a3930 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005fd0 tx=0x7f1b28009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b3659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f07632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b36d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0764ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b35d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0764140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b36d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0764ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54904/0 (socket says 172.21.15.12:54904) 2023-12-11T20:33:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b36d9d700 1 -- 172.21.15.12:0/2677830950 learned_addr learned my addr 172.21.15.12:0/2677830950 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b3659c700 1 -- 172.21.15.12:0/2677830950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 msgr2=0x5571f0764ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b3659c700 1 --2- 172.21.15.12:0/2677830950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0764ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b3659c700 1 -- 172.21.15.12:0/2677830950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 msgr2=0x5571f0764140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b3659c700 1 --2- 172.21.15.12:0/2677830950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0764140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.928+0000 7f1b3659c700 1 -- 172.21.15.12:0/2677830950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571f05345d0 con 0x5571f0762ed0 2023-12-11T20:33:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.930+0000 7f1b3659c700 1 --2- 172.21.15.12:0/2677830950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f07632f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1b280124a0 tx=0x7f1b28014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd13c47f0550785 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.930+0000 7f1b24ff9700 1 -- 172.21.15.12:0/2677830950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2801f620 con 0x5571f0762ed0 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.930+0000 7f1b24ff9700 1 -- 172.21.15.12:0/2677830950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b28016070 con 0x5571f0762ed0 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.930+0000 7f1b24ff9700 1 -- 172.21.15.12:0/2677830950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2801d980 con 0x5571f0762ed0 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 -- 172.21.15.12:0/2677830950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 msgr2=0x5571f07632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 --2- 172.21.15.12:0/2677830950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f07632f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1b280124a0 tx=0x7f1b28014000 comp rx=0 tx=0).stop 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 -- 172.21.15.12:0/2677830950 shutdown_connections 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 --2- 172.21.15.12:0/2677830950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0764ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 --2- 172.21.15.12:0/2677830950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f07632f0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 --2- 172.21.15.12:0/2677830950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0764140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 -- 172.21.15.12:0/2677830950 >> 172.21.15.12:0/2677830950 conn(0x5571f0692780 msgr2=0x5571f075f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 -- 172.21.15.12:0/2677830950 shutdown_connections 2023-12-11T20:33:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.932+0000 7f1b50818b80 1 -- 172.21.15.12:0/2677830950 wait complete. 2023-12-11T20:33:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.933+0000 7f1b50818b80 1 -- start start 2023-12-11T20:33:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.934+0000 7f1b50818b80 1 Processor -- start 2023-12-11T20:33:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.935+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f076cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.935+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f076d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.936+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0774290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.936+0000 7f1b50818b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f0671500 con 0x5571f0762ed0 2023-12-11T20:33:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.936+0000 7f1b50818b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f06711a0 con 0x5571f0763830 2023-12-11T20:33:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.936+0000 7f1b50818b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f05368c0 con 0x5571f0764720 2023-12-11T20:33:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.937+0000 7f1b3659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f076cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.937+0000 7f1b35d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f076d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.937+0000 7f1b35d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f076d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50558/0 (socket says 172.21.15.12:50558) 2023-12-11T20:33:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.937+0000 7f1b35d9b700 1 -- 172.21.15.12:0/1066861477 learned_addr learned my addr 172.21.15.12:0/1066861477 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.937+0000 7f1b36d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0774290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.937+0000 7f1b50818b80 10 client.0 _ll_register_callbacks cb 0x5571f059ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.937+0000 7f1b3659c700 1 -- 172.21.15.12:0/1066861477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 msgr2=0x5571f0774290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.937+0000 7f1b3659c700 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0774290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.938+0000 7f1b3659c700 1 -- 172.21.15.12:0/1066861477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 msgr2=0x5571f076d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.938+0000 7f1b3659c700 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f076d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.938+0000 7f1b3659c700 1 -- 172.21.15.12:0/1066861477 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b28011ce0 con 0x5571f0762ed0 2023-12-11T20:33:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.939+0000 7f1b3659c700 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f076cf20 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1b280124a0 tx=0x7f1b28005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0c57ae8c70546c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:38.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.939+0000 7f1b1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:38.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.939+0000 7f1b1dffb700 1 -- 172.21.15.12:0/1066861477 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2802e070 con 0x5571f0762ed0 2023-12-11T20:33:38.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.940+0000 7f1b1dffb700 1 -- 172.21.15.12:0/1066861477 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1b28018070 con 0x5571f0762ed0 2023-12-11T20:33:38.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.940+0000 7f1b50818b80 1 -- 172.21.15.12:0/1066861477 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571f0756730 con 0x5571f0762ed0 2023-12-11T20:33:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.941+0000 7f1b1dffb700 1 -- 172.21.15.12:0/1066861477 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b2802e070 con 0x5571f0762ed0 2023-12-11T20:33:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.941+0000 7f1b50818b80 10 client.20397 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:38.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.941+0000 7f1b50818b80 1 -- 172.21.15.12:0/1066861477 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5571f04e0d80 con 0x5571f0762ed0 2023-12-11T20:33:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.942+0000 7f1b1dffb700 1 -- 172.21.15.12:0/1066861477 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b2803a030 con 0x5571f0762ed0 2023-12-11T20:33:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.942+0000 7f1b1dffb700 1 -- 172.21.15.12:0/1066861477 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1b2801dcf0 con 0x5571f0762ed0 2023-12-11T20:33:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.942+0000 7f1b50818b80 10 client.20397 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.942+0000 7f1b50818b80 10 client.20397 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.942+0000 7f1b50818b80 20 client.20397 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.942+0000 7f1b50818b80 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571f0778bf0 0x5571f077b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.942+0000 7f1b50818b80 4 client.20397 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.942+0000 7f1b50818b80 1 -- 172.21.15.12:0/1066861477 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571f0732ee0 con 0x5571f0778bf0 2023-12-11T20:33:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.943+0000 7f1b35d9b700 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571f0778bf0 0x5571f077b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.944+0000 7f1b35d9b700 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571f0778bf0 0x5571f077b010 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=380a6c518871c0d7 server_cookie=a640c49633544d15 in_seq=0 out_seq=0 2023-12-11T20:33:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.944+0000 7f1b1dffb700 10 client.20397 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.945+0000 7f1b1dffb700 1 -- 172.21.15.12:0/1066861477 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571f0732ee0 con 0x5571f0778bf0 2023-12-11T20:33:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.945+0000 7f1b1dffb700 10 client.20397 handle_command_reply: tid=0 2023-12-11T20:33:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.945+0000 7f1b50818b80 1 client.20397 shutdown 2023-12-11T20:33:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 -- 172.21.15.12:0/1066861477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 msgr2=0x5571f076cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f076cf20 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1b280124a0 tx=0x7f1b28005750 comp rx=0 tx=0).stop 2023-12-11T20:33:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 -- 172.21.15.12:0/1066861477 shutdown_connections 2023-12-11T20:33:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571f0778bf0 0x5571f077b010 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0774290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b1dffb700 0 client.20397 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f076cf20 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 --2- 172.21.15.12:0/1066861477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f076d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 -- 172.21.15.12:0/1066861477 >> 172.21.15.12:0/1066861477 conn(0x5571f0692780 msgr2=0x5571f075dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 -- 172.21.15.12:0/1066861477 shutdown_connections 2023-12-11T20:33:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 1 -- 172.21.15.12:0/1066861477 wait complete. 2023-12-11T20:33:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.946+0000 7f1b50818b80 20 client.20397 trim_cache size 0 max 16384 2023-12-11T20:33:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.978+0000 7f1b50818b80 1 Processor -- start 2023-12-11T20:33:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.978+0000 7f1b50818b80 1 -- start start 2023-12-11T20:33:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.979+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0762ed0 0x5571f07632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.979+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0774220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.979+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0764720 0x5571f076c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.979+0000 7f1b50818b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f07748c0 con 0x5571f0764720 2023-12-11T20:33:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.979+0000 7f1b50818b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f0780240 con 0x5571f0763830 2023-12-11T20:33:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.979+0000 7f1b50818b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f076a910 con 0x5571f0762ed0 2023-12-11T20:33:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b3659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0762ed0 0x5571f07632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b35d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0774220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b36d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0764720 0x5571f076c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b36d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0764720 0x5571f076c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39398/0 (socket says 172.21.15.12:39398) 2023-12-11T20:33:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b36d9d700 1 -- 172.21.15.12:0/3242702055 learned_addr learned my addr 172.21.15.12:0/3242702055 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b36d9d700 1 -- 172.21.15.12:0/3242702055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0762ed0 msgr2=0x5571f07632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b36d9d700 1 --2- 172.21.15.12:0/3242702055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0762ed0 0x5571f07632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b36d9d700 1 -- 172.21.15.12:0/3242702055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 msgr2=0x5571f0774220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.980+0000 7f1b36d9d700 1 --2- 172.21.15.12:0/3242702055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0774220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.981+0000 7f1b36d9d700 1 -- 172.21.15.12:0/3242702055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571f04c9c00 con 0x5571f0764720 2023-12-11T20:33:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.981+0000 7f1b3659c700 1 --2- 172.21.15.12:0/3242702055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0762ed0 0x5571f07632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.981+0000 7f1b36d9d700 1 --2- 172.21.15.12:0/3242702055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0764720 0x5571f076c220 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1b300c98d0 tx=0x7f1b300cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6155d2170d7c7bc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.981+0000 7f1b257fa700 1 -- 172.21.15.12:0/3242702055 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b300990f0 con 0x5571f0764720 2023-12-11T20:33:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.982+0000 7f1b257fa700 1 -- 172.21.15.12:0/3242702055 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b3009d240 con 0x5571f0764720 2023-12-11T20:33:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.982+0000 7f1b257fa700 1 -- 172.21.15.12:0/3242702055 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30009470 con 0x5571f0764720 2023-12-11T20:33:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.982+0000 7f1b50818b80 1 -- 172.21.15.12:0/3242702055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0764720 msgr2=0x5571f076c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.982+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3242702055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0764720 0x5571f076c220 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1b300c98d0 tx=0x7f1b300cb040 comp rx=0 tx=0).stop 2023-12-11T20:33:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.984+0000 7f1b50818b80 1 -- 172.21.15.12:0/3242702055 shutdown_connections 2023-12-11T20:33:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.984+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3242702055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0764720 0x5571f076c220 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.984+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3242702055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0762ed0 0x5571f07632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.984+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3242702055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0774220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.984+0000 7f1b50818b80 1 -- 172.21.15.12:0/3242702055 >> 172.21.15.12:0/3242702055 conn(0x5571f0692780 msgr2=0x5571f076ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.985+0000 7f1b50818b80 1 -- 172.21.15.12:0/3242702055 shutdown_connections 2023-12-11T20:33:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.986+0000 7f1b50818b80 1 -- 172.21.15.12:0/3242702055 wait complete. 2023-12-11T20:33:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.986+0000 7f1b50818b80 1 -- start start 2023-12-11T20:33:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.987+0000 7f1b50818b80 1 Processor -- start 2023-12-11T20:33:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.987+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f0772000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0772540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b50818b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0773410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b50818b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f0773950 con 0x5571f0762ed0 2023-12-11T20:33:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b50818b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f0773ac0 con 0x5571f0763830 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b50818b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571f0773c80 con 0x5571f0764720 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b50818b80 10 client.0 _ll_register_callbacks cb 0x5571f059ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b3659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f0772000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b3659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f0772000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39414/0 (socket says 172.21.15.12:39414) 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.988+0000 7f1b3659c700 1 -- 172.21.15.12:0/3625458841 learned_addr learned my addr 172.21.15.12:0/3625458841 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.989+0000 7f1b35d9b700 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0772540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.989+0000 7f1b36d9d700 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0773410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.990+0000 7f1b35d9b700 1 -- 172.21.15.12:0/3625458841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 msgr2=0x5571f0773410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.990+0000 7f1b35d9b700 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0773410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.990+0000 7f1b35d9b700 1 -- 172.21.15.12:0/3625458841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 msgr2=0x5571f0772000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.990+0000 7f1b35d9b700 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f0772000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.990+0000 7f1b35d9b700 1 -- 172.21.15.12:0/3625458841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b381a5d80 con 0x5571f0763830 2023-12-11T20:33:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.991+0000 7f1b35d9b700 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0772540 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5571f077b910 tx=0x7f1b2c00f5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49729662de483a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.991+0000 7f1b1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.992+0000 7f1b1dffb700 1 -- 172.21.15.12:0/3625458841 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c01c040 con 0x5571f0763830 2023-12-11T20:33:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.992+0000 7f1b1dffb700 1 -- 172.21.15.12:0/3625458841 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1b2c0237a0 con 0x5571f0763830 2023-12-11T20:33:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.993+0000 7f1b50818b80 1 -- 172.21.15.12:0/3625458841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b28016070 con 0x5571f0763830 2023-12-11T20:33:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.993+0000 7f1b1dffb700 1 -- 172.21.15.12:0/3625458841 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b2c00f7e0 con 0x5571f0763830 2023-12-11T20:33:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.993+0000 7f1b50818b80 10 client.29936 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.993+0000 7f1b50818b80 1 -- 172.21.15.12:0/3625458841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5571f05071f0 con 0x5571f0763830 2023-12-11T20:33:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.994+0000 7f1b1dffb700 1 -- 172.21.15.12:0/3625458841 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b28016070 con 0x5571f0763830 2023-12-11T20:33:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.994+0000 7f1b1dffb700 1 -- 172.21.15.12:0/3625458841 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1b2c009920 con 0x5571f0763830 2023-12-11T20:33:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.994+0000 7f1b50818b80 10 client.29936 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.994+0000 7f1b50818b80 10 client.29936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.994+0000 7f1b50818b80 20 client.29936 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.994+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571f0778bf0 0x5571f07d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.994+0000 7f1b50818b80 4 client.29936 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:33:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.994+0000 7f1b50818b80 1 -- 172.21.15.12:0/3625458841 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5571f067df70 con 0x5571f0778bf0 2023-12-11T20:33:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:38.995+0000 7f1b3659c700 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571f0778bf0 0x5571f07d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.000+0000 7f1b3659c700 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571f0778bf0 0x5571f07d1ff0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6120320d8d29915 server_cookie=1b7ae7ca5623fde0 in_seq=0 out_seq=0 2023-12-11T20:33:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.000+0000 7f1b1dffb700 10 client.29936 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b1dffb700 1 -- 172.21.15.12:0/3625458841 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5571f067df70 con 0x5571f0778bf0 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b1dffb700 10 client.29936 handle_command_reply: tid=0 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 client.29936 shutdown 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 -- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 msgr2=0x5571f0772540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0772540 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5571f077b910 tx=0x7f1b2c00f5c0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 -- 172.21.15.12:0/3625458841 shutdown_connections 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5571f0778bf0 0x5571f07d1ff0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5571f0764720 0x5571f0773410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571f0762ed0 0x5571f0772000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 --2- 172.21.15.12:0/3625458841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571f0763830 0x5571f0772540 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b1dffb700 0 client.29936 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.020+0000 7f1b50818b80 1 -- 172.21.15.12:0/3625458841 >> 172.21.15.12:0/3625458841 conn(0x5571f0692780 msgr2=0x5571f076aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.021+0000 7f1b50818b80 1 -- 172.21.15.12:0/3625458841 shutdown_connections 2023-12-11T20:33:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.021+0000 7f1b50818b80 1 -- 172.21.15.12:0/3625458841 wait complete. 2023-12-11T20:33:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.021+0000 7f1b50818b80 20 client.29936 trim_cache size 0 max 16384 2023-12-11T20:33:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:33:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:33:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:33:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:33:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 -- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b200a1470 msgr2=0x7f1b200a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b200a1470 0x7f1b200a3930 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005fd0 tx=0x7f1b28009310 comp rx=0 tx=0).stop 2023-12-11T20:33:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 -- 172.21.15.12:0/773050879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b381071e0 msgr2=0x7f1b381a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b381071e0 0x7f1b381a5070 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b30007ee0 tx=0x7f1b3000d3b0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 -- 172.21.15.12:0/773050879 shutdown_connections 2023-12-11T20:33:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1b200a1470 0x7f1b200a3930 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b38101f80 0x7f1b381951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b381071e0 0x7f1b381a5070 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 --2- 172.21.15.12:0/773050879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b381048b0 0x7f1b381956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.022+0000 7f1b3cdff700 1 -- 172.21.15.12:0/773050879 >> 172.21.15.12:0/773050879 conn(0x7f1b380fb930 msgr2=0x7f1b38101710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.023+0000 7f1b3cdff700 1 -- 172.21.15.12:0/773050879 shutdown_connections 2023-12-11T20:33:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:39.024+0000 7f1b3cdff700 1 -- 172.21.15.12:0/773050879 wait complete. 2023-12-11T20:33:39.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:38 smithi039 ceph-mon[102205]: pgmap v906: 97 pgs: 97 active+clean; 13 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 4.98k op/s 2023-12-11T20:33:39.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:38 smithi012 ceph-mon[128787]: pgmap v906: 97 pgs: 97 active+clean; 13 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 4.98k op/s 2023-12-11T20:33:39.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:38 smithi032 ceph-mon[132488]: pgmap v906: 97 pgs: 97 active+clean; 13 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 4.98k op/s 2023-12-11T20:33:41.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:40 smithi039 ceph-mon[102205]: pgmap v907: 97 pgs: 97 active+clean; 13 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 MiB/s wr, 4.61k op/s 2023-12-11T20:33:41.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:40 smithi012 ceph-mon[128787]: pgmap v907: 97 pgs: 97 active+clean; 13 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 MiB/s wr, 4.61k op/s 2023-12-11T20:33:41.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:40 smithi032 ceph-mon[132488]: pgmap v907: 97 pgs: 97 active+clean; 13 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 MiB/s wr, 4.61k op/s 2023-12-11T20:33:42.054 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:41 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:33:42.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:41 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:33:42.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:41 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:33:43.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.82k op/s 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi032 to 223.0M 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: Unable to set osd_memory_target on smithi032 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: Adjusting osd_memory_target on smithi039 to 221.9M 2023-12-11T20:33:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:42 smithi039 ceph-mon[102205]: Unable to set osd_memory_target on smithi039 to 232772915: error parsing value: Value '232772915' is below minimum 939524096 2023-12-11T20:33:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.82k op/s 2023-12-11T20:33:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi032 to 223.0M 2023-12-11T20:33:43.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: Unable to set osd_memory_target on smithi032 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:33:43.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: Adjusting osd_memory_target on smithi039 to 221.9M 2023-12-11T20:33:43.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:42 smithi012 ceph-mon[128787]: Unable to set osd_memory_target on smithi039 to 232772915: error parsing value: Value '232772915' is below minimum 939524096 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.82k op/s 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi032 to 223.0M 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: Unable to set osd_memory_target on smithi032 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-12-11T20:33:43.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-11T20:33:43.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: Adjusting osd_memory_target on smithi039 to 221.9M 2023-12-11T20:33:43.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:42 smithi032 ceph-mon[132488]: Unable to set osd_memory_target on smithi039 to 232772915: error parsing value: Value '232772915' is below minimum 939524096 2023-12-11T20:33:43.222 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:33:43.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.802+0000 7f6a5fbff700 1 -- 172.21.15.12:0/2917129947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a58103040 msgr2=0x7f6a581098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.802+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/2917129947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a58103040 0x7f6a581098f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000b0a0 tx=0x7f6a5000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.803+0000 7f6a5fbff700 1 -- 172.21.15.12:0/2917129947 shutdown_connections 2023-12-11T20:33:43.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.803+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/2917129947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a581014b0 0x7f6a581018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.803+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/2917129947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a58103040 0x7f6a581098f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.803+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/2917129947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a581026a0 0x7f6a58102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.803+0000 7f6a5fbff700 1 -- 172.21.15.12:0/2917129947 >> 172.21.15.12:0/2917129947 conn(0x7f6a580fca00 msgr2=0x7f6a580fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:43.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.803+0000 7f6a5fbff700 1 -- 172.21.15.12:0/2917129947 shutdown_connections 2023-12-11T20:33:43.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.805+0000 7f6a5fbff700 1 -- 172.21.15.12:0/2917129947 wait complete. 2023-12-11T20:33:43.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.808+0000 7f6a5fbff700 1 Processor -- start 2023-12-11T20:33:43.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.808+0000 7f6a5fbff700 1 -- start start 2023-12-11T20:33:43.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.809+0000 7f6a5fbff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a581014b0 0x7f6a58195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5fbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a581026a0 0x7f6a58195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5fbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a58103040 0x7f6a581adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5d99b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a581014b0 0x7f6a58195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5d99b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a581014b0 0x7f6a58195350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54944/0 (socket says 172.21.15.12:54944) 2023-12-11T20:33:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5d99b700 1 -- 172.21.15.12:0/329929443 learned_addr learned my addr 172.21.15.12:0/329929443 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5819a890 con 0x7f6a581026a0 2023-12-11T20:33:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5819aa00 con 0x7f6a58103040 2023-12-11T20:33:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a581ae1c0 con 0x7f6a581014b0 2023-12-11T20:33:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5e19c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a58103040 0x7f6a581adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.810+0000 7f6a5d19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a581026a0 0x7f6a58195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.811+0000 7f6a5d19a700 1 -- 172.21.15.12:0/329929443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a581014b0 msgr2=0x7f6a58195350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.811+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a581014b0 0x7f6a58195350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.811+0000 7f6a5d19a700 1 -- 172.21.15.12:0/329929443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a58103040 msgr2=0x7f6a581adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.811+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a58103040 0x7f6a581adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.811+0000 7f6a5d19a700 1 -- 172.21.15.12:0/329929443 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50009d00 con 0x7f6a581026a0 2023-12-11T20:33:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.811+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a581026a0 0x7f6a58195890 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800b450 tx=0x7f6a4800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.812+0000 7f6a4effd700 1 -- 172.21.15.12:0/329929443 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48011620 con 0x7f6a581026a0 2023-12-11T20:33:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.812+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a581ae3c0 con 0x7f6a581026a0 2023-12-11T20:33:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.812+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a581ae9a0 con 0x7f6a581026a0 2023-12-11T20:33:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.812+0000 7f6a4effd700 1 -- 172.21.15.12:0/329929443 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a48009280 con 0x7f6a581026a0 2023-12-11T20:33:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.815+0000 7f6a4effd700 1 -- 172.21.15.12:0/329929443 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4801ab60 con 0x7f6a581026a0 2023-12-11T20:33:43.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.819+0000 7f6a4effd700 1 -- 172.21.15.12:0/329929443 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6a4801acc0 con 0x7f6a581026a0 2023-12-11T20:33:43.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.823+0000 7f6a735ebb80 1 Processor -- start 2023-12-11T20:33:43.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.823+0000 7f6a4effd700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6a440a14d0 0x7f6a440a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.823+0000 7f6a4effd700 1 -- 172.21.15.12:0/329929443 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6a480cc570 con 0x7f6a581026a0 2023-12-11T20:33:43.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.824+0000 7f6a735ebb80 1 -- start start 2023-12-11T20:33:43.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.824+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59af37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.824+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59af4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.824+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59af50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.824+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59a4eb50 con 0x55db59af4c20 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.824+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59a4c470 con 0x55db59af3d30 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.824+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59a47d60 con 0x55db59af33d0 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d99b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59af37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d99b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59af37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54958/0 (socket says 172.21.15.12:54958) 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d99b700 1 -- 172.21.15.12:0/2436083357 learned_addr learned my addr 172.21.15.12:0/2436083357 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/2436083357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59af4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d99b700 1 -- 172.21.15.12:0/2436083357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 msgr2=0x55db59af4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/2436083357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59af4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d99b700 1 -- 172.21.15.12:0/2436083357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 msgr2=0x55db59af50a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/2436083357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59af50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.825+0000 7f6a5d99b700 1 -- 172.21.15.12:0/2436083357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db598c4630 con 0x55db59af33d0 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.826+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/2436083357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59af37f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009df0 tx=0x7f6a54011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7d211dda1e3a1c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:43.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.826+0000 7f6a5e19c700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6a440a14d0 0x7f6a440a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.826+0000 7f6a43fff700 1 -- 172.21.15.12:0/2436083357 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54011e80 con 0x55db59af33d0 2023-12-11T20:33:43.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.826+0000 7f6a43fff700 1 -- 172.21.15.12:0/2436083357 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a540044c0 con 0x55db59af33d0 2023-12-11T20:33:43.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.826+0000 7f6a43fff700 1 -- 172.21.15.12:0/2436083357 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5403b460 con 0x55db59af33d0 2023-12-11T20:33:43.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.827+0000 7f6a735ebb80 1 -- 172.21.15.12:0/2436083357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 msgr2=0x55db59af37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.827+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/2436083357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59af37f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009df0 tx=0x7f6a54011720 comp rx=0 tx=0).stop 2023-12-11T20:33:43.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.827+0000 7f6a5e19c700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6a440a14d0 0x7f6a440a3990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009fd0 tx=0x7f6a500093a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:43.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.828+0000 7f6a735ebb80 1 -- 172.21.15.12:0/2436083357 shutdown_connections 2023-12-11T20:33:43.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.828+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/2436083357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59af50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.828+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/2436083357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59af37f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.828+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/2436083357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59af4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.828+0000 7f6a735ebb80 1 -- 172.21.15.12:0/2436083357 >> 172.21.15.12:0/2436083357 conn(0x55db59a227e0 msgr2=0x55db59aefd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:43.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.829+0000 7f6a735ebb80 1 -- 172.21.15.12:0/2436083357 shutdown_connections 2023-12-11T20:33:43.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.829+0000 7f6a735ebb80 1 -- 172.21.15.12:0/2436083357 wait complete. 2023-12-11T20:33:43.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.830+0000 7f6a735ebb80 1 -- start start 2023-12-11T20:33:43.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.830+0000 7f6a735ebb80 1 Processor -- start 2023-12-11T20:33:43.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.831+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59afd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.831+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59afd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.831+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59b04750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.831+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59a01560 con 0x55db59af4c20 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.831+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59a01200 con 0x55db59af3d30 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.831+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db598c6920 con 0x55db59af33d0 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.831+0000 7f6a735ebb80 10 client.0 _ll_register_callbacks cb 0x55db5992ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.832+0000 7f6a5d19a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59afd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.832+0000 7f6a5d19a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59afd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50616/0 (socket says 172.21.15.12:50616) 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.832+0000 7f6a5d19a700 1 -- 172.21.15.12:0/700748010 learned_addr learned my addr 172.21.15.12:0/700748010 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.832+0000 7f6a5d19a700 1 -- 172.21.15.12:0/700748010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 msgr2=0x55db59afd1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.832+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59afd1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.832+0000 7f6a5d19a700 1 -- 172.21.15.12:0/700748010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 msgr2=0x55db59b04750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.832+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59b04750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.832+0000 7f6a5d19a700 1 -- 172.21.15.12:0/700748010 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a54009a50 con 0x55db59af3d30 2023-12-11T20:33:43.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.833+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59afd710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6a48000c00 tx=0x7f6a4809dac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82b366df9584fd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.833+0000 7f6a417fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.834+0000 7f6a417fa700 1 -- 172.21.15.12:0/700748010 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48018510 con 0x55db59af3d30 2023-12-11T20:33:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.834+0000 7f6a417fa700 1 -- 172.21.15.12:0/700748010 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6a480840b0 con 0x55db59af3d30 2023-12-11T20:33:43.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.834+0000 7f6a735ebb80 1 -- 172.21.15.12:0/700748010 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db59ae6b40 con 0x55db59af3d30 2023-12-11T20:33:43.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.834+0000 7f6a417fa700 1 -- 172.21.15.12:0/700748010 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a48084270 con 0x55db59af3d30 2023-12-11T20:33:43.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.834+0000 7f6a735ebb80 10 client.29948 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:43.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.835+0000 7f6a735ebb80 1 -- 172.21.15.12:0/700748010 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55db59870de0 con 0x55db59af3d30 2023-12-11T20:33:43.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.835+0000 7f6a417fa700 1 -- 172.21.15.12:0/700748010 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55db59ae6b40 con 0x55db59af3d30 2023-12-11T20:33:43.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.835+0000 7f6a417fa700 1 -- 172.21.15.12:0/700748010 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6a48098e30 con 0x55db59af3d30 2023-12-11T20:33:43.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.838+0000 7f6a735ebb80 10 client.29948 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:43.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.838+0000 7f6a735ebb80 10 client.29948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:43.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.838+0000 7f6a735ebb80 20 client.29948 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:43.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.838+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55db59b09100 0x55db59b0b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.838+0000 7f6a735ebb80 4 client.29948 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:43.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.838+0000 7f6a735ebb80 1 -- 172.21.15.12:0/700748010 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db59ac2f40 con 0x55db59b09100 2023-12-11T20:33:43.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.839+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55db59b09100 0x55db59b0b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.840+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55db59b09100 0x55db59b0b520 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34cd6618de9f07b0 server_cookie=c5cb7bb84d244690 in_seq=0 out_seq=0 2023-12-11T20:33:43.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.840+0000 7f6a417fa700 10 client.29948 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.841+0000 7f6a417fa700 1 -- 172.21.15.12:0/700748010 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55db59ac2f40 con 0x55db59b09100 2023-12-11T20:33:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.841+0000 7f6a417fa700 10 client.29948 handle_command_reply: tid=0 2023-12-11T20:33:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.841+0000 7f6a735ebb80 1 client.29948 shutdown 2023-12-11T20:33:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.842+0000 7f6a735ebb80 1 -- 172.21.15.12:0/700748010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 msgr2=0x55db59afd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.842+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59afd710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6a48000c00 tx=0x7f6a4809dac0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a735ebb80 1 -- 172.21.15.12:0/700748010 shutdown_connections 2023-12-11T20:33:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55db59b09100 0x55db59b0b520 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59b04750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af33d0 0x55db59afd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a417fa700 0 client.29948 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/700748010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59afd710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a735ebb80 1 -- 172.21.15.12:0/700748010 >> 172.21.15.12:0/700748010 conn(0x55db59a227e0 msgr2=0x55db59aeea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a735ebb80 1 -- 172.21.15.12:0/700748010 shutdown_connections 2023-12-11T20:33:43.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.843+0000 7f6a735ebb80 1 -- 172.21.15.12:0/700748010 wait complete. 2023-12-11T20:33:43.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.844+0000 7f6a735ebb80 20 client.29948 trim_cache size 0 max 16384 2023-12-11T20:33:43.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.885+0000 7f6a735ebb80 1 Processor -- start 2023-12-11T20:33:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.885+0000 7f6a735ebb80 1 -- start start 2023-12-11T20:33:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.886+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af33d0 0x55db59af7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.886+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af3d30 0x55db59b04710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.886+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59af8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.886+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59b06460 con 0x55db59af4c20 2023-12-11T20:33:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.886+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59b10730 con 0x55db59af33d0 2023-12-11T20:33:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.886+0000 7f6a735ebb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59aeab50 con 0x55db59af3d30 2023-12-11T20:33:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.887+0000 7f6a5d19a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af3d30 0x55db59b04710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.887+0000 7f6a5d99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af33d0 0x55db59af7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.887+0000 7f6a5d19a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af3d30 0x55db59b04710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:54976/0 (socket says 172.21.15.12:54976) 2023-12-11T20:33:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.887+0000 7f6a5d19a700 1 -- 172.21.15.12:0/213514975 learned_addr learned my addr 172.21.15.12:0/213514975 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:43.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.887+0000 7f6a5e19c700 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59af8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.888+0000 7f6a5d19a700 1 -- 172.21.15.12:0/213514975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af33d0 msgr2=0x55db59af7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:43.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.888+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af33d0 0x55db59af7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.888+0000 7f6a5d19a700 1 -- 172.21.15.12:0/213514975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 msgr2=0x55db59af8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:43.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.888+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59af8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.888+0000 7f6a5d19a700 1 -- 172.21.15.12:0/213514975 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db59859c60 con 0x55db59af3d30 2023-12-11T20:33:43.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.888+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af33d0 0x55db59af7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:43.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.888+0000 7f6a5e19c700 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59af8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:43.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.888+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af3d30 0x55db59b04710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6a480962b0 tx=0x7f6a48095b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c7d8336566e2650 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:43.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.889+0000 7f6a4cbff700 1 -- 172.21.15.12:0/213514975 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48084270 con 0x55db59af3d30 2023-12-11T20:33:43.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.889+0000 7f6a4cbff700 1 -- 172.21.15.12:0/213514975 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a480840b0 con 0x55db59af3d30 2023-12-11T20:33:43.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.889+0000 7f6a4cbff700 1 -- 172.21.15.12:0/213514975 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48098f90 con 0x55db59af3d30 2023-12-11T20:33:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 -- 172.21.15.12:0/213514975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af3d30 msgr2=0x55db59b04710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af3d30 0x55db59b04710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6a480962b0 tx=0x7f6a48095b80 comp rx=0 tx=0).stop 2023-12-11T20:33:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 -- 172.21.15.12:0/213514975 shutdown_connections 2023-12-11T20:33:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af33d0 0x55db59af7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af4c20 0x55db59af8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/213514975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af3d30 0x55db59b04710 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 -- 172.21.15.12:0/213514975 >> 172.21.15.12:0/213514975 conn(0x55db59a227e0 msgr2=0x55db59afc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 -- 172.21.15.12:0/213514975 shutdown_connections 2023-12-11T20:33:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.890+0000 7f6a735ebb80 1 -- 172.21.15.12:0/213514975 wait complete. 2023-12-11T20:33:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.891+0000 7f6a735ebb80 1 -- start start 2023-12-11T20:33:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.891+0000 7f6a735ebb80 1 Processor -- start 2023-12-11T20:33:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.892+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af33d0 0x55db59b004e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.893+0000 7f6a735ebb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59b00a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.893+0000 7f6a5d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af33d0 0x55db59b004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.893+0000 7f6a5d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af33d0 0x55db59b004e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39450/0 (socket says 172.21.15.12:39450) 2023-12-11T20:33:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.893+0000 7f6a5d99b700 1 -- 172.21.15.12:0/1980594634 learned_addr learned my addr 172.21.15.12:0/1980594634 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.893+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59b00a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.893+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af4c20 0x55db59b03a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.894+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59b03f80 con 0x55db59af33d0 2023-12-11T20:33:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.894+0000 7f6a5e19c700 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af4c20 0x55db59b03a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.894+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59b040f0 con 0x55db59af3d30 2023-12-11T20:33:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.894+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db59b042b0 con 0x55db59af4c20 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a5d19a700 1 -- 172.21.15.12:0/1980594634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af4c20 msgr2=0x55db59b03a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af4c20 0x55db59b03a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a5d19a700 1 -- 172.21.15.12:0/1980594634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af33d0 msgr2=0x55db59b004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af33d0 0x55db59b004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a5d19a700 1 -- 172.21.15.12:0/1980594634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db598c4630 con 0x55db59af3d30 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af33d0 0x55db59b004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a5d19a700 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59b00a20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6a48097b90 tx=0x7f6a4809dac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e9ce13ba09c36fe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a735ebb80 10 client.0 _ll_register_callbacks cb 0x55db5992ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.895+0000 7f6a417fa700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.896+0000 7f6a417fa700 1 -- 172.21.15.12:0/1980594634 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480a1740 con 0x55db59af3d30 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.896+0000 7f6a417fa700 1 -- 172.21.15.12:0/1980594634 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6a480a1980 con 0x55db59af3d30 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.896+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a540044c0 con 0x55db59af3d30 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.896+0000 7f6a417fa700 1 -- 172.21.15.12:0/1980594634 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a48099cb0 con 0x55db59af3d30 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.896+0000 7f6a735ebb80 10 client.29954 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.896+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({fsmap=38}) v3 -- 0x7f6a5810a240 con 0x55db59af3d30 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.897+0000 7f6a417fa700 1 -- 172.21.15.12:0/1980594634 <== mon.2 v2:172.21.15.32:3300/0 4 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6a480cc0f0 con 0x55db59af3d30 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.897+0000 7f6a735ebb80 10 client.29954 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.897+0000 7f6a735ebb80 10 client.29954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.897+0000 7f6a735ebb80 20 client.29954 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.897+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55db59b5fee0 0x55db59b62360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.897+0000 7f6a735ebb80 4 client.29954 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.897+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55db59a0dfd0 con 0x55db59b5fee0 2023-12-11T20:33:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.898+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55db59b5fee0 0x55db59b62360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a5d99b700 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55db59b5fee0 0x55db59b62360 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4762bbad289516d4 server_cookie=ca2e50012457032a in_seq=0 out_seq=0 2023-12-11T20:33:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a417fa700 10 client.29954 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a417fa700 1 -- 172.21.15.12:0/1980594634 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55db59a0dfd0 con 0x55db59b5fee0 2023-12-11T20:33:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a417fa700 10 client.29954 handle_command_reply: tid=0 2023-12-11T20:33:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a735ebb80 1 client.29954 shutdown 2023-12-11T20:33:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 msgr2=0x55db59b00a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59b00a20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6a48097b90 tx=0x7f6a4809dac0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 shutdown_connections 2023-12-11T20:33:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55db59b5fee0 0x55db59b62360 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.902 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:33:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:33:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:33:43.902 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:33:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db59af4c20 0x55db59b03a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55db59af33d0 0x55db59b004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.899+0000 7f6a735ebb80 1 --2- 172.21.15.12:0/1980594634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55db59af3d30 0x55db59b00a20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.900+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 >> 172.21.15.12:0/1980594634 conn(0x55db59a227e0 msgr2=0x55db59afd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.900+0000 7f6a417fa700 0 client.29954 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.900+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 shutdown_connections 2023-12-11T20:33:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.900+0000 7f6a735ebb80 1 -- 172.21.15.12:0/1980594634 wait complete. 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.900+0000 7f6a735ebb80 20 client.29954 trim_cache size 0 max 16384 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.902+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6a440a14d0 msgr2=0x7f6a440a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.902+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6a440a14d0 0x7f6a440a3990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009fd0 tx=0x7f6a500093a0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a581026a0 msgr2=0x7f6a58195890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a581026a0 0x7f6a58195890 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800b450 tx=0x7f6a4800b760 comp rx=0 tx=0).stop 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 shutdown_connections 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6a440a14d0 0x7f6a440a3990 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a58103040 0x7f6a581adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a581014b0 0x7f6a58195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 --2- 172.21.15.12:0/329929443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a581026a0 0x7f6a58195890 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:43.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 >> 172.21.15.12:0/329929443 conn(0x7f6a580fca00 msgr2=0x7f6a581038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:43.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 shutdown_connections 2023-12-11T20:33:43.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:43.903+0000 7f6a5fbff700 1 -- 172.21.15.12:0/329929443 wait complete. 2023-12-11T20:33:43.942 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:33:43.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:33:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.332+0000 7f05adfff700 1 -- 172.21.15.12:0/2300854077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8101600 msgr2=0x7f05a8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.332+0000 7f05adfff700 1 --2- 172.21.15.12:0/2300854077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8101600 0x7f05a8101a60 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f059c009990 tx=0x7f059c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.333+0000 7f05adfff700 1 -- 172.21.15.12:0/2300854077 shutdown_connections 2023-12-11T20:33:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.333+0000 7f05adfff700 1 --2- 172.21.15.12:0/2300854077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05a8101fa0 0x7f05a8068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.333+0000 7f05adfff700 1 --2- 172.21.15.12:0/2300854077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a8100410 0x7f05a8100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.333+0000 7f05adfff700 1 --2- 172.21.15.12:0/2300854077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8101600 0x7f05a8101a60 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.333+0000 7f05adfff700 1 -- 172.21.15.12:0/2300854077 >> 172.21.15.12:0/2300854077 conn(0x7f05a80fb980 msgr2=0x7f05a80fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.333+0000 7f05adfff700 1 -- 172.21.15.12:0/2300854077 shutdown_connections 2023-12-11T20:33:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.334+0000 7f05adfff700 1 -- 172.21.15.12:0/2300854077 wait complete. 2023-12-11T20:33:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.335+0000 7f05adfff700 1 Processor -- start 2023-12-11T20:33:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.335+0000 7f05adfff700 1 -- start start 2023-12-11T20:33:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.336+0000 7f05adfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8100410 0x7f05a8107210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.337+0000 7f05adfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a8101600 0x7f05a8107750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.337+0000 7f05adfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05a8101fa0 0x7f05a810e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.338+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05a8101fa0 0x7f05a810e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.337+0000 7f05adfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a8107ea0 con 0x7f05a8100410 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.338+0000 7f05adfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a81adea0 con 0x7f05a8101fa0 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.338+0000 7f05a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05a8101fa0 0x7f05a810e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50636/0 (socket says 172.21.15.12:50636) 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.338+0000 7f05a7fff700 1 -- 172.21.15.12:0/204468495 learned_addr learned my addr 172.21.15.12:0/204468495 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.338+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a81ae060 con 0x7f05a8101600 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.338+0000 7f05a77fe700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8100410 0x7f05a8107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.338+0000 7f05a7fff700 1 -- 172.21.15.12:0/204468495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a8101600 msgr2=0x7f05a8107750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T20:33:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.339+0000 7f05a7fff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a8101600 0x7f05a8107750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.339+0000 7f05a7fff700 1 -- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8100410 msgr2=0x7f05a8107210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.339+0000 7f05a7fff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8100410 0x7f05a8107210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.339+0000 7f05a7fff700 1 -- 172.21.15.12:0/204468495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0095f0 con 0x7f05a8101fa0 2023-12-11T20:33:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.339+0000 7f05a77fe700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8100410 0x7f05a8107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.339+0000 7f05a7fff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05a8101fa0 0x7f05a810e770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f05a000ef30 tx=0x7f05a000c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:44.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.340+0000 7f05a4ff9700 1 -- 172.21.15.12:0/204468495 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0018070 con 0x7f05a8101fa0 2023-12-11T20:33:44.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.340+0000 7f05a4ff9700 1 -- 172.21.15.12:0/204468495 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05a000f040 con 0x7f05a8101fa0 2023-12-11T20:33:44.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.340+0000 7f05a4ff9700 1 -- 172.21.15.12:0/204468495 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0003d00 con 0x7f05a8101fa0 2023-12-11T20:33:44.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.340+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a81ae2e0 con 0x7f05a8101fa0 2023-12-11T20:33:44.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.341+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a81ae7a0 con 0x7f05a8101fa0 2023-12-11T20:33:44.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.343+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a8198e40 con 0x7f05a8101fa0 2023-12-11T20:33:44.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.345+0000 7f05a4ff9700 1 -- 172.21.15.12:0/204468495 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f05a000caa0 con 0x7f05a8101fa0 2023-12-11T20:33:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.351+0000 7f05a4ff9700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f05900a1550 0x7f05900a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.351+0000 7f05a4ff9700 1 -- 172.21.15.12:0/204468495 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f05a00cc2f0 con 0x7f05a8101fa0 2023-12-11T20:33:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.353+0000 7f05a77fe700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f05900a1550 0x7f05900a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.353+0000 7f05a4ff9700 1 -- 172.21.15.12:0/204468495 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f05a00958a0 con 0x7f05a8101fa0 2023-12-11T20:33:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:44.354+0000 7f05a77fe700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f05900a1550 0x7f05900a3a10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f05a8101460 tx=0x7f0598009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:45.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.026+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05a8068330 con 0x7f05a8101fa0 2023-12-11T20:33:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.028+0000 7f05a4ff9700 1 -- 172.21.15.12:0/204468495 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+11309 (secure 0 0 0) 0x7f05a8068330 con 0x7f05a8101fa0 2023-12-11T20:33:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:33:45.028 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:33:36.126988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:33:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.033+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f05900a1550 msgr2=0x7f05900a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.033+0000 7f05adfff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f05900a1550 0x7f05900a3a10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f05a8101460 tx=0x7f0598009260 comp rx=0 tx=0).stop 2023-12-11T20:33:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.033+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05a8101fa0 msgr2=0x7f05a810e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.033+0000 7f05adfff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05a8101fa0 0x7f05a810e770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f05a000ef30 tx=0x7f05a000c450 comp rx=0 tx=0).stop 2023-12-11T20:33:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.034+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 shutdown_connections 2023-12-11T20:33:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.034+0000 7f05adfff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f05900a1550 0x7f05900a3a10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.034+0000 7f05adfff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05a8101fa0 0x7f05a810e770 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.034+0000 7f05adfff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8100410 0x7f05a8107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.034+0000 7f05adfff700 1 --2- 172.21.15.12:0/204468495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a8101600 0x7f05a8107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.034+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 >> 172.21.15.12:0/204468495 conn(0x7f05a80fb980 msgr2=0x7f05a80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:45.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.035+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 shutdown_connections 2023-12-11T20:33:45.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.035+0000 7f05adfff700 1 -- 172.21.15.12:0/204468495 wait complete. 2023-12-11T20:33:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 38 2023-12-11T20:33:45.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:44 smithi039 ceph-mon[102205]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2023-12-11T20:33:45.073 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:44 smithi012 ceph-mon[128787]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2023-12-11T20:33:45.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:33:45.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:44 smithi032 ceph-mon[132488]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2023-12-11T20:33:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.558+0000 7fc7f4dff700 1 -- 172.21.15.12:0/361544261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 msgr2=0x7fc7f0100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.558+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/361544261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 0x7fc7f0100ba0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80099c0 tx=0x7fc7d8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.559+0000 7fc7f4dff700 1 -- 172.21.15.12:0/361544261 shutdown_connections 2023-12-11T20:33:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.559+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/361544261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00ffdc0 0x7fc7f01001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.559+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/361544261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f01010e0 0x7fc7f0101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.559+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/361544261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 0x7fc7f0100ba0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.559+0000 7fc7f4dff700 1 -- 172.21.15.12:0/361544261 >> 172.21.15.12:0/361544261 conn(0x7fc7f00fb960 msgr2=0x7fc7f00fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:45.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.560+0000 7fc7f4dff700 1 -- 172.21.15.12:0/361544261 shutdown_connections 2023-12-11T20:33:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.560+0000 7fc7f4dff700 1 -- 172.21.15.12:0/361544261 wait complete. 2023-12-11T20:33:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.562+0000 7fc7f4dff700 1 Processor -- start 2023-12-11T20:33:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.562+0000 7fc7f4dff700 1 -- start start 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.562+0000 7fc7f4dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00ffdc0 0x7fc7f0104730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7f4dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 0x7fc7f0104c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7f4dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f01010e0 0x7fc7f010bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7f4dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f010c260 con 0x7fc7f0100720 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7f4dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f01ade70 con 0x7fc7f01010e0 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7f4dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f01adfb0 con 0x7fc7f00ffdc0 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7edd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 0x7fc7f0104c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7ee59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00ffdc0 0x7fc7f0104730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7ee59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00ffdc0 0x7fc7f0104730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55032/0 (socket says 172.21.15.12:55032) 2023-12-11T20:33:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7ee59c700 1 -- 172.21.15.12:0/2456046379 learned_addr learned my addr 172.21.15.12:0/2456046379 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.563+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f01010e0 0x7fc7f010bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.564+0000 7fc7edd9b700 1 -- 172.21.15.12:0/2456046379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00ffdc0 msgr2=0x7fc7f0104730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.564+0000 7fc7edd9b700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00ffdc0 0x7fc7f0104730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.564+0000 7fc7edd9b700 1 -- 172.21.15.12:0/2456046379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f01010e0 msgr2=0x7fc7f010bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.564+0000 7fc7edd9b700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f01010e0 0x7fc7f010bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.564+0000 7fc7edd9b700 1 -- 172.21.15.12:0/2456046379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d80095f0 con 0x7fc7f0100720 2023-12-11T20:33:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.564+0000 7fc7edd9b700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 0x7fc7f0104c70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8006010 tx=0x7fc7d8005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:45.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.565+0000 7fc7e77fe700 1 -- 172.21.15.12:0/2456046379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d801d070 con 0x7fc7f0100720 2023-12-11T20:33:45.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.566+0000 7fc7e77fe700 1 -- 172.21.15.12:0/2456046379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7d8005680 con 0x7fc7f0100720 2023-12-11T20:33:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.566+0000 7fc7e77fe700 1 -- 172.21.15.12:0/2456046379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800fab0 con 0x7fc7f0100720 2023-12-11T20:33:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.567+0000 7fc7f4dff700 1 -- 172.21.15.12:0/2456046379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f01ae230 con 0x7fc7f0100720 2023-12-11T20:33:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.567+0000 7fc7f4dff700 1 -- 172.21.15.12:0/2456046379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f01ae5a0 con 0x7fc7f0100720 2023-12-11T20:33:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.576+0000 7fc7e77fe700 1 -- 172.21.15.12:0/2456046379 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fc7d80036f0 con 0x7fc7f0100720 2023-12-11T20:33:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.576+0000 7fc80878db80 1 Processor -- start 2023-12-11T20:33:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.577+0000 7fc80878db80 1 -- start start 2023-12-11T20:33:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.577+0000 7fc80878db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e943d0 0x562eb2e947f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.577+0000 7fc80878db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2e95640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.577+0000 7fc80878db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e95c20 0x562eb2e960a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.577+0000 7fc80878db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2defb50 con 0x562eb2e94d30 2023-12-11T20:33:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.577+0000 7fc80878db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2ded470 con 0x562eb2e95c20 2023-12-11T20:33:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.577+0000 7fc80878db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2de8d60 con 0x562eb2e943d0 2023-12-11T20:33:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.579+0000 7fc7ee59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2e95640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.579+0000 7fc7e77fe700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7dc0a15d0 0x7fc7dc0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.580+0000 7fc7edd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e95c20 0x562eb2e960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.580+0000 7fc7edd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e95c20 0x562eb2e960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50672/0 (socket says 172.21.15.12:50672) 2023-12-11T20:33:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.580+0000 7fc7edd9b700 1 -- 172.21.15.12:0/3085865227 learned_addr learned my addr 172.21.15.12:0/3085865227 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.580+0000 7fc7e77fe700 1 -- 172.21.15.12:0/2456046379 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc7d80cd890 con 0x7fc7f0100720 2023-12-11T20:33:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.580+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e943d0 0x562eb2e947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.581+0000 7fc7eed9d700 1 -- 172.21.15.12:0/3085865227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e95c20 msgr2=0x562eb2e960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.581+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e95c20 0x562eb2e960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.581+0000 7fc7eed9d700 1 -- 172.21.15.12:0/3085865227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 msgr2=0x562eb2e95640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.581+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2e95640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.581+0000 7fc7eed9d700 1 -- 172.21.15.12:0/3085865227 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eb2c65630 con 0x562eb2e943d0 2023-12-11T20:33:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.581+0000 7fc7ee59c700 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2e95640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.581+0000 7fc7edd9b700 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e95c20 0x562eb2e960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.582+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7dc0a15d0 0x7fc7dc0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.582+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e943d0 0x562eb2e947f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8013610 tx=0x7fc7e8013920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=874970a1afe1137 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.583+0000 7fc7e4ff9700 1 -- 172.21.15.12:0/3085865227 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800e040 con 0x562eb2e943d0 2023-12-11T20:33:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.583+0000 7fc7e4ff9700 1 -- 172.21.15.12:0/3085865227 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7e800f040 con 0x562eb2e943d0 2023-12-11T20:33:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.583+0000 7fc7e4ff9700 1 -- 172.21.15.12:0/3085865227 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80163d0 con 0x562eb2e943d0 2023-12-11T20:33:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.584+0000 7fc80878db80 1 -- 172.21.15.12:0/3085865227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e943d0 msgr2=0x562eb2e947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.584+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7dc0a15d0 0x7fc7dc0a3a90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8020000 tx=0x7fc7e8016a00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.584+0000 7fc80878db80 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e943d0 0x562eb2e947f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8013610 tx=0x7fc7e8013920 comp rx=0 tx=0).stop 2023-12-11T20:33:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.584+0000 7fc80878db80 1 -- 172.21.15.12:0/3085865227 shutdown_connections 2023-12-11T20:33:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.584+0000 7fc80878db80 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e95c20 0x562eb2e960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.584+0000 7fc80878db80 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e943d0 0x562eb2e947f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.584+0000 7fc80878db80 1 --2- 172.21.15.12:0/3085865227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2e95640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.584+0000 7fc80878db80 1 -- 172.21.15.12:0/3085865227 >> 172.21.15.12:0/3085865227 conn(0x562eb2dc37e0 msgr2=0x562eb2e90d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.585+0000 7fc80878db80 1 -- 172.21.15.12:0/3085865227 shutdown_connections 2023-12-11T20:33:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.585+0000 7fc80878db80 1 -- 172.21.15.12:0/3085865227 wait complete. 2023-12-11T20:33:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.585+0000 7fc80878db80 1 -- start start 2023-12-11T20:33:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.586+0000 7fc80878db80 1 Processor -- start 2023-12-11T20:33:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.587+0000 7fc80878db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.587+0000 7fc80878db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2e9e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.587+0000 7fc80878db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.588+0000 7fc7edd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2e9e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.588+0000 7fc7ee59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.588+0000 7fc7ee59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39508/0 (socket says 172.21.15.12:39508) 2023-12-11T20:33:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.588+0000 7fc7edd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2e9e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50686/0 (socket says 172.21.15.12:50686) 2023-12-11T20:33:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.589+0000 7fc80878db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2da2560 con 0x562eb2e943d0 2023-12-11T20:33:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.589+0000 7fc80878db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2da2200 con 0x562eb2e94d30 2023-12-11T20:33:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.589+0000 7fc80878db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2c67920 con 0x562eb2e95c20 2023-12-11T20:33:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.589+0000 7fc80878db80 10 client.0 _ll_register_callbacks cb 0x562eb2ccda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.589+0000 7fc7eed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.590+0000 7fc7eed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55052/0 (socket says 172.21.15.12:55052) 2023-12-11T20:33:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.590+0000 7fc7eed9d700 1 -- 172.21.15.12:0/2213025884 learned_addr learned my addr 172.21.15.12:0/2213025884 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.591+0000 7fc7eed9d700 1 -- 172.21.15.12:0/2213025884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 msgr2=0x562eb2e9e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.591+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2e9e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.591+0000 7fc7eed9d700 1 -- 172.21.15.12:0/2213025884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 msgr2=0x562eb2e9e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.591+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.591+0000 7fc7edd9b700 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2e9e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-11T20:33:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.591+0000 7fc7eed9d700 1 -- 172.21.15.12:0/2213025884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f01ae5a0 con 0x562eb2e95c20 2023-12-11T20:33:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.591+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea57a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8013c70 tx=0x7fc7e8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95cde6242a4b9942 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.591+0000 7fc7d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.592+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/2213025884 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800e040 con 0x562eb2e95c20 2023-12-11T20:33:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.592+0000 7fc80878db80 1 -- 172.21.15.12:0/2213025884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562eb2e87b40 con 0x562eb2e95c20 2023-12-11T20:33:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.592+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/2213025884 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc7e8004c30 con 0x562eb2e95c20 2023-12-11T20:33:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.593+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/2213025884 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7e8004df0 con 0x562eb2e95c20 2023-12-11T20:33:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.593+0000 7fc80878db80 10 client.29971 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.593+0000 7fc80878db80 1 -- 172.21.15.12:0/2213025884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7fc7e80132f0 con 0x562eb2e95c20 2023-12-11T20:33:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.593+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/2213025884 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562eb2e87b40 con 0x562eb2e95c20 2023-12-11T20:33:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.594+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/2213025884 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc7e80364d0 con 0x562eb2e95c20 2023-12-11T20:33:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.594+0000 7fc80878db80 10 client.29971 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.594+0000 7fc80878db80 10 client.29971 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:33:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.594+0000 7fc80878db80 20 client.29971 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.594+0000 7fc80878db80 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x562eb2ea9fe0 0x562eb2eac400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.594+0000 7fc80878db80 4 client.29971 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.594+0000 7fc80878db80 1 -- 172.21.15.12:0/2213025884 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562eb2e63f40 con 0x562eb2ea9fe0 2023-12-11T20:33:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.595+0000 7fc7ee59c700 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x562eb2ea9fe0 0x562eb2eac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.595+0000 7fc7ee59c700 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x562eb2ea9fe0 0x562eb2eac400 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=43c3bee54145a94d server_cookie=430c10228dbf9cd8 in_seq=0 out_seq=0 2023-12-11T20:33:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.595+0000 7fc7d5ffb700 10 client.29971 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:33:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.597+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/2213025884 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562eb2e63f40 con 0x562eb2ea9fe0 2023-12-11T20:33:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.597+0000 7fc7d5ffb700 10 client.29971 handle_command_reply: tid=0 2023-12-11T20:33:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.597+0000 7fc80878db80 1 client.29971 shutdown 2023-12-11T20:33:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.598+0000 7fc80878db80 1 -- 172.21.15.12:0/2213025884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 msgr2=0x562eb2ea57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.598+0000 7fc80878db80 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea57a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8013c70 tx=0x7fc7e8018000 comp rx=0 tx=0).stop 2023-12-11T20:33:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.599+0000 7fc80878db80 1 -- 172.21.15.12:0/2213025884 shutdown_connections 2023-12-11T20:33:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.599+0000 7fc80878db80 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x562eb2ea9fe0 0x562eb2eac400 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.599+0000 7fc80878db80 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea57a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.599+0000 7fc80878db80 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.599+0000 7fc80878db80 1 --2- 172.21.15.12:0/2213025884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2e9e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.599+0000 7fc80878db80 1 -- 172.21.15.12:0/2213025884 >> 172.21.15.12:0/2213025884 conn(0x562eb2dc37e0 msgr2=0x562eb2e8fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.600+0000 7fc7d5ffb700 0 client.29971 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:33:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.600+0000 7fc80878db80 1 -- 172.21.15.12:0/2213025884 shutdown_connections 2023-12-11T20:33:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.600+0000 7fc80878db80 1 -- 172.21.15.12:0/2213025884 wait complete. 2023-12-11T20:33:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.601+0000 7fc80878db80 20 client.29971 trim_cache size 0 max 16384 2023-12-11T20:33:45.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.629+0000 7fc80878db80 1 Processor -- start 2023-12-11T20:33:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.630+0000 7fc80878db80 1 -- start start 2023-12-11T20:33:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.630+0000 7fc80878db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.630+0000 7fc80878db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2ea5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.630+0000 7fc80878db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2e98130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.630+0000 7fc80878db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2e93f70 con 0x562eb2e943d0 2023-12-11T20:33:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.630+0000 7fc80878db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2ea6920 con 0x562eb2e94d30 2023-12-11T20:33:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.630+0000 7fc80878db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2e9dde0 con 0x562eb2e95c20 2023-12-11T20:33:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.633+0000 7fc7ee59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.633+0000 7fc7edd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2ea5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.633+0000 7fc7edd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2ea5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50694/0 (socket says 172.21.15.12:50694) 2023-12-11T20:33:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.633+0000 7fc7edd9b700 1 -- 172.21.15.12:0/3167042726 learned_addr learned my addr 172.21.15.12:0/3167042726 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.634+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2e98130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.634+0000 7fc7eed9d700 1 -- 172.21.15.12:0/3167042726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 msgr2=0x562eb2ea5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.634+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2ea5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.634+0000 7fc7eed9d700 1 -- 172.21.15.12:0/3167042726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 msgr2=0x562eb2e9ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.634+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.634+0000 7fc7eed9d700 1 -- 172.21.15.12:0/3167042726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eb2c11de0 con 0x562eb2e95c20 2023-12-11T20:33:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.634+0000 7fc7ee59c700 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.634+0000 7fc7edd9b700 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2ea5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.635+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2e98130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009ec0 tx=0x7fc7e8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56dc2860444e6d17 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.635+0000 7fc7e57fa700 1 -- 172.21.15.12:0/3167042726 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800e040 con 0x562eb2e95c20 2023-12-11T20:33:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.635+0000 7fc7e57fa700 1 -- 172.21.15.12:0/3167042726 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7e8017730 con 0x562eb2e95c20 2023-12-11T20:33:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.635+0000 7fc7e57fa700 1 -- 172.21.15.12:0/3167042726 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8036d10 con 0x562eb2e95c20 2023-12-11T20:33:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.637+0000 7fc80878db80 1 -- 172.21.15.12:0/3167042726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 msgr2=0x562eb2e98130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.637+0000 7fc80878db80 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2e98130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009ec0 tx=0x7fc7e8017000 comp rx=0 tx=0).stop 2023-12-11T20:33:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.637+0000 7fc80878db80 1 -- 172.21.15.12:0/3167042726 shutdown_connections 2023-12-11T20:33:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.637+0000 7fc80878db80 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2e98130 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.637+0000 7fc80878db80 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e943d0 0x562eb2e9ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.637+0000 7fc80878db80 1 --2- 172.21.15.12:0/3167042726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e94d30 0x562eb2ea5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.638+0000 7fc80878db80 1 -- 172.21.15.12:0/3167042726 >> 172.21.15.12:0/3167042726 conn(0x562eb2dc37e0 msgr2=0x562eb2e9c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.638+0000 7fc80878db80 1 -- 172.21.15.12:0/3167042726 shutdown_connections 2023-12-11T20:33:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.638+0000 7fc80878db80 1 -- 172.21.15.12:0/3167042726 wait complete. 2023-12-11T20:33:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.638+0000 7fc80878db80 1 -- start start 2023-12-11T20:33:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.639+0000 7fc80878db80 1 Processor -- start 2023-12-11T20:33:45.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.640+0000 7fc80878db80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e943d0 0x562eb2ea18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.640+0000 7fc80878db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2ea3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc80878db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc80878db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2ea4b80 con 0x562eb2e94d30 2023-12-11T20:33:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc80878db80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2ea4cf0 con 0x562eb2e943d0 2023-12-11T20:33:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc80878db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eb2ea4eb0 con 0x562eb2e95c20 2023-12-11T20:33:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc7eed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc7eed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55070/0 (socket says 172.21.15.12:55070) 2023-12-11T20:33:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc7eed9d700 1 -- 172.21.15.12:0/4125155715 learned_addr learned my addr 172.21.15.12:0/4125155715 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc80878db80 10 client.0 _ll_register_callbacks cb 0x562eb2ccda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc7edd9b700 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2ea3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.641+0000 7fc7ee59c700 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e943d0 0x562eb2ea18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.642+0000 7fc7eed9d700 1 -- 172.21.15.12:0/4125155715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e943d0 msgr2=0x562eb2ea18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.642+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e943d0 0x562eb2ea18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.642+0000 7fc7eed9d700 1 -- 172.21.15.12:0/4125155715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 msgr2=0x562eb2ea3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.642+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2ea3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.642+0000 7fc7eed9d700 1 -- 172.21.15.12:0/4125155715 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e0009b70 con 0x562eb2e95c20 2023-12-11T20:33:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.643+0000 7fc7eed9d700 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea4420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80369a0 tx=0x7fc7e8016600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61b73d8f0379a4d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.643+0000 7fc7d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.643+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/4125155715 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800e040 con 0x562eb2e95c20 2023-12-11T20:33:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.643+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/4125155715 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc7e8007620 con 0x562eb2e95c20 2023-12-11T20:33:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.644+0000 7fc80878db80 1 -- 172.21.15.12:0/4125155715 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7e800f040 con 0x562eb2e95c20 2023-12-11T20:33:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.644+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/4125155715 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7e80077e0 con 0x562eb2e95c20 2023-12-11T20:33:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.644+0000 7fc80878db80 10 client.29977 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.644+0000 7fc80878db80 1 -- 172.21.15.12:0/4125155715 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7fc7f01ae230 con 0x562eb2e95c20 2023-12-11T20:33:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.645+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/4125155715 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7e805a080 con 0x562eb2e95c20 2023-12-11T20:33:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.646+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/4125155715 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc7e8049a20 con 0x562eb2e95c20 2023-12-11T20:33:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.646+0000 7fc80878db80 10 client.29977 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.646+0000 7fc80878db80 10 client.29977 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:33:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.646+0000 7fc80878db80 20 client.29977 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.646+0000 7fc80878db80 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x562eb2f11c90 0x562eb2f140b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.646+0000 7fc80878db80 4 client.29977 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:33:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.646+0000 7fc80878db80 1 -- 172.21.15.12:0/4125155715 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562eb2daefd0 con 0x562eb2f11c90 2023-12-11T20:33:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.646+0000 7fc7ee59c700 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x562eb2f11c90 0x562eb2f140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.648+0000 7fc7d5ffb700 10 client.29977 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:33:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.648+0000 7fc7ee59c700 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x562eb2f11c90 0x562eb2f140b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e994a253140b26b9 server_cookie=dcd2f6ce494a7631 in_seq=0 out_seq=0 2023-12-11T20:33:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.650+0000 7fc7d5ffb700 1 -- 172.21.15.12:0/4125155715 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562eb2daefd0 con 0x562eb2f11c90 2023-12-11T20:33:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.650+0000 7fc7d5ffb700 10 client.29977 handle_command_reply: tid=0 2023-12-11T20:33:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.650+0000 7fc80878db80 1 client.29977 shutdown 2023-12-11T20:33:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.651+0000 7fc80878db80 1 -- 172.21.15.12:0/4125155715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 msgr2=0x562eb2ea4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.651+0000 7fc80878db80 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea4420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80369a0 tx=0x7fc7e8016600 comp rx=0 tx=0).stop 2023-12-11T20:33:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.652+0000 7fc80878db80 1 -- 172.21.15.12:0/4125155715 shutdown_connections 2023-12-11T20:33:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.652+0000 7fc80878db80 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x562eb2f11c90 0x562eb2f140b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.652+0000 7fc80878db80 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562eb2e943d0 0x562eb2ea18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.652+0000 7fc7d5ffb700 0 client.29977 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:33:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.652+0000 7fc80878db80 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562eb2e95c20 0x562eb2ea4420 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.652+0000 7fc80878db80 1 --2- 172.21.15.12:0/4125155715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562eb2e94d30 0x562eb2ea3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.652+0000 7fc80878db80 1 -- 172.21.15.12:0/4125155715 >> 172.21.15.12:0/4125155715 conn(0x562eb2dc37e0 msgr2=0x562eb2e9e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.654+0000 7fc80878db80 1 -- 172.21.15.12:0/4125155715 shutdown_connections 2023-12-11T20:33:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.654+0000 7fc80878db80 1 -- 172.21.15.12:0/4125155715 wait complete. 2023-12-11T20:33:45.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.656+0000 7fc80878db80 20 client.29977 trim_cache size 0 max 16384 2023-12-11T20:33:45.656 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:33:45.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.657+0000 7fc7f4dff700 1 -- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7dc0a15d0 msgr2=0x7fc7dc0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.657+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7dc0a15d0 0x7fc7dc0a3a90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8020000 tx=0x7fc7e8016a00 comp rx=0 tx=0).stop 2023-12-11T20:33:45.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.657+0000 7fc7f4dff700 1 -- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 msgr2=0x7fc7f0104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:45.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.657+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 0x7fc7f0104c70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8006010 tx=0x7fc7d8005280 comp rx=0 tx=0).stop 2023-12-11T20:33:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.658+0000 7fc7f4dff700 1 -- 172.21.15.12:0/2456046379 shutdown_connections 2023-12-11T20:33:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.658+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fc7dc0a15d0 0x7fc7dc0a3a90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.658+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f01010e0 0x7fc7f010bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.658+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7f00ffdc0 0x7fc7f0104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.658+0000 7fc7f4dff700 1 --2- 172.21.15.12:0/2456046379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f0100720 0x7fc7f0104c70 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.658+0000 7fc7f4dff700 1 -- 172.21.15.12:0/2456046379 >> 172.21.15.12:0/2456046379 conn(0x7fc7f00fb960 msgr2=0x7fc7f00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:45.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.659+0000 7fc7f4dff700 1 -- 172.21.15.12:0/2456046379 shutdown_connections 2023-12-11T20:33:45.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:45.659+0000 7fc7f4dff700 1 -- 172.21.15.12:0/2456046379 wait complete. 2023-12-11T20:33:45.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:33:46.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:45 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/204468495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:33:46.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:45 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/204468495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.112+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/776004801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f70099b70 msgr2=0x7f5f700a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.112+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/776004801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f70099b70 0x7f5f700a0420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5f780673c0 tx=0x7f5f780503b0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.112+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/776004801 shutdown_connections 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.112+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/776004801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f70099b70 0x7f5f700a0420 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.112+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/776004801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70097fe0 0x7f5f70098400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.112+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/776004801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f700991d0 0x7f5f70099630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.112+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/776004801 >> 172.21.15.12:0/776004801 conn(0x7f5f70093590 msgr2=0x7f5f700959b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.113+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/776004801 shutdown_connections 2023-12-11T20:33:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.113+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/776004801 wait complete. 2023-12-11T20:33:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.114+0000 7f5f7cd9d700 1 Processor -- start 2023-12-11T20:33:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.117+0000 7f5f7cd9d700 1 -- start start 2023-12-11T20:33:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.119+0000 7f5f7cd9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f70097fe0 0x7f5f701322b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.119+0000 7f5f7cd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f700991d0 0x7f5f701327f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.119+0000 7f5f7cd9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f70099b70 0x7f5f701397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.119+0000 7f5f7cd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f70139d90 con 0x7f5f700991d0 2023-12-11T20:33:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f7cd9d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7014aee0 con 0x7f5f70097fe0 2023-12-11T20:33:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f7cd9d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7014b070 con 0x7f5f70099b70 2023-12-11T20:33:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f700991d0 0x7f5f701327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f700991d0 0x7f5f701327f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39538/0 (socket says 172.21.15.12:39538) 2023-12-11T20:33:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f76ffd700 1 -- 172.21.15.12:0/542121503 learned_addr learned my addr 172.21.15.12:0/542121503 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f77fff700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f70099b70 0x7f5f701397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f77fff700 1 -- 172.21.15.12:0/542121503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f70097fe0 msgr2=0x7f5f701322b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f77fff700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f70097fe0 0x7f5f701322b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f77fff700 1 -- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f700991d0 msgr2=0x7f5f701327f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f77fff700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f700991d0 0x7f5f701327f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f77fff700 1 -- 172.21.15.12:0/542121503 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7804fae0 con 0x7f5f70099b70 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.120+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f700991d0 0x7f5f701327f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.121+0000 7f5f77fff700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f70099b70 0x7f5f701397c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5f78000eb0 tx=0x7f5f780765f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.121+0000 7f5f74ff9700 1 -- 172.21.15.12:0/542121503 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7807b040 con 0x7f5f70099b70 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.121+0000 7f5f74ff9700 1 -- 172.21.15.12:0/542121503 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f78076810 con 0x7f5f70099b70 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.121+0000 7f5f74ff9700 1 -- 172.21.15.12:0/542121503 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78071700 con 0x7f5f70099b70 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.121+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/542121503 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7014b2f0 con 0x7f5f70099b70 2023-12-11T20:33:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.122+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/542121503 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7014b6c0 con 0x7f5f70099b70 2023-12-11T20:33:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.126+0000 7f5f74ff9700 1 -- 172.21.15.12:0/542121503 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5f78071860 con 0x7f5f70099b70 2023-12-11T20:33:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.132+0000 7f5f74ff9700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5f680a1480 0x7f5f680a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.132+0000 7f5f74ff9700 1 -- 172.21.15.12:0/542121503 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5f7812ff00 con 0x7f5f70099b70 2023-12-11T20:33:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.133+0000 7f5f777fe700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5f680a1480 0x7f5f680a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.134+0000 7f5f918a1b80 1 Processor -- start 2023-12-11T20:33:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.134+0000 7f5f918a1b80 1 -- start start 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.135+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4983e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.135+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49848a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.135+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4985240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.135+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f48deb50 con 0x5647f4984de0 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.135+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f48dc470 con 0x5647f49843c0 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.135+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f48d7d60 con 0x5647f4983a60 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.135+0000 7f5f777fe700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5f680a1480 0x7f5f680a3940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5f70099030 tx=0x7f5f6c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.136+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4983e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.136+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4985240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.136+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4985240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39546/0 (socket says 172.21.15.12:39546) 2023-12-11T20:33:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.136+0000 7f5f77fff700 1 -- 172.21.15.12:0/979136909 learned_addr learned my addr 172.21.15.12:0/979136909 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.136+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4983e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55102/0 (socket says 172.21.15.12:55102) 2023-12-11T20:33:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.136+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49848a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.137+0000 7f5f777fe700 1 -- 172.21.15.12:0/979136909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 msgr2=0x5647f49848a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.137+0000 7f5f777fe700 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49848a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.137+0000 7f5f777fe700 1 -- 172.21.15.12:0/979136909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 msgr2=0x5647f4985240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.137+0000 7f5f777fe700 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4985240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.137+0000 7f5f777fe700 1 -- 172.21.15.12:0/979136909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f4754630 con 0x5647f4983a60 2023-12-11T20:33:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.137+0000 7f5f77fff700 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4985240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.137+0000 7f5f777fe700 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4983e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00eae0 tx=0x7f5f6c011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97e716eba989cb94 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.138+0000 7f5f61ffb700 1 -- 172.21.15.12:0/979136909 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c010840 con 0x5647f4983a60 2023-12-11T20:33:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.138+0000 7f5f61ffb700 1 -- 172.21.15.12:0/979136909 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f6c010e30 con 0x5647f4983a60 2023-12-11T20:33:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.138+0000 7f5f61ffb700 1 -- 172.21.15.12:0/979136909 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c01c420 con 0x5647f4983a60 2023-12-11T20:33:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.139+0000 7f5f918a1b80 1 -- 172.21.15.12:0/979136909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 msgr2=0x5647f4983e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.139+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4983e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00eae0 tx=0x7f5f6c011000 comp rx=0 tx=0).stop 2023-12-11T20:33:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.139+0000 7f5f918a1b80 1 -- 172.21.15.12:0/979136909 shutdown_connections 2023-12-11T20:33:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.139+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4985240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.139+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4983e80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.139+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/979136909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49848a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.139+0000 7f5f918a1b80 1 -- 172.21.15.12:0/979136909 >> 172.21.15.12:0/979136909 conn(0x5647f48b27e0 msgr2=0x5647f497e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.140+0000 7f5f918a1b80 1 -- 172.21.15.12:0/979136909 shutdown_connections 2023-12-11T20:33:46.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.140+0000 7f5f918a1b80 1 -- 172.21.15.12:0/979136909 wait complete. 2023-12-11T20:33:46.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.141+0000 7f5f918a1b80 1 -- start start 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.142+0000 7f5f918a1b80 1 Processor -- start 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f498d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f49843c0 0x5647f498d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4984de0 0x5647f49949d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f4891560 con 0x5647f49843c0 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f4891200 con 0x5647f4984de0 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f4756920 con 0x5647f4983a60 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f918a1b80 10 client.0 _ll_register_callbacks cb 0x5647f47bca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f49843c0 0x5647f498d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.143+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f49843c0 0x5647f498d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39548/0 (socket says 172.21.15.12:39548) 2023-12-11T20:33:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.144+0000 7f5f76ffd700 1 -- 172.21.15.12:0/2810533570 learned_addr learned my addr 172.21.15.12:0/2810533570 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.144+0000 7f5f77fff700 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4984de0 0x5647f49949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.144+0000 7f5f777fe700 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f498d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.144+0000 7f5f76ffd700 1 -- 172.21.15.12:0/2810533570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 msgr2=0x5647f498d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.144+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f498d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.144+0000 7f5f76ffd700 1 -- 172.21.15.12:0/2810533570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4984de0 msgr2=0x5647f49949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.144+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4984de0 0x5647f49949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.144+0000 7f5f76ffd700 1 -- 172.21.15.12:0/2810533570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7014b6c0 con 0x5647f49843c0 2023-12-11T20:33:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.146+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f49843c0 0x5647f498d9e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f5f64012d20 tx=0x7f5f6400f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2af83e3f758841 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.146+0000 7f5f56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.147+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2810533570 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64017070 con 0x5647f49843c0 2023-12-11T20:33:46.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.147+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2810533570 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5f6400fc30 con 0x5647f49843c0 2023-12-11T20:33:46.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.147+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2810533570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647f49769e0 con 0x5647f49843c0 2023-12-11T20:33:46.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.147+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2810533570 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f640122e0 con 0x5647f49843c0 2023-12-11T20:33:46.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.147+0000 7f5f918a1b80 10 client.20442 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:46.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.148+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2810533570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7f5f6c00e7c0 con 0x5647f49843c0 2023-12-11T20:33:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.149+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2810533570 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f640122e0 con 0x5647f49843c0 2023-12-11T20:33:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.149+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2810533570 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5f64010430 con 0x5647f49843c0 2023-12-11T20:33:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.150+0000 7f5f918a1b80 10 client.20442 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.150+0000 7f5f918a1b80 10 client.20442 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:33:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.150+0000 7f5f918a1b80 20 client.20442 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.150+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5647f4999360 0x5647f499b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.150+0000 7f5f918a1b80 4 client.20442 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.150+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2810533570 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647f4952f40 con 0x5647f4999360 2023-12-11T20:33:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.150+0000 7f5f777fe700 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5647f4999360 0x5647f499b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.151+0000 7f5f777fe700 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5647f4999360 0x5647f499b780 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e4725b748df86e8 server_cookie=6326617a4cfb4936 in_seq=0 out_seq=0 2023-12-11T20:33:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.151+0000 7f5f56ffd700 10 client.20442 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:33:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.152+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2810533570 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5647f4952f40 con 0x5647f4999360 2023-12-11T20:33:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.152+0000 7f5f56ffd700 10 client.20442 handle_command_reply: tid=0 2023-12-11T20:33:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.152+0000 7f5f918a1b80 1 client.20442 shutdown 2023-12-11T20:33:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2810533570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f49843c0 msgr2=0x5647f498d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f49843c0 0x5647f498d9e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f5f64012d20 tx=0x7f5f6400f6a0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2810533570 shutdown_connections 2023-12-11T20:33:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5647f4999360 0x5647f499b780 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4984de0 0x5647f49949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f498d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2810533570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f49843c0 0x5647f498d9e0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2810533570 >> 172.21.15.12:0/2810533570 conn(0x5647f48b27e0 msgr2=0x5647f4982820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.153+0000 7f5f56ffd700 0 client.20442 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:33:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.154+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2810533570 shutdown_connections 2023-12-11T20:33:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.154+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2810533570 wait complete. 2023-12-11T20:33:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.154+0000 7f5f918a1b80 20 client.20442 trim_cache size 0 max 16384 2023-12-11T20:33:46.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.190+0000 7f5f918a1b80 1 Processor -- start 2023-12-11T20:33:46.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.190+0000 7f5f918a1b80 1 -- start start 2023-12-11T20:33:46.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.191+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4995080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.191+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49948f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.191+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f49a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f4996720 con 0x5647f4984de0 2023-12-11T20:33:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f4994e60 con 0x5647f49843c0 2023-12-11T20:33:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f497abb0 con 0x5647f4983a60 2023-12-11T20:33:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49948f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50734/0 (socket says 172.21.15.12:50734) 2023-12-11T20:33:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f76ffd700 1 -- 172.21.15.12:0/785393053 learned_addr learned my addr 172.21.15.12:0/785393053 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4995080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f76ffd700 1 -- 172.21.15.12:0/785393053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 msgr2=0x5647f4995080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/785393053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4995080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f76ffd700 1 -- 172.21.15.12:0/785393053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 msgr2=0x5647f49a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/785393053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f49a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.192+0000 7f5f76ffd700 1 -- 172.21.15.12:0/785393053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f4700de0 con 0x5647f49843c0 2023-12-11T20:33:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.193+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/785393053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49948f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5f64000c00 tx=0x7f5f64001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a578272250e1256 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.194+0000 7f5f627fc700 1 -- 172.21.15.12:0/785393053 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64017040 con 0x5647f49843c0 2023-12-11T20:33:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.194+0000 7f5f627fc700 1 -- 172.21.15.12:0/785393053 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5647f49769e0 con 0x5647f49843c0 2023-12-11T20:33:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.194+0000 7f5f627fc700 1 -- 172.21.15.12:0/785393053 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640109b0 con 0x5647f49843c0 2023-12-11T20:33:46.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.195+0000 7f5f918a1b80 1 -- 172.21.15.12:0/785393053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 msgr2=0x5647f49948f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.195+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/785393053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49948f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5f64000c00 tx=0x7f5f64001e70 comp rx=0 tx=0).stop 2023-12-11T20:33:46.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.195+0000 7f5f918a1b80 1 -- 172.21.15.12:0/785393053 shutdown_connections 2023-12-11T20:33:46.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.195+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/785393053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f49a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.195+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/785393053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f4983a60 0x5647f4995080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.195+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/785393053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f49843c0 0x5647f49948f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.195+0000 7f5f918a1b80 1 -- 172.21.15.12:0/785393053 >> 172.21.15.12:0/785393053 conn(0x5647f48b27e0 msgr2=0x5647f498b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.195+0000 7f5f918a1b80 1 -- 172.21.15.12:0/785393053 shutdown_connections 2023-12-11T20:33:46.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.196+0000 7f5f918a1b80 1 -- 172.21.15.12:0/785393053 wait complete. 2023-12-11T20:33:46.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.196+0000 7f5f918a1b80 1 -- start start 2023-12-11T20:33:46.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.196+0000 7f5f918a1b80 1 Processor -- start 2023-12-11T20:33:46.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.197+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4983a60 0x5647f49940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.197+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f49843c0 0x5647f49945f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.197+0000 7f5f918a1b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4992bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.197+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f4993130 con 0x5647f4984de0 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.197+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f49932a0 con 0x5647f4983a60 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.197+0000 7f5f918a1b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f4993460 con 0x5647f49843c0 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.198+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f49843c0 0x5647f49945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.198+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f49843c0 0x5647f49945f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55140/0 (socket says 172.21.15.12:55140) 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.198+0000 7f5f76ffd700 1 -- 172.21.15.12:0/2900381043 learned_addr learned my addr 172.21.15.12:0/2900381043 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.198+0000 7f5f77fff700 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4992bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.198+0000 7f5f76ffd700 1 -- 172.21.15.12:0/2900381043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4983a60 msgr2=0x5647f49940b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.199+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4983a60 0x5647f49940b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.199+0000 7f5f918a1b80 10 client.0 _ll_register_callbacks cb 0x5647f47bca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.199+0000 7f5f76ffd700 1 -- 172.21.15.12:0/2900381043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 msgr2=0x5647f4992bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.199+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4992bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.199+0000 7f5f76ffd700 1 -- 172.21.15.12:0/2900381043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c00e7c0 con 0x5647f49843c0 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.199+0000 7f5f77fff700 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4992bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.199+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2900381043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f6c010e30 con 0x5647f49843c0 2023-12-11T20:33:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.200+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f49843c0 0x5647f49945f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f64005e90 tx=0x7f5f64009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2042d6ef88a9c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.200+0000 7f5f56ffd700 10 client.29992 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.201+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2900381043 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64017070 con 0x5647f49843c0 2023-12-11T20:33:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.201+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2900381043 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5f6400fc30 con 0x5647f49843c0 2023-12-11T20:33:46.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.201+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2900381043 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f6400fe70 con 0x5647f49843c0 2023-12-11T20:33:46.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.201+0000 7f5f918a1b80 10 client.29992 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:46.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.201+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2900381043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=38}) v3 -- 0x5647f46e9c60 con 0x5647f49843c0 2023-12-11T20:33:46.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.203+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2900381043 <== mon.1 v2:172.21.15.39:3300/0 4 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5f640050b0 con 0x5647f49843c0 2023-12-11T20:33:46.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.204+0000 7f5f918a1b80 10 client.29992 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:46.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.204+0000 7f5f918a1b80 10 client.29992 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:33:46.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.204+0000 7f5f918a1b80 20 client.29992 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:46.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.204+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5647f49f03c0 0x5647f49f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.204+0000 7f5f918a1b80 4 client.29992 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:33:46.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.204+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2900381043 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5647f489dfd0 con 0x5647f49f03c0 2023-12-11T20:33:46.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.204+0000 7f5f777fe700 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5647f49f03c0 0x5647f49f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.205+0000 7f5f56ffd700 10 client.29992 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:33:46.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.205+0000 7f5f777fe700 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5647f49f03c0 0x5647f49f27e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b12a19c5415e4682 server_cookie=bff2d863c0f08afd in_seq=0 out_seq=0 2023-12-11T20:33:46.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f56ffd700 1 -- 172.21.15.12:0/2900381043 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5647f489dfd0 con 0x5647f49f03c0 2023-12-11T20:33:46.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f56ffd700 10 client.29992 handle_command_reply: tid=0 2023-12-11T20:33:46.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 client.29992 shutdown 2023-12-11T20:33:46.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2900381043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f49843c0 msgr2=0x5647f49945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f49843c0 0x5647f49945f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f64005e90 tx=0x7f5f64009440 comp rx=0 tx=0).stop 2023-12-11T20:33:46.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2900381043 shutdown_connections 2023-12-11T20:33:46.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5647f49f03c0 0x5647f49f27e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5647f4983a60 0x5647f49940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647f4984de0 0x5647f4992bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 --2- 172.21.15.12:0/2900381043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5647f49843c0 0x5647f49945f0 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f64005e90 tx=0x7f5f64009440 comp rx=0 tx=0).stop 2023-12-11T20:33:46.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f56ffd700 0 client.29992 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:33:46.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.206+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2900381043 >> 172.21.15.12:0/2900381043 conn(0x5647f48b27e0 msgr2=0x5647f49a00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.208+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2900381043 shutdown_connections 2023-12-11T20:33:46.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.208+0000 7f5f918a1b80 1 -- 172.21.15.12:0/2900381043 wait complete. 2023-12-11T20:33:46.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.209+0000 7f5f918a1b80 20 client.29992 trim_cache size 0 max 16384 2023-12-11T20:33:46.208 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:33:46.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5f680a1480 msgr2=0x7f5f680a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5f680a1480 0x7f5f680a3940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5f70099030 tx=0x7f5f6c009260 comp rx=0 tx=0).stop 2023-12-11T20:33:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/542121503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f70099b70 msgr2=0x7f5f701397c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f70099b70 0x7f5f701397c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5f78000eb0 tx=0x7f5f780765f0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/542121503 shutdown_connections 2023-12-11T20:33:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5f680a1480 0x7f5f680a3940 secure :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5f70099030 tx=0x7f5f6c009260 comp rx=0 tx=0).stop 2023-12-11T20:33:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5f70097fe0 0x7f5f701322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f70099b70 0x7f5f701397c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/542121503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f700991d0 0x7f5f701327f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.210+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/542121503 >> 172.21.15.12:0/542121503 conn(0x7f5f70093590 msgr2=0x7f5f7000bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.212+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/542121503 shutdown_connections 2023-12-11T20:33:46.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.212+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/542121503 wait complete. 2023-12-11T20:33:46.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:45 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/204468495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:33:46.248 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:33:46.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.636+0000 7f7271bff700 1 -- 172.21.15.12:0/3538814655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1026e0 msgr2=0x7f726c104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.636+0000 7f7271bff700 1 --2- 172.21.15.12:0/3538814655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1026e0 0x7f726c104b70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7254009990 tx=0x7f7254009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.636+0000 7f7271bff700 1 -- 172.21.15.12:0/3538814655 shutdown_connections 2023-12-11T20:33:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.636+0000 7f7271bff700 1 --2- 172.21.15.12:0/3538814655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f726c1050b0 0x7f726c105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.636+0000 7f7271bff700 1 --2- 172.21.15.12:0/3538814655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f726c0ffd70 0x7f726c1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.636+0000 7f7271bff700 1 --2- 172.21.15.12:0/3538814655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1026e0 0x7f726c104b70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.636+0000 7f7271bff700 1 -- 172.21.15.12:0/3538814655 >> 172.21.15.12:0/3538814655 conn(0x7f726c0fb930 msgr2=0x7f726c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.637+0000 7f7271bff700 1 -- 172.21.15.12:0/3538814655 shutdown_connections 2023-12-11T20:33:46.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.637+0000 7f7271bff700 1 -- 172.21.15.12:0/3538814655 wait complete. 2023-12-11T20:33:46.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.638+0000 7f7271bff700 1 Processor -- start 2023-12-11T20:33:46.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.639+0000 7f7271bff700 1 -- start start 2023-12-11T20:33:46.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7271bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f726c0ffd70 0x7f726c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7271bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f726c1026e0 0x7f726c070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7271bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1050b0 0x7f726c1ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7271bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c073480 con 0x7f726c0ffd70 2023-12-11T20:33:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7262ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f726c1026e0 0x7f726c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7271bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0735f0 con 0x7f726c1050b0 2023-12-11T20:33:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7262ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f726c1026e0 0x7f726c070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55170/0 (socket says 172.21.15.12:55170) 2023-12-11T20:33:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7262ffd700 1 -- 172.21.15.12:0/527637853 learned_addr learned my addr 172.21.15.12:0/527637853 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.640+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c1adfa0 con 0x7f726c1026e0 2023-12-11T20:33:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.641+0000 7f726b7fe700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f726c0ffd70 0x7f726c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.641+0000 7f726bfff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1050b0 0x7f726c1ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.641+0000 7f726bfff700 1 -- 172.21.15.12:0/527637853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f726c1026e0 msgr2=0x7f726c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.641+0000 7f726bfff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f726c1026e0 0x7f726c070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.641+0000 7f726bfff700 1 -- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f726c0ffd70 msgr2=0x7f726c06ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.642+0000 7f726bfff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f726c0ffd70 0x7f726c06ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.642+0000 7f726bfff700 1 -- 172.21.15.12:0/527637853 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540095f0 con 0x7f726c1050b0 2023-12-11T20:33:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.642+0000 7f7262ffd700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f726c1026e0 0x7f726c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:46.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.642+0000 7f726b7fe700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f726c0ffd70 0x7f726c06ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.643+0000 7f726bfff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1050b0 0x7f726c1ada60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f726400c7a0 tx=0x7f726400cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.643+0000 7f72697fa700 1 -- 172.21.15.12:0/527637853 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264004a30 con 0x7f726c1050b0 2023-12-11T20:33:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.643+0000 7f72697fa700 1 -- 172.21.15.12:0/527637853 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72640054b0 con 0x7f726c1050b0 2023-12-11T20:33:46.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.643+0000 7f72697fa700 1 -- 172.21.15.12:0/527637853 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400ea90 con 0x7f726c1050b0 2023-12-11T20:33:46.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.643+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c1ae200 con 0x7f726c1050b0 2023-12-11T20:33:46.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.643+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c1ae690 con 0x7f726c1050b0 2023-12-11T20:33:46.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.649+0000 7f72697fa700 1 -- 172.21.15.12:0/527637853 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f726400ec70 con 0x7f726c1050b0 2023-12-11T20:33:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.650+0000 7f72697fa700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f72580a1550 0x7f72580a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.650+0000 7f72697fa700 1 -- 172.21.15.12:0/527637853 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f72640cc880 con 0x7f726c1050b0 2023-12-11T20:33:46.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.651+0000 7f726b7fe700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f72580a1550 0x7f72580a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.652+0000 7f726b7fe700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f72580a1550 0x7f72580a3a10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f725c00e300 tx=0x7f725c009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.655+0000 7f72855bfb80 1 Processor -- start 2023-12-11T20:33:46.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.655+0000 7f72855bfb80 1 -- start start 2023-12-11T20:33:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 0x55bacec677f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec67d30 0x55bacec68640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec68c20 0x55bacec690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f72855bfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacebc2b50 con 0x55bacec673d0 2023-12-11T20:33:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f72855bfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacebc0470 con 0x55bacec68c20 2023-12-11T20:33:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f72855bfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacebbbd60 con 0x55bacec67d30 2023-12-11T20:33:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f7262ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec67d30 0x55bacec68640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f7262ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec67d30 0x55bacec68640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55186/0 (socket says 172.21.15.12:55186) 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.656+0000 7f7262ffd700 1 -- 172.21.15.12:0/3172715742 learned_addr learned my addr 172.21.15.12:0/3172715742 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.657+0000 7f726bfff700 1 --2- 172.21.15.12:0/3172715742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec68c20 0x55bacec690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.657+0000 7f726bfff700 1 -- 172.21.15.12:0/3172715742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec67d30 msgr2=0x55bacec68640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.657+0000 7f726bfff700 1 --2- 172.21.15.12:0/3172715742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec67d30 0x55bacec68640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.657+0000 7f726bfff700 1 -- 172.21.15.12:0/3172715742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 msgr2=0x55bacec677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.657+0000 7f726bfff700 1 --2- 172.21.15.12:0/3172715742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 0x55bacec677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.657+0000 7f726bfff700 1 -- 172.21.15.12:0/3172715742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bacea38630 con 0x55bacec68c20 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.657+0000 7f726bfff700 1 --2- 172.21.15.12:0/3172715742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec68c20 0x55bacec690a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7264099a80 tx=0x7f72640996b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c8255e66fa22706 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.658+0000 7f7261ffb700 1 -- 172.21.15.12:0/3172715742 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726409a1f0 con 0x55bacec68c20 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.658+0000 7f7261ffb700 1 -- 172.21.15.12:0/3172715742 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7264099af0 con 0x55bacec68c20 2023-12-11T20:33:46.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.659+0000 7f7261ffb700 1 -- 172.21.15.12:0/3172715742 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264099d50 con 0x55bacec68c20 2023-12-11T20:33:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.660+0000 7f72855bfb80 1 -- 172.21.15.12:0/3172715742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec68c20 msgr2=0x55bacec690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.660+0000 7f72855bfb80 1 --2- 172.21.15.12:0/3172715742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec68c20 0x55bacec690a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7264099a80 tx=0x7f72640996b0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.660+0000 7f72855bfb80 1 -- 172.21.15.12:0/3172715742 shutdown_connections 2023-12-11T20:33:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.660+0000 7f72855bfb80 1 --2- 172.21.15.12:0/3172715742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec68c20 0x55bacec690a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.660+0000 7f72855bfb80 1 --2- 172.21.15.12:0/3172715742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 0x55bacec677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.660+0000 7f72855bfb80 1 --2- 172.21.15.12:0/3172715742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec67d30 0x55bacec68640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.660+0000 7f72855bfb80 1 -- 172.21.15.12:0/3172715742 >> 172.21.15.12:0/3172715742 conn(0x55baceb967e0 msgr2=0x55bacec63d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.661+0000 7f72855bfb80 1 -- 172.21.15.12:0/3172715742 shutdown_connections 2023-12-11T20:33:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.661+0000 7f72855bfb80 1 -- 172.21.15.12:0/3172715742 wait complete. 2023-12-11T20:33:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.661+0000 7f72855bfb80 1 -- start start 2023-12-11T20:33:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.662+0000 7f72855bfb80 1 Processor -- start 2023-12-11T20:33:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.662+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec71240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.663+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec71780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.663+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec787c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.663+0000 7f72855bfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baceb75560 con 0x55bacec67d30 2023-12-11T20:33:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.663+0000 7f72855bfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baceb75200 con 0x55bacec673d0 2023-12-11T20:33:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.663+0000 7f72855bfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacea3a920 con 0x55bacec68c20 2023-12-11T20:33:46.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.663+0000 7f72855bfb80 10 client.0 _ll_register_callbacks cb 0x55baceaa0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec71240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec71240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50782/0 (socket says 172.21.15.12:50782) 2023-12-11T20:33:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726b7fe700 1 -- 172.21.15.12:0/2433279537 learned_addr learned my addr 172.21.15.12:0/2433279537 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726bfff700 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f7262ffd700 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec71780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726bfff700 1 -- 172.21.15.12:0/2433279537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 msgr2=0x55bacec71240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726bfff700 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec71240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726bfff700 1 -- 172.21.15.12:0/2433279537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 msgr2=0x55bacec71780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726bfff700 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec71780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.664+0000 7f726bfff700 1 -- 172.21.15.12:0/2433279537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c1ae690 con 0x55bacec68c20 2023-12-11T20:33:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.665+0000 7f726bfff700 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec787c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f726409de00 tx=0x7f7264004d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10a1dc18a26a7b4b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.665+0000 7f724affd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.667+0000 7f724affd700 1 -- 172.21.15.12:0/2433279537 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640b23b0 con 0x55bacec68c20 2023-12-11T20:33:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.667+0000 7f724affd700 1 -- 172.21.15.12:0/2433279537 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f72640a1e80 con 0x55bacec68c20 2023-12-11T20:33:46.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.668+0000 7f72855bfb80 1 -- 172.21.15.12:0/2433279537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bacec5ab40 con 0x55bacec68c20 2023-12-11T20:33:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.668+0000 7f724affd700 1 -- 172.21.15.12:0/2433279537 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72640652c0 con 0x55bacec68c20 2023-12-11T20:33:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.668+0000 7f72855bfb80 10 client.30001 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:46.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.668+0000 7f72855bfb80 1 -- 172.21.15.12:0/2433279537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55bace9e4de0 con 0x55bacec68c20 2023-12-11T20:33:46.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.670+0000 7f724affd700 1 -- 172.21.15.12:0/2433279537 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bacec5ab40 con 0x55bacec68c20 2023-12-11T20:33:46.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.670+0000 7f724affd700 1 -- 172.21.15.12:0/2433279537 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f72640a1af0 con 0x55bacec68c20 2023-12-11T20:33:46.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.670+0000 7f72855bfb80 10 client.30001 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:46.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.670+0000 7f72855bfb80 10 client.30001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:46.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.670+0000 7f72855bfb80 20 client.30001 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:46.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.670+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bacec7cb10 0x55bacec7ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.670+0000 7f72855bfb80 4 client.30001 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:46.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.670+0000 7f72855bfb80 1 -- 172.21.15.12:0/2433279537 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bacec36f40 con 0x55bacec7cb10 2023-12-11T20:33:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.671+0000 7f726b7fe700 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bacec7cb10 0x55bacec7ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.673+0000 7f726b7fe700 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bacec7cb10 0x55bacec7ef00 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b85a073b5da0be server_cookie=9b960f214320ef52 in_seq=0 out_seq=0 2023-12-11T20:33:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.673+0000 7f724affd700 10 client.30001 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:46.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.673+0000 7f724affd700 1 -- 172.21.15.12:0/2433279537 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bacec36f40 con 0x55bacec7cb10 2023-12-11T20:33:46.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.673+0000 7f724affd700 10 client.30001 handle_command_reply: tid=0 2023-12-11T20:33:46.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.673+0000 7f72855bfb80 1 client.30001 shutdown 2023-12-11T20:33:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 -- 172.21.15.12:0/2433279537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 msgr2=0x55bacec787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec787c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f726409de00 tx=0x7f7264004d80 comp rx=0 tx=0).stop 2023-12-11T20:33:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 -- 172.21.15.12:0/2433279537 shutdown_connections 2023-12-11T20:33:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bacec7cb10 0x55bacec7ef00 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f724affd700 0 client.30001 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec71240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec787c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2433279537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec71780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 -- 172.21.15.12:0/2433279537 >> 172.21.15.12:0/2433279537 conn(0x55baceb967e0 msgr2=0x55bacec62a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 -- 172.21.15.12:0/2433279537 shutdown_connections 2023-12-11T20:33:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.674+0000 7f72855bfb80 1 -- 172.21.15.12:0/2433279537 wait complete. 2023-12-11T20:33:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.675+0000 7f72855bfb80 20 client.30001 trim_cache size 0 max 16384 2023-12-11T20:33:46.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.704+0000 7f72855bfb80 1 Processor -- start 2023-12-11T20:33:46.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.704+0000 7f72855bfb80 1 -- start start 2023-12-11T20:33:46.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.705+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 0x55bacec78e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.705+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec67d30 0x55bacec78780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.705+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec69000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.705+0000 7f72855bfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacec79990 con 0x55bacec673d0 2023-12-11T20:33:46.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.705+0000 7f72855bfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacec70db0 con 0x55bacec67d30 2023-12-11T20:33:46.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.705+0000 7f72855bfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacec7c940 con 0x55bacec68c20 2023-12-11T20:33:46.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f726bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec69000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f726bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec69000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55202/0 (socket says 172.21.15.12:55202) 2023-12-11T20:33:46.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f726bfff700 1 -- 172.21.15.12:0/2221047067 learned_addr learned my addr 172.21.15.12:0/2221047067 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f726b7fe700 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 0x55bacec78e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f7262ffd700 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec67d30 0x55bacec78780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f726bfff700 1 -- 172.21.15.12:0/2221047067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec67d30 msgr2=0x55bacec78780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f726bfff700 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec67d30 0x55bacec78780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f726bfff700 1 -- 172.21.15.12:0/2221047067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 msgr2=0x55bacec78e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.706+0000 7f726bfff700 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 0x55bacec78e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.707+0000 7f726bfff700 1 -- 172.21.15.12:0/2221047067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bace9cdc60 con 0x55bacec68c20 2023-12-11T20:33:46.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.707+0000 7f726b7fe700 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 0x55bacec78e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:46.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.707+0000 7f726bfff700 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec69000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7264096560 tx=0x7f7264004df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6af620e0de35138 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.708+0000 7f72627fc700 1 -- 172.21.15.12:0/2221047067 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640b23b0 con 0x55bacec68c20 2023-12-11T20:33:46.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.708+0000 7f72627fc700 1 -- 172.21.15.12:0/2221047067 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72640a1e80 con 0x55bacec68c20 2023-12-11T20:33:46.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.708+0000 7f72627fc700 1 -- 172.21.15.12:0/2221047067 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640a1c50 con 0x55bacec68c20 2023-12-11T20:33:46.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.709+0000 7f72855bfb80 1 -- 172.21.15.12:0/2221047067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 msgr2=0x55bacec69000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.709+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec69000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7264096560 tx=0x7f7264004df0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.712+0000 7f72855bfb80 1 -- 172.21.15.12:0/2221047067 shutdown_connections 2023-12-11T20:33:46.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.712+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec69000 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.712+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec673d0 0x55bacec78e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.712+0000 7f72855bfb80 1 --2- 172.21.15.12:0/2221047067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec67d30 0x55bacec78780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.712+0000 7f72855bfb80 1 -- 172.21.15.12:0/2221047067 >> 172.21.15.12:0/2221047067 conn(0x55baceb967e0 msgr2=0x55bacec6f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.714+0000 7f72855bfb80 1 -- 172.21.15.12:0/2221047067 shutdown_connections 2023-12-11T20:33:46.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.714+0000 7f72855bfb80 1 -- 172.21.15.12:0/2221047067 wait complete. 2023-12-11T20:33:46.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.715+0000 7f72855bfb80 1 -- start start 2023-12-11T20:33:46.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.715+0000 7f72855bfb80 1 Processor -- start 2023-12-11T20:33:46.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.721+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec75f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.721+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec76450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.721+0000 7f72855bfb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec77460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.722+0000 7f72855bfb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacec779a0 con 0x55bacec67d30 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.722+0000 7f72855bfb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacec77b10 con 0x55bacec673d0 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.722+0000 7f72855bfb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacec77cd0 con 0x55bacec68c20 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.722+0000 7f726bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec77460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.722+0000 7f726bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec77460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55208/0 (socket says 172.21.15.12:55208) 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.722+0000 7f726bfff700 1 -- 172.21.15.12:0/198414697 learned_addr learned my addr 172.21.15.12:0/198414697 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.722+0000 7f726b7fe700 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec75f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.722+0000 7f72855bfb80 10 client.0 _ll_register_callbacks cb 0x55baceaa0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.723+0000 7f726bfff700 1 -- 172.21.15.12:0/198414697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 msgr2=0x55bacec75f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.723+0000 7f726bfff700 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec75f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.723+0000 7f726bfff700 1 -- 172.21.15.12:0/198414697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 msgr2=0x55bacec76450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.723+0000 7f7262ffd700 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec76450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.723+0000 7f726bfff700 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec76450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.723+0000 7f726bfff700 1 -- 172.21.15.12:0/198414697 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bace9e4de0 con 0x55bacec68c20 2023-12-11T20:33:46.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.723+0000 7f7262ffd700 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec76450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:46.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.724+0000 7f726bfff700 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec77460 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f72640997f0 tx=0x7f726409a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b701cd87d2b4ca39 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:46.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.724+0000 7f724affd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:46.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.724+0000 7f724affd700 1 -- 172.21.15.12:0/198414697 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726409a1f0 con 0x55bacec68c20 2023-12-11T20:33:46.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.725+0000 7f724affd700 1 -- 172.21.15.12:0/198414697 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f726409dc40 con 0x55bacec68c20 2023-12-11T20:33:46.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.725+0000 7f72855bfb80 1 -- 172.21.15.12:0/198414697 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7264099af0 con 0x55bacec68c20 2023-12-11T20:33:46.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.726+0000 7f724affd700 1 -- 172.21.15.12:0/198414697 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72640b23b0 con 0x55bacec68c20 2023-12-11T20:33:46.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.727+0000 7f72855bfb80 10 client.30007 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:46.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.727+0000 7f72855bfb80 1 -- 172.21.15.12:0/198414697 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55bacea0b250 con 0x55bacec68c20 2023-12-11T20:33:46.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.727+0000 7f724affd700 1 -- 172.21.15.12:0/198414697 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7264099af0 con 0x55bacec68c20 2023-12-11T20:33:46.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.727+0000 7f724affd700 1 -- 172.21.15.12:0/198414697 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7264098ae0 con 0x55bacec68c20 2023-12-11T20:33:46.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.727+0000 7f72855bfb80 10 client.30007 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:46.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.727+0000 7f72855bfb80 10 client.30007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:46.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.727+0000 7f72855bfb80 20 client.30007 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:46.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.727+0000 7f72855bfb80 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bacecd3430 0x55bacecd5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:46.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.728+0000 7f72855bfb80 4 client.30007 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:33:46.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.728+0000 7f72855bfb80 1 -- 172.21.15.12:0/198414697 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55baceb81fd0 con 0x55bacecd3430 2023-12-11T20:33:46.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.730+0000 7f726b7fe700 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bacecd3430 0x55bacecd5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:46.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.731+0000 7f726b7fe700 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bacecd3430 0x55bacecd5820 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9208892094ceae0 server_cookie=1d62805be6288e63 in_seq=0 out_seq=0 2023-12-11T20:33:46.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.731+0000 7f724affd700 10 client.30007 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:46.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.732+0000 7f724affd700 1 -- 172.21.15.12:0/198414697 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55baceb81fd0 con 0x55bacecd3430 2023-12-11T20:33:46.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.732+0000 7f724affd700 10 client.30007 handle_command_reply: tid=0 2023-12-11T20:33:46.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.732+0000 7f72855bfb80 1 client.30007 shutdown 2023-12-11T20:33:46.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.733+0000 7f72855bfb80 1 -- 172.21.15.12:0/198414697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 msgr2=0x55bacec77460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.733+0000 7f72855bfb80 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec77460 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f72640997f0 tx=0x7f726409a030 comp rx=0 tx=0).stop 2023-12-11T20:33:46.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.733+0000 7f72855bfb80 1 -- 172.21.15.12:0/198414697 shutdown_connections 2023-12-11T20:33:46.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.734+0000 7f72855bfb80 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55bacecd3430 0x55bacecd5820 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.734+0000 7f72855bfb80 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55bacec673d0 0x55bacec75f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.734+0000 7f72855bfb80 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bacec68c20 0x55bacec77460 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.734+0000 7f72855bfb80 1 --2- 172.21.15.12:0/198414697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bacec67d30 0x55bacec76450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.734+0000 7f72855bfb80 1 -- 172.21.15.12:0/198414697 >> 172.21.15.12:0/198414697 conn(0x55baceb967e0 msgr2=0x55bacec6ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.734+0000 7f724affd700 0 client.30007 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:46.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.735+0000 7f72855bfb80 1 -- 172.21.15.12:0/198414697 shutdown_connections 2023-12-11T20:33:46.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.735+0000 7f72855bfb80 1 -- 172.21.15.12:0/198414697 wait complete. 2023-12-11T20:33:46.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.735+0000 7f72855bfb80 20 client.30007 trim_cache size 0 max 16384 2023-12-11T20:33:46.735 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:33:46.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.736+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f72580a1550 msgr2=0x7f72580a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.736+0000 7f7271bff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f72580a1550 0x7f72580a3a10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f725c00e300 tx=0x7f725c009040 comp rx=0 tx=0).stop 2023-12-11T20:33:46.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.736+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1050b0 msgr2=0x7f726c1ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:46.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.736+0000 7f7271bff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1050b0 0x7f726c1ada60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f726400c7a0 tx=0x7f726400cab0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.737+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 shutdown_connections 2023-12-11T20:33:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.737+0000 7f7271bff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f72580a1550 0x7f72580a3a10 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.737+0000 7f7271bff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f726c1050b0 0x7f726c1ada60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.737+0000 7f7271bff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f726c0ffd70 0x7f726c06ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.737+0000 7f7271bff700 1 --2- 172.21.15.12:0/527637853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f726c1026e0 0x7f726c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.737+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 >> 172.21.15.12:0/527637853 conn(0x7f726c0fb930 msgr2=0x7f726c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:46.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.737+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 shutdown_connections 2023-12-11T20:33:46.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:46.738+0000 7f7271bff700 1 -- 172.21.15.12:0/527637853 wait complete. 2023-12-11T20:33:47.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:46 smithi012 ceph-mon[128787]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2023-12-11T20:33:47.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:46 smithi032 ceph-mon[132488]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2023-12-11T20:33:47.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:46 smithi039 ceph-mon[102205]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2023-12-11T20:33:47.773 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-11T20:33:47.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-11T20:33:47.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 -- 172.21.15.12:0/583677307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe01014b0 msgr2=0x7fcfe01018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:47.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/583677307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe01014b0 0x7fcfe01018d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00099c0 tx=0x7fcfd0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:33:47.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 -- 172.21.15.12:0/583677307 shutdown_connections 2023-12-11T20:33:47.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/583677307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe01014b0 0x7fcfe01018d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:47.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/583677307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe0103040 0x7fcfe01098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:47.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/583677307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfe01026a0 0x7fcfe0102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:47.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 -- 172.21.15.12:0/583677307 >> 172.21.15.12:0/583677307 conn(0x7fcfe00fca00 msgr2=0x7fcfe00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:47.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 -- 172.21.15.12:0/583677307 shutdown_connections 2023-12-11T20:33:47.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.986+0000 7fcfe5dff700 1 -- 172.21.15.12:0/583677307 wait complete. 2023-12-11T20:33:47.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.987+0000 7fcfe5dff700 1 Processor -- start 2023-12-11T20:33:47.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.987+0000 7fcfe5dff700 1 -- start start 2023-12-11T20:33:47.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfe5dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe01014b0 0x7fcfe0197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:47.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfe5dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfe01026a0 0x7fcfe01978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:47.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfe5dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe0103040 0x7fcfe019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:47.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfe5dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe019ee90 con 0x7fcfe01014b0 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfe5dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe019efd0 con 0x7fcfe0103040 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfe5dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe019f160 con 0x7fcfe01026a0 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe01014b0 0x7fcfe0197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfe01026a0 0x7fcfe01978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe01014b0 0x7fcfe0197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39658/0 (socket says 172.21.15.12:39658) 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdf7fe700 1 -- 172.21.15.12:0/3893852621 learned_addr learned my addr 172.21.15.12:0/3893852621 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdf7fe700 1 -- 172.21.15.12:0/3893852621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfe01026a0 msgr2=0x7fcfe01978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfe01026a0 0x7fcfe01978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdffff700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe0103040 0x7fcfe019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdf7fe700 1 -- 172.21.15.12:0/3893852621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe0103040 msgr2=0x7fcfe019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe0103040 0x7fcfe019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdf7fe700 1 -- 172.21.15.12:0/3893852621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00095f0 con 0x7fcfe01014b0 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.988+0000 7fcfdffff700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe0103040 0x7fcfe019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:47.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.989+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe01014b0 0x7fcfe0197360 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0000c00 tx=0x7fcfd000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:47.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.989+0000 7fcfdcff9700 1 -- 172.21.15.12:0/3893852621 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd001d070 con 0x7fcfe01014b0 2023-12-11T20:33:47.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.989+0000 7fcfdcff9700 1 -- 172.21.15.12:0/3893852621 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfd00054c0 con 0x7fcfe01014b0 2023-12-11T20:33:47.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.989+0000 7fcfe5dff700 1 -- 172.21.15.12:0/3893852621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe019f3e0 con 0x7fcfe01014b0 2023-12-11T20:33:47.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.989+0000 7fcfdcff9700 1 -- 172.21.15.12:0/3893852621 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0004ba0 con 0x7fcfe01014b0 2023-12-11T20:33:47.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.989+0000 7fcfe5dff700 1 -- 172.21.15.12:0/3893852621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe019f800 con 0x7fcfe01014b0 2023-12-11T20:33:47.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.992+0000 7fcfdcff9700 1 -- 172.21.15.12:0/3893852621 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcfd0004d00 con 0x7fcfe01014b0 2023-12-11T20:33:47.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcff96ebb80 1 Processor -- start 2023-12-11T20:33:47.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcfdcff9700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcfc80a1480 0x7fcfc80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:47.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcfdcff9700 1 -- 172.21.15.12:0/3893852621 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcfd00cda50 con 0x7fcfe01014b0 2023-12-11T20:33:47.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcff96ebb80 1 -- start start 2023-12-11T20:33:47.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcfc80a1480 0x7fcfc80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d29c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d2aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d2b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736c80bd0 con 0x555736d2b0b0 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736c7e4f0 con 0x555736d2a1c0 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.994+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736c79de0 con 0x555736d29860 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d2b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d2aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d2b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39674/0 (socket says 172.21.15.12:39674) 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d2aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50832/0 (socket says 172.21.15.12:50832) 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdffff700 1 -- 172.21.15.12:0/3297380658 learned_addr learned my addr 172.21.15.12:0/3297380658 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d29c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:47.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcfc80a1480 0x7fcfc80a3940 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009cb0 tx=0x7fcfd4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 -- 172.21.15.12:0/3297380658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 msgr2=0x555736d29c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d29c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 -- 172.21.15.12:0/3297380658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 msgr2=0x555736d2b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d2b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 -- 172.21.15.12:0/3297380658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555736af66b0 con 0x555736d2a1c0 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d29c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.995+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d2aad0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4012cd0 tx=0x7fcfd4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93ac2d8dcb173811 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.996+0000 7fcfc5ffb700 1 -- 172.21.15.12:0/3297380658 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd401cb60 con 0x555736d2a1c0 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.996+0000 7fcfc5ffb700 1 -- 172.21.15.12:0/3297380658 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfd401ccc0 con 0x555736d2a1c0 2023-12-11T20:33:47.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.996+0000 7fcfc5ffb700 1 -- 172.21.15.12:0/3297380658 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40054c0 con 0x555736d2a1c0 2023-12-11T20:33:47.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.996+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3297380658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 msgr2=0x555736d2aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.996+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d2aad0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4012cd0 tx=0x7fcfd4014000 comp rx=0 tx=0).stop 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.997+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3297380658 shutdown_connections 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.997+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d2b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.997+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d29c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.997+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/3297380658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d2aad0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.997+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3297380658 >> 172.21.15.12:0/3297380658 conn(0x555736c54860 msgr2=0x555736d21e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.997+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3297380658 shutdown_connections 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.997+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3297380658 wait complete. 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.997+0000 7fcff96ebb80 1 -- start start 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcff96ebb80 1 Processor -- start 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d33640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2a1c0 0x555736d33b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2b0b0 0x555736d3abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736c335e0 con 0x555736d2a1c0 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736c33280 con 0x555736d29860 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736af89a0 con 0x555736d2b0b0 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcff96ebb80 10 client.0 _ll_register_callbacks cb 0x555736b5eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2a1c0 0x555736d33b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2a1c0 0x555736d33b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39688/0 (socket says 172.21.15.12:39688) 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.998+0000 7fcfdeffd700 1 -- 172.21.15.12:0/2048975856 learned_addr learned my addr 172.21.15.12:0/2048975856 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdffff700 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2b0b0 0x555736d3abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d33640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdeffd700 1 -- 172.21.15.12:0/2048975856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2b0b0 msgr2=0x555736d3abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2b0b0 0x555736d3abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdeffd700 1 -- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 msgr2=0x555736d33640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d33640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdeffd700 1 -- 172.21.15.12:0/2048975856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe019f800 con 0x555736d2a1c0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d33640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2a1c0 0x555736d33b80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4026040 tx=0x7fcfd4005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad6c0052659c30e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfbeffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2048975856 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4004710 con 0x555736d2a1c0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2048975856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555736d18bc0 con 0x555736d2a1c0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:47.999+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2048975856 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcfd4004870 con 0x555736d2a1c0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2048975856 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfd4004a30 con 0x555736d2a1c0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcff96ebb80 10 client.20463 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2048975856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7fcfd4017050 con 0x555736d2a1c0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2048975856 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555736d18bc0 con 0x555736d2a1c0 2023-12-11T20:33:48.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2048975856 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fcfd402d410 con 0x555736d2a1c0 2023-12-11T20:33:48.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcff96ebb80 10 client.20463 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:48.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcff96ebb80 10 client.20463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:48.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcff96ebb80 20 client.20463 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:48.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555736d3f410 0x555736d41830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcff96ebb80 4 client.20463 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:48.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.000+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2048975856 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555736cf4fc0 con 0x555736d3f410 2023-12-11T20:33:48.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.001+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555736d3f410 0x555736d41830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.001+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555736d3f410 0x555736d41830 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a49e16837b3a828f server_cookie=5f107f2cebda321e in_seq=0 out_seq=0 2023-12-11T20:33:48.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.001+0000 7fcfbeffd700 10 client.20463 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2048975856 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555736cf4fc0 con 0x555736d3f410 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcfbeffd700 10 client.20463 handle_command_reply: tid=0 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 client.20463 shutdown 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2048975856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2a1c0 msgr2=0x555736d33b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2a1c0 0x555736d33b80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4026040 tx=0x7fcfd4005da0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2048975856 shutdown_connections 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555736d3f410 0x555736d41830 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d33640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2b0b0 0x555736d3abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcfbeffd700 0 client.20463 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2048975856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2a1c0 0x555736d33b80 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2048975856 >> 172.21.15.12:0/2048975856 conn(0x555736c54860 msgr2=0x555736d20ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2048975856 shutdown_connections 2023-12-11T20:33:48.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.002+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2048975856 wait complete. 2023-12-11T20:33:48.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.003+0000 7fcff96ebb80 20 client.20463 trim_cache size 0 max 16384 2023-12-11T20:33:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcff96ebb80 1 Processor -- start 2023-12-11T20:33:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcff96ebb80 1 -- start start 2023-12-11T20:33:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d22100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2a1c0 0x555736d3ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d201e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736d3c8d0 con 0x555736d2b0b0 2023-12-11T20:33:48.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736d46a40 con 0x555736d29860 2023-12-11T20:33:48.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736d1cbd0 con 0x555736d2a1c0 2023-12-11T20:33:48.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcfdffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2a1c0 0x555736d3ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcfdffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d201e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39692/0 (socket says 172.21.15.12:39692) 2023-12-11T20:33:48.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.022+0000 7fcfdffff700 1 -- 172.21.15.12:0/3708817952 learned_addr learned my addr 172.21.15.12:0/3708817952 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d22100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfdeffd700 1 -- 172.21.15.12:0/3708817952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 msgr2=0x555736d22100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d22100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfdeffd700 1 -- 172.21.15.12:0/3708817952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 msgr2=0x555736d201e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d201e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfdeffd700 1 -- 172.21.15.12:0/3708817952 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555736aa2e60 con 0x555736d2a1c0 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfdffff700 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2a1c0 0x555736d3ab80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcfd402d870 tx=0x7fcfd4009390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52c74739670e5ea1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfc67fc700 1 -- 172.21.15.12:0/3708817952 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd402d9e0 con 0x555736d2a1c0 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfc67fc700 1 -- 172.21.15.12:0/3708817952 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfd402db40 con 0x555736d2a1c0 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.023+0000 7fcfc67fc700 1 -- 172.21.15.12:0/3708817952 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd402f440 con 0x555736d2a1c0 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3708817952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2a1c0 msgr2=0x555736d3ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2a1c0 0x555736d3ab80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcfd402d870 tx=0x7fcfd4009390 comp rx=0 tx=0).stop 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3708817952 shutdown_connections 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d29860 0x555736d22100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d201e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/3708817952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d2a1c0 0x555736d3ab80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3708817952 >> 172.21.15.12:0/3708817952 conn(0x555736c54860 msgr2=0x555736d219f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3708817952 shutdown_connections 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 -- 172.21.15.12:0/3708817952 wait complete. 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.024+0000 7fcff96ebb80 1 -- start start 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcff96ebb80 1 Processor -- start 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d39c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d3a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcff96ebb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d95990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736d95ed0 con 0x555736d2b0b0 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736d96010 con 0x555736d2a1c0 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcff96ebb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555736d961a0 con 0x555736d29860 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcff96ebb80 10 client.0 _ll_register_callbacks cb 0x555736b5eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcfdffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d95990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d3a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcfdffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d95990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39704/0 (socket says 172.21.15.12:39704) 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.025+0000 7fcfdffff700 1 -- 172.21.15.12:0/2827951021 learned_addr learned my addr 172.21.15.12:0/2827951021 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d39c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfdffff700 1 -- 172.21.15.12:0/2827951021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 msgr2=0x555736d39c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfdffff700 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d39c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfdffff700 1 -- 172.21.15.12:0/2827951021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 msgr2=0x555736d3a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfdffff700 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d3a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfdffff700 1 -- 172.21.15.12:0/2827951021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd8009360 con 0x555736d2b0b0 2023-12-11T20:33:48.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfdeffd700 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d3a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfdffff700 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d95990 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8017430 tx=0x7fcfd8017460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4858ef106c36b06 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfbeffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2827951021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8017c60 con 0x555736d2b0b0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2827951021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfd401ccc0 con 0x555736d2b0b0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.026+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2827951021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcfd8017dc0 con 0x555736d2b0b0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.027+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2827951021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfd8021470 con 0x555736d2b0b0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.027+0000 7fcff96ebb80 10 client.20469 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.027+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2827951021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7fcfd4017050 con 0x555736d2b0b0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2827951021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfd401ccc0 con 0x555736d2b0b0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2827951021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fcfd8018760 con 0x555736d2b0b0 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcff96ebb80 10 client.20469 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcff96ebb80 10 client.20469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcff96ebb80 20 client.20469 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:48.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555736d97cb0 0x555736d9a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcff96ebb80 4 client.20469 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-11T20:33:48.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2827951021 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555736c40050 con 0x555736d97cb0 2023-12-11T20:33:48.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.028+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555736d97cb0 0x555736d9a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.029+0000 7fcfdf7fe700 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555736d97cb0 0x555736d9a0d0 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37e9629016e6ea46 server_cookie=3cdd2c2e458b52ac in_seq=0 out_seq=0 2023-12-11T20:33:48.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.029+0000 7fcfbeffd700 10 client.20469 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcfbeffd700 1 -- 172.21.15.12:0/2827951021 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555736c40050 con 0x555736d97cb0 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcfbeffd700 10 client.20469 handle_command_reply: tid=0 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 client.20469 shutdown 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2827951021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 msgr2=0x555736d95990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d95990 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8017430 tx=0x7fcfd8017460 comp rx=0 tx=0).stop 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2827951021 shutdown_connections 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x555736d97cb0 0x555736d9a0d0 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555736d2b0b0 0x555736d95990 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555736d29860 0x555736d39c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 --2- 172.21.15.12:0/2827951021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x555736d2a1c0 0x555736d3a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcfbeffd700 0 client.20469 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2827951021 >> 172.21.15.12:0/2827951021 conn(0x555736c54860 msgr2=0x555736d1a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2827951021 shutdown_connections 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 1 -- 172.21.15.12:0/2827951021 wait complete. 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.030+0000 7fcff96ebb80 20 client.20469 trim_cache size 0 max 16384 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "71adec90-f07c-446c-bebd-c4683f6fe2dd", 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2023-12-11T20:33:48.032 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:33:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 -- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcfc80a1480 msgr2=0x7fcfc80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcfc80a1480 0x7fcfc80a3940 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009cb0 tx=0x7fcfd4009260 comp rx=0 tx=0).stop 2023-12-11T20:33:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 -- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe01014b0 msgr2=0x7fcfe0197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe01014b0 0x7fcfe0197360 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0000c00 tx=0x7fcfd000f690 comp rx=0 tx=0).stop 2023-12-11T20:33:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 -- 172.21.15.12:0/3893852621 shutdown_connections 2023-12-11T20:33:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcfc80a1480 0x7fcfc80a3940 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfe0103040 0x7fcfe019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfe01014b0 0x7fcfe0197360 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 --2- 172.21.15.12:0/3893852621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcfe01026a0 0x7fcfe01978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 -- 172.21.15.12:0/3893852621 >> 172.21.15.12:0/3893852621 conn(0x7fcfe00fca00 msgr2=0x7fcfe0105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 -- 172.21.15.12:0/3893852621 shutdown_connections 2023-12-11T20:33:48.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.031+0000 7fcfe5dff700 1 -- 172.21.15.12:0/3893852621 wait complete. 2023-12-11T20:33:48.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:33:48.056 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:33:48.057 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:33:48.057 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:47 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:33:48.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:33:48.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:33:48.083 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:47 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:33:48.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:33:48.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:33:48.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:47 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:33:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.435+0000 7ffb15dff700 1 -- 172.21.15.12:0/842968331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10101fe0 msgr2=0x7ffb101043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.435+0000 7ffb15dff700 1 --2- 172.21.15.12:0/842968331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10101fe0 0x7ffb101043d0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009990 tx=0x7ffb00009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.436+0000 7ffb15dff700 1 -- 172.21.15.12:0/842968331 shutdown_connections 2023-12-11T20:33:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.436+0000 7ffb15dff700 1 --2- 172.21.15.12:0/842968331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb10107240 0x7ffb10109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.436+0000 7ffb15dff700 1 --2- 172.21.15.12:0/842968331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10101fe0 0x7ffb101043d0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.436+0000 7ffb15dff700 1 --2- 172.21.15.12:0/842968331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb10104910 0x7ffb10106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.436+0000 7ffb15dff700 1 -- 172.21.15.12:0/842968331 >> 172.21.15.12:0/842968331 conn(0x7ffb100fb930 msgr2=0x7ffb100fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.436+0000 7ffb15dff700 1 -- 172.21.15.12:0/842968331 shutdown_connections 2023-12-11T20:33:48.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.436+0000 7ffb15dff700 1 -- 172.21.15.12:0/842968331 wait complete. 2023-12-11T20:33:48.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.438+0000 7ffb15dff700 1 Processor -- start 2023-12-11T20:33:48.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.438+0000 7ffb15dff700 1 -- start start 2023-12-11T20:33:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.439+0000 7ffb15dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb10101fe0 0x7ffb100732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.439+0000 7ffb15dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10104910 0x7ffb1006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.440+0000 7ffb15dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb10107240 0x7ffb10070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.440+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb10101fe0 0x7ffb100732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.440+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb10101fe0 0x7ffb100732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55264/0 (socket says 172.21.15.12:55264) 2023-12-11T20:33:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.440+0000 7ffb15dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb101a97e0 con 0x7ffb10104910 2023-12-11T20:33:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.440+0000 7ffb15dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb101a9920 con 0x7ffb10107240 2023-12-11T20:33:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.440+0000 7ffb15dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb101a9ab0 con 0x7ffb10101fe0 2023-12-11T20:33:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.440+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10104910 0x7ffb1006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.441+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/3366047061 learned_addr learned my addr 172.21.15.12:0/3366047061 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.441+0000 7ffb0ffff700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb10107240 0x7ffb10070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.441+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/3366047061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb10107240 msgr2=0x7ffb10070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.441+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb10107240 0x7ffb10070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.442+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10104910 msgr2=0x7ffb1006fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.442+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10104910 0x7ffb1006fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.442+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/3366047061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000095f0 con 0x7ffb10101fe0 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.442+0000 7ffb0ffff700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb10107240 0x7ffb10070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.442+0000 7ffb0effd700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10104910 0x7ffb1006fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.442+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb10101fe0 0x7ffb100732c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b5c0 tx=0x7ffb0000f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.443+0000 7ffb0cff9700 1 -- 172.21.15.12:0/3366047061 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0001d070 con 0x7ffb10101fe0 2023-12-11T20:33:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.443+0000 7ffb0cff9700 1 -- 172.21.15.12:0/3366047061 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb000054c0 con 0x7ffb10101fe0 2023-12-11T20:33:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.443+0000 7ffb0cff9700 1 -- 172.21.15.12:0/3366047061 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00004c70 con 0x7ffb10101fe0 2023-12-11T20:33:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.443+0000 7ffb15dff700 1 -- 172.21.15.12:0/3366047061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb101a9d30 con 0x7ffb10101fe0 2023-12-11T20:33:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.443+0000 7ffb15dff700 1 -- 172.21.15.12:0/3366047061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb101aa0a0 con 0x7ffb10101fe0 2023-12-11T20:33:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.450+0000 7ffb0cff9700 1 -- 172.21.15.12:0/3366047061 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ffb0000fc30 con 0x7ffb10101fe0 2023-12-11T20:33:48.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.452+0000 7ffb0cff9700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffaf80a1600 0x7ffaf80a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.452+0000 7ffb0cff9700 1 -- 172.21.15.12:0/3366047061 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffb000cddd0 con 0x7ffb10101fe0 2023-12-11T20:33:48.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.453+0000 7ffb0effd700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffaf80a1600 0x7ffaf80a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.454+0000 7ffb0effd700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffaf80a1600 0x7ffaf80a3ac0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009de0 tx=0x7ffb04009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.455+0000 7ffb2977eb80 1 Processor -- start 2023-12-11T20:33:48.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.455+0000 7ffb2977eb80 1 -- start start 2023-12-11T20:33:48.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.455+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ec3d0 0x55564d2ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2ed640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2edc20 0x55564d2ee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d247b50 con 0x55564d2ec3d0 2023-12-11T20:33:48.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d245470 con 0x55564d2edc20 2023-12-11T20:33:48.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d240d60 con 0x55564d2ecd30 2023-12-11T20:33:48.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2ed640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55266/0 (socket says 172.21.15.12:55266) 2023-12-11T20:33:48.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb0effd700 1 -- 172.21.15.12:0/1713531855 learned_addr learned my addr 172.21.15.12:0/1713531855 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:48.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ec3d0 0x55564d2ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.456+0000 7ffb0ffff700 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2edc20 0x55564d2ee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffb0effd700 1 -- 172.21.15.12:0/1713531855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2edc20 msgr2=0x55564d2ee0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffb0effd700 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2edc20 0x55564d2ee0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffb0effd700 1 -- 172.21.15.12:0/1713531855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ec3d0 msgr2=0x55564d2ec7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffb0effd700 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ec3d0 0x55564d2ec7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffb0effd700 1 -- 172.21.15.12:0/1713531855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55564d0bd630 con 0x55564d2ecd30 2023-12-11T20:33:48.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffb0effd700 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2ed640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400ee60 tx=0x7ffb04011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40ca8b865ff32fca server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffaf5ffb700 1 -- 172.21.15.12:0/1713531855 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400ee90 con 0x55564d2ecd30 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffaf5ffb700 1 -- 172.21.15.12:0/1713531855 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb04015da0 con 0x55564d2ecd30 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.457+0000 7ffaf5ffb700 1 -- 172.21.15.12:0/1713531855 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04013da0 con 0x55564d2ecd30 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.458+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1713531855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 msgr2=0x55564d2ed640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.458+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2ed640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400ee60 tx=0x7ffb04011000 comp rx=0 tx=0).stop 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.459+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1713531855 shutdown_connections 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.459+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2edc20 0x55564d2ee0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.459+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ec3d0 0x55564d2ec7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.459+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/1713531855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2ed640 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.459+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1713531855 >> 172.21.15.12:0/1713531855 conn(0x55564d21b7e0 msgr2=0x55564d2e8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.459+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1713531855 shutdown_connections 2023-12-11T20:33:48.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.459+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1713531855 wait complete. 2023-12-11T20:33:48.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.460+0000 7ffb2977eb80 1 -- start start 2023-12-11T20:33:48.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.460+0000 7ffb2977eb80 1 Processor -- start 2023-12-11T20:33:48.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.461+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.462+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.462+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d2fd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.462+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d1fa560 con 0x55564d2edc20 2023-12-11T20:33:48.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.462+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d1fa200 con 0x55564d2ec3d0 2023-12-11T20:33:48.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.462+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d0bf920 con 0x55564d2ecd30 2023-12-11T20:33:48.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.462+0000 7ffb2977eb80 10 client.0 _ll_register_callbacks cb 0x55564d125a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:48.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.464+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.464+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55270/0 (socket says 172.21.15.12:55270) 2023-12-11T20:33:48.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.464+0000 7ffb0effd700 1 -- 172.21.15.12:0/261804017 learned_addr learned my addr 172.21.15.12:0/261804017 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:48.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.464+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.464+0000 7ffb0ffff700 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d2fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.465+0000 7ffb0effd700 1 -- 172.21.15.12:0/261804017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 msgr2=0x55564d2f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.465+0000 7ffb0effd700 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.465+0000 7ffb0effd700 1 -- 172.21.15.12:0/261804017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 msgr2=0x55564d2fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.465+0000 7ffb0effd700 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d2fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.465+0000 7ffb0effd700 1 -- 172.21.15.12:0/261804017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0400eb10 con 0x55564d2ecd30 2023-12-11T20:33:48.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.465+0000 7ffb0effd700 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2f66e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ffb04017010 tx=0x7ffb04013680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc6e98fc30448f07 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.465+0000 7ffaeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:33:48.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.466+0000 7ffaeeffd700 1 -- 172.21.15.12:0/261804017 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04032410 con 0x55564d2ecd30 2023-12-11T20:33:48.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.466+0000 7ffaeeffd700 1 -- 172.21.15.12:0/261804017 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffb04032570 con 0x55564d2ecd30 2023-12-11T20:33:48.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.466+0000 7ffb2977eb80 1 -- 172.21.15.12:0/261804017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55564d2dfb40 con 0x55564d2ecd30 2023-12-11T20:33:48.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.466+0000 7ffaeeffd700 1 -- 172.21.15.12:0/261804017 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb04032730 con 0x55564d2ecd30 2023-12-11T20:33:48.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.466+0000 7ffb2977eb80 10 client.30034 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:48.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.466+0000 7ffb2977eb80 1 -- 172.21.15.12:0/261804017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55564d069de0 con 0x55564d2ecd30 2023-12-11T20:33:48.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.467+0000 7ffaeeffd700 1 -- 172.21.15.12:0/261804017 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55564d2dfb40 con 0x55564d2ecd30 2023-12-11T20:33:48.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.467+0000 7ffaeeffd700 1 -- 172.21.15.12:0/261804017 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ffb0403c780 con 0x55564d2ecd30 2023-12-11T20:33:48.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.467+0000 7ffb2977eb80 10 client.30034 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:48.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.467+0000 7ffb2977eb80 10 client.30034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:48.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.468+0000 7ffb2977eb80 20 client.30034 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:48.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.468+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55564d301f20 0x55564d304340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.468+0000 7ffb2977eb80 4 client.30034 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:48.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.468+0000 7ffb2977eb80 1 -- 172.21.15.12:0/261804017 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55564d2bbf40 con 0x55564d301f20 2023-12-11T20:33:48.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.468+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55564d301f20 0x55564d304340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.469+0000 7ffaeeffd700 10 client.30034 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:48.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.469+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55564d301f20 0x55564d304340 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d620f1c74142664d server_cookie=451c15cad9463985 in_seq=0 out_seq=0 2023-12-11T20:33:48.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.469+0000 7ffaeeffd700 1 -- 172.21.15.12:0/261804017 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55564d2bbf40 con 0x55564d301f20 2023-12-11T20:33:48.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.469+0000 7ffaeeffd700 10 client.30034 handle_command_reply: tid=0 2023-12-11T20:33:48.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.469+0000 7ffb2977eb80 1 client.30034 shutdown 2023-12-11T20:33:48.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 -- 172.21.15.12:0/261804017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 msgr2=0x55564d2f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2f66e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ffb04017010 tx=0x7ffb04013680 comp rx=0 tx=0).stop 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 -- 172.21.15.12:0/261804017 shutdown_connections 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55564d301f20 0x55564d304340 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d2fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/261804017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ecd30 0x55564d2f66e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 -- 172.21.15.12:0/261804017 >> 172.21.15.12:0/261804017 conn(0x55564d21b7e0 msgr2=0x55564d2e7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffaeeffd700 0 client.30034 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 -- 172.21.15.12:0/261804017 shutdown_connections 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.470+0000 7ffb2977eb80 1 -- 172.21.15.12:0/261804017 wait complete. 2023-12-11T20:33:48.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.471+0000 7ffb2977eb80 20 client.30034 trim_cache size 0 max 16384 2023-12-11T20:33:48.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.507+0000 7ffb2977eb80 1 Processor -- start 2023-12-11T20:33:48.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.508+0000 7ffb2977eb80 1 -- start start 2023-12-11T20:33:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2ee000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ecd30 0x55564d2fd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2edc20 0x55564d308c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d2fe8a0 con 0x55564d2ecd30 2023-12-11T20:33:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d2f5d10 con 0x55564d2ec3d0 2023-12-11T20:33:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb2977eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d2e9370 con 0x55564d2edc20 2023-12-11T20:33:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2ee000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50912/0 (socket says 172.21.15.12:50912) 2023-12-11T20:33:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.509+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/1187185266 learned_addr learned my addr 172.21.15.12:0/1187185266 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.510+0000 7ffb0ffff700 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2edc20 0x55564d308c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.510+0000 7ffb0effd700 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ecd30 0x55564d2fd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.510+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/1187185266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2edc20 msgr2=0x55564d308c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.510+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2edc20 0x55564d308c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.510+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/1187185266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ecd30 msgr2=0x55564d2fd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.510+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ecd30 0x55564d2fd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.510+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/1187185266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55564d052c60 con 0x55564d2ec3d0 2023-12-11T20:33:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.510+0000 7ffb0effd700 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ecd30 0x55564d2fd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:48.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.511+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2ee000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffb00097ba0 tx=0x7ffb000a1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f52b930c2aeb17b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.511+0000 7ffaf67fc700 1 -- 172.21.15.12:0/1187185266 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0009f280 con 0x55564d2ec3d0 2023-12-11T20:33:48.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.511+0000 7ffaf67fc700 1 -- 172.21.15.12:0/1187185266 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb000abe90 con 0x55564d2ec3d0 2023-12-11T20:33:48.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.512+0000 7ffaf67fc700 1 -- 172.21.15.12:0/1187185266 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000994d0 con 0x55564d2ec3d0 2023-12-11T20:33:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.512+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1187185266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 msgr2=0x55564d2ee000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.512+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2ee000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffb00097ba0 tx=0x7ffb000a1040 comp rx=0 tx=0).stop 2023-12-11T20:33:48.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.513+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1187185266 shutdown_connections 2023-12-11T20:33:48.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.513+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ec3d0 0x55564d2ee000 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.513+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2edc20 0x55564d308c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.513+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/1187185266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2ecd30 0x55564d2fd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.513+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1187185266 >> 172.21.15.12:0/1187185266 conn(0x55564d21b7e0 msgr2=0x55564d2f4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.515+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1187185266 shutdown_connections 2023-12-11T20:33:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.517+0000 7ffb2977eb80 1 -- 172.21.15.12:0/1187185266 wait complete. 2023-12-11T20:33:48.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.518+0000 7ffb2977eb80 1 -- start start 2023-12-11T20:33:48.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.518+0000 7ffb2977eb80 1 Processor -- start 2023-12-11T20:33:48.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.521+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ec3d0 0x55564d2fb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.521+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ecd30 0x55564d3543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.521+0000 7ffb2977eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d356a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.521+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ec3d0 0x55564d2fb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.521+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ec3d0 0x55564d2fb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55296/0 (socket says 172.21.15.12:55296) 2023-12-11T20:33:48.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.521+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ecd30 0x55564d3543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.521+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ecd30 0x55564d3543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:50928/0 (socket says 172.21.15.12:50928) 2023-12-11T20:33:48.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.522+0000 7ffb0ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d356a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.522+0000 7ffb0ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d356a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39760/0 (socket says 172.21.15.12:39760) 2023-12-11T20:33:48.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.522+0000 7ffb0f7fe700 1 -- 172.21.15.12:0/2334414359 learned_addr learned my addr 172.21.15.12:0/2334414359 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:48.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.522+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d357150 con 0x55564d2edc20 2023-12-11T20:33:48.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.523+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d3572c0 con 0x55564d2ecd30 2023-12-11T20:33:48.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.523+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564d357480 con 0x55564d2ec3d0 2023-12-11T20:33:48.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.523+0000 7ffb2977eb80 10 client.0 _ll_register_callbacks cb 0x55564d125a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:48.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.523+0000 7ffb0effd700 1 -- 172.21.15.12:0/2334414359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ec3d0 msgr2=0x55564d2fb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.523+0000 7ffb0effd700 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ec3d0 0x55564d2fb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.523+0000 7ffb0effd700 1 -- 172.21.15.12:0/2334414359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 msgr2=0x55564d356a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:48.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.524+0000 7ffb0effd700 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d356a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.524+0000 7ffb0effd700 1 -- 172.21.15.12:0/2334414359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55564d069de0 con 0x55564d2ecd30 2023-12-11T20:33:48.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.524+0000 7ffb0ffff700 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d356a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:48.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.525+0000 7ffb0effd700 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ecd30 0x55564d3543d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e840 tx=0x7ffb0403cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ffdddbe2817ff6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:48.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.525+0000 7ffaeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:48.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.525+0000 7ffaeeffd700 1 -- 172.21.15.12:0/2334414359 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04042070 con 0x55564d2ecd30 2023-12-11T20:33:48.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.525+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb04015da0 con 0x55564d2ecd30 2023-12-11T20:33:48.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.525+0000 7ffaeeffd700 1 -- 172.21.15.12:0/2334414359 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffb04038030 con 0x55564d2ecd30 2023-12-11T20:33:48.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.525+0000 7ffaeeffd700 1 -- 172.21.15.12:0/2334414359 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb040136f0 con 0x55564d2ecd30 2023-12-11T20:33:48.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffb2977eb80 10 client.30032 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:48.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7ffb101aa0a0 con 0x55564d2ecd30 2023-12-11T20:33:48.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffaeeffd700 1 -- 172.21.15.12:0/2334414359 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb04015da0 con 0x55564d2ecd30 2023-12-11T20:33:48.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffaeeffd700 1 -- 172.21.15.12:0/2334414359 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ffb0403c6f0 con 0x55564d2ecd30 2023-12-11T20:33:48.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffb2977eb80 10 client.30032 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:48.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffb2977eb80 10 client.30032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffb2977eb80 20 client.30032 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55564d358b60 0x55564d35af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffb2977eb80 4 client.30032 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:33:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.526+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55564d206fd0 con 0x55564d358b60 2023-12-11T20:33:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.527+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55564d358b60 0x55564d35af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.527+0000 7ffb0f7fe700 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55564d358b60 0x55564d35af50 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e30865def00e72 server_cookie=ece84c1f5a1f6eb in_seq=0 out_seq=0 2023-12-11T20:33:48.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.527+0000 7ffaeeffd700 10 client.30032 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.528+0000 7ffaeeffd700 1 -- 172.21.15.12:0/2334414359 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55564d206fd0 con 0x55564d358b60 2023-12-11T20:33:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.528+0000 7ffaeeffd700 10 client.30032 handle_command_reply: tid=0 2023-12-11T20:33:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.528+0000 7ffb2977eb80 1 client.30032 shutdown 2023-12-11T20:33:48.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.528+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ecd30 msgr2=0x55564d3543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.528+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ecd30 0x55564d3543d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e840 tx=0x7ffb0403cf30 comp rx=0 tx=0).stop 2023-12-11T20:33:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 shutdown_connections 2023-12-11T20:33:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55564d358b60 0x55564d35af50 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55564d2edc20 0x55564d356a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55564d2ec3d0 0x55564d2fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffb2977eb80 1 --2- 172.21.15.12:0/2334414359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55564d2ecd30 0x55564d3543d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 >> 172.21.15.12:0/2334414359 conn(0x55564d21b7e0 msgr2=0x55564d308c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffaeeffd700 0 client.30032 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:48.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 shutdown_connections 2023-12-11T20:33:48.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.529+0000 7ffb2977eb80 1 -- 172.21.15.12:0/2334414359 wait complete. 2023-12-11T20:33:48.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.530+0000 7ffb2977eb80 20 client.30032 trim_cache size 0 max 16384 2023-12-11T20:33:48.529 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:33:48.529 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-11T20:33:48.529 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2023-12-11T20:33:48.529 INFO:teuthology.orchestra.run.smithi012.stdout: "71adec90-f07c-446c-bebd-c4683f6fe2dd": { 2023-12-11T20:33:48.530 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2023-12-11T20:33:48.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "71adec90-f07c-446c-bebd-c4683f6fe2dd", 2023-12-11T20:33:48.530 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2023-12-11T20:33:48.530 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:33:48.530 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:33:48.530 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:33:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 -- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffaf80a1600 msgr2=0x7ffaf80a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffaf80a1600 0x7ffaf80a3ac0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009de0 tx=0x7ffb04009190 comp rx=0 tx=0).stop 2023-12-11T20:33:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 -- 172.21.15.12:0/3366047061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb10101fe0 msgr2=0x7ffb100732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb10101fe0 0x7ffb100732c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b5c0 tx=0x7ffb0000f7f0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 -- 172.21.15.12:0/3366047061 shutdown_connections 2023-12-11T20:33:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ffaf80a1600 0x7ffaf80a3ac0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb10107240 0x7ffb10070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffb10101fe0 0x7ffb100732c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 --2- 172.21.15.12:0/3366047061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10104910 0x7ffb1006fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.531+0000 7ffb15dff700 1 -- 172.21.15.12:0/3366047061 >> 172.21.15.12:0/3366047061 conn(0x7ffb100fb930 msgr2=0x7ffb101028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.532+0000 7ffb15dff700 1 -- 172.21.15.12:0/3366047061 shutdown_connections 2023-12-11T20:33:48.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:33:48.532+0000 7ffb15dff700 1 -- 172.21.15.12:0/3366047061 wait complete. 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.056+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000271 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile109 auth v2306 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:21.560074+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa560ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000271:[<0x100000004d1/datafile109 v2062>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000271:[<0x100000004d1/datafile109 v2306>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v300>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.056+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000020b [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile6 auth v2333 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:35.559448+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1},l=15345(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa55c4ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000020b:[<0x100000004d1/datafile6 v156>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x2000000020b:[<0x100000004d1/datafile6 v2333>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v300>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.056+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000027a [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile118 auth v2335 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:35.589393+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1},l=15345(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa55db3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000027a:[<0x100000004d1/datafile118 v2152>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x2000000027a:[<0x100000004d1/datafile118 v2335>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v300>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.056+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000215 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile16 auth v2294 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:14.455757+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fa560ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000215:[<0x100000004d1/datafile16 v356>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000215:[<0x100000004d1/datafile16 v2294>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v300>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.056+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000244 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile63 auth v2347 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:41.389039+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@4},l=15345(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa55f2f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000244:[<0x100000004d1/datafile63 v2148>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000244:[<0x100000004d1/datafile63 v2347>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v300>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.057+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000249 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile68 auth v2349 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:41.407253+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1},l=15345(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa55bdf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000249:[<0x100000004d1/datafile68 v1398>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000249:[<0x100000004d1/datafile68 v2349>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v300>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.058+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000282 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile126 auth v2327 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:32.025912+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1},l=15345(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=1 authpin=1 tempexporting=0 scrubqueue=0 0x55fa55fa0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000282:[<0x100000004d1/datafile126 v2157>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000282:[<0x100000004d1/datafile126 v2327>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.058+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000021d [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile24 auth v2337 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:35.831919+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1},l=15345(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa560aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000021d:[<0x100000004d1/datafile24 v2142>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x2000000021d:[<0x100000004d1/datafile24 v2337>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.058+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000250 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile75 auth v2339 ap=1 s=104857600 n(v0 rc2023-12-11T20:32:38.661708+0000 b104857600 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15345=0-213909504@1} caps={15345=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=15345 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa55f3b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000250:[<0x100000004d1/datafile75 v1538>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000250:[<0x100000004d1/datafile75 v2339>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.553 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.059+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000280 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile124 auth v2345 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:07.611226+0000 b104857600 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15345=0-213909504@1} caps={15345=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=15345 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa5617eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000280:[<0x100000004d1/datafile124 v2103>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000280:[<0x100000004d1/datafile124 v2345>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.554 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.059+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000259 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile84 auth v2343 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:42.716207+0000 b104857600 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15345=0-213909504@1} caps={15345=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15345 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa56180680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000259:[<0x100000004d1/datafile84 v2146>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000259:[<0x100000004d1/datafile84 v2343>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.554 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.060+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000269 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile100 auth v2341 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:20.684507+0000 b104857600 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15345=0-213909504@1} caps={15345=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=15345 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa55fa1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000269:[<0x100000004d1/datafile100 v2018>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000269:[<0x100000004d1/datafile100 v2341>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.554 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.060+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000213 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile14 auth v2325 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:07.150139+0000 b104857600 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15345=0-213909504@1} caps={15345=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=15345 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa56079180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000213:[<0x100000004d1/datafile14 v2144>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000213:[<0x100000004d1/datafile14 v2325>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.554 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.060+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000025c [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile87 auth v2276 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:03.258674+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fa55d7f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000025c:[<0x100000004d1/datafile87 v1776>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x2000000025c:[<0x100000004d1/datafile87 v2276>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.554 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.060+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000255 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile80 auth v2297 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:18.081418+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fa56077b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000255:[<0x100000004d1/datafile80 v1638>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000255:[<0x100000004d1/datafile80 v2297>,<0x100000004d0/data v3253>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.554 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.062+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000025a [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile85 auth v2280 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:05.744268+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fa560a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000025a:[<0x100000004d1/datafile85 v1736>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x2000000025a:[<0x100000004d1/datafile85 v2280>,<0x100000004d0/data v3256>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.554 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.062+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000238 [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile51 auth v2261 ap=1 s=104857600 n(v0 rc2023-12-11T20:32:55.838022+0000 b104857600 1=1+0) (iversion lock) caps={15345=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55fa560a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000238:[<0x100000004d1/datafile51 v2150>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x20000000238:[<0x100000004d1/datafile51 v2261>,<0x100000004d0/data v3256>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.554 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:33:48.062+0000 7f8241dd3700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000026e [2,head] /volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile105 auth v2330 ap=1 s=104857600 n(v0 rc2023-12-11T20:33:06.497947+0000 b104857600 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15345=0-213909504@1} caps={15345=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=15345 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55fa55db2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000026e:[<0x100000004d1/datafile105 v2155>,<0x100000004d0/data v2822>,<0x10000000006/tmp v3568>,<0x10000000005/tmp v222>,<0x10000000003/client.0 v280>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v297>,<0x10000000001/sv_0 v321>,<0x10000000000/_nogroup v305>,<0x1/volumes v297>]//[]","memoryvalue":"(3)0x2000000026e:[<0x100000004d1/datafile105 v2330>,<0x100000004d0/data v3256>,<0x10000000006/tmp v3590>,<0x10000000005/tmp v73>,<0x10000000003/client.0 v302>,<0x10000000002/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b v92>,<0x10000000001/sv_0 v122>,<0x10000000000/_nogroup v108>,<0x1/volumes v102>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-11T20:33:48.567 INFO:tasks.cephfs.filesystem:scrub status for tag:71adec90-f07c-446c-bebd-c4683f6fe2dd - {'path': '/', 'tag': '71adec90-f07c-446c-bebd-c4683f6fe2dd', 'options': 'recursive,force'} 2023-12-11T20:33:48.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:48.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: scrub queued for path: / 2023-12-11T20:33:48.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:48.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:33:48.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:33:48.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: scrub summary: active paths [/] 2023-12-11T20:33:48.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000271 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile109) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x2000000020b (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile6) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x2000000027a (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile118) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000215 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile16) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000244 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile63) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000249 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile68) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000282 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile126) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x2000000021d (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile24) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000250 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile75) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000280 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile124) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000259 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile84) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000269 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile100) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000213 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile14) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x2000000025c (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile87) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000255 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile80) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.816 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x2000000025a (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile85) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.816 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x20000000238 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile51) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.816 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: Scrub error on inode 0x2000000026e (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile105) see mds.i log and `damage ls` output for details 2023-12-11T20:33:48.816 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:48.816 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:48 smithi012 ceph-mon[128787]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: scrub queued for path: / 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: scrub summary: active paths [/] 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000271 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile109) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x2000000020b (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile6) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x2000000027a (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile118) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000215 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile16) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000244 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile63) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000249 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile68) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000282 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile126) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x2000000021d (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile24) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000250 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile75) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000280 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile124) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000259 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile84) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000269 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile100) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000213 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile14) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x2000000025c (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile87) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000255 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile80) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x2000000025a (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile85) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.215 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x20000000238 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile51) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.215 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: Scrub error on inode 0x2000000026e (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile105) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.215 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:49.215 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:48 smithi032 ceph-mon[132488]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:49.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 4.77k op/s 2023-12-11T20:33:49.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: scrub queued for path: / 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: scrub summary: active paths [/] 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000271 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile109) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x2000000020b (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile6) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x2000000027a (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile118) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000215 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile16) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000244 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile63) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000249 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile68) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000282 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile126) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x2000000021d (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile24) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.304 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000250 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile75) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000280 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile124) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000259 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile84) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000269 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile100) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000213 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile14) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x2000000025c (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile87) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000255 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile80) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x2000000025a (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile85) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x20000000238 (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile51) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: Scrub error on inode 0x2000000026e (/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile105) see mds.i log and `damage ls` output for details 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:49.305 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:48 smithi039 ceph-mon[102205]: scrub summary: idle+waiting paths [/] 2023-12-11T20:33:51.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:50 smithi012 ceph-mon[128787]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2023-12-11T20:33:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:50 smithi032 ceph-mon[132488]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2023-12-11T20:33:51.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:50 smithi039 ceph-mon[102205]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 4.20k op/s 2023-12-11T20:33:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.342+0000 7fa5db59d700 1 -- 172.21.15.12:0/1302924144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 msgr2=0x7fa5cc099450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.342+0000 7fa5db59d700 1 --2- 172.21.15.12:0/1302924144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 0x7fa5cc099450 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009990 tx=0x7fa5c4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.345+0000 7fa5db59d700 1 -- 172.21.15.12:0/1302924144 shutdown_connections 2023-12-11T20:33:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.345+0000 7fa5db59d700 1 --2- 172.21.15.12:0/1302924144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5cc099990 0x7fa5cc099e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.345+0000 7fa5db59d700 1 --2- 172.21.15.12:0/1302924144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5cc094650 0x7fa5cc096a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.345+0000 7fa5db59d700 1 --2- 172.21.15.12:0/1302924144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 0x7fa5cc099450 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.345+0000 7fa5db59d700 1 -- 172.21.15.12:0/1302924144 >> 172.21.15.12:0/1302924144 conn(0x7fa5cc090230 msgr2=0x7fa5cc092690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.345+0000 7fa5db59d700 1 -- 172.21.15.12:0/1302924144 shutdown_connections 2023-12-11T20:33:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.345+0000 7fa5db59d700 1 -- 172.21.15.12:0/1302924144 wait complete. 2023-12-11T20:33:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.347+0000 7fa5db59d700 1 Processor -- start 2023-12-11T20:33:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.347+0000 7fa5db59d700 1 -- start start 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.348+0000 7fa5db59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5cc094650 0x7fa5cc1322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.348+0000 7fa5db59d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 0x7fa5cc132810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.348+0000 7fa5db59d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5cc099990 0x7fa5cc139830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.348+0000 7fa5db59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc139e00 con 0x7fa5cc094650 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.348+0000 7fa5db59d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc139f40 con 0x7fa5cc099990 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.348+0000 7fa5db59d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc13a0d0 con 0x7fa5cc096fc0 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5d9d9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 0x7fa5cc132810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5d9d9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 0x7fa5cc132810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:58132/0 (socket says 172.21.15.12:58132) 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/191503877 learned_addr learned my addr 172.21.15.12:0/191503877 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5da59b700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5cc094650 0x7fa5cc1322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/191503877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5cc099990 msgr2=0x7fa5cc139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5cc099990 0x7fa5cc139830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5cc094650 msgr2=0x7fa5cc1322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5cc094650 0x7fa5cc1322d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.349+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/191503877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40095f0 con 0x7fa5cc096fc0 2023-12-11T20:33:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.350+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 0x7fa5cc132810 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4000c00 tx=0x7fa5c4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.350+0000 7fa5cb7fe700 1 -- 172.21.15.12:0/191503877 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c401d070 con 0x7fa5cc096fc0 2023-12-11T20:33:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.350+0000 7fa5cb7fe700 1 -- 172.21.15.12:0/191503877 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5c4003f40 con 0x7fa5cc096fc0 2023-12-11T20:33:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.350+0000 7fa5cb7fe700 1 -- 172.21.15.12:0/191503877 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c401d070 con 0x7fa5cc096fc0 2023-12-11T20:33:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.350+0000 7fa5db59d700 1 -- 172.21.15.12:0/191503877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5cc13a350 con 0x7fa5cc096fc0 2023-12-11T20:33:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.351+0000 7fa5db59d700 1 -- 172.21.15.12:0/191503877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc13a720 con 0x7fa5cc096fc0 2023-12-11T20:33:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.355+0000 7fa5cb7fe700 1 -- 172.21.15.12:0/191503877 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa5c4003ab0 con 0x7fa5cc096fc0 2023-12-11T20:33:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.358+0000 7fa5f020fb80 1 Processor -- start 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.359+0000 7fa5f020fb80 1 -- start start 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.359+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7ea770 0x56435d7eab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.359+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7eb0d0 0x56435d7ef640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.359+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d7f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.359+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d745af0 con 0x56435d7efb80 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.359+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d743410 con 0x56435d7ea770 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.359+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d73ed00 con 0x56435d7eb0d0 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5dad9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7ea770 0x56435d7eab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5dad9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7ea770 0x56435d7eab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35066/0 (socket says 172.21.15.12:35066) 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5dad9c700 1 -- 172.21.15.12:0/3654106745 learned_addr learned my addr 172.21.15.12:0/3654106745 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5da59b700 1 --2- 172.21.15.12:0/3654106745 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7eb0d0 0x56435d7ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5dad9c700 1 -- 172.21.15.12:0/3654106745 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7eb0d0 msgr2=0x56435d7ef640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5dad9c700 1 --2- 172.21.15.12:0/3654106745 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7eb0d0 0x56435d7ef640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5dad9c700 1 -- 172.21.15.12:0/3654106745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 msgr2=0x56435d7f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5dad9c700 1 --2- 172.21.15.12:0/3654106745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d7f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5dad9c700 1 -- 172.21.15.12:0/3654106745 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56435d5bb5d0 con 0x56435d7ea770 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.360+0000 7fa5cb7fe700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5c00a1560 0x7fa5c00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.361+0000 7fa5dad9c700 1 --2- 172.21.15.12:0/3654106745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7ea770 0x56435d7eab90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000bb10 tx=0x7fa5d000be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3d004e5cca696a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.361+0000 7fa5cb7fe700 1 -- 172.21.15.12:0/191503877 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5c40cdad0 con 0x7fa5cc096fc0 2023-12-11T20:33:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.361+0000 7fa5da59b700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5c00a1560 0x7fa5c00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.361+0000 7fa5c8ff9700 1 -- 172.21.15.12:0/3654106745 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0004830 con 0x56435d7ea770 2023-12-11T20:33:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.361+0000 7fa5c8ff9700 1 -- 172.21.15.12:0/3654106745 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5d0004e20 con 0x56435d7ea770 2023-12-11T20:33:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.361+0000 7fa5c8ff9700 1 -- 172.21.15.12:0/3654106745 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00053a0 con 0x56435d7ea770 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 -- 172.21.15.12:0/3654106745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7ea770 msgr2=0x56435d7eab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/3654106745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7ea770 0x56435d7eab90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000bb10 tx=0x7fa5d000be20 comp rx=0 tx=0).stop 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5da59b700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5c00a1560 0x7fa5c00a3a20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4050880 tx=0x7fa5d404f880 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 -- 172.21.15.12:0/3654106745 shutdown_connections 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/3654106745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7ea770 0x56435d7eab90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/3654106745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d7f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/3654106745 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7eb0d0 0x56435d7ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 -- 172.21.15.12:0/3654106745 >> 172.21.15.12:0/3654106745 conn(0x56435d719780 msgr2=0x56435d7e6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 -- 172.21.15.12:0/3654106745 shutdown_connections 2023-12-11T20:33:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.362+0000 7fa5f020fb80 1 -- 172.21.15.12:0/3654106745 wait complete. 2023-12-11T20:33:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.363+0000 7fa5f020fb80 1 -- start start 2023-12-11T20:33:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.364+0000 7fa5f020fb80 1 Processor -- start 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.364+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7ea770 0x56435d804fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.364+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d8054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.364+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7efb80 0x56435d80c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.364+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d6f8500 con 0x56435d7ea770 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.364+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d6f81a0 con 0x56435d7eb0d0 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.364+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d5bd8c0 con 0x56435d7efb80 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.364+0000 7fa5f020fb80 10 client.0 _ll_register_callbacks cb 0x56435d623a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.365+0000 7fa5da59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7ea770 0x56435d804fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.365+0000 7fa5d9d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d8054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.365+0000 7fa5d9d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d8054e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35080/0 (socket says 172.21.15.12:35080) 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.365+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/121739320 learned_addr learned my addr 172.21.15.12:0/121739320 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.365+0000 7fa5dad9c700 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7efb80 0x56435d80c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.366+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/121739320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7efb80 msgr2=0x56435d80c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.366+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7efb80 0x56435d80c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.366+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/121739320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7ea770 msgr2=0x56435d804fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.366+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7ea770 0x56435d804fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.366+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/121739320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d000b740 con 0x56435d7eb0d0 2023-12-11T20:33:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.366+0000 7fa5da59b700 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7ea770 0x56435d804fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:33:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.366+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d8054e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa5c409ab30 tx=0x7fa5c409b370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be72c46bc7d3aed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.366+0000 7fa5bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.367+0000 7fa5bdffb700 1 -- 172.21.15.12:0/121739320 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003d60 con 0x56435d7eb0d0 2023-12-11T20:33:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.367+0000 7fa5bdffb700 1 -- 172.21.15.12:0/121739320 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5c409b530 con 0x56435d7eb0d0 2023-12-11T20:33:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.367+0000 7fa5f020fb80 1 -- 172.21.15.12:0/121739320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56435d7dd730 con 0x56435d7eb0d0 2023-12-11T20:33:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.368+0000 7fa5bdffb700 1 -- 172.21.15.12:0/121739320 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c409ae30 con 0x56435d7eb0d0 2023-12-11T20:33:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.368+0000 7fa5f020fb80 10 client.30041 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.368+0000 7fa5f020fb80 1 -- 172.21.15.12:0/121739320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x56435d567d80 con 0x56435d7eb0d0 2023-12-11T20:33:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.369+0000 7fa5bdffb700 1 -- 172.21.15.12:0/121739320 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56435d7dd730 con 0x56435d7eb0d0 2023-12-11T20:33:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.369+0000 7fa5bdffb700 1 -- 172.21.15.12:0/121739320 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa5c40a2ca0 con 0x56435d7eb0d0 2023-12-11T20:33:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.370+0000 7fa5f020fb80 10 client.30041 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.370+0000 7fa5f020fb80 10 client.30041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.370+0000 7fa5f020fb80 20 client.30041 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.370+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56435d810c20 0x56435d813040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.370+0000 7fa5f020fb80 4 client.30041 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:33:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.370+0000 7fa5f020fb80 1 -- 172.21.15.12:0/121739320 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56435d7b9ee0 con 0x56435d810c20 2023-12-11T20:33:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.370+0000 7fa5da59b700 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56435d810c20 0x56435d813040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.371+0000 7fa5da59b700 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56435d810c20 0x56435d813040 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f007a7a5cd043055 server_cookie=b07ad9ab60e8704a in_seq=0 out_seq=0 2023-12-11T20:33:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.371+0000 7fa5bdffb700 10 client.30041 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.372+0000 7fa5bdffb700 1 -- 172.21.15.12:0/121739320 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56435d7b9ee0 con 0x56435d810c20 2023-12-11T20:33:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.372+0000 7fa5bdffb700 10 client.30041 handle_command_reply: tid=0 2023-12-11T20:33:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.372+0000 7fa5f020fb80 1 client.30041 shutdown 2023-12-11T20:33:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.373+0000 7fa5f020fb80 1 -- 172.21.15.12:0/121739320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 msgr2=0x56435d8054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.373+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d8054e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa5c409ab30 tx=0x7fa5c409b370 comp rx=0 tx=0).stop 2023-12-11T20:33:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.374+0000 7fa5f020fb80 1 -- 172.21.15.12:0/121739320 shutdown_connections 2023-12-11T20:33:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.374+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56435d810c20 0x56435d813040 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.374+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7efb80 0x56435d80c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.374+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7ea770 0x56435d804fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.374+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/121739320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d8054e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.374+0000 7fa5f020fb80 1 -- 172.21.15.12:0/121739320 >> 172.21.15.12:0/121739320 conn(0x56435d719780 msgr2=0x56435d7e7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.374+0000 7fa5bdffb700 0 client.30041 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:52.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.375+0000 7fa5f020fb80 1 -- 172.21.15.12:0/121739320 shutdown_connections 2023-12-11T20:33:52.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.375+0000 7fa5f020fb80 1 -- 172.21.15.12:0/121739320 wait complete. 2023-12-11T20:33:52.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.375+0000 7fa5f020fb80 20 client.30041 trim_cache size 0 max 16384 2023-12-11T20:33:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.401+0000 7fa5f020fb80 1 Processor -- start 2023-12-11T20:33:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.401+0000 7fa5f020fb80 1 -- start start 2023-12-11T20:33:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.402+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.402+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d7f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.402+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d8044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.402+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d8133d0 con 0x56435d7efb80 2023-12-11T20:33:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.402+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d818210 con 0x56435d7eb0d0 2023-12-11T20:33:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.402+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d7dd4c0 con 0x56435d7ea770 2023-12-11T20:33:52.402 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.403+0000 7fa5d9d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d7f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.403+0000 7fa5da59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.403+0000 7fa5da59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:58174/0 (socket says 172.21.15.12:58174) 2023-12-11T20:33:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.403+0000 7fa5da59b700 1 -- 172.21.15.12:0/766219881 learned_addr learned my addr 172.21.15.12:0/766219881 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.404+0000 7fa5dad9c700 1 --2- 172.21.15.12:0/766219881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d8044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.404+0000 7fa5da59b700 1 -- 172.21.15.12:0/766219881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 msgr2=0x56435d7f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.404+0000 7fa5da59b700 1 --2- 172.21.15.12:0/766219881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d7f1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.404+0000 7fa5da59b700 1 -- 172.21.15.12:0/766219881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 msgr2=0x56435d8044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.404+0000 7fa5da59b700 1 --2- 172.21.15.12:0/766219881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d8044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.404+0000 7fa5da59b700 1 -- 172.21.15.12:0/766219881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56435d550c00 con 0x56435d7ea770 2023-12-11T20:33:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.405+0000 7fa5da59b700 1 --2- 172.21.15.12:0/766219881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80cbd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4064df0 tx=0x7fa5d4072000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d988bb1fdbf171 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.405+0000 7fa5c97fa700 1 -- 172.21.15.12:0/766219881 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4091070 con 0x56435d7ea770 2023-12-11T20:33:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.405+0000 7fa5c97fa700 1 -- 172.21.15.12:0/766219881 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5d407dd80 con 0x56435d7ea770 2023-12-11T20:33:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.405+0000 7fa5c97fa700 1 -- 172.21.15.12:0/766219881 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d408c6b0 con 0x56435d7ea770 2023-12-11T20:33:52.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.406+0000 7fa5f020fb80 1 -- 172.21.15.12:0/766219881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 msgr2=0x56435d80cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.407+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/766219881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80cbd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4064df0 tx=0x7fa5d4072000 comp rx=0 tx=0).stop 2023-12-11T20:33:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.407+0000 7fa5f020fb80 1 -- 172.21.15.12:0/766219881 shutdown_connections 2023-12-11T20:33:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.407+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/766219881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d8044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.407+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/766219881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80cbd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.407+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/766219881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d7f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.407+0000 7fa5f020fb80 1 -- 172.21.15.12:0/766219881 >> 172.21.15.12:0/766219881 conn(0x56435d719780 msgr2=0x56435d7ef3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.407+0000 7fa5f020fb80 1 -- 172.21.15.12:0/766219881 shutdown_connections 2023-12-11T20:33:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.407+0000 7fa5f020fb80 1 -- 172.21.15.12:0/766219881 wait complete. 2023-12-11T20:33:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.409+0000 7fa5f020fb80 1 -- start start 2023-12-11T20:33:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.411+0000 7fa5f020fb80 1 Processor -- start 2023-12-11T20:33:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d80a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5f020fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d80b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d80ba50 con 0x56435d7efb80 2023-12-11T20:33:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d80bbc0 con 0x56435d7eb0d0 2023-12-11T20:33:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5f020fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56435d80bd80 con 0x56435d7ea770 2023-12-11T20:33:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5f020fb80 10 client.0 _ll_register_callbacks cb 0x56435d623a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5d9d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d80a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5d9d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d80a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35106/0 (socket says 172.21.15.12:35106) 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.412+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/2844722119 learned_addr learned my addr 172.21.15.12:0/2844722119 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.413+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/2844722119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 msgr2=0x56435d80a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.413+0000 7fa5da59b700 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.413+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.413+0000 7fa5dad9c700 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d80b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.413+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/2844722119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 msgr2=0x56435d80b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:33:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.413+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d80b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.413+0000 7fa5d9d9a700 1 -- 172.21.15.12:0/2844722119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d407ae90 con 0x56435d7eb0d0 2023-12-11T20:33:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.413+0000 7fa5dad9c700 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d80b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:33:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.414+0000 7fa5d9d9a700 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d80a5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40a30a0 tx=0x7fa5c4005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ac975a775adab8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:33:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.414+0000 7fa5bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:33:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.414+0000 7fa5bdffb700 1 -- 172.21.15.12:0/2844722119 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40aebd0 con 0x56435d7eb0d0 2023-12-11T20:33:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.414+0000 7fa5bdffb700 1 -- 172.21.15.12:0/2844722119 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5c40aee30 con 0x56435d7eb0d0 2023-12-11T20:33:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.414+0000 7fa5f020fb80 1 -- 172.21.15.12:0/2844722119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56435d7dffb0 con 0x56435d7eb0d0 2023-12-11T20:33:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.415+0000 7fa5bdffb700 1 -- 172.21.15.12:0/2844722119 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c4003d60 con 0x56435d7eb0d0 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.415+0000 7fa5f020fb80 10 client.30047 fetch_fsmap learned FSMap version 38 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.415+0000 7fa5f020fb80 1 -- 172.21.15.12:0/2844722119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x56435d58e1f0 con 0x56435d7eb0d0 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.415+0000 7fa5bdffb700 1 -- 172.21.15.12:0/2844722119 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56435d7dffb0 con 0x56435d7eb0d0 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.416+0000 7fa5bdffb700 1 -- 172.21.15.12:0/2844722119 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 38) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa5c40b3860 con 0x56435d7eb0d0 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.416+0000 7fa5f020fb80 10 client.30047 fetch_fsmap finished waiting for FSMap version 38 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.416+0000 7fa5f020fb80 10 client.30047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.416+0000 7fa5f020fb80 20 client.30047 populate_metadata read hostname 'smithi012' 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.416+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56435d867870 0x56435d869c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.416+0000 7fa5f020fb80 4 client.30047 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:33:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.416+0000 7fa5f020fb80 1 -- 172.21.15.12:0/2844722119 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fa5d0004e20 con 0x56435d867870 2023-12-11T20:33:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.416+0000 7fa5da59b700 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56435d867870 0x56435d869c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:33:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.417+0000 7fa5da59b700 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56435d867870 0x56435d869c60 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6863af782f9cd402 server_cookie=143250fb15fc2fec in_seq=0 out_seq=0 2023-12-11T20:33:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.417+0000 7fa5bdffb700 10 client.30047 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5bdffb700 1 -- 172.21.15.12:0/2844722119 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fa5d0004e20 con 0x56435d867870 2023-12-11T20:33:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5bdffb700 10 client.30047 handle_command_reply: tid=0 2023-12-11T20:33:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 client.30047 shutdown 2023-12-11T20:33:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 -- 172.21.15.12:0/2844722119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 msgr2=0x56435d80a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d80a5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40a30a0 tx=0x7fa5c4005fb0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 -- 172.21.15.12:0/2844722119 shutdown_connections 2023-12-11T20:33:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56435d867870 0x56435d869c60 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56435d7efb80 0x56435d80b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56435d7ea770 0x56435d80a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 --2- 172.21.15.12:0/2844722119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56435d7eb0d0 0x56435d80a5a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.439+0000 7fa5f020fb80 1 -- 172.21.15.12:0/2844722119 >> 172.21.15.12:0/2844722119 conn(0x56435d719780 msgr2=0x56435d8043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.440+0000 7fa5bdffb700 0 client.30047 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.440+0000 7fa5f020fb80 1 -- 172.21.15.12:0/2844722119 shutdown_connections 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.440+0000 7fa5f020fb80 1 -- 172.21.15.12:0/2844722119 wait complete. 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.440+0000 7fa5f020fb80 20 client.30047 trim_cache size 0 max 16384 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:33:52.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:33:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 -- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5c00a1560 msgr2=0x7fa5c00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5c00a1560 0x7fa5c00a3a20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4050880 tx=0x7fa5d404f880 comp rx=0 tx=0).stop 2023-12-11T20:33:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 -- 172.21.15.12:0/191503877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 msgr2=0x7fa5cc132810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:33:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 0x7fa5cc132810 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4000c00 tx=0x7fa5c4004730 comp rx=0 tx=0).stop 2023-12-11T20:33:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 -- 172.21.15.12:0/191503877 shutdown_connections 2023-12-11T20:33:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa5c00a1560 0x7fa5c00a3a20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5cc099990 0x7fa5cc139830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5cc094650 0x7fa5cc1322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 --2- 172.21.15.12:0/191503877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5cc096fc0 0x7fa5cc132810 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:33:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 -- 172.21.15.12:0/191503877 >> 172.21.15.12:0/191503877 conn(0x7fa5cc090230 msgr2=0x7fa5cc096530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:33:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 -- 172.21.15.12:0/191503877 shutdown_connections 2023-12-11T20:33:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:33:52.446+0000 7fa5db59d700 1 -- 172.21.15.12:0/191503877 wait complete. 2023-12-11T20:33:53.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:52 smithi032 ceph-mon[132488]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:33:53.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:52 smithi039 ceph-mon[102205]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:33:53.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:52 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-a[128763]: 2023-12-11T20:33:52.821+0000 7fd4cc6bf700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-11T20:33:53.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:52 smithi012 ceph-mon[128787]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:33:54.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:53 smithi032 ceph-mon[132488]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-11T20:33:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:53 smithi032 ceph-mon[132488]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:active 2023-12-11T20:33:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:53 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:54.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:53 smithi039 ceph-mon[102205]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-11T20:33:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:53 smithi039 ceph-mon[102205]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:active 2023-12-11T20:33:54.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:53 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:54.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:53 smithi012 ceph-mon[128787]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-11T20:33:54.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:53 smithi012 ceph-mon[128787]: mds.? [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] up:active 2023-12-11T20:33:54.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:53 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:33:55.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:54 smithi032 ceph-mon[132488]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:33:55.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:54 smithi039 ceph-mon[102205]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:33:55.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:54 smithi012 ceph-mon[128787]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:33:57.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:56 smithi032 ceph-mon[132488]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2023-12-11T20:33:57.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:56 smithi039 ceph-mon[102205]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2023-12-11T20:33:57.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:56 smithi012 ceph-mon[128787]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2023-12-11T20:33:59.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:33:58 smithi032 ceph-mon[132488]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2023-12-11T20:33:59.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:33:58 smithi039 ceph-mon[102205]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2023-12-11T20:33:59.333 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:33:58 smithi012 ceph-mon[128787]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 4.49k op/s 2023-12-11T20:34:01.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:00 smithi032 ceph-mon[132488]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2023-12-11T20:34:01.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:00 smithi039 ceph-mon[102205]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2023-12-11T20:34:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:00 smithi012 ceph-mon[128787]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2023-12-11T20:34:02.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:01 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:34:02.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:01 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:34:02.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:01 smithi032 ceph-mon[132488]: scrub summary: idle 2023-12-11T20:34:02.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:01 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:34:02.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:01 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:34:02.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:01 smithi039 ceph-mon[102205]: scrub summary: idle 2023-12-11T20:34:02.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:01 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:34:02.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:01 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:34:02.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:01 smithi012 ceph-mon[128787]: scrub summary: idle 2023-12-11T20:34:03.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:02 smithi032 ceph-mon[132488]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:34:03.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:02 smithi039 ceph-mon[102205]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:34:03.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:02 smithi012 ceph-mon[128787]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:34:05.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:04 smithi032 ceph-mon[132488]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2023-12-11T20:34:05.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:04 smithi039 ceph-mon[102205]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2023-12-11T20:34:05.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:04 smithi012 ceph-mon[128787]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2023-12-11T20:34:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.796+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/1320315888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 msgr2=0x7fb5f8101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.796+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/1320315888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 0x7fb5f8101920 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009fc0 tx=0x7fb5f000b330 comp rx=0 tx=0).stop 2023-12-11T20:34:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.797+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/1320315888 shutdown_connections 2023-12-11T20:34:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.797+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/1320315888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5f8103090 0x7fb5f8109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.797+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/1320315888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 0x7fb5f8101920 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.797+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/1320315888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f81026f0 0x7fb5f8102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.797+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/1320315888 >> 172.21.15.12:0/1320315888 conn(0x7fb5f80fca90 msgr2=0x7fb5f80feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.797+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/1320315888 shutdown_connections 2023-12-11T20:34:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.797+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/1320315888 wait complete. 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.799+0000 7fb5fc9ff700 1 Processor -- start 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.799+0000 7fb5fc9ff700 1 -- start start 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.800+0000 7fb5fc9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 0x7fb5f8070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.800+0000 7fb5fc9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f81026f0 0x7fb5f80705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.800+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 0x7fb5f8070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5fc9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5f8103090 0x7fb5f81a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5fc9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8070c50 con 0x7fb5f8101500 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5fc9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81a79f0 con 0x7fb5f81026f0 2023-12-11T20:34:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 0x7fb5f8070060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40188/0 (socket says 172.21.15.12:40188) 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5fc9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81a7b30 con 0x7fb5f8103090 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f659c700 1 -- 172.21.15.12:0/3937374028 learned_addr learned my addr 172.21.15.12:0/3937374028 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f81026f0 0x7fb5f80705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/3937374028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5f8103090 msgr2=0x7fb5f81a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5f8103090 0x7fb5f81a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 msgr2=0x7fb5f8070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 0x7fb5f8070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/3937374028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0009c40 con 0x7fb5f81026f0 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.801+0000 7fb5f659c700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 0x7fb5f8070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.802+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f81026f0 0x7fb5f80705a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00e9f0 tx=0x7fb5ec00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.803+0000 7fb5e77fe700 1 -- 172.21.15.12:0/3937374028 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00c9c0 con 0x7fb5f81026f0 2023-12-11T20:34:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.803+0000 7fb5e77fe700 1 -- 172.21.15.12:0/3937374028 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5ec010430 con 0x7fb5f81026f0 2023-12-11T20:34:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.803+0000 7fb5e77fe700 1 -- 172.21.15.12:0/3937374028 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec018680 con 0x7fb5f81026f0 2023-12-11T20:34:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.803+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/3937374028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f8073860 con 0x7fb5f81026f0 2023-12-11T20:34:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.803+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/3937374028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f8073c60 con 0x7fb5f81026f0 2023-12-11T20:34:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.812+0000 7fb5e77fe700 1 -- 172.21.15.12:0/3937374028 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb5ec0105a0 con 0x7fb5f81026f0 2023-12-11T20:34:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.814+0000 7fb6103aeb80 1 Processor -- start 2023-12-11T20:34:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.815+0000 7fb6103aeb80 1 -- start start 2023-12-11T20:34:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.816+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc2ed0 0x563289dc32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.816+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc3830 0x563289dc4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.816+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dc4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.816+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289d1eaf0 con 0x563289dc3830 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.816+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289d1c410 con 0x563289dc2ed0 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.816+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289d17d00 con 0x563289dc4720 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.817+0000 7fb5f5d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dc4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.817+0000 7fb5f5d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dc4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55982/0 (socket says 172.21.15.12:55982) 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.817+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/739958904 learned_addr learned my addr 172.21.15.12:0/739958904 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.817+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/739958904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc2ed0 msgr2=0x563289dc32f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.817+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/739958904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc2ed0 0x563289dc32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.817+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/739958904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc3830 msgr2=0x563289dc4140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.817+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/739958904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc3830 0x563289dc4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.817+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/739958904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563289b945d0 con 0x563289dc4720 2023-12-11T20:34:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.818+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/739958904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dc4ba0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0d0d50 tx=0x7fb5ec0d5720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c9ee65495cd792d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.818+0000 7fb5e77fe700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb5e00a59d0 0x7fb5e00a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.818+0000 7fb5e4ff9700 1 -- 172.21.15.12:0/739958904 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec096550 con 0x563289dc4720 2023-12-11T20:34:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.818+0000 7fb5e77fe700 1 -- 172.21.15.12:0/3937374028 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb5ec014070 con 0x7fb5f81026f0 2023-12-11T20:34:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.818+0000 7fb5e4ff9700 1 -- 172.21.15.12:0/739958904 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5ec099fe0 con 0x563289dc4720 2023-12-11T20:34:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.818+0000 7fb5e4ff9700 1 -- 172.21.15.12:0/739958904 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec099d50 con 0x563289dc4720 2023-12-11T20:34:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.818+0000 7fb5f6d9d700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb5e00a59d0 0x7fb5e00a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 -- 172.21.15.12:0/739958904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 msgr2=0x563289dc4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/739958904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dc4ba0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0d0d50 tx=0x7fb5ec0d5720 comp rx=0 tx=0).stop 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb5f6d9d700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb5e00a59d0 0x7fb5e00a7e90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8005950 tx=0x7fb5e80058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 -- 172.21.15.12:0/739958904 shutdown_connections 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/739958904 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc2ed0 0x563289dc32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/739958904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dc4ba0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/739958904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc3830 0x563289dc4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 -- 172.21.15.12:0/739958904 >> 172.21.15.12:0/739958904 conn(0x563289cf2780 msgr2=0x563289dbf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 -- 172.21.15.12:0/739958904 shutdown_connections 2023-12-11T20:34:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.823+0000 7fb6103aeb80 1 -- 172.21.15.12:0/739958904 wait complete. 2023-12-11T20:34:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.824+0000 7fb6103aeb80 1 -- start start 2023-12-11T20:34:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.824+0000 7fb6103aeb80 1 Processor -- start 2023-12-11T20:34:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.825+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc2ed0 0x563289dccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.825+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dcd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.826+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc4720 0x563289dd4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb5f5d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dcd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb5f6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc4720 0x563289dd4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc2ed0 0x563289dccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc2ed0 0x563289dccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55990/0 (socket says 172.21.15.12:55990) 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb5f6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc4720 0x563289dd4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40200/0 (socket says 172.21.15.12:40200) 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb5f5d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dcd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37656/0 (socket says 172.21.15.12:37656) 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb5f659c700 1 -- 172.21.15.12:0/3343187551 learned_addr learned my addr 172.21.15.12:0/3343187551 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289cd1500 con 0x563289dc4720 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289cd11a0 con 0x563289dc3830 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289b968c0 con 0x563289dc2ed0 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.827+0000 7fb6103aeb80 10 client.0 _ll_register_callbacks cb 0x563289bfca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb5f659c700 1 -- 172.21.15.12:0/3343187551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 msgr2=0x563289dcd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb5f659c700 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dcd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb5f659c700 1 -- 172.21.15.12:0/3343187551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc4720 msgr2=0x563289dd4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb5f659c700 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc4720 0x563289dd4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb5f659c700 1 -- 172.21.15.12:0/3343187551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f8073c60 con 0x563289dc2ed0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb5f6d9d700 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc4720 0x563289dd4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563289db6730 con 0x563289dc2ed0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb5f659c700 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc2ed0 0x563289dccf40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009bc0 tx=0x7fb5f0007780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d23efccb81949d79 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.828+0000 7fb5ddffb700 10 client.30064 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.829+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3343187551 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000e040 con 0x563289dc2ed0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.829+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3343187551 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb5f0003a00 con 0x563289dc2ed0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.829+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3343187551 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5f0003bc0 con 0x563289dc2ed0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.829+0000 7fb6103aeb80 10 client.30064 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.829+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=39}) v3 -- 0x563289b40d80 con 0x563289dc2ed0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.830+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3343187551 <== mon.1 v2:172.21.15.39:3300/0 4 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb5f0019050 con 0x563289dc2ed0 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.830+0000 7fb6103aeb80 10 client.30064 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.830+0000 7fb6103aeb80 10 client.30064 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.830+0000 7fb6103aeb80 20 client.30064 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.830+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563289dd8bd0 0x563289ddb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.830+0000 7fb6103aeb80 4 client.30064 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.830+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563289d92ee0 con 0x563289dd8bd0 2023-12-11T20:34:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.830+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563289dd8bd0 0x563289ddb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.831+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563289dd8bd0 0x563289ddb010 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=407517958ceb9a6e server_cookie=701ad71ea3d8858d in_seq=0 out_seq=0 2023-12-11T20:34:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.831+0000 7fb5ddffb700 10 client.30064 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.832+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3343187551 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563289d92ee0 con 0x563289dd8bd0 2023-12-11T20:34:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.832+0000 7fb5ddffb700 10 client.30064 handle_command_reply: tid=0 2023-12-11T20:34:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.832+0000 7fb6103aeb80 1 client.30064 shutdown 2023-12-11T20:34:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc2ed0 msgr2=0x563289dccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc2ed0 0x563289dccf40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009bc0 tx=0x7fb5f0007780 comp rx=0 tx=0).stop 2023-12-11T20:34:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 shutdown_connections 2023-12-11T20:34:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563289dd8bd0 0x563289ddb010 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc4720 0x563289dd4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb5ddffb700 0 client.30064 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc2ed0 0x563289dccf40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3343187551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dcd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 >> 172.21.15.12:0/3343187551 conn(0x563289cf2780 msgr2=0x563289dbdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.833+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 shutdown_connections 2023-12-11T20:34:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.834+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3343187551 wait complete. 2023-12-11T20:34:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.834+0000 7fb6103aeb80 20 client.30064 trim_cache size 0 max 16384 2023-12-11T20:34:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.868+0000 7fb6103aeb80 1 Processor -- start 2023-12-11T20:34:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.868+0000 7fb6103aeb80 1 -- start start 2023-12-11T20:34:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.868+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dc4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dcc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289dca960 con 0x563289dc2ed0 2023-12-11T20:34:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289dc8250 con 0x563289dc3830 2023-12-11T20:34:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289db64c0 con 0x563289dc4720 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dc4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dc4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40216/0 (socket says 172.21.15.12:40216) 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb5f659c700 1 -- 172.21.15.12:0/2358253040 learned_addr learned my addr 172.21.15.12:0/2358253040 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.869+0000 7fb5f6d9d700 1 --2- 172.21.15.12:0/2358253040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dcc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.870+0000 7fb5f659c700 1 -- 172.21.15.12:0/2358253040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 msgr2=0x563289dcc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.870+0000 7fb5f659c700 1 --2- 172.21.15.12:0/2358253040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dcc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.870+0000 7fb5f659c700 1 -- 172.21.15.12:0/2358253040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 msgr2=0x563289dd4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.870+0000 7fb5f659c700 1 --2- 172.21.15.12:0/2358253040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.870+0000 7fb5f659c700 1 -- 172.21.15.12:0/2358253040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563289b29c00 con 0x563289dc2ed0 2023-12-11T20:34:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.870+0000 7fb5f659c700 1 --2- 172.21.15.12:0/2358253040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dc4b60 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0007780 tx=0x7fb5f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b19812f02b1b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.870+0000 7fb5e57fa700 1 -- 172.21.15.12:0/2358253040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000e040 con 0x563289dc2ed0 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.871+0000 7fb5e57fa700 1 -- 172.21.15.12:0/2358253040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5f002a030 con 0x563289dc2ed0 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.871+0000 7fb5e57fa700 1 -- 172.21.15.12:0/2358253040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00051a0 con 0x563289dc2ed0 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.871+0000 7fb6103aeb80 1 -- 172.21.15.12:0/2358253040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 msgr2=0x563289dc4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.871+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/2358253040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dc4b60 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0007780 tx=0x7fb5f001f000 comp rx=0 tx=0).stop 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.872+0000 7fb6103aeb80 1 -- 172.21.15.12:0/2358253040 shutdown_connections 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.872+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/2358253040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dcc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.872+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/2358253040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dc4b60 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.872+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/2358253040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.872+0000 7fb6103aeb80 1 -- 172.21.15.12:0/2358253040 >> 172.21.15.12:0/2358253040 conn(0x563289cf2780 msgr2=0x563289dcace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.872+0000 7fb6103aeb80 1 -- 172.21.15.12:0/2358253040 shutdown_connections 2023-12-11T20:34:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.872+0000 7fb6103aeb80 1 -- 172.21.15.12:0/2358253040 wait complete. 2023-12-11T20:34:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.873+0000 7fb6103aeb80 1 -- start start 2023-12-11T20:34:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.873+0000 7fb6103aeb80 1 Processor -- start 2023-12-11T20:34:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.874+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dd1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.874+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.874+0000 7fb6103aeb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dd3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.874+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289dd36c0 con 0x563289dc2ed0 2023-12-11T20:34:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.874+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289dd3830 con 0x563289dc3830 2023-12-11T20:34:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.874+0000 7fb6103aeb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x563289dd39f0 con 0x563289dc4720 2023-12-11T20:34:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.874+0000 7fb6103aeb80 10 client.0 _ll_register_callbacks cb 0x563289bfca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.874+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dd1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f5d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f5d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37668/0 (socket says 172.21.15.12:37668) 2023-12-11T20:34:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/3426108166 learned_addr learned my addr 172.21.15.12:0/3426108166 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f6d9d700 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dd3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/3426108166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 msgr2=0x563289dd3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dd3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/3426108166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 msgr2=0x563289dd1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dd1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f5d9b700 1 -- 172.21.15.12:0/3426108166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563289b40d80 con 0x563289dc3830 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f6d9d700 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dd3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.875+0000 7fb5f659c700 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dd1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.876+0000 7fb5f5d9b700 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd2210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0cad60 tx=0x7fb5ec00c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f3b822abad16c2f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.876+0000 7fb5ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.876+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3426108166 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec099b70 con 0x563289dc3830 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.876+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3426108166 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb5ec010880 con 0x563289dc3830 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.876+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3426108166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5ec099fe0 con 0x563289dc3830 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.876+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3426108166 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5ec096550 con 0x563289dc3830 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.876+0000 7fb6103aeb80 10 client.30059 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.876+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3426108166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x563289b671f0 con 0x563289dc3830 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3426108166 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5ec099fe0 con 0x563289dc3830 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3426108166 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb5ec096920 con 0x563289dc3830 2023-12-11T20:34:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb6103aeb80 10 client.30059 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb6103aeb80 10 client.30059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb6103aeb80 20 client.30059 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563289e38220 0x563289e3a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb6103aeb80 4 client.30059 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:34:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3426108166 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563289cddf70 con 0x563289e38220 2023-12-11T20:34:05.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.877+0000 7fb5f659c700 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563289e38220 0x563289e3a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.883+0000 7fb5ddffb700 10 client.30059 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.883+0000 7fb5f659c700 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563289e38220 0x563289e3a640 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f55d59ad31e38279 server_cookie=4c968611aa1f0ab7 in_seq=0 out_seq=0 2023-12-11T20:34:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.898+0000 7fb5ddffb700 1 -- 172.21.15.12:0/3426108166 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563289cddf70 con 0x563289e38220 2023-12-11T20:34:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.898+0000 7fb5ddffb700 10 client.30059 handle_command_reply: tid=0 2023-12-11T20:34:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.898+0000 7fb6103aeb80 1 client.30059 shutdown 2023-12-11T20:34:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3426108166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 msgr2=0x563289dd2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd2210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0cad60 tx=0x7fb5ec00c6e0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3426108166 shutdown_connections 2023-12-11T20:34:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x563289e38220 0x563289e3a640 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563289dc4720 0x563289dd3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563289dc2ed0 0x563289dd1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb6103aeb80 1 --2- 172.21.15.12:0/3426108166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x563289dc3830 0x563289dd2210 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3426108166 >> 172.21.15.12:0/3426108166 conn(0x563289cf2780 msgr2=0x563289dcc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.899+0000 7fb5ddffb700 0 client.30059 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.900+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3426108166 shutdown_connections 2023-12-11T20:34:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.900+0000 7fb6103aeb80 1 -- 172.21.15.12:0/3426108166 wait complete. 2023-12-11T20:34:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.901+0000 7fb6103aeb80 20 client.30059 trim_cache size 0 max 16384 2023-12-11T20:34:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:34:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:34:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:34:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:34:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb5e00a59d0 msgr2=0x7fb5e00a7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb5e00a59d0 0x7fb5e00a7e90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8005950 tx=0x7fb5e80058e0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/3937374028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f81026f0 msgr2=0x7fb5f80705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f81026f0 0x7fb5f80705a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00e9f0 tx=0x7fb5ec00ed00 comp rx=0 tx=0).stop 2023-12-11T20:34:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/3937374028 shutdown_connections 2023-12-11T20:34:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb5e00a59d0 0x7fb5e00a7e90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5f8103090 0x7fb5f81a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f8101500 0x7fb5f8070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 --2- 172.21.15.12:0/3937374028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f81026f0 0x7fb5f80705a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/3937374028 >> 172.21.15.12:0/3937374028 conn(0x7fb5f80fca90 msgr2=0x7fb5f8105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/3937374028 shutdown_connections 2023-12-11T20:34:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:05.902+0000 7fb5fc9ff700 1 -- 172.21.15.12:0/3937374028 wait complete. 2023-12-11T20:34:07.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:06 smithi032 ceph-mon[132488]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2023-12-11T20:34:07.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:06 smithi039 ceph-mon[102205]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2023-12-11T20:34:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:06 smithi012 ceph-mon[128787]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.76k op/s 2023-12-11T20:34:09.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:08 smithi032 ceph-mon[132488]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.82k op/s 2023-12-11T20:34:09.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:08 smithi039 ceph-mon[102205]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.82k op/s 2023-12-11T20:34:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:08 smithi012 ceph-mon[128787]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.82k op/s 2023-12-11T20:34:11.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:10 smithi032 ceph-mon[132488]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.55k op/s 2023-12-11T20:34:11.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:10 smithi039 ceph-mon[102205]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.55k op/s 2023-12-11T20:34:11.334 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:10 smithi012 ceph-mon[128787]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.55k op/s 2023-12-11T20:34:13.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:12 smithi032 ceph-mon[132488]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:34:13.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:12 smithi039 ceph-mon[102205]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:34:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:12 smithi012 ceph-mon[128787]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:34:15.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:14 smithi032 ceph-mon[132488]: pgmap v924: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2023-12-11T20:34:15.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:14 smithi039 ceph-mon[102205]: pgmap v924: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2023-12-11T20:34:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:14 smithi012 ceph-mon[128787]: pgmap v924: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2023-12-11T20:34:17.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:16 smithi032 ceph-mon[132488]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2023-12-11T20:34:17.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:16 smithi039 ceph-mon[102205]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2023-12-11T20:34:17.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:16 smithi012 ceph-mon[128787]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.73k op/s 2023-12-11T20:34:18.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-11T20:34:19.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:18.999+0000 7f84cefff700 1 -- 172.21.15.12:0/1347769361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84c8107ad0 msgr2=0x7f84c8107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:18.999+0000 7f84cefff700 1 --2- 172.21.15.12:0/1347769361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84c8107ad0 0x7f84c8107ef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009990 tx=0x7f84bc009ca0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.000+0000 7f84cefff700 1 -- 172.21.15.12:0/1347769361 shutdown_connections 2023-12-11T20:34:19.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.000+0000 7f84cefff700 1 --2- 172.21.15.12:0/1347769361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c8109660 0x7f84c810ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.000+0000 7f84cefff700 1 --2- 172.21.15.12:0/1347769361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84c8107ad0 0x7f84c8107ef0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.000+0000 7f84cefff700 1 --2- 172.21.15.12:0/1347769361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c8108cc0 0x7f84c8109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.000+0000 7f84cefff700 1 -- 172.21.15.12:0/1347769361 >> 172.21.15.12:0/1347769361 conn(0x7f84c8076a90 msgr2=0x7f84c8078eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.001+0000 7f84cefff700 1 -- 172.21.15.12:0/1347769361 shutdown_connections 2023-12-11T20:34:19.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.002+0000 7f84cefff700 1 -- 172.21.15.12:0/1347769361 wait complete. 2023-12-11T20:34:19.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.006+0000 7f84cefff700 1 Processor -- start 2023-12-11T20:34:19.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.007+0000 7f84cefff700 1 -- start start 2023-12-11T20:34:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84cefff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c8107ad0 0x7f84c819da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84cefff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c8108cc0 0x7f84c819df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84cefff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84c8109660 0x7f84c81a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84cefff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81a5540 con 0x7f84c8108cc0 2023-12-11T20:34:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84cefff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81a5680 con 0x7f84c8107ad0 2023-12-11T20:34:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84cefff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81a5810 con 0x7f84c8109660 2023-12-11T20:34:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84ccd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c8107ad0 0x7f84c819da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84ccd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c8107ad0 0x7f84c819da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37472/0 (socket says 172.21.15.12:37472) 2023-12-11T20:34:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84ccd9b700 1 -- 172.21.15.12:0/1994838843 learned_addr learned my addr 172.21.15.12:0/1994838843 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84c7fff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c8108cc0 0x7f84c819df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.008+0000 7f84cd59c700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84c8109660 0x7f84c81a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84c7fff700 1 -- 172.21.15.12:0/1994838843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84c8109660 msgr2=0x7f84c81a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84c7fff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84c8109660 0x7f84c81a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84c7fff700 1 -- 172.21.15.12:0/1994838843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c8107ad0 msgr2=0x7f84c819da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84c7fff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c8107ad0 0x7f84c819da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84c7fff700 1 -- 172.21.15.12:0/1994838843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0095f0 con 0x7f84c8108cc0 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c8107ad0 0x7f84c819da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84c7fff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c8108cc0 0x7f84c819df50 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f84b800b450 tx=0x7f84b800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84c5ffb700 1 -- 172.21.15.12:0/1994838843 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011830 con 0x7f84c8108cc0 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.009+0000 7f84cefff700 1 -- 172.21.15.12:0/1994838843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c81a5af0 con 0x7f84c8108cc0 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.010+0000 7f84c5ffb700 1 -- 172.21.15.12:0/1994838843 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84b800be60 con 0x7f84c8108cc0 2023-12-11T20:34:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.010+0000 7f84c5ffb700 1 -- 172.21.15.12:0/1994838843 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011830 con 0x7f84c8108cc0 2023-12-11T20:34:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.010+0000 7f84cefff700 1 -- 172.21.15.12:0/1994838843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c81a6050 con 0x7f84c8108cc0 2023-12-11T20:34:19.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.019+0000 7f84c5ffb700 1 -- 172.21.15.12:0/1994838843 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f84b8010ae0 con 0x7f84c8108cc0 2023-12-11T20:34:19.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.020+0000 7f84e28b5b80 1 Processor -- start 2023-12-11T20:34:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.021+0000 7f84e28b5b80 1 -- start start 2023-12-11T20:34:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.021+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a2f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.021+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f4d30 0x55b05a2f5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.021+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a2f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.021+0000 7f84e28b5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a24fb50 con 0x55b05a2f5c20 2023-12-11T20:34:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.021+0000 7f84e28b5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a24d470 con 0x55b05a2f4d30 2023-12-11T20:34:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.021+0000 7f84e28b5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a248d60 con 0x55b05a2f43d0 2023-12-11T20:34:19.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.022+0000 7f84cd59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a2f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84cd59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a2f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49968/0 (socket says 172.21.15.12:49968) 2023-12-11T20:34:19.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84cd59c700 1 -- 172.21.15.12:0/2348829548 learned_addr learned my addr 172.21.15.12:0/2348829548 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f4d30 0x55b05a2f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a2f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84cd59c700 1 -- 172.21.15.12:0/2348829548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f4d30 msgr2=0x55b05a2f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f4d30 0x55b05a2f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84cd59c700 1 -- 172.21.15.12:0/2348829548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 msgr2=0x55b05a2f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a2f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84cd59c700 1 -- 172.21.15.12:0/2348829548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b05a0c5630 con 0x55b05a2f43d0 2023-12-11T20:34:19.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.023+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a2f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:19.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.024+0000 7f84c5ffb700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f84b00a15e0 0x7f84b00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.025+0000 7f84c5ffb700 1 -- 172.21.15.12:0/1994838843 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f84b80cc310 con 0x7f84c8108cc0 2023-12-11T20:34:19.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.025+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a2f47f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f84c0007500 tx=0x7f84c0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d73587d099feafe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.025+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f84b00a15e0 0x7f84b00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.025+0000 7f84aeffd700 1 -- 172.21.15.12:0/2348829548 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00147f0 con 0x55b05a2f43d0 2023-12-11T20:34:19.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.026+0000 7f84aeffd700 1 -- 172.21.15.12:0/2348829548 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84c000f040 con 0x55b05a2f43d0 2023-12-11T20:34:19.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.026+0000 7f84aeffd700 1 -- 172.21.15.12:0/2348829548 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0015c60 con 0x55b05a2f43d0 2023-12-11T20:34:19.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.027+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2348829548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 msgr2=0x55b05a2f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.027+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f84b00a15e0 0x7f84b00a3aa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f84bc004360 tx=0x7f84bc0058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.027+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a2f47f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f84c0007500 tx=0x7f84c0009920 comp rx=0 tx=0).stop 2023-12-11T20:34:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.027+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2348829548 shutdown_connections 2023-12-11T20:34:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.027+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a2f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.027+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a2f47f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.027+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2348829548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f4d30 0x55b05a2f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.027+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2348829548 >> 172.21.15.12:0/2348829548 conn(0x55b05a2237e0 msgr2=0x55b05a2f0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.028+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2348829548 shutdown_connections 2023-12-11T20:34:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.028+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2348829548 wait complete. 2023-12-11T20:34:19.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.030+0000 7f84e28b5b80 1 -- start start 2023-12-11T20:34:19.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.030+0000 7f84e28b5b80 1 Processor -- start 2023-12-11T20:34:19.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.033+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a30f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.033+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f4d30 0x55b05a30f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f5c20 0x55b05a316790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84ccd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a30f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84ccd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a30f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49976/0 (socket says 172.21.15.12:49976) 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84ccd9b700 1 -- 172.21.15.12:0/2332372802 learned_addr learned my addr 172.21.15.12:0/2332372802 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a202560 con 0x55b05a2f4d30 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a202200 con 0x55b05a2f5c20 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a0c7920 con 0x55b05a2f43d0 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f4d30 0x55b05a30f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84e28b5b80 10 client.0 _ll_register_callbacks cb 0x55b05a12da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.034+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f5c20 0x55b05a316790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.035+0000 7f84c7fff700 1 -- 172.21.15.12:0/2332372802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 msgr2=0x55b05a30f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.035+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a30f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.035+0000 7f84c7fff700 1 -- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f5c20 msgr2=0x55b05a316790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.035+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f5c20 0x55b05a316790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.035+0000 7f84c7fff700 1 -- 172.21.15.12:0/2332372802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c0009260 con 0x55b05a2f4d30 2023-12-11T20:34:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.035+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f5c20 0x55b05a316790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:19.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.038+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f4d30 0x55b05a30f750 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x55b05a2f5400 tx=0x7f84b80991f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6162d7a0baeb2208 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.038+0000 7f84a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:34:19.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.039+0000 7f84a7fff700 1 -- 172.21.15.12:0/2332372802 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8099580 con 0x55b05a2f4d30 2023-12-11T20:34:19.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.039+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b05a2e7b40 con 0x55b05a2f4d30 2023-12-11T20:34:19.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.040+0000 7f84a7fff700 1 -- 172.21.15.12:0/2332372802 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f84b809d6d0 con 0x55b05a2f4d30 2023-12-11T20:34:19.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.041+0000 7f84a7fff700 1 -- 172.21.15.12:0/2332372802 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84b80a1910 con 0x55b05a2f4d30 2023-12-11T20:34:19.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.041+0000 7f84e28b5b80 10 client.20520 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:19.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.041+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55b05a071de0 con 0x55b05a2f4d30 2023-12-11T20:34:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.042+0000 7f84a7fff700 1 -- 172.21.15.12:0/2332372802 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b05a2e7b40 con 0x55b05a2f4d30 2023-12-11T20:34:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.042+0000 7f84a7fff700 1 -- 172.21.15.12:0/2332372802 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f84b8098a70 con 0x55b05a2f4d30 2023-12-11T20:34:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.042+0000 7f84e28b5b80 10 client.20520 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.042+0000 7f84e28b5b80 10 client.20520 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.042+0000 7f84e28b5b80 20 client.20520 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.042+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b05a31af40 0x55b05a31d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.042+0000 7f84e28b5b80 4 client.20520 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.042+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b05a2c3f40 con 0x55b05a31af40 2023-12-11T20:34:19.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.045+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b05a31af40 0x55b05a31d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.047+0000 7f84a7fff700 10 client.20520 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.047+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b05a31af40 0x55b05a31d360 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d1a28d16c73b29f server_cookie=2f7c0bb533d9b553 in_seq=0 out_seq=0 2023-12-11T20:34:19.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.048+0000 7f84a7fff700 1 -- 172.21.15.12:0/2332372802 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b05a2c3f40 con 0x55b05a31af40 2023-12-11T20:34:19.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.048+0000 7f84a7fff700 10 client.20520 handle_command_reply: tid=0 2023-12-11T20:34:19.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.048+0000 7f84e28b5b80 1 client.20520 shutdown 2023-12-11T20:34:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f4d30 msgr2=0x55b05a30f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f4d30 0x55b05a30f750 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x55b05a2f5400 tx=0x7f84b80991f0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 shutdown_connections 2023-12-11T20:34:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b05a31af40 0x55b05a31d360 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f5c20 0x55b05a316790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a30f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2332372802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f4d30 0x55b05a30f750 secure :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x55b05a2f5400 tx=0x7f84b80991f0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 >> 172.21.15.12:0/2332372802 conn(0x55b05a2237e0 msgr2=0x55b05a2efa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.049+0000 7f84a7fff700 0 client.20520 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.050+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 shutdown_connections 2023-12-11T20:34:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.050+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2332372802 wait complete. 2023-12-11T20:34:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.051+0000 7f84e28b5b80 20 client.20520 trim_cache size 0 max 16384 2023-12-11T20:34:19.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:18 smithi012 ceph-mon[128787]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.83k op/s 2023-12-11T20:34:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.107+0000 7f84e28b5b80 1 Processor -- start 2023-12-11T20:34:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.110+0000 7f84e28b5b80 1 -- start start 2023-12-11T20:34:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.110+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f43d0 0x55b05a30e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.110+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f5c20 0x55b05a30ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.110+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a316750 0x55b05a30f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.111+0000 7f84e28b5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a2ebb50 con 0x55b05a316750 2023-12-11T20:34:19.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.111+0000 7f84e28b5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a2f3f70 con 0x55b05a2f43d0 2023-12-11T20:34:19.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.111+0000 7f84cd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a316750 0x55b05a30f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.113+0000 7f84cd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a316750 0x55b05a30f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43036/0 (socket says 172.21.15.12:43036) 2023-12-11T20:34:19.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.113+0000 7f84cd59c700 1 -- 172.21.15.12:0/2673413529 learned_addr learned my addr 172.21.15.12:0/2673413529 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.112+0000 7f84c7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f5c20 0x55b05a30ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.114+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2673413529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a322550 con 0x55b05a2f5c20 2023-12-11T20:34:19.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.111+0000 7f84ccd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f43d0 0x55b05a30e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.117+0000 7f84cd59c700 1 -- 172.21.15.12:0/2673413529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f5c20 msgr2=0x55b05a30ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.117+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f5c20 0x55b05a30ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.117+0000 7f84cd59c700 1 -- 172.21.15.12:0/2673413529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f43d0 msgr2=0x55b05a30e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.117+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f43d0 0x55b05a30e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.118+0000 7f84cd59c700 1 -- 172.21.15.12:0/2673413529 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b05a05ac60 con 0x55b05a316750 2023-12-11T20:34:19.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.118+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f5c20 0x55b05a30ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:19.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.119+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f43d0 0x55b05a30e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:19.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.119+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a316750 0x55b05a30f210 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f84c0007ec0 tx=0x7f84c0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcfe8210de2acc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.120+0000 7f84af7fe700 1 -- 172.21.15.12:0/2673413529 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0003c00 con 0x55b05a316750 2023-12-11T20:34:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.120+0000 7f84af7fe700 1 -- 172.21.15.12:0/2673413529 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84c0003d60 con 0x55b05a316750 2023-12-11T20:34:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.120+0000 7f84af7fe700 1 -- 172.21.15.12:0/2673413529 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00157f0 con 0x55b05a316750 2023-12-11T20:34:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2673413529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a316750 msgr2=0x55b05a30f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a316750 0x55b05a30f210 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f84c0007ec0 tx=0x7f84c0007ef0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2673413529 shutdown_connections 2023-12-11T20:34:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a2f43d0 0x55b05a30e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a316750 0x55b05a30f210 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2673413529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f5c20 0x55b05a30ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2673413529 >> 172.21.15.12:0/2673413529 conn(0x55b05a2237e0 msgr2=0x55b05a2fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2673413529 shutdown_connections 2023-12-11T20:34:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.121+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2673413529 wait complete. 2023-12-11T20:34:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.122+0000 7f84e28b5b80 1 -- start start 2023-12-11T20:34:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.123+0000 7f84e28b5b80 1 Processor -- start 2023-12-11T20:34:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.123+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a314190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.123+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a3146d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.123+0000 7f84e28b5b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a316750 0x55b05a315640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.123+0000 7f84e28b5b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a315b80 con 0x55b05a2f5c20 2023-12-11T20:34:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.123+0000 7f84e28b5b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a315cf0 con 0x55b05a316750 2023-12-11T20:34:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.123+0000 7f84e28b5b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b05a315eb0 con 0x55b05a2f43d0 2023-12-11T20:34:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.123+0000 7f84e28b5b80 10 client.0 _ll_register_callbacks cb 0x55b05a12da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84cd59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a316750 0x55b05a315640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84cd59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a316750 0x55b05a315640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37504/0 (socket says 172.21.15.12:37504) 2023-12-11T20:34:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84cd59c700 1 -- 172.21.15.12:0/2381655409 learned_addr learned my addr 172.21.15.12:0/2381655409 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a3146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a314190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84cd59c700 1 -- 172.21.15.12:0/2381655409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 msgr2=0x55b05a314190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a314190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84cd59c700 1 -- 172.21.15.12:0/2381655409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 msgr2=0x55b05a3146d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a3146d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.124+0000 7f84cd59c700 1 -- 172.21.15.12:0/2381655409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c8110860 con 0x55b05a316750 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.125+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a314190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.125+0000 7f84c7fff700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a3146d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.125+0000 7f84cd59c700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a316750 0x55b05a315640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f84c0007fd0 tx=0x7f84c0014820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f87e21f15fd83556 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.125+0000 7f84a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:34:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.125+0000 7f84a7fff700 1 -- 172.21.15.12:0/2381655409 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00156f0 con 0x55b05a316750 2023-12-11T20:34:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.126+0000 7f84a7fff700 1 -- 172.21.15.12:0/2381655409 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f84c0015850 con 0x55b05a316750 2023-12-11T20:34:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.126+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2381655409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84c000f040 con 0x55b05a316750 2023-12-11T20:34:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.126+0000 7f84a7fff700 1 -- 172.21.15.12:0/2381655409 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84c0014bd0 con 0x55b05a316750 2023-12-11T20:34:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.126+0000 7f84e28b5b80 10 client.30074 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.126+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2381655409 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55b05a071de0 con 0x55b05a316750 2023-12-11T20:34:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.127+0000 7f84a7fff700 1 -- 172.21.15.12:0/2381655409 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84c000f040 con 0x55b05a316750 2023-12-11T20:34:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.127+0000 7f84a7fff700 1 -- 172.21.15.12:0/2381655409 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f84c00056a0 con 0x55b05a316750 2023-12-11T20:34:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.127+0000 7f84e28b5b80 10 client.30074 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.127+0000 7f84e28b5b80 10 client.30074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.127+0000 7f84e28b5b80 20 client.30074 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.127+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b05a372040 0x55b05a374460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.127+0000 7f84e28b5b80 4 client.30074 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-12-11T20:34:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.127+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2381655409 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b05a20efd0 con 0x55b05a372040 2023-12-11T20:34:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.129+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b05a372040 0x55b05a374460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.131+0000 7f84ccd9b700 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b05a372040 0x55b05a374460 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c80248ac7bdca503 server_cookie=353c743b52f4c59b in_seq=0 out_seq=0 2023-12-11T20:34:19.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.131+0000 7f84a7fff700 10 client.30074 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:19.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.132+0000 7f84a7fff700 1 -- 172.21.15.12:0/2381655409 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b05a20efd0 con 0x55b05a372040 2023-12-11T20:34:19.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.132+0000 7f84a7fff700 10 client.30074 handle_command_reply: tid=0 2023-12-11T20:34:19.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.132+0000 7f84e28b5b80 1 client.30074 shutdown 2023-12-11T20:34:19.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.132+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2381655409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a316750 msgr2=0x55b05a315640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.132+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a316750 0x55b05a315640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f84c0007fd0 tx=0x7f84c0014820 comp rx=0 tx=0).stop 2023-12-11T20:34:19.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.134+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2381655409 shutdown_connections 2023-12-11T20:34:19.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.134+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b05a372040 0x55b05a374460 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.134+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b05a316750 0x55b05a315640 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.134+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b05a2f43d0 0x55b05a314190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.134+0000 7f84e28b5b80 1 --2- 172.21.15.12:0/2381655409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b05a2f5c20 0x55b05a3146d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.134+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2381655409 >> 172.21.15.12:0/2381655409 conn(0x55b05a2237e0 msgr2=0x55b05a2f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.135+0000 7f84a7fff700 0 client.30074 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:19.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.135+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2381655409 shutdown_connections 2023-12-11T20:34:19.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.135+0000 7f84e28b5b80 1 -- 172.21.15.12:0/2381655409 wait complete. 2023-12-11T20:34:19.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.136+0000 7f84e28b5b80 20 client.30074 trim_cache size 0 max 16384 2023-12-11T20:34:19.136 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:34:19.136 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2023-12-11T20:34:19.137 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2023-12-11T20:34:19.137 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.140+0000 7f84cefff700 1 -- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f84b00a15e0 msgr2=0x7f84b00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.140+0000 7f84cefff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f84b00a15e0 0x7f84b00a3aa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f84bc004360 tx=0x7f84bc0058e0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.140+0000 7f84cefff700 1 -- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c8108cc0 msgr2=0x7f84c819df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.140+0000 7f84cefff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c8108cc0 0x7f84c819df50 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f84b800b450 tx=0x7f84b800b760 comp rx=0 tx=0).stop 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.141+0000 7f84cefff700 1 -- 172.21.15.12:0/1994838843 shutdown_connections 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.141+0000 7f84cefff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f84b00a15e0 0x7f84b00a3aa0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.141+0000 7f84cefff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84c8107ad0 0x7f84c819da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.141+0000 7f84cefff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84c8109660 0x7f84c81a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.141+0000 7f84cefff700 1 --2- 172.21.15.12:0/1994838843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c8108cc0 0x7f84c819df50 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.141+0000 7f84cefff700 1 -- 172.21.15.12:0/1994838843 >> 172.21.15.12:0/1994838843 conn(0x7f84c8076a90 msgr2=0x7f84c810c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.142+0000 7f84cefff700 1 -- 172.21.15.12:0/1994838843 shutdown_connections 2023-12-11T20:34:19.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.142+0000 7f84cefff700 1 -- 172.21.15.12:0/1994838843 wait complete. 2023-12-11T20:34:19.179 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-11T20:34:19.180 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T20:34:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.211+0000 7fe6a45ff700 1 -- 172.21.15.12:0/1914154313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c0771d0 msgr2=0x7fe69c077650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.211+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/1914154313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c0771d0 0x7fe69c077650 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fe688009990 tx=0x7fe688009ca0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.212+0000 7fe6a45ff700 1 -- 172.21.15.12:0/1914154313 shutdown_connections 2023-12-11T20:34:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.212+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/1914154313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe69c075f90 0x7fe69c0763b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.212+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/1914154313 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c077b90 0x7fe69c078410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.212+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/1914154313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c0771d0 0x7fe69c077650 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.212+0000 7fe6a45ff700 1 -- 172.21.15.12:0/1914154313 >> 172.21.15.12:0/1914154313 conn(0x7fe69c0feca0 msgr2=0x7fe69c1010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.212+0000 7fe6a45ff700 1 -- 172.21.15.12:0/1914154313 shutdown_connections 2023-12-11T20:34:19.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.212+0000 7fe6a45ff700 1 -- 172.21.15.12:0/1914154313 wait complete. 2023-12-11T20:34:19.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:18 smithi032 ceph-mon[132488]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.83k op/s 2023-12-11T20:34:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.214+0000 7fe6a45ff700 1 Processor -- start 2023-12-11T20:34:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.214+0000 7fe6a45ff700 1 -- start start 2023-12-11T20:34:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.215+0000 7fe6a45ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c075f90 0x7fe69c19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.216+0000 7fe6a45ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c0771d0 0x7fe69c19df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.216+0000 7fe6a239b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c075f90 0x7fe69c19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.216+0000 7fe6a239b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c075f90 0x7fe69c19d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43070/0 (socket says 172.21.15.12:43070) 2023-12-11T20:34:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.216+0000 7fe6a1b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c0771d0 0x7fe69c19df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.216+0000 7fe6a1b9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c0771d0 0x7fe69c19df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50004/0 (socket says 172.21.15.12:50004) 2023-12-11T20:34:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.217+0000 7fe6a45ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe69c077b90 0x7fe69c1a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.217+0000 7fe6a45ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c1a54b0 con 0x7fe69c075f90 2023-12-11T20:34:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.217+0000 7fe6a45ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c1a55f0 con 0x7fe69c077b90 2023-12-11T20:34:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.217+0000 7fe6a45ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c1a5780 con 0x7fe69c0771d0 2023-12-11T20:34:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.217+0000 7fe6a239b700 1 -- 172.21.15.12:0/201259881 learned_addr learned my addr 172.21.15.12:0/201259881 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.217+0000 7fe6a2b9c700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe69c077b90 0x7fe69c1a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.218+0000 7fe6a2b9c700 1 -- 172.21.15.12:0/201259881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c0771d0 msgr2=0x7fe69c19df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.218+0000 7fe6a2b9c700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c0771d0 0x7fe69c19df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.218+0000 7fe6a2b9c700 1 -- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c075f90 msgr2=0x7fe69c19d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.218+0000 7fe6a2b9c700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c075f90 0x7fe69c19d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.218+0000 7fe6a2b9c700 1 -- 172.21.15.12:0/201259881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6880095f0 con 0x7fe69c077b90 2023-12-11T20:34:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.218+0000 7fe6a239b700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c075f90 0x7fe69c19d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.218+0000 7fe6a2b9c700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe69c077b90 0x7fe69c1a4ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe69400d720 tx=0x7fe69400da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.219+0000 7fe69b7fe700 1 -- 172.21.15.12:0/201259881 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694004220 con 0x7fe69c077b90 2023-12-11T20:34:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.219+0000 7fe6a45ff700 1 -- 172.21.15.12:0/201259881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c1a5a60 con 0x7fe69c077b90 2023-12-11T20:34:19.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.219+0000 7fe69b7fe700 1 -- 172.21.15.12:0/201259881 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe694004380 con 0x7fe69c077b90 2023-12-11T20:34:19.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.219+0000 7fe6a45ff700 1 -- 172.21.15.12:0/201259881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c1a5f70 con 0x7fe69c077b90 2023-12-11T20:34:19.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.219+0000 7fe69b7fe700 1 -- 172.21.15.12:0/201259881 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694003aa0 con 0x7fe69c077b90 2023-12-11T20:34:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.231+0000 7fe69b7fe700 1 -- 172.21.15.12:0/201259881 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe694003c00 con 0x7fe69c077b90 2023-12-11T20:34:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.233+0000 7fe6b7e3fb80 1 Processor -- start 2023-12-11T20:34:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.233+0000 7fe6b7e3fb80 1 -- start start 2023-12-11T20:34:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc8830 0x5617c1cc9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 0x5617c1cc9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1c23af0 con 0x5617c1cc8830 2023-12-11T20:34:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1c21410 con 0x5617c1cc7ed0 2023-12-11T20:34:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1c1cd00 con 0x5617c1cc9720 2023-12-11T20:34:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6a1b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6a1b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37538/0 (socket says 172.21.15.12:37538) 2023-12-11T20:34:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6a1b9a700 1 -- 172.21.15.12:0/2953552294 learned_addr learned my addr 172.21.15.12:0/2953552294 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.234+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 0x5617c1cc9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.235+0000 7fe6a239b700 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc8830 0x5617c1cc9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.236+0000 7fe6a239b700 1 -- 172.21.15.12:0/2953552294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 msgr2=0x5617c1cc9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.236+0000 7fe6a239b700 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 0x5617c1cc9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.236+0000 7fe6a239b700 1 -- 172.21.15.12:0/2953552294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 msgr2=0x5617c1cc82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.236+0000 7fe6a239b700 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.236+0000 7fe6a239b700 1 -- 172.21.15.12:0/2953552294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617c1a995d0 con 0x5617c1cc8830 2023-12-11T20:34:19.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.237+0000 7fe6a239b700 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc8830 0x5617c1cc9140 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fe690009430 tx=0x7fe690009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae6d8cae7aae8ed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.238+0000 7fe698bfe700 1 -- 172.21.15.12:0/2953552294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69000e900 con 0x5617c1cc8830 2023-12-11T20:34:19.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.238+0000 7fe698bfe700 1 -- 172.21.15.12:0/2953552294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe69000f040 con 0x5617c1cc8830 2023-12-11T20:34:19.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.238+0000 7fe698bfe700 1 -- 172.21.15.12:0/2953552294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690015c40 con 0x5617c1cc8830 2023-12-11T20:34:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.238+0000 7fe69b7fe700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe68c0a1570 0x7fe68c0a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.239+0000 7fe69b7fe700 1 -- 172.21.15.12:0/201259881 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe6940cc290 con 0x7fe69c077b90 2023-12-11T20:34:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.239+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2953552294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc8830 msgr2=0x5617c1cc9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.239+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc8830 0x5617c1cc9140 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fe690009430 tx=0x7fe690009920 comp rx=0 tx=0).stop 2023-12-11T20:34:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.240+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2953552294 shutdown_connections 2023-12-11T20:34:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.240+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.240+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 0x5617c1cc9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.240+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2953552294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc8830 0x5617c1cc9140 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.240+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2953552294 >> 172.21.15.12:0/2953552294 conn(0x5617c1bf7780 msgr2=0x5617c1cc4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.240+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe68c0a1570 0x7fe68c0a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.241+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2953552294 shutdown_connections 2023-12-11T20:34:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.241+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2953552294 wait complete. 2023-12-11T20:34:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.242+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe68c0a1570 0x7fe68c0a3a30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe688005cd0 tx=0x7fe68801a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.242+0000 7fe6b7e3fb80 1 -- start start 2023-12-11T20:34:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.243+0000 7fe6b7e3fb80 1 Processor -- start 2023-12-11T20:34:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.245+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.245+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc8830 0x5617c1cd2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.245+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 0x5617c1cd91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6a1b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc8830 0x5617c1cd2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6a1b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc8830 0x5617c1cd2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37550/0 (socket says 172.21.15.12:37550) 2023-12-11T20:34:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6a1b9a700 1 -- 172.21.15.12:0/3089181544 learned_addr learned my addr 172.21.15.12:0/3089181544 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1bd6500 con 0x5617c1cc7ed0 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1bd61a0 con 0x5617c1cc8830 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1a9b8c0 con 0x5617c1cc9720 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6a239b700 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6b7e3fb80 10 client.0 _ll_register_callbacks cb 0x5617c1b01a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.246+0000 7fe6a2b9c700 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 0x5617c1cd91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.247+0000 7fe6a239b700 1 -- 172.21.15.12:0/3089181544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 msgr2=0x5617c1cd91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.247+0000 7fe6a239b700 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 0x5617c1cd91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.247+0000 7fe6a239b700 1 -- 172.21.15.12:0/3089181544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc8830 msgr2=0x5617c1cd2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.247+0000 7fe6a239b700 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc8830 0x5617c1cd2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.247+0000 7fe6a239b700 1 -- 172.21.15.12:0/3089181544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe690009110 con 0x5617c1cc7ed0 2023-12-11T20:34:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.248+0000 7fe6a239b700 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd1e30 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fe690009c10 tx=0x7fe690015c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359f9a342c0c2afb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.248+0000 7fe685ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:34:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.251+0000 7fe685ffb700 1 -- 172.21.15.12:0/3089181544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690003c00 con 0x5617c1cc7ed0 2023-12-11T20:34:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.251+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617c1cbb730 con 0x5617c1cc7ed0 2023-12-11T20:34:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.251+0000 7fe685ffb700 1 -- 172.21.15.12:0/3089181544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe690003d60 con 0x5617c1cc7ed0 2023-12-11T20:34:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.252+0000 7fe685ffb700 1 -- 172.21.15.12:0/3089181544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe690003c00 con 0x5617c1cc7ed0 2023-12-11T20:34:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.252+0000 7fe6b7e3fb80 10 client.20538 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.252+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5617c1a45d80 con 0x5617c1cc7ed0 2023-12-11T20:34:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.253+0000 7fe685ffb700 1 -- 172.21.15.12:0/3089181544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5617c1cbb730 con 0x5617c1cc7ed0 2023-12-11T20:34:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.253+0000 7fe685ffb700 1 -- 172.21.15.12:0/3089181544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe690004470 con 0x5617c1cc7ed0 2023-12-11T20:34:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.254+0000 7fe6b7e3fb80 10 client.20538 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.255+0000 7fe6b7e3fb80 10 client.20538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.255+0000 7fe6b7e3fb80 20 client.20538 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.255+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5617c1cddbc0 0x5617c1cdffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.255+0000 7fe6b7e3fb80 4 client.20538 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.255+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617c1c97ee0 con 0x5617c1cddbc0 2023-12-11T20:34:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.255+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5617c1cddbc0 0x5617c1cdffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.258+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5617c1cddbc0 0x5617c1cdffe0 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121e8b575e226208 server_cookie=2dd068c663dc8f2c in_seq=0 out_seq=0 2023-12-11T20:34:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.258+0000 7fe685ffb700 10 client.20538 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.259+0000 7fe685ffb700 1 -- 172.21.15.12:0/3089181544 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5617c1c97ee0 con 0x5617c1cddbc0 2023-12-11T20:34:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.259+0000 7fe685ffb700 10 client.20538 handle_command_reply: tid=0 2023-12-11T20:34:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.259+0000 7fe6b7e3fb80 1 client.20538 shutdown 2023-12-11T20:34:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc7ed0 msgr2=0x5617c1cd1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd1e30 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fe690009c10 tx=0x7fe690015c10 comp rx=0 tx=0).stop 2023-12-11T20:34:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 shutdown_connections 2023-12-11T20:34:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5617c1cddbc0 0x5617c1cdffe0 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc9720 0x5617c1cd91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd1e30 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3089181544 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc8830 0x5617c1cd2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 >> 172.21.15.12:0/3089181544 conn(0x5617c1bf7780 msgr2=0x5617c1cc2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.261+0000 7fe685ffb700 0 client.20538 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.262+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 shutdown_connections 2023-12-11T20:34:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.263+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3089181544 wait complete. 2023-12-11T20:34:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.263+0000 7fe6b7e3fb80 20 client.20538 trim_cache size 0 max 16384 2023-12-11T20:34:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.301+0000 7fe6b7e3fb80 1 Processor -- start 2023-12-11T20:34:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.302+0000 7fe6b7e3fb80 1 -- start start 2023-12-11T20:34:19.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:18 smithi039 ceph-mon[102205]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.83k op/s 2023-12-11T20:34:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.302+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.304+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.304+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 0x5617c1cd1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.304+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1cbb700 con 0x5617c1cc9720 2023-12-11T20:34:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.304+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1cdd930 con 0x5617c1cc7ed0 2023-12-11T20:34:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.304+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1cd9e40 con 0x5617c1cc8830 2023-12-11T20:34:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.304+0000 7fe6a239b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.304+0000 7fe6a239b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37558/0 (socket says 172.21.15.12:37558) 2023-12-11T20:34:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.304+0000 7fe6a239b700 1 -- 172.21.15.12:0/3304956680 learned_addr learned my addr 172.21.15.12:0/3304956680 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.305+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/3304956680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.305+0000 7fe6a1b9a700 1 -- 172.21.15.12:0/3304956680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 msgr2=0x5617c1cc9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.305+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/3304956680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.305+0000 7fe6a1b9a700 1 -- 172.21.15.12:0/3304956680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 msgr2=0x5617c1cd1130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:34:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.305+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/3304956680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 0x5617c1cd1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.306+0000 7fe6a1b9a700 1 -- 172.21.15.12:0/3304956680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617c1a2ec00 con 0x5617c1cc8830 2023-12-11T20:34:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.306+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/3304956680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd9130 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x5617c1ce08c0 tx=0x7fe688009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f394afe37eff8b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.306+0000 7fe6993ff700 1 -- 172.21.15.12:0/3304956680 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800baa0 con 0x5617c1cc8830 2023-12-11T20:34:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.307+0000 7fe6993ff700 1 -- 172.21.15.12:0/3304956680 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe68800bc00 con 0x5617c1cc8830 2023-12-11T20:34:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.307+0000 7fe6993ff700 1 -- 172.21.15.12:0/3304956680 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800f550 con 0x5617c1cc8830 2023-12-11T20:34:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3304956680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 msgr2=0x5617c1cd9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3304956680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd9130 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x5617c1ce08c0 tx=0x7fe688009310 comp rx=0 tx=0).stop 2023-12-11T20:34:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3304956680 shutdown_connections 2023-12-11T20:34:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3304956680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cc9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3304956680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 0x5617c1cd1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/3304956680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd9130 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3304956680 >> 172.21.15.12:0/3304956680 conn(0x5617c1bf7780 msgr2=0x5617c1cc4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3304956680 shutdown_connections 2023-12-11T20:34:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.308+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/3304956680 wait complete. 2023-12-11T20:34:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.309+0000 7fe6b7e3fb80 1 -- start start 2023-12-11T20:34:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.309+0000 7fe6b7e3fb80 1 Processor -- start 2023-12-11T20:34:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.311+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.311+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.312+0000 7fe6b7e3fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 0x5617c1cd8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6a239b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1cd86d0 con 0x5617c1cc9720 2023-12-11T20:34:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1cd8840 con 0x5617c1cc7ed0 2023-12-11T20:34:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6b7e3fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617c1cd8a00 con 0x5617c1cc8830 2023-12-11T20:34:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6b7e3fb80 10 client.0 _ll_register_callbacks cb 0x5617c1b01a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6a239b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37562/0 (socket says 172.21.15.12:37562) 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6a239b700 1 -- 172.21.15.12:0/2168112464 learned_addr learned my addr 172.21.15.12:0/2168112464 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6a2b9c700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 0x5617c1cd8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.313+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.314+0000 7fe6a239b700 1 -- 172.21.15.12:0/2168112464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 msgr2=0x5617c1cd71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.314+0000 7fe6a239b700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.314+0000 7fe6a239b700 1 -- 172.21.15.12:0/2168112464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 msgr2=0x5617c1cd8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.314+0000 7fe6a239b700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 0x5617c1cd8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.314+0000 7fe6a239b700 1 -- 172.21.15.12:0/2168112464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe688020040 con 0x5617c1cc7ed0 2023-12-11T20:34:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.314+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.315+0000 7fe6a2b9c700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 0x5617c1cd8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.315+0000 7fe685ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:34:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.315+0000 7fe6a239b700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd6c90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe69001e470 tx=0x7fe690009730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d100d1a3d586ec48 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.316+0000 7fe685ffb700 1 -- 172.21.15.12:0/2168112464 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69001e4f0 con 0x5617c1cc7ed0 2023-12-11T20:34:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.316+0000 7fe685ffb700 1 -- 172.21.15.12:0/2168112464 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe69000eb20 con 0x5617c1cc7ed0 2023-12-11T20:34:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.316+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2168112464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe69000f040 con 0x5617c1cc7ed0 2023-12-11T20:34:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.317+0000 7fe685ffb700 1 -- 172.21.15.12:0/2168112464 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe69000ece0 con 0x5617c1cc7ed0 2023-12-11T20:34:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.317+0000 7fe6b7e3fb80 10 client.30092 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.317+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2168112464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5617c1a6c1f0 con 0x5617c1cc7ed0 2023-12-11T20:34:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.317+0000 7fe685ffb700 1 -- 172.21.15.12:0/2168112464 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe69000f040 con 0x5617c1cc7ed0 2023-12-11T20:34:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.317+0000 7fe685ffb700 1 -- 172.21.15.12:0/2168112464 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe69002f460 con 0x5617c1cc7ed0 2023-12-11T20:34:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.318+0000 7fe6b7e3fb80 10 client.30092 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.318+0000 7fe6b7e3fb80 10 client.30092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.318+0000 7fe6b7e3fb80 20 client.30092 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.318+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5617c1d34b40 0x5617c1d36f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.318+0000 7fe6b7e3fb80 4 client.30092 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:34:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.318+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2168112464 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5617c1be2f70 con 0x5617c1d34b40 2023-12-11T20:34:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.319+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5617c1d34b40 0x5617c1d36f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.320+0000 7fe6a1b9a700 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5617c1d34b40 0x5617c1d36f60 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd61e069d424f2af server_cookie=f549677d7730f084 in_seq=0 out_seq=0 2023-12-11T20:34:19.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.320+0000 7fe685ffb700 10 client.30092 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.350+0000 7fe685ffb700 1 -- 172.21.15.12:0/2168112464 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5617c1be2f70 con 0x5617c1d34b40 2023-12-11T20:34:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.350+0000 7fe685ffb700 10 client.30092 handle_command_reply: tid=0 2023-12-11T20:34:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.350+0000 7fe6b7e3fb80 1 client.30092 shutdown 2023-12-11T20:34:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.351+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2168112464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 msgr2=0x5617c1cd6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.351+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd6c90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe69001e470 tx=0x7fe690009730 comp rx=0 tx=0).stop 2023-12-11T20:34:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.351+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2168112464 shutdown_connections 2023-12-11T20:34:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.351+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5617c1d34b40 0x5617c1d36f60 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.351+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5617c1cc7ed0 0x5617c1cd6c90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.351+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617c1cc9720 0x5617c1cd8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.351+0000 7fe6b7e3fb80 1 --2- 172.21.15.12:0/2168112464 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5617c1cc8830 0x5617c1cd71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.352+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2168112464 >> 172.21.15.12:0/2168112464 conn(0x5617c1bf7780 msgr2=0x5617c1cd1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.352+0000 7fe685ffb700 0 client.30092 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.352+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2168112464 shutdown_connections 2023-12-11T20:34:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.352+0000 7fe6b7e3fb80 1 -- 172.21.15.12:0/2168112464 wait complete. 2023-12-11T20:34:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.353+0000 7fe6b7e3fb80 20 client.30092 trim_cache size 0 max 16384 2023-12-11T20:34:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:34:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:34:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:34:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:34:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 -- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe68c0a1570 msgr2=0x7fe68c0a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe68c0a1570 0x7fe68c0a3a30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe688005cd0 tx=0x7fe68801a040 comp rx=0 tx=0).stop 2023-12-11T20:34:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 -- 172.21.15.12:0/201259881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe69c077b90 msgr2=0x7fe69c1a4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe69c077b90 0x7fe69c1a4ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe69400d720 tx=0x7fe69400da30 comp rx=0 tx=0).stop 2023-12-11T20:34:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 -- 172.21.15.12:0/201259881 shutdown_connections 2023-12-11T20:34:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe68c0a1570 0x7fe68c0a3a30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe69c077b90 0x7fe69c1a4ee0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe69c075f90 0x7fe69c19d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 --2- 172.21.15.12:0/201259881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe69c0771d0 0x7fe69c19df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 -- 172.21.15.12:0/201259881 >> 172.21.15.12:0/201259881 conn(0x7fe69c0feca0 msgr2=0x7fe69c1007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 -- 172.21.15.12:0/201259881 shutdown_connections 2023-12-11T20:34:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:19.354+0000 7fe6a45ff700 1 -- 172.21.15.12:0/201259881 wait complete. 2023-12-11T20:34:19.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.583+0000 7f3fbf7fe700 1 --2- 172.21.15.12:0/2793605837 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc00ffd80 0x7f3fc01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:19.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.584+0000 7f3fc5dff700 1 -- 172.21.15.12:0/2793605837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fc01026f0 msgr2=0x7f3fc0104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.584+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/2793605837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fc01026f0 0x7f3fc0104b80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009990 tx=0x7f3fb4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.584+0000 7f3fc5dff700 1 -- 172.21.15.12:0/2793605837 shutdown_connections 2023-12-11T20:34:19.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.584+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/2793605837 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc00ffd80 0x7f3fc01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.584+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/2793605837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc01050c0 0x7f3fc0105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.584+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/2793605837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fc01026f0 0x7f3fc0104b80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.584+0000 7f3fc5dff700 1 -- 172.21.15.12:0/2793605837 >> 172.21.15.12:0/2793605837 conn(0x7f3fc00fb980 msgr2=0x7f3fc00fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:19.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.585+0000 7f3fc5dff700 1 -- 172.21.15.12:0/2793605837 shutdown_connections 2023-12-11T20:34:19.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.585+0000 7f3fc5dff700 1 -- 172.21.15.12:0/2793605837 wait complete. 2023-12-11T20:34:19.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.587+0000 7f3fc5dff700 1 Processor -- start 2023-12-11T20:34:19.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.587+0000 7f3fc5dff700 1 -- start start 2023-12-11T20:34:19.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.587+0000 7f3fc5dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc00ffd80 0x7f3fc019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.587+0000 7f3fc5dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc01026f0 0x7f3fc019de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.587+0000 7f3fc5dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fc01050c0 0x7f3fc01a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.587+0000 7f3fc5dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc01a5410 con 0x7f3fc00ffd80 2023-12-11T20:34:19.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.587+0000 7f3fc5dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc01a5550 con 0x7f3fc01026f0 2023-12-11T20:34:19.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.587+0000 7f3fc5dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc01a56e0 con 0x7f3fc01050c0 2023-12-11T20:34:19.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.588+0000 7f3fbeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc01026f0 0x7f3fc019de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.588+0000 7f3fbeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc01026f0 0x7f3fc019de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37592/0 (socket says 172.21.15.12:37592) 2023-12-11T20:34:19.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.588+0000 7f3fbeffd700 1 -- 172.21.15.12:0/564945445 learned_addr learned my addr 172.21.15.12:0/564945445 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:19.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.588+0000 7f3fbffff700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fc01050c0 0x7f3fc01a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.588+0000 7f3fbf7fe700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc00ffd80 0x7f3fc019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.589+0000 7f3fbeffd700 1 -- 172.21.15.12:0/564945445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fc01050c0 msgr2=0x7f3fc01a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.589+0000 7f3fbeffd700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fc01050c0 0x7f3fc01a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.589+0000 7f3fbeffd700 1 -- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc00ffd80 msgr2=0x7f3fc019d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:19.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.589+0000 7f3fbeffd700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc00ffd80 0x7f3fc019d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:19.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.589+0000 7f3fbeffd700 1 -- 172.21.15.12:0/564945445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40095f0 con 0x7f3fc01026f0 2023-12-11T20:34:19.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.589+0000 7f3fbf7fe700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc00ffd80 0x7f3fc019d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:19.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.589+0000 7f3fbeffd700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc01026f0 0x7f3fc019de20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40098e0 tx=0x7f3fb4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.589+0000 7f3fbcff9700 1 -- 172.21.15.12:0/564945445 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb401d070 con 0x7f3fc01026f0 2023-12-11T20:34:19.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.590+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc01a5960 con 0x7f3fc01026f0 2023-12-11T20:34:19.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.590+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc01a5e60 con 0x7f3fc01026f0 2023-12-11T20:34:19.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.590+0000 7f3fbcff9700 1 -- 172.21.15.12:0/564945445 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fb4004060 con 0x7f3fc01026f0 2023-12-11T20:34:19.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.590+0000 7f3fbcff9700 1 -- 172.21.15.12:0/564945445 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400fde0 con 0x7f3fc01026f0 2023-12-11T20:34:19.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.593+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac005320 con 0x7f3fc01026f0 2023-12-11T20:34:19.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.593+0000 7f3fbcff9700 1 -- 172.21.15.12:0/564945445 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f3fb402b440 con 0x7f3fc01026f0 2023-12-11T20:34:19.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.595+0000 7f3fbcff9700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3fa80a1550 0x7f3fa80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:19.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.595+0000 7f3fbcff9700 1 -- 172.21.15.12:0/564945445 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3fb40cdd60 con 0x7f3fc01026f0 2023-12-11T20:34:19.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.595+0000 7f3fbf7fe700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3fa80a1550 0x7f3fa80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:19.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.596+0000 7f3fbf7fe700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3fa80a1550 0x7f3fa80a3a10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000afd0 tx=0x7f3fb000a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:19.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:19.600+0000 7f3fbcff9700 1 -- 172.21.15.12:0/564945445 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3fb4098180 con 0x7f3fc01026f0 2023-12-11T20:34:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.097+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fac005b50 con 0x7f3fc01026f0 2023-12-11T20:34:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.098+0000 7f3fbcff9700 1 -- 172.21.15.12:0/564945445 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+11311 (secure 0 0 0) 0x7f3fb409b7a0 con 0x7f3fc01026f0 2023-12-11T20:34:20.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:34:20.099 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14607,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1084131113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1084131113},{"type":"v1","addr":"172.21.15.12:6835","nonce":1084131113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1410309441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":1410309441},{"type":"v1","addr":"172.21.15.12:6837","nonce":1410309441}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/3831802568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":3831802568},{"type":"v1","addr":"172.21.15.12:6839","nonce":3831802568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14715,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/3948008588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":3948008588},{"type":"v1","addr":"172.21.15.12:6841","nonce":3948008588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3471280196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3471280196},{"type":"v1","addr":"172.21.15.39:6833","nonce":3471280196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2096200170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2096200170},{"type":"v1","addr":"172.21.15.32:6833","nonce":2096200170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-11T20:13:53.009335+0000","modified":"2023-12-11T20:33:52.596883+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24620,"mds_1":24577,"mds_2":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.32:6835/1999108930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1999108930},{"type":"v1","addr":"172.21.15.32:6835","nonce":1999108930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6835/2029236451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2029236451},{"type":"v1","addr":"172.21.15.39:6835","nonce":2029236451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2148366648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2148366648},{"type":"v1","addr":"172.21.15.39:6837","nonce":2148366648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.32:6837/173395142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":173395142},{"type":"v1","addr":"172.21.15.32:6837","nonce":173395142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":305,"addr":"172.21.15.39:6839/2020485308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":2020485308},{"type":"v1","addr":"172.21.15.39:6839","nonce":2020485308}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24620":{"gid":24620,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6839/3894896449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6838","nonce":3894896449},{"type":"v1","addr":"172.21.15.32:6839","nonce":3894896449}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T20:34:20.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3fa80a1550 msgr2=0x7f3fa80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3fa80a1550 0x7f3fa80a3a10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000afd0 tx=0x7f3fb000a380 comp rx=0 tx=0).stop 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc01026f0 msgr2=0x7f3fc019de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc01026f0 0x7f3fc019de20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40098e0 tx=0x7f3fb4005740 comp rx=0 tx=0).stop 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 shutdown_connections 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f3fa80a1550 0x7f3fa80a3a10 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3fc01050c0 0x7f3fc01a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fc00ffd80 0x7f3fc019d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 --2- 172.21.15.12:0/564945445 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc01026f0 0x7f3fc019de20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 >> 172.21.15.12:0/564945445 conn(0x7f3fc00fb980 msgr2=0x7f3fc0100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.103+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 shutdown_connections 2023-12-11T20:34:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.104+0000 7f3fc5dff700 1 -- 172.21.15.12:0/564945445 wait complete. 2023-12-11T20:34:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 39 2023-12-11T20:34:20.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-11T20:34:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.542+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/2693503806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 msgr2=0x7fdf84106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.542+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/2693503806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 0x7fdf84106ca0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009990 tx=0x7fdf74009ca0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.542+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/2693503806 shutdown_connections 2023-12-11T20:34:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.542+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/2693503806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84101f80 0x7fdf84104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.542+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/2693503806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf841071e0 0x7fdf84109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.542+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/2693503806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 0x7fdf84106ca0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.543+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/2693503806 >> 172.21.15.12:0/2693503806 conn(0x7fdf840fb930 msgr2=0x7fdf840fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.543+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/2693503806 shutdown_connections 2023-12-11T20:34:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.543+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/2693503806 wait complete. 2023-12-11T20:34:20.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.544+0000 7fdf8c3ff700 1 Processor -- start 2023-12-11T20:34:20.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.544+0000 7fdf8c3ff700 1 -- start start 2023-12-11T20:34:20.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8c3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84101f80 0x7fdf841972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8c3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 0x7fdf84197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8c3ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf841071e0 0x7fdf8419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8c3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8419ee20 con 0x7fdf841048b0 2023-12-11T20:34:20.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8c3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8406aff0 con 0x7fdf84101f80 2023-12-11T20:34:20.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8c3ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8406b180 con 0x7fdf841071e0 2023-12-11T20:34:20.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8999a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 0x7fdf84197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8999a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 0x7fdf84197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43144/0 (socket says 172.21.15.12:43144) 2023-12-11T20:34:20.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.545+0000 7fdf8999a700 1 -- 172.21.15.12:0/1310233580 learned_addr learned my addr 172.21.15.12:0/1310233580 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:20.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.546+0000 7fdf8a99c700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf841071e0 0x7fdf8419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.546+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84101f80 0x7fdf841972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.546+0000 7fdf8999a700 1 -- 172.21.15.12:0/1310233580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf841071e0 msgr2=0x7fdf8419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.546+0000 7fdf8999a700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf841071e0 0x7fdf8419e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.546+0000 7fdf8999a700 1 -- 172.21.15.12:0/1310233580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84101f80 msgr2=0x7fdf841972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.546+0000 7fdf8999a700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84101f80 0x7fdf841972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.546+0000 7fdf8999a700 1 -- 172.21.15.12:0/1310233580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740095f0 con 0x7fdf841048b0 2023-12-11T20:34:20.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.547+0000 7fdf8999a700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 0x7fdf84197830 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fdf74005740 tx=0x7fdf74005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:20.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.548+0000 7fdf7b7fe700 1 -- 172.21.15.12:0/1310233580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7401d070 con 0x7fdf841048b0 2023-12-11T20:34:20.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.548+0000 7fdf7b7fe700 1 -- 172.21.15.12:0/1310233580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf74004060 con 0x7fdf841048b0 2023-12-11T20:34:20.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.548+0000 7fdf7b7fe700 1 -- 172.21.15.12:0/1310233580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400fd50 con 0x7fdf841048b0 2023-12-11T20:34:20.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.548+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/1310233580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8406b400 con 0x7fdf841048b0 2023-12-11T20:34:20.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.549+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/1310233580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8406b860 con 0x7fdf841048b0 2023-12-11T20:34:20.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.553+0000 7fdf7b7fe700 1 -- 172.21.15.12:0/1310233580 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fdf7400f460 con 0x7fdf841048b0 2023-12-11T20:34:20.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.556+0000 7fdf9fcadb80 1 Processor -- start 2023-12-11T20:34:20.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.556+0000 7fdf7b7fe700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdf700a1500 0x7fdf700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.557+0000 7fdf8a99c700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdf700a1500 0x7fdf700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.558+0000 7fdf7b7fe700 1 -- 172.21.15.12:0/1310233580 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf740cdbe0 con 0x7fdf841048b0 2023-12-11T20:34:20.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.558+0000 7fdf9fcadb80 1 -- start start 2023-12-11T20:34:20.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.558+0000 7fdf8a99c700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdf700a1500 0x7fdf700a39c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c006130 tx=0x7fdf7c009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:20.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc5a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc5b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 0x55f24cc5c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cbb5b50 con 0x55f24cc5bc20 2023-12-11T20:34:20.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cbb3470 con 0x55f24cc5a3d0 2023-12-11T20:34:20.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cbaed60 con 0x55f24cc5ad30 2023-12-11T20:34:20.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf8a19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc5a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf8a19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc5a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37606/0 (socket says 172.21.15.12:37606) 2023-12-11T20:34:20.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf8a19b700 1 -- 172.21.15.12:0/508013874 learned_addr learned my addr 172.21.15.12:0/508013874 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:20.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.559+0000 7fdf8999a700 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc5b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.560+0000 7fdf8a99c700 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 0x55f24cc5c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.560+0000 7fdf8a19b700 1 -- 172.21.15.12:0/508013874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 msgr2=0x55f24cc5b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:20.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.560+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc5b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.560+0000 7fdf8a19b700 1 -- 172.21.15.12:0/508013874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 msgr2=0x55f24cc5c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:20.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.560+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 0x55f24cc5c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.560+0000 7fdf8a19b700 1 -- 172.21.15.12:0/508013874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f24ca2b630 con 0x55f24cc5a3d0 2023-12-11T20:34:20.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.560+0000 7fdf8a99c700 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 0x55f24cc5c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:34:20.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.561+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc5a7f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000bcd0 tx=0x7fdf8000f360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3499ca6de7436e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:20.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.561+0000 7fdf78bfe700 1 -- 172.21.15.12:0/508013874 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000fbd0 con 0x55f24cc5a3d0 2023-12-11T20:34:20.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.561+0000 7fdf78bfe700 1 -- 172.21.15.12:0/508013874 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf80018070 con 0x55f24cc5a3d0 2023-12-11T20:34:20.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.562+0000 7fdf78bfe700 1 -- 172.21.15.12:0/508013874 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80014c00 con 0x55f24cc5a3d0 2023-12-11T20:34:20.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.562+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/508013874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 msgr2=0x55f24cc5a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.562+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc5a7f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000bcd0 tx=0x7fdf8000f360 comp rx=0 tx=0).stop 2023-12-11T20:34:20.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.562+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/508013874 shutdown_connections 2023-12-11T20:34:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.562+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc5a7f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.562+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 0x55f24cc5c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.562+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/508013874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc5b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.562+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/508013874 >> 172.21.15.12:0/508013874 conn(0x55f24cb897e0 msgr2=0x55f24cc56d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.563+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/508013874 shutdown_connections 2023-12-11T20:34:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.563+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/508013874 wait complete. 2023-12-11T20:34:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.563+0000 7fdf9fcadb80 1 -- start start 2023-12-11T20:34:20.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.566+0000 7fdf9fcadb80 1 Processor -- start 2023-12-11T20:34:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5a3d0 0x55f24cc64260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5ad30 0x55f24cc647a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5bc20 0x55f24cc6b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cb68560 con 0x55f24cc5ad30 2023-12-11T20:34:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cb68200 con 0x55f24cc5bc20 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24ca2d920 con 0x55f24cc5a3d0 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf9fcadb80 10 client.0 _ll_register_callbacks cb 0x55f24ca93a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf8999a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5ad30 0x55f24cc647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf8a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5a3d0 0x55f24cc64260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf8a19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5a3d0 0x55f24cc64260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50118/0 (socket says 172.21.15.12:50118) 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.567+0000 7fdf8a19b700 1 -- 172.21.15.12:0/2979126321 learned_addr learned my addr 172.21.15.12:0/2979126321 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.568+0000 7fdf8999a700 1 -- 172.21.15.12:0/2979126321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5a3d0 msgr2=0x55f24cc64260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.568+0000 7fdf8999a700 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5a3d0 0x55f24cc64260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.568+0000 7fdf8999a700 1 -- 172.21.15.12:0/2979126321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5bc20 msgr2=0x55f24cc6b7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.568+0000 7fdf8999a700 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5bc20 0x55f24cc6b7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.568+0000 7fdf8999a700 1 -- 172.21.15.12:0/2979126321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8000b900 con 0x55f24cc5ad30 2023-12-11T20:34:20.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.571+0000 7fdf8999a700 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5ad30 0x55f24cc647a0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c010 tx=0x7fdf74004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce3e043f5a1fef1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:20.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.571+0000 7fdf6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:34:20.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.571+0000 7fdf6dffb700 1 -- 172.21.15.12:0/2979126321 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf740b2070 con 0x55f24cc5ad30 2023-12-11T20:34:20.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.572+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2979126321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f24cc4db40 con 0x55f24cc5ad30 2023-12-11T20:34:20.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.572+0000 7fdf6dffb700 1 -- 172.21.15.12:0/2979126321 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf7409af40 con 0x55f24cc5ad30 2023-12-11T20:34:20.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.572+0000 7fdf6dffb700 1 -- 172.21.15.12:0/2979126321 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf740b9170 con 0x55f24cc5ad30 2023-12-11T20:34:20.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.572+0000 7fdf9fcadb80 10 client.20556 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:20.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.572+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2979126321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f24c9d7de0 con 0x55f24cc5ad30 2023-12-11T20:34:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.573+0000 7fdf6dffb700 1 -- 172.21.15.12:0/2979126321 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf74064080 con 0x55f24cc5ad30 2023-12-11T20:34:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.573+0000 7fdf6dffb700 1 -- 172.21.15.12:0/2979126321 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fdf740a2db0 con 0x55f24cc5ad30 2023-12-11T20:34:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.573+0000 7fdf9fcadb80 10 client.20556 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.573+0000 7fdf9fcadb80 10 client.20556 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:34:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.573+0000 7fdf9fcadb80 20 client.20556 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.573+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f24cc6fc40 0x55f24cc72030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.573+0000 7fdf9fcadb80 4 client.20556 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.573+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2979126321 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f24cc29f40 con 0x55f24cc6fc40 2023-12-11T20:34:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.574+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f24cc6fc40 0x55f24cc72030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.575+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f24cc6fc40 0x55f24cc72030 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa387d541c78f213 server_cookie=54b4ec33912bfedf in_seq=0 out_seq=0 2023-12-11T20:34:20.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.575+0000 7fdf6dffb700 10 client.20556 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:34:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.576+0000 7fdf6dffb700 1 -- 172.21.15.12:0/2979126321 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f24cc29f40 con 0x55f24cc6fc40 2023-12-11T20:34:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.576+0000 7fdf6dffb700 10 client.20556 handle_command_reply: tid=0 2023-12-11T20:34:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.576+0000 7fdf9fcadb80 1 client.20556 shutdown 2023-12-11T20:34:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.576+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2979126321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5ad30 msgr2=0x55f24cc647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.576+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5ad30 0x55f24cc647a0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c010 tx=0x7fdf74004250 comp rx=0 tx=0).stop 2023-12-11T20:34:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2979126321 shutdown_connections 2023-12-11T20:34:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f24cc6fc40 0x55f24cc72030 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf6dffb700 0 client.20556 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:34:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5bc20 0x55f24cc6b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5a3d0 0x55f24cc64260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2979126321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5ad30 0x55f24cc647a0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2979126321 >> 172.21.15.12:0/2979126321 conn(0x55f24cb897e0 msgr2=0x55f24cc55a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2979126321 shutdown_connections 2023-12-11T20:34:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.577+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2979126321 wait complete. 2023-12-11T20:34:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.578+0000 7fdf9fcadb80 20 client.20556 trim_cache size 0 max 16384 2023-12-11T20:34:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.606+0000 7fdf9fcadb80 1 Processor -- start 2023-12-11T20:34:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf9fcadb80 1 -- start start 2023-12-11T20:34:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc63770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 0x55f24cc5c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc5b430 con 0x55f24cc5bc20 2023-12-11T20:34:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc61e40 con 0x55f24cc5a3d0 2023-12-11T20:34:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc6c250 con 0x55f24cc5ad30 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf8a19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc63770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf8a19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc63770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37620/0 (socket says 172.21.15.12:37620) 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.607+0000 7fdf8a19b700 1 -- 172.21.15.12:0/2039123110 learned_addr learned my addr 172.21.15.12:0/2039123110 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.608+0000 7fdf8999a700 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.608+0000 7fdf8a19b700 1 -- 172.21.15.12:0/2039123110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 msgr2=0x55f24cc6b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.608+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.608+0000 7fdf8a19b700 1 -- 172.21.15.12:0/2039123110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 msgr2=0x55f24cc5c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.608+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 0x55f24cc5c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.608+0000 7fdf8a19b700 1 -- 172.21.15.12:0/2039123110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f24c9c0c60 con 0x55f24cc5a3d0 2023-12-11T20:34:20.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.608+0000 7fdf8999a700 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:34:20.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.609+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc63770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdf80005d90 tx=0x7fdf80005ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3455c34f03e189 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:20.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.609+0000 7fdf793ff700 1 -- 172.21.15.12:0/2039123110 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80023040 con 0x55f24cc5a3d0 2023-12-11T20:34:20.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.610+0000 7fdf793ff700 1 -- 172.21.15.12:0/2039123110 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf80024040 con 0x55f24cc5a3d0 2023-12-11T20:34:20.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.610+0000 7fdf793ff700 1 -- 172.21.15.12:0/2039123110 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80004fc0 con 0x55f24cc5a3d0 2023-12-11T20:34:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.611+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2039123110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 msgr2=0x55f24cc63770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.611+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc63770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdf80005d90 tx=0x7fdf80005ce0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.611+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2039123110 shutdown_connections 2023-12-11T20:34:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.611+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5a3d0 0x55f24cc63770 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.611+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5bc20 0x55f24cc5c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.611+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/2039123110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.611+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2039123110 >> 172.21.15.12:0/2039123110 conn(0x55f24cb897e0 msgr2=0x55f24cc5ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:20.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.612+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2039123110 shutdown_connections 2023-12-11T20:34:20.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.612+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/2039123110 wait complete. 2023-12-11T20:34:20.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.612+0000 7fdf9fcadb80 1 -- start start 2023-12-11T20:34:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.613+0000 7fdf9fcadb80 1 Processor -- start 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5a3d0 0x55f24cc6b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf9fcadb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5bc20 0x55f24cc69890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc69ff0 con 0x55f24cc5a3d0 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc6a160 con 0x55f24cc5bc20 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf9fcadb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc6a320 con 0x55f24cc5ad30 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf9fcadb80 10 client.0 _ll_register_callbacks cb 0x55f24ca93a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf8a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5a3d0 0x55f24cc6b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.614+0000 7fdf8a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5a3d0 0x55f24cc6b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43170/0 (socket says 172.21.15.12:43170) 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.615+0000 7fdf8a19b700 1 -- 172.21.15.12:0/510351486 learned_addr learned my addr 172.21.15.12:0/510351486 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:20.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.615+0000 7fdf8999a700 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.616+0000 7fdf8a19b700 1 -- 172.21.15.12:0/510351486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 msgr2=0x55f24cc6b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:20.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.616+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.616+0000 7fdf8a19b700 1 -- 172.21.15.12:0/510351486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5bc20 msgr2=0x55f24cc69890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:34:20.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.616+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5bc20 0x55f24cc69890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.616+0000 7fdf8a19b700 1 -- 172.21.15.12:0/510351486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f24ca2b630 con 0x55f24cc5a3d0 2023-12-11T20:34:20.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.617+0000 7fdf8a19b700 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5a3d0 0x55f24cc6b1b0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000bfe0 tx=0x7fdf800045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601b77aad62e819c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:20.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.617+0000 7fdf6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:34:20.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.617+0000 7fdf6dffb700 1 -- 172.21.15.12:0/510351486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80004da0 con 0x55f24cc5a3d0 2023-12-11T20:34:20.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.617+0000 7fdf6dffb700 1 -- 172.21.15.12:0/510351486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf8000f9d0 con 0x55f24cc5a3d0 2023-12-11T20:34:20.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.618+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/510351486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf80018070 con 0x55f24cc5a3d0 2023-12-11T20:34:20.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.618+0000 7fdf6dffb700 1 -- 172.21.15.12:0/510351486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf8000fb90 con 0x55f24cc5a3d0 2023-12-11T20:34:20.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.618+0000 7fdf9fcadb80 10 client.20559 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:20.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.618+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/510351486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f24c9fe250 con 0x55f24cc5a3d0 2023-12-11T20:34:20.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.619+0000 7fdf6dffb700 1 -- 172.21.15.12:0/510351486 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf80039030 con 0x55f24cc5a3d0 2023-12-11T20:34:20.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.619+0000 7fdf6dffb700 1 -- 172.21.15.12:0/510351486 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fdf80032020 con 0x55f24cc5a3d0 2023-12-11T20:34:20.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.619+0000 7fdf9fcadb80 10 client.20559 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:20.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.619+0000 7fdf9fcadb80 10 client.20559 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-12-11T20:34:20.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.619+0000 7fdf9fcadb80 20 client.20559 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:20.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.619+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f24ccc12b0 0x55f24ccc36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:20.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.619+0000 7fdf9fcadb80 4 client.20559 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:34:20.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.619+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/510351486 --> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f24cb74fd0 con 0x55f24ccc12b0 2023-12-11T20:34:20.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.620+0000 7fdf8999a700 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f24ccc12b0 0x55f24ccc36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:20.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.621+0000 7fdf8999a700 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f24ccc12b0 0x55f24ccc36d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=20de3914b772a270 server_cookie=464fe98c379d7530 in_seq=0 out_seq=0 2023-12-11T20:34:20.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.622+0000 7fdf6dffb700 10 client.20559 ms_handle_connect on v2:172.21.15.32:6836/173395142 2023-12-11T20:34:20.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.622+0000 7fdf6dffb700 1 -- 172.21.15.12:0/510351486 <== mds.2 v2:172.21.15.32:6836/173395142 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f24cb74fd0 con 0x55f24ccc12b0 2023-12-11T20:34:20.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.622+0000 7fdf6dffb700 10 client.20559 handle_command_reply: tid=0 2023-12-11T20:34:20.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.622+0000 7fdf9fcadb80 1 client.20559 shutdown 2023-12-11T20:34:20.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.622+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/510351486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5a3d0 msgr2=0x55f24cc6b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5a3d0 0x55f24cc6b1b0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000bfe0 tx=0x7fdf800045b0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/510351486 shutdown_connections 2023-12-11T20:34:20.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.32:6836/173395142,v1:172.21.15.32:6837/173395142] conn(0x55f24ccc12b0 0x55f24ccc36d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f24cc5bc20 0x55f24cc69890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f24cc5a3d0 0x55f24cc6b1b0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 --2- 172.21.15.12:0/510351486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f24cc5ad30 0x55f24cc6b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/510351486 >> 172.21.15.12:0/510351486 conn(0x55f24cb897e0 msgr2=0x55f24cc64200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf6dffb700 0 client.20559 ms_handle_reset on v2:172.21.15.32:6836/173395142 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/510351486 shutdown_connections 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.623+0000 7fdf9fcadb80 1 -- 172.21.15.12:0/510351486 wait complete. 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.624+0000 7fdf9fcadb80 20 client.20559 trim_cache size 0 max 16384 2023-12-11T20:34:20.623 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdf700a1500 msgr2=0x7fdf700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdf700a1500 0x7fdf700a39c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c006130 tx=0x7fdf7c009040 comp rx=0 tx=0).stop 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 msgr2=0x7fdf84197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 0x7fdf84197830 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fdf74005740 tx=0x7fdf74005da0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/1310233580 shutdown_connections 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fdf700a1500 0x7fdf700a39c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf84101f80 0x7fdf841972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf841071e0 0x7fdf8419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 --2- 172.21.15.12:0/1310233580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf841048b0 0x7fdf84197830 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/1310233580 >> 172.21.15.12:0/1310233580 conn(0x7fdf840fb930 msgr2=0x7fdf84102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/1310233580 shutdown_connections 2023-12-11T20:34:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:20.625+0000 7fdf8c3ff700 1 -- 172.21.15.12:0/1310233580 wait complete. 2023-12-11T20:34:20.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-11T20:34:21.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.043+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/47665516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28109680 msgr2=0x7f2a2810ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.043+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/47665516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28109680 0x7f2a2810ff30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000b0a0 tx=0x7f2a2000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.044+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/47665516 shutdown_connections 2023-12-11T20:34:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.044+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/47665516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a28107af0 0x7f2a28107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.044+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/47665516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28109680 0x7f2a2810ff30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.044+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/47665516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a28108ce0 0x7f2a28109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.044+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/47665516 >> 172.21.15.12:0/47665516 conn(0x7f2a28076a90 msgr2=0x7f2a28078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.045+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/47665516 shutdown_connections 2023-12-11T20:34:21.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.045+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/47665516 wait complete. 2023-12-11T20:34:21.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.048+0000 7f2a2e5ff700 1 Processor -- start 2023-12-11T20:34:21.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.049+0000 7f2a2e5ff700 1 -- start start 2023-12-11T20:34:21.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.050+0000 7f2a2e5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a28107af0 0x7f2a2819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.050+0000 7f2a2e5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28108ce0 0x7f2a2819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.050+0000 7f2a2e5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a28109680 0x7f2a281a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.050+0000 7f2a2e5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a281a5580 con 0x7f2a28109680 2023-12-11T20:34:21.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.050+0000 7f2a2e5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a281a56c0 con 0x7f2a28107af0 2023-12-11T20:34:21.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.050+0000 7f2a2e5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a281a5850 con 0x7f2a28108ce0 2023-12-11T20:34:21.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.050+0000 7f2a277fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28108ce0 0x7f2a2819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.051+0000 7f2a277fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28108ce0 0x7f2a2819df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50160/0 (socket says 172.21.15.12:50160) 2023-12-11T20:34:21.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.051+0000 7f2a277fe700 1 -- 172.21.15.12:0/1662849456 learned_addr learned my addr 172.21.15.12:0/1662849456 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.051+0000 7f2a27fff700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a28107af0 0x7f2a2819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.051+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a28109680 0x7f2a281a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.052+0000 7f2a277fe700 1 -- 172.21.15.12:0/1662849456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a28107af0 msgr2=0x7f2a2819da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.052+0000 7f2a277fe700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a28107af0 0x7f2a2819da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.052+0000 7f2a277fe700 1 -- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a28109680 msgr2=0x7f2a281a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.052+0000 7f2a277fe700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a28109680 0x7f2a281a4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.052+0000 7f2a277fe700 1 -- 172.21.15.12:0/1662849456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20009d00 con 0x7f2a28108ce0 2023-12-11T20:34:21.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.052+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a28109680 0x7f2a281a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.053+0000 7f2a277fe700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28108ce0 0x7f2a2819df90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00e9a0 tx=0x7f2a1c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.053+0000 7f2a257fa700 1 -- 172.21.15.12:0/1662849456 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c009790 con 0x7f2a28108ce0 2023-12-11T20:34:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.053+0000 7f2a257fa700 1 -- 172.21.15.12:0/1662849456 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a1c010430 con 0x7f2a28108ce0 2023-12-11T20:34:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.053+0000 7f2a257fa700 1 -- 172.21.15.12:0/1662849456 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00cea0 con 0x7f2a28108ce0 2023-12-11T20:34:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.053+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/1662849456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a281a5b30 con 0x7f2a28108ce0 2023-12-11T20:34:21.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.054+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/1662849456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a281a5f30 con 0x7f2a28108ce0 2023-12-11T20:34:21.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.062+0000 7f2a257fa700 1 -- 172.21.15.12:0/1662849456 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2a1c0105a0 con 0x7f2a28108ce0 2023-12-11T20:34:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.064+0000 7f2a41fd6b80 1 Processor -- start 2023-12-11T20:34:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.064+0000 7f2a257fa700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a180a1580 0x7f2a180a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.065+0000 7f2a257fa700 1 -- 172.21.15.12:0/1662849456 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2a1c014070 con 0x7f2a28108ce0 2023-12-11T20:34:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.066+0000 7f2a41fd6b80 1 -- start start 2023-12-11T20:34:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.066+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a180a1580 0x7f2a180a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.066+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720b93d0 0x5611720b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.066+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.066+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 0x5611720bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.066+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561172014b50 con 0x5611720b93d0 2023-12-11T20:34:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.066+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561172012470 con 0x5611720b9d30 2023-12-11T20:34:21.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.066+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117200dd60 con 0x5611720bac20 2023-12-11T20:34:21.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.067+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720b93d0 0x5611720b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.067+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720b93d0 0x5611720b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43208/0 (socket says 172.21.15.12:43208) 2023-12-11T20:34:21.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.067+0000 7f2a27fff700 1 -- 172.21.15.12:0/2512049804 learned_addr learned my addr 172.21.15.12:0/2512049804 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.067+0000 7f2a277fe700 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 0x5611720bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a180a1580 0x7f2a180a3a40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009fd0 tx=0x7f2a2000b720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a27fff700 1 -- 172.21.15.12:0/2512049804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 msgr2=0x5611720bb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a27fff700 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 0x5611720bb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a27fff700 1 -- 172.21.15.12:0/2512049804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 msgr2=0x5611720ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a27fff700 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a27fff700 1 -- 172.21.15.12:0/2512049804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561171e8a630 con 0x5611720b93d0 2023-12-11T20:34:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a277fe700 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.068+0000 7f2a27fff700 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720b93d0 0x5611720b97f0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400ac80 tx=0x7f2a1400af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de19a9c4d54e5641 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.069+0000 7f2a127fc700 1 -- 172.21.15.12:0/2512049804 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400fde0 con 0x5611720b93d0 2023-12-11T20:34:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.069+0000 7f2a127fc700 1 -- 172.21.15.12:0/2512049804 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a140044b0 con 0x5611720b93d0 2023-12-11T20:34:21.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.069+0000 7f2a127fc700 1 -- 172.21.15.12:0/2512049804 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14018440 con 0x5611720b93d0 2023-12-11T20:34:21.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.070+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/2512049804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720b93d0 msgr2=0x5611720b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.070+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720b93d0 0x5611720b97f0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400ac80 tx=0x7f2a1400af90 comp rx=0 tx=0).stop 2023-12-11T20:34:21.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.072+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/2512049804 shutdown_connections 2023-12-11T20:34:21.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.072+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 0x5611720bb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.072+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720b93d0 0x5611720b97f0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.072+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/2512049804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.072+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/2512049804 >> 172.21.15.12:0/2512049804 conn(0x561171fe87e0 msgr2=0x5611720b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.072+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/2512049804 shutdown_connections 2023-12-11T20:34:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.072+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/2512049804 wait complete. 2023-12-11T20:34:21.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.073+0000 7f2a41fd6b80 1 -- start start 2023-12-11T20:34:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.075+0000 7f2a41fd6b80 1 Processor -- start 2023-12-11T20:34:21.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.076+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720b9d30 0x5611720c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.076+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 0x5611720c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 0x5611720cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561171fc7560 con 0x5611720c8980 2023-12-11T20:34:21.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561171fc7200 con 0x5611720bac20 2023-12-11T20:34:21.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561171e8c920 con 0x5611720b9d30 2023-12-11T20:34:21.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a41fd6b80 10 client.0 _ll_register_callbacks cb 0x561171ef2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:21.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720b9d30 0x5611720c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720b9d30 0x5611720c3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50172/0 (socket says 172.21.15.12:50172) 2023-12-11T20:34:21.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a27fff700 1 -- 172.21.15.12:0/21860148 learned_addr learned my addr 172.21.15.12:0/21860148 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.077+0000 7f2a277fe700 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 0x5611720c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.078+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 0x5611720cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.078+0000 7f2a27fff700 1 -- 172.21.15.12:0/21860148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 msgr2=0x5611720c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.078+0000 7f2a27fff700 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 0x5611720c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.078+0000 7f2a27fff700 1 -- 172.21.15.12:0/21860148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 msgr2=0x5611720cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.079+0000 7f2a27fff700 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 0x5611720cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.079+0000 7f2a27fff700 1 -- 172.21.15.12:0/21860148 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a281a5f30 con 0x5611720b9d30 2023-12-11T20:34:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.079+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 0x5611720cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.079+0000 7f2a27fff700 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720b9d30 0x5611720c3410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2a1401a040 tx=0x7f2a14005eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c78585247fbd8733 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.079+0000 7f2a077fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:34:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.079+0000 7f2a077fe700 1 -- 172.21.15.12:0/21860148 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14004200 con 0x5611720b9d30 2023-12-11T20:34:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.080+0000 7f2a077fe700 1 -- 172.21.15.12:0/21860148 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2a14005040 con 0x5611720b9d30 2023-12-11T20:34:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.080+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/21860148 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611720acb40 con 0x5611720b9d30 2023-12-11T20:34:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.080+0000 7f2a077fe700 1 -- 172.21.15.12:0/21860148 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a14005200 con 0x5611720b9d30 2023-12-11T20:34:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.081+0000 7f2a41fd6b80 10 client.30130 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.081+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/21860148 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f2a1400a8b0 con 0x5611720b9d30 2023-12-11T20:34:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.081+0000 7f2a077fe700 1 -- 172.21.15.12:0/21860148 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5611720acb40 con 0x5611720b9d30 2023-12-11T20:34:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.081+0000 7f2a077fe700 1 -- 172.21.15.12:0/21860148 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2a14020040 con 0x5611720b9d30 2023-12-11T20:34:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.082+0000 7f2a41fd6b80 10 client.30130 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.082+0000 7f2a41fd6b80 10 client.30130 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:34:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.082+0000 7f2a41fd6b80 20 client.30130 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.082+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5611720cf530 0x5611720d1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.082+0000 7f2a41fd6b80 4 client.30130 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.082+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/21860148 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561172088f40 con 0x5611720cf530 2023-12-11T20:34:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.083+0000 7f2a277fe700 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5611720cf530 0x5611720d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.084+0000 7f2a277fe700 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5611720cf530 0x5611720d1950 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a3fc39597855c79 server_cookie=42fcdeeac32d863 in_seq=0 out_seq=0 2023-12-11T20:34:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.084+0000 7f2a077fe700 10 client.30130 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:34:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.085+0000 7f2a077fe700 1 -- 172.21.15.12:0/21860148 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561172088f40 con 0x5611720cf530 2023-12-11T20:34:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.085+0000 7f2a077fe700 10 client.30130 handle_command_reply: tid=0 2023-12-11T20:34:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.085+0000 7f2a41fd6b80 1 client.30130 shutdown 2023-12-11T20:34:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.087+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/21860148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720b9d30 msgr2=0x5611720c3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.087+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720b9d30 0x5611720c3410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2a1401a040 tx=0x7f2a14005eb0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.087+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/21860148 shutdown_connections 2023-12-11T20:34:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.087+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5611720cf530 0x5611720d1950 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.087+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 0x5611720cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.088+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720b9d30 0x5611720c3410 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.088+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/21860148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 0x5611720c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.088+0000 7f2a077fe700 0 client.30130 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:34:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.088+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/21860148 >> 172.21.15.12:0/21860148 conn(0x561171fe87e0 msgr2=0x5611720b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.088+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/21860148 shutdown_connections 2023-12-11T20:34:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.089+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/21860148 wait complete. 2023-12-11T20:34:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.089+0000 7f2a41fd6b80 20 client.30130 trim_cache size 0 max 16384 2023-12-11T20:34:21.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.130+0000 7f2a41fd6b80 1 Processor -- start 2023-12-11T20:34:21.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.135+0000 7f2a41fd6b80 1 -- start start 2023-12-11T20:34:21.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.137+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.137+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 0x5611720cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.137+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 0x5611720bb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.137+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611720baaa0 con 0x5611720c8980 2023-12-11T20:34:21.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.137+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611720cbf00 con 0x5611720b9d30 2023-12-11T20:34:21.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.137+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611720b0790 con 0x5611720bac20 2023-12-11T20:34:21.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37674/0 (socket says 172.21.15.12:37674) 2023-12-11T20:34:21.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a27fff700 1 -- 172.21.15.12:0/3568173947 learned_addr learned my addr 172.21.15.12:0/3568173947 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a277fe700 1 --2- 172.21.15.12:0/3568173947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 0x5611720cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a27fff700 1 -- 172.21.15.12:0/3568173947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 msgr2=0x5611720cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a27fff700 1 --2- 172.21.15.12:0/3568173947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 0x5611720cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a27fff700 1 -- 172.21.15.12:0/3568173947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 msgr2=0x5611720bb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a27fff700 1 --2- 172.21.15.12:0/3568173947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 0x5611720bb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.138+0000 7f2a27fff700 1 -- 172.21.15.12:0/3568173947 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561171e36de0 con 0x5611720b9d30 2023-12-11T20:34:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.139+0000 7f2a27fff700 1 --2- 172.21.15.12:0/3568173947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720d1920 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400ac80 tx=0x7f2a1400af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e85e43cf67f688f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.139+0000 7f2a12ffd700 1 -- 172.21.15.12:0/3568173947 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14003c00 con 0x5611720b9d30 2023-12-11T20:34:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.140+0000 7f2a12ffd700 1 -- 172.21.15.12:0/3568173947 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a14003c00 con 0x5611720b9d30 2023-12-11T20:34:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.140+0000 7f2a12ffd700 1 -- 172.21.15.12:0/3568173947 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14022770 con 0x5611720b9d30 2023-12-11T20:34:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.141+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/3568173947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 msgr2=0x5611720d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.141+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/3568173947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720d1920 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400ac80 tx=0x7f2a1400af90 comp rx=0 tx=0).stop 2023-12-11T20:34:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.141+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/3568173947 shutdown_connections 2023-12-11T20:34:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.141+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/3568173947 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720b9d30 0x5611720d1920 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400ac80 tx=0x7f2a1400af90 comp rx=0 tx=0).stop 2023-12-11T20:34:21.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.141+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/3568173947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720c8980 0x5611720bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.141+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/3568173947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720bac20 0x5611720cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.141+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/3568173947 >> 172.21.15.12:0/3568173947 conn(0x561171fe87e0 msgr2=0x5611720c2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.142+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/3568173947 shutdown_connections 2023-12-11T20:34:21.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.142+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/3568173947 wait complete. 2023-12-11T20:34:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.142+0000 7f2a41fd6b80 1 -- start start 2023-12-11T20:34:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.143+0000 7f2a41fd6b80 1 Processor -- start 2023-12-11T20:34:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.144+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 0x5611720dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.144+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720c8980 0x5611720dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.144+0000 7f2a41fd6b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720dfda0 0x5611721244f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.144+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611720dd4c0 con 0x5611720dfda0 2023-12-11T20:34:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.144+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561172124a30 con 0x5611720bac20 2023-12-11T20:34:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.144+0000 7f2a41fd6b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561172124bf0 con 0x5611720c8980 2023-12-11T20:34:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.144+0000 7f2a41fd6b80 10 client.0 _ll_register_callbacks cb 0x561171ef2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.145+0000 7f2a2cb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720dfda0 0x5611721244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.145+0000 7f2a2cb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720dfda0 0x5611721244f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43232/0 (socket says 172.21.15.12:43232) 2023-12-11T20:34:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.145+0000 7f2a2cb9c700 1 -- 172.21.15.12:0/1677556805 learned_addr learned my addr 172.21.15.12:0/1677556805 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.145+0000 7f2a277fe700 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720c8980 0x5611720dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.145+0000 7f2a27fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 0x5611720dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.146+0000 7f2a2cb9c700 1 -- 172.21.15.12:0/1677556805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720c8980 msgr2=0x5611720dcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.146+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720c8980 0x5611720dcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.146+0000 7f2a2cb9c700 1 -- 172.21.15.12:0/1677556805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 msgr2=0x5611720dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.146+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 0x5611720dc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.146+0000 7f2a2cb9c700 1 -- 172.21.15.12:0/1677556805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1400a8b0 con 0x5611720dfda0 2023-12-11T20:34:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.146+0000 7f2a2cb9c700 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720dfda0 0x5611721244f0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000b0a0 tx=0x7f2a2000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da38eddfb631d315 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.146+0000 7f2a077fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:34:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.147+0000 7f2a077fe700 1 -- 172.21.15.12:0/1677556805 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000e040 con 0x5611720dfda0 2023-12-11T20:34:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.147+0000 7f2a077fe700 1 -- 172.21.15.12:0/1677556805 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2a20005620 con 0x5611720dfda0 2023-12-11T20:34:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.148+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/1677556805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a140044b0 con 0x5611720dfda0 2023-12-11T20:34:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.148+0000 7f2a077fe700 1 -- 172.21.15.12:0/1677556805 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a20005820 con 0x5611720dfda0 2023-12-11T20:34:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.148+0000 7f2a41fd6b80 10 client.20571 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.148+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/1677556805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x561171e1fc60 con 0x5611720dfda0 2023-12-11T20:34:21.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.149+0000 7f2a077fe700 1 -- 172.21.15.12:0/1677556805 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a140044b0 con 0x5611720dfda0 2023-12-11T20:34:21.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.150+0000 7f2a077fe700 1 -- 172.21.15.12:0/1677556805 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2a20023070 con 0x5611720dfda0 2023-12-11T20:34:21.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.150+0000 7f2a41fd6b80 10 client.20571 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.150+0000 7f2a41fd6b80 10 client.20571 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-12-11T20:34:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.150+0000 7f2a41fd6b80 20 client.20571 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.150+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5611721266f0 0x561172128b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.150+0000 7f2a41fd6b80 4 client.20571 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:34:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.150+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/1677556805 --> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561171fd3fd0 con 0x5611721266f0 2023-12-11T20:34:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.150+0000 7f2a27fff700 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5611721266f0 0x561172128b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.151+0000 7f2a27fff700 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5611721266f0 0x561172128b10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eded0a6592dab807 server_cookie=83e50005cf3724ec in_seq=0 out_seq=0 2023-12-11T20:34:21.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.151+0000 7f2a077fe700 10 client.20571 ms_handle_connect on v2:172.21.15.39:6838/2020485308 2023-12-11T20:34:21.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a077fe700 1 -- 172.21.15.12:0/1677556805 <== mds.1 v2:172.21.15.39:6838/2020485308 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3894 (crc 0 0 0) 0x561171fd3fd0 con 0x5611721266f0 2023-12-11T20:34:21.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a077fe700 10 client.20571 handle_command_reply: tid=0 2023-12-11T20:34:21.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 client.20571 shutdown 2023-12-11T20:34:21.156 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-12-11T20:34:21.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.156 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.156 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 214149013, 2023-12-11T20:34:21.156 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256174, 2023-12-11T20:34:21.156 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile105" 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 317799373, 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256177, 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile109" 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1265956484, 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256154, 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile85" 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.157 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1416201096, 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256169, 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile100" 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1566037103, 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256075, 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile6" 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1596670633, 2023-12-11T20:34:21.158 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256149, 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile80" 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1629592379, 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256144, 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile75" 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1824488438, 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256093, 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile24" 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1881343750, 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256156, 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile87" 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1894873672, 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256120, 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile51" 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1908140250, 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256194, 2023-12-11T20:34:21.160 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile126" 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2081305932, 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256083, 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile14" 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2257948063, 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256132, 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile63" 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.161 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2294473965, 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256192, 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile124" 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2603270212, 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256137, 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile68" 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2891836849, 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256085, 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile16" 2023-12-11T20:34:21.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3374247018, 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256153, 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile84" 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3887567309, 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 2199023256186, 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile118" 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:34:21.163 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-12-11T20:34:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/1677556805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720dfda0 msgr2=0x5611721244f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720dfda0 0x5611721244f0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000b0a0 tx=0x7f2a2000bf40 comp rx=0 tx=0).stop 2023-12-11T20:34:21.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/1677556805 shutdown_connections 2023-12-11T20:34:21.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.39:6838/2020485308,v1:172.21.15.39:6839/2020485308] conn(0x5611721266f0 0x561172128b10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5611720bac20 0x5611720dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5611720dfda0 0x5611721244f0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 --2- 172.21.15.12:0/1677556805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5611720c8980 0x5611720dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a077fe700 0 client.20571 ms_handle_reset on v2:172.21.15.39:6838/2020485308 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.152+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/1677556805 >> 172.21.15.12:0/1677556805 conn(0x561171fe87e0 msgr2=0x5611720c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.155+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/1677556805 shutdown_connections 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.155+0000 7f2a41fd6b80 1 -- 172.21.15.12:0/1677556805 wait complete. 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.155+0000 7f2a41fd6b80 20 client.20571 trim_cache size 0 max 16384 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a180a1580 msgr2=0x7f2a180a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a180a1580 0x7f2a180a3a40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009fd0 tx=0x7f2a2000b720 comp rx=0 tx=0).stop 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/1662849456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28108ce0 msgr2=0x7f2a2819df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28108ce0 0x7f2a2819df90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00e9a0 tx=0x7f2a1c00ecb0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/1662849456 shutdown_connections 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2a180a1580 0x7f2a180a3a40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a28107af0 0x7f2a2819da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a28109680 0x7f2a281a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 --2- 172.21.15.12:0/1662849456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a28108ce0 0x7f2a2819df90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/1662849456 >> 172.21.15.12:0/1662849456 conn(0x7f2a28076a90 msgr2=0x7f2a2810c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/1662849456 shutdown_connections 2023-12-11T20:34:21.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.157+0000 7f2a2e5ff700 1 -- 172.21.15.12:0/1662849456 wait complete. 2023-12-11T20:34:21.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:20 smithi012 ceph-mon[128787]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:34:21.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:20 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/564945445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:34:21.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-11T20:34:21.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:20 smithi032 ceph-mon[132488]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:34:21.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:20 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/564945445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:34:21.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:20 smithi039 ceph-mon[102205]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:34:21.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:20 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/564945445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-11T20:34:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.583+0000 7f7f281ff700 1 -- 172.21.15.12:0/916245262 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f20105280 msgr2=0x7f7f2010bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.583+0000 7f7f281ff700 1 --2- 172.21.15.12:0/916245262 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f20105280 0x7f7f2010bb30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b0a0 tx=0x7f7f1800b3b0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.583+0000 7f7f281ff700 1 -- 172.21.15.12:0/916245262 shutdown_connections 2023-12-11T20:34:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.583+0000 7f7f281ff700 1 --2- 172.21.15.12:0/916245262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f201036f0 0x7f7f20103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.583+0000 7f7f281ff700 1 --2- 172.21.15.12:0/916245262 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f20105280 0x7f7f2010bb30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.583+0000 7f7f281ff700 1 --2- 172.21.15.12:0/916245262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f201048e0 0x7f7f20104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.583+0000 7f7f281ff700 1 -- 172.21.15.12:0/916245262 >> 172.21.15.12:0/916245262 conn(0x7f7f200fec80 msgr2=0x7f7f201010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.583+0000 7f7f281ff700 1 -- 172.21.15.12:0/916245262 shutdown_connections 2023-12-11T20:34:21.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.585+0000 7f7f281ff700 1 -- 172.21.15.12:0/916245262 wait complete. 2023-12-11T20:34:21.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.586+0000 7f7f281ff700 1 Processor -- start 2023-12-11T20:34:21.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.588+0000 7f7f281ff700 1 -- start start 2023-12-11T20:34:21.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.588+0000 7f7f281ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f201036f0 0x7f7f20079330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.588+0000 7f7f281ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f201048e0 0x7f7f20079870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.588+0000 7f7f281ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f20105280 0x7f7f20075ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.588+0000 7f7f281ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20076660 con 0x7f7f201036f0 2023-12-11T20:34:21.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.588+0000 7f7f281ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200767d0 con 0x7f7f20105280 2023-12-11T20:34:21.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.588+0000 7f7f281ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20076990 con 0x7f7f201048e0 2023-12-11T20:34:21.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.589+0000 7f7f25f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f201036f0 0x7f7f20079330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.589+0000 7f7f25f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f201036f0 0x7f7f20079330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43242/0 (socket says 172.21.15.12:43242) 2023-12-11T20:34:21.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.589+0000 7f7f2679c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f20105280 0x7f7f20075ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.589+0000 7f7f25f9b700 1 -- 172.21.15.12:0/3966680219 learned_addr learned my addr 172.21.15.12:0/3966680219 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.589+0000 7f7f2579a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f201048e0 0x7f7f20079870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.589+0000 7f7f2679c700 1 -- 172.21.15.12:0/3966680219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f201048e0 msgr2=0x7f7f20079870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.589+0000 7f7f2679c700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f201048e0 0x7f7f20079870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.589+0000 7f7f2679c700 1 -- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f201036f0 msgr2=0x7f7f20079330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.590+0000 7f7f2679c700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f201036f0 0x7f7f20079330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.590+0000 7f7f2679c700 1 -- 172.21.15.12:0/3966680219 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009d00 con 0x7f7f20105280 2023-12-11T20:34:21.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.590+0000 7f7f25f9b700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f201036f0 0x7f7f20079330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:21.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.590+0000 7f7f2679c700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f20105280 0x7f7f20075ec0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7f18007b90 tx=0x7f7f180095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.591+0000 7f7f16ffd700 1 -- 172.21.15.12:0/3966680219 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800e040 con 0x7f7f20105280 2023-12-11T20:34:21.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.591+0000 7f7f16ffd700 1 -- 172.21.15.12:0/3966680219 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f18003e90 con 0x7f7f20105280 2023-12-11T20:34:21.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.591+0000 7f7f16ffd700 1 -- 172.21.15.12:0/3966680219 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1801d480 con 0x7f7f20105280 2023-12-11T20:34:21.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.591+0000 7f7f281ff700 1 -- 172.21.15.12:0/3966680219 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f201a5b20 con 0x7f7f20105280 2023-12-11T20:34:21.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.591+0000 7f7f281ff700 1 -- 172.21.15.12:0/3966680219 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f201a5fa0 con 0x7f7f20105280 2023-12-11T20:34:21.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.596+0000 7f7f16ffd700 1 -- 172.21.15.12:0/3966680219 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7f180040b0 con 0x7f7f20105280 2023-12-11T20:34:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.599+0000 7f7f3bb41b80 1 Processor -- start 2023-12-11T20:34:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.599+0000 7f7f16ffd700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f0c0a15d0 0x7f7f0c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.599+0000 7f7f3bb41b80 1 -- start start 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.599+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 0x5597425cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.599+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 0x5597425cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.599+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559742526b50 con 0x5597425cbd30 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559742524470 con 0x5597425cb3d0 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974251fd60 con 0x5597425ccc20 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f2679c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f2679c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50200/0 (socket says 172.21.15.12:50200) 2023-12-11T20:34:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f2679c700 1 -- 172.21.15.12:0/2730379142 learned_addr learned my addr 172.21.15.12:0/2730379142 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f2679c700 1 -- 172.21.15.12:0/2730379142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 msgr2=0x5597425cb7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:34:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f2679c700 1 --2- 172.21.15.12:0/2730379142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 0x5597425cb7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f2679c700 1 -- 172.21.15.12:0/2730379142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 msgr2=0x5597425cc640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:34:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f2679c700 1 --2- 172.21.15.12:0/2730379142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 0x5597425cc640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.600+0000 7f7f2679c700 1 -- 172.21.15.12:0/2730379142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974239c630 con 0x5597425ccc20 2023-12-11T20:34:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.601+0000 7f7f2679c700 1 --2- 172.21.15.12:0/2730379142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425cd0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7f18097be0 tx=0x7f7f18090ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e64dd168e4aac013 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.601+0000 7f7f2579a700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f0c0a15d0 0x7f7f0c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.601+0000 7f7f0bfff700 1 -- 172.21.15.12:0/2730379142 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18097a70 con 0x5597425ccc20 2023-12-11T20:34:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.601+0000 7f7f0bfff700 1 -- 172.21.15.12:0/2730379142 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f18009b80 con 0x5597425ccc20 2023-12-11T20:34:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.601+0000 7f7f0bfff700 1 -- 172.21.15.12:0/2730379142 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180a4960 con 0x5597425ccc20 2023-12-11T20:34:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.602+0000 7f7f16ffd700 1 -- 172.21.15.12:0/3966680219 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f180ce430 con 0x7f7f20105280 2023-12-11T20:34:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.602+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2730379142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 msgr2=0x5597425cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.602+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2730379142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425cd0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7f18097be0 tx=0x7f7f18090ef0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.602+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2730379142 shutdown_connections 2023-12-11T20:34:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.602+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2730379142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 0x5597425cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.602+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2730379142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425cd0a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.602+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2730379142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 0x5597425cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.602+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2730379142 >> 172.21.15.12:0/2730379142 conn(0x5597424fa7e0 msgr2=0x5597425c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.603+0000 7f7f2579a700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f0c0a15d0 0x7f7f0c0a3a90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009ab0 tx=0x7f7f10009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.603+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2730379142 shutdown_connections 2023-12-11T20:34:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.603+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2730379142 wait complete. 2023-12-11T20:34:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.604+0000 7f7f3bb41b80 1 -- start start 2023-12-11T20:34:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.604+0000 7f7f3bb41b80 1 Processor -- start 2023-12-11T20:34:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.605+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.605+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cbd30 0x5597425d5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425dc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597424d9560 con 0x5597425cb3d0 2023-12-11T20:34:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597424d9200 con 0x5597425cbd30 2023-12-11T20:34:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974239e920 con 0x5597425ccc20 2023-12-11T20:34:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f2579a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cbd30 0x5597425d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f2579a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cbd30 0x5597425d5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37724/0 (socket says 172.21.15.12:37724) 2023-12-11T20:34:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f2579a700 1 -- 172.21.15.12:0/2873198132 learned_addr learned my addr 172.21.15.12:0/2873198132 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f25f9b700 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f2679c700 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f2579a700 1 -- 172.21.15.12:0/2873198132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 msgr2=0x5597425dc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f2579a700 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425dc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f2579a700 1 -- 172.21.15.12:0/2873198132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 msgr2=0x5597425d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.606+0000 7f7f3bb41b80 10 client.0 _ll_register_callbacks cb 0x559742404a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.607+0000 7f7f2579a700 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.607+0000 7f7f2579a700 1 -- 172.21.15.12:0/2873198132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f201a5fa0 con 0x5597425cbd30 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.607+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2873198132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55974259af40 con 0x5597425cbd30 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.608+0000 7f7f2579a700 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cbd30 0x5597425d5450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7f10015730 tx=0x7f7f10004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed89af4a1e93fa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.608+0000 7f7f097fa700 10 client.30128 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.608+0000 7f7f097fa700 1 -- 172.21.15.12:0/2873198132 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000ee50 con 0x5597425cbd30 2023-12-11T20:34:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.608+0000 7f7f097fa700 1 -- 172.21.15.12:0/2873198132 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f10015d50 con 0x5597425cbd30 2023-12-11T20:34:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.608+0000 7f7f097fa700 1 -- 172.21.15.12:0/2873198132 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f10013450 con 0x5597425cbd30 2023-12-11T20:34:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.608+0000 7f7f3bb41b80 10 client.30128 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.608+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2873198132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({fsmap=39}) v3 -- 0x559742348de0 con 0x5597425cbd30 2023-12-11T20:34:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.609+0000 7f7f097fa700 1 -- 172.21.15.12:0/2873198132 <== mon.2 v2:172.21.15.32:3300/0 4 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7f100135b0 con 0x5597425cbd30 2023-12-11T20:34:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.609+0000 7f7f3bb41b80 10 client.30128 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.609+0000 7f7f3bb41b80 10 client.30128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.609+0000 7f7f3bb41b80 20 client.30128 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.609+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5597425e0c70 0x5597425e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.609+0000 7f7f3bb41b80 4 client.30128 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.609+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2873198132 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597424e5fd0 con 0x5597425e0c70 2023-12-11T20:34:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.610+0000 7f7f25f9b700 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5597425e0c70 0x5597425e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.610+0000 7f7f25f9b700 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5597425e0c70 0x5597425e3090 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5c4b5cab3e63552 server_cookie=94c0c9d6a7057fa1 in_seq=0 out_seq=0 2023-12-11T20:34:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.610+0000 7f7f097fa700 10 client.30128 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.611+0000 7f7f097fa700 1 -- 172.21.15.12:0/2873198132 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5597424e5fd0 con 0x5597425e0c70 2023-12-11T20:34:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.611+0000 7f7f097fa700 10 client.30128 handle_command_reply: tid=0 2023-12-11T20:34:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 client.30128 shutdown 2023-12-11T20:34:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2873198132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cbd30 msgr2=0x5597425d5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cbd30 0x5597425d5450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7f10015730 tx=0x7f7f10004860 comp rx=0 tx=0).stop 2023-12-11T20:34:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2873198132 shutdown_connections 2023-12-11T20:34:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5597425e0c70 0x5597425e3090 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425dc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/2873198132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cbd30 0x5597425d5450 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2873198132 >> 172.21.15.12:0/2873198132 conn(0x5597424fa7e0 msgr2=0x5597425c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.612+0000 7f7f097fa700 0 client.30128 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:21.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.613+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2873198132 shutdown_connections 2023-12-11T20:34:21.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.613+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/2873198132 wait complete. 2023-12-11T20:34:21.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.613+0000 7f7f3bb41b80 20 client.30128 trim_cache size 0 max 16384 2023-12-11T20:34:21.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.642+0000 7f7f3bb41b80 1 Processor -- start 2023-12-11T20:34:21.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.643+0000 7f7f3bb41b80 1 -- start start 2023-12-11T20:34:21.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.644+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 0x5597425cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.644+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 0x5597425dc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f25f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 0x5597425cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597425d4aa0 con 0x5597425cbd30 2023-12-11T20:34:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f25f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 0x5597425cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:37738/0 (socket says 172.21.15.12:37738) 2023-12-11T20:34:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f25f9b700 1 -- 172.21.15.12:0/4232240070 learned_addr learned my addr 172.21.15.12:0/4232240070 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597425cc110 con 0x5597425cb3d0 2023-12-11T20:34:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f2679c700 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/4232240070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597425caf70 con 0x5597425ccc20 2023-12-11T20:34:21.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.645+0000 7f7f2579a700 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 0x5597425dc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.646+0000 7f7f2679c700 1 -- 172.21.15.12:0/4232240070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 msgr2=0x5597425cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.646+0000 7f7f2679c700 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 0x5597425cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.646+0000 7f7f2679c700 1 -- 172.21.15.12:0/4232240070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 msgr2=0x5597425dc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.646+0000 7f7f2679c700 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 0x5597425dc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.646+0000 7f7f2679c700 1 -- 172.21.15.12:0/4232240070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559742331c60 con 0x5597425ccc20 2023-12-11T20:34:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.646+0000 7f7f2579a700 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 0x5597425dc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.646+0000 7f7f2679c700 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425d4f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b070 tx=0x7f7f18004020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9424a506130c293c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.647+0000 7f7f14ff9700 1 -- 172.21.15.12:0/4232240070 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18097a70 con 0x5597425ccc20 2023-12-11T20:34:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.647+0000 7f7f14ff9700 1 -- 172.21.15.12:0/4232240070 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f18009b80 con 0x5597425ccc20 2023-12-11T20:34:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.648+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/4232240070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 msgr2=0x5597425d4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.648+0000 7f7f14ff9700 1 -- 172.21.15.12:0/4232240070 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1809f880 con 0x5597425ccc20 2023-12-11T20:34:21.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.648+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425d4f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b070 tx=0x7f7f18004020 comp rx=0 tx=0).stop 2023-12-11T20:34:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.648+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/4232240070 shutdown_connections 2023-12-11T20:34:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.648+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425cb3d0 0x5597425cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.648+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425ccc20 0x5597425d4f10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.649+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/4232240070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cbd30 0x5597425dc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.649+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/4232240070 >> 172.21.15.12:0/4232240070 conn(0x5597424fa7e0 msgr2=0x5597425d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.649+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/4232240070 shutdown_connections 2023-12-11T20:34:21.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.649+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/4232240070 wait complete. 2023-12-11T20:34:21.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.650+0000 7f7f3bb41b80 1 -- start start 2023-12-11T20:34:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.652+0000 7f7f3bb41b80 1 Processor -- start 2023-12-11T20:34:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425cbd30 0x5597425d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f3bb41b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425ccc20 0x5597425dae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597425db340 con 0x5597425cb3d0 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597425db4b0 con 0x5597425ccc20 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f3bb41b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597425db670 con 0x5597425cbd30 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f3bb41b80 10 client.0 _ll_register_callbacks cb 0x559742404a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f25f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.654+0000 7f7f25f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43266/0 (socket says 172.21.15.12:43266) 2023-12-11T20:34:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.655+0000 7f7f25f9b700 1 -- 172.21.15.12:0/1308665429 learned_addr learned my addr 172.21.15.12:0/1308665429 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.655+0000 7f7f25f9b700 1 -- 172.21.15.12:0/1308665429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425cbd30 msgr2=0x5597425d9df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:34:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.656+0000 7f7f2679c700 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425ccc20 0x5597425dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.656+0000 7f7f2579a700 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425cbd30 0x5597425d9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.656+0000 7f7f25f9b700 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425cbd30 0x5597425d9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.656+0000 7f7f25f9b700 1 -- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425ccc20 msgr2=0x5597425dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.656+0000 7f7f25f9b700 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425ccc20 0x5597425dae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.656+0000 7f7f25f9b700 1 -- 172.21.15.12:0/1308665429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559742348de0 con 0x5597425cb3d0 2023-12-11T20:34:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.656+0000 7f7f2679c700 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425ccc20 0x5597425dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.656+0000 7f7f25f9b700 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d98b0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c019df0 tx=0x7f7f1c004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d316dd11bb115e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:21.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.659+0000 7f7f097fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:34:21.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.659+0000 7f7f097fa700 1 -- 172.21.15.12:0/1308665429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c017040 con 0x5597425cb3d0 2023-12-11T20:34:21.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.659+0000 7f7f097fa700 1 -- 172.21.15.12:0/1308665429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f1c0198a0 con 0x5597425cb3d0 2023-12-11T20:34:21.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.660+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/1308665429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597424d8490 con 0x5597425cb3d0 2023-12-11T20:34:21.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.660+0000 7f7f097fa700 1 -- 172.21.15.12:0/1308665429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f1c003880 con 0x5597425cb3d0 2023-12-11T20:34:21.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.660+0000 7f7f3bb41b80 10 client.20583 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:21.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.660+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/1308665429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55974239c630 con 0x5597425cb3d0 2023-12-11T20:34:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.661+0000 7f7f097fa700 1 -- 172.21.15.12:0/1308665429 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5597424d8490 con 0x5597425cb3d0 2023-12-11T20:34:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.661+0000 7f7f097fa700 1 -- 172.21.15.12:0/1308665429 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7f1c02a070 con 0x5597425cb3d0 2023-12-11T20:34:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.662+0000 7f7f3bb41b80 10 client.20583 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.662+0000 7f7f3bb41b80 10 client.20583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.662+0000 7f7f3bb41b80 20 client.20583 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.662+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559742648830 0x55974264ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.662+0000 7f7f3bb41b80 4 client.20583 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-12-11T20:34:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.662+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/1308665429 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559742369f70 con 0x559742648830 2023-12-11T20:34:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.663+0000 7f7f2579a700 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559742648830 0x55974264ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:21.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.664+0000 7f7f097fa700 10 client.20583 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:21.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.664+0000 7f7f2579a700 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559742648830 0x55974264ac50 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f639945e2394cbdf server_cookie=da459da737cfb94d in_seq=0 out_seq=0 2023-12-11T20:34:21.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.664+0000 7f7f097fa700 1 -- 172.21.15.12:0/1308665429 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559742369f70 con 0x559742648830 2023-12-11T20:34:21.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.664+0000 7f7f097fa700 10 client.20583 handle_command_reply: tid=0 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.664+0000 7f7f3bb41b80 1 client.20583 shutdown 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.664+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/1308665429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 msgr2=0x5597425d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.664+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d98b0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c019df0 tx=0x7f7f1c004320 comp rx=0 tx=0).stop 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.664+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/1308665429 shutdown_connections 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x559742648830 0x55974264ac50 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5597425ccc20 0x5597425dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597425cb3d0 0x5597425d98b0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f3bb41b80 1 --2- 172.21.15.12:0/1308665429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5597425cbd30 0x5597425d9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/1308665429 >> 172.21.15.12:0/1308665429 conn(0x5597424fa7e0 msgr2=0x5597425d4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f097fa700 0 client.20583 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:21.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/1308665429 shutdown_connections 2023-12-11T20:34:21.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f3bb41b80 1 -- 172.21.15.12:0/1308665429 wait complete. 2023-12-11T20:34:21.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.665+0000 7f7f3bb41b80 20 client.20583 trim_cache size 0 max 16384 2023-12-11T20:34:21.665 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-12-11T20:34:21.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 -- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f0c0a15d0 msgr2=0x7f7f0c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f0c0a15d0 0x7f7f0c0a3a90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009ab0 tx=0x7f7f10009190 comp rx=0 tx=0).stop 2023-12-11T20:34:21.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 -- 172.21.15.12:0/3966680219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f20105280 msgr2=0x7f7f20075ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:21.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f20105280 0x7f7f20075ec0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7f18007b90 tx=0x7f7f180095c0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 -- 172.21.15.12:0/3966680219 shutdown_connections 2023-12-11T20:34:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7f0c0a15d0 0x7f7f0c0a3a90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f20105280 0x7f7f20075ec0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f201036f0 0x7f7f20079330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 --2- 172.21.15.12:0/3966680219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f201048e0 0x7f7f20079870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 -- 172.21.15.12:0/3966680219 >> 172.21.15.12:0/3966680219 conn(0x7f7f200fec80 msgr2=0x7f7f20107c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 -- 172.21.15.12:0/3966680219 shutdown_connections 2023-12-11T20:34:21.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:34:21.666+0000 7f7f281ff700 1 -- 172.21.15.12:0/3966680219 wait complete. 2023-12-11T20:34:21.696 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 214149013, 'ino': 2199023256174, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile105'}, {'damage_type': 'backtrace', 'id': 317799373, 'ino': 2199023256177, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile109'}, {'damage_type': 'backtrace', 'id': 1265956484, 'ino': 2199023256154, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile85'}, {'damage_type': 'backtrace', 'id': 1416201096, 'ino': 2199023256169, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile100'}, {'damage_type': 'backtrace', 'id': 1566037103, 'ino': 2199023256075, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile6'}, {'damage_type': 'backtrace', 'id': 1596670633, 'ino': 2199023256149, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile80'}, {'damage_type': 'backtrace', 'id': 1629592379, 'ino': 2199023256144, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile75'}, {'damage_type': 'backtrace', 'id': 1824488438, 'ino': 2199023256093, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile24'}, {'damage_type': 'backtrace', 'id': 1881343750, 'ino': 2199023256156, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile87'}, {'damage_type': 'backtrace', 'id': 1894873672, 'ino': 2199023256120, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile51'}, {'damage_type': 'backtrace', 'id': 1908140250, 'ino': 2199023256194, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile126'}, {'damage_type': 'backtrace', 'id': 2081305932, 'ino': 2199023256083, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile14'}, {'damage_type': 'backtrace', 'id': 2257948063, 'ino': 2199023256132, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile63'}, {'damage_type': 'backtrace', 'id': 2294473965, 'ino': 2199023256192, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile124'}, {'damage_type': 'backtrace', 'id': 2603270212, 'ino': 2199023256137, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile68'}, {'damage_type': 'backtrace', 'id': 2891836849, 'ino': 2199023256085, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile16'}, {'damage_type': 'backtrace', 'id': 3374247018, 'ino': 2199023256153, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile84'}, {'damage_type': 'backtrace', 'id': 3887567309, 'ino': 2199023256186, 'path': '/volumes/_nogroup/sv_0/cf96d957-e35a-436d-9f5a-d2f1b3bfb30b/client.0/tmp/tmp/data/datafile118'}] 2023-12-11T20:34:21.696 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-12-11T20:34:23.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:22 smithi032 ceph-mon[132488]: pgmap v928: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:34:23.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:22 smithi039 ceph-mon[102205]: pgmap v928: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:34:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:22 smithi012 ceph-mon[128787]: pgmap v928: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:34:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:24 smithi032 ceph-mon[132488]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.11k op/s 2023-12-11T20:34:25.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:24 smithi039 ceph-mon[102205]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.11k op/s 2023-12-11T20:34:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:24 smithi012 ceph-mon[128787]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.11k op/s 2023-12-11T20:34:27.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:26 smithi032 ceph-mon[132488]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2023-12-11T20:34:27.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:26 smithi039 ceph-mon[102205]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2023-12-11T20:34:27.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:26 smithi012 ceph-mon[128787]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.40k op/s 2023-12-11T20:34:29.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:28 smithi032 ceph-mon[132488]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.47k op/s 2023-12-11T20:34:29.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:28 smithi039 ceph-mon[102205]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.47k op/s 2023-12-11T20:34:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:28 smithi012 ceph-mon[128787]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.47k op/s 2023-12-11T20:34:31.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:30 smithi032 ceph-mon[132488]: pgmap v932: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.04k op/s 2023-12-11T20:34:31.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:30 smithi039 ceph-mon[102205]: pgmap v932: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.04k op/s 2023-12-11T20:34:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:30 smithi012 ceph-mon[128787]: pgmap v932: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.04k op/s 2023-12-11T20:34:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.664+0000 7fb9bd599700 1 -- 172.21.15.12:0/2038683174 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0007e10 con 0x7fb9b8102000 2023-12-11T20:34:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.665+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2038683174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8102000 msgr2=0x7fb9b81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.665+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2038683174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8102000 0x7fb9b81043f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000b0a0 tx=0x7fb9b000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.665+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2038683174 shutdown_connections 2023-12-11T20:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.665+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2038683174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b8107260 0x7fb9b8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.665+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2038683174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8102000 0x7fb9b81043f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.665+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2038683174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b8104930 0x7fb9b8106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.665+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2038683174 >> 172.21.15.12:0/2038683174 conn(0x7fb9b80fb930 msgr2=0x7fb9b80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.665+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2038683174 shutdown_connections 2023-12-11T20:34:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.666+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2038683174 wait complete. 2023-12-11T20:34:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.667+0000 7fb9c07ff700 1 Processor -- start 2023-12-11T20:34:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.667+0000 7fb9c07ff700 1 -- start start 2023-12-11T20:34:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9c07ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b8102000 0x7fb9b8199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9c07ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8104930 0x7fb9b8199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9c07ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b8107260 0x7fb9b81a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9c07ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b81a1180 con 0x7fb9b8107260 2023-12-11T20:34:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9c07ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b81a12c0 con 0x7fb9b8102000 2023-12-11T20:34:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9c07ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b81a1450 con 0x7fb9b8104930 2023-12-11T20:34:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9be59b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b8102000 0x7fb9b8199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9bdd9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8104930 0x7fb9b8199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9bdd9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8104930 0x7fb9b8199b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:57952/0 (socket says 172.21.15.12:57952) 2023-12-11T20:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.668+0000 7fb9bdd9a700 1 -- 172.21.15.12:0/2694288244 learned_addr learned my addr 172.21.15.12:0/2694288244 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.669+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b8107260 0x7fb9b81a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.669+0000 7fb9bed9c700 1 -- 172.21.15.12:0/2694288244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8104930 msgr2=0x7fb9b8199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.669+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8104930 0x7fb9b8199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.669+0000 7fb9bed9c700 1 -- 172.21.15.12:0/2694288244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b8102000 msgr2=0x7fb9b8199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.669+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b8102000 0x7fb9b8199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.669+0000 7fb9bed9c700 1 -- 172.21.15.12:0/2694288244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b0009d00 con 0x7fb9b8107260 2023-12-11T20:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.670+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b8107260 0x7fb9b81a0bb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400e970 tx=0x7fb9b400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.670+0000 7fb9ab7fe700 1 -- 172.21.15.12:0/2694288244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4004220 con 0x7fb9b8107260 2023-12-11T20:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.670+0000 7fb9ab7fe700 1 -- 172.21.15.12:0/2694288244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9b4004cc0 con 0x7fb9b8107260 2023-12-11T20:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.670+0000 7fb9ab7fe700 1 -- 172.21.15.12:0/2694288244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4005590 con 0x7fb9b8107260 2023-12-11T20:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.670+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2694288244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b81a1730 con 0x7fb9b8107260 2023-12-11T20:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.671+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2694288244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b81a1bf0 con 0x7fb9b8107260 2023-12-11T20:34:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.677+0000 7fb9ab7fe700 1 -- 172.21.15.12:0/2694288244 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fb9b4004750 con 0x7fb9b8107260 2023-12-11T20:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.680+0000 7fb9ab7fe700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9a40a15b0 0x7fb9a40a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.680+0000 7fb9d4069b80 1 Processor -- start 2023-12-11T20:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.680+0000 7fb9ab7fe700 1 -- 172.21.15.12:0/2694288244 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb9b4014070 con 0x7fb9b8107260 2023-12-11T20:34:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.681+0000 7fb9d4069b80 1 -- start start 2023-12-11T20:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.683+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f78332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.683+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7834140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.683+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7834ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9be59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f78332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9be59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f78332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:57958/0 (socket says 172.21.15.12:57958) 2023-12-11T20:34:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9be59b700 1 -- 172.21.15.12:0/4004001729 learned_addr learned my addr 172.21.15.12:0/4004001729 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.683+0000 7fb9bdd9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7834140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7834ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9d4069b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f778eaf0 con 0x5606f7834720 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9d4069b80 1 -- 172.21.15.12:0/4004001729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f778c410 con 0x5606f7833830 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9d4069b80 1 -- 172.21.15.12:0/4004001729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f7787d00 con 0x5606f7832ed0 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9be59b700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9a40a15b0 0x7fb9a40a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9bdd9a700 1 -- 172.21.15.12:0/4004001729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 msgr2=0x5606f78332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f78332f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.684+0000 7fb9bdd9a700 1 -- 172.21.15.12:0/4004001729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 msgr2=0x5606f7834ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.685+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7834ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.685+0000 7fb9bdd9a700 1 -- 172.21.15.12:0/4004001729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606f76045d0 con 0x5606f7833830 2023-12-11T20:34:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.685+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7834ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.685+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7834140 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00ac90 tx=0x7fb9ac00f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b2cb122b9bf685 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.686+0000 7fb9a8ff9700 1 -- 172.21.15.12:0/4004001729 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00fdf0 con 0x5606f7833830 2023-12-11T20:34:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.686+0000 7fb9be59b700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9a40a15b0 0x7fb9a40a3a70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0006280 tx=0x7fb9b0006000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.686+0000 7fb9a8ff9700 1 -- 172.21.15.12:0/4004001729 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9ac0044b0 con 0x5606f7833830 2023-12-11T20:34:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.686+0000 7fb9a8ff9700 1 -- 172.21.15.12:0/4004001729 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac018440 con 0x5606f7833830 2023-12-11T20:34:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.687+0000 7fb9d4069b80 1 -- 172.21.15.12:0/4004001729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 msgr2=0x5606f7834140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.687+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7834140 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00ac90 tx=0x7fb9ac00f3c0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.687+0000 7fb9d4069b80 1 -- 172.21.15.12:0/4004001729 shutdown_connections 2023-12-11T20:34:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.687+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7834ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.687+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f78332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.687+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/4004001729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7834140 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.687+0000 7fb9d4069b80 1 -- 172.21.15.12:0/4004001729 >> 172.21.15.12:0/4004001729 conn(0x5606f7762780 msgr2=0x5606f782f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:32.691 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.692+0000 7fb9d4069b80 1 -- 172.21.15.12:0/4004001729 shutdown_connections 2023-12-11T20:34:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.694+0000 7fb9d4069b80 1 -- 172.21.15.12:0/4004001729 wait complete. 2023-12-11T20:34:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.695+0000 7fb9d4069b80 1 -- start start 2023-12-11T20:34:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.696+0000 7fb9d4069b80 1 Processor -- start 2023-12-11T20:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.696+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f783cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.696+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f783d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.697+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7834720 0x5606f7844260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.697+0000 7fb9be59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f783cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.697+0000 7fb9be59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f783cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:57964/0 (socket says 172.21.15.12:57964) 2023-12-11T20:34:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.698+0000 7fb9be59b700 1 -- 172.21.15.12:0/475190594 learned_addr learned my addr 172.21.15.12:0/475190594 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.698+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f783d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.698+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f7741500 con 0x5606f7833830 2023-12-11T20:34:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.698+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f77411a0 con 0x5606f7834720 2023-12-11T20:34:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.698+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f76068c0 con 0x5606f7832ed0 2023-12-11T20:34:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.698+0000 7fb9d4069b80 10 client.0 _ll_register_callbacks cb 0x5606f766ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.698+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7834720 0x5606f7844260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.699+0000 7fb9bed9c700 1 -- 172.21.15.12:0/475190594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 msgr2=0x5606f783cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.699+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f783cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.699+0000 7fb9bed9c700 1 -- 172.21.15.12:0/475190594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 msgr2=0x5606f783d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.699+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f783d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.699+0000 7fb9bed9c700 1 -- 172.21.15.12:0/475190594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b81a1bf0 con 0x5606f7834720 2023-12-11T20:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.700+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f783d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:34:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.700+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7834720 0x5606f7844260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009fd0 tx=0x7fb9b409a260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9561638d841a942c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.700+0000 7fb9a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.701+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/475190594 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40a20b0 con 0x5606f7834720 2023-12-11T20:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.701+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/475190594 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb9b4004410 con 0x5606f7834720 2023-12-11T20:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.701+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606f7826730 con 0x5606f7834720 2023-12-11T20:34:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.702+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/475190594 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9b4004a00 con 0x5606f7834720 2023-12-11T20:34:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.704+0000 7fb9d4069b80 10 client.30140 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.704+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7fb9ac00a8f0 con 0x5606f7834720 2023-12-11T20:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.705+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/475190594 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5606f7826730 con 0x5606f7834720 2023-12-11T20:34:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.705+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/475190594 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb9b4095b10 con 0x5606f7834720 2023-12-11T20:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.705+0000 7fb9d4069b80 10 client.30140 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.705+0000 7fb9d4069b80 10 client.30140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.706+0000 7fb9d4069b80 20 client.30140 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.706+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5606f7848e10 0x5606f784b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.706+0000 7fb9d4069b80 4 client.30140 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.706+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606f7802ee0 con 0x5606f7848e10 2023-12-11T20:34:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.707+0000 7fb9be59b700 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5606f7848e10 0x5606f784b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.707+0000 7fb9be59b700 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5606f7848e10 0x5606f784b230 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b238a2f87fc9db8 server_cookie=f5ea4705f816b70 in_seq=0 out_seq=0 2023-12-11T20:34:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.707+0000 7fb9a1ffb700 10 client.30140 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.708+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/475190594 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5606f7802ee0 con 0x5606f7848e10 2023-12-11T20:34:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.708+0000 7fb9a1ffb700 10 client.30140 handle_command_reply: tid=0 2023-12-11T20:34:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.708+0000 7fb9d4069b80 1 client.30140 shutdown 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7834720 msgr2=0x5606f7844260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7834720 0x5606f7844260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009fd0 tx=0x7fb9b409a260 comp rx=0 tx=0).stop 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 shutdown_connections 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5606f7848e10 0x5606f784b230 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9a1ffb700 0 client.30140 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7834720 0x5606f7844260 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f783cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/475190594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f783d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.709+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 >> 172.21.15.12:0/475190594 conn(0x5606f7762780 msgr2=0x5606f782dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.710+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 shutdown_connections 2023-12-11T20:34:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.710+0000 7fb9d4069b80 1 -- 172.21.15.12:0/475190594 wait complete. 2023-12-11T20:34:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.710+0000 7fb9d4069b80 20 client.30140 trim_cache size 0 max 16384 2023-12-11T20:34:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.745+0000 7fb9d4069b80 1 Processor -- start 2023-12-11T20:34:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.745+0000 7fb9d4069b80 1 -- start start 2023-12-11T20:34:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.745+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7832ed0 0x5606f7844b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.745+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f7844220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.745+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7834720 0x5606f783ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.746+0000 7fb9d4069b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f782ed70 con 0x5606f7833830 2023-12-11T20:34:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.746+0000 7fb9d4069b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f7850420 con 0x5606f7832ed0 2023-12-11T20:34:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.746+0000 7fb9d4069b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f783ded0 con 0x5606f7834720 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.746+0000 7fb9be59b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7832ed0 0x5606f7844b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.746+0000 7fb9bed9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7834720 0x5606f783ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.746+0000 7fb9bed9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7834720 0x5606f783ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:57976/0 (socket says 172.21.15.12:57976) 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.746+0000 7fb9bed9c700 1 -- 172.21.15.12:0/2373812570 learned_addr learned my addr 172.21.15.12:0/2373812570 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.746+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/2373812570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f7844220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9bed9c700 1 -- 172.21.15.12:0/2373812570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7832ed0 msgr2=0x5606f7844b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/2373812570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7832ed0 0x5606f7844b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9bed9c700 1 -- 172.21.15.12:0/2373812570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 msgr2=0x5606f7844220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/2373812570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f7844220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9bed9c700 1 -- 172.21.15.12:0/2373812570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606f75b0d80 con 0x5606f7834720 2023-12-11T20:34:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/2373812570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7834720 0x5606f783ac90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400e940 tx=0x7fb9b409df30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4fa90ee889ab745 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9a97fa700 1 -- 172.21.15.12:0/2373812570 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40a20b0 con 0x5606f7834720 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9a97fa700 1 -- 172.21.15.12:0/2373812570 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9b40b7020 con 0x5606f7834720 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.747+0000 7fb9a97fa700 1 -- 172.21.15.12:0/2373812570 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4098c80 con 0x5606f7834720 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 -- 172.21.15.12:0/2373812570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7834720 msgr2=0x5606f783ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/2373812570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7834720 0x5606f783ac90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400e940 tx=0x7fb9b409df30 comp rx=0 tx=0).stop 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 -- 172.21.15.12:0/2373812570 shutdown_connections 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/2373812570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7832ed0 0x5606f7844b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/2373812570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7834720 0x5606f783ac90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/2373812570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7833830 0x5606f7844220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 -- 172.21.15.12:0/2373812570 >> 172.21.15.12:0/2373812570 conn(0x5606f7762780 msgr2=0x5606f783c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 -- 172.21.15.12:0/2373812570 shutdown_connections 2023-12-11T20:34:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.748+0000 7fb9d4069b80 1 -- 172.21.15.12:0/2373812570 wait complete. 2023-12-11T20:34:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.749+0000 7fb9d4069b80 1 -- start start 2023-12-11T20:34:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.749+0000 7fb9d4069b80 1 Processor -- start 2023-12-11T20:34:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f7841730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7841c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9d4069b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7842c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9d4069b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f78431c0 con 0x5606f7834720 2023-12-11T20:34:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9d4069b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f7843330 con 0x5606f7833830 2023-12-11T20:34:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9d4069b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f78434f0 con 0x5606f7832ed0 2023-12-11T20:34:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9d4069b80 10 client.0 _ll_register_callbacks cb 0x5606f766ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9be59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f7841730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9be59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f7841730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:57986/0 (socket says 172.21.15.12:57986) 2023-12-11T20:34:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9be59b700 1 -- 172.21.15.12:0/3689819293 learned_addr learned my addr 172.21.15.12:0/3689819293 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9bed9c700 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7842c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7841c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9be59b700 1 -- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 msgr2=0x5606f7841c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9be59b700 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7841c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9be59b700 1 -- 172.21.15.12:0/3689819293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 msgr2=0x5606f7842c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9be59b700 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7842c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9be59b700 1 -- 172.21.15.12:0/3689819293 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac00a8f0 con 0x5606f7832ed0 2023-12-11T20:34:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.750+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7841c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:34:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.751+0000 7fb9be59b700 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f7841730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009fd0 tx=0x7fb9b00099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa820fc077abe23d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.751+0000 7fb9a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:34:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.752+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/3689819293 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b002f040 con 0x5606f7832ed0 2023-12-11T20:34:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.752+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/3689819293 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb9b0003a00 con 0x5606f7832ed0 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.752+0000 7fb9d4069b80 1 -- 172.21.15.12:0/3689819293 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9ac0044b0 con 0x5606f7832ed0 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.752+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/3689819293 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9b000e040 con 0x5606f7832ed0 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.752+0000 7fb9d4069b80 10 client.30169 fetch_fsmap learned FSMap version 39 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.752+0000 7fb9d4069b80 1 -- 172.21.15.12:0/3689819293 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5606f7599c00 con 0x5606f7832ed0 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.752+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/3689819293 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9ac0044b0 con 0x5606f7832ed0 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.753+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/3689819293 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb9b00050b0 con 0x5606f7832ed0 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.753+0000 7fb9d4069b80 10 client.30169 fetch_fsmap finished waiting for FSMap version 39 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.753+0000 7fb9d4069b80 10 client.30169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.753+0000 7fb9d4069b80 20 client.30169 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.753+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5606f789fb70 0x5606f78a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.753+0000 7fb9d4069b80 4 client.30169 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.753+0000 7fb9d4069b80 1 -- 172.21.15.12:0/3689819293 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5606f774df70 con 0x5606f789fb70 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.753+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5606f789fb70 0x5606f78a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.754+0000 7fb9bdd9a700 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5606f789fb70 0x5606f78a1f90 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75cfe0c5ee1e0c53 server_cookie=d61959275bf66805 in_seq=0 out_seq=0 2023-12-11T20:34:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.754+0000 7fb9a1ffb700 10 client.30169 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.773+0000 7fb9a1ffb700 1 -- 172.21.15.12:0/3689819293 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5606f774df70 con 0x5606f789fb70 2023-12-11T20:34:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.773+0000 7fb9a1ffb700 10 client.30169 handle_command_reply: tid=0 2023-12-11T20:34:32.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.774+0000 7fb9d4069b80 1 client.30169 shutdown 2023-12-11T20:34:32.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.774+0000 7fb9d4069b80 1 -- 172.21.15.12:0/3689819293 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 msgr2=0x5606f7841730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.774+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f7841730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009fd0 tx=0x7fb9b00099e0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.775+0000 7fb9d4069b80 1 -- 172.21.15.12:0/3689819293 shutdown_connections 2023-12-11T20:34:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.775+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5606f789fb70 0x5606f78a1f90 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.775+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f7834720 0x5606f7842c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.775+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5606f7832ed0 0x5606f7841730 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.775+0000 7fb9d4069b80 1 --2- 172.21.15.12:0/3689819293 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5606f7833830 0x5606f7841c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.775+0000 7fb9d4069b80 1 -- 172.21.15.12:0/3689819293 >> 172.21.15.12:0/3689819293 conn(0x5606f7762780 msgr2=0x5606f7837940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.775+0000 7fb9a1ffb700 0 client.30169 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.775+0000 7fb9d4069b80 1 -- 172.21.15.12:0/3689819293 shutdown_connections 2023-12-11T20:34:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.776+0000 7fb9d4069b80 1 -- 172.21.15.12:0/3689819293 wait complete. 2023-12-11T20:34:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.776+0000 7fb9d4069b80 20 client.30169 trim_cache size 0 max 16384 2023-12-11T20:34:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:34:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:34:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:34:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:34:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.777+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9a40a15b0 msgr2=0x7fb9a40a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.777+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9a40a15b0 0x7fb9a40a3a70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0006280 tx=0x7fb9b0006000 comp rx=0 tx=0).stop 2023-12-11T20:34:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.777+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b8107260 msgr2=0x7fb9b81a0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.777+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b8107260 0x7fb9b81a0bb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400e970 tx=0x7fb9b400ec80 comp rx=0 tx=0).stop 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.778+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2694288244 shutdown_connections 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.778+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fb9a40a15b0 0x7fb9a40a3a70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.778+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b8102000 0x7fb9b8199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.778+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b8107260 0x7fb9b81a0bb0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.778+0000 7fb9c07ff700 1 --2- 172.21.15.12:0/2694288244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9b8104930 0x7fb9b8199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.778+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2694288244 >> 172.21.15.12:0/2694288244 conn(0x7fb9b80fb930 msgr2=0x7fb9b8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.778+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2694288244 shutdown_connections 2023-12-11T20:34:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:32.778+0000 7fb9c07ff700 1 -- 172.21.15.12:0/2694288244 wait complete. 2023-12-11T20:34:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:32 smithi032 ceph-mon[132488]: pgmap v933: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:34:33.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:32 smithi039 ceph-mon[102205]: pgmap v933: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:34:33.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:32 smithi012 ceph-mon[128787]: pgmap v933: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:34:35.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:34 smithi039 ceph-mon[102205]: pgmap v934: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.95k op/s 2023-12-11T20:34:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:34 smithi012 ceph-mon[128787]: pgmap v934: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.95k op/s 2023-12-11T20:34:35.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:34 smithi032 ceph-mon[132488]: pgmap v934: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.95k op/s 2023-12-11T20:34:37.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:36 smithi039 ceph-mon[102205]: pgmap v935: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:34:37.332 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:36 smithi012 ceph-mon[128787]: pgmap v935: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:34:37.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:36 smithi032 ceph-mon[132488]: pgmap v935: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:34:38.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:37 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:34:38.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:37 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:34:38.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:37 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:34:39.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:38 smithi039 ceph-mon[102205]: pgmap v936: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.69k op/s 2023-12-11T20:34:39.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:38 smithi012 ceph-mon[128787]: pgmap v936: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.69k op/s 2023-12-11T20:34:39.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:38 smithi032 ceph-mon[132488]: pgmap v936: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.69k op/s 2023-12-11T20:34:41.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:41 smithi039 ceph-mon[102205]: pgmap v937: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2023-12-11T20:34:41.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:41 smithi012 ceph-mon[128787]: pgmap v937: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2023-12-11T20:34:41.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:41 smithi032 ceph-mon[132488]: pgmap v937: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2023-12-11T20:34:43.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:43 smithi039 ceph-mon[102205]: pgmap v938: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:34:43.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:43 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:34:43.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:43 smithi012 ceph-mon[128787]: pgmap v938: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:34:43.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:43 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:34:43.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:43 smithi032 ceph-mon[132488]: pgmap v938: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:34:43.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:43 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:34:45.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:45 smithi039 ceph-mon[102205]: pgmap v939: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2023-12-11T20:34:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:45 smithi012 ceph-mon[128787]: pgmap v939: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2023-12-11T20:34:45.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:45 smithi032 ceph-mon[132488]: pgmap v939: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.33k op/s 2023-12-11T20:34:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.087+0000 7f10b87ff700 1 -- 172.21.15.12:0/819223243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10b00ffd30 msgr2=0x7f10b0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.087+0000 7f10b87ff700 1 --2- 172.21.15.12:0/819223243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10b00ffd30 0x7f10b0102160 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009990 tx=0x7f10ac009ca0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.087+0000 7f10b87ff700 1 -- 172.21.15.12:0/819223243 shutdown_connections 2023-12-11T20:34:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.087+0000 7f10b87ff700 1 --2- 172.21.15.12:0/819223243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10b00ffd30 0x7f10b0102160 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.087+0000 7f10b87ff700 1 --2- 172.21.15.12:0/819223243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10b0105070 0x7f10b01054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.087+0000 7f10b87ff700 1 --2- 172.21.15.12:0/819223243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10b01026a0 0x7f10b0104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.087+0000 7f10b87ff700 1 -- 172.21.15.12:0/819223243 >> 172.21.15.12:0/819223243 conn(0x7f10b00fb930 msgr2=0x7f10b00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.087+0000 7f10b87ff700 1 -- 172.21.15.12:0/819223243 shutdown_connections 2023-12-11T20:34:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.088+0000 7f10b87ff700 1 -- 172.21.15.12:0/819223243 wait complete. 2023-12-11T20:34:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.090+0000 7f10b87ff700 1 Processor -- start 2023-12-11T20:34:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.090+0000 7f10b87ff700 1 -- start start 2023-12-11T20:34:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.090+0000 7f10b87ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10b00ffd30 0x7f10b006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.090+0000 7f10b87ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10b01026a0 0x7f10b00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.090+0000 7f10b87ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10b0105070 0x7f10b01ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.090+0000 7f10b87ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0073470 con 0x7f10b01026a0 2023-12-11T20:34:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.090+0000 7f10b87ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00735b0 con 0x7f10b0105070 2023-12-11T20:34:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.090+0000 7f10b87ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0106350 con 0x7f10b00ffd30 2023-12-11T20:34:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.091+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10b01026a0 0x7f10b00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.091+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10b01026a0 0x7f10b00703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38942/0 (socket says 172.21.15.12:38942) 2023-12-11T20:34:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.091+0000 7f10b5d9a700 1 -- 172.21.15.12:0/1404037292 learned_addr learned my addr 172.21.15.12:0/1404037292 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.091+0000 7f10b659b700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10b00ffd30 0x7f10b006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.091+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10b0105070 0x7f10b01ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.092+0000 7f10b659b700 1 -- 172.21.15.12:0/1404037292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10b0105070 msgr2=0x7f10b01ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.092+0000 7f10b659b700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10b0105070 0x7f10b01ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.092+0000 7f10b659b700 1 -- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10b01026a0 msgr2=0x7f10b00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.092+0000 7f10b659b700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10b01026a0 0x7f10b00703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.092+0000 7f10b659b700 1 -- 172.21.15.12:0/1404037292 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac0095f0 con 0x7f10b00ffd30 2023-12-11T20:34:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.093+0000 7f10b659b700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10b00ffd30 0x7f10b006fea0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0098e0 tx=0x7f10ac003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.093+0000 7f10a77fe700 1 -- 172.21.15.12:0/1404037292 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac01d070 con 0x7f10b00ffd30 2023-12-11T20:34:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.093+0000 7f10a77fe700 1 -- 172.21.15.12:0/1404037292 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10ac004220 con 0x7f10b00ffd30 2023-12-11T20:34:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.093+0000 7f10a77fe700 1 -- 172.21.15.12:0/1404037292 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00fb90 con 0x7f10b00ffd30 2023-12-11T20:34:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.095+0000 7f10b87ff700 1 -- 172.21.15.12:0/1404037292 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b01065d0 con 0x7f10b00ffd30 2023-12-11T20:34:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.096+0000 7f10b87ff700 1 -- 172.21.15.12:0/1404037292 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b0106a30 con 0x7f10b00ffd30 2023-12-11T20:34:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.100+0000 7f10a77fe700 1 -- 172.21.15.12:0/1404037292 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f10ac00fcf0 con 0x7f10b00ffd30 2023-12-11T20:34:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.102+0000 7f10a77fe700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f109c0a1600 0x7f109c0a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.102+0000 7f10a77fe700 1 -- 172.21.15.12:0/1404037292 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10ac0cd7a0 con 0x7f10b00ffd30 2023-12-11T20:34:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.103+0000 7f10cc069b80 1 Processor -- start 2023-12-11T20:34:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.103+0000 7f10cc069b80 1 -- start start 2023-12-11T20:34:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.103+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466216ed0 0x5624662172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.103+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466218140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.103+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466218720 0x562466218ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.104+0000 7f10cc069b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562466172af0 con 0x562466216ed0 2023-12-11T20:34:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.104+0000 7f10cc069b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562466170410 con 0x562466217830 2023-12-11T20:34:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.104+0000 7f10cc069b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246616bd00 con 0x562466218720 2023-12-11T20:34:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.105+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466218140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.105+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466218140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40258/0 (socket says 172.21.15.12:40258) 2023-12-11T20:34:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.105+0000 7f10b5d9a700 1 -- 172.21.15.12:0/2454633089 learned_addr learned my addr 172.21.15.12:0/2454633089 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.105+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f109c0a1600 0x7f109c0a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.106+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466218720 0x562466218ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.106+0000 7f10b5d9a700 1 -- 172.21.15.12:0/2454633089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466218720 msgr2=0x562466218ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.106+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466218720 0x562466218ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.106+0000 7f10b5d9a700 1 -- 172.21.15.12:0/2454633089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466216ed0 msgr2=0x5624662172f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.106+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466216ed0 0x5624662172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.106+0000 7f10b5d9a700 1 -- 172.21.15.12:0/2454633089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562465fe85d0 con 0x562466217830 2023-12-11T20:34:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.107+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466218720 0x562466218ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.107+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f109c0a1600 0x7f109c0a3ac0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f10a0033aa0 tx=0x7f10a000a950 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.108+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466218140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f10a0033fc0 tx=0x7f10a003d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969550baef7b6d0f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.108+0000 7f10a4ff9700 1 -- 172.21.15.12:0/2454633089 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00333e0 con 0x562466217830 2023-12-11T20:34:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.108+0000 7f10a4ff9700 1 -- 172.21.15.12:0/2454633089 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10a0031d60 con 0x562466217830 2023-12-11T20:34:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.108+0000 7f10a4ff9700 1 -- 172.21.15.12:0/2454633089 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0047660 con 0x562466217830 2023-12-11T20:34:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.109+0000 7f10cc069b80 1 -- 172.21.15.12:0/2454633089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 msgr2=0x562466218140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.109+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466218140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f10a0033fc0 tx=0x7f10a003d000 comp rx=0 tx=0).stop 2023-12-11T20:34:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.109+0000 7f10cc069b80 1 -- 172.21.15.12:0/2454633089 shutdown_connections 2023-12-11T20:34:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.109+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466218720 0x562466218ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.109+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466216ed0 0x5624662172f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.109+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2454633089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466218140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.109+0000 7f10cc069b80 1 -- 172.21.15.12:0/2454633089 >> 172.21.15.12:0/2454633089 conn(0x562466146780 msgr2=0x562466213880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.110+0000 7f10cc069b80 1 -- 172.21.15.12:0/2454633089 shutdown_connections 2023-12-11T20:34:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.110+0000 7f10cc069b80 1 -- 172.21.15.12:0/2454633089 wait complete. 2023-12-11T20:34:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.111+0000 7f10cc069b80 1 -- start start 2023-12-11T20:34:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.111+0000 7f10cc069b80 1 Processor -- start 2023-12-11T20:34:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.112+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466216ed0 0x562466220eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.112+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466217830 0x5624662213f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.112+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466228220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.112+0000 7f10cc069b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562466125500 con 0x562466218720 2023-12-11T20:34:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.112+0000 7f10cc069b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624661251a0 con 0x562466216ed0 2023-12-11T20:34:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.112+0000 7f10cc069b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x562465fea8c0 con 0x562466217830 2023-12-11T20:34:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.112+0000 7f10cc069b80 10 client.0 _ll_register_callbacks cb 0x562466050a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.113+0000 7f10b6d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466228220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466217830 0x5624662213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b6d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466228220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38964/0 (socket says 172.21.15.12:38964) 2023-12-11T20:34:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b6d9c700 1 -- 172.21.15.12:0/2280656374 learned_addr learned my addr 172.21.15.12:0/2280656374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b659b700 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466216ed0 0x562466220eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b6d9c700 1 -- 172.21.15.12:0/2280656374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466217830 msgr2=0x5624662213f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466217830 0x5624662213f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b6d9c700 1 -- 172.21.15.12:0/2280656374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466216ed0 msgr2=0x562466220eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466216ed0 0x562466220eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.114+0000 7f10b6d9c700 1 -- 172.21.15.12:0/2280656374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a003b040 con 0x562466218720 2023-12-11T20:34:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.115+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466228220 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f10a8010a40 tx=0x7f10a8010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ffc9fc824f4ce0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.116+0000 7f1099ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:34:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.118+0000 7f1099ffb700 1 -- 172.21.15.12:0/2280656374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800e850 con 0x562466218720 2023-12-11T20:34:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.118+0000 7f10cc069b80 1 -- 172.21.15.12:0/2280656374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56246620a730 con 0x562466218720 2023-12-11T20:34:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.119+0000 7f1099ffb700 1 -- 172.21.15.12:0/2280656374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10a800e9b0 con 0x562466218720 2023-12-11T20:34:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.119+0000 7f1099ffb700 1 -- 172.21.15.12:0/2280656374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10a800eb90 con 0x562466218720 2023-12-11T20:34:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.120+0000 7f10cc069b80 10 client.20607 fetch_fsmap learned FSMap version 41 2023-12-11T20:34:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.120+0000 7f10cc069b80 1 -- 172.21.15.12:0/2280656374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562465f94d80 con 0x562466218720 2023-12-11T20:34:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.120+0000 7f1099ffb700 1 -- 172.21.15.12:0/2280656374 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56246620a730 con 0x562466218720 2023-12-11T20:34:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.121+0000 7f1099ffb700 1 -- 172.21.15.12:0/2280656374 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f10a8016410 con 0x562466218720 2023-12-11T20:34:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.121+0000 7f10cc069b80 10 client.20607 fetch_fsmap finished waiting for FSMap version 41 2023-12-11T20:34:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.121+0000 7f10cc069b80 10 client.20607 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.121+0000 7f10cc069b80 20 client.20607 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.121+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56246622cd80 0x56246622f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.121+0000 7f10cc069b80 4 client.20607 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.121+0000 7f10cc069b80 1 -- 172.21.15.12:0/2280656374 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624661e6ee0 con 0x56246622cd80 2023-12-11T20:34:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.121+0000 7f10b659b700 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56246622cd80 0x56246622f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.123+0000 7f10b659b700 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56246622cd80 0x56246622f1a0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a74471865fe31b7f server_cookie=6d33381c46864459 in_seq=0 out_seq=0 2023-12-11T20:34:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.123+0000 7f1099ffb700 10 client.20607 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.124+0000 7f1099ffb700 1 -- 172.21.15.12:0/2280656374 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5624661e6ee0 con 0x56246622cd80 2023-12-11T20:34:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.124+0000 7f1099ffb700 10 client.20607 handle_command_reply: tid=0 2023-12-11T20:34:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 client.20607 shutdown 2023-12-11T20:34:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 -- 172.21.15.12:0/2280656374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 msgr2=0x562466228220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466228220 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f10a8010a40 tx=0x7f10a8010e00 comp rx=0 tx=0).stop 2023-12-11T20:34:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 -- 172.21.15.12:0/2280656374 shutdown_connections 2023-12-11T20:34:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56246622cd80 0x56246622f1a0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466216ed0 0x562466220eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466228220 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 --2- 172.21.15.12:0/2280656374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466217830 0x5624662213f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f10cc069b80 1 -- 172.21.15.12:0/2280656374 >> 172.21.15.12:0/2280656374 conn(0x562466146780 msgr2=0x562466211ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.125+0000 7f1099ffb700 0 client.20607 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.126+0000 7f10cc069b80 1 -- 172.21.15.12:0/2280656374 shutdown_connections 2023-12-11T20:34:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.126+0000 7f10cc069b80 1 -- 172.21.15.12:0/2280656374 wait complete. 2023-12-11T20:34:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.126+0000 7f10cc069b80 20 client.20607 trim_cache size 0 max 16384 2023-12-11T20:34:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.169+0000 7f10cc069b80 1 Processor -- start 2023-12-11T20:34:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.169+0000 7f10cc069b80 1 -- start start 2023-12-11T20:34:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x5624662201b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466228140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466233b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10cc069b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562466220850 con 0x562466218720 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10cc069b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562466229600 con 0x562466217830 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10cc069b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246621f730 con 0x562466216ed0 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466228140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466228140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40278/0 (socket says 172.21.15.12:40278) 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10b5d9a700 1 -- 172.21.15.12:0/54997569 learned_addr learned my addr 172.21.15.12:0/54997569 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10b659b700 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x5624662201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.170+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466233b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.171+0000 7f10b5d9a700 1 -- 172.21.15.12:0/54997569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 msgr2=0x5624662201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.171+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x5624662201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.171+0000 7f10b5d9a700 1 -- 172.21.15.12:0/54997569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 msgr2=0x562466233b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.171+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466233b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.171+0000 7f10b5d9a700 1 -- 172.21.15.12:0/54997569 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562465f7dc00 con 0x562466217830 2023-12-11T20:34:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.172+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466228140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f10a000a880 tx=0x7f10a000a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d907dc49c38b55 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.173+0000 7f10a57fa700 1 -- 172.21.15.12:0/54997569 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00333e0 con 0x562466217830 2023-12-11T20:34:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.173+0000 7f10a57fa700 1 -- 172.21.15.12:0/54997569 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10a00054d0 con 0x562466217830 2023-12-11T20:34:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.173+0000 7f10a57fa700 1 -- 172.21.15.12:0/54997569 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0004cb0 con 0x562466217830 2023-12-11T20:34:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.174+0000 7f10cc069b80 1 -- 172.21.15.12:0/54997569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 msgr2=0x562466228140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.174+0000 7f10cc069b80 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466228140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f10a000a880 tx=0x7f10a000a5f0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.175+0000 7f10cc069b80 1 -- 172.21.15.12:0/54997569 shutdown_connections 2023-12-11T20:34:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.175+0000 7f10cc069b80 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466233b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.175+0000 7f10cc069b80 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x5624662201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.175+0000 7f10cc069b80 1 --2- 172.21.15.12:0/54997569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466228140 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.175+0000 7f10cc069b80 1 -- 172.21.15.12:0/54997569 >> 172.21.15.12:0/54997569 conn(0x562466146780 msgr2=0x56246621ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.175+0000 7f10cc069b80 1 -- 172.21.15.12:0/54997569 shutdown_connections 2023-12-11T20:34:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.176+0000 7f10cc069b80 1 -- 172.21.15.12:0/54997569 wait complete. 2023-12-11T20:34:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.176+0000 7f10cc069b80 1 -- start start 2023-12-11T20:34:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.177+0000 7f10cc069b80 1 Processor -- start 2023-12-11T20:34:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.178+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x562466225a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.178+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466225f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.178+0000 7f10cc069b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466226f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.178+0000 7f10cc069b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624662274c0 con 0x562466218720 2023-12-11T20:34:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.178+0000 7f10cc069b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x562466227630 con 0x562466217830 2023-12-11T20:34:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.178+0000 7f10cc069b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624662277f0 con 0x562466216ed0 2023-12-11T20:34:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.178+0000 7f10cc069b80 10 client.0 _ll_register_callbacks cb 0x562466050a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.179+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466225f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.179+0000 7f10b5d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466225f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40292/0 (socket says 172.21.15.12:40292) 2023-12-11T20:34:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.179+0000 7f10b5d9a700 1 -- 172.21.15.12:0/1230170524 learned_addr learned my addr 172.21.15.12:0/1230170524 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.179+0000 7f10b659b700 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x562466225a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466226f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f10b659b700 1 -- 172.21.15.12:0/1230170524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 msgr2=0x562466225f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f10b659b700 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466225f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f10b659b700 1 -- 172.21.15.12:0/1230170524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 msgr2=0x562466226f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f10b659b700 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466226f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f10b659b700 1 -- 172.21.15.12:0/1230170524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562465fe85d0 con 0x562466216ed0 2023-12-11T20:34:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f10b6d9c700 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466226f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f10b659b700 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x562466225a30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0cb5c0 tx=0x7f10ac00b540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a00f148dfbe30ac5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f1099ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.180+0000 7f1099ffb700 1 -- 172.21.15.12:0/1230170524 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0a2e00 con 0x562466216ed0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.181+0000 7f10cc069b80 1 -- 172.21.15.12:0/1230170524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10a0031d60 con 0x562466216ed0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.181+0000 7f1099ffb700 1 -- 172.21.15.12:0/1230170524 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10ac00f460 con 0x562466216ed0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.181+0000 7f1099ffb700 1 -- 172.21.15.12:0/1230170524 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10ac0b3150 con 0x562466216ed0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.181+0000 7f10cc069b80 10 client.30181 fetch_fsmap learned FSMap version 41 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.181+0000 7f10cc069b80 1 -- 172.21.15.12:0/1230170524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562465fbb1f0 con 0x562466216ed0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.181+0000 7f1099ffb700 1 -- 172.21.15.12:0/1230170524 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10a0031d60 con 0x562466216ed0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.182+0000 7f1099ffb700 1 -- 172.21.15.12:0/1230170524 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 41) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f10ac099ff0 con 0x562466216ed0 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.182+0000 7f10cc069b80 10 client.30181 fetch_fsmap finished waiting for FSMap version 41 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.182+0000 7f10cc069b80 10 client.30181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.182+0000 7f10cc069b80 20 client.30181 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.182+0000 7f10cc069b80 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5624662839e0 0x562466285e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.182+0000 7f10cc069b80 4 client.30181 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:34:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.182+0000 7f10cc069b80 1 -- 172.21.15.12:0/1230170524 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562466131f70 con 0x5624662839e0 2023-12-11T20:34:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.182+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5624662839e0 0x562466285e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.184+0000 7f10b5d9a700 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5624662839e0 0x562466285e00 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d0504ac74d7fec8 server_cookie=1a6faca1499ee7f4 in_seq=0 out_seq=0 2023-12-11T20:34:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.184+0000 7f1099ffb700 10 client.30181 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:46.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.198+0000 7f1099ffb700 1 -- 172.21.15.12:0/1230170524 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562466131f70 con 0x5624662839e0 2023-12-11T20:34:46.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.198+0000 7f1099ffb700 10 client.30181 handle_command_reply: tid=0 2023-12-11T20:34:46.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.198+0000 7f10cc069b80 1 client.30181 shutdown 2023-12-11T20:34:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f10cc069b80 1 -- 172.21.15.12:0/1230170524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 msgr2=0x562466225a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f10cc069b80 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x562466225a30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0cb5c0 tx=0x7f10ac00b540 comp rx=0 tx=0).stop 2023-12-11T20:34:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f10cc069b80 1 -- 172.21.15.12:0/1230170524 shutdown_connections 2023-12-11T20:34:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f10cc069b80 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5624662839e0 0x562466285e00 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f10cc069b80 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562466218720 0x562466226f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f10cc069b80 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562466216ed0 0x562466225a30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f10cc069b80 1 --2- 172.21.15.12:0/1230170524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x562466217830 0x562466225f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f10cc069b80 1 -- 172.21.15.12:0/1230170524 >> 172.21.15.12:0/1230170524 conn(0x562466146780 msgr2=0x56246621eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.199+0000 7f1099ffb700 0 client.30181 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.200+0000 7f10cc069b80 1 -- 172.21.15.12:0/1230170524 shutdown_connections 2023-12-11T20:34:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.200+0000 7f10cc069b80 1 -- 172.21.15.12:0/1230170524 wait complete. 2023-12-11T20:34:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.200+0000 7f10cc069b80 20 client.30181 trim_cache size 0 max 16384 2023-12-11T20:34:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:34:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:34:46.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:34:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:34:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 -- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f109c0a1600 msgr2=0x7f109c0a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f109c0a1600 0x7f109c0a3ac0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f10a0033aa0 tx=0x7f10a000a950 comp rx=0 tx=0).stop 2023-12-11T20:34:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 -- 172.21.15.12:0/1404037292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10b00ffd30 msgr2=0x7f10b006fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10b00ffd30 0x7f10b006fea0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0098e0 tx=0x7f10ac003a50 comp rx=0 tx=0).stop 2023-12-11T20:34:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 -- 172.21.15.12:0/1404037292 shutdown_connections 2023-12-11T20:34:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f109c0a1600 0x7f109c0a3ac0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10b0105070 0x7f10b01ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10b00ffd30 0x7f10b006fea0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 --2- 172.21.15.12:0/1404037292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10b01026a0 0x7f10b00703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 -- 172.21.15.12:0/1404037292 >> 172.21.15.12:0/1404037292 conn(0x7f10b00fb930 msgr2=0x7f10b0102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:46.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.202+0000 7f10b87ff700 1 -- 172.21.15.12:0/1404037292 shutdown_connections 2023-12-11T20:34:46.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:46.203+0000 7f10b87ff700 1 -- 172.21.15.12:0/1404037292 wait complete. 2023-12-11T20:34:47.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:47 smithi039 ceph-mon[102205]: pgmap v940: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.78k op/s 2023-12-11T20:34:47.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:47 smithi012 ceph-mon[128787]: pgmap v940: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.78k op/s 2023-12-11T20:34:47.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:47 smithi032 ceph-mon[132488]: pgmap v940: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.78k op/s 2023-12-11T20:34:48.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:48 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:34:48.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:48 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:34:48.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:48 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:34:49.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:49 smithi039 ceph-mon[102205]: pgmap v941: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.92k op/s 2023-12-11T20:34:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:49 smithi012 ceph-mon[128787]: pgmap v941: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.92k op/s 2023-12-11T20:34:49.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:49 smithi032 ceph-mon[132488]: pgmap v941: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 4.92k op/s 2023-12-11T20:34:50.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:34:50.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:34:50.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:50 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:34:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:34:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:34:50.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:50 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:34:50.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:34:50.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:34:50.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:50 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:34:51.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:51 smithi039 ceph-mon[102205]: pgmap v942: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2023-12-11T20:34:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:51 smithi012 ceph-mon[128787]: pgmap v942: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2023-12-11T20:34:51.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:51 smithi032 ceph-mon[132488]: pgmap v942: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.53k op/s 2023-12-11T20:34:53.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:53 smithi012 ceph-mon[128787]: pgmap v943: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.67k op/s 2023-12-11T20:34:53.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:53 smithi032 ceph-mon[132488]: pgmap v943: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.67k op/s 2023-12-11T20:34:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:53 smithi039 ceph-mon[102205]: pgmap v943: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.67k op/s 2023-12-11T20:34:55.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:55 smithi012 ceph-mon[128787]: pgmap v944: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2023-12-11T20:34:55.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:55 smithi032 ceph-mon[132488]: pgmap v944: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2023-12-11T20:34:55.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:55 smithi039 ceph-mon[102205]: pgmap v944: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.21k op/s 2023-12-11T20:34:57.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:57 smithi012 ceph-mon[128787]: pgmap v945: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:34:57.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:57 smithi032 ceph-mon[132488]: pgmap v945: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:34:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:57 smithi039 ceph-mon[102205]: pgmap v945: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:34:59.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:34:59 smithi012 ceph-mon[128787]: pgmap v946: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2023-12-11T20:34:59.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:34:59 smithi032 ceph-mon[132488]: pgmap v946: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2023-12-11T20:34:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.493+0000 7f7421dff700 1 -- 172.21.15.12:0/3875311643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 msgr2=0x7f741c1054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.493+0000 7f7421dff700 1 --2- 172.21.15.12:0/3875311643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 0x7f741c1054f0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f7414009f90 tx=0x7f741400b330 comp rx=0 tx=0).stop 2023-12-11T20:34:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.494+0000 7f7421dff700 1 -- 172.21.15.12:0/3875311643 shutdown_connections 2023-12-11T20:34:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.494+0000 7f7421dff700 1 --2- 172.21.15.12:0/3875311643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 0x7f741c1054f0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.494+0000 7f7421dff700 1 --2- 172.21.15.12:0/3875311643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c0ffd30 0x7f741c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.494+0000 7f7421dff700 1 --2- 172.21.15.12:0/3875311643 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c1026a0 0x7f741c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.494+0000 7f7421dff700 1 -- 172.21.15.12:0/3875311643 >> 172.21.15.12:0/3875311643 conn(0x7f741c0fb930 msgr2=0x7f741c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.495+0000 7f7421dff700 1 -- 172.21.15.12:0/3875311643 shutdown_connections 2023-12-11T20:34:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.495+0000 7f7421dff700 1 -- 172.21.15.12:0/3875311643 wait complete. 2023-12-11T20:34:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.496+0000 7f7421dff700 1 Processor -- start 2023-12-11T20:34:59.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.497+0000 7f7421dff700 1 -- start start 2023-12-11T20:34:59.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.497+0000 7f7421dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c0ffd30 0x7f741c10b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.497+0000 7f7421dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c1026a0 0x7f741c10b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.497+0000 7f7421dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 0x7f741c1adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.497+0000 7f7421dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c10bf20 con 0x7f741c105070 2023-12-11T20:34:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.497+0000 7f7421dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1adff0 con 0x7f741c1026a0 2023-12-11T20:34:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.497+0000 7f7421dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1ae130 con 0x7f741c0ffd30 2023-12-11T20:34:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.498+0000 7f741bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 0x7f741c1adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.498+0000 7f741bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 0x7f741c1adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38722/0 (socket says 172.21.15.12:38722) 2023-12-11T20:34:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.498+0000 7f741bfff700 1 -- 172.21.15.12:0/2226305047 learned_addr learned my addr 172.21.15.12:0/2226305047 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.499+0000 7f741b7fe700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c0ffd30 0x7f741c10b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.500+0000 7f741b7fe700 1 -- 172.21.15.12:0/2226305047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c1026a0 msgr2=0x7f741c10b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.500+0000 7f741affd700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c1026a0 0x7f741c10b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.500+0000 7f741b7fe700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c1026a0 0x7f741c10b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.500+0000 7f741b7fe700 1 -- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 msgr2=0x7f741c1adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.500+0000 7f741b7fe700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 0x7f741c1adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.500+0000 7f741b7fe700 1 -- 172.21.15.12:0/2226305047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009c40 con 0x7f741c0ffd30 2023-12-11T20:34:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.501+0000 7f741affd700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c1026a0 0x7f741c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:34:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.501+0000 7f741bfff700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 0x7f741c1adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.502+0000 7f741b7fe700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c0ffd30 0x7f741c10b380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f740c00b450 tx=0x7f740c00b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.502+0000 7f7418ff9700 1 -- 172.21.15.12:0/2226305047 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c011830 con 0x7f741c0ffd30 2023-12-11T20:34:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.502+0000 7f7418ff9700 1 -- 172.21.15.12:0/2226305047 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f740c011e20 con 0x7f741c0ffd30 2023-12-11T20:34:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.502+0000 7f7418ff9700 1 -- 172.21.15.12:0/2226305047 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c010c90 con 0x7f741c0ffd30 2023-12-11T20:34:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.502+0000 7f7421dff700 1 -- 172.21.15.12:0/2226305047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c1ae360 con 0x7f741c0ffd30 2023-12-11T20:34:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.503+0000 7f7421dff700 1 -- 172.21.15.12:0/2226305047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c1ae820 con 0x7f741c0ffd30 2023-12-11T20:34:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.508+0000 7f7418ff9700 1 -- 172.21.15.12:0/2226305047 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f740c01a400 con 0x7f741c0ffd30 2023-12-11T20:34:59.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.510+0000 7f7418ff9700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74040a15b0 0x7f74040a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.511+0000 7f743580ab80 1 Processor -- start 2023-12-11T20:34:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.512+0000 7f7418ff9700 1 -- 172.21.15.12:0/2226305047 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f740c0cc410 con 0x7f741c0ffd30 2023-12-11T20:34:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.512+0000 7f743580ab80 1 -- start start 2023-12-11T20:34:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.512+0000 7f743580ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.513+0000 7f743580ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b02140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.513+0000 7f743580ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 0x5599e9b02ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.513+0000 7f743580ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9a5caf0 con 0x5599e9b00ed0 2023-12-11T20:34:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.513+0000 7f743580ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9a5a410 con 0x5599e9b02720 2023-12-11T20:34:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.513+0000 7f743580ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9a55d00 con 0x5599e9b01830 2023-12-11T20:34:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.514+0000 7f741bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 0x5599e9b02ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.514+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.514+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38738/0 (socket says 172.21.15.12:38738) 2023-12-11T20:34:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.514+0000 7f741b7fe700 1 -- 172.21.15.12:0/3912120132 learned_addr learned my addr 172.21.15.12:0/3912120132 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.514+0000 7f741affd700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74040a15b0 0x7f74040a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.514+0000 7f741affd700 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b02140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.515+0000 7f741bfff700 1 -- 172.21.15.12:0/3912120132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 msgr2=0x5599e9b02140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.515+0000 7f741bfff700 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b02140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.515+0000 7f741bfff700 1 -- 172.21.15.12:0/3912120132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 msgr2=0x5599e9b012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.515+0000 7f741affd700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74040a15b0 0x7f74040a3a70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7410005fd0 tx=0x7f7410009870 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.515+0000 7f741bfff700 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.516+0000 7f741bfff700 1 -- 172.21.15.12:0/3912120132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599e98d25d0 con 0x5599e9b02720 2023-12-11T20:34:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.516+0000 7f741b7fe700 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.516+0000 7f741bfff700 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 0x5599e9b02ba0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7414007970 tx=0x7f7414007bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0bbf2a3c381d87a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.516+0000 7f7401ffb700 1 -- 172.21.15.12:0/3912120132 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400e040 con 0x5599e9b02720 2023-12-11T20:34:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.517+0000 7f7401ffb700 1 -- 172.21.15.12:0/3912120132 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7414003e90 con 0x5599e9b02720 2023-12-11T20:34:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.517+0000 7f7401ffb700 1 -- 172.21.15.12:0/3912120132 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140053b0 con 0x5599e9b02720 2023-12-11T20:34:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.517+0000 7f743580ab80 1 -- 172.21.15.12:0/3912120132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 msgr2=0x5599e9b02ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.517+0000 7f743580ab80 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 0x5599e9b02ba0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7414007970 tx=0x7f7414007bf0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.518+0000 7f743580ab80 1 -- 172.21.15.12:0/3912120132 shutdown_connections 2023-12-11T20:34:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.518+0000 7f743580ab80 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 0x5599e9b02ba0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.518+0000 7f743580ab80 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.518+0000 7f743580ab80 1 --2- 172.21.15.12:0/3912120132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b02140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.518+0000 7f743580ab80 1 -- 172.21.15.12:0/3912120132 >> 172.21.15.12:0/3912120132 conn(0x5599e9a30780 msgr2=0x5599e9afd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.518+0000 7f743580ab80 1 -- 172.21.15.12:0/3912120132 shutdown_connections 2023-12-11T20:34:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.518+0000 7f743580ab80 1 -- 172.21.15.12:0/3912120132 wait complete. 2023-12-11T20:34:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.519+0000 7f743580ab80 1 -- start start 2023-12-11T20:34:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.519+0000 7f743580ab80 1 Processor -- start 2023-12-11T20:34:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.520+0000 7f743580ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b00ed0 0x5599e9b0ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.520+0000 7f743580ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b0b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.520+0000 7f743580ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b02720 0x5599e9b121f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.520+0000 7f743580ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9a0f500 con 0x5599e9b02720 2023-12-11T20:34:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.520+0000 7f743580ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9a0f1a0 con 0x5599e9b00ed0 2023-12-11T20:34:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.520+0000 7f743580ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e98d48c0 con 0x5599e9b01830 2023-12-11T20:34:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.520+0000 7f743580ab80 10 client.0 _ll_register_callbacks cb 0x5599e993aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.522+0000 7f741bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b02720 0x5599e9b121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.522+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b00ed0 0x5599e9b0ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.522+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b00ed0 0x5599e9b0ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:40868/0 (socket says 172.21.15.12:40868) 2023-12-11T20:34:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.522+0000 7f741b7fe700 1 -- 172.21.15.12:0/1185129829 learned_addr learned my addr 172.21.15.12:0/1185129829 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.522+0000 7f741affd700 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b0b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.523+0000 7f741affd700 1 -- 172.21.15.12:0/1185129829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b00ed0 msgr2=0x5599e9b0ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:59.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.523+0000 7f741affd700 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b00ed0 0x5599e9b0ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.523+0000 7f741affd700 1 -- 172.21.15.12:0/1185129829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b02720 msgr2=0x5599e9b121f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.523+0000 7f741affd700 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b02720 0x5599e9b121f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.523+0000 7f741affd700 1 -- 172.21.15.12:0/1185129829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c1ae820 con 0x5599e9b01830 2023-12-11T20:34:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.523+0000 7f741bfff700 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b02720 0x5599e9b121f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.523+0000 7f741affd700 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b0b3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7410009b70 tx=0x7f74100047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c0daa559a4fe07 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.523+0000 7f73faffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:34:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.524+0000 7f73faffd700 1 -- 172.21.15.12:0/1185129829 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410004230 con 0x5599e9b01830 2023-12-11T20:34:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.524+0000 7f73faffd700 1 -- 172.21.15.12:0/1185129829 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7410012e60 con 0x5599e9b01830 2023-12-11T20:34:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.524+0000 7f743580ab80 1 -- 172.21.15.12:0/1185129829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599e9af4730 con 0x5599e9b01830 2023-12-11T20:34:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.525+0000 7f73faffd700 1 -- 172.21.15.12:0/1185129829 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7410004390 con 0x5599e9b01830 2023-12-11T20:34:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.525+0000 7f743580ab80 10 client.30190 fetch_fsmap learned FSMap version 41 2023-12-11T20:34:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.525+0000 7f743580ab80 1 -- 172.21.15.12:0/1185129829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f741c106020 con 0x5599e9b01830 2023-12-11T20:34:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.526+0000 7f73faffd700 1 -- 172.21.15.12:0/1185129829 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5599e9af4730 con 0x5599e9b01830 2023-12-11T20:34:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.526+0000 7f73faffd700 1 -- 172.21.15.12:0/1185129829 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 41) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7410029600 con 0x5599e9b01830 2023-12-11T20:34:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.526+0000 7f743580ab80 10 client.30190 fetch_fsmap finished waiting for FSMap version 41 2023-12-11T20:34:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.526+0000 7f743580ab80 10 client.30190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.526+0000 7f743580ab80 20 client.30190 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.526+0000 7f743580ab80 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5599e9b16df0 0x5599e9b19210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.527+0000 7f743580ab80 4 client.30190 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:34:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.527+0000 7f743580ab80 1 -- 172.21.15.12:0/1185129829 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599e9ad0ee0 con 0x5599e9b16df0 2023-12-11T20:34:59.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.527+0000 7f741b7fe700 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5599e9b16df0 0x5599e9b19210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.528+0000 7f741b7fe700 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5599e9b16df0 0x5599e9b19210 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56393b12b5c72b89 server_cookie=ac6dde22107059e3 in_seq=0 out_seq=0 2023-12-11T20:34:59.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.528+0000 7f73faffd700 10 client.30190 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:59.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.528+0000 7f73faffd700 1 -- 172.21.15.12:0/1185129829 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5599e9ad0ee0 con 0x5599e9b16df0 2023-12-11T20:34:59.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.528+0000 7f73faffd700 10 client.30190 handle_command_reply: tid=0 2023-12-11T20:34:59.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.528+0000 7f743580ab80 1 client.30190 shutdown 2023-12-11T20:34:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.532+0000 7f743580ab80 1 -- 172.21.15.12:0/1185129829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 msgr2=0x5599e9b0b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.532+0000 7f743580ab80 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b0b3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7410009b70 tx=0x7f74100047c0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.533+0000 7f743580ab80 1 -- 172.21.15.12:0/1185129829 shutdown_connections 2023-12-11T20:34:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.533+0000 7f743580ab80 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5599e9b16df0 0x5599e9b19210 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.533+0000 7f743580ab80 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b00ed0 0x5599e9b0ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.533+0000 7f743580ab80 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b02720 0x5599e9b121f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.533+0000 7f743580ab80 1 --2- 172.21.15.12:0/1185129829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b0b3c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.533+0000 7f743580ab80 1 -- 172.21.15.12:0/1185129829 >> 172.21.15.12:0/1185129829 conn(0x5599e9a30780 msgr2=0x5599e9afbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:59.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.534+0000 7f73faffd700 0 client.30190 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:59.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.534+0000 7f743580ab80 1 -- 172.21.15.12:0/1185129829 shutdown_connections 2023-12-11T20:34:59.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.534+0000 7f743580ab80 1 -- 172.21.15.12:0/1185129829 wait complete. 2023-12-11T20:34:59.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.535+0000 7f743580ab80 20 client.30190 trim_cache size 0 max 16384 2023-12-11T20:34:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:34:59 smithi039 ceph-mon[102205]: pgmap v946: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2023-12-11T20:34:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.582+0000 7f743580ab80 1 Processor -- start 2023-12-11T20:34:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.582+0000 7f743580ab80 1 -- start start 2023-12-11T20:34:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.583+0000 7f743580ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.583+0000 7f743580ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b121b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.583+0000 7f743580ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 0x5599e9afd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.583+0000 7f743580ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9b1e460 con 0x5599e9b00ed0 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.583+0000 7f743580ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9b0be60 con 0x5599e9b02720 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.583+0000 7f743580ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9b00950 con 0x5599e9b01830 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.583+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.584+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b191e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38768/0 (socket says 172.21.15.12:38768) 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.584+0000 7f741b7fe700 1 -- 172.21.15.12:0/1381721343 learned_addr learned my addr 172.21.15.12:0/1381721343 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.584+0000 7f741affd700 1 --2- 172.21.15.12:0/1381721343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.584+0000 7f741b7fe700 1 -- 172.21.15.12:0/1381721343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 msgr2=0x5599e9b121b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.584+0000 7f741b7fe700 1 --2- 172.21.15.12:0/1381721343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b121b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.584+0000 7f741b7fe700 1 -- 172.21.15.12:0/1381721343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 msgr2=0x5599e9afd460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.584+0000 7f741b7fe700 1 --2- 172.21.15.12:0/1381721343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 0x5599e9afd460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.584+0000 7f741b7fe700 1 -- 172.21.15.12:0/1381721343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599e987ed80 con 0x5599e9b00ed0 2023-12-11T20:34:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.585+0000 7f741b7fe700 1 --2- 172.21.15.12:0/1381721343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b191e0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f740c09a4d0 tx=0x7f740c004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a652d62e7792458 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.585+0000 7f74027fc700 1 -- 172.21.15.12:0/1381721343 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c09e690 con 0x5599e9b00ed0 2023-12-11T20:34:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.585+0000 7f74027fc700 1 -- 172.21.15.12:0/1381721343 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f740c0b1070 con 0x5599e9b00ed0 2023-12-11T20:34:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.585+0000 7f74027fc700 1 -- 172.21.15.12:0/1381721343 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0c9f70 con 0x5599e9b00ed0 2023-12-11T20:34:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.586+0000 7f743580ab80 1 -- 172.21.15.12:0/1381721343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 msgr2=0x5599e9b191e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.586+0000 7f743580ab80 1 --2- 172.21.15.12:0/1381721343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b191e0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f740c09a4d0 tx=0x7f740c004860 comp rx=0 tx=0).stop 2023-12-11T20:34:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.587+0000 7f743580ab80 1 -- 172.21.15.12:0/1381721343 shutdown_connections 2023-12-11T20:34:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.587+0000 7f743580ab80 1 --2- 172.21.15.12:0/1381721343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b02720 0x5599e9afd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.587+0000 7f743580ab80 1 --2- 172.21.15.12:0/1381721343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b191e0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.587+0000 7f743580ab80 1 --2- 172.21.15.12:0/1381721343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b01830 0x5599e9b121b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.587+0000 7f743580ab80 1 -- 172.21.15.12:0/1381721343 >> 172.21.15.12:0/1381721343 conn(0x5599e9a30780 msgr2=0x5599e9b08be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.587+0000 7f743580ab80 1 -- 172.21.15.12:0/1381721343 shutdown_connections 2023-12-11T20:34:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.587+0000 7f743580ab80 1 -- 172.21.15.12:0/1381721343 wait complete. 2023-12-11T20:34:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.587+0000 7f743580ab80 1 -- start start 2023-12-11T20:34:59.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.588+0000 7f743580ab80 1 Processor -- start 2023-12-11T20:34:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.589+0000 7f743580ab80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b0f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.589+0000 7f743580ab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b01830 0x5599e9b0fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.589+0000 7f743580ab80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b02720 0x5599e9b10c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.589+0000 7f743580ab80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9b11190 con 0x5599e9b00ed0 2023-12-11T20:34:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.589+0000 7f743580ab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9b11300 con 0x5599e9b01830 2023-12-11T20:34:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.589+0000 7f743580ab80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e9b114c0 con 0x5599e9b02720 2023-12-11T20:34:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.589+0000 7f743580ab80 10 client.0 _ll_register_callbacks cb 0x5599e993aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:34:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.590+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b0f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.590+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b0f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38772/0 (socket says 172.21.15.12:38772) 2023-12-11T20:34:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.590+0000 7f741b7fe700 1 -- 172.21.15.12:0/3407925300 learned_addr learned my addr 172.21.15.12:0/3407925300 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:34:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.591+0000 7f741bfff700 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b02720 0x5599e9b10c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.591+0000 7f741affd700 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b01830 0x5599e9b0fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.592+0000 7f741b7fe700 1 -- 172.21.15.12:0/3407925300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b02720 msgr2=0x5599e9b10c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.593+0000 7f741b7fe700 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b02720 0x5599e9b10c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.593+0000 7f741b7fe700 1 -- 172.21.15.12:0/3407925300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b01830 msgr2=0x5599e9b0fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:34:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.593+0000 7f741b7fe700 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b01830 0x5599e9b0fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.593+0000 7f741b7fe700 1 -- 172.21.15.12:0/3407925300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c1ae360 con 0x5599e9b00ed0 2023-12-11T20:34:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.593+0000 7f741bfff700 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b02720 0x5599e9b10c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:34:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.594+0000 7f741b7fe700 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b0f700 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f740c004790 tx=0x7f740c09ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcebc7dbc3acef4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:34:59.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.594+0000 7f73faffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:34:59.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.596+0000 7f73faffd700 1 -- 172.21.15.12:0/3407925300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c09e690 con 0x5599e9b00ed0 2023-12-11T20:34:59.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.596+0000 7f73faffd700 1 -- 172.21.15.12:0/3407925300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f740c0a28d0 con 0x5599e9b00ed0 2023-12-11T20:34:59.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.596+0000 7f743580ab80 1 -- 172.21.15.12:0/3407925300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7414003e90 con 0x5599e9b00ed0 2023-12-11T20:34:59.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.597+0000 7f73faffd700 1 -- 172.21.15.12:0/3407925300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f740c010380 con 0x5599e9b00ed0 2023-12-11T20:34:59.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.597+0000 7f743580ab80 10 client.20628 fetch_fsmap learned FSMap version 41 2023-12-11T20:34:59.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.597+0000 7f743580ab80 1 -- 172.21.15.12:0/3407925300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5599e9867c00 con 0x5599e9b00ed0 2023-12-11T20:34:59.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.598+0000 7f73faffd700 1 -- 172.21.15.12:0/3407925300 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7414003e90 con 0x5599e9b00ed0 2023-12-11T20:34:59.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.599+0000 7f73faffd700 1 -- 172.21.15.12:0/3407925300 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f740c080030 con 0x5599e9b00ed0 2023-12-11T20:34:59.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.599+0000 7f743580ab80 10 client.20628 fetch_fsmap finished waiting for FSMap version 41 2023-12-11T20:34:59.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.599+0000 7f743580ab80 10 client.20628 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:34:59.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.599+0000 7f743580ab80 20 client.20628 populate_metadata read hostname 'smithi012' 2023-12-11T20:34:59.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.599+0000 7f743580ab80 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5599e9b6d750 0x5599e9b6fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:34:59.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.599+0000 7f743580ab80 4 client.20628 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:34:59.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.599+0000 7f743580ab80 1 -- 172.21.15.12:0/3407925300 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5599e9a1bf70 con 0x5599e9b6d750 2023-12-11T20:34:59.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.599+0000 7f741affd700 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5599e9b6d750 0x5599e9b6fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:34:59.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.601+0000 7f741affd700 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5599e9b6d750 0x5599e9b6fb70 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9855fad90839f587 server_cookie=89d6aabab16d2257 in_seq=0 out_seq=0 2023-12-11T20:34:59.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.601+0000 7f73faffd700 10 client.20628 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f73faffd700 1 -- 172.21.15.12:0/3407925300 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5599e9a1bf70 con 0x5599e9b6d750 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f73faffd700 10 client.20628 handle_command_reply: tid=0 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 client.20628 shutdown 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 -- 172.21.15.12:0/3407925300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 msgr2=0x5599e9b0f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b0f700 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f740c004790 tx=0x7f740c09ad80 comp rx=0 tx=0).stop 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 -- 172.21.15.12:0/3407925300 shutdown_connections 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5599e9b6d750 0x5599e9b6fb70 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5599e9b02720 0x5599e9b10c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599e9b00ed0 0x5599e9b0f700 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 --2- 172.21.15.12:0/3407925300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5599e9b01830 0x5599e9b0fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.620+0000 7f743580ab80 1 -- 172.21.15.12:0/3407925300 >> 172.21.15.12:0/3407925300 conn(0x5599e9a30780 msgr2=0x5599e9afd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.621+0000 7f73faffd700 0 client.20628 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:34:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.621+0000 7f743580ab80 1 -- 172.21.15.12:0/3407925300 shutdown_connections 2023-12-11T20:34:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.622+0000 7f743580ab80 1 -- 172.21.15.12:0/3407925300 wait complete. 2023-12-11T20:34:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.622+0000 7f743580ab80 20 client.20628 trim_cache size 0 max 16384 2023-12-11T20:34:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:34:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:34:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:34:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:34:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.624+0000 7f7421dff700 1 -- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74040a15b0 msgr2=0x7f74040a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74040a15b0 0x7f74040a3a70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7410005fd0 tx=0x7f7410009870 comp rx=0 tx=0).stop 2023-12-11T20:34:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 -- 172.21.15.12:0/2226305047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c0ffd30 msgr2=0x7f741c10b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:34:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c0ffd30 0x7f741c10b380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f740c00b450 tx=0x7f740c00b760 comp rx=0 tx=0).stop 2023-12-11T20:34:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 -- 172.21.15.12:0/2226305047 shutdown_connections 2023-12-11T20:34:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f74040a15b0 0x7f74040a3a70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c105070 0x7f741c1adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f741c0ffd30 0x7f741c10b380 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 --2- 172.21.15.12:0/2226305047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c1026a0 0x7f741c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:34:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 -- 172.21.15.12:0/2226305047 >> 172.21.15.12:0/2226305047 conn(0x7f741c0fb930 msgr2=0x7f741c100610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:34:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.625+0000 7f7421dff700 1 -- 172.21.15.12:0/2226305047 shutdown_connections 2023-12-11T20:34:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:34:59.626+0000 7f7421dff700 1 -- 172.21.15.12:0/2226305047 wait complete. 2023-12-11T20:35:01.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:01 smithi032 ceph-mon[132488]: pgmap v947: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:35:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:01 smithi039 ceph-mon[102205]: pgmap v947: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:35:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:01 smithi012 ceph-mon[128787]: pgmap v947: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:35:03.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:03 smithi032 ceph-mon[132488]: pgmap v948: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:35:03.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:03 smithi039 ceph-mon[102205]: pgmap v948: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:35:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:03 smithi012 ceph-mon[128787]: pgmap v948: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:35:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:05 smithi012 ceph-mon[128787]: pgmap v949: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.15k op/s 2023-12-11T20:35:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:05 smithi032 ceph-mon[132488]: pgmap v949: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.15k op/s 2023-12-11T20:35:05.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:05 smithi039 ceph-mon[102205]: pgmap v949: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.15k op/s 2023-12-11T20:35:07.466 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:07 smithi032 ceph-mon[132488]: pgmap v950: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2023-12-11T20:35:07.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:07 smithi039 ceph-mon[102205]: pgmap v950: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2023-12-11T20:35:07.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:07 smithi012 ceph-mon[128787]: pgmap v950: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.46k op/s 2023-12-11T20:35:09.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:09 smithi032 ceph-mon[132488]: pgmap v951: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2023-12-11T20:35:09.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:09 smithi039 ceph-mon[102205]: pgmap v951: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2023-12-11T20:35:09.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:09 smithi012 ceph-mon[128787]: pgmap v951: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.62k op/s 2023-12-11T20:35:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:11 smithi032 ceph-mon[132488]: pgmap v952: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2023-12-11T20:35:11.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:11 smithi039 ceph-mon[102205]: pgmap v952: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2023-12-11T20:35:11.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:11 smithi012 ceph-mon[128787]: pgmap v952: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2023-12-11T20:35:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.904+0000 7f073e19d700 1 -- 172.21.15.12:0/2231966914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 msgr2=0x7f0730095100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:12.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.905+0000 7f073e19d700 1 --2- 172.21.15.12:0/2231966914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 0x7f0730095100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0734009990 tx=0x7f0734009ca0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.905+0000 7f073e19d700 1 -- 172.21.15.12:0/2231966914 shutdown_connections 2023-12-11T20:35:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.905+0000 7f073e19d700 1 --2- 172.21.15.12:0/2231966914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0730096870 0x7f073009d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.905+0000 7f073e19d700 1 --2- 172.21.15.12:0/2231966914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 0x7f0730095100 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.905+0000 7f073e19d700 1 --2- 172.21.15.12:0/2231966914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0730095ed0 0x7f0730096330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.905+0000 7f073e19d700 1 -- 172.21.15.12:0/2231966914 >> 172.21.15.12:0/2231966914 conn(0x7f0730090230 msgr2=0x7f0730092690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.905+0000 7f073e19d700 1 -- 172.21.15.12:0/2231966914 shutdown_connections 2023-12-11T20:35:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.905+0000 7f073e19d700 1 -- 172.21.15.12:0/2231966914 wait complete. 2023-12-11T20:35:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.906+0000 7f073e19d700 1 Processor -- start 2023-12-11T20:35:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073e19d700 1 -- start start 2023-12-11T20:35:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073e19d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 0x7f073012ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073e19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0730095ed0 0x7f073012e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073e19d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0730096870 0x7f07301353e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073d19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 0x7f073012ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073d19b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 0x7f073012ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50870/0 (socket says 172.21.15.12:50870) 2023-12-11T20:35:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073d19b700 1 -- 172.21.15.12:0/3654180096 learned_addr learned my addr 172.21.15.12:0/3654180096 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07301359b0 con 0x7f0730095ed0 2023-12-11T20:35:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0730135af0 con 0x7f0730096870 2023-12-11T20:35:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.907+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0730135c80 con 0x7f0730094ce0 2023-12-11T20:35:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.908+0000 7f073c99a700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0730095ed0 0x7f073012e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.908+0000 7f073d99c700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0730096870 0x7f07301353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.908+0000 7f073d19b700 1 -- 172.21.15.12:0/3654180096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0730096870 msgr2=0x7f07301353e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.908+0000 7f073d19b700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0730096870 0x7f07301353e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.908+0000 7f073d19b700 1 -- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0730095ed0 msgr2=0x7f073012e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.908+0000 7f073d19b700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0730095ed0 0x7f073012e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.908+0000 7f073d19b700 1 -- 172.21.15.12:0/3654180096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072800b730 con 0x7f0730094ce0 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.908+0000 7f073c99a700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0730095ed0 0x7f073012e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.909+0000 7f073d19b700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 0x7f073012ded0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0734000c00 tx=0x7f073400b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.909+0000 7f072e7fc700 1 -- 172.21.15.12:0/3654180096 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073401d070 con 0x7f0730094ce0 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.909+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07340095f0 con 0x7f0730094ce0 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.909+0000 7f072e7fc700 1 -- 172.21.15.12:0/3654180096 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f073400f460 con 0x7f0730094ce0 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.909+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07301361a0 con 0x7f0730094ce0 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.909+0000 7f072e7fc700 1 -- 172.21.15.12:0/3654180096 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073401d070 con 0x7f0730094ce0 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.916+0000 7f072e7fc700 1 -- 172.21.15.12:0/3654180096 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f073400f5d0 con 0x7f0730094ce0 2023-12-11T20:35:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.918+0000 7f072e7fc700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07240a14e0 0x7f07240a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.918+0000 7f072e7fc700 1 -- 172.21.15.12:0/3654180096 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f07340cdc90 con 0x7f0730094ce0 2023-12-11T20:35:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.920+0000 7f0752d8eb80 1 Processor -- start 2023-12-11T20:35:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.921+0000 7f0752d8eb80 1 -- start start 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.922+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8a770 0x55a1bdf8ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.922+0000 7f073c99a700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07240a14e0 0x7f07240a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.922+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf8f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.922+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf91f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.922+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdee5af0 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.922+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdee3410 con 0x55a1bdf8fb80 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.922+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdeded00 con 0x55a1bdf8a770 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.923+0000 7f073c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf8f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.923+0000 7f073c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf8f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36162/0 (socket says 172.21.15.12:36162) 2023-12-11T20:35:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.923+0000 7f073c99a700 1 -- 172.21.15.12:0/1539969541 learned_addr learned my addr 172.21.15.12:0/1539969541 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.924+0000 7f073d99c700 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf91f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.925+0000 7f073d19b700 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8a770 0x55a1bdf8ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.925+0000 7f073c99a700 1 -- 172.21.15.12:0/1539969541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8a770 msgr2=0x55a1bdf8ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.925+0000 7f073c99a700 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8a770 0x55a1bdf8ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.925+0000 7f073c99a700 1 -- 172.21.15.12:0/1539969541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8fb80 msgr2=0x55a1bdf91f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.925+0000 7f073c99a700 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf91f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.925+0000 7f073c99a700 1 -- 172.21.15.12:0/1539969541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1bdd5b5d0 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.925+0000 7f073d99c700 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf91f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:35:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.926+0000 7f073c99a700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07240a14e0 0x7f07240a39a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f072800aac0 tx=0x7f072800be70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.926+0000 7f073c99a700 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf8f640 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f072800ba50 tx=0x7f072801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65e7e9e721f73c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:12.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.927+0000 7f07237fe700 1 -- 172.21.15.12:0/1539969541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728019e00 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.927+0000 7f07237fe700 1 -- 172.21.15.12:0/1539969541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f072801c900 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.928+0000 7f0752d8eb80 1 -- 172.21.15.12:0/1539969541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 msgr2=0x55a1bdf8f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.928+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf8f640 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f072800ba50 tx=0x7f072801c000 comp rx=0 tx=0).stop 2023-12-11T20:35:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.928+0000 7f07237fe700 1 -- 172.21.15.12:0/1539969541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728026600 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.930+0000 7f0752d8eb80 1 -- 172.21.15.12:0/1539969541 shutdown_connections 2023-12-11T20:35:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.930+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf91f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.930+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8a770 0x55a1bdf8ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.930+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/1539969541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf8f640 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.930+0000 7f0752d8eb80 1 -- 172.21.15.12:0/1539969541 >> 172.21.15.12:0/1539969541 conn(0x55a1bdeb9780 msgr2=0x55a1bdf86b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:12.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.931+0000 7f0752d8eb80 1 -- 172.21.15.12:0/1539969541 shutdown_connections 2023-12-11T20:35:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.931+0000 7f0752d8eb80 1 -- 172.21.15.12:0/1539969541 wait complete. 2023-12-11T20:35:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.932+0000 7f0752d8eb80 1 -- start start 2023-12-11T20:35:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.932+0000 7f0752d8eb80 1 Processor -- start 2023-12-11T20:35:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.935+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf93e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.935+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.935+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.935+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bde98500 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.935+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bde981a0 con 0x55a1bdf8a770 2023-12-11T20:35:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.935+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdd5d8c0 con 0x55a1bdf8fb80 2023-12-11T20:35:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.935+0000 7f0752d8eb80 10 client.0 _ll_register_callbacks cb 0x55a1bddc3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:35:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d99c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d99c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:50890/0 (socket says 172.21.15.12:50890) 2023-12-11T20:35:12.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d99c700 1 -- 172.21.15.12:0/4098698408 learned_addr learned my addr 172.21.15.12:0/4098698408 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073c99a700 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d19b700 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf93e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d99c700 1 -- 172.21.15.12:0/4098698408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 msgr2=0x55a1bdf93e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d99c700 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf93e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d99c700 1 -- 172.21.15.12:0/4098698408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 msgr2=0x55a1bdf943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d99c700 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf943d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.936+0000 7f073d99c700 1 -- 172.21.15.12:0/4098698408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0728013040 con 0x55a1bdf8fb80 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.937+0000 7f073d99c700 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b410 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0738066f00 tx=0x7f073807f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba7525e7d878c34 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.937+0000 7f0720ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:35:12.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.937+0000 7f0720ff9700 1 -- 172.21.15.12:0/4098698408 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738073e60 con 0x55a1bdf8fb80 2023-12-11T20:35:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.937+0000 7f0752d8eb80 1 -- 172.21.15.12:0/4098698408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1bdf7d730 con 0x55a1bdf8fb80 2023-12-11T20:35:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.938+0000 7f0720ff9700 1 -- 172.21.15.12:0/4098698408 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f073807c5f0 con 0x55a1bdf8fb80 2023-12-11T20:35:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.938+0000 7f0720ff9700 1 -- 172.21.15.12:0/4098698408 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f073807c7b0 con 0x55a1bdf8fb80 2023-12-11T20:35:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.938+0000 7f0752d8eb80 10 client.30205 fetch_fsmap learned FSMap version 41 2023-12-11T20:35:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.938+0000 7f0752d8eb80 1 -- 172.21.15.12:0/4098698408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55a1bdd07d80 con 0x55a1bdf8fb80 2023-12-11T20:35:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f0720ff9700 1 -- 172.21.15.12:0/4098698408 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a1bdf7d730 con 0x55a1bdf8fb80 2023-12-11T20:35:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f0720ff9700 1 -- 172.21.15.12:0/4098698408 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 41) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f07380928f0 con 0x55a1bdf8fb80 2023-12-11T20:35:12.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f0752d8eb80 10 client.30205 fetch_fsmap finished waiting for FSMap version 41 2023-12-11T20:35:12.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f0752d8eb80 10 client.30205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:35:12.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f0752d8eb80 20 client.30205 populate_metadata read hostname 'smithi012' 2023-12-11T20:35:12.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a1bdfa8530 0x55a1bdfaa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f0752d8eb80 4 client.30205 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:35:12.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f0752d8eb80 1 -- 172.21.15.12:0/4098698408 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1bdf59ee0 con 0x55a1bdfa8530 2023-12-11T20:35:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.939+0000 7f073d19b700 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a1bdfa8530 0x55a1bdfaa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.940+0000 7f0720ff9700 10 client.30205 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.940+0000 7f073d19b700 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a1bdfa8530 0x55a1bdfaa950 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fd589bad935d98b server_cookie=47a72e2542f195ca in_seq=0 out_seq=0 2023-12-11T20:35:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0720ff9700 1 -- 172.21.15.12:0/4098698408 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a1bdf59ee0 con 0x55a1bdfa8530 2023-12-11T20:35:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0720ff9700 10 client.30205 handle_command_reply: tid=0 2023-12-11T20:35:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 client.30205 shutdown 2023-12-11T20:35:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 -- 172.21.15.12:0/4098698408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 msgr2=0x55a1bdf9b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b410 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0738066f00 tx=0x7f073807f720 comp rx=0 tx=0).stop 2023-12-11T20:35:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 -- 172.21.15.12:0/4098698408 shutdown_connections 2023-12-11T20:35:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a1bdfa8530 0x55a1bdfaa950 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf93e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b410 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/4098698408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0752d8eb80 1 -- 172.21.15.12:0/4098698408 >> 172.21.15.12:0/4098698408 conn(0x55a1bdeb9780 msgr2=0x55a1bdf87560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.941+0000 7f0720ff9700 0 client.30205 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.942+0000 7f0752d8eb80 1 -- 172.21.15.12:0/4098698408 shutdown_connections 2023-12-11T20:35:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.942+0000 7f0752d8eb80 1 -- 172.21.15.12:0/4098698408 wait complete. 2023-12-11T20:35:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.942+0000 7f0752d8eb80 20 client.30205 trim_cache size 0 max 16384 2023-12-11T20:35:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.973+0000 7f0752d8eb80 1 Processor -- start 2023-12-11T20:35:12.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.973+0000 7f0752d8eb80 1 -- start start 2023-12-11T20:35:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.973+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8a770 0x55a1bdf933a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.973+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf91f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.973+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.973+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdf9b8b0 con 0x55a1bdf8a770 2023-12-11T20:35:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.973+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdf93a30 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.973+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdf81640 con 0x55a1bdf8fb80 2023-12-11T20:35:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.974+0000 7f073c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf91f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.974+0000 7f073d99c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.974+0000 7f073c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf91f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:52910/0 (socket says 172.21.15.12:52910) 2023-12-11T20:35:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.975+0000 7f073c99a700 1 -- 172.21.15.12:0/289241282 learned_addr learned my addr 172.21.15.12:0/289241282 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.975+0000 7f073d19b700 1 --2- 172.21.15.12:0/289241282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8a770 0x55a1bdf933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f073c99a700 1 -- 172.21.15.12:0/289241282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 msgr2=0x55a1bdf9b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f073c99a700 1 --2- 172.21.15.12:0/289241282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f073c99a700 1 -- 172.21.15.12:0/289241282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8a770 msgr2=0x55a1bdf933a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f073c99a700 1 --2- 172.21.15.12:0/289241282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8a770 0x55a1bdf933a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f073c99a700 1 -- 172.21.15.12:0/289241282 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1bdcf0c00 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f073c99a700 1 --2- 172.21.15.12:0/289241282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf91f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f072801cfd0 tx=0x7f072801cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e246a72b901b9f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f0723fff700 1 -- 172.21.15.12:0/289241282 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072802a040 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f0723fff700 1 -- 172.21.15.12:0/289241282 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0728019dd0 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.976+0000 7f0723fff700 1 -- 172.21.15.12:0/289241282 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728004440 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.978+0000 7f0752d8eb80 1 -- 172.21.15.12:0/289241282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8b0d0 msgr2=0x55a1bdf91f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.978+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/289241282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf91f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f072801cfd0 tx=0x7f072801cf40 comp rx=0 tx=0).stop 2023-12-11T20:35:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.978+0000 7f0752d8eb80 1 -- 172.21.15.12:0/289241282 shutdown_connections 2023-12-11T20:35:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.978+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/289241282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.978+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/289241282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8a770 0x55a1bdf933a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.978+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/289241282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf91f70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.978+0000 7f0752d8eb80 1 -- 172.21.15.12:0/289241282 >> 172.21.15.12:0/289241282 conn(0x55a1bdeb9780 msgr2=0x55a1bdf8f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.979+0000 7f0752d8eb80 1 -- 172.21.15.12:0/289241282 shutdown_connections 2023-12-11T20:35:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.979+0000 7f0752d8eb80 1 -- 172.21.15.12:0/289241282 wait complete. 2023-12-11T20:35:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.979+0000 7f0752d8eb80 1 -- start start 2023-12-11T20:35:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.980+0000 7f0752d8eb80 1 Processor -- start 2023-12-11T20:35:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.980+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf96e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.980+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf973a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.980+0000 7f0752d8eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.980+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdf9a900 con 0x55a1bdf8b0d0 2023-12-11T20:35:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.980+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdf9aa70 con 0x55a1bdf8a770 2023-12-11T20:35:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f0752d8eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1bdf9ac30 con 0x55a1bdf8fb80 2023-12-11T20:35:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f0752d8eb80 10 client.0 _ll_register_callbacks cb 0x55a1bddc3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:35:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f073d19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf96e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f073d19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf96e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:52924/0 (socket says 172.21.15.12:52924) 2023-12-11T20:35:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f073d19b700 1 -- 172.21.15.12:0/3315891992 learned_addr learned my addr 172.21.15.12:0/3315891992 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f073c99a700 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f073d99c700 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f073d19b700 1 -- 172.21.15.12:0/3315891992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 msgr2=0x55a1bdf9a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f073d19b700 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.981+0000 7f073d19b700 1 -- 172.21.15.12:0/3315891992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 msgr2=0x55a1bdf973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.982+0000 7f073d19b700 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.982+0000 7f073d19b700 1 -- 172.21.15.12:0/3315891992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1bdd5b5d0 con 0x55a1bdf8a770 2023-12-11T20:35:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.982+0000 7f073c99a700 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:35:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.983+0000 7f073d19b700 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf96e60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f07340974f0 tx=0x7f0734009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bcee4dbc8ecd4e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.983+0000 7f0720ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:35:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.983+0000 7f0720ff9700 1 -- 172.21.15.12:0/3315891992 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07340a32f0 con 0x55a1bdf8a770 2023-12-11T20:35:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.983+0000 7f0720ff9700 1 -- 172.21.15.12:0/3315891992 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f073400f880 con 0x55a1bdf8a770 2023-12-11T20:35:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.984+0000 7f0752d8eb80 1 -- 172.21.15.12:0/3315891992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f072801c900 con 0x55a1bdf8a770 2023-12-11T20:35:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.985+0000 7f0720ff9700 1 -- 172.21.15.12:0/3315891992 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f073409b250 con 0x55a1bdf8a770 2023-12-11T20:35:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.985+0000 7f0752d8eb80 10 client.30191 fetch_fsmap learned FSMap version 41 2023-12-11T20:35:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.985+0000 7f0752d8eb80 1 -- 172.21.15.12:0/3315891992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55a1bdd2e1f0 con 0x55a1bdf8a770 2023-12-11T20:35:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.985+0000 7f0720ff9700 1 -- 172.21.15.12:0/3315891992 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07340b7070 con 0x55a1bdf8a770 2023-12-11T20:35:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.986+0000 7f0720ff9700 1 -- 172.21.15.12:0/3315891992 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 41) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f07340a2e60 con 0x55a1bdf8a770 2023-12-11T20:35:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.986+0000 7f0752d8eb80 10 client.30191 fetch_fsmap finished waiting for FSMap version 41 2023-12-11T20:35:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.986+0000 7f0752d8eb80 10 client.30191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:35:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.986+0000 7f0752d8eb80 20 client.30191 populate_metadata read hostname 'smithi012' 2023-12-11T20:35:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.986+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a1be010560 0x55a1be012980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.986+0000 7f0752d8eb80 4 client.30191 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:35:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.986+0000 7f0752d8eb80 1 -- 172.21.15.12:0/3315891992 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a1bdea4f70 con 0x55a1be010560 2023-12-11T20:35:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.986+0000 7f073c99a700 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a1be010560 0x55a1be012980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.987+0000 7f073c99a700 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a1be010560 0x55a1be012980 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fec96daab95bca5 server_cookie=a3bd876dd118e34c in_seq=0 out_seq=0 2023-12-11T20:35:12.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:12.987+0000 7f0720ff9700 10 client.30191 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.004+0000 7f0720ff9700 1 -- 172.21.15.12:0/3315891992 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a1bdea4f70 con 0x55a1be010560 2023-12-11T20:35:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.004+0000 7f0720ff9700 10 client.30191 handle_command_reply: tid=0 2023-12-11T20:35:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.004+0000 7f0752d8eb80 1 client.30191 shutdown 2023-12-11T20:35:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0752d8eb80 1 -- 172.21.15.12:0/3315891992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 msgr2=0x55a1bdf96e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf96e60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f07340974f0 tx=0x7f0734009ca0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0752d8eb80 1 -- 172.21.15.12:0/3315891992 shutdown_connections 2023-12-11T20:35:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a1be010560 0x55a1be012980 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a1bdf8a770 0x55a1bdf96e60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a1bdf8fb80 0x55a1bdf9a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0752d8eb80 1 --2- 172.21.15.12:0/3315891992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a1bdf8b0d0 0x55a1bdf973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0752d8eb80 1 -- 172.21.15.12:0/3315891992 >> 172.21.15.12:0/3315891992 conn(0x55a1bdeb9780 msgr2=0x55a1bdf8f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.005+0000 7f0720ff9700 0 client.30191 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.006+0000 7f0752d8eb80 1 -- 172.21.15.12:0/3315891992 shutdown_connections 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.006+0000 7f0752d8eb80 1 -- 172.21.15.12:0/3315891992 wait complete. 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.006+0000 7f0752d8eb80 20 client.30191 trim_cache size 0 max 16384 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:35:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:35:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:35:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.008+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07240a14e0 msgr2=0x7f07240a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.008+0000 7f073e19d700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07240a14e0 0x7f07240a39a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f072800aac0 tx=0x7f072800be70 comp rx=0 tx=0).stop 2023-12-11T20:35:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.008+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 msgr2=0x7f073012ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.008+0000 7f073e19d700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 0x7f073012ded0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0734000c00 tx=0x7f073400b9e0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.009+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 shutdown_connections 2023-12-11T20:35:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.009+0000 7f073e19d700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07240a14e0 0x7f07240a39a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.009+0000 7f073e19d700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0730096870 0x7f07301353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.009+0000 7f073e19d700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0730094ce0 0x7f073012ded0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.009+0000 7f073e19d700 1 --2- 172.21.15.12:0/3654180096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0730095ed0 0x7f073012e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.009+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 >> 172.21.15.12:0/3654180096 conn(0x7f0730090230 msgr2=0x7f0730099360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.010+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 shutdown_connections 2023-12-11T20:35:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:13.010+0000 7f073e19d700 1 -- 172.21.15.12:0/3654180096 wait complete. 2023-12-11T20:35:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:13 smithi032 ceph-mon[132488]: pgmap v953: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2023-12-11T20:35:13.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:13 smithi039 ceph-mon[102205]: pgmap v953: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2023-12-11T20:35:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:13 smithi012 ceph-mon[128787]: pgmap v953: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2023-12-11T20:35:15.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:15 smithi032 ceph-mon[132488]: pgmap v954: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.11k op/s 2023-12-11T20:35:15.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:15 smithi039 ceph-mon[102205]: pgmap v954: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.11k op/s 2023-12-11T20:35:15.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:15 smithi012 ceph-mon[128787]: pgmap v954: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.11k op/s 2023-12-11T20:35:17.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:17 smithi032 ceph-mon[132488]: pgmap v955: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:35:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:17 smithi039 ceph-mon[102205]: pgmap v955: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:35:17.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:17 smithi012 ceph-mon[128787]: pgmap v955: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:35:19.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:19 smithi032 ceph-mon[132488]: pgmap v956: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2023-12-11T20:35:19.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:19 smithi039 ceph-mon[102205]: pgmap v956: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2023-12-11T20:35:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:19 smithi012 ceph-mon[128787]: pgmap v956: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 4.72k op/s 2023-12-11T20:35:21.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:21 smithi032 ceph-mon[132488]: pgmap v957: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2023-12-11T20:35:21.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:21 smithi039 ceph-mon[102205]: pgmap v957: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2023-12-11T20:35:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:21 smithi012 ceph-mon[128787]: pgmap v957: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.39k op/s 2023-12-11T20:35:23.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:23 smithi032 ceph-mon[132488]: pgmap v958: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:35:23.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:23 smithi039 ceph-mon[102205]: pgmap v958: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:35:23.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:23 smithi012 ceph-mon[128787]: pgmap v958: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.66k op/s 2023-12-11T20:35:25.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:25 smithi032 ceph-mon[132488]: pgmap v959: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:35:25.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:25 smithi039 ceph-mon[102205]: pgmap v959: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:35:25.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:25 smithi012 ceph-mon[128787]: pgmap v959: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:35:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.303+0000 7f8aa95ff700 1 -- 172.21.15.12:0/3196373161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100e40 msgr2=0x7f8aa41056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.303+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/3196373161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100e40 0x7f8aa41056e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009990 tx=0x7f8a98009ca0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.304+0000 7f8aa95ff700 1 -- 172.21.15.12:0/3196373161 shutdown_connections 2023-12-11T20:35:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.304+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/3196373161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100e40 0x7f8aa41056e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.304+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/3196373161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8aa40ff350 0x7f8aa40ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.304+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/3196373161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa4100480 0x7f8aa4100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.304+0000 7f8aa95ff700 1 -- 172.21.15.12:0/3196373161 >> 172.21.15.12:0/3196373161 conn(0x7f8aa40fac70 msgr2=0x7f8aa40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.304+0000 7f8aa95ff700 1 -- 172.21.15.12:0/3196373161 shutdown_connections 2023-12-11T20:35:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.305+0000 7f8aa95ff700 1 -- 172.21.15.12:0/3196373161 wait complete. 2023-12-11T20:35:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.306+0000 7f8aa95ff700 1 Processor -- start 2023-12-11T20:35:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.307+0000 7f8aa95ff700 1 -- start start 2023-12-11T20:35:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.307+0000 7f8aa95ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa40ff350 0x7f8aa419d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.307+0000 7f8aa95ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100480 0x7f8aa419de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.307+0000 7f8aa95ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8aa4100e40 0x7f8aa41a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa95ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41a5410 con 0x7f8aa40ff350 2023-12-11T20:35:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa27fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100480 0x7f8aa419de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa27fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100480 0x7f8aa419de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58882/0 (socket says 172.21.15.12:58882) 2023-12-11T20:35:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa27fc700 1 -- 172.21.15.12:0/4249664522 learned_addr learned my addr 172.21.15.12:0/4249664522 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41a5550 con 0x7f8aa4100480 2023-12-11T20:35:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41a56e0 con 0x7f8aa4100e40 2023-12-11T20:35:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8aa4100e40 0x7f8aa41a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa37fe700 1 -- 172.21.15.12:0/4249664522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100480 msgr2=0x7f8aa419de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100480 0x7f8aa419de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa37fe700 1 -- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa40ff350 msgr2=0x7f8aa419d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa40ff350 0x7f8aa419d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.309+0000 7f8aa37fe700 1 -- 172.21.15.12:0/4249664522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a980095f0 con 0x7f8aa4100e40 2023-12-11T20:35:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.313+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8aa4100e40 0x7f8aa41a4e40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8a980098e0 tx=0x7f8a98005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.313+0000 7f8a8bfff700 1 -- 172.21.15.12:0/4249664522 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9801d070 con 0x7f8aa4100e40 2023-12-11T20:35:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.313+0000 7f8a8bfff700 1 -- 172.21.15.12:0/4249664522 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a98003f80 con 0x7f8aa4100e40 2023-12-11T20:35:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.313+0000 7f8a8bfff700 1 -- 172.21.15.12:0/4249664522 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98022aa0 con 0x7f8aa4100e40 2023-12-11T20:35:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.314+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa41a5960 con 0x7f8aa4100e40 2023-12-11T20:35:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.314+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa41a5d30 con 0x7f8aa4100e40 2023-12-11T20:35:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.320+0000 7f8a8bfff700 1 -- 172.21.15.12:0/4249664522 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f8a98003af0 con 0x7f8aa4100e40 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.321+0000 7f8abcee7b80 1 Processor -- start 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.321+0000 7f8abcee7b80 1 -- start start 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.322+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3140ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.322+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a314100140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.322+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a314100ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.322+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a31405aaf0 con 0x55a314100720 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.322+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a314058410 con 0x55a3140ff830 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.322+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a314053d00 con 0x55a3140feed0 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.324+0000 7f8aa27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3140ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.324+0000 7f8aa27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3140ff2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55114/0 (socket says 172.21.15.12:55114) 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.324+0000 7f8aa27fc700 1 -- 172.21.15.12:0/447538538 learned_addr learned my addr 172.21.15.12:0/447538538 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.325+0000 7f8aa27fc700 1 -- 172.21.15.12:0/447538538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 msgr2=0x55a314100140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.325+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/447538538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a314100140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.325+0000 7f8aa27fc700 1 -- 172.21.15.12:0/447538538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 msgr2=0x55a314100ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.325+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/447538538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a314100ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.325+0000 7f8aa27fc700 1 -- 172.21.15.12:0/447538538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a313ed05d0 con 0x55a3140feed0 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.326+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/447538538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3140ff2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400be20 tx=0x7f8a940126d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba8b577d3a13ab6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.326+0000 7f8a8bfff700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a8c0a1570 0x7f8a8c0a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.326+0000 7f8a897fa700 1 -- 172.21.15.12:0/447538538 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004830 con 0x55a3140feed0 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.326+0000 7f8a897fa700 1 -- 172.21.15.12:0/447538538 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a94004e20 con 0x55a3140feed0 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.326+0000 7f8a8bfff700 1 -- 172.21.15.12:0/4249664522 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a980ce0c0 con 0x7f8aa4100e40 2023-12-11T20:35:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.326+0000 7f8a897fa700 1 -- 172.21.15.12:0/447538538 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004830 con 0x55a3140feed0 2023-12-11T20:35:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.328+0000 7f8abcee7b80 1 -- 172.21.15.12:0/447538538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 msgr2=0x55a3140ff2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.328+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/447538538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3140ff2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400be20 tx=0x7f8a940126d0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.329+0000 7f8abcee7b80 1 -- 172.21.15.12:0/447538538 shutdown_connections 2023-12-11T20:35:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.329+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/447538538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a314100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.329+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/447538538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3140ff2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.329+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/447538538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a314100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.329+0000 7f8abcee7b80 1 -- 172.21.15.12:0/447538538 >> 172.21.15.12:0/447538538 conn(0x55a31402e780 msgr2=0x55a3140fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.331+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a8c0a1570 0x7f8a8c0a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.331+0000 7f8abcee7b80 1 -- 172.21.15.12:0/447538538 shutdown_connections 2023-12-11T20:35:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.331+0000 7f8abcee7b80 1 -- 172.21.15.12:0/447538538 wait complete. 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.332+0000 7f8abcee7b80 1 -- start start 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.333+0000 7f8abcee7b80 1 Processor -- start 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.333+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a8c0a1570 0x7f8a8c0a3a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009550 tx=0x7f8a9c009050 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.335+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a314119d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.335+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a31411a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.335+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a3141210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.335+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a31400d500 con 0x55a314100720 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.335+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a31400d1a0 con 0x55a3140ff830 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.335+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a313ed28c0 con 0x55a3140feed0 2023-12-11T20:35:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.335+0000 7f8abcee7b80 10 client.0 _ll_register_callbacks cb 0x55a313f38a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a314119d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a314119d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:55128/0 (socket says 172.21.15.12:55128) 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa2ffd700 1 -- 172.21.15.12:0/906576356 learned_addr learned my addr 172.21.15.12:0/906576356 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a3141210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a31411a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa2ffd700 1 -- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 msgr2=0x55a31411a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a31411a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa2ffd700 1 -- 172.21.15.12:0/906576356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 msgr2=0x55a3141210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a3141210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa2ffd700 1 -- 172.21.15.12:0/906576356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9400bb00 con 0x55a3140feed0 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.336+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a31411a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.337+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a314119d80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009a30 tx=0x7f8a9c009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5246aa7471a83e2b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.337+0000 7f8a86ff5700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:35:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.337+0000 7f8a86ff5700 1 -- 172.21.15.12:0/906576356 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c01c070 con 0x55a3140feed0 2023-12-11T20:35:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.337+0000 7f8abcee7b80 1 -- 172.21.15.12:0/906576356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3140f2730 con 0x55a3140feed0 2023-12-11T20:35:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.337+0000 7f8a86ff5700 1 -- 172.21.15.12:0/906576356 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a9c003a00 con 0x55a3140feed0 2023-12-11T20:35:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.338+0000 7f8a86ff5700 1 -- 172.21.15.12:0/906576356 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9c003bc0 con 0x55a3140feed0 2023-12-11T20:35:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.338+0000 7f8abcee7b80 10 client.30223 fetch_fsmap learned FSMap version 42 2023-12-11T20:35:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.338+0000 7f8abcee7b80 1 -- 172.21.15.12:0/906576356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55a313e7cd80 con 0x55a3140feed0 2023-12-11T20:35:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.338+0000 7f8a86ff5700 1 -- 172.21.15.12:0/906576356 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a9c00f040 con 0x55a3140feed0 2023-12-11T20:35:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.339+0000 7f8a86ff5700 1 -- 172.21.15.12:0/906576356 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 42) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f8a9c020410 con 0x55a3140feed0 2023-12-11T20:35:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.339+0000 7f8abcee7b80 10 client.30223 fetch_fsmap finished waiting for FSMap version 42 2023-12-11T20:35:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.339+0000 7f8abcee7b80 10 client.30223 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:35:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.339+0000 7f8abcee7b80 20 client.30223 populate_metadata read hostname 'smithi012' 2023-12-11T20:35:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.339+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a314125c40 0x55a3141280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.339+0000 7f8abcee7b80 4 client.30223 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:35:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.339+0000 7f8abcee7b80 1 -- 172.21.15.12:0/906576356 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3140f2730 con 0x55a314125c40 2023-12-11T20:35:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.339+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a314125c40 0x55a3141280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.340+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a314125c40 0x55a3141280c0 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f881cb8c40f334 server_cookie=c06b36467bc968a in_seq=0 out_seq=0 2023-12-11T20:35:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.341+0000 7f8a86ff5700 10 client.30223 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.341+0000 7f8a86ff5700 1 -- 172.21.15.12:0/906576356 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a3140f2730 con 0x55a314125c40 2023-12-11T20:35:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.341+0000 7f8a86ff5700 10 client.30223 handle_command_reply: tid=0 2023-12-11T20:35:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.341+0000 7f8abcee7b80 1 client.30223 shutdown 2023-12-11T20:35:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.342+0000 7f8abcee7b80 1 -- 172.21.15.12:0/906576356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 msgr2=0x55a314119d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.342+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a314119d80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009a30 tx=0x7f8a9c009600 comp rx=0 tx=0).stop 2023-12-11T20:35:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.343+0000 7f8abcee7b80 1 -- 172.21.15.12:0/906576356 shutdown_connections 2023-12-11T20:35:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.343+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a314125c40 0x55a3141280c0 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.343+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a3141210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.343+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a314119d80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.343+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/906576356 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a31411a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.343+0000 7f8abcee7b80 1 -- 172.21.15.12:0/906576356 >> 172.21.15.12:0/906576356 conn(0x55a31402e780 msgr2=0x55a3140f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.343+0000 7f8a86ff5700 0 client.30223 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.344+0000 7f8abcee7b80 1 -- 172.21.15.12:0/906576356 shutdown_connections 2023-12-11T20:35:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.344+0000 7f8abcee7b80 1 -- 172.21.15.12:0/906576356 wait complete. 2023-12-11T20:35:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.344+0000 7f8abcee7b80 20 client.30223 trim_cache size 0 max 16384 2023-12-11T20:35:26.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.380+0000 7f8abcee7b80 1 Processor -- start 2023-12-11T20:35:26.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.380+0000 7f8abcee7b80 1 -- start start 2023-12-11T20:35:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.381+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3140feed0 0x55a314121980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.381+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140ff830 0x55a314121030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.381+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a314100720 0x55a31412ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.381+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3140f4b10 con 0x55a3140feed0 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.381+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a314103ff0 con 0x55a314100720 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.381+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3140f24c0 con 0x55a3140ff830 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.381+0000 7f8aa2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3140feed0 0x55a314121980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3140feed0 0x55a314121980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42780/0 (socket says 172.21.15.12:42780) 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa2ffd700 1 -- 172.21.15.12:0/2225109194 learned_addr learned my addr 172.21.15.12:0/2225109194 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a314100720 0x55a31412ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa2ffd700 1 -- 172.21.15.12:0/2225109194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140ff830 msgr2=0x55a314121030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140ff830 0x55a314121030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140ff830 0x55a314121030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa2ffd700 1 -- 172.21.15.12:0/2225109194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a314100720 msgr2=0x55a31412ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a314100720 0x55a31412ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa2ffd700 1 -- 172.21.15.12:0/2225109194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a313e65c00 con 0x55a3140feed0 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a314100720 0x55a31412ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.382+0000 7f8aa27fc700 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140ff830 0x55a314121030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.383+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3140feed0 0x55a314121980 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c004b10 tx=0x7f8a9c009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b28f2cb8e1617e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.383+0000 7f8a89ffb700 1 -- 172.21.15.12:0/2225109194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c01c070 con 0x55a3140feed0 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.383+0000 7f8a89ffb700 1 -- 172.21.15.12:0/2225109194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a9c00f040 con 0x55a3140feed0 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.383+0000 7f8a89ffb700 1 -- 172.21.15.12:0/2225109194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c004260 con 0x55a3140feed0 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.384+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2225109194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3140feed0 msgr2=0x55a314121980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.384+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3140feed0 0x55a314121980 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c004b10 tx=0x7f8a9c009f10 comp rx=0 tx=0).stop 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.384+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2225109194 shutdown_connections 2023-12-11T20:35:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.384+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a314100720 0x55a31412ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.384+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a3140feed0 0x55a314121980 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.384+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2225109194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140ff830 0x55a314121030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.384+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2225109194 >> 172.21.15.12:0/2225109194 conn(0x55a31402e780 msgr2=0x55a3140fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.384+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2225109194 shutdown_connections 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.385+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2225109194 wait complete. 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.385+0000 7f8abcee7b80 1 -- start start 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.386+0000 7f8abcee7b80 1 Processor -- start 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.387+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3141761a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.387+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a3141786f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.387+0000 7f8abcee7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a31417ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a31417b440 con 0x55a314100720 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a31417b5b0 con 0x55a3140ff830 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8abcee7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a31417b770 con 0x55a3140feed0 2023-12-11T20:35:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8abcee7b80 10 client.0 _ll_register_callbacks cb 0x55a314128550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8aa27fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a3141786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8aa37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a31417ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8aa37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a31417ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42792/0 (socket says 172.21.15.12:42792) 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8aa27fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a3141786f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:58924/0 (socket says 172.21.15.12:58924) 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8aa37fe700 1 -- 172.21.15.12:0/2019257510 learned_addr learned my addr 172.21.15.12:0/2019257510 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.388+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3141761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.389+0000 7f8aa37fe700 1 -- 172.21.15.12:0/2019257510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 msgr2=0x55a3141761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.389+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3141761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.389+0000 7f8aa37fe700 1 -- 172.21.15.12:0/2019257510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 msgr2=0x55a3141786f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.389+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a3141786f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.389+0000 7f8aa37fe700 1 -- 172.21.15.12:0/2019257510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a313e7cd80 con 0x55a314100720 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.390+0000 7f8aa37fe700 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a31417ace0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800c010 tx=0x7f8a9809b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4995ae54dd7bb90 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.390+0000 7f8a86ff5700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:35:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.390+0000 7f8a86ff5700 1 -- 172.21.15.12:0/2019257510 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98003da0 con 0x55a314100720 2023-12-11T20:35:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.390+0000 7f8a86ff5700 1 -- 172.21.15.12:0/2019257510 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a9809bac0 con 0x55a314100720 2023-12-11T20:35:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.391+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2019257510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a94004e20 con 0x55a314100720 2023-12-11T20:35:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.391+0000 7f8a86ff5700 1 -- 172.21.15.12:0/2019257510 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9809b3c0 con 0x55a314100720 2023-12-11T20:35:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.391+0000 7f8abcee7b80 10 client.20655 fetch_fsmap learned FSMap version 42 2023-12-11T20:35:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.391+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2019257510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55a313ea31f0 con 0x55a314100720 2023-12-11T20:35:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.392+0000 7f8a86ff5700 1 -- 172.21.15.12:0/2019257510 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a94004e20 con 0x55a314100720 2023-12-11T20:35:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.392+0000 7f8a86ff5700 1 -- 172.21.15.12:0/2019257510 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f8a980a3230 con 0x55a314100720 2023-12-11T20:35:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.396+0000 7f8abcee7b80 10 client.20655 fetch_fsmap finished waiting for FSMap version 42 2023-12-11T20:35:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.396+0000 7f8abcee7b80 10 client.20655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:35:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.396+0000 7f8abcee7b80 20 client.20655 populate_metadata read hostname 'smithi012' 2023-12-11T20:35:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.396+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a31417cd80 0x55a31417f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.397+0000 7f8abcee7b80 4 client.20655 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:35:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.397+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2019257510 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a3140ceee0 con 0x55a31417cd80 2023-12-11T20:35:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.397+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a31417cd80 0x55a31417f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.400+0000 7f8aa2ffd700 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a31417cd80 0x55a31417f1a0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9729a98f83d1d894 server_cookie=987f34f5ace19914 in_seq=0 out_seq=0 2023-12-11T20:35:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.400+0000 7f8a86ff5700 10 client.20655 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.417+0000 7f8a86ff5700 1 -- 172.21.15.12:0/2019257510 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a3140ceee0 con 0x55a31417cd80 2023-12-11T20:35:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.418+0000 7f8a86ff5700 10 client.20655 handle_command_reply: tid=0 2023-12-11T20:35:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.418+0000 7f8abcee7b80 1 client.20655 shutdown 2023-12-11T20:35:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.420+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2019257510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 msgr2=0x55a31417ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.420+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a31417ace0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800c010 tx=0x7f8a9809b030 comp rx=0 tx=0).stop 2023-12-11T20:35:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2019257510 shutdown_connections 2023-12-11T20:35:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55a31417cd80 0x55a31417f1a0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a314100720 0x55a31417ace0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a3140feed0 0x55a3141761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8abcee7b80 1 --2- 172.21.15.12:0/2019257510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55a3140ff830 0x55a3141786f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2019257510 >> 172.21.15.12:0/2019257510 conn(0x55a31402e780 msgr2=0x55a31412ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8a86ff5700 0 client.20655 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2019257510 shutdown_connections 2023-12-11T20:35:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.422+0000 7f8abcee7b80 1 -- 172.21.15.12:0/2019257510 wait complete. 2023-12-11T20:35:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.423+0000 7f8abcee7b80 20 client.20655 trim_cache size 0 max 16384 2023-12-11T20:35:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:35:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:35:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:35:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:35:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a8c0a1570 msgr2=0x7f8a8c0a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a8c0a1570 0x7f8a8c0a3a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009550 tx=0x7f8a9c009050 comp rx=0 tx=0).stop 2023-12-11T20:35:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8aa4100e40 msgr2=0x7f8aa41a4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8aa4100e40 0x7f8aa41a4e40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8a980098e0 tx=0x7f8a98005740 comp rx=0 tx=0).stop 2023-12-11T20:35:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 shutdown_connections 2023-12-11T20:35:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f8a8c0a1570 0x7f8a8c0a3a30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8aa4100e40 0x7f8aa41a4e40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa40ff350 0x7f8aa419d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 --2- 172.21.15.12:0/4249664522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8aa4100480 0x7f8aa419de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 >> 172.21.15.12:0/4249664522 conn(0x7f8aa40fac70 msgr2=0x7f8aa41016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.424+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 shutdown_connections 2023-12-11T20:35:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:26.425+0000 7f8aa95ff700 1 -- 172.21.15.12:0/4249664522 wait complete. 2023-12-11T20:35:27.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:27 smithi032 ceph-mon[132488]: pgmap v960: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2023-12-11T20:35:27.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:27 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:35:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:27 smithi039 ceph-mon[102205]: pgmap v960: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2023-12-11T20:35:27.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:27 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:27 smithi012 ceph-mon[128787]: pgmap v960: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.64k op/s 2023-12-11T20:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:27 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:35:29.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:29 smithi032 ceph-mon[132488]: pgmap v961: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:35:29.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:29 smithi039 ceph-mon[102205]: pgmap v961: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:35:29.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:29 smithi012 ceph-mon[128787]: pgmap v961: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 4.79k op/s 2023-12-11T20:35:31.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:31 smithi032 ceph-mon[132488]: pgmap v962: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:35:31.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:31 smithi039 ceph-mon[102205]: pgmap v962: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:35:31.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:31 smithi012 ceph-mon[128787]: pgmap v962: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:35:33.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:33 smithi032 ceph-mon[132488]: pgmap v963: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:35:33.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:33 smithi039 ceph-mon[102205]: pgmap v963: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:35:33.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:33 smithi012 ceph-mon[128787]: pgmap v963: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:35:35.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:35 smithi032 ceph-mon[132488]: pgmap v964: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.14k op/s 2023-12-11T20:35:35.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:35 smithi039 ceph-mon[102205]: pgmap v964: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.14k op/s 2023-12-11T20:35:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:35 smithi012 ceph-mon[128787]: pgmap v964: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.14k op/s 2023-12-11T20:35:37.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:37 smithi032 ceph-mon[132488]: pgmap v965: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2023-12-11T20:35:37.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:37 smithi039 ceph-mon[102205]: pgmap v965: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2023-12-11T20:35:37.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:37 smithi012 ceph-mon[128787]: pgmap v965: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.45k op/s 2023-12-11T20:35:39.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:39 smithi032 ceph-mon[132488]: pgmap v966: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.56k op/s 2023-12-11T20:35:39.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:39 smithi039 ceph-mon[102205]: pgmap v966: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.56k op/s 2023-12-11T20:35:39.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:39 smithi012 ceph-mon[128787]: pgmap v966: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.56k op/s 2023-12-11T20:35:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.715+0000 7fa411bff700 1 -- 172.21.15.12:0/3615226962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c101f50 msgr2=0x7fa40c104340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.715+0000 7fa411bff700 1 --2- 172.21.15.12:0/3615226962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c101f50 0x7fa40c104340 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa40400b0a0 tx=0x7fa40400b3b0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.717+0000 7fa411bff700 1 -- 172.21.15.12:0/3615226962 shutdown_connections 2023-12-11T20:35:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.718+0000 7fa411bff700 1 --2- 172.21.15.12:0/3615226962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa40c1071b0 0x7fa40c109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.718+0000 7fa411bff700 1 --2- 172.21.15.12:0/3615226962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c101f50 0x7fa40c104340 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.718+0000 7fa411bff700 1 --2- 172.21.15.12:0/3615226962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c104880 0x7fa40c106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.718+0000 7fa411bff700 1 -- 172.21.15.12:0/3615226962 >> 172.21.15.12:0/3615226962 conn(0x7fa40c0fb960 msgr2=0x7fa40c0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.719+0000 7fa411bff700 1 -- 172.21.15.12:0/3615226962 shutdown_connections 2023-12-11T20:35:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.719+0000 7fa411bff700 1 -- 172.21.15.12:0/3615226962 wait complete. 2023-12-11T20:35:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.720+0000 7fa411bff700 1 Processor -- start 2023-12-11T20:35:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.721+0000 7fa411bff700 1 -- start start 2023-12-11T20:35:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.721+0000 7fa411bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c101f50 0x7fa40c19db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.721+0000 7fa411bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa40c104880 0x7fa40c19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.721+0000 7fa411bff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c1071b0 0x7fa40c1a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.721+0000 7fa411bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1a5660 con 0x7fa40c101f50 2023-12-11T20:35:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.721+0000 7fa411bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c10a460 con 0x7fa40c104880 2023-12-11T20:35:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.721+0000 7fa411bff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c10a5f0 con 0x7fa40c1071b0 2023-12-11T20:35:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.722+0000 7fa40affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa40c104880 0x7fa40c19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.722+0000 7fa40bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c1071b0 0x7fa40c1a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.722+0000 7fa40bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c1071b0 0x7fa40c1a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:51852/0 (socket says 172.21.15.12:51852) 2023-12-11T20:35:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.722+0000 7fa40bfff700 1 -- 172.21.15.12:0/2450158357 learned_addr learned my addr 172.21.15.12:0/2450158357 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.722+0000 7fa40bfff700 1 -- 172.21.15.12:0/2450158357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa40c104880 msgr2=0x7fa40c19e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.722+0000 7fa40bfff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa40c104880 0x7fa40c19e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.723+0000 7fa40bfff700 1 -- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c101f50 msgr2=0x7fa40c19db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.723+0000 7fa40bfff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c101f50 0x7fa40c19db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.723+0000 7fa40bfff700 1 -- 172.21.15.12:0/2450158357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009d00 con 0x7fa40c1071b0 2023-12-11T20:35:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.723+0000 7fa40bfff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c1071b0 0x7fa40c1a5090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b550 tx=0x7fa3fc00b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.724+0000 7fa408ff9700 1 -- 172.21.15.12:0/2450158357 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc011830 con 0x7fa40c1071b0 2023-12-11T20:35:39.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.724+0000 7fa408ff9700 1 -- 172.21.15.12:0/2450158357 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3fc011e20 con 0x7fa40c1071b0 2023-12-11T20:35:39.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.724+0000 7fa408ff9700 1 -- 172.21.15.12:0/2450158357 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc010e40 con 0x7fa40c1071b0 2023-12-11T20:35:39.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.725+0000 7fa411bff700 1 -- 172.21.15.12:0/2450158357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c10a8d0 con 0x7fa40c1071b0 2023-12-11T20:35:39.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.725+0000 7fa411bff700 1 -- 172.21.15.12:0/2450158357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c10ae10 con 0x7fa40c1071b0 2023-12-11T20:35:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.735+0000 7fa408ff9700 1 -- 172.21.15.12:0/2450158357 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa3fc011990 con 0x7fa40c1071b0 2023-12-11T20:35:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.736+0000 7fa425494b80 1 Processor -- start 2023-12-11T20:35:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.736+0000 7fa425494b80 1 -- start start 2023-12-11T20:35:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.738+0000 7fa408ff9700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3f80a1570 0x7fa3f80a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.738+0000 7fa408ff9700 1 -- 172.21.15.12:0/2450158357 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa3fc0cc4b0 con 0x7fa40c1071b0 2023-12-11T20:35:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.738+0000 7fa425494b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd857300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.738+0000 7fa425494b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd857840 0x5566dd858150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.738+0000 7fa425494b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.738+0000 7fa425494b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd7a1af0 con 0x5566dd856ee0 2023-12-11T20:35:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.738+0000 7fa425494b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd79f410 con 0x5566dd857840 2023-12-11T20:35:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.738+0000 7fa425494b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd79ad00 con 0x5566dd858730 2023-12-11T20:35:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.740+0000 7fa40affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd857840 0x5566dd858150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.740+0000 7fa40affd700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3f80a1570 0x7fa3f80a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.740+0000 7fa40bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.740+0000 7fa40bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:51866/0 (socket says 172.21.15.12:51866) 2023-12-11T20:35:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.740+0000 7fa40bfff700 1 -- 172.21.15.12:0/4231309932 learned_addr learned my addr 172.21.15.12:0/4231309932 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.740+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd857300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.741+0000 7fa40bfff700 1 -- 172.21.15.12:0/4231309932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd857840 msgr2=0x5566dd858150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.741+0000 7fa40bfff700 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd857840 0x5566dd858150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.741+0000 7fa40bfff700 1 -- 172.21.15.12:0/4231309932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 msgr2=0x5566dd857300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.741+0000 7fa40bfff700 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd857300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.741+0000 7fa40bfff700 1 -- 172.21.15.12:0/4231309932 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566dd6175d0 con 0x5566dd858730 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.741+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd857300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.742+0000 7fa40affd700 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd857840 0x5566dd858150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.742+0000 7fa40bfff700 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858bb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0996b0 tx=0x7fa3fc004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=790cff43a4635a12 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.742+0000 7fa401ffb700 1 -- 172.21.15.12:0/4231309932 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc011c40 con 0x5566dd858730 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.742+0000 7fa401ffb700 1 -- 172.21.15.12:0/4231309932 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3fc099e20 con 0x5566dd858730 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.742+0000 7fa40affd700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3f80a1570 0x7fa3f80a3a30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400b6c0 tx=0x7fa3f400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.743+0000 7fa401ffb700 1 -- 172.21.15.12:0/4231309932 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0a1ab0 con 0x5566dd858730 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.743+0000 7fa425494b80 1 -- 172.21.15.12:0/4231309932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 msgr2=0x5566dd858bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.743+0000 7fa425494b80 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858bb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0996b0 tx=0x7fa3fc004860 comp rx=0 tx=0).stop 2023-12-11T20:35:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.744+0000 7fa425494b80 1 -- 172.21.15.12:0/4231309932 shutdown_connections 2023-12-11T20:35:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.744+0000 7fa425494b80 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858bb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.744+0000 7fa425494b80 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd857300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.744+0000 7fa425494b80 1 --2- 172.21.15.12:0/4231309932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd857840 0x5566dd858150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.744+0000 7fa425494b80 1 -- 172.21.15.12:0/4231309932 >> 172.21.15.12:0/4231309932 conn(0x5566dd775780 msgr2=0x5566dd842880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.746+0000 7fa425494b80 1 -- 172.21.15.12:0/4231309932 shutdown_connections 2023-12-11T20:35:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.747+0000 7fa425494b80 1 -- 172.21.15.12:0/4231309932 wait complete. 2023-12-11T20:35:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.747+0000 7fa425494b80 1 -- start start 2023-12-11T20:35:39.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.748+0000 7fa425494b80 1 Processor -- start 2023-12-11T20:35:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa425494b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd856ee0 0x5566dd860f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa425494b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd861490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa425494b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd868270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa425494b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd754500 con 0x5566dd857840 2023-12-11T20:35:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa425494b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd7541a0 con 0x5566dd858730 2023-12-11T20:35:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa425494b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd6198c0 con 0x5566dd856ee0 2023-12-11T20:35:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa425494b80 10 client.0 _ll_register_callbacks cb 0x5566dd67fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:35:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa40bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd868270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa40bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd868270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:48216/0 (socket says 172.21.15.12:48216) 2023-12-11T20:35:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.750+0000 7fa40bfff700 1 -- 172.21.15.12:0/2976882601 learned_addr learned my addr 172.21.15.12:0/2976882601 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.751+0000 7fa40affd700 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd861490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.751+0000 7fa40bfff700 1 -- 172.21.15.12:0/2976882601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd856ee0 msgr2=0x5566dd860f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.751+0000 7fa40bfff700 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd856ee0 0x5566dd860f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.751+0000 7fa40bfff700 1 -- 172.21.15.12:0/2976882601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 msgr2=0x5566dd861490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.751+0000 7fa40bfff700 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd861490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.751+0000 7fa40bfff700 1 -- 172.21.15.12:0/2976882601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c10ae10 con 0x5566dd858730 2023-12-11T20:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.751+0000 7fa40affd700 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd861490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:35:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.751+0000 7fa40bfff700 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd868270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b520 tx=0x7fa3fc099f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afb1cb69447e8a68 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.752+0000 7fa3eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:35:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.752+0000 7fa3eaffd700 1 -- 172.21.15.12:0/2976882601 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc010380 con 0x5566dd858730 2023-12-11T20:35:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.752+0000 7fa3eaffd700 1 -- 172.21.15.12:0/2976882601 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa3fc0a1ab0 con 0x5566dd858730 2023-12-11T20:35:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.752+0000 7fa425494b80 1 -- 172.21.15.12:0/2976882601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566dd839730 con 0x5566dd858730 2023-12-11T20:35:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.752+0000 7fa3eaffd700 1 -- 172.21.15.12:0/2976882601 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3fc099980 con 0x5566dd858730 2023-12-11T20:35:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.752+0000 7fa425494b80 10 client.30209 fetch_fsmap learned FSMap version 42 2023-12-11T20:35:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.752+0000 7fa425494b80 1 -- 172.21.15.12:0/2976882601 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5566dd5c3d80 con 0x5566dd858730 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa3eaffd700 1 -- 172.21.15.12:0/2976882601 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5566dd839730 con 0x5566dd858730 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa3eaffd700 1 -- 172.21.15.12:0/2976882601 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 42) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa3fc0a1620 con 0x5566dd858730 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa425494b80 10 client.30209 fetch_fsmap finished waiting for FSMap version 42 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa425494b80 10 client.30209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa425494b80 20 client.30209 populate_metadata read hostname 'smithi012' 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa425494b80 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5566dd86c8c0 0x5566dd86ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa425494b80 4 client.30209 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa425494b80 1 -- 172.21.15.12:0/2976882601 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566dd815ee0 con 0x5566dd86c8c0 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.754+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5566dd86c8c0 0x5566dd86ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.756+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5566dd86c8c0 0x5566dd86ed00 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22993d2e6a9ae015 server_cookie=5d00450205655e92 in_seq=0 out_seq=0 2023-12-11T20:35:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.756+0000 7fa3eaffd700 10 client.30209 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.757+0000 7fa3eaffd700 1 -- 172.21.15.12:0/2976882601 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5566dd815ee0 con 0x5566dd86c8c0 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.757+0000 7fa3eaffd700 10 client.30209 handle_command_reply: tid=0 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.757+0000 7fa425494b80 1 client.30209 shutdown 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa425494b80 1 -- 172.21.15.12:0/2976882601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 msgr2=0x5566dd868270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa425494b80 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd868270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b520 tx=0x7fa3fc099f90 comp rx=0 tx=0).stop 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa425494b80 1 -- 172.21.15.12:0/2976882601 shutdown_connections 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa425494b80 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5566dd86c8c0 0x5566dd86ed00 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa425494b80 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd868270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa425494b80 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd856ee0 0x5566dd860f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa425494b80 1 --2- 172.21.15.12:0/2976882601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd861490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa425494b80 1 -- 172.21.15.12:0/2976882601 >> 172.21.15.12:0/2976882601 conn(0x5566dd775780 msgr2=0x5566dd840ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.758+0000 7fa3eaffd700 0 client.30209 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.759+0000 7fa425494b80 1 -- 172.21.15.12:0/2976882601 shutdown_connections 2023-12-11T20:35:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.759+0000 7fa425494b80 1 -- 172.21.15.12:0/2976882601 wait complete. 2023-12-11T20:35:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.760+0000 7fa425494b80 20 client.30209 trim_cache size 0 max 16384 2023-12-11T20:35:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.789+0000 7fa425494b80 1 Processor -- start 2023-12-11T20:35:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.790+0000 7fa425494b80 1 -- start start 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.790+0000 7fa425494b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd856ee0 0x5566dd868b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.790+0000 7fa425494b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd868230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.790+0000 7fa425494b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.790+0000 7fa425494b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd856a80 con 0x5566dd857840 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.790+0000 7fa425494b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd86c630 con 0x5566dd856ee0 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.790+0000 7fa425494b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd857680 con 0x5566dd858730 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.790+0000 7fa40affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd868230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd868230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45600/0 (socket says 172.21.15.12:45600) 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40affd700 1 -- 172.21.15.12:0/230748073 learned_addr learned my addr 172.21.15.12:0/230748073 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd856ee0 0x5566dd868b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40bfff700 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40affd700 1 -- 172.21.15.12:0/230748073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 msgr2=0x5566dd858b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40affd700 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40affd700 1 -- 172.21.15.12:0/230748073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd856ee0 msgr2=0x5566dd868b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40affd700 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd856ee0 0x5566dd868b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.791+0000 7fa40affd700 1 -- 172.21.15.12:0/230748073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566dd5acc00 con 0x5566dd857840 2023-12-11T20:35:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.792+0000 7fa40affd700 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd868230 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4012d00 tx=0x7fa3f4005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469474685e7c2d0e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.792+0000 7fa4027fc700 1 -- 172.21.15.12:0/230748073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4022070 con 0x5566dd857840 2023-12-11T20:35:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.792+0000 7fa4027fc700 1 -- 172.21.15.12:0/230748073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3f401da10 con 0x5566dd857840 2023-12-11T20:35:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.792+0000 7fa4027fc700 1 -- 172.21.15.12:0/230748073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40268f0 con 0x5566dd857840 2023-12-11T20:35:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 -- 172.21.15.12:0/230748073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 msgr2=0x5566dd868230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd868230 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4012d00 tx=0x7fa3f4005d20 comp rx=0 tx=0).stop 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 -- 172.21.15.12:0/230748073 shutdown_connections 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd856ee0 0x5566dd868b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd858730 0x5566dd858b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 --2- 172.21.15.12:0/230748073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd857840 0x5566dd868230 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 -- 172.21.15.12:0/230748073 >> 172.21.15.12:0/230748073 conn(0x5566dd775780 msgr2=0x5566dd860250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 -- 172.21.15.12:0/230748073 shutdown_connections 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.793+0000 7fa425494b80 1 -- 172.21.15.12:0/230748073 wait complete. 2023-12-11T20:35:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.794+0000 7fa425494b80 1 -- start start 2023-12-11T20:35:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.794+0000 7fa425494b80 1 Processor -- start 2023-12-11T20:35:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.795+0000 7fa425494b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd867bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.796+0000 7fa425494b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd857840 0x5566dd868130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.796+0000 7fa425494b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd866220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.796+0000 7fa40b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd867bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.796+0000 7fa40b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd867bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45614/0 (socket says 172.21.15.12:45614) 2023-12-11T20:35:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.797+0000 7fa40b7fe700 1 -- 172.21.15.12:0/1051134439 learned_addr learned my addr 172.21.15.12:0/1051134439 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.797+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd866930 con 0x5566dd856ee0 2023-12-11T20:35:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.797+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd866aa0 con 0x5566dd858730 2023-12-11T20:35:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.797+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566dd866c60 con 0x5566dd857840 2023-12-11T20:35:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.797+0000 7fa425494b80 10 client.0 _ll_register_callbacks cb 0x5566dd67fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:35:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.798+0000 7fa40affd700 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd857840 0x5566dd868130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.799+0000 7fa40bfff700 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd866220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.799+0000 7fa40b7fe700 1 -- 172.21.15.12:0/1051134439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd857840 msgr2=0x5566dd868130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.799+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd857840 0x5566dd868130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.799+0000 7fa40b7fe700 1 -- 172.21.15.12:0/1051134439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 msgr2=0x5566dd866220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.799+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd866220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.799+0000 7fa40b7fe700 1 -- 172.21.15.12:0/1051134439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f4017030 con 0x5566dd856ee0 2023-12-11T20:35:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.800+0000 7fa40b7fe700 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd867bf0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fa404007a30 tx=0x7fa404009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657455165b2c8aab server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.801+0000 7fa3eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:35:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.801+0000 7fa3eaffd700 1 -- 172.21.15.12:0/1051134439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400e040 con 0x5566dd856ee0 2023-12-11T20:35:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.801+0000 7fa3eaffd700 1 -- 172.21.15.12:0/1051134439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa404003c00 con 0x5566dd856ee0 2023-12-11T20:35:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.801+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3fc099e20 con 0x5566dd856ee0 2023-12-11T20:35:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.802+0000 7fa3eaffd700 1 -- 172.21.15.12:0/1051134439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa404003dc0 con 0x5566dd856ee0 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.802+0000 7fa425494b80 10 client.20670 fetch_fsmap learned FSMap version 42 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.802+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5566dd5ea1f0 con 0x5566dd856ee0 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.802+0000 7fa3eaffd700 1 -- 172.21.15.12:0/1051134439 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3fc099e20 con 0x5566dd856ee0 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.802+0000 7fa3eaffd700 1 -- 172.21.15.12:0/1051134439 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa40400b0d0 con 0x5566dd856ee0 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.803+0000 7fa425494b80 10 client.20670 fetch_fsmap finished waiting for FSMap version 42 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.803+0000 7fa425494b80 10 client.20670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.803+0000 7fa425494b80 20 client.20670 populate_metadata read hostname 'smithi012' 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.803+0000 7fa425494b80 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5566dd8c42a0 0x5566dd8c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.803+0000 7fa425494b80 4 client.20670 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:35:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.803+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5566dd760f70 con 0x5566dd8c42a0 2023-12-11T20:35:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.803+0000 7fa40affd700 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5566dd8c42a0 0x5566dd8c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.805+0000 7fa40affd700 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5566dd8c42a0 0x5566dd8c66c0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f2884b3fda042b5 server_cookie=9fbad81b489af9d6 in_seq=0 out_seq=0 2023-12-11T20:35:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.805+0000 7fa3eaffd700 10 client.20670 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.821+0000 7fa3eaffd700 1 -- 172.21.15.12:0/1051134439 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5566dd760f70 con 0x5566dd8c42a0 2023-12-11T20:35:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.821+0000 7fa3eaffd700 10 client.20670 handle_command_reply: tid=0 2023-12-11T20:35:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.821+0000 7fa425494b80 1 client.20670 shutdown 2023-12-11T20:35:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 msgr2=0x5566dd867bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa425494b80 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd867bf0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fa404007a30 tx=0x7fa404009180 comp rx=0 tx=0).stop 2023-12-11T20:35:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 shutdown_connections 2023-12-11T20:35:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa425494b80 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x5566dd8c42a0 0x5566dd8c66c0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa3eaffd700 0 client.20670 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa425494b80 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5566dd858730 0x5566dd866220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa425494b80 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5566dd856ee0 0x5566dd867bf0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa425494b80 1 --2- 172.21.15.12:0/1051134439 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5566dd857840 0x5566dd868130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.822+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 >> 172.21.15.12:0/1051134439 conn(0x5566dd775780 msgr2=0x5566dd842460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.823+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 shutdown_connections 2023-12-11T20:35:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.823+0000 7fa425494b80 1 -- 172.21.15.12:0/1051134439 wait complete. 2023-12-11T20:35:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.824+0000 7fa425494b80 20 client.20670 trim_cache size 0 max 16384 2023-12-11T20:35:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:35:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:35:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:35:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:35:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 -- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3f80a1570 msgr2=0x7fa3f80a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3f80a1570 0x7fa3f80a3a30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400b6c0 tx=0x7fa3f400b410 comp rx=0 tx=0).stop 2023-12-11T20:35:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 -- 172.21.15.12:0/2450158357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c1071b0 msgr2=0x7fa40c1a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c1071b0 0x7fa40c1a5090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b550 tx=0x7fa3fc00b860 comp rx=0 tx=0).stop 2023-12-11T20:35:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 -- 172.21.15.12:0/2450158357 shutdown_connections 2023-12-11T20:35:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa3f80a1570 0x7fa3f80a3a30 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa40c1071b0 0x7fa40c1a5090 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa40c101f50 0x7fa40c19db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 --2- 172.21.15.12:0/2450158357 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa40c104880 0x7fa40c19e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.825+0000 7fa411bff700 1 -- 172.21.15.12:0/2450158357 >> 172.21.15.12:0/2450158357 conn(0x7fa40c0fb960 msgr2=0x7fa40c102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.826+0000 7fa411bff700 1 -- 172.21.15.12:0/2450158357 shutdown_connections 2023-12-11T20:35:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:39.826+0000 7fa411bff700 1 -- 172.21.15.12:0/2450158357 wait complete. 2023-12-11T20:35:41.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:41 smithi039 ceph-mon[102205]: pgmap v967: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2023-12-11T20:35:41.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:41 smithi012 ceph-mon[128787]: pgmap v967: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2023-12-11T20:35:41.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:41 smithi032 ceph-mon[132488]: pgmap v967: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.18k op/s 2023-12-11T20:35:42.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:42 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:35:42.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:42 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:35:42.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:42 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:35:43.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:43 smithi039 ceph-mon[102205]: pgmap v968: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:35:43.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:43 smithi012 ceph-mon[128787]: pgmap v968: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:35:43.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:43 smithi032 ceph-mon[132488]: pgmap v968: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:35:45.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:45 smithi039 ceph-mon[102205]: pgmap v969: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2023-12-11T20:35:45.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:45 smithi012 ceph-mon[128787]: pgmap v969: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2023-12-11T20:35:45.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:45 smithi032 ceph-mon[132488]: pgmap v969: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2023-12-11T20:35:47.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:47 smithi039 ceph-mon[102205]: pgmap v970: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2023-12-11T20:35:47.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:47 smithi012 ceph-mon[128787]: pgmap v970: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2023-12-11T20:35:47.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:47 smithi032 ceph-mon[132488]: pgmap v970: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.31k op/s 2023-12-11T20:35:49.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:49 smithi039 ceph-mon[102205]: pgmap v971: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:35:49.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:49 smithi012 ceph-mon[128787]: pgmap v971: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:35:49.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:49 smithi032 ceph-mon[132488]: pgmap v971: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.50k op/s 2023-12-11T20:35:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:51 smithi039 ceph-mon[102205]: pgmap v972: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.05k op/s 2023-12-11T20:35:51.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:51 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:35:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:51 smithi012 ceph-mon[128787]: pgmap v972: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.05k op/s 2023-12-11T20:35:51.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:51 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:35:51.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:51 smithi032 ceph-mon[132488]: pgmap v972: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.05k op/s 2023-12-11T20:35:51.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:51 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:35:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.134+0000 7f1fe17ff700 1 -- 172.21.15.12:0/2598484396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc1014f0 msgr2=0x7f1fdc101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.134+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/2598484396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc1014f0 0x7f1fdc101910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009990 tx=0x7f1fc4009ca0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.134+0000 7f1fe17ff700 1 -- 172.21.15.12:0/2598484396 shutdown_connections 2023-12-11T20:35:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.134+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/2598484396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fdc103080 0x7f1fdc109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.134+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/2598484396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc1014f0 0x7f1fdc101910 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.134+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/2598484396 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fdc1026e0 0x7f1fdc102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.134+0000 7f1fe17ff700 1 -- 172.21.15.12:0/2598484396 >> 172.21.15.12:0/2598484396 conn(0x7f1fdc0fca60 msgr2=0x7f1fdc0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.135+0000 7f1fe17ff700 1 -- 172.21.15.12:0/2598484396 shutdown_connections 2023-12-11T20:35:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.135+0000 7f1fe17ff700 1 -- 172.21.15.12:0/2598484396 wait complete. 2023-12-11T20:35:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.136+0000 7f1fe17ff700 1 Processor -- start 2023-12-11T20:35:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.137+0000 7f1fe17ff700 1 -- start start 2023-12-11T20:35:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.137+0000 7f1fe17ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fdc1014f0 0x7f1fdc06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.137+0000 7f1fe17ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fdc1026e0 0x7f1fdc070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.137+0000 7f1fe17ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc103080 0x7f1fdc1a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.137+0000 7f1fe17ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc073510 con 0x7f1fdc1014f0 2023-12-11T20:35:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.137+0000 7f1fe17ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc073680 con 0x7f1fdc1026e0 2023-12-11T20:35:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.137+0000 7f1fe17ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1a5870 con 0x7f1fdc103080 2023-12-11T20:35:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fdc1014f0 0x7f1fdc06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fdc1014f0 0x7f1fdc06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40884/0 (socket says 172.21.15.12:40884) 2023-12-11T20:35:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdaffd700 1 -- 172.21.15.12:0/1508162922 learned_addr learned my addr 172.21.15.12:0/1508162922 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdb7fe700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc103080 0x7f1fdc1a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdb7fe700 1 -- 172.21.15.12:0/1508162922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fdc1026e0 msgr2=0x7f1fdc070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdb7fe700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fdc1026e0 0x7f1fdc070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdb7fe700 1 -- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fdc1014f0 msgr2=0x7f1fdc06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdb7fe700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fdc1014f0 0x7f1fdc06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.138+0000 7f1fdb7fe700 1 -- 172.21.15.12:0/1508162922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc40095f0 con 0x7f1fdc103080 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.139+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fdc1014f0 0x7f1fdc06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.139+0000 7f1fdb7fe700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc103080 0x7f1fdc1a5330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40123f0 tx=0x7f1fd4012700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.139+0000 7f1fd3fff700 1 -- 172.21.15.12:0/1508162922 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4004db0 con 0x7f1fdc103080 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.139+0000 7f1fd3fff700 1 -- 172.21.15.12:0/1508162922 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fd4013040 con 0x7f1fdc103080 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.139+0000 7f1fd3fff700 1 -- 172.21.15.12:0/1508162922 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400d130 con 0x7f1fdc103080 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.139+0000 7f1fe17ff700 1 -- 172.21.15.12:0/1508162922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc1a5b50 con 0x7f1fdc103080 2023-12-11T20:35:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.139+0000 7f1fe17ff700 1 -- 172.21.15.12:0/1508162922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc1a6090 con 0x7f1fdc103080 2023-12-11T20:35:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.154+0000 7f1fd3fff700 1 -- 172.21.15.12:0/1508162922 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f1fd4003a00 con 0x7f1fdc103080 2023-12-11T20:35:53.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.155+0000 7f1ff5162b80 1 Processor -- start 2023-12-11T20:35:53.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.156+0000 7f1ff5162b80 1 -- start start 2023-12-11T20:35:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.156+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 0x55c3a08132f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.156+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a0814140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.156+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0814720 0x55c3a0814ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.156+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a076eaf0 con 0x55c3a0814720 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.156+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a076c410 con 0x55c3a0812ed0 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.156+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a0767d00 con 0x55c3a0813830 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.157+0000 7f1fda7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0814720 0x55c3a0814ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.157+0000 7f1fda7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0814720 0x55c3a0814ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40896/0 (socket says 172.21.15.12:40896) 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.157+0000 7f1fda7fc700 1 -- 172.21.15.12:0/3412953019 learned_addr learned my addr 172.21.15.12:0/3412953019 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.157+0000 7f1fd3fff700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fc80a1570 0x7f1fc80a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.157+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a0814140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.157+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 0x55c3a08132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.158+0000 7f1fda7fc700 1 -- 172.21.15.12:0/3412953019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 msgr2=0x55c3a0814140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.158+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a0814140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.158+0000 7f1fda7fc700 1 -- 172.21.15.12:0/3412953019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 msgr2=0x55c3a08132f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.158+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 0x55c3a08132f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.158+0000 7f1fda7fc700 1 -- 172.21.15.12:0/3412953019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3a05e45d0 con 0x55c3a0814720 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.158+0000 7f1fd3fff700 1 -- 172.21.15.12:0/1508162922 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1fd40d0c90 con 0x7f1fdc103080 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.158+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0814720 0x55c3a0814ba0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc001e70 tx=0x7f1fcc009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493fdd42dab04e74 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.158+0000 7f1fdb7fe700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fc80a1570 0x7f1fc80a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.159+0000 7f1fd17fa700 1 -- 172.21.15.12:0/3412953019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc015d80 con 0x55c3a0814720 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.159+0000 7f1fd17fa700 1 -- 172.21.15.12:0/3412953019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fcc008e40 con 0x55c3a0814720 2023-12-11T20:35:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.159+0000 7f1fd17fa700 1 -- 172.21.15.12:0/3412953019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc004a60 con 0x55c3a0814720 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.162+0000 7f1ff5162b80 1 -- 172.21.15.12:0/3412953019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0814720 msgr2=0x55c3a0814ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.162+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0814720 0x55c3a0814ba0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc001e70 tx=0x7f1fcc009e90 comp rx=0 tx=0).stop 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.163+0000 7f1fdb7fe700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fc80a1570 0x7f1fc80a3a30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1fd409aa00 tx=0x7f1fd4004f10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.163+0000 7f1ff5162b80 1 -- 172.21.15.12:0/3412953019 shutdown_connections 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.163+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 0x55c3a08132f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.163+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0814720 0x55c3a0814ba0 secure :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc001e70 tx=0x7f1fcc009e90 comp rx=0 tx=0).stop 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.163+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/3412953019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a0814140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.163+0000 7f1ff5162b80 1 -- 172.21.15.12:0/3412953019 >> 172.21.15.12:0/3412953019 conn(0x55c3a0742780 msgr2=0x55c3a080f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.164+0000 7f1ff5162b80 1 -- 172.21.15.12:0/3412953019 shutdown_connections 2023-12-11T20:35:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.164+0000 7f1ff5162b80 1 -- 172.21.15.12:0/3412953019 wait complete. 2023-12-11T20:35:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.165+0000 7f1ff5162b80 1 -- start start 2023-12-11T20:35:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.166+0000 7f1ff5162b80 1 Processor -- start 2023-12-11T20:35:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.167+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0812ed0 0x55c3a081d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.167+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a081d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.167+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 0x55c3a0824860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.167+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a0721500 con 0x55c3a0812ed0 2023-12-11T20:35:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.167+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a07211a0 con 0x55c3a0822470 2023-12-11T20:35:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.167+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a05e68c0 con 0x55c3a0813830 2023-12-11T20:35:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.167+0000 7f1ff5162b80 10 client.0 _ll_register_callbacks cb 0x55c3a064ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:35:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.168+0000 7f1fda7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0812ed0 0x55c3a081d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.168+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a081d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.168+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a081d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44156/0 (socket says 172.21.15.12:44156) 2023-12-11T20:35:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.168+0000 7f1fdaffd700 1 -- 172.21.15.12:0/2772810268 learned_addr learned my addr 172.21.15.12:0/2772810268 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.168+0000 7f1fda7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0812ed0 0x55c3a081d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40912/0 (socket says 172.21.15.12:40912) 2023-12-11T20:35:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.168+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 0x55c3a0824860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.169+0000 7f1fdaffd700 1 -- 172.21.15.12:0/2772810268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 msgr2=0x55c3a0824860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.169+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 0x55c3a0824860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.169+0000 7f1fdaffd700 1 -- 172.21.15.12:0/2772810268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0812ed0 msgr2=0x55c3a081d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.169+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0812ed0 0x55c3a081d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.169+0000 7f1fdaffd700 1 -- 172.21.15.12:0/2772810268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc015270 con 0x55c3a0813830 2023-12-11T20:35:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.170+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a081d650 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400ba10 tx=0x7f1fc400ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e4f8c39b7c0f9fb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.170+0000 7f1fc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:35:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.171+0000 7f1fc27fc700 1 -- 172.21.15.12:0/2772810268 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4005680 con 0x55c3a0813830 2023-12-11T20:35:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.171+0000 7f1ff5162b80 1 -- 172.21.15.12:0/2772810268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3a0806730 con 0x55c3a0813830 2023-12-11T20:35:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.171+0000 7f1fc27fc700 1 -- 172.21.15.12:0/2772810268 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1fc4003890 con 0x55c3a0813830 2023-12-11T20:35:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.172+0000 7f1fc27fc700 1 -- 172.21.15.12:0/2772810268 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fc4003a50 con 0x55c3a0813830 2023-12-11T20:35:53.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.172+0000 7f1ff5162b80 10 client.30250 fetch_fsmap learned FSMap version 43 2023-12-11T20:35:53.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.172+0000 7f1ff5162b80 1 -- 172.21.15.12:0/2772810268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55c3a0590d80 con 0x55c3a0813830 2023-12-11T20:35:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.172+0000 7f1fc27fc700 1 -- 172.21.15.12:0/2772810268 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fc4043020 con 0x55c3a0813830 2023-12-11T20:35:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.172+0000 7f1fc27fc700 1 -- 172.21.15.12:0/2772810268 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1fc4033070 con 0x55c3a0813830 2023-12-11T20:35:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.173+0000 7f1ff5162b80 10 client.30250 fetch_fsmap finished waiting for FSMap version 43 2023-12-11T20:35:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.173+0000 7f1ff5162b80 10 client.30250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:35:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.173+0000 7f1ff5162b80 20 client.30250 populate_metadata read hostname 'smithi012' 2023-12-11T20:35:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.173+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c3a0829370 0x55c3a082b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.173+0000 7f1ff5162b80 4 client.30250 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:35:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.173+0000 7f1ff5162b80 1 -- 172.21.15.12:0/2772810268 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3a07e2ee0 con 0x55c3a0829370 2023-12-11T20:35:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.174+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c3a0829370 0x55c3a082b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.175+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c3a0829370 0x55c3a082b790 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf256d1487a66a65 server_cookie=85705d2d922b8c12 in_seq=0 out_seq=0 2023-12-11T20:35:53.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.175+0000 7f1fc27fc700 10 client.30250 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:53.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.176+0000 7f1fc27fc700 1 -- 172.21.15.12:0/2772810268 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c3a07e2ee0 con 0x55c3a0829370 2023-12-11T20:35:53.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.176+0000 7f1fc27fc700 10 client.30250 handle_command_reply: tid=0 2023-12-11T20:35:53.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.176+0000 7f1ff5162b80 1 client.30250 shutdown 2023-12-11T20:35:53.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.178+0000 7f1ff5162b80 1 -- 172.21.15.12:0/2772810268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 msgr2=0x55c3a081d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.178+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a081d650 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400ba10 tx=0x7f1fc400ba40 comp rx=0 tx=0).stop 2023-12-11T20:35:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.179+0000 7f1ff5162b80 1 -- 172.21.15.12:0/2772810268 shutdown_connections 2023-12-11T20:35:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.179+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c3a0829370 0x55c3a082b790 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.179+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 0x55c3a0824860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.179+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0812ed0 0x55c3a081d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.179+0000 7f1fc27fc700 0 client.30250 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.179+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/2772810268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a081d650 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.179+0000 7f1ff5162b80 1 -- 172.21.15.12:0/2772810268 >> 172.21.15.12:0/2772810268 conn(0x55c3a0742780 msgr2=0x55c3a080dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.179+0000 7f1ff5162b80 1 -- 172.21.15.12:0/2772810268 shutdown_connections 2023-12-11T20:35:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.180+0000 7f1ff5162b80 1 -- 172.21.15.12:0/2772810268 wait complete. 2023-12-11T20:35:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.180+0000 7f1ff5162b80 20 client.30250 trim_cache size 0 max 16384 2023-12-11T20:35:53.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.230+0000 7f1ff5162b80 1 Processor -- start 2023-12-11T20:35:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.230+0000 7f1ff5162b80 1 -- start start 2023-12-11T20:35:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.230+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 0x55c3a081ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.230+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a08079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.230+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0822470 0x55c3a081b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.230+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a081bf20 con 0x55c3a0822470 2023-12-11T20:35:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.230+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a0813c10 con 0x55c3a0812ed0 2023-12-11T20:35:53.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.230+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a080fe20 con 0x55c3a0813830 2023-12-11T20:35:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.231+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a08079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.231+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a08079a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44164/0 (socket says 172.21.15.12:44164) 2023-12-11T20:35:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.231+0000 7f1fdaffd700 1 -- 172.21.15.12:0/771723860 learned_addr learned my addr 172.21.15.12:0/771723860 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.232+0000 7f1fdaffd700 1 -- 172.21.15.12:0/771723860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 msgr2=0x55c3a081ada0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:35:53.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.232+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 0x55c3a081ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.232+0000 7f1fdaffd700 1 -- 172.21.15.12:0/771723860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0822470 msgr2=0x55c3a081b9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T20:35:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.233+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0822470 0x55c3a081b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.234+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0822470 0x55c3a081b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.234+0000 7f1fdaffd700 1 -- 172.21.15.12:0/771723860 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3a0579c00 con 0x55c3a0813830 2023-12-11T20:35:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.234+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0822470 0x55c3a081b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:35:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.234+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a08079a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400b9e0 tx=0x7f1fc400b310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b69688facf9ed209 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.235+0000 7f1fd1ffb700 1 -- 172.21.15.12:0/771723860 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4009290 con 0x55c3a0813830 2023-12-11T20:35:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.235+0000 7f1fd1ffb700 1 -- 172.21.15.12:0/771723860 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fc4043030 con 0x55c3a0813830 2023-12-11T20:35:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.235+0000 7f1fd1ffb700 1 -- 172.21.15.12:0/771723860 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4009290 con 0x55c3a0813830 2023-12-11T20:35:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.236+0000 7f1ff5162b80 1 -- 172.21.15.12:0/771723860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 msgr2=0x55c3a08079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.236+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a08079a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400b9e0 tx=0x7f1fc400b310 comp rx=0 tx=0).stop 2023-12-11T20:35:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.237+0000 7f1ff5162b80 1 -- 172.21.15.12:0/771723860 shutdown_connections 2023-12-11T20:35:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.237+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0812ed0 0x55c3a081ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.237+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0822470 0x55c3a081b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.237+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/771723860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0813830 0x55c3a08079a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.237+0000 7f1ff5162b80 1 -- 172.21.15.12:0/771723860 >> 172.21.15.12:0/771723860 conn(0x55c3a0742780 msgr2=0x55c3a080f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.237+0000 7f1ff5162b80 1 -- 172.21.15.12:0/771723860 shutdown_connections 2023-12-11T20:35:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.237+0000 7f1ff5162b80 1 -- 172.21.15.12:0/771723860 wait complete. 2023-12-11T20:35:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.238+0000 7f1ff5162b80 1 -- start start 2023-12-11T20:35:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.238+0000 7f1ff5162b80 1 Processor -- start 2023-12-11T20:35:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.239+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0812ed0 0x55c3a0838ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.239+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0813830 0x55c3a0839420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.239+0000 7f1ff5162b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 0x55c3a087e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.239+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a087ea30 con 0x55c3a0813830 2023-12-11T20:35:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.239+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a087eba0 con 0x55c3a0822470 2023-12-11T20:35:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.239+0000 7f1ff5162b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3a087ed60 con 0x55c3a0812ed0 2023-12-11T20:35:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.241+0000 7f1fda7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0812ed0 0x55c3a0838ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.242+0000 7f1ff5162b80 10 client.0 _ll_register_callbacks cb 0x55c3a064ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:35:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.242+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0813830 0x55c3a0839420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.242+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0813830 0x55c3a0839420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40938/0 (socket says 172.21.15.12:40938) 2023-12-11T20:35:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.242+0000 7f1fda7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0812ed0 0x55c3a0838ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44174/0 (socket says 172.21.15.12:44174) 2023-12-11T20:35:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.242+0000 7f1fdaffd700 1 -- 172.21.15.12:0/124608874 learned_addr learned my addr 172.21.15.12:0/124608874 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:35:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.242+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 0x55c3a087e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.243+0000 7f1fda7fc700 1 -- 172.21.15.12:0/124608874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 msgr2=0x55c3a087e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.243+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 0x55c3a087e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.243+0000 7f1fda7fc700 1 -- 172.21.15.12:0/124608874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0813830 msgr2=0x55c3a0839420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:35:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.243+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0813830 0x55c3a0839420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.243+0000 7f1fda7fc700 1 -- 172.21.15.12:0/124608874 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3a0590d80 con 0x55c3a0812ed0 2023-12-11T20:35:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.243+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0813830 0x55c3a0839420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:35:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.243+0000 7f1fda7fc700 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0812ed0 0x55c3a0838ee0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55c3a08150e0 tx=0x7f1fcc009b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42be6f01bddb25fe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:35:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.243+0000 7f1fc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:35:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.244+0000 7f1fc27fc700 1 -- 172.21.15.12:0/124608874 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc008c70 con 0x55c3a0812ed0 2023-12-11T20:35:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.244+0000 7f1fc27fc700 1 -- 172.21.15.12:0/124608874 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1fcc015d60 con 0x55c3a0812ed0 2023-12-11T20:35:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.244+0000 7f1ff5162b80 1 -- 172.21.15.12:0/124608874 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fcc008e40 con 0x55c3a0812ed0 2023-12-11T20:35:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.245+0000 7f1fc27fc700 1 -- 172.21.15.12:0/124608874 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fcc0070f0 con 0x55c3a0812ed0 2023-12-11T20:35:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.245+0000 7f1ff5162b80 10 client.30256 fetch_fsmap learned FSMap version 43 2023-12-11T20:35:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.245+0000 7f1ff5162b80 1 -- 172.21.15.12:0/124608874 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55c3a05b71f0 con 0x55c3a0812ed0 2023-12-11T20:35:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.246+0000 7f1fc27fc700 1 -- 172.21.15.12:0/124608874 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fcc008e40 con 0x55c3a0812ed0 2023-12-11T20:35:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.246+0000 7f1fc27fc700 1 -- 172.21.15.12:0/124608874 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1fcc0295c0 con 0x55c3a0812ed0 2023-12-11T20:35:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.246+0000 7f1ff5162b80 10 client.30256 fetch_fsmap finished waiting for FSMap version 43 2023-12-11T20:35:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.246+0000 7f1ff5162b80 10 client.30256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:35:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.246+0000 7f1ff5162b80 20 client.30256 populate_metadata read hostname 'smithi012' 2023-12-11T20:35:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.246+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c3a08804a0 0x55c3a08828c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:35:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.246+0000 7f1ff5162b80 4 client.30256 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:35:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.246+0000 7f1ff5162b80 1 -- 172.21.15.12:0/124608874 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c3a072df70 con 0x55c3a08804a0 2023-12-11T20:35:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.247+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c3a08804a0 0x55c3a08828c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:35:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.248+0000 7f1fc27fc700 10 client.30256 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.248+0000 7f1fdaffd700 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c3a08804a0 0x55c3a08828c0 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d838e24d9c42812e server_cookie=bdb6ab3f5071cea5 in_seq=0 out_seq=0 2023-12-11T20:35:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.267+0000 7f1fc27fc700 1 -- 172.21.15.12:0/124608874 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c3a072df70 con 0x55c3a08804a0 2023-12-11T20:35:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.267+0000 7f1fc27fc700 10 client.30256 handle_command_reply: tid=0 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.267+0000 7f1ff5162b80 1 client.30256 shutdown 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 -- 172.21.15.12:0/124608874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0812ed0 msgr2=0x55c3a0838ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0812ed0 0x55c3a0838ee0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55c3a08150e0 tx=0x7f1fcc009b10 comp rx=0 tx=0).stop 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 -- 172.21.15.12:0/124608874 shutdown_connections 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55c3a08804a0 0x55c3a08828c0 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55c3a0822470 0x55c3a087e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c3a0812ed0 0x55c3a0838ee0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 --2- 172.21.15.12:0/124608874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3a0813830 0x55c3a0839420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 -- 172.21.15.12:0/124608874 >> 172.21.15.12:0/124608874 conn(0x55c3a0742780 msgr2=0x55c3a08300f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1fc27fc700 0 client.30256 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:35:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.268+0000 7f1ff5162b80 1 -- 172.21.15.12:0/124608874 shutdown_connections 2023-12-11T20:35:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.269+0000 7f1ff5162b80 1 -- 172.21.15.12:0/124608874 wait complete. 2023-12-11T20:35:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.269+0000 7f1ff5162b80 20 client.30256 trim_cache size 0 max 16384 2023-12-11T20:35:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:35:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:35:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:35:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:35:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.270+0000 7f1fe17ff700 1 -- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fc80a1570 msgr2=0x7f1fc80a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.270+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fc80a1570 0x7f1fc80a3a30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1fd409aa00 tx=0x7f1fd4004f10 comp rx=0 tx=0).stop 2023-12-11T20:35:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.271+0000 7f1fe17ff700 1 -- 172.21.15.12:0/1508162922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc103080 msgr2=0x7f1fdc1a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:35:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.271+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc103080 0x7f1fdc1a5330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40123f0 tx=0x7f1fd4012700 comp rx=0 tx=0).stop 2023-12-11T20:35:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.271+0000 7f1fe17ff700 1 -- 172.21.15.12:0/1508162922 shutdown_connections 2023-12-11T20:35:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.271+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f1fc80a1570 0x7f1fc80a3a30 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.271+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fdc103080 0x7f1fdc1a5330 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.271+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fdc1014f0 0x7f1fdc06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.271+0000 7f1fe17ff700 1 --2- 172.21.15.12:0/1508162922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fdc1026e0 0x7f1fdc070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:35:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.271+0000 7f1fe17ff700 1 -- 172.21.15.12:0/1508162922 >> 172.21.15.12:0/1508162922 conn(0x7f1fdc0fca60 msgr2=0x7f1fdc105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:35:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.272+0000 7f1fe17ff700 1 -- 172.21.15.12:0/1508162922 shutdown_connections 2023-12-11T20:35:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:35:53.272+0000 7f1fe17ff700 1 -- 172.21.15.12:0/1508162922 wait complete. 2023-12-11T20:35:53.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:53 smithi039 ceph-mon[102205]: pgmap v973: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2023-12-11T20:35:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:35:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:35:53.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:35:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:53 smithi012 ceph-mon[128787]: pgmap v973: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2023-12-11T20:35:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:35:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:35:53.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:35:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:53 smithi032 ceph-mon[132488]: pgmap v973: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.27k op/s 2023-12-11T20:35:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:35:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:35:53.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:35:55.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:55 smithi039 ceph-mon[102205]: pgmap v974: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2023-12-11T20:35:55.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:55 smithi012 ceph-mon[128787]: pgmap v974: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2023-12-11T20:35:55.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:55 smithi032 ceph-mon[132488]: pgmap v974: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.89k op/s 2023-12-11T20:35:57.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:57 smithi039 ceph-mon[102205]: pgmap v975: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2023-12-11T20:35:57.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:57 smithi012 ceph-mon[128787]: pgmap v975: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2023-12-11T20:35:57.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:57 smithi032 ceph-mon[132488]: pgmap v975: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 4.13k op/s 2023-12-11T20:35:59.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:35:59 smithi039 ceph-mon[102205]: pgmap v976: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2023-12-11T20:35:59.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:35:59 smithi012 ceph-mon[128787]: pgmap v976: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2023-12-11T20:35:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:35:59 smithi032 ceph-mon[132488]: pgmap v976: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.38k op/s 2023-12-11T20:36:01.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:01 smithi039 ceph-mon[102205]: pgmap v977: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 3.96k op/s 2023-12-11T20:36:01.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:01 smithi012 ceph-mon[128787]: pgmap v977: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 3.96k op/s 2023-12-11T20:36:01.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:01 smithi032 ceph-mon[132488]: pgmap v977: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 3.96k op/s 2023-12-11T20:36:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:03 smithi012 ceph-mon[128787]: pgmap v978: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2023-12-11T20:36:03.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:03 smithi032 ceph-mon[132488]: pgmap v978: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2023-12-11T20:36:03.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:03 smithi039 ceph-mon[102205]: pgmap v978: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.35k op/s 2023-12-11T20:36:05.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:05 smithi012 ceph-mon[128787]: pgmap v979: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.94k op/s 2023-12-11T20:36:05.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:05 smithi032 ceph-mon[132488]: pgmap v979: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.94k op/s 2023-12-11T20:36:05.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:05 smithi039 ceph-mon[102205]: pgmap v979: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.94k op/s 2023-12-11T20:36:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 -- 172.21.15.12:0/2032749859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba80ff6e0 msgr2=0x7f0ba80ffb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/2032749859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba80ff6e0 0x7f0ba80ffb00 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009990 tx=0x7f0ba0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 -- 172.21.15.12:0/2032749859 shutdown_connections 2023-12-11T20:36:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/2032749859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ba8067d30 0x7f0ba8101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/2032749859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba80ff6e0 0x7f0ba80ffb00 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/2032749859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ba81008d0 0x7f0ba8100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 -- 172.21.15.12:0/2032749859 >> 172.21.15.12:0/2032749859 conn(0x7f0ba80fac70 msgr2=0x7f0ba80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 -- 172.21.15.12:0/2032749859 shutdown_connections 2023-12-11T20:36:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.587+0000 7f0baf1ff700 1 -- 172.21.15.12:0/2032749859 wait complete. 2023-12-11T20:36:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.589+0000 7f0baf1ff700 1 Processor -- start 2023-12-11T20:36:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0baf1ff700 1 -- start start 2023-12-11T20:36:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0baf1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8067d30 0x7f0ba8194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0baf1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ba80ff6e0 0x7f0ba8195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0baf1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ba81008d0 0x7f0ba81a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0baf1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba8195d00 con 0x7f0ba8067d30 2023-12-11T20:36:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0baf1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba81a5590 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0baf1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba81a5700 con 0x7f0ba81008d0 2023-12-11T20:36:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0ba7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ba80ff6e0 0x7f0ba8195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.590+0000 7f0ba7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ba80ff6e0 0x7f0ba8195410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42092/0 (socket says 172.21.15.12:42092) 2023-12-11T20:36:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.591+0000 7f0ba7fff700 1 -- 172.21.15.12:0/1375232898 learned_addr learned my addr 172.21.15.12:0/1375232898 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.591+0000 7f0bad79c700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ba81008d0 0x7f0ba81a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.591+0000 7f0ba7fff700 1 -- 172.21.15.12:0/1375232898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ba81008d0 msgr2=0x7f0ba81a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.591+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ba81008d0 0x7f0ba81a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.591+0000 7f0ba7fff700 1 -- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8067d30 msgr2=0x7f0ba8194ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.591+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8067d30 0x7f0ba8194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.591+0000 7f0ba7fff700 1 -- 172.21.15.12:0/1375232898 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba00095f0 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.591+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ba80ff6e0 0x7f0ba8195410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000c9b0 tx=0x7f0b9000ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.592+0000 7f0ba5ffb700 1 -- 172.21.15.12:0/1375232898 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90007b00 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.592+0000 7f0baf1ff700 1 -- 172.21.15.12:0/1375232898 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba81a59e0 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.592+0000 7f0ba5ffb700 1 -- 172.21.15.12:0/1375232898 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b90007c60 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.592+0000 7f0ba5ffb700 1 -- 172.21.15.12:0/1375232898 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90018660 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.592+0000 7f0baf1ff700 1 -- 172.21.15.12:0/1375232898 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba81a5f40 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.598+0000 7f0ba5ffb700 1 -- 172.21.15.12:0/1375232898 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0b90004830 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.600+0000 7f0ba5ffb700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b940a1570 0x7f0b940a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.601+0000 7f0ba5ffb700 1 -- 172.21.15.12:0/1375232898 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0b900ccd00 con 0x7f0ba80ff6e0 2023-12-11T20:36:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.601+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b940a1570 0x7f0b940a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.603+0000 7f0bc2ac7b80 1 Processor -- start 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.604+0000 7f0bc2ac7b80 1 -- start start 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.604+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b940a1570 0x7f0b940a3a30 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00098e0 tx=0x7f0ba0000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.604+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c502f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.604+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c51140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.604+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.604+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181babaf0 con 0x557181c51720 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.605+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181ba9410 con 0x557181c4fed0 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.605+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181ba4d00 con 0x557181c50830 2023-12-11T20:36:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.605+0000 7f0bad79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.605+0000 7f0bad79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55040/0 (socket says 172.21.15.12:55040) 2023-12-11T20:36:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.606+0000 7f0bad79c700 1 -- 172.21.15.12:0/4150338554 learned_addr learned my addr 172.21.15.12:0/4150338554 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.606+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c51140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.606+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.607+0000 7f0ba7fff700 1 -- 172.21.15.12:0/4150338554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 msgr2=0x557181c502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.607+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.607+0000 7f0ba7fff700 1 -- 172.21.15.12:0/4150338554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 msgr2=0x557181c51ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.607+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.607+0000 7f0ba7fff700 1 -- 172.21.15.12:0/4150338554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557181a215d0 con 0x557181c50830 2023-12-11T20:36:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.607+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c51140 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0b900074a0 tx=0x7f0b90099f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ccadf66e2f81106 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.608+0000 7f0b9effd700 1 -- 172.21.15.12:0/4150338554 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900b1070 con 0x557181c50830 2023-12-11T20:36:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.608+0000 7f0b9effd700 1 -- 172.21.15.12:0/4150338554 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b900a2300 con 0x557181c50830 2023-12-11T20:36:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.608+0000 7f0b9effd700 1 -- 172.21.15.12:0/4150338554 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900a20d0 con 0x557181c50830 2023-12-11T20:36:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.609+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/4150338554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 msgr2=0x557181c51140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.609+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c51140 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0b900074a0 tx=0x7f0b90099f00 comp rx=0 tx=0).stop 2023-12-11T20:36:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.609+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/4150338554 shutdown_connections 2023-12-11T20:36:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.609+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.609+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.609+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/4150338554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c51140 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.609+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/4150338554 >> 172.21.15.12:0/4150338554 conn(0x557181b7f780 msgr2=0x557181c4c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.610+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/4150338554 shutdown_connections 2023-12-11T20:36:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.610+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/4150338554 wait complete. 2023-12-11T20:36:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.611+0000 7f0bc2ac7b80 1 -- start start 2023-12-11T20:36:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.611+0000 7f0bc2ac7b80 1 Processor -- start 2023-12-11T20:36:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.612+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c4fed0 0x557181c6af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.613+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c50830 0x557181c6b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.613+0000 7f0bacf9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c4fed0 0x557181c6af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.613+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c51720 0x557181c722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.613+0000 7f0bacf9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c4fed0 0x557181c6af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55052/0 (socket says 172.21.15.12:55052) 2023-12-11T20:36:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.613+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181b5e500 con 0x557181c4fed0 2023-12-11T20:36:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.613+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181b5e1a0 con 0x557181c50830 2023-12-11T20:36:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.613+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181a238c0 con 0x557181c51720 2023-12-11T20:36:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.614+0000 7f0bc2ac7b80 10 client.0 _ll_register_callbacks cb 0x557181a89a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:36:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.614+0000 7f0bacf9b700 1 -- 172.21.15.12:0/529085102 learned_addr learned my addr 172.21.15.12:0/529085102 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.614+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c50830 0x557181c6b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.614+0000 7f0bad79c700 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c51720 0x557181c722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.615+0000 7f0ba7fff700 1 -- 172.21.15.12:0/529085102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c51720 msgr2=0x557181c722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.615+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c51720 0x557181c722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.615+0000 7f0ba7fff700 1 -- 172.21.15.12:0/529085102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c4fed0 msgr2=0x557181c6af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.615+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c4fed0 0x557181c6af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.615+0000 7f0ba7fff700 1 -- 172.21.15.12:0/529085102 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba81a5f40 con 0x557181c50830 2023-12-11T20:36:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.615+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c4fed0 0x557181c6af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:36:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.615+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c50830 0x557181c6b470 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0b90000c00 tx=0x7f0b900a2230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28a711353e52300 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.615+0000 7f0b87fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:36:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.616+0000 7f0b87fff700 1 -- 172.21.15.12:0/529085102 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900b1070 con 0x557181c50830 2023-12-11T20:36:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.616+0000 7f0b87fff700 1 -- 172.21.15.12:0/529085102 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0b900991c0 con 0x557181c50830 2023-12-11T20:36:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.616+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/529085102 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557181c43730 con 0x557181c50830 2023-12-11T20:36:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.616+0000 7f0b87fff700 1 -- 172.21.15.12:0/529085102 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b9000f450 con 0x557181c50830 2023-12-11T20:36:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.616+0000 7f0bc2ac7b80 10 client.30236 fetch_fsmap learned FSMap version 43 2023-12-11T20:36:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.616+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/529085102 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5571819cdd80 con 0x557181c50830 2023-12-11T20:36:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.616+0000 7f0b87fff700 1 -- 172.21.15.12:0/529085102 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557181c43730 con 0x557181c50830 2023-12-11T20:36:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.617+0000 7f0b87fff700 1 -- 172.21.15.12:0/529085102 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0b900977f0 con 0x557181c50830 2023-12-11T20:36:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.617+0000 7f0bc2ac7b80 10 client.30236 fetch_fsmap finished waiting for FSMap version 43 2023-12-11T20:36:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.617+0000 7f0bc2ac7b80 10 client.30236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:36:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.617+0000 7f0bc2ac7b80 20 client.30236 populate_metadata read hostname 'smithi012' 2023-12-11T20:36:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.617+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557181c768e0 0x557181c78d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.617+0000 7f0bc2ac7b80 4 client.30236 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:36:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.617+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/529085102 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557181c1fee0 con 0x557181c768e0 2023-12-11T20:36:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.617+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557181c768e0 0x557181c78d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.618+0000 7f0b87fff700 10 client.30236 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.618+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557181c768e0 0x557181c78d00 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3ff93845096952 server_cookie=c62e73a68e9efd67 in_seq=0 out_seq=0 2023-12-11T20:36:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.619+0000 7f0b87fff700 1 -- 172.21.15.12:0/529085102 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557181c1fee0 con 0x557181c768e0 2023-12-11T20:36:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.619+0000 7f0b87fff700 10 client.30236 handle_command_reply: tid=0 2023-12-11T20:36:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.619+0000 7f0bc2ac7b80 1 client.30236 shutdown 2023-12-11T20:36:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c50830 msgr2=0x557181c6b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c50830 0x557181c6b470 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0b90000c00 tx=0x7f0b900a2230 comp rx=0 tx=0).stop 2023-12-11T20:36:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/529085102 shutdown_connections 2023-12-11T20:36:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557181c768e0 0x557181c78d00 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c51720 0x557181c722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c4fed0 0x557181c6af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/529085102 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c50830 0x557181c6b470 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/529085102 >> 172.21.15.12:0/529085102 conn(0x557181b7f780 msgr2=0x557181c4aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0b87fff700 0 client.30236 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/529085102 shutdown_connections 2023-12-11T20:36:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.620+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/529085102 wait complete. 2023-12-11T20:36:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.621+0000 7f0bc2ac7b80 20 client.30236 trim_cache size 0 max 16384 2023-12-11T20:36:06.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.660+0000 7f0bc2ac7b80 1 Processor -- start 2023-12-11T20:36:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.660+0000 7f0bc2ac7b80 1 -- start start 2023-12-11T20:36:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.661+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.661+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c72260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.661+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.661+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181c73650 con 0x557181c51720 2023-12-11T20:36:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.661+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181c6a890 con 0x557181c4fed0 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.661+0000 7f0bacf9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0bacf9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42116/0 (socket says 172.21.15.12:42116) 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0bacf9b700 1 -- 172.21.15.12:0/2453355828 learned_addr learned my addr 172.21.15.12:0/2453355828 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/2453355828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181c7df10 con 0x557181c50830 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c72260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0bacf9b700 1 -- 172.21.15.12:0/2453355828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 msgr2=0x557181c72260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c72260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0bacf9b700 1 -- 172.21.15.12:0/2453355828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 msgr2=0x557181c51b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0bad79c700 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.662+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.663+0000 7f0bacf9b700 1 -- 172.21.15.12:0/2453355828 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571819b6c00 con 0x557181c4fed0 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.663+0000 7f0bad79c700 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:36:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.663+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6a230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0006010 tx=0x7f0ba0020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b478ae3deceb68 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.664+0000 7f0b9f7fe700 1 -- 172.21.15.12:0/2453355828 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba002b070 con 0x557181c4fed0 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.664+0000 7f0b9f7fe700 1 -- 172.21.15.12:0/2453355828 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ba002c040 con 0x557181c4fed0 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.664+0000 7f0b9f7fe700 1 -- 172.21.15.12:0/2453355828 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba001d070 con 0x557181c4fed0 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.666+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/2453355828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 msgr2=0x557181c6a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.666+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6a230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0006010 tx=0x7f0ba0020000 comp rx=0 tx=0).stop 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.666+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/2453355828 shutdown_connections 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.666+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6a230 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.666+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c51b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.666+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/2453355828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c72260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.666+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/2453355828 >> 172.21.15.12:0/2453355828 conn(0x557181b7f780 msgr2=0x557181c57c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.667+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/2453355828 shutdown_connections 2023-12-11T20:36:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.667+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/2453355828 wait complete. 2023-12-11T20:36:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.667+0000 7f0bc2ac7b80 1 -- start start 2023-12-11T20:36:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.668+0000 7f0bc2ac7b80 1 Processor -- start 2023-12-11T20:36:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.669+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.669+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.669+0000 7f0bc2ac7b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.670+0000 7f0bad79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.670+0000 7f0bacf9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181c71a10 con 0x557181c51720 2023-12-11T20:36:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181c71b80 con 0x557181c4fed0 2023-12-11T20:36:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bc2ac7b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557181c71d40 con 0x557181c50830 2023-12-11T20:36:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bc2ac7b80 10 client.0 _ll_register_callbacks cb 0x557181a89a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:36:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bacf9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:42118/0 (socket says 172.21.15.12:42118) 2023-12-11T20:36:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bacf9b700 1 -- 172.21.15.12:0/1257921338 learned_addr learned my addr 172.21.15.12:0/1257921338 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.670+0000 7f0bad79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55072/0 (socket says 172.21.15.12:55072) 2023-12-11T20:36:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bad79c700 1 -- 172.21.15.12:0/1257921338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 msgr2=0x557181c704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bad79c700 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bad79c700 1 -- 172.21.15.12:0/1257921338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 msgr2=0x557181c6ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bad79c700 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bad79c700 1 -- 172.21.15.12:0/1257921338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba8106030 con 0x557181c51720 2023-12-11T20:36:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0ba7fff700 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:36:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.671+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:36:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.672+0000 7f0bad79c700 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c714d0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x557181c51090 tx=0x7f0b98007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9156080a88fe1328 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.672+0000 7f0b87fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:36:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.672+0000 7f0b87fff700 1 -- 172.21.15.12:0/1257921338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98004db0 con 0x557181c51720 2023-12-11T20:36:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.672+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/1257921338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b900a2300 con 0x557181c51720 2023-12-11T20:36:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.672+0000 7f0b87fff700 1 -- 172.21.15.12:0/1257921338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0b980186f0 con 0x557181c51720 2023-12-11T20:36:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.673+0000 7f0b87fff700 1 -- 172.21.15.12:0/1257921338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b980188b0 con 0x557181c51720 2023-12-11T20:36:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.673+0000 7f0bc2ac7b80 10 client.20697 fetch_fsmap learned FSMap version 43 2023-12-11T20:36:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.673+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/1257921338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5571819f41f0 con 0x557181c51720 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.673+0000 7f0b87fff700 1 -- 172.21.15.12:0/1257921338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b900a2300 con 0x557181c51720 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.674+0000 7f0b87fff700 1 -- 172.21.15.12:0/1257921338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0b98020b70 con 0x557181c51720 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.674+0000 7f0bc2ac7b80 10 client.20697 fetch_fsmap finished waiting for FSMap version 43 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.674+0000 7f0bc2ac7b80 10 client.20697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.674+0000 7f0bc2ac7b80 20 client.20697 populate_metadata read hostname 'smithi012' 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.674+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557181ccdce0 0x557181cd0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.674+0000 7f0bc2ac7b80 4 client.20697 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.674+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/1257921338 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557181b6af70 con 0x557181ccdce0 2023-12-11T20:36:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.674+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557181ccdce0 0x557181cd0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.675+0000 7f0bacf9b700 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557181ccdce0 0x557181cd0100 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e4b3fdfa372329b server_cookie=886eff24bca7c58a in_seq=0 out_seq=0 2023-12-11T20:36:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.675+0000 7f0b87fff700 10 client.20697 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.695+0000 7f0b87fff700 1 -- 172.21.15.12:0/1257921338 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557181b6af70 con 0x557181ccdce0 2023-12-11T20:36:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.695+0000 7f0b87fff700 10 client.20697 handle_command_reply: tid=0 2023-12-11T20:36:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.696+0000 7f0bc2ac7b80 1 client.20697 shutdown 2023-12-11T20:36:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.698+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/1257921338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 msgr2=0x557181c714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.698+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c714d0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x557181c51090 tx=0x7f0b98007af0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.697 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.699+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/1257921338 shutdown_connections 2023-12-11T20:36:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.699+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x557181ccdce0 0x557181cd0100 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.699+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x557181c4fed0 0x557181c6ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.698 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.699+0000 7f0b87fff700 0 client.20697 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.699+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557181c51720 0x557181c714d0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.699+0000 7f0bc2ac7b80 1 --2- 172.21.15.12:0/1257921338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557181c50830 0x557181c704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.699+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/1257921338 >> 172.21.15.12:0/1257921338 conn(0x557181b7f780 msgr2=0x557181c54940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.700+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/1257921338 shutdown_connections 2023-12-11T20:36:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.701+0000 7f0bc2ac7b80 1 -- 172.21.15.12:0/1257921338 wait complete. 2023-12-11T20:36:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.701+0000 7f0bc2ac7b80 20 client.20697 trim_cache size 0 max 16384 2023-12-11T20:36:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:36:06.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:36:06.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:36:06.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:36:06.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.702+0000 7f0baf1ff700 1 -- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b940a1570 msgr2=0x7f0b940a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.702+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b940a1570 0x7f0b940a3a30 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00098e0 tx=0x7f0ba0000bc0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.702+0000 7f0baf1ff700 1 -- 172.21.15.12:0/1375232898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ba80ff6e0 msgr2=0x7f0ba8195410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.702+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ba80ff6e0 0x7f0ba8195410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000c9b0 tx=0x7f0b9000ccc0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.703+0000 7f0baf1ff700 1 -- 172.21.15.12:0/1375232898 shutdown_connections 2023-12-11T20:36:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.703+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f0b940a1570 0x7f0b940a3a30 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.703+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ba81008d0 0x7f0ba81a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.703+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8067d30 0x7f0ba8194ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.703+0000 7f0baf1ff700 1 --2- 172.21.15.12:0/1375232898 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ba80ff6e0 0x7f0ba8195410 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.703+0000 7f0baf1ff700 1 -- 172.21.15.12:0/1375232898 >> 172.21.15.12:0/1375232898 conn(0x7f0ba80fac70 msgr2=0x7f0ba80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.703+0000 7f0baf1ff700 1 -- 172.21.15.12:0/1375232898 shutdown_connections 2023-12-11T20:36:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:06.703+0000 7f0baf1ff700 1 -- 172.21.15.12:0/1375232898 wait complete. 2023-12-11T20:36:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:07 smithi012 ceph-mon[128787]: pgmap v980: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.23k op/s 2023-12-11T20:36:07.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:07 smithi032 ceph-mon[132488]: pgmap v980: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.23k op/s 2023-12-11T20:36:07.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:07 smithi039 ceph-mon[102205]: pgmap v980: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.23k op/s 2023-12-11T20:36:08.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:08 smithi012 ceph-mon[128787]: pgmap v981: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:36:08.712 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:08 smithi032 ceph-mon[132488]: pgmap v981: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:36:08.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:08 smithi039 ceph-mon[102205]: pgmap v981: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.58k op/s 2023-12-11T20:36:10.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:10 smithi032 ceph-mon[132488]: pgmap v982: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2023-12-11T20:36:11.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:10 smithi039 ceph-mon[102205]: pgmap v982: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2023-12-11T20:36:11.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:10 smithi012 ceph-mon[128787]: pgmap v982: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2023-12-11T20:36:12.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:12 smithi032 ceph-mon[132488]: pgmap v983: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:36:13.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:12 smithi039 ceph-mon[102205]: pgmap v983: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:36:13.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:12 smithi012 ceph-mon[128787]: pgmap v983: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:36:14.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:14 smithi032 ceph-mon[132488]: pgmap v984: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2023-12-11T20:36:15.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:14 smithi039 ceph-mon[102205]: pgmap v984: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2023-12-11T20:36:15.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:14 smithi012 ceph-mon[128787]: pgmap v984: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 4.07k op/s 2023-12-11T20:36:16.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:16 smithi032 ceph-mon[132488]: pgmap v985: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2023-12-11T20:36:17.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:16 smithi039 ceph-mon[102205]: pgmap v985: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2023-12-11T20:36:17.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:16 smithi012 ceph-mon[128787]: pgmap v985: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.42k op/s 2023-12-11T20:36:18.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:18 smithi032 ceph-mon[132488]: pgmap v986: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.68k op/s 2023-12-11T20:36:19.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:18 smithi039 ceph-mon[102205]: pgmap v986: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.68k op/s 2023-12-11T20:36:19.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:18 smithi012 ceph-mon[128787]: pgmap v986: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 4.68k op/s 2023-12-11T20:36:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.026+0000 7f560c9ff700 1 -- 172.21.15.12:0/3708684754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5608108ce0 msgr2=0x7f5608109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.026+0000 7f560c9ff700 1 --2- 172.21.15.12:0/3708684754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5608108ce0 0x7f5608109140 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009920 tx=0x7f55f0009c30 comp rx=0 tx=0).stop 2023-12-11T20:36:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.027+0000 7f560c9ff700 1 -- 172.21.15.12:0/3708684754 shutdown_connections 2023-12-11T20:36:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.027+0000 7f560c9ff700 1 --2- 172.21.15.12:0/3708684754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5608107af0 0x7f5608107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.027+0000 7f560c9ff700 1 --2- 172.21.15.12:0/3708684754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5608109680 0x7f560810ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.027+0000 7f560c9ff700 1 --2- 172.21.15.12:0/3708684754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5608108ce0 0x7f5608109140 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.027+0000 7f560c9ff700 1 -- 172.21.15.12:0/3708684754 >> 172.21.15.12:0/3708684754 conn(0x7f5608076a90 msgr2=0x7f5608078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.028+0000 7f560c9ff700 1 -- 172.21.15.12:0/3708684754 shutdown_connections 2023-12-11T20:36:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.029+0000 7f560c9ff700 1 -- 172.21.15.12:0/3708684754 wait complete. 2023-12-11T20:36:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.030+0000 7f560c9ff700 1 Processor -- start 2023-12-11T20:36:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.031+0000 7f560c9ff700 1 -- start start 2023-12-11T20:36:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.031+0000 7f560c9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5608107af0 0x7f560819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.031+0000 7f560c9ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5608108ce0 0x7f560819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.031+0000 7f560c9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5608109680 0x7f56081a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.031+0000 7f560c9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56081a54f0 con 0x7f5608109680 2023-12-11T20:36:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.031+0000 7f560c9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608079e20 con 0x7f5608107af0 2023-12-11T20:36:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.031+0000 7f560c9ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608079fb0 con 0x7f5608108ce0 2023-12-11T20:36:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f560659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5608107af0 0x7f560819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f560659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5608107af0 0x7f560819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38078/0 (socket says 172.21.15.12:38078) 2023-12-11T20:36:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f560659c700 1 -- 172.21.15.12:0/283248180 learned_addr learned my addr 172.21.15.12:0/283248180 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f55fdd9b700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5608108ce0 0x7f560819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f560659c700 1 -- 172.21.15.12:0/283248180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5608108ce0 msgr2=0x7f560819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f560659c700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5608108ce0 0x7f560819dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f560659c700 1 -- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5608109680 msgr2=0x7f56081a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f560659c700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5608109680 0x7f56081a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.032+0000 7f560659c700 1 -- 172.21.15.12:0/283248180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80095f0 con 0x7f5608107af0 2023-12-11T20:36:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.033+0000 7f560659c700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5608107af0 0x7f560819da60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f55f800ebf0 tx=0x7f55f800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.033+0000 7f55fffff700 1 -- 172.21.15.12:0/283248180 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800ce10 con 0x7f5608107af0 2023-12-11T20:36:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.033+0000 7f55fffff700 1 -- 172.21.15.12:0/283248180 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55f80108c0 con 0x7f5608107af0 2023-12-11T20:36:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.033+0000 7f55fffff700 1 -- 172.21.15.12:0/283248180 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f80187a0 con 0x7f5608107af0 2023-12-11T20:36:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.033+0000 7f560c9ff700 1 -- 172.21.15.12:0/283248180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f0009520 con 0x7f5608107af0 2023-12-11T20:36:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.034+0000 7f560c9ff700 1 -- 172.21.15.12:0/283248180 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560807a5c0 con 0x7f5608107af0 2023-12-11T20:36:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.041+0000 7f55fffff700 1 -- 172.21.15.12:0/283248180 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f55f8010a30 con 0x7f5608107af0 2023-12-11T20:36:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.041+0000 7f5620334b80 1 Processor -- start 2023-12-11T20:36:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.042+0000 7f5620334b80 1 -- start start 2023-12-11T20:36:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.042+0000 7f5620334b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561974909ed0 0x56197490a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.042+0000 7f5620334b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490a830 0x56197490b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.042+0000 7f5620334b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490b720 0x56197490bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.043+0000 7f5620334b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561974865af0 con 0x561974909ed0 2023-12-11T20:36:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.043+0000 7f5620334b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561974863410 con 0x56197490b720 2023-12-11T20:36:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.043+0000 7f5620334b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56197485ed00 con 0x56197490a830 2023-12-11T20:36:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.043+0000 7f5606d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561974909ed0 0x56197490a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.043+0000 7f560659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490a830 0x56197490b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.043+0000 7f560659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490a830 0x56197490b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:56882/0 (socket says 172.21.15.12:56882) 2023-12-11T20:36:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.043+0000 7f560659c700 1 -- 172.21.15.12:0/549502382 learned_addr learned my addr 172.21.15.12:0/549502382 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.044+0000 7f55fdd9b700 1 --2- 172.21.15.12:0/549502382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490b720 0x56197490bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.044+0000 7f55fffff700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55f40a1640 0x7f55f40a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.045+0000 7f55fffff700 1 -- 172.21.15.12:0/283248180 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f55f8014070 con 0x7f5608107af0 2023-12-11T20:36:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.045+0000 7f5606d9d700 1 -- 172.21.15.12:0/549502382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490a830 msgr2=0x56197490b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.045+0000 7f5606d9d700 1 --2- 172.21.15.12:0/549502382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490a830 0x56197490b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.045+0000 7f5606d9d700 1 -- 172.21.15.12:0/549502382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490b720 msgr2=0x56197490bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.045+0000 7f5606d9d700 1 --2- 172.21.15.12:0/549502382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490b720 0x56197490bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.045+0000 7f5606d9d700 1 -- 172.21.15.12:0/549502382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619746db5d0 con 0x561974909ed0 2023-12-11T20:36:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.046+0000 7f5606d9d700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55f40a1640 0x7f55f40a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.046+0000 7f5606d9d700 1 --2- 172.21.15.12:0/549502382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561974909ed0 0x56197490a2f0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f560000e490 tx=0x7f560000e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6dc5f05a070fdf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.046+0000 7f55fcd99700 1 -- 172.21.15.12:0/549502382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560001a070 con 0x561974909ed0 2023-12-11T20:36:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.047+0000 7f55fcd99700 1 -- 172.21.15.12:0/549502382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f560000f040 con 0x561974909ed0 2023-12-11T20:36:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.047+0000 7f55fcd99700 1 -- 172.21.15.12:0/549502382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600020420 con 0x561974909ed0 2023-12-11T20:36:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.048+0000 7f5620334b80 1 -- 172.21.15.12:0/549502382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561974909ed0 msgr2=0x56197490a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.048+0000 7f5606d9d700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55f40a1640 0x7f55f40a3b00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f560001d000 tx=0x7f5600020000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.048+0000 7f5620334b80 1 --2- 172.21.15.12:0/549502382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561974909ed0 0x56197490a2f0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f560000e490 tx=0x7f560000e7a0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.048+0000 7f5620334b80 1 -- 172.21.15.12:0/549502382 shutdown_connections 2023-12-11T20:36:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.049+0000 7f5620334b80 1 --2- 172.21.15.12:0/549502382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490b720 0x56197490bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.049+0000 7f5620334b80 1 --2- 172.21.15.12:0/549502382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561974909ed0 0x56197490a2f0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.049+0000 7f5620334b80 1 --2- 172.21.15.12:0/549502382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490a830 0x56197490b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.049+0000 7f5620334b80 1 -- 172.21.15.12:0/549502382 >> 172.21.15.12:0/549502382 conn(0x561974839780 msgr2=0x561974906880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.051+0000 7f5620334b80 1 -- 172.21.15.12:0/549502382 shutdown_connections 2023-12-11T20:36:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.051+0000 7f5620334b80 1 -- 172.21.15.12:0/549502382 wait complete. 2023-12-11T20:36:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.052+0000 7f5620334b80 1 -- start start 2023-12-11T20:36:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.052+0000 7f5620334b80 1 Processor -- start 2023-12-11T20:36:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.053+0000 7f5620334b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561974909ed0 0x561974913f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.053+0000 7f5620334b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490a830 0x561974914440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.053+0000 7f5620334b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490b720 0x56197491b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f55fdd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490a830 0x561974914440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f55fdd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490a830 0x561974914440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38106/0 (socket says 172.21.15.12:38106) 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f5620334b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x561974818500 con 0x56197490b720 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f5620334b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619748181a0 con 0x56197490a830 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f5620334b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619746dd8c0 con 0x561974909ed0 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f55fdd9b700 1 -- 172.21.15.12:0/1379635633 learned_addr learned my addr 172.21.15.12:0/1379635633 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f5620334b80 10 client.0 _ll_register_callbacks cb 0x561974743a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:36:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f560659c700 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561974909ed0 0x561974913f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f5606d9d700 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490b720 0x56197491b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f55fdd9b700 1 -- 172.21.15.12:0/1379635633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561974909ed0 msgr2=0x561974913f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f55fdd9b700 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561974909ed0 0x561974913f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f55fdd9b700 1 -- 172.21.15.12:0/1379635633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490b720 msgr2=0x56197491b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.054+0000 7f55fdd9b700 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490b720 0x56197491b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.055+0000 7f55fdd9b700 1 -- 172.21.15.12:0/1379635633 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560000e140 con 0x56197490a830 2023-12-11T20:36:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.055+0000 7f560659c700 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561974909ed0 0x561974913f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:36:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.056+0000 7f55edffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:36:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.056+0000 7f55fdd9b700 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490a830 0x561974914440 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009920 tx=0x7f55f000f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17f76a94090ee504 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.057+0000 7f55edffb700 1 -- 172.21.15.12:0/1379635633 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f001c050 con 0x56197490a830 2023-12-11T20:36:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.057+0000 7f55edffb700 1 -- 172.21.15.12:0/1379635633 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f55f000b970 con 0x56197490a830 2023-12-11T20:36:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.057+0000 7f5620334b80 1 -- 172.21.15.12:0/1379635633 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619748fd730 con 0x56197490a830 2023-12-11T20:36:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.059+0000 7f55edffb700 1 -- 172.21.15.12:0/1379635633 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55f000bec0 con 0x56197490a830 2023-12-11T20:36:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.060+0000 7f5620334b80 10 client.30254 fetch_fsmap learned FSMap version 43 2023-12-11T20:36:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.060+0000 7f5620334b80 1 -- 172.21.15.12:0/1379635633 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x561974687d80 con 0x56197490a830 2023-12-11T20:36:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.060+0000 7f55edffb700 1 -- 172.21.15.12:0/1379635633 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5619748fd730 con 0x56197490a830 2023-12-11T20:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.062+0000 7f55edffb700 1 -- 172.21.15.12:0/1379635633 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f55f0015020 con 0x56197490a830 2023-12-11T20:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.062+0000 7f5620334b80 10 client.30254 fetch_fsmap finished waiting for FSMap version 43 2023-12-11T20:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.062+0000 7f5620334b80 10 client.30254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.062+0000 7f5620334b80 20 client.30254 populate_metadata read hostname 'smithi012' 2023-12-11T20:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.062+0000 7f5620334b80 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56197491fdc0 0x5619749221e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.062+0000 7f5620334b80 4 client.30254 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.062+0000 7f5620334b80 1 -- 172.21.15.12:0/1379635633 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5619748d9ee0 con 0x56197491fdc0 2023-12-11T20:36:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.064+0000 7f560659c700 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56197491fdc0 0x5619749221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.065+0000 7f560659c700 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56197491fdc0 0x5619749221e0 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1997b4e0076d1d7 server_cookie=201b1ff3a9317b1e in_seq=0 out_seq=0 2023-12-11T20:36:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.065+0000 7f55edffb700 10 client.30254 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.066+0000 7f55edffb700 1 -- 172.21.15.12:0/1379635633 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5619748d9ee0 con 0x56197491fdc0 2023-12-11T20:36:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.066+0000 7f55edffb700 10 client.30254 handle_command_reply: tid=0 2023-12-11T20:36:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.067+0000 7f5620334b80 1 client.30254 shutdown 2023-12-11T20:36:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.067+0000 7f5620334b80 1 -- 172.21.15.12:0/1379635633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490a830 msgr2=0x561974914440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.067+0000 7f5620334b80 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490a830 0x561974914440 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009920 tx=0x7f55f000f740 comp rx=0 tx=0).stop 2023-12-11T20:36:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 1 -- 172.21.15.12:0/1379635633 shutdown_connections 2023-12-11T20:36:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56197491fdc0 0x5619749221e0 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490b720 0x56197491b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561974909ed0 0x561974913f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 1 --2- 172.21.15.12:0/1379635633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56197490a830 0x561974914440 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 1 -- 172.21.15.12:0/1379635633 >> 172.21.15.12:0/1379635633 conn(0x561974839780 msgr2=0x561974904ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f55edffb700 0 client.30254 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 1 -- 172.21.15.12:0/1379635633 shutdown_connections 2023-12-11T20:36:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 1 -- 172.21.15.12:0/1379635633 wait complete. 2023-12-11T20:36:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.068+0000 7f5620334b80 20 client.30254 trim_cache size 0 max 16384 2023-12-11T20:36:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.110+0000 7f5620334b80 1 Processor -- start 2023-12-11T20:36:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.110+0000 7f5620334b80 1 -- start start 2023-12-11T20:36:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.110+0000 7f5620334b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x56197491bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.110+0000 7f5620334b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x56197491b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.110+0000 7f5620334b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974913200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.110+0000 7f5620334b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619748fd700 con 0x56197490a830 2023-12-11T20:36:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.110+0000 7f5620334b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x561974914bf0 con 0x561974909ed0 2023-12-11T20:36:20.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.110+0000 7f5620334b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561974905d70 con 0x56197490b720 2023-12-11T20:36:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.111+0000 7f55fdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x56197491b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.111+0000 7f55fdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x56197491b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54980/0 (socket says 172.21.15.12:54980) 2023-12-11T20:36:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.111+0000 7f55fdd9b700 1 -- 172.21.15.12:0/1767958895 learned_addr learned my addr 172.21.15.12:0/1767958895 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.111+0000 7f5606d9d700 1 --2- 172.21.15.12:0/1767958895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974913200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.112+0000 7f5606d9d700 1 -- 172.21.15.12:0/1767958895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 msgr2=0x56197491bb50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:36:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.112+0000 7f5606d9d700 1 --2- 172.21.15.12:0/1767958895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x56197491bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.112+0000 7f5606d9d700 1 -- 172.21.15.12:0/1767958895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 msgr2=0x56197491b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.112+0000 7f5606d9d700 1 --2- 172.21.15.12:0/1767958895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x56197491b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.112+0000 7f5606d9d700 1 -- 172.21.15.12:0/1767958895 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561974670c00 con 0x56197490b720 2023-12-11T20:36:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.112+0000 7f5606d9d700 1 --2- 172.21.15.12:0/1767958895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974913200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x561974914a80 tx=0x7f5600024000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b0c333ecfc1d3ac server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.113+0000 7f55fd59a700 1 -- 172.21.15.12:0/1767958895 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000098a0 con 0x56197490b720 2023-12-11T20:36:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.113+0000 7f55fd59a700 1 -- 172.21.15.12:0/1767958895 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f560001a030 con 0x56197490b720 2023-12-11T20:36:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.113+0000 7f55fd59a700 1 -- 172.21.15.12:0/1767958895 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000146e0 con 0x56197490b720 2023-12-11T20:36:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 -- 172.21.15.12:0/1767958895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 msgr2=0x561974913200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 --2- 172.21.15.12:0/1767958895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974913200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x561974914a80 tx=0x7f5600024000 comp rx=0 tx=0).stop 2023-12-11T20:36:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 -- 172.21.15.12:0/1767958895 shutdown_connections 2023-12-11T20:36:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 --2- 172.21.15.12:0/1767958895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x56197491bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 --2- 172.21.15.12:0/1767958895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974913200 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 --2- 172.21.15.12:0/1767958895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x56197491b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 -- 172.21.15.12:0/1767958895 >> 172.21.15.12:0/1767958895 conn(0x561974839780 msgr2=0x561974911c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 -- 172.21.15.12:0/1767958895 shutdown_connections 2023-12-11T20:36:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.114+0000 7f5620334b80 1 -- 172.21.15.12:0/1767958895 wait complete. 2023-12-11T20:36:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.115+0000 7f5620334b80 1 -- start start 2023-12-11T20:36:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.116+0000 7f5620334b80 1 Processor -- start 2023-12-11T20:36:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.117+0000 7f5620334b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x561974918920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.118+0000 7f5620334b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x561974918e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.118+0000 7f5620334b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974919e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.118+0000 7f5620334b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56197491a3b0 con 0x56197490a830 2023-12-11T20:36:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.118+0000 7f5620334b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56197491a520 con 0x561974909ed0 2023-12-11T20:36:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.118+0000 7f5620334b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56197491a6e0 con 0x56197490b720 2023-12-11T20:36:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.118+0000 7f5620334b80 10 client.0 _ll_register_callbacks cb 0x561974743a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:36:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.118+0000 7f560659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x561974918920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.118+0000 7f560659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x561974918920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:38130/0 (socket says 172.21.15.12:38130) 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.119+0000 7f560659c700 1 -- 172.21.15.12:0/466506369 learned_addr learned my addr 172.21.15.12:0/466506369 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.119+0000 7f5606d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974919e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.119+0000 7f55fdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x561974918e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.120+0000 7f560659c700 1 -- 172.21.15.12:0/466506369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 msgr2=0x561974919e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.120+0000 7f560659c700 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974919e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.120+0000 7f560659c700 1 -- 172.21.15.12:0/466506369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 msgr2=0x561974918e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.120+0000 7f560659c700 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x561974918e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.120+0000 7f560659c700 1 -- 172.21.15.12:0/466506369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619746db5d0 con 0x561974909ed0 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.120+0000 7f55edffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.121+0000 7f560659c700 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x561974918920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f55f8096390 tx=0x7f55f8009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e600df26ee78068 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.121+0000 7f55edffb700 1 -- 172.21.15.12:0/466506369 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8099f70 con 0x561974909ed0 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.121+0000 7f5620334b80 1 -- 172.21.15.12:0/466506369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f560000f040 con 0x561974909ed0 2023-12-11T20:36:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.121+0000 7f55edffb700 1 -- 172.21.15.12:0/466506369 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f55f8010d10 con 0x561974909ed0 2023-12-11T20:36:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.121+0000 7f55edffb700 1 -- 172.21.15.12:0/466506369 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55f80b5070 con 0x561974909ed0 2023-12-11T20:36:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.121+0000 7f5620334b80 10 client.30257 fetch_fsmap learned FSMap version 43 2023-12-11T20:36:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.121+0000 7f5620334b80 1 -- 172.21.15.12:0/466506369 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5619746ae1f0 con 0x561974909ed0 2023-12-11T20:36:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.122+0000 7f55edffb700 1 -- 172.21.15.12:0/466506369 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f560000f040 con 0x561974909ed0 2023-12-11T20:36:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.124+0000 7f55edffb700 1 -- 172.21.15.12:0/466506369 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f55f80cc070 con 0x561974909ed0 2023-12-11T20:36:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.124+0000 7f5620334b80 10 client.30257 fetch_fsmap finished waiting for FSMap version 43 2023-12-11T20:36:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.124+0000 7f5620334b80 10 client.30257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:36:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.124+0000 7f5620334b80 20 client.30257 populate_metadata read hostname 'smithi012' 2023-12-11T20:36:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.124+0000 7f5620334b80 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561974976c60 0x561974979080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.124+0000 7f5620334b80 4 client.30257 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:36:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.124+0000 7f5620334b80 1 -- 172.21.15.12:0/466506369 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561974824f70 con 0x561974976c60 2023-12-11T20:36:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.124+0000 7f55fdd9b700 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561974976c60 0x561974979080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.125+0000 7f55fdd9b700 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561974976c60 0x561974979080 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=108f6c86adfe8504 server_cookie=90804655e914b6a0 in_seq=0 out_seq=0 2023-12-11T20:36:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.126+0000 7f55edffb700 10 client.30257 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.149+0000 7f55edffb700 1 -- 172.21.15.12:0/466506369 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561974824f70 con 0x561974976c60 2023-12-11T20:36:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.149+0000 7f55edffb700 10 client.30257 handle_command_reply: tid=0 2023-12-11T20:36:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.149+0000 7f5620334b80 1 client.30257 shutdown 2023-12-11T20:36:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f5620334b80 1 -- 172.21.15.12:0/466506369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 msgr2=0x561974918920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f5620334b80 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x561974918920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f55f8096390 tx=0x7f55f8009290 comp rx=0 tx=0).stop 2023-12-11T20:36:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f5620334b80 1 -- 172.21.15.12:0/466506369 shutdown_connections 2023-12-11T20:36:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f5620334b80 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x561974976c60 0x561974979080 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f5620334b80 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x561974909ed0 0x561974918920 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f5620334b80 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56197490b720 0x561974919e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f5620334b80 1 --2- 172.21.15.12:0/466506369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56197490a830 0x561974918e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f5620334b80 1 -- 172.21.15.12:0/466506369 >> 172.21.15.12:0/466506369 conn(0x561974839780 msgr2=0x561974913200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.150+0000 7f55edffb700 0 client.30257 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.151+0000 7f5620334b80 1 -- 172.21.15.12:0/466506369 shutdown_connections 2023-12-11T20:36:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.151+0000 7f5620334b80 1 -- 172.21.15.12:0/466506369 wait complete. 2023-12-11T20:36:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.152+0000 7f5620334b80 20 client.30257 trim_cache size 0 max 16384 2023-12-11T20:36:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:36:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:36:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:36:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:36:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.154+0000 7f560c9ff700 1 -- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55f40a1640 msgr2=0x7f55f40a3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.155+0000 7f560c9ff700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55f40a1640 0x7f55f40a3b00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f560001d000 tx=0x7f5600020000 comp rx=0 tx=0).stop 2023-12-11T20:36:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.155+0000 7f560c9ff700 1 -- 172.21.15.12:0/283248180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5608107af0 msgr2=0x7f560819da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.155+0000 7f560c9ff700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5608107af0 0x7f560819da60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f55f800ebf0 tx=0x7f55f800c2d0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.155+0000 7f560c9ff700 1 -- 172.21.15.12:0/283248180 shutdown_connections 2023-12-11T20:36:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.156+0000 7f560c9ff700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f55f40a1640 0x7f55f40a3b00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.156+0000 7f560c9ff700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5608107af0 0x7f560819da60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.156+0000 7f560c9ff700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5608109680 0x7f56081a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.156+0000 7f560c9ff700 1 --2- 172.21.15.12:0/283248180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5608108ce0 0x7f560819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.156+0000 7f560c9ff700 1 -- 172.21.15.12:0/283248180 >> 172.21.15.12:0/283248180 conn(0x7f5608076a90 msgr2=0x7f560810c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.157+0000 7f560c9ff700 1 -- 172.21.15.12:0/283248180 shutdown_connections 2023-12-11T20:36:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:20.157+0000 7f560c9ff700 1 -- 172.21.15.12:0/283248180 wait complete. 2023-12-11T20:36:20.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:20 smithi032 ceph-mon[132488]: pgmap v987: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2023-12-11T20:36:21.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:20 smithi039 ceph-mon[102205]: pgmap v987: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2023-12-11T20:36:21.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:20 smithi012 ceph-mon[128787]: pgmap v987: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 4.30k op/s 2023-12-11T20:36:22.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:22 smithi032 ceph-mon[132488]: pgmap v988: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:36:23.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:22 smithi039 ceph-mon[102205]: pgmap v988: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:36:23.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:22 smithi012 ceph-mon[128787]: pgmap v988: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.54k op/s 2023-12-11T20:36:24.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:24 smithi032 ceph-mon[132488]: pgmap v989: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2023-12-11T20:36:25.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:24 smithi039 ceph-mon[102205]: pgmap v989: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2023-12-11T20:36:25.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:24 smithi012 ceph-mon[128787]: pgmap v989: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.19k op/s 2023-12-11T20:36:26.963 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:26 smithi032 ceph-mon[132488]: pgmap v990: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:36:27.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:26 smithi039 ceph-mon[102205]: pgmap v990: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:36:27.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:26 smithi012 ceph-mon[128787]: pgmap v990: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.46k op/s 2023-12-11T20:36:27.962 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:27 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:36:28.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:27 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:36:28.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:27 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:36:29.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:28 smithi039 ceph-mon[102205]: pgmap v991: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.61k op/s 2023-12-11T20:36:29.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:28 smithi012 ceph-mon[128787]: pgmap v991: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.61k op/s 2023-12-11T20:36:29.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:28 smithi032 ceph-mon[132488]: pgmap v991: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 4.61k op/s 2023-12-11T20:36:31.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:30 smithi039 ceph-mon[102205]: pgmap v992: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2023-12-11T20:36:31.084 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:30 smithi012 ceph-mon[128787]: pgmap v992: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2023-12-11T20:36:31.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:30 smithi032 ceph-mon[132488]: pgmap v992: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 4.17k op/s 2023-12-11T20:36:33.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:32 smithi039 ceph-mon[102205]: pgmap v993: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:36:33.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:32 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:36:33.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:32 smithi012 ceph-mon[128787]: pgmap v993: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:36:33.082 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:32 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:36:33.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:32 smithi032 ceph-mon[132488]: pgmap v993: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.34k op/s 2023-12-11T20:36:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:32 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.493+0000 7f07305ff700 1 -- 172.21.15.12:0/188930570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0728101270 msgr2=0x7f0728107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.493+0000 7f07305ff700 1 --2- 172.21.15.12:0/188930570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0728101270 0x7f0728107b20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f072001c100 tx=0x7f072001c410 comp rx=0 tx=0).stop 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.493+0000 7f07305ff700 1 -- 172.21.15.12:0/188930570 shutdown_connections 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.493+0000 7f07305ff700 1 --2- 172.21.15.12:0/188930570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0728101270 0x7f0728107b20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.493+0000 7f07305ff700 1 --2- 172.21.15.12:0/188930570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07280ff6e0 0x7f07280ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.493+0000 7f07305ff700 1 --2- 172.21.15.12:0/188930570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07281008d0 0x7f0728100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.493+0000 7f07305ff700 1 -- 172.21.15.12:0/188930570 >> 172.21.15.12:0/188930570 conn(0x7f07280fac70 msgr2=0x7f07280fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.494+0000 7f07305ff700 1 -- 172.21.15.12:0/188930570 shutdown_connections 2023-12-11T20:36:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.494+0000 7f07305ff700 1 -- 172.21.15.12:0/188930570 wait complete. 2023-12-11T20:36:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.495+0000 7f07305ff700 1 Processor -- start 2023-12-11T20:36:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.496+0000 7f07305ff700 1 -- start start 2023-12-11T20:36:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.496+0000 7f07305ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07280ff6e0 0x7f072806e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.496+0000 7f07305ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07281008d0 0x7f072806eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.496+0000 7f07305ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728101270 0x7f0728071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.496+0000 7f07305ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728072490 con 0x7f07281008d0 2023-12-11T20:36:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.496+0000 7f07305ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728072600 con 0x7f07280ff6e0 2023-12-11T20:36:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.496+0000 7f07305ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07280727c0 con 0x7f0728101270 2023-12-11T20:36:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072e39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07280ff6e0 0x7f072806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072e39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07280ff6e0 0x7f072806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:47140/0 (socket says 172.21.15.12:47140) 2023-12-11T20:36:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072e39b700 1 -- 172.21.15.12:0/3615738297 learned_addr learned my addr 172.21.15.12:0/3615738297 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072eb9c700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728101270 0x7f0728071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072db9a700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07281008d0 0x7f072806eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072eb9c700 1 -- 172.21.15.12:0/3615738297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07280ff6e0 msgr2=0x7f072806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072eb9c700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07280ff6e0 0x7f072806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072eb9c700 1 -- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07281008d0 msgr2=0x7f072806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072eb9c700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07281008d0 0x7f072806eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072eb9c700 1 -- 172.21.15.12:0/3615738297 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072001ad10 con 0x7f0728101270 2023-12-11T20:36:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.498+0000 7f072db9a700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07281008d0 0x7f072806eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:36:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.499+0000 7f072eb9c700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728101270 0x7f0728071ec0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0720018ab0 tx=0x7f072001a370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.499+0000 7f071f7fe700 1 -- 172.21.15.12:0/3615738297 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072001f040 con 0x7f0728101270 2023-12-11T20:36:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.499+0000 7f07305ff700 1 -- 172.21.15.12:0/3615738297 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07280729e0 con 0x7f0728101270 2023-12-11T20:36:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.500+0000 7f071f7fe700 1 -- 172.21.15.12:0/3615738297 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0720003e10 con 0x7f0728101270 2023-12-11T20:36:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.500+0000 7f07305ff700 1 -- 172.21.15.12:0/3615738297 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0728072e30 con 0x7f0728101270 2023-12-11T20:36:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.500+0000 7f071f7fe700 1 -- 172.21.15.12:0/3615738297 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200052a0 con 0x7f0728101270 2023-12-11T20:36:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.505+0000 7f071f7fe700 1 -- 172.21.15.12:0/3615738297 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f0720005400 con 0x7f0728101270 2023-12-11T20:36:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.508+0000 7f071f7fe700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07140a15b0 0x7f07140a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.508+0000 7f071f7fe700 1 -- 172.21.15.12:0/3615738297 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f07200df1f0 con 0x7f0728101270 2023-12-11T20:36:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.509+0000 7f0743f4eb80 1 Processor -- start 2023-12-11T20:36:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.509+0000 7f072e39b700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07140a15b0 0x7f07140a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.509+0000 7f0743f4eb80 1 -- start start 2023-12-11T20:36:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.510+0000 7f072e39b700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07140a15b0 0x7f07140a3a70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0718007cf0 tx=0x7f0718007480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.510+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e192f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.510+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e1a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.510+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e1aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.510+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9d74af0 con 0x55f4f9e1a720 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.510+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9d72410 con 0x55f4f9e19830 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.510+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9d6dd00 con 0x55f4f9e18ed0 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072e39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072e39b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e192f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:35506/0 (socket says 172.21.15.12:35506) 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072e39b700 1 -- 172.21.15.12:0/859084149 learned_addr learned my addr 172.21.15.12:0/859084149 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072db9a700 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e1a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072eb9c700 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e1aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072db9a700 1 -- 172.21.15.12:0/859084149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 msgr2=0x55f4f9e192f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072db9a700 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e192f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072db9a700 1 -- 172.21.15.12:0/859084149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 msgr2=0x55f4f9e1aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072db9a700 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e1aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.511+0000 7f072db9a700 1 -- 172.21.15.12:0/859084149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f9bea5d0 con 0x55f4f9e19830 2023-12-11T20:36:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.512+0000 7f072db9a700 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e1a140 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f07240077e0 tx=0x7f0724007af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e9b9963787aaf7f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.512+0000 7f071cbfe700 1 -- 172.21.15.12:0/859084149 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240125f0 con 0x55f4f9e19830 2023-12-11T20:36:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.512+0000 7f071cbfe700 1 -- 172.21.15.12:0/859084149 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0724012be0 con 0x55f4f9e19830 2023-12-11T20:36:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.512+0000 7f071cbfe700 1 -- 172.21.15.12:0/859084149 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724013d60 con 0x55f4f9e19830 2023-12-11T20:36:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.513+0000 7f0743f4eb80 1 -- 172.21.15.12:0/859084149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 msgr2=0x55f4f9e1a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.513+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e1a140 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f07240077e0 tx=0x7f0724007af0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.514+0000 7f0743f4eb80 1 -- 172.21.15.12:0/859084149 shutdown_connections 2023-12-11T20:36:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.514+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e1aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.514+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e192f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.514+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/859084149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e1a140 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.514+0000 7f0743f4eb80 1 -- 172.21.15.12:0/859084149 >> 172.21.15.12:0/859084149 conn(0x55f4f9d48780 msgr2=0x55f4f9e15880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.514+0000 7f0743f4eb80 1 -- 172.21.15.12:0/859084149 shutdown_connections 2023-12-11T20:36:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.515+0000 7f0743f4eb80 1 -- 172.21.15.12:0/859084149 wait complete. 2023-12-11T20:36:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.515+0000 7f0743f4eb80 1 -- start start 2023-12-11T20:36:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.516+0000 7f0743f4eb80 1 Processor -- start 2023-12-11T20:36:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.517+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e22e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.517+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.517+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e2a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.517+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9d27500 con 0x55f4f9e1a720 2023-12-11T20:36:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.517+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9d271a0 con 0x55f4f9e19830 2023-12-11T20:36:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.517+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9bec8c0 con 0x55f4f9e18ed0 2023-12-11T20:36:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.517+0000 7f0743f4eb80 10 client.0 _ll_register_callbacks cb 0x55f4f9c52a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:36:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.518+0000 7f072db9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.518+0000 7f072db9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e233c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:47152/0 (socket says 172.21.15.12:47152) 2023-12-11T20:36:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.518+0000 7f072db9a700 1 -- 172.21.15.12:0/1999253529 learned_addr learned my addr 172.21.15.12:0/1999253529 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.518+0000 7f072e39b700 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e22e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.518+0000 7f072eb9c700 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e2a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.519+0000 7f072db9a700 1 -- 172.21.15.12:0/1999253529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 msgr2=0x55f4f9e22e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.519+0000 7f072db9a700 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e22e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.519+0000 7f072db9a700 1 -- 172.21.15.12:0/1999253529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 msgr2=0x55f4f9e2a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.519+0000 7f072db9a700 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e2a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.519+0000 7f072db9a700 1 -- 172.21.15.12:0/1999253529 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072400e040 con 0x55f4f9e19830 2023-12-11T20:36:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.522+0000 7f072db9a700 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e233c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0724012dd0 tx=0x7f0724012e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69561667805b24b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.522+0000 7f0711ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:36:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.522+0000 7f0711ffb700 1 -- 172.21.15.12:0/1999253529 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240125f0 con 0x55f4f9e19830 2023-12-11T20:36:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.523+0000 7f0711ffb700 1 -- 172.21.15.12:0/1999253529 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0724023070 con 0x55f4f9e19830 2023-12-11T20:36:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.523+0000 7f0743f4eb80 1 -- 172.21.15.12:0/1999253529 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4f9e0c730 con 0x55f4f9e19830 2023-12-11T20:36:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.523+0000 7f0711ffb700 1 -- 172.21.15.12:0/1999253529 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0724012750 con 0x55f4f9e19830 2023-12-11T20:36:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.523+0000 7f0743f4eb80 10 client.30269 fetch_fsmap learned FSMap version 45 2023-12-11T20:36:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.523+0000 7f0743f4eb80 1 -- 172.21.15.12:0/1999253529 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55f4f9b96d80 con 0x55f4f9e19830 2023-12-11T20:36:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.524+0000 7f0711ffb700 1 -- 172.21.15.12:0/1999253529 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4f9e0c730 con 0x55f4f9e19830 2023-12-11T20:36:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.524+0000 7f0711ffb700 1 -- 172.21.15.12:0/1999253529 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 45) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0724030070 con 0x55f4f9e19830 2023-12-11T20:36:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.524+0000 7f0743f4eb80 10 client.30269 fetch_fsmap finished waiting for FSMap version 45 2023-12-11T20:36:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.524+0000 7f0743f4eb80 10 client.30269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:36:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.524+0000 7f0743f4eb80 20 client.30269 populate_metadata read hostname 'smithi012' 2023-12-11T20:36:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.524+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4f9e2ecd0 0x55f4f9e310f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.524+0000 7f0743f4eb80 4 client.30269 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:36:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.524+0000 7f0743f4eb80 1 -- 172.21.15.12:0/1999253529 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4f9de8ee0 con 0x55f4f9e2ecd0 2023-12-11T20:36:33.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.526+0000 7f072e39b700 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4f9e2ecd0 0x55f4f9e310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.527+0000 7f072e39b700 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4f9e2ecd0 0x55f4f9e310f0 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dedccc51e8647acb server_cookie=7329d324312432c7 in_seq=0 out_seq=0 2023-12-11T20:36:33.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.527+0000 7f0711ffb700 10 client.30269 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:33.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.528+0000 7f0711ffb700 1 -- 172.21.15.12:0/1999253529 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f4f9de8ee0 con 0x55f4f9e2ecd0 2023-12-11T20:36:33.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.528+0000 7f0711ffb700 10 client.30269 handle_command_reply: tid=0 2023-12-11T20:36:33.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.528+0000 7f0743f4eb80 1 client.30269 shutdown 2023-12-11T20:36:33.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.529+0000 7f0743f4eb80 1 -- 172.21.15.12:0/1999253529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 msgr2=0x55f4f9e233c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.529+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e233c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0724012dd0 tx=0x7f0724012e00 comp rx=0 tx=0).stop 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.529+0000 7f0743f4eb80 1 -- 172.21.15.12:0/1999253529 shutdown_connections 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.529+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4f9e2ecd0 0x55f4f9e310f0 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.529+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e2a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.529+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e22e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.529+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/1999253529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e233c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.530+0000 7f0743f4eb80 1 -- 172.21.15.12:0/1999253529 >> 172.21.15.12:0/1999253529 conn(0x55f4f9d48780 msgr2=0x55f4f9e13ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.530+0000 7f0711ffb700 0 client.30269 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.530+0000 7f0743f4eb80 1 -- 172.21.15.12:0/1999253529 shutdown_connections 2023-12-11T20:36:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.530+0000 7f0743f4eb80 1 -- 172.21.15.12:0/1999253529 wait complete. 2023-12-11T20:36:33.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.531+0000 7f0743f4eb80 20 client.30269 trim_cache size 0 max 16384 2023-12-11T20:36:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.570+0000 7f0743f4eb80 1 Processor -- start 2023-12-11T20:36:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.570+0000 7f0743f4eb80 1 -- start start 2023-12-11T20:36:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.570+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e2aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.570+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e2a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.570+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e22e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.570+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9e2a7f0 con 0x55f4f9e1a720 2023-12-11T20:36:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.570+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9e139f0 con 0x55f4f9e19830 2023-12-11T20:36:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.570+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9e21c30 con 0x55f4f9e18ed0 2023-12-11T20:36:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.571+0000 7f072db9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e2a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.571+0000 7f072eb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e22e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.571+0000 7f072eb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e22e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51366/0 (socket says 172.21.15.12:51366) 2023-12-11T20:36:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.571+0000 7f072eb9c700 1 -- 172.21.15.12:0/3426358207 learned_addr learned my addr 172.21.15.12:0/3426358207 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.572+0000 7f072e39b700 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e2aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.572+0000 7f072db9a700 1 -- 172.21.15.12:0/3426358207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 msgr2=0x55f4f9e2aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.572+0000 7f072db9a700 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e2aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.572+0000 7f072db9a700 1 -- 172.21.15.12:0/3426358207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 msgr2=0x55f4f9e22e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.572+0000 7f072db9a700 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e22e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.572+0000 7f072db9a700 1 -- 172.21.15.12:0/3426358207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f9b7fc00 con 0x55f4f9e19830 2023-12-11T20:36:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.572+0000 7f072e39b700 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e2aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:36:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.573+0000 7f072eb9c700 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e22e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:36:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.573+0000 7f072db9a700 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e2a1b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0724013640 tx=0x7f0724007af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfe43fc4e49fa3ae server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.574+0000 7f071d3ff700 1 -- 172.21.15.12:0/3426358207 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240136e0 con 0x55f4f9e19830 2023-12-11T20:36:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.574+0000 7f071d3ff700 1 -- 172.21.15.12:0/3426358207 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f072402d070 con 0x55f4f9e19830 2023-12-11T20:36:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.574+0000 7f071d3ff700 1 -- 172.21.15.12:0/3426358207 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724003ff0 con 0x55f4f9e19830 2023-12-11T20:36:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3426358207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 msgr2=0x55f4f9e2a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e2a1b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0724013640 tx=0x7f0724007af0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3426358207 shutdown_connections 2023-12-11T20:36:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e22e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e2aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3426358207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e19830 0x55f4f9e2a1b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3426358207 >> 172.21.15.12:0/3426358207 conn(0x55f4f9d48780 msgr2=0x55f4f9e35a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3426358207 shutdown_connections 2023-12-11T20:36:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.575+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3426358207 wait complete. 2023-12-11T20:36:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.576+0000 7f0743f4eb80 1 -- start start 2023-12-11T20:36:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.577+0000 7f0743f4eb80 1 Processor -- start 2023-12-11T20:36:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.579+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e7f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.579+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e19830 0x55f4f9e816e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.579+0000 7f0743f4eb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e83c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.579+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9e84170 con 0x55f4f9e1a720 2023-12-11T20:36:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.579+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9e842b0 con 0x55f4f9e18ed0 2023-12-11T20:36:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.579+0000 7f0743f4eb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f9e843f0 con 0x55f4f9e19830 2023-12-11T20:36:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.579+0000 7f0743f4eb80 10 client.0 _ll_register_callbacks cb 0x55f4f9c52a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:36:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.579+0000 7f072e39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e7f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.580+0000 7f072e39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e7f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:47176/0 (socket says 172.21.15.12:47176) 2023-12-11T20:36:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.580+0000 7f072e39b700 1 -- 172.21.15.12:0/3627132924 learned_addr learned my addr 172.21.15.12:0/3627132924 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.580+0000 7f072db9a700 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e19830 0x55f4f9e816e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.580+0000 7f072db9a700 1 -- 172.21.15.12:0/3627132924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e18ed0 msgr2=0x55f4f9e7f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.580+0000 7f072db9a700 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e7f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.580+0000 7f072db9a700 1 -- 172.21.15.12:0/3627132924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 msgr2=0x55f4f9e83c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.580+0000 7f072db9a700 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e83c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.580+0000 7f072db9a700 1 -- 172.21.15.12:0/3627132924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0728072e30 con 0x55f4f9e19830 2023-12-11T20:36:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.581+0000 7f072db9a700 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e19830 0x55f4f9e816e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55f4f9e2e8b0 tx=0x7f0724013720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=388bddcfeaf3e29 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.581+0000 7f0711ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:36:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.581+0000 7f0711ffb700 1 -- 172.21.15.12:0/3627132924 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724012900 con 0x55f4f9e19830 2023-12-11T20:36:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.581+0000 7f0711ffb700 1 -- 172.21.15.12:0/3627132924 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0724023030 con 0x55f4f9e19830 2023-12-11T20:36:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.582+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3627132924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0724012be0 con 0x55f4f9e19830 2023-12-11T20:36:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.582+0000 7f0711ffb700 1 -- 172.21.15.12:0/3627132924 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0724005a00 con 0x55f4f9e19830 2023-12-11T20:36:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.582+0000 7f0743f4eb80 10 client.30295 fetch_fsmap learned FSMap version 45 2023-12-11T20:36:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.582+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3627132924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55f4f9b96d80 con 0x55f4f9e19830 2023-12-11T20:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.583+0000 7f0711ffb700 1 -- 172.21.15.12:0/3627132924 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0724012be0 con 0x55f4f9e19830 2023-12-11T20:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.586+0000 7f0711ffb700 1 -- 172.21.15.12:0/3627132924 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 45) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0724007b60 con 0x55f4f9e19830 2023-12-11T20:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.586+0000 7f0743f4eb80 10 client.30295 fetch_fsmap finished waiting for FSMap version 45 2023-12-11T20:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.586+0000 7f0743f4eb80 10 client.30295 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.586+0000 7f0743f4eb80 20 client.30295 populate_metadata read hostname 'smithi012' 2023-12-11T20:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.586+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4f9e85850 0x55f4f9e87c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.586+0000 7f0743f4eb80 4 client.30295 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:36:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.586+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3627132924 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f4f9d33f70 con 0x55f4f9e85850 2023-12-11T20:36:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.587+0000 7f072e39b700 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4f9e85850 0x55f4f9e87c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.589+0000 7f072e39b700 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4f9e85850 0x55f4f9e87c40 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e157f5ea26478cec server_cookie=afdbf949e629aef8 in_seq=0 out_seq=0 2023-12-11T20:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.589+0000 7f0711ffb700 10 client.30295 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.605+0000 7f0711ffb700 1 -- 172.21.15.12:0/3627132924 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f4f9d33f70 con 0x55f4f9e85850 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.605+0000 7f0711ffb700 10 client.30295 handle_command_reply: tid=0 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.605+0000 7f0743f4eb80 1 client.30295 shutdown 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3627132924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e19830 msgr2=0x55f4f9e816e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e19830 0x55f4f9e816e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55f4f9e2e8b0 tx=0x7f0724013720 comp rx=0 tx=0).stop 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3627132924 shutdown_connections 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55f4f9e85850 0x55f4f9e87c40 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0711ffb700 0 client.30295 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55f4f9e18ed0 0x55f4f9e7f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f9e1a720 0x55f4f9e83c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 --2- 172.21.15.12:0/3627132924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f4f9e19830 0x55f4f9e816e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3627132924 >> 172.21.15.12:0/3627132924 conn(0x55f4f9d48780 msgr2=0x55f4f9e22e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3627132924 shutdown_connections 2023-12-11T20:36:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.606+0000 7f0743f4eb80 1 -- 172.21.15.12:0/3627132924 wait complete. 2023-12-11T20:36:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.607+0000 7f0743f4eb80 20 client.30295 trim_cache size 0 max 16384 2023-12-11T20:36:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:36:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:36:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:36:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:36:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 -- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07140a15b0 msgr2=0x7f07140a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07140a15b0 0x7f07140a3a70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0718007cf0 tx=0x7f0718007480 comp rx=0 tx=0).stop 2023-12-11T20:36:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 -- 172.21.15.12:0/3615738297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728101270 msgr2=0x7f0728071ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728101270 0x7f0728071ec0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0720018ab0 tx=0x7f072001a370 comp rx=0 tx=0).stop 2023-12-11T20:36:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 -- 172.21.15.12:0/3615738297 shutdown_connections 2023-12-11T20:36:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f07140a15b0 0x7f07140a3a70 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07280ff6e0 0x7f072806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0728101270 0x7f0728071ec0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 --2- 172.21.15.12:0/3615738297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07281008d0 0x7f072806eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 -- 172.21.15.12:0/3615738297 >> 172.21.15.12:0/3615738297 conn(0x7f07280fac70 msgr2=0x7f072810bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 -- 172.21.15.12:0/3615738297 shutdown_connections 2023-12-11T20:36:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:33.608+0000 7f07305ff700 1 -- 172.21.15.12:0/3615738297 wait complete. 2023-12-11T20:36:35.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:34 smithi039 ceph-mon[102205]: pgmap v994: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.02k op/s 2023-12-11T20:36:35.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:34 smithi012 ceph-mon[128787]: pgmap v994: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.02k op/s 2023-12-11T20:36:35.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:34 smithi032 ceph-mon[132488]: pgmap v994: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.02k op/s 2023-12-11T20:36:37.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:36 smithi039 ceph-mon[102205]: pgmap v995: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:36:37.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:36 smithi012 ceph-mon[128787]: pgmap v995: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:36:37.216 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:36 smithi032 ceph-mon[132488]: pgmap v995: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 MiB/s wr, 4.29k op/s 2023-12-11T20:36:39.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:38 smithi039 ceph-mon[102205]: pgmap v996: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:36:39.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:38 smithi012 ceph-mon[128787]: pgmap v996: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:36:39.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:38 smithi032 ceph-mon[132488]: pgmap v996: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.48k op/s 2023-12-11T20:36:41.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:40 smithi039 ceph-mon[102205]: pgmap v997: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2023-12-11T20:36:41.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:40 smithi012 ceph-mon[128787]: pgmap v997: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2023-12-11T20:36:41.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:40 smithi032 ceph-mon[132488]: pgmap v997: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 4.10k op/s 2023-12-11T20:36:43.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:42 smithi039 ceph-mon[102205]: pgmap v998: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:36:43.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:42 smithi012 ceph-mon[128787]: pgmap v998: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:36:43.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:42 smithi032 ceph-mon[132488]: pgmap v998: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:36:45.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:44 smithi039 ceph-mon[102205]: pgmap v999: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:36:45.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:44 smithi012 ceph-mon[128787]: pgmap v999: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:36:45.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:44 smithi032 ceph-mon[132488]: pgmap v999: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:36:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.931+0000 7efbf55ff700 1 -- 172.21.15.12:0/3983630465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 msgr2=0x7efbf0101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.931+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3983630465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 0x7efbf0101920 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009fc0 tx=0x7efbe800b330 comp rx=0 tx=0).stop 2023-12-11T20:36:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.931+0000 7efbf55ff700 1 -- 172.21.15.12:0/3983630465 shutdown_connections 2023-12-11T20:36:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.931+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3983630465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0103090 0x7efbf0109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.931+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3983630465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 0x7efbf0101920 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.931+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3983630465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf01026f0 0x7efbf0102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.931+0000 7efbf55ff700 1 -- 172.21.15.12:0/3983630465 >> 172.21.15.12:0/3983630465 conn(0x7efbf00fca90 msgr2=0x7efbf00feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.932+0000 7efbf55ff700 1 -- 172.21.15.12:0/3983630465 shutdown_connections 2023-12-11T20:36:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.932+0000 7efbf55ff700 1 -- 172.21.15.12:0/3983630465 wait complete. 2023-12-11T20:36:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.934+0000 7efbf55ff700 1 Processor -- start 2023-12-11T20:36:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.934+0000 7efbf55ff700 1 -- start start 2023-12-11T20:36:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.934+0000 7efbf55ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 0x7efbf01a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.934+0000 7efbf55ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf01026f0 0x7efbf01a2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.935+0000 7efbf55ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0103090 0x7efbf01a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.935+0000 7efbee7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf01026f0 0x7efbf01a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.935+0000 7efbee7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf01026f0 0x7efbf01a2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:35412/0 (socket says 172.21.15.12:35412) 2023-12-11T20:36:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.935+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 0x7efbf01a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.936+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 0x7efbf01a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57656/0 (socket says 172.21.15.12:57656) 2023-12-11T20:36:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.936+0000 7efbf55ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01a5520 con 0x7efbf0101500 2023-12-11T20:36:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.936+0000 7efbf55ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01a5690 con 0x7efbf0103090 2023-12-11T20:36:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.936+0000 7efbf55ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01a5850 con 0x7efbf01026f0 2023-12-11T20:36:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.936+0000 7efbeeffd700 1 -- 172.21.15.12:0/3652046109 learned_addr learned my addr 172.21.15.12:0/3652046109 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.937+0000 7efbef7fe700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0103090 0x7efbf01a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.937+0000 7efbeeffd700 1 -- 172.21.15.12:0/3652046109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf01026f0 msgr2=0x7efbf01a2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.937+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf01026f0 0x7efbf01a2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.937+0000 7efbeeffd700 1 -- 172.21.15.12:0/3652046109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0103090 msgr2=0x7efbf01a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.937+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0103090 0x7efbf01a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.937+0000 7efbeeffd700 1 -- 172.21.15.12:0/3652046109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009c40 con 0x7efbf0101500 2023-12-11T20:36:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.937+0000 7efbef7fe700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0103090 0x7efbf01a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:36:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.938+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 0x7efbf01a01b0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009f90 tx=0x7efbe800bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.939+0000 7efbd7fff700 1 -- 172.21.15.12:0/3652046109 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe800e040 con 0x7efbf0101500 2023-12-11T20:36:46.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.939+0000 7efbf55ff700 1 -- 172.21.15.12:0/3652046109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf01a5ad0 con 0x7efbf0101500 2023-12-11T20:36:46.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.939+0000 7efbf55ff700 1 -- 172.21.15.12:0/3652046109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf01a5fd0 con 0x7efbf0101500 2023-12-11T20:36:46.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.940+0000 7efbd7fff700 1 -- 172.21.15.12:0/3652046109 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbe8004e60 con 0x7efbf0101500 2023-12-11T20:36:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.940+0000 7efbd7fff700 1 -- 172.21.15.12:0/3652046109 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe800e040 con 0x7efbf0101500 2023-12-11T20:36:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.946+0000 7efbd7fff700 1 -- 172.21.15.12:0/3652046109 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7efbe801d470 con 0x7efbf0101500 2023-12-11T20:36:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.949+0000 7efbd7fff700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd80a15a0 0x7efbd80a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.950+0000 7efbd7fff700 1 -- 172.21.15.12:0/3652046109 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efbe80cdb30 con 0x7efbf0101500 2023-12-11T20:36:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.950+0000 7efc08eafb80 1 Processor -- start 2023-12-11T20:36:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.951+0000 7efbee7fc700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd80a15a0 0x7efbd80a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.951+0000 7efc08eafb80 1 -- start start 2023-12-11T20:36:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.952+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48ced0 0x56475d48d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.952+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d48e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.952+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48e720 0x56475d48eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.952+0000 7efc08eafb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d3e8af0 con 0x56475d48e720 2023-12-11T20:36:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.952+0000 7efc08eafb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d3e6410 con 0x56475d48d830 2023-12-11T20:36:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.952+0000 7efc08eafb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d3e1d00 con 0x56475d48ced0 2023-12-11T20:36:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.952+0000 7efbee7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d48e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.953+0000 7efbee7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d48e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:56038/0 (socket says 172.21.15.12:56038) 2023-12-11T20:36:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.953+0000 7efbee7fc700 1 -- 172.21.15.12:0/3643625800 learned_addr learned my addr 172.21.15.12:0/3643625800 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.953+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48ced0 0x56475d48d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.954+0000 7efbeeffd700 1 -- 172.21.15.12:0/3643625800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 msgr2=0x56475d48e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.954+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d48e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.954+0000 7efbeeffd700 1 -- 172.21.15.12:0/3643625800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48e720 msgr2=0x56475d48eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.954+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48e720 0x56475d48eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.954+0000 7efbeeffd700 1 -- 172.21.15.12:0/3643625800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56475d25e5d0 con 0x56475d48ced0 2023-12-11T20:36:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.954+0000 7efbee7fc700 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d48e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:36:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.954+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48ced0 0x56475d48d2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efbe80079d0 tx=0x7efbe8009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9781b7a1302956 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.955+0000 7efbd57fa700 1 -- 172.21.15.12:0/3643625800 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe809efe0 con 0x56475d48ced0 2023-12-11T20:36:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.955+0000 7efbd57fa700 1 -- 172.21.15.12:0/3643625800 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbe80a3190 con 0x56475d48ced0 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.955+0000 7efbd57fa700 1 -- 172.21.15.12:0/3643625800 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe809a380 con 0x56475d48ced0 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.956+0000 7efc08eafb80 1 -- 172.21.15.12:0/3643625800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48ced0 msgr2=0x56475d48d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.956+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48ced0 0x56475d48d2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efbe80079d0 tx=0x7efbe8009920 comp rx=0 tx=0).stop 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.956+0000 7efc08eafb80 1 -- 172.21.15.12:0/3643625800 shutdown_connections 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.956+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48e720 0x56475d48eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.956+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48ced0 0x56475d48d2f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.956+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3643625800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d48e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.956+0000 7efc08eafb80 1 -- 172.21.15.12:0/3643625800 >> 172.21.15.12:0/3643625800 conn(0x56475d3bc780 msgr2=0x56475d489880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.957+0000 7efbee7fc700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd80a15a0 0x7efbd80a3a60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efbe0017690 tx=0x7efbe0009f00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.957+0000 7efc08eafb80 1 -- 172.21.15.12:0/3643625800 shutdown_connections 2023-12-11T20:36:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.958+0000 7efc08eafb80 1 -- 172.21.15.12:0/3643625800 wait complete. 2023-12-11T20:36:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.960+0000 7efc08eafb80 1 -- start start 2023-12-11T20:36:46.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.961+0000 7efc08eafb80 1 Processor -- start 2023-12-11T20:36:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.962+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d496cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.962+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d4971f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.962+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d49e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.962+0000 7efc08eafb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d39b500 con 0x56475d48ced0 2023-12-11T20:36:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.962+0000 7efc08eafb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d39b1a0 con 0x56475d48d830 2023-12-11T20:36:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.962+0000 7efc08eafb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d2608c0 con 0x56475d48e720 2023-12-11T20:36:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.962+0000 7efc08eafb80 10 client.0 _ll_register_callbacks cb 0x56475d2c6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:36:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.963+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d496cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.963+0000 7efbee7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d4971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.963+0000 7efbef7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d49e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.963+0000 7efbee7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d4971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:56052/0 (socket says 172.21.15.12:56052) 2023-12-11T20:36:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.963+0000 7efbee7fc700 1 -- 172.21.15.12:0/644931727 learned_addr learned my addr 172.21.15.12:0/644931727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.964+0000 7efbee7fc700 1 -- 172.21.15.12:0/644931727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 msgr2=0x56475d49e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.964+0000 7efbee7fc700 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d49e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.964+0000 7efbee7fc700 1 -- 172.21.15.12:0/644931727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 msgr2=0x56475d496cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.964+0000 7efbee7fc700 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d496cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.964+0000 7efbee7fc700 1 -- 172.21.15.12:0/644931727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbe0018450 con 0x56475d48d830 2023-12-11T20:36:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.964+0000 7efbeeffd700 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d496cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:36:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.965+0000 7efbee7fc700 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d4971f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efbe0018a00 tx=0x7efbe0004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a09cac2e998be81 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.965+0000 7efbd2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:36:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.965+0000 7efbd2ff5700 1 -- 172.21.15.12:0/644931727 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0004020 con 0x56475d48d830 2023-12-11T20:36:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.966+0000 7efbd2ff5700 1 -- 172.21.15.12:0/644931727 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efbe0004180 con 0x56475d48d830 2023-12-11T20:36:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.966+0000 7efc08eafb80 1 -- 172.21.15.12:0/644931727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56475d480730 con 0x56475d48d830 2023-12-11T20:36:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.966+0000 7efbd2ff5700 1 -- 172.21.15.12:0/644931727 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbe0004340 con 0x56475d48d830 2023-12-11T20:36:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.967+0000 7efc08eafb80 10 client.30284 fetch_fsmap learned FSMap version 45 2023-12-11T20:36:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.967+0000 7efc08eafb80 1 -- 172.21.15.12:0/644931727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x7efbf01a5fd0 con 0x56475d48d830 2023-12-11T20:36:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.967+0000 7efbd2ff5700 1 -- 172.21.15.12:0/644931727 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56475d480730 con 0x56475d48d830 2023-12-11T20:36:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.968+0000 7efbd2ff5700 1 -- 172.21.15.12:0/644931727 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 45) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efbe0003860 con 0x56475d48d830 2023-12-11T20:36:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.968+0000 7efc08eafb80 10 client.30284 fetch_fsmap finished waiting for FSMap version 45 2023-12-11T20:36:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.968+0000 7efc08eafb80 10 client.30284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:36:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.968+0000 7efc08eafb80 20 client.30284 populate_metadata read hostname 'smithi012' 2023-12-11T20:36:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.968+0000 7efc08eafb80 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56475d4b3bd0 0x56475d4b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.968+0000 7efc08eafb80 4 client.30284 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:36:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.968+0000 7efc08eafb80 1 -- 172.21.15.12:0/644931727 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56475d45cee0 con 0x56475d4b3bd0 2023-12-11T20:36:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.968+0000 7efbeeffd700 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56475d4b3bd0 0x56475d4b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.969+0000 7efbd2ff5700 10 client.30284 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.969+0000 7efbeeffd700 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56475d4b3bd0 0x56475d4b5ff0 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe2b920fc4731f6 server_cookie=189a1010f2c1b2cd in_seq=0 out_seq=0 2023-12-11T20:36:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.970+0000 7efbd2ff5700 1 -- 172.21.15.12:0/644931727 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56475d45cee0 con 0x56475d4b3bd0 2023-12-11T20:36:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.970+0000 7efbd2ff5700 10 client.30284 handle_command_reply: tid=0 2023-12-11T20:36:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.970+0000 7efc08eafb80 1 client.30284 shutdown 2023-12-11T20:36:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.971+0000 7efc08eafb80 1 -- 172.21.15.12:0/644931727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 msgr2=0x56475d4971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.971+0000 7efc08eafb80 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d4971f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efbe0018a00 tx=0x7efbe0004790 comp rx=0 tx=0).stop 2023-12-11T20:36:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.972+0000 7efc08eafb80 1 -- 172.21.15.12:0/644931727 shutdown_connections 2023-12-11T20:36:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.972+0000 7efc08eafb80 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56475d4b3bd0 0x56475d4b5ff0 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.972+0000 7efc08eafb80 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d49e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.972+0000 7efc08eafb80 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d496cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.972+0000 7efc08eafb80 1 --2- 172.21.15.12:0/644931727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d4971f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.972+0000 7efc08eafb80 1 -- 172.21.15.12:0/644931727 >> 172.21.15.12:0/644931727 conn(0x56475d3bc780 msgr2=0x56475d487ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.972+0000 7efbd2ff5700 0 client.30284 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.972+0000 7efc08eafb80 1 -- 172.21.15.12:0/644931727 shutdown_connections 2023-12-11T20:36:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.973+0000 7efc08eafb80 1 -- 172.21.15.12:0/644931727 wait complete. 2023-12-11T20:36:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:46.974+0000 7efc08eafb80 20 client.30284 trim_cache size 0 max 16384 2023-12-11T20:36:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.027+0000 7efc08eafb80 1 Processor -- start 2023-12-11T20:36:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efc08eafb80 1 -- start start 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d495fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d487ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efc08eafb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d4b03e0 con 0x56475d48ced0 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efc08eafb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d480700 con 0x56475d48d830 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efc08eafb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d496610 con 0x56475d48e720 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d495fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d495fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57688/0 (socket says 172.21.15.12:57688) 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efbee7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efbeeffd700 1 -- 172.21.15.12:0/117055002 learned_addr learned my addr 172.21.15.12:0/117055002 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.028+0000 7efbef7fe700 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d487ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.029+0000 7efbeeffd700 1 -- 172.21.15.12:0/117055002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 msgr2=0x56475d487ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.029+0000 7efbeeffd700 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d487ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.029+0000 7efbeeffd700 1 -- 172.21.15.12:0/117055002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 msgr2=0x56475d49df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.029+0000 7efbeeffd700 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.029+0000 7efbeeffd700 1 -- 172.21.15.12:0/117055002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56475d20ad80 con 0x56475d48ced0 2023-12-11T20:36:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.029+0000 7efbee7fc700 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:36:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.029+0000 7efbeeffd700 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d495fb0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009c10 tx=0x7efbe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9e506e06ede8a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.029+0000 7efbd5ffb700 1 -- 172.21.15.12:0/117055002 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8098fd0 con 0x56475d48ced0 2023-12-11T20:36:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.030+0000 7efbd5ffb700 1 -- 172.21.15.12:0/117055002 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56475d45cee0 con 0x56475d48ced0 2023-12-11T20:36:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.030+0000 7efbd5ffb700 1 -- 172.21.15.12:0/117055002 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe809a5e0 con 0x56475d48ced0 2023-12-11T20:36:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.031+0000 7efc08eafb80 1 -- 172.21.15.12:0/117055002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 msgr2=0x56475d495fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.031+0000 7efc08eafb80 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d495fb0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009c10 tx=0x7efbe800b330 comp rx=0 tx=0).stop 2023-12-11T20:36:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.031+0000 7efc08eafb80 1 -- 172.21.15.12:0/117055002 shutdown_connections 2023-12-11T20:36:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.031+0000 7efc08eafb80 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d487ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.031+0000 7efc08eafb80 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d48ced0 0x56475d495fb0 secure :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009c10 tx=0x7efbe800b330 comp rx=0 tx=0).stop 2023-12-11T20:36:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.031+0000 7efc08eafb80 1 --2- 172.21.15.12:0/117055002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.031+0000 7efc08eafb80 1 -- 172.21.15.12:0/117055002 >> 172.21.15.12:0/117055002 conn(0x56475d3bc780 msgr2=0x56475d494c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.032+0000 7efc08eafb80 1 -- 172.21.15.12:0/117055002 shutdown_connections 2023-12-11T20:36:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.032+0000 7efc08eafb80 1 -- 172.21.15.12:0/117055002 wait complete. 2023-12-11T20:36:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.033+0000 7efc08eafb80 1 -- start start 2023-12-11T20:36:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.034+0000 7efc08eafb80 1 Processor -- start 2023-12-11T20:36:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d49c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efc08eafb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d49cf10 0x56475d49d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efc08eafb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d49da70 con 0x56475d49cf10 2023-12-11T20:36:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efc08eafb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d49dbe0 con 0x56475d48d830 2023-12-11T20:36:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efc08eafb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56475d49dda0 con 0x56475d48e720 2023-12-11T20:36:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efc08eafb80 10 client.0 _ll_register_callbacks cb 0x56475d2c6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:36:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efbeeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:56076/0 (socket says 172.21.15.12:56076) 2023-12-11T20:36:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.035+0000 7efbeeffd700 1 -- 172.21.15.12:0/3238509946 learned_addr learned my addr 172.21.15.12:0/3238509946 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:36:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.036+0000 7efbee7fc700 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d49c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.036+0000 7efbef7fe700 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d49cf10 0x56475d49d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.036+0000 7efbeeffd700 1 -- 172.21.15.12:0/3238509946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 msgr2=0x56475d49c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.036+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d49c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.036+0000 7efbeeffd700 1 -- 172.21.15.12:0/3238509946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d49cf10 msgr2=0x56475d49d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:36:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.036+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d49cf10 0x56475d49d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.036+0000 7efbeeffd700 1 -- 172.21.15.12:0/3238509946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf01a5fd0 con 0x56475d48d830 2023-12-11T20:36:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.036+0000 7efbef7fe700 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d49cf10 0x56475d49d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:36:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.037+0000 7efbeeffd700 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49c490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efbe809ae20 tx=0x7efbe809b0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eea89b6b44993d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:36:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.038+0000 7efbd2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-12-11T20:36:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.038+0000 7efbd2ff5700 1 -- 172.21.15.12:0/3238509946 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80a10d0 con 0x56475d48d830 2023-12-11T20:36:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.038+0000 7efbd2ff5700 1 -- 172.21.15.12:0/3238509946 <== mon.2 v2:172.21.15.32:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efbe809a380 con 0x56475d48d830 2023-12-11T20:36:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.038+0000 7efc08eafb80 1 -- 172.21.15.12:0/3238509946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbe80a3190 con 0x56475d48d830 2023-12-11T20:36:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.038+0000 7efbd2ff5700 1 -- 172.21.15.12:0/3238509946 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbe809a540 con 0x56475d48d830 2023-12-11T20:36:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.038+0000 7efc08eafb80 10 client.30290 fetch_fsmap learned FSMap version 45 2023-12-11T20:36:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.039+0000 7efc08eafb80 1 -- 172.21.15.12:0/3238509946 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x56475d25e5d0 con 0x56475d48d830 2023-12-11T20:36:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.039+0000 7efbd2ff5700 1 -- 172.21.15.12:0/3238509946 <== mon.2 v2:172.21.15.32:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efbe80a3190 con 0x56475d48d830 2023-12-11T20:36:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.039+0000 7efbd2ff5700 1 -- 172.21.15.12:0/3238509946 <== mon.2 v2:172.21.15.32:3300/0 5 ==== fsmap(e 45) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efbe8066060 con 0x56475d48d830 2023-12-11T20:36:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.040+0000 7efc08eafb80 10 client.30290 fetch_fsmap finished waiting for FSMap version 45 2023-12-11T20:36:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.040+0000 7efc08eafb80 10 client.30290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:36:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.040+0000 7efc08eafb80 20 client.30290 populate_metadata read hostname 'smithi012' 2023-12-11T20:36:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.040+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56475d50ad00 0x56475d50d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:36:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.040+0000 7efc08eafb80 4 client.30290 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:36:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.040+0000 7efc08eafb80 1 -- 172.21.15.12:0/3238509946 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56475d3a7f70 con 0x56475d50ad00 2023-12-11T20:36:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.041+0000 7efbee7fc700 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56475d50ad00 0x56475d50d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:36:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.043+0000 7efbd2ff5700 10 client.30290 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.043+0000 7efbee7fc700 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56475d50ad00 0x56475d50d0f0 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b55fb5806a4328 server_cookie=bc7cba58cf6c3742 in_seq=0 out_seq=0 2023-12-11T20:36:47.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:46 smithi039 ceph-mon[102205]: pgmap v1000: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2023-12-11T20:36:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.066+0000 7efbd2ff5700 1 -- 172.21.15.12:0/3238509946 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56475d3a7f70 con 0x56475d50ad00 2023-12-11T20:36:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.066+0000 7efbd2ff5700 10 client.30290 handle_command_reply: tid=0 2023-12-11T20:36:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.066+0000 7efc08eafb80 1 client.30290 shutdown 2023-12-11T20:36:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 -- 172.21.15.12:0/3238509946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 msgr2=0x56475d49c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49c490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efbe809ae20 tx=0x7efbe809b0f0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 -- 172.21.15.12:0/3238509946 shutdown_connections 2023-12-11T20:36:47.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56475d50ad00 0x56475d50d0f0 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56475d48d830 0x56475d49c490 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56475d49cf10 0x56475d49d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 --2- 172.21.15.12:0/3238509946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56475d48e720 0x56475d49c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 -- 172.21.15.12:0/3238509946 >> 172.21.15.12:0/3238509946 conn(0x56475d3bc780 msgr2=0x56475d496a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:47.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efbd2ff5700 0 client.30290 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:36:47.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.067+0000 7efc08eafb80 1 -- 172.21.15.12:0/3238509946 shutdown_connections 2023-12-11T20:36:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.068+0000 7efc08eafb80 1 -- 172.21.15.12:0/3238509946 wait complete. 2023-12-11T20:36:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.068+0000 7efc08eafb80 20 client.30290 trim_cache size 0 max 16384 2023-12-11T20:36:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:36:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:36:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:36:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:36:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 -- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd80a15a0 msgr2=0x7efbd80a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd80a15a0 0x7efbd80a3a60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efbe0017690 tx=0x7efbe0009f00 comp rx=0 tx=0).stop 2023-12-11T20:36:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 -- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 msgr2=0x7efbf01a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:36:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 0x7efbf01a01b0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009f90 tx=0x7efbe800bcd0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 -- 172.21.15.12:0/3652046109 shutdown_connections 2023-12-11T20:36:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efbd80a15a0 0x7efbd80a3a60 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efbf0103090 0x7efbf01a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf0101500 0x7efbf01a01b0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 --2- 172.21.15.12:0/3652046109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbf01026f0 0x7efbf01a2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:36:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 -- 172.21.15.12:0/3652046109 >> 172.21.15.12:0/3652046109 conn(0x7efbf00fca90 msgr2=0x7efbf00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:36:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 -- 172.21.15.12:0/3652046109 shutdown_connections 2023-12-11T20:36:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:36:47.069+0000 7efbf55ff700 1 -- 172.21.15.12:0/3652046109 wait complete. 2023-12-11T20:36:47.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:46 smithi012 ceph-mon[128787]: pgmap v1000: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2023-12-11T20:36:47.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:46 smithi032 ceph-mon[132488]: pgmap v1000: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.22k op/s 2023-12-11T20:36:49.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:48 smithi039 ceph-mon[102205]: pgmap v1001: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2023-12-11T20:36:49.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:48 smithi012 ceph-mon[128787]: pgmap v1001: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2023-12-11T20:36:49.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:48 smithi032 ceph-mon[132488]: pgmap v1001: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 4.37k op/s 2023-12-11T20:36:51.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:50 smithi039 ceph-mon[102205]: pgmap v1002: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.99k op/s 2023-12-11T20:36:51.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:50 smithi012 ceph-mon[128787]: pgmap v1002: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.99k op/s 2023-12-11T20:36:51.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:50 smithi032 ceph-mon[132488]: pgmap v1002: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.99k op/s 2023-12-11T20:36:53.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:52 smithi039 ceph-mon[102205]: pgmap v1003: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2023-12-11T20:36:53.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:52 smithi012 ceph-mon[128787]: pgmap v1003: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2023-12-11T20:36:53.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:52 smithi032 ceph-mon[132488]: pgmap v1003: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 4.25k op/s 2023-12-11T20:36:54.051 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:53 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:36:54.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:53 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:36:54.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:53 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:36:55.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:54 smithi039 ceph-mon[102205]: pgmap v1004: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:36:55.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:55.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:54 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:55.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:54 smithi012 ceph-mon[128787]: pgmap v1004: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:36:55.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:55.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:54 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:55.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:54 smithi032 ceph-mon[132488]: pgmap v1004: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.92k op/s 2023-12-11T20:36:55.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:54 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:55.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:54 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:57.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:56 smithi039 ceph-mon[102205]: pgmap v1005: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2023-12-11T20:36:57.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:56 smithi012 ceph-mon[128787]: pgmap v1005: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2023-12-11T20:36:57.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:56 smithi032 ceph-mon[132488]: pgmap v1005: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 4.24k op/s 2023-12-11T20:36:58.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:58 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:58 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:58.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:58 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:36:59.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:36:59 smithi032 ceph-mon[132488]: pgmap v1006: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:36:59.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:36:59 smithi039 ceph-mon[102205]: pgmap v1006: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:36:59.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:36:59 smithi012 ceph-mon[128787]: pgmap v1006: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 4.32k op/s 2023-12-11T20:37:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.503+0000 7f2fae7ff700 1 -- 172.21.15.12:0/44327911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8073fd0 msgr2=0x7f2fa8074450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.503+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/44327911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8073fd0 0x7f2fa8074450 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0098f0 tx=0x7f2f9c009c00 comp rx=0 tx=0).stop 2023-12-11T20:37:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.503+0000 7f2fae7ff700 1 -- 172.21.15.12:0/44327911 shutdown_connections 2023-12-11T20:37:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.503+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/44327911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fa80755b0 0x7f2fa8073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.503+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/44327911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fa81093a0 0x7f2fa810b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.503+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/44327911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8073fd0 0x7f2fa8074450 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.503+0000 7f2fae7ff700 1 -- 172.21.15.12:0/44327911 >> 172.21.15.12:0/44327911 conn(0x7f2fa80fca60 msgr2=0x7f2fa80fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.504+0000 7f2fae7ff700 1 -- 172.21.15.12:0/44327911 shutdown_connections 2023-12-11T20:37:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.504+0000 7f2fae7ff700 1 -- 172.21.15.12:0/44327911 wait complete. 2023-12-11T20:37:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.506+0000 7f2fae7ff700 1 Processor -- start 2023-12-11T20:37:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.507+0000 7f2fae7ff700 1 -- start start 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.507+0000 7f2fae7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fa8073fd0 0x7f2fa81995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.507+0000 7f2fae7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa80755b0 0x7f2fa8199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.507+0000 7f2fae7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fa81093a0 0x7f2fa81a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.507+0000 7f2fae7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81a10c0 con 0x7f2fa80755b0 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.507+0000 7f2fae7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81a1200 con 0x7f2fa81093a0 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.507+0000 7f2fae7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81a1390 con 0x7f2fa8073fd0 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa80755b0 0x7f2fa8199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa80755b0 0x7f2fa8199b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57902/0 (socket says 172.21.15.12:57902) 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa77fe700 1 -- 172.21.15.12:0/1969960921 learned_addr learned my addr 172.21.15.12:0/1969960921 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa7fff700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fa8073fd0 0x7f2fa81995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2facd9c700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fa81093a0 0x7f2fa81a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa77fe700 1 -- 172.21.15.12:0/1969960921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fa8073fd0 msgr2=0x7f2fa81995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fa8073fd0 0x7f2fa81995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa77fe700 1 -- 172.21.15.12:0/1969960921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fa81093a0 msgr2=0x7f2fa81a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fa81093a0 0x7f2fa81a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.508+0000 7f2fa77fe700 1 -- 172.21.15.12:0/1969960921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c009520 con 0x7f2fa80755b0 2023-12-11T20:37:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.509+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa80755b0 0x7f2fa8199b20 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009230 tx=0x7f2f9c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.510+0000 7f2fa57fa700 1 -- 172.21.15.12:0/1969960921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c01c070 con 0x7f2fa80755b0 2023-12-11T20:37:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.510+0000 7f2fa57fa700 1 -- 172.21.15.12:0/1969960921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f9c00f7d0 con 0x7f2fa80755b0 2023-12-11T20:37:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.510+0000 7f2fa57fa700 1 -- 172.21.15.12:0/1969960921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0038c0 con 0x7f2fa80755b0 2023-12-11T20:37:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.510+0000 7f2fae7ff700 1 -- 172.21.15.12:0/1969960921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa81a1610 con 0x7f2fa80755b0 2023-12-11T20:37:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.512+0000 7f2fae7ff700 1 -- 172.21.15.12:0/1969960921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa81a19e0 con 0x7f2fa80755b0 2023-12-11T20:37:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.519+0000 7f2fc20fdb80 1 Processor -- start 2023-12-11T20:37:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.519+0000 7f2fc20fdb80 1 -- start start 2023-12-11T20:37:00.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.520+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413dee5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.520+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413dee3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.520+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413dee4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.520+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413de3faf0 con 0x56413dee5d70 2023-12-11T20:37:00.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.520+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413de3d410 con 0x56413dee5410 2023-12-11T20:37:00.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.520+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413de38d00 con 0x56413dee41e0 2023-12-11T20:37:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.521+0000 7f2fa57fa700 1 -- 172.21.15.12:0/1969960921 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f2f9c020030 con 0x7f2fa80755b0 2023-12-11T20:37:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.522+0000 7f2fa77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413dee4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.522+0000 7f2fa77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413dee4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44546/0 (socket says 172.21.15.12:44546) 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.522+0000 7f2fa77fe700 1 -- 172.21.15.12:0/3121047970 learned_addr learned my addr 172.21.15.12:0/3121047970 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.523+0000 7f2fa77fe700 1 -- 172.21.15.12:0/3121047970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 msgr2=0x56413dee5830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.523+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/3121047970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413dee5830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.523+0000 7f2fa77fe700 1 -- 172.21.15.12:0/3121047970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 msgr2=0x56413dee3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.523+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/3121047970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413dee3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.523+0000 7f2fa57fa700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f980a1570 0x7f2f980a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.523+0000 7f2fa77fe700 1 -- 172.21.15.12:0/3121047970 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56413dcb55d0 con 0x56413dee41e0 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.524+0000 7f2facd9c700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f980a1570 0x7f2f980a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.524+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/3121047970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413dee4660 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0a3590 tx=0x7f2f9c097410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=218318e1c5a13b5b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.524+0000 7f2f927fc700 1 -- 172.21.15.12:0/3121047970 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c09aea0 con 0x56413dee41e0 2023-12-11T20:37:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.525+0000 7f2f927fc700 1 -- 172.21.15.12:0/3121047970 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f9c0d1900 con 0x56413dee41e0 2023-12-11T20:37:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.525+0000 7f2f927fc700 1 -- 172.21.15.12:0/3121047970 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c099270 con 0x56413dee41e0 2023-12-11T20:37:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.525+0000 7f2facd9c700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f980a1570 0x7f2f980a3a30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009610 tx=0x7f2fa0009150 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.527+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3121047970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 msgr2=0x56413dee4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.527+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3121047970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413dee4660 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0a3590 tx=0x7f2f9c097410 comp rx=0 tx=0).stop 2023-12-11T20:37:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.527+0000 7f2fa57fa700 1 -- 172.21.15.12:0/1969960921 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2f9c0cddd0 con 0x7f2fa80755b0 2023-12-11T20:37:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.527+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3121047970 shutdown_connections 2023-12-11T20:37:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.527+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3121047970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413dee5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.527+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3121047970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413dee4660 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.527+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3121047970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413dee3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.527+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3121047970 >> 172.21.15.12:0/3121047970 conn(0x56413de13780 msgr2=0x56413dee0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.528+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3121047970 shutdown_connections 2023-12-11T20:37:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.528+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3121047970 wait complete. 2023-12-11T20:37:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.529+0000 7f2fc20fdb80 1 -- start start 2023-12-11T20:37:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.530+0000 7f2fc20fdb80 1 Processor -- start 2023-12-11T20:37:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.531+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee41e0 0x56413deeda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.531+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5410 0x56413deedfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.531+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee5d70 0x56413def2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2fa7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee41e0 0x56413deeda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2fa7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee41e0 0x56413deeda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:46296/0 (socket says 172.21.15.12:46296) 2023-12-11T20:37:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413ddf2500 con 0x56413dee5410 2023-12-11T20:37:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413ddf21a0 con 0x56413dee41e0 2023-12-11T20:37:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413dcb78c0 con 0x56413dee5d70 2023-12-11T20:37:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2fa77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5410 0x56413deedfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2fc20fdb80 10 client.0 _ll_register_callbacks cb 0x56413dd1da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2fa7fff700 1 -- 172.21.15.12:0/3535500813 learned_addr learned my addr 172.21.15.12:0/3535500813 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.532+0000 7f2facd9c700 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee5d70 0x56413def2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2facd9c700 1 -- 172.21.15.12:0/3535500813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee41e0 msgr2=0x56413deeda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2facd9c700 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee41e0 0x56413deeda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2facd9c700 1 -- 172.21.15.12:0/3535500813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5410 msgr2=0x56413deedfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2facd9c700 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5410 0x56413deedfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2facd9c700 1 -- 172.21.15.12:0/3535500813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa81a19e0 con 0x56413dee5d70 2023-12-11T20:37:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2fa7fff700 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee41e0 0x56413deeda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:37:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5410 0x56413deedfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:37:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2facd9c700 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee5d70 0x56413def2dd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009f90 tx=0x7f2fa0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46f36b3c923e445d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.533+0000 7f2f877fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-12-11T20:37:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.535+0000 7f2f877fe700 1 -- 172.21.15.12:0/3535500813 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0021640 con 0x56413dee5d70 2023-12-11T20:37:00.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.535+0000 7f2f877fe700 1 -- 172.21.15.12:0/3535500813 <== mon.1 v2:172.21.15.39:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2fa00217a0 con 0x56413dee5d70 2023-12-11T20:37:00.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.536+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3535500813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56413deb3ee0 con 0x56413dee5d70 2023-12-11T20:37:00.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.536+0000 7f2f877fe700 1 -- 172.21.15.12:0/3535500813 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fa0021960 con 0x56413dee5d70 2023-12-11T20:37:00.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.536+0000 7f2fc20fdb80 10 client.30322 fetch_fsmap learned FSMap version 45 2023-12-11T20:37:00.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.537+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3535500813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x56413dc61d80 con 0x56413dee5d70 2023-12-11T20:37:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.537+0000 7f2f877fe700 1 -- 172.21.15.12:0/3535500813 <== mon.1 v2:172.21.15.39:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56413deb3ee0 con 0x56413dee5d70 2023-12-11T20:37:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.538+0000 7f2f877fe700 1 -- 172.21.15.12:0/3535500813 <== mon.1 v2:172.21.15.39:3300/0 5 ==== fsmap(e 45) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2fa0015ad0 con 0x56413dee5d70 2023-12-11T20:37:00.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.538+0000 7f2fc20fdb80 10 client.30322 fetch_fsmap finished waiting for FSMap version 45 2023-12-11T20:37:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.538+0000 7f2fc20fdb80 10 client.30322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:37:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.539+0000 7f2fc20fdb80 20 client.30322 populate_metadata read hostname 'smithi012' 2023-12-11T20:37:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.539+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56413df0aad0 0x56413df0cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.539+0000 7f2fc20fdb80 4 client.30322 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:37:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.539+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3535500813 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56413ddfef70 con 0x56413df0aad0 2023-12-11T20:37:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.539+0000 7f2fa7fff700 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56413df0aad0 0x56413df0cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.540+0000 7f2fa7fff700 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56413df0aad0 0x56413df0cef0 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c4d3e3db565391 server_cookie=b9d7796ffb703631 in_seq=0 out_seq=0 2023-12-11T20:37:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.540+0000 7f2f877fe700 10 client.30322 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:37:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.541+0000 7f2f877fe700 1 -- 172.21.15.12:0/3535500813 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56413ddfef70 con 0x56413df0aad0 2023-12-11T20:37:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.541+0000 7f2f877fe700 10 client.30322 handle_command_reply: tid=0 2023-12-11T20:37:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.542+0000 7f2fc20fdb80 1 client.30322 shutdown 2023-12-11T20:37:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.546+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3535500813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee5d70 msgr2=0x56413def2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.546+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee5d70 0x56413def2dd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009f90 tx=0x7f2fa0004b40 comp rx=0 tx=0).stop 2023-12-11T20:37:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.547+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3535500813 shutdown_connections 2023-12-11T20:37:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.547+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56413df0aad0 0x56413df0cef0 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.547+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee41e0 0x56413deeda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.547+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee5d70 0x56413def2dd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.547+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3535500813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5410 0x56413deedfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.547+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3535500813 >> 172.21.15.12:0/3535500813 conn(0x56413de13780 msgr2=0x56413ded9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.548+0000 7f2f877fe700 0 client.30322 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:37:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.548+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3535500813 shutdown_connections 2023-12-11T20:37:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.548+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3535500813 wait complete. 2023-12-11T20:37:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.549+0000 7f2fc20fdb80 20 client.30322 trim_cache size 0 max 16384 2023-12-11T20:37:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.615+0000 7f2fc20fdb80 1 Processor -- start 2023-12-11T20:37:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.615+0000 7f2fc20fdb80 1 -- start start 2023-12-11T20:37:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.615+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413deecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.615+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.615+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413df1b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.615+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413deed3d0 con 0x56413dee5d70 2023-12-11T20:37:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.615+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413dee3950 con 0x56413dee5410 2023-12-11T20:37:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.615+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413def48a0 con 0x56413dee41e0 2023-12-11T20:37:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.616+0000 7f2fa7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413deecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.616+0000 7f2fa7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413deecd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44556/0 (socket says 172.21.15.12:44556) 2023-12-11T20:37:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.616+0000 7f2fa7fff700 1 -- 172.21.15.12:0/3422202211 learned_addr learned my addr 172.21.15.12:0/3422202211 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.616+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/3422202211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.617+0000 7f2fa77fe700 1 -- 172.21.15.12:0/3422202211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 msgr2=0x56413deecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.617+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/3422202211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413deecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.617+0000 7f2fa77fe700 1 -- 172.21.15.12:0/3422202211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 msgr2=0x56413df1b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.617+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/3422202211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413df1b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.617+0000 7f2fa77fe700 1 -- 172.21.15.12:0/3422202211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56413dc4ac00 con 0x56413dee5410 2023-12-11T20:37:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.617+0000 7f2fa77fe700 1 --2- 172.21.15.12:0/3422202211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0a3590 tx=0x7f2f9c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba92f78f232cca8d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:00.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.618+0000 7f2f92ffd700 1 -- 172.21.15.12:0/3422202211 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0d1290 con 0x56413dee5410 2023-12-11T20:37:00.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.618+0000 7f2f92ffd700 1 -- 172.21.15.12:0/3422202211 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f9c0d1900 con 0x56413dee5410 2023-12-11T20:37:00.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.618+0000 7f2f92ffd700 1 -- 172.21.15.12:0/3422202211 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0d1290 con 0x56413dee5410 2023-12-11T20:37:00.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.619+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3422202211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 msgr2=0x56413df1ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.619+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3422202211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0a3590 tx=0x7f2f9c009260 comp rx=0 tx=0).stop 2023-12-11T20:37:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.620+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3422202211 shutdown_connections 2023-12-11T20:37:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.620+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3422202211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413df1b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.620+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3422202211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413deecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.620+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/3422202211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.620+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3422202211 >> 172.21.15.12:0/3422202211 conn(0x56413de13780 msgr2=0x56413dee8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.620+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3422202211 shutdown_connections 2023-12-11T20:37:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.620+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/3422202211 wait complete. 2023-12-11T20:37:00.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.621+0000 7f2fc20fdb80 1 -- start start 2023-12-11T20:37:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.622+0000 7f2fc20fdb80 1 Processor -- start 2023-12-11T20:37:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.623+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413df5d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.623+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.623+0000 7f2fc20fdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413df709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.623+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413df1b4b0 con 0x56413dee5d70 2023-12-11T20:37:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.623+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413df1b620 con 0x56413dee5410 2023-12-11T20:37:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.623+0000 7f2fc20fdb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x56413df70f80 con 0x56413dee41e0 2023-12-11T20:37:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.623+0000 7f2fc20fdb80 10 client.0 _ll_register_callbacks cb 0x56413dd1da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:37:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.625+0000 7f2fa77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.625+0000 7f2fa7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413df5d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.625+0000 7f2fa7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413df5d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:44562/0 (socket says 172.21.15.12:44562) 2023-12-11T20:37:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.625+0000 7f2fa7fff700 1 -- 172.21.15.12:0/2019747625 learned_addr learned my addr 172.21.15.12:0/2019747625 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.625+0000 7f2facd9c700 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413df709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.626+0000 7f2facd9c700 1 -- 172.21.15.12:0/2019747625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 msgr2=0x56413df5d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.626+0000 7f2facd9c700 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413df5d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.626+0000 7f2facd9c700 1 -- 172.21.15.12:0/2019747625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 msgr2=0x56413df1ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.626+0000 7f2facd9c700 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.626+0000 7f2facd9c700 1 -- 172.21.15.12:0/2019747625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56413dcb55d0 con 0x56413dee5d70 2023-12-11T20:37:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.626+0000 7f2facd9c700 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413df709f0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0015ee0 tx=0x7f2fa0016f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607f0df568e0130b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.626+0000 7f2f877fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:37:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.627+0000 7f2f877fe700 1 -- 172.21.15.12:0/2019747625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0004e40 con 0x56413dee5d70 2023-12-11T20:37:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.627+0000 7f2f877fe700 1 -- 172.21.15.12:0/2019747625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2fa0003b20 con 0x56413dee5d70 2023-12-11T20:37:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.627+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/2019747625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56413ddf1430 con 0x56413dee5d70 2023-12-11T20:37:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.628+0000 7f2f877fe700 1 -- 172.21.15.12:0/2019747625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fa0016540 con 0x56413dee5d70 2023-12-11T20:37:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.628+0000 7f2fc20fdb80 10 client.20751 fetch_fsmap learned FSMap version 45 2023-12-11T20:37:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.628+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/2019747625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x56413dc881f0 con 0x56413dee5d70 2023-12-11T20:37:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.628+0000 7f2f877fe700 1 -- 172.21.15.12:0/2019747625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56413ddf1430 con 0x56413dee5d70 2023-12-11T20:37:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.629+0000 7f2f877fe700 1 -- 172.21.15.12:0/2019747625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 45) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2fa0005220 con 0x56413dee5d70 2023-12-11T20:37:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.629+0000 7f2fc20fdb80 10 client.20751 fetch_fsmap finished waiting for FSMap version 45 2023-12-11T20:37:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.629+0000 7f2fc20fdb80 10 client.20751 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:37:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.629+0000 7f2fc20fdb80 20 client.20751 populate_metadata read hostname 'smithi012' 2023-12-11T20:37:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.629+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56413df72980 0x56413df74da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:00.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.629+0000 7f2fc20fdb80 4 client.20751 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:37:00.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.629+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/2019747625 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56413dc82f10 con 0x56413df72980 2023-12-11T20:37:00.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.630+0000 7f2fa7fff700 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56413df72980 0x56413df74da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.632+0000 7f2fa7fff700 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56413df72980 0x56413df74da0 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f9e42231f99b809 server_cookie=ab982b6af8370b22 in_seq=0 out_seq=0 2023-12-11T20:37:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.632+0000 7f2f877fe700 10 client.20751 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:37:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.649+0000 7f2f877fe700 1 -- 172.21.15.12:0/2019747625 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56413dc82f10 con 0x56413df72980 2023-12-11T20:37:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.649+0000 7f2f877fe700 10 client.20751 handle_command_reply: tid=0 2023-12-11T20:37:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.651+0000 7f2fc20fdb80 1 client.20751 shutdown 2023-12-11T20:37:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.651+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/2019747625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 msgr2=0x56413df709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.651+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413df709f0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0015ee0 tx=0x7f2fa0016f70 comp rx=0 tx=0).stop 2023-12-11T20:37:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.653+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/2019747625 shutdown_connections 2023-12-11T20:37:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.653+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x56413df72980 0x56413df74da0 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.653+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56413dee5d70 0x56413df709f0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.653+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56413dee41e0 0x56413df5d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.653+0000 7f2fc20fdb80 1 --2- 172.21.15.12:0/2019747625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x56413dee5410 0x56413df1ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.653+0000 7f2f877fe700 0 client.20751 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:37:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.653+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/2019747625 >> 172.21.15.12:0/2019747625 conn(0x56413de13780 msgr2=0x56413deeda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:00.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.654+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/2019747625 shutdown_connections 2023-12-11T20:37:00.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.654+0000 7f2fc20fdb80 1 -- 172.21.15.12:0/2019747625 wait complete. 2023-12-11T20:37:00.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.654+0000 7f2fc20fdb80 20 client.20751 trim_cache size 0 max 16384 2023-12-11T20:37:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:37:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:37:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:37:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.655+0000 7f2fae7ff700 1 -- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f980a1570 msgr2=0x7f2f980a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.655+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f980a1570 0x7f2f980a3a30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009610 tx=0x7f2fa0009150 comp rx=0 tx=0).stop 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.655+0000 7f2fae7ff700 1 -- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa80755b0 msgr2=0x7f2fa8199b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.655+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa80755b0 0x7f2fa8199b20 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009230 tx=0x7f2f9c00b790 comp rx=0 tx=0).stop 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.656+0000 7f2fae7ff700 1 -- 172.21.15.12:0/1969960921 shutdown_connections 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.656+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f2f980a1570 0x7f2f980a3a30 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.656+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fa81093a0 0x7f2fa81a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.656+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fa8073fd0 0x7f2fa81995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.656+0000 7f2fae7ff700 1 --2- 172.21.15.12:0/1969960921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa80755b0 0x7f2fa8199b20 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.656+0000 7f2fae7ff700 1 -- 172.21.15.12:0/1969960921 >> 172.21.15.12:0/1969960921 conn(0x7f2fa80fca60 msgr2=0x7f2fa81052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.656+0000 7f2fae7ff700 1 -- 172.21.15.12:0/1969960921 shutdown_connections 2023-12-11T20:37:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:00.656+0000 7f2fae7ff700 1 -- 172.21.15.12:0/1969960921 wait complete. 2023-12-11T20:37:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:00 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:00 smithi032 ceph-mon[132488]: pgmap v1007: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 3.90k op/s 2023-12-11T20:37:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:00 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.802 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:00 smithi039 ceph-mon[102205]: pgmap v1007: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 3.90k op/s 2023-12-11T20:37:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:00 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:00.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:00 smithi012 ceph-mon[128787]: pgmap v1007: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 3.90k op/s 2023-12-11T20:37:02.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:02 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:02.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:02 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:02.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:02 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:02.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:02 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:02.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:02 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:02.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:02 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:03.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:03 smithi039 ceph-mon[102205]: pgmap v1008: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 4.15k op/s 2023-12-11T20:37:03.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:03 smithi012 ceph-mon[128787]: pgmap v1008: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 4.15k op/s 2023-12-11T20:37:03.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:03 smithi032 ceph-mon[132488]: pgmap v1008: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 4.15k op/s 2023-12-11T20:37:05.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:05 smithi039 ceph-mon[102205]: pgmap v1009: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 3.71k op/s 2023-12-11T20:37:05.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:05 smithi012 ceph-mon[128787]: pgmap v1009: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 3.71k op/s 2023-12-11T20:37:05.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:05 smithi032 ceph-mon[132488]: pgmap v1009: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 3.71k op/s 2023-12-11T20:37:07.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:07 smithi039 ceph-mon[102205]: pgmap v1010: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2023-12-11T20:37:07.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:07 smithi012 ceph-mon[128787]: pgmap v1010: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2023-12-11T20:37:07.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:07 smithi032 ceph-mon[132488]: pgmap v1010: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 3.87k op/s 2023-12-11T20:37:09.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:08 smithi012 ceph-mon[128787]: pgmap v1011: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2023-12-11T20:37:09.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:37:09.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:37:09.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:08 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:08 smithi032 ceph-mon[132488]: pgmap v1011: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2023-12-11T20:37:09.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:37:09.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:37:09.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:08 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:08 smithi039 ceph-mon[102205]: pgmap v1011: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 3.56k op/s 2023-12-11T20:37:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:37:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:37:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:08 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout:Syncing()...6 sec 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout:FFSB benchmark finished at: Mon Dec 11 20:37:09 2023 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout:Results: 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout:Benchmark took 312.56 sec 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout:Total Results 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout:=============== 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout: ======= ============ ========= ======= =========== ========== 2023-12-11T20:37:09.623 INFO:tasks.workunit.client.0.smithi012.stdout: write : 1383680 4426.94 100.000% 100.000% 17.3MB/sec 2023-12-11T20:37:09.624 INFO:tasks.workunit.client.0.smithi012.stdout:- 2023-12-11T20:37:09.624 INFO:tasks.workunit.client.0.smithi012.stdout:4426.94 Transactions per Second 2023-12-11T20:37:09.624 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.624 INFO:tasks.workunit.client.0.smithi012.stdout:Throughput Results 2023-12-11T20:37:09.624 INFO:tasks.workunit.client.0.smithi012.stdout:=================== 2023-12-11T20:37:09.624 INFO:tasks.workunit.client.0.smithi012.stdout:Write Throughput: 17.3MB/sec 2023-12-11T20:37:09.639 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.639 INFO:tasks.workunit.client.0.smithi012.stdout:System Call Latency statistics in millisecs 2023-12-11T20:37:09.639 INFO:tasks.workunit.client.0.smithi012.stdout:===== 2023-12-11T20:37:09.639 INFO:tasks.workunit.client.0.smithi012.stdout: Min Avg Max Total Calls 2023-12-11T20:37:09.639 INFO:tasks.workunit.client.0.smithi012.stdout: ======== ======== ======== ============ 2023-12-11T20:37:09.639 INFO:tasks.workunit.client.0.smithi012.stdout:[ open] 1.086000 25.637931 320.942993 1081 2023-12-11T20:37:09.639 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2023-12-11T20:37:09.639 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[4] 200.000000 - 500.000000 : 6 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[5] 100.000000 - 200.000000 : 7 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[6] 50.000000 - 100.000000 : 49 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[7] 20.000000 - 50.000000 : 568 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[8] 10.000000 - 20.000000 : 373 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[9] 5.000000 - 10.000000 : 65 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[10] 2.000000 - 5.000000 : 11 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[11] 1.000000 - 2.000000 : 2 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2023-12-11T20:37:09.640 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout:[ write] 0.178000 6.998337 336.815002 1383680 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[4] 200.000000 - 500.000000 : 282 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[5] 100.000000 - 200.000000 : 218 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[6] 50.000000 - 100.000000 : 1250 2023-12-11T20:37:09.641 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[7] 20.000000 - 50.000000 : 61661 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[8] 10.000000 - 20.000000 : 215766 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[9] 5.000000 - 10.000000 : 459732 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[10] 2.000000 - 5.000000 : 422843 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[11] 1.000000 - 2.000000 : 68597 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[12] 0.500000 - 1.000000 : 68968 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[13] 0.200000 - 0.500000 : 84332 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[14] 0.100000 - 0.200000 : 31 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2023-12-11T20:37:09.642 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2023-12-11T20:37:09.643 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2023-12-11T20:37:09.643 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.643 INFO:tasks.workunit.client.0.smithi012.stdout:[ lseek] 0.000000 0.002016 3.934000 1383680 2023-12-11T20:37:09.643 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2023-12-11T20:37:09.643 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2023-12-11T20:37:09.644 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2023-12-11T20:37:09.645 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2023-12-11T20:37:09.645 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[10] 2.000000 - 5.000000 : 5 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[11] 1.000000 - 2.000000 : 27 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[12] 0.500000 - 1.000000 : 86 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[13] 0.200000 - 0.500000 : 355 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[14] 0.100000 - 0.200000 : 532 2023-12-11T20:37:09.646 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[15] 0.050000 - 0.100000 : 855 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[16] 0.020000 - 0.050000 : 2471 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[17] 0.010000 - 0.020000 : 2346 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[18] 0.000000 - 0.010000 : 1377003 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout:[ close] 0.037000 3.048001 36.423000 1081 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2023-12-11T20:37:09.647 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2023-12-11T20:37:09.648 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2023-12-11T20:37:09.648 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2023-12-11T20:37:09.648 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[7] 20.000000 - 50.000000 : 24 2023-12-11T20:37:09.648 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[8] 10.000000 - 20.000000 : 63 2023-12-11T20:37:09.648 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[9] 5.000000 - 10.000000 : 92 2023-12-11T20:37:09.648 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[10] 2.000000 - 5.000000 : 272 2023-12-11T20:37:09.648 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[11] 1.000000 - 2.000000 : 139 2023-12-11T20:37:09.648 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[12] 0.500000 - 1.000000 : 25 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[13] 0.200000 - 0.500000 : 80 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[14] 0.100000 - 0.200000 : 130 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[15] 0.050000 - 0.100000 : 247 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[16] 0.020000 - 0.050000 : 9 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.649 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-12-11T20:37:09.650 INFO:tasks.workunit.client.0.smithi012.stdout:1.1% User Time 2023-12-11T20:37:09.650 INFO:tasks.workunit.client.0.smithi012.stdout:28.1% System Time 2023-12-11T20:37:09.650 INFO:tasks.workunit.client.0.smithi012.stdout:29.2% CPU Utilization 2023-12-11T20:37:09.651 INFO:tasks.workunit.client.0.smithi012.stderr:+ cd .. 2023-12-11T20:37:09.657 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -r tmp ffsb 2023-12-11T20:37:11.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:10 smithi032 ceph-mon[132488]: pgmap v1012: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 2.73k op/s 2023-12-11T20:37:11.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:10 smithi039 ceph-mon[102205]: pgmap v1012: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 2.73k op/s 2023-12-11T20:37:11.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:10 smithi012 ceph-mon[128787]: pgmap v1012: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 2.73k op/s 2023-12-11T20:37:13.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:12 smithi032 ceph-mon[132488]: pgmap v1013: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.8 MiB/s wr, 2.23k op/s 2023-12-11T20:37:13.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:12 smithi039 ceph-mon[102205]: pgmap v1013: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.8 MiB/s wr, 2.23k op/s 2023-12-11T20:37:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:12 smithi012 ceph-mon[128787]: pgmap v1013: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.8 MiB/s wr, 2.23k op/s 2023-12-11T20:37:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.921+0000 7f5ec53ff700 1 -- 172.21.15.12:0/179669740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ec010d910 msgr2=0x7f5ec010dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.921+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/179669740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ec010d910 0x7f5ec010dd90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80098f0 tx=0x7f5eb8009c00 comp rx=0 tx=0).stop 2023-12-11T20:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.921+0000 7f5ec53ff700 1 -- 172.21.15.12:0/179669740 shutdown_connections 2023-12-11T20:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.921+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/179669740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ec01085d0 0x7f5ec010aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.922+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/179669740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ec010d910 0x7f5ec010dd90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.922+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/179669740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ec010af40 0x7f5ec010d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.922+0000 7f5ec53ff700 1 -- 172.21.15.12:0/179669740 >> 172.21.15.12:0/179669740 conn(0x7f5ec006e530 msgr2=0x7f5ec0070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.922+0000 7f5ec53ff700 1 -- 172.21.15.12:0/179669740 shutdown_connections 2023-12-11T20:37:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.923+0000 7f5ec53ff700 1 -- 172.21.15.12:0/179669740 wait complete. 2023-12-11T20:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.925+0000 7f5ec53ff700 1 Processor -- start 2023-12-11T20:37:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.926+0000 7f5ec53ff700 1 -- start start 2023-12-11T20:37:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.927+0000 7f5ec53ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ec01085d0 0x7f5ec01a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.927+0000 7f5ec53ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ec010af40 0x7f5ec01a6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.927+0000 7f5ec53ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ec010d910 0x7f5ec01ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.927+0000 7f5ec53ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec01adc10 con 0x7f5ec010d910 2023-12-11T20:37:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.927+0000 7f5ec53ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec01add50 con 0x7f5ec01085d0 2023-12-11T20:37:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.927+0000 7f5ec53ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec01adee0 con 0x7f5ec010af40 2023-12-11T20:37:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ec010d910 0x7f5ec01ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ec010d910 0x7f5ec01ad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46536/0 (socket says 172.21.15.12:46536) 2023-12-11T20:37:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/7239684 learned_addr learned my addr 172.21.15.12:0/7239684 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ec01085d0 0x7f5ec01a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ec010af40 0x7f5ec01a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/7239684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ec010af40 msgr2=0x7f5ec01a6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ec010af40 0x7f5ec01a6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/7239684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ec01085d0 msgr2=0x7f5ec01a60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ec01085d0 0x7f5ec01a60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.928+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/7239684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8009520 con 0x7f5ec010d910 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.929+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ec010d910 0x7f5ec01ad640 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009230 tx=0x7f5eb800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.930+0000 7f5eb7fff700 1 -- 172.21.15.12:0/7239684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb801c070 con 0x7f5ec010d910 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.930+0000 7f5eb7fff700 1 -- 172.21.15.12:0/7239684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5eb800f7d0 con 0x7f5ec010d910 2023-12-11T20:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.930+0000 7f5eb7fff700 1 -- 172.21.15.12:0/7239684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8004bd0 con 0x7f5ec010d910 2023-12-11T20:37:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.931+0000 7f5ec53ff700 1 -- 172.21.15.12:0/7239684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec01ae160 con 0x7f5ec010d910 2023-12-11T20:37:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.932+0000 7f5ec53ff700 1 -- 172.21.15.12:0/7239684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec01ae530 con 0x7f5ec010d910 2023-12-11T20:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.940+0000 7f5ed8d62b80 1 Processor -- start 2023-12-11T20:37:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.943+0000 7f5eb7fff700 1 -- 172.21.15.12:0/7239684 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f5eb8020070 con 0x7f5ec010d910 2023-12-11T20:37:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.945+0000 7f5ed8d62b80 1 -- start start 2023-12-11T20:37:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.946+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb8ed0 0x55b0a0cb92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.946+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.946+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.946+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0c14af0 con 0x55b0a0cba720 2023-12-11T20:37:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.946+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0c12410 con 0x55b0a0cb8ed0 2023-12-11T20:37:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.946+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0c0dd00 con 0x55b0a0cb9830 2023-12-11T20:37:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.947+0000 7f5ebe7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb8ed0 0x55b0a0cb92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.947+0000 7f5ebe7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb8ed0 0x55b0a0cb92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:34960/0 (socket says 172.21.15.12:34960) 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.947+0000 7f5ebe7fc700 1 -- 172.21.15.12:0/2214276514 learned_addr learned my addr 172.21.15.12:0/2214276514 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.947+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.947+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.947+0000 7f5ebe7fc700 1 -- 172.21.15.12:0/2214276514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 msgr2=0x55b0a0cba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.947+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cba140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.947+0000 7f5ebe7fc700 1 -- 172.21.15.12:0/2214276514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 msgr2=0x55b0a0cbaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.948+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.948+0000 7f5ebe7fc700 1 -- 172.21.15.12:0/2214276514 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0a0a8a5d0 con 0x55b0a0cb8ed0 2023-12-11T20:37:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.948+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T20:37:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.948+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb8ed0 0x55b0a0cb92f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800cf10 tx=0x7f5ea800c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5abbed61e4cd27ff server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.951+0000 7f5eb7fff700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5ea00a1570 0x7f5ea00a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.951+0000 7f5eb57fa700 1 -- 172.21.15.12:0/2214276514 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80142f0 con 0x55b0a0cb8ed0 2023-12-11T20:37:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.951+0000 7f5eb57fa700 1 -- 172.21.15.12:0/2214276514 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ea8004cc0 con 0x55b0a0cb8ed0 2023-12-11T20:37:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.951+0000 7f5eb57fa700 1 -- 172.21.15.12:0/2214276514 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8005710 con 0x55b0a0cb8ed0 2023-12-11T20:37:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.951+0000 7f5eb7fff700 1 -- 172.21.15.12:0/7239684 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5eb80cd840 con 0x7f5ec010d910 2023-12-11T20:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.952+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/2214276514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb8ed0 msgr2=0x55b0a0cb92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.952+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb8ed0 0x55b0a0cb92f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800cf10 tx=0x7f5ea800c4d0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.953+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/2214276514 shutdown_connections 2023-12-11T20:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.953+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb8ed0 0x55b0a0cb92f0 secure :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800cf10 tx=0x7f5ea800c4d0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.953+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.953+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/2214276514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.953+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/2214276514 >> 172.21.15.12:0/2214276514 conn(0x55b0a0be8780 msgr2=0x55b0a0cb5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.953+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/2214276514 shutdown_connections 2023-12-11T20:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.953+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5ea00a1570 0x7f5ea00a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.953+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/2214276514 wait complete. 2023-12-11T20:37:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.954+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5ea00a1570 0x7f5ea00a3a30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009fd0 tx=0x7f5eb0009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.955+0000 7f5ed8d62b80 1 -- start start 2023-12-11T20:37:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.955+0000 7f5ed8d62b80 1 Processor -- start 2023-12-11T20:37:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.957+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cc3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.957+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cba720 0x55b0a0cc3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.957+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cc8470 0x55b0a0cca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.957+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0bc7500 con 0x55b0a0cc8470 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.957+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0bc71a0 con 0x55b0a0cba720 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.957+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0a8c8c0 con 0x55b0a0cb9830 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.957+0000 7f5ed8d62b80 10 client.0 _ll_register_callbacks cb 0x55b0a0af2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.958+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cc8470 0x55b0a0cca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.958+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cc8470 0x55b0a0cca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46548/0 (socket says 172.21.15.12:46548) 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.958+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/3222573550 learned_addr learned my addr 172.21.15.12:0/3222573550 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.958+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/3222573550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 msgr2=0x55b0a0cc3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.958+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cc3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.958+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/3222573550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cba720 msgr2=0x55b0a0cc3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.958+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cba720 0x55b0a0cc3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.958+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/3222573550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea8014470 con 0x55b0a0cc8470 2023-12-11T20:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.959+0000 7f5eae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.960+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cc8470 0x55b0a0cca860 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80098c0 tx=0x7f5eb809a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcc6c294471f5ab server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.960+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3222573550 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb809a230 con 0x55b0a0cc8470 2023-12-11T20:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.960+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3222573550 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5eb809ab40 con 0x55b0a0cc8470 2023-12-11T20:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.960+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3222573550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0a0cac730 con 0x55b0a0cc8470 2023-12-11T20:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.960+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3222573550 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eb809ec90 con 0x55b0a0cc8470 2023-12-11T20:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.960+0000 7f5ed8d62b80 10 client.20763 fetch_fsmap learned FSMap version 46 2023-12-11T20:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.961+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3222573550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55b0a0a36d80 con 0x55b0a0cc8470 2023-12-11T20:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.961+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3222573550 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5eb80a2e40 con 0x55b0a0cc8470 2023-12-11T20:37:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.961+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3222573550 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f5eb8099aa0 con 0x55b0a0cc8470 2023-12-11T20:37:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.961+0000 7f5ed8d62b80 10 client.20763 fetch_fsmap finished waiting for FSMap version 46 2023-12-11T20:37:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.961+0000 7f5ed8d62b80 10 client.20763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:37:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.961+0000 7f5ed8d62b80 20 client.20763 populate_metadata read hostname 'smithi012' 2023-12-11T20:37:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.961+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0a0ccee50 0x55b0a0cd1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.962+0000 7f5ed8d62b80 4 client.20763 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T20:37:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.962+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3222573550 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0a0cac730 con 0x55b0a0ccee50 2023-12-11T20:37:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.962+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0a0ccee50 0x55b0a0cd1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.963+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0a0ccee50 0x55b0a0cd1310 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be668a028245fcb7 server_cookie=5f2cc0ede9aaf705 in_seq=0 out_seq=0 2023-12-11T20:37:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.963+0000 7f5eae7fc700 10 client.20763 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:37:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.965+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3222573550 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b0a0cac730 con 0x55b0a0ccee50 2023-12-11T20:37:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.965+0000 7f5eae7fc700 10 client.20763 handle_command_reply: tid=0 2023-12-11T20:37:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.965+0000 7f5ed8d62b80 1 client.20763 shutdown 2023-12-11T20:37:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.966+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3222573550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cc8470 msgr2=0x55b0a0cca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.966+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cc8470 0x55b0a0cca860 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80098c0 tx=0x7f5eb809a550 comp rx=0 tx=0).stop 2023-12-11T20:37:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.967+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3222573550 shutdown_connections 2023-12-11T20:37:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.967+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0a0ccee50 0x55b0a0cd1310 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.967+0000 7f5eae7fc700 0 client.20763 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:37:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.967+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cc8470 0x55b0a0cca860 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.967+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cc3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.968+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3222573550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cba720 0x55b0a0cc3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.968+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3222573550 >> 172.21.15.12:0/3222573550 conn(0x55b0a0be8780 msgr2=0x55b0a0cb3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.968+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3222573550 shutdown_connections 2023-12-11T20:37:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.968+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3222573550 wait complete. 2023-12-11T20:37:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:13.969+0000 7f5ed8d62b80 20 client.20763 trim_cache size 0 max 16384 2023-12-11T20:37:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.006+0000 7f5ed8d62b80 1 Processor -- start 2023-12-11T20:37:14.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.006+0000 7f5ed8d62b80 1 -- start start 2023-12-11T20:37:14.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.007+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb9830 0x55b0a0cd1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:14.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.007+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:14.006 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.007+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cc8470 0x55b0a0cd5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.007+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0cc3e00 con 0x55b0a0cba720 2023-12-11T20:37:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.007+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0cac700 con 0x55b0a0cb9830 2023-12-11T20:37:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.007+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0cb0920 con 0x55b0a0cc8470 2023-12-11T20:37:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebe7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46550/0 (socket says 172.21.15.12:46550) 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebe7fc700 1 -- 172.21.15.12:0/597271160 learned_addr learned my addr 172.21.15.12:0/597271160 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/597271160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb9830 0x55b0a0cd1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebe7fc700 1 -- 172.21.15.12:0/597271160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cc8470 msgr2=0x55b0a0cd5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/597271160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cc8470 0x55b0a0cd5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebe7fc700 1 -- 172.21.15.12:0/597271160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb9830 msgr2=0x55b0a0cd1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/597271160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb9830 0x55b0a0cd1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.008+0000 7f5ebe7fc700 1 -- 172.21.15.12:0/597271160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0a0a1fc00 con 0x55b0a0cba720 2023-12-11T20:37:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.009+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/597271160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbab00 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8014760 tx=0x7f5ea8004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11daac030f3b95d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.010+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/597271160 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80140f0 con 0x55b0a0cba720 2023-12-11T20:37:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.010+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/597271160 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ea8014250 con 0x55b0a0cba720 2023-12-11T20:37:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.010+0000 7f5eb5ffb700 1 -- 172.21.15.12:0/597271160 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8012450 con 0x55b0a0cba720 2023-12-11T20:37:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.011+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/597271160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 msgr2=0x55b0a0cbab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.011+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/597271160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbab00 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8014760 tx=0x7f5ea8004e30 comp rx=0 tx=0).stop 2023-12-11T20:37:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.012+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/597271160 shutdown_connections 2023-12-11T20:37:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.012+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/597271160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cb9830 0x55b0a0cd1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.012+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/597271160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cc8470 0x55b0a0cd5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.012+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/597271160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0cba720 0x55b0a0cbab00 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.012+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/597271160 >> 172.21.15.12:0/597271160 conn(0x55b0a0be8780 msgr2=0x55b0a0cc2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.012+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/597271160 shutdown_connections 2023-12-11T20:37:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.012+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/597271160 wait complete. 2023-12-11T20:37:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.013+0000 7f5ed8d62b80 1 -- start start 2023-12-11T20:37:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.013+0000 7f5ed8d62b80 1 Processor -- start 2023-12-11T20:37:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.015+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cdd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.015+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cc8470 0x55b0a0cdf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.015+0000 7f5ed8d62b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0ccee50 0x55b0a0d34fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:14.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.015+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0d356f0 con 0x55b0a0ccee50 2023-12-11T20:37:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.015+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0d35860 con 0x55b0a0cc8470 2023-12-11T20:37:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.015+0000 7f5ed8d62b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0a0d35a20 con 0x55b0a0cb9830 2023-12-11T20:37:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ed8d62b80 10 client.0 _ll_register_callbacks cb 0x55b0a0af2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T20:37:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebeffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cdd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0ccee50 0x55b0a0d34fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0ccee50 0x55b0a0d34fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46564/0 (socket says 172.21.15.12:46564) 2023-12-11T20:37:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/3722766039 learned_addr learned my addr 172.21.15.12:0/3722766039 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebe7fc700 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cc8470 0x55b0a0cdf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/3722766039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 msgr2=0x55b0a0cdd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cdd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/3722766039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cc8470 msgr2=0x55b0a0cdf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cc8470 0x55b0a0cdf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.016+0000 7f5ebf7fe700 1 -- 172.21.15.12:0/3722766039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0a0a8a5d0 con 0x55b0a0ccee50 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.017+0000 7f5ebf7fe700 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0ccee50 0x55b0a0d34fb0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8098e90 tx=0x7f5eb800b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474d652e37271908 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.017+0000 7f5eae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-12-11T20:37:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.017+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3722766039 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb809a230 con 0x55b0a0ccee50 2023-12-11T20:37:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.017+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3722766039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ea8004cc0 con 0x55b0a0ccee50 2023-12-11T20:37:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.017+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3722766039 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5eb809ab40 con 0x55b0a0ccee50 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3722766039 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eb80b3360 con 0x55b0a0ccee50 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5ed8d62b80 10 client.20769 fetch_fsmap learned FSMap version 46 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3722766039 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55b0a0a5d1f0 con 0x55b0a0ccee50 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3722766039 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ea8004cc0 con 0x55b0a0ccee50 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3722766039 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f5eb80ba320 con 0x55b0a0ccee50 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5ed8d62b80 10 client.20769 fetch_fsmap finished waiting for FSMap version 46 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5ed8d62b80 10 client.20769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5ed8d62b80 20 client.20769 populate_metadata read hostname 'smithi012' 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0a0d36d00 0x55b0a0d390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5ed8d62b80 4 client.20769 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.018+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3722766039 --> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b0a0c88ee0 con 0x55b0a0d36d00 2023-12-11T20:37:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.019+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0a0d36d00 0x55b0a0d390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.020+0000 7f5ebeffd700 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0a0d36d00 0x55b0a0d390f0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcaf72e112840c8b server_cookie=720aeea28f47dfb2 in_seq=0 out_seq=0 2023-12-11T20:37:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.020+0000 7f5eae7fc700 10 client.20769 ms_handle_connect on v2:172.21.15.32:6838/3894896449 2023-12-11T20:37:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5eae7fc700 1 -- 172.21.15.12:0/3722766039 <== mds.0 v2:172.21.15.32:6838/3894896449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b0a0c88ee0 con 0x55b0a0d36d00 2023-12-11T20:37:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5eae7fc700 10 client.20769 handle_command_reply: tid=0 2023-12-11T20:37:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 client.20769 shutdown 2023-12-11T20:37:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3722766039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0ccee50 msgr2=0x55b0a0d34fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0ccee50 0x55b0a0d34fb0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8098e90 tx=0x7f5eb800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3722766039 shutdown_connections 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.32:6838/3894896449,v1:172.21.15.32:6839/3894896449] conn(0x55b0a0d36d00 0x55b0a0d390f0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0a0ccee50 0x55b0a0d34fb0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b0a0cb9830 0x55b0a0cdd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 --2- 172.21.15.12:0/3722766039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55b0a0cc8470 0x55b0a0cdf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3722766039 >> 172.21.15.12:0/3722766039 conn(0x55b0a0be8780 msgr2=0x55b0a0cd5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5eae7fc700 0 client.20769 ms_handle_reset on v2:172.21.15.32:6838/3894896449 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3722766039 shutdown_connections 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 1 -- 172.21.15.12:0/3722766039 wait complete. 2023-12-11T20:37:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.237+0000 7f5ed8d62b80 20 client.20769 trim_cache size 0 max 16384 2023-12-11T20:37:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2023-12-11T20:37:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2023-12-11T20:37:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2023-12-11T20:37:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2023-12-11T20:37:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 -- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5ea00a1570 msgr2=0x7f5ea00a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5ea00a1570 0x7f5ea00a3a30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009fd0 tx=0x7f5eb0009040 comp rx=0 tx=0).stop 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 -- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ec010d910 msgr2=0x7f5ec01ad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ec010d910 0x7f5ec01ad640 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009230 tx=0x7f5eb800b840 comp rx=0 tx=0).stop 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 -- 172.21.15.12:0/7239684 shutdown_connections 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f5ea00a1570 0x7f5ea00a3a30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ec01085d0 0x7f5ec01a60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ec010d910 0x7f5ec01ad640 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 --2- 172.21.15.12:0/7239684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ec010af40 0x7f5ec01a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 -- 172.21.15.12:0/7239684 >> 172.21.15.12:0/7239684 conn(0x7f5ec006e530 msgr2=0x7f5ec010b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 -- 172.21.15.12:0/7239684 shutdown_connections 2023-12-11T20:37:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2023-12-11T20:37:14.238+0000 7f5ec53ff700 1 -- 172.21.15.12:0/7239684 wait complete. 2023-12-11T20:37:15.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:14 smithi032 ceph-mon[132488]: pgmap v1014: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.7 MiB/s wr, 1.43k op/s 2023-12-11T20:37:15.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:14 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:15.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:14 smithi039 ceph-mon[102205]: pgmap v1014: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.7 MiB/s wr, 1.43k op/s 2023-12-11T20:37:15.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:14 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:14 smithi012 ceph-mon[128787]: pgmap v1014: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.7 MiB/s wr, 1.43k op/s 2023-12-11T20:37:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:14 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:16.356 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-11T20:37:16.357 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-11T20:37:16.561 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2023-12-11T20:37:16.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-11T20:37:17.214 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:16 smithi032 ceph-mon[132488]: pgmap v1015: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.3 MiB/s wr, 1.09k op/s 2023-12-11T20:37:17.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:16 smithi039 ceph-mon[102205]: pgmap v1015: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.3 MiB/s wr, 1.09k op/s 2023-12-11T20:37:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:16 smithi012 ceph-mon[128787]: pgmap v1015: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.3 MiB/s wr, 1.09k op/s 2023-12-11T20:37:18.009 DEBUG:teuthology.parallel:result is None 2023-12-11T20:37:18.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-11T20:37:18.158 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:17 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:18.161 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-11T20:37:18.162 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-12-11T20:37:18.171 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi012.front.sepia.ceph.com 2023-12-11T20:37:18.195 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-12-11T20:37:18.204 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-12-11T20:37:18.204 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-12-11T20:37:18.205 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-12-11T20:37:18.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:37:18.216 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:17 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:18.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:17 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.582+0000 7f17ad5ff700 1 -- 172.21.15.12:0/1801101226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17a81072b0 msgr2=0x7f17a81096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.582+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/1801101226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17a81072b0 0x7f17a81096a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f17a000b0a0 tx=0x7f17a000b3b0 comp rx=0 tx=0).stop 2023-12-11T20:37:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.583+0000 7f17ad5ff700 1 -- 172.21.15.12:0/1801101226 shutdown_connections 2023-12-11T20:37:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.583+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/1801101226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17a81072b0 0x7f17a81096a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.583+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/1801101226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a8102050 0x7f17a8104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.583+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/1801101226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a8104980 0x7f17a8106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.583+0000 7f17ad5ff700 1 -- 172.21.15.12:0/1801101226 >> 172.21.15.12:0/1801101226 conn(0x7f17a80fb980 msgr2=0x7f17a80fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.583+0000 7f17ad5ff700 1 -- 172.21.15.12:0/1801101226 shutdown_connections 2023-12-11T20:37:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.583+0000 7f17ad5ff700 1 -- 172.21.15.12:0/1801101226 wait complete. 2023-12-11T20:37:18.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.585+0000 7f17ad5ff700 1 Processor -- start 2023-12-11T20:37:18.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.585+0000 7f17ad5ff700 1 -- start start 2023-12-11T20:37:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.585+0000 7f17ad5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a8102050 0x7f17a81103c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.585+0000 7f17ad5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a8104980 0x7f17a8110900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17ad5ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17a81072b0 0x7f17a81118f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17ad5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8111ec0 con 0x7f17a8104980 2023-12-11T20:37:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17ad5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8112030 con 0x7f17a8102050 2023-12-11T20:37:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17ad5ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a81121f0 con 0x7f17a81072b0 2023-12-11T20:37:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17a6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a8102050 0x7f17a81103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17a6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a8102050 0x7f17a81103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:35002/0 (socket says 172.21.15.12:35002) 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17a6ffd700 1 -- 172.21.15.12:0/3482243815 learned_addr learned my addr 172.21.15.12:0/3482243815 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17a67fc700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a8104980 0x7f17a8110900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.586+0000 7f17a77fe700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17a81072b0 0x7f17a81118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.587+0000 7f17a6ffd700 1 -- 172.21.15.12:0/3482243815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17a81072b0 msgr2=0x7f17a81118f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.587+0000 7f17a6ffd700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17a81072b0 0x7f17a81118f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.587+0000 7f17a6ffd700 1 -- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a8104980 msgr2=0x7f17a8110900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.587+0000 7f17a6ffd700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a8104980 0x7f17a8110900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.587+0000 7f17a6ffd700 1 -- 172.21.15.12:0/3482243815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0009d00 con 0x7f17a8102050 2023-12-11T20:37:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.587+0000 7f17a6ffd700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a8102050 0x7f17a81103c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f179c00b550 tx=0x7f179c00b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.588+0000 7f178ffff700 1 -- 172.21.15.12:0/3482243815 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c011830 con 0x7f17a8102050 2023-12-11T20:37:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.588+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a8112470 con 0x7f17a8102050 2023-12-11T20:37:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.588+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a8112a00 con 0x7f17a8102050 2023-12-11T20:37:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.589+0000 7f178ffff700 1 -- 172.21.15.12:0/3482243815 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f179c011e20 con 0x7f17a8102050 2023-12-11T20:37:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.589+0000 7f178ffff700 1 -- 172.21.15.12:0/3482243815 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c010e20 con 0x7f17a8102050 2023-12-11T20:37:18.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.590+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1794005320 con 0x7f17a8102050 2023-12-11T20:37:18.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.596+0000 7f178ffff700 1 -- 172.21.15.12:0/3482243815 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f179c011990 con 0x7f17a8102050 2023-12-11T20:37:18.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.599+0000 7f178ffff700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f17900a1530 0x7f17900a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:18.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.599+0000 7f178ffff700 1 -- 172.21.15.12:0/3482243815 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f179c0cba90 con 0x7f17a8102050 2023-12-11T20:37:18.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.600+0000 7f17a67fc700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f17900a1530 0x7f17900a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:18.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.603+0000 7f17a67fc700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f17900a1530 0x7f17900a39f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1798009c60 tx=0x7f1798009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:18.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:18.608+0000 7f178ffff700 1 -- 172.21.15.12:0/3482243815 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f179c0950a0 con 0x7f17a8102050 2023-12-11T20:37:19.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.020+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17940055d0 con 0x7f17a8102050 2023-12-11T20:37:19.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.023+0000 7f178ffff700 1 -- 172.21.15.12:0/3482243815 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7f179c0986c0 con 0x7f17a8102050 2023-12-11T20:37:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:37:19.023 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:37:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f17900a1530 msgr2=0x7f17900a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f17900a1530 0x7f17900a39f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1798009c60 tx=0x7f1798009260 comp rx=0 tx=0).stop 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a8102050 msgr2=0x7f17a81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a8102050 0x7f17a81103c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f179c00b550 tx=0x7f179c00b860 comp rx=0 tx=0).stop 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 shutdown_connections 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f17900a1530 0x7f17900a39f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f17a8102050 0x7f17a81103c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f17a81072b0 0x7f17a81118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 --2- 172.21.15.12:0/3482243815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a8104980 0x7f17a8110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 >> 172.21.15.12:0/3482243815 conn(0x7f17a80fb980 msgr2=0x7f17a8102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:19.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 shutdown_connections 2023-12-11T20:37:19.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.029+0000 7f17ad5ff700 1 -- 172.21.15.12:0/3482243815 wait complete. 2023-12-11T20:37:19.066 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:37:19.066 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:37:19.181 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:18 smithi012 ceph-mon[128787]: pgmap v1016: 97 pgs: 97 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 1.8 MiB/s wr, 534 op/s 2023-12-11T20:37:19.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:18 smithi032 ceph-mon[132488]: pgmap v1016: 97 pgs: 97 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 1.8 MiB/s wr, 534 op/s 2023-12-11T20:37:19.307 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:18 smithi039 ceph-mon[102205]: pgmap v1016: 97 pgs: 97 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 1.8 MiB/s wr, 534 op/s 2023-12-11T20:37:19.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 -- 172.21.15.12:0/460392657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850109680 msgr2=0x7f285010ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:19.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 --2- 172.21.15.12:0/460392657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850109680 0x7f285010ff30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f284800b0d0 tx=0x7f284800b3e0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 -- 172.21.15.12:0/460392657 shutdown_connections 2023-12-11T20:37:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 --2- 172.21.15.12:0/460392657 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850109680 0x7f285010ff30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 --2- 172.21.15.12:0/460392657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2850107af0 0x7f2850107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 --2- 172.21.15.12:0/460392657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2850108ce0 0x7f2850109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 -- 172.21.15.12:0/460392657 >> 172.21.15.12:0/460392657 conn(0x7f2850076a90 msgr2=0x7f2850078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 -- 172.21.15.12:0/460392657 shutdown_connections 2023-12-11T20:37:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.430+0000 7f28553ff700 1 -- 172.21.15.12:0/460392657 wait complete. 2023-12-11T20:37:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.431+0000 7f28553ff700 1 Processor -- start 2023-12-11T20:37:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.432+0000 7f28553ff700 1 -- start start 2023-12-11T20:37:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.432+0000 7f28553ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2850107af0 0x7f285019da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.432+0000 7f28553ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850108ce0 0x7f285019df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.432+0000 7f28553ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2850109680 0x7f28501a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.432+0000 7f28553ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a5540 con 0x7f2850109680 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.432+0000 7f28553ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a5680 con 0x7f2850108ce0 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.432+0000 7f28553ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a5810 con 0x7f2850107af0 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f284effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2850107af0 0x7f285019da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f284effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2850107af0 0x7f285019da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47700/0 (socket says 172.21.15.12:47700) 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f284effd700 1 -- 172.21.15.12:0/2995912546 learned_addr learned my addr 172.21.15.12:0/2995912546 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f28467fc700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850108ce0 0x7f285019df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f284f7fe700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2850109680 0x7f28501a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f28467fc700 1 -- 172.21.15.12:0/2995912546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2850107af0 msgr2=0x7f285019da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f28467fc700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2850107af0 0x7f285019da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f28467fc700 1 -- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2850109680 msgr2=0x7f28501a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f28467fc700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2850109680 0x7f28501a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.433+0000 7f28467fc700 1 -- 172.21.15.12:0/2995912546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009d00 con 0x7f2850108ce0 2023-12-11T20:37:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.434+0000 7f28467fc700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850108ce0 0x7f285019df50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f284000e9f0 tx=0x7f284000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.434+0000 7f284cff9700 1 -- 172.21.15.12:0/2995912546 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000c9c0 con 0x7f2850108ce0 2023-12-11T20:37:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.434+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28501a5af0 con 0x7f2850108ce0 2023-12-11T20:37:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.434+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28501a6050 con 0x7f2850108ce0 2023-12-11T20:37:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.434+0000 7f284cff9700 1 -- 172.21.15.12:0/2995912546 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2840010430 con 0x7f2850108ce0 2023-12-11T20:37:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.434+0000 7f284cff9700 1 -- 172.21.15.12:0/2995912546 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840018680 con 0x7f2850108ce0 2023-12-11T20:37:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.437+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285010ef40 con 0x7f2850108ce0 2023-12-11T20:37:19.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.438+0000 7f284cff9700 1 -- 172.21.15.12:0/2995912546 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f28400187e0 con 0x7f2850108ce0 2023-12-11T20:37:19.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.440+0000 7f284cff9700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f283c0a14d0 0x7f283c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:19.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.440+0000 7f284cff9700 1 -- 172.21.15.12:0/2995912546 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2840014070 con 0x7f2850108ce0 2023-12-11T20:37:19.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.440+0000 7f284effd700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f283c0a14d0 0x7f283c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.441+0000 7f284effd700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f283c0a14d0 0x7f283c0a3990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2838005950 tx=0x7f2838009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.444+0000 7f284cff9700 1 -- 172.21.15.12:0/2995912546 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f28400522f0 con 0x7f2850108ce0 2023-12-11T20:37:19.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.826+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28501a5c80 con 0x7f2850108ce0 2023-12-11T20:37:19.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.826+0000 7f284cff9700 1 -- 172.21.15.12:0/2995912546 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28501a5c80 con 0x7f2850108ce0 2023-12-11T20:37:19.825 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:37:19.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f283c0a14d0 msgr2=0x7f283c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:19.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f283c0a14d0 0x7f283c0a3990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2838005950 tx=0x7f2838009260 comp rx=0 tx=0).stop 2023-12-11T20:37:19.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850108ce0 msgr2=0x7f285019df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850108ce0 0x7f285019df50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f284000e9f0 tx=0x7f284000ed00 comp rx=0 tx=0).stop 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 shutdown_connections 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f283c0a14d0 0x7f283c0a3990 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2850109680 0x7f28501a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2850107af0 0x7f285019da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 --2- 172.21.15.12:0/2995912546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2850108ce0 0x7f285019df50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 >> 172.21.15.12:0/2995912546 conn(0x7f2850076a90 msgr2=0x7f285010c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 shutdown_connections 2023-12-11T20:37:19.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:19.829+0000 7f28553ff700 1 -- 172.21.15.12:0/2995912546 wait complete. 2023-12-11T20:37:19.848 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:37:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.158+0000 7fe87d1ff700 1 -- 172.21.15.12:0/1920454828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe878101f80 msgr2=0x7fe878104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.158+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/1920454828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe878101f80 0x7fe878104370 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fe868009990 tx=0x7fe868009ca0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.159+0000 7fe87d1ff700 1 -- 172.21.15.12:0/1920454828 shutdown_connections 2023-12-11T20:37:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.159+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/1920454828 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8781071e0 0x7fe878109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.159+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/1920454828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe878101f80 0x7fe878104370 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.159+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/1920454828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8781048b0 0x7fe878106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.159+0000 7fe87d1ff700 1 -- 172.21.15.12:0/1920454828 >> 172.21.15.12:0/1920454828 conn(0x7fe8780fb930 msgr2=0x7fe8780fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.159+0000 7fe87d1ff700 1 -- 172.21.15.12:0/1920454828 shutdown_connections 2023-12-11T20:37:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.159+0000 7fe87d1ff700 1 -- 172.21.15.12:0/1920454828 wait complete. 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.160+0000 7fe87d1ff700 1 Processor -- start 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.160+0000 7fe87d1ff700 1 -- start start 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.160+0000 7fe87d1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe878101f80 0x7fe8781973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.160+0000 7fe87d1ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8781048b0 0x7fe878197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.160+0000 7fe87d1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8781071e0 0x7fe87819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.160+0000 7fe87d1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87819eef0 con 0x7fe8781071e0 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.160+0000 7fe87d1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87819f030 con 0x7fe878101f80 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.160+0000 7fe87d1ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87819f1c0 con 0x7fe8781048b0 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8781071e0 0x7fe87819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8781071e0 0x7fe87819e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50224/0 (socket says 172.21.15.12:50224) 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 -- 172.21.15.12:0/2063195417 learned_addr learned my addr 172.21.15.12:0/2063195417 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87659c700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8781048b0 0x7fe878197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe876d9d700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe878101f80 0x7fe8781973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 -- 172.21.15.12:0/2063195417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8781048b0 msgr2=0x7fe878197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8781048b0 0x7fe878197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 -- 172.21.15.12:0/2063195417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe878101f80 msgr2=0x7fe8781973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe878101f80 0x7fe8781973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 -- 172.21.15.12:0/2063195417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8680095f0 con 0x7fe8781071e0 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.161+0000 7fe87759e700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8781071e0 0x7fe87819e920 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fe87000b970 tx=0x7fe87000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.162+0000 7fe85ffff700 1 -- 172.21.15.12:0/2063195417 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000c930 con 0x7fe8781071e0 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.162+0000 7fe85ffff700 1 -- 172.21.15.12:0/2063195417 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe870014440 con 0x7fe8781071e0 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.162+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87819f4a0 con 0x7fe8781071e0 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.162+0000 7fe85ffff700 1 -- 172.21.15.12:0/2063195417 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8700075d0 con 0x7fe8781071e0 2023-12-11T20:37:20.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.162+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87819f9e0 con 0x7fe8781071e0 2023-12-11T20:37:20.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.163+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8780fd4b0 con 0x7fe8781071e0 2023-12-11T20:37:20.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.165+0000 7fe85ffff700 1 -- 172.21.15.12:0/2063195417 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fe8700145b0 con 0x7fe8781071e0 2023-12-11T20:37:20.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.166+0000 7fe85ffff700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8600a1480 0x7fe8600a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:20.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.166+0000 7fe85ffff700 1 -- 172.21.15.12:0/2063195417 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe870006e40 con 0x7fe8781071e0 2023-12-11T20:37:20.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.167+0000 7fe876d9d700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8600a1480 0x7fe8600a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.167+0000 7fe876d9d700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8600a1480 0x7fe8600a3940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe868003780 tx=0x7fe868005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:20.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.175+0000 7fe85ffff700 1 -- 172.21.15.12:0/2063195417 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe870095cc0 con 0x7fe8781071e0 2023-12-11T20:37:20.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:19 smithi032 ceph-mon[132488]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:20.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:19 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3482243815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:37:20.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:19 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2995912546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:37:20.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:19 smithi039 ceph-mon[102205]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:20.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:19 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3482243815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:37:20.303 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:19 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2995912546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:37:20.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:19 smithi012 ceph-mon[128787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-12-11T20:37:20.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:19 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3482243815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:37:20.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:19 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2995912546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:37:20.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.518+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8780fce90 con 0x7fe8781071e0 2023-12-11T20:37:20.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.519+0000 7fe85ffff700 1 -- 172.21.15.12:0/2063195417 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8700992e0 con 0x7fe8781071e0 2023-12-11T20:37:20.518 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:37:20.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.523+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8600a1480 msgr2=0x7fe8600a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.523+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8600a1480 0x7fe8600a3940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe868003780 tx=0x7fe868005fb0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.523+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8781071e0 msgr2=0x7fe87819e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.523+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8781071e0 0x7fe87819e920 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fe87000b970 tx=0x7fe87000bc80 comp rx=0 tx=0).stop 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.524+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 shutdown_connections 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.524+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fe8600a1480 0x7fe8600a3940 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.524+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe878101f80 0x7fe8781973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.524+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8781071e0 0x7fe87819e920 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.524+0000 7fe87d1ff700 1 --2- 172.21.15.12:0/2063195417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8781048b0 0x7fe878197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.524+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 >> 172.21.15.12:0/2063195417 conn(0x7fe8780fb930 msgr2=0x7fe8781029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:20.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.525+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 shutdown_connections 2023-12-11T20:37:20.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.525+0000 7fe87d1ff700 1 -- 172.21.15.12:0/2063195417 wait complete. 2023-12-11T20:37:20.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:37:20.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa87d59a700 1 -- 172.21.15.12:0/425876574 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874003ae0 con 0x7fa880107ab0 2023-12-11T20:37:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 -- 172.21.15.12:0/425876574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa880107ab0 msgr2=0x7fa880107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 --2- 172.21.15.12:0/425876574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa880107ab0 0x7fa880107ed0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa874009990 tx=0x7fa874009ca0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 -- 172.21.15.12:0/425876574 shutdown_connections 2023-12-11T20:37:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 --2- 172.21.15.12:0/425876574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa880109640 0x7fa88010fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 --2- 172.21.15.12:0/425876574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa880107ab0 0x7fa880107ed0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 --2- 172.21.15.12:0/425876574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa880108ca0 0x7fa880109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 -- 172.21.15.12:0/425876574 >> 172.21.15.12:0/425876574 conn(0x7fa880076a50 msgr2=0x7fa880078e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:20.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 -- 172.21.15.12:0/425876574 shutdown_connections 2023-12-11T20:37:20.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.899+0000 7fa884dff700 1 -- 172.21.15.12:0/425876574 wait complete. 2023-12-11T20:37:20.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.901+0000 7fa884dff700 1 Processor -- start 2023-12-11T20:37:20.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.901+0000 7fa884dff700 1 -- start start 2023-12-11T20:37:20.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.901+0000 7fa884dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa880107ab0 0x7fa88007ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:20.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.901+0000 7fa884dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa880108ca0 0x7fa88007f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.901+0000 7fa884dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa880109640 0x7fa8801adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.901+0000 7fa884dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa880082300 con 0x7fa880108ca0 2023-12-11T20:37:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.901+0000 7fa884dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa880082470 con 0x7fa880109640 2023-12-11T20:37:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.901+0000 7fa884dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801ae060 con 0x7fa880107ab0 2023-12-11T20:37:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.902+0000 7fa87ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa880109640 0x7fa8801adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.902+0000 7fa87ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa880109640 0x7fa8801adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:51002/0 (socket says 172.21.15.12:51002) 2023-12-11T20:37:20.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.902+0000 7fa87ed9d700 1 -- 172.21.15.12:0/2484599044 learned_addr learned my addr 172.21.15.12:0/2484599044 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.902+0000 7fa87dd9b700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa880108ca0 0x7fa88007f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.903+0000 7fa87ed9d700 1 -- 172.21.15.12:0/2484599044 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa880107ab0 msgr2=0x7fa88007ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.903+0000 7fa87ed9d700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa880107ab0 0x7fa88007ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.903+0000 7fa87ed9d700 1 -- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa880108ca0 msgr2=0x7fa88007f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.903+0000 7fa87ed9d700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa880108ca0 0x7fa88007f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.903+0000 7fa87ed9d700 1 -- 172.21.15.12:0/2484599044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740095f0 con 0x7fa880109640 2023-12-11T20:37:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.904+0000 7fa87ed9d700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa880109640 0x7fa8801adb20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa87000d980 tx=0x7fa87000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.904+0000 7fa86f7fe700 1 -- 172.21.15.12:0/2484599044 <== mon.2 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870004a30 con 0x7fa880109640 2023-12-11T20:37:20.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.904+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8801ae2f0 con 0x7fa880109640 2023-12-11T20:37:20.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.904+0000 7fa86f7fe700 1 -- 172.21.15.12:0/2484599044 <== mon.2 v2:172.21.15.32:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa87000b5c0 con 0x7fa880109640 2023-12-11T20:37:20.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.904+0000 7fa86f7fe700 1 -- 172.21.15.12:0/2484599044 <== mon.2 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870004a30 con 0x7fa880109640 2023-12-11T20:37:20.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.904+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8801ae8d0 con 0x7fa880109640 2023-12-11T20:37:20.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.907+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88010efd0 con 0x7fa880109640 2023-12-11T20:37:20.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.915+0000 7fa86f7fe700 1 -- 172.21.15.12:0/2484599044 <== mon.2 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fa870005020 con 0x7fa880109640 2023-12-11T20:37:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.917+0000 7fa86f7fe700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa8680a1590 0x7fa8680a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.917+0000 7fa86f7fe700 1 -- 172.21.15.12:0/2484599044 <== mon.2 v2:172.21.15.32:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa8700cc760 con 0x7fa880109640 2023-12-11T20:37:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.918+0000 7fa87e59c700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa8680a1590 0x7fa8680a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.919+0000 7fa87e59c700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa8680a1590 0x7fa8680a3a50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa8740095c0 tx=0x7fa874009510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:20.929+0000 7fa86f7fe700 1 -- 172.21.15.12:0/2484599044 <== mon.2 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa870095d70 con 0x7fa880109640 2023-12-11T20:37:21.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:20 smithi032 ceph-mon[132488]: pgmap v1017: 97 pgs: 97 active+clean; 7.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 165 KiB/s wr, 149 op/s 2023-12-11T20:37:21.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:20 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2063195417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:37:21.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.285+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8801ae480 con 0x7fa880109640 2023-12-11T20:37:21.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.288+0000 7fa86f7fe700 1 -- 172.21.15.12:0/2484599044 <== mon.2 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8801ae480 con 0x7fa880109640 2023-12-11T20:37:21.287 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:37:21.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.292+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa8680a1590 msgr2=0x7fa8680a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:21.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.292+0000 7fa884dff700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa8680a1590 0x7fa8680a3a50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa8740095c0 tx=0x7fa874009510 comp rx=0 tx=0).stop 2023-12-11T20:37:21.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.292+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa880109640 msgr2=0x7fa8801adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:21.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.292+0000 7fa884dff700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa880109640 0x7fa8801adb20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa87000d980 tx=0x7fa87000dc90 comp rx=0 tx=0).stop 2023-12-11T20:37:21.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.293+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 shutdown_connections 2023-12-11T20:37:21.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.293+0000 7fa884dff700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fa8680a1590 0x7fa8680a3a50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.293+0000 7fa884dff700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa880109640 0x7fa8801adb20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.293+0000 7fa884dff700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa880107ab0 0x7fa88007ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.293+0000 7fa884dff700 1 --2- 172.21.15.12:0/2484599044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa880108ca0 0x7fa88007f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.293+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 >> 172.21.15.12:0/2484599044 conn(0x7fa880076a50 msgr2=0x7fa88010c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:21.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.293+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 shutdown_connections 2023-12-11T20:37:21.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.293+0000 7fa884dff700 1 -- 172.21.15.12:0/2484599044 wait complete. 2023-12-11T20:37:21.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:20 smithi039 ceph-mon[102205]: pgmap v1017: 97 pgs: 97 active+clean; 7.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 165 KiB/s wr, 149 op/s 2023-12-11T20:37:21.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:20 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2063195417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:37:21.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:20 smithi012 ceph-mon[128787]: pgmap v1017: 97 pgs: 97 active+clean; 7.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 165 KiB/s wr, 149 op/s 2023-12-11T20:37:21.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:20 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2063195417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:37:21.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.639+0000 7efc7b59e700 1 -- 172.21.15.12:0/506143343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 msgr2=0x7efc7c101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.639+0000 7efc7b59e700 1 --2- 172.21.15.12:0/506143343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 0x7efc7c101f50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009990 tx=0x7efc6c009ca0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.639+0000 7efc7b59e700 1 -- 172.21.15.12:0/506143343 shutdown_connections 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.639+0000 7efc7b59e700 1 --2- 172.21.15.12:0/506143343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc7c104e60 0x7efc7c1052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.639+0000 7efc7b59e700 1 --2- 172.21.15.12:0/506143343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 0x7efc7c101f50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.639+0000 7efc7b59e700 1 --2- 172.21.15.12:0/506143343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc7c102490 0x7efc7c104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.639+0000 7efc7b59e700 1 -- 172.21.15.12:0/506143343 >> 172.21.15.12:0/506143343 conn(0x7efc7c0fb760 msgr2=0x7efc7c0fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.640+0000 7efc7b59e700 1 -- 172.21.15.12:0/506143343 shutdown_connections 2023-12-11T20:37:21.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.640+0000 7efc7b59e700 1 -- 172.21.15.12:0/506143343 wait complete. 2023-12-11T20:37:21.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.643+0000 7efc7b59e700 1 Processor -- start 2023-12-11T20:37:21.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.643+0000 7efc7b59e700 1 -- start start 2023-12-11T20:37:21.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7b59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 0x7efc7c19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:21.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc7c102490 0x7efc7c19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:21.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc7c104e60 0x7efc7c1a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:21.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1a51f0 con 0x7efc7c104e60 2023-12-11T20:37:21.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7b59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1a5330 con 0x7efc7c102490 2023-12-11T20:37:21.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7b59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1a54c0 con 0x7efc7c0ffb20 2023-12-11T20:37:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 0x7efc7c19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 0x7efc7c19d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:47736/0 (socket says 172.21.15.12:47736) 2023-12-11T20:37:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.644+0000 7efc7a59c700 1 -- 172.21.15.12:0/2166340475 learned_addr learned my addr 172.21.15.12:0/2166340475 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:37:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.645+0000 7efc79d9b700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc7c102490 0x7efc7c19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.645+0000 7efc7ad9d700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc7c104e60 0x7efc7c1a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:21.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.645+0000 7efc7a59c700 1 -- 172.21.15.12:0/2166340475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc7c102490 msgr2=0x7efc7c19dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:21.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.645+0000 7efc7a59c700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc7c102490 0x7efc7c19dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.645+0000 7efc7a59c700 1 -- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc7c104e60 msgr2=0x7efc7c1a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:21.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.645+0000 7efc7a59c700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc7c104e60 0x7efc7c1a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:21.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.645+0000 7efc7a59c700 1 -- 172.21.15.12:0/2166340475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc70009520 con 0x7efc7c0ffb20 2023-12-11T20:37:21.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.645+0000 7efc7ad9d700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc7c104e60 0x7efc7c1a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:37:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.646+0000 7efc7a59c700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 0x7efc7c19d710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00b2e0 tx=0x7efc6c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.646+0000 7efc6b7fe700 1 -- 172.21.15.12:0/2166340475 <== mon.1 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c01d070 con 0x7efc7c0ffb20 2023-12-11T20:37:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.646+0000 7efc6b7fe700 1 -- 172.21.15.12:0/2166340475 <== mon.1 v2:172.21.15.39:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc6c00beb0 con 0x7efc7c0ffb20 2023-12-11T20:37:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.646+0000 7efc6b7fe700 1 -- 172.21.15.12:0/2166340475 <== mon.1 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c005260 con 0x7efc7c0ffb20 2023-12-11T20:37:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.647+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0095f0 con 0x7efc7c0ffb20 2023-12-11T20:37:21.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.648+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c1a5920 con 0x7efc7c0ffb20 2023-12-11T20:37:21.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.650+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c0fd2e0 con 0x7efc7c0ffb20 2023-12-11T20:37:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.654+0000 7efc6b7fe700 1 -- 172.21.15.12:0/2166340475 <== mon.1 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7efc6c004a10 con 0x7efc7c0ffb20 2023-12-11T20:37:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.656+0000 7efc6b7fe700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efc640a1500 0x7efc640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:37:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.656+0000 7efc6b7fe700 1 -- 172.21.15.12:0/2166340475 <== mon.1 v2:172.21.15.39:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efc6c0ce0f0 con 0x7efc7c0ffb20 2023-12-11T20:37:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.657+0000 7efc79d9b700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efc640a1500 0x7efc640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:37:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.658+0000 7efc79d9b700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efc640a1500 0x7efc640a39c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efc70009d80 tx=0x7efc70009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:37:21.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:21.669+0000 7efc6b7fe700 1 -- 172.21.15.12:0/2166340475 <== mon.1 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efc6c097730 con 0x7efc7c0ffb20 2023-12-11T20:37:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.080+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7efc7c02d3b0 con 0x7efc7c0ffb20 2023-12-11T20:37:22.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.102+0000 7efc6b7fe700 1 -- 172.21.15.12:0/2166340475 <== mon.1 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733881 (secure 0 0 0) 0x7efc6c029e80 con 0x7efc7c0ffb20 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 18, 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout: "active_gid": 14148, 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout: "active_name": "x", 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addrs": { 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1969938581 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1969938581 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addr": "172.21.15.12:6801/1969938581", 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "active_change": "2023-12-11T20:06:02.927654+0000", 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "active_mgr_features": 4540138322906710015, 2023-12-11T20:37:22.113 INFO:teuthology.orchestra.run.smithi012.stdout: "available": true, 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "standbys": [ 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 14214, 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "z", 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540138322906710015, 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.116 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.117 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.118 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.119 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.122 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2023-12-11T20:37:22.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.124 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.126 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2023-12-11T20:37:22.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.130 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.131 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2023-12-11T20:37:22.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2023-12-11T20:37:22.133 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-11T20:37:22.134 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-11T20:37:22.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-11T20:37:22.136 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.137 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.140 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.141 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.143 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap" 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2023-12-11T20:37:22.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-11T20:37:22.145 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.146 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.148 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2023-12-11T20:37:22.149 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2023-12-11T20:37:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.151 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-11T20:37:22.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-11T20:37:22.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.155 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2023-12-11T20:37:22.156 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.157 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.159 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.160 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.161 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.162 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-11T20:37:22.163 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.164 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.167 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.168 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.169 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.170 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.172 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.174 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.176 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.177 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2023-12-11T20:37:22.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.179 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.180 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-11T20:37:22.181 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.184 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.185 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-11T20:37:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.188 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.189 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.190 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.191 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.192 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2023-12-11T20:37:22.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2023-12-11T20:37:22.194 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2023-12-11T20:37:22.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2023-12-11T20:37:22.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.197 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.199 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2023-12-11T20:37:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2023-12-11T20:37:22.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2023-12-11T20:37:22.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2023-12-11T20:37:22.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.204 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.205 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.208 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.212 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.213 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.214 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-11T20:37:22.216 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.217 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.218 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.220 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.222 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.223 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.225 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-11T20:37:22.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-11T20:37:22.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-11T20:37:22.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.231 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.233 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.234 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.236 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.237 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.238 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.240 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.241 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-11T20:37:22.242 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-11T20:37:22.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.245 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.246 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.247 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.248 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.249 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.252 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2023-12-11T20:37:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-11T20:37:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.253 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:22.254 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.255 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.256 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "UNSAFE_TLS_v1_2": { 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "UNSAFE_TLS_v1_2", 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.257 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.258 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.259 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2023-12-11T20:37:22.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.263 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.264 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.265 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.266 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.267 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:22.271 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:22.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.273 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.274 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.275 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.276 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.277 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2023-12-11T20:37:22.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2023-12-11T20:37:22.279 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.280 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.281 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.282 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.284 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.286 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2023-12-11T20:37:22.287 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.288 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.289 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2023-12-11T20:37:22.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.292 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.293 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.294 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.295 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.297 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2023-12-11T20:37:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.299 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.300 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2023-12-11T20:37:22.301 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.302 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.303 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2023-12-11T20:37:22.304 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.308 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.309 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.310 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.311 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2023-12-11T20:37:22.312 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.313 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.314 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2023-12-11T20:37:22.315 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.316 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.317 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.318 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.319 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.321 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.322 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.323 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.324 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.325 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2023-12-11T20:37:22.326 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.327 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.329 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.330 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.331 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.332 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2023-12-11T20:37:22.333 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.334 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.335 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.336 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.337 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.338 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2023-12-11T20:37:22.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.340 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.342 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2023-12-11T20:37:22.343 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.344 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.345 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.346 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.347 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.348 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.351 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.352 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.353 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.354 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.355 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.356 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.357 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.358 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.359 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.360 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.361 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.362 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.363 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.364 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.365 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.366 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2023-12-11T20:37:22.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.368 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.369 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.370 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.371 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.372 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.373 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.374 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.375 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.376 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.377 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.378 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.379 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.380 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.381 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.382 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.383 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.384 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.385 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.386 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2023-12-11T20:37:22.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.388 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.389 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.390 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.391 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.392 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.393 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.394 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2023-12-11T20:37:22.396 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.397 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.399 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.400 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.402 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.403 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.404 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.405 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-11T20:37:22.406 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.408 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2023-12-11T20:37:22.409 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2023-12-11T20:37:22.410 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.412 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.414 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.430 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.431 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.432 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.433 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "drive_group_interval": { 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "drive_group_interval", 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300.0", 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.434 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.435 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.439 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.441 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.443 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.444 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.446 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.447 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.448 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.449 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.450 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.451 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.453 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.454 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2023-12-11T20:37:22.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.456 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2023-12-11T20:37:22.457 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.459 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.460 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.461 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.462 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2023-12-11T20:37:22.464 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.465 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.466 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.467 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.468 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.469 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.470 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.471 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.474 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.476 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.478 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.480 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.481 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.482 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.484 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.485 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.486 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.487 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.488 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-11T20:37:22.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2023-12-11T20:37:22.491 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.492 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.493 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.494 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.495 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.496 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.498 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.499 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.500 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2023-12-11T20:37:22.501 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.502 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.503 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.504 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.505 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.506 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.507 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.508 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.509 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.511 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.513 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.515 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.517 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.518 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.519 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.520 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.522 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2023-12-11T20:37:22.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.524 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.526 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 24116, 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "y", 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540138322906710015, 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.527 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.528 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2023-12-11T20:37:22.533 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.537 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.538 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2023-12-11T20:37:22.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.540 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.541 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-11T20:37:22.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2023-12-11T20:37:22.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2023-12-11T20:37:22.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2023-12-11T20:37:22.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.549 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.551 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.552 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.553 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2023-12-11T20:37:22.554 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap" 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.555 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.556 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.557 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.558 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.559 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.560 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2023-12-11T20:37:22.561 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.562 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.563 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-11T20:37:22.564 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2023-12-11T20:37:22.565 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.566 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-11T20:37:22.567 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.569 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.570 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.571 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2023-12-11T20:37:22.572 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2023-12-11T20:37:22.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.574 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.575 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-11T20:37:22.576 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.577 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.578 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.579 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.580 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2023-12-11T20:37:22.581 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.584 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.585 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.586 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2023-12-11T20:37:22.587 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2023-12-11T20:37:22.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.589 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.592 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.593 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.594 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.595 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.596 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.597 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.598 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.599 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.600 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.601 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-11T20:37:22.602 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.603 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.604 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-11T20:37:22.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.606 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2023-12-11T20:37:22.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.609 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.612 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.614 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.615 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.616 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.617 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.618 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2023-12-11T20:37:22.619 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-11T20:37:22.621 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.622 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.623 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.624 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.625 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.626 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.627 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.628 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.629 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.630 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.631 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.633 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.634 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.635 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.636 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.637 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.638 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.639 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.641 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.642 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-11T20:37:22.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.644 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.646 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.647 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.648 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.649 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.650 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.652 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-11T20:37:22.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.654 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:22.656 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.657 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.659 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.659 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.659 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.659 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.661 INFO:teuthology.orchestra.run.smithi012.stdout: "UNSAFE_TLS_v1_2": { 2023-12-11T20:37:22.661 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "UNSAFE_TLS_v1_2", 2023-12-11T20:37:22.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.661 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.661 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.662 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.662 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.662 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.662 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.662 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.662 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.663 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.667 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2023-12-11T20:37:22.668 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.669 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.670 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.672 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.673 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2023-12-11T20:37:22.675 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.676 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.677 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2023-12-11T20:37:22.679 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2023-12-11T20:37:22.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2023-12-11T20:37:22.681 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2023-12-11T20:37:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.684 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.688 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.688 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.688 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.688 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.688 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.688 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.689 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.689 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.689 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.689 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.689 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.689 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.690 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.690 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.690 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.690 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.690 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.690 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.690 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.691 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.691 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.691 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.691 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.691 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.692 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.692 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.692 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.692 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.692 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.692 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.692 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.693 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2023-12-11T20:37:22.693 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2023-12-11T20:37:22.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.693 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.693 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2023-12-11T20:37:22.693 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2023-12-11T20:37:22.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.695 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.696 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.697 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.698 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.699 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.700 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.701 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.706 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.708 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2023-12-11T20:37:22.711 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.712 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.713 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.715 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.716 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.720 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2023-12-11T20:37:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.722 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.723 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.724 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.726 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.727 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.728 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.730 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.731 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.733 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.735 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.739 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.740 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.745 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.746 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.747 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.748 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2023-12-11T20:37:22.749 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-11T20:37:22.750 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.751 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.753 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.757 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.759 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.760 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.763 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.764 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.765 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.766 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.767 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.768 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.769 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.770 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.772 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.773 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.774 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.775 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.777 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.778 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.780 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.783 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.789 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2023-12-11T20:37:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.791 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2023-12-11T20:37:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.793 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.795 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.796 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2023-12-11T20:37:22.798 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2023-12-11T20:37:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.813 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.814 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.822 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.823 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.825 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.828 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.829 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.830 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.831 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.832 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.834 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.835 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "drive_group_interval": { 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "drive_group_interval", 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.838 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300.0", 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.839 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.846 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.848 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.849 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.850 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2023-12-11T20:37:22.851 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.852 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.853 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.854 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.855 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2023-12-11T20:37:22.857 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2023-12-11T20:37:22.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.859 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.861 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.867 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.868 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.869 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.870 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.871 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.872 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.873 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.874 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.878 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.879 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2023-12-11T20:37:22.887 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.888 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.889 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.890 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.892 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-11T20:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.901 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.902 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.903 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.905 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.909 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.910 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.913 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.914 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.915 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.916 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2023-12-11T20:37:22.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.919 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2023-12-11T20:37:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.921 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.923 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.924 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.925 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.927 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2023-12-11T20:37:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2023-12-11T20:37:22.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.930 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.931 INFO:teuthology.orchestra.run.smithi012.stdout: "modules": [ 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard", 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "iostat", 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "nfs", 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "restful" 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:22.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2023-12-11T20:37:22.938 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.941 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2023-12-11T20:37:22.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2023-12-11T20:37:22.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2023-12-11T20:37:22.945 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2023-12-11T20:37:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2023-12-11T20:37:22.947 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-11T20:37:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.950 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-11T20:37:22.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.952 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.954 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.957 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.958 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2023-12-11T20:37:22.959 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap" 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.961 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.962 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2023-12-11T20:37:22.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:22.964 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2023-12-11T20:37:22.969 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2023-12-11T20:37:22.970 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.974 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2023-12-11T20:37:22.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2023-12-11T20:37:22.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-11T20:37:22.982 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.984 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-12-11T20:37:22.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.986 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:22.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.991 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-11T20:37:22.992 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2023-12-11T20:37:22.995 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:22.999 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.001 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.004 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2023-12-11T20:37:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2023-12-11T20:37:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2023-12-11T20:37:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2023-12-11T20:37:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2023-12-11T20:37:23.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2023-12-11T20:37:23.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2023-12-11T20:37:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.018 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.020 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2023-12-11T20:37:23.026 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.029 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.031 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.034 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-11T20:37:23.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-11T20:37:23.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.041 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.042 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.043 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.044 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-11T20:37:23.047 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-11T20:37:23.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.050 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.052 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.053 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.054 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.056 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.058 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.060 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-11T20:37:23.061 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-11T20:37:23.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.063 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.064 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "UNSAFE_TLS_v1_2": { 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "UNSAFE_TLS_v1_2", 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.066 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.067 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.069 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2023-12-11T20:37:23.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2023-12-11T20:37:23.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2023-12-11T20:37:23.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.075 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.076 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.078 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.079 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.082 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.085 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.086 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.088 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.089 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.090 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.092 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.094 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2023-12-11T20:37:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2023-12-11T20:37:23.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.098 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-11T20:37:23.101 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.102 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2023-12-11T20:37:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.120 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2023-12-11T20:37:23.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.124 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.125 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.126 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.127 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.128 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.129 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.130 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.132 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2023-12-11T20:37:23.134 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.137 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.138 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.139 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.140 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2023-12-11T20:37:23.141 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.142 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.143 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.145 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.146 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2023-12-11T20:37:23.149 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2023-12-11T20:37:23.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.152 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.153 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.155 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.157 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.158 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.161 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2023-12-11T20:37:23.162 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.163 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.164 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.165 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.168 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.169 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.170 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.172 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.175 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.178 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.180 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.181 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.183 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.186 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.188 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.189 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.191 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.192 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.193 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.195 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.196 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.198 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.199 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.200 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.202 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.203 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.204 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.205 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.208 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-11T20:37:23.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2023-12-11T20:37:23.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.212 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.213 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2023-12-11T20:37:23.215 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.216 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.217 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.218 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.219 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.220 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.222 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2023-12-11T20:37:23.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.225 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.228 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.229 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.230 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.232 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.233 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.234 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.236 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.237 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "drive_group_interval": { 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "drive_group_interval", 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.238 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300.0", 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.240 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.241 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.242 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.243 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.244 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.245 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.246 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2023-12-11T20:37:23.247 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.249 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.250 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.251 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.253 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2023-12-11T20:37:23.254 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.255 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.256 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.258 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2023-12-11T20:37:23.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.261 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.263 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.264 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.265 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.266 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.267 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.269 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.270 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.273 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.275 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-11T20:37:23.291 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.292 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.294 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2023-12-11T20:37:23.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2023-12-11T20:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.300 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.301 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.302 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.303 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.304 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.305 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.306 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.307 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-11T20:37:23.309 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.311 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.312 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.313 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.314 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.315 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.317 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.318 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.319 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.321 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2023-12-11T20:37:23.322 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2023-12-11T20:37:23.323 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2023-12-11T20:37:23.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2023-12-11T20:37:23.325 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.327 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.328 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2023-12-11T20:37:23.329 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.330 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.331 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.332 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2023-12-11T20:37:23.333 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "services": { 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard": "https://172.21.15.12:8443/" 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "always_on_modules": { 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "octopus": [ 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2023-12-11T20:37:23.334 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "pacific": [ 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2023-12-11T20:37:23.335 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "quincy": [ 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "reef": [ 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2023-12-11T20:37:23.336 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "last_failure_osd_epoch": 3, 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "active_clients": [ 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.337 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2604531932 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "libcephsqlite", 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2023-12-11T20:37:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1336767852 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3748541661 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:23.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1265360928 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-12-11T20:37:23.340 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:37:23.342 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:21 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2484599044' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:37:23.342 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:22 smithi039 ceph-mon[102205]: pgmap v1018: 97 pgs: 97 active+clean; 5.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 131 KiB/s wr, 193 op/s 2023-12-11T20:37:23.342 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:22 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2166340475' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-11T20:37:23.342 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:21 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2484599044' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:37:23.342 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:22 smithi032 ceph-mon[132488]: pgmap v1018: 97 pgs: 97 active+clean; 5.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 131 KiB/s wr, 193 op/s 2023-12-11T20:37:23.342 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:22 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2166340475' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efc640a1500 msgr2=0x7efc640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efc640a1500 0x7efc640a39c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efc70009d80 tx=0x7efc70009260 comp rx=0 tx=0).stop 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 msgr2=0x7efc7c19d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 0x7efc7c19d710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00b2e0 tx=0x7efc6c004730 comp rx=0 tx=0).stop 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 shutdown_connections 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7efc640a1500 0x7efc640a39c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc7c104e60 0x7efc7c1a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc7c0ffb20 0x7efc7c19d710 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 --2- 172.21.15.12:0/2166340475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc7c102490 0x7efc7c19dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.110+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 >> 172.21.15.12:0/2166340475 conn(0x7efc7c0fb760 msgr2=0x7efc7c102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:37:23.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.111+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 shutdown_connections 2023-12-11T20:37:23.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:37:22.111+0000 7efc7b59e700 1 -- 172.21.15.12:0/2166340475 wait complete. 2023-12-11T20:37:23.349 DEBUG:tasks.check_counter:Getting stats from a 2023-12-11T20:37:23.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.a perf dump 2023-12-11T20:37:23.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:21 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2484599044' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:37:23.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:22 smithi012 ceph-mon[128787]: pgmap v1018: 97 pgs: 97 active+clean; 5.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 131 KiB/s wr, 193 op/s 2023-12-11T20:37:23.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:22 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2166340475' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-11T20:37:24.296 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:37:25.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:24 smithi032 ceph-mon[132488]: pgmap v1019: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 141 KiB/s wr, 228 op/s 2023-12-11T20:37:25.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:24 smithi039 ceph-mon[102205]: pgmap v1019: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 141 KiB/s wr, 228 op/s 2023-12-11T20:37:25.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:24 smithi012 ceph-mon[128787]: pgmap v1019: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 141 KiB/s wr, 228 op/s 2023-12-11T20:37:26.527 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:37:26.527 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:37:26.527 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 0, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 0, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 0, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.004127331, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000000000, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.000736531, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:26.528 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 2, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 289, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 320, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 204752, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2023-12-11T20:37:26.529 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.028114188, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.023037331, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.002108989, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 287, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.015757827, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000054905 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 204752 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 383, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 378, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 521200, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 227936, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.069694150, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.032709187, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.021775886, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.009905007, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 378, 2023-12-11T20:37:26.531 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.031991274, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000084633 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 521200, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 227936 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2023-12-11T20:37:26.532 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2023-12-11T20:37:26.533 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:37:26.534 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148744, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 30, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2023-12-11T20:37:26.535 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:37:26.536 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 381, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 464628, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 381, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 381, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 464628, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:26.537 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:26.538 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:37:27.006 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-12-11T20:37:27.006 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-12-11T20:37:27.006 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2023-12-11T20:37:27.006 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2023-12-11T20:37:27.006 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2023-12-11T20:37:27.006 DEBUG:tasks.check_counter:Getting stats from d 2023-12-11T20:37:27.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.d perf dump 2023-12-11T20:37:27.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:26 smithi032 ceph-mon[132488]: pgmap v1020: 97 pgs: 97 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 275 op/s 2023-12-11T20:37:27.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:26 smithi039 ceph-mon[102205]: pgmap v1020: 97 pgs: 97 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 275 op/s 2023-12-11T20:37:27.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:26 smithi012 ceph-mon[128787]: pgmap v1020: 97 pgs: 97 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 275 op/s 2023-12-11T20:37:27.797 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:37:29.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:28 smithi032 ceph-mon[132488]: pgmap v1021: 97 pgs: 97 active+clean; 33 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 83 KiB/s wr, 291 op/s 2023-12-11T20:37:29.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:28 smithi039 ceph-mon[102205]: pgmap v1021: 97 pgs: 97 active+clean; 33 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 83 KiB/s wr, 291 op/s 2023-12-11T20:37:29.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:28 smithi012 ceph-mon[128787]: pgmap v1021: 97 pgs: 97 active+clean; 33 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 83 KiB/s wr, 291 op/s 2023-12-11T20:37:29.617 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 0, 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2, 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 0, 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 0, 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.003552351, 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000000000, 2023-12-11T20:37:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.000518985, 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 2, 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 294, 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 320, 2023-12-11T20:37:29.620 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 205632, 2023-12-11T20:37:29.621 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2023-12-11T20:37:29.621 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2023-12-11T20:37:29.621 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.032330950, 2023-12-11T20:37:29.621 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.026814929, 2023-12-11T20:37:29.621 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.001996453, 2023-12-11T20:37:29.621 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:37:29.621 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 292, 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.019080614, 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000065344 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.622 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 205632 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 391, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 386, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 524000, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 232640, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.070364623, 2023-12-11T20:37:29.623 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.034704804, 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.023234714, 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.009490941, 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 386, 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.029128294, 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000075461 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:29.624 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 524000, 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 232640 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2023-12-11T20:37:29.625 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:37:29.626 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2023-12-11T20:37:29.626 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:37:29.626 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:37:29.626 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2023-12-11T20:37:29.627 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2023-12-11T20:37:29.628 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148704, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 29, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:37:29.629 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:29.630 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 389, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 466305, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 389, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 389, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 466305, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:29.631 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:29.632 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:29.632 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:29.632 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:37:30.105 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-12-11T20:37:30.105 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-12-11T20:37:30.105 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-12-11T20:37:30.105 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-12-11T20:37:30.105 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2023-12-11T20:37:30.105 DEBUG:tasks.check_counter:Getting stats from g 2023-12-11T20:37:30.106 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.g perf dump 2023-12-11T20:37:30.907 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:37:31.212 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:30 smithi032 ceph-mon[132488]: pgmap v1022: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 71 KiB/s wr, 232 op/s 2023-12-11T20:37:31.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:30 smithi039 ceph-mon[102205]: pgmap v1022: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 71 KiB/s wr, 232 op/s 2023-12-11T20:37:31.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:30 smithi012 ceph-mon[128787]: pgmap v1022: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 71 KiB/s wr, 232 op/s 2023-12-11T20:37:33.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:32 smithi032 ceph-mon[132488]: pgmap v1023: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 183 op/s 2023-12-11T20:37:33.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:32 smithi039 ceph-mon[102205]: pgmap v1023: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 183 op/s 2023-12-11T20:37:33.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:32 smithi012 ceph-mon[128787]: pgmap v1023: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 183 op/s 2023-12-11T20:37:35.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:34 smithi032 ceph-mon[132488]: pgmap v1024: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 131 op/s 2023-12-11T20:37:35.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:34 smithi039 ceph-mon[102205]: pgmap v1024: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 131 op/s 2023-12-11T20:37:35.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:34 smithi012 ceph-mon[128787]: pgmap v1024: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 131 op/s 2023-12-11T20:37:37.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:36 smithi032 ceph-mon[132488]: pgmap v1025: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 96 op/s 2023-12-11T20:37:37.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:36 smithi039 ceph-mon[102205]: pgmap v1025: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 96 op/s 2023-12-11T20:37:37.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:36 smithi012 ceph-mon[128787]: pgmap v1025: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 96 op/s 2023-12-11T20:37:39.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:38 smithi032 ceph-mon[132488]: pgmap v1026: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 46 op/s 2023-12-11T20:37:39.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:38 smithi039 ceph-mon[102205]: pgmap v1026: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 46 op/s 2023-12-11T20:37:39.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:38 smithi012 ceph-mon[128787]: pgmap v1026: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 46 op/s 2023-12-11T20:37:41.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:40 smithi039 ceph-mon[102205]: pgmap v1027: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 8 op/s 2023-12-11T20:37:41.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:40 smithi012 ceph-mon[128787]: pgmap v1027: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 8 op/s 2023-12-11T20:37:41.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:40 smithi032 ceph-mon[132488]: pgmap v1027: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 8 op/s 2023-12-11T20:37:43.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:42 smithi039 ceph-mon[102205]: pgmap v1028: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:37:43.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:42 smithi012 ceph-mon[128787]: pgmap v1028: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:37:43.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:42 smithi032 ceph-mon[132488]: pgmap v1028: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:37:45.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:44 smithi039 ceph-mon[102205]: pgmap v1029: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:37:45.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:44 smithi012 ceph-mon[128787]: pgmap v1029: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:37:45.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:44 smithi032 ceph-mon[132488]: pgmap v1029: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:37:45.863 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:37:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:37:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 0, 2023-12-11T20:37:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2, 2023-12-11T20:37:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 0, 2023-12-11T20:37:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 0, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.003794327, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000000000, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.000664523, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 391, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 386, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 524064, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 232176, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.065671447, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.031228023, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.021853332, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.009539724, 2023-12-11T20:37:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 386, 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.029575878, 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000076621 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 524064, 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 232176 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:37:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 2, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 294, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 320, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 205632, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.024368024, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.019510451, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.001773537, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 292, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.021133300, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000072374 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 205632 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:37:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:37:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:37:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148704, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 29, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2023-12-11T20:37:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 389, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 466369, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 389, 2023-12-11T20:37:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 389, 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 466369, 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:45.873 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:37:46.350 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2023-12-11T20:37:46.350 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2023-12-11T20:37:46.351 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2023-12-11T20:37:46.351 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2023-12-11T20:37:46.351 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2023-12-11T20:37:46.351 DEBUG:tasks.check_counter:Getting stats from j 2023-12-11T20:37:46.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.j perf dump 2023-12-11T20:37:47.146 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.a/config 2023-12-11T20:37:47.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:46 smithi039 ceph-mon[102205]: pgmap v1030: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:47.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:46 smithi012 ceph-mon[128787]: pgmap v1030: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:47.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:46 smithi032 ceph-mon[132488]: pgmap v1030: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 367, 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 365, 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 514976, 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 220000, 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.070669791, 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.031001702, 2023-12-11T20:37:48.637 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.022822473, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.010069607, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 363, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.026644579, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000073401 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 514976, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 220000 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.638 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 35, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 329, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 149264, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 224864, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.037564997, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.026878354, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.007106865, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000890314, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 328, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.026887535, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000081974 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 149264, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 224864 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 0, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 3, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 0, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 0, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 3, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.001437643, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000000000, 2023-12-11T20:37:48.640 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.001210552, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:37:48.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:37:48.642 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:37:48.643 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148705, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 29, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2023-12-11T20:37:48.644 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2023-12-11T20:37:48.645 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 398, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 604963, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 398, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 398, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 604963, 2023-12-11T20:37:48.646 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2023-12-11T20:37:48.647 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2023-12-11T20:37:48.647 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2023-12-11T20:37:48.647 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2023-12-11T20:37:48.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:48.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-12-11T20:37:48.647 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-12-11T20:37:49.152 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-12-11T20:37:49.153 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-12-11T20:37:49.153 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-12-11T20:37:49.153 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-12-11T20:37:49.153 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-12-11T20:37:49.153 DEBUG:tasks.check_counter:Getting stats from b 2023-12-11T20:37:49.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.b perf dump 2023-12-11T20:37:49.244 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:48 smithi032 ceph-mon[132488]: pgmap v1031: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:37:49.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:48 smithi039 ceph-mon[102205]: pgmap v1031: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:37:49.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:48 smithi012 ceph-mon[128787]: pgmap v1031: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:37:49.969 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:37:51.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:50 smithi032 ceph-mon[132488]: pgmap v1032: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:51.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:50 smithi039 ceph-mon[102205]: pgmap v1032: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:51.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:50 smithi012 ceph-mon[128787]: pgmap v1032: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:51.596 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-12-11T20:37:51.596 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:37:51.596 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 6117, 2023-12-11T20:37:51.596 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 6536, 2023-12-11T20:37:51.596 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 1919748, 2023-12-11T20:37:51.596 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 15139645, 2023-12-11T20:37:51.596 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 468, 2023-12-11T20:37:51.596 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 5, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 1.025701244, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.373712692, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.471735450, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.109814998, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 6534, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.733359907, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000112237 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 6666, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.001974858, 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000296 2023-12-11T20:37:51.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 10382, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 11346, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 4233713, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 8508189, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 11, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 5, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 1.121137302, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.408504693, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.587991947, 2023-12-11T20:37:51.598 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.183260575, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 11345, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 1.558732608, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000137393 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 15241, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.003732502, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000244 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 716032, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 313200 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.599 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 4804, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 5627, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 1738684, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 2825224, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 11, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 6, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.590559736, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.229553832, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.238998922, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.115141809, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 5626, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.729803101, 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000129719 2023-12-11T20:37:51.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 6412, 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.001746070, 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000272 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 3280, 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 628384 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "cct": { 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "total_workers": 1, 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "unhealthy_workers": 0 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "finisher-MDSRank": { 2023-12-11T20:37:51.601 INFO:teuthology.orchestra.run.smithi032.stdout: "queue_len": 0, 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "complete_latency": { 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 4766, 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 2.546810870, 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000534370 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "finisher-PurgeQueue": { 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "queue_len": 0, 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "complete_latency": { 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 1598, 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.094096439, 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000058883 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.602 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "request": 3307, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "reply": 2938, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "reply_latency": { 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 2938, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 9.707422315, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.003304092 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "slow_reply": 0, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "forward": 369, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_fetch_complete": 8, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_fetch_keys": 2, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_commit": 695, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_split": 0, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_merge": 0, 2023-12-11T20:37:51.603 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes": 42, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_top": 5, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_bottom": 26, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_pin_tail": 11, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_pinned": 34, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_expired": 402, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_with_caps": 2, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": 2, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "subtrees": 4, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse": 5036, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_hit": 4476, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_forward": 352, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_discover": 17, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_dir_fetch": 0, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_remote_ino": 0, 2023-12-11T20:37:51.604 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_lock": 54, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "load_cent": 40, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "q": 0, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "exported": 28, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "exported_inodes": 355, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "imported": 5, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "imported_inodes": 50, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_dir_fetch": 0, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_backtrace_fetch": 2213, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_peer_discover": 0, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rfiles": 4, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rbytes": 246, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rsnaps": 0, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_backtrace_fetch": 2213, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_set_tag": 0, 2023-12-11T20:37:51.605 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_backtrace_repaired": 0, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_inotable_repaired": 0, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dir_inodes": 376, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dir_base_inodes": 33, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dirfrag_rstats": 343, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_file_inodes": 1837, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_inode_file_caps": 0, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_revoke": 1053, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_grant": 1412, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_trunc": 6, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_caps": 2810, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_caps_dirty": 1047, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_cap_release": 29, 2023-12-11T20:37:51.606 INFO:teuthology.orchestra.run.smithi032.stdout: "process_request_cap_release": 1914 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache": { 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_update": 150, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_update_receipt": 89, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_try_discover": 52, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_send_discover": 68, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_handle_discover": 335, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays": 0, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays_delayed": 0, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays_enqueuing": 0, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_created": 543, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_enqueued": 482, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_reintegrated": 61, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_migrated": 0, 2023-12-11T20:37:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_processing": 0, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_enqueued": 0, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_prioritized": 0, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_started": 0, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_completed": 0, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_enqueue_scrub": 33, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_exportdir": 28, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_flush": 0, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_fragmentdir": 0, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_fragstats": 0, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_inodestats": 0 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log": { 2023-12-11T20:37:51.608 INFO:teuthology.orchestra.run.smithi032.stdout: "evlrg": 0, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "evadd": 4208, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "evex": 4179, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "evtrm": 4179, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "ev": 29, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "evexg": 0, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "evexd": 61, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "segadd": 103, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "segex": 102, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "segtrm": 102, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "seg": 1, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "segmjr": 1, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "segexg": 0, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "segexd": 1, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "expos": 13760098, 2023-12-11T20:37:51.609 INFO:teuthology.orchestra.run.smithi032.stdout: "wrpos": 13799604, 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "rdpos": 0, 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "jlat": { 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 1012, 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 13.301855294, 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.013144125 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "replayed": 0 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_mem": { 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "ino": 28, 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "ino+": 861, 2023-12-11T20:37:51.610 INFO:teuthology.orchestra.run.smithi032.stdout: "ino-": 833, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "dir": 23, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "dir+": 163, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "dir-": 140, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "dn": 42, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "dn+": 1112, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "dn-": 1070, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "cap": 2, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "cap+": 796, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "cap-": 794, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "rss": 62028, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "heap": 207228 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_server": { 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "dispatch_client_request": 4086, 2023-12-11T20:37:51.611 INFO:teuthology.orchestra.run.smithi032.stdout: "dispatch_server_request": 41, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_request": 3307, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_session": 47, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_peer_request": 93, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "req_create_latency": { 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 618, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.561421685, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000908449 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getattr_latency": { 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 739, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.202699987, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000274289 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getfilelock_latency": { 2023-12-11T20:37:51.612 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "req_link_latency": { 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 61, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.134608141, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.002206690 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookup_latency": { 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 344, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.505532399, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.001469570 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookuphash_latency": { 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.613 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupino_latency": { 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupname_latency": { 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupparent_latency": { 2023-12-11T20:37:51.614 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupsnap_latency": { 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lssnap_latency": { 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.615 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mkdir_latency": { 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 105, 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.115896982, 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.001103780 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mknod_latency": { 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mksnap_latency": { 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "req_open_latency": { 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 279, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.243807451, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000873861 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "req_readdir_latency": { 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 142, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.685923910, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.004830450 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rename_latency": { 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 95, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 6.369777509, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.067050289 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.617 INFO:teuthology.orchestra.run.smithi032.stdout: "req_renamesnap_latency": { 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "req_snapdiff_latency": { 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmdir_latency": { 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 17, 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.142704545, 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.008394385 2023-12-11T20:37:51.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmsnap_latency": { 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmxattr_latency": { 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setattr_latency": { 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 4, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.003538411, 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000884602 2023-12-11T20:37:51.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setdirlayout_latency": { 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setfilelock_latency": { 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 4, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.001407202, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000351800 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setlayout_latency": { 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.620 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setxattr_latency": { 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 6, 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.019579412, 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.003263235 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "req_symlink_latency": { 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 13, 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.010294447, 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000791880 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "req_unlink_latency": { 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 511, 2023-12-11T20:37:51.621 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.710230234, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.001389883 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "cap_revoke_eviction": 0, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "cap_acquisition_throttle": 0, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getvxattr_latency": { 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sessions": { 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "session_count": 1, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "session_add": 2, 2023-12-11T20:37:51.622 INFO:teuthology.orchestra.run.smithi032.stdout: "session_remove": 1, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "sessions_open": 1, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "sessions_stale": 0, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "total_load": 126, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "average_load": 126, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "avg_session_uptime": 1337, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "mdthresh_evicted": 0 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "mempool": { 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "bloom_filter_items": 0, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:37:51.623 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_items": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blob_items": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:37:51.624 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_txc_items": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_items": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_bytes": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_items": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:37:51.625 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_anon_bytes": 307975, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_anon_items": 118, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_meta_items": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bytes": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_items": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mapbl_items": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pglog_items": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_bytes": 7824, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_items": 165, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "pgmap_bytes": 0, 2023-12-11T20:37:51.626 INFO:teuthology.orchestra.run.smithi032.stdout: "pgmap_items": 0, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_co_bytes": 124434, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_co_items": 821, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_1_bytes": 0, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_1_items": 0, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_2_bytes": 0, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_2_items": 0 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter": { 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "op_active": 0, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "op_laggy": 0, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "op_send": 6759, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "op_send_bytes": 10858460, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "op_resend": 31, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "op_reply": 6759, 2023-12-11T20:37:51.627 INFO:teuthology.orchestra.run.smithi032.stdout: "op_latency": { 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 6759, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 100.589970966, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.014882374 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "op_inflight": 0, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "oplen_avg": { 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 6759, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 9101 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "op": 6759, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "op_r": 2330, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "op_w": 4429, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "op_rmw": 0, 2023-12-11T20:37:51.628 INFO:teuthology.orchestra.run.smithi032.stdout: "op_pg": 0, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_stat": 618, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_create": 409, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_read": 74, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_write": 1053, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_writefull": 327, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_writesame": 0, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_append": 0, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_zero": 0, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_truncate": 0, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_delete": 1742, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_mapext": 0, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_sparse_read": 0, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_clonerange": 0, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_getxattr": 2256, 2023-12-11T20:37:51.629 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_setxattr": 818, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_cmpxattr": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_rmxattr": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_resetxattrs": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_call": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_watch": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_notify": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_src_cmpxattr": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_pgls": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_pgls_filter": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_other": 6, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_active": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_send": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_resend": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_ping": 0, 2023-12-11T20:37:51.630 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_active": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_send": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_resend": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_active": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_send": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_resend": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_active": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_send": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_resend": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "command_active": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "command_send": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "command_resend": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "map_epoch": 89, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "map_full": 0, 2023-12-11T20:37:51.631 INFO:teuthology.orchestra.run.smithi032.stdout: "map_inc": 5, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_sessions": 12, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_session_open": 12, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_session_close": 0, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_laggy": 0, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_wr": 1646, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_rd": 20, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_del": 132 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "oft": { 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_objs": 1, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_kv_pairs": 0, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_updates": 0, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_removes": 0 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.632 INFO:teuthology.orchestra.run.smithi032.stdout: "osd-slow-ops": { 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "slow_ops_count": 0 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "purge_queue": { 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_ops": 0, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_ops_high_water": 25, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing": 0, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_high_water": 10, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executed_ops": 1226, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executed": 482, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_item_in_journal": 0 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 104857600, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:51.633 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 21299, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 5941011, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 21299, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 21299, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 5941011, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-objecter_bytes": { 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:51.634 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 104857600, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 0, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 0, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 0, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 6759, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 10907006, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 6759, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 10907006, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.635 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-objecter_ops": { 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 1024, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 0, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 0, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 0, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 6759, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 6759, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 6759, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 6759, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.636 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-write_buf_throttle": { 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 3758096384, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 482, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 48682, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 482, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 41, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 48682, 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:51.637 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-write_buf_throttle-0x561ea0508640": { 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 3758096384, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 4208, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 9605300, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 4208, 2023-12-11T20:37:51.638 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 1012, 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 9605300, 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:51.639 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-12-11T20:37:52.064 INFO:tasks.check_counter:Daemon mds.b mds.exported=28 2023-12-11T20:37:52.064 INFO:tasks.check_counter:Daemon mds.b mds.imported=5 2023-12-11T20:37:52.065 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=150 2023-12-11T20:37:52.065 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=89 2023-12-11T20:37:52.065 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2023-12-11T20:37:52.065 DEBUG:tasks.check_counter:Getting stats from e 2023-12-11T20:37:52.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.e perf dump 2023-12-11T20:37:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:37:53.260 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:52 smithi032 ceph-mon[132488]: pgmap v1033: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:37:53.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:52 smithi039 ceph-mon[102205]: pgmap v1033: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:37:53.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:52 smithi012 ceph-mon[128787]: pgmap v1033: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:37:54.313 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-12-11T20:37:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:37:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 1705, 2023-12-11T20:37:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 1705, 2023-12-11T20:37:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 2999435, 2023-12-11T20:37:54.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 529523, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 7, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 2, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.195907409, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.080676404, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.046095222, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.046136687, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 1704, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.094308509, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000055345 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.314 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 448 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 1797, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 1768, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 981036, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 662772, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 4, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 3, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.218565214, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.076675644, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.060841993, 2023-12-11T20:37:54.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.060665558, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 1767, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.102166626, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000057819 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 644240, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 237008 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:37:54.316 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 1434, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 1731, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 481472, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 1062696, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 5, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 3, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.216604920, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.076545307, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.053019304, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.059317522, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 1729, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.137139648, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000079317 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.317 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 617344 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "cct": { 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "total_workers": 1, 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "unhealthy_workers": 0 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "finisher-MDSRank": { 2023-12-11T20:37:54.318 INFO:teuthology.orchestra.run.smithi032.stdout: "queue_len": 0, 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "complete_latency": { 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 7406, 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.256981873, 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000034699 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "finisher-PurgeQueue": { 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "queue_len": 0, 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "complete_latency": { 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "request": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "reply": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "reply_latency": { 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "slow_reply": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "forward": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_fetch_complete": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_fetch_keys": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_commit": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_split": 0, 2023-12-11T20:37:54.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_merge": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes": 398, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_top": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_bottom": 398, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_pin_tail": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_pinned": 398, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_expired": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_with_caps": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "subtrees": 1, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_hit": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_forward": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_discover": 0, 2023-12-11T20:37:54.321 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_dir_fetch": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_remote_ino": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_lock": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "load_cent": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "q": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "exported": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "exported_inodes": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "imported": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "imported_inodes": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_dir_fetch": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_backtrace_fetch": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_peer_discover": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rfiles": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rbytes": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rsnaps": 0, 2023-12-11T20:37:54.322 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_backtrace_fetch": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_set_tag": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_backtrace_repaired": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_inotable_repaired": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dir_inodes": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dir_base_inodes": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dirfrag_rstats": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_file_inodes": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_inode_file_caps": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_revoke": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_grant": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_trunc": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_caps": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_caps_dirty": 0, 2023-12-11T20:37:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_cap_release": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "process_request_cap_release": 0 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache": { 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_update": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_update_receipt": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_try_discover": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_send_discover": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_handle_discover": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays_delayed": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays_enqueuing": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_created": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_enqueued": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_reintegrated": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_migrated": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_processing": 0, 2023-12-11T20:37:54.324 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_enqueued": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_prioritized": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_started": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_completed": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_enqueue_scrub": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_exportdir": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_flush": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_fragmentdir": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_fragstats": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_inodestats": 0 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log": { 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "evlrg": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "evadd": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "evex": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "evtrm": 0, 2023-12-11T20:37:54.325 INFO:teuthology.orchestra.run.smithi032.stdout: "ev": 1568, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "evexg": 0, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "evexd": 0, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "segadd": 0, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "segex": 0, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "segtrm": 0, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "seg": 3, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "segmjr": 2, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "segexg": 0, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "segexd": 0, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "expos": 4194304, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "wrpos": 6748734, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "rdpos": 6748135, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "jlat": { 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.326 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "replayed": 1568 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_mem": { 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "ino": 9, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "ino+": 345, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "ino-": 336, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "dir": 7, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "dir+": 96, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "dir-": 89, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "dn": 398, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "dn+": 749, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "dn-": 351, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "cap": 0, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "cap+": 0, 2023-12-11T20:37:54.327 INFO:teuthology.orchestra.run.smithi032.stdout: "cap-": 0, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "rss": 51164, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "heap": 207228 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_server": { 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "dispatch_client_request": 0, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "dispatch_server_request": 0, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_request": 0, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_session": 0, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_peer_request": 0, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "req_create_latency": { 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getattr_latency": { 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getfilelock_latency": { 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "req_link_latency": { 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.329 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookup_latency": { 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookuphash_latency": { 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupino_latency": { 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.330 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupname_latency": { 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupparent_latency": { 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupsnap_latency": { 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lssnap_latency": { 2023-12-11T20:37:54.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mkdir_latency": { 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mknod_latency": { 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.332 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mksnap_latency": { 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "req_open_latency": { 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "req_readdir_latency": { 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rename_latency": { 2023-12-11T20:37:54.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.335 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "req_renamesnap_latency": { 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "req_snapdiff_latency": { 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmdir_latency": { 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.336 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmsnap_latency": { 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmxattr_latency": { 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setattr_latency": { 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.337 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setdirlayout_latency": { 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setfilelock_latency": { 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setlayout_latency": { 2023-12-11T20:37:54.338 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setxattr_latency": { 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "req_symlink_latency": { 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "req_unlink_latency": { 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.339 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "cap_revoke_eviction": 0, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "cap_acquisition_throttle": 0, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getvxattr_latency": { 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sessions": { 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "session_count": 1, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "session_add": 2, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "session_remove": 1, 2023-12-11T20:37:54.340 INFO:teuthology.orchestra.run.smithi032.stdout: "sessions_open": 1, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "sessions_stale": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "total_load": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "average_load": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "avg_session_uptime": 3120, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "mdthresh_evicted": 0 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "mempool": { 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bloom_filter_items": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:37:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_items": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blob_items": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:37:54.342 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_txc_items": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_items": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_bytes": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_items": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_anon_bytes": 190935, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_anon_items": 53, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:37:54.343 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_meta_items": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bytes": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_items": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mapbl_items": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pglog_items": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_bytes": 7824, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_items": 165, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pgmap_bytes": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pgmap_items": 0, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_co_bytes": 309520, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_co_items": 2032, 2023-12-11T20:37:54.344 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_1_bytes": 0, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_1_items": 0, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_2_bytes": 0, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_2_items": 0 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter": { 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "op_active": 0, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "op_laggy": 0, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "op_send": 4502, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "op_send_bytes": 21, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "op_resend": 3, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "op_reply": 4502, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "op_latency": { 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 4502, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 4.299912243, 2023-12-11T20:37:54.345 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000955111 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "op_inflight": 0, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "oplen_avg": { 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 4502, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 4503 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "op": 4502, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "op_r": 4502, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "op_w": 0, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "op_rmw": 0, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "op_pg": 0, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_stat": 2799, 2023-12-11T20:37:54.346 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_create": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_read": 1701, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_write": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_writefull": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_writesame": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_append": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_zero": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_truncate": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_delete": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_mapext": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_sparse_read": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_clonerange": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_getxattr": 1, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_setxattr": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_cmpxattr": 0, 2023-12-11T20:37:54.347 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_rmxattr": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_resetxattrs": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_call": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_watch": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_notify": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_src_cmpxattr": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_pgls": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_pgls_filter": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_other": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_active": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_send": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_resend": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_ping": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_active": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_send": 0, 2023-12-11T20:37:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_resend": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_active": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_send": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_resend": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_active": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_send": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_resend": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "command_active": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "command_send": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "command_resend": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "map_epoch": 89, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "map_full": 0, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "map_inc": 4, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_sessions": 5, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_session_open": 6, 2023-12-11T20:37:54.349 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_session_close": 1, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_laggy": 0, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_wr": 0, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_rd": 2, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_del": 0 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "oft": { 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_objs": 0, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_kv_pairs": 0, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_updates": 0, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_removes": 0 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "osd-slow-ops": { 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: "slow_ops_count": 0 2023-12-11T20:37:54.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "purge_queue": { 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_ops": 0, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_ops_high_water": 0, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing": 0, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_high_water": 0, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executed_ops": 0, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executed": 0, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_item_in_journal": 0 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 104857600, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 4932, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 3993207, 2023-12-11T20:37:54.351 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 4932, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 4932, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 3993207, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-objecter_bytes": { 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 104857600, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 0, 2023-12-11T20:37:54.352 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 0, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 0, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 4502, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 2554435, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 4502, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 2554435, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-objecter_ops": { 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 1024, 2023-12-11T20:37:54.353 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 0, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 0, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 0, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 4502, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 4502, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 4502, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 4502, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-write_buf_throttle": { 2023-12-11T20:37:54.354 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 3758096384, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-write_buf_throttle-0x555ab2250a00": { 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 3758096384, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:54.356 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:54.357 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-12-11T20:37:54.945 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-12-11T20:37:54.945 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-12-11T20:37:54.945 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-12-11T20:37:54.945 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-12-11T20:37:54.945 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2023-12-11T20:37:54.945 DEBUG:tasks.check_counter:Getting stats from h 2023-12-11T20:37:54.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.h perf dump 2023-12-11T20:37:55.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:54 smithi032 ceph-mon[132488]: pgmap v1034: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:37:55.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:55 smithi039 ceph-mon[102205]: pgmap v1034: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:37:55.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:54 smithi012 ceph-mon[128787]: pgmap v1034: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:37:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:37:57.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:57 smithi039 ceph-mon[102205]: pgmap v1035: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 5390, 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 4975, 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 1823993, 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 4702466, 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 69, 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 3, 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.692674854, 2023-12-11T20:37:57.310 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.327121795, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.294287293, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.069725196, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 4975, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.424795203, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000085385 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 6236, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.001579840, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000253 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.311 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 4220, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 5505, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 2042540, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 2608651, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 12, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 7, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.501634114, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.195310849, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.254423783, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.058560647, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 5502, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.600995376, 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000109232 2023-12-11T20:37:57.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 4692, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.001317026, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000280 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 660016, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 273408 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 3060, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 3483, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 1549744, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 1790561, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 17, 2023-12-11T20:37:57.313 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 6, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.347386644, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.146614754, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.146075494, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.050002525, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 3482, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.325177979, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000093388 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 2751, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000685362, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000249 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.314 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 4208, 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 623216 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "cct": { 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "total_workers": 1, 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "unhealthy_workers": 0 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "finisher-MDSRank": { 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "queue_len": 0, 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "complete_latency": { 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 3041, 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 1.074346275, 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000353287 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.315 INFO:teuthology.orchestra.run.smithi032.stdout: "finisher-PurgeQueue": { 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "queue_len": 0, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "complete_latency": { 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 2016, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.120035124, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000059541 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": { 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "request": 1428, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "reply": 1376, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "reply_latency": { 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 1376, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 3.519398265, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.002557702 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.316 INFO:teuthology.orchestra.run.smithi032.stdout: "slow_reply": 0, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "forward": 52, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_fetch_complete": 0, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_fetch_keys": 0, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_commit": 11, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_split": 0, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_merge": 0, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes": 27, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_top": 7, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_bottom": 6, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_pin_tail": 14, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_pinned": 17, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_expired": 22, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "inodes_with_caps": 0, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": 0, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "subtrees": 4, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse": 2435, 2023-12-11T20:37:57.317 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_hit": 2261, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_forward": 51, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_discover": 84, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_dir_fetch": 0, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_remote_ino": 0, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "traverse_lock": 0, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "load_cent": 0, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "q": 0, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "exported": 4, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "exported_inodes": 1, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "imported": 11, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "imported_inodes": 406, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_dir_fetch": 0, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_backtrace_fetch": 2863, 2023-12-11T20:37:57.318 INFO:teuthology.orchestra.run.smithi032.stdout: "openino_peer_discover": 0, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rfiles": 324, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rbytes": 13424350689, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "root_rsnaps": 0, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_backtrace_fetch": 2863, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_set_tag": 0, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_backtrace_repaired": 0, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_inotable_repaired": 0, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dir_inodes": 734, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dir_base_inodes": 0, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_dirfrag_rstats": 734, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "scrub_file_inodes": 2129, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_inode_file_caps": 8, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_revoke": 179, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_grant": 668, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_trunc": 0, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-11T20:37:57.319 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_caps": 572, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_caps_dirty": 378, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_cap_release": 7, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "process_request_cap_release": 660 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache": { 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_update": 31, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_update_receipt": 291, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_try_discover": 186, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_send_discover": 220, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "dir_handle_discover": 68, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays": 4, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays_delayed": 0, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "num_strays_enqueuing": 0, 2023-12-11T20:37:57.320 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_created": 330, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_enqueued": 326, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_reintegrated": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "strays_migrated": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_processing": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_enqueued": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "num_recovering_prioritized": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_started": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_completed": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_enqueue_scrub": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_exportdir": 4, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_flush": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_fragmentdir": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_fragstats": 0, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "ireq_inodestats": 0 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.321 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log": { 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "evlrg": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "evadd": 1568, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "evex": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "evtrm": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "ev": 1568, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "evexg": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "evexd": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "segadd": 3, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "segex": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "segtrm": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "seg": 3, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "segmjr": 2, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "segexg": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "segexd": 0, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "expos": 4194304, 2023-12-11T20:37:57.322 INFO:teuthology.orchestra.run.smithi032.stdout: "wrpos": 6748734, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "rdpos": 0, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "jlat": { 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 538, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 3.691310468, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.006861171 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "replayed": 0 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_mem": { 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ino": 28, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ino+": 365, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "ino-": 337, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "dir": 26, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "dir+": 145, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "dir-": 119, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "dn": 27, 2023-12-11T20:37:57.323 INFO:teuthology.orchestra.run.smithi032.stdout: "dn+": 777, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "dn-": 750, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "cap": 0, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "cap+": 332, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "cap-": 332, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "rss": 57664, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "heap": 199036 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_server": { 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "dispatch_client_request": 1832, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "dispatch_server_request": 11, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_request": 1428, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_client_session": 20, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "handle_peer_request": 49, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "req_create_latency": { 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 1, 2023-12-11T20:37:57.324 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.008851909, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.008851909 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getattr_latency": { 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 451, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.174429033, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000386760 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getfilelock_latency": { 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "req_link_latency": { 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.325 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookup_latency": { 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 330, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.228725459, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000693107 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookuphash_latency": { 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupino_latency": { 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupname_latency": { 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupparent_latency": { 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lookupsnap_latency": { 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "req_lssnap_latency": { 2023-12-11T20:37:57.327 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mkdir_latency": { 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mknod_latency": { 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "req_mksnap_latency": { 2023-12-11T20:37:57.328 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "req_open_latency": { 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 246, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.179418272, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000729342 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "req_readdir_latency": { 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 18, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.012659343, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000703296 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rename_latency": { 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.329 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "req_renamesnap_latency": { 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "req_snapdiff_latency": { 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmdir_latency": { 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 80, 2023-12-11T20:37:57.330 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 2.498585014, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.031232312 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmsnap_latency": { 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "req_rmxattr_latency": { 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setattr_latency": { 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.331 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setdirlayout_latency": { 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setfilelock_latency": { 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setlayout_latency": { 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.332 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "req_setxattr_latency": { 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "req_symlink_latency": { 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "req_unlink_latency": { 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 250, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.416729235, 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.001666916 2023-12-11T20:37:57.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "cap_revoke_eviction": 0, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "cap_acquisition_throttle": 0, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "req_getvxattr_latency": { 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sessions": { 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "session_count": 1, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "session_add": 2, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "session_remove": 1, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "sessions_open": 1, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "sessions_stale": 0, 2023-12-11T20:37:57.334 INFO:teuthology.orchestra.run.smithi032.stdout: "total_load": 1029, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "average_load": 1029, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "avg_session_uptime": 1339, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "mdthresh_evicted": 0 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "mempool": { 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bloom_filter_items": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:37:57.335 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_items": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blob_items": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_txc_items": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:37:57.336 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_items": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_bytes": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_items": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_anon_bytes": 286263, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_anon_items": 113, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_meta_items": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bytes": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_items": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mapbl_items": 0, 2023-12-11T20:37:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pglog_items": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_bytes": 7824, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_items": 165, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "pgmap_bytes": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "pgmap_items": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_co_bytes": 115501, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_co_items": 951, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_1_bytes": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_1_items": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_2_bytes": 0, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_2_items": 0 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.338 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter": { 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "op_active": 0, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "op_laggy": 0, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "op_send": 5286, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "op_send_bytes": 2651598, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "op_resend": 27, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "op_reply": 5286, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "op_latency": { 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 5286, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 91.550160561, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.017319364 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "op_inflight": 0, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "oplen_avg": { 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 5286, 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 5438 2023-12-11T20:37:57.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "op": 5286, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "op_r": 2870, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "op_w": 2416, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "op_rmw": 0, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "op_pg": 0, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_stat": 0, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_create": 10, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_read": 7, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_write": 545, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_writefull": 46, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_writesame": 0, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_append": 0, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_zero": 0, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_truncate": 0, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_delete": 1730, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_mapext": 0, 2023-12-11T20:37:57.340 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_sparse_read": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_clonerange": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_getxattr": 2863, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_setxattr": 20, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_cmpxattr": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_rmxattr": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_resetxattrs": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_call": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_watch": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_notify": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_src_cmpxattr": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_pgls": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_pgls_filter": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "osdop_other": 0, 2023-12-11T20:37:57.341 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_active": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_send": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_resend": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "linger_ping": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_active": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_send": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "poolop_resend": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_active": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_send": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "poolstat_resend": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_active": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_send": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "statfs_resend": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "command_active": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "command_send": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "command_resend": 0, 2023-12-11T20:37:57.342 INFO:teuthology.orchestra.run.smithi032.stdout: "map_epoch": 89, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "map_full": 0, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "map_inc": 4, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_sessions": 12, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_session_open": 12, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_session_close": 0, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_laggy": 0, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_wr": 152, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_rd": 0, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_del": 65 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "oft": { 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_objs": 1, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_kv_pairs": 0, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_updates": 0, 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: "omap_total_removes": 0 2023-12-11T20:37:57.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "osd-slow-ops": { 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "slow_ops_count": 0 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "purge_queue": { 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_ops": 0, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_ops_high_water": 34, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing": 0, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executing_high_water": 10, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executed_ops": 1718, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_executed": 326, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "pq_item_in_journal": 0 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 104857600, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:57.344 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 12666, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 4247645, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 12666, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 12666, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 4247645, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-objecter_bytes": { 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:57.345 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 104857600, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 0, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 0, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 0, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 5286, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 2684524, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 5286, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 2684524, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-objecter_ops": { 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 1024, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 0, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 0, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 0, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 5286, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 5286, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 5286, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 5286, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.347 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-write_buf_throttle": { 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 3758096384, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 326, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 32926, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 326, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 7, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 32926, 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:57.348 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-write_buf_throttle-0x56197628e640": { 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 3758096384, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 1568, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 2554430, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 1568, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:37:57.349 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 538, 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 2554430, 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:37:57.350 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-12-11T20:37:57.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:57 smithi012 ceph-mon[128787]: pgmap v1035: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:57.351 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:57 smithi032 ceph-mon[132488]: pgmap v1035: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:37:57.828 INFO:tasks.check_counter:Daemon mds.h mds.exported=4 2023-12-11T20:37:57.828 INFO:tasks.check_counter:Daemon mds.h mds.imported=11 2023-12-11T20:37:57.829 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=31 2023-12-11T20:37:57.829 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=291 2023-12-11T20:37:57.829 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2023-12-11T20:37:57.829 DEBUG:tasks.check_counter:Getting stats from k 2023-12-11T20:37:57.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.k perf dump 2023-12-11T20:37:58.615 INFO:teuthology.orchestra.run.smithi032.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.b/config 2023-12-11T20:37:59.213 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:37:59 smithi032 ceph-mon[132488]: pgmap v1036: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:37:59.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:37:59 smithi039 ceph-mon[102205]: pgmap v1036: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:37:59.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:37:59 smithi012 ceph-mon[128787]: pgmap v1036: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 0, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 2, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 0, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 0, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 4, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 0, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.003596646, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.000000000, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.000944859, 2023-12-11T20:38:00.154 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 2, 2023-12-11T20:38:00.155 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 302, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 320, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 145120, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 4, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 2, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.022774357, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.015999767, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.001895015, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 300, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.022901123, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000076337 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:00.156 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 145120 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_messages": 402, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages": 397, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_bytes": 527152, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_bytes": 238720, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_created_connections": 2, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_active_connections": 1, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_total_time": 0.074203464, 2023-12-11T20:38:00.157 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_send_time": 0.031956451, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_recv_time": 0.027096816, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_running_fast_dispatch_time": 0.010023830, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 397, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.027634647, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000069608 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_recv_encrypted_bytes": 527152, 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: "msgr_send_encrypted_bytes": 238720 2023-12-11T20:38:00.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "cct": { 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "total_workers": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "unhealthy_workers": 0 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "mempool": { 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bloom_filter_items": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:38:00.159 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_items": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blob_items": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:38:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_txc_items": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_writing_items": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_bytes": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_items": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_anon_bytes": 148721, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_anon_items": 30, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "buffer_meta_items": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bytes": 0, 2023-12-11T20:38:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_items": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mapbl_items": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pglog_items": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_bytes": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_items": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "pgmap_bytes": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "pgmap_items": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_co_bytes": 928, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_co_items": 2, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_1_bytes": 0, 2023-12-11T20:38:00.162 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_1_items": 0, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_2_bytes": 0, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "unittest_2_items": 0 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "val": 0, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "max": 104857600, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "get_started": 0, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "get": 400, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "get_sum": 467902, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "get_or_fail_success": 400, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "take": 0, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "take_sum": 0, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "put": 400, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "put_sum": 467902, 2023-12-11T20:38:00.163 INFO:teuthology.orchestra.run.smithi032.stdout: "wait": { 2023-12-11T20:38:00.164 INFO:teuthology.orchestra.run.smithi032.stdout: "avgcount": 0, 2023-12-11T20:38:00.164 INFO:teuthology.orchestra.run.smithi032.stdout: "sum": 0.000000000, 2023-12-11T20:38:00.164 INFO:teuthology.orchestra.run.smithi032.stdout: "avgtime": 0.000000000 2023-12-11T20:38:00.164 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:38:00.164 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-12-11T20:38:00.164 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-12-11T20:38:00.710 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-12-11T20:38:00.710 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-12-11T20:38:00.710 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2023-12-11T20:38:00.710 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2023-12-11T20:38:00.710 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2023-12-11T20:38:00.710 DEBUG:tasks.check_counter:Getting stats from c 2023-12-11T20:38:00.711 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.c perf dump 2023-12-11T20:38:01.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:01 smithi039 ceph-mon[102205]: pgmap v1037: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:01.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:01 smithi012 ceph-mon[128787]: pgmap v1037: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:01.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:01 smithi032 ceph-mon[132488]: pgmap v1037: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:01.525 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:38:03.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:03 smithi039 ceph-mon[102205]: pgmap v1038: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:38:03.063 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-12-11T20:38:03.063 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:38:03.063 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1670, 2023-12-11T20:38:03.063 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1672, 2023-12-11T20:38:03.063 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 4738603, 2023-12-11T20:38:03.063 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 519380, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 6, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.232530320, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.070176785, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.065149830, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.067927922, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1670, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.125225216, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000074985 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.064 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 2216, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2187, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 2307056, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 793304, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.274185010, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.107733952, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.072494220, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.073051944, 2023-12-11T20:38:03.065 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2186, 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.134075409, 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000061333 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 644672, 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 237792 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:38:03.066 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1270, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1565, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 4523175, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 1014065, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.168924932, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.075620420, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.038896359, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.034529139, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1564, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.086764067, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000055475 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.067 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 3280, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 620960 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 7812, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.286242729, 2023-12-11T20:38:03.068 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000036641 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 0, 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 0, 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.069 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 0, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 0, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 560, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 370, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 190, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2023-12-11T20:38:03.070 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 31, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 2, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2023-12-11T20:38:03.071 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 4, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 246, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2023-12-11T20:38:03.072 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 0 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2023-12-11T20:38:03.073 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2023-12-11T20:38:03.074 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 4208, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2023-12-11T20:38:03.075 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 2, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 99, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 13760098, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 13799604, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 13795840, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 4208 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 18, 2023-12-11T20:38:03.076 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 800, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 782, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 14, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 121, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 107, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 560, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 1058, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 498, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 0, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 0, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 51768, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 207228 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 0, 2023-12-11T20:38:03.077 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 0, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 0, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.078 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.079 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2023-12-11T20:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2023-12-11T20:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.082 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.083 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.084 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.085 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.086 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 2, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 1, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 1, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2023-12-11T20:38:03.088 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 3072, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:38:03.089 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:38:03.090 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 190167, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 52, 2023-12-11T20:38:03.091 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 7824, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 165, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 451381, 2023-12-11T20:38:03.092 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2447, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 4720, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 26, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 4, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 4720, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 4720, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 3.793919644, 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000803796 2023-12-11T20:38:03.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 4720, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 4721 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 4720, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 4720, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 0, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 2864, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 0, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 1853, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 0, 2023-12-11T20:38:03.094 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 2, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2023-12-11T20:38:03.095 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2023-12-11T20:38:03.096 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 89, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 4, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 5, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 6, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 1, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 0, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 2, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 0 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 0, 2023-12-11T20:38:03.097 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2023-12-11T20:38:03.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 5152, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 11080200, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 5152, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 5152, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 11080200, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 4720, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 9605310, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 4720, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 9605310, 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:03.100 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 4720, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 4720, 2023-12-11T20:38:03.101 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 4720, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 4720, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:03.102 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x55782ac60a00": { 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:03.103 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:03.104 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-12-11T20:38:03.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:03 smithi012 ceph-mon[128787]: pgmap v1038: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:38:03.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:03 smithi032 ceph-mon[132488]: pgmap v1038: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:38:03.515 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-12-11T20:38:03.515 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-12-11T20:38:03.515 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-12-11T20:38:03.515 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-12-11T20:38:03.515 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2023-12-11T20:38:03.515 DEBUG:tasks.check_counter:Getting stats from f 2023-12-11T20:38:03.515 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.f perf dump 2023-12-11T20:38:04.303 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:38:05.266 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:05 smithi039 ceph-mon[102205]: pgmap v1039: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:38:05.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:05 smithi012 ceph-mon[128787]: pgmap v1039: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:38:05.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:05 smithi032 ceph-mon[132488]: pgmap v1039: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:38:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-12-11T20:38:05.921 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 5174, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 5174, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 6474556, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 1608325, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 6, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.539296269, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.181857130, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.140433623, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.167489497, 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:05.922 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 5173, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.251066716, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000048534 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 448 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 4, 2023-12-11T20:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 302, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 876, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 621372, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.021913562, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.015285956, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.002166469, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000084823, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 300, 2023-12-11T20:38:05.924 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.025010239, 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000083367 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 620688 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 431, 2023-12-11T20:38:05.925 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 402, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 645052, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 238567, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.080954130, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.033651874, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.033181818, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.010375261, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 401, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.033403509, 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000083300 2023-12-11T20:38:05.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 644784, 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 238256 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.927 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 8925, 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.283499658, 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000031764 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.928 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 0, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 0, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 0, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2023-12-11T20:38:05.929 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 61, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 61, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 61, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 1, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 0, 2023-12-11T20:38:05.930 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 0, 2023-12-11T20:38:05.931 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-11T20:38:05.932 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 0 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2023-12-11T20:38:05.933 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.934 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 2504, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 5, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 2, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2023-12-11T20:38:05.935 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 4194304, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 9240217, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 9239618, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 2504 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 5, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 366, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 361, 2023-12-11T20:38:05.936 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 3, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 103, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 100, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 61, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 443, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 382, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 0, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 0, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 51320, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 207228 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 0, 2023-12-11T20:38:05.937 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 0, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 0, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2023-12-11T20:38:05.938 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2023-12-11T20:38:05.939 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2023-12-11T20:38:05.940 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.941 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.942 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.943 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2023-12-11T20:38:05.944 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2023-12-11T20:38:05.946 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2023-12-11T20:38:05.947 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 2, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 1, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 1, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 0, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 0, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 3074, 2023-12-11T20:38:05.949 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:38:05.950 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:38:05.951 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:38:05.952 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 182087, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 48, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 7824, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 165, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:38:05.953 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 58184, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 284, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2023-12-11T20:38:05.954 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 5173, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 21, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 3, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 5173, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 5173, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 3.850918456, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000744426 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 5173, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 5174 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.955 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 5173, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 5173, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 2823, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 2348, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2023-12-11T20:38:05.956 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 1, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2023-12-11T20:38:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2023-12-11T20:38:05.958 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 89, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 4, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 4, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 5, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 1, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 0, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 2, 2023-12-11T20:38:05.959 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 0 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 0, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2023-12-11T20:38:05.960 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 5605, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 6591074, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 5605, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 5605, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 6591074, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.961 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 5173, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 5045918, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 5173, 2023-12-11T20:38:05.962 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 5045918, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 5173, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 5173, 2023-12-11T20:38:05.963 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 5173, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 5173, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:05.964 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x55ead18e4a00": { 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:05.965 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-12-11T20:38:06.395 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-12-11T20:38:06.395 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-12-11T20:38:06.395 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-12-11T20:38:06.395 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-12-11T20:38:06.395 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-12-11T20:38:06.396 DEBUG:tasks.check_counter:Getting stats from i 2023-12-11T20:38:06.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.i perf dump 2023-12-11T20:38:07.185 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:38:07.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:07 smithi039 ceph-mon[102205]: pgmap v1040: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:07.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:07 smithi012 ceph-mon[128787]: pgmap v1040: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:07.462 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:07 smithi032 ceph-mon[132488]: pgmap v1040: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:08.663 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-12-11T20:38:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:38:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 7629, 2023-12-11T20:38:08.663 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 7101, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 2604098, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 8105271, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 76, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.797177936, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.307326305, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.352558852, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.124893148, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 7101, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.404119450, 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000056910 2023-12-11T20:38:08.664 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 6585, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.001691435, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000256 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 5449, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 7871, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 1963084, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 3547533, 2023-12-11T20:38:08.665 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 12, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 7, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.699275884, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.299317301, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.358709834, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.064425920, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 7868, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.400557359, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000050909 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 7021, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.002614357, 2023-12-11T20:38:08.666 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000372 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 4704, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 573664 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 4128, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 3976, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 2162771, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 1813617, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 9, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 6, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.432289261, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.176137437, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.184083851, 2023-12-11T20:38:08.667 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.069222882, 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3975, 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.267675565, 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000067339 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2842, 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000705138, 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000248 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 664304, 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 289776 2023-12-11T20:38:08.668 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 6866, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.922720068, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000280034 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1116, 2023-12-11T20:38:08.669 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.048764956, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000043696 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 1084, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 931, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 931, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.325962524, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001424234 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 153, 2023-12-11T20:38:08.670 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 20, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 1, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 17, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 2, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 5, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 10, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 13, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 388, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 3, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 3, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 4, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 1850, 2023-12-11T20:38:08.671 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 1369, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 142, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 92, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 1000, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 1, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 12, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 323, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 28, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 223, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 5673, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 324, 2023-12-11T20:38:08.672 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 13424350689, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 5673, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 1613, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 1613, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 4060, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 41, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 1563, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 1728, 2023-12-11T20:38:08.673 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 1571, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 8, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 301 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 49, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 264, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 176, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 181, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 66, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 59, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 59, 2023-12-11T20:38:08.674 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 12, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 1, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2023-12-11T20:38:08.675 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 2504, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 2504, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 5, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 5, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 2, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 4194304, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 9240217, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 0, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1583, 2023-12-11T20:38:08.676 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 5.499253220, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.003473943 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 0 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 22, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 401, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 379, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 21, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 141, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 120, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 17, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 504, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 487, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 3, 2023-12-11T20:38:08.677 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 350, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 347, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 56320, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 199036 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 1241, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 27, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 1084, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 30, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 101, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 144, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.207749708, 2023-12-11T20:38:08.678 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001442706 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 14, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.003978340, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000284167 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.679 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 366, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.316327535, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000864282 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.680 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.681 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.682 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 321, 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.655105729, 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.002040827 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 27, 2023-12-11T20:38:08.683 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.014490260, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000536676 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 18, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.060101455, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.003338969 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.684 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.015335222, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.007667611 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.685 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.687 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 39, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.052874275, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.001355750 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.688 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 2, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 1, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 1, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 184, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 184, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 1352, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2023-12-11T20:38:08.689 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2023-12-11T20:38:08.690 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:38:08.691 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 291621, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 110, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 7824, 2023-12-11T20:38:08.692 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 165, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 88933, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 389, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2023-12-11T20:38:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 8657, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 5267098, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 27, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 8657, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 8657, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 81.594314604, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.009425241 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 8657, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 9073 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 8657, 2023-12-11T20:38:08.694 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 5684, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 2973, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 10, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 11, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 1594, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 94, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 1, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 1016, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2023-12-11T20:38:08.695 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 5673, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 20, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2023-12-11T20:38:08.696 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 89, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2023-12-11T20:38:08.697 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 4, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 12, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 12, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 0, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 462, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 0, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 192 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 1, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.698 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 26, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 6, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 1003, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 59, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2023-12-11T20:38:08.699 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 17202, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 5152837, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 17202, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 17202, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 5152837, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2023-12-11T20:38:08.700 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 8657, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 5273065, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 8657, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 5273065, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.701 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 8657, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 8657, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 8657, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 8657, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.702 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 59, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 5967, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 59, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 11, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 5967, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.703 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x55fa55b40640": { 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 2504, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 5045913, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 2504, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 1583, 2023-12-11T20:38:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 5045913, 2023-12-11T20:38:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.705 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:08.705 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-12-11T20:38:09.179 INFO:tasks.check_counter:Daemon mds.i mds.exported=12 2023-12-11T20:38:09.179 INFO:tasks.check_counter:Daemon mds.i mds.imported=28 2023-12-11T20:38:09.179 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=49 2023-12-11T20:38:09.179 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=264 2023-12-11T20:38:09.180 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=1 2023-12-11T20:38:09.180 DEBUG:tasks.check_counter:Getting stats from l 2023-12-11T20:38:09.180 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid 732461f0-9860-11ee-95a3-87774f69a715 -- ceph daemon mds.l perf dump 2023-12-11T20:38:09.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:09 smithi039 ceph-mon[102205]: pgmap v1041: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:38:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:38:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:09 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:09 smithi012 ceph-mon[128787]: pgmap v1041: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:38:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:38:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:09 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:09 smithi032 ceph-mon[132488]: pgmap v1041: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-12-11T20:38:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-11T20:38:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:09 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:09.971 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/mon.c/config 2023-12-11T20:38:10.300 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:38:10.300 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:38:10.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:10 smithi039 ceph-mon[102205]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:38:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:38:10.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:10 smithi012 ceph-mon[128787]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:10.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-11T20:38:10.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-11T20:38:10.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:10 smithi032 ceph-mon[132488]: from='mgr.14148 172.21.15.12:0/2848235421' entity='mgr.x' 2023-12-11T20:38:11.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:11 smithi039 ceph-mon[102205]: pgmap v1042: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:11.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:11 smithi012 ceph-mon[128787]: pgmap v1042: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:11.401 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-12-11T20:38:11.401 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2023-12-11T20:38:11.401 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.003083843, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000587432, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:11.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 406, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 401, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 528240, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 241216, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.077477864, 2023-12-11T20:38:11.403 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.034151825, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.027483070, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.010535644, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 401, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.030800953, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000076810 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.404 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 528240, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 241216 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 2, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 305, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 320, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 145648, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.022633861, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.015857367, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001593922, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-11T20:38:11.405 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 303, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.022938235, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000075703 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 145648 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2023-12-11T20:38:11.406 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2023-12-11T20:38:11.407 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2023-12-11T20:38:11.408 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148744, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 30, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2023-12-11T20:38:11.409 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2023-12-11T20:38:11.410 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 404, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 468422, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 404, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2023-12-11T20:38:11.411 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 404, 2023-12-11T20:38:11.412 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 468422, 2023-12-11T20:38:11.412 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2023-12-11T20:38:11.412 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2023-12-11T20:38:11.412 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2023-12-11T20:38:11.412 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2023-12-11T20:38:11.412 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:11.412 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-12-11T20:38:11.412 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-12-11T20:38:11.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:11 smithi032 ceph-mon[132488]: pgmap v1042: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:11.970 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-12-11T20:38:11.970 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-12-11T20:38:11.970 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2023-12-11T20:38:11.970 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2023-12-11T20:38:11.970 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2023-12-11T20:38:11.970 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-11T20:38:11.983 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-11T20:38:11.984 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:38:11.984 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T20:38:12.052 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:38:12.052 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T20:38:12.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.352+0000 7f9559dff700 1 -- 172.21.15.12:0/3087078427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554103030 msgr2=0x7f95541098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.352+0000 7f9559dff700 1 --2- 172.21.15.12:0/3087078427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554103030 0x7f95541098e0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f954c00b0d0 tx=0x7f954c00b3e0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.353+0000 7f9559dff700 1 -- 172.21.15.12:0/3087078427 shutdown_connections 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.353+0000 7f9559dff700 1 --2- 172.21.15.12:0/3087078427 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95541014a0 0x7f95541018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.353+0000 7f9559dff700 1 --2- 172.21.15.12:0/3087078427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554103030 0x7f95541098e0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.353+0000 7f9559dff700 1 --2- 172.21.15.12:0/3087078427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9554102690 0x7f9554102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.353+0000 7f9559dff700 1 -- 172.21.15.12:0/3087078427 >> 172.21.15.12:0/3087078427 conn(0x7f95540fca10 msgr2=0x7f95540fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.353+0000 7f9559dff700 1 -- 172.21.15.12:0/3087078427 shutdown_connections 2023-12-11T20:38:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.353+0000 7f9559dff700 1 -- 172.21.15.12:0/3087078427 wait complete. 2023-12-11T20:38:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.354+0000 7f9559dff700 1 Processor -- start 2023-12-11T20:38:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.354+0000 7f9559dff700 1 -- start start 2023-12-11T20:38:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9559dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95541014a0 0x7f9554197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9559dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554102690 0x7f9554197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9559dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9554103030 0x7f955419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9559dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955419ef30 con 0x7f9554102690 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9559dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955419f070 con 0x7f9554103030 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9559dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955419f200 con 0x7f95541014a0 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9552ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554102690 0x7f9554197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9552ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554102690 0x7f9554197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36386/0 (socket says 172.21.15.12:36386) 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9552ffd700 1 -- 172.21.15.12:0/3498665757 learned_addr learned my addr 172.21.15.12:0/3498665757 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f95537fe700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95541014a0 0x7f9554197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9553fff700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9554103030 0x7f955419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9552ffd700 1 -- 172.21.15.12:0/3498665757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95541014a0 msgr2=0x7f9554197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9552ffd700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95541014a0 0x7f9554197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9552ffd700 1 -- 172.21.15.12:0/3498665757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9554103030 msgr2=0x7f955419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.355+0000 7f9552ffd700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9554103030 0x7f955419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.356+0000 7f9552ffd700 1 -- 172.21.15.12:0/3498665757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c009d00 con 0x7f9554102690 2023-12-11T20:38:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.356+0000 7f9552ffd700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554102690 0x7f9554197940 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f954800e9a0 tx=0x7f954800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.356+0000 7f9550ff9700 1 -- 172.21.15.12:0/3498665757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548009790 con 0x7f9554102690 2023-12-11T20:38:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.356+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955419f4e0 con 0x7f9554102690 2023-12-11T20:38:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.356+0000 7f9550ff9700 1 -- 172.21.15.12:0/3498665757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f954800cbd0 con 0x7f9554102690 2023-12-11T20:38:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.356+0000 7f9550ff9700 1 -- 172.21.15.12:0/3498665757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548018680 con 0x7f9554102690 2023-12-11T20:38:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.356+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955419f9f0 con 0x7f9554102690 2023-12-11T20:38:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.357+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95541088f0 con 0x7f9554102690 2023-12-11T20:38:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.359+0000 7f9550ff9700 1 -- 172.21.15.12:0/3498665757 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f954800cd40 con 0x7f9554102690 2023-12-11T20:38:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.362+0000 7f9550ff9700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f953c0a1480 0x7f953c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.362+0000 7f9550ff9700 1 -- 172.21.15.12:0/3498665757 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9548014070 con 0x7f9554102690 2023-12-11T20:38:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.362+0000 7f95537fe700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f953c0a1480 0x7f953c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.362+0000 7f95537fe700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f953c0a1480 0x7f953c0a3940 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f95541024f0 tx=0x7f9544007400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:12.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.366+0000 7f9550ff9700 1 -- 172.21.15.12:0/3498665757 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f95480522f0 con 0x7f9554102690 2023-12-11T20:38:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.581+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f955410cb70 con 0x7f9554102690 2023-12-11T20:38:12.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.583+0000 7f9550ff9700 1 -- 172.21.15.12:0/3498665757 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7f95480d0030 con 0x7f9554102690 2023-12-11T20:38:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:38:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:38:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f953c0a1480 msgr2=0x7f953c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f953c0a1480 0x7f953c0a3940 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f95541024f0 tx=0x7f9544007400 comp rx=0 tx=0).stop 2023-12-11T20:38:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554102690 msgr2=0x7f9554197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554102690 0x7f9554197940 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f954800e9a0 tx=0x7f954800ecb0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 shutdown_connections 2023-12-11T20:38:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f953c0a1480 0x7f953c0a3940 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9554103030 0x7f955419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95541014a0 0x7f9554197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 --2- 172.21.15.12:0/3498665757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9554102690 0x7f9554197940 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 >> 172.21.15.12:0/3498665757 conn(0x7f95540fca10 msgr2=0x7f9554105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 shutdown_connections 2023-12-11T20:38:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.586+0000 7f9559dff700 1 -- 172.21.15.12:0/3498665757 wait complete. 2023-12-11T20:38:12.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:38:12.604 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:38:12.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 -- 172.21.15.12:0/2233273202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0074030 msgr2=0x7f16c00744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2233273202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0074030 0x7f16c00744b0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009990 tx=0x7f16b0009ca0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 -- 172.21.15.12:0/2233273202 shutdown_connections 2023-12-11T20:38:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2233273202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c0109370 0x7f16c010b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2233273202 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16c0075610 0x7f16c0073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2233273202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0074030 0x7f16c00744b0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 -- 172.21.15.12:0/2233273202 >> 172.21.15.12:0/2233273202 conn(0x7f16c00fca00 msgr2=0x7f16c00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 -- 172.21.15.12:0/2233273202 shutdown_connections 2023-12-11T20:38:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.811+0000 7f16c7fff700 1 -- 172.21.15.12:0/2233273202 wait complete. 2023-12-11T20:38:12.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.812+0000 7f16c7fff700 1 Processor -- start 2023-12-11T20:38:12.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.812+0000 7f16c7fff700 1 -- start start 2023-12-11T20:38:12.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16c0074030 0x7f16c01995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:12.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0075610 0x7f16c0199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c0109370 0x7f16c01a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01a1120 con 0x7f16c0075610 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c7fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01a1260 con 0x7f16c0109370 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c7fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01a13f0 con 0x7f16c0074030 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0075610 0x7f16c0199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0075610 0x7f16c0199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36404/0 (socket says 172.21.15.12:36404) 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c559a700 1 -- 172.21.15.12:0/2270977421 learned_addr learned my addr 172.21.15.12:0/2270977421 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c5d9b700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16c0074030 0x7f16c01995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c659c700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c0109370 0x7f16c01a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c559a700 1 -- 172.21.15.12:0/2270977421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16c0074030 msgr2=0x7f16c01995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c559a700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16c0074030 0x7f16c01995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c559a700 1 -- 172.21.15.12:0/2270977421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c0109370 msgr2=0x7f16c01a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c559a700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c0109370 0x7f16c01a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c559a700 1 -- 172.21.15.12:0/2270977421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b00095f0 con 0x7f16c0075610 2023-12-11T20:38:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.813+0000 7f16c659c700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c0109370 0x7f16c01a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:38:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.814+0000 7f16c559a700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0075610 0x7f16c0199b30 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f16b0006010 tx=0x7f16b0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.814+0000 7f16b6ffd700 1 -- 172.21.15.12:0/2270977421 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b001d070 con 0x7f16c0075610 2023-12-11T20:38:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.814+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c01a1670 con 0x7f16c0075610 2023-12-11T20:38:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.814+0000 7f16b6ffd700 1 -- 172.21.15.12:0/2270977421 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16b000be30 con 0x7f16c0075610 2023-12-11T20:38:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.814+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c01a1aa0 con 0x7f16c0075610 2023-12-11T20:38:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.814+0000 7f16b6ffd700 1 -- 172.21.15.12:0/2270977421 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000fe50 con 0x7f16c0075610 2023-12-11T20:38:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.815+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0108130 con 0x7f16c0075610 2023-12-11T20:38:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.817+0000 7f16b6ffd700 1 -- 172.21.15.12:0/2270977421 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f16b000b9a0 con 0x7f16c0075610 2023-12-11T20:38:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.818+0000 7f16b6ffd700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16ac0a1480 0x7f16ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.818+0000 7f16b6ffd700 1 -- 172.21.15.12:0/2270977421 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f16b00cdff0 con 0x7f16c0075610 2023-12-11T20:38:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.819+0000 7f16c5d9b700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16ac0a1480 0x7f16ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.819+0000 7f16c5d9b700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16ac0a1480 0x7f16ac0a3940 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009c60 tx=0x7f16bc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:12.823+0000 7f16b6ffd700 1 -- 172.21.15.12:0/2270977421 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f16b005c2f0 con 0x7f16c0075610 2023-12-11T20:38:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.035+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16c010f020 con 0x7f16c0075610 2023-12-11T20:38:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.036+0000 7f16b6ffd700 1 -- 172.21.15.12:0/2270977421 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16b0097670 con 0x7f16c0075610 2023-12-11T20:38:13.034 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:38:13.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16ac0a1480 msgr2=0x7f16ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16ac0a1480 0x7f16ac0a3940 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009c60 tx=0x7f16bc009260 comp rx=0 tx=0).stop 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0075610 msgr2=0x7f16c0199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0075610 0x7f16c0199b30 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f16b0006010 tx=0x7f16b0005740 comp rx=0 tx=0).stop 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 shutdown_connections 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f16ac0a1480 0x7f16ac0a3940 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c0109370 0x7f16c01a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16c0074030 0x7f16c01995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 --2- 172.21.15.12:0/2270977421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c0075610 0x7f16c0199b30 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.038+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 >> 172.21.15.12:0/2270977421 conn(0x7f16c00fca00 msgr2=0x7f16c0105270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.039+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 shutdown_connections 2023-12-11T20:38:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.039+0000 7f16c7fff700 1 -- 172.21.15.12:0/2270977421 wait complete. 2023-12-11T20:38:13.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:38:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 -- 172.21.15.12:0/3896822046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 msgr2=0x7fad941018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/3896822046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 0x7fad941018d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fad840099c0 tx=0x7fad84009cd0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 -- 172.21.15.12:0/3896822046 shutdown_connections 2023-12-11T20:38:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/3896822046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad94103040 0x7fad941098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/3896822046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 0x7fad941018d0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/3896822046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad941026a0 0x7fad94102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 -- 172.21.15.12:0/3896822046 >> 172.21.15.12:0/3896822046 conn(0x7fad940fca00 msgr2=0x7fad940fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:13.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 -- 172.21.15.12:0/3896822046 shutdown_connections 2023-12-11T20:38:13.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.265+0000 7fad9a7ff700 1 -- 172.21.15.12:0/3896822046 wait complete. 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.266+0000 7fad9a7ff700 1 Processor -- start 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.266+0000 7fad9a7ff700 1 -- start start 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad9a7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 0x7fad941995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad9a7ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad941026a0 0x7fad94199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad9a7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad94103040 0x7fad941a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad9a7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad941a10e0 con 0x7fad941014b0 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad9a7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad941a1220 con 0x7fad94103040 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad9a7ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad941a13b0 con 0x7fad941026a0 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad93fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 0x7fad941995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad93fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 0x7fad941995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36420/0 (socket says 172.21.15.12:36420) 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad93fff700 1 -- 172.21.15.12:0/2728289414 learned_addr learned my addr 172.21.15.12:0/2728289414 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:13.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad98d9c700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad94103040 0x7fad941a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad937fe700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad941026a0 0x7fad94199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad93fff700 1 -- 172.21.15.12:0/2728289414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad941026a0 msgr2=0x7fad94199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad93fff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad941026a0 0x7fad94199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad93fff700 1 -- 172.21.15.12:0/2728289414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad94103040 msgr2=0x7fad941a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad93fff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad94103040 0x7fad941a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.267+0000 7fad93fff700 1 -- 172.21.15.12:0/2728289414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840095f0 con 0x7fad941014b0 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.268+0000 7fad93fff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 0x7fad941995b0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fad84009f50 tx=0x7fad84005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.268+0000 7fad917fa700 1 -- 172.21.15.12:0/2728289414 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8401d070 con 0x7fad941014b0 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.268+0000 7fad917fa700 1 -- 172.21.15.12:0/2728289414 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad8400bda0 con 0x7fad941014b0 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.268+0000 7fad917fa700 1 -- 172.21.15.12:0/2728289414 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84022d30 con 0x7fad941014b0 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.268+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad941a1630 con 0x7fad941014b0 2023-12-11T20:38:13.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.268+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad941a1a00 con 0x7fad941014b0 2023-12-11T20:38:13.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.269+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad94068330 con 0x7fad941014b0 2023-12-11T20:38:13.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.271+0000 7fad917fa700 1 -- 172.21.15.12:0/2728289414 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fad84022500 con 0x7fad941014b0 2023-12-11T20:38:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.272+0000 7fad917fa700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad7c0a1500 0x7fad7c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.272+0000 7fad917fa700 1 -- 172.21.15.12:0/2728289414 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fad840cdff0 con 0x7fad941014b0 2023-12-11T20:38:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.272+0000 7fad937fe700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad7c0a1500 0x7fad7c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.273+0000 7fad937fe700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad7c0a1500 0x7fad7c0a39c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fad88005950 tx=0x7fad8800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:13.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.276+0000 7fad917fa700 1 -- 172.21.15.12:0/2728289414 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fad84097690 con 0x7fad941014b0 2023-12-11T20:38:13.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:13 smithi039 ceph-mon[102205]: pgmap v1043: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:38:13.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:13 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3498665757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:38:13.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:13 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2270977421' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:38:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:13 smithi012 ceph-mon[128787]: pgmap v1043: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:38:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:13 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3498665757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:38:13.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:13 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2270977421' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:38:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:13 smithi032 ceph-mon[132488]: pgmap v1043: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-11T20:38:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:13 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3498665757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:38:13.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:13 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2270977421' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:38:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.490+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad941a1e00 con 0x7fad941014b0 2023-12-11T20:38:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.490+0000 7fad917fa700 1 -- 172.21.15.12:0/2728289414 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad8409acb0 con 0x7fad941014b0 2023-12-11T20:38:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:38:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad7c0a1500 msgr2=0x7fad7c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad7c0a1500 0x7fad7c0a39c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fad88005950 tx=0x7fad8800b410 comp rx=0 tx=0).stop 2023-12-11T20:38:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 msgr2=0x7fad941995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 0x7fad941995b0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fad84009f50 tx=0x7fad84005b00 comp rx=0 tx=0).stop 2023-12-11T20:38:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 shutdown_connections 2023-12-11T20:38:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fad7c0a1500 0x7fad7c0a39c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad94103040 0x7fad941a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad941014b0 0x7fad941995b0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 --2- 172.21.15.12:0/2728289414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad941026a0 0x7fad94199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 >> 172.21.15.12:0/2728289414 conn(0x7fad940fca00 msgr2=0x7fad94107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 shutdown_connections 2023-12-11T20:38:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.493+0000 7fad9a7ff700 1 -- 172.21.15.12:0/2728289414 wait complete. 2023-12-11T20:38:13.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:38:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 -- 172.21.15.12:0/1181939998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d101014b0 msgr2=0x7f7d101018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1181939998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d101014b0 0x7f7d101018d0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f7d000099c0 tx=0x7f7d00009cd0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 -- 172.21.15.12:0/1181939998 shutdown_connections 2023-12-11T20:38:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1181939998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d10103040 0x7f7d101098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1181939998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d101014b0 0x7f7d101018d0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1181939998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d101026a0 0x7f7d10102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 -- 172.21.15.12:0/1181939998 >> 172.21.15.12:0/1181939998 conn(0x7f7d100fca00 msgr2=0x7f7d100fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:13.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 -- 172.21.15.12:0/1181939998 shutdown_connections 2023-12-11T20:38:13.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.719+0000 7f7d15fff700 1 -- 172.21.15.12:0/1181939998 wait complete. 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.720+0000 7f7d15fff700 1 Processor -- start 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.720+0000 7f7d15fff700 1 -- start start 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.720+0000 7f7d15fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d101014b0 0x7f7d10199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.720+0000 7f7d15fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d101026a0 0x7f7d10199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d15fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d10103040 0x7f7d101a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d15fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d101a1100 con 0x7f7d10103040 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d15fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d101a1240 con 0x7f7d101026a0 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d15fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d101a13d0 con 0x7f7d101014b0 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d10103040 0x7f7d101a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d07fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d101026a0 0x7f7d10199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:13.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d10103040 0x7f7d101a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36446/0 (socket says 172.21.15.12:36446) 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0ffff700 1 -- 172.21.15.12:0/1010079669 learned_addr learned my addr 172.21.15.12:0/1010079669 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0f7fe700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d101014b0 0x7f7d10199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0ffff700 1 -- 172.21.15.12:0/1010079669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d101014b0 msgr2=0x7f7d10199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0ffff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d101014b0 0x7f7d10199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0ffff700 1 -- 172.21.15.12:0/1010079669 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d101026a0 msgr2=0x7f7d10199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0ffff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d101026a0 0x7f7d10199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0ffff700 1 -- 172.21.15.12:0/1010079669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000095f0 con 0x7f7d10103040 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.721+0000 7f7d0f7fe700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d101014b0 0x7f7d10199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.722+0000 7f7d0ffff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d10103040 0x7f7d101a0b30 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f7d08007ee0 tx=0x7f7d0800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.722+0000 7f7d0d7fa700 1 -- 172.21.15.12:0/1010079669 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800ddd0 con 0x7f7d10103040 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.722+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d101a16b0 con 0x7f7d10103040 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.722+0000 7f7d0d7fa700 1 -- 172.21.15.12:0/1010079669 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d0800f040 con 0x7f7d10103040 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.722+0000 7f7d0d7fa700 1 -- 172.21.15.12:0/1010079669 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08004790 con 0x7f7d10103040 2023-12-11T20:38:13.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.722+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d101a1bc0 con 0x7f7d10103040 2023-12-11T20:38:13.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.723+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d10193bc0 con 0x7f7d10103040 2023-12-11T20:38:13.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.725+0000 7f7d0d7fa700 1 -- 172.21.15.12:0/1010079669 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f7d08003f20 con 0x7f7d10103040 2023-12-11T20:38:13.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.726+0000 7f7d0d7fa700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7cfc0a1480 0x7f7cfc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:13.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.726+0000 7f7d0d7fa700 1 -- 172.21.15.12:0/1010079669 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7d080cc670 con 0x7f7d10103040 2023-12-11T20:38:13.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.726+0000 7f7d0f7fe700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7cfc0a1480 0x7f7cfc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:13.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.727+0000 7f7d0f7fe700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7cfc0a1480 0x7f7cfc0a3940 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009990 tx=0x7f7d0001a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:13.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.730+0000 7f7d0d7fa700 1 -- 172.21.15.12:0/1010079669 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7d0804f2f0 con 0x7f7d10103040 2023-12-11T20:38:13.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.945+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d1002d3d0 con 0x7f7d10103040 2023-12-11T20:38:13.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.945+0000 7f7d0d7fa700 1 -- 172.21.15.12:0/1010079669 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d08095c20 con 0x7f7d10103040 2023-12-11T20:38:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:38:13.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7cfc0a1480 msgr2=0x7f7cfc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7cfc0a1480 0x7f7cfc0a3940 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009990 tx=0x7f7d0001a040 comp rx=0 tx=0).stop 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d10103040 msgr2=0x7f7d101a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d10103040 0x7f7d101a0b30 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f7d08007ee0 tx=0x7f7d0800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 shutdown_connections 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f7cfc0a1480 0x7f7cfc0a3940 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d10103040 0x7f7d101a0b30 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d101014b0 0x7f7d10199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.947+0000 7f7d15fff700 1 --2- 172.21.15.12:0/1010079669 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7d101026a0 0x7f7d10199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.948+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 >> 172.21.15.12:0/1010079669 conn(0x7f7d100fca00 msgr2=0x7f7d10107fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.948+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 shutdown_connections 2023-12-11T20:38:13.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:13.948+0000 7f7d15fff700 1 -- 172.21.15.12:0/1010079669 wait complete. 2023-12-11T20:38:13.965 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-11T20:38:14.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 -- 172.21.15.12:0/2009533474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec1014b0 msgr2=0x7ff4ec1018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/2009533474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec1014b0 0x7ff4ec1018d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80099c0 tx=0x7ff4e8009cd0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 -- 172.21.15.12:0/2009533474 shutdown_connections 2023-12-11T20:38:14.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/2009533474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4ec103040 0x7ff4ec1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/2009533474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec1014b0 0x7ff4ec1018d0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/2009533474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4ec1026a0 0x7ff4ec102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 -- 172.21.15.12:0/2009533474 >> 172.21.15.12:0/2009533474 conn(0x7ff4ec0fca00 msgr2=0x7ff4ec0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:14.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 -- 172.21.15.12:0/2009533474 shutdown_connections 2023-12-11T20:38:14.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.172+0000 7ff4f45ff700 1 -- 172.21.15.12:0/2009533474 wait complete. 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.173+0000 7ff4f45ff700 1 Processor -- start 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.173+0000 7ff4f45ff700 1 -- start start 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.173+0000 7ff4f45ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4ec1014b0 0x7ff4ec197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.173+0000 7ff4f45ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4ec1026a0 0x7ff4ec1978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f45ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec103040 0x7ff4ec19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f45ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec19eea0 con 0x7ff4ec103040 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f45ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec19efe0 con 0x7ff4ec1014b0 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f45ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec19f170 con 0x7ff4ec1026a0 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec103040 0x7ff4ec19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f239b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4ec1014b0 0x7ff4ec197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec103040 0x7ff4ec19e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36450/0 (socket says 172.21.15.12:36450) 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 -- 172.21.15.12:0/3376410763 learned_addr learned my addr 172.21.15.12:0/3376410763 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:14.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f1b9a700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4ec1026a0 0x7ff4ec1978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 -- 172.21.15.12:0/3376410763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4ec1026a0 msgr2=0x7ff4ec1978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4ec1026a0 0x7ff4ec1978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 -- 172.21.15.12:0/3376410763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4ec1014b0 msgr2=0x7ff4ec197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4ec1014b0 0x7ff4ec197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 -- 172.21.15.12:0/3376410763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80095f0 con 0x7ff4ec103040 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f239b700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4ec1014b0 0x7ff4ec197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.174+0000 7ff4f2b9c700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec103040 0x7ff4ec19e8d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400ef30 tx=0x7ff4e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.175+0000 7ff4e37fe700 1 -- 172.21.15.12:0/3376410763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4018070 con 0x7ff4ec103040 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.175+0000 7ff4e37fe700 1 -- 172.21.15.12:0/3376410763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4e400f040 con 0x7ff4ec103040 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.175+0000 7ff4e37fe700 1 -- 172.21.15.12:0/3376410763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400cbc0 con 0x7ff4ec103040 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.175+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec19f3f0 con 0x7ff4ec103040 2023-12-11T20:38:14.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.175+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec19f8b0 con 0x7ff4ec103040 2023-12-11T20:38:14.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.176+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec108a70 con 0x7ff4ec103040 2023-12-11T20:38:14.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.178+0000 7ff4e37fe700 1 -- 172.21.15.12:0/3376410763 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7ff4e4007500 con 0x7ff4ec103040 2023-12-11T20:38:14.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.179+0000 7ff4e37fe700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4d80a1500 0x7ff4d80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:14.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.179+0000 7ff4e37fe700 1 -- 172.21.15.12:0/3376410763 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff4e40cc7f0 con 0x7ff4ec103040 2023-12-11T20:38:14.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.180+0000 7ff4f239b700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4d80a1500 0x7ff4d80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:14.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.180+0000 7ff4f239b700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4d80a1500 0x7ff4d80a39c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8000c00 tx=0x7ff4e801a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:14.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.183+0000 7ff4e37fe700 1 -- 172.21.15.12:0/3376410763 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff4e4095e30 con 0x7ff4ec103040 2023-12-11T20:38:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:14 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2728289414' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:38:14.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:14 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1010079669' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:38:14.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.412+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff4ec068330 con 0x7ff4ec103040 2023-12-11T20:38:14.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.413+0000 7ff4e37fe700 1 -- 172.21.15.12:0/3376410763 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+592 (secure 0 0 0) 0x7ff4e4099450 con 0x7ff4ec103040 2023-12-11T20:38:14.411 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2124039140 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:14.411 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/3786645349 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:14.411 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/1214012838 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:14.411 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1620764312 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:14.411 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/3786645349 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:14.411 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/1214012838 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:14.412 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1991414308 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:14.412 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/4022688169 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:14.412 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3706548929 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:14.412 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3589244140 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:14.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4d80a1500 msgr2=0x7ff4d80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4d80a1500 0x7ff4d80a39c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8000c00 tx=0x7ff4e801a040 comp rx=0 tx=0).stop 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec103040 msgr2=0x7ff4ec19e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec103040 0x7ff4ec19e8d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400ef30 tx=0x7ff4e400c3a0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 shutdown_connections 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7ff4d80a1500 0x7ff4d80a39c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4ec1014b0 0x7ff4ec197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4ec103040 0x7ff4ec19e8d0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 --2- 172.21.15.12:0/3376410763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4ec1026a0 0x7ff4ec1978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 >> 172.21.15.12:0/3376410763 conn(0x7ff4ec0fca00 msgr2=0x7ff4ec105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 shutdown_connections 2023-12-11T20:38:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.415+0000 7ff4f45ff700 1 -- 172.21.15.12:0/3376410763 wait complete. 2023-12-11T20:38:14.415 INFO:teuthology.orchestra.run.smithi012.stderr:listed 10 entries 2023-12-11T20:38:14.432 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-12-11T20:38:14.433 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T20:38:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:14 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2728289414' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:38:14.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:14 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1010079669' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:38:14.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T20:38:14.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:14 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2728289414' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:38:14.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:14 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1010079669' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:38:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 -- 172.21.15.12:0/1888935487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec109360 msgr2=0x7f71ec10b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 --2- 172.21.15.12:0/1888935487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec109360 0x7f71ec10b7f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009f90 tx=0x7f71e400b330 comp rx=0 tx=0).stop 2023-12-11T20:38:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 -- 172.21.15.12:0/1888935487 shutdown_connections 2023-12-11T20:38:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 --2- 172.21.15.12:0/1888935487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec109360 0x7f71ec10b7f0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 --2- 172.21.15.12:0/1888935487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71ec075610 0x7f71ec073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 --2- 172.21.15.12:0/1888935487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71ec074030 0x7f71ec0744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 -- 172.21.15.12:0/1888935487 >> 172.21.15.12:0/1888935487 conn(0x7f71ec0fca10 msgr2=0x7f71ec0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 -- 172.21.15.12:0/1888935487 shutdown_connections 2023-12-11T20:38:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.723+0000 7f71f27ff700 1 -- 172.21.15.12:0/1888935487 wait complete. 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.724+0000 7f71f27ff700 1 Processor -- start 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.724+0000 7f71f27ff700 1 -- start start 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.724+0000 7f71f27ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec074030 0x7f71ec199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.724+0000 7f71f27ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71ec075610 0x7f71ec199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.724+0000 7f71f27ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71ec109360 0x7f71ec1a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.724+0000 7f71f27ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1a1180 con 0x7f71ec074030 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.724+0000 7f71f27ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1a12c0 con 0x7f71ec075610 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.724+0000 7f71f27ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1a1450 con 0x7f71ec109360 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec074030 0x7f71ec199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec074030 0x7f71ec199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36464/0 (socket says 172.21.15.12:36464) 2023-12-11T20:38:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 -- 172.21.15.12:0/3436100901 learned_addr learned my addr 172.21.15.12:0/3436100901 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71f0d9c700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71ec109360 0x7f71ec1a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71eb7fe700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71ec075610 0x7f71ec199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 -- 172.21.15.12:0/3436100901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71ec109360 msgr2=0x7f71ec1a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71ec109360 0x7f71ec1a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 -- 172.21.15.12:0/3436100901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71ec075610 msgr2=0x7f71ec199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71ec075610 0x7f71ec199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 -- 172.21.15.12:0/3436100901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009c40 con 0x7f71ec074030 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71eb7fe700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71ec075610 0x7f71ec199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.725+0000 7f71ebfff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec074030 0x7f71ec199650 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00e9c0 tx=0x7f71dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.726+0000 7f71e97fa700 1 -- 172.21.15.12:0/3436100901 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00cbd0 con 0x7f71ec074030 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.726+0000 7f71e97fa700 1 -- 172.21.15.12:0/3436100901 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71dc00eeb0 con 0x7f71ec074030 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.726+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec1a1730 con 0x7f71ec074030 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.726+0000 7f71e97fa700 1 -- 172.21.15.12:0/3436100901 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc005410 con 0x7f71ec074030 2023-12-11T20:38:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.726+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec1a1c90 con 0x7f71ec074030 2023-12-11T20:38:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.727+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec108120 con 0x7f71ec074030 2023-12-11T20:38:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.729+0000 7f71e97fa700 1 -- 172.21.15.12:0/3436100901 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f71dc0055b0 con 0x7f71ec074030 2023-12-11T20:38:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.730+0000 7f71e97fa700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f71d40a1500 0x7f71d40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.730+0000 7f71e97fa700 1 -- 172.21.15.12:0/3436100901 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f71dc014070 con 0x7f71ec074030 2023-12-11T20:38:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.730+0000 7f71eb7fe700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f71d40a1500 0x7f71d40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.731+0000 7f71eb7fe700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f71d40a1500 0x7f71d40a39c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f71ec075330 tx=0x7f71e0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:14.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.734+0000 7f71e97fa700 1 -- 172.21.15.12:0/3436100901 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f71dc096540 con 0x7f71ec074030 2023-12-11T20:38:14.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.948+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71ec068330 con 0x7f71ec074030 2023-12-11T20:38:14.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.949+0000 7f71e97fa700 1 -- 172.21.15.12:0/3436100901 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22641 (secure 0 0 0) 0x7f71dc099b60 con 0x7f71ec074030 2023-12-11T20:38:14.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-12-11T20:38:14.948 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"732461f0-9860-11ee-95a3-87774f69a715","created":"2023-12-11T20:05:01.329428+0000","modified":"2023-12-11T20:15:05.279887+0000","last_up_change":"2023-12-11T20:12:53.263481+0000","last_in_change":"2023-12-11T20:12:32.778748+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T20:08:47.557892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T20:13:51.190224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T20:13:52.445613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff2be1ef-1062-4420-9daa-1bc0c4ba2d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6803","nonce":3118387286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6805","nonce":3118387286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6809","nonce":3118387286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3118387286},{"type":"v1","addr":"172.21.15.12:6807","nonce":3118387286}]},"public_addr":"172.21.15.12:6803/3118387286","cluster_addr":"172.21.15.12:6805/3118387286","heartbeat_back_addr":"172.21.15.12:6809/3118387286","heartbeat_front_addr":"172.21.15.12:6807/3118387286","state":["exists","up"]},{"osd":1,"uuid":"ced82c4f-0fb8-4d33-a889-952c83e51c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6801","nonce":1010988585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6803","nonce":1010988585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6807","nonce":1010988585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1010988585},{"type":"v1","addr":"172.21.15.32:6805","nonce":1010988585}]},"public_addr":"172.21.15.32:6801/1010988585","cluster_addr":"172.21.15.32:6803/1010988585","heartbeat_back_addr":"172.21.15.32:6807/1010988585","heartbeat_front_addr":"172.21.15.32:6805/1010988585","state":["exists","up"]},{"osd":2,"uuid":"447b88d3-b083-4d3e-aa61-1c9971321335","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6801","nonce":2638974966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6803","nonce":2638974966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6807","nonce":2638974966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2638974966},{"type":"v1","addr":"172.21.15.39:6805","nonce":2638974966}]},"public_addr":"172.21.15.39:6801/2638974966","cluster_addr":"172.21.15.39:6803/2638974966","heartbeat_back_addr":"172.21.15.39:6807/2638974966","heartbeat_front_addr":"172.21.15.39:6805/2638974966","state":["exists","up"]},{"osd":3,"uuid":"f9e8e074-7466-40c2-8850-fa247fe45dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6811","nonce":2780370696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6813","nonce":2780370696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6817","nonce":2780370696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2780370696},{"type":"v1","addr":"172.21.15.12:6815","nonce":2780370696}]},"public_addr":"172.21.15.12:6811/2780370696","cluster_addr":"172.21.15.12:6813/2780370696","heartbeat_back_addr":"172.21.15.12:6817/2780370696","heartbeat_front_addr":"172.21.15.12:6815/2780370696","state":["exists","up"]},{"osd":4,"uuid":"ee6f15ff-052e-4621-9d90-4d2e6790b314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6809","nonce":773206736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6811","nonce":773206736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6815","nonce":773206736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":773206736},{"type":"v1","addr":"172.21.15.32:6813","nonce":773206736}]},"public_addr":"172.21.15.32:6809/773206736","cluster_addr":"172.21.15.32:6811/773206736","heartbeat_back_addr":"172.21.15.32:6815/773206736","heartbeat_front_addr":"172.21.15.32:6813/773206736","state":["exists","up"]},{"osd":5,"uuid":"8a466cf2-6909-4fc8-8439-6b033c5e942f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6809","nonce":1408420882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6811","nonce":1408420882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6815","nonce":1408420882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1408420882},{"type":"v1","addr":"172.21.15.39:6813","nonce":1408420882}]},"public_addr":"172.21.15.39:6809/1408420882","cluster_addr":"172.21.15.39:6811/1408420882","heartbeat_back_addr":"172.21.15.39:6815/1408420882","heartbeat_front_addr":"172.21.15.39:6813/1408420882","state":["exists","up"]},{"osd":6,"uuid":"c12c5683-1166-46dc-8ae9-1acc04f75ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6819","nonce":1028787749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6821","nonce":1028787749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6825","nonce":1028787749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":1028787749},{"type":"v1","addr":"172.21.15.12:6823","nonce":1028787749}]},"public_addr":"172.21.15.12:6819/1028787749","cluster_addr":"172.21.15.12:6821/1028787749","heartbeat_back_addr":"172.21.15.12:6825/1028787749","heartbeat_front_addr":"172.21.15.12:6823/1028787749","state":["exists","up"]},{"osd":7,"uuid":"f81d15a2-358b-4de6-af22-fdb5476b625e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6817","nonce":1475605108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6819","nonce":1475605108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6823","nonce":1475605108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1475605108},{"type":"v1","addr":"172.21.15.32:6821","nonce":1475605108}]},"public_addr":"172.21.15.32:6817/1475605108","cluster_addr":"172.21.15.32:6819/1475605108","heartbeat_back_addr":"172.21.15.32:6823/1475605108","heartbeat_front_addr":"172.21.15.32:6821/1475605108","state":["exists","up"]},{"osd":8,"uuid":"2ac0416b-ec57-468d-8340-9732d86f108d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6817","nonce":2259242252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6819","nonce":2259242252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6823","nonce":2259242252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2259242252},{"type":"v1","addr":"172.21.15.39:6821","nonce":2259242252}]},"public_addr":"172.21.15.39:6817/2259242252","cluster_addr":"172.21.15.39:6819/2259242252","heartbeat_back_addr":"172.21.15.39:6823/2259242252","heartbeat_front_addr":"172.21.15.39:6821/2259242252","state":["exists","up"]},{"osd":9,"uuid":"a1e53870-78e8-499e-8244-1415187611a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6827","nonce":3572865206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6829","nonce":3572865206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6833","nonce":3572865206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3572865206},{"type":"v1","addr":"172.21.15.12:6831","nonce":3572865206}]},"public_addr":"172.21.15.12:6827/3572865206","cluster_addr":"172.21.15.12:6829/3572865206","heartbeat_back_addr":"172.21.15.12:6833/3572865206","heartbeat_front_addr":"172.21.15.12:6831/3572865206","state":["exists","up"]},{"osd":10,"uuid":"23a020ac-a8b6-4da5-91ce-9d9490d4594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6825","nonce":2249244334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6827","nonce":2249244334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6831","nonce":2249244334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2249244334},{"type":"v1","addr":"172.21.15.32:6829","nonce":2249244334}]},"public_addr":"172.21.15.32:6825/2249244334","cluster_addr":"172.21.15.32:6827/2249244334","heartbeat_back_addr":"172.21.15.32:6831/2249244334","heartbeat_front_addr":"172.21.15.32:6829/2249244334","state":["exists","up"]},{"osd":11,"uuid":"0f0f6457-4ef9-495a-b399-8fdaf347f3c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6825","nonce":1041735400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6827","nonce":1041735400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6831","nonce":1041735400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1041735400},{"type":"v1","addr":"172.21.15.39:6829","nonce":1041735400}]},"public_addr":"172.21.15.39:6825/1041735400","cluster_addr":"172.21.15.39:6827/1041735400","heartbeat_back_addr":"172.21.15.39:6831/1041735400","heartbeat_front_addr":"172.21.15.39:6829/1041735400","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:07:48.584798+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:16.303221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:08:43.297565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:12.396143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:09:39.776984+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:07.196950+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:10:34.938428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:02.451564+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:29.647544+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:11:57.419305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:24.829655+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T20:12:51.539889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2124039140":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6800/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1620764312":"2023-12-12T20:05:33.970421+0000","172.21.15.12:6801/3786645349":"2023-12-12T20:06:02.927546+0000","172.21.15.12:6801/1214012838":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/1991414308":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/4022688169":"2023-12-12T20:06:02.927546+0000","172.21.15.12:0/3706548929":"2023-12-12T20:05:33.970421+0000","172.21.15.12:0/3589244140":"2023-12-12T20:05:33.970421+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T20:38:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f71d40a1500 msgr2=0x7f71d40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f71d40a1500 0x7f71d40a39c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f71ec075330 tx=0x7f71e0009260 comp rx=0 tx=0).stop 2023-12-11T20:38:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec074030 msgr2=0x7f71ec199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec074030 0x7f71ec199650 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00e9c0 tx=0x7f71dc00ecd0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 shutdown_connections 2023-12-11T20:38:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f71d40a1500 0x7f71d40a39c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71ec109360 0x7f71ec1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71ec074030 0x7f71ec199650 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 --2- 172.21.15.12:0/3436100901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71ec075610 0x7f71ec199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 >> 172.21.15.12:0/3436100901 conn(0x7f71ec0fca10 msgr2=0x7f71ec105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 shutdown_connections 2023-12-11T20:38:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:14.952+0000 7f71f27ff700 1 -- 172.21.15.12:0/3436100901 wait complete. 2023-12-11T20:38:14.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T20:08:47.557892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T20:13:51.190224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T20:13:52.445613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T20:38:14.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T20:38:15.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 -- 172.21.15.12:0/1711781422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc01014b0 msgr2=0x7fcbc01018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/1711781422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc01014b0 0x7fcbc01018d0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00099c0 tx=0x7fcbb0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 -- 172.21.15.12:0/1711781422 shutdown_connections 2023-12-11T20:38:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/1711781422 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbc0103040 0x7fcbc01098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/1711781422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc01014b0 0x7fcbc01018d0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/1711781422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcbc01026a0 0x7fcbc0102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 -- 172.21.15.12:0/1711781422 >> 172.21.15.12:0/1711781422 conn(0x7fcbc00fca00 msgr2=0x7fcbc00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 -- 172.21.15.12:0/1711781422 shutdown_connections 2023-12-11T20:38:15.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.179+0000 7fcbc51ff700 1 -- 172.21.15.12:0/1711781422 wait complete. 2023-12-11T20:38:15.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.180+0000 7fcbc51ff700 1 Processor -- start 2023-12-11T20:38:15.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.180+0000 7fcbc51ff700 1 -- start start 2023-12-11T20:38:15.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbc51ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcbc01014b0 0x7fcbc01973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:15.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbc51ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbc01026a0 0x7fcbc0197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbc51ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc0103040 0x7fcbc019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbc51ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc019ef00 con 0x7fcbc0103040 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbc51ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc019f040 con 0x7fcbc01026a0 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbc51ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc019f1d0 con 0x7fcbc01014b0 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc0103040 0x7fcbc019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc0103040 0x7fcbc019e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36478/0 (socket says 172.21.15.12:36478) 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbf59e700 1 -- 172.21.15.12:0/2452806050 learned_addr learned my addr 172.21.15.12:0/2452806050 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbe59c700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbc01026a0 0x7fcbc0197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbed9d700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcbc01014b0 0x7fcbc01973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbf59e700 1 -- 172.21.15.12:0/2452806050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcbc01014b0 msgr2=0x7fcbc01973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbf59e700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcbc01014b0 0x7fcbc01973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbf59e700 1 -- 172.21.15.12:0/2452806050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbc01026a0 msgr2=0x7fcbc0197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbf59e700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbc01026a0 0x7fcbc0197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.181+0000 7fcbbf59e700 1 -- 172.21.15.12:0/2452806050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00095f0 con 0x7fcbc0103040 2023-12-11T20:38:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.182+0000 7fcbbf59e700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc0103040 0x7fcbc019e930 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8007ee0 tx=0x7fcbb800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.182+0000 7fcba7fff700 1 -- 172.21.15.12:0/2452806050 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8017070 con 0x7fcbc0103040 2023-12-11T20:38:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.182+0000 7fcba7fff700 1 -- 172.21.15.12:0/2452806050 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbb800f040 con 0x7fcbc0103040 2023-12-11T20:38:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.182+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc019f4b0 con 0x7fcbc0103040 2023-12-11T20:38:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.182+0000 7fcba7fff700 1 -- 172.21.15.12:0/2452806050 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8005570 con 0x7fcbc0103040 2023-12-11T20:38:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.182+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc019f9c0 con 0x7fcbc0103040 2023-12-11T20:38:15.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.183+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc0108a70 con 0x7fcbc0103040 2023-12-11T20:38:15.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.185+0000 7fcba7fff700 1 -- 172.21.15.12:0/2452806050 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7fcbb800db20 con 0x7fcbc0103040 2023-12-11T20:38:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.186+0000 7fcba7fff700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcba80a1500 0x7fcba80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.187+0000 7fcba7fff700 1 -- 172.21.15.12:0/2452806050 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcbb80cc4e0 con 0x7fcbc0103040 2023-12-11T20:38:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.187+0000 7fcbbed9d700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcba80a1500 0x7fcba80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:15.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.187+0000 7fcbbed9d700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcba80a1500 0x7fcba80a39c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0006010 tx=0x7fcbb0003740 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:15.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.190+0000 7fcba7fff700 1 -- 172.21.15.12:0/2452806050 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcbb8095a90 con 0x7fcbc0103040 2023-12-11T20:38:15.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:15 smithi039 ceph-mon[102205]: pgmap v1044: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:38:15.301 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:15 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3376410763' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-11T20:38:15.302 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:15 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/3436100901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:38:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:15 smithi012 ceph-mon[128787]: pgmap v1044: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:38:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:15 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3376410763' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-11T20:38:15.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:15 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/3436100901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:38:15.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.404+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbc002d310 con 0x7fcbc0103040 2023-12-11T20:38:15.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.404+0000 7fcba7fff700 1 -- 172.21.15.12:0/2452806050 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbb80990b0 con 0x7fcbc0103040 2023-12-11T20:38:15.402 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-12-11T20:38:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcba80a1500 msgr2=0x7fcba80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcba80a1500 0x7fcba80a39c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0006010 tx=0x7fcbb0003740 comp rx=0 tx=0).stop 2023-12-11T20:38:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc0103040 msgr2=0x7fcbc019e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc0103040 0x7fcbc019e930 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8007ee0 tx=0x7fcbb800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 shutdown_connections 2023-12-11T20:38:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7fcba80a1500 0x7fcba80a39c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbc0103040 0x7fcbc019e930 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcbc01014b0 0x7fcbc01973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 --2- 172.21.15.12:0/2452806050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbc01026a0 0x7fcbc0197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 >> 172.21.15.12:0/2452806050 conn(0x7fcbc00fca00 msgr2=0x7fcbc0105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:15.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 shutdown_connections 2023-12-11T20:38:15.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.407+0000 7fcbc51ff700 1 -- 172.21.15.12:0/2452806050 wait complete. 2023-12-11T20:38:15.424 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T20:38:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:15 smithi032 ceph-mon[132488]: pgmap v1044: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-12-11T20:38:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:15 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3376410763' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-11T20:38:15.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:15 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/3436100901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-11T20:38:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.632+0000 7faed07ff700 1 -- 172.21.15.12:0/4165252320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec8103040 msgr2=0x7faec81098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.632+0000 7faed07ff700 1 --2- 172.21.15.12:0/4165252320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec8103040 0x7faec81098f0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7faec000b0d0 tx=0x7faec000b3e0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.632+0000 7faed07ff700 1 -- 172.21.15.12:0/4165252320 shutdown_connections 2023-12-11T20:38:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.632+0000 7faed07ff700 1 --2- 172.21.15.12:0/4165252320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec8103040 0x7faec81098f0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.632+0000 7faed07ff700 1 --2- 172.21.15.12:0/4165252320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faec81014b0 0x7faec81018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.632+0000 7faed07ff700 1 --2- 172.21.15.12:0/4165252320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faec81026a0 0x7faec8102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.632+0000 7faed07ff700 1 -- 172.21.15.12:0/4165252320 >> 172.21.15.12:0/4165252320 conn(0x7faec80fca00 msgr2=0x7faec80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.632+0000 7faed07ff700 1 -- 172.21.15.12:0/4165252320 shutdown_connections 2023-12-11T20:38:15.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.633+0000 7faed07ff700 1 -- 172.21.15.12:0/4165252320 wait complete. 2023-12-11T20:38:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.633+0000 7faed07ff700 1 Processor -- start 2023-12-11T20:38:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faed07ff700 1 -- start start 2023-12-11T20:38:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faed07ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faec81014b0 0x7faec8199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faed07ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec81026a0 0x7faec8199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faed07ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faec8103040 0x7faec81a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faed07ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec81a1170 con 0x7faec81026a0 2023-12-11T20:38:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faed07ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec81a12b0 con 0x7faec8103040 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faed07ff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec81a1440 con 0x7faec81014b0 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faecdd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec81026a0 0x7faec8199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faece59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faec81014b0 0x7faec8199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faece59b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faec81014b0 0x7faec8199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.12:49486/0 (socket says 172.21.15.12:49486) 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faece59b700 1 -- 172.21.15.12:0/2598338783 learned_addr learned my addr 172.21.15.12:0/2598338783 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.634+0000 7faeced9c700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faec8103040 0x7faec81a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faecdd9a700 1 -- 172.21.15.12:0/2598338783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faec81014b0 msgr2=0x7faec8199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faecdd9a700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faec81014b0 0x7faec8199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faecdd9a700 1 -- 172.21.15.12:0/2598338783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faec8103040 msgr2=0x7faec81a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faecdd9a700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faec8103040 0x7faec81a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faecdd9a700 1 -- 172.21.15.12:0/2598338783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0009d00 con 0x7faec81026a0 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faecdd9a700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec81026a0 0x7faec8199bd0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7faeb800d740 tx=0x7faeb800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faebf7fe700 1 -- 172.21.15.12:0/2598338783 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8004220 con 0x7faec81026a0 2023-12-11T20:38:15.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faebf7fe700 1 -- 172.21.15.12:0/2598338783 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeb8004cc0 con 0x7faec81026a0 2023-12-11T20:38:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec81a1720 con 0x7faec81026a0 2023-12-11T20:38:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faebf7fe700 1 -- 172.21.15.12:0/2598338783 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb80055c0 con 0x7faec81026a0 2023-12-11T20:38:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.635+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec81a1c30 con 0x7faec81026a0 2023-12-11T20:38:15.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.636+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec8068330 con 0x7faec81026a0 2023-12-11T20:38:15.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.638+0000 7faebf7fe700 1 -- 172.21.15.12:0/2598338783 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7faeb8004750 con 0x7faec81026a0 2023-12-11T20:38:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.640+0000 7faebf7fe700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faeb40a1500 0x7faeb40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.640+0000 7faebf7fe700 1 -- 172.21.15.12:0/2598338783 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faeb80ccb50 con 0x7faec81026a0 2023-12-11T20:38:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.640+0000 7faece59b700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faeb40a1500 0x7faeb40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.641+0000 7faece59b700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faeb40a1500 0x7faeb40a39c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faec4005950 tx=0x7faec4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:15.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.644+0000 7faebf7fe700 1 -- 172.21.15.12:0/2598338783 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faeb8096100 con 0x7faec81026a0 2023-12-11T20:38:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.857+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faec810cb30 con 0x7faec81026a0 2023-12-11T20:38:15.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.857+0000 7faebf7fe700 1 -- 172.21.15.12:0/2598338783 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7faeb80160a0 con 0x7faec81026a0 2023-12-11T20:38:15.858 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faeb40a1500 msgr2=0x7faeb40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faeb40a1500 0x7faeb40a39c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faec4005950 tx=0x7faec4009260 comp rx=0 tx=0).stop 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec81026a0 msgr2=0x7faec8199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec81026a0 0x7faec8199bd0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7faeb800d740 tx=0x7faeb800da50 comp rx=0 tx=0).stop 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 shutdown_connections 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7faeb40a1500 0x7faeb40a39c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faec8103040 0x7faec81a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faec81014b0 0x7faec8199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 --2- 172.21.15.12:0/2598338783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faec81026a0 0x7faec8199bd0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 >> 172.21.15.12:0/2598338783 conn(0x7faec80fca00 msgr2=0x7faec8107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 shutdown_connections 2023-12-11T20:38:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:15.860+0000 7faed07ff700 1 -- 172.21.15.12:0/2598338783 wait complete. 2023-12-11T20:38:15.877 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T20:38:16.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 -- 172.21.15.12:0/1397402050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f01026a0 msgr2=0x7f28f0102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1397402050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f01026a0 0x7f28f0102b00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f28e00099c0 tx=0x7f28e0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 -- 172.21.15.12:0/1397402050 shutdown_connections 2023-12-11T20:38:16.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1397402050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28f01014b0 0x7f28f01018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1397402050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28f0103040 0x7f28f01098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1397402050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f01026a0 0x7f28f0102b00 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 -- 172.21.15.12:0/1397402050 >> 172.21.15.12:0/1397402050 conn(0x7f28f00fca00 msgr2=0x7f28f00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:16.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 -- 172.21.15.12:0/1397402050 shutdown_connections 2023-12-11T20:38:16.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.087+0000 7f28f7dff700 1 -- 172.21.15.12:0/1397402050 wait complete. 2023-12-11T20:38:16.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.088+0000 7f28f7dff700 1 Processor -- start 2023-12-11T20:38:16.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f7dff700 1 -- start start 2023-12-11T20:38:16.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f7dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28f01014b0 0x7f28f0197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:16.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f7dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28f01026a0 0x7f28f0197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:16.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f7dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f0103040 0x7f28f019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:16.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f7dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f019ef40 con 0x7f28f0103040 2023-12-11T20:38:16.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f7dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f019f080 con 0x7f28f01014b0 2023-12-11T20:38:16.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f7dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f019f210 con 0x7f28f01026a0 2023-12-11T20:38:16.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f5b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28f01014b0 0x7f28f0197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:16.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f0103040 0x7f28f019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:16.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f5b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28f01014b0 0x7f28f0197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.12:52638/0 (socket says 172.21.15.12:52638) 2023-12-11T20:38:16.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f0103040 0x7f28f019e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36504/0 (socket says 172.21.15.12:36504) 2023-12-11T20:38:16.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f5b9b700 1 -- 172.21.15.12:0/1872954392 learned_addr learned my addr 172.21.15.12:0/1872954392 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:16.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.089+0000 7f28f539a700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28f01026a0 0x7f28f0197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:16.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28f639c700 1 -- 172.21.15.12:0/1872954392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28f01026a0 msgr2=0x7f28f0197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28f639c700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28f01026a0 0x7f28f0197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28f639c700 1 -- 172.21.15.12:0/1872954392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28f01014b0 msgr2=0x7f28f0197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28f639c700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28f01014b0 0x7f28f0197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28f639c700 1 -- 172.21.15.12:0/1872954392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e00095f0 con 0x7f28f0103040 2023-12-11T20:38:16.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28f639c700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f0103040 0x7f28f019e970 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f28e8007f10 tx=0x7f28e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:16.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28e6ffd700 1 -- 172.21.15.12:0/1872954392 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8004db0 con 0x7f28f0103040 2023-12-11T20:38:16.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28e6ffd700 1 -- 172.21.15.12:0/1872954392 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28e800f040 con 0x7f28f0103040 2023-12-11T20:38:16.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f019f4f0 con 0x7f28f0103040 2023-12-11T20:38:16.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.090+0000 7f28e6ffd700 1 -- 172.21.15.12:0/1872954392 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8005960 con 0x7f28f0103040 2023-12-11T20:38:16.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.091+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f019fa00 con 0x7f28f0103040 2023-12-11T20:38:16.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.092+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f01089d0 con 0x7f28f0103040 2023-12-11T20:38:16.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.094+0000 7f28e6ffd700 1 -- 172.21.15.12:0/1872954392 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f28e800db20 con 0x7f28f0103040 2023-12-11T20:38:16.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.095+0000 7f28e6ffd700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f28dc0a1500 0x7f28dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:16.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.095+0000 7f28e6ffd700 1 -- 172.21.15.12:0/1872954392 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f28e80ccde0 con 0x7f28f0103040 2023-12-11T20:38:16.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.095+0000 7f28f5b9b700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f28dc0a1500 0x7f28dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:16.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.096+0000 7f28f5b9b700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f28dc0a1500 0x7f28dc0a39c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009aa0 tx=0x7f28ec009240 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:16.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.097+0000 7f28e6ffd700 1 -- 172.21.15.12:0/1872954392 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f28e8096390 con 0x7f28f0103040 2023-12-11T20:38:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.309+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28f010cc60 con 0x7f28f0103040 2023-12-11T20:38:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.310+0000 7f28e6ffd700 1 -- 172.21.15.12:0/1872954392 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28e8023020 con 0x7f28f0103040 2023-12-11T20:38:16.308 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-12-11T20:38:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f28dc0a1500 msgr2=0x7f28dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f28dc0a1500 0x7f28dc0a39c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009aa0 tx=0x7f28ec009240 comp rx=0 tx=0).stop 2023-12-11T20:38:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f0103040 msgr2=0x7f28f019e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f0103040 0x7f28f019e970 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f28e8007f10 tx=0x7f28e800d3b0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 shutdown_connections 2023-12-11T20:38:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f28dc0a1500 0x7f28dc0a39c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28f01014b0 0x7f28f0197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f0103040 0x7f28f019e970 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 --2- 172.21.15.12:0/1872954392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28f01026a0 0x7f28f0197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 >> 172.21.15.12:0/1872954392 conn(0x7f28f00fca00 msgr2=0x7f28f0105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 shutdown_connections 2023-12-11T20:38:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.312+0000 7f28f7dff700 1 -- 172.21.15.12:0/1872954392 wait complete. 2023-12-11T20:38:16.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:16 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2452806050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:38:16.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:16 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/2598338783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:38:16.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-11T20:38:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:16 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2452806050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:38:16.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:16 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/2598338783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:38:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 -- 172.21.15.12:0/2690063746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 msgr2=0x7f6ebc102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/2690063746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 0x7f6ebc102b00 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00099c0 tx=0x7f6eb0009cd0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 -- 172.21.15.12:0/2690063746 shutdown_connections 2023-12-11T20:38:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/2690063746 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ebc103040 0x7f6ebc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/2690063746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ebc1014b0 0x7f6ebc1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/2690063746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 0x7f6ebc102b00 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 -- 172.21.15.12:0/2690063746 >> 172.21.15.12:0/2690063746 conn(0x7f6ebc0fca00 msgr2=0x7f6ebc0fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:16.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 -- 172.21.15.12:0/2690063746 shutdown_connections 2023-12-11T20:38:16.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.539+0000 7f6ec1dff700 1 -- 172.21.15.12:0/2690063746 wait complete. 2023-12-11T20:38:16.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.540+0000 7f6ec1dff700 1 Processor -- start 2023-12-11T20:38:16.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ec1dff700 1 -- start start 2023-12-11T20:38:16.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ec1dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ebc1014b0 0x7f6ebc1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ec1dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 0x7f6ebc199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ec1dff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ebc103040 0x7f6ebc1a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ec1dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc1a10e0 con 0x7f6ebc1026a0 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ec1dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc1a1220 con 0x7f6ebc1014b0 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ec1dff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc1a13b0 con 0x7f6ebc103040 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ebaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 0x7f6ebc199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ebaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 0x7f6ebc199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36520/0 (socket says 172.21.15.12:36520) 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.541+0000 7f6ebaffd700 1 -- 172.21.15.12:0/450648335 learned_addr learned my addr 172.21.15.12:0/450648335 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ebb7fe700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ebc1014b0 0x7f6ebc1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ebaffd700 1 -- 172.21.15.12:0/450648335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ebc103040 msgr2=0x7f6ebc1a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ebaffd700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ebc103040 0x7f6ebc1a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ebaffd700 1 -- 172.21.15.12:0/450648335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ebc1014b0 msgr2=0x7f6ebc1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ebaffd700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ebc1014b0 0x7f6ebc1995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ebaffd700 1 -- 172.21.15.12:0/450648335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb00095f0 con 0x7f6ebc1026a0 2023-12-11T20:38:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ebaffd700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 0x7f6ebc199af0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0000c00 tx=0x7f6eb0003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6eb8ff9700 1 -- 172.21.15.12:0/450648335 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb001d070 con 0x7f6ebc1026a0 2023-12-11T20:38:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc1a1630 con 0x7f6ebc1026a0 2023-12-11T20:38:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6eb8ff9700 1 -- 172.21.15.12:0/450648335 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6eb000bd30 con 0x7f6ebc1026a0 2023-12-11T20:38:16.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6eb8ff9700 1 -- 172.21.15.12:0/450648335 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0022dc0 con 0x7f6ebc1026a0 2023-12-11T20:38:16.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.542+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc1a1a60 con 0x7f6ebc1026a0 2023-12-11T20:38:16.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.543+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc068330 con 0x7f6ebc1026a0 2023-12-11T20:38:16.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.545+0000 7f6eb8ff9700 1 -- 172.21.15.12:0/450648335 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136006+0+0 (secure 0 0 0) 0x7f6eb0003ff0 con 0x7f6ebc1026a0 2023-12-11T20:38:16.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.547+0000 7f6eb8ff9700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6ea40a1480 0x7f6ea40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T20:38:16.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.547+0000 7f6eb8ff9700 1 -- 172.21.15.12:0/450648335 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6eb00ce290 con 0x7f6ebc1026a0 2023-12-11T20:38:16.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.547+0000 7f6ebb7fe700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6ea40a1480 0x7f6ea40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T20:38:16.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.548+0000 7f6ebb7fe700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6ea40a1480 0x7f6ea40a3940 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6eac005950 tx=0x7f6eac0058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T20:38:16.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.551+0000 7f6eb8ff9700 1 -- 172.21.15.12:0/450648335 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6eb00978d0 con 0x7f6ebc1026a0 2023-12-11T20:38:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:16 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2452806050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-11T20:38:16.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:16 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/2598338783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-11T20:38:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.780+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ebc10cd80 con 0x7f6ebc1026a0 2023-12-11T20:38:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.781+0000 7f6eb8ff9700 1 -- 172.21.15.12:0/450648335 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+592 (secure 0 0 0) 0x7f6eb009aef0 con 0x7f6ebc1026a0 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2124039140 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/3786645349 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/1214012838 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1620764312 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/3786645349 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/1214012838 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1991414308 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/4022688169 2023-12-12T20:06:02.927546+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3706548929 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3589244140 2023-12-12T20:05:33.970421+0000 2023-12-11T20:38:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6ea40a1480 msgr2=0x7f6ea40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6ea40a1480 0x7f6ea40a3940 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6eac005950 tx=0x7f6eac0058e0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 msgr2=0x7f6ebc199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T20:38:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 0x7f6ebc199af0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0000c00 tx=0x7f6eb0003b00 comp rx=0 tx=0).stop 2023-12-11T20:38:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 shutdown_connections 2023-12-11T20:38:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:6800/1969938581,v1:172.21.15.12:6801/1969938581] conn(0x7f6ea40a1480 0x7f6ea40a3940 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ebc1014b0 0x7f6ebc1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ebc103040 0x7f6ebc1a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 --2- 172.21.15.12:0/450648335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ebc1026a0 0x7f6ebc199af0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T20:38:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 >> 172.21.15.12:0/450648335 conn(0x7f6ebc0fca00 msgr2=0x7f6ebc107f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T20:38:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 shutdown_connections 2023-12-11T20:38:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-12-11T20:38:16.783+0000 7f6ec1dff700 1 -- 172.21.15.12:0/450648335 wait complete. 2023-12-11T20:38:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:listed 10 entries 2023-12-11T20:38:16.800 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2023-12-11T20:38:16.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:38:16.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-11T20:38:16.886 INFO:teuthology.orchestra.run:waiting for 300 2023-12-11T20:38:16.900 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[190277]: fuse finished with error 0 and tester_r 0 2023-12-11T20:38:17.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:17 smithi012 ceph-mon[128787]: pgmap v1045: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:17.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:17 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/1872954392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:38:17.331 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:17 smithi012 ceph-mon[128787]: from='client.? 172.21.15.12:0/450648335' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-11T20:38:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:17 smithi032 ceph-mon[132488]: pgmap v1045: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:17 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/1872954392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:38:17.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:17 smithi032 ceph-mon[132488]: from='client.? 172.21.15.12:0/450648335' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-11T20:38:17.551 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:17 smithi039 ceph-mon[102205]: pgmap v1045: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-11T20:38:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:17 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/1872954392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-11T20:38:17.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:17 smithi039 ceph-mon[102205]: from='client.? 172.21.15.12:0/450648335' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-11T20:38:19.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:19 smithi032 ceph-mon[132488]: pgmap v1046: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2023-12-11T20:38:19.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:19 smithi039 ceph-mon[102205]: pgmap v1046: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2023-12-11T20:38:19.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:19 smithi012 ceph-mon[128787]: pgmap v1046: 97 pgs: 97 active+clean; 9.1 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2023-12-11T20:38:21.463 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:21 smithi032 ceph-mon[132488]: pgmap v1047: 97 pgs: 97 active+clean; 9.1 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-12-11T20:38:21.552 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:21 smithi039 ceph-mon[102205]: pgmap v1047: 97 pgs: 97 active+clean; 9.1 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-12-11T20:38:21.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:21 smithi012 ceph-mon[128787]: pgmap v1047: 97 pgs: 97 active+clean; 9.1 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-12-11T20:38:22.989 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-12-11T20:38:22.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:38:22.989 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-11T20:38:23.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:38:23.056 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-12-11T20:38:23.104 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-11T20:38:23.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:38:23.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T20:38:23.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T20:38:23.178 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-12-11T20:38:23.288 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-11T20:38:23.301 INFO:tasks.cephadm:Teardown begin 2023-12-11T20:38:23.301 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/cephadm.py", line 1794, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-12-11T20:38:23.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:38:23.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:23 smithi012 ceph-mon[128787]: pgmap v1048: 97 pgs: 97 active+clean; 9.1 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-11T20:38:23.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:38:23.443 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:23 smithi032 ceph-mon[132488]: pgmap v1048: 97 pgs: 97 active+clean; 9.1 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-11T20:38:23.454 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:38:23.526 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:23 smithi039 ceph-mon[102205]: pgmap v1048: 97 pgs: 97 active+clean; 9.1 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-12-11T20:38:23.537 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-11T20:38:23.537 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-11T20:38:23.581 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-11T20:38:23.627 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-11T20:38:23.673 INFO:tasks.cephadm:Stopping all daemons... 2023-12-11T20:38:23.673 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-12-11T20:38:23.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.a 2023-12-11T20:38:24.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:23 smithi012 systemd[1]: Stopping Ceph mon.a for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:24.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:24 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-a[128763]: 2023-12-11T20:38:24.190+0000 7fd4cf6c5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:38:24.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:24 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-a[128763]: 2023-12-11T20:38:24.190+0000 7fd4cf6c5700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-12-11T20:38:24.830 INFO:journalctl@ceph.mon.a.smithi012.stdout:Dec 11 20:38:24 smithi012 bash[260846]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-a 2023-12-11T20:38:25.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.a.service' 2023-12-11T20:38:25.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:25.207 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-12-11T20:38:25.207 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-12-11T20:38:25.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.b 2023-12-11T20:38:25.713 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:25 smithi032 systemd[1]: Stopping Ceph mon.b for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:26.034 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-b[132464]: 2023-12-11T20:38:25.736+0000 7f972b002700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:38:26.034 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:25 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-b[132464]: 2023-12-11T20:38:25.736+0000 7f972b002700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-12-11T20:38:26.293 INFO:journalctl@ceph.mon.b.smithi032.stdout:Dec 11 20:38:26 smithi032 bash[176181]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-b 2023-12-11T20:38:26.601 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.b.service' 2023-12-11T20:38:26.706 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:26.706 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-12-11T20:38:26.706 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-12-11T20:38:26.706 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.c 2023-12-11T20:38:27.052 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:26 smithi039 systemd[1]: Stopping Ceph mon.c for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:27.512 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:27 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-c[102174]: 2023-12-11T20:38:27.254+0000 7f602b9ef700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:38:27.512 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:27 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-c[102174]: 2023-12-11T20:38:27.254+0000 7f602b9ef700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-12-11T20:38:27.801 INFO:journalctl@ceph.mon.c.smithi039.stdout:Dec 11 20:38:27 smithi039 bash[148042]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mon-c 2023-12-11T20:38:27.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mon.c.service' 2023-12-11T20:38:28.105 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:28.105 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-12-11T20:38:28.105 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-12-11T20:38:28.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.x 2023-12-11T20:38:28.580 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:38:28 smithi012 systemd[1]: Stopping Ceph mgr.x for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:28.941 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:38:28 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:38:28.687+0000 7f15f5fb4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:38:28.941 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:38:28 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x[129031]: 2023-12-11T20:38:28.687+0000 7f15f5fb4700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-11T20:38:29.330 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Dec 11 20:38:28 smithi012 bash[260992]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-x 2023-12-11T20:38:29.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.x.service' 2023-12-11T20:38:29.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:29.490 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-12-11T20:38:29.490 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-12-11T20:38:29.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.y 2023-12-11T20:38:29.963 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:38:29 smithi032 systemd[1]: Stopping Ceph mgr.y for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:30.547 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:38:30 smithi032 bash[176332]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-y 2023-12-11T20:38:30.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.y.service' 2023-12-11T20:38:30.804 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:38:30 smithi032 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-12-11T20:38:30.805 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:38:30 smithi032 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2023-12-11T20:38:30.805 INFO:journalctl@ceph.mgr.y.smithi032.stdout:Dec 11 20:38:30 smithi032 systemd[1]: Stopped Ceph mgr.y for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:38:30.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:30.831 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-12-11T20:38:30.832 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-12-11T20:38:30.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.z 2023-12-11T20:38:31.302 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:38:30 smithi039 systemd[1]: Stopping Ceph mgr.z for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:31.949 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:38:31 smithi039 bash[148201]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mgr-z 2023-12-11T20:38:32.163 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.z.service' 2023-12-11T20:38:32.224 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:38:31 smithi039 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-12-11T20:38:32.224 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:38:32 smithi039 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@mgr.z.service: Failed with result 'exit-code'. 2023-12-11T20:38:32.224 INFO:journalctl@ceph.mgr.z.smithi039.stdout:Dec 11 20:38:32 smithi039 systemd[1]: Stopped Ceph mgr.z for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:38:32.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:32.251 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-12-11T20:38:32.251 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-11T20:38:32.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.0 2023-12-11T20:38:32.580 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:38:32 smithi012 systemd[1]: Stopping Ceph osd.0 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:33.080 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:38:32 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-0[144052]: 2023-12-11T20:38:32.779+0000 7f2c69fc2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:38:33.091 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:38:32 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-0[144052]: 2023-12-11T20:38:32.779+0000 7f2c69fc2700 -1 osd.0 89 *** Got signal Terminated *** 2023-12-11T20:38:33.091 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:38:32 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-0[144052]: 2023-12-11T20:38:32.779+0000 7f2c69fc2700 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:38:38.830 INFO:journalctl@ceph.osd.0.smithi012.stdout:Dec 11 20:38:38 smithi012 bash[261138]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-0 2023-12-11T20:38:40.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.0.service' 2023-12-11T20:38:40.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:40.786 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-11T20:38:40.787 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-11T20:38:40.787 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.1 2023-12-11T20:38:41.213 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:38:40 smithi032 systemd[1]: Stopping Ceph osd.1 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:41.713 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:38:41 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-1[137660]: 2023-12-11T20:38:41.316+0000 7fa71f884700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:38:41.713 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:38:41 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-1[137660]: 2023-12-11T20:38:41.316+0000 7fa71f884700 -1 osd.1 89 *** Got signal Terminated *** 2023-12-11T20:38:41.713 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:38:41 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-1[137660]: 2023-12-11T20:38:41.316+0000 7fa71f884700 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:38:47.713 INFO:journalctl@ceph.osd.1.smithi032.stdout:Dec 11 20:38:47 smithi032 bash[176486]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-1 2023-12-11T20:38:49.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.1.service' 2023-12-11T20:38:49.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:49.414 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-11T20:38:49.414 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-11T20:38:49.415 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.2 2023-12-11T20:38:49.802 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:38:49 smithi039 systemd[1]: Stopping Ceph osd.2 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:50.302 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:38:49 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-2[107948]: 2023-12-11T20:38:49.959+0000 7fe9b0531700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:38:50.302 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:38:49 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-2[107948]: 2023-12-11T20:38:49.959+0000 7fe9b0531700 -1 osd.2 89 *** Got signal Terminated *** 2023-12-11T20:38:50.302 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:38:49 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-2[107948]: 2023-12-11T20:38:49.959+0000 7fe9b0531700 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:38:56.302 INFO:journalctl@ceph.osd.2.smithi039.stdout:Dec 11 20:38:56 smithi039 bash[148358]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-2 2023-12-11T20:38:58.044 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.2.service' 2023-12-11T20:38:58.134 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:38:58.135 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-11T20:38:58.135 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-11T20:38:58.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.3 2023-12-11T20:38:58.580 INFO:journalctl@ceph.osd.3.smithi012.stdout:Dec 11 20:38:58 smithi012 systemd[1]: Stopping Ceph osd.3 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:38:59.080 INFO:journalctl@ceph.osd.3.smithi012.stdout:Dec 11 20:38:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-3[152623]: 2023-12-11T20:38:58.657+0000 7f25ce2fc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:38:59.080 INFO:journalctl@ceph.osd.3.smithi012.stdout:Dec 11 20:38:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-3[152623]: 2023-12-11T20:38:58.657+0000 7f25ce2fc700 -1 osd.3 89 *** Got signal Terminated *** 2023-12-11T20:38:59.080 INFO:journalctl@ceph.osd.3.smithi012.stdout:Dec 11 20:38:58 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-3[152623]: 2023-12-11T20:38:58.657+0000 7f25ce2fc700 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:39:04.830 INFO:journalctl@ceph.osd.3.smithi012.stdout:Dec 11 20:39:04 smithi012 bash[261421]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-3 2023-12-11T20:39:06.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.3.service' 2023-12-11T20:39:06.664 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:39:06.664 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-11T20:39:06.664 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-11T20:39:06.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.4 2023-12-11T20:39:07.196 INFO:journalctl@ceph.osd.4.smithi032.stdout:Dec 11 20:39:06 smithi032 systemd[1]: Stopping Ceph osd.4 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:39:07.463 INFO:journalctl@ceph.osd.4.smithi032.stdout:Dec 11 20:39:07 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-4[145510]: 2023-12-11T20:39:07.197+0000 7fba4fdcd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:39:07.463 INFO:journalctl@ceph.osd.4.smithi032.stdout:Dec 11 20:39:07 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-4[145510]: 2023-12-11T20:39:07.197+0000 7fba4fdcd700 -1 osd.4 89 *** Got signal Terminated *** 2023-12-11T20:39:07.463 INFO:journalctl@ceph.osd.4.smithi032.stdout:Dec 11 20:39:07 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-4[145510]: 2023-12-11T20:39:07.197+0000 7fba4fdcd700 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:39:13.713 INFO:journalctl@ceph.osd.4.smithi032.stdout:Dec 11 20:39:13 smithi032 bash[176765]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-4 2023-12-11T20:39:15.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.4.service' 2023-12-11T20:39:15.313 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:39:15.313 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-11T20:39:15.314 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-11T20:39:15.314 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.5 2023-12-11T20:39:15.802 INFO:journalctl@ceph.osd.5.smithi039.stdout:Dec 11 20:39:15 smithi039 systemd[1]: Stopping Ceph osd.5 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:39:16.302 INFO:journalctl@ceph.osd.5.smithi039.stdout:Dec 11 20:39:15 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-5[116350]: 2023-12-11T20:39:15.971+0000 7f11e87db700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:39:16.302 INFO:journalctl@ceph.osd.5.smithi039.stdout:Dec 11 20:39:15 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-5[116350]: 2023-12-11T20:39:15.971+0000 7f11e87db700 -1 osd.5 89 *** Got signal Terminated *** 2023-12-11T20:39:16.302 INFO:journalctl@ceph.osd.5.smithi039.stdout:Dec 11 20:39:15 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-5[116350]: 2023-12-11T20:39:15.971+0000 7f11e87db700 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:39:22.552 INFO:journalctl@ceph.osd.5.smithi039.stdout:Dec 11 20:39:22 smithi039 bash[148635]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-5 2023-12-11T20:39:24.095 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.5.service' 2023-12-11T20:39:24.188 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:39:24.188 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-11T20:39:24.189 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-12-11T20:39:24.189 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.6 2023-12-11T20:39:24.580 INFO:journalctl@ceph.osd.6.smithi012.stdout:Dec 11 20:39:24 smithi012 systemd[1]: Stopping Ceph osd.6 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:39:25.080 INFO:journalctl@ceph.osd.6.smithi012.stdout:Dec 11 20:39:24 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-6[161096]: 2023-12-11T20:39:24.710+0000 7fd15bbec700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:39:25.080 INFO:journalctl@ceph.osd.6.smithi012.stdout:Dec 11 20:39:24 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-6[161096]: 2023-12-11T20:39:24.710+0000 7fd15bbec700 -1 osd.6 89 *** Got signal Terminated *** 2023-12-11T20:39:25.080 INFO:journalctl@ceph.osd.6.smithi012.stdout:Dec 11 20:39:24 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-6[161096]: 2023-12-11T20:39:24.710+0000 7fd15bbec700 -1 osd.6 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:39:30.830 INFO:journalctl@ceph.osd.6.smithi012.stdout:Dec 11 20:39:30 smithi012 bash[261699]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-6 2023-12-11T20:39:32.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.6.service' 2023-12-11T20:39:32.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:39:32.615 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-12-11T20:39:32.615 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-12-11T20:39:32.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.7 2023-12-11T20:39:32.963 INFO:journalctl@ceph.osd.7.smithi032.stdout:Dec 11 20:39:32 smithi032 systemd[1]: Stopping Ceph osd.7 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:39:33.463 INFO:journalctl@ceph.osd.7.smithi032.stdout:Dec 11 20:39:33 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-7[153449]: 2023-12-11T20:39:33.151+0000 7f17205e3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:39:33.463 INFO:journalctl@ceph.osd.7.smithi032.stdout:Dec 11 20:39:33 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-7[153449]: 2023-12-11T20:39:33.151+0000 7f17205e3700 -1 osd.7 89 *** Got signal Terminated *** 2023-12-11T20:39:33.463 INFO:journalctl@ceph.osd.7.smithi032.stdout:Dec 11 20:39:33 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-7[153449]: 2023-12-11T20:39:33.151+0000 7f17205e3700 -1 osd.7 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:39:39.145 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:38 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:38.881+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:39.463 INFO:journalctl@ceph.osd.7.smithi032.stdout:Dec 11 20:39:39 smithi032 bash[177039]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-7 2023-12-11T20:39:40.175 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:39 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:39.902+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:40.302 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:40 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:40.046+0000 7fb7dfe31700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:33.270917+0000 front 2023-12-11T20:38:33.270986+0000 (oldest deadline 2023-12-11T20:39:39.171358+0000) 2023-12-11T20:39:40.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:40 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:40.886+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:41.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.7.service' 2023-12-11T20:39:41.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:39:41.139 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-12-11T20:39:41.139 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-12-11T20:39:41.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.8 2023-12-11T20:39:41.393 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:41 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:41.088+0000 7fb7dfe31700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:33.270917+0000 front 2023-12-11T20:38:33.270986+0000 (oldest deadline 2023-12-11T20:39:39.171358+0000) 2023-12-11T20:39:41.393 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:41 smithi039 systemd[1]: Stopping Ceph osd.8 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:39:41.675 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:41 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:41.392+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:42.051 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:41 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:41.675+0000 7fb7e783e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:39:42.052 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:41 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:41.675+0000 7fb7e783e700 -1 osd.8 89 *** Got signal Terminated *** 2023-12-11T20:39:42.052 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:41 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:41.675+0000 7fb7e783e700 -1 osd.8 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:39:42.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:41 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:41.888+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:42.347 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:42 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:42.071+0000 7fb7dfe31700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:33.270917+0000 front 2023-12-11T20:38:33.270986+0000 (oldest deadline 2023-12-11T20:39:39.171358+0000) 2023-12-11T20:39:42.801 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:42 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:42.347+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:43.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:42 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:42.650+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:43.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:42 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:42.854+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:43.339 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:43 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:43.061+0000 7fb7dfe31700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:33.270917+0000 front 2023-12-11T20:38:33.270986+0000 (oldest deadline 2023-12-11T20:39:39.171358+0000) 2023-12-11T20:39:43.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:43 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:43.340+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:44.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:43 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:43.691+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:44.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:43 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:43.866+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:44.334 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:44 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:44.064+0000 7fb7dfe31700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:33.270917+0000 front 2023-12-11T20:38:33.270986+0000 (oldest deadline 2023-12-11T20:39:39.171358+0000) 2023-12-11T20:39:44.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:44 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:44.335+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:45.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:44 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:44.695+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:45.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:44 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:44.863+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:45.552 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:45 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:45.351+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:45.553 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:45 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:45.102+0000 7fb7dfe31700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:33.270917+0000 front 2023-12-11T20:38:33.270986+0000 (oldest deadline 2023-12-11T20:39:39.171358+0000) 2023-12-11T20:39:46.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:45 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:45.721+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:46.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:45 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:45.822+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:46.551 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:46 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8[124990]: 2023-12-11T20:39:46.070+0000 7fb7dfe31700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:33.270917+0000 front 2023-12-11T20:38:33.270986+0000 (oldest deadline 2023-12-11T20:39:39.171358+0000) 2023-12-11T20:39:46.552 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:46 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:46.305+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:47.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:46 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:46.764+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:47.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:46 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:46.797+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:47.636 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:47 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:47.314+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:48.051 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:47 smithi039 bash[148894]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-8 2023-12-11T20:39:48.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:47 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:47.731+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:48.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:47 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:47.761+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:48.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:48.354+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:48.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:48 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:48.354+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:49.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:48 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:48.769+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:49.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:48 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:48.794+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:49.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:48 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:48.794+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:49.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.8.service' 2023-12-11T20:39:49.695 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:49 smithi039 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.8.service: Succeeded. 2023-12-11T20:39:49.696 INFO:journalctl@ceph.osd.8.smithi039.stdout:Dec 11 20:39:49 smithi039 systemd[1]: Stopped Ceph osd.8 for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:39:49.696 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:49 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:49.397+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:49.696 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:49 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:49.397+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:49.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:39:49.722 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-12-11T20:39:49.722 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-12-11T20:39:49.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.9 2023-12-11T20:39:50.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:49 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:49.781+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:50.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:49 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:49.781+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.427859+0000 front 2023-12-11T20:38:45.427987+0000 (oldest deadline 2023-12-11T20:39:49.528100+0000) 2023-12-11T20:39:50.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:49 smithi012 systemd[1]: Stopping Ceph osd.9 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:39:50.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:49 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:49.775+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:50.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:49 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:49.775+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:50.580 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:50 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:50.254+0000 7f667005b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:39:50.580 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:50 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:50.254+0000 7f667005b700 -1 osd.9 89 *** Got signal Terminated *** 2023-12-11T20:39:50.580 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:50 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:50.254+0000 7f667005b700 -1 osd.9 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:39:50.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:50 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:50.395+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:50.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:50 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:50.395+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:51.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:50 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:50.744+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:51.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:50 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:50.744+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.427859+0000 front 2023-12-11T20:38:45.427987+0000 (oldest deadline 2023-12-11T20:39:49.528100+0000) 2023-12-11T20:39:51.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:50 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:50.784+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:51.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:50 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:50.785+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:51.801 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:51 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:51.434+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:51.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:51 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:51.434+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:52.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:51 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:51.744+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:52.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:51 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:51.744+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.427859+0000 front 2023-12-11T20:38:45.427987+0000 (oldest deadline 2023-12-11T20:39:49.528100+0000) 2023-12-11T20:39:52.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:51 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:51.740+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:52.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:51 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:51.740+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:52.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:52 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:52.389+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:52.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:52 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:52.389+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:53.081 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:52 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:52.723+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:53.081 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:52 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:52.723+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.427859+0000 front 2023-12-11T20:38:45.427987+0000 (oldest deadline 2023-12-11T20:39:49.528100+0000) 2023-12-11T20:39:53.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:52 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:52.790+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:53.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:52 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:52.790+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:53.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:53 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:53.423+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:53.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:53 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:53.423+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:54.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:53 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:53.753+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:54.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:53 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:53.753+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.427859+0000 front 2023-12-11T20:38:45.427987+0000 (oldest deadline 2023-12-11T20:39:49.528100+0000) 2023-12-11T20:39:54.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:53 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:53.756+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:54.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:53 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:53.756+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:54.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:54 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:54.425+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:54.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:54 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:54.425+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:54.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:54 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:54.712+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:54.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:54 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:54.712+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:55.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:54.726+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.226186+0000 front 2023-12-11T20:38:37.226418+0000 (oldest deadline 2023-12-11T20:39:41.926409+0000) 2023-12-11T20:39:55.080 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:54 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9[169038]: 2023-12-11T20:39:54.726+0000 7f6669e51700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.427859+0000 front 2023-12-11T20:38:45.427987+0000 (oldest deadline 2023-12-11T20:39:49.528100+0000) 2023-12-11T20:39:55.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:55 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:55.443+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:55.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:55 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:55.443+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:55.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:55 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:55.704+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:55.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:55 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:55.704+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:56.580 INFO:journalctl@ceph.osd.9.smithi012.stdout:Dec 11 20:39:56 smithi012 bash[261978]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-9 2023-12-11T20:39:56.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:56 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:56.472+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:56.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:56 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:56.472+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:56.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:56 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:56.712+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:56.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:56 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:56.712+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:56.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:56 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:56.712+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:51.062050+0000 front 2023-12-11T20:38:51.061772+0000 (oldest deadline 2023-12-11T20:39:56.361816+0000) 2023-12-11T20:39:57.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:57 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:57.430+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:57.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:57 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:57.430+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:58.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.9.service' 2023-12-11T20:39:58.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:39:58.197 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-12-11T20:39:58.197 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-12-11T20:39:58.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.10 2023-12-11T20:39:58.214 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:57 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:57.756+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:58.214 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:57 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:57.756+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:58.214 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:57 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:57.756+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:51.062050+0000 front 2023-12-11T20:38:51.061772+0000 (oldest deadline 2023-12-11T20:39:56.361816+0000) 2023-12-11T20:39:58.713 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:58 smithi032 systemd[1]: Stopping Ceph osd.10 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:39:58.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:58 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:58.388+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:58.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:58 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:58.388+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:59.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:58 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:58.732+0000 7f615b6a0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:39:59.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:58 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:58.732+0000 7f615b6a0700 -1 osd.10 89 *** Got signal Terminated *** 2023-12-11T20:39:59.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:58 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:58.732+0000 7f615b6a0700 -1 osd.10 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:39:59.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:58 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:58.801+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:39:59.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:58 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:58.801+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:39:59.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:58 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:58.801+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:51.062050+0000 front 2023-12-11T20:38:51.061772+0000 (oldest deadline 2023-12-11T20:39:56.361816+0000) 2023-12-11T20:39:59.801 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:59 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:59.402+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:39:59.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:59 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:59.402+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:39:59.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:39:59 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:39:59.402+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:00.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:59 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:59.764+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:40:00.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:59 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:59.764+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:40:00.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:39:59 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:39:59.764+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:51.062050+0000 front 2023-12-11T20:38:51.061772+0000 (oldest deadline 2023-12-11T20:39:56.361816+0000) 2023-12-11T20:40:00.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:00 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:00.379+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:00.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:00 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:00.379+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:00.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:00 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:00.379+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:01.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:00 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:00.805+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:40:01.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:00 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:00.805+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:40:01.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:00 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:00.805+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:51.062050+0000 front 2023-12-11T20:38:51.061772+0000 (oldest deadline 2023-12-11T20:39:56.361816+0000) 2023-12-11T20:40:01.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:01 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:01.372+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:01.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:01 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:01.372+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:01.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:01 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:01.372+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:02.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:01 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:01.766+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:40:02.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:01 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:01.766+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:40:02.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:01 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:01.766+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:51.062050+0000 front 2023-12-11T20:38:51.061772+0000 (oldest deadline 2023-12-11T20:39:56.361816+0000) 2023-12-11T20:40:02.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:02 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:02.333+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:02.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:02 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:02.333+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:02.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:02 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:02.333+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:03.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:02 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:02.764+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:40:03.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:02 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:02.764+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:40:03.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:02 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:02.764+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:51.062050+0000 front 2023-12-11T20:38:51.061772+0000 (oldest deadline 2023-12-11T20:39:56.361816+0000) 2023-12-11T20:40:03.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:03 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:03.319+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:03.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:03 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:03.319+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:03.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:03 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:03.319+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:04.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:03 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:03.725+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.758783+0000 front 2023-12-11T20:38:37.758805+0000 (oldest deadline 2023-12-11T20:39:38.858909+0000) 2023-12-11T20:40:04.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:03 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:03.725+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:42.960002+0000 front 2023-12-11T20:38:42.960043+0000 (oldest deadline 2023-12-11T20:39:48.260150+0000) 2023-12-11T20:40:04.213 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:03 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10[162154]: 2023-12-11T20:40:03.725+0000 7f6155c97700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:51.062050+0000 front 2023-12-11T20:38:51.061772+0000 (oldest deadline 2023-12-11T20:39:56.361816+0000) 2023-12-11T20:40:04.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:04 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:04.350+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:04.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:04 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:04.350+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:04.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:04 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:04.350+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:04.963 INFO:journalctl@ceph.osd.10.smithi032.stdout:Dec 11 20:40:04 smithi032 bash[177305]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-10 2023-12-11T20:40:05.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:05 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:05.306+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:05.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:05 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:05.306+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:05.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:05 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:05.306+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:06.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.10.service' 2023-12-11T20:40:06.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:06.606 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-12-11T20:40:06.606 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-12-11T20:40:06.607 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.11 2023-12-11T20:40:06.670 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:06 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:06.339+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:06.670 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:06 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:06.339+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:06.670 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:06 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:06.339+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:07.052 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:06 smithi039 systemd[1]: Stopping Ceph osd.11 for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:07.552 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:07.131+0000 7f1332cd3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:07.552 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:07.131+0000 7f1332cd3700 -1 osd.11 89 *** Got signal Terminated *** 2023-12-11T20:40:07.553 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:07.131+0000 7f1332cd3700 -1 osd.11 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-11T20:40:07.553 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:07.357+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:07.553 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:07.357+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:07.553 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:07.357+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:08.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:08 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:08.358+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:08.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:08 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:08.358+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:08.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:08 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:08.358+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:09.801 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:09 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:09.381+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:09.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:09 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:09.381+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:09.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:09 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:09.381+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:10.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:10 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:10.383+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:10.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:10 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:10.383+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:10.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:10 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:10.383+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:11.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:11 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:11.410+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2023-12-11T20:38:37.025154+0000 front 2023-12-11T20:38:37.025303+0000 (oldest deadline 2023-12-11T20:39:41.125135+0000) 2023-12-11T20:40:11.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:11 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:11.410+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.32:6804 osd.1 since back 2023-12-11T20:38:45.127292+0000 front 2023-12-11T20:38:45.127073+0000 (oldest deadline 2023-12-11T20:39:48.027239+0000) 2023-12-11T20:40:11.802 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:11 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11[133639]: 2023-12-11T20:40:11.410+0000 7f132d2ca700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.39:6804 osd.2 since back 2023-12-11T20:38:54.329208+0000 front 2023-12-11T20:38:54.329251+0000 (oldest deadline 2023-12-11T20:39:58.429278+0000) 2023-12-11T20:40:13.302 INFO:journalctl@ceph.osd.11.smithi039.stdout:Dec 11 20:40:13 smithi039 bash[149177]: ceph-732461f0-9860-11ee-95a3-87774f69a715-osd-11 2023-12-11T20:40:15.130 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@osd.11.service' 2023-12-11T20:40:15.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:15.221 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-12-11T20:40:15.221 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-12-11T20:40:15.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.a 2023-12-11T20:40:15.580 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:40:15 smithi012 systemd[1]: Stopping Ceph mds.a for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:16.080 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:40:15 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-a[177014]: 2023-12-11T20:40:15.741+0000 7fe6d66a3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:16.080 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:40:15 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-a[177014]: 2023-12-11T20:40:15.741+0000 7fe6d66a3700 -1 mds.a *** got signal Terminated *** 2023-12-11T20:40:19.323 INFO:journalctl@ceph.mds.a.smithi012.stdout:Dec 11 20:40:19 smithi012 bash[262250]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-a 2023-12-11T20:40:19.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.a.service' 2023-12-11T20:40:19.715 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:19.715 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-12-11T20:40:19.715 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-12-11T20:40:19.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.d 2023-12-11T20:40:20.080 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:40:19 smithi012 systemd[1]: Stopping Ceph mds.d for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:20.580 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:40:20 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-d[175926]: 2023-12-11T20:40:20.222+0000 7f755f82f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:20.594 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:40:20 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-d[175926]: 2023-12-11T20:40:20.222+0000 7f755f82f700 -1 mds.d *** got signal Terminated *** 2023-12-11T20:40:24.330 INFO:journalctl@ceph.mds.d.smithi012.stdout:Dec 11 20:40:24 smithi012 bash[262390]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-d 2023-12-11T20:40:24.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.d.service' 2023-12-11T20:40:24.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:24.571 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-12-11T20:40:24.571 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-12-11T20:40:24.571 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.g 2023-12-11T20:40:24.830 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:40:24 smithi012 systemd[1]: Stopping Ceph mds.g for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:25.330 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:40:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-g[176627]: 2023-12-11T20:40:25.079+0000 7fd461ae5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:25.330 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:40:25 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-g[176627]: 2023-12-11T20:40:25.079+0000 7fd461ae5700 -1 mds.g *** got signal Terminated *** 2023-12-11T20:40:28.330 INFO:journalctl@ceph.mds.g.smithi012.stdout:Dec 11 20:40:28 smithi012 bash[262534]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-g 2023-12-11T20:40:28.539 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.g.service' 2023-12-11T20:40:28.621 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:28.621 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-12-11T20:40:28.622 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-12-11T20:40:28.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.j 2023-12-11T20:40:28.830 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:40:28 smithi012 systemd[1]: Stopping Ceph mds.j for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:29.580 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:40:29 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-j[175543]: 2023-12-11T20:40:29.129+0000 7fbc258f8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:29.580 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:40:29 smithi012 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-j[175543]: 2023-12-11T20:40:29.129+0000 7fbc258f8700 -1 mds.j *** got signal Terminated *** 2023-12-11T20:40:33.265 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:40:33 smithi012 bash[262679]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-j 2023-12-11T20:40:33.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.j.service' 2023-12-11T20:40:33.560 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:40:33 smithi012 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.j.service: Succeeded. 2023-12-11T20:40:33.561 INFO:journalctl@ceph.mds.j.smithi012.stdout:Dec 11 20:40:33 smithi012 systemd[1]: Stopped Ceph mds.j for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:40:33.582 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:33.583 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-12-11T20:40:33.583 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-12-11T20:40:33.583 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.b 2023-12-11T20:40:33.963 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:40:33 smithi032 systemd[1]: Stopping Ceph mds.b for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:34.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:40:34 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:40:34.110+0000 7f064bf37700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:34.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:40:34 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b[169117]: 2023-12-11T20:40:34.110+0000 7f064bf37700 -1 mds.b *** got signal Terminated *** 2023-12-11T20:40:40.463 INFO:journalctl@ceph.mds.b.smithi032.stdout:Dec 11 20:40:40 smithi032 bash[177584]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-b 2023-12-11T20:40:40.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.b.service' 2023-12-11T20:40:40.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:40.659 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-12-11T20:40:40.659 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-12-11T20:40:40.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.e 2023-12-11T20:40:40.963 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:40:40 smithi032 systemd[1]: Stopping Ceph mds.e for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:41.463 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:40:41 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-e[168438]: 2023-12-11T20:40:41.167+0000 7f1c6cec3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:41.463 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:40:41 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-e[168438]: 2023-12-11T20:40:41.167+0000 7f1c6cec3700 -1 mds.e *** got signal Terminated *** 2023-12-11T20:40:43.713 INFO:journalctl@ceph.mds.e.smithi032.stdout:Dec 11 20:40:43 smithi032 bash[177731]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-e 2023-12-11T20:40:43.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.e.service' 2023-12-11T20:40:43.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:43.986 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-12-11T20:40:43.986 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-12-11T20:40:43.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.h 2023-12-11T20:40:44.213 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:40:44 smithi032 systemd[1]: Stopping Ceph mds.h for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:44.963 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:40:44 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-h[168779]: 2023-12-11T20:40:44.493+0000 7f154b29b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:44.963 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:40:44 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-h[168779]: 2023-12-11T20:40:44.493+0000 7f154b29b700 -1 mds.h *** got signal Terminated *** 2023-12-11T20:40:46.963 INFO:journalctl@ceph.mds.h.smithi032.stdout:Dec 11 20:40:46 smithi032 bash[177876]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-h 2023-12-11T20:40:47.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.h.service' 2023-12-11T20:40:47.297 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:47.297 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-12-11T20:40:47.297 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-12-11T20:40:47.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.k 2023-12-11T20:40:47.463 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:40:47 smithi032 systemd[1]: Stopping Ceph mds.k for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:48.213 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:40:47 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-k[168099]: 2023-12-11T20:40:47.801+0000 7f63f3a85700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:48.213 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:40:47 smithi032 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-k[168099]: 2023-12-11T20:40:47.801+0000 7f63f3a85700 -1 mds.k *** got signal Terminated *** 2023-12-11T20:40:50.213 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:40:49 smithi032 bash[178022]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-k 2023-12-11T20:40:50.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.k.service' 2023-12-11T20:40:50.581 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:40:50 smithi032 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.k.service: Succeeded. 2023-12-11T20:40:50.582 INFO:journalctl@ceph.mds.k.smithi032.stdout:Dec 11 20:40:50 smithi032 systemd[1]: Stopped Ceph mds.k for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:40:50.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:50.605 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-12-11T20:40:50.605 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-12-11T20:40:50.605 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.c 2023-12-11T20:40:51.052 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:40:50 smithi039 systemd[1]: Stopping Ceph mds.c for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:51.553 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:40:51 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-c[139728]: 2023-12-11T20:40:51.132+0000 7fb39fd0e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:51.554 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:40:51 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-c[139728]: 2023-12-11T20:40:51.132+0000 7fb39fd0e700 -1 mds.c *** got signal Terminated *** 2023-12-11T20:40:54.552 INFO:journalctl@ceph.mds.c.smithi039.stdout:Dec 11 20:40:54 smithi039 bash[149447]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-c 2023-12-11T20:40:54.584 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.c.service' 2023-12-11T20:40:54.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:54.670 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-12-11T20:40:54.670 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-12-11T20:40:54.670 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.f 2023-12-11T20:40:55.052 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:40:54 smithi039 systemd[1]: Stopping Ceph mds.f for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:40:55.552 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:40:55 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-f[139382]: 2023-12-11T20:40:55.165+0000 7fe5eb3f4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:40:55.552 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:40:55 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-f[139382]: 2023-12-11T20:40:55.165+0000 7fe5eb3f4700 -1 mds.f *** got signal Terminated *** 2023-12-11T20:40:59.052 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:40:58 smithi039 bash[149592]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-f 2023-12-11T20:40:59.233 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.f.service' 2023-12-11T20:40:59.301 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:40:59 smithi039 systemd[1]: ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.f.service: Succeeded. 2023-12-11T20:40:59.301 INFO:journalctl@ceph.mds.f.smithi039.stdout:Dec 11 20:40:59 smithi039 systemd[1]: Stopped Ceph mds.f for 732461f0-9860-11ee-95a3-87774f69a715. 2023-12-11T20:40:59.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:40:59.316 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-12-11T20:40:59.316 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-12-11T20:40:59.316 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.i 2023-12-11T20:40:59.552 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:40:59 smithi039 systemd[1]: Stopping Ceph mds.i for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:41:00.302 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:40:59 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:40:59.839+0000 7f82495e2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:41:00.302 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:40:59 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i[140064]: 2023-12-11T20:40:59.839+0000 7f82495e2700 -1 mds.i *** got signal Terminated *** 2023-12-11T20:41:06.552 INFO:journalctl@ceph.mds.i.smithi039.stdout:Dec 11 20:41:06 smithi039 bash[149740]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-i 2023-12-11T20:41:06.587 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.i.service' 2023-12-11T20:41:06.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:41:06.672 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-12-11T20:41:06.673 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-12-11T20:41:06.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.l 2023-12-11T20:41:07.052 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:41:06 smithi039 systemd[1]: Stopping Ceph mds.l for 732461f0-9860-11ee-95a3-87774f69a715... 2023-12-11T20:41:07.552 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:41:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-l[139038]: 2023-12-11T20:41:07.172+0000 7f86e45fd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-11T20:41:07.552 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:41:07 smithi039 ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-l[139038]: 2023-12-11T20:41:07.172+0000 7f86e45fd700 -1 mds.l *** got signal Terminated *** 2023-12-11T20:41:10.757 INFO:journalctl@ceph.mds.l.smithi039.stdout:Dec 11 20:41:10 smithi039 bash[149893]: ceph-732461f0-9860-11ee-95a3-87774f69a715-mds-l 2023-12-11T20:41:11.068 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-732461f0-9860-11ee-95a3-87774f69a715@mds.l.service' 2023-12-11T20:41:11.153 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-11T20:41:11.153 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-12-11T20:41:11.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 732461f0-9860-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-11T20:41:11.608 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:41:14.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 732461f0-9860-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-11T20:41:15.413 INFO:teuthology.orchestra.run.smithi032.stdout:Deleting cluster with fsid: 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:41:18.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 732461f0-9860-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-11T20:41:19.377 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:41:22.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:41:22.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:41:22.887 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-11T20:41:22.960 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-11T20:41:22.962 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi012/crash 2023-12-11T20:41:22.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash -- . 2023-12-11T20:41:23.076 INFO:teuthology.orchestra.run.smithi012.stderr:tar: /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-11T20:41:23.077 INFO:teuthology.orchestra.run.smithi012.stderr:tar: Error is not recoverable: exiting now 2023-12-11T20:41:23.080 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi032/crash 2023-12-11T20:41:23.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash -- . 2023-12-11T20:41:23.162 INFO:teuthology.orchestra.run.smithi032.stderr:tar: /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-11T20:41:23.162 INFO:teuthology.orchestra.run.smithi032.stderr:tar: Error is not recoverable: exiting now 2023-12-11T20:41:23.165 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi039/crash 2023-12-11T20:41:23.166 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash -- . 2023-12-11T20:41:23.342 INFO:teuthology.orchestra.run.smithi039.stderr:tar: /var/lib/ceph/732461f0-9860-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-11T20:41:23.342 INFO:teuthology.orchestra.run.smithi039.stderr:tar: Error is not recoverable: exiting now 2023-12-11T20:41:23.343 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-11T20:41:23.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-12-11T20:41:23.427 INFO:teuthology.orchestra.run.smithi012.stderr:grep: /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph.log: No such file or directory 2023-12-11T20:41:23.432 INFO:tasks.cephadm:Compressing logs... 2023-12-11T20:41:23.432 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-11T20:41:23.437 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-11T20:41:23.441 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-11T20:41:23.506 INFO:teuthology.orchestra.run.smithi032.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-11T20:41:23.506 INFO:teuthology.orchestra.run.smithi032.stderr:: No such file or directory 2023-12-11T20:41:23.506 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.10.log 2023-12-11T20:41:23.508 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.h.log 2023-12-11T20:41:23.509 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.10.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-11T20:41:23.509 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.e.log 2023-12-11T20:41:23.510 INFO:teuthology.orchestra.run.smithi012.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose : No such file or directory-- 2023-12-11T20:41:23.510 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/cephadm.log 2023-12-11T20:41:23.510 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.4.log 2023-12-11T20:41:23.511 INFO:teuthology.orchestra.run.smithi039.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-11T20:41:23.511 INFO:teuthology.orchestra.run.smithi039.stderr:: No such file or directory 2023-12-11T20:41:23.512 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.1.log 2023-12-11T20:41:23.512 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.5.log 2023-12-11T20:41:23.513 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.2.log 2023-12-11T20:41:23.513 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.k.log 2023-12-11T20:41:23.514 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.5.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-11T20:41:23.514 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.11.log 2023-12-11T20:41:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-12-11T20:41:23.515 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-11T20:41:23.516 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.z.log 2023-12-11T20:41:23.517 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.0.log 2023-12-11T20:41:23.517 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.8.log 2023-12-11T20:41:23.517 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.g.log 2023-12-11T20:41:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.a.log 2023-12-11T20:41:23.519 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.f.log 2023-12-11T20:41:23.519 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.6.log 2023-12-11T20:41:23.520 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.k.log: /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.7.log 2023-12-11T20:41:23.520 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.3.log 2023-12-11T20:41:23.520 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.c.log 2023-12-11T20:41:23.521 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.b.log 2023-12-11T20:41:23.521 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.d.log 2023-12-11T20:41:23.522 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.i.log 2023-12-11T20:41:23.523 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.x.log 2023-12-11T20:41:23.523 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.9.log 2023-12-11T20:41:23.524 INFO:teuthology.orchestra.run.smithi012.stderr: 94.6% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.g.log.gz 2023-12-11T20:41:23.525 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.7.log: 94.5% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.k.log.gz 2023-12-11T20:41:23.525 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.x.log: 94.6% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.a.log.gz 2023-12-11T20:41:23.525 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-11T20:41:23.526 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.c.log: /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.c.log 2023-12-11T20:41:23.526 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.j.log 2023-12-11T20:41:23.528 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.b.log 2023-12-11T20:41:23.528 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.y.log 2023-12-11T20:41:23.528 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.a.log 2023-12-11T20:41:23.528 INFO:teuthology.orchestra.run.smithi039.stderr: 93.4% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.z.log.gz 2023-12-11T20:41:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-11T20:41:23.529 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.d.log.gz 2023-12-11T20:41:23.531 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.c.log: /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.l.log 2023-12-11T20:41:23.533 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.a.log: 94.6% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.j.log.gz 2023-12-11T20:41:23.545 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.l.log: 91.1% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-11T20:41:23.549 INFO:teuthology.orchestra.run.smithi039.stderr: 94.5% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.l.log.gz 2023-12-11T20:41:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.b.log: /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.b.log: /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.y.log: 91.1% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-11T20:41:23.560 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.y.log.gz 2023-12-11T20:41:23.731 INFO:teuthology.orchestra.run.smithi012.stderr: 91.1% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-11T20:41:23.732 INFO:teuthology.orchestra.run.smithi032.stderr: 94.6% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.e.log.gz 2023-12-11T20:41:23.829 INFO:teuthology.orchestra.run.smithi039.stderr: 94.3% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.f.log.gz 2023-12-11T20:41:23.835 INFO:teuthology.orchestra.run.smithi012.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-11T20:41:23.982 INFO:teuthology.orchestra.run.smithi039.stderr: 94.4% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.c.log.gz 2023-12-11T20:41:24.079 INFO:teuthology.orchestra.run.smithi039.stderr: 92.0% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.c.log.gz 2023-12-11T20:41:24.286 INFO:teuthology.orchestra.run.smithi012.stderr: 90.3% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mgr.x.log.gz 2023-12-11T20:41:24.352 INFO:teuthology.orchestra.run.smithi032.stderr: 91.8% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.b.log.gz 2023-12-11T20:41:25.702 INFO:teuthology.orchestra.run.smithi032.stderr: 93.8% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.h.log.gz 2023-12-11T20:41:26.603 INFO:teuthology.orchestra.run.smithi039.stderr: 93.5% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.i.log.gz 2023-12-11T20:41:27.456 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mds.b.log.gz 2023-12-11T20:41:27.545 INFO:teuthology.orchestra.run.smithi012.stderr: 90.4% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-mon.a.log.gz 2023-12-11T20:42:06.382 INFO:teuthology.orchestra.run.smithi039.stderr: 90.9% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.8.log.gz 2023-12-11T20:42:08.030 INFO:teuthology.orchestra.run.smithi039.stderr: 90.9% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.2.log.gz 2023-12-11T20:42:09.143 INFO:teuthology.orchestra.run.smithi032.stderr: 90.9% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.4.log.gz 2023-12-11T20:42:09.164 INFO:teuthology.orchestra.run.smithi032.stderr: 91.0% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.7.log.gz 2023-12-11T20:42:09.978 INFO:teuthology.orchestra.run.smithi039.stderr: 91.0% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.11.log.gz 2023-12-11T20:42:10.715 INFO:teuthology.orchestra.run.smithi039.stderr: 90.9% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.5.log.gz 2023-12-11T20:42:10.719 INFO:teuthology.orchestra.run.smithi039.stderr: 2023-12-11T20:42:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:real 0m47.236s 2023-12-11T20:42:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:user 2m52.277s 2023-12-11T20:42:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m12.587s 2023-12-11T20:42:12.830 INFO:teuthology.orchestra.run.smithi032.stderr: 90.9% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.10.log.gz 2023-12-11T20:42:17.298 INFO:teuthology.orchestra.run.smithi032.stderr: 90.9% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.1.log.gz 2023-12-11T20:42:17.301 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-12-11T20:42:17.301 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m53.823s 2023-12-11T20:42:17.301 INFO:teuthology.orchestra.run.smithi032.stderr:user 3m7.483s 2023-12-11T20:42:17.301 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m13.475s 2023-12-11T20:42:25.854 INFO:teuthology.orchestra.run.smithi012.stderr: 90.9% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.9.log.gz 2023-12-11T20:42:32.386 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.6.log.gz 2023-12-11T20:42:44.058 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.3.log.gz 2023-12-11T20:42:55.337 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/732461f0-9860-11ee-95a3-87774f69a715/ceph-osd.0.log.gz 2023-12-11T20:45:12.423 INFO:teuthology.orchestra.run.smithi012.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-12-11T20:45:12.426 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-12-11T20:45:12.426 INFO:teuthology.orchestra.run.smithi012.stderr:real 3m48.952s 2023-12-11T20:45:12.426 INFO:teuthology.orchestra.run.smithi012.stderr:user 5m33.872s 2023-12-11T20:45:12.426 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m39.263s 2023-12-11T20:45:12.427 INFO:tasks.cephadm:Archiving logs... 2023-12-11T20:45:12.428 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi012/log 2023-12-11T20:45:12.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-11T20:45:59.807 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi032/log 2023-12-11T20:45:59.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-11T20:46:30.982 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi039/log 2023-12-11T20:46:30.983 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-11T20:47:00.329 INFO:tasks.cephadm:Removing cluster... 2023-12-11T20:47:00.329 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 732461f0-9860-11ee-95a3-87774f69a715 --force 2023-12-11T20:47:00.933 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:47:02.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 732461f0-9860-11ee-95a3-87774f69a715 --force 2023-12-11T20:47:02.804 INFO:teuthology.orchestra.run.smithi032.stdout:Deleting cluster with fsid: 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:47:04.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 732461f0-9860-11ee-95a3-87774f69a715 --force 2023-12-11T20:47:04.732 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: 732461f0-9860-11ee-95a3-87774f69a715 2023-12-11T20:47:06.176 INFO:tasks.cephadm:Removing cephadm ... 2023-12-11T20:47:06.176 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-11T20:47:06.227 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-11T20:47:06.278 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-11T20:47:06.322 INFO:tasks.cephadm:Teardown complete 2023-12-11T20:47:06.323 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-11T20:47:06.334 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-12-11T20:47:06.335 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-11T20:47:06.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-11T20:47:06.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-11T20:47:06.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-11T20:47:06.505 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-11T20:47:06.516 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-11T20:47:06.517 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-11T20:47:06.522 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-11T20:47:06.527 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-11T20:47:06.561 INFO:teuthology.orchestra.run.smithi012.stderr:bash: ntpq: command not found 2023-12-11T20:47:06.565 INFO:teuthology.orchestra.run.smithi032.stderr:bash: ntpq: command not found 2023-12-11T20:47:06.568 INFO:teuthology.orchestra.run.smithi039.stderr:bash: ntpq: command not found 2023-12-11T20:47:06.574 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-11T20:47:06.574 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2023-12-11T20:47:06.574 INFO:teuthology.orchestra.run.smithi032.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +2432us[+2432us] +/- 99ms 2023-12-11T20:47:06.574 INFO:teuthology.orchestra.run.smithi032.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -1304us[-1277us] +/- 56ms 2023-12-11T20:47:06.574 INFO:teuthology.orchestra.run.smithi032.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -19us[ -19us] +/- 65ms 2023-12-11T20:47:06.574 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:47:06.576 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-11T20:47:06.576 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2023-12-11T20:47:06.576 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +2468us[+2474us] +/- 99ms 2023-12-11T20:47:06.576 INFO:teuthology.orchestra.run.smithi039.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -1280us[-1274us] +/- 56ms 2023-12-11T20:47:06.576 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -22us[ -16us] +/- 65ms 2023-12-11T20:47:06.576 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:47:06.589 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-11T20:47:06.589 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-12-11T20:47:06.590 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 +2443us[+2443us] +/- 99ms 2023-12-11T20:47:06.590 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -1306us[-1295us] +/- 56ms 2023-12-11T20:47:06.590 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -41us[ -31us] +/- 65ms 2023-12-11T20:47:06.590 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T20:47:06.591 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-11T20:47:06.603 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-11T20:47:06.603 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-11T20:47:06.614 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-11T20:47:06.869 DEBUG:teuthology.orchestra.run.smithi032:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-11T20:47:07.048 DEBUG:teuthology.orchestra.run.smithi039:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-11T20:47:07.222 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-11T20:47:07.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T20:47:07.301 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-11T20:47:07.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T20:47:07.378 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-11T20:47:07.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T20:47:07.454 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-11T20:47:07.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-11T20:47:07.481 INFO:teuthology.task.internal:Duration was 3586.555425 seconds 2023-12-11T20:47:07.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-11T20:47:07.501 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-11T20:47:07.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-11T20:47:07.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-11T20:47:07.511 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-11T20:47:07.626 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-11T20:47:07.630 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-11T20:47:07.669 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-11T20:47:07.889 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-11T20:47:07.889 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2023-12-11T20:47:07.889 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-11T20:47:07.948 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2023-12-11T20:47:07.949 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-11T20:47:08.009 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2023-12-11T20:47:08.009 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-11T20:47:08.069 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-11T20:47:08.069 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-11T20:47:08.074 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-11T20:47:08.078 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-11T20:47:08.195 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-11T20:47:08.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-11T20:47:08.200 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-11T20:47:08.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-11T20:47:08.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-11T20:47:08.384 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-11T20:47:08.385 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-11T20:47:08.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-11T20:47:08.526 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-11T20:47:08.598 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-11T20:47:08.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-11T20:47:08.620 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-11T20:47:08.624 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-11T20:47:08.689 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2023-12-11T20:47:08.693 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2023-12-11T20:47:08.698 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2023-12-11T20:47:08.735 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-11T20:47:08.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T20:47:08.777 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-11T20:47:08.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T20:47:08.819 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-11T20:47:08.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T20:47:08.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-11T20:47:08.875 INFO:teuthology.task.internal:Transferring archived files... 2023-12-11T20:47:08.876 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi012 2023-12-11T20:47:08.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-11T20:47:08.963 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi032 2023-12-11T20:47:08.963 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-11T20:47:09.045 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249/remote/smithi039 2023-12-11T20:47:09.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-11T20:47:09.128 INFO:teuthology.task.internal:Removing archive directory... 2023-12-11T20:47:09.128 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-11T20:47:09.133 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-11T20:47:09.137 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-11T20:47:09.181 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-11T20:47:09.194 INFO:teuthology.task.internal:Not uploading archives. 2023-12-11T20:47:09.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-11T20:47:09.208 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-11T20:47:09.209 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-11T20:47:09.217 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-11T20:47:09.221 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-11T20:47:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 11 20:47 /home/ubuntu/cephtest 2023-12-11T20:47:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 11 20:47 /home/ubuntu/cephtest 2023-12-11T20:47:09.265 INFO:teuthology.orchestra.run.smithi039.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 11 20:47 /home/ubuntu/cephtest 2023-12-11T20:47:09.268 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-11T20:47:09.282 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-11T20:47:09.297 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-12-11T20:47:09.297 INFO:teuthology.nuke:Checking targets against current locks 2023-12-11T20:47:09.329 DEBUG:teuthology.nuke:shortname: smithi012 2023-12-11T20:47:09.329 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T20:47:09.354 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:36:36.161215', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T20:47:09.358 DEBUG:teuthology.nuke:shortname: smithi032 2023-12-11T20:47:09.358 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T20:47:09.383 DEBUG:teuthology.nuke:shortname: smithi039 2023-12-11T20:47:09.383 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T20:47:09.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:36:36.157134', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T20:47:09.418 INFO:teuthology.orchestra.console.smithi012:Power off 2023-12-11T20:47:09.418 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T20:47:09.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 19:36:36.158923', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T20:47:09.442 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-12-11T20:47:09.442 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:09.459 INFO:teuthology.orchestra.console.smithi032:Power off 2023-12-11T20:47:09.460 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T20:47:09.470 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-11T20:47:09.484 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-12-11T20:47:09.484 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:09.500 INFO:teuthology.orchestra.console.smithi039:Power off 2023-12-11T20:47:09.500 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T20:47:09.509 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-12-11T20:47:09.522 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2023-12-11T20:47:09.522 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:09.546 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-12-11T20:47:13.471 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:13.511 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:13.548 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:13.581 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-11T20:47:13.621 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-12-11T20:47:13.657 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-12-11T20:47:17.586 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:17.622 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:17.658 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:17.696 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-11T20:47:17.735 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-12-11T20:47:17.769 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-12-11T20:47:17.837 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-12-11T20:47:21.700 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:21.770 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T20:47:21.810 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-12-11T20:47:21.880 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-12-11T20:47:21.910 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-12-11T20:47:21.981 INFO:teuthology.orchestra.console.smithi039:Power off completed 2023-12-11T20:47:22.086 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} duration: 3586.555424928665 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default mon.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.c-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: scheduled_rishabh@teuthology status: fail success: false 2023-12-11T20:47:22.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T20:47:22.163 INFO:teuthology.run:FAIL